-- Logs begin at Sun 2022-07-31 00:10:32 UTC, end at Sun 2022-07-31 02:45:42 UTC. -- Jul 31 00:55:04.726598 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jul 31 00:55:04.740366 n-d-master-1 devstack@n-api.service[104007]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 31 00:55:04.743132 n-d-master-1 devstack@n-api.service[104007]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 31 00:55:04 2022] *** Jul 31 00:55:04.743132 n-d-master-1 devstack@n-api.service[104007]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 31 00:55:04.743132 n-d-master-1 devstack@n-api.service[104007]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 31 00:55:04.743132 n-d-master-1 devstack@n-api.service[104007]: nodename: n-d-master-1 Jul 31 00:55:04.743132 n-d-master-1 devstack@n-api.service[104007]: machine: x86_64 Jul 31 00:55:04.743132 n-d-master-1 devstack@n-api.service[104007]: clock source: unix Jul 31 00:55:04.743132 n-d-master-1 devstack@n-api.service[104007]: pcre jit disabled Jul 31 00:55:04.743132 n-d-master-1 devstack@n-api.service[104007]: detected number of CPU cores: 4 Jul 31 00:55:04.743132 n-d-master-1 devstack@n-api.service[104007]: current working directory: / Jul 31 00:55:04.743132 n-d-master-1 devstack@n-api.service[104007]: detected binary path: /usr/bin/uwsgi-core Jul 31 00:55:04.743132 n-d-master-1 devstack@n-api.service[104007]: your processes number limit is 47680 Jul 31 00:55:04.743132 n-d-master-1 devstack@n-api.service[104007]: your memory page size is 4096 bytes Jul 31 00:55:04.743132 n-d-master-1 devstack@n-api.service[104007]: detected max file descriptor number: 2048 Jul 31 00:55:04.743132 n-d-master-1 devstack@n-api.service[104007]: lock engine: pthread robust mutexes Jul 31 00:55:04.744763 n-d-master-1 devstack@n-api.service[104007]: thunder lock: enabled Jul 31 00:55:04.744763 n-d-master-1 devstack@n-api.service[104007]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 31 00:55:04.744763 n-d-master-1 devstack@n-api.service[104007]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 31 00:55:04.813080 n-d-master-1 devstack@n-api.service[104007]: Python main interpreter initialized at 0x55f4f96719c0 Jul 31 00:55:04.813080 n-d-master-1 devstack@n-api.service[104007]: python threads support enabled Jul 31 00:55:04.813080 n-d-master-1 devstack@n-api.service[104007]: your server socket listen backlog is limited to 100 connections Jul 31 00:55:04.813080 n-d-master-1 devstack@n-api.service[104007]: your mercy for graceful operations on workers is 90 seconds Jul 31 00:55:04.813704 n-d-master-1 devstack@n-api.service[104007]: mapped 403077 bytes (393 KB) for 2 cores Jul 31 00:55:04.813704 n-d-master-1 devstack@n-api.service[104007]: *** Operational MODE: preforking *** Jul 31 00:55:04.814174 n-d-master-1 devstack@n-api.service[104007]: *** uWSGI is running in multiple interpreter mode *** Jul 31 00:55:04.814174 n-d-master-1 devstack@n-api.service[104007]: spawned uWSGI master process (pid: 104007) Jul 31 00:55:04.819554 n-d-master-1 devstack@n-api.service[104007]: spawned uWSGI worker 1 (pid: 104069, cores: 1) Jul 31 00:55:04.819554 n-d-master-1 devstack@n-api.service[104007]: spawned uWSGI worker 2 (pid: 104070, cores: 1) Jul 31 00:55:04.819554 n-d-master-1 devstack@n-api.service[104007]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 31 00:55:04.814392 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jul 31 00:55:05.581162 n-d-master-1 devstack@n-api.service[104070]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 31 00:55:05.658540 n-d-master-1 devstack@n-api.service[104069]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 31 00:55:06.708598 n-d-master-1 devstack@n-api.service[104070]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 00:55:06.708598 n-d-master-1 devstack@n-api.service[104070]: from cryptography.utils import int_from_bytes Jul 31 00:55:06.709539 n-d-master-1 devstack@n-api.service[104070]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 00:55:06.709539 n-d-master-1 devstack@n-api.service[104070]: from cryptography.utils import int_from_bytes Jul 31 00:55:06.755081 n-d-master-1 devstack@n-api.service[104069]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 00:55:06.755081 n-d-master-1 devstack@n-api.service[104069]: from cryptography.utils import int_from_bytes Jul 31 00:55:06.756046 n-d-master-1 devstack@n-api.service[104069]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 00:55:06.756046 n-d-master-1 devstack@n-api.service[104069]: from cryptography.utils import int_from_bytes Jul 31 00:55:09.336357 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 00:55:09.337229 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 00:55:09.337229 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 00:55:09.337527 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 00:55:09.337746 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 00:55:09.338134 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.338464 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.338789 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.339125 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.339479 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.339827 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.340158 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.340478 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.340806 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.341092 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.341240 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 00:55:09.341918 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.342064 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 00:55:09.342209 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.342338 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 00:55:09.342463 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.342600 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 00:55:09.342750 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.342883 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 00:55:09.343006 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.343140 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.343276 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.343276 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.343604 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.343604 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.343841 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.343973 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.344108 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.344241 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.344378 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.344541 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.344993 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.345179 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.345380 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.345569 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.345762 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.345951 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.346135 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.346587 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.346793 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.346987 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.347184 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.347376 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.347516 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.347664 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.347829 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.347993 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.348153 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.348311 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.348461 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.348630 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.348783 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.349182 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.349397 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.349617 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.349827 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.350034 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.350254 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.350485 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.350706 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.350922 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.351131 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.351265 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.351504 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.351709 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.351878 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.352026 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.352172 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.352324 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.352482 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.352644 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.352813 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.352967 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.353112 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.353112 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.353404 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.353543 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.353702 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.353702 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.353985 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.354129 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.354275 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.354410 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.354540 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.354679 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.354897 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.355039 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.355181 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.355865 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.356031 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.356258 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.356403 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.356553 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.356760 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.356914 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.357064 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.357216 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.357366 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.357516 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.357678 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.357817 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.357960 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.358118 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.358260 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.358408 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.358558 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.358705 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.358865 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.359006 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.359174 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.359321 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.359514 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.359847 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.360008 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.360165 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.360321 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.360472 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.360623 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.360768 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.360918 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.361068 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.361216 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.361358 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.361513 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.361670 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.361871 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.362016 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.362157 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.362300 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.362438 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.362438 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.362842 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.362995 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.363148 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.363287 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.363469 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.363623 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.363760 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.363898 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.364042 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.364198 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.364370 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.364511 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.364666 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.364813 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.364950 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.365088 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.365246 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.365386 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.365525 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.365666 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.365814 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.365954 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.366106 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.366246 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.366392 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.366539 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.366675 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.366827 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.366971 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.367110 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.367264 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.367445 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.367603 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.367756 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.367898 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.368039 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.368192 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.368338 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.368493 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.368645 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.368783 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.368918 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.369068 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.369212 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.369361 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.369518 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.369735 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.369969 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.370157 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.370315 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.370458 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.370620 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.370759 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.370897 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.371143 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.371309 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.371569 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.371711 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.371869 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.372090 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.372236 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.372375 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.372539 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.372680 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.372820 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.372959 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.373099 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.373250 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.373415 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.373561 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.373695 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.373834 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.373997 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.374136 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.374287 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.374429 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.374568 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.374722 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.374722 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.374991 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.375154 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.375306 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.375539 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.375698 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.375846 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.375998 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.376156 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.376305 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.376462 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.376604 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.376742 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.376955 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.377100 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.377257 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.377414 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.377549 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.377696 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.377850 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.378022 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.378165 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.378305 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.378467 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.378611 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.378770 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.378917 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.379064 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.379214 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.379427 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.379573 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.379740 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.379952 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.380154 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.380340 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.380485 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.380641 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.380799 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.380941 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.381082 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.381224 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.381366 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.381502 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.381652 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.381795 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.381935 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.382084 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.382284 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.382443 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.382594 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.382735 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.382883 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.383023 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.383173 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.383330 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.383494 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.383647 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.383790 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.383935 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.384077 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.384242 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.384242 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.384520 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.384678 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.384819 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.384971 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.385126 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.385271 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.385440 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.385589 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.385731 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.385883 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.386024 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.386165 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.386304 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.386446 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.386601 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.387292 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.387514 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.387678 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 00:55:09.387822 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.387977 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.388119 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.388280 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.388422 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.388576 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.388723 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.388869 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.389012 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.389178 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.389325 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.389467 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.389623 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.389765 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.390019 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.390165 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.390360 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.390552 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.390705 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.390888 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.391050 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.391205 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.391383 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.391526 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.391669 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.391805 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.391963 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.392102 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.392263 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.392457 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.392617 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.392771 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.392923 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.393066 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.393066 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.393352 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.393494 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.393625 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.393783 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.393937 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.394086 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.394240 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.394389 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.394543 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.394765 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.394914 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.395060 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.395211 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.395391 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.395563 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.395713 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.395860 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.396023 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.396180 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.396324 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.396481 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.396624 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.396775 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.396932 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.397071 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.397209 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.397423 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.397569 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.397712 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.397855 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.398012 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.398166 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.398325 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.398483 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.398624 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.398776 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.398920 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.399073 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.399215 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.399455 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.399601 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.399760 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.399906 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.400060 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.400264 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.400410 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.400619 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.400810 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.400958 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.401121 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.401264 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.401407 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.401566 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.401704 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.401845 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.402002 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.402143 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.402360 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.402984 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.403112 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.403258 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.403425 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.403586 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.403738 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.403878 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.404036 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.404192 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.404339 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.404483 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.404624 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.404775 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.404914 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.405077 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.405284 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.405432 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.405578 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.405731 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.405876 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.406031 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.406191 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.406344 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.406495 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.406638 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.406782 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.406941 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.407086 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.407223 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.407419 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.407568 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.407732 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.407877 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.408016 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.408168 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.408312 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.408450 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.408612 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.408755 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.408897 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.409050 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.409191 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.409333 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.409489 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.409641 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.409792 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.409940 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.410091 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.410247 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.410447 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.410447 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.410708 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.410908 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.411110 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.411268 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.411439 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.411439 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.411718 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.411718 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.411988 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.411988 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.412268 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.412268 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.412553 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.412699 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.412841 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.412841 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.413274 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.413434 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.413577 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.413721 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.413874 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.414016 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.414160 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.414361 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.414505 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.414646 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.414799 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.414952 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.415096 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.415235 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.415472 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.415638 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.415798 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.415943 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.416101 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.416254 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.416397 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.416553 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.416709 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.416853 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.416997 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.416997 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.417261 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.417426 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.417632 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.417780 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.417946 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.418084 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.418238 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.418397 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.418544 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.418683 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.418825 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.418969 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.419112 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.419264 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.419428 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.419597 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.419741 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.419886 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.420025 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.420183 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.420347 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.420492 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.420623 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.420757 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.420912 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.421135 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.421336 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.421483 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.421626 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.421766 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.421921 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.422075 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.422224 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.422376 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.422523 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.422674 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.422824 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.422959 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.423101 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.423243 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.423500 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.423650 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.423821 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.423973 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.424160 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.424286 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.424428 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.424568 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.424724 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.424852 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.424994 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.425281 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.425447 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.425625 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.425770 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.425924 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.426073 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.426224 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.426386 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.426550 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.426699 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.426846 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.426996 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.427145 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.427290 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.427552 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.427715 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.427872 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.428018 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.428173 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.428318 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.428474 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.428622 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.428780 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.428923 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.429067 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.429213 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.429381 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.429536 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.429677 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.429815 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.429970 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.430132 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.430132 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.430367 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.430509 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.430648 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.430777 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.430777 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.431022 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.431174 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.431174 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.431431 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.431560 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.431560 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.431824 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.431968 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.431968 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.432243 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.432398 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.432558 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.432703 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.432703 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.432964 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.433118 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.433118 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.433414 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.433619 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.433619 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.433880 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.434032 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.434032 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.434321 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.434465 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.434627 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.434787 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.434787 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.435076 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.435245 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.435245 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.435570 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.435698 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.435698 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.435974 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.436124 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.436124 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.436389 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.436533 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.436686 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.436842 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.436842 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.437117 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.437259 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.437259 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.437522 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.437648 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.437648 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.437899 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.438054 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.438054 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.438339 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.438493 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.438636 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.438779 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.438779 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.439042 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.439204 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.439204 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.439607 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.439752 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.439752 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.440036 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.440182 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.440334 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.440477 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.440477 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.440742 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.441056 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.441056 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.441349 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.441543 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.441543 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.441854 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.442010 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.442164 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.442308 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.442451 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.442603 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.442603 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.442879 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.443025 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.443025 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.443286 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.443447 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.443653 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.443786 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.443990 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.444199 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.444351 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.444640 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.444811 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.444964 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.445193 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.445355 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.445544 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.445723 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.445874 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.446156 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.446303 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.446461 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.446752 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.446906 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.447051 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.447281 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.447462 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.447678 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.447825 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.447970 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.448285 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.448450 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.448605 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.448831 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.448994 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.449719 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.449894 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.450058 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.450347 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.450497 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.450641 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.450883 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.451102 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.451252 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.451483 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.451641 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.451891 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.452040 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.452204 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.452485 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.452639 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.452842 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.453014 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.453192 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.453754 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.453907 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.454065 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.454279 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.454445 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.454689 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.454851 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.454996 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.455290 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.455545 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.455689 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.455857 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.456002 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.456223 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.456368 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.456522 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.456819 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.456989 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.457147 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.457349 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.457500 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.457728 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.457888 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.458031 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.458332 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.458482 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.458647 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.458963 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.459199 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.459392 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.459586 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.459811 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.459975 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.460196 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.460357 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.460502 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.460802 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.460954 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.461097 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.461332 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.461509 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.461700 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.461903 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.462052 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.462304 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.462463 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.462620 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.462911 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.463062 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.463204 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.463491 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.463673 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.463831 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.464028 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.464230 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.464432 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.464589 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.464749 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.465601 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.465762 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.465906 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.466144 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.466296 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.466516 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.466686 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.466831 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.467132 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.467284 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.467536 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.467678 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.467847 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.468052 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.468199 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.468344 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.468653 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.468804 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.468962 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.469178 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.469331 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.469541 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.469685 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.469842 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.470140 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.470291 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.470463 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.470671 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.470823 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.471089 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.471231 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.471400 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.471676 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.471826 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.472042 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.472266 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.472419 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.472665 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.472812 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.472955 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.473262 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.473431 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.473588 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.473795 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.473948 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.474188 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.474391 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.474562 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.474796 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.474947 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.475091 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.475313 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.475515 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.475736 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.475917 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.476069 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.476336 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.476485 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.476644 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.476930 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.477094 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.477250 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.477477 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.477627 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.477883 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.478031 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.478208 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.478518 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.478683 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.478827 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.479040 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.479190 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.479448 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.479622 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.479791 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.480057 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.480218 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.480373 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.480655 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.480820 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.480997 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.481185 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.481348 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.481612 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.481761 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.481905 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.482168 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.482322 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.482516 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.482665 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.482808 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.483135 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.483288 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.483556 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.483700 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.483856 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.484058 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.484206 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.484364 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.484666 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.484827 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.484974 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.485190 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.485397 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.485691 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.485846 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.486001 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.486217 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.486367 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.486606 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.486765 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.486911 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.487204 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.487393 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.487539 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.487751 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.487921 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.488223 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.488377 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.488560 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.488759 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.488925 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.489176 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.489323 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.489466 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.489745 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.489910 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.490069 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.490280 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.490444 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.490677 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.490824 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.490969 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.491274 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.491512 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.491655 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.491831 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.491982 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.492222 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.492447 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.492645 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.492845 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.492996 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.493257 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.493420 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.493678 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.493829 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.493973 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.494275 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.494441 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.494599 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.494821 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.495026 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.495225 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.495398 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.495561 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.495858 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.496010 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.496204 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.496415 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.496566 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.496848 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.497020 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.497165 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.497395 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.497547 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.497769 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.497915 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.498073 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.498400 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.498572 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.498729 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.498951 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.499116 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.499464 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.499634 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.499792 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.500108 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.500258 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.500423 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.500662 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.500815 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.501039 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.501196 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.501340 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.501639 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.501791 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.501934 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.502150 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.502302 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.502522 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.502722 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.502871 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.503138 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.503287 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.503476 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.503708 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.503873 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.504083 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.504240 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.504386 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.504686 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.504905 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.505053 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.505219 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.505417 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.505614 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.505791 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.505956 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.506222 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.506384 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.506528 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.506785 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.507048 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.507195 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.507333 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.507539 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.507750 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.507898 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.508061 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.508384 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.508577 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.508736 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.508893 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.509049 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.509209 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.509358 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.509592 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.509753 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.509929 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.510130 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.510296 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.510577 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.510726 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.510881 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.511133 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.511302 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.511533 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.512272 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.512402 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.512688 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.512892 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.513056 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.513242 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.513394 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.513585 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.513787 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.513939 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.514187 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.514387 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.514534 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.514783 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.514931 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.515086 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.515313 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.515596 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.515767 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.515910 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.516054 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.516331 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.516481 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.516633 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.516877 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.517032 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.517214 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.517416 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.517568 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.517858 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.518033 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.518180 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.518453 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.518607 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.518812 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.518974 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.519148 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.519484 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.519639 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.519801 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.520017 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.520283 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.520429 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.520567 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.520713 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.521024 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.521177 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.521337 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.521554 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.521711 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.521945 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.522174 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.522328 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.522557 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.522718 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.522912 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.523175 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.523327 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.523690 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.523843 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.524092 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.524238 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.524383 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.524672 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.524841 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.524987 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.525191 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.525344 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.525602 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.525755 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.525914 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.526176 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.526329 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.526502 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.526703 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.526853 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.527132 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.527964 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.528115 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.528332 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.528491 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.528701 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.528851 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.529025 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.529338 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.529507 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.529653 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.529863 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.530017 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.530306 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.530462 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.530605 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.530849 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.531003 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.531223 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.531550 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.531726 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.531872 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.532091 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.532243 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.532470 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.532670 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.532821 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.533085 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.533303 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.533465 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.533610 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.533753 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.533995 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.534158 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.534317 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.534611 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.534930 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.534930 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.535216 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.535403 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.535581 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.535726 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.535928 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.536212 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.536442 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.536773 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.536926 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.537072 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.537377 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.537554 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.537738 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.537898 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.538072 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.538384 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.538550 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.538696 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.538906 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.539069 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.539320 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.539499 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.539645 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.539941 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.540118 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.540268 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.540468 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.540620 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.540854 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.541001 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.541161 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.541446 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.541602 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.541746 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.541987 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.542139 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.542456 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.542623 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.542979 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.543177 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.543325 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.543646 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.543849 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.543999 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.544239 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.544393 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.544577 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.544775 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.544928 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.545202 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.545431 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.545597 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.545815 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.545975 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.546121 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.546423 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.546575 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.546720 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.546956 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.547123 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.547323 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.547543 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.547693 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.547957 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.548120 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.548276 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.548557 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.548711 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.548867 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.549098 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.549266 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.549457 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.549618 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.549762 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.550067 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.550219 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.550375 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.550628 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.550792 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.550991 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.551170 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.551421 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.551632 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.551827 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.552023 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.552206 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.552388 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.552587 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.552784 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.552967 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.553151 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.553398 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.553601 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.553797 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.553989 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.554176 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.554362 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.554539 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.554730 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.554923 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.555225 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.555447 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.555631 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.555829 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.556013 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.556209 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.556396 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.556591 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.556883 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.557085 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.557388 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.557570 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.557753 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.557974 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.558173 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.558355 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.558597 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.558791 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.558971 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.559147 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.559391 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.559613 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.559821 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.560002 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.560179 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.560417 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.560600 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.560816 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.561008 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.561188 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.561365 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.561562 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.561744 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.561947 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.562137 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.562361 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.562573 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.562754 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.562943 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.563140 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.563369 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.563570 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.563752 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.563932 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.564121 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.564330 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.564532 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.564711 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.564904 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.565122 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.565321 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.565513 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.565693 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.565890 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.566069 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.566253 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.566444 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.566640 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.566812 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.567006 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.568244 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.568409 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.568570 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.568570 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.568855 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.568999 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.569140 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.569357 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.569357 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.569626 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.569774 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.569929 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.570086 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.570086 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.570366 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.570510 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.570510 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.570777 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.570934 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.571087 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.571286 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.571455 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.571664 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.571834 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.571992 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.572228 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.572392 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.572636 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.572787 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.572951 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.573237 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.573387 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.573531 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.573768 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.573941 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.574682 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.574882 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.575034 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.575293 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.575505 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.575650 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.575920 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.576071 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.576214 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.576449 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.576602 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.576804 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.576976 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.577122 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.577404 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.577608 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.577794 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.577982 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.578133 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.578277 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.578768 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.578933 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.579129 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.579290 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.579456 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.579756 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.579906 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.580052 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.580341 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.580515 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.580672 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.580878 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.581030 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.581222 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.581403 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.581622 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.581878 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.582027 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.582185 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.582411 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.582576 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.582800 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.582948 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.583107 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.583438 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.583589 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.583752 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.583981 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.584147 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.584373 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.584520 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.584664 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.584968 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.585121 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.585294 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.585501 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.585654 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.585904 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.586054 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.586199 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.586597 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.586757 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.587021 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.587198 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.587557 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.587707 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.587891 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.588088 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.588244 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.588531 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.588681 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.588859 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.589122 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.589276 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.589496 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.589714 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.590501 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.590704 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.590867 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.591014 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.591282 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.591550 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.591748 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.591906 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.592053 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.592257 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.592416 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.592562 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.592873 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.593039 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.593234 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.593428 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.593593 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.593868 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.594044 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.594195 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.594517 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.594785 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.594934 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.595072 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.595203 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.595485 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.595635 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.595837 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.596108 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.596264 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.596492 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.596641 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.596823 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.597146 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.597451 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.597608 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.597752 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.597987 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.598196 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 00:55:09.598504 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.598924 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.599380 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.599783 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.600190 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.600609 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.601015 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.601421 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.601827 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.602246 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.602664 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.603088 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.603574 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.603988 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.604407 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.604817 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.605225 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.605712 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.606124 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.606556 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.606971 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.607415 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.607838 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.608253 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.608687 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.609099 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.609507 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.609914 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.610326 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.610735 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.611143 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.611605 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.612041 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.612465 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.612872 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.613278 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.613687 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.614365 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.614757 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.615188 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.615655 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.616071 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.616479 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.616894 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.617309 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.617717 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.618114 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.618519 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.618951 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.619417 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.619803 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.620215 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.620613 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.621679 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.622087 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.622879 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.623327 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.623763 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.624185 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.624602 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.625011 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.625413 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.625836 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.626237 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.626785 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.627447 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.627815 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.628168 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.628519 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.628876 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.629312 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.629721 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.630127 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.630532 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.630963 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.631432 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.631802 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.632210 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.632640 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.633046 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.633451 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.633850 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.634247 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.634654 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.635052 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.635502 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.635925 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.636344 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.637324 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.637730 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.638198 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.638626 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.639029 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.639493 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.639914 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.640320 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.640737 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.641155 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.641563 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.642004 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.642413 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.643107 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.643574 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.644010 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.644444 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.644866 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.645268 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.645668 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.646101 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.646518 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.646929 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.647376 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.647779 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.648208 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.648622 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.649027 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.649463 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.649868 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.650273 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.650685 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.651089 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.651533 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.651945 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.652393 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.652809 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.653261 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.653679 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.654097 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.654505 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.654921 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.655359 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.655787 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.656221 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.656638 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.657056 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.657494 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.657917 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.658325 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.658863 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.659274 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.659730 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.660147 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.660563 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.660989 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.661408 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.661821 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.662235 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.662641 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.663074 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.663555 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.663981 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.664401 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.664800 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.665210 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.665620 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.666032 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.666475 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.666887 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.667288 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.667736 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.668180 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.668582 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.668980 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.669385 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.669787 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.670241 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.670642 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.671044 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.671486 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.671887 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.672285 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.672694 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.673109 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.673509 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.673907 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.674304 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.674702 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.675114 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.675596 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.676024 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.676438 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.676852 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.677271 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.677689 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.678092 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.678506 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.679532 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.679990 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.680407 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.680839 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.681254 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.681660 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.682082 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.682491 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.682909 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.683328 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.684335 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.684760 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.685171 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.685600 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.686013 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.686430 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.686871 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.687279 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.687740 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.688158 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.688567 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.693402 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.694134 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.694538 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.694958 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.697046 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.697539 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.697992 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.698427 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.698883 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.700875 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.701331 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.701776 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.702214 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.702664 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.703080 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.704008 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.704439 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.707787 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.708357 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.708789 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 00:55:09.709137 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 00:55:09.751376 n-d-master-1 devstack@n-api.service[104070]: INFO dbcounter [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] Registered counter for database nova_api Jul 31 00:55:09.774057 n-d-master-1 devstack@n-api.service[104070]: DEBUG oslo_db.sqlalchemy.engines [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 00:55:09.781942 n-d-master-1 devstack@n-api.service[104070]: DEBUG dbcounter [-] [104070] Writer thread running {{(pid=104070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 00:55:09.845301 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.context [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b79bbab3-22fe-4aca-b591-999750c84479(cell1) {{(pid=104070) load_cells /opt/stack/nova/nova/context.py:464}} Jul 31 00:55:09.849530 n-d-master-1 devstack@n-api.service[104070]: DEBUG oslo_concurrency.lockutils [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 00:55:09.851192 n-d-master-1 devstack@n-api.service[104070]: DEBUG oslo_concurrency.lockutils [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 00:55:09.852075 n-d-master-1 devstack@n-api.service[104070]: DEBUG oslo_concurrency.lockutils [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 00:55:09.854163 n-d-master-1 devstack@n-api.service[104070]: DEBUG oslo_concurrency.lockutils [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 00:55:09.856369 n-d-master-1 devstack@n-api.service[104070]: INFO dbcounter [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] Registered counter for database nova_cell0 Jul 31 00:55:09.862621 n-d-master-1 devstack@n-api.service[104070]: INFO dbcounter [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] Registered counter for database nova_cell1 Jul 31 00:55:09.873178 n-d-master-1 devstack@n-api.service[104070]: DEBUG oslo_db.sqlalchemy.engines [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 00:55:09.874693 n-d-master-1 devstack@n-api.service[104070]: DEBUG oslo_db.sqlalchemy.engines [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 00:55:09.879143 n-d-master-1 devstack@n-api.service[104069]: INFO dbcounter [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] Registered counter for database nova_api Jul 31 00:55:09.882325 n-d-master-1 devstack@n-api.service[104070]: DEBUG dbcounter [-] [104070] Writer thread running {{(pid=104070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 00:55:09.884803 n-d-master-1 devstack@n-api.service[104070]: DEBUG dbcounter [-] [104070] Writer thread running {{(pid=104070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 00:55:09.903525 n-d-master-1 devstack@n-api.service[104069]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 00:55:09.911932 n-d-master-1 devstack@n-api.service[104069]: DEBUG dbcounter [-] [104069] Writer thread running {{(pid=104069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 00:55:09.971416 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.context [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b79bbab3-22fe-4aca-b591-999750c84479(cell1) {{(pid=104069) load_cells /opt/stack/nova/nova/context.py:464}} Jul 31 00:55:09.975759 n-d-master-1 devstack@n-api.service[104069]: DEBUG oslo_concurrency.lockutils [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 00:55:09.977442 n-d-master-1 devstack@n-api.service[104069]: DEBUG oslo_concurrency.lockutils [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 00:55:09.978321 n-d-master-1 devstack@n-api.service[104069]: DEBUG oslo_concurrency.lockutils [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 00:55:09.981057 n-d-master-1 devstack@n-api.service[104069]: DEBUG oslo_concurrency.lockutils [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 00:55:09.983502 n-d-master-1 devstack@n-api.service[104069]: INFO dbcounter [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] Registered counter for database nova_cell0 Jul 31 00:55:09.989686 n-d-master-1 devstack@n-api.service[104069]: INFO dbcounter [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] Registered counter for database nova_cell1 Jul 31 00:55:09.998666 n-d-master-1 devstack@n-api.service[104069]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 00:55:10.004466 n-d-master-1 devstack@n-api.service[104069]: DEBUG dbcounter [-] [104069] Writer thread running {{(pid=104069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 00:55:10.009260 n-d-master-1 devstack@n-api.service[104069]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 00:55:10.052645 n-d-master-1 devstack@n-api.service[104070]: INFO dbcounter [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] Registered counter for database nova_cell0 Jul 31 00:55:10.064945 n-d-master-1 devstack@n-api.service[104070]: DEBUG oslo_db.sqlalchemy.engines [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 00:55:10.070692 n-d-master-1 devstack@n-api.service[104070]: DEBUG dbcounter [-] [104070] Writer thread running {{(pid=104070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 00:55:10.155874 n-d-master-1 devstack@n-api.service[104069]: DEBUG dbcounter [-] [104069] Writer thread running {{(pid=104069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 00:55:10.172314 n-d-master-1 devstack@n-api.service[104069]: INFO dbcounter [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] Registered counter for database nova_cell0 Jul 31 00:55:10.184959 n-d-master-1 devstack@n-api.service[104069]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 00:55:10.192539 n-d-master-1 devstack@n-api.service[104069]: DEBUG dbcounter [-] [104069] Writer thread running {{(pid=104069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 00:55:10.424240 n-d-master-1 devstack@n-api.service[104070]: WARNING keystonemiddleware.auth_token [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 00:55:10.431759 n-d-master-1 devstack@n-api.service[104070]: WARNING keystonemiddleware.auth_token [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 00:55:10.644024 n-d-master-1 devstack@n-api.service[104069]: WARNING keystonemiddleware.auth_token [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 00:55:10.651890 n-d-master-1 devstack@n-api.service[104069]: WARNING keystonemiddleware.auth_token [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 00:55:10.773802 n-d-master-1 devstack@n-api.service[104070]: WARNING keystonemiddleware.auth_token [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 00:55:10.779910 n-d-master-1 devstack@n-api.service[104070]: WARNING keystonemiddleware.auth_token [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 00:55:10.785317 n-d-master-1 devstack@n-api.service[104070]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f4f96719c0 pid: 104070 (default app) Jul 31 00:55:10.787560 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:55:10.788760 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001874 Jul 31 00:55:10.789180 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Sun Jul 31 00:55:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:55:10.995760 n-d-master-1 devstack@n-api.service[104069]: WARNING keystonemiddleware.auth_token [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 00:55:11.002479 n-d-master-1 devstack@n-api.service[104069]: WARNING keystonemiddleware.auth_token [None req-8ce69a91-35ae-4fc1-b15c-2117e8d2c800 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 00:55:11.007841 n-d-master-1 devstack@n-api.service[104069]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f4f96719c0 pid: 104069 (default app) Jul 31 00:56:31.892672 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:56:31.894951 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002670 Jul 31 00:56:31.896940 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 930 bytes} [Sun Jul 31 00:56:31 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:56:31.909497 n-d-master-1 devstack@n-api.service[104069]: DEBUG dbcounter [-] [104069] Writing DB stats nova_api:SELECT=3 {{(pid=104069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:56:31.910811 n-d-master-1 devstack@n-api.service[104069]: DEBUG dbcounter [-] [104069] Writing DB stats nova_cell0:SELECT=3 {{(pid=104069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:56:31.911875 n-d-master-1 devstack@n-api.service[104069]: DEBUG dbcounter [-] [104069] Writing DB stats nova_cell1:SELECT=3 {{(pid=104069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:56:31.913049 n-d-master-1 devstack@n-api.service[104069]: DEBUG dbcounter [-] [104069] Writing DB stats nova_cell0:SELECT=3 {{(pid=104069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:56:32.832977 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-474912f5-de38-46e7-802b-a6c5059aadaf admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:56:32.866822 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-474912f5-de38-46e7-802b-a6c5059aadaf admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.962674 Jul 31 00:56:32.867503 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1291 bytes} [Sun Jul 31 00:56:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 00:56:35.130571 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:56:35.131815 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-477dcb1a-cc68-43bc-a3f0-40221d43bcdc None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Jul 31 00:56:35.132412 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 930 bytes} [Sun Jul 31 00:56:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:56:35.590595 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-1f7d5607-6032-42d9-8c75-f215fbfe99d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "vcpus": 1, "disk": 1, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:56:35.611059 n-d-master-1 devstack@n-api.service[104069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 00:56:35.611059 n-d-master-1 devstack@n-api.service[104069]: warnings.warn(msg) Jul 31 00:56:35.642240 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-1f7d5607-6032-42d9-8c75-f215fbfe99d6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.502384 Jul 31 00:56:35.642810 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1282 bytes} [Sun Jul 31 00:56:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 00:56:35.657185 n-d-master-1 devstack@n-api.service[104070]: DEBUG dbcounter [-] [104070] Writing DB stats nova_api:SELECT=3 {{(pid=104070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:56:35.657937 n-d-master-1 devstack@n-api.service[104070]: DEBUG dbcounter [-] [104070] Writing DB stats nova_cell1:SELECT=3 {{(pid=104070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:56:35.659199 n-d-master-1 devstack@n-api.service[104070]: DEBUG dbcounter [-] [104070] Writing DB stats nova_cell0:SELECT=3 {{(pid=104070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:56:35.660633 n-d-master-1 devstack@n-api.service[104070]: DEBUG dbcounter [-] [104070] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:56:35.888581 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-3b8b554a-943f-4c46-bd83-d3f816f5d8a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:56:35.894099 n-d-master-1 devstack@n-api.service[104070]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 00:56:35.894099 n-d-master-1 devstack@n-api.service[104070]: warnings.warn(msg) Jul 31 00:56:35.964435 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-3b8b554a-943f-4c46-bd83-d3f816f5d8a1 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.313359 Jul 31 00:56:35.965196 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1335 bytes} [Sun Jul 31 00:56:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 00:56:38.234629 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-1f7d5607-6032-42d9-8c75-f215fbfe99d6 admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:56:38.235592 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-1f7d5607-6032-42d9-8c75-f215fbfe99d6 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 31 00:56:38.236269 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 930 bytes} [Sun Jul 31 00:56:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:56:39.035050 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-67a04674-ee3a-470a-b011-012034540779 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "vcpus": 1, "id": "d1"}} {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:56:39.054507 n-d-master-1 devstack@n-api.service[104070]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 00:56:39.054507 n-d-master-1 devstack@n-api.service[104070]: warnings.warn(msg) Jul 31 00:56:39.073235 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-67a04674-ee3a-470a-b011-012034540779 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.830612 Jul 31 00:56:39.073936 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1282 bytes} [Sun Jul 31 00:56:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 00:56:39.085957 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-26278f30-9cad-4f75-8230-cff4efa0bdea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:56:39.089671 n-d-master-1 devstack@n-api.service[104069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 00:56:39.089671 n-d-master-1 devstack@n-api.service[104069]: warnings.warn(msg) Jul 31 00:56:39.127391 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-26278f30-9cad-4f75-8230-cff4efa0bdea admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045027 Jul 31 00:56:39.143852 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1335 bytes} [Sun Jul 31 00:56:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 00:56:41.581519 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-67a04674-ee3a-470a-b011-012034540779 admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:56:41.582484 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-67a04674-ee3a-470a-b011-012034540779 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 31 00:56:41.583098 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 930 bytes} [Sun Jul 31 00:56:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:56:42.176030 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-dff4a2d8-47fa-4020-95bc-5c4a42b939ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:56:42.203936 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-dff4a2d8-47fa-4020-95bc-5c4a42b939ec admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.613729 Jul 31 00:56:42.204890 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1282 bytes} [Sun Jul 31 00:56:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 00:56:42.218568 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-2c26f67d-4d4c-4f48-9ba2-0c8c76f1dbaa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:56:42.258702 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-2c26f67d-4d4c-4f48-9ba2-0c8c76f1dbaa admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044277 Jul 31 00:56:42.268314 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1335 bytes} [Sun Jul 31 00:56:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 00:56:44.607595 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-dff4a2d8-47fa-4020-95bc-5c4a42b939ec admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:56:44.608767 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-dff4a2d8-47fa-4020-95bc-5c4a42b939ec admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 Jul 31 00:56:44.620369 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 930 bytes} [Sun Jul 31 00:56:44 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:56:45.074444 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-a0e6e6a0-5be2-44d5-95c4-48929c24f987 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "disk": 10, "name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:56:45.099373 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-a0e6e6a0-5be2-44d5-95c4-48929c24f987 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.483884 Jul 31 00:56:45.100195 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1282 bytes} [Sun Jul 31 00:56:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 00:56:45.114337 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-a8de1dd7-1276-4402-a0d9-f97b3afa7579 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:56:45.140527 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-a8de1dd7-1276-4402-a0d9-f97b3afa7579 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030144 Jul 31 00:56:45.156013 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1335 bytes} [Sun Jul 31 00:56:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 00:56:47.509978 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-a0e6e6a0-5be2-44d5-95c4-48929c24f987 admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:56:47.511140 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-a0e6e6a0-5be2-44d5-95c4-48929c24f987 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001634 Jul 31 00:56:47.512189 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 930 bytes} [Sun Jul 31 00:56:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:56:48.131230 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-ad9d8cce-d0bc-4c14-a183-49cf95f13283 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 20, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:56:48.152044 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-ad9d8cce-d0bc-4c14-a183-49cf95f13283 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.627701 Jul 31 00:56:48.152653 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1282 bytes} [Sun Jul 31 00:56:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 00:56:48.167296 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-9c876de6-a657-42cd-bd38-7c04752f28cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:56:48.205474 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-9c876de6-a657-42cd-bd38-7c04752f28cc admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043445 Jul 31 00:56:48.223377 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1335 bytes} [Sun Jul 31 00:56:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 00:56:50.717167 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-ad9d8cce-d0bc-4c14-a183-49cf95f13283 admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:56:50.718767 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-ad9d8cce-d0bc-4c14-a183-49cf95f13283 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002026 Jul 31 00:56:50.731741 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 930 bytes} [Sun Jul 31 00:56:50 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 00:56:51.483196 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-5c72a52e-0e82-4eba-af4e-2114681ed7b4 admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:56:51.523107 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-5c72a52e-0e82-4eba-af4e-2114681ed7b4 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.796984 Jul 31 00:56:51.523688 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1291 bytes} [Sun Jul 31 00:56:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 00:56:53.854622 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-ad9d8cce-d0bc-4c14-a183-49cf95f13283 admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:56:53.856090 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-ad9d8cce-d0bc-4c14-a183-49cf95f13283 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 Jul 31 00:56:53.856609 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 930 bytes} [Sun Jul 31 00:56:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:56:54.383890 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-6f61efa8-d020-4fe8-8848-a0617fd2e1d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:56:54.406973 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-6f61efa8-d020-4fe8-8848-a0617fd2e1d8 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.541723 Jul 31 00:56:54.407737 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1282 bytes} [Sun Jul 31 00:56:53 2022] POST /compute/v2.1/flavors => generated 402 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 00:56:54.423488 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-b36094c8-03cd-4175-a366-6ff0a83bc078 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:56:54.456633 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-b36094c8-03cd-4175-a366-6ff0a83bc078 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038015 Jul 31 00:56:54.457345 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1332 bytes} [Sun Jul 31 00:56:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 00:56:56.777485 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-6f61efa8-d020-4fe8-8848-a0617fd2e1d8 admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:56:56.779011 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-6f61efa8-d020-4fe8-8848-a0617fd2e1d8 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002058 Jul 31 00:56:56.779683 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 930 bytes} [Sun Jul 31 00:56:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:56:57.214385 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-1d39c471-2e32-46e6-9d53-457bd59416d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "id": "2", "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:56:57.234610 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-1d39c471-2e32-46e6-9d53-457bd59416d0 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.449041 Jul 31 00:56:57.235380 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1282 bytes} [Sun Jul 31 00:56:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 00:56:57.248413 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-b9fb24a2-273a-444d-b24a-6cf640dd164a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:56:57.274355 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-b9fb24a2-273a-444d-b24a-6cf640dd164a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030262 Jul 31 00:56:57.275102 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1332 bytes} [Sun Jul 31 00:56:57 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 00:56:59.489570 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-1d39c471-2e32-46e6-9d53-457bd59416d0 admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:56:59.490697 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-1d39c471-2e32-46e6-9d53-457bd59416d0 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Jul 31 00:56:59.491365 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 930 bytes} [Sun Jul 31 00:56:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:56:59.902664 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-44fe8c6f-9d00-48ad-b3f2-11c3f87294a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40}} {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:56:59.920917 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-44fe8c6f-9d00-48ad-b3f2-11c3f87294a5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.423754 Jul 31 00:56:59.921501 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1282 bytes} [Sun Jul 31 00:56:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 00:56:59.933945 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-d267f4e1-b51e-48d6-85f2-e57b227396e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:56:59.957932 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-d267f4e1-b51e-48d6-85f2-e57b227396e1 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028291 Jul 31 00:56:59.958489 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1332 bytes} [Sun Jul 31 00:56:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 00:57:02.198144 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-44fe8c6f-9d00-48ad-b3f2-11c3f87294a5 admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:02.199174 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-44fe8c6f-9d00-48ad-b3f2-11c3f87294a5 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 31 00:57:02.199606 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 930 bytes} [Sun Jul 31 00:57:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:57:02.615694 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-b4e074aa-06f0-4c58-ad8d-fae13fab19c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "vcpus": 4, "id": "4", "name": "m1.large", "os-flavor-access:is_public": true}} {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:57:02.621365 n-d-master-1 devstack@n-api.service[104069]: DEBUG dbcounter [-] [104069] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:57:02.636702 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-b4e074aa-06f0-4c58-ad8d-fae13fab19c6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.430858 Jul 31 00:57:02.637436 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1282 bytes} [Sun Jul 31 00:57:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 00:57:02.649104 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-af61d903-74c2-48a5-949e-6a3bdb0dabf4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:57:02.677087 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-af61d903-74c2-48a5-949e-6a3bdb0dabf4 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031104 Jul 31 00:57:02.677674 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1332 bytes} [Sun Jul 31 00:57:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 00:57:04.936759 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-b4e074aa-06f0-4c58-ad8d-fae13fab19c6 admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:04.937778 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-b4e074aa-06f0-4c58-ad8d-fae13fab19c6 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 31 00:57:04.938182 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 930 bytes} [Sun Jul 31 00:57:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:57:05.420788 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-2bb3b3a6-2f81-4e5d-acb2-58615a9054ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "disk": 160, "vcpus": 8, "id": "5", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:57:05.441028 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-2bb3b3a6-2f81-4e5d-acb2-58615a9054ce admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.496630 Jul 31 00:57:05.441577 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1282 bytes} [Sun Jul 31 00:57:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 00:57:05.454068 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-87e93c1f-cc35-41ad-9cfa-65ba7cb6bff3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:57:05.482063 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-87e93c1f-cc35-41ad-9cfa-65ba7cb6bff3 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032100 Jul 31 00:57:05.483679 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1332 bytes} [Sun Jul 31 00:57:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 00:57:28.706922 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-2bb3b3a6-2f81-4e5d-acb2-58615a9054ce admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:28.707987 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-2bb3b3a6-2f81-4e5d-acb2-58615a9054ce admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 31 00:57:28.708425 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 930 bytes} [Sun Jul 31 00:57:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:57:28.720415 n-d-master-1 devstack@n-api.service[104069]: DEBUG dbcounter [-] [104069] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=104069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:57:29.130347 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-59f73e22-74a2-4a60-bfb4-4d7929c0b9d9 admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:29.150275 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-59f73e22-74a2-4a60-bfb4-4d7929c0b9d9 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.434572 Jul 31 00:57:29.150696 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1291 bytes} [Sun Jul 31 00:57:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 00:57:30.226418 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-2bb3b3a6-2f81-4e5d-acb2-58615a9054ce admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:30.227610 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-2bb3b3a6-2f81-4e5d-acb2-58615a9054ce admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 31 00:57:30.228017 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Sun Jul 31 00:57:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:57:30.846672 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-98f41d8c-aef1-42f5-9155-e7d72d1700de admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:30.853845 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.wsgi [None req-98f41d8c-aef1-42f5-9155-e7d72d1700de admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-98f41d8c-aef1-42f5-9155-e7d72d1700de admin admin] Request method failure captured: Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: Accept: application/json Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: Accept-Encoding: gzip, deflate Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: Connection: keep-alive Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: Content-Length: 0 Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: Host: 10.222.0.45 Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: Openstack-Api-Version: compute 2.90 Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: Openstack-System-Scope: None Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: User-Agent: python-novaclient Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: X-Auth-Token: gAAAAABi5dN6jKCBt9JFibVNJRuGQ-NoUnNQga6OyH0CmAF0qDS5R0kAiQzx3rOxAgG_N5bFdQZuec15cZ-jVdjdola8hidasEpw-PKOjLf_P-1JTXZX-7oOFfUIrfH3CMgpwZhtuIBSxNMKFeeIcvBndp4JY2SYT2eok1Vy_-1D44BQ4Z5uv_Q Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: X-Domain-Id: None Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: X-Domain-Name: None Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: X-Identity-Status: Confirmed Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: X-Is-Admin-Project: True Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: X-Project-Domain-Id: default Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: X-Project-Domain-Name: Default Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: X-Project-Id: 53fe8c9f1dcd40fe86bca3695051ce6e Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: X-Project-Name: admin Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: X-Role: member,admin,reader Jul 31 00:57:30.857750 n-d-master-1 devstack@n-api.service[104069]: X-Roles: member,admin,reader Jul 31 00:57:30.859611 n-d-master-1 devstack@n-api.service[104069]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_53fe8c9f1dcd40fe86bca3695051ce6e", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 00:57:30.859611 n-d-master-1 devstack@n-api.service[104069]: X-Tenant: admin Jul 31 00:57:30.859611 n-d-master-1 devstack@n-api.service[104069]: X-Tenant-Id: 53fe8c9f1dcd40fe86bca3695051ce6e Jul 31 00:57:30.859611 n-d-master-1 devstack@n-api.service[104069]: X-Tenant-Name: admin Jul 31 00:57:30.859611 n-d-master-1 devstack@n-api.service[104069]: X-User: admin Jul 31 00:57:30.859611 n-d-master-1 devstack@n-api.service[104069]: X-User-Domain-Id: default Jul 31 00:57:30.859611 n-d-master-1 devstack@n-api.service[104069]: X-User-Domain-Name: Default Jul 31 00:57:30.859611 n-d-master-1 devstack@n-api.service[104069]: X-User-Id: faccc743e5274e53ab7a0e67e040c98e Jul 31 00:57:30.859611 n-d-master-1 devstack@n-api.service[104069]: X-User-Name: admin Jul 31 00:57:30.859611 n-d-master-1 devstack@n-api.service[104069]: method: > Jul 31 00:57:30.859611 n-d-master-1 devstack@n-api.service[104069]: exception: Flavor 42 could not be found. Jul 31 00:57:30.859611 n-d-master-1 devstack@n-api.service[104069]: action_args: {'id': '42'} Jul 31 00:57:30.859611 n-d-master-1 devstack@n-api.service[104069]: {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 00:57:30.859611 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 00:57:30.861088 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Jul 31 00:57:30.862444 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-98f41d8c-aef1-42f5-9155-e7d72d1700de admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 00:57:30.863756 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-98f41d8c-aef1-42f5-9155-e7d72d1700de admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.473543 Jul 31 00:57:30.863756 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Sun Jul 31 00:57:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 475 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 00:57:30.869614 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-dce416e3-ee63-4cc1-8462-c7c0e07b84cb admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:30.875107 n-d-master-1 devstack@n-api.service[104070]: DEBUG dbcounter [-] [104070] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:57:30.896105 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-dce416e3-ee63-4cc1-8462-c7c0e07b84cb admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030633 Jul 31 00:57:30.896677 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Sun Jul 31 00:57:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 00:57:30.908549 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-739a56a2-9235-44fb-b926-eff70b96dcc3 admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:30.933759 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-739a56a2-9235-44fb-b926-eff70b96dcc3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028759 Jul 31 00:57:30.934355 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Sun Jul 31 00:57:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 00:57:30.944574 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-f64884aa-1ec9-4f90-a4dd-1968d678db0b admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:30.951222 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.wsgi [None req-f64884aa-1ec9-4f90-a4dd-1968d678db0b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-f64884aa-1ec9-4f90-a4dd-1968d678db0b admin admin] Request method failure captured: Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: Accept: application/json Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: Accept-Encoding: gzip, deflate Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: Connection: keep-alive Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: Content-Length: 0 Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: Host: 10.222.0.45 Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: Openstack-Api-Version: compute 2.90 Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: Openstack-System-Scope: None Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: User-Agent: python-novaclient Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: X-Auth-Token: gAAAAABi5dN6jKCBt9JFibVNJRuGQ-NoUnNQga6OyH0CmAF0qDS5R0kAiQzx3rOxAgG_N5bFdQZuec15cZ-jVdjdola8hidasEpw-PKOjLf_P-1JTXZX-7oOFfUIrfH3CMgpwZhtuIBSxNMKFeeIcvBndp4JY2SYT2eok1Vy_-1D44BQ4Z5uv_Q Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: X-Domain-Id: None Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: X-Domain-Name: None Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: X-Identity-Status: Confirmed Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: X-Is-Admin-Project: True Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: X-Project-Domain-Id: default Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: X-Project-Domain-Name: Default Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: X-Project-Id: 53fe8c9f1dcd40fe86bca3695051ce6e Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: X-Project-Name: admin Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: X-Role: member,admin,reader Jul 31 00:57:30.956357 n-d-master-1 devstack@n-api.service[104070]: X-Roles: member,admin,reader Jul 31 00:57:30.957908 n-d-master-1 devstack@n-api.service[104070]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_53fe8c9f1dcd40fe86bca3695051ce6e", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 00:57:30.957908 n-d-master-1 devstack@n-api.service[104070]: X-Tenant: admin Jul 31 00:57:30.957908 n-d-master-1 devstack@n-api.service[104070]: X-Tenant-Id: 53fe8c9f1dcd40fe86bca3695051ce6e Jul 31 00:57:30.957908 n-d-master-1 devstack@n-api.service[104070]: X-Tenant-Name: admin Jul 31 00:57:30.957908 n-d-master-1 devstack@n-api.service[104070]: X-User: admin Jul 31 00:57:30.957908 n-d-master-1 devstack@n-api.service[104070]: X-User-Domain-Id: default Jul 31 00:57:30.957908 n-d-master-1 devstack@n-api.service[104070]: X-User-Domain-Name: Default Jul 31 00:57:30.957908 n-d-master-1 devstack@n-api.service[104070]: X-User-Id: faccc743e5274e53ab7a0e67e040c98e Jul 31 00:57:30.957908 n-d-master-1 devstack@n-api.service[104070]: X-User-Name: admin Jul 31 00:57:30.957908 n-d-master-1 devstack@n-api.service[104070]: method: > Jul 31 00:57:30.957908 n-d-master-1 devstack@n-api.service[104070]: exception: Flavor 42 could not be found. Jul 31 00:57:30.957908 n-d-master-1 devstack@n-api.service[104070]: action_args: {'id': '42'} Jul 31 00:57:30.957908 n-d-master-1 devstack@n-api.service[104070]: {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 00:57:30.957908 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 00:57:30.958797 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Jul 31 00:57:30.959949 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-f64884aa-1ec9-4f90-a4dd-1968d678db0b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 00:57:30.960942 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-f64884aa-1ec9-4f90-a4dd-1968d678db0b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017212 Jul 31 00:57:30.960942 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Sun Jul 31 00:57:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 00:57:31.934115 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-739a56a2-9235-44fb-b926-eff70b96dcc3 admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:31.935131 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-739a56a2-9235-44fb-b926-eff70b96dcc3 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 31 00:57:31.935608 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Sun Jul 31 00:57:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:57:32.496177 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-9ca3e8ec-d869-42e2-a7b9-595258472e75 admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:32.502092 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.wsgi [None req-9ca3e8ec-d869-42e2-a7b9-595258472e75 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-9ca3e8ec-d869-42e2-a7b9-595258472e75 admin admin] Request method failure captured: Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: Accept: application/json Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: Accept-Encoding: gzip, deflate Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: Connection: keep-alive Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: Content-Length: 0 Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: Host: 10.222.0.45 Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: Openstack-Api-Version: compute 2.90 Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: Openstack-System-Scope: None Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: User-Agent: python-novaclient Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: X-Auth-Token: gAAAAABi5dN7kcMsrLVld1m9fPm-3iarXzvtp80x-WJs1cgSK1D3yvd7YFnxQWkWGTUh0UkGMUsQfDugFdAR1uB3pYGYv3mLkpfWkCSzvGDxnmm8eAhIiu2mklZP1oHascWMvgEFWYpVb5X7H72RFLyt3Eys1E8h-O1nlw_nvrul-YOWDfBTLoo Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: X-Domain-Id: None Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: X-Domain-Name: None Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: X-Identity-Status: Confirmed Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: X-Is-Admin-Project: True Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: X-Project-Domain-Id: default Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: X-Project-Domain-Name: Default Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: X-Project-Id: 53fe8c9f1dcd40fe86bca3695051ce6e Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: X-Project-Name: admin Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: X-Role: member,admin,reader Jul 31 00:57:32.503706 n-d-master-1 devstack@n-api.service[104070]: X-Roles: member,admin,reader Jul 31 00:57:32.505260 n-d-master-1 devstack@n-api.service[104070]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_53fe8c9f1dcd40fe86bca3695051ce6e", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 00:57:32.505260 n-d-master-1 devstack@n-api.service[104070]: X-Tenant: admin Jul 31 00:57:32.505260 n-d-master-1 devstack@n-api.service[104070]: X-Tenant-Id: 53fe8c9f1dcd40fe86bca3695051ce6e Jul 31 00:57:32.505260 n-d-master-1 devstack@n-api.service[104070]: X-Tenant-Name: admin Jul 31 00:57:32.505260 n-d-master-1 devstack@n-api.service[104070]: X-User: admin Jul 31 00:57:32.505260 n-d-master-1 devstack@n-api.service[104070]: X-User-Domain-Id: default Jul 31 00:57:32.505260 n-d-master-1 devstack@n-api.service[104070]: X-User-Domain-Name: Default Jul 31 00:57:32.505260 n-d-master-1 devstack@n-api.service[104070]: X-User-Id: faccc743e5274e53ab7a0e67e040c98e Jul 31 00:57:32.505260 n-d-master-1 devstack@n-api.service[104070]: X-User-Name: admin Jul 31 00:57:32.505260 n-d-master-1 devstack@n-api.service[104070]: method: > Jul 31 00:57:32.505260 n-d-master-1 devstack@n-api.service[104070]: exception: Flavor 84 could not be found. Jul 31 00:57:32.505260 n-d-master-1 devstack@n-api.service[104070]: action_args: {'id': '84'} Jul 31 00:57:32.505260 n-d-master-1 devstack@n-api.service[104070]: {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 00:57:32.505260 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 00:57:32.506134 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Jul 31 00:57:32.507364 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-9ca3e8ec-d869-42e2-a7b9-595258472e75 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 00:57:32.508657 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-9ca3e8ec-d869-42e2-a7b9-595258472e75 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.430674 Jul 31 00:57:32.508657 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Sun Jul 31 00:57:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 00:57:32.514957 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-83a6b62e-69c2-492e-8daa-e620b9ff45be admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:32.530422 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-83a6b62e-69c2-492e-8daa-e620b9ff45be admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019035 Jul 31 00:57:32.530988 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Sun Jul 31 00:57:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 00:57:32.541864 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-12d8b002-77dc-4167-9d33-929126e53be5 admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:32.559636 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-12d8b002-77dc-4167-9d33-929126e53be5 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021939 Jul 31 00:57:32.560210 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Sun Jul 31 00:57:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 00:57:32.569814 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-9f71593d-0a93-4e7a-9478-13132aa2da56 admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:32.575192 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.wsgi [None req-9f71593d-0a93-4e7a-9478-13132aa2da56 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-9f71593d-0a93-4e7a-9478-13132aa2da56 admin admin] Request method failure captured: Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: Accept: application/json Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: Accept-Encoding: gzip, deflate Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: Connection: keep-alive Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: Content-Length: 0 Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: Host: 10.222.0.45 Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: Openstack-Api-Version: compute 2.90 Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: Openstack-System-Scope: None Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: User-Agent: python-novaclient Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: X-Auth-Token: gAAAAABi5dN7kcMsrLVld1m9fPm-3iarXzvtp80x-WJs1cgSK1D3yvd7YFnxQWkWGTUh0UkGMUsQfDugFdAR1uB3pYGYv3mLkpfWkCSzvGDxnmm8eAhIiu2mklZP1oHascWMvgEFWYpVb5X7H72RFLyt3Eys1E8h-O1nlw_nvrul-YOWDfBTLoo Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: X-Domain-Id: None Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: X-Domain-Name: None Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: X-Identity-Status: Confirmed Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: X-Is-Admin-Project: True Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: X-Project-Domain-Id: default Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: X-Project-Domain-Name: Default Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: X-Project-Id: 53fe8c9f1dcd40fe86bca3695051ce6e Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: X-Project-Name: admin Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: X-Role: member,admin,reader Jul 31 00:57:32.576784 n-d-master-1 devstack@n-api.service[104069]: X-Roles: member,admin,reader Jul 31 00:57:32.578529 n-d-master-1 devstack@n-api.service[104069]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_53fe8c9f1dcd40fe86bca3695051ce6e", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 00:57:32.578529 n-d-master-1 devstack@n-api.service[104069]: X-Tenant: admin Jul 31 00:57:32.578529 n-d-master-1 devstack@n-api.service[104069]: X-Tenant-Id: 53fe8c9f1dcd40fe86bca3695051ce6e Jul 31 00:57:32.578529 n-d-master-1 devstack@n-api.service[104069]: X-Tenant-Name: admin Jul 31 00:57:32.578529 n-d-master-1 devstack@n-api.service[104069]: X-User: admin Jul 31 00:57:32.578529 n-d-master-1 devstack@n-api.service[104069]: X-User-Domain-Id: default Jul 31 00:57:32.578529 n-d-master-1 devstack@n-api.service[104069]: X-User-Domain-Name: Default Jul 31 00:57:32.578529 n-d-master-1 devstack@n-api.service[104069]: X-User-Id: faccc743e5274e53ab7a0e67e040c98e Jul 31 00:57:32.578529 n-d-master-1 devstack@n-api.service[104069]: X-User-Name: admin Jul 31 00:57:32.578529 n-d-master-1 devstack@n-api.service[104069]: method: > Jul 31 00:57:32.578529 n-d-master-1 devstack@n-api.service[104069]: exception: Flavor 84 could not be found. Jul 31 00:57:32.578529 n-d-master-1 devstack@n-api.service[104069]: action_args: {'id': '84'} Jul 31 00:57:32.578529 n-d-master-1 devstack@n-api.service[104069]: {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 00:57:32.578529 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 00:57:32.579948 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Jul 31 00:57:32.581304 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-9f71593d-0a93-4e7a-9478-13132aa2da56 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 00:57:32.582531 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-9f71593d-0a93-4e7a-9478-13132aa2da56 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012050 Jul 31 00:57:32.582531 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Sun Jul 31 00:57:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 00:57:33.545554 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-12d8b002-77dc-4167-9d33-929126e53be5 admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:33.546558 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-12d8b002-77dc-4167-9d33-929126e53be5 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 31 00:57:33.546969 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Sun Jul 31 00:57:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:57:34.076074 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-2620f2df-68c1-43e0-8364-1fd5236e44c8 admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:34.081902 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.wsgi [None req-2620f2df-68c1-43e0-8364-1fd5236e44c8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-2620f2df-68c1-43e0-8364-1fd5236e44c8 admin admin] Request method failure captured: Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: Accept: application/json Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: Accept-Encoding: gzip, deflate Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: Connection: keep-alive Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: Content-Length: 0 Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: Host: 10.222.0.45 Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: Openstack-Api-Version: compute 2.90 Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: Openstack-System-Scope: None Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: User-Agent: python-novaclient Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: X-Auth-Token: gAAAAABi5dN9bA9C2McpoocPDGM92s-LGt4mHwuJ9FQ-LYXoMsCjXRA5GYofJC9-mSY_iN3B9mJznRJrBf9ydQwRYDJmHTFb0932cXnPFaiIHFZeHkOQA1jOLXVwkI0QCUu1u9mVokBvCJlBPqLoySWktZ5K4BuJ6TMSbth_sIFSmOKsh68V-6Q Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: X-Domain-Id: None Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: X-Domain-Name: None Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: X-Identity-Status: Confirmed Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: X-Is-Admin-Project: True Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: X-Project-Domain-Id: default Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: X-Project-Domain-Name: Default Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: X-Project-Id: 53fe8c9f1dcd40fe86bca3695051ce6e Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: X-Project-Name: admin Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: X-Role: member,admin,reader Jul 31 00:57:34.083392 n-d-master-1 devstack@n-api.service[104069]: X-Roles: member,admin,reader Jul 31 00:57:34.086915 n-d-master-1 devstack@n-api.service[104069]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_53fe8c9f1dcd40fe86bca3695051ce6e", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 00:57:34.086915 n-d-master-1 devstack@n-api.service[104069]: X-Tenant: admin Jul 31 00:57:34.086915 n-d-master-1 devstack@n-api.service[104069]: X-Tenant-Id: 53fe8c9f1dcd40fe86bca3695051ce6e Jul 31 00:57:34.086915 n-d-master-1 devstack@n-api.service[104069]: X-Tenant-Name: admin Jul 31 00:57:34.086915 n-d-master-1 devstack@n-api.service[104069]: X-User: admin Jul 31 00:57:34.086915 n-d-master-1 devstack@n-api.service[104069]: X-User-Domain-Id: default Jul 31 00:57:34.086915 n-d-master-1 devstack@n-api.service[104069]: X-User-Domain-Name: Default Jul 31 00:57:34.086915 n-d-master-1 devstack@n-api.service[104069]: X-User-Id: faccc743e5274e53ab7a0e67e040c98e Jul 31 00:57:34.086915 n-d-master-1 devstack@n-api.service[104069]: X-User-Name: admin Jul 31 00:57:34.086915 n-d-master-1 devstack@n-api.service[104069]: method: > Jul 31 00:57:34.086915 n-d-master-1 devstack@n-api.service[104069]: exception: Flavor 451 could not be found. Jul 31 00:57:34.086915 n-d-master-1 devstack@n-api.service[104069]: action_args: {'id': '451'} Jul 31 00:57:34.086915 n-d-master-1 devstack@n-api.service[104069]: {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 00:57:34.086915 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 00:57:34.087904 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: ERROR nova.api.openstack.wsgi Jul 31 00:57:34.089163 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-2620f2df-68c1-43e0-8364-1fd5236e44c8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 00:57:34.090388 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-2620f2df-68c1-43e0-8364-1fd5236e44c8 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.397212 Jul 31 00:57:34.090388 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Sun Jul 31 00:57:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 00:57:34.095015 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-d1ea10a4-9a08-412d-bdd8-618c3cfdfadf admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:34.109701 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-d1ea10a4-9a08-412d-bdd8-618c3cfdfadf admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018262 Jul 31 00:57:34.110236 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Sun Jul 31 00:57:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 00:57:34.119895 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-0310898d-ee99-4396-9d1a-6d3482b994ba admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:34.134963 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-0310898d-ee99-4396-9d1a-6d3482b994ba admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019011 Jul 31 00:57:34.135501 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Sun Jul 31 00:57:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 00:57:34.145897 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-a4083d39-fe0f-4d22-b5ca-4d27b9af1391 admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:34.151351 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.wsgi [None req-a4083d39-fe0f-4d22-b5ca-4d27b9af1391 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-a4083d39-fe0f-4d22-b5ca-4d27b9af1391 admin admin] Request method failure captured: Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: Accept: application/json Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: Accept-Encoding: gzip, deflate Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: Connection: keep-alive Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: Content-Length: 0 Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: Host: 10.222.0.45 Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: Openstack-Api-Version: compute 2.90 Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: Openstack-System-Scope: None Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: User-Agent: python-novaclient Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: X-Auth-Token: gAAAAABi5dN9bA9C2McpoocPDGM92s-LGt4mHwuJ9FQ-LYXoMsCjXRA5GYofJC9-mSY_iN3B9mJznRJrBf9ydQwRYDJmHTFb0932cXnPFaiIHFZeHkOQA1jOLXVwkI0QCUu1u9mVokBvCJlBPqLoySWktZ5K4BuJ6TMSbth_sIFSmOKsh68V-6Q Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: X-Domain-Id: None Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: X-Domain-Name: None Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: X-Identity-Status: Confirmed Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: X-Is-Admin-Project: True Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: X-Project-Domain-Id: default Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: X-Project-Domain-Name: Default Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: X-Project-Id: 53fe8c9f1dcd40fe86bca3695051ce6e Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: X-Project-Name: admin Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: X-Role: member,admin,reader Jul 31 00:57:34.152867 n-d-master-1 devstack@n-api.service[104070]: X-Roles: member,admin,reader Jul 31 00:57:34.154378 n-d-master-1 devstack@n-api.service[104070]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/53fe8c9f1dcd40fe86bca3695051ce6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_53fe8c9f1dcd40fe86bca3695051ce6e", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 00:57:34.154378 n-d-master-1 devstack@n-api.service[104070]: X-Tenant: admin Jul 31 00:57:34.154378 n-d-master-1 devstack@n-api.service[104070]: X-Tenant-Id: 53fe8c9f1dcd40fe86bca3695051ce6e Jul 31 00:57:34.154378 n-d-master-1 devstack@n-api.service[104070]: X-Tenant-Name: admin Jul 31 00:57:34.154378 n-d-master-1 devstack@n-api.service[104070]: X-User: admin Jul 31 00:57:34.154378 n-d-master-1 devstack@n-api.service[104070]: X-User-Domain-Id: default Jul 31 00:57:34.154378 n-d-master-1 devstack@n-api.service[104070]: X-User-Domain-Name: Default Jul 31 00:57:34.154378 n-d-master-1 devstack@n-api.service[104070]: X-User-Id: faccc743e5274e53ab7a0e67e040c98e Jul 31 00:57:34.154378 n-d-master-1 devstack@n-api.service[104070]: X-User-Name: admin Jul 31 00:57:34.154378 n-d-master-1 devstack@n-api.service[104070]: method: > Jul 31 00:57:34.154378 n-d-master-1 devstack@n-api.service[104070]: exception: Flavor 451 could not be found. Jul 31 00:57:34.154378 n-d-master-1 devstack@n-api.service[104070]: action_args: {'id': '451'} Jul 31 00:57:34.154378 n-d-master-1 devstack@n-api.service[104070]: {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 00:57:34.154378 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 00:57:34.155542 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: ERROR nova.api.openstack.wsgi Jul 31 00:57:34.156846 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-a4083d39-fe0f-4d22-b5ca-4d27b9af1391 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 00:57:34.158054 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-a4083d39-fe0f-4d22-b5ca-4d27b9af1391 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012515 Jul 31 00:57:34.158054 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Sun Jul 31 00:57:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 31 00:57:35.139588 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-0310898d-ee99-4396-9d1a-6d3482b994ba admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:35.140602 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-0310898d-ee99-4396-9d1a-6d3482b994ba admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 31 00:57:35.140996 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Sun Jul 31 00:57:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:57:35.703316 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-1940a929-37ab-4c9e-9a05-206cf20c7e38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:57:35.724626 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-1940a929-37ab-4c9e-9a05-206cf20c7e38 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.445920 Jul 31 00:57:35.725209 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Sun Jul 31 00:57:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 00:57:36.743674 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-0310898d-ee99-4396-9d1a-6d3482b994ba admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:36.744740 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-0310898d-ee99-4396-9d1a-6d3482b994ba admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002152 Jul 31 00:57:36.745159 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Sun Jul 31 00:57:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:57:37.550332 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-e9a6a3e4-a005-4139-ab4d-176521c43e8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:57:37.572708 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-e9a6a3e4-a005-4139-ab4d-176521c43e8a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.672919 Jul 31 00:57:37.573376 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Sun Jul 31 00:57:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 00:57:38.733049 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-0310898d-ee99-4396-9d1a-6d3482b994ba admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:38.734473 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-0310898d-ee99-4396-9d1a-6d3482b994ba admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001988 Jul 31 00:57:38.735022 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Sun Jul 31 00:57:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:57:39.381646 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-a57d79f8-25b7-4a46-b2bb-6950ec6e5156 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:57:39.408081 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-a57d79f8-25b7-4a46-b2bb-6950ec6e5156 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.529794 Jul 31 00:57:39.408702 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Sun Jul 31 00:57:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 00:57:40.513765 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-0310898d-ee99-4396-9d1a-6d3482b994ba admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:40.514824 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-0310898d-ee99-4396-9d1a-6d3482b994ba admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jul 31 00:57:40.515263 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Sun Jul 31 00:57:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:57:41.155287 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-8a850aa5-56d3-4ccc-a577-d7fd50960775 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 00:57:41.177376 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-8a850aa5-56d3-4ccc-a577-d7fd50960775 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.511326 Jul 31 00:57:41.178073 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Sun Jul 31 00:57:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 00:57:42.305586 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-0310898d-ee99-4396-9d1a-6d3482b994ba admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:42.306968 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-0310898d-ee99-4396-9d1a-6d3482b994ba admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 Jul 31 00:57:42.307480 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Sun Jul 31 00:57:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:57:42.970090 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-2bddd330-81c4-4cb7-9110-8aebb7dc7809 admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:57:42.995309 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-2bddd330-81c4-4cb7-9110-8aebb7dc7809 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.536990 Jul 31 00:57:42.995958 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Sun Jul 31 00:57:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 00:58:37.645185 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-0310898d-ee99-4396-9d1a-6d3482b994ba admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:58:37.646207 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-0310898d-ee99-4396-9d1a-6d3482b994ba admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 31 00:58:37.646617 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 930 bytes} [Sun Jul 31 00:58:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 00:58:37.657771 n-d-master-1 devstack@n-api.service[104070]: DEBUG dbcounter [-] [104070] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:58:38.060105 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-99b85a25-c863-4e28-ab83-c2e9d669b66f admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:58:38.081069 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-99b85a25-c863-4e28-ab83-c2e9d669b66f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.427765 Jul 31 00:58:38.081622 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1291 bytes} [Sun Jul 31 00:58:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 00:58:38.103495 n-d-master-1 devstack@n-api.service[104069]: DEBUG dbcounter [-] [104069] Writing DB stats nova_api:SELECT=14 {{(pid=104069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 00:58:38.107253 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-c960fe85-e8ed-4f03-9901-922d95fb2a03 admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:58:38.115050 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-c960fe85-e8ed-4f03-9901-922d95fb2a03 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013008 Jul 31 00:58:38.115617 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1282 bytes} [Sun Jul 31 00:58:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 00:58:38.127252 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-4f6dbbba-071e-4767-bd62-e73676ceec26 admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:58:38.135411 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-4f6dbbba-071e-4767-bd62-e73676ceec26 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011708 Jul 31 00:58:38.135937 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1285 bytes} [Sun Jul 31 00:58:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 00:58:38.147961 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-a1be816f-6193-4ad8-bf5a-5afd89dd0135 admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:58:38.156911 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-a1be816f-6193-4ad8-bf5a-5afd89dd0135 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013266 Jul 31 00:58:38.157468 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1285 bytes} [Sun Jul 31 00:58:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 00:58:38.171041 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-703e1325-3a64-47c2-800c-086865e493a0 admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 00:58:38.179543 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-703e1325-3a64-47c2-800c-086865e493a0 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012599 Jul 31 00:58:38.180202 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1282 bytes} [Sun Jul 31 00:58:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:15.167451 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-a1be816f-6193-4ad8-bf5a-5afd89dd0135 admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:04:15.168457 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-a1be816f-6193-4ad8-bf5a-5afd89dd0135 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 31 01:04:15.168852 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1074 bytes} [Sun Jul 31 01:04:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:04:15.309933 n-d-master-1 devstack@n-api.service[104070]: DEBUG dbcounter [-] [104070] Writing DB stats nova_api:SELECT=6 {{(pid=104070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:15.460897 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-09832864-e17d-4d8a-9f70-dcbbe0540a71 admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:04:15.463261 n-d-master-1 devstack@n-api.service[104070]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:04:15.463261 n-d-master-1 devstack@n-api.service[104070]: warnings.warn(msg) Jul 31 01:04:15.464649 n-d-master-1 devstack@n-api.service[104070]: DEBUG oslo_concurrency.lockutils [None req-09832864-e17d-4d8a-9f70-dcbbe0540a71 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:04:15.465096 n-d-master-1 devstack@n-api.service[104070]: DEBUG oslo_concurrency.lockutils [None req-09832864-e17d-4d8a-9f70-dcbbe0540a71 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:04:15.465888 n-d-master-1 devstack@n-api.service[104070]: DEBUG oslo_concurrency.lockutils [None req-09832864-e17d-4d8a-9f70-dcbbe0540a71 admin admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:04:15.466319 n-d-master-1 devstack@n-api.service[104070]: DEBUG oslo_concurrency.lockutils [None req-09832864-e17d-4d8a-9f70-dcbbe0540a71 admin admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:04:15.507863 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-09832864-e17d-4d8a-9f70-dcbbe0540a71 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.199302 Jul 31 01:04:15.508446 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 36/70] 10.222.0.45 () {60 vars in 1193 bytes} [Sun Jul 31 01:04:15 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:04:16.343756 n-d-master-1 devstack@n-api.service[104069]: DEBUG nova.api.openstack.wsgi [None req-a1be816f-6193-4ad8-bf5a-5afd89dd0135 admin admin] Calling method '>' {{(pid=104069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:04:16.344791 n-d-master-1 devstack@n-api.service[104069]: INFO nova.api.openstack.requestlog [None req-a1be816f-6193-4ad8-bf5a-5afd89dd0135 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jul 31 01:04:16.345188 n-d-master-1 devstack@n-api.service[104069]: [pid: 104069|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1074 bytes} [Sun Jul 31 01:04:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:04:16.538631 n-d-master-1 devstack@n-api.service[104070]: DEBUG nova.api.openstack.wsgi [None req-c7be48ec-7aba-4a4f-ba66-cbef72d93458 admin admin] Calling method '>' {{(pid=104070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:04:16.541034 n-d-master-1 devstack@n-api.service[104070]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:04:16.541034 n-d-master-1 devstack@n-api.service[104070]: warnings.warn(msg) Jul 31 01:04:16.542226 n-d-master-1 devstack@n-api.service[104070]: DEBUG oslo_concurrency.lockutils [None req-c7be48ec-7aba-4a4f-ba66-cbef72d93458 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:04:16.542666 n-d-master-1 devstack@n-api.service[104070]: DEBUG oslo_concurrency.lockutils [None req-c7be48ec-7aba-4a4f-ba66-cbef72d93458 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:04:16.543491 n-d-master-1 devstack@n-api.service[104070]: DEBUG oslo_concurrency.lockutils [None req-c7be48ec-7aba-4a4f-ba66-cbef72d93458 admin admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:04:16.544009 n-d-master-1 devstack@n-api.service[104070]: DEBUG oslo_concurrency.lockutils [None req-c7be48ec-7aba-4a4f-ba66-cbef72d93458 admin admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:04:16.567327 n-d-master-1 devstack@n-api.service[104070]: INFO nova.api.openstack.requestlog [None req-c7be48ec-7aba-4a4f-ba66-cbef72d93458 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.083210 Jul 31 01:04:16.567923 n-d-master-1 devstack@n-api.service[104070]: [pid: 104070|app: 0|req: 37/72] 10.222.0.45 () {60 vars in 1193 bytes} [Sun Jul 31 01:04:16 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:05:02.164068 n-d-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 31 01:05:02.164738 n-d-master-1 devstack@n-api.service[104007]: Sun Jul 31 01:05:02 2022 - graceful shutdown triggered... Jul 31 01:05:02.165199 n-d-master-1 devstack@n-api.service[104069]: Gracefully killing worker 1 (pid: 104069)... Jul 31 01:05:02.165799 n-d-master-1 devstack@n-api.service[104070]: Gracefully killing worker 2 (pid: 104070)... Jul 31 01:05:03.165501 n-d-master-1 devstack@n-api.service[104007]: worker 1 buried after 1 seconds Jul 31 01:05:03.165501 n-d-master-1 devstack@n-api.service[104007]: worker 2 buried after 1 seconds Jul 31 01:05:03.165501 n-d-master-1 devstack@n-api.service[104007]: goodbye to uWSGI. Jul 31 01:05:03.167186 n-d-master-1 systemd[1]: devstack@n-api.service: Succeeded. Jul 31 01:05:03.167788 n-d-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 31 01:05:03.170586 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jul 31 01:05:03.191273 n-d-master-1 devstack@n-api.service[119466]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 31 01:05:03.193221 n-d-master-1 devstack@n-api.service[119466]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 31 01:05:03 2022] *** Jul 31 01:05:03.193221 n-d-master-1 devstack@n-api.service[119466]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 31 01:05:03.193221 n-d-master-1 devstack@n-api.service[119466]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 31 01:05:03.193221 n-d-master-1 devstack@n-api.service[119466]: nodename: n-d-master-1 Jul 31 01:05:03.193221 n-d-master-1 devstack@n-api.service[119466]: machine: x86_64 Jul 31 01:05:03.193221 n-d-master-1 devstack@n-api.service[119466]: clock source: unix Jul 31 01:05:03.193221 n-d-master-1 devstack@n-api.service[119466]: pcre jit disabled Jul 31 01:05:03.193221 n-d-master-1 devstack@n-api.service[119466]: detected number of CPU cores: 4 Jul 31 01:05:03.193221 n-d-master-1 devstack@n-api.service[119466]: current working directory: / Jul 31 01:05:03.193221 n-d-master-1 devstack@n-api.service[119466]: detected binary path: /usr/bin/uwsgi-core Jul 31 01:05:03.193221 n-d-master-1 devstack@n-api.service[119466]: your processes number limit is 47680 Jul 31 01:05:03.194042 n-d-master-1 devstack@n-api.service[119466]: your memory page size is 4096 bytes Jul 31 01:05:03.194042 n-d-master-1 devstack@n-api.service[119466]: detected max file descriptor number: 2048 Jul 31 01:05:03.194042 n-d-master-1 devstack@n-api.service[119466]: lock engine: pthread robust mutexes Jul 31 01:05:03.194042 n-d-master-1 devstack@n-api.service[119466]: thunder lock: enabled Jul 31 01:05:03.194042 n-d-master-1 devstack@n-api.service[119466]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 31 01:05:03.194042 n-d-master-1 devstack@n-api.service[119466]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 31 01:05:03.236807 n-d-master-1 devstack@n-api.service[119466]: Python main interpreter initialized at 0x5646986129c0 Jul 31 01:05:03.236807 n-d-master-1 devstack@n-api.service[119466]: python threads support enabled Jul 31 01:05:03.236807 n-d-master-1 devstack@n-api.service[119466]: your server socket listen backlog is limited to 100 connections Jul 31 01:05:03.236807 n-d-master-1 devstack@n-api.service[119466]: your mercy for graceful operations on workers is 90 seconds Jul 31 01:05:03.237485 n-d-master-1 devstack@n-api.service[119466]: mapped 403077 bytes (393 KB) for 2 cores Jul 31 01:05:03.237485 n-d-master-1 devstack@n-api.service[119466]: *** Operational MODE: preforking *** Jul 31 01:05:03.237785 n-d-master-1 devstack@n-api.service[119466]: *** uWSGI is running in multiple interpreter mode *** Jul 31 01:05:03.237785 n-d-master-1 devstack@n-api.service[119466]: spawned uWSGI master process (pid: 119466) Jul 31 01:05:03.244215 n-d-master-1 devstack@n-api.service[119466]: spawned uWSGI worker 1 (pid: 119474, cores: 1) Jul 31 01:05:03.244215 n-d-master-1 devstack@n-api.service[119466]: spawned uWSGI worker 2 (pid: 119475, cores: 1) Jul 31 01:05:03.244215 n-d-master-1 devstack@n-api.service[119466]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 31 01:05:03.237840 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jul 31 01:05:03.913472 n-d-master-1 devstack@n-api.service[119474]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 31 01:05:03.923521 n-d-master-1 devstack@n-api.service[119475]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 31 01:05:05.093064 n-d-master-1 devstack@n-api.service[119474]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 01:05:05.093064 n-d-master-1 devstack@n-api.service[119474]: from cryptography.utils import int_from_bytes Jul 31 01:05:05.093703 n-d-master-1 devstack@n-api.service[119474]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 01:05:05.093703 n-d-master-1 devstack@n-api.service[119474]: from cryptography.utils import int_from_bytes Jul 31 01:05:05.094515 n-d-master-1 devstack@n-api.service[119475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 01:05:05.094515 n-d-master-1 devstack@n-api.service[119475]: from cryptography.utils import int_from_bytes Jul 31 01:05:05.094941 n-d-master-1 devstack@n-api.service[119475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 01:05:05.094941 n-d-master-1 devstack@n-api.service[119475]: from cryptography.utils import int_from_bytes Jul 31 01:05:07.575826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 01:05:07.576348 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 01:05:07.576550 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 01:05:07.576914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 01:05:07.577208 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 01:05:07.577591 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.577953 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.578276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.578596 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.578926 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.579241 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.579591 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.579932 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.580264 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.580524 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.580755 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 01:05:07.581156 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.581257 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 01:05:07.581349 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.581448 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.581549 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 01:05:07.581914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.582020 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 01:05:07.582176 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 01:05:07.582276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.582529 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.582629 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.582834 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.582947 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.583204 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.583329 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.583527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.583625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.583879 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.584027 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.584453 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.584733 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.584864 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.585041 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.585222 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.585349 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.585477 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.585674 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.585817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.585996 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.586097 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.586328 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.586429 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.586657 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.586794 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.587007 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.587148 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.587351 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.587495 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.587665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.587806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.588075 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.588222 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.588386 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.588514 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.588736 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.588844 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.589003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.589206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.589431 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.589576 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.589764 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.589854 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.590039 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.590260 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.590405 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.590501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.590665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.590767 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.590971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.591071 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.591294 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.591419 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.591638 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.591742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.591956 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.592059 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.592274 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.592374 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.592574 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.592950 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.593054 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.593189 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.593290 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.593376 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.593538 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.593874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.593979 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.594066 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.594193 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.594330 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.594433 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.594646 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.594755 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.594972 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.595074 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.595300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.595415 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.595666 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.595905 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.596054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.596144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.596311 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.596414 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.596634 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.596728 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.596961 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.597053 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.597268 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.597370 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.597583 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.597682 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.597898 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.598002 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.598211 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.598303 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.598517 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.598612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.598852 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.598967 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.599069 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.599161 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.599397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.599507 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.599728 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.599828 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.600063 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.600244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.600382 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.600651 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.600749 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.600915 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.601010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.601174 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.601388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.601489 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.601639 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.601823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.601931 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.602270 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.602408 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.602588 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.602796 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.602938 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.603120 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.603268 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.603463 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.603568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.603782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.603877 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.604098 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.604192 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.604399 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.604496 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.604713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.604805 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.605032 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.605131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.605335 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.605428 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.605586 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.605679 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.605883 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.605982 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.606187 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.606282 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.606503 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.606670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.606806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.606928 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.607112 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.607244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.607438 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.607614 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.607738 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.607938 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.608043 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.608255 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.608401 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.608583 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.608702 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.608977 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.609094 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.609197 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.609283 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.609499 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.609605 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.609800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.609905 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.610103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.610206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.610405 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.610506 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.610722 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.610971 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.611065 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.611933 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.612092 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.612282 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.612557 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.612673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.612892 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.613129 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.613254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.613506 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.613718 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.613813 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.614120 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.614312 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.614421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.614718 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.614882 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.615035 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.615373 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.615475 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.615707 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.616015 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.616120 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.616316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.616418 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.616625 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.616736 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.616945 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.617047 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.617253 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.617346 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.617558 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.617657 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.617860 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.618038 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.618169 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.618262 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.618506 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.618607 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.618823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.618919 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.619162 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.619268 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.619504 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.619603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.619825 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.619920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.620142 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.620234 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.620460 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.620555 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.620779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.620932 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.621109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.621202 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.621424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.621523 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.621740 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.621846 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.622073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.622169 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.622388 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.625816 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.626007 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.627958 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.628128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.628274 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.628411 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.628551 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.628696 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.628830 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.628968 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.629108 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.629266 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.629400 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.629541 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.629691 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.629830 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.629973 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.630111 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.630256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.630388 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.630526 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.630656 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.630794 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.630930 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.631075 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.631211 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.631366 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.631501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.631616 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.631759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.631900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.632032 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.632162 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.632303 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.632434 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.632562 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.632688 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.632826 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.632968 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.633106 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.633245 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.633388 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.633666 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.633763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.633855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.634766 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:05:07.634871 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.635055 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.635158 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.635411 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.635552 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.635665 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.635783 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.635931 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.636206 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.636338 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.638370 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.638583 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.638683 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.638781 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.638886 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.639118 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.639307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.639459 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.639609 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.639748 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.639895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.640038 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.640180 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.640369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.640369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.640644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.640735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.640858 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.640985 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.641112 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.641112 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.641331 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.641429 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.641564 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.641672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.641759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.641841 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.641972 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.642065 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.642156 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.642251 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.642251 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.644327 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.645033 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.645160 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.645263 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.645263 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.645685 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.645797 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.645906 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.646007 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.646007 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.646221 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.646371 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.646511 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.646649 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.646649 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.646900 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.647030 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.647158 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.647287 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.647287 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.647549 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.647791 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.647912 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.648081 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.648224 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.648346 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.648450 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.648524 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.648953 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.649057 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.649173 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.649363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.649500 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.649618 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.649760 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.649904 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.650023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.650145 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.650282 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.650418 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.650549 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.650680 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.650808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.650808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.651048 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.651136 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.651276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.651423 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.651512 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.651611 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.651703 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.651795 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.651888 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.651973 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.652054 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.652144 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.652228 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.652390 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.652483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.652631 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.652760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.652889 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.653015 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.653152 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.653287 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.653429 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.653517 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.653609 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.653746 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.653843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.653934 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.654019 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.654109 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.654201 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.654295 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.654397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.654482 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.654619 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.654708 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.654790 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.654889 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.654974 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.655065 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.655149 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.655230 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.655230 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.655469 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.655469 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.655633 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.655717 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.655799 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.655799 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.655971 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.656055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.656145 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.656145 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.656296 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.656366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.656529 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.656619 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.656709 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.656801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.656885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.656975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.657066 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.657150 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.657239 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.657330 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.657421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.657513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.657605 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.657689 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.657771 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.657862 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.657952 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.658049 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.658140 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.658225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.658315 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.658446 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.658541 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.658635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.658726 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.658817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.658915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.659007 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.659100 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.659184 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.659266 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.659364 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.659582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.659725 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.659863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.659991 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.660117 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.660250 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.660377 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.660511 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.660648 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.660738 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.660875 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.660875 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.661033 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.661115 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.661115 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.661289 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.661380 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.661380 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.661638 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.661736 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.661830 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.662046 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.662353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.662446 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.662701 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.662807 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.663013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.663112 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.663399 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.663507 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.663990 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.664116 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.664436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.664543 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.664632 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.664787 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.664877 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.664976 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.665070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.665166 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.665251 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.665424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.665563 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.665745 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.665923 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.666101 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.666245 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.666456 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.666641 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.666781 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.666918 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.667090 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.667286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.667468 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.667671 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.667768 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.667883 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.668075 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.668215 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.668411 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.668517 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.668757 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.668862 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.669127 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.669229 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.669438 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.669569 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.669764 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.670058 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.670151 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.670364 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.670670 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.670762 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.670978 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.671143 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.671294 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.671630 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.671738 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.671941 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.672246 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.672348 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.672564 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.672831 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.672961 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.673165 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.673412 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.673518 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.674302 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.674432 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.674626 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.674782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.674937 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.675208 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.675312 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.675725 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.675847 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.676610 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.676726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.676816 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.676900 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.677006 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.677201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.677401 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.677587 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.677754 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.678088 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.678251 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.678422 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.678592 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.678835 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.678835 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.679543 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.679733 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.679879 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.680015 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.680211 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.680367 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.680524 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.680628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.680848 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.681008 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.681162 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.681314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.681519 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.681662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.681849 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.681997 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.682169 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.682265 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.682480 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.682582 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.682794 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.682896 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.683108 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.683203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.683445 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.683543 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.683761 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.683868 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.684087 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.684190 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.684398 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.684499 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.684709 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.684858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.685023 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.685167 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.685330 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.685473 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.685642 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.685777 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.685977 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.686078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.686301 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.686587 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.686691 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.686927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.687021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.687238 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.687331 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.687582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.687683 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.687900 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.688001 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.688215 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.688316 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.688547 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.688687 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.688878 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.689047 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.689235 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.690087 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.690203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.690401 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.690710 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.690859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.691020 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.691219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.691411 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.691653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.691812 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.692307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.692422 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.692519 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.692619 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.692705 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.692976 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.693210 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.693442 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.693537 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.693862 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.693978 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.694187 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.694387 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.694493 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.694856 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.694974 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.695636 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.695813 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.695951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.696084 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.696216 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.696361 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.696494 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.696585 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.696679 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.696766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.696859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.697102 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.697206 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.697412 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.697506 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.697722 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.697825 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.698052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.698146 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.698369 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.698463 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.698687 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.698794 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.699010 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.699113 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.699331 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.699458 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.699673 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.699768 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.700011 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.700254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.700351 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.700436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.700637 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.700736 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.700944 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.701046 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.701252 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.701355 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.701564 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.701659 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.701872 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.702065 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.702215 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.702473 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.702781 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.703069 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.703181 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.703409 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.703628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.703767 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.704012 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.704187 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.704294 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.704616 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.704713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.705057 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.705197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.705457 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.705584 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.705940 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.706037 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.706287 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.706436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.706652 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.706980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.707084 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.707703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.707875 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.707986 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.708074 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.708167 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.708254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.708338 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.708430 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.708583 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.708721 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.708902 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.709036 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.709479 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.709611 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.709808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.709927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.710125 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.710235 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.710444 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.710551 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.710755 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.710911 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.711069 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.711208 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.711415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.711513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.711730 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.711838 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.712053 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.712147 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.712366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.712461 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.712672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.712843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.713000 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.713095 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.713305 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.713397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.713623 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.713780 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.713930 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.714241 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.714333 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.714545 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.714851 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.714944 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.715156 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.715472 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.715581 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.715783 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.716087 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.716182 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.716395 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.716487 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.716702 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.716843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.717010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.717243 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.717336 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.717632 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.717803 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.717936 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.718241 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.718357 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.718542 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.718690 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.718886 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.719018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.719192 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.719446 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.719574 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.719789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.719895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.720187 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.720356 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.721071 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.721329 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.721482 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.721644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.721961 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.722065 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.722270 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.722374 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.722587 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.722724 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.723528 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.723634 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.723721 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.723806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.723890 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.723991 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.724088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.724175 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.724267 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.724380 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.724679 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.724679 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.725426 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.725588 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.725730 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.725873 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.726022 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.726228 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.726228 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.727095 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.728725 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.729237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.729390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.729390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.729634 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.729723 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.729816 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.729910 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.730005 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.730090 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.730181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.730264 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.730264 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.730426 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.730519 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.730612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.730697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.730697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.730847 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.730930 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.731042 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.731183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.731322 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.731480 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.731612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.731740 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.731740 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.731910 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.732005 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.732105 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.732190 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.732282 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.732367 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.732449 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.732566 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.732735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.733060 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.733163 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.733381 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.733706 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.733901 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.734042 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.734374 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.734477 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.734692 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.735006 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.735106 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.735323 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.735542 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.735687 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.735876 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.736016 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.736843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.736988 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.737163 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.737307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.737479 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.737619 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.737794 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.737934 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.738111 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.738245 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.738425 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.738530 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.738761 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.738856 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.739082 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.739248 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.739421 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.739603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.739740 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.740058 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.740421 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.740739 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.741022 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.741145 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.741355 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.741486 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.741692 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.741817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.742049 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.742375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.742507 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.742697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.743016 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.743121 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.743358 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.743701 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.744025 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.744363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.744582 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.744843 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.744975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.745246 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.745498 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.745694 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.745850 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.745997 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.746175 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.746485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.746640 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.746802 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.747069 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.747227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.747638 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.747748 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.747878 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.748068 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.748162 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.748485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.748662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.748907 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.749194 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.749288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.749675 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.749821 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.750106 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.750206 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.750442 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.750606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.750777 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.751091 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.751191 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.751452 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.751735 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.751838 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.752253 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.752348 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.752588 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.752885 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.752981 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.753352 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.753491 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.753713 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.753977 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.754091 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.754357 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.754567 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.754701 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.754977 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.755196 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.755494 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.755711 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.755928 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.756152 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.756318 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.756432 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.756521 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.756614 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.756825 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.757155 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.757314 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.757488 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.757654 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.757868 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.758225 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.758403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.758628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.758897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.759037 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.759425 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.759548 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.759702 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.759956 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.760125 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.760439 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.760625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.760804 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.761014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.761257 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.761522 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.761697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.761929 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.762267 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.762419 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.762753 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.762873 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.762997 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.763381 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.763551 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.763723 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.764036 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.764160 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.764510 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.764611 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.764851 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.765152 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.765274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.765503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.765704 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.765900 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.766081 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.766492 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.766592 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.766863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.767103 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.767196 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.767532 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.767619 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.767866 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.767958 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.768195 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.768285 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.768535 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.768697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.768926 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.769095 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.769230 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.769423 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.769543 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.769859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.769950 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.770172 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.770273 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.770577 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.770724 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.770890 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.771258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.771413 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.771603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.771914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.772016 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.772225 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.772414 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.772583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.772864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.773210 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.773516 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.773630 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.773832 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.774067 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.774176 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.774418 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.774635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.774922 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.775028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.775244 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.775612 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.776034 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.776135 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.776318 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.776497 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.776581 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.776864 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.777065 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.777341 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.777491 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.777680 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.777901 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.778087 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.778274 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.778520 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.778692 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.778958 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.779183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.779387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.779782 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.779934 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.780089 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.780331 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.780784 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.781132 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.781319 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.781457 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.781672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.781813 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.782131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.782226 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.782455 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.782624 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.782776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.783638 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.783806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.783956 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.784271 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.784445 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.784609 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.784918 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.785015 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.785242 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.785369 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.785566 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.785816 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.785923 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.786189 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.786289 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.786504 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.786696 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.786840 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.787143 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.787237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.787502 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.787635 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.787828 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.788047 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.788211 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.788480 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.788579 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.788795 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.788920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.789128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.789385 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.789485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.789754 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.789889 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.790069 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.790287 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.790389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.790723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.790822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.791037 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.791213 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.791389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.791644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.791857 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.792018 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.792339 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.792535 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.792767 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.792906 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.793177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.793370 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.793491 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.793863 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.794013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.794255 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.794418 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.794575 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.794955 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.795103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.795198 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.795541 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.795747 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.795854 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.796197 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.796291 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.796603 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.796786 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.796935 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.797254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.797357 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.797703 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.797809 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.798151 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.798252 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.798486 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.799283 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.799539 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.799716 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.799948 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.800053 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.800393 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.800568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.800715 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.801033 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.801125 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.801350 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.801665 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.801765 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.802021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.802264 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.802358 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.802747 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.802850 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.803111 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.803475 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.803661 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.803994 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.804108 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.804345 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.804682 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.804779 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.805018 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.805268 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.805372 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.805661 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.805857 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.805997 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.806207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.806300 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.806933 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.807031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.807117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.807210 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.807311 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.807490 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.807636 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.807765 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.807900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.808037 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.808165 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.808300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.808472 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.808569 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.808798 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.808891 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.809113 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.809258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.809655 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.809759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.810064 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.810206 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.811062 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.811219 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.811431 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.811573 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.811713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.811835 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.811954 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.812085 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.812085 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.812304 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.812423 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.812542 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.812663 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.812787 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.812900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.813025 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.813135 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.813254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.813527 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.813657 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.813859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.814113 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.814282 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.814503 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.814632 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.814813 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.815163 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.815284 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.815645 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.815768 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.816078 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.816210 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.816417 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.816672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.816851 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.817102 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.817223 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.817574 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.817720 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.817967 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.818183 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.818331 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.818581 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.818745 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.818894 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.819205 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.819385 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.819683 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.819975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.820077 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.820457 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.820593 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.820780 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.821024 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.821211 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.821366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.821703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.821842 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.822036 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.822367 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.822458 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.822694 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.822937 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.823038 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.823285 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.823423 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.823691 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.823846 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.824010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.824114 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.824363 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.824459 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.824689 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.824806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.825014 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.825185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.825341 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.825511 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.825881 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.825991 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.826191 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.826302 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.826561 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.826655 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.826897 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.827233 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.827325 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.827586 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.827916 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.828050 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.828257 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.828457 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.828566 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.828866 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.829008 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.829186 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.829292 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.829505 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.849086 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.849086 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.850458 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.851437 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.851892 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.852172 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.852493 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.853719 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.854515 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.854515 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.855783 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.855783 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.855783 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.856293 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.856420 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.856420 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.856664 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.856797 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.856797 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.857115 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.857656 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.858244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.858655 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.858655 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.859394 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.860303 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.860866 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.861176 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.861877 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.862199 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.862496 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.862630 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.862820 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.863004 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.863137 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.863210 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.863277 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.863461 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.863586 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.863733 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.863733 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.863973 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.863973 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.864289 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.864364 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.864364 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.864464 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.864559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.864559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.864902 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.865095 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.865171 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.865475 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.865475 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.865669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.865771 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.865879 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.866063 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.866166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.866166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.866501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.866501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.866744 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.866870 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.866996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.867130 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.867253 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.867393 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.867528 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.867667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.867791 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.867791 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.868042 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.868166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.868166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.868393 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.868498 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.868576 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.868644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.868644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.868765 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.868850 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.868928 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.868996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.868996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.869124 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.869192 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.869258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.869325 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.869431 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.869514 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.869584 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.869652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.869717 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.869784 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.869784 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.869958 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.870031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.870031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.870150 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.870216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.870282 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.870395 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.870472 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.870540 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.870606 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.870606 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.870606 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.870788 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.870854 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.870920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.870920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.870920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.871100 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.871168 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.871234 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.871234 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.871427 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.871502 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.871571 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.871645 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.871715 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.871782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.871849 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.871916 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.871916 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872046 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872115 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872115 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872236 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872304 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872304 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872433 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.872795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.873301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.873372 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.873372 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.873372 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.873610 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.873679 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.873746 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.873746 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.873875 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.873944 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.874011 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.874079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.874079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.874247 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.874328 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.874401 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.874469 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.874536 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.874603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.874603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.874731 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.874801 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.874801 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.874921 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.875027 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.875027 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.875208 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.875304 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.875304 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.875505 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.875598 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.875725 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.875801 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.875801 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.875925 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.876031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.876031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.876209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.876286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.876286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.876398 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.876454 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.876454 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.876739 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.876854 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.876854 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.877053 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.877129 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.877129 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.877264 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.877332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.877332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.877454 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.877521 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.877521 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.877653 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.877759 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.878015 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.878090 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.878347 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.878699 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.878777 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.879018 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.879288 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.879403 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.879712 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.879945 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.880029 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.880334 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.880570 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.880647 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.880882 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 01:05:07.881114 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.881658 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.882182 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.882733 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.883324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.883942 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.884487 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.885000 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.885510 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.886021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.886576 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.887103 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.887646 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.888152 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.888658 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.889219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.889763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.890173 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.890690 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.891231 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.891654 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.892685 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.892685 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.893249 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.893779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.894248 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.894803 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.895286 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.895897 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.896332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.896854 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.897445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.898029 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.898663 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.899279 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.899902 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.900536 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.901160 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.901789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.902398 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.903031 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.903727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.904353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.904960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.905612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.906100 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.906442 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.907094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.907094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.907526 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.907793 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.908677 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.909174 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.909504 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.909848 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.910183 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.910523 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.910861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.911190 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.911557 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.911884 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.912209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.912533 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.912922 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.913181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.913525 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.913860 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.914184 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.914513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.914926 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.915274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.915791 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.916362 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.917264 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.917462 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.918460 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.918805 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.919209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.919523 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.919910 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.920477 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.921033 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:05:07.921487 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 01:05:07.951149 n-d-master-1 devstack@n-api.service[119474]: INFO dbcounter [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] Registered counter for database nova_api Jul 31 01:05:07.972793 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_db.sqlalchemy.engines [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 01:05:07.979913 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writer thread running {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 01:05:08.011456 n-d-master-1 devstack@n-api.service[119475]: INFO dbcounter [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] Registered counter for database nova_api Jul 31 01:05:08.033795 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_db.sqlalchemy.engines [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 01:05:08.037332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.context [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b79bbab3-22fe-4aca-b591-999750c84479(cell1) {{(pid=119474) load_cells /opt/stack/nova/nova/context.py:464}} Jul 31 01:05:08.041581 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:08.041840 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writer thread running {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 01:05:08.043206 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:08.044039 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:08.046085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:08.048161 n-d-master-1 devstack@n-api.service[119474]: INFO dbcounter [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] Registered counter for database nova_cell0 Jul 31 01:05:08.052946 n-d-master-1 devstack@n-api.service[119474]: INFO dbcounter [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] Registered counter for database nova_cell1 Jul 31 01:05:08.061482 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_db.sqlalchemy.engines [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 01:05:08.067691 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writer thread running {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 01:05:08.069440 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_db.sqlalchemy.engines [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 01:05:08.103523 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.context [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b79bbab3-22fe-4aca-b591-999750c84479(cell1) {{(pid=119475) load_cells /opt/stack/nova/nova/context.py:464}} Jul 31 01:05:08.107778 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:08.109442 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:08.110299 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:08.113010 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:08.115097 n-d-master-1 devstack@n-api.service[119475]: INFO dbcounter [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] Registered counter for database nova_cell0 Jul 31 01:05:08.119517 n-d-master-1 devstack@n-api.service[119475]: INFO dbcounter [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] Registered counter for database nova_cell1 Jul 31 01:05:08.126783 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_db.sqlalchemy.engines [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 01:05:08.130185 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_db.sqlalchemy.engines [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 01:05:08.136647 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writer thread running {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 01:05:08.138734 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writer thread running {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 01:05:08.233027 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writer thread running {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 01:05:08.242672 n-d-master-1 devstack@n-api.service[119474]: INFO dbcounter [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] Registered counter for database nova_cell0 Jul 31 01:05:08.250443 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_db.sqlalchemy.engines [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 01:05:08.255524 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writer thread running {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 01:05:08.295575 n-d-master-1 devstack@n-api.service[119475]: INFO dbcounter [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] Registered counter for database nova_cell0 Jul 31 01:05:08.303652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_db.sqlalchemy.engines [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 01:05:08.309013 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writer thread running {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 01:05:08.616142 n-d-master-1 devstack@n-api.service[119474]: WARNING keystonemiddleware.auth_token [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 01:05:08.623379 n-d-master-1 devstack@n-api.service[119474]: WARNING keystonemiddleware.auth_token [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 01:05:08.649015 n-d-master-1 devstack@n-api.service[119475]: WARNING keystonemiddleware.auth_token [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 01:05:08.656334 n-d-master-1 devstack@n-api.service[119475]: WARNING keystonemiddleware.auth_token [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 01:05:08.963386 n-d-master-1 devstack@n-api.service[119474]: WARNING keystonemiddleware.auth_token [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 01:05:08.969354 n-d-master-1 devstack@n-api.service[119474]: WARNING keystonemiddleware.auth_token [None req-39c2345e-5339-4f2b-90fd-92be1133afde None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 01:05:08.974602 n-d-master-1 devstack@n-api.service[119474]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5646986129c0 pid: 119474 (default app) Jul 31 01:05:08.998174 n-d-master-1 devstack@n-api.service[119475]: WARNING keystonemiddleware.auth_token [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 01:05:09.004721 n-d-master-1 devstack@n-api.service[119475]: WARNING keystonemiddleware.auth_token [None req-899510e8-a5d3-423f-9075-23209f93de8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 01:05:09.009993 n-d-master-1 devstack@n-api.service[119475]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5646986129c0 pid: 119475 (default app) Jul 31 01:05:56.317309 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:56.318535 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:56.319513 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:56.320331 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:56.711067 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:56.714059 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:56.715385 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:56.716564 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:57.784659 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-50e1c47c-acd5-4c8f-bdc5-898a7eff7eaa tempest-FlavorsV261TestJSON-819448144 tempest-FlavorsV261TestJSON-819448144-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-831743424", "id": 78892192, "os-flavor-access:is_public": "True"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:05:57.805294 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:05:57.805294 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:05:57.888560 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-50e1c47c-acd5-4c8f-bdc5-898a7eff7eaa tempest-FlavorsV261TestJSON-819448144 tempest-FlavorsV261TestJSON-819448144-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 461 microversion: 2.61 time: 1.578471 Jul 31 01:05:57.903700 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1/1] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:05:56 2022] POST /compute/v2.1/flavors => generated 461 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:05:58.038130 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-47d16d33-a223-4b27-9af6-f81a6298583e tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:05:58.040948 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:05:58.040948 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:05:58.042247 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47d16d33-a223-4b27-9af6-f81a6298583e tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:58.042706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47d16d33-a223-4b27-9af6-f81a6298583e tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:58.043565 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47d16d33-a223-4b27-9af6-f81a6298583e tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:58.044018 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47d16d33-a223-4b27-9af6-f81a6298583e tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:58.143139 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-47d16d33-a223-4b27-9af6-f81a6298583e tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.241285 Jul 31 01:05:58.144026 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2/2] 10.222.0.45 () {58 vars in 1176 bytes} [Sun Jul 31 01:05:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:05:58.169714 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-80578b67-db05-4562-80eb-7e4efa769749 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Calling method '.version_select at 0x7fede81aeee0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:05:58.174731 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:05:58.174731 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:05:58.190649 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-80578b67-db05-4562-80eb-7e4efa769749 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b79bbab3-22fe-4aca-b591-999750c84479(cell1) {{(pid=119475) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 31 01:05:58.193268 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80578b67-db05-4562-80eb-7e4efa769749 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:58.193733 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80578b67-db05-4562-80eb-7e4efa769749 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:58.255222 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80578b67-db05-4562-80eb-7e4efa769749 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:58.255612 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80578b67-db05-4562-80eb-7e4efa769749 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:58.290903 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80578b67-db05-4562-80eb-7e4efa769749 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:58.291436 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80578b67-db05-4562-80eb-7e4efa769749 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:58.299986 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-80578b67-db05-4562-80eb-7e4efa769749 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.605437 Jul 31 01:05:58.300903 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1208 bytes} [Sun Jul 31 01:05:56 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:05:58.481163 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5748186a-bb73-4720-a4d8-65ef5fac7cde tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '.version_select at 0x7fede7fe1c10>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:05:58.482220 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:05:58.482220 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:05:58.495441 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5748186a-bb73-4720-a4d8-65ef5fac7cde tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b79bbab3-22fe-4aca-b591-999750c84479(cell1) {{(pid=119474) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 31 01:05:58.496308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5748186a-bb73-4720-a4d8-65ef5fac7cde tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:58.497301 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5748186a-bb73-4720-a4d8-65ef5fac7cde tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:58.567579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5748186a-bb73-4720-a4d8-65ef5fac7cde tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:58.568347 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5748186a-bb73-4720-a4d8-65ef5fac7cde tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:58.601938 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5748186a-bb73-4720-a4d8-65ef5fac7cde tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:58.605603 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5748186a-bb73-4720-a4d8-65ef5fac7cde tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:58.624315 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5748186a-bb73-4720-a4d8-65ef5fac7cde tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.479222 Jul 31 01:05:58.632407 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3/4] 10.222.0.45 () {58 vars in 1167 bytes} [Sun Jul 31 01:05:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:05:58.736138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-00deabc0-5910-4601-8c26-7a681b8d61e3 tempest-AZAdminV2TestJSON-1882189385 tempest-AZAdminV2TestJSON-1882189385-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:05:58.738808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00deabc0-5910-4601-8c26-7a681b8d61e3 tempest-AZAdminV2TestJSON-1882189385 tempest-AZAdminV2TestJSON-1882189385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:58.739410 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00deabc0-5910-4601-8c26-7a681b8d61e3 tempest-AZAdminV2TestJSON-1882189385 tempest-AZAdminV2TestJSON-1882189385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:58.740235 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00deabc0-5910-4601-8c26-7a681b8d61e3 tempest-AZAdminV2TestJSON-1882189385 tempest-AZAdminV2TestJSON-1882189385-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:58.740677 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00deabc0-5910-4601-8c26-7a681b8d61e3 tempest-AZAdminV2TestJSON-1882189385 tempest-AZAdminV2TestJSON-1882189385-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:58.803669 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-00deabc0-5910-4601-8c26-7a681b8d61e3 tempest-AZAdminV2TestJSON-1882189385 tempest-AZAdminV2TestJSON-1882189385-project-admin] 10.222.0.45 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.501305 Jul 31 01:05:58.811771 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2/5] 10.222.0.45 () {58 vars in 1164 bytes} [Sun Jul 31 01:05:58 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:05:58.826259 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-036ded48-ebb0-404f-a089-de05d3e9140f tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1515918357", "id": 1842251847, "os-flavor-access:is_public": "False"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:05:58.830036 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:05:58.830036 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:05:58.847628 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-036ded48-ebb0-404f-a089-de05d3e9140f tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.213160 Jul 31 01:05:58.857051 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 4/6] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:05:58 2022] POST /compute/v2.1/flavors => generated 439 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:05:58.863200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c54f632-fb8c-4a7d-9663-2107a58eacc8 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1106198782"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:05:58.865877 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:05:58.865877 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:05:58.866702 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.aggregate [None req-2c54f632-fb8c-4a7d-9663-2107a58eacc8 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Generated uuid 11de995a-6a08-47d6-a6b1-baee9b26dc88 for aggregate {{(pid=119474) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:05:58.997670 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2c54f632-fb8c-4a7d-9663-2107a58eacc8 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.138039 Jul 31 01:05:59.005240 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 5/7] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:05:58 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:05:59.027693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c6605e65-4620-49a7-9479-f98bc33f6555 tempest-AZAdminV2TestJSON-1882189385 tempest-AZAdminV2TestJSON-1882189385-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:05:59.028920 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:05:59.028920 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:05:59.030577 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6605e65-4620-49a7-9479-f98bc33f6555 tempest-AZAdminV2TestJSON-1882189385 tempest-AZAdminV2TestJSON-1882189385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:59.031245 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6605e65-4620-49a7-9479-f98bc33f6555 tempest-AZAdminV2TestJSON-1882189385 tempest-AZAdminV2TestJSON-1882189385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:59.032373 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6605e65-4620-49a7-9479-f98bc33f6555 tempest-AZAdminV2TestJSON-1882189385 tempest-AZAdminV2TestJSON-1882189385-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:59.033034 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6605e65-4620-49a7-9479-f98bc33f6555 tempest-AZAdminV2TestJSON-1882189385 tempest-AZAdminV2TestJSON-1882189385-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:59.042424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ebca369c-74a6-42d8-8b33-17a71a226e50 tempest-FlavorsV261TestJSON-350909870 tempest-FlavorsV261TestJSON-350909870-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:05:59.066101 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c6605e65-4620-49a7-9479-f98bc33f6555 tempest-AZAdminV2TestJSON-1882189385 tempest-AZAdminV2TestJSON-1882189385-project-admin] 10.222.0.45 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.059412 Jul 31 01:05:59.067131 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 6/8] 10.222.0.45 () {58 vars in 1185 bytes} [Sun Jul 31 01:05:59 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:05:59.085219 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-04c62a1a-d831-4d09-82c0-2fffbe3b9817 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9d0f1d8a4f7e4e9bb33007fe146dc574"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:05:59.089610 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ebca369c-74a6-42d8-8b33-17a71a226e50 tempest-FlavorsV261TestJSON-350909870 tempest-FlavorsV261TestJSON-350909870-project] 10.222.0.45 "GET /compute/v2.1/flavors/78892192" status: 200 len: 461 microversion: 2.61 time: 0.281436 Jul 31 01:05:59.093676 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:05:59.093676 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:05:59.094152 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3/9] 10.222.0.45 () {60 vars in 1193 bytes} [Sun Jul 31 01:05:58 2022] GET /compute/v2.1/flavors/78892192 => generated 461 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:05:59.103304 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9d3a0ebb-040c-465b-ad65-39fdb9d12ed2 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:05:59.107698 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:05:59.107698 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:05:59.157622 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d3a0ebb-040c-465b-ad65-39fdb9d12ed2 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:05:59.158358 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d3a0ebb-040c-465b-ad65-39fdb9d12ed2 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:05:59.686530 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-04c62a1a-d831-4d09-82c0-2fffbe3b9817 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1842251847/action" status: 200 len: 97 microversion: 2.1 time: 0.618086 Jul 31 01:05:59.688066 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 7/10] 10.222.0.45 () {60 vars in 1200 bytes} [Sun Jul 31 01:05:59 2022] POST /compute/v2.1/flavors/1842251847/action => generated 97 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:05:59.699570 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3bd6b877-1731-4d13-8ab8-3c2a5b148722 tempest-FlavorsV261TestJSON-819448144 tempest-FlavorsV261TestJSON-819448144-project-admin] Action: 'update', calling method: .version_select at 0x7fede8581a60>, body: {"flavor": {"description": "new"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:05:59.724476 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:05:59.724476 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:05:59.784690 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3bd6b877-1731-4d13-8ab8-3c2a5b148722 tempest-FlavorsV261TestJSON-819448144 tempest-FlavorsV261TestJSON-819448144-project-admin] 10.222.0.45 "PUT /compute/v2.1/flavors/78892192" status: 200 len: 462 microversion: 2.61 time: 0.095383 Jul 31 01:05:59.793236 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 8/11] 10.222.0.45 () {62 vars in 1213 bytes} [Sun Jul 31 01:05:59 2022] PUT /compute/v2.1/flavors/78892192 => generated 462 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:05:59.962780 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5b1feddf-63f9-4bff-b96c-bece69ce5286 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1045435367", "id": 988439706, "os-flavor-access:is_public": "True"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:05:59.966659 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:05:59.966659 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:05:59.990014 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5b1feddf-63f9-4bff-b96c-bece69ce5286 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.203186 Jul 31 01:05:59.999711 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 9/12] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:05:59 2022] POST /compute/v2.1/flavors => generated 427 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:00.002073 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d92d8d9c-7d1f-4153-aa91-fb7214dd2542 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9d0f1d8a4f7e4e9bb33007fe146dc574"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:00.078477 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9d3a0ebb-040c-465b-ad65-39fdb9d12ed2 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.982652 Jul 31 01:06:00.079093 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 4/13] 10.222.0.45 () {60 vars in 1191 bytes} [Sun Jul 31 01:05:59 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:00.091601 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ab6450a0-a74b-478b-97e6-37740ba5f829 tempest-FlavorsV261TestJSON-350909870 tempest-FlavorsV261TestJSON-350909870-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:00.126243 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ab6450a0-a74b-478b-97e6-37740ba5f829 tempest-FlavorsV261TestJSON-350909870 tempest-FlavorsV261TestJSON-350909870-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 6700 microversion: 2.61 time: 0.038748 Jul 31 01:06:00.143114 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 5/14] 10.222.0.45 () {60 vars in 1187 bytes} [Sun Jul 31 01:06:00 2022] GET /compute/v2.1/flavors/detail => generated 6700 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:06:00.143114 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ee9cdc37-5a65-4914-8e0d-16cfed1eb5b0 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:00.143114 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:00.143114 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:00.192608 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ee9cdc37-5a65-4914-8e0d-16cfed1eb5b0 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/988439706" status: 202 len: 0 microversion: 2.1 time: 0.059276 Jul 31 01:06:00.193863 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 6/15] 10.222.0.45 () {58 vars in 1158 bytes} [Sun Jul 31 01:06:00 2022] DELETE /compute/v2.1/flavors/988439706 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:06:00.203415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7d1ed626-1ff0-4759-80f8-49db44f5061d tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:00.205389 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-d92d8d9c-7d1f-4153-aa91-fb7214dd2542 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 9d0f1d8a4f7e4e9bb33007fe146dc574 combination. Jul 31 01:06:00.207730 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:00.207730 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d92d8d9c-7d1f-4153-aa91-fb7214dd2542 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Request method failure captured: Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/flavors/1842251847/action HTTP/1.1 Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 67 Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dVzy4gS-UPbu3wRcJC8b_lE_goUEdbUMZLtG18j56oiA2HAVnjmCreHcF7hDGa94zfWioM0kA0hAmDKGA7PQOrvPBWFkvQukVsxCsACrErFTrn9XltXSk35nnr8cbsOooTz7bkPAphdVSh0JY-eJWALwofNA56yZl3vLlIiC0EA_RU Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: ec8e200820fd4f2bbe83fbbbd175c18b Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-743278349 Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:06:00.225055 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:06:00.226580 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec8e200820fd4f2bbe83fbbbd175c18b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec8e200820fd4f2bbe83fbbbd175c18b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec8e200820fd4f2bbe83fbbbd175c18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec8e200820fd4f2bbe83fbbbd175c18b", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:00.226580 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-743278349 Jul 31 01:06:00.226580 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: ec8e200820fd4f2bbe83fbbbd175c18b Jul 31 01:06:00.226580 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-743278349 Jul 31 01:06:00.226580 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin Jul 31 01:06:00.226580 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:00.226580 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:00.226580 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: e95c1144af444d28a2802ba27d9e2834 Jul 31 01:06:00.226580 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin Jul 31 01:06:00.226580 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:06:00.226580 n-d-master-1 devstack@n-api.service[119474]: {"addTenantAccess": {"tenant": "9d0f1d8a4f7e4e9bb33007fe146dc574"}} Jul 31 01:06:00.226580 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: exception: Flavor access already exists for flavor 16 and project 9d0f1d8a4f7e4e9bb33007fe146dc574 combination. Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '1842251847', 'body': {'addTenantAccess': {'tenant': '9d0f1d8a4f7e4e9bb33007fe146dc574'}}} Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result.read() Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:06:00.227660 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-9d0f1d8a4f7e4e9bb33007fe146dc574' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi session.flush() Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 31 01:06:00.228808 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 31 01:06:00.230161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:06:00.231847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result.read() Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-9d0f1d8a4f7e4e9bb33007fe146dc574' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 31, 1, 6, 0, 193019), 'updated_at': None, 'flavor_id': 16, 'project_id': '9d0f1d8a4f7e4e9bb33007fe146dc574'}] Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:00.232723 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 9d0f1d8a4f7e4e9bb33007fe146dc574 combination. Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:00.233867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 9d0f1d8a4f7e4e9bb33007fe146dc574 combination. Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:00.236728 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:00.239213 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 9d0f1d8a4f7e4e9bb33007fe146dc574 combination. Jul 31 01:06:00.239213 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.239213 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d92d8d9c-7d1f-4153-aa91-fb7214dd2542 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 9d0f1d8a4f7e4e9bb33007fe146dc574 combination. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:00.239213 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d92d8d9c-7d1f-4153-aa91-fb7214dd2542 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1842251847/action" status: 409 len: 152 microversion: 2.1 time: 0.237299 Jul 31 01:06:00.239213 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 10/16] 10.222.0.45 () {60 vars in 1200 bytes} [Sun Jul 31 01:05:59 2022] POST /compute/v2.1/flavors/1842251847/action => generated 152 bytes in 243 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:06:00.243195 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8c1e439c-e057-4412-8069-538b7f9f3c08 tempest-FlavorsV261TestJSON-350909870 tempest-FlavorsV261TestJSON-350909870-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:00.251851 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7d1ed626-1ff0-4759-80f8-49db44f5061d tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:00.252477 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7d1ed626-1ff0-4759-80f8-49db44f5061d tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:00.276747 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8c1e439c-e057-4412-8069-538b7f9f3c08 tempest-FlavorsV261TestJSON-350909870 tempest-FlavorsV261TestJSON-350909870-project] 10.222.0.45 "GET /compute/v2.1/flavors" status: 200 len: 3150 microversion: 2.61 time: 0.037652 Jul 31 01:06:00.277650 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 11/17] 10.222.0.45 () {60 vars in 1166 bytes} [Sun Jul 31 01:06:00 2022] GET /compute/v2.1/flavors => generated 3150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:06:00.286875 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-7d1ed626-1ff0-4759-80f8-49db44f5061d tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-master-1. Jul 31 01:06:00.292219 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8d7bb8a0-ce73-4116-aed9-6ec6a34c54c7 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7d1ed626-1ff0-4759-80f8-49db44f5061d tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Request method failure captured: Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 39 Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dV0Qv9DBEc5_aQcul5-AcfiVWHPU7-yr1F_vYEbPK677XUQUK-je6FFKN1m6Ll9WbjyJcGYXWT4Qq2K_K3MT6h3pCsgLJl2PsRrhf0q9qvZFBvWgDbNzYzG4sjmb5XnuJ8pFmaDdO8H-b5ndeLEekVzbO-C42Xeb7HCIO5VYxgj9fg Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 6def54c32aa54cffa86e5494da0f4b34 Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:06:00.316559 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:06:00.317606 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6def54c32aa54cffa86e5494da0f4b34", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:00.317606 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:00.317606 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 6def54c32aa54cffa86e5494da0f4b34 Jul 31 01:06:00.317606 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:00.317606 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin Jul 31 01:06:00.317606 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:00.317606 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:00.317606 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 41d5ded808be42ec8c0b1134191742e6 Jul 31 01:06:00.317606 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin Jul 31 01:06:00.317606 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:06:00.317606 n-d-master-1 devstack@n-api.service[119475]: {"add_host": {"host": "n-h1-master-1"}} Jul 31 01:06:00.317606 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:00.317606 n-d-master-1 devstack@n-api.service[119475]: exception: Aggregate 1 already has host n-h1-master-1. Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result.read() Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:06:00.318243 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi session.flush() Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 31 01:06:00.319127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 31 01:06:00.320105 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:06:00.320945 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result.read() Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 31, 1, 6, 0, 272947), 'updated_at': None, 'host': 'n-h1-master-1', 'aggregate_id': 1}] Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:00.323723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6594, in add_host_to_aggregate Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-master-1. Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.326358 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-master-1. Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:00.328735 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:00.331616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-master-1. Jul 31 01:06:00.331616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:00.331616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7d1ed626-1ff0-4759-80f8-49db44f5061d tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-master-1. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:00.331616 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7d1ed626-1ff0-4759-80f8-49db44f5061d tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.123276 Jul 31 01:06:00.331616 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 7/18] 10.222.0.45 () {60 vars in 1191 bytes} [Sun Jul 31 01:06:00 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 31 01:06:00.331616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3d1728ab-c57a-4e3c-8143-844479242d0e tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9d0f1d8a4f7e4e9bb33007fe146dc574"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:00.331970 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:00.331970 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:00.346792 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8d7bb8a0-ce73-4116-aed9-6ec6a34c54c7 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.068051 Jul 31 01:06:00.347396 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 12/19] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:00 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:00.361199 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5e27beef-46e8-4e78-9ffe-9783727458b2 tempest-FlavorsV261TestJSON-819448144 tempest-FlavorsV261TestJSON-819448144-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:00.361199 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:00.361199 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:00.391122 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5e27beef-46e8-4e78-9ffe-9783727458b2 tempest-FlavorsV261TestJSON-819448144 tempest-FlavorsV261TestJSON-819448144-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/78892192" status: 202 len: 0 microversion: 2.61 time: 0.038441 Jul 31 01:06:00.392090 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 13/20] 10.222.0.45 () {60 vars in 1196 bytes} [Sun Jul 31 01:06:00 2022] DELETE /compute/v2.1/flavors/78892192 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:06:00.398527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e012486a-6d58-40be-862f-938d1278ff5e tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:00.402088 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:00.402088 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:00.411617 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e012486a-6d58-40be-862f-938d1278ff5e tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:00.412077 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e012486a-6d58-40be-862f-938d1278ff5e tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:00.699677 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3d1728ab-c57a-4e3c-8143-844479242d0e tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1842251847/action" status: 200 len: 21 microversion: 2.1 time: 0.378455 Jul 31 01:06:00.701490 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 8/21] 10.222.0.45 () {60 vars in 1200 bytes} [Sun Jul 31 01:06:00 2022] POST /compute/v2.1/flavors/1842251847/action => generated 21 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:06:00.719856 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-31f7d394-ab15-4612-91b8-739b8c2bf5f4 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1587133599", "id": 105691049, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:00.760772 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:00.760772 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:00.791683 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-31f7d394-ab15-4612-91b8-739b8c2bf5f4 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.088809 Jul 31 01:06:00.800791 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 9/22] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:00 2022] POST /compute/v2.1/flavors => generated 414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:00.800791 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2fed0bac-13d3-4866-aac1-87cc7f93ef45 tempest-FlavorsV261TestJSON-819448144 tempest-FlavorsV261TestJSON-819448144-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:00.841813 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2fed0bac-13d3-4866-aac1-87cc7f93ef45 tempest-FlavorsV261TestJSON-819448144 tempest-FlavorsV261TestJSON-819448144-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.61 time: 0.045897 Jul 31 01:06:00.842426 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 10/23] 10.222.0.45 () {60 vars in 1187 bytes} [Sun Jul 31 01:06:00 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:06:00.848245 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-07dc76ec-38ca-4112-94cb-30b7435cf051 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:00.849922 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:00.849922 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:00.871844 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-07dc76ec-38ca-4112-94cb-30b7435cf051 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1842251847" status: 202 len: 0 microversion: 2.1 time: 0.027412 Jul 31 01:06:00.877062 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 11/24] 10.222.0.45 () {58 vars in 1161 bytes} [Sun Jul 31 01:06:00 2022] DELETE /compute/v2.1/flavors/1842251847 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:06:00.884185 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9479c527-f8aa-411f-8cec-42c3d5002806 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:00.916929 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9479c527-f8aa-411f-8cec-42c3d5002806 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.038448 Jul 31 01:06:00.918190 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 12/25] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:00 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:00.925424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fabd927d-b5d0-4a3f-9a61-48ede1798ad8 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:00.963888 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fabd927d-b5d0-4a3f-9a61-48ede1798ad8 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.042772 Jul 31 01:06:00.965185 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 13/26] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:00 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:01.004327 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-aee78ce1-1ff2-40f2-a78e-2dd6aeda26aa tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:01.073316 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-aee78ce1-1ff2-40f2-a78e-2dd6aeda26aa tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/105691049" status: 202 len: 0 microversion: 2.1 time: 0.092892 Jul 31 01:06:01.077629 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 14/27] 10.222.0.45 () {58 vars in 1158 bytes} [Sun Jul 31 01:06:00 2022] DELETE /compute/v2.1/flavors/105691049 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:06:01.097724 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4300b12b-c29f-41a5-b5f1-75259e797782 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1988486779", "id": 1711244623, "os-flavor-access:is_public": "True"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:01.176377 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4300b12b-c29f-41a5-b5f1-75259e797782 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.092854 Jul 31 01:06:01.179090 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 15/28] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:01 2022] POST /compute/v2.1/flavors => generated 438 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:01.196844 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-69c0eba3-62cc-4b4b-ac87-712df992bb65 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:01.264357 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-69c0eba3-62cc-4b4b-ac87-712df992bb65 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5419 microversion: 2.1 time: 0.080907 Jul 31 01:06:01.281245 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 16/29] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:01 2022] GET /compute/v2.1/flavors/detail => generated 5419 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:01.297013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8b988cf5-b39c-4824-ae98-b0dff6c0dd89 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:01.297829 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:01.297829 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:01.313545 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-8b988cf5-b39c-4824-ae98-b0dff6c0dd89 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8b988cf5-b39c-4824-ae98-b0dff6c0dd89 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Request method failure captured: Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/flavors/1711244623/os-flavor-access HTTP/1.1 Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dVzy4gS-UPbu3wRcJC8b_lE_goUEdbUMZLtG18j56oiA2HAVnjmCreHcF7hDGa94zfWioM0kA0hAmDKGA7PQOrvPBWFkvQukVsxCsACrErFTrn9XltXSk35nnr8cbsOooTz7bkPAphdVSh0JY-eJWALwofNA56yZl3vLlIiC0EA_RU Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: ec8e200820fd4f2bbe83fbbbd175c18b Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-743278349 Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:06:01.316588 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:06:01.318001 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec8e200820fd4f2bbe83fbbbd175c18b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec8e200820fd4f2bbe83fbbbd175c18b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec8e200820fd4f2bbe83fbbbd175c18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec8e200820fd4f2bbe83fbbbd175c18b", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:01.318001 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-743278349 Jul 31 01:06:01.318001 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: ec8e200820fd4f2bbe83fbbbd175c18b Jul 31 01:06:01.318001 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-743278349 Jul 31 01:06:01.318001 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin Jul 31 01:06:01.318001 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:01.318001 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:01.318001 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: e95c1144af444d28a2802ba27d9e2834 Jul 31 01:06:01.318001 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin Jul 31 01:06:01.318001 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:01.318001 n-d-master-1 devstack@n-api.service[119475]: exception: Access list not available for public flavors. Jul 31 01:06:01.318001 n-d-master-1 devstack@n-api.service[119475]: action_args: {'flavor_id': '1711244623'} Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 31 01:06:01.318862 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:01.320133 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8b988cf5-b39c-4824-ae98-b0dff6c0dd89 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:01.321132 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8b988cf5-b39c-4824-ae98-b0dff6c0dd89 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/1711244623/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.038666 Jul 31 01:06:01.322094 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 17/30] 10.222.0.45 () {58 vars in 1209 bytes} [Sun Jul 31 01:06:01 2022] GET /compute/v2.1/flavors/1711244623/os-flavor-access => generated 91 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:06:01.332183 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3b59d9c5-a4fc-4989-9de6-23ea9cffe29f tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1444580170", "id": 1850644785, "os-flavor-access:is_public": "True"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:01.370860 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3b59d9c5-a4fc-4989-9de6-23ea9cffe29f tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.046953 Jul 31 01:06:01.371508 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 18/31] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:01 2022] POST /compute/v2.1/flavors => generated 429 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:01.411053 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7a7a3cea-9cb5-481c-9508-0f8b236dd609 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:01.457785 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7a7a3cea-9cb5-481c-9508-0f8b236dd609 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1711244623" status: 202 len: 0 microversion: 2.1 time: 0.085166 Jul 31 01:06:01.462392 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 19/32] 10.222.0.45 () {58 vars in 1161 bytes} [Sun Jul 31 01:06:01 2022] DELETE /compute/v2.1/flavors/1711244623 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:06:01.468060 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9b8fcc48-09c4-4d4d-b94b-de4f7f070009 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:01.492624 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e012486a-6d58-40be-862f-938d1278ff5e tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 1.096656 Jul 31 01:06:01.494964 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 14/33] 10.222.0.45 () {60 vars in 1191 bytes} [Sun Jul 31 01:06:00 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:01.520504 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a5e78714-8411-4d84-961b-e28c1df0c77c tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:01.527544 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9b8fcc48-09c4-4d4d-b94b-de4f7f070009 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1850644785" status: 202 len: 0 microversion: 2.1 time: 0.063906 Jul 31 01:06:01.528855 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 20/34] 10.222.0.45 () {58 vars in 1161 bytes} [Sun Jul 31 01:06:01 2022] DELETE /compute/v2.1/flavors/1850644785 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:06:01.544114 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7d861d2-1bf1-4a64-8d2b-93e037e5880c tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:01.546128 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:01.546128 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:01.578141 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a5e78714-8411-4d84-961b-e28c1df0c77c tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081803 Jul 31 01:06:01.584848 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 15/35] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:01.602205 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7de4f8cd-4d4e-4cb9-bd13-22bd02095fe3 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:01.609011 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a7d861d2-1bf1-4a64-8d2b-93e037e5880c tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.078693 Jul 31 01:06:01.610016 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 21/36] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:06:01 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:01.621582 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f2c7b74e-f0a4-4de1-98bc-d8b792b38a8e tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1498693721", "id": 895402760, "os-flavor-access:is_public": "False"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:01.626798 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:01.626798 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:01.652022 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:DELETE=18 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:01.656548 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7de4f8cd-4d4e-4cb9-bd13-22bd02095fe3 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068958 Jul 31 01:06:01.664581 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f2c7b74e-f0a4-4de1-98bc-d8b792b38a8e tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.052840 Jul 31 01:06:01.675913 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 22/37] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:01 2022] POST /compute/v2.1/flavors => generated 436 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:01.676101 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 16/38] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:01.676197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d7629d33-b5c2-4b3c-a287-cb766efba920 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1633378297"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:01.678810 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a1e793d1-775e-4a15-afe8-5032c9d2110c tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-773946934"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:01.679531 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:01.679531 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:01.682608 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:01.682608 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:01.684119 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.aggregate [None req-a1e793d1-775e-4a15-afe8-5032c9d2110c tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Generated uuid f83d870d-106d-4906-8702-a87c2358a1f4 for aggregate {{(pid=119474) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:01.685829 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.aggregate [None req-d7629d33-b5c2-4b3c-a287-cb766efba920 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Generated uuid 1558cfa8-ed55-4d7b-ab1b-27f337273c8f for aggregate {{(pid=119475) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:01.712985 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a1e793d1-775e-4a15-afe8-5032c9d2110c tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.037939 Jul 31 01:06:01.721531 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 17/39] 10.222.0.45 () {62 vars in 1205 bytes} [Sun Jul 31 01:06:01 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:01.721531 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1583cdbb-ef46-4879-9141-fcc240ce4d16 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-830566415", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:01.724529 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:01.724529 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:01.745249 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d7629d33-b5c2-4b3c-a287-cb766efba920 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077110 Jul 31 01:06:01.746379 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1583cdbb-ef46-4879-9141-fcc240ce4d16 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.030989 Jul 31 01:06:01.746929 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 23/40] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:06:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:01.747277 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 18/41] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:01 2022] POST /compute/v2.1/flavors => generated 506 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:01.761014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5fe35e74-1d45-4dbf-a612-406d5bf5ae1c tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1058345266"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:01.857502 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:01.857502 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:01.928179 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5fe35e74-1d45-4dbf-a612-406d5bf5ae1c tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-aggregates/2" status: 200 len: 299 microversion: 2.41 time: 0.171307 Jul 31 01:06:01.929090 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 19/42] 10.222.0.45 () {62 vars in 1210 bytes} [Sun Jul 31 01:06:01 2022] PUT /compute/v2.1/os-aggregates/2 => generated 299 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:02.191666 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-60b206ae-71a0-47e6-918e-10eb868abf72 tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:02.192645 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1fdaf779-3707-4a77-95d5-81edf171cc43 tempest-FlavorsAccessNegativeTestJSON-570050554 tempest-FlavorsAccessNegativeTestJSON-570050554-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9d0f1d8a4f7e4e9bb33007fe146dc574"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:02.195412 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:02.195412 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:02.196387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1fdaf779-3707-4a77-95d5-81edf171cc43 tempest-FlavorsAccessNegativeTestJSON-570050554 tempest-FlavorsAccessNegativeTestJSON-570050554-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '7b168c8581184dd7bed2541f5f1e715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f1d8a4f7e4e9bb33007fe146dc574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:02.198834 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:02.198834 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:02.202319 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-60b206ae-71a0-47e6-918e-10eb868abf72 tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '6914dc05e91240c9a3cca15d4ecfc3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eafe4a206e4141f3b0f07c1aa5e8ffd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1fdaf779-3707-4a77-95d5-81edf171cc43 tempest-FlavorsAccessNegativeTestJSON-570050554 tempest-FlavorsAccessNegativeTestJSON-570050554-project] Request method failure captured: Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/flavors/895402760/action HTTP/1.1 Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 67 Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dVwPPlwqAO28hPbAptNBAehfxRAn5XZNZe6fR35tV0FWp6lU3pyG-wE5-ieJnb_zMFqR0VppFBywJs9tacUTFeTOTmxm_7yJn5ArRRy7tAhoLRmCLH-3ub5aUwbdFrh_OL7M8s8uu4cJ2dGfMARrn-8K2Sd-7e2orHmFXndFlAfSnQ Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 9d0f1d8a4f7e4e9bb33007fe146dc574 Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-570050554 Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:06:02.203072 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:06:02.205128 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9d0f1d8a4f7e4e9bb33007fe146dc574"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9d0f1d8a4f7e4e9bb33007fe146dc574"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9d0f1d8a4f7e4e9bb33007fe146dc574"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9d0f1d8a4f7e4e9bb33007fe146dc574", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:02.205128 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-570050554 Jul 31 01:06:02.205128 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 9d0f1d8a4f7e4e9bb33007fe146dc574 Jul 31 01:06:02.205128 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-570050554 Jul 31 01:06:02.205128 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-FlavorsAccessNegativeTestJSON-570050554-project Jul 31 01:06:02.205128 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:02.205128 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:02.205128 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 7b168c8581184dd7bed2541f5f1e715e Jul 31 01:06:02.205128 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-570050554-project Jul 31 01:06:02.205128 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:06:02.205128 n-d-master-1 devstack@n-api.service[119475]: {"addTenantAccess": {"tenant": "9d0f1d8a4f7e4e9bb33007fe146dc574"}} Jul 31 01:06:02.205128 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '895402760', 'body': {'addTenantAccess': {'tenant': '9d0f1d8a4f7e4e9bb33007fe146dc574'}}} Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:06:02.205885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 31 01:06:02.208178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:02.211455 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1fdaf779-3707-4a77-95d5-81edf171cc43 tempest-FlavorsAccessNegativeTestJSON-570050554 tempest-FlavorsAccessNegativeTestJSON-570050554-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:02.211455 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1fdaf779-3707-4a77-95d5-81edf171cc43 tempest-FlavorsAccessNegativeTestJSON-570050554 tempest-FlavorsAccessNegativeTestJSON-570050554-project] 10.222.0.45 "POST /compute/v2.1/flavors/895402760/action" status: 403 len: 130 microversion: 2.1 time: 0.459630 Jul 31 01:06:02.211455 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 24/43] 10.222.0.45 () {60 vars in 1197 bytes} [Sun Jul 31 01:06:01 2022] POST /compute/v2.1/flavors/895402760/action => generated 130 bytes in 463 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:02.219703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3f9d9fc8-6443-459c-86b4-c8316f2e4258 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-60b206ae-71a0-47e6-918e-10eb868abf72 tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Request method failure captured: Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 39 Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dVxVfU84qM1wJ08a8-FVOA3BqVddY2X1If4ALa4Z2cnxBXV4PcoFyU0K7D-A1zUHNDJwixvpKtxtgrE-EewAsDTO9mrJWDY_5TKmPXQNf8AOgFW5iPmJpSmHqy0brdEQU9-9YIMC3lWxn_L_zFALIoDuxznafLVYyovCANsRP2XNX4 Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: eafe4a206e4141f3b0f07c1aa5e8ffd6 Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:06:02.224845 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:06:02.227166 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eafe4a206e4141f3b0f07c1aa5e8ffd6", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:02.227166 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:02.227166 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: eafe4a206e4141f3b0f07c1aa5e8ffd6 Jul 31 01:06:02.227166 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:02.227166 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AggregatesAdminNegativeTestJSON-1377799865-project Jul 31 01:06:02.227166 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:02.227166 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:02.227166 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 6914dc05e91240c9a3cca15d4ecfc3cf Jul 31 01:06:02.227166 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865-project Jul 31 01:06:02.227166 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:06:02.227166 n-d-master-1 devstack@n-api.service[119474]: {"add_host": {"host": "n-h1-master-1"}} Jul 31 01:06:02.227166 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:02.227166 n-d-master-1 devstack@n-api.service[119474]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:02.228554 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 31 01:06:02.233695 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:02.240595 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:02.240595 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:02.241885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-60b206ae-71a0-47e6-918e-10eb868abf72 tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:02.244168 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-60b206ae-71a0-47e6-918e-10eb868abf72 tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] 10.222.0.45 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.310883 Jul 31 01:06:02.245299 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 20/44] 10.222.0.45 () {60 vars in 1191 bytes} [Sun Jul 31 01:06:01 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 313 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:02.251329 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6b6559e8-8eb3-40b2-9363-036f2924d14e tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:02.252493 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:02.252493 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:02.265822 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6b6559e8-8eb3-40b2-9363-036f2924d14e tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 299 microversion: 2.41 time: 0.019005 Jul 31 01:06:02.268469 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3f9d9fc8-6443-459c-86b4-c8316f2e4258 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/a9dff839-5fec-446b-a950-442484b3c6a1" status: 202 len: 0 microversion: 2.1 time: 0.056439 Jul 31 01:06:02.268820 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 25/45] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:06:02 2022] DELETE /compute/v2.1/flavors/a9dff839-5fec-446b-a950-442484b3c6a1 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:06:02.270242 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 21/46] 10.222.0.45 () {60 vars in 1190 bytes} [Sun Jul 31 01:06:02 2022] GET /compute/v2.1/os-aggregates/2 => generated 299 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:02.275322 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0f0ecb5e-2693-45fd-9210-6368c94e1c15 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:02.275972 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dd4db08f-3e68-4f86-8650-1df67b8a5777 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:02.277122 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:02.277122 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:02.326975 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0f0ecb5e-2693-45fd-9210-6368c94e1c15 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/895402760" status: 202 len: 0 microversion: 2.1 time: 0.057183 Jul 31 01:06:02.327940 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 26/47] 10.222.0.45 () {58 vars in 1158 bytes} [Sun Jul 31 01:06:02 2022] DELETE /compute/v2.1/flavors/895402760 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:06:02.332954 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d55789d2-71e8-4588-9819-fa97fd4d6771 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:02.339850 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dd4db08f-3e68-4f86-8650-1df67b8a5777 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.067916 Jul 31 01:06:02.341260 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 22/48] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:06:02 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:02.352832 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3ec04af0-9d55-44d6-b4a9-52ac33a87152 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:02.356646 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:02.356646 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:02.375476 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ec04af0-9d55-44d6-b4a9-52ac33a87152 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:02.376128 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ec04af0-9d55-44d6-b4a9-52ac33a87152 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:02.384161 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d55789d2-71e8-4588-9819-fa97fd4d6771 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055133 Jul 31 01:06:02.399749 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 27/49] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:02.405227 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d56ef4e4-086d-4acf-8576-6e4054e018d5 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:02.426333 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d56ef4e4-086d-4acf-8576-6e4054e018d5 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025183 Jul 31 01:06:02.427630 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 28/50] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:02.432611 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ddcda41a-e57f-4558-b439-7d185ebdf9cf tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-497065276"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:02.435492 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:02.435492 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:02.436722 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.aggregate [None req-ddcda41a-e57f-4558-b439-7d185ebdf9cf tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Generated uuid 5b377e12-fc32-466d-aac8-c50572174d5c for aggregate {{(pid=119475) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:02.488480 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ddcda41a-e57f-4558-b439-7d185ebdf9cf tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.059427 Jul 31 01:06:02.497423 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 29/51] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:06:02 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:02.504404 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c6ffaa2c-7e11-4285-ba32-e38b6f15d2b8 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1953523148", "id": "040b2e5d-8291-48f8-8b38-bb7c35675441", "os-flavor-access:is_public": "True"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:02.508820 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:02.508820 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:02.542422 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c6ffaa2c-7e11-4285-ba32-e38b6f15d2b8 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.041055 Jul 31 01:06:02.543558 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 30/52] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:02 2022] POST /compute/v2.1/flavors => generated 507 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:02.552012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3fbe522f-f2a8-44b3-a4fc-b96e9dbc928c tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-448768242", "id": 2075793906, "os-flavor-access:is_public": "False"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:02.587189 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3ec04af0-9d55-44d6-b4a9-52ac33a87152 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.41 time: 0.243941 Jul 31 01:06:02.596188 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 23/53] 10.222.0.45 () {62 vars in 1232 bytes} [Sun Jul 31 01:06:02 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:02.601823 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ef54d9ab-24f1-421e-a40b-c65014195abe tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1117270847"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:02.604312 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:02.604312 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:02.610713 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:02.613019 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3fbe522f-f2a8-44b3-a4fc-b96e9dbc928c tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.068075 Jul 31 01:06:02.613647 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 31/54] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:02 2022] POST /compute/v2.1/flavors => generated 438 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:02.624208 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c82356a3-9753-49c3-9039-555ea402f197 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:02.625471 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:02.625471 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:02.628546 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef54d9ab-24f1-421e-a40b-c65014195abe tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:02.629270 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef54d9ab-24f1-421e-a40b-c65014195abe tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:02.645742 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef54d9ab-24f1-421e-a40b-c65014195abe tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:02.646263 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef54d9ab-24f1-421e-a40b-c65014195abe tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:02.666019 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c82356a3-9753-49c3-9039-555ea402f197 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/040b2e5d-8291-48f8-8b38-bb7c35675441" status: 202 len: 0 microversion: 2.1 time: 0.051264 Jul 31 01:06:02.666579 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 32/55] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:06:02 2022] DELETE /compute/v2.1/flavors/040b2e5d-8291-48f8-8b38-bb7c35675441 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:06:02.668613 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-ef54d9ab-24f1-421e-a40b-c65014195abe tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1117270847 could not be found. Jul 31 01:06:02.673463 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d9ada22e-2051-4009-b89d-76404527e3f7 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:02.679176 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:02.679176 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ef54d9ab-24f1-421e-a40b-c65014195abe tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Request method failure captured: Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 58 Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dV0Qv9DBEc5_aQcul5-AcfiVWHPU7-yr1F_vYEbPK677XUQUK-je6FFKN1m6Ll9WbjyJcGYXWT4Qq2K_K3MT6h3pCsgLJl2PsRrhf0q9qvZFBvWgDbNzYzG4sjmb5XnuJ8pFmaDdO8H-b5ndeLEekVzbO-C42Xeb7HCIO5VYxgj9fg Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6def54c32aa54cffa86e5494da0f4b34 Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:06:02.680968 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:06:02.682170 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6def54c32aa54cffa86e5494da0f4b34", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:02.682170 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:02.682170 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6def54c32aa54cffa86e5494da0f4b34 Jul 31 01:06:02.682170 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:02.682170 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin Jul 31 01:06:02.682170 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:02.682170 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:02.682170 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 41d5ded808be42ec8c0b1134191742e6 Jul 31 01:06:02.682170 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin Jul 31 01:06:02.682170 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:06:02.682170 n-d-master-1 devstack@n-api.service[119474]: {"add_host": {"host": "tempest-nonexist_host-1117270847"}} Jul 31 01:06:02.682170 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:02.682170 n-d-master-1 devstack@n-api.service[119474]: exception: Compute host tempest-nonexist_host-1117270847 could not be found. Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1117270847'}}} Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1117270847' is not mapped to any cell Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:02.682904 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6574, in add_host_to_aggregate Jul 31 01:06:02.683840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1117270847 could not be found. Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1117270847 could not be found. Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:02.684852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:02.685870 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:02.685870 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:02.685870 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:02.685870 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:02.685870 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:02.685870 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1117270847 could not be found. Jul 31 01:06:02.685870 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:02.685870 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ef54d9ab-24f1-421e-a40b-c65014195abe tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1117270847 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:02.685870 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ef54d9ab-24f1-421e-a40b-c65014195abe tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.090312 Jul 31 01:06:02.691310 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 24/56] 10.222.0.45 () {60 vars in 1191 bytes} [Sun Jul 31 01:06:02 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:02.704525 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8ecd3901-f8dd-42e2-ade0-2a502f63b297 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9d0f1d8a4f7e4e9bb33007fe146dc574"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:02.709004 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9ada22e-2051-4009-b89d-76404527e3f7 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:02.710003 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9ada22e-2051-4009-b89d-76404527e3f7 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:02.726497 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:02.726497 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:02.906895 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d9ada22e-2051-4009-b89d-76404527e3f7 tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.41 time: 0.239065 Jul 31 01:06:02.908742 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 33/57] 10.222.0.45 () {62 vars in 1232 bytes} [Sun Jul 31 01:06:02 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:02.923691 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eced11ea-0827-48a1-84f0-45f14a3b04d1 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:02.971870 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eced11ea-0827-48a1-84f0-45f14a3b04d1 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058578 Jul 31 01:06:02.977440 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 34/58] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:02.984243 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c1ee58fe-7661-490c-b634-c89891a073eb tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:02.987329 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:02.987329 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:03.023759 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c1ee58fe-7661-490c-b634-c89891a073eb tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.043854 Jul 31 01:06:03.025819 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 35/59] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:06:02 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:03.041729 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4a8fea2b-8a3d-4618-bf4b-efa4414b08da tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:03.043904 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:03.043904 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:03.099967 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4a8fea2b-8a3d-4618-bf4b-efa4414b08da tempest-AggregatesAdminTestV241-761788440 tempest-AggregatesAdminTestV241-761788440-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.41 time: 0.070186 Jul 31 01:06:03.101941 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 36/60] 10.222.0.45 () {60 vars in 1193 bytes} [Sun Jul 31 01:06:03 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:03.115512 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-37a7a7b8-eab9-472c-abb4-35c89ac9a2f2 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-676126703", "id": 1118305601, "os-flavor-access:is_public": "True"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:03.122819 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:03.122819 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:03.154897 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-37a7a7b8-eab9-472c-abb4-35c89ac9a2f2 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.051787 Jul 31 01:06:03.160037 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 37/61] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:03 2022] POST /compute/v2.1/flavors => generated 413 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:03.165840 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ab8f896e-8d1d-4c77-9c0d-56dbf5ac98a9 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ab8f896e-8d1d-4c77-9c0d-56dbf5ac98a9 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Request method failure captured: Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 283 Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dV0Qv9DBEc5_aQcul5-AcfiVWHPU7-yr1F_vYEbPK677XUQUK-je6FFKN1m6Ll9WbjyJcGYXWT4Qq2K_K3MT6h3pCsgLJl2PsRrhf0q9qvZFBvWgDbNzYzG4sjmb5XnuJ8pFmaDdO8H-b5ndeLEekVzbO-C42Xeb7HCIO5VYxgj9fg Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 6def54c32aa54cffa86e5494da0f4b34 Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:06:03.176634 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:06:03.177797 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6def54c32aa54cffa86e5494da0f4b34", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:03.177797 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:03.177797 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 6def54c32aa54cffa86e5494da0f4b34 Jul 31 01:06:03.177797 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:03.177797 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin Jul 31 01:06:03.177797 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:03.177797 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:03.177797 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 41d5ded808be42ec8c0b1134191742e6 Jul 31 01:06:03.177797 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin Jul 31 01:06:03.177797 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:06:03.177797 n-d-master-1 devstack@n-api.service[119475]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 31 01:06:03.178365 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:03.178365 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 31 01:06:03.178365 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 31 01:06:03.178365 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:03.178365 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:03.178365 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:06:03.178365 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:06:03.178365 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:06:03.178365 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:06:03.178365 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 31 01:06:03.178365 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:06:03.178943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:06:03.179959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:06:03.179959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:06:03.179959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:06:03.179959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:06:03.179959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 31 01:06:03.179959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.179959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:03.179959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.179959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:03.179959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:03.179959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:03.179959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:06:03.179959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:06:03.180653 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 31 01:06:03.180653 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.180653 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ab8f896e-8d1d-4c77-9c0d-56dbf5ac98a9 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:03.180653 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ab8f896e-8d1d-4c77-9c0d-56dbf5ac98a9 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.016408 Jul 31 01:06:03.180953 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 38/62] 10.222.0.45 () {60 vars in 1165 bytes} [Sun Jul 31 01:06:03 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:06:03.193412 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-140e854a-d91f-404e-8a26-573fd25a5c13 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1806112391", "name": "tempest-test_aggregate-2144433014"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:03.245560 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:03.245560 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:03.246672 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.aggregate [None req-140e854a-d91f-404e-8a26-573fd25a5c13 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Generated uuid b5502c38-a46c-4120-bd37-50529b34478a for aggregate {{(pid=119475) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:03.292383 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8ecd3901-f8dd-42e2-ade0-2a502f63b297 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/2075793906/action" status: 200 len: 97 microversion: 2.1 time: 0.599319 Jul 31 01:06:03.293947 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 25/63] 10.222.0.45 () {60 vars in 1200 bytes} [Sun Jul 31 01:06:02 2022] POST /compute/v2.1/flavors/2075793906/action => generated 97 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:06:03.311392 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-140e854a-d91f-404e-8a26-573fd25a5c13 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.131646 Jul 31 01:06:03.316125 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b22a8fba-de4b-46e9-93c6-724d1a725894 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:03.321378 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 39/64] 10.222.0.45 () {60 vars in 1165 bytes} [Sun Jul 31 01:06:03 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:03.348171 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2ba839f7-42c2-4770-9281-80f289081466 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:03.352447 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b22a8fba-de4b-46e9-93c6-724d1a725894 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/1118305601" status: 200 len: 413 microversion: 2.1 time: 0.054375 Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2ba839f7-42c2-4770-9281-80f289081466 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Request method failure captured: Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 27 Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dV0Qv9DBEc5_aQcul5-AcfiVWHPU7-yr1F_vYEbPK677XUQUK-je6FFKN1m6Ll9WbjyJcGYXWT4Qq2K_K3MT6h3pCsgLJl2PsRrhf0q9qvZFBvWgDbNzYzG4sjmb5XnuJ8pFmaDdO8H-b5ndeLEekVzbO-C42Xeb7HCIO5VYxgj9fg Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 6def54c32aa54cffa86e5494da0f4b34 Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:06:03.356659 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:06:03.357774 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6def54c32aa54cffa86e5494da0f4b34", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:03.357774 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:03.357774 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 6def54c32aa54cffa86e5494da0f4b34 Jul 31 01:06:03.357774 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:03.357774 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin Jul 31 01:06:03.357774 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:03.357774 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:03.357774 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 41d5ded808be42ec8c0b1134191742e6 Jul 31 01:06:03.357774 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin Jul 31 01:06:03.357774 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:06:03.357774 n-d-master-1 devstack@n-api.service[119475]: {"aggregate": {"name": ""}} Jul 31 01:06:03.357774 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:03.357774 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi '' Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:03.358418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 31 01:06:03.359582 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.360977 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 26/65] 10.222.0.45 () {58 vars in 1158 bytes} [Sun Jul 31 01:06:03 2022] GET /compute/v2.1/flavors/1118305601 => generated 413 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:03.363520 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2ba839f7-42c2-4770-9281-80f289081466 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:03.364621 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2ba839f7-42c2-4770-9281-80f289081466 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.042003 Jul 31 01:06:03.366193 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 40/66] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:06:03 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:06:03.373248 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-718ac1e9-c20f-4f56-8d9b-30fc1e4225f8 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:03.374420 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:03.374420 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:03.379379 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7a7cf107-b162-4f20-8147-be8450d6dd61 tempest-FlavorsAccessNegativeTestJSON-570050554 tempest-FlavorsAccessNegativeTestJSON-570050554-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9d0f1d8a4f7e4e9bb33007fe146dc574"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:03.384342 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:03.384342 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:03.389456 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-718ac1e9-c20f-4f56-8d9b-30fc1e4225f8 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.021982 Jul 31 01:06:03.392030 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 41/67] 10.222.0.45 () {58 vars in 1143 bytes} [Sun Jul 31 01:06:03 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:03.392407 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7a7cf107-b162-4f20-8147-be8450d6dd61 tempest-FlavorsAccessNegativeTestJSON-570050554 tempest-FlavorsAccessNegativeTestJSON-570050554-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '7b168c8581184dd7bed2541f5f1e715e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d0f1d8a4f7e4e9bb33007fe146dc574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7a7cf107-b162-4f20-8147-be8450d6dd61 tempest-FlavorsAccessNegativeTestJSON-570050554 tempest-FlavorsAccessNegativeTestJSON-570050554-project] Request method failure captured: Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/flavors/2075793906/action HTTP/1.1 Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 70 Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dVwPPlwqAO28hPbAptNBAehfxRAn5XZNZe6fR35tV0FWp6lU3pyG-wE5-ieJnb_zMFqR0VppFBywJs9tacUTFeTOTmxm_7yJn5ArRRy7tAhoLRmCLH-3ub5aUwbdFrh_OL7M8s8uu4cJ2dGfMARrn-8K2Sd-7e2orHmFXndFlAfSnQ Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 9d0f1d8a4f7e4e9bb33007fe146dc574 Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-570050554 Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:06:03.394470 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:06:03.395602 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9d0f1d8a4f7e4e9bb33007fe146dc574"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9d0f1d8a4f7e4e9bb33007fe146dc574"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9d0f1d8a4f7e4e9bb33007fe146dc574"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9d0f1d8a4f7e4e9bb33007fe146dc574", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:03.395602 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-570050554 Jul 31 01:06:03.395602 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 9d0f1d8a4f7e4e9bb33007fe146dc574 Jul 31 01:06:03.395602 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-570050554 Jul 31 01:06:03.395602 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-FlavorsAccessNegativeTestJSON-570050554-project Jul 31 01:06:03.395602 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:03.395602 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:03.395602 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 7b168c8581184dd7bed2541f5f1e715e Jul 31 01:06:03.395602 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-570050554-project Jul 31 01:06:03.395602 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:06:03.395602 n-d-master-1 devstack@n-api.service[119474]: {"removeTenantAccess": {"tenant": "9d0f1d8a4f7e4e9bb33007fe146dc574"}} Jul 31 01:06:03.395602 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '2075793906', 'body': {'removeTenantAccess': {'tenant': '9d0f1d8a4f7e4e9bb33007fe146dc574'}}} Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi context.can( Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:03.396211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 31 01:06:03.397189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.401849 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7a7cf107-b162-4f20-8147-be8450d6dd61 tempest-FlavorsAccessNegativeTestJSON-570050554 tempest-FlavorsAccessNegativeTestJSON-570050554-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:03.402972 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7a7cf107-b162-4f20-8147-be8450d6dd61 tempest-FlavorsAccessNegativeTestJSON-570050554 tempest-FlavorsAccessNegativeTestJSON-570050554-project] 10.222.0.45 "POST /compute/v2.1/flavors/2075793906/action" status: 403 len: 133 microversion: 2.1 time: 0.044562 Jul 31 01:06:03.408130 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 27/68] 10.222.0.45 () {60 vars in 1200 bytes} [Sun Jul 31 01:06:03 2022] POST /compute/v2.1/flavors/2075793906/action => generated 133 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:03.417233 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-939600a8-dc42-49f7-9c1e-a9a23d356bcb tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-435079946"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:03.422156 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:03.422156 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:03.424361 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-939600a8-dc42-49f7-9c1e-a9a23d356bcb tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '6914dc05e91240c9a3cca15d4ecfc3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eafe4a206e4141f3b0f07c1aa5e8ffd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-939600a8-dc42-49f7-9c1e-a9a23d356bcb tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Request method failure captured: Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 59 Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dVxVfU84qM1wJ08a8-FVOA3BqVddY2X1If4ALa4Z2cnxBXV4PcoFyU0K7D-A1zUHNDJwixvpKtxtgrE-EewAsDTO9mrJWDY_5TKmPXQNf8AOgFW5iPmJpSmHqy0brdEQU9-9YIMC3lWxn_L_zFALIoDuxznafLVYyovCANsRP2XNX4 Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: eafe4a206e4141f3b0f07c1aa5e8ffd6 Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:06:03.426559 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:06:03.427989 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eafe4a206e4141f3b0f07c1aa5e8ffd6", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:03.427989 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:03.427989 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: eafe4a206e4141f3b0f07c1aa5e8ffd6 Jul 31 01:06:03.427989 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:03.427989 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AggregatesAdminNegativeTestJSON-1377799865-project Jul 31 01:06:03.427989 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:03.427989 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:03.427989 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 6914dc05e91240c9a3cca15d4ecfc3cf Jul 31 01:06:03.427989 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865-project Jul 31 01:06:03.427989 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:06:03.427989 n-d-master-1 devstack@n-api.service[119474]: {"aggregate": {"name": "tempest-test_aggregate-435079946"}} Jul 31 01:06:03.427989 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:03.427989 n-d-master-1 devstack@n-api.service[119474]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-435079946'}}} Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:06:03.428736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:06:03.429850 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 31 01:06:03.431161 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:03.433301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-939600a8-dc42-49f7-9c1e-a9a23d356bcb tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:03.436156 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-939600a8-dc42-49f7-9c1e-a9a23d356bcb tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.026805 Jul 31 01:06:03.436809 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 28/69] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:06:03 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:03.457772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2e2de773-88c9-4da6-aa58-81168a25ef20 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:03.478766 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e2de773-88c9-4da6-aa58-81168a25ef20 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:03.480342 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e2de773-88c9-4da6-aa58-81168a25ef20 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:03.776188 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2e2de773-88c9-4da6-aa58-81168a25ef20 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 315 microversion: 2.1 time: 0.329573 Jul 31 01:06:03.788796 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 29/70] 10.222.0.45 () {60 vars in 1191 bytes} [Sun Jul 31 01:06:03 2022] POST /compute/v2.1/os-aggregates/5/action => generated 315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:03.805411 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-99f05a91-379c-4688-8d8a-ec21894dcaba tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9d0f1d8a4f7e4e9bb33007fe146dc574"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:03.812391 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:03.812391 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:04.515891 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-48fec427-a912-4719-9269-7b77856f4efb tempest-FlavorsAdminTestJSON-1352364219 tempest-FlavorsAdminTestJSON-1352364219-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:04.563177 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-48fec427-a912-4719-9269-7b77856f4efb tempest-FlavorsAdminTestJSON-1352364219 tempest-FlavorsAdminTestJSON-1352364219-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 1.162161 Jul 31 01:06:04.569204 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-99f05a91-379c-4688-8d8a-ec21894dcaba tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/2075793906/action" status: 200 len: 21 microversion: 2.1 time: 0.775746 Jul 31 01:06:04.575782 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 30/71] 10.222.0.45 () {60 vars in 1200 bytes} [Sun Jul 31 01:06:03 2022] POST /compute/v2.1/flavors/2075793906/action => generated 21 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:06:04.580807 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 42/72] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:03 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:04.587520 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-55cf7e48-cf94-4442-9142-72e698060d10 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-563655216"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:04.601530 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:04.601530 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:04.602588 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.aggregate [None req-55cf7e48-cf94-4442-9142-72e698060d10 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Generated uuid e0d16353-0aeb-4223-b17f-8500267b0cc4 for aggregate {{(pid=119474) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:04.641399 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-55cf7e48-cf94-4442-9142-72e698060d10 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.064364 Jul 31 01:06:04.642803 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 31/73] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:06:04 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:04.656617 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1bd5c544-3dce-45eb-8c06-80f5d1908d84 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:04.659562 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:04.659562 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:04.711233 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1bd5c544-3dce-45eb-8c06-80f5d1908d84 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/2075793906" status: 202 len: 0 microversion: 2.1 time: 0.066564 Jul 31 01:06:04.712183 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 32/74] 10.222.0.45 () {58 vars in 1161 bytes} [Sun Jul 31 01:06:04 2022] DELETE /compute/v2.1/flavors/2075793906 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:06:04.728936 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-711431276", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "availability_zone": "tempest-test_az-1806112391"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:04.733757 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-636dfa55-bc0d-4cca-aeb0-92005afabbff tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:04.800434 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:04.804943 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:04.806262 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:04.809197 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:04.809475 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-636dfa55-bc0d-4cca-aeb0-92005afabbff tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1118305601" status: 202 len: 0 microversion: 2.1 time: 0.093423 Jul 31 01:06:04.813431 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 33/75] 10.222.0.45 () {58 vars in 1161 bytes} [Sun Jul 31 01:06:04 2022] DELETE /compute/v2.1/flavors/1118305601 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:06:04.832211 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8a34506d-d311-45b9-ac1e-195fb350dfc3 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-563655216"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:04.837945 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:04.837945 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:04.844169 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.aggregate [None req-8a34506d-d311-45b9-ac1e-195fb350dfc3 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Generated uuid cac9ae68-af6e-44d9-aa97-bc4590f27504 for aggregate {{(pid=119474) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:04.878609 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-8a34506d-d311-45b9-ac1e-195fb350dfc3 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-563655216 already exists. Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8a34506d-d311-45b9-ac1e-195fb350dfc3 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Request method failure captured: Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 59 Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dV0Qv9DBEc5_aQcul5-AcfiVWHPU7-yr1F_vYEbPK677XUQUK-je6FFKN1m6Ll9WbjyJcGYXWT4Qq2K_K3MT6h3pCsgLJl2PsRrhf0q9qvZFBvWgDbNzYzG4sjmb5XnuJ8pFmaDdO8H-b5ndeLEekVzbO-C42Xeb7HCIO5VYxgj9fg Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6def54c32aa54cffa86e5494da0f4b34 Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:06:04.883042 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:06:04.885214 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6def54c32aa54cffa86e5494da0f4b34", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:04.885214 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:04.885214 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6def54c32aa54cffa86e5494da0f4b34 Jul 31 01:06:04.885214 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:04.885214 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin Jul 31 01:06:04.885214 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:04.885214 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:04.885214 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 41d5ded808be42ec8c0b1134191742e6 Jul 31 01:06:04.885214 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin Jul 31 01:06:04.885214 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:06:04.885214 n-d-master-1 devstack@n-api.service[119474]: {"aggregate": {"name": "tempest-test_aggregate-563655216"}} Jul 31 01:06:04.885214 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:04.885214 n-d-master-1 devstack@n-api.service[119474]: exception: Aggregate tempest-test_aggregate-563655216 already exists. Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-563655216'}}} Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6411, in create_aggregate Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 31 01:06:04.887015 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-563655216 already exists. Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:04.889143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 31 01:06:04.891063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 31 01:06:04.891063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-563655216 already exists. Jul 31 01:06:04.891063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:04.891063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:04.891063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:04.891063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:04.891063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:04.891063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:04.891063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:04.891063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:04.891063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-563655216 already exists. Jul 31 01:06:04.891063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:04.897059 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8a34506d-d311-45b9-ac1e-195fb350dfc3 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-563655216 already exists. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:04.901019 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8a34506d-d311-45b9-ac1e-195fb350dfc3 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.083029 Jul 31 01:06:04.919993 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 34/76] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:06:04 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:06:04.945003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7bf11089-7c8b-4e0c-a8ec-a8748a40b047 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:05.029052 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7bf11089-7c8b-4e0c-a8ec-a8748a40b047 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.107008 Jul 31 01:06:05.032066 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 35/77] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:05.044023 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b59120c5-e3e5-48c9-9769-32a6a2a3c405 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:05.174483 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b59120c5-e3e5-48c9-9769-32a6a2a3c405 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.139040 Jul 31 01:06:05.184610 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 36/78] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:05.223284 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9cd15fd1-f994-4c7a-adc2-61d3f75417e2 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:05.234493 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:05.234493 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:05.309222 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9cd15fd1-f994-4c7a-adc2-61d3f75417e2 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.121135 Jul 31 01:06:05.316739 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 37/79] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:06:05 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:05.325947 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8ff8b746-e1e7-4bec-8b86-f8fafb6b9598 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1075386172", "id": 1658094497, "os-flavor-access:is_public": "False"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:05.332269 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:05.332269 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:05.401888 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8ff8b746-e1e7-4bec-8b86-f8fafb6b9598 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.083677 Jul 31 01:06:05.415836 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 38/80] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:05 2022] POST /compute/v2.1/flavors => generated 439 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:05.434183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21529b2f-e606-4d9e-85f4-5a63e6835cbd tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-853359536", "id": 708570826, "os-flavor-access:is_public": "False"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:05.469517 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-21529b2f-e606-4d9e-85f4-5a63e6835cbd tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.052282 Jul 31 01:06:05.469857 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 39/81] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:05 2022] POST /compute/v2.1/flavors => generated 426 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:05.482875 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d85bed8d-02b1-4645-a823-089fe9a73ed6 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1381061479"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:05.507841 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:05.507841 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:05.515331 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.aggregate [None req-d85bed8d-02b1-4645-a823-089fe9a73ed6 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Generated uuid 4dea99ad-a93d-4e83-9251-cdab1a808741 for aggregate {{(pid=119474) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:05.570406 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d85bed8d-02b1-4645-a823-089fe9a73ed6 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.091085 Jul 31 01:06:05.572458 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 40/82] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:06:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:05.585754 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ae56b65-d20c-42de-9949-8699f45e9088 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9a68fab5e9664cc69de90630074c97a2"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:05.596714 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:05.596714 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:05.988426 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:06:06.105509 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-0ae56b65-d20c-42de-9949-8699f45e9088 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] HTTP exception thrown: Flavor access not found for 26 / 9a68fab5e9664cc69de90630074c97a2 combination. Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ae56b65-d20c-42de-9949-8699f45e9088 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Request method failure captured: Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/flavors/1658094497/action HTTP/1.1 Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 70 Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dVzy4gS-UPbu3wRcJC8b_lE_goUEdbUMZLtG18j56oiA2HAVnjmCreHcF7hDGa94zfWioM0kA0hAmDKGA7PQOrvPBWFkvQukVsxCsACrErFTrn9XltXSk35nnr8cbsOooTz7bkPAphdVSh0JY-eJWALwofNA56yZl3vLlIiC0EA_RU Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: ec8e200820fd4f2bbe83fbbbd175c18b Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-743278349 Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:06:06.107174 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:06:06.108282 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec8e200820fd4f2bbe83fbbbd175c18b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ec8e200820fd4f2bbe83fbbbd175c18b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ec8e200820fd4f2bbe83fbbbd175c18b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ec8e200820fd4f2bbe83fbbbd175c18b", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:06.108282 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-743278349 Jul 31 01:06:06.108282 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: ec8e200820fd4f2bbe83fbbbd175c18b Jul 31 01:06:06.108282 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-743278349 Jul 31 01:06:06.108282 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin Jul 31 01:06:06.108282 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:06.108282 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:06.108282 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: e95c1144af444d28a2802ba27d9e2834 Jul 31 01:06:06.108282 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin Jul 31 01:06:06.108282 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:06:06.108282 n-d-master-1 devstack@n-api.service[119474]: {"removeTenantAccess": {"tenant": "9a68fab5e9664cc69de90630074c97a2"}} Jul 31 01:06:06.108282 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: exception: Flavor access not found for 26 / 9a68fab5e9664cc69de90630074c97a2 combination. Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '1658094497', 'body': {'removeTenantAccess': {'tenant': '9a68fab5e9664cc69de90630074c97a2'}}} Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 31 01:06:06.108996 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 26 / 9a68fab5e9664cc69de90630074c97a2 combination. Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 26 / 9a68fab5e9664cc69de90630074c97a2 combination. Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.110280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:06.111858 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:06.111858 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:06.111858 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:06.111858 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:06.111858 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 26 / 9a68fab5e9664cc69de90630074c97a2 combination. Jul 31 01:06:06.111858 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.111858 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ae56b65-d20c-42de-9949-8699f45e9088 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Returning 404 to user: Flavor access not found for 26 / 9a68fab5e9664cc69de90630074c97a2 combination. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:06.111858 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0ae56b65-d20c-42de-9949-8699f45e9088 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1658094497/action" status: 404 len: 124 microversion: 2.1 time: 0.535051 Jul 31 01:06:06.114167 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 41/83] 10.222.0.45 () {60 vars in 1200 bytes} [Sun Jul 31 01:06:05 2022] POST /compute/v2.1/flavors/1658094497/action => generated 124 bytes in 540 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:06.119638 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1f8dbe85-c95c-4b8e-b51a-848d6ac1da35 tempest-FlavorsAdminTestJSON-1352364219 tempest-FlavorsAdminTestJSON-1352364219-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "708570826"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:06.196695 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-1f8dbe85-c95c-4b8e-b51a-848d6ac1da35 tempest-FlavorsAdminTestJSON-1352364219 tempest-FlavorsAdminTestJSON-1352364219-project] HTTP exception thrown: Flavor 708570826 could not be found. Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1f8dbe85-c95c-4b8e-b51a-848d6ac1da35 tempest-FlavorsAdminTestJSON-1352364219 tempest-FlavorsAdminTestJSON-1352364219-project] Request method failure captured: Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 106 Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dV2qi9Bh8Fzzynx4TMssk46z0038M9Kwpwlp0aXZqYQ65B1pvbV05vdVL3cYv9NbbWCgV6d2FNaSyi1AWiFEBsFu7tzcJ1ryYbdqtwlo-9Ml09v83UwtwMfUwVaq0fKYBnE-C1vCOwegH0KbDKxwwdP58K4uKuTrqQl5NrH0Q9rlhM Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: d2d86a11a66f45129e8725b7755f8bed Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-FlavorsAdminTestJSON-1352364219 Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:06:06.213668 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:06:06.215091 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d2d86a11a66f45129e8725b7755f8bed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d2d86a11a66f45129e8725b7755f8bed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d2d86a11a66f45129e8725b7755f8bed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d2d86a11a66f45129e8725b7755f8bed", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:06.215091 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-FlavorsAdminTestJSON-1352364219 Jul 31 01:06:06.215091 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: d2d86a11a66f45129e8725b7755f8bed Jul 31 01:06:06.215091 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1352364219 Jul 31 01:06:06.215091 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-FlavorsAdminTestJSON-1352364219-project Jul 31 01:06:06.215091 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:06.215091 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:06.215091 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: e3d624b886174067ad22688fddadc010 Jul 31 01:06:06.215091 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-FlavorsAdminTestJSON-1352364219-project Jul 31 01:06:06.215091 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:06:06.215091 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": "test", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "708570826"}} Jul 31 01:06:06.215091 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:06.215091 n-d-master-1 devstack@n-api.service[119474]: exception: Flavor 708570826 could not be found. Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '708570826'}}} Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 708570826 could not be found. Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.215927 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 708570826 could not be found. Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:06.217018 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:06.219127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:06.219127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:06.219127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:06.219127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 708570826 could not be found. Jul 31 01:06:06.219127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.219127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1f8dbe85-c95c-4b8e-b51a-848d6ac1da35 tempest-FlavorsAdminTestJSON-1352364219 tempest-FlavorsAdminTestJSON-1352364219-project] Returning 400 to user: Flavor 708570826 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:06.219127 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1f8dbe85-c95c-4b8e-b51a-848d6ac1da35 tempest-FlavorsAdminTestJSON-1352364219 tempest-FlavorsAdminTestJSON-1352364219-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.101856 Jul 31 01:06:06.219127 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 42/84] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:06 2022] POST /compute/v2.1/servers => generated 80 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:06.237721 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cc4c7a6f-2d90-4fa0-a8c4-3b791538e249 tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:06.238516 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:06.238516 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:06.246770 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cc4c7a6f-2d90-4fa0-a8c4-3b791538e249 tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '6914dc05e91240c9a3cca15d4ecfc3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eafe4a206e4141f3b0f07c1aa5e8ffd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cc4c7a6f-2d90-4fa0-a8c4-3b791538e249 tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Request method failure captured: Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dVxVfU84qM1wJ08a8-FVOA3BqVddY2X1If4ALa4Z2cnxBXV4PcoFyU0K7D-A1zUHNDJwixvpKtxtgrE-EewAsDTO9mrJWDY_5TKmPXQNf8AOgFW5iPmJpSmHqy0brdEQU9-9YIMC3lWxn_L_zFALIoDuxznafLVYyovCANsRP2XNX4 Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: eafe4a206e4141f3b0f07c1aa5e8ffd6 Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:06:06.249740 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:06:06.252494 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eafe4a206e4141f3b0f07c1aa5e8ffd6", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:06.252494 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:06.252494 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: eafe4a206e4141f3b0f07c1aa5e8ffd6 Jul 31 01:06:06.252494 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:06.252494 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AggregatesAdminNegativeTestJSON-1377799865-project Jul 31 01:06:06.252494 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:06.252494 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:06.252494 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 6914dc05e91240c9a3cca15d4ecfc3cf Jul 31 01:06:06.252494 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865-project Jul 31 01:06:06.252494 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:06.252494 n-d-master-1 devstack@n-api.service[119474]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 31 01:06:06.252494 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '7'} Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:06.256638 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.257790 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cc4c7a6f-2d90-4fa0-a8c4-3b791538e249 tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:06.258798 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cc4c7a6f-2d90-4fa0-a8c4-3b791538e249 tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.022411 Jul 31 01:06:06.258798 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 43/85] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:06:06 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:06.281133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0c14c44b-6bc3-4904-898d-6c08f35da46b tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:06.281998 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:06.281998 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:06.334443 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0c14c44b-6bc3-4904-898d-6c08f35da46b tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1658094497" status: 202 len: 0 microversion: 2.1 time: 0.080197 Jul 31 01:06:06.338598 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 44/86] 10.222.0.45 () {58 vars in 1161 bytes} [Sun Jul 31 01:06:06 2022] DELETE /compute/v2.1/flavors/1658094497 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:06:06.346513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c1f6d8fb-fd67-42dc-b51a-849c64ba2bf8 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:06.385702 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c1f6d8fb-fd67-42dc-b51a-849c64ba2bf8 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/708570826" status: 202 len: 0 microversion: 2.1 time: 0.048426 Jul 31 01:06:06.387145 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 45/87] 10.222.0.45 () {58 vars in 1158 bytes} [Sun Jul 31 01:06:06 2022] DELETE /compute/v2.1/flavors/708570826 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:06:06.394828 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d5da199d-0243-4820-8469-3cc20b8ba2ed tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:06.466175 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d5da199d-0243-4820-8469-3cc20b8ba2ed tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.076030 Jul 31 01:06:06.469188 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 46/88] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:06:06 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:06.499324 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-226ff5dc-bda4-45c5-8424-ceb2e74954e7 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:06.626261 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-226ff5dc-bda4-45c5-8424-ceb2e74954e7 tempest-FlavorsAccessNegativeTestJSON-743278349 tempest-FlavorsAccessNegativeTestJSON-743278349-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.141820 Jul 31 01:06:06.628714 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 47/89] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:06.639993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a51cd830-e6ab-4113-bcb1-a068fb52614c tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:06.692691 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a51cd830-e6ab-4113-bcb1-a068fb52614c tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058517 Jul 31 01:06:06.692691 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 48/90] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:06.699052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4cff2975-3da1-4d6f-a348-b8495b960a8f tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:06.699972 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:06.699972 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:06.721612 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:DELETE=18 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:06.726435 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-4cff2975-3da1-4d6f-a348-b8495b960a8f tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4cff2975-3da1-4d6f-a348-b8495b960a8f tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Request method failure captured: Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dV0Qv9DBEc5_aQcul5-AcfiVWHPU7-yr1F_vYEbPK677XUQUK-je6FFKN1m6Ll9WbjyJcGYXWT4Qq2K_K3MT6h3pCsgLJl2PsRrhf0q9qvZFBvWgDbNzYzG4sjmb5XnuJ8pFmaDdO8H-b5ndeLEekVzbO-C42Xeb7HCIO5VYxgj9fg Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6def54c32aa54cffa86e5494da0f4b34 Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:06:06.730772 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:06:06.732178 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6def54c32aa54cffa86e5494da0f4b34", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:06.732178 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:06.732178 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6def54c32aa54cffa86e5494da0f4b34 Jul 31 01:06:06.732178 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:06.732178 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin Jul 31 01:06:06.732178 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:06.732178 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:06.732178 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 41d5ded808be42ec8c0b1134191742e6 Jul 31 01:06:06.732178 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin Jul 31 01:06:06.732178 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:06.732178 n-d-master-1 devstack@n-api.service[119474]: exception: Aggregate -1 could not be found. Jul 31 01:06:06.732178 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '-1'} Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 31 01:06:06.732916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.734060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:06.735312 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:06.735312 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:06.735312 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:06.735312 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:06.735312 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 31 01:06:06.735312 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.740220 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4cff2975-3da1-4d6f-a348-b8495b960a8f tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:06.741517 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4cff2975-3da1-4d6f-a348-b8495b960a8f tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.050931 Jul 31 01:06:06.742539 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 49/91] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:06:06 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:06:06.759606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0af85b08-43c9-42d6-827d-3aff153c1bd5 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-623753806", "id": 468535560, "os-flavor-access:is_public": "False"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:06.767496 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:06.767496 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:06.833291 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0af85b08-43c9-42d6-827d-3aff153c1bd5 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.089478 Jul 31 01:06:06.834546 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 50/92] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:06 2022] POST /compute/v2.1/flavors => generated 411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:06.839490 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-847a4761-ad02-47bd-b9dd-a3f905db6ba0 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-445243965"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:06.850026 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:06.850026 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:06.852527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.aggregate [None req-847a4761-ad02-47bd-b9dd-a3f905db6ba0 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Generated uuid 52015403-597d-4a9b-be48-5fa7e681d353 for aggregate {{(pid=119474) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:06.895992 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-847a4761-ad02-47bd-b9dd-a3f905db6ba0 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.060136 Jul 31 01:06:06.900447 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 51/93] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:06:06 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:06.911961 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95cc1964-c918-42f9-b694-d94db5db2fc3 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-541050988", "id": 2018417939, "os-flavor-access:is_public": "True"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:06.923977 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:06.923977 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:06.955978 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-95cc1964-c918-42f9-b694-d94db5db2fc3 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.051160 Jul 31 01:06:06.957246 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 52/94] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:06 2022] POST /compute/v2.1/flavors => generated 413 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:06.972356 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f39bb43-79da-4fb1-a29c-7ab5c218ab71 tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:06.973579 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:06.973579 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:06.978066 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6f39bb43-79da-4fb1-a29c-7ab5c218ab71 tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '6914dc05e91240c9a3cca15d4ecfc3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eafe4a206e4141f3b0f07c1aa5e8ffd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f39bb43-79da-4fb1-a29c-7ab5c218ab71 tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Request method failure captured: Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dVxVfU84qM1wJ08a8-FVOA3BqVddY2X1If4ALa4Z2cnxBXV4PcoFyU0K7D-A1zUHNDJwixvpKtxtgrE-EewAsDTO9mrJWDY_5TKmPXQNf8AOgFW5iPmJpSmHqy0brdEQU9-9YIMC3lWxn_L_zFALIoDuxznafLVYyovCANsRP2XNX4 Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: eafe4a206e4141f3b0f07c1aa5e8ffd6 Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:06:06.984394 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:06:06.986088 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eafe4a206e4141f3b0f07c1aa5e8ffd6", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:06.986088 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:06.986088 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: eafe4a206e4141f3b0f07c1aa5e8ffd6 Jul 31 01:06:06.986088 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:06.986088 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AggregatesAdminNegativeTestJSON-1377799865-project Jul 31 01:06:06.986088 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:06.986088 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:06.986088 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 6914dc05e91240c9a3cca15d4ecfc3cf Jul 31 01:06:06.986088 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865-project Jul 31 01:06:06.986088 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:06.986088 n-d-master-1 devstack@n-api.service[119474]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 31 01:06:06.986088 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '8'} Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:06.986763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:06:06.987696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:06:06.987696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:06:06.987696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:06:06.987696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:06:06.987696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:06:06.987696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 31 01:06:06.987696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.987696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:06.987696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.987696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:06.987696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:06.987696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:06.987696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:06:06.987696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:06:06.987696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 31 01:06:06.987696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:06.989891 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f39bb43-79da-4fb1-a29c-7ab5c218ab71 tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:06.992276 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6f39bb43-79da-4fb1-a29c-7ab5c218ab71 tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] 10.222.0.45 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.030532 Jul 31 01:06:06.993072 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 53/95] 10.222.0.45 () {58 vars in 1149 bytes} [Sun Jul 31 01:06:06 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:07.004394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-724d2764-8a4f-4fac-a948-89fe4292aa4f tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:07.047644 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-724d2764-8a4f-4fac-a948-89fe4292aa4f tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.053274 Jul 31 01:06:07.058642 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 54/96] 10.222.0.45 () {58 vars in 1169 bytes} [Sun Jul 31 01:06:06 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:07.070513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-54c4291f-c889-4590-9384-6eb3532f652b tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:07.071559 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:07.071559 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:07.113139 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-54c4291f-c889-4590-9384-6eb3532f652b tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.052980 Jul 31 01:06:07.116203 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 55/97] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:06:07 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:07.131375 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-17c465a2-d943-4701-82e6-a09599089b06 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:07.155991 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-17c465a2-d943-4701-82e6-a09599089b06 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.035212 Jul 31 01:06:07.160079 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 56/98] 10.222.0.45 () {58 vars in 1177 bytes} [Sun Jul 31 01:06:07 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:07.171949 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-28ffd908-b1de-49a4-802e-2c20625c7414 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:07.179316 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:07.179316 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:07.210114 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-28ffd908-b1de-49a4-802e-2c20625c7414 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-28ffd908-b1de-49a4-802e-2c20625c7414 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Request method failure captured: Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dV0Qv9DBEc5_aQcul5-AcfiVWHPU7-yr1F_vYEbPK677XUQUK-je6FFKN1m6Ll9WbjyJcGYXWT4Qq2K_K3MT6h3pCsgLJl2PsRrhf0q9qvZFBvWgDbNzYzG4sjmb5XnuJ8pFmaDdO8H-b5ndeLEekVzbO-C42Xeb7HCIO5VYxgj9fg Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6def54c32aa54cffa86e5494da0f4b34 Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:06:07.213855 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:06:07.215125 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6def54c32aa54cffa86e5494da0f4b34", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:07.215125 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:07.215125 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6def54c32aa54cffa86e5494da0f4b34 Jul 31 01:06:07.215125 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:07.215125 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin Jul 31 01:06:07.215125 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:07.215125 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:07.215125 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 41d5ded808be42ec8c0b1134191742e6 Jul 31 01:06:07.215125 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin Jul 31 01:06:07.215125 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:07.215125 n-d-master-1 devstack@n-api.service[119474]: exception: Aggregate -1 could not be found. Jul 31 01:06:07.215125 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '-1'} Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:07.215763 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 31 01:06:07.216833 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:07.217765 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-28ffd908-b1de-49a4-802e-2c20625c7414 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:07.227975 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-28ffd908-b1de-49a4-802e-2c20625c7414 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.054298 Jul 31 01:06:07.244230 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 57/99] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:06:07 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:06:07.254636 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c5377187-3866-4a7a-be52-00063a7eb693 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:07.288879 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c5377187-3866-4a7a-be52-00063a7eb693 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.043021 Jul 31 01:06:07.290800 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 58/100] 10.222.0.45 () {58 vars in 1171 bytes} [Sun Jul 31 01:06:07 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:07.303001 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4cfc0a82-16d9-4fe8-96f9-1c771f44788d tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:07.308527 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:07.308527 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:07.310848 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4cfc0a82-16d9-4fe8-96f9-1c771f44788d tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '6914dc05e91240c9a3cca15d4ecfc3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eafe4a206e4141f3b0f07c1aa5e8ffd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4cfc0a82-16d9-4fe8-96f9-1c771f44788d tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Request method failure captured: Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dVxVfU84qM1wJ08a8-FVOA3BqVddY2X1If4ALa4Z2cnxBXV4PcoFyU0K7D-A1zUHNDJwixvpKtxtgrE-EewAsDTO9mrJWDY_5TKmPXQNf8AOgFW5iPmJpSmHqy0brdEQU9-9YIMC3lWxn_L_zFALIoDuxznafLVYyovCANsRP2XNX4 Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: eafe4a206e4141f3b0f07c1aa5e8ffd6 Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:06:07.315394 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:06:07.317321 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eafe4a206e4141f3b0f07c1aa5e8ffd6", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:07.317321 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:07.317321 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: eafe4a206e4141f3b0f07c1aa5e8ffd6 Jul 31 01:06:07.317321 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:07.317321 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AggregatesAdminNegativeTestJSON-1377799865-project Jul 31 01:06:07.317321 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:07.317321 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:07.317321 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 6914dc05e91240c9a3cca15d4ecfc3cf Jul 31 01:06:07.317321 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865-project Jul 31 01:06:07.317321 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:07.317321 n-d-master-1 devstack@n-api.service[119474]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 31 01:06:07.317321 n-d-master-1 devstack@n-api.service[119474]: action_args: {} Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:07.317928 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:06:07.318875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:06:07.318875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:06:07.318875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:06:07.318875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:06:07.318875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:06:07.318875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 31 01:06:07.318875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:07.318875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:07.318875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:07.318875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:07.318875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:07.318875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:07.318875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:06:07.318875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:06:07.318875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 31 01:06:07.318875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:07.330072 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4cfc0a82-16d9-4fe8-96f9-1c771f44788d tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:07.332844 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4cfc0a82-16d9-4fe8-96f9-1c771f44788d tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] 10.222.0.45 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.038503 Jul 31 01:06:07.333619 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 59/101] 10.222.0.45 () {58 vars in 1143 bytes} [Sun Jul 31 01:06:07 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:07.346701 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-576441aa-b1a5-4c7a-8fb0-960f3fee28e5 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:07.385779 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-576441aa-b1a5-4c7a-8fb0-960f3fee28e5 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.049721 Jul 31 01:06:07.389144 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 60/102] 10.222.0.45 () {58 vars in 1169 bytes} [Sun Jul 31 01:06:07 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:07.403539 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-178a7024-5536-4fde-b3bf-ed04fcc64be2 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:07.475084 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-178a7024-5536-4fde-b3bf-ed04fcc64be2 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.077326 Jul 31 01:06:07.476087 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 61/103] 10.222.0.45 () {58 vars in 1169 bytes} [Sun Jul 31 01:06:07 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:06:07.495529 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ed490e5-5699-4452-8e1d-b266c2249dd1 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:07.580920 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0ed490e5-5699-4452-8e1d-b266c2249dd1 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.089403 Jul 31 01:06:07.583125 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 62/104] 10.222.0.45 () {58 vars in 1175 bytes} [Sun Jul 31 01:06:07 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:06:07.604572 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d3e45ba4-da51-42e9-b592-d757a05ceece tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:07.636085 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d3e45ba4-da51-42e9-b592-d757a05ceece tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.037580 Jul 31 01:06:07.636675 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 63/105] 10.222.0.45 () {58 vars in 1173 bytes} [Sun Jul 31 01:06:07 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:07.655080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1657fb8c-fc91-4695-926c-1161b85b0ddb tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:07.700954 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1657fb8c-fc91-4695-926c-1161b85b0ddb tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.045062 Jul 31 01:06:07.704188 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 64/106] 10.222.0.45 () {58 vars in 1169 bytes} [Sun Jul 31 01:06:07 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:07.722274 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eea55982-e15a-4379-a729-92aabeb39a8b tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:07.723538 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:07.723538 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:07.767864 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eea55982-e15a-4379-a729-92aabeb39a8b tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/2018417939" status: 202 len: 0 microversion: 2.1 time: 0.049538 Jul 31 01:06:07.768772 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 65/107] 10.222.0.45 () {58 vars in 1161 bytes} [Sun Jul 31 01:06:07 2022] DELETE /compute/v2.1/flavors/2018417939 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 01:06:07.776891 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-94a0aaa6-5b24-4431-8121-3d62a3f9b51d tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:07.812406 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-94a0aaa6-5b24-4431-8121-3d62a3f9b51d tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039559 Jul 31 01:06:07.820660 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 66/108] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:06:07.838371 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4bd556b5-025e-40a0-8cfa-0c2e8289f5f7 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:07.882201 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4bd556b5-025e-40a0-8cfa-0c2e8289f5f7 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/468535560" status: 202 len: 0 microversion: 2.1 time: 0.047580 Jul 31 01:06:07.886019 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 67/109] 10.222.0.45 () {58 vars in 1158 bytes} [Sun Jul 31 01:06:07 2022] DELETE /compute/v2.1/flavors/468535560 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:06:07.891149 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-618dacbb-a943-4a8a-a59e-daa7c9d3279b tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:07.926047 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-618dacbb-a943-4a8a-a59e-daa7c9d3279b tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038611 Jul 31 01:06:07.935578 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 68/110] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:07.947178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-560de6fb-377d-487b-9ef1-e64e336d3bf2 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-418973279", "id": 845327443, "os-flavor-access:is_public": "False"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:07.949925 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:07.949925 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:07.984497 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-560de6fb-377d-487b-9ef1-e64e336d3bf2 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.042087 Jul 31 01:06:07.992287 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 69/111] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:07 2022] POST /compute/v2.1/flavors => generated 411 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:06:07.997118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-591f0a7d-5a0b-4dba-bedf-4174c52cc18e tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:08.036676 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-591f0a7d-5a0b-4dba-bedf-4174c52cc18e tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043137 Jul 31 01:06:08.050031 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 70/112] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:08.053961 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-50c585a9-05c3-459d-bd4f-bec881aea2f3 tempest-FlavorsAdminTestJSON-1352364219 tempest-FlavorsAdminTestJSON-1352364219-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:08.058850 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:06:08.060068 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:06:08.060908 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:06:08.061497 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:06:08.062963 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:06:08.093531 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:08.094717 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-50c585a9-05c3-459d-bd4f-bec881aea2f3 tempest-FlavorsAdminTestJSON-1352364219 tempest-FlavorsAdminTestJSON-1352364219-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044305 Jul 31 01:06:08.098375 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:08.099659 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:08.100350 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:08.119375 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 71/113] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:06:08.133298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f3efd733-4661-4ba1-8e0a-555fb273f234 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:08.178020 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f3efd733-4661-4ba1-8e0a-555fb273f234 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/845327443" status: 202 len: 0 microversion: 2.1 time: 0.050421 Jul 31 01:06:08.184858 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 72/114] 10.222.0.45 () {58 vars in 1158 bytes} [Sun Jul 31 01:06:08 2022] DELETE /compute/v2.1/flavors/845327443 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 01:06:08.197186 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3d9a1bd7-66eb-4add-883a-5ad8b0598ce4 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:08.236220 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Getting quotas for project 7f9b36e5f5fd4944b791d80037ef872b. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:06:08.255246 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Getting quotas for user 30734920b5a64cbe96bb43aa81c1539d and project 7f9b36e5f5fd4944b791d80037ef872b. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:06:08.266056 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3d9a1bd7-66eb-4add-883a-5ad8b0598ce4 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077569 Jul 31 01:06:08.268804 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 73/115] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:08.289047 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4a5980e4-4b08-4f48-8480-f6e5ba83736f tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1313611297", "id": 1937049759, "os-flavor-access:is_public": "True"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:08.308551 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:06:08.313330 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:06:08.333960 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4a5980e4-4b08-4f48-8480-f6e5ba83736f tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.047997 Jul 31 01:06:08.334793 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 74/116] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:08 2022] POST /compute/v2.1/flavors => generated 414 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:08.362470 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aa343ccd-4471-4eaf-b0f5-55e6d177872d tempest-FlavorsAdminTestJSON-1352364219 tempest-FlavorsAdminTestJSON-1352364219-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:08.422696 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aa343ccd-4471-4eaf-b0f5-55e6d177872d tempest-FlavorsAdminTestJSON-1352364219 tempest-FlavorsAdminTestJSON-1352364219-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.072066 Jul 31 01:06:08.437462 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 75/117] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:08 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:08.450205 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-260662aa-6bb2-448a-8ade-d8c211bc6130 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.865917 Jul 31 01:06:08.451670 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 43/118] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:06:08.453483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c0e51d55-7c07-4927-a403-ab34940ea974 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:08.466639 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c192ec79-062c-4c5e-8475-f6fe96758e78 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:08.468613 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c192ec79-062c-4c5e-8475-f6fe96758e78 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:08.494165 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=10,nova_api:DELETE=14 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:08.497736 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c0e51d55-7c07-4927-a403-ab34940ea974 tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1937049759" status: 202 len: 0 microversion: 2.1 time: 0.054566 Jul 31 01:06:08.503758 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 76/119] 10.222.0.45 () {58 vars in 1161 bytes} [Sun Jul 31 01:06:08 2022] DELETE /compute/v2.1/flavors/1937049759 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:06:08.515730 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9d85d9ec-f4d4-431d-90a1-425b43c4955c tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:08.584642 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9d85d9ec-f4d4-431d-90a1-425b43c4955c tempest-FlavorsAdminTestJSON-1912564997 tempest-FlavorsAdminTestJSON-1912564997-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071921 Jul 31 01:06:08.603037 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 77/120] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:08.852476 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c192ec79-062c-4c5e-8475-f6fe96758e78 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:08.882297 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c192ec79-062c-4c5e-8475-f6fe96758e78 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1242 microversion: 2.1 time: 0.422351 Jul 31 01:06:08.883588 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 44/121] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:08 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1242 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:06:09.910060 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-aa9a093b-b442-4a7a-b6bf-321912333fdd tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:09.911411 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-aa9a093b-b442-4a7a-b6bf-321912333fdd tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:10.108816 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-aa9a093b-b442-4a7a-b6bf-321912333fdd tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:10.118353 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-aa9a093b-b442-4a7a-b6bf-321912333fdd tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1242 microversion: 2.1 time: 0.213885 Jul 31 01:06:10.121919 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 45/122] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:09 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1242 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:10.230236 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-517e3a90-aa00-409d-8d6d-6f737e4ca4e0 tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] Action: 'create', calling method: .version_select at 0x7fede63bdca0>, body: {"keypair": {"name": "tempest-keypair-427100446", "type": "ssh", "user_id": "0491cea6f4034d1fb7171b2221b30ccb", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInMVqzUEIVDB7y3mowGInJjHTXjNsdA3/eciy6KI1Yxj7NNanLjFXJv9+qD1aKMUDubgy3Ub+2TzAqdFwcazfwZJtIZGXBAbhS1i1gLx9CvYi7nO8arYuv9mcdx7oaOJw=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:10.324634 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-517e3a90-aa00-409d-8d6d-6f737e4ca4e0 tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] Getting quotas for project 70d29635240842dfb4eea49e77d677a1. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:06:10.353639 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-517e3a90-aa00-409d-8d6d-6f737e4ca4e0 tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] Getting quotas for user fc8e2096f17d4f50b6b2e78f2058f5ad and project 70d29635240842dfb4eea49e77d677a1. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:06:10.445991 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-517e3a90-aa00-409d-8d6d-6f737e4ca4e0 tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.931673 Jul 31 01:06:10.448651 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 78/123] 10.222.0.45 () {62 vars in 1200 bytes} [Sun Jul 31 01:06:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 936 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:10.463872 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d9f27e7d-a211-4fde-ad14-b429f60bab7e tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] Action: 'create', calling method: .version_select at 0x7fede62f9430>, body: {"keypair": {"name": "tempest-keypair-530951570", "type": "ssh", "user_id": "0491cea6f4034d1fb7171b2221b30ccb", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbYvsKbf5jMuNN/5bHYLIKlUEBr/X20Zxm3uibUoG+IhvPECSZklywd9K0y3EW8Ow3NEnqUU2zJAlIm8FVosm/KkvNTWgDKAUUkLfmyLun3uM6phwbkSiEwqwGOZ2KHYw=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:10.507825 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-d9f27e7d-a211-4fde-ad14-b429f60bab7e tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] Getting quotas for project 70d29635240842dfb4eea49e77d677a1. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:06:10.516581 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-d9f27e7d-a211-4fde-ad14-b429f60bab7e tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] Getting quotas for user fc8e2096f17d4f50b6b2e78f2058f5ad and project 70d29635240842dfb4eea49e77d677a1. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:06:10.595546 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d9f27e7d-a211-4fde-ad14-b429f60bab7e tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.136565 Jul 31 01:06:10.596876 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 46/124] 10.222.0.45 () {62 vars in 1200 bytes} [Sun Jul 31 01:06:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:10.611697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7916e531-3342-4cd2-93df-48969c15da11 tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] Calling method '.version_select at 0x7fede63aaee0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:10.645449 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:DELETE=14 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:10.647562 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7916e531-3342-4cd2-93df-48969c15da11 tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] 10.222.0.45 "GET /compute/v2.1/os-keypairs/tempest-keypair-427100446?user_id=0491cea6f4034d1fb7171b2221b30ccb" status: 200 len: 511 microversion: 2.10 time: 0.043897 Jul 31 01:06:10.649060 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 79/125] 10.222.0.45 () {60 vars in 1337 bytes} [Sun Jul 31 01:06:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-427100446?user_id=0491cea6f4034d1fb7171b2221b30ccb => generated 511 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:10.666734 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4dbd6567-14c4-4f9d-96dd-7802b233bcfe tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] Action: 'create', calling method: .version_select at 0x7fede62f9ee0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-385859052", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLT6nd8F2o01jUNc1/67FlKqMDCzptu0w82z3bMGFs0GOOFWKYZRivecUuuRQAjwudk27+2XOY0/kT0NRsSHavigs7cp+4UEJVHzBiawesrCWrwvM5sHMUuwDm0m7VQTUw=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:10.687607 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-4dbd6567-14c4-4f9d-96dd-7802b233bcfe tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] Getting quotas for project 70d29635240842dfb4eea49e77d677a1. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:06:10.706100 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-4dbd6567-14c4-4f9d-96dd-7802b233bcfe tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] Getting quotas for user fc8e2096f17d4f50b6b2e78f2058f5ad and project 70d29635240842dfb4eea49e77d677a1. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:06:10.741929 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4dbd6567-14c4-4f9d-96dd-7802b233bcfe tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.081558 Jul 31 01:06:10.743201 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 47/126] 10.222.0.45 () {62 vars in 1200 bytes} [Sun Jul 31 01:06:10 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 31 01:06:10.755006 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e67d5d24-f45f-4936-a5a1-b72f5446063c tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] Calling method '.version_select at 0x7fede63aaa60>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:10.760586 n-d-master-1 devstack@n-api.service[119474]: WARNING oslo_db.sqlalchemy.utils [None req-e67d5d24-f45f-4936-a5a1-b72f5446063c tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 31 01:06:10.770266 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e67d5d24-f45f-4936-a5a1-b72f5446063c tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] 10.222.0.45 "GET /compute/v2.1/os-keypairs?user_id=0491cea6f4034d1fb7171b2221b30ccb" status: 200 len: 724 microversion: 2.10 time: 0.018952 Jul 31 01:06:10.771370 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 80/127] 10.222.0.45 () {60 vars in 1259 bytes} [Sun Jul 31 01:06:10 2022] GET /compute/v2.1/os-keypairs?user_id=0491cea6f4034d1fb7171b2221b30ccb => generated 724 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 01:06:10.783475 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ef1598e5-8602-48ff-b42b-5e133e98f165 tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] Calling method '.version_select at 0x7fede62dadc0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:10.813963 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ef1598e5-8602-48ff-b42b-5e133e98f165 tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-385859052" status: 204 len: 0 microversion: 2.10 time: 0.034406 Jul 31 01:06:10.820054 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 48/128] 10.222.0.45 () {60 vars in 1322 bytes} [Sun Jul 31 01:06:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-385859052 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:06:10.834728 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-446aa12d-3523-475f-aa59-85d21843fa2d tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] Calling method '.version_select at 0x7fede62f6b80>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:10.906480 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-446aa12d-3523-475f-aa59-85d21843fa2d tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-530951570?user_id=0491cea6f4034d1fb7171b2221b30ccb" status: 204 len: 0 microversion: 2.10 time: 0.083820 Jul 31 01:06:10.910709 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 81/129] 10.222.0.45 () {60 vars in 1340 bytes} [Sun Jul 31 01:06:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-530951570?user_id=0491cea6f4034d1fb7171b2221b30ccb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:06:10.919605 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-93daefda-96ab-4e97-8bfe-a7395ff838b5 tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] Calling method '.version_select at 0x7fede629a550>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:10.998855 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-93daefda-96ab-4e97-8bfe-a7395ff838b5 tempest-KeyPairsV210TestJSON-1115608762 tempest-KeyPairsV210TestJSON-1115608762-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-427100446?user_id=0491cea6f4034d1fb7171b2221b30ccb" status: 204 len: 0 microversion: 2.10 time: 0.083003 Jul 31 01:06:11.011398 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 49/130] 10.222.0.45 () {60 vars in 1340 bytes} [Sun Jul 31 01:06:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-427100446?user_id=0491cea6f4034d1fb7171b2221b30ccb => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:06:11.143150 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4d4c893c-df30-4d88-8665-a6203751f4ee tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:11.143884 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4d4c893c-df30-4d88-8665-a6203751f4ee tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:11.183005 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d4c893c-df30-4d88-8665-a6203751f4ee tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:11.184978 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d4c893c-df30-4d88-8665-a6203751f4ee tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:11.187955 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d4c893c-df30-4d88-8665-a6203751f4ee tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:11.189198 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d4c893c-df30-4d88-8665-a6203751f4ee tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:12.645472 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:13.912766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4d4c893c-df30-4d88-8665-a6203751f4ee tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:13.946571 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4d4c893c-df30-4d88-8665-a6203751f4ee tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1242 microversion: 2.1 time: 2.808362 Jul 31 01:06:13.951005 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 82/131] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:11 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1242 bytes in 2813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:14.987011 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e459a0e7-67fb-4941-abea-1e4ea89e3039 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:14.988673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e459a0e7-67fb-4941-abea-1e4ea89e3039 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:15.014701 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e459a0e7-67fb-4941-abea-1e4ea89e3039 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:15.015626 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e459a0e7-67fb-4941-abea-1e4ea89e3039 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:15.016662 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e459a0e7-67fb-4941-abea-1e4ea89e3039 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:15.019558 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e459a0e7-67fb-4941-abea-1e4ea89e3039 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:15.328328 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e459a0e7-67fb-4941-abea-1e4ea89e3039 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:15.344244 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e459a0e7-67fb-4941-abea-1e4ea89e3039 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1296 microversion: 2.1 time: 0.363775 Jul 31 01:06:15.348012 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 83/132] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:14 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1296 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:15.765026 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-293f4357-eb0c-460d-924d-59392e73ca06 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1341456092", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:15.940138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-293f4357-eb0c-460d-924d-59392e73ca06 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:06:16.372495 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21d07e23-63a3-46a9-8d4d-8b39133180c4 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:16.380693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-21d07e23-63a3-46a9-8d4d-8b39133180c4 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:16.406296 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21d07e23-63a3-46a9-8d4d-8b39133180c4 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:16.409156 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21d07e23-63a3-46a9-8d4d-8b39133180c4 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:16.410893 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21d07e23-63a3-46a9-8d4d-8b39133180c4 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:16.412438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21d07e23-63a3-46a9-8d4d-8b39133180c4 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:16.840836 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-21d07e23-63a3-46a9-8d4d-8b39133180c4 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:16.852378 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-21d07e23-63a3-46a9-8d4d-8b39133180c4 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1338 microversion: 2.1 time: 0.484238 Jul 31 01:06:16.857656 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 84/133] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:16 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1338 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:06:17.580080 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-293f4357-eb0c-460d-924d-59392e73ca06 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:06:17.580676 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-293f4357-eb0c-460d-924d-59392e73ca06 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:06:17.581036 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-293f4357-eb0c-460d-924d-59392e73ca06 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:06:17.581519 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-293f4357-eb0c-460d-924d-59392e73ca06 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:06:17.582137 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-293f4357-eb0c-460d-924d-59392e73ca06 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:06:17.630208 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-293f4357-eb0c-460d-924d-59392e73ca06 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:17.630686 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-293f4357-eb0c-460d-924d-59392e73ca06 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:17.642156 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-293f4357-eb0c-460d-924d-59392e73ca06 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:17.642737 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-293f4357-eb0c-460d-924d-59392e73ca06 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:17.726131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-293f4357-eb0c-460d-924d-59392e73ca06 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Getting quotas for project 00d5d344212642b29dbc39c58f8895f3. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:06:17.741653 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-293f4357-eb0c-460d-924d-59392e73ca06 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Getting quotas for user 1994d455dd3e4143a14ab7f856929080 and project 00d5d344212642b29dbc39c58f8895f3. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:06:17.770456 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fbabf25b-00b3-4420-9d03-1636ef26b871 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:17.775310 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-293f4357-eb0c-460d-924d-59392e73ca06 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:06:17.780138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-293f4357-eb0c-460d-924d-59392e73ca06 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:06:17.795053 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fbabf25b-00b3-4420-9d03-1636ef26b871 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.935870 Jul 31 01:06:17.796294 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 85/134] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:06:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:17.893819 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-293f4357-eb0c-460d-924d-59392e73ca06 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.357281 Jul 31 01:06:17.898392 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 50/135] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:06:17.908703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed53bfa9-62b4-4d41-8103-e2ba9b845538 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:17.909546 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ed53bfa9-62b4-4d41-8103-e2ba9b845538 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:17.917772 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed53bfa9-62b4-4d41-8103-e2ba9b845538 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:17.918842 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed53bfa9-62b4-4d41-8103-e2ba9b845538 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:17.921273 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed53bfa9-62b4-4d41-8103-e2ba9b845538 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:17.922848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed53bfa9-62b4-4d41-8103-e2ba9b845538 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:18.651048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ed53bfa9-62b4-4d41-8103-e2ba9b845538 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:18.670527 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ed53bfa9-62b4-4d41-8103-e2ba9b845538 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1338 microversion: 2.1 time: 0.769800 Jul 31 01:06:18.674606 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 51/136] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:17 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1338 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:18.692709 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1d9aa098-0105-4c80-8b06-fe06c549cc0c tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:18.693834 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1d9aa098-0105-4c80-8b06-fe06c549cc0c tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:18.855477 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1d9aa098-0105-4c80-8b06-fe06c549cc0c tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:18.870759 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1d9aa098-0105-4c80-8b06-fe06c549cc0c tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1220 microversion: 2.1 time: 0.193599 Jul 31 01:06:18.884853 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 52/137] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:18 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1220 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:18.988616 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d5c82d63-8b53-4df0-afcd-195b33a48fc4 tempest-ServersWithSpecificFlavorTestJSON-1056725628 tempest-ServersWithSpecificFlavorTestJSON-1056725628-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-370667008", "id": 1005941521, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:18.991989 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:18.991989 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:19.049395 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d5c82d63-8b53-4df0-afcd-195b33a48fc4 tempest-ServersWithSpecificFlavorTestJSON-1056725628 tempest-ServersWithSpecificFlavorTestJSON-1056725628-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 1.242913 Jul 31 01:06:19.051606 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 86/138] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:17 2022] POST /compute/v2.1/flavors => generated 424 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:06:19.063791 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4bc8ba70-c7c2-46ed-9ece-54e3a1723fea tempest-ServersWithSpecificFlavorTestJSON-1056725628 tempest-ServersWithSpecificFlavorTestJSON-1056725628-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:19.077737 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4bc8ba70-c7c2-46ed-9ece-54e3a1723fea tempest-ServersWithSpecificFlavorTestJSON-1056725628 tempest-ServersWithSpecificFlavorTestJSON-1056725628-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018041 Jul 31 01:06:19.086366 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 53/139] 10.222.0.45 () {58 vars in 1182 bytes} [Sun Jul 31 01:06:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:06:19.092133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-22a0775d-8abe-4d8e-9ab0-3a9034b8b1f7 tempest-ServersWithSpecificFlavorTestJSON-1056725628 tempest-ServersWithSpecificFlavorTestJSON-1056725628-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1441060425", "id": 140579913, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:19.191125 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-22a0775d-8abe-4d8e-9ab0-3a9034b8b1f7 tempest-ServersWithSpecificFlavorTestJSON-1056725628 tempest-ServersWithSpecificFlavorTestJSON-1056725628-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.102474 Jul 31 01:06:19.203297 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 87/140] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:19 2022] POST /compute/v2.1/flavors => generated 422 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:19.205001 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-91a6a530-f603-4862-a687-8bcd90093fa4 tempest-ServersWithSpecificFlavorTestJSON-1056725628 tempest-ServersWithSpecificFlavorTestJSON-1056725628-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:19.230445 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-91a6a530-f603-4862-a687-8bcd90093fa4 tempest-ServersWithSpecificFlavorTestJSON-1056725628 tempest-ServersWithSpecificFlavorTestJSON-1056725628-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029404 Jul 31 01:06:19.242069 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 54/141] 10.222.0.45 () {58 vars in 1182 bytes} [Sun Jul 31 01:06:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:06:19.255118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4986cf5b-8a0b-4c9c-9838-9fdd89669844 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Action: 'create', calling method: .version_select at 0x7fede62fb820>, body: {"keypair": {"name": "tempest-keypair-1989891644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfvX5+WILhV0oyT9PFbWrqLaksB9AIg4QZmGsJlUS0VVrkzb9nHZtV1XR80dkT22QoV0yRoNOBCm/k0IxfhT8vbiDkkJxD6ZS09S6Scblk4Zu+iz0k14AmLvabuLlfnGg=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:19.333346 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-4986cf5b-8a0b-4c9c-9838-9fdd89669844 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Getting quotas for project 69a24d132da74cd0a21d1851711745c0. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:06:19.361654 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-4986cf5b-8a0b-4c9c-9838-9fdd89669844 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Getting quotas for user 505f516270844b7e9d0f213c3ce3da6f and project 69a24d132da74cd0a21d1851711745c0. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:06:19.436504 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4986cf5b-8a0b-4c9c-9838-9fdd89669844 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.186793 Jul 31 01:06:19.442147 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 88/142] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:06:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:19.705700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-021d20f5-3569-4549-bc36-b9b04af83c37 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:19.706339 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-021d20f5-3569-4549-bc36-b9b04af83c37 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:19.731212 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-021d20f5-3569-4549-bc36-b9b04af83c37 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:19.731954 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-021d20f5-3569-4549-bc36-b9b04af83c37 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:19.733004 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-021d20f5-3569-4549-bc36-b9b04af83c37 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:19.736123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-021d20f5-3569-4549-bc36-b9b04af83c37 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:19.894286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-933df00e-9762-40dc-80b8-f77002d10f53 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:19.895045 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-933df00e-9762-40dc-80b8-f77002d10f53 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:20.971144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-933df00e-9762-40dc-80b8-f77002d10f53 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:20.996549 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-933df00e-9762-40dc-80b8-f77002d10f53 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1220 microversion: 2.1 time: 1.106201 Jul 31 01:06:20.998562 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 89/143] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:19 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1220 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:21.354082 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-021d20f5-3569-4549-bc36-b9b04af83c37 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:21.372184 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-021d20f5-3569-4549-bc36-b9b04af83c37 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1338 microversion: 2.1 time: 1.663067 Jul 31 01:06:21.372897 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 55/144] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:19 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1338 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:22.019715 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4ea63102-ec2c-4717-a7db-22868bde398d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:22.020371 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4ea63102-ec2c-4717-a7db-22868bde398d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:22.047185 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ea63102-ec2c-4717-a7db-22868bde398d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:22.048856 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ea63102-ec2c-4717-a7db-22868bde398d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:22.049701 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ea63102-ec2c-4717-a7db-22868bde398d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:22.050151 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ea63102-ec2c-4717-a7db-22868bde398d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:22.396512 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-db390087-d858-493d-9e1e-14bab7c941fb tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:22.397263 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-db390087-d858-493d-9e1e-14bab7c941fb tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:22.406617 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db390087-d858-493d-9e1e-14bab7c941fb tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:22.407081 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db390087-d858-493d-9e1e-14bab7c941fb tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:22.407937 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db390087-d858-493d-9e1e-14bab7c941fb tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:22.408385 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db390087-d858-493d-9e1e-14bab7c941fb tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:22.539774 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4ea63102-ec2c-4717-a7db-22868bde398d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:22.550224 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4ea63102-ec2c-4717-a7db-22868bde398d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1278 microversion: 2.1 time: 0.535928 Jul 31 01:06:22.568406 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 90/145] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:22 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1278 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:23.067781 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-db390087-d858-493d-9e1e-14bab7c941fb tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:23.076765 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-db390087-d858-493d-9e1e-14bab7c941fb tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1338 microversion: 2.1 time: 0.684717 Jul 31 01:06:23.080268 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 56/146] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:22 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1338 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:06:23.589913 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b1c9dfcf-ad05-4691-a3a7-a261d8a71e18 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:23.590688 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b1c9dfcf-ad05-4691-a3a7-a261d8a71e18 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:23.607019 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1c9dfcf-ad05-4691-a3a7-a261d8a71e18 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:23.610819 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1c9dfcf-ad05-4691-a3a7-a261d8a71e18 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:23.611821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1c9dfcf-ad05-4691-a3a7-a261d8a71e18 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:23.612366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1c9dfcf-ad05-4691-a3a7-a261d8a71e18 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:24.043281 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b1c9dfcf-ad05-4691-a3a7-a261d8a71e18 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:24.054135 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b1c9dfcf-ad05-4691-a3a7-a261d8a71e18 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1278 microversion: 2.1 time: 0.468427 Jul 31 01:06:24.055278 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 91/147] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:23 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1278 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:24.450393 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-cbef846b-5298-43df-98a8-09e9ded150a0 req-8458aad8-9fcf-4423-97d8-4b3143d3d850 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8", "tag": "c6c034ef-1782-4a89-acec-2c1fd500dc47"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:24.509147 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-cbef846b-5298-43df-98a8-09e9ded150a0 req-8458aad8-9fcf-4423-97d8-4b3143d3d850 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:24.509587 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-cbef846b-5298-43df-98a8-09e9ded150a0 req-8458aad8-9fcf-4423-97d8-4b3143d3d850 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:24.601711 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-cbef846b-5298-43df-98a8-09e9ded150a0 req-8458aad8-9fcf-4423-97d8-4b3143d3d850 service nova] Creating event network-changed:c6c034ef-1782-4a89-acec-2c1fd500dc47 for instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 on n-h1-master-1 Jul 31 01:06:24.602266 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-cbef846b-5298-43df-98a8-09e9ded150a0 req-8458aad8-9fcf-4423-97d8-4b3143d3d850 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 01:06:24.603429 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db861d56-df2b-474b-a70e-15c8deb8acc7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:24.621628 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db861d56-df2b-474b-a70e-15c8deb8acc7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:24.625690 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db861d56-df2b-474b-a70e-15c8deb8acc7 None None] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:24.641899 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db861d56-df2b-474b-a70e-15c8deb8acc7 None None] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:24.658137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-de505665-e52b-4198-affa-257625c6fb19 tempest-FlavorsV255TestJSON-2140757410 tempest-FlavorsV255TestJSON-2140757410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1711456031", "id": 793296752, "os-flavor-access:is_public": "True"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:24.662664 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:24.662664 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:24.681652 n-d-master-1 devstack@n-api.service[119475]: INFO nova.compute.rpcapi [None req-db861d56-df2b-474b-a70e-15c8deb8acc7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 31 01:06:24.681652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db861d56-df2b-474b-a70e-15c8deb8acc7 None None] Releasing lock "compute-rpcapi-router" {{(pid=119475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 01:06:24.702865 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-db861d56-df2b-474b-a70e-15c8deb8acc7 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.017214 Jul 31 01:06:24.704406 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 57/148] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:24.713851 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-de6148dc-06d7-4def-a459-3ae3c3bfba49 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:24.715439 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-de6148dc-06d7-4def-a459-3ae3c3bfba49 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:24.724029 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-de505665-e52b-4198-affa-257625c6fb19 tempest-FlavorsV255TestJSON-2140757410 tempest-FlavorsV255TestJSON-2140757410-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.627522 Jul 31 01:06:24.725112 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 92/149] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:06:24 2022] POST /compute/v2.1/flavors => generated 446 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:24.725354 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-de6148dc-06d7-4def-a459-3ae3c3bfba49 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:24.725958 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-de6148dc-06d7-4def-a459-3ae3c3bfba49 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:24.728624 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-de6148dc-06d7-4def-a459-3ae3c3bfba49 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:24.729519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-de6148dc-06d7-4def-a459-3ae3c3bfba49 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:25.378401 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-de6148dc-06d7-4def-a459-3ae3c3bfba49 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:25.392540 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-de6148dc-06d7-4def-a459-3ae3c3bfba49 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1338 microversion: 2.1 time: 0.685881 Jul 31 01:06:25.409523 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 58/150] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:24 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1338 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:25.419934 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d5d25d24-ebf8-439a-9a6d-78bc4ec5d126 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1210887451", "ram": 512, "vcpus": 1, "disk": 10, "id": 1462069733, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:25.468733 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d5d25d24-ebf8-439a-9a6d-78bc4ec5d126 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.742084 Jul 31 01:06:25.469841 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 93/151] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:24 2022] POST /compute/v2.1/flavors => generated 416 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:25.504039 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a3d83c17-5d17-4fab-af3b-07bcbbeb5962 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:25.504996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a3d83c17-5d17-4fab-af3b-07bcbbeb5962 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:25.527708 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3d83c17-5d17-4fab-af3b-07bcbbeb5962 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:25.528512 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3d83c17-5d17-4fab-af3b-07bcbbeb5962 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:25.529589 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3d83c17-5d17-4fab-af3b-07bcbbeb5962 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:25.530222 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3d83c17-5d17-4fab-af3b-07bcbbeb5962 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:25.712584 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a3d83c17-5d17-4fab-af3b-07bcbbeb5962 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:25.723745 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a3d83c17-5d17-4fab-af3b-07bcbbeb5962 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1278 microversion: 2.1 time: 0.244388 Jul 31 01:06:25.745050 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 94/152] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:25 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1278 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:25.812200 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ec0f11cd-fd2b-423e-ba80-92efba6e0c85 tempest-FlavorsV255TestJSON-1812856105 tempest-FlavorsV255TestJSON-1812856105-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:25.867148 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ec0f11cd-fd2b-423e-ba80-92efba6e0c85 tempest-FlavorsV255TestJSON-1812856105 tempest-FlavorsV255TestJSON-1812856105-project] 10.222.0.45 "GET /compute/v2.1/flavors/793296752" status: 200 len: 446 microversion: 2.55 time: 0.446113 Jul 31 01:06:25.872716 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 59/153] 10.222.0.45 () {60 vars in 1196 bytes} [Sun Jul 31 01:06:25 2022] GET /compute/v2.1/flavors/793296752 => generated 446 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:25.981048 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-330c3cc3-5c25-4d25-bffb-ca7dcd44bbd8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1851023695", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:26.103996 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6c94f7ab-6dc8-4145-b207-d4597070c03e tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:26.125034 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-6c94f7ab-6dc8-4145-b207-d4597070c03e tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] HTTP exception thrown: Flavor 1462069733 has no extra specs with key hw:cpu_thread_policy. Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6c94f7ab-6dc8-4145-b207-d4597070c03e tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] Request method failure captured: Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/flavors/1462069733/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWL_HVLwnClbQmIZFb2hGpP0U5-aTL6wFKWIn6W5ZCiJiTvj9uoen9jIaiBZb4v96nSTMbcU7XNAh-_HDXFeAQH--1ANnfZPggf7DCqXcHOiiFn-uvuhPMg-butrMxTXgiToD7T2Vyi_4iM-5NbKu52Tun_Wlr6_RGCMGaLeyd7Dk0 Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a5185afec8204fde8de1dcaa6ede3c93 Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:06:26.136825 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:06:26.138747 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a5185afec8204fde8de1dcaa6ede3c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a5185afec8204fde8de1dcaa6ede3c93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a5185afec8204fde8de1dcaa6ede3c93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a5185afec8204fde8de1dcaa6ede3c93", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:26.138747 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 Jul 31 01:06:26.138747 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a5185afec8204fde8de1dcaa6ede3c93 Jul 31 01:06:26.138747 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 Jul 31 01:06:26.138747 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project Jul 31 01:06:26.138747 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:26.138747 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:26.138747 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 46e77cdb93264d2ea97cb4c1f769c957 Jul 31 01:06:26.138747 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project Jul 31 01:06:26.138747 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:26.138747 n-d-master-1 devstack@n-api.service[119475]: exception: Flavor 1462069733 has no extra specs with key hw:cpu_thread_policy. Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: action_args: {'flavor_id': '1462069733', 'id': 'hw:cpu_thread_policy'} Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1462069733 has no extra specs with key hw:cpu_thread_policy. Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:26.139695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:26.141437 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:26.141437 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:26.141437 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:26.141437 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:26.141437 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:26.141437 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1462069733 has no extra specs with key hw:cpu_thread_policy. Jul 31 01:06:26.141437 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:26.141437 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6c94f7ab-6dc8-4145-b207-d4597070c03e tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] Returning 404 to user: Flavor 1462069733 has no extra specs with key hw:cpu_thread_policy. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:26.141437 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6c94f7ab-6dc8-4145-b207-d4597070c03e tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] 10.222.0.45 "GET /compute/v2.1/flavors/1462069733/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.264332 Jul 31 01:06:26.141437 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 60/154] 10.222.0.45 () {58 vars in 1266 bytes} [Sun Jul 31 01:06:25 2022] GET /compute/v2.1/flavors/1462069733/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 265 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:26.168814 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-91d4773c-60d1-4b4a-a39d-0e52a4294088 tempest-FlavorsV255TestJSON-2140757410 tempest-FlavorsV255TestJSON-2140757410-project-admin] Action: 'update', calling method: .version_select at 0x7fede8586550>, body: {"flavor": {"description": "new"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:26.228001 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:26.228001 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:26.396091 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-91d4773c-60d1-4b4a-a39d-0e52a4294088 tempest-FlavorsV255TestJSON-2140757410 tempest-FlavorsV255TestJSON-2140757410-project-admin] 10.222.0.45 "PUT /compute/v2.1/flavors/793296752" status: 200 len: 447 microversion: 2.55 time: 0.251849 Jul 31 01:06:26.398544 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 61/155] 10.222.0.45 () {62 vars in 1216 bytes} [Sun Jul 31 01:06:26 2022] PUT /compute/v2.1/flavors/793296752 => generated 447 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:26.408932 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ea0cce9b-0578-4575-8369-42e99ec7d250 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:26.427475 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:26.427475 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:26.428588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ea0cce9b-0578-4575-8369-42e99ec7d250 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '46e77cdb93264d2ea97cb4c1f769c957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5185afec8204fde8de1dcaa6ede3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ea0cce9b-0578-4575-8369-42e99ec7d250 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] Request method failure captured: Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/flavors/1462069733/os-extra_specs HTTP/1.1 Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 66 Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWL_HVLwnClbQmIZFb2hGpP0U5-aTL6wFKWIn6W5ZCiJiTvj9uoen9jIaiBZb4v96nSTMbcU7XNAh-_HDXFeAQH--1ANnfZPggf7DCqXcHOiiFn-uvuhPMg-butrMxTXgiToD7T2Vyi_4iM-5NbKu52Tun_Wlr6_RGCMGaLeyd7Dk0 Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a5185afec8204fde8de1dcaa6ede3c93 Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:06:26.432604 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:06:26.434063 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a5185afec8204fde8de1dcaa6ede3c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a5185afec8204fde8de1dcaa6ede3c93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a5185afec8204fde8de1dcaa6ede3c93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a5185afec8204fde8de1dcaa6ede3c93", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:26.434063 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 Jul 31 01:06:26.434063 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a5185afec8204fde8de1dcaa6ede3c93 Jul 31 01:06:26.434063 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 Jul 31 01:06:26.434063 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project Jul 31 01:06:26.434063 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:26.434063 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:26.434063 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 46e77cdb93264d2ea97cb4c1f769c957 Jul 31 01:06:26.434063 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project Jul 31 01:06:26.434063 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:06:26.434063 n-d-master-1 devstack@n-api.service[119475]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 31 01:06:26.434063 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: action_args: {'flavor_id': '1462069733', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:06:26.434884 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 31 01:06:26.436616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:26.437804 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ea0cce9b-0578-4575-8369-42e99ec7d250 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:26.437804 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ea0cce9b-0578-4575-8369-42e99ec7d250 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] 10.222.0.45 "POST /compute/v2.1/flavors/1462069733/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.035527 Jul 31 01:06:26.440091 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 62/156] 10.222.0.45 () {60 vars in 1224 bytes} [Sun Jul 31 01:06:26 2022] POST /compute/v2.1/flavors/1462069733/os-extra_specs => generated 124 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:26.446175 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-92992c2f-d319-4242-a590-8b7c97f48d3e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1982347195", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "140579913", "adminPass": "***", "networks": [{"uuid": "10f4e51d-9cd3-4323-a9ec-09ee36626e8f"}], "security_groups": [{"name": "tempest-securitygroup--1377524876"}], "key_name": "tempest-keypair-1989891644", "user_data": "}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:28.860839 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=26 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:30.464522 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-330c3cc3-5c25-4d25-bffb-ca7dcd44bbd8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] validate_networks() for None {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:06:30.883241 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-92992c2f-d319-4242-a590-8b7c97f48d3e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] validate_networks() for [('10f4e51d-9cd3-4323-a9ec-09ee36626e8f', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:06:30.980596 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=10 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:31.424805 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-330c3cc3-5c25-4d25-bffb-ca7dcd44bbd8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:06:31.425562 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-330c3cc3-5c25-4d25-bffb-ca7dcd44bbd8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:06:31.426229 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-330c3cc3-5c25-4d25-bffb-ca7dcd44bbd8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:06:31.426822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-330c3cc3-5c25-4d25-bffb-ca7dcd44bbd8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:06:31.427513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-330c3cc3-5c25-4d25-bffb-ca7dcd44bbd8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:06:31.453035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-330c3cc3-5c25-4d25-bffb-ca7dcd44bbd8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:31.453783 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-330c3cc3-5c25-4d25-bffb-ca7dcd44bbd8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:31.455840 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-330c3cc3-5c25-4d25-bffb-ca7dcd44bbd8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:31.456792 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-330c3cc3-5c25-4d25-bffb-ca7dcd44bbd8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:31.485585 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=61 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:31.512432 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-330c3cc3-5c25-4d25-bffb-ca7dcd44bbd8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Getting quotas for project 87496179e992473c991977e0e517460a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:06:31.524953 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-330c3cc3-5c25-4d25-bffb-ca7dcd44bbd8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Getting quotas for user 9a2a0f61c8304c9a9ad7af6120e83443 and project 87496179e992473c991977e0e517460a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:06:31.550084 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-330c3cc3-5c25-4d25-bffb-ca7dcd44bbd8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:06:31.553313 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-330c3cc3-5c25-4d25-bffb-ca7dcd44bbd8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:06:31.658742 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-330c3cc3-5c25-4d25-bffb-ca7dcd44bbd8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.912184 Jul 31 01:06:31.663606 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 95/157] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 5918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:06:31.670393 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3acc78cd-b680-4ba4-a52a-f0f4c88b8b39 tempest-FlavorsV255TestJSON-1812856105 tempest-FlavorsV255TestJSON-1812856105-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:31.708025 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3acc78cd-b680-4ba4-a52a-f0f4c88b8b39 tempest-FlavorsV255TestJSON-1812856105 tempest-FlavorsV255TestJSON-1812856105-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 7017 microversion: 2.55 time: 0.041350 Jul 31 01:06:31.709164 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 96/158] 10.222.0.45 () {60 vars in 1187 bytes} [Sun Jul 31 01:06:31 2022] GET /compute/v2.1/flavors/detail => generated 7017 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:06:31.714512 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-395b705b-d9f1-4145-ab5b-f4ace42d0c48 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:31.715507 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-395b705b-d9f1-4145-ab5b-f4ace42d0c48 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:31.722035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-395b705b-d9f1-4145-ab5b-f4ace42d0c48 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:31.722843 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-395b705b-d9f1-4145-ab5b-f4ace42d0c48 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:31.723909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-395b705b-d9f1-4145-ab5b-f4ace42d0c48 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:31.724566 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-395b705b-d9f1-4145-ab5b-f4ace42d0c48 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:32.037283 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-395b705b-d9f1-4145-ab5b-f4ace42d0c48 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:32.046338 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-395b705b-d9f1-4145-ab5b-f4ace42d0c48 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1338 microversion: 2.1 time: 0.335845 Jul 31 01:06:32.051971 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 97/159] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:31 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1338 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:32.073423 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4e1ecff8-a307-4182-a44b-5d5237cfcfbb tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:32.078199 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:32.078199 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:32.177332 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4e1ecff8-a307-4182-a44b-5d5237cfcfbb tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1462069733/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.123091 Jul 31 01:06:32.178462 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 98/160] 10.222.0.45 () {60 vars in 1224 bytes} [Sun Jul 31 01:06:32 2022] POST /compute/v2.1/flavors/1462069733/os-extra_specs => generated 66 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:06:32.186703 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-81545bdc-61a0-462f-8ae7-de0490d11497 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:32.190558 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-81545bdc-61a0-462f-8ae7-de0490d11497 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:32.210116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81545bdc-61a0-462f-8ae7-de0490d11497 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:32.210860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81545bdc-61a0-462f-8ae7-de0490d11497 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:32.211965 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81545bdc-61a0-462f-8ae7-de0490d11497 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:32.213918 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81545bdc-61a0-462f-8ae7-de0490d11497 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:33.063043 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-81545bdc-61a0-462f-8ae7-de0490d11497 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:33.073415 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-81545bdc-61a0-462f-8ae7-de0490d11497 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1320 microversion: 2.1 time: 0.894063 Jul 31 01:06:33.096418 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 99/161] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:32 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1320 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:33.117735 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9f5d4595-ca09-4f98-bfc6-e30bed779bc2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:33.120232 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9f5d4595-ca09-4f98-bfc6-e30bed779bc2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:33.138859 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f5d4595-ca09-4f98-bfc6-e30bed779bc2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:33.139593 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f5d4595-ca09-4f98-bfc6-e30bed779bc2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:33.142145 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f5d4595-ca09-4f98-bfc6-e30bed779bc2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:33.144188 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f5d4595-ca09-4f98-bfc6-e30bed779bc2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:33.304800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-92992c2f-d319-4242-a590-8b7c97f48d3e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:06:33.305314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-92992c2f-d319-4242-a590-8b7c97f48d3e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:06:33.305723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-92992c2f-d319-4242-a590-8b7c97f48d3e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:06:33.306147 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-92992c2f-d319-4242-a590-8b7c97f48d3e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:06:33.306566 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-92992c2f-d319-4242-a590-8b7c97f48d3e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:06:33.308921 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9f5d4595-ca09-4f98-bfc6-e30bed779bc2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:33.318586 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9f5d4595-ca09-4f98-bfc6-e30bed779bc2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1239 microversion: 2.1 time: 0.217751 Jul 31 01:06:33.321737 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 100/162] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:33 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1239 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:33.327578 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92992c2f-d319-4242-a590-8b7c97f48d3e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:33.328079 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92992c2f-d319-4242-a590-8b7c97f48d3e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:33.328912 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92992c2f-d319-4242-a590-8b7c97f48d3e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:33.329392 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92992c2f-d319-4242-a590-8b7c97f48d3e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:33.331779 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d6f22864-b9a5-4731-8cff-0f2bb5b791da tempest-FlavorsV255TestJSON-1812856105 tempest-FlavorsV255TestJSON-1812856105-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:33.352652 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=11 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:33.353312 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=53 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:33.386300 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d6f22864-b9a5-4731-8cff-0f2bb5b791da tempest-FlavorsV255TestJSON-1812856105 tempest-FlavorsV255TestJSON-1812856105-project] 10.222.0.45 "GET /compute/v2.1/flavors" status: 200 len: 3933 microversion: 2.55 time: 0.062349 Jul 31 01:06:33.386921 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-92992c2f-d319-4242-a590-8b7c97f48d3e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Getting quotas for project 69a24d132da74cd0a21d1851711745c0. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:06:33.387663 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 101/163] 10.222.0.45 () {60 vars in 1166 bytes} [Sun Jul 31 01:06:33 2022] GET /compute/v2.1/flavors => generated 3933 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:06:33.393615 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6c063569-db97-4eef-ac9a-f83bbcd30086 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:33.394742 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:33.394742 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:33.396112 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6c063569-db97-4eef-ac9a-f83bbcd30086 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '46e77cdb93264d2ea97cb4c1f769c957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5185afec8204fde8de1dcaa6ede3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6c063569-db97-4eef-ac9a-f83bbcd30086 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] Request method failure captured: Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/flavors/1462069733/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dWL_HVLwnClbQmIZFb2hGpP0U5-aTL6wFKWIn6W5ZCiJiTvj9uoen9jIaiBZb4v96nSTMbcU7XNAh-_HDXFeAQH--1ANnfZPggf7DCqXcHOiiFn-uvuhPMg-butrMxTXgiToD7T2Vyi_4iM-5NbKu52Tun_Wlr6_RGCMGaLeyd7Dk0 Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: a5185afec8204fde8de1dcaa6ede3c93 Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:06:33.399105 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:06:33.400414 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a5185afec8204fde8de1dcaa6ede3c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a5185afec8204fde8de1dcaa6ede3c93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a5185afec8204fde8de1dcaa6ede3c93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a5185afec8204fde8de1dcaa6ede3c93", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:33.400414 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 Jul 31 01:06:33.400414 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: a5185afec8204fde8de1dcaa6ede3c93 Jul 31 01:06:33.400414 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 Jul 31 01:06:33.400414 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project Jul 31 01:06:33.400414 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:33.400414 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:33.400414 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 46e77cdb93264d2ea97cb4c1f769c957 Jul 31 01:06:33.400414 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project Jul 31 01:06:33.400414 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:33.400414 n-d-master-1 devstack@n-api.service[119474]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: action_args: {'flavor_id': '1462069733', 'id': 'hw:numa_nodes'} Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:33.401093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:06:33.402173 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:06:33.402173 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:06:33.402173 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:06:33.402173 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:06:33.402173 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:06:33.402173 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 31 01:06:33.402173 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:33.402173 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:33.402173 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:33.402173 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:33.402173 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:33.402173 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:33.402173 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:06:33.402173 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:06:33.402173 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 31 01:06:33.402173 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:33.404961 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-92992c2f-d319-4242-a590-8b7c97f48d3e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Getting quotas for user 505f516270844b7e9d0f213c3ce3da6f and project 69a24d132da74cd0a21d1851711745c0. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:06:33.405259 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6c063569-db97-4eef-ac9a-f83bbcd30086 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:33.406652 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6c063569-db97-4eef-ac9a-f83bbcd30086 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] 10.222.0.45 "DELETE /compute/v2.1/flavors/1462069733/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017702 Jul 31 01:06:33.412754 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 102/164] 10.222.0.45 () {58 vars in 1248 bytes} [Sun Jul 31 01:06:33 2022] DELETE /compute/v2.1/flavors/1462069733/os-extra_specs/hw:numa_nodes => generated 124 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:33.418680 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ae0da46a-facb-407d-bb07-a5d0a6c606c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:33.420897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ae0da46a-facb-407d-bb07-a5d0a6c606c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:33.434403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-92992c2f-d319-4242-a590-8b7c97f48d3e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:06:33.436083 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae0da46a-facb-407d-bb07-a5d0a6c606c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:33.436688 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae0da46a-facb-407d-bb07-a5d0a6c606c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:33.437630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae0da46a-facb-407d-bb07-a5d0a6c606c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:33.438523 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae0da46a-facb-407d-bb07-a5d0a6c606c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:33.440983 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-92992c2f-d319-4242-a590-8b7c97f48d3e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:06:33.537614 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:33.601889 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-92992c2f-d319-4242-a590-8b7c97f48d3e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 7.160347 Jul 31 01:06:33.602856 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 63/165] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 7162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:06:33.821483 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-6cefa938-47d7-421d-b6d4-d4667fa33c6d req-873243d6-0ee4-4ffa-8460-84a339c34f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1acc67-c73e-4481-9e5a-87c112dc026e", "tag": "9b9e5438-ce9b-48e0-ad40-9d365147835c"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:33.852936 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6cefa938-47d7-421d-b6d4-d4667fa33c6d req-873243d6-0ee4-4ffa-8460-84a339c34f76 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:33.853400 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6cefa938-47d7-421d-b6d4-d4667fa33c6d req-873243d6-0ee4-4ffa-8460-84a339c34f76 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:33.882234 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-6cefa938-47d7-421d-b6d4-d4667fa33c6d req-873243d6-0ee4-4ffa-8460-84a339c34f76 service nova] Creating event network-changed:9b9e5438-ce9b-48e0-ad40-9d365147835c for instance cc1acc67-c73e-4481-9e5a-87c112dc026e on n-h2-master-1 Jul 31 01:06:33.902277 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-6cefa938-47d7-421d-b6d4-d4667fa33c6d req-873243d6-0ee4-4ffa-8460-84a339c34f76 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.269585 Jul 31 01:06:33.903710 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 64/166] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:33.925525 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7046bae8-54fc-4331-a089-02aa093a2ca3 tempest-FlavorsV255TestJSON-2140757410 tempest-FlavorsV255TestJSON-2140757410-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:33.931674 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:33.931674 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:33.988901 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7046bae8-54fc-4331-a089-02aa093a2ca3 tempest-FlavorsV255TestJSON-2140757410 tempest-FlavorsV255TestJSON-2140757410-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/793296752" status: 202 len: 0 microversion: 2.55 time: 0.083482 Jul 31 01:06:33.990123 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 65/167] 10.222.0.45 () {60 vars in 1199 bytes} [Sun Jul 31 01:06:33 2022] DELETE /compute/v2.1/flavors/793296752 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:06:33.999695 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-88778134-9413-4734-a211-342aff184619 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:34.018720 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:34.018720 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:34.154713 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-88778134-9413-4734-a211-342aff184619 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1462069733/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.163213 Jul 31 01:06:34.156146 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 66/168] 10.222.0.45 () {60 vars in 1224 bytes} [Sun Jul 31 01:06:33 2022] POST /compute/v2.1/flavors/1462069733/os-extra_specs => generated 66 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:06:34.163607 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7d93d423-5f05-4d86-97ef-04aa86f841da tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:34.174822 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7d93d423-5f05-4d86-97ef-04aa86f841da tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:34.183792 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ae0da46a-facb-407d-bb07-a5d0a6c606c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:34.193241 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ae0da46a-facb-407d-bb07-a5d0a6c606c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1338 microversion: 2.1 time: 0.779090 Jul 31 01:06:34.197992 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 103/169] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:33 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1338 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:34.206652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5ea44a93-fb95-4f6e-b2c8-53d28c50b321 tempest-FlavorsV255TestJSON-2140757410 tempest-FlavorsV255TestJSON-2140757410-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:34.264074 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5ea44a93-fb95-4f6e-b2c8-53d28c50b321 tempest-FlavorsV255TestJSON-2140757410 tempest-FlavorsV255TestJSON-2140757410-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 6580 microversion: 2.55 time: 0.061512 Jul 31 01:06:34.279904 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 104/170] 10.222.0.45 () {60 vars in 1187 bytes} [Sun Jul 31 01:06:34 2022] GET /compute/v2.1/flavors/detail => generated 6580 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:06:34.305348 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b41c0289-c922-49ef-b9d4-af4be9b76430 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:34.306228 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b41c0289-c922-49ef-b9d4-af4be9b76430 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:34.313702 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b41c0289-c922-49ef-b9d4-af4be9b76430 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:34.314294 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b41c0289-c922-49ef-b9d4-af4be9b76430 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:34.315182 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b41c0289-c922-49ef-b9d4-af4be9b76430 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:34.315687 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b41c0289-c922-49ef-b9d4-af4be9b76430 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:34.453470 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7d93d423-5f05-4d86-97ef-04aa86f841da tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:34.463661 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7d93d423-5f05-4d86-97ef-04aa86f841da tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 200 len: 1263 microversion: 2.1 time: 0.302876 Jul 31 01:06:34.478731 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 67/171] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:34 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 1263 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:34.490802 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6d8d4371-8012-4dd6-a7bb-fc54a4c2455e tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:34.493389 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:34.493389 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:34.494310 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6d8d4371-8012-4dd6-a7bb-fc54a4c2455e tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '46e77cdb93264d2ea97cb4c1f769c957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5185afec8204fde8de1dcaa6ede3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6d8d4371-8012-4dd6-a7bb-fc54a4c2455e tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] Request method failure captured: Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: request: PUT /compute/v2.1/flavors/1462069733/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 22 Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWL_HVLwnClbQmIZFb2hGpP0U5-aTL6wFKWIn6W5ZCiJiTvj9uoen9jIaiBZb4v96nSTMbcU7XNAh-_HDXFeAQH--1ANnfZPggf7DCqXcHOiiFn-uvuhPMg-butrMxTXgiToD7T2Vyi_4iM-5NbKu52Tun_Wlr6_RGCMGaLeyd7Dk0 Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a5185afec8204fde8de1dcaa6ede3c93 Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:06:34.496068 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:06:34.497499 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a5185afec8204fde8de1dcaa6ede3c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a5185afec8204fde8de1dcaa6ede3c93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a5185afec8204fde8de1dcaa6ede3c93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a5185afec8204fde8de1dcaa6ede3c93", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:34.497499 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 Jul 31 01:06:34.497499 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a5185afec8204fde8de1dcaa6ede3c93 Jul 31 01:06:34.497499 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 Jul 31 01:06:34.497499 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project Jul 31 01:06:34.497499 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:34.497499 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:34.497499 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 46e77cdb93264d2ea97cb4c1f769c957 Jul 31 01:06:34.497499 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project Jul 31 01:06:34.497499 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:06:34.497499 n-d-master-1 devstack@n-api.service[119475]: {"hw:numa_nodes": "1"} Jul 31 01:06:34.497499 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:34.497499 n-d-master-1 devstack@n-api.service[119475]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: action_args: {'flavor_id': '1462069733', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:34.498424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 31 01:06:34.500660 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.502511 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6d8d4371-8012-4dd6-a7bb-fc54a4c2455e tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:34.506351 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6d8d4371-8012-4dd6-a7bb-fc54a4c2455e tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068 tempest-FlavorsExtraSpecsNegativeTestJSON-1761352068-project] 10.222.0.45 "PUT /compute/v2.1/flavors/1462069733/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.026215 Jul 31 01:06:34.509881 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 68/172] 10.222.0.45 () {60 vars in 1265 bytes} [Sun Jul 31 01:06:34 2022] PUT /compute/v2.1/flavors/1462069733/os-extra_specs/hw:numa_nodes => generated 124 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:34.520855 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cefa1721-d17c-40e3-8718-3e113828e4c1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:34.521905 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cefa1721-d17c-40e3-8718-3e113828e4c1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:34.536895 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cefa1721-d17c-40e3-8718-3e113828e4c1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:34.537376 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cefa1721-d17c-40e3-8718-3e113828e4c1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:34.538180 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cefa1721-d17c-40e3-8718-3e113828e4c1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:34.538614 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cefa1721-d17c-40e3-8718-3e113828e4c1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:34.684465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cefa1721-d17c-40e3-8718-3e113828e4c1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:34.702850 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cefa1721-d17c-40e3-8718-3e113828e4c1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1293 microversion: 2.1 time: 0.187921 Jul 31 01:06:34.718674 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 69/173] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:34 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1293 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:34.730952 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ae3afa8a-8b53-4bd9-ae8e-65d108f7b28d tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:34.731652 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:34.731652 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:34.745751 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-ae3afa8a-8b53-4bd9-ae8e-65d108f7b28d tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] HTTP exception thrown: Flavor 1462069733 has no extra specs with key hw:cpu_thread_policy. Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ae3afa8a-8b53-4bd9-ae8e-65d108f7b28d tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] Request method failure captured: Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/flavors/1462069733/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWQThP1n3gJOrRndlM85vSvmRNbY3sDIRrGKdNp5Q4hSZuTqWodqlEGpn_Mmnu60iis5tFwUQEyqQGo4qOa6eK1CuMMXDLPAg_V-gkEqv7q10dnRj4h3a5Fhoo1GWCcmcA2zibSbTzOeCprWJrSJ5qr3R_PQ0RGB1Mj7g-og_lgamE Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: db6f6fb157554c888c3902f8c7d2fb57 Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:06:34.748724 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:06:34.749944 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db6f6fb157554c888c3902f8c7d2fb57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db6f6fb157554c888c3902f8c7d2fb57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db6f6fb157554c888c3902f8c7d2fb57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db6f6fb157554c888c3902f8c7d2fb57", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:34.749944 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 Jul 31 01:06:34.749944 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: db6f6fb157554c888c3902f8c7d2fb57 Jul 31 01:06:34.749944 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 Jul 31 01:06:34.749944 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin Jul 31 01:06:34.749944 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:34.749944 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:34.749944 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: a769f221421a4f4483252b2ba7a342e9 Jul 31 01:06:34.749944 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin Jul 31 01:06:34.749944 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:34.749944 n-d-master-1 devstack@n-api.service[119475]: exception: Flavor 1462069733 has no extra specs with key hw:cpu_thread_policy. Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: action_args: {'flavor_id': '1462069733', 'id': 'hw:cpu_thread_policy'} Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1462069733 has no extra specs with key hw:cpu_thread_policy. Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:34.750554 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.752624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:34.752624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:34.752624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:34.752624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:34.752624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:34.752624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1462069733 has no extra specs with key hw:cpu_thread_policy. Jul 31 01:06:34.752624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.754847 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ae3afa8a-8b53-4bd9-ae8e-65d108f7b28d tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] Returning 404 to user: Flavor 1462069733 has no extra specs with key hw:cpu_thread_policy. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:34.756180 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ae3afa8a-8b53-4bd9-ae8e-65d108f7b28d tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1462069733/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.036394 Jul 31 01:06:34.758224 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 70/174] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 01:06:34 2022] DELETE /compute/v2.1/flavors/1462069733/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:34.771764 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3af26163-9693-4c0a-8387-2cc74132db4f tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:34.774858 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:34.774858 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:34.776572 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-3af26163-9693-4c0a-8387-2cc74132db4f tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3af26163-9693-4c0a-8387-2cc74132db4f tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] Request method failure captured: Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: request: PUT /compute/v2.1/flavors/1462069733/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 27 Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWQThP1n3gJOrRndlM85vSvmRNbY3sDIRrGKdNp5Q4hSZuTqWodqlEGpn_Mmnu60iis5tFwUQEyqQGo4qOa6eK1CuMMXDLPAg_V-gkEqv7q10dnRj4h3a5Fhoo1GWCcmcA2zibSbTzOeCprWJrSJ5qr3R_PQ0RGB1Mj7g-og_lgamE Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: db6f6fb157554c888c3902f8c7d2fb57 Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:06:34.779266 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:06:34.780438 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db6f6fb157554c888c3902f8c7d2fb57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db6f6fb157554c888c3902f8c7d2fb57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db6f6fb157554c888c3902f8c7d2fb57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db6f6fb157554c888c3902f8c7d2fb57", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:34.780438 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 Jul 31 01:06:34.780438 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: db6f6fb157554c888c3902f8c7d2fb57 Jul 31 01:06:34.780438 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 Jul 31 01:06:34.780438 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin Jul 31 01:06:34.780438 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:34.780438 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:34.780438 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: a769f221421a4f4483252b2ba7a342e9 Jul 31 01:06:34.780438 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin Jul 31 01:06:34.780438 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:06:34.780438 n-d-master-1 devstack@n-api.service[119475]: {"hw:cpu_policy": "shared"} Jul 31 01:06:34.780438 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:34.780438 n-d-master-1 devstack@n-api.service[119475]: exception: Request body and URI mismatch Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: action_args: {'flavor_id': '1462069733', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:34.781112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:34.782240 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:34.782240 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:34.782240 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 31 01:06:34.782240 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.785144 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3af26163-9693-4c0a-8387-2cc74132db4f tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:34.787006 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3af26163-9693-4c0a-8387-2cc74132db4f tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] 10.222.0.45 "PUT /compute/v2.1/flavors/1462069733/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.020631 Jul 31 01:06:34.788167 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 71/175] 10.222.0.45 () {60 vars in 1265 bytes} [Sun Jul 31 01:06:34 2022] PUT /compute/v2.1/flavors/1462069733/os-extra_specs/hw:numa_nodes => generated 73 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 31 01:06:34.799722 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-26c8e1b1-3589-4bd5-b8e7-e89254f7090a tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-26c8e1b1-3589-4bd5-b8e7-e89254f7090a tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] Request method failure captured: Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: request: PUT /compute/v2.1/flavors/1462069733/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 49 Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWQThP1n3gJOrRndlM85vSvmRNbY3sDIRrGKdNp5Q4hSZuTqWodqlEGpn_Mmnu60iis5tFwUQEyqQGo4qOa6eK1CuMMXDLPAg_V-gkEqv7q10dnRj4h3a5Fhoo1GWCcmcA2zibSbTzOeCprWJrSJ5qr3R_PQ0RGB1Mj7g-og_lgamE Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: db6f6fb157554c888c3902f8c7d2fb57 Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:06:34.804112 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:06:34.805428 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db6f6fb157554c888c3902f8c7d2fb57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/db6f6fb157554c888c3902f8c7d2fb57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/db6f6fb157554c888c3902f8c7d2fb57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_db6f6fb157554c888c3902f8c7d2fb57", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:34.805428 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 Jul 31 01:06:34.805428 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: db6f6fb157554c888c3902f8c7d2fb57 Jul 31 01:06:34.805428 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 Jul 31 01:06:34.805428 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin Jul 31 01:06:34.805428 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:34.805428 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:34.805428 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: a769f221421a4f4483252b2ba7a342e9 Jul 31 01:06:34.805428 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin Jul 31 01:06:34.805428 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:06:34.805428 n-d-master-1 devstack@n-api.service[119475]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 31 01:06:34.805428 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: action_args: {'flavor_id': '1462069733', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance: Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 31 01:06:34.806072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.807245 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:34.808391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:34.808391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:34.808391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:06:34.808391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:06:34.808391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 31 01:06:34.808391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:34.808391 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-26c8e1b1-3589-4bd5-b8e7-e89254f7090a tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:34.808391 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-26c8e1b1-3589-4bd5-b8e7-e89254f7090a tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] 10.222.0.45 "PUT /compute/v2.1/flavors/1462069733/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.010994 Jul 31 01:06:34.810475 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 72/176] 10.222.0.45 () {60 vars in 1265 bytes} [Sun Jul 31 01:06:34 2022] PUT /compute/v2.1/flavors/1462069733/os-extra_specs/hw:numa_nodes => generated 117 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:06:34.816241 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dac9544b-b4a9-4931-8863-c35ac2e3037d tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:34.817214 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:34.817214 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:34.837782 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dac9544b-b4a9-4931-8863-c35ac2e3037d tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1462069733" status: 202 len: 0 microversion: 2.1 time: 0.025805 Jul 31 01:06:34.843122 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 73/177] 10.222.0.45 () {58 vars in 1161 bytes} [Sun Jul 31 01:06:34 2022] DELETE /compute/v2.1/flavors/1462069733 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:06:34.850602 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-633765c5-283a-43c1-958e-45c403aac31b tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:34.882141 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-633765c5-283a-43c1-958e-45c403aac31b tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041 tempest-FlavorsExtraSpecsNegativeTestJSON-1286873041-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.037086 Jul 31 01:06:34.900439 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b41c0289-c922-49ef-b9d4-af4be9b76430 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:34.907544 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 74/178] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:34 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:34.908617 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b41c0289-c922-49ef-b9d4-af4be9b76430 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1320 microversion: 2.1 time: 0.625979 Jul 31 01:06:34.909632 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 105/179] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:34 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1320 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:35.222674 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1bd86c7a-fefb-4f13-ba58-530a563e12a7 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:35.223770 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1bd86c7a-fefb-4f13-ba58-530a563e12a7 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:35.233377 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bd86c7a-fefb-4f13-ba58-530a563e12a7 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:35.234058 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bd86c7a-fefb-4f13-ba58-530a563e12a7 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:35.235411 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bd86c7a-fefb-4f13-ba58-530a563e12a7 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:35.236064 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bd86c7a-fefb-4f13-ba58-530a563e12a7 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:35.486056 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3ef7908a-30b5-4ea1-a85e-7bc2193ff0b0 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:35.486852 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3ef7908a-30b5-4ea1-a85e-7bc2193ff0b0 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:35.498744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ef7908a-30b5-4ea1-a85e-7bc2193ff0b0 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:35.499204 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ef7908a-30b5-4ea1-a85e-7bc2193ff0b0 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:35.500022 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ef7908a-30b5-4ea1-a85e-7bc2193ff0b0 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:35.500459 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ef7908a-30b5-4ea1-a85e-7bc2193ff0b0 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:35.705191 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1bd86c7a-fefb-4f13-ba58-530a563e12a7 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:35.712201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3ef7908a-30b5-4ea1-a85e-7bc2193ff0b0 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:35.714170 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1bd86c7a-fefb-4f13-ba58-530a563e12a7 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1338 microversion: 2.1 time: 0.498671 Jul 31 01:06:35.727915 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3ef7908a-30b5-4ea1-a85e-7bc2193ff0b0 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 200 len: 1315 microversion: 2.1 time: 0.244828 Jul 31 01:06:35.727915 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 106/180] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:35 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:35.729095 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 75/181] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:35 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1338 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:35.744538 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b0620e93-6eb9-4cd4-a58a-67a2fb2a09b3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:35.744995 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b0620e93-6eb9-4cd4-a58a-67a2fb2a09b3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:35.748136 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=10,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:35.752380 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0620e93-6eb9-4cd4-a58a-67a2fb2a09b3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:35.752835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0620e93-6eb9-4cd4-a58a-67a2fb2a09b3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:35.753634 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0620e93-6eb9-4cd4-a58a-67a2fb2a09b3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:35.754265 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0620e93-6eb9-4cd4-a58a-67a2fb2a09b3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:35.934182 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b3af76df-4916-412c-81f6-ea70da96d5a0 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:35.934910 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b3af76df-4916-412c-81f6-ea70da96d5a0 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:35.945429 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3af76df-4916-412c-81f6-ea70da96d5a0 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:35.945881 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3af76df-4916-412c-81f6-ea70da96d5a0 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:35.946692 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3af76df-4916-412c-81f6-ea70da96d5a0 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:35.951142 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3af76df-4916-412c-81f6-ea70da96d5a0 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:36.200605 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b0620e93-6eb9-4cd4-a58a-67a2fb2a09b3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:36.208435 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b0620e93-6eb9-4cd4-a58a-67a2fb2a09b3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1293 microversion: 2.1 time: 0.480624 Jul 31 01:06:36.208922 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 107/182] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:35 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1293 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:36.454634 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b3af76df-4916-412c-81f6-ea70da96d5a0 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:36.467230 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b3af76df-4916-412c-81f6-ea70da96d5a0 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1320 microversion: 2.1 time: 0.537154 Jul 31 01:06:36.470750 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 76/183] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:35 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1320 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:36.735307 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5087ce1f-181b-4310-ad4c-81b862a7da30 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:36.736842 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5087ce1f-181b-4310-ad4c-81b862a7da30 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:36.741980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-76b7f219-1ffd-44cb-bc86-d2c502f2518f req-330296b7-4502-4e42-bfc9-d8726ce6a57f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8", "name": "network-vif-plugged", "status": "completed", "tag": "c6c034ef-1782-4a89-acec-2c1fd500dc47"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:36.745072 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5087ce1f-181b-4310-ad4c-81b862a7da30 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:36.745788 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5087ce1f-181b-4310-ad4c-81b862a7da30 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:36.746853 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5087ce1f-181b-4310-ad4c-81b862a7da30 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:36.747583 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5087ce1f-181b-4310-ad4c-81b862a7da30 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:36.761177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-76b7f219-1ffd-44cb-bc86-d2c502f2518f req-330296b7-4502-4e42-bfc9-d8726ce6a57f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:36.761868 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-76b7f219-1ffd-44cb-bc86-d2c502f2518f req-330296b7-4502-4e42-bfc9-d8726ce6a57f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:36.801092 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-76b7f219-1ffd-44cb-bc86-d2c502f2518f req-330296b7-4502-4e42-bfc9-d8726ce6a57f service nova] Creating event network-vif-plugged:c6c034ef-1782-4a89-acec-2c1fd500dc47 for instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 on n-h1-master-1 Jul 31 01:06:36.802214 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-76b7f219-1ffd-44cb-bc86-d2c502f2518f req-330296b7-4502-4e42-bfc9-d8726ce6a57f service nova] Acquired lock "compute-rpcapi-router" {{(pid=119474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 01:06:36.804363 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d2486b9-afe5-42dd-af71-90165cf43c66 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:36.805324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d2486b9-afe5-42dd-af71-90165cf43c66 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:36.806737 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d2486b9-afe5-42dd-af71-90165cf43c66 None None] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:36.808823 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d2486b9-afe5-42dd-af71-90165cf43c66 None None] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:36.830922 n-d-master-1 devstack@n-api.service[119474]: INFO nova.compute.rpcapi [None req-7d2486b9-afe5-42dd-af71-90165cf43c66 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 31 01:06:36.832378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d2486b9-afe5-42dd-af71-90165cf43c66 None None] Releasing lock "compute-rpcapi-router" {{(pid=119474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 01:06:36.858543 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7d2486b9-afe5-42dd-af71-90165cf43c66 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219620 Jul 31 01:06:36.860267 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 108/184] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:36.868945 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-706d8d2b-3670-49f8-9bfa-12df94ca8fee tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:36.869883 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-706d8d2b-3670-49f8-9bfa-12df94ca8fee tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:36.879441 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-706d8d2b-3670-49f8-9bfa-12df94ca8fee tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:36.880180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-706d8d2b-3670-49f8-9bfa-12df94ca8fee tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:36.881283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-706d8d2b-3670-49f8-9bfa-12df94ca8fee tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:36.881902 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-706d8d2b-3670-49f8-9bfa-12df94ca8fee tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:37.045079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-706d8d2b-3670-49f8-9bfa-12df94ca8fee tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:37.062819 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-706d8d2b-3670-49f8-9bfa-12df94ca8fee tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 200 len: 1323 microversion: 2.1 time: 0.200732 Jul 31 01:06:37.076807 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 109/185] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:36 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 1323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:37.231887 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c083a35d-2ea4-45f5-adb5-0a8ec5398bb3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:37.232577 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c083a35d-2ea4-45f5-adb5-0a8ec5398bb3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:37.246921 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c083a35d-2ea4-45f5-adb5-0a8ec5398bb3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:37.250035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c083a35d-2ea4-45f5-adb5-0a8ec5398bb3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:37.255583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c083a35d-2ea4-45f5-adb5-0a8ec5398bb3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:37.256052 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c083a35d-2ea4-45f5-adb5-0a8ec5398bb3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:37.339146 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5087ce1f-181b-4310-ad4c-81b862a7da30 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:37.348704 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5087ce1f-181b-4310-ad4c-81b862a7da30 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1338 microversion: 2.1 time: 0.618219 Jul 31 01:06:37.349975 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 77/186] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:36 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1338 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:06:37.488795 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5b5eae29-0bb0-46c1-b9d2-ba1316d8dc64 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:37.489737 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5b5eae29-0bb0-46c1-b9d2-ba1316d8dc64 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:37.496610 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b5eae29-0bb0-46c1-b9d2-ba1316d8dc64 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:37.497428 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b5eae29-0bb0-46c1-b9d2-ba1316d8dc64 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:37.498446 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b5eae29-0bb0-46c1-b9d2-ba1316d8dc64 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:37.499588 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b5eae29-0bb0-46c1-b9d2-ba1316d8dc64 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:37.684039 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c083a35d-2ea4-45f5-adb5-0a8ec5398bb3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:37.698562 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c083a35d-2ea4-45f5-adb5-0a8ec5398bb3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1335 microversion: 2.1 time: 0.470541 Jul 31 01:06:37.700889 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 110/187] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:37 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1335 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:06:38.007468 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5b5eae29-0bb0-46c1-b9d2-ba1316d8dc64 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:38.024287 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5b5eae29-0bb0-46c1-b9d2-ba1316d8dc64 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1320 microversion: 2.1 time: 0.531536 Jul 31 01:06:38.040996 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 78/188] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:37 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1320 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:38.086595 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d1e54eca-a4d6-4ac7-bbcf-f8ddb3fda545 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:38.087229 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d1e54eca-a4d6-4ac7-bbcf-f8ddb3fda545 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:38.139794 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d1e54eca-a4d6-4ac7-bbcf-f8ddb3fda545 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:38.146931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d1e54eca-a4d6-4ac7-bbcf-f8ddb3fda545 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:38.152402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d1e54eca-a4d6-4ac7-bbcf-f8ddb3fda545 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:38.152945 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d1e54eca-a4d6-4ac7-bbcf-f8ddb3fda545 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:38.356748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d1e54eca-a4d6-4ac7-bbcf-f8ddb3fda545 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:38.371277 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eb22dc7d-5538-405e-856c-99c279c91b6f tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:38.372252 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d1e54eca-a4d6-4ac7-bbcf-f8ddb3fda545 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 200 len: 1321 microversion: 2.1 time: 0.284217 Jul 31 01:06:38.372990 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 111/189] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:38 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:38.373325 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eb22dc7d-5538-405e-856c-99c279c91b6f tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:38.387054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb22dc7d-5538-405e-856c-99c279c91b6f tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:38.387832 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb22dc7d-5538-405e-856c-99c279c91b6f tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:38.390396 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb22dc7d-5538-405e-856c-99c279c91b6f tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:38.400093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb22dc7d-5538-405e-856c-99c279c91b6f tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:38.721526 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c746df1-2fa0-4d22-b6ab-3329b889fae4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:38.722357 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2c746df1-2fa0-4d22-b6ab-3329b889fae4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:38.735806 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c746df1-2fa0-4d22-b6ab-3329b889fae4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:38.736651 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c746df1-2fa0-4d22-b6ab-3329b889fae4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:38.737586 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c746df1-2fa0-4d22-b6ab-3329b889fae4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:38.738167 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c746df1-2fa0-4d22-b6ab-3329b889fae4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:39.164548 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eb22dc7d-5538-405e-856c-99c279c91b6f tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:39.174138 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eb22dc7d-5538-405e-856c-99c279c91b6f tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1338 microversion: 2.1 time: 0.805441 Jul 31 01:06:39.189730 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 79/190] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:38 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1338 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:06:39.194690 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-33fdff65-d2f9-4989-920d-10d73cb8dccd tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:39.195638 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-33fdff65-d2f9-4989-920d-10d73cb8dccd tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:39.225989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33fdff65-d2f9-4989-920d-10d73cb8dccd tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:39.226628 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33fdff65-d2f9-4989-920d-10d73cb8dccd tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:39.227612 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33fdff65-d2f9-4989-920d-10d73cb8dccd tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:39.228302 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33fdff65-d2f9-4989-920d-10d73cb8dccd tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:39.547055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2c746df1-2fa0-4d22-b6ab-3329b889fae4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:39.561857 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2c746df1-2fa0-4d22-b6ab-3329b889fae4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1335 microversion: 2.1 time: 0.844546 Jul 31 01:06:39.564297 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 112/191] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:38 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1335 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:06:39.590777 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-19e4b26f-137d-45d8-a9c2-216d79428d77 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:39.592935 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-19e4b26f-137d-45d8-a9c2-216d79428d77 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:39.615818 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-19e4b26f-137d-45d8-a9c2-216d79428d77 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:39.620448 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-19e4b26f-137d-45d8-a9c2-216d79428d77 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:39.621726 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-19e4b26f-137d-45d8-a9c2-216d79428d77 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:39.622352 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-19e4b26f-137d-45d8-a9c2-216d79428d77 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:40.035805 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-33fdff65-d2f9-4989-920d-10d73cb8dccd tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:40.062717 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-33fdff65-d2f9-4989-920d-10d73cb8dccd tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1320 microversion: 2.1 time: 0.871781 Jul 31 01:06:40.073403 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 80/192] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:39 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1320 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:40.196911 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2d6a3279-a50c-461f-8159-8b56bb4893e8 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:40.197870 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2d6a3279-a50c-461f-8159-8b56bb4893e8 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:40.216740 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d6a3279-a50c-461f-8159-8b56bb4893e8 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:40.219996 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d6a3279-a50c-461f-8159-8b56bb4893e8 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:40.223414 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d6a3279-a50c-461f-8159-8b56bb4893e8 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:40.227642 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d6a3279-a50c-461f-8159-8b56bb4893e8 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:40.970299 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-19e4b26f-137d-45d8-a9c2-216d79428d77 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:40.991981 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-19e4b26f-137d-45d8-a9c2-216d79428d77 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 200 len: 1389 microversion: 2.1 time: 1.424681 Jul 31 01:06:40.994138 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 113/193] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:39 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 1389 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:41.014514 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-63a2b175-9578-4359-b1c9-a384cf70f2d7 req-0509f29d-34a3-4471-85ae-bb7522132474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eccd8f8d-d332-4c4e-bef6-30de69b8f681", "tag": "f7832bd1-893a-4d8d-a8db-89c1491322de"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:41.034954 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-63a2b175-9578-4359-b1c9-a384cf70f2d7 req-0509f29d-34a3-4471-85ae-bb7522132474 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:41.037331 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-63a2b175-9578-4359-b1c9-a384cf70f2d7 req-0509f29d-34a3-4471-85ae-bb7522132474 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:41.078074 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-63a2b175-9578-4359-b1c9-a384cf70f2d7 req-0509f29d-34a3-4471-85ae-bb7522132474 service nova] Creating event network-changed:f7832bd1-893a-4d8d-a8db-89c1491322de for instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 on n-h2-master-1 Jul 31 01:06:41.089903 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2d6a3279-a50c-461f-8159-8b56bb4893e8 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:41.101998 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-63a2b175-9578-4359-b1c9-a384cf70f2d7 req-0509f29d-34a3-4471-85ae-bb7522132474 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106275 Jul 31 01:06:41.103926 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2d6a3279-a50c-461f-8159-8b56bb4893e8 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1488 microversion: 2.1 time: 0.911093 Jul 31 01:06:41.104270 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 114/194] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:41.122947 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 81/195] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:40 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1488 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:41.127241 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e8b4a4e8-66c2-41f6-b89c-8a9bdaa75070 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:41.129189 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e8b4a4e8-66c2-41f6-b89c-8a9bdaa75070 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:41.134821 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-b4e12384-10f8-4b29-8537-f65d62b43f10 req-e9f88043-124a-44f9-961b-1c535f31d27c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "389e7feb-f45c-4e78-ad80-6a5d230e68ba", "tag": "59525f1d-b7cd-4a9a-86cf-0466f0ad21ef"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:41.157876 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b4e12384-10f8-4b29-8537-f65d62b43f10 req-e9f88043-124a-44f9-961b-1c535f31d27c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:41.158741 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b4e12384-10f8-4b29-8537-f65d62b43f10 req-e9f88043-124a-44f9-961b-1c535f31d27c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:41.159909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8b4a4e8-66c2-41f6-b89c-8a9bdaa75070 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:41.160551 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8b4a4e8-66c2-41f6-b89c-8a9bdaa75070 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:41.162151 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8b4a4e8-66c2-41f6-b89c-8a9bdaa75070 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:41.162758 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8b4a4e8-66c2-41f6-b89c-8a9bdaa75070 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:41.184117 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-b4e12384-10f8-4b29-8537-f65d62b43f10 req-e9f88043-124a-44f9-961b-1c535f31d27c service nova] Creating event network-changed:59525f1d-b7cd-4a9a-86cf-0466f0ad21ef for instance 389e7feb-f45c-4e78-ad80-6a5d230e68ba on n-h1-master-1 Jul 31 01:06:41.201242 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-b4e12384-10f8-4b29-8537-f65d62b43f10 req-e9f88043-124a-44f9-961b-1c535f31d27c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076870 Jul 31 01:06:41.202207 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 82/196] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:41.207426 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a33cf987-3610-4fae-b11c-2d6225cf901a tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:41.208144 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a33cf987-3610-4fae-b11c-2d6225cf901a tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:41.230428 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a33cf987-3610-4fae-b11c-2d6225cf901a tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:41.231007 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a33cf987-3610-4fae-b11c-2d6225cf901a tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:41.231839 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a33cf987-3610-4fae-b11c-2d6225cf901a tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:41.232288 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a33cf987-3610-4fae-b11c-2d6225cf901a tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:41.544586 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:41.779588 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e8b4a4e8-66c2-41f6-b89c-8a9bdaa75070 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:41.784811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a33cf987-3610-4fae-b11c-2d6225cf901a tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:41.790245 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e8b4a4e8-66c2-41f6-b89c-8a9bdaa75070 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1335 microversion: 2.1 time: 0.684359 Jul 31 01:06:41.791251 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 115/197] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:41 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1335 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:41.795395 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a33cf987-3610-4fae-b11c-2d6225cf901a tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1320 microversion: 2.1 time: 0.591931 Jul 31 01:06:41.799034 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 83/198] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:41 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1320 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:41.817437 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-199daa75-8f29-405a-b8e3-ddac35ad6d0a tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:41.818345 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-199daa75-8f29-405a-b8e3-ddac35ad6d0a tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:41.829330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-199daa75-8f29-405a-b8e3-ddac35ad6d0a tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:41.829794 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-199daa75-8f29-405a-b8e3-ddac35ad6d0a tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:41.833054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-199daa75-8f29-405a-b8e3-ddac35ad6d0a tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:41.834057 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-199daa75-8f29-405a-b8e3-ddac35ad6d0a tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:42.116677 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21a9b42d-d3e5-4b61-9fd9-11a762efbfb9 tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Calling method '.version_select at 0x7fede60fbca0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:42.118412 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:42.118412 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:42.119788 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-21a9b42d-d3e5-4b61-9fd9-11a762efbfb9 tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '131f889806ae453e8ed9635ced04beae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c3f138ede449b9adf7341614708716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21a9b42d-d3e5-4b61-9fd9-11a762efbfb9 tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Request method failure captured: Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dWfH4T61PJDNg7HaVagah3HZY_nv_0DGb5a8gsf9BlRolkqI9fgR6ejeUbGKtMrSW1G-kFau2lf3khQO0UG-P_ixwakl6WQAyxPG2hhlK6T54rj10YM6uM0aAIre2Mxe64vW9Zs3X0PmrjFQroXoaakKyuCx09cdxJ2GKb9cXq0Buw Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 40c3f138ede449b9adf7341614708716 Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-479430249 Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:06:42.122300 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:06:42.123437 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/40c3f138ede449b9adf7341614708716"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/40c3f138ede449b9adf7341614708716"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/40c3f138ede449b9adf7341614708716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_40c3f138ede449b9adf7341614708716", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:42.123437 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-479430249 Jul 31 01:06:42.123437 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 40c3f138ede449b9adf7341614708716 Jul 31 01:06:42.123437 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-479430249 Jul 31 01:06:42.123437 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-HypervisorAdminNegativeTestJSON-479430249-project Jul 31 01:06:42.123437 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:42.123437 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:42.123437 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 131f889806ae453e8ed9635ced04beae Jul 31 01:06:42.123437 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-479430249-project Jul 31 01:06:42.123437 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:06:42.123437 n-d-master-1 devstack@n-api.service[119474]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 31 01:06:42.123437 n-d-master-1 devstack@n-api.service[119474]: action_args: {} Jul 31 01:06:42.123437 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:42.124154 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 31 01:06:42.125126 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:42.128982 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21a9b42d-d3e5-4b61-9fd9-11a762efbfb9 tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:42.130077 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-21a9b42d-d3e5-4b61-9fd9-11a762efbfb9 tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.337506 Jul 31 01:06:42.131147 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 116/199] 10.222.0.45 () {58 vars in 1167 bytes} [Sun Jul 31 01:06:41 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 339 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:42.136692 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-3f9cfe22-c7e8-4ed1-ba62-f41f8229eafb req-ab856f3c-46b8-47a1-90bb-1e393322e033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1acc67-c73e-4481-9e5a-87c112dc026e", "name": "network-vif-plugged", "status": "completed", "tag": "9b9e5438-ce9b-48e0-ad40-9d365147835c"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:42.149756 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3f9cfe22-c7e8-4ed1-ba62-f41f8229eafb req-ab856f3c-46b8-47a1-90bb-1e393322e033 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:42.150549 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3f9cfe22-c7e8-4ed1-ba62-f41f8229eafb req-ab856f3c-46b8-47a1-90bb-1e393322e033 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:42.164948 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-3f9cfe22-c7e8-4ed1-ba62-f41f8229eafb req-ab856f3c-46b8-47a1-90bb-1e393322e033 service nova] Creating event network-vif-plugged:9b9e5438-ce9b-48e0-ad40-9d365147835c for instance cc1acc67-c73e-4481-9e5a-87c112dc026e on n-h2-master-1 Jul 31 01:06:42.171204 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-3f9cfe22-c7e8-4ed1-ba62-f41f8229eafb req-ab856f3c-46b8-47a1-90bb-1e393322e033 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038550 Jul 31 01:06:42.172280 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 117/200] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:42.183091 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cf215d3c-56a6-4d96-980c-305dcbeca7b7 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:42.185233 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cf215d3c-56a6-4d96-980c-305dcbeca7b7 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:42.193722 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf215d3c-56a6-4d96-980c-305dcbeca7b7 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:42.194503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf215d3c-56a6-4d96-980c-305dcbeca7b7 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:42.195532 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf215d3c-56a6-4d96-980c-305dcbeca7b7 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:42.196199 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf215d3c-56a6-4d96-980c-305dcbeca7b7 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:42.826673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cf215d3c-56a6-4d96-980c-305dcbeca7b7 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:42.840462 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cf215d3c-56a6-4d96-980c-305dcbeca7b7 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 200 len: 1389 microversion: 2.1 time: 0.665436 Jul 31 01:06:42.841330 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 118/201] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:42 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 1389 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:42.856535 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a0329d55-7f59-4856-bce7-5b174429076b tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Calling method '.version_select at 0x7fede6198550>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:42.858239 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:42.858239 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:42.859745 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a0329d55-7f59-4856-bce7-5b174429076b tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '131f889806ae453e8ed9635ced04beae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c3f138ede449b9adf7341614708716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a0329d55-7f59-4856-bce7-5b174429076b tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Request method failure captured: Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dWfH4T61PJDNg7HaVagah3HZY_nv_0DGb5a8gsf9BlRolkqI9fgR6ejeUbGKtMrSW1G-kFau2lf3khQO0UG-P_ixwakl6WQAyxPG2hhlK6T54rj10YM6uM0aAIre2Mxe64vW9Zs3X0PmrjFQroXoaakKyuCx09cdxJ2GKb9cXq0Buw Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 40c3f138ede449b9adf7341614708716 Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-479430249 Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:06:42.863085 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:06:42.864487 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/40c3f138ede449b9adf7341614708716"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/40c3f138ede449b9adf7341614708716"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/40c3f138ede449b9adf7341614708716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_40c3f138ede449b9adf7341614708716", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:42.864487 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-479430249 Jul 31 01:06:42.864487 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 40c3f138ede449b9adf7341614708716 Jul 31 01:06:42.864487 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-479430249 Jul 31 01:06:42.864487 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-HypervisorAdminNegativeTestJSON-479430249-project Jul 31 01:06:42.864487 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:42.864487 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:42.864487 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 131f889806ae453e8ed9635ced04beae Jul 31 01:06:42.864487 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-479430249-project Jul 31 01:06:42.864487 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:06:42.864487 n-d-master-1 devstack@n-api.service[119474]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 31 01:06:42.864487 n-d-master-1 devstack@n-api.service[119474]: action_args: {} Jul 31 01:06:42.864487 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:42.865163 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 31 01:06:42.866182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:42.869789 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a0329d55-7f59-4856-bce7-5b174429076b tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:42.871126 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a0329d55-7f59-4856-bce7-5b174429076b tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.028197 Jul 31 01:06:42.872256 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 119/202] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:42 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:42.879401 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-60a15084-a25b-4d23-a061-3b2a2a9a88f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:42.880387 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-60a15084-a25b-4d23-a061-3b2a2a9a88f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:42.890883 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60a15084-a25b-4d23-a061-3b2a2a9a88f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:42.891260 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60a15084-a25b-4d23-a061-3b2a2a9a88f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:42.892774 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60a15084-a25b-4d23-a061-3b2a2a9a88f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:42.893220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60a15084-a25b-4d23-a061-3b2a2a9a88f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:42.942188 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-199daa75-8f29-405a-b8e3-ddac35ad6d0a tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1639 microversion: 2.1 time: 1.142044 Jul 31 01:06:42.948969 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 84/203] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:41 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1639 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:42.965650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3f8e6053-e701-48c5-9d5e-4cf342e868fd tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:42.970447 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3f8e6053-e701-48c5-9d5e-4cf342e868fd tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:42.977093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f8e6053-e701-48c5-9d5e-4cf342e868fd tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:42.977784 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f8e6053-e701-48c5-9d5e-4cf342e868fd tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:42.978725 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f8e6053-e701-48c5-9d5e-4cf342e868fd tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:42.979322 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f8e6053-e701-48c5-9d5e-4cf342e868fd tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:43.280148 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-60a15084-a25b-4d23-a061-3b2a2a9a88f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:43.296667 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-60a15084-a25b-4d23-a061-3b2a2a9a88f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1335 microversion: 2.1 time: 0.422281 Jul 31 01:06:43.298534 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 120/204] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:42 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1335 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:43.307616 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d71b749d-5fe2-45a6-beba-a3843958be0c tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Calling method '.version_select at 0x7fede62fb820>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:43.308690 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:43.308690 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:43.310174 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d71b749d-5fe2-45a6-beba-a3843958be0c tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '131f889806ae453e8ed9635ced04beae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c3f138ede449b9adf7341614708716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d71b749d-5fe2-45a6-beba-a3843958be0c tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Request method failure captured: Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dWfH4T61PJDNg7HaVagah3HZY_nv_0DGb5a8gsf9BlRolkqI9fgR6ejeUbGKtMrSW1G-kFau2lf3khQO0UG-P_ixwakl6WQAyxPG2hhlK6T54rj10YM6uM0aAIre2Mxe64vW9Zs3X0PmrjFQroXoaakKyuCx09cdxJ2GKb9cXq0Buw Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 40c3f138ede449b9adf7341614708716 Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-479430249 Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:06:43.311992 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:06:43.313191 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/40c3f138ede449b9adf7341614708716"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/40c3f138ede449b9adf7341614708716"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/40c3f138ede449b9adf7341614708716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_40c3f138ede449b9adf7341614708716", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:43.313191 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-479430249 Jul 31 01:06:43.313191 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 40c3f138ede449b9adf7341614708716 Jul 31 01:06:43.313191 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-479430249 Jul 31 01:06:43.313191 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-HypervisorAdminNegativeTestJSON-479430249-project Jul 31 01:06:43.313191 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:43.313191 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:43.313191 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 131f889806ae453e8ed9635ced04beae Jul 31 01:06:43.313191 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-479430249-project Jul 31 01:06:43.313191 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:06:43.313191 n-d-master-1 devstack@n-api.service[119474]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 31 01:06:43.313191 n-d-master-1 devstack@n-api.service[119474]: action_args: {} Jul 31 01:06:43.313191 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:43.314460 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 31 01:06:43.315486 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.318755 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d71b749d-5fe2-45a6-beba-a3843958be0c tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:43.319852 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d71b749d-5fe2-45a6-beba-a3843958be0c tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.020196 Jul 31 01:06:43.328444 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 121/205] 10.222.0.45 () {58 vars in 1179 bytes} [Sun Jul 31 01:06:43 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:43.346873 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-28b5e5b9-548a-4c09-b205-b4efdcc14a2d tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:43.347409 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-28b5e5b9-548a-4c09-b205-b4efdcc14a2d tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:43.359061 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28b5e5b9-548a-4c09-b205-b4efdcc14a2d tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:43.359783 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28b5e5b9-548a-4c09-b205-b4efdcc14a2d tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:43.361114 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28b5e5b9-548a-4c09-b205-b4efdcc14a2d tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:43.361634 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28b5e5b9-548a-4c09-b205-b4efdcc14a2d tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:43.366171 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:43.378118 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:43.390811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3f8e6053-e701-48c5-9d5e-4cf342e868fd tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:43.392452 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-28b5e5b9-548a-4c09-b205-b4efdcc14a2d tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:06:43.402831 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3f8e6053-e701-48c5-9d5e-4cf342e868fd tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1320 microversion: 2.1 time: 0.446184 Jul 31 01:06:43.404843 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 85/206] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:42 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1320 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:43.514690 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-61b6cbd7-7f39-4743-996d-ac24ce70fb04 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Calling method '.version_select at 0x7fede6207160>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:43.515623 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:43.515623 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:43.516994 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61b6cbd7-7f39-4743-996d-ac24ce70fb04 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:43.517536 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61b6cbd7-7f39-4743-996d-ac24ce70fb04 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:43.542517 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61b6cbd7-7f39-4743-996d-ac24ce70fb04 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:43.543230 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61b6cbd7-7f39-4743-996d-ac24ce70fb04 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:43.571668 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61b6cbd7-7f39-4743-996d-ac24ce70fb04 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:43.572396 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61b6cbd7-7f39-4743-996d-ac24ce70fb04 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:43.582316 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-61b6cbd7-7f39-4743-996d-ac24ce70fb04 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.176120 Jul 31 01:06:43.583255 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 86/207] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:43.595245 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8796dee9-4ded-4d9d-8368-3eb0627f68f0 tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Calling method '.version_select at 0x7fede6192d30>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:43.596397 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:43.596397 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:43.598953 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8796dee9-4ded-4d9d-8368-3eb0627f68f0 tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '131f889806ae453e8ed9635ced04beae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c3f138ede449b9adf7341614708716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8796dee9-4ded-4d9d-8368-3eb0627f68f0 tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Request method failure captured: Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWfH4T61PJDNg7HaVagah3HZY_nv_0DGb5a8gsf9BlRolkqI9fgR6ejeUbGKtMrSW1G-kFau2lf3khQO0UG-P_ixwakl6WQAyxPG2hhlK6T54rj10YM6uM0aAIre2Mxe64vW9Zs3X0PmrjFQroXoaakKyuCx09cdxJ2GKb9cXq0Buw Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 40c3f138ede449b9adf7341614708716 Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-479430249 Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:06:43.603231 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:06:43.604508 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/40c3f138ede449b9adf7341614708716"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/40c3f138ede449b9adf7341614708716"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/40c3f138ede449b9adf7341614708716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_40c3f138ede449b9adf7341614708716", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:43.604508 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-479430249 Jul 31 01:06:43.604508 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 40c3f138ede449b9adf7341614708716 Jul 31 01:06:43.604508 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-479430249 Jul 31 01:06:43.604508 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-HypervisorAdminNegativeTestJSON-479430249-project Jul 31 01:06:43.604508 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:43.604508 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:43.604508 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 131f889806ae453e8ed9635ced04beae Jul 31 01:06:43.604508 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-479430249-project Jul 31 01:06:43.604508 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:06:43.604508 n-d-master-1 devstack@n-api.service[119475]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 31 01:06:43.604508 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '1'} Jul 31 01:06:43.604508 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:43.605327 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 31 01:06:43.606462 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.607360 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8796dee9-4ded-4d9d-8368-3eb0627f68f0 tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:43.607360 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8796dee9-4ded-4d9d-8368-3eb0627f68f0 tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.014116 Jul 31 01:06:43.609656 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 87/208] 10.222.0.45 () {58 vars in 1173 bytes} [Sun Jul 31 01:06:43 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:43.623640 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-28b5e5b9-548a-4c09-b205-b4efdcc14a2d tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "DELETE /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 204 len: 0 microversion: 2.1 time: 0.289538 Jul 31 01:06:43.624450 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 122/209] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:06:43 2022] DELETE /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:06:43.625924 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3bb6d6d9-f8a3-42c6-8607-f53681786c26 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Calling method '.version_select at 0x7fede6125670>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:43.628068 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-3bb6d6d9-f8a3-42c6-8607-f53681786c26 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] HTTP exception thrown: Hypervisor with ID 'dfae3146-6a24-4f4d-bb54-1d787fa845cb' could not be found. Jul 31 01:06:43.637732 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c705b9b-6df2-4828-ac40-057c73abbe37 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:43.639754 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2c705b9b-6df2-4828-ac40-057c73abbe37 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3bb6d6d9-f8a3-42c6-8607-f53681786c26 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Request method failure captured: Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-hypervisors/dfae3146-6a24-4f4d-bb54-1d787fa845cb/uptime HTTP/1.1 Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWg-9N0a9sokt0_yfHpsyEWzDOwvWt90p1VvarYmKECmpfxG2N2vEx3dZg-ZgDSMP2aMmRSINVsxH1VvSSo0c4caCji8ZDnezl_SbNrnXF7G4LUPtsgjYtkdzfBcvnpT9-Wotz3ZcldaNwjeHJNc-drAWhboW9owkfXvq-bFcR99x0 Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: ba0d349f1c554179b2bf7cb4ac04c516 Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-312202312 Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:06:43.643052 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:06:43.644491 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba0d349f1c554179b2bf7cb4ac04c516"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba0d349f1c554179b2bf7cb4ac04c516"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ba0d349f1c554179b2bf7cb4ac04c516"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ba0d349f1c554179b2bf7cb4ac04c516", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:43.644491 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-312202312 Jul 31 01:06:43.644491 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: ba0d349f1c554179b2bf7cb4ac04c516 Jul 31 01:06:43.644491 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-312202312 Jul 31 01:06:43.644491 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin Jul 31 01:06:43.644491 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:43.644491 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:43.644491 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 9185fb7fd7d14d9ba2bf7638f2a98e9a Jul 31 01:06:43.644491 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin Jul 31 01:06:43.644491 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:06:43.644491 n-d-master-1 devstack@n-api.service[119475]: exception: Hypervisor with ID 'dfae3146-6a24-4f4d-bb54-1d787fa845cb' could not be found. Jul 31 01:06:43.644491 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'dfae3146-6a24-4f4d-bb54-1d787fa845cb'} Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'dfae3146-6a24-4f4d-bb54-1d787fa845cb' Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 31 01:06:43.645297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'dfae3146-6a24-4f4d-bb54-1d787fa845cb' could not be found. Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:43.646661 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.648059 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:43.648059 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:43.648059 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:43.648059 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:43.648059 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:43.648059 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'dfae3146-6a24-4f4d-bb54-1d787fa845cb' could not be found. Jul 31 01:06:43.648059 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.652610 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3bb6d6d9-f8a3-42c6-8607-f53681786c26 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Returning 404 to user: Hypervisor with ID 'dfae3146-6a24-4f4d-bb54-1d787fa845cb' could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:43.653656 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3bb6d6d9-f8a3-42c6-8607-f53681786c26 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/dfae3146-6a24-4f4d-bb54-1d787fa845cb/uptime" status: 404 len: 123 microversion: 2.1 time: 0.040012 Jul 31 01:06:43.659124 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 88/210] 10.222.0.45 () {58 vars in 1278 bytes} [Sun Jul 31 01:06:43 2022] GET /compute/v2.1/os-hypervisors/dfae3146-6a24-4f4d-bb54-1d787fa845cb/uptime => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:43.668554 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c705b9b-6df2-4828-ac40-057c73abbe37 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:43.669007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c705b9b-6df2-4828-ac40-057c73abbe37 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:43.671790 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f5efa0a8-f24d-48f8-971b-78051b60027c tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Calling method '.version_select at 0x7fede6125430>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:43.672425 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c705b9b-6df2-4828-ac40-057c73abbe37 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:43.673603 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c705b9b-6df2-4828-ac40-057c73abbe37 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:43.674080 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:43.674080 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:43.675718 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5efa0a8-f24d-48f8-971b-78051b60027c tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:43.676374 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5efa0a8-f24d-48f8-971b-78051b60027c tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:43.696073 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5efa0a8-f24d-48f8-971b-78051b60027c tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:43.696819 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5efa0a8-f24d-48f8-971b-78051b60027c tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:43.720393 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5efa0a8-f24d-48f8-971b-78051b60027c tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:43.721174 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5efa0a8-f24d-48f8-971b-78051b60027c tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:43.737131 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f5efa0a8-f24d-48f8-971b-78051b60027c tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.072468 Jul 31 01:06:43.738072 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 89/211] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:06:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:43.758443 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-09c1f877-fb10-448a-9e3c-62bcae9978d6 tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Calling method '.version_select at 0x7fede629f160>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:43.760342 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:43.760342 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:43.763012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-09c1f877-fb10-448a-9e3c-62bcae9978d6 tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '131f889806ae453e8ed9635ced04beae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c3f138ede449b9adf7341614708716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-09c1f877-fb10-448a-9e3c-62bcae9978d6 tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Request method failure captured: Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWfH4T61PJDNg7HaVagah3HZY_nv_0DGb5a8gsf9BlRolkqI9fgR6ejeUbGKtMrSW1G-kFau2lf3khQO0UG-P_ixwakl6WQAyxPG2hhlK6T54rj10YM6uM0aAIre2Mxe64vW9Zs3X0PmrjFQroXoaakKyuCx09cdxJ2GKb9cXq0Buw Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 40c3f138ede449b9adf7341614708716 Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-479430249 Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:06:43.766098 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:06:43.768075 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/40c3f138ede449b9adf7341614708716"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/40c3f138ede449b9adf7341614708716"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/40c3f138ede449b9adf7341614708716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_40c3f138ede449b9adf7341614708716", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:43.768075 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-479430249 Jul 31 01:06:43.768075 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 40c3f138ede449b9adf7341614708716 Jul 31 01:06:43.768075 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-479430249 Jul 31 01:06:43.768075 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-HypervisorAdminNegativeTestJSON-479430249-project Jul 31 01:06:43.768075 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:43.768075 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:43.768075 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 131f889806ae453e8ed9635ced04beae Jul 31 01:06:43.768075 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-479430249-project Jul 31 01:06:43.768075 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:06:43.768075 n-d-master-1 devstack@n-api.service[119475]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 31 01:06:43.768075 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '1'} Jul 31 01:06:43.768075 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:43.768762 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 31 01:06:43.769765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.774312 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-09c1f877-fb10-448a-9e3c-62bcae9978d6 tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:43.776118 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-09c1f877-fb10-448a-9e3c-62bcae9978d6 tempest-HypervisorAdminNegativeTestJSON-479430249 tempest-HypervisorAdminNegativeTestJSON-479430249-project] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.030271 Jul 31 01:06:43.777275 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 90/212] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:06:43 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:43.792595 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-17e430c8-af3b-48d7-b7c6-758ca7657d28 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Calling method '.version_select at 0x7fede61e89d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:43.797520 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-17e430c8-af3b-48d7-b7c6-758ca7657d28 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] HTTP exception thrown: Hypervisor with ID '6b91185c-69a7-49d3-bbc0-c5ad96fa363c' could not be found. Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-17e430c8-af3b-48d7-b7c6-758ca7657d28 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Request method failure captured: Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-hypervisors/6b91185c-69a7-49d3-bbc0-c5ad96fa363c HTTP/1.1 Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWg-9N0a9sokt0_yfHpsyEWzDOwvWt90p1VvarYmKECmpfxG2N2vEx3dZg-ZgDSMP2aMmRSINVsxH1VvSSo0c4caCji8ZDnezl_SbNrnXF7G4LUPtsgjYtkdzfBcvnpT9-Wotz3ZcldaNwjeHJNc-drAWhboW9owkfXvq-bFcR99x0 Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: ba0d349f1c554179b2bf7cb4ac04c516 Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-312202312 Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:06:43.799725 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:06:43.800991 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba0d349f1c554179b2bf7cb4ac04c516"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba0d349f1c554179b2bf7cb4ac04c516"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ba0d349f1c554179b2bf7cb4ac04c516"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ba0d349f1c554179b2bf7cb4ac04c516", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:43.800991 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-312202312 Jul 31 01:06:43.800991 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: ba0d349f1c554179b2bf7cb4ac04c516 Jul 31 01:06:43.800991 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-312202312 Jul 31 01:06:43.800991 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin Jul 31 01:06:43.800991 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:43.800991 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:43.800991 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 9185fb7fd7d14d9ba2bf7638f2a98e9a Jul 31 01:06:43.800991 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin Jul 31 01:06:43.800991 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:06:43.800991 n-d-master-1 devstack@n-api.service[119475]: exception: Hypervisor with ID '6b91185c-69a7-49d3-bbc0-c5ad96fa363c' could not be found. Jul 31 01:06:43.800991 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '6b91185c-69a7-49d3-bbc0-c5ad96fa363c'} Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '6b91185c-69a7-49d3-bbc0-c5ad96fa363c' Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 31 01:06:43.801651 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 31 01:06:43.802790 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '6b91185c-69a7-49d3-bbc0-c5ad96fa363c' could not be found. Jul 31 01:06:43.804546 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.804546 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:43.804546 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.804546 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:43.804546 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:43.804546 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:43.804546 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:43.804546 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:43.804546 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '6b91185c-69a7-49d3-bbc0-c5ad96fa363c' could not be found. Jul 31 01:06:43.804546 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:43.805865 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-17e430c8-af3b-48d7-b7c6-758ca7657d28 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] Returning 404 to user: Hypervisor with ID '6b91185c-69a7-49d3-bbc0-c5ad96fa363c' could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:43.806725 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-17e430c8-af3b-48d7-b7c6-758ca7657d28 tempest-HypervisorAdminNegativeTestJSON-312202312 tempest-HypervisorAdminNegativeTestJSON-312202312-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/6b91185c-69a7-49d3-bbc0-c5ad96fa363c" status: 404 len: 123 microversion: 2.1 time: 0.020740 Jul 31 01:06:43.807550 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 91/213] 10.222.0.45 () {58 vars in 1257 bytes} [Sun Jul 31 01:06:43 2022] GET /compute/v2.1/os-hypervisors/6b91185c-69a7-49d3-bbc0-c5ad96fa363c => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:43.864993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d13912e3-47e6-459b-aaaa-fad14b5d93c6 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:43.865733 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d13912e3-47e6-459b-aaaa-fad14b5d93c6 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:43.873265 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d13912e3-47e6-459b-aaaa-fad14b5d93c6 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:43.873977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d13912e3-47e6-459b-aaaa-fad14b5d93c6 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:43.875174 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d13912e3-47e6-459b-aaaa-fad14b5d93c6 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:43.875901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d13912e3-47e6-459b-aaaa-fad14b5d93c6 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:44.461076 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:44.547924 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d13912e3-47e6-459b-aaaa-fad14b5d93c6 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:44.566324 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2c705b9b-6df2-4828-ac40-057c73abbe37 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:44.572252 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d13912e3-47e6-459b-aaaa-fad14b5d93c6 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 200 len: 1389 microversion: 2.1 time: 0.705532 Jul 31 01:06:44.574603 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 92/214] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:43 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 1389 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:44.592817 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2c705b9b-6df2-4828-ac40-057c73abbe37 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1494 microversion: 2.1 time: 0.963243 Jul 31 01:06:44.599400 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ab990c50-2f18-41cb-aeaa-3dd1689823f5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:44.600515 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ab990c50-2f18-41cb-aeaa-3dd1689823f5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:44.608815 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab990c50-2f18-41cb-aeaa-3dd1689823f5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:44.609523 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab990c50-2f18-41cb-aeaa-3dd1689823f5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:44.611303 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab990c50-2f18-41cb-aeaa-3dd1689823f5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:44.611468 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 123/215] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:43 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1494 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:44.612394 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab990c50-2f18-41cb-aeaa-3dd1689823f5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:44.622948 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9d12d4e2-5b93-4a5a-b1ab-ff71e4b77572 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:44.625584 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9d12d4e2-5b93-4a5a-b1ab-ff71e4b77572 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:44.639922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d12d4e2-5b93-4a5a-b1ab-ff71e4b77572 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:44.640434 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d12d4e2-5b93-4a5a-b1ab-ff71e4b77572 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:44.642528 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d12d4e2-5b93-4a5a-b1ab-ff71e4b77572 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:44.642967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d12d4e2-5b93-4a5a-b1ab-ff71e4b77572 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:45.108653 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ab990c50-2f18-41cb-aeaa-3dd1689823f5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:45.118397 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ab990c50-2f18-41cb-aeaa-3dd1689823f5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1335 microversion: 2.1 time: 0.540190 Jul 31 01:06:45.119311 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 93/216] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:44 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1335 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:45.191688 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9d12d4e2-5b93-4a5a-b1ab-ff71e4b77572 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:45.202487 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9d12d4e2-5b93-4a5a-b1ab-ff71e4b77572 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1320 microversion: 2.1 time: 0.589269 Jul 31 01:06:45.217365 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 124/217] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:44 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1320 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:45.627203 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cc5dba13-7b62-43d9-9842-ce3eea1c9ad4 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:45.629821 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cc5dba13-7b62-43d9-9842-ce3eea1c9ad4 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:45.630211 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3459273-1709-4ed4-8b69-f7f64fc82675 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:45.637344 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3459273-1709-4ed4-8b69-f7f64fc82675 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:45.660919 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cc5dba13-7b62-43d9-9842-ce3eea1c9ad4 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:45.661984 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cc5dba13-7b62-43d9-9842-ce3eea1c9ad4 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:45.663088 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cc5dba13-7b62-43d9-9842-ce3eea1c9ad4 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:45.664260 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cc5dba13-7b62-43d9-9842-ce3eea1c9ad4 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:45.665215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3459273-1709-4ed4-8b69-f7f64fc82675 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:45.666667 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3459273-1709-4ed4-8b69-f7f64fc82675 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:45.674517 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3459273-1709-4ed4-8b69-f7f64fc82675 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:45.676387 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3459273-1709-4ed4-8b69-f7f64fc82675 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:46.185302 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cc5dba13-7b62-43d9-9842-ce3eea1c9ad4 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:46.205436 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cc5dba13-7b62-43d9-9842-ce3eea1c9ad4 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1494 microversion: 2.1 time: 0.589251 Jul 31 01:06:46.223127 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 125/218] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:45 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1494 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:06:46.229868 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a55401d9-c52f-46b1-8eff-523e58287ce8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:46.232756 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a55401d9-c52f-46b1-8eff-523e58287ce8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:46.242438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a55401d9-c52f-46b1-8eff-523e58287ce8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:46.243543 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a55401d9-c52f-46b1-8eff-523e58287ce8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:46.244977 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a55401d9-c52f-46b1-8eff-523e58287ce8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:46.245861 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a55401d9-c52f-46b1-8eff-523e58287ce8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:46.498411 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3459273-1709-4ed4-8b69-f7f64fc82675 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:46.501954 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:46.514767 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3459273-1709-4ed4-8b69-f7f64fc82675 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 200 len: 1389 microversion: 2.1 time: 0.920729 Jul 31 01:06:46.515608 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 94/219] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:45 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 1389 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:46.533144 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9ac4d0d3-b8c7-4fa1-a095-ca897a46858f tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:46.534138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9ac4d0d3-b8c7-4fa1-a095-ca897a46858f tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:46.541103 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9ac4d0d3-b8c7-4fa1-a095-ca897a46858f tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:46.544305 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9ac4d0d3-b8c7-4fa1-a095-ca897a46858f tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:46.545533 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9ac4d0d3-b8c7-4fa1-a095-ca897a46858f tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:46.545983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9ac4d0d3-b8c7-4fa1-a095-ca897a46858f tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:46.692847 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a55401d9-c52f-46b1-8eff-523e58287ce8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:46.701443 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a55401d9-c52f-46b1-8eff-523e58287ce8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1335 microversion: 2.1 time: 0.476799 Jul 31 01:06:46.706679 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 126/220] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:46 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1335 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:46.965070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-d1227a31-b0c3-41f4-9879-ba836cbd79b9 req-829167fa-64bf-4c8d-ae14-a7f389a0f09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8", "name": "network-vif-deleted", "tag": "c6c034ef-1782-4a89-acec-2c1fd500dc47"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:46.978520 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:46.999539 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9ac4d0d3-b8c7-4fa1-a095-ca897a46858f tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:47.014814 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d1227a31-b0c3-41f4-9879-ba836cbd79b9 req-829167fa-64bf-4c8d-ae14-a7f389a0f09e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:47.016297 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d1227a31-b0c3-41f4-9879-ba836cbd79b9 req-829167fa-64bf-4c8d-ae14-a7f389a0f09e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:47.026909 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9ac4d0d3-b8c7-4fa1-a095-ca897a46858f tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1470 microversion: 2.1 time: 0.509784 Jul 31 01:06:47.027540 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 95/221] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:46 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1470 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:47.050706 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-d1227a31-b0c3-41f4-9879-ba836cbd79b9 req-829167fa-64bf-4c8d-ae14-a7f389a0f09e service nova] Creating event network-vif-deleted:c6c034ef-1782-4a89-acec-2c1fd500dc47 for instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 on n-h1-master-1 Jul 31 01:06:47.056862 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-d1227a31-b0c3-41f4-9879-ba836cbd79b9 req-829167fa-64bf-4c8d-ae14-a7f389a0f09e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096810 Jul 31 01:06:47.060765 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 127/222] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:47.234312 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a8c89d50-cd6e-4fca-b493-984e394fbdab tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:47.236363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a8c89d50-cd6e-4fca-b493-984e394fbdab tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:47.248100 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8c89d50-cd6e-4fca-b493-984e394fbdab tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:47.255726 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8c89d50-cd6e-4fca-b493-984e394fbdab tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:47.256611 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8c89d50-cd6e-4fca-b493-984e394fbdab tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:47.257051 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8c89d50-cd6e-4fca-b493-984e394fbdab tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:47.338999 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8c89d50-cd6e-4fca-b493-984e394fbdab tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:47.339472 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8c89d50-cd6e-4fca-b493-984e394fbdab tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:47.340023 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-a8c89d50-cd6e-4fca-b493-984e394fbdab tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lazy-loading 'fault' on Instance uuid 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:06:47.436379 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4b82569f-0fae-4093-a403-463083cce581 tempest-DeleteServersAdminTestJSON-970395564 tempest-DeleteServersAdminTestJSON-970395564-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:47.436883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4b82569f-0fae-4093-a403-463083cce581 tempest-DeleteServersAdminTestJSON-970395564 tempest-DeleteServersAdminTestJSON-970395564-project-admin] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:47.445280 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a8c89d50-cd6e-4fca-b493-984e394fbdab tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30734920b5a64cbe96bb43aa81c1539d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9b36e5f5fd4944b791d80037ef872b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:47.447643 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b82569f-0fae-4093-a403-463083cce581 tempest-DeleteServersAdminTestJSON-970395564 tempest-DeleteServersAdminTestJSON-970395564-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:47.453694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b82569f-0fae-4093-a403-463083cce581 tempest-DeleteServersAdminTestJSON-970395564 tempest-DeleteServersAdminTestJSON-970395564-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:47.454926 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b82569f-0fae-4093-a403-463083cce581 tempest-DeleteServersAdminTestJSON-970395564 tempest-DeleteServersAdminTestJSON-970395564-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:47.455519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b82569f-0fae-4093-a403-463083cce581 tempest-DeleteServersAdminTestJSON-970395564 tempest-DeleteServersAdminTestJSON-970395564-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:47.462839 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a8c89d50-cd6e-4fca-b493-984e394fbdab tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 200 len: 1328 microversion: 2.1 time: 0.230729 Jul 31 01:06:47.463819 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 128/223] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:47 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 1328 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:47.519093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4b82569f-0fae-4093-a403-463083cce581 tempest-DeleteServersAdminTestJSON-970395564 tempest-DeleteServersAdminTestJSON-970395564-project-admin] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:06:47.537346 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0e0e31ea-d1b3-4a59-b604-9b04deb8b3c3 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:47.537957 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0e0e31ea-d1b3-4a59-b604-9b04deb8b3c3 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:47.546908 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e0e31ea-d1b3-4a59-b604-9b04deb8b3c3 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:47.547488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e0e31ea-d1b3-4a59-b604-9b04deb8b3c3 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:47.552419 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e0e31ea-d1b3-4a59-b604-9b04deb8b3c3 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:47.552831 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e0e31ea-d1b3-4a59-b604-9b04deb8b3c3 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:47.790702 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4b82569f-0fae-4093-a403-463083cce581 tempest-DeleteServersAdminTestJSON-970395564 tempest-DeleteServersAdminTestJSON-970395564-project-admin] 10.222.0.45 "DELETE /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 204 len: 0 microversion: 2.1 time: 0.744465 Jul 31 01:06:47.791366 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 96/224] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:06:47 2022] DELETE /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 0 bytes in 746 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:06:47.799633 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e0e31ea-d1b3-4a59-b604-9b04deb8b3c3 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:47.802859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3fd4cedf-fb47-442c-891b-0f2764936f15 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:47.809039 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0e0e31ea-d1b3-4a59-b604-9b04deb8b3c3 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 200 len: 1389 microversion: 2.1 time: 0.275374 Jul 31 01:06:47.809376 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3fd4cedf-fb47-442c-891b-0f2764936f15 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:47.823535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3fd4cedf-fb47-442c-891b-0f2764936f15 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:47.823535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3fd4cedf-fb47-442c-891b-0f2764936f15 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:47.823535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3fd4cedf-fb47-442c-891b-0f2764936f15 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:47.823535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3fd4cedf-fb47-442c-891b-0f2764936f15 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:47.826394 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 129/225] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:47 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 1389 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:06:47.835231 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5a79c90c-4c30-49cf-8def-5ccb76da5e97 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:47.835882 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5a79c90c-4c30-49cf-8def-5ccb76da5e97 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:47.857542 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a79c90c-4c30-49cf-8def-5ccb76da5e97 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:47.858114 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a79c90c-4c30-49cf-8def-5ccb76da5e97 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:47.858935 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a79c90c-4c30-49cf-8def-5ccb76da5e97 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:47.861339 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a79c90c-4c30-49cf-8def-5ccb76da5e97 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:48.104773 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3fd4cedf-fb47-442c-891b-0f2764936f15 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:48.122559 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3fd4cedf-fb47-442c-891b-0f2764936f15 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1335 microversion: 2.1 time: 0.326217 Jul 31 01:06:48.125430 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 97/226] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:47 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1335 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:48.142040 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5a79c90c-4c30-49cf-8def-5ccb76da5e97 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:48.158095 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5a79c90c-4c30-49cf-8def-5ccb76da5e97 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1476 microversion: 2.1 time: 0.329549 Jul 31 01:06:48.159863 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 130/227] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:47 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1476 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:48.488315 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1574b5f0-e143-4f65-ba95-e9f7c3d10f27 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:48.488944 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1574b5f0-e143-4f65-ba95-e9f7c3d10f27 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:48.495364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1574b5f0-e143-4f65-ba95-e9f7c3d10f27 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:48.495848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1574b5f0-e143-4f65-ba95-e9f7c3d10f27 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:48.497093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1574b5f0-e143-4f65-ba95-e9f7c3d10f27 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:48.497093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1574b5f0-e143-4f65-ba95-e9f7c3d10f27 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:48.512117 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-1574b5f0-e143-4f65-ba95-e9f7c3d10f27 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] HTTP exception thrown: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1574b5f0-e143-4f65-ba95-e9f7c3d10f27 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Request method failure captured: Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 HTTP/1.1 Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dVy5sxVk-oeuwMEOcdkk3wXlcOpMdAozzrD9LucAZM4dKEbL0EBPRGtQsI3fPVuH6gBkZuHOpElemk7tI2NbZQKBtarhUmmeZG42oIkKIubIjbOPRGEUhd89LhvYugwj_gT3xkUvlg0zASGAjCojZx1tYDUggMaoyHUwu6k-4laQOI Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 7f9b36e5f5fd4944b791d80037ef872b Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AggregatesAdminTestJSON-2086364881 Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:06:48.514872 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:06:48.516066 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7f9b36e5f5fd4944b791d80037ef872b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7f9b36e5f5fd4944b791d80037ef872b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7f9b36e5f5fd4944b791d80037ef872b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7f9b36e5f5fd4944b791d80037ef872b", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:48.516066 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AggregatesAdminTestJSON-2086364881 Jul 31 01:06:48.516066 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 7f9b36e5f5fd4944b791d80037ef872b Jul 31 01:06:48.516066 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2086364881 Jul 31 01:06:48.516066 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AggregatesAdminTestJSON-2086364881-project Jul 31 01:06:48.516066 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:48.516066 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:48.516066 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 30734920b5a64cbe96bb43aa81c1539d Jul 31 01:06:48.516066 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AggregatesAdminTestJSON-2086364881-project Jul 31 01:06:48.516066 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:48.516066 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. Jul 31 01:06:48.516066 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8'} Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:48.517276 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. Jul 31 01:06:48.518302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:48.521717 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1574b5f0-e143-4f65-ba95-e9f7c3d10f27 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Returning 404 to user: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:48.523219 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1574b5f0-e143-4f65-ba95-e9f7c3d10f27 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 404 len: 111 microversion: 2.1 time: 0.038666 Jul 31 01:06:48.524351 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 98/228] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:48 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:48.533708 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-56de11cc-8ba8-4c57-aa40-fce7755ff638 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:48.536701 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:48.536701 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:48.547871 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-56de11cc-8ba8-4c57-aa40-fce7755ff638 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:48.548688 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-56de11cc-8ba8-4c57-aa40-fce7755ff638 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:48.717701 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-56de11cc-8ba8-4c57-aa40-fce7755ff638 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 300 microversion: 2.1 time: 0.188628 Jul 31 01:06:48.719965 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 131/229] 10.222.0.45 () {60 vars in 1191 bytes} [Sun Jul 31 01:06:48 2022] POST /compute/v2.1/os-aggregates/5/action => generated 300 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:48.730371 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7d80fa89-8142-49b9-90d2-090e43817567 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:48.731147 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:48.731147 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:48.765250 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7d80fa89-8142-49b9-90d2-090e43817567 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.038306 Jul 31 01:06:48.767121 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 99/230] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:06:48 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:48.778923 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9840ff34-181e-4a76-a6f0-7eb31c3d34ff tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1164830098"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:48.781900 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:48.781900 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:48.782924 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.aggregate [None req-9840ff34-181e-4a76-a6f0-7eb31c3d34ff tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Generated uuid b85b29de-6f3c-4648-9c2c-7c58d6e67b9b for aggregate {{(pid=119474) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:48.804290 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9840ff34-181e-4a76-a6f0-7eb31c3d34ff tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.029050 Jul 31 01:06:48.816701 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 132/231] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:06:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:06:48.825609 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d2ff395c-3f8d-45ea-bfd9-6d336f625b41 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:48.829020 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:48.829020 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:48.839578 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0e5aa0c6-b82b-4142-99f9-748fe63a1b26 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:48.841122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0e5aa0c6-b82b-4142-99f9-748fe63a1b26 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:48.849377 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2ff395c-3f8d-45ea-bfd9-6d336f625b41 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:48.851991 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2ff395c-3f8d-45ea-bfd9-6d336f625b41 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:48.858583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e5aa0c6-b82b-4142-99f9-748fe63a1b26 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:48.860207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e5aa0c6-b82b-4142-99f9-748fe63a1b26 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:48.861196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e5aa0c6-b82b-4142-99f9-748fe63a1b26 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:48.862796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e5aa0c6-b82b-4142-99f9-748fe63a1b26 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:49.042898 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d2ff395c-3f8d-45ea-bfd9-6d336f625b41 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.223489 Jul 31 01:06:49.043520 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 100/232] 10.222.0.45 () {60 vars in 1191 bytes} [Sun Jul 31 01:06:48 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:49.055400 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2d10cba2-94eb-4c05-abe1-e79cdcb0b507 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:49.069423 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:49.069423 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:49.089235 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=85,nova_api:DELETE=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:49.113688 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2d10cba2-94eb-4c05-abe1-e79cdcb0b507 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 242 microversion: 2.1 time: 0.056356 Jul 31 01:06:49.114315 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 101/233] 10.222.0.45 () {58 vars in 1149 bytes} [Sun Jul 31 01:06:49 2022] GET /compute/v2.1/os-aggregates/9 => generated 242 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:49.128265 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0d0f9be2-78a6-4708-9a01-c34351de6e92 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:49.133862 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:49.133862 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:49.159877 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d0f9be2-78a6-4708-9a01-c34351de6e92 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:49.161426 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d0f9be2-78a6-4708-9a01-c34351de6e92 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:49.163724 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e5aa0c6-b82b-4142-99f9-748fe63a1b26 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:49.175705 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0e5aa0c6-b82b-4142-99f9-748fe63a1b26 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 200 len: 1389 microversion: 2.1 time: 0.344612 Jul 31 01:06:49.185932 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 133/234] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:48 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 1389 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:49.200063 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-717a04a5-d599-443e-860d-854af661f3c4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:49.200978 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-717a04a5-d599-443e-860d-854af661f3c4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:49.236756 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-717a04a5-d599-443e-860d-854af661f3c4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:49.236949 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-717a04a5-d599-443e-860d-854af661f3c4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:49.239535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-717a04a5-d599-443e-860d-854af661f3c4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:49.240068 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-717a04a5-d599-443e-860d-854af661f3c4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:49.429939 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0d0f9be2-78a6-4708-9a01-c34351de6e92 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.305933 Jul 31 01:06:49.450609 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 102/235] 10.222.0.45 () {60 vars in 1191 bytes} [Sun Jul 31 01:06:49 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:49.477998 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c08aa278-cbd4-42c9-b7b2-d12f78371cba tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:49.484280 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c08aa278-cbd4-42c9-b7b2-d12f78371cba tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:49.516513 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c08aa278-cbd4-42c9-b7b2-d12f78371cba tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:49.518452 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c08aa278-cbd4-42c9-b7b2-d12f78371cba tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:49.521949 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c08aa278-cbd4-42c9-b7b2-d12f78371cba tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:49.522684 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c08aa278-cbd4-42c9-b7b2-d12f78371cba tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:49.566535 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-717a04a5-d599-443e-860d-854af661f3c4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:49.589414 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-717a04a5-d599-443e-860d-854af661f3c4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1313 microversion: 2.1 time: 0.401438 Jul 31 01:06:49.592619 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 134/236] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:49 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:49.610062 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-803e1c30-841e-4a66-98c8-6ceb5fea7b9d tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:49.614071 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:49.614071 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:49.669360 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-803e1c30-841e-4a66-98c8-6ceb5fea7b9d tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.070263 Jul 31 01:06:49.676918 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 135/237] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:06:49 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:49.690806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fca6c32e-0182-493f-b641-3decd9ed74b8 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1555743952"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:49.694292 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:49.694292 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:49.696833 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.aggregate [None req-fca6c32e-0182-493f-b641-3decd9ed74b8 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Generated uuid d51a6513-a8f9-45a1-88c4-664139ab3248 for aggregate {{(pid=119474) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:49.732358 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fca6c32e-0182-493f-b641-3decd9ed74b8 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.052474 Jul 31 01:06:49.733774 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 136/238] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:06:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:49.749459 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e87d07ab-0f3b-4532-974a-6f2b03882291 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:49.759013 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:49.759013 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:49.774522 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e87d07ab-0f3b-4532-974a-6f2b03882291 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:49.774974 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e87d07ab-0f3b-4532-974a-6f2b03882291 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:50.034509 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e87d07ab-0f3b-4532-974a-6f2b03882291 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.292980 Jul 31 01:06:50.035137 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 137/239] 10.222.0.45 () {60 vars in 1194 bytes} [Sun Jul 31 01:06:49 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:06:50.048126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-93fefbe4-fc8d-4c92-825d-f734f653ee33 req-e3b29462-2399-43ed-b2e0-7a2ae3d4c96a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eccd8f8d-d332-4c4e-bef6-30de69b8f681", "name": "network-vif-plugged", "status": "completed", "tag": "f7832bd1-893a-4d8d-a8db-89c1491322de"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:50.053985 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c08aa278-cbd4-42c9-b7b2-d12f78371cba tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:50.061998 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c08aa278-cbd4-42c9-b7b2-d12f78371cba tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1476 microversion: 2.1 time: 0.612763 Jul 31 01:06:50.062589 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 103/240] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:49 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1476 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:50.072955 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-07fb75f9-e6be-4727-b9ae-ac423dda0e8b tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:50.073891 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:50.073891 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:50.090484 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-93fefbe4-fc8d-4c92-825d-f734f653ee33 req-e3b29462-2399-43ed-b2e0-7a2ae3d4c96a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:50.090942 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-93fefbe4-fc8d-4c92-825d-f734f653ee33 req-e3b29462-2399-43ed-b2e0-7a2ae3d4c96a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:50.100788 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-07fb75f9-e6be-4727-b9ae-ac423dda0e8b tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.031615 Jul 31 01:06:50.101373 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 104/241] 10.222.0.45 () {58 vars in 1143 bytes} [Sun Jul 31 01:06:50 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:50.115946 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8f8fbf84-146f-4e02-9e6b-7027a1aea47c tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:50.118059 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-93fefbe4-fc8d-4c92-825d-f734f653ee33 req-e3b29462-2399-43ed-b2e0-7a2ae3d4c96a service nova] Creating event network-vif-plugged:f7832bd1-893a-4d8d-a8db-89c1491322de for instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 on n-h2-master-1 Jul 31 01:06:50.124026 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-93fefbe4-fc8d-4c92-825d-f734f653ee33 req-e3b29462-2399-43ed-b2e0-7a2ae3d4c96a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080760 Jul 31 01:06:50.125471 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:50.125471 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:50.128171 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 138/242] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:50.138215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f8fbf84-146f-4e02-9e6b-7027a1aea47c tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:50.144062 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f8fbf84-146f-4e02-9e6b-7027a1aea47c tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:50.203038 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c1632aec-4878-4645-b278-472738b990b5 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:50.203834 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c1632aec-4878-4645-b278-472738b990b5 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:50.214280 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1632aec-4878-4645-b278-472738b990b5 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:50.214725 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1632aec-4878-4645-b278-472738b990b5 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:50.215546 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1632aec-4878-4645-b278-472738b990b5 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:50.220392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1632aec-4878-4645-b278-472738b990b5 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:50.424671 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8f8fbf84-146f-4e02-9e6b-7027a1aea47c tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.315137 Jul 31 01:06:50.425922 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 105/243] 10.222.0.45 () {60 vars in 1194 bytes} [Sun Jul 31 01:06:50 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:06:50.451098 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f1bcf701-9ebf-41d0-bd25-4dd5044912cf tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:50.452267 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:50.452267 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:50.495555 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f1bcf701-9ebf-41d0-bd25-4dd5044912cf tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.054569 Jul 31 01:06:50.496456 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 106/244] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:06:50 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:50.506905 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0dbaba25-5d39-4765-bbdf-2bf2b036ce29 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1415037494"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:50.514431 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:50.514431 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:50.515675 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.aggregate [None req-0dbaba25-5d39-4765-bbdf-2bf2b036ce29 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Generated uuid 930ba2ff-e74b-4ee4-abb6-bb4704c0a823 for aggregate {{(pid=119475) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:50.584005 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0dbaba25-5d39-4765-bbdf-2bf2b036ce29 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.079182 Jul 31 01:06:50.585398 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 107/245] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:06:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:50.590583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c1632aec-4878-4645-b278-472738b990b5 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:50.604524 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c1632aec-4878-4645-b278-472738b990b5 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 200 len: 1389 microversion: 2.1 time: 0.405826 Jul 31 01:06:50.605321 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 139/246] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:50 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 1389 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:06:50.619612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7567e911-03b7-4ff6-8c8b-e58d97ed20fa tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:50.625463 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7e39e49c-331d-424e-b960-17ef57fd6701 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:50.627187 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:50.627187 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:50.627920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7e39e49c-331d-424e-b960-17ef57fd6701 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:50.647867 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e39e49c-331d-424e-b960-17ef57fd6701 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:50.648580 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e39e49c-331d-424e-b960-17ef57fd6701 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:50.649511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e39e49c-331d-424e-b960-17ef57fd6701 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:50.650067 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e39e49c-331d-424e-b960-17ef57fd6701 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:50.652480 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7567e911-03b7-4ff6-8c8b-e58d97ed20fa tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:50.653293 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7567e911-03b7-4ff6-8c8b-e58d97ed20fa tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:50.838278 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7567e911-03b7-4ff6-8c8b-e58d97ed20fa tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.228567 Jul 31 01:06:50.841823 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 108/247] 10.222.0.45 () {60 vars in 1194 bytes} [Sun Jul 31 01:06:50 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:50.856564 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6ca2e703-6f88-4f2a-9c64-91586f7ed07a tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:50.859637 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:50.859637 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:50.862490 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6ca2e703-6f88-4f2a-9c64-91586f7ed07a tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '6914dc05e91240c9a3cca15d4ecfc3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eafe4a206e4141f3b0f07c1aa5e8ffd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6ca2e703-6f88-4f2a-9c64-91586f7ed07a tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Request method failure captured: Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 42 Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dVxVfU84qM1wJ08a8-FVOA3BqVddY2X1If4ALa4Z2cnxBXV4PcoFyU0K7D-A1zUHNDJwixvpKtxtgrE-EewAsDTO9mrJWDY_5TKmPXQNf8AOgFW5iPmJpSmHqy0brdEQU9-9YIMC3lWxn_L_zFALIoDuxznafLVYyovCANsRP2XNX4 Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: eafe4a206e4141f3b0f07c1aa5e8ffd6 Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:06:50.864589 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:06:50.865801 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/eafe4a206e4141f3b0f07c1aa5e8ffd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_eafe4a206e4141f3b0f07c1aa5e8ffd6", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:50.865801 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:50.865801 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: eafe4a206e4141f3b0f07c1aa5e8ffd6 Jul 31 01:06:50.865801 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865 Jul 31 01:06:50.865801 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AggregatesAdminNegativeTestJSON-1377799865-project Jul 31 01:06:50.865801 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:50.865801 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:50.865801 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 6914dc05e91240c9a3cca15d4ecfc3cf Jul 31 01:06:50.865801 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1377799865-project Jul 31 01:06:50.865801 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:06:50.865801 n-d-master-1 devstack@n-api.service[119475]: {"remove_host": {"host": "n-h1-master-1"}} Jul 31 01:06:50.865801 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:50.865801 n-d-master-1 devstack@n-api.service[119475]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '11', 'body': {'remove_host': {'host': 'n-h1-master-1'}}} Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:50.866540 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 31 01:06:50.868559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:50.872752 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6ca2e703-6f88-4f2a-9c64-91586f7ed07a tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:50.874000 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6ca2e703-6f88-4f2a-9c64-91586f7ed07a tempest-AggregatesAdminNegativeTestJSON-1377799865 tempest-AggregatesAdminNegativeTestJSON-1377799865-project] 10.222.0.45 "POST /compute/v2.1/os-aggregates/11/action" status: 403 len: 121 microversion: 2.1 time: 0.024895 Jul 31 01:06:50.874776 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 109/248] 10.222.0.45 () {60 vars in 1194 bytes} [Sun Jul 31 01:06:50 2022] POST /compute/v2.1/os-aggregates/11/action => generated 121 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:06:50.891134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ff857b68-8986-4c7b-bdda-af38ba0ee7ba tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:50.920334 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7e39e49c-331d-424e-b960-17ef57fd6701 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:50.922096 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff857b68-8986-4c7b-bdda-af38ba0ee7ba tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:50.922752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff857b68-8986-4c7b-bdda-af38ba0ee7ba tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:50.928647 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7e39e49c-331d-424e-b960-17ef57fd6701 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1313 microversion: 2.1 time: 0.311422 Jul 31 01:06:50.930931 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 140/249] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:50 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:51.076754 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ff857b68-8986-4c7b-bdda-af38ba0ee7ba tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.196332 Jul 31 01:06:51.078024 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 110/250] 10.222.0.45 () {60 vars in 1194 bytes} [Sun Jul 31 01:06:50 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:51.086081 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8614a09d-acee-4dca-b468-ea78a3e416e1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:51.087250 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8614a09d-acee-4dca-b468-ea78a3e416e1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:51.094816 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8614a09d-acee-4dca-b468-ea78a3e416e1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:51.095777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8614a09d-acee-4dca-b468-ea78a3e416e1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:51.096806 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8614a09d-acee-4dca-b468-ea78a3e416e1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:51.097457 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8614a09d-acee-4dca-b468-ea78a3e416e1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:51.202636 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-03e27796-58ce-4208-be9a-c82d90cee617 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-368286871", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": "none"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:51.265682 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8614a09d-acee-4dca-b468-ea78a3e416e1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:51.271219 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-03e27796-58ce-4208-be9a-c82d90cee617 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:06:51.271675 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-03e27796-58ce-4208-be9a-c82d90cee617 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:06:51.272144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-03e27796-58ce-4208-be9a-c82d90cee617 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:06:51.272557 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-03e27796-58ce-4208-be9a-c82d90cee617 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:06:51.272963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-03e27796-58ce-4208-be9a-c82d90cee617 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:06:51.275245 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8614a09d-acee-4dca-b468-ea78a3e416e1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1476 microversion: 2.1 time: 0.193829 Jul 31 01:06:51.282860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03e27796-58ce-4208-be9a-c82d90cee617 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:51.283307 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03e27796-58ce-4208-be9a-c82d90cee617 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:51.284140 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03e27796-58ce-4208-be9a-c82d90cee617 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:51.284575 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03e27796-58ce-4208-be9a-c82d90cee617 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:51.289387 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 111/251] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:51 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1476 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:51.296444 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-92055cb1-37fd-4ef6-8948-206b63c8b926 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:51.298255 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:51.298255 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:51.302963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-03e27796-58ce-4208-be9a-c82d90cee617 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Getting quotas for project 7be9a55220414df38304fd11004f2a9a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:06:51.304437 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:51.308822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-03e27796-58ce-4208-be9a-c82d90cee617 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Getting quotas for user 136afabc79b34d7890d97563a12c9807 and project 7be9a55220414df38304fd11004f2a9a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:06:51.323511 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-03e27796-58ce-4208-be9a-c82d90cee617 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:06:51.325590 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-03e27796-58ce-4208-be9a-c82d90cee617 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:06:51.339569 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-92055cb1-37fd-4ef6-8948-206b63c8b926 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.047107 Jul 31 01:06:51.340797 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 112/252] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:06:51 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:51.351885 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ec87edbb-8bcb-45e1-86b4-9635bdd09500 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-180271973"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:51.356280 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:51.356280 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:51.357503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.aggregate [None req-ec87edbb-8bcb-45e1-86b4-9635bdd09500 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Generated uuid 4a106ba5-eaff-4c00-95cd-3f8230913782 for aggregate {{(pid=119475) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:51.386591 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ec87edbb-8bcb-45e1-86b4-9635bdd09500 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038703 Jul 31 01:06:51.387242 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 113/253] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:06:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:51.396055 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6bfacca6-8ab8-4475-b6d8-81a423d7397a tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1639857599"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:51.397933 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-03e27796-58ce-4208-be9a-c82d90cee617 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.365601 Jul 31 01:06:51.399402 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 141/254] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:06:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 368 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 31 01:06:51.404470 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:51.404470 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:51.406035 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.aggregate [None req-6bfacca6-8ab8-4475-b6d8-81a423d7397a tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Generated uuid f69d6be9-c461-42ac-b612-bcd636ffa79c for aggregate {{(pid=119475) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:51.407848 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1f824830-1e53-4b1f-8e26-484cec3fda62 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:51.410575 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:51.410575 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:51.420894 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f824830-1e53-4b1f-8e26-484cec3fda62 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:51.421362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f824830-1e53-4b1f-8e26-484cec3fda62 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:51.428169 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f824830-1e53-4b1f-8e26-484cec3fda62 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:51.428641 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f824830-1e53-4b1f-8e26-484cec3fda62 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:51.438095 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6bfacca6-8ab8-4475-b6d8-81a423d7397a tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049519 Jul 31 01:06:51.439425 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 114/255] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:06:51 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:51.445501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8937872a-ce2c-4967-ab36-90743e2f6c57 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:51.448524 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8937872a-ce2c-4967-ab36-90743e2f6c57 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:51.457827 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.compute.aggregates [None req-1f824830-1e53-4b1f-8e26-484cec3fda62 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Failed to remove host nonexist_host from aggregate 12. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 31 01:06:51.458529 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-1f824830-1e53-4b1f-8e26-484cec3fda62 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 12 Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1f824830-1e53-4b1f-8e26-484cec3fda62 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Request method failure captured: Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 42 Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dV0Qv9DBEc5_aQcul5-AcfiVWHPU7-yr1F_vYEbPK677XUQUK-je6FFKN1m6Ll9WbjyJcGYXWT4Qq2K_K3MT6h3pCsgLJl2PsRrhf0q9qvZFBvWgDbNzYzG4sjmb5XnuJ8pFmaDdO8H-b5ndeLEekVzbO-C42Xeb7HCIO5VYxgj9fg Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6def54c32aa54cffa86e5494da0f4b34 Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:06:51.460423 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:06:51.462129 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6def54c32aa54cffa86e5494da0f4b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6def54c32aa54cffa86e5494da0f4b34", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:51.462129 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:51.462129 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6def54c32aa54cffa86e5494da0f4b34 Jul 31 01:06:51.462129 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379 Jul 31 01:06:51.462129 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin Jul 31 01:06:51.462129 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:51.462129 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:51.462129 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 41d5ded808be42ec8c0b1134191742e6 Jul 31 01:06:51.462129 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin Jul 31 01:06:51.462129 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:06:51.462129 n-d-master-1 devstack@n-api.service[119474]: {"remove_host": {"host": "nonexist_host"}} Jul 31 01:06:51.462129 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:51.462129 n-d-master-1 devstack@n-api.service[119474]: exception: Cannot remove host nonexist_host in aggregate 12 Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Jul 31 01:06:51.462995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in remove_host_from_aggregate Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 31 01:06:51.464444 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 12 Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:51.465718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:51.466931 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:51.466931 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:51.466931 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:51.466931 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:51.466931 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 12 Jul 31 01:06:51.466931 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:51.466931 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1f824830-1e53-4b1f-8e26-484cec3fda62 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 12 {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:51.466931 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1f824830-1e53-4b1f-8e26-484cec3fda62 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 94 microversion: 2.1 time: 0.058995 Jul 31 01:06:51.466931 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 142/256] 10.222.0.45 () {60 vars in 1194 bytes} [Sun Jul 31 01:06:51 2022] POST /compute/v2.1/os-aggregates/12/action => generated 94 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:06:51.471527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-79cfa477-6202-41a2-a78f-bcab61f55ca6 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:51.474058 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:51.474058 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:51.483378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79cfa477-6202-41a2-a78f-bcab61f55ca6 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:51.483835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79cfa477-6202-41a2-a78f-bcab61f55ca6 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:51.487882 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:51.567590 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8937872a-ce2c-4967-ab36-90743e2f6c57 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:51.576978 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8937872a-ce2c-4967-ab36-90743e2f6c57 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:51.581387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8937872a-ce2c-4967-ab36-90743e2f6c57 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:51.590454 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8937872a-ce2c-4967-ab36-90743e2f6c57 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "PUT /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1358 microversion: 2.75 time: 0.149614 Jul 31 01:06:51.605035 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 115/257] 10.222.0.45 () {62 vars in 1297 bytes} [Sun Jul 31 01:06:51 2022] PUT /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:06:51.605035 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5fb26873-ea2b-4242-938f-d28b02aa0cd5 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:51.605035 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:51.605035 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:51.622293 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5fb26873-ea2b-4242-938f-d28b02aa0cd5 tempest-AggregatesAdminNegativeTestJSON-1249078379 tempest-AggregatesAdminNegativeTestJSON-1249078379-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.029581 Jul 31 01:06:51.635164 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 116/258] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:06:51 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:51.653692 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-430aad62-337b-480b-bfae-7d25ea485926 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:51.655319 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-430aad62-337b-480b-bfae-7d25ea485926 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:51.707434 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-79cfa477-6202-41a2-a78f-bcab61f55ca6 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.239171 Jul 31 01:06:51.708271 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 143/259] 10.222.0.45 () {60 vars in 1194 bytes} [Sun Jul 31 01:06:51 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:51.716358 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cb9a503d-6c6a-470b-a804-b5b49a9d10c7 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:51.717803 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cb9a503d-6c6a-470b-a804-b5b49a9d10c7 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:51.731680 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9a503d-6c6a-470b-a804-b5b49a9d10c7 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:51.731680 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9a503d-6c6a-470b-a804-b5b49a9d10c7 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:51.731680 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9a503d-6c6a-470b-a804-b5b49a9d10c7 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:51.753686 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9a503d-6c6a-470b-a804-b5b49a9d10c7 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:51.768167 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-430aad62-337b-480b-bfae-7d25ea485926 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:51.777617 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-430aad62-337b-480b-bfae-7d25ea485926 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:51.782684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-430aad62-337b-480b-bfae-7d25ea485926 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:51.795019 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-430aad62-337b-480b-bfae-7d25ea485926 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1358 microversion: 2.75 time: 0.152285 Jul 31 01:06:51.799174 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 117/260] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:06:51 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:06:51.803883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d886da41-0352-4352-a3f7-998b92476218 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:51.814521 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:51.814521 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:51.842523 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d886da41-0352-4352-a3f7-998b92476218 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:51.842983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d886da41-0352-4352-a3f7-998b92476218 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:52.090953 n-d-master-1 devstack@n-api.service[119475]: WARNING nova.scheduler.client.report [None req-d886da41-0352-4352-a3f7-998b92476218 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] [req-ebc6e9c6-228b-4d89-8ab0-aa69de9be747] Failed to update aggregates to [] for resource provider with UUID 8067e9c1-12b0-41a7-bdba-9fa5eac68054. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-ebc6e9c6-228b-4d89-8ab0-aa69de9be747"}]} Jul 31 01:06:52.228589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cb9a503d-6c6a-470b-a804-b5b49a9d10c7 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:52.248211 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cb9a503d-6c6a-470b-a804-b5b49a9d10c7 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 200 len: 1389 microversion: 2.1 time: 0.538533 Jul 31 01:06:52.249409 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 144/261] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:51 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 1389 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:52.255775 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bc13b4a3-47de-4c8c-afed-54680207a7e4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:52.256817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bc13b4a3-47de-4c8c-afed-54680207a7e4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:52.268831 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc13b4a3-47de-4c8c-afed-54680207a7e4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:52.269790 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc13b4a3-47de-4c8c-afed-54680207a7e4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:52.275423 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d886da41-0352-4352-a3f7-998b92476218 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.474921 Jul 31 01:06:52.279004 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc13b4a3-47de-4c8c-afed-54680207a7e4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:52.283711 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc13b4a3-47de-4c8c-afed-54680207a7e4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:52.286353 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 118/262] 10.222.0.45 () {60 vars in 1194 bytes} [Sun Jul 31 01:06:51 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:52.308557 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-a654f081-7894-4663-8ddd-6a6ca87c990e req-4cf95a5e-dfe0-4754-9946-47ccb2d52899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1acc67-c73e-4481-9e5a-87c112dc026e", "name": "network-vif-deleted", "tag": "9b9e5438-ce9b-48e0-ad40-9d365147835c"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:52.361371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a654f081-7894-4663-8ddd-6a6ca87c990e req-4cf95a5e-dfe0-4754-9946-47ccb2d52899 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:52.364000 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a654f081-7894-4663-8ddd-6a6ca87c990e req-4cf95a5e-dfe0-4754-9946-47ccb2d52899 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:52.388773 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-a654f081-7894-4663-8ddd-6a6ca87c990e req-4cf95a5e-dfe0-4754-9946-47ccb2d52899 service nova] Creating event network-vif-deleted:9b9e5438-ce9b-48e0-ad40-9d365147835c for instance cc1acc67-c73e-4481-9e5a-87c112dc026e on n-h2-master-1 Jul 31 01:06:52.398261 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-a654f081-7894-4663-8ddd-6a6ca87c990e req-4cf95a5e-dfe0-4754-9946-47ccb2d52899 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103792 Jul 31 01:06:52.400501 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 119/263] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:52.413464 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-65ef3f9d-3bf3-4cef-ab6a-cfd355838cb2 req-582681e2-977f-4f0f-a109-47d645f09962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "389e7feb-f45c-4e78-ad80-6a5d230e68ba", "name": "network-vif-plugged", "status": "completed", "tag": "59525f1d-b7cd-4a9a-86cf-0466f0ad21ef"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:52.427714 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-65ef3f9d-3bf3-4cef-ab6a-cfd355838cb2 req-582681e2-977f-4f0f-a109-47d645f09962 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:52.441021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-65ef3f9d-3bf3-4cef-ab6a-cfd355838cb2 req-582681e2-977f-4f0f-a109-47d645f09962 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:52.469835 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-65ef3f9d-3bf3-4cef-ab6a-cfd355838cb2 req-582681e2-977f-4f0f-a109-47d645f09962 service nova] Creating event network-vif-plugged:59525f1d-b7cd-4a9a-86cf-0466f0ad21ef for instance 389e7feb-f45c-4e78-ad80-6a5d230e68ba on n-h1-master-1 Jul 31 01:06:52.491979 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-65ef3f9d-3bf3-4cef-ab6a-cfd355838cb2 req-582681e2-977f-4f0f-a109-47d645f09962 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086578 Jul 31 01:06:52.493676 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 120/264] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:52.513246 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-daeb761b-2ef4-4237-835d-9262e0354055 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:52.516114 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-daeb761b-2ef4-4237-835d-9262e0354055 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:52.533459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daeb761b-2ef4-4237-835d-9262e0354055 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:52.536913 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daeb761b-2ef4-4237-835d-9262e0354055 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:52.538180 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daeb761b-2ef4-4237-835d-9262e0354055 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:52.540510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daeb761b-2ef4-4237-835d-9262e0354055 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:52.668695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bc13b4a3-47de-4c8c-afed-54680207a7e4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:52.677975 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bc13b4a3-47de-4c8c-afed-54680207a7e4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1313 microversion: 2.1 time: 0.427098 Jul 31 01:06:52.678547 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 145/265] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:52 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:52.681348 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daeb761b-2ef4-4237-835d-9262e0354055 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:52.681913 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daeb761b-2ef4-4237-835d-9262e0354055 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:52.682588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-daeb761b-2ef4-4237-835d-9262e0354055 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lazy-loading 'fault' on Instance uuid cc1acc67-c73e-4481-9e5a-87c112dc026e {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:06:52.695697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ff69284c-37cf-40cf-9581-7a9499d5032e tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:52.696882 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:52.696882 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:52.762232 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ff69284c-37cf-40cf-9581-7a9499d5032e tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.076269 Jul 31 01:06:52.769113 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 146/266] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:06:52 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:52.780965 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6016f1c4-0058-42da-afe4-83b864d30298 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-822390583"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:52.790750 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:52.790750 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:52.792846 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.aggregate [None req-6016f1c4-0058-42da-afe4-83b864d30298 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Generated uuid 38483ab0-f66b-4af3-8d6c-768ee85f7d1e for aggregate {{(pid=119474) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:52.810201 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-daeb761b-2ef4-4237-835d-9262e0354055 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:52.821574 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-daeb761b-2ef4-4237-835d-9262e0354055 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 200 len: 1310 microversion: 2.1 time: 0.325258 Jul 31 01:06:52.825458 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 121/267] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:52 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 1310 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:52.841131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c5adb23c-b6e3-4612-a644-3bbc3a187f86 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:52.843470 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c5adb23c-b6e3-4612-a644-3bbc3a187f86 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:52.858201 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5adb23c-b6e3-4612-a644-3bbc3a187f86 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:52.859156 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5adb23c-b6e3-4612-a644-3bbc3a187f86 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:52.863527 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5adb23c-b6e3-4612-a644-3bbc3a187f86 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:52.866566 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5adb23c-b6e3-4612-a644-3bbc3a187f86 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:52.869603 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6016f1c4-0058-42da-afe4-83b864d30298 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.099200 Jul 31 01:06:52.872078 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 147/268] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:06:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:52.886216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-48fd2c3d-75d7-4f88-8fc7-41ea36c691d0 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:52.888634 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:52.888634 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:52.939454 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-48fd2c3d-75d7-4f88-8fc7-41ea36c691d0 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.056413 Jul 31 01:06:52.941209 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 148/269] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:06:52 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:52.968321 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ebe5bd45-7748-4df5-8e97-cae2d28e1ca0 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:52.972488 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:52.972488 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:52.988812 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-ebe5bd45-7748-4df5-8e97-cae2d28e1ca0 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ebe5bd45-7748-4df5-8e97-cae2d28e1ca0 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Request method failure captured: Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dV0gZeIf61TIi935UHlLyJ-SE1LwiR26au0A8Am-kzcWQEP76ikbPwbQSAYPVhD_3me4h0wQExM-LyGeFuK70n2XeiFqNI-66pajSeaSJtfbFYJxM6pln1AxaEVjTQlOB-f8CB0fH2tMRLgl-kCozgBUCMoZfaOvmQJMbY9cvMb6rg Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 9c3d9ff8445a4d7cb8f3d9428e2d2a79 Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AggregatesAdminTestJSON-1053778191 Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:06:52.996568 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:06:52.997801 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9c3d9ff8445a4d7cb8f3d9428e2d2a79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9c3d9ff8445a4d7cb8f3d9428e2d2a79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9c3d9ff8445a4d7cb8f3d9428e2d2a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9c3d9ff8445a4d7cb8f3d9428e2d2a79", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:52.997801 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AggregatesAdminTestJSON-1053778191 Jul 31 01:06:52.997801 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 9c3d9ff8445a4d7cb8f3d9428e2d2a79 Jul 31 01:06:52.997801 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1053778191 Jul 31 01:06:52.997801 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AggregatesAdminTestJSON-1053778191-project-admin Jul 31 01:06:52.997801 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:52.997801 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:52.997801 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: d921fbb60de04c9ca58ae2853b815aa6 Jul 31 01:06:52.997801 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AggregatesAdminTestJSON-1053778191-project-admin Jul 31 01:06:52.997801 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:52.997801 n-d-master-1 devstack@n-api.service[119474]: exception: Aggregate 14 could not be found. Jul 31 01:06:52.997801 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '14'} Jul 31 01:06:52.997801 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:52.998520 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 31 01:06:52.999573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:53.000549 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ebe5bd45-7748-4df5-8e97-cae2d28e1ca0 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:53.000549 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ebe5bd45-7748-4df5-8e97-cae2d28e1ca0 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.052762 Jul 31 01:06:53.003685 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 149/270] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:06:52 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:06:53.022080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-863d7230-b85a-4497-a50b-731d21f75603 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:53.024403 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:53.024403 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:53.052656 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-863d7230-b85a-4497-a50b-731d21f75603 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-863d7230-b85a-4497-a50b-731d21f75603 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Request method failure captured: Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dV0gZeIf61TIi935UHlLyJ-SE1LwiR26au0A8Am-kzcWQEP76ikbPwbQSAYPVhD_3me4h0wQExM-LyGeFuK70n2XeiFqNI-66pajSeaSJtfbFYJxM6pln1AxaEVjTQlOB-f8CB0fH2tMRLgl-kCozgBUCMoZfaOvmQJMbY9cvMb6rg Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 9c3d9ff8445a4d7cb8f3d9428e2d2a79 Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AggregatesAdminTestJSON-1053778191 Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:06:53.054596 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:06:53.055825 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9c3d9ff8445a4d7cb8f3d9428e2d2a79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9c3d9ff8445a4d7cb8f3d9428e2d2a79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9c3d9ff8445a4d7cb8f3d9428e2d2a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9c3d9ff8445a4d7cb8f3d9428e2d2a79", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:53.055825 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AggregatesAdminTestJSON-1053778191 Jul 31 01:06:53.055825 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 9c3d9ff8445a4d7cb8f3d9428e2d2a79 Jul 31 01:06:53.055825 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1053778191 Jul 31 01:06:53.055825 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AggregatesAdminTestJSON-1053778191-project-admin Jul 31 01:06:53.055825 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:53.055825 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:53.055825 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: d921fbb60de04c9ca58ae2853b815aa6 Jul 31 01:06:53.055825 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AggregatesAdminTestJSON-1053778191-project-admin Jul 31 01:06:53.055825 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:53.055825 n-d-master-1 devstack@n-api.service[119474]: exception: Aggregate 14 could not be found. Jul 31 01:06:53.055825 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '14'} Jul 31 01:06:53.055825 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:06:53.056537 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:53.057535 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:53.059144 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:53.059144 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:53.059144 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:53.059144 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 31 01:06:53.059144 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:53.059144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-863d7230-b85a-4497-a50b-731d21f75603 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:53.059144 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-863d7230-b85a-4497-a50b-731d21f75603 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.050148 Jul 31 01:06:53.060050 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 150/271] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:06:53 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:06:53.073863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fed058f7-2dc6-4b8d-9281-80a632a25c9a tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1656647421", "name": "tempest-test_aggregate-1674720616"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:53.137395 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:53.137395 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:53.139299 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.aggregate [None req-fed058f7-2dc6-4b8d-9281-80a632a25c9a tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Generated uuid 23c9402b-0dfe-41a1-befe-5ede9e927e19 for aggregate {{(pid=119474) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:53.185908 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fed058f7-2dc6-4b8d-9281-80a632a25c9a tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.117863 Jul 31 01:06:53.187293 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 151/272] 10.222.0.45 () {60 vars in 1165 bytes} [Sun Jul 31 01:06:53 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:53.211927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e5ff35dc-428f-4fc7-b4bd-81fdc5f949b1 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:53.214786 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:53.214786 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:53.297251 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e5ff35dc-428f-4fc7-b4bd-81fdc5f949b1 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.099901 Jul 31 01:06:53.299936 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 152/273] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:06:53 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:53.313384 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-97517926-a35d-41e8-92fa-7e7cf7bdbfae tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:53.314503 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-97517926-a35d-41e8-92fa-7e7cf7bdbfae tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:53.319371 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c5adb23c-b6e3-4612-a644-3bbc3a187f86 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:53.324367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97517926-a35d-41e8-92fa-7e7cf7bdbfae tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:53.325465 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97517926-a35d-41e8-92fa-7e7cf7bdbfae tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:53.326619 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97517926-a35d-41e8-92fa-7e7cf7bdbfae tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:53.327220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97517926-a35d-41e8-92fa-7e7cf7bdbfae tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:53.332217 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c5adb23c-b6e3-4612-a644-3bbc3a187f86 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:53.333737 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c5adb23c-b6e3-4612-a644-3bbc3a187f86 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:53.354289 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=10,nova_api:INSERT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:53.363177 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c5adb23c-b6e3-4612-a644-3bbc3a187f86 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1354 microversion: 2.75 time: 0.533183 Jul 31 01:06:53.363865 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 122/274] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:06:52 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1354 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:06:53.380841 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e759aab-6c98-4a7f-a6fe-d5dc46585c16 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:53.382818 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:53.382818 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:53.407624 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-1e759aab-6c98-4a7f-a6fe-d5dc46585c16 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e759aab-6c98-4a7f-a6fe-d5dc46585c16 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Request method failure captured: Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dV0gZeIf61TIi935UHlLyJ-SE1LwiR26au0A8Am-kzcWQEP76ikbPwbQSAYPVhD_3me4h0wQExM-LyGeFuK70n2XeiFqNI-66pajSeaSJtfbFYJxM6pln1AxaEVjTQlOB-f8CB0fH2tMRLgl-kCozgBUCMoZfaOvmQJMbY9cvMb6rg Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 9c3d9ff8445a4d7cb8f3d9428e2d2a79 Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AggregatesAdminTestJSON-1053778191 Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:06:53.415436 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:06:53.416620 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9c3d9ff8445a4d7cb8f3d9428e2d2a79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9c3d9ff8445a4d7cb8f3d9428e2d2a79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9c3d9ff8445a4d7cb8f3d9428e2d2a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9c3d9ff8445a4d7cb8f3d9428e2d2a79", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:53.416620 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AggregatesAdminTestJSON-1053778191 Jul 31 01:06:53.416620 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 9c3d9ff8445a4d7cb8f3d9428e2d2a79 Jul 31 01:06:53.416620 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1053778191 Jul 31 01:06:53.416620 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AggregatesAdminTestJSON-1053778191-project-admin Jul 31 01:06:53.416620 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:53.416620 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:53.416620 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: d921fbb60de04c9ca58ae2853b815aa6 Jul 31 01:06:53.416620 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AggregatesAdminTestJSON-1053778191-project-admin Jul 31 01:06:53.416620 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:53.416620 n-d-master-1 devstack@n-api.service[119475]: exception: Aggregate 15 could not be found. Jul 31 01:06:53.416620 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '15'} Jul 31 01:06:53.416620 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:53.417294 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Jul 31 01:06:53.418348 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:53.420150 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e759aab-6c98-4a7f-a6fe-d5dc46585c16 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:53.420150 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1e759aab-6c98-4a7f-a6fe-d5dc46585c16 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.052003 Jul 31 01:06:53.420150 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 123/275] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:06:53 2022] GET /compute/v2.1/os-aggregates/15 => generated 78 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:06:53.436525 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-048c6d1e-15de-43bf-9e4a-075ff7ff2f87 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:53.437285 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:53.437285 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:53.459530 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-048c6d1e-15de-43bf-9e4a-075ff7ff2f87 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-048c6d1e-15de-43bf-9e4a-075ff7ff2f87 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Request method failure captured: Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dV0gZeIf61TIi935UHlLyJ-SE1LwiR26au0A8Am-kzcWQEP76ikbPwbQSAYPVhD_3me4h0wQExM-LyGeFuK70n2XeiFqNI-66pajSeaSJtfbFYJxM6pln1AxaEVjTQlOB-f8CB0fH2tMRLgl-kCozgBUCMoZfaOvmQJMbY9cvMb6rg Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 9c3d9ff8445a4d7cb8f3d9428e2d2a79 Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AggregatesAdminTestJSON-1053778191 Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:06:53.461205 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:06:53.462805 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9c3d9ff8445a4d7cb8f3d9428e2d2a79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9c3d9ff8445a4d7cb8f3d9428e2d2a79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9c3d9ff8445a4d7cb8f3d9428e2d2a79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9c3d9ff8445a4d7cb8f3d9428e2d2a79", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:53.462805 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AggregatesAdminTestJSON-1053778191 Jul 31 01:06:53.462805 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 9c3d9ff8445a4d7cb8f3d9428e2d2a79 Jul 31 01:06:53.462805 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1053778191 Jul 31 01:06:53.462805 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AggregatesAdminTestJSON-1053778191-project-admin Jul 31 01:06:53.462805 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:53.462805 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:53.462805 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: d921fbb60de04c9ca58ae2853b815aa6 Jul 31 01:06:53.462805 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AggregatesAdminTestJSON-1053778191-project-admin Jul 31 01:06:53.462805 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:53.462805 n-d-master-1 devstack@n-api.service[119475]: exception: Aggregate 15 could not be found. Jul 31 01:06:53.462805 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '15'} Jul 31 01:06:53.462805 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:06:53.463553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:53.471326 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:53.474819 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:53.474819 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:53.474819 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:53.474819 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Jul 31 01:06:53.474819 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:53.474819 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-048c6d1e-15de-43bf-9e4a-075ff7ff2f87 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:53.474819 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-048c6d1e-15de-43bf-9e4a-075ff7ff2f87 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.030437 Jul 31 01:06:53.474819 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 124/276] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:06:53 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:06:53.483918 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-10b40036-6f15-4d5a-b40b-78249e33d4f1 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2046180861"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:53.487307 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:53.487307 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:53.488390 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.aggregate [None req-10b40036-6f15-4d5a-b40b-78249e33d4f1 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Generated uuid 7c8cd7a7-ed02-4352-be18-75f77bf699ef for aggregate {{(pid=119475) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:53.526361 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-10b40036-6f15-4d5a-b40b-78249e33d4f1 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056439 Jul 31 01:06:53.527306 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 125/277] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:06:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:53.538903 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0f6abc07-3209-40e5-bd16-5cb257a9da61 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:53.540687 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:53.540687 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:53.574744 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0f6abc07-3209-40e5-bd16-5cb257a9da61 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.039432 Jul 31 01:06:53.584133 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 126/278] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:06:53 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:53.592337 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a2029baa-0d33-4456-8bc1-48d685bcced5 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:53.596801 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:53.596801 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:53.613819 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-97517926-a35d-41e8-92fa-7e7cf7bdbfae tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:53.623168 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-97517926-a35d-41e8-92fa-7e7cf7bdbfae tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 200 len: 1589 microversion: 2.1 time: 0.320518 Jul 31 01:06:53.623797 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 153/279] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:53 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 1589 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:53.652390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4edbd25b-92d4-45f3-86d8-a346be64ad6e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:53.652955 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4edbd25b-92d4-45f3-86d8-a346be64ad6e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:53.656200 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a2029baa-0d33-4456-8bc1-48d685bcced5 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.068773 Jul 31 01:06:53.657841 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 127/280] 10.222.0.45 () {60 vars in 1194 bytes} [Sun Jul 31 01:06:53 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:53.662675 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4edbd25b-92d4-45f3-86d8-a346be64ad6e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:53.663193 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4edbd25b-92d4-45f3-86d8-a346be64ad6e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:53.664007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4edbd25b-92d4-45f3-86d8-a346be64ad6e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:53.664461 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4edbd25b-92d4-45f3-86d8-a346be64ad6e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:53.672045 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4f9b1f38-1c52-4f66-9959-7963e7630f20 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:53.672890 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:53.672890 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:53.681923 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4f9b1f38-1c52-4f66-9959-7963e7630f20 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.016835 Jul 31 01:06:53.690236 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 128/281] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:06:53 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:53.696499 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-52ebcab0-72f5-4789-9aad-a22e53363d92 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:53.697316 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:53.697316 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:53.725193 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-52ebcab0-72f5-4789-9aad-a22e53363d92 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.033578 Jul 31 01:06:53.731731 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 129/282] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:06:53 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:53.739064 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8ba6d4ef-3984-4fd6-a320-9db9ca1af603 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:53.740528 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8ba6d4ef-3984-4fd6-a320-9db9ca1af603 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:53.748849 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ba6d4ef-3984-4fd6-a320-9db9ca1af603 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:53.749783 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ba6d4ef-3984-4fd6-a320-9db9ca1af603 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:53.751111 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ba6d4ef-3984-4fd6-a320-9db9ca1af603 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:53.752221 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ba6d4ef-3984-4fd6-a320-9db9ca1af603 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:53.909703 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4edbd25b-92d4-45f3-86d8-a346be64ad6e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.263783 Jul 31 01:06:53.910516 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 154/283] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:06:53 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681/os-interface => generated 285 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:53.924750 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-79dd717c-8eda-408b-9f3d-80ef7c7fcef0 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1545671048", "availability_zone": "tempest-test_az-381606486"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:53.928006 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:53.928006 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:53.929539 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.aggregate [None req-79dd717c-8eda-408b-9f3d-80ef7c7fcef0 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Generated uuid 8ee6c491-718b-45b5-9584-e6f5d589d93d for aggregate {{(pid=119474) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:53.962501 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-79dd717c-8eda-408b-9f3d-80ef7c7fcef0 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.042777 Jul 31 01:06:53.965813 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 155/284] 10.222.0.45 () {60 vars in 1165 bytes} [Sun Jul 31 01:06:53 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:53.975262 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-30b97ed6-3b71-41a1-984f-bc1bacf4e66d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:53.978271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-30b97ed6-3b71-41a1-984f-bc1bacf4e66d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:53.999718 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30b97ed6-3b71-41a1-984f-bc1bacf4e66d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:54.001959 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30b97ed6-3b71-41a1-984f-bc1bacf4e66d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:54.005652 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30b97ed6-3b71-41a1-984f-bc1bacf4e66d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:54.008496 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30b97ed6-3b71-41a1-984f-bc1bacf4e66d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:54.077543 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-30b97ed6-3b71-41a1-984f-bc1bacf4e66d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] HTTP exception thrown: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-30b97ed6-3b71-41a1-984f-bc1bacf4e66d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Request method failure captured: Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e HTTP/1.1 Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dWDtZ4dVDAxc4a82pIiBYzrX2WvfIKqnTlbBy50cIrMtLG3LhojWo-7hnBeHzS-aOSM1QPbc0kRay_5qMSbirXMDFkc5Gh92gylZBD_52df32W2e7mKCc1VoL9erv_KiFm2cKAWFCRA_Rr_zffUwJY3_9Ca4WfcLsXhoU4mOl19eIs Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 00d5d344212642b29dbc39c58f8895f3 Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:06:54.082373 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:06:54.084350 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_00d5d344212642b29dbc39c58f8895f3", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:54.084350 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:06:54.084350 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 00d5d344212642b29dbc39c58f8895f3 Jul 31 01:06:54.084350 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:06:54.084350 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersAdminTestJSON-1609993599-project Jul 31 01:06:54.084350 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:06:54.084350 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:06:54.084350 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 1994d455dd3e4143a14ab7f856929080 Jul 31 01:06:54.084350 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersAdminTestJSON-1609993599-project Jul 31 01:06:54.084350 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:06:54.084350 n-d-master-1 devstack@n-api.service[119474]: exception: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. Jul 31 01:06:54.084350 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'cc1acc67-c73e-4481-9e5a-87c112dc026e'} Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:54.085251 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. Jul 31 01:06:54.086819 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:06:54.094295 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-30b97ed6-3b71-41a1-984f-bc1bacf4e66d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Returning 404 to user: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:54.096359 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-30b97ed6-3b71-41a1-984f-bc1bacf4e66d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 404 len: 111 microversion: 2.1 time: 0.128216 Jul 31 01:06:54.097728 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 156/285] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:53 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:54.124330 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d2dfa12a-5ff6-45d2-8105-077d3c7ca4a7 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1545671048_new", "availability_zone": "tempest-test_az-381606486_new"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:54.129762 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:54.129762 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:06:54.203320 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2dfa12a-5ff6-45d2-8105-077d3c7ca4a7 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:54.206184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2dfa12a-5ff6-45d2-8105-077d3c7ca4a7 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:54.304798 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d2dfa12a-5ff6-45d2-8105-077d3c7ca4a7 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 335 microversion: 2.1 time: 0.203635 Jul 31 01:06:54.305447 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 157/286] 10.222.0.45 () {60 vars in 1173 bytes} [Sun Jul 31 01:06:54 2022] PUT /compute/v2.1/os-aggregates/17 => generated 335 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:54.315436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f4f9a197-b87e-44c0-88cc-144b28b203aa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-361353117", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:54.431716 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-f4f9a197-b87e-44c0-88cc-144b28b203aa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] validate_networks() for None {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:06:54.781791 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8ba6d4ef-3984-4fd6-a320-9db9ca1af603 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:54.789927 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8ba6d4ef-3984-4fd6-a320-9db9ca1af603 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1313 microversion: 2.1 time: 1.056683 Jul 31 01:06:54.790654 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 130/287] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:53 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1313 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:54.801244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-12c807dc-df3c-4a8f-856b-cac4733039f8 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:54.803723 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:54.803723 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:54.817188 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-12c807dc-df3c-4a8f-856b-cac4733039f8 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.025220 Jul 31 01:06:54.824238 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 131/288] 10.222.0.45 () {58 vars in 1143 bytes} [Sun Jul 31 01:06:54 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:54.830191 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7fc8255d-d0d2-4552-8b81-6e317700d593 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:54.834654 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7fc8255d-d0d2-4552-8b81-6e317700d593 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:54.853104 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fc8255d-d0d2-4552-8b81-6e317700d593 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:54.853773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fc8255d-d0d2-4552-8b81-6e317700d593 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:54.854739 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fc8255d-d0d2-4552-8b81-6e317700d593 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:54.855368 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fc8255d-d0d2-4552-8b81-6e317700d593 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:55.061664 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7fc8255d-d0d2-4552-8b81-6e317700d593 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:55.071550 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7fc8255d-d0d2-4552-8b81-6e317700d593 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:55.082500 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7fc8255d-d0d2-4552-8b81-6e317700d593 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:55.098361 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7fc8255d-d0d2-4552-8b81-6e317700d593 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1416 microversion: 2.75 time: 0.272407 Jul 31 01:06:55.098973 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 132/289] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:06:54 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1416 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:06:55.121566 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ed3273c-a54a-4eeb-b400-7936a20a1b9b tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:55.122417 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:55.122417 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:55.161564 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4ed3273c-a54a-4eeb-b400-7936a20a1b9b tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.048829 Jul 31 01:06:55.162203 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 133/290] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:06:55 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:55.173650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-737afbfb-9404-434c-8779-d800a1595865 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1214096399"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:55.176339 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:55.176339 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:55.177329 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.aggregate [None req-737afbfb-9404-434c-8779-d800a1595865 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Generated uuid 0ddf295f-6a76-4893-b3cc-507085269d44 for aggregate {{(pid=119475) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:06:55.221418 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-737afbfb-9404-434c-8779-d800a1595865 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.051943 Jul 31 01:06:55.222042 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 134/291] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:06:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:06:55.232981 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fa4766cf-460f-4d83-9ac5-7a912d4698cf tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:55.234106 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:55.234106 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:55.244022 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fa4766cf-460f-4d83-9ac5-7a912d4698cf tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.014654 Jul 31 01:06:55.251729 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 135/292] 10.222.0.45 () {58 vars in 1143 bytes} [Sun Jul 31 01:06:55 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:06:55.258041 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-da91daca-3670-43b1-944f-23ef872cb6c2 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:55.268418 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:06:55.268418 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:06:55.304954 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-da91daca-3670-43b1-944f-23ef872cb6c2 tempest-AggregatesAdminTestJSON-1053778191 tempest-AggregatesAdminTestJSON-1053778191-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.051654 Jul 31 01:06:55.306841 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 136/293] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:06:55 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:06:55.322238 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0dc0d3e1-49cb-4534-ac46-fd895cc9d476 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:55.324450 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0dc0d3e1-49cb-4534-ac46-fd895cc9d476 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:55.341576 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0dc0d3e1-49cb-4534-ac46-fd895cc9d476 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:55.342585 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0dc0d3e1-49cb-4534-ac46-fd895cc9d476 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:55.344179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0dc0d3e1-49cb-4534-ac46-fd895cc9d476 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:55.344901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0dc0d3e1-49cb-4534-ac46-fd895cc9d476 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:55.380116 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-0dc0d3e1-49cb-4534-ac46-fd895cc9d476 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] HTTP exception thrown: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0dc0d3e1-49cb-4534-ac46-fd895cc9d476 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Request method failure captured: Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 HTTP/1.1 Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dVy5sxVk-oeuwMEOcdkk3wXlcOpMdAozzrD9LucAZM4dKEbL0EBPRGtQsI3fPVuH6gBkZuHOpElemk7tI2NbZQKBtarhUmmeZG42oIkKIubIjbOPRGEUhd89LhvYugwj_gT3xkUvlg0zASGAjCojZx1tYDUggMaoyHUwu6k-4laQOI Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 7f9b36e5f5fd4944b791d80037ef872b Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AggregatesAdminTestJSON-2086364881 Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:06:55.383444 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:06:55.384665 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7f9b36e5f5fd4944b791d80037ef872b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7f9b36e5f5fd4944b791d80037ef872b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7f9b36e5f5fd4944b791d80037ef872b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7f9b36e5f5fd4944b791d80037ef872b", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:55.384665 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AggregatesAdminTestJSON-2086364881 Jul 31 01:06:55.384665 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 7f9b36e5f5fd4944b791d80037ef872b Jul 31 01:06:55.384665 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2086364881 Jul 31 01:06:55.384665 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AggregatesAdminTestJSON-2086364881-project Jul 31 01:06:55.384665 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:55.384665 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:55.384665 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 30734920b5a64cbe96bb43aa81c1539d Jul 31 01:06:55.384665 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AggregatesAdminTestJSON-2086364881-project Jul 31 01:06:55.384665 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:55.384665 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. Jul 31 01:06:55.384665 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8'} Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:55.385341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. Jul 31 01:06:55.386373 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:55.392467 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0dc0d3e1-49cb-4534-ac46-fd895cc9d476 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Returning 404 to user: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:55.394295 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0dc0d3e1-49cb-4534-ac46-fd895cc9d476 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "DELETE /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 404 len: 111 microversion: 2.1 time: 0.080801 Jul 31 01:06:55.415512 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 137/294] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:06:55 2022] DELETE /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:06:55.424289 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-70c451d1-8ddd-4bb1-8a60-ad254c71d8c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:55.425345 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-70c451d1-8ddd-4bb1-8a60-ad254c71d8c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] [instance: 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:55.434943 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-70c451d1-8ddd-4bb1-8a60-ad254c71d8c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:55.435766 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-70c451d1-8ddd-4bb1-8a60-ad254c71d8c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:55.440437 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-70c451d1-8ddd-4bb1-8a60-ad254c71d8c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:55.441228 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-70c451d1-8ddd-4bb1-8a60-ad254c71d8c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:55.445422 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:55.500733 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-70c451d1-8ddd-4bb1-8a60-ad254c71d8c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] HTTP exception thrown: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-70c451d1-8ddd-4bb1-8a60-ad254c71d8c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Request method failure captured: Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 HTTP/1.1 Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dVy5sxVk-oeuwMEOcdkk3wXlcOpMdAozzrD9LucAZM4dKEbL0EBPRGtQsI3fPVuH6gBkZuHOpElemk7tI2NbZQKBtarhUmmeZG42oIkKIubIjbOPRGEUhd89LhvYugwj_gT3xkUvlg0zASGAjCojZx1tYDUggMaoyHUwu6k-4laQOI Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 7f9b36e5f5fd4944b791d80037ef872b Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AggregatesAdminTestJSON-2086364881 Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:06:55.503030 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:06:55.504544 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7f9b36e5f5fd4944b791d80037ef872b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7f9b36e5f5fd4944b791d80037ef872b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7f9b36e5f5fd4944b791d80037ef872b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7f9b36e5f5fd4944b791d80037ef872b", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:06:55.504544 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AggregatesAdminTestJSON-2086364881 Jul 31 01:06:55.504544 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 7f9b36e5f5fd4944b791d80037ef872b Jul 31 01:06:55.504544 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2086364881 Jul 31 01:06:55.504544 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AggregatesAdminTestJSON-2086364881-project Jul 31 01:06:55.504544 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:06:55.504544 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:06:55.504544 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 30734920b5a64cbe96bb43aa81c1539d Jul 31 01:06:55.504544 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AggregatesAdminTestJSON-2086364881-project Jul 31 01:06:55.504544 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:06:55.504544 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. Jul 31 01:06:55.504544 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8'} Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:06:55.505224 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. Jul 31 01:06:55.506290 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:06:55.509899 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-70c451d1-8ddd-4bb1-8a60-ad254c71d8c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] Returning 404 to user: Instance 825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:06:55.511745 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-70c451d1-8ddd-4bb1-8a60-ad254c71d8c9 tempest-AggregatesAdminTestJSON-2086364881 tempest-AggregatesAdminTestJSON-2086364881-project] 10.222.0.45 "GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8" status: 404 len: 111 microversion: 2.1 time: 0.094278 Jul 31 01:06:55.517275 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 138/295] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:55 2022] GET /compute/v2.1/servers/825a9e7e-1bee-4f1f-a53b-bf14cf2c27e8 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:06:55.814757 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d492d73b-2b1d-490e-8d78-d56b5a8e3a8b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:55.816635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d492d73b-2b1d-490e-8d78-d56b5a8e3a8b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:55.829719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d492d73b-2b1d-490e-8d78-d56b5a8e3a8b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:55.831269 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d492d73b-2b1d-490e-8d78-d56b5a8e3a8b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:55.833138 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d492d73b-2b1d-490e-8d78-d56b5a8e3a8b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:55.840638 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d492d73b-2b1d-490e-8d78-d56b5a8e3a8b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:56.207605 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-f4f9a197-b87e-44c0-88cc-144b28b203aa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:06:56.208097 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-f4f9a197-b87e-44c0-88cc-144b28b203aa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:06:56.208490 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-f4f9a197-b87e-44c0-88cc-144b28b203aa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:06:56.208905 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-f4f9a197-b87e-44c0-88cc-144b28b203aa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:06:56.209320 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-f4f9a197-b87e-44c0-88cc-144b28b203aa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:06:56.224878 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4f9a197-b87e-44c0-88cc-144b28b203aa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:56.225332 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4f9a197-b87e-44c0-88cc-144b28b203aa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:56.226201 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4f9a197-b87e-44c0-88cc-144b28b203aa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:56.226569 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4f9a197-b87e-44c0-88cc-144b28b203aa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:56.282784 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-f4f9a197-b87e-44c0-88cc-144b28b203aa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Getting quotas for project 00d5d344212642b29dbc39c58f8895f3. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:06:56.306907 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-f4f9a197-b87e-44c0-88cc-144b28b203aa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Getting quotas for user 1994d455dd3e4143a14ab7f856929080 and project 00d5d344212642b29dbc39c58f8895f3. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:06:56.336222 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f4f9a197-b87e-44c0-88cc-144b28b203aa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:06:56.346316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f4f9a197-b87e-44c0-88cc-144b28b203aa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:06:56.439283 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f4f9a197-b87e-44c0-88cc-144b28b203aa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.131779 Jul 31 01:06:56.441035 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 158/296] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:06:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:06:56.450297 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-83c4052a-dae6-4c88-9281-be0024101f64 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:56.452710 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-83c4052a-dae6-4c88-9281-be0024101f64 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:56.469708 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83c4052a-dae6-4c88-9281-be0024101f64 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:56.470240 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83c4052a-dae6-4c88-9281-be0024101f64 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:56.476436 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83c4052a-dae6-4c88-9281-be0024101f64 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:56.476821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83c4052a-dae6-4c88-9281-be0024101f64 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:56.830189 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-83c4052a-dae6-4c88-9281-be0024101f64 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:56.853446 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-83c4052a-dae6-4c88-9281-be0024101f64 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:56.871954 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-83c4052a-dae6-4c88-9281-be0024101f64 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:56.903178 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=12,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:56.914027 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-83c4052a-dae6-4c88-9281-be0024101f64 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1416 microversion: 2.75 time: 0.471467 Jul 31 01:06:56.920103 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 159/297] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:06:56 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1416 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:06:56.934452 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-87e11ffb-32d7-4bde-a7f2-51048e922f6f tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:56.950471 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-87e11ffb-32d7-4bde-a7f2-51048e922f6f tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:57.063995 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d492d73b-2b1d-490e-8d78-d56b5a8e3a8b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:57.074022 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d492d73b-2b1d-490e-8d78-d56b5a8e3a8b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1463 microversion: 2.1 time: 1.267520 Jul 31 01:06:57.080419 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 139/298] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:55 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1463 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:57.142684 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-87e11ffb-32d7-4bde-a7f2-51048e922f6f tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:57.152934 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-87e11ffb-32d7-4bde-a7f2-51048e922f6f tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 200 len: 1219 microversion: 2.1 time: 0.230400 Jul 31 01:06:57.156892 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 160/299] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:56 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 1219 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:57.566561 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c462ff4a-e638-4fc1-85a5-2b8181e959f4 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:57.567326 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c462ff4a-e638-4fc1-85a5-2b8181e959f4 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:57.590840 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c462ff4a-e638-4fc1-85a5-2b8181e959f4 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:57.591291 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c462ff4a-e638-4fc1-85a5-2b8181e959f4 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:57.592433 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c462ff4a-e638-4fc1-85a5-2b8181e959f4 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:57.593399 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c462ff4a-e638-4fc1-85a5-2b8181e959f4 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:57.947291 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1f2af073-6f6e-4ef3-8a8d-2b3d837a9e23 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:57.948122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1f2af073-6f6e-4ef3-8a8d-2b3d837a9e23 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:57.962819 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f2af073-6f6e-4ef3-8a8d-2b3d837a9e23 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:57.970979 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f2af073-6f6e-4ef3-8a8d-2b3d837a9e23 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:57.975134 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f2af073-6f6e-4ef3-8a8d-2b3d837a9e23 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:57.978990 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f2af073-6f6e-4ef3-8a8d-2b3d837a9e23 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:58.208090 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1f2af073-6f6e-4ef3-8a8d-2b3d837a9e23 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:58.219988 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1f2af073-6f6e-4ef3-8a8d-2b3d837a9e23 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:58.224672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1f2af073-6f6e-4ef3-8a8d-2b3d837a9e23 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:58.240783 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1f2af073-6f6e-4ef3-8a8d-2b3d837a9e23 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1437 microversion: 2.75 time: 0.302458 Jul 31 01:06:58.241251 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 161/300] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:06:57 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1437 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:06:58.255764 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-682597ee-a26d-465b-9527-6178196b692d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:58.258991 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-682597ee-a26d-465b-9527-6178196b692d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:58.271443 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-682597ee-a26d-465b-9527-6178196b692d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:58.271910 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-682597ee-a26d-465b-9527-6178196b692d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:58.281264 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-682597ee-a26d-465b-9527-6178196b692d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:58.282338 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-682597ee-a26d-465b-9527-6178196b692d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:58.976258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-682597ee-a26d-465b-9527-6178196b692d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:06:58.987237 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-682597ee-a26d-465b-9527-6178196b692d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 200 len: 1271 microversion: 2.1 time: 0.740124 Jul 31 01:06:59.009340 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 162/301] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:58 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 1271 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:06:59.035705 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0f306572-729b-4b95-a357-79461887e541"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:06:59.048997 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:59.069761 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:59.071681 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:59.073155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:59.077706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:59.324559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:06:59.324989 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:06:59.325621 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:06:59.326462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:06:59.326878 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:06:59.458366 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c462ff4a-e638-4fc1-85a5-2b8181e959f4 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1614 microversion: 2.1 time: 2.356440 Jul 31 01:06:59.463297 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 140/302] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:57 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1614 bytes in 2362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:06:59.508722 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8a0e607f-eefe-4f11-a7bf-6c9625807a59 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:06:59.514228 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8a0e607f-eefe-4f11-a7bf-6c9625807a59 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:59.518532 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:06:59.534475 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:59.543570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:59.547101 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a0e607f-eefe-4f11-a7bf-6c9625807a59 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:59.549279 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a0e607f-eefe-4f11-a7bf-6c9625807a59 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:59.549909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:59.550355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:06:59.552933 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a0e607f-eefe-4f11-a7bf-6c9625807a59 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:06:59.554394 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a0e607f-eefe-4f11-a7bf-6c9625807a59 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:00.023631 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:00.035366 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:00.037019 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:00.069227 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-675a7cb7-a53d-44e5-879f-a4e338d808f5 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "POST /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324/action" status: 202 len: 1494 microversion: 2.75 time: 1.051833 Jul 31 01:07:00.069978 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 163/303] 10.222.0.45 () {62 vars in 1319 bytes} [Sun Jul 31 01:06:59 2022] POST /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324/action => generated 1494 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 31 01:07:00.088943 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-0f7ad118-265d-4322-b212-348738ff0788 req-c777dbd5-01ed-4e6b-a09f-aced4f86a6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eccd8f8d-d332-4c4e-bef6-30de69b8f681", "tag": "f7832bd1-893a-4d8d-a8db-89c1491322de"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:00.122316 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0f7ad118-265d-4322-b212-348738ff0788 req-c777dbd5-01ed-4e6b-a09f-aced4f86a6b5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:00.126964 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0f7ad118-265d-4322-b212-348738ff0788 req-c777dbd5-01ed-4e6b-a09f-aced4f86a6b5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:00.166049 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-0f7ad118-265d-4322-b212-348738ff0788 req-c777dbd5-01ed-4e6b-a09f-aced4f86a6b5 service nova] Creating event network-changed:f7832bd1-893a-4d8d-a8db-89c1491322de for instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 on n-h2-master-1 Jul 31 01:07:00.178882 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-0f7ad118-265d-4322-b212-348738ff0788 req-c777dbd5-01ed-4e6b-a09f-aced4f86a6b5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103963 Jul 31 01:07:00.182781 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 164/304] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:00.210958 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f7a4c03d-b93f-426f-b009-f42634ae375d tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:00.212576 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f7a4c03d-b93f-426f-b009-f42634ae375d tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:00.233578 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7a4c03d-b93f-426f-b009-f42634ae375d tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:00.234749 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7a4c03d-b93f-426f-b009-f42634ae375d tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:00.237976 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7a4c03d-b93f-426f-b009-f42634ae375d tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:00.243789 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7a4c03d-b93f-426f-b009-f42634ae375d tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:00.497995 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8a0e607f-eefe-4f11-a7bf-6c9625807a59 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:00.518554 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8a0e607f-eefe-4f11-a7bf-6c9625807a59 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 200 len: 1589 microversion: 2.1 time: 1.050235 Jul 31 01:07:00.525141 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 141/305] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:06:59 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 1589 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:00.538584 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-28ca9576-27c2-464c-872a-70a2029618e1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:00.542223 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-28ca9576-27c2-464c-872a-70a2029618e1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:00.562819 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28ca9576-27c2-464c-872a-70a2029618e1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:00.563630 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28ca9576-27c2-464c-872a-70a2029618e1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:00.566449 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28ca9576-27c2-464c-872a-70a2029618e1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:00.569146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28ca9576-27c2-464c-872a-70a2029618e1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:00.867012 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f7a4c03d-b93f-426f-b009-f42634ae375d tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3a7cac3afc994979bb4ddb916f2619b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd524a3978c454fb791ef231d147ca14a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:00.868057 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f7a4c03d-b93f-426f-b009-f42634ae375d tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] flavor_id is None. Assuming migration. {{(pid=119474) resize /opt/stack/nova/nova/compute/api.py:4144}} Jul 31 01:07:00.869138 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f7a4c03d-b93f-426f-b009-f42634ae375d tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119474) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 31 01:07:01.075203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-28ca9576-27c2-464c-872a-70a2029618e1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:01.084654 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-28ca9576-27c2-464c-872a-70a2029618e1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 200 len: 1319 microversion: 2.1 time: 0.557725 Jul 31 01:07:01.085255 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 142/306] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:00 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 1319 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:01.106541 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3ac13e2d-22bd-4bea-884b-85e863b7d9bb tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:01.107216 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3ac13e2d-22bd-4bea-884b-85e863b7d9bb tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:01.121036 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ac13e2d-22bd-4bea-884b-85e863b7d9bb tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:01.126374 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ac13e2d-22bd-4bea-884b-85e863b7d9bb tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:01.128067 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ac13e2d-22bd-4bea-884b-85e863b7d9bb tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:01.128067 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ac13e2d-22bd-4bea-884b-85e863b7d9bb tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:01.310350 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3ac13e2d-22bd-4bea-884b-85e863b7d9bb tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:01.327897 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3ac13e2d-22bd-4bea-884b-85e863b7d9bb tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:01.335792 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3ac13e2d-22bd-4bea-884b-85e863b7d9bb tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:01.352707 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3ac13e2d-22bd-4bea-884b-85e863b7d9bb tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.263320 Jul 31 01:07:01.353901 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 143/307] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:01 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:01.557933 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f7a4c03d-b93f-426f-b009-f42634ae375d tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba/action" status: 202 len: 0 microversion: 2.1 time: 1.367537 Jul 31 01:07:01.565755 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 165/308] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:07:00 2022] POST /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba/action => generated 0 bytes in 1374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:07:01.580260 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b4c8a4c0-1009-47e5-bab3-07f91d4f122c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:01.581266 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b4c8a4c0-1009-47e5-bab3-07f91d4f122c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:01.597046 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4c8a4c0-1009-47e5-bab3-07f91d4f122c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:01.598175 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4c8a4c0-1009-47e5-bab3-07f91d4f122c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:01.602402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4c8a4c0-1009-47e5-bab3-07f91d4f122c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:01.603078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4c8a4c0-1009-47e5-bab3-07f91d4f122c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:01.772672 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:01.870136 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-890fc69a-d767-453d-b727-2d31eb3d236b tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-56802361", "id": 1524901786, "os-flavor-access:is_public": "False"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:01.877007 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:01.877007 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:01.890681 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b4c8a4c0-1009-47e5-bab3-07f91d4f122c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:01.902237 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b4c8a4c0-1009-47e5-bab3-07f91d4f122c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1472 microversion: 2.1 time: 0.332638 Jul 31 01:07:01.903169 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 166/309] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:01 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1472 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:01.916457 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-890fc69a-d767-453d-b727-2d31eb3d236b tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.556415 Jul 31 01:07:01.916457 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 144/310] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:07:01 2022] POST /compute/v2.1/flavors => generated 429 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:01.929547 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e5b5384d-de99-4222-8eb1-637e9ba0e61e tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e66d12817028479eb912527e39338518"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:01.941854 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:01.941854 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:02.112122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3d8ac7ad-bd30-418e-a06b-2dbbe6d64036 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:02.114411 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3d8ac7ad-bd30-418e-a06b-2dbbe6d64036 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:02.128206 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d8ac7ad-bd30-418e-a06b-2dbbe6d64036 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:02.129458 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d8ac7ad-bd30-418e-a06b-2dbbe6d64036 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:02.130696 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d8ac7ad-bd30-418e-a06b-2dbbe6d64036 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:02.131660 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d8ac7ad-bd30-418e-a06b-2dbbe6d64036 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:02.543432 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e5b5384d-de99-4222-8eb1-637e9ba0e61e tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1524901786/action" status: 200 len: 97 microversion: 2.1 time: 0.620232 Jul 31 01:07:02.547023 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 145/311] 10.222.0.45 () {60 vars in 1200 bytes} [Sun Jul 31 01:07:01 2022] POST /compute/v2.1/flavors/1524901786/action => generated 97 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:07:02.557406 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-18e7c35c-eaee-463e-9ccd-95b8a2294a72 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:02.565325 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-18e7c35c-eaee-463e-9ccd-95b8a2294a72 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:02.589419 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18e7c35c-eaee-463e-9ccd-95b8a2294a72 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:02.591688 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18e7c35c-eaee-463e-9ccd-95b8a2294a72 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:02.593104 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18e7c35c-eaee-463e-9ccd-95b8a2294a72 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:02.596093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18e7c35c-eaee-463e-9ccd-95b8a2294a72 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:02.620419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3d8ac7ad-bd30-418e-a06b-2dbbe6d64036 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:02.633812 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3d8ac7ad-bd30-418e-a06b-2dbbe6d64036 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 200 len: 1319 microversion: 2.1 time: 0.528005 Jul 31 01:07:02.662963 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 167/312] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:02 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 1319 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:07:02.835858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-18e7c35c-eaee-463e-9ccd-95b8a2294a72 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:02.852462 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-18e7c35c-eaee-463e-9ccd-95b8a2294a72 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:02.860644 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-18e7c35c-eaee-463e-9ccd-95b8a2294a72 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:02.879379 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-18e7c35c-eaee-463e-9ccd-95b8a2294a72 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.329463 Jul 31 01:07:02.881954 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 146/313] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:02 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:02.927935 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-848b04ce-b2af-416b-84aa-77ed520f0ae6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:02.928891 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-848b04ce-b2af-416b-84aa-77ed520f0ae6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:02.943491 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-848b04ce-b2af-416b-84aa-77ed520f0ae6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:02.945236 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-848b04ce-b2af-416b-84aa-77ed520f0ae6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:02.947528 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-848b04ce-b2af-416b-84aa-77ed520f0ae6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:02.948175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-848b04ce-b2af-416b-84aa-77ed520f0ae6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:03.259869 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-848b04ce-b2af-416b-84aa-77ed520f0ae6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:03.269506 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-848b04ce-b2af-416b-84aa-77ed520f0ae6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1472 microversion: 2.1 time: 0.346888 Jul 31 01:07:03.273579 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 147/314] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:02 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1472 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:03.340986 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-de16494d-5be7-46d8-a3bc-c2449a622995 tempest-FlavorsAccessTestJSON-1920702095 tempest-FlavorsAccessTestJSON-1920702095-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:03.395256 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-de16494d-5be7-46d8-a3bc-c2449a622995 tempest-FlavorsAccessTestJSON-1920702095 tempest-FlavorsAccessTestJSON-1920702095-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 6236 microversion: 2.1 time: 0.730687 Jul 31 01:07:03.397131 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 168/315] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:07:02 2022] GET /compute/v2.1/flavors/detail => generated 6236 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:03.406116 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-119edb6d-29e9-42d5-9d0d-c0c5403025f1 req-18c63f05-2d94-4076-8c13-e1ac9811784f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a44b0a-6c30-4b99-a071-adbc610df74d", "tag": "998bd7c0-2efb-4942-b7a7-b7c146e8554b"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:03.432364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-119edb6d-29e9-42d5-9d0d-c0c5403025f1 req-18c63f05-2d94-4076-8c13-e1ac9811784f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:03.434161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-119edb6d-29e9-42d5-9d0d-c0c5403025f1 req-18c63f05-2d94-4076-8c13-e1ac9811784f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:03.448827 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:03.452832 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-119edb6d-29e9-42d5-9d0d-c0c5403025f1 req-18c63f05-2d94-4076-8c13-e1ac9811784f service nova] Creating event network-changed:998bd7c0-2efb-4942-b7a7-b7c146e8554b for instance 74a44b0a-6c30-4b99-a071-adbc610df74d on n-h2-master-1 Jul 31 01:07:03.460774 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-119edb6d-29e9-42d5-9d0d-c0c5403025f1 req-18c63f05-2d94-4076-8c13-e1ac9811784f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062331 Jul 31 01:07:03.462483 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 169/316] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:03.470418 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-925c39fa-0b89-4afa-b5b7-c236e183a9c0 tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e66d12817028479eb912527e39338518"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:03.475656 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:03.475656 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:03.586504 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-50e5dca3-bd99-4850-b263-0290dab49f2a tempest-AZAdminNegativeTestJSON-825442321 tempest-AZAdminNegativeTestJSON-825442321-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:03.587601 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:03.587601 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:03.588396 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-50e5dca3-bd99-4850-b263-0290dab49f2a tempest-AZAdminNegativeTestJSON-825442321 tempest-AZAdminNegativeTestJSON-825442321-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '41dd72384f28456a97fa41b809a344d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9321e6caf8e42339e798c217ac55b64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-50e5dca3-bd99-4850-b263-0290dab49f2a tempest-AZAdminNegativeTestJSON-825442321 tempest-AZAdminNegativeTestJSON-825442321-project] Request method failure captured: Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dW0YLO-W1sXcFxZ6VYxflei5-mi0fDV6YOHHfs0AtlqQaQk8hVZ7fkzrycRinmxUoRpXK3v7-0eMtHHQqDwGInTSZY2Ue40BNz1WSpGy_bSYkrPBwDk2DonesGwL-iKwLZC1eqb2RfWk0ddwWHB0irshw3FwBeRKVQoYDBL6RsBYkY Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: c9321e6caf8e42339e798c217ac55b64 Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AZAdminNegativeTestJSON-825442321 Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:07:03.590195 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:07:03.591460 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c9321e6caf8e42339e798c217ac55b64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c9321e6caf8e42339e798c217ac55b64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c9321e6caf8e42339e798c217ac55b64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c9321e6caf8e42339e798c217ac55b64", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:03.591460 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AZAdminNegativeTestJSON-825442321 Jul 31 01:07:03.591460 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: c9321e6caf8e42339e798c217ac55b64 Jul 31 01:07:03.591460 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-825442321 Jul 31 01:07:03.591460 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AZAdminNegativeTestJSON-825442321-project Jul 31 01:07:03.591460 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:07:03.591460 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:07:03.591460 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 41dd72384f28456a97fa41b809a344d2 Jul 31 01:07:03.591460 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AZAdminNegativeTestJSON-825442321-project Jul 31 01:07:03.591460 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:07:03.591460 n-d-master-1 devstack@n-api.service[119475]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 31 01:07:03.591460 n-d-master-1 devstack@n-api.service[119475]: action_args: {} Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:07:03.592146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:03.593754 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-50e5dca3-bd99-4850-b263-0290dab49f2a tempest-AZAdminNegativeTestJSON-825442321 tempest-AZAdminNegativeTestJSON-825442321-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:03.594784 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-50e5dca3-bd99-4850-b263-0290dab49f2a tempest-AZAdminNegativeTestJSON-825442321 tempest-AZAdminNegativeTestJSON-825442321-project] 10.222.0.45 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.314437 Jul 31 01:07:03.594784 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 148/317] 10.222.0.45 () {58 vars in 1185 bytes} [Sun Jul 31 01:07:03 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 315 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:03.663989 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4339ae72-195b-44d4-a4a1-9dbf288ad348 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:03.664611 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4339ae72-195b-44d4-a4a1-9dbf288ad348 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:03.680398 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4339ae72-195b-44d4-a4a1-9dbf288ad348 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:03.680945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4339ae72-195b-44d4-a4a1-9dbf288ad348 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:03.681793 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4339ae72-195b-44d4-a4a1-9dbf288ad348 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:03.682240 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4339ae72-195b-44d4-a4a1-9dbf288ad348 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:03.976917 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-925c39fa-0b89-4afa-b5b7-c236e183a9c0 tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/1524901786/action" status: 200 len: 21 microversion: 2.1 time: 0.512278 Jul 31 01:07:03.979672 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 170/318] 10.222.0.45 () {60 vars in 1200 bytes} [Sun Jul 31 01:07:03 2022] POST /compute/v2.1/flavors/1524901786/action => generated 21 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:07:03.985667 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e1f3a49a-d98a-4eb4-a396-0bff4020de93 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:03.986402 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e1f3a49a-d98a-4eb4-a396-0bff4020de93 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:04.004857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e1f3a49a-d98a-4eb4-a396-0bff4020de93 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:04.006659 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e1f3a49a-d98a-4eb4-a396-0bff4020de93 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:04.007887 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e1f3a49a-d98a-4eb4-a396-0bff4020de93 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:04.010604 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e1f3a49a-d98a-4eb4-a396-0bff4020de93 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:04.172397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4339ae72-195b-44d4-a4a1-9dbf288ad348 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:04.183630 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e1f3a49a-d98a-4eb4-a396-0bff4020de93 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:04.187947 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4339ae72-195b-44d4-a4a1-9dbf288ad348 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 200 len: 1319 microversion: 2.1 time: 0.527634 Jul 31 01:07:04.191329 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 149/319] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:03 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 1319 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:07:04.203300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9c81870c-cb41-47e2-be3c-3f88ae949b85 tempest-FlavorsAccessTestJSON-1920702095 tempest-FlavorsAccessTestJSON-1920702095-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:04.232956 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e1f3a49a-d98a-4eb4-a396-0bff4020de93 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:04.236830 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e1f3a49a-d98a-4eb4-a396-0bff4020de93 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:04.247555 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e1f3a49a-d98a-4eb4-a396-0bff4020de93 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.266280 Jul 31 01:07:04.250061 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 171/320] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:03 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:04.272470 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9c81870c-cb41-47e2-be3c-3f88ae949b85 tempest-FlavorsAccessTestJSON-1920702095 tempest-FlavorsAccessTestJSON-1920702095-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.075815 Jul 31 01:07:04.274732 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 150/321] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:07:04 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:04.295183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bc4c8c8d-be70-49cb-9c2d-8e0a464e9534 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:04.295663 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9815620e-e80a-493d-8bf3-d16b5f16d0e4 tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:04.296606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bc4c8c8d-be70-49cb-9c2d-8e0a464e9534 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:04.296954 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:04.296954 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:04.305911 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc4c8c8d-be70-49cb-9c2d-8e0a464e9534 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:04.306972 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc4c8c8d-be70-49cb-9c2d-8e0a464e9534 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:04.309577 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc4c8c8d-be70-49cb-9c2d-8e0a464e9534 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:04.310534 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc4c8c8d-be70-49cb-9c2d-8e0a464e9534 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:04.360041 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9815620e-e80a-493d-8bf3-d16b5f16d0e4 tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1524901786" status: 202 len: 0 microversion: 2.1 time: 0.069924 Jul 31 01:07:04.363977 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 151/322] 10.222.0.45 () {58 vars in 1161 bytes} [Sun Jul 31 01:07:04 2022] DELETE /compute/v2.1/flavors/1524901786 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:07:04.370907 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-135e3315-ba34-4b62-8bd6-dcbc4b847d57 tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:04.379677 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:DELETE=9 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:04.433672 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-135e3315-ba34-4b62-8bd6-dcbc4b847d57 tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.068206 Jul 31 01:07:04.437817 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 152/323] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:07:04 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:04.462406 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-57932f67-a774-46de-87b8-b56d9d8e552c tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-141923903", "id": 268128528, "os-flavor-access:is_public": "False"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:04.471651 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:04.471651 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:04.524092 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-57932f67-a774-46de-87b8-b56d9d8e552c tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.066050 Jul 31 01:07:04.532975 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 153/324] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:07:04 2022] POST /compute/v2.1/flavors => generated 427 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:04.538598 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f42edcb1-e980-4561-b845-6e74d597d98b tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:04.539642 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:04.539642 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:04.574989 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f42edcb1-e980-4561-b845-6e74d597d98b tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/268128528/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.040665 Jul 31 01:07:04.575799 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 154/325] 10.222.0.45 () {58 vars in 1206 bytes} [Sun Jul 31 01:07:04 2022] GET /compute/v2.1/flavors/268128528/os-flavor-access => generated 21 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 31 01:07:04.589425 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f10659a9-2f64-4ebb-82e6-8333b5a57dbc tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:04.615834 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f10659a9-2f64-4ebb-82e6-8333b5a57dbc tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/268128528" status: 202 len: 0 microversion: 2.1 time: 0.031959 Jul 31 01:07:04.616936 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 155/326] 10.222.0.45 () {58 vars in 1158 bytes} [Sun Jul 31 01:07:04 2022] DELETE /compute/v2.1/flavors/268128528 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 01:07:04.628069 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7ba40ce9-7f4f-4020-bc44-140c062bdae4 tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:04.672962 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7ba40ce9-7f4f-4020-bc44-140c062bdae4 tempest-FlavorsAccessTestJSON-306845479 tempest-FlavorsAccessTestJSON-306845479-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.050175 Jul 31 01:07:04.687514 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 156/327] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:07:04 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:07:04.736491 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bc4c8c8d-be70-49cb-9c2d-8e0a464e9534 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:04.749975 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bc4c8c8d-be70-49cb-9c2d-8e0a464e9534 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1472 microversion: 2.1 time: 0.460014 Jul 31 01:07:04.751517 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 172/328] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:04 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1472 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:05.231831 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8d0e992f-1442-45d3-beb2-2105726cd8cb tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:05.232847 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8d0e992f-1442-45d3-beb2-2105726cd8cb tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:05.245027 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d0e992f-1442-45d3-beb2-2105726cd8cb tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:05.249834 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d0e992f-1442-45d3-beb2-2105726cd8cb tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:05.252284 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d0e992f-1442-45d3-beb2-2105726cd8cb tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:05.253056 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d0e992f-1442-45d3-beb2-2105726cd8cb tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:05.285085 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fcd0f0ea-f87f-4fde-adf8-f8996bcb6b91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:05.295846 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fcd0f0ea-f87f-4fde-adf8-f8996bcb6b91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:05.320616 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcd0f0ea-f87f-4fde-adf8-f8996bcb6b91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:05.329489 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcd0f0ea-f87f-4fde-adf8-f8996bcb6b91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:05.333232 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcd0f0ea-f87f-4fde-adf8-f8996bcb6b91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:05.341359 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcd0f0ea-f87f-4fde-adf8-f8996bcb6b91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:05.585353 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fcd0f0ea-f87f-4fde-adf8-f8996bcb6b91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:05.621895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fcd0f0ea-f87f-4fde-adf8-f8996bcb6b91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:05.633302 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fcd0f0ea-f87f-4fde-adf8-f8996bcb6b91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:05.646552 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fcd0f0ea-f87f-4fde-adf8-f8996bcb6b91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.370961 Jul 31 01:07:05.648410 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 173/329] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:05 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:05.748692 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8d0e992f-1442-45d3-beb2-2105726cd8cb tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:05.760032 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8d0e992f-1442-45d3-beb2-2105726cd8cb tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 200 len: 1319 microversion: 2.1 time: 0.533962 Jul 31 01:07:05.767189 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 157/330] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:05 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 1319 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:05.771781 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cb0723ec-27ec-4c31-8d58-867b76c5fb49 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:05.772612 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cb0723ec-27ec-4c31-8d58-867b76c5fb49 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:05.780320 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb0723ec-27ec-4c31-8d58-867b76c5fb49 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:05.781094 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb0723ec-27ec-4c31-8d58-867b76c5fb49 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:05.782355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb0723ec-27ec-4c31-8d58-867b76c5fb49 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:05.783973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb0723ec-27ec-4c31-8d58-867b76c5fb49 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:06.259394 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:06.354572 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cb0723ec-27ec-4c31-8d58-867b76c5fb49 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:06.400185 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cb0723ec-27ec-4c31-8d58-867b76c5fb49 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1472 microversion: 2.1 time: 0.631395 Jul 31 01:07:06.401994 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 174/331] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:05 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1472 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:07:06.674937 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-38510a80-649c-43ca-a12b-60a6f7a3c3a2 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:06.677536 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-38510a80-649c-43ca-a12b-60a6f7a3c3a2 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:06.684812 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38510a80-649c-43ca-a12b-60a6f7a3c3a2 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:06.685667 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38510a80-649c-43ca-a12b-60a6f7a3c3a2 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:06.686784 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38510a80-649c-43ca-a12b-60a6f7a3c3a2 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:06.687487 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38510a80-649c-43ca-a12b-60a6f7a3c3a2 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:06.794369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-38510a80-649c-43ca-a12b-60a6f7a3c3a2 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:06.805549 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ee8bb931-64c9-423a-b74d-53e0e42a65d9 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:06.811070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ee8bb931-64c9-423a-b74d-53e0e42a65d9 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:06.814213 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-38510a80-649c-43ca-a12b-60a6f7a3c3a2 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:06.815917 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-38510a80-649c-43ca-a12b-60a6f7a3c3a2 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:06.824811 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee8bb931-64c9-423a-b74d-53e0e42a65d9 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:06.826359 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee8bb931-64c9-423a-b74d-53e0e42a65d9 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:06.844421 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-38510a80-649c-43ca-a12b-60a6f7a3c3a2 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.173861 Jul 31 01:07:06.845292 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 158/332] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:06 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:06.846095 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee8bb931-64c9-423a-b74d-53e0e42a65d9 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:06.847481 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee8bb931-64c9-423a-b74d-53e0e42a65d9 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:07.153587 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=14 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:07.423997 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-09e0255f-0050-4a80-987c-d4b848bb6c52 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:07.424629 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-09e0255f-0050-4a80-987c-d4b848bb6c52 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:07.443201 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09e0255f-0050-4a80-987c-d4b848bb6c52 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:07.443723 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09e0255f-0050-4a80-987c-d4b848bb6c52 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:07.445326 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09e0255f-0050-4a80-987c-d4b848bb6c52 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:07.445597 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09e0255f-0050-4a80-987c-d4b848bb6c52 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:07.642032 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ee8bb931-64c9-423a-b74d-53e0e42a65d9 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:07.671773 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ee8bb931-64c9-423a-b74d-53e0e42a65d9 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 200 len: 1319 microversion: 2.1 time: 0.882387 Jul 31 01:07:07.695105 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 175/333] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:06 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 1319 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:07.871863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2d6b9328-554f-4b5f-a344-3cee0d852e3e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:07.872706 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2d6b9328-554f-4b5f-a344-3cee0d852e3e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:07.879728 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d6b9328-554f-4b5f-a344-3cee0d852e3e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:07.880394 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d6b9328-554f-4b5f-a344-3cee0d852e3e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:07.881192 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d6b9328-554f-4b5f-a344-3cee0d852e3e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:07.881793 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d6b9328-554f-4b5f-a344-3cee0d852e3e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:08.070014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2d6b9328-554f-4b5f-a344-3cee0d852e3e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:08.084459 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2d6b9328-554f-4b5f-a344-3cee0d852e3e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:08.086035 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2d6b9328-554f-4b5f-a344-3cee0d852e3e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:08.100933 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2d6b9328-554f-4b5f-a344-3cee0d852e3e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.232799 Jul 31 01:07:08.101851 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 176/334] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:07 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:07:08.107616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-09e0255f-0050-4a80-987c-d4b848bb6c52 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:08.116409 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-09e0255f-0050-4a80-987c-d4b848bb6c52 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1472 microversion: 2.1 time: 0.697245 Jul 31 01:07:08.117009 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 159/335] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:07 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1472 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:08.722559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-411fbb19-9a07-4075-accc-28266291868e tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:08.728764 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-411fbb19-9a07-4075-accc-28266291868e tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:08.756430 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-411fbb19-9a07-4075-accc-28266291868e tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:08.757227 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-411fbb19-9a07-4075-accc-28266291868e tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:08.761509 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-411fbb19-9a07-4075-accc-28266291868e tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:08.763773 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-411fbb19-9a07-4075-accc-28266291868e tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:09.086596 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-411fbb19-9a07-4075-accc-28266291868e tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:09.096785 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-411fbb19-9a07-4075-accc-28266291868e tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 200 len: 1319 microversion: 2.1 time: 0.385877 Jul 31 01:07:09.100179 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 177/336] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:08 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:09.132936 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-537a7740-5a3e-4d1a-807f-b467bb7806be tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:09.136311 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-537a7740-5a3e-4d1a-807f-b467bb7806be tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:09.153159 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cd55d902-7d18-4240-a3ae-15f8fa1ab0a4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:09.154549 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-537a7740-5a3e-4d1a-807f-b467bb7806be tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:09.154708 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cd55d902-7d18-4240-a3ae-15f8fa1ab0a4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:09.155436 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-537a7740-5a3e-4d1a-807f-b467bb7806be tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:09.157132 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-537a7740-5a3e-4d1a-807f-b467bb7806be tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:09.158478 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-537a7740-5a3e-4d1a-807f-b467bb7806be tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:09.165208 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd55d902-7d18-4240-a3ae-15f8fa1ab0a4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:09.168523 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd55d902-7d18-4240-a3ae-15f8fa1ab0a4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:09.169618 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd55d902-7d18-4240-a3ae-15f8fa1ab0a4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:09.179025 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd55d902-7d18-4240-a3ae-15f8fa1ab0a4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:09.284236 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-537a7740-5a3e-4d1a-807f-b467bb7806be tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:09.296764 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-537a7740-5a3e-4d1a-807f-b467bb7806be tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:09.305260 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-537a7740-5a3e-4d1a-807f-b467bb7806be tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:09.317427 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-537a7740-5a3e-4d1a-807f-b467bb7806be tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.190444 Jul 31 01:07:09.319700 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 160/337] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:09 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:09.535563 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cd55d902-7d18-4240-a3ae-15f8fa1ab0a4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:09.556657 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ae74f843-3a40-4c8c-a8bc-cb531c290cd3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-481530149", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "3c2be060-a5dd-4923-9ec8-26881bd84082"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:09.558802 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cd55d902-7d18-4240-a3ae-15f8fa1ab0a4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1477 microversion: 2.1 time: 0.418126 Jul 31 01:07:09.559563 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 178/338] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:09 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1477 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:07:09.690563 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-ae74f843-3a40-4c8c-a8bc-cb531c290cd3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] validate_networks() for [('3c2be060-a5dd-4923-9ec8-26881bd84082', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:07:10.128750 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b724a85f-b4f8-4439-aa3f-756719a2e8e4 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:10.129989 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b724a85f-b4f8-4439-aa3f-756719a2e8e4 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:10.143508 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b724a85f-b4f8-4439-aa3f-756719a2e8e4 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:10.144488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b724a85f-b4f8-4439-aa3f-756719a2e8e4 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:10.149413 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b724a85f-b4f8-4439-aa3f-756719a2e8e4 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:10.150172 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b724a85f-b4f8-4439-aa3f-756719a2e8e4 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:10.585889 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b724a85f-b4f8-4439-aa3f-756719a2e8e4 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:10.595893 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b724a85f-b4f8-4439-aa3f-756719a2e8e4 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 200 len: 1319 microversion: 2.1 time: 0.472084 Jul 31 01:07:10.600539 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 179/339] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:10 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 1319 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:07:10.613456 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-738d7aab-d7b1-4a48-bf60-7fb7f3385ac7 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:10.614718 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-738d7aab-d7b1-4a48-bf60-7fb7f3385ac7 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:10.629161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-738d7aab-d7b1-4a48-bf60-7fb7f3385ac7 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:10.632981 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-738d7aab-d7b1-4a48-bf60-7fb7f3385ac7 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:10.634813 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-738d7aab-d7b1-4a48-bf60-7fb7f3385ac7 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:10.635559 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-738d7aab-d7b1-4a48-bf60-7fb7f3385ac7 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:10.738808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ae74f843-3a40-4c8c-a8bc-cb531c290cd3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:07:10.739683 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ae74f843-3a40-4c8c-a8bc-cb531c290cd3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:07:10.740285 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ae74f843-3a40-4c8c-a8bc-cb531c290cd3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:07:10.740946 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ae74f843-3a40-4c8c-a8bc-cb531c290cd3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:07:10.741465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ae74f843-3a40-4c8c-a8bc-cb531c290cd3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:07:10.770133 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae74f843-3a40-4c8c-a8bc-cb531c290cd3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:10.770588 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae74f843-3a40-4c8c-a8bc-cb531c290cd3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:10.771427 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae74f843-3a40-4c8c-a8bc-cb531c290cd3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:10.771872 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae74f843-3a40-4c8c-a8bc-cb531c290cd3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:10.776369 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-738d7aab-d7b1-4a48-bf60-7fb7f3385ac7 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:10.786513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-738d7aab-d7b1-4a48-bf60-7fb7f3385ac7 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:10.788059 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-738d7aab-d7b1-4a48-bf60-7fb7f3385ac7 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:10.804569 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-738d7aab-d7b1-4a48-bf60-7fb7f3385ac7 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.201380 Jul 31 01:07:10.815868 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 180/340] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:10 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:10.827200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-15a3ed95-d421-41e8-a73e-ba897c37ad41 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:10.832084 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-15a3ed95-d421-41e8-a73e-ba897c37ad41 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:10.842480 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-ae74f843-3a40-4c8c-a8bc-cb531c290cd3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Getting quotas for project 5881381d95ec452eb516c0c7ad826a08. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:07:10.847329 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15a3ed95-d421-41e8-a73e-ba897c37ad41 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:10.848020 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15a3ed95-d421-41e8-a73e-ba897c37ad41 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:10.849384 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15a3ed95-d421-41e8-a73e-ba897c37ad41 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:10.851020 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15a3ed95-d421-41e8-a73e-ba897c37ad41 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:10.856992 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-ae74f843-3a40-4c8c-a8bc-cb531c290cd3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Getting quotas for user cd6eb7e316f54ff386eaa598df805de9 and project 5881381d95ec452eb516c0c7ad826a08. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:07:10.881371 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ae74f843-3a40-4c8c-a8bc-cb531c290cd3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:07:10.884024 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ae74f843-3a40-4c8c-a8bc-cb531c290cd3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:07:10.991296 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ae74f843-3a40-4c8c-a8bc-cb531c290cd3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.670135 Jul 31 01:07:10.998905 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 161/341] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:07:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 01:07:11.005090 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8da0f436-a9f7-4cf8-915e-35afc4108e7a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:11.005618 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8da0f436-a9f7-4cf8-915e-35afc4108e7a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:11.223323 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8da0f436-a9f7-4cf8-915e-35afc4108e7a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:11.232437 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8da0f436-a9f7-4cf8-915e-35afc4108e7a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:11.252138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8da0f436-a9f7-4cf8-915e-35afc4108e7a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:11.253341 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-15a3ed95-d421-41e8-a73e-ba897c37ad41 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:11.253865 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8da0f436-a9f7-4cf8-915e-35afc4108e7a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1261 microversion: 2.25 time: 0.253054 Jul 31 01:07:11.254476 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 162/342] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:10 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1261 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:11.282886 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-15a3ed95-d421-41e8-a73e-ba897c37ad41 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1477 microversion: 2.1 time: 0.465159 Jul 31 01:07:11.286964 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 181/343] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:10 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1477 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:11.289670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8da0f436-a9f7-4cf8-915e-35afc4108e7a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:11.290965 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8da0f436-a9f7-4cf8-915e-35afc4108e7a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001642 Jul 31 01:07:11.291609 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 163/344] 10.222.0.45 () {56 vars in 886 bytes} [Sun Jul 31 01:07:11 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 31 01:07:11.622220 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d5145483-b5df-4319-9f35-27e4c61861fa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:11.623256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d5145483-b5df-4319-9f35-27e4c61861fa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:11.639225 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5145483-b5df-4319-9f35-27e4c61861fa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:11.639619 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5145483-b5df-4319-9f35-27e4c61861fa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:11.644656 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5145483-b5df-4319-9f35-27e4c61861fa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:11.647034 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5145483-b5df-4319-9f35-27e4c61861fa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:12.122110 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d5145483-b5df-4319-9f35-27e4c61861fa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:12.134813 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d5145483-b5df-4319-9f35-27e4c61861fa tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 200 len: 1319 microversion: 2.1 time: 0.516959 Jul 31 01:07:12.135412 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 182/345] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:11 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 1319 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:07:12.152230 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-83422ef6-1ac5-4328-8d4f-093461eb661b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:12.153325 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-83422ef6-1ac5-4328-8d4f-093461eb661b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:12.169035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83422ef6-1ac5-4328-8d4f-093461eb661b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:12.172411 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83422ef6-1ac5-4328-8d4f-093461eb661b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:12.174195 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83422ef6-1ac5-4328-8d4f-093461eb661b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:12.176629 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83422ef6-1ac5-4328-8d4f-093461eb661b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:12.347611 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-83422ef6-1ac5-4328-8d4f-093461eb661b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:12.362032 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-83422ef6-1ac5-4328-8d4f-093461eb661b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:12.367528 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-83422ef6-1ac5-4328-8d4f-093461eb661b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:12.378666 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-83422ef6-1ac5-4328-8d4f-093461eb661b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.241397 Jul 31 01:07:12.382917 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 183/346] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:12 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:12.396051 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-476a9060-caff-48fd-95bc-34602bc2c53c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:12.398179 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-476a9060-caff-48fd-95bc-34602bc2c53c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:12.406102 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9d6ec2ac-92e7-434c-8751-d94c5166e13b tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1249423750", "ram": 512, "vcpus": 1, "disk": 10, "id": 461857478, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:12.415105 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-476a9060-caff-48fd-95bc-34602bc2c53c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:12.415436 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:12.415436 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:12.418305 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-476a9060-caff-48fd-95bc-34602bc2c53c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:12.420473 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-476a9060-caff-48fd-95bc-34602bc2c53c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:12.421019 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-476a9060-caff-48fd-95bc-34602bc2c53c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:12.450573 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9d6ec2ac-92e7-434c-8751-d94c5166e13b tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.707702 Jul 31 01:07:12.451724 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 164/347] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:07:11 2022] POST /compute/v2.1/flavors => generated 413 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:07:12.465077 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1571ea24-daea-4ff8-a754-0e4791e0821c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:12.467252 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1571ea24-daea-4ff8-a754-0e4791e0821c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:12.486834 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1571ea24-daea-4ff8-a754-0e4791e0821c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:12.487683 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1571ea24-daea-4ff8-a754-0e4791e0821c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:12.491323 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1571ea24-daea-4ff8-a754-0e4791e0821c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:12.493011 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1571ea24-daea-4ff8-a754-0e4791e0821c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:12.699833 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-476a9060-caff-48fd-95bc-34602bc2c53c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:12.715767 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-476a9060-caff-48fd-95bc-34602bc2c53c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:12.718882 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-476a9060-caff-48fd-95bc-34602bc2c53c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:12.725728 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-476a9060-caff-48fd-95bc-34602bc2c53c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1257 microversion: 2.25 time: 0.338586 Jul 31 01:07:12.726833 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 184/348] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:12 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1257 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:12.734567 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-da623bcf-9743-461d-80e1-09257b370bb8 tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:12.739927 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:12.739927 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:12.805570 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-da623bcf-9743-461d-80e1-09257b370bb8 tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/461857478/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.077378 Jul 31 01:07:12.806537 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 185/349] 10.222.0.45 () {60 vars in 1221 bytes} [Sun Jul 31 01:07:12 2022] POST /compute/v2.1/flavors/461857478/os-extra_specs => generated 66 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:07:12.818056 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-52f0df62-bf8b-41d4-8c29-46fcdfd285b3 req-bac9fcca-d583-4e70-a00e-66b853939d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a44b0a-6c30-4b99-a071-adbc610df74d", "name": "network-vif-plugged", "status": "completed", "tag": "998bd7c0-2efb-4942-b7a7-b7c146e8554b"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:12.873242 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-52f0df62-bf8b-41d4-8c29-46fcdfd285b3 req-bac9fcca-d583-4e70-a00e-66b853939d77 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:12.876075 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-52f0df62-bf8b-41d4-8c29-46fcdfd285b3 req-bac9fcca-d583-4e70-a00e-66b853939d77 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:12.911054 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-52f0df62-bf8b-41d4-8c29-46fcdfd285b3 req-bac9fcca-d583-4e70-a00e-66b853939d77 service nova] Creating event network-vif-plugged:998bd7c0-2efb-4942-b7a7-b7c146e8554b for instance 74a44b0a-6c30-4b99-a071-adbc610df74d on n-h2-master-1 Jul 31 01:07:12.950262 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-52f0df62-bf8b-41d4-8c29-46fcdfd285b3 req-bac9fcca-d583-4e70-a00e-66b853939d77 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141067 Jul 31 01:07:12.952553 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 186/350] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:13.365858 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a453a409-d44e-4751-ad90-d1f64429dd3d tempest-FlavorsExtraSpecsTestJSON-1389220565 tempest-FlavorsExtraSpecsTestJSON-1389220565-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:13.398310 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a453a409-d44e-4751-ad90-d1f64429dd3d tempest-FlavorsExtraSpecsTestJSON-1389220565 tempest-FlavorsExtraSpecsTestJSON-1389220565-project] 10.222.0.45 "GET /compute/v2.1/flavors/461857478/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.444023 Jul 31 01:07:13.402009 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 187/351] 10.222.0.45 () {58 vars in 1200 bytes} [Sun Jul 31 01:07:12 2022] GET /compute/v2.1/flavors/461857478/os-extra_specs => generated 66 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:07:13.415421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-365d4193-9f37-4882-80bc-befc7d8d3118 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:13.416176 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-365d4193-9f37-4882-80bc-befc7d8d3118 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:13.434064 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-365d4193-9f37-4882-80bc-befc7d8d3118 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:13.434518 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-365d4193-9f37-4882-80bc-befc7d8d3118 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:13.435308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-365d4193-9f37-4882-80bc-befc7d8d3118 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:13.435778 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-365d4193-9f37-4882-80bc-befc7d8d3118 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:13.897191 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1571ea24-daea-4ff8-a754-0e4791e0821c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:13.930587 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1571ea24-daea-4ff8-a754-0e4791e0821c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1477 microversion: 2.1 time: 1.477054 Jul 31 01:07:13.944620 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 165/352] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:12 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1477 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:13.961497 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fab9b21d-1a7b-45c0-8856-e0b8cc449e75 tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:13.968893 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:13.968893 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:14.002906 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-365d4193-9f37-4882-80bc-befc7d8d3118 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:14.018553 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-365d4193-9f37-4882-80bc-befc7d8d3118 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 200 len: 1319 microversion: 2.1 time: 0.615012 Jul 31 01:07:14.022515 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 188/353] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:13 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 1319 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:14.033729 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ed9be5cf-513b-4210-bb47-2bb91b26ed00 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:14.038457 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ed9be5cf-513b-4210-bb47-2bb91b26ed00 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:14.050419 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fab9b21d-1a7b-45c0-8856-e0b8cc449e75 tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/461857478/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.104454 Jul 31 01:07:14.051815 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:14.052548 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 166/354] 10.222.0.45 () {60 vars in 1221 bytes} [Sun Jul 31 01:07:13 2022] POST /compute/v2.1/flavors/461857478/os-extra_specs => generated 66 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:07:14.057091 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed9be5cf-513b-4210-bb47-2bb91b26ed00 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:14.058905 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed9be5cf-513b-4210-bb47-2bb91b26ed00 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:14.061889 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed9be5cf-513b-4210-bb47-2bb91b26ed00 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:14.065192 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed9be5cf-513b-4210-bb47-2bb91b26ed00 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:14.066354 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-42dc3a2e-9667-4d38-b218-149e78856f39 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:14.067264 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-42dc3a2e-9667-4d38-b218-149e78856f39 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:14.089912 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42dc3a2e-9667-4d38-b218-149e78856f39 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:14.093215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42dc3a2e-9667-4d38-b218-149e78856f39 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:14.095373 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42dc3a2e-9667-4d38-b218-149e78856f39 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:14.104504 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42dc3a2e-9667-4d38-b218-149e78856f39 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:14.287907 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ed9be5cf-513b-4210-bb47-2bb91b26ed00 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:14.319421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ed9be5cf-513b-4210-bb47-2bb91b26ed00 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:14.325849 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ed9be5cf-513b-4210-bb47-2bb91b26ed00 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:14.340399 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-42dc3a2e-9667-4d38-b218-149e78856f39 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:14.350161 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-42dc3a2e-9667-4d38-b218-149e78856f39 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:14.362911 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-42dc3a2e-9667-4d38-b218-149e78856f39 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:14.364306 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ed9be5cf-513b-4210-bb47-2bb91b26ed00 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.335129 Jul 31 01:07:14.364936 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 189/355] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:14 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:14.372008 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-42dc3a2e-9667-4d38-b218-149e78856f39 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1319 microversion: 2.25 time: 0.312417 Jul 31 01:07:14.372883 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 167/356] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:14 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:14.376863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0893b4bf-6e6c-4b7e-9456-2db1ccd6feb3 tempest-FlavorsExtraSpecsTestJSON-1389220565 tempest-FlavorsExtraSpecsTestJSON-1389220565-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:14.434877 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0893b4bf-6e6c-4b7e-9456-2db1ccd6feb3 tempest-FlavorsExtraSpecsTestJSON-1389220565 tempest-FlavorsExtraSpecsTestJSON-1389220565-project] 10.222.0.45 "GET /compute/v2.1/flavors/461857478/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.065671 Jul 31 01:07:14.445626 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6c183245-7a9b-4e63-8774-9dc21cea3daf tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:14.450933 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:14.450933 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:14.462575 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 190/357] 10.222.0.45 () {58 vars in 1242 bytes} [Sun Jul 31 01:07:14 2022] GET /compute/v2.1/flavors/461857478/os-extra_specs/hw:numa_nodes => generated 22 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:07:14.498731 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6c183245-7a9b-4e63-8774-9dc21cea3daf tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/461857478/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056750 Jul 31 01:07:14.501443 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 168/358] 10.222.0.45 () {60 vars in 1221 bytes} [Sun Jul 31 01:07:14 2022] POST /compute/v2.1/flavors/461857478/os-extra_specs => generated 66 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 31 01:07:14.510798 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bda9f379-aad4-4310-912c-0b0bed3728ad tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:14.524785 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bda9f379-aad4-4310-912c-0b0bed3728ad tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/461857478/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017816 Jul 31 01:07:14.535035 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 191/359] 10.222.0.45 () {58 vars in 1200 bytes} [Sun Jul 31 01:07:14 2022] GET /compute/v2.1/flavors/461857478/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:07:14.541253 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-60f59a33-e6ab-4314-a640-6d58ddee0bd7 tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:14.544000 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:14.544000 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:14.631117 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-60f59a33-e6ab-4314-a640-6d58ddee0bd7 tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] 10.222.0.45 "PUT /compute/v2.1/flavors/461857478/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.094456 Jul 31 01:07:14.635545 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 169/360] 10.222.0.45 () {60 vars in 1262 bytes} [Sun Jul 31 01:07:14 2022] PUT /compute/v2.1/flavors/461857478/os-extra_specs/hw:numa_nodes => generated 22 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 31 01:07:14.646223 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-415fe787-7c56-49f0-a6ea-6ae7b36a2eec tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:14.662626 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-415fe787-7c56-49f0-a6ea-6ae7b36a2eec tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/461857478/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.021517 Jul 31 01:07:14.677216 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ba54fd96-288a-4fea-b20d-24b45a923b04 tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:14.678818 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:14.678818 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:14.681734 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 192/361] 10.222.0.45 () {58 vars in 1200 bytes} [Sun Jul 31 01:07:14 2022] GET /compute/v2.1/flavors/461857478/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:07:14.723353 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ba54fd96-288a-4fea-b20d-24b45a923b04 tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/461857478/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.051101 Jul 31 01:07:14.736470 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-70174179-e199-4d46-ba78-12c14ff30cdd tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:14.738828 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:14.738828 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:14.744334 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 170/362] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:07:14 2022] DELETE /compute/v2.1/flavors/461857478/os-extra_specs/hw:numa_nodes => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:07:14.785919 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-70174179-e199-4d46-ba78-12c14ff30cdd tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/461857478/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.053996 Jul 31 01:07:14.789003 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 193/363] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:07:14 2022] DELETE /compute/v2.1/flavors/461857478/os-extra_specs/hw:cpu_policy => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 31 01:07:14.798106 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c86b6f09-d521-462e-990c-e456ff51b2c2 tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:14.802271 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=5,nova_api:DELETE=4,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:14.813287 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c86b6f09-d521-462e-990c-e456ff51b2c2 tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/461857478/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018459 Jul 31 01:07:14.816108 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 171/364] 10.222.0.45 () {58 vars in 1200 bytes} [Sun Jul 31 01:07:14 2022] GET /compute/v2.1/flavors/461857478/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:07:14.826779 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ca60ad5a-e84b-4c0f-b071-1e147408679a tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:14.827803 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:14.827803 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:14.864570 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ca60ad5a-e84b-4c0f-b071-1e147408679a tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/461857478" status: 202 len: 0 microversion: 2.1 time: 0.041974 Jul 31 01:07:14.866114 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 194/365] 10.222.0.45 () {58 vars in 1158 bytes} [Sun Jul 31 01:07:14 2022] DELETE /compute/v2.1/flavors/461857478 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:07:14.876112 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c5692603-bb39-4057-9502-9170e39a4006 tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:14.932497 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c5692603-bb39-4057-9502-9170e39a4006 tempest-FlavorsExtraSpecsTestJSON-1794537770 tempest-FlavorsExtraSpecsTestJSON-1794537770-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.062218 Jul 31 01:07:14.934156 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 172/366] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:07:14 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:14.959282 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ffa107cd-3203-411c-b619-55e9881ca5c1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:14.960313 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ffa107cd-3203-411c-b619-55e9881ca5c1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:14.970343 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ffa107cd-3203-411c-b619-55e9881ca5c1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:14.974806 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ffa107cd-3203-411c-b619-55e9881ca5c1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:14.975997 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ffa107cd-3203-411c-b619-55e9881ca5c1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:14.977765 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ffa107cd-3203-411c-b619-55e9881ca5c1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:14.989016 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:15.042389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3addd18-d9d7-46ab-b3b5-f2cf6cd07baf tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:15.043065 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3addd18-d9d7-46ab-b3b5-f2cf6cd07baf tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:15.065612 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3addd18-d9d7-46ab-b3b5-f2cf6cd07baf tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:15.067939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3addd18-d9d7-46ab-b3b5-f2cf6cd07baf tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:15.069063 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3addd18-d9d7-46ab-b3b5-f2cf6cd07baf tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:15.071071 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3addd18-d9d7-46ab-b3b5-f2cf6cd07baf tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:15.624913 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3addd18-d9d7-46ab-b3b5-f2cf6cd07baf tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:15.639090 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3addd18-d9d7-46ab-b3b5-f2cf6cd07baf tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 200 len: 1469 microversion: 2.1 time: 0.596388 Jul 31 01:07:15.643234 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 173/367] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:15 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 1469 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:15.660127 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e1e7b15f-8b45-4543-ae2e-1dd3c7c6fa36 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:15.661086 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e1e7b15f-8b45-4543-ae2e-1dd3c7c6fa36 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:15.669517 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1e7b15f-8b45-4543-ae2e-1dd3c7c6fa36 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:15.673575 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1e7b15f-8b45-4543-ae2e-1dd3c7c6fa36 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:15.679572 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1e7b15f-8b45-4543-ae2e-1dd3c7c6fa36 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:15.680497 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1e7b15f-8b45-4543-ae2e-1dd3c7c6fa36 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:15.726596 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ffa107cd-3203-411c-b619-55e9881ca5c1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:15.738683 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ffa107cd-3203-411c-b619-55e9881ca5c1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1477 microversion: 2.1 time: 0.784488 Jul 31 01:07:15.755638 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 195/368] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:14 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1477 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:15.764823 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b6f60f3b-019a-465c-9639-031b256c3d8b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:15.765478 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b6f60f3b-019a-465c-9639-031b256c3d8b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:15.772762 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6f60f3b-019a-465c-9639-031b256c3d8b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:15.773138 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6f60f3b-019a-465c-9639-031b256c3d8b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:15.774250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6f60f3b-019a-465c-9639-031b256c3d8b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:15.774907 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6f60f3b-019a-465c-9639-031b256c3d8b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:15.928383 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e1e7b15f-8b45-4543-ae2e-1dd3c7c6fa36 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:15.938809 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e1e7b15f-8b45-4543-ae2e-1dd3c7c6fa36 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:15.940798 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e1e7b15f-8b45-4543-ae2e-1dd3c7c6fa36 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:15.947746 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e1e7b15f-8b45-4543-ae2e-1dd3c7c6fa36 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.301980 Jul 31 01:07:15.947746 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 174/369] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:15 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:15.964933 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ec662cd8-50b7-448c-99bf-cb77b2f7a438 tempest-DeleteServersAdminTestJSON-970395564 tempest-DeleteServersAdminTestJSON-970395564-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:15.984733 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ec662cd8-50b7-448c-99bf-cb77b2f7a438 tempest-DeleteServersAdminTestJSON-970395564 tempest-DeleteServersAdminTestJSON-970395564-project-admin] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:15.992452 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec662cd8-50b7-448c-99bf-cb77b2f7a438 tempest-DeleteServersAdminTestJSON-970395564 tempest-DeleteServersAdminTestJSON-970395564-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:15.993807 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec662cd8-50b7-448c-99bf-cb77b2f7a438 tempest-DeleteServersAdminTestJSON-970395564 tempest-DeleteServersAdminTestJSON-970395564-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:15.998946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec662cd8-50b7-448c-99bf-cb77b2f7a438 tempest-DeleteServersAdminTestJSON-970395564 tempest-DeleteServersAdminTestJSON-970395564-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:16.000134 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec662cd8-50b7-448c-99bf-cb77b2f7a438 tempest-DeleteServersAdminTestJSON-970395564 tempest-DeleteServersAdminTestJSON-970395564-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:16.004543 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:16.025917 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b6f60f3b-019a-465c-9639-031b256c3d8b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:16.049252 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b6f60f3b-019a-465c-9639-031b256c3d8b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:16.052559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b6f60f3b-019a-465c-9639-031b256c3d8b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:16.062544 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b6f60f3b-019a-465c-9639-031b256c3d8b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1319 microversion: 2.25 time: 0.303563 Jul 31 01:07:16.066419 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 196/370] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:15 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:16.169617 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ec662cd8-50b7-448c-99bf-cb77b2f7a438 tempest-DeleteServersAdminTestJSON-970395564 tempest-DeleteServersAdminTestJSON-970395564-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d/action" status: 202 len: 0 microversion: 2.1 time: 0.220767 Jul 31 01:07:16.173170 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 175/371] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:07:15 2022] POST /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:07:16.179185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cbea4e02-c7bf-4815-8491-10f55428e817 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:16.179851 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cbea4e02-c7bf-4815-8491-10f55428e817 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:16.193831 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbea4e02-c7bf-4815-8491-10f55428e817 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:16.194290 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbea4e02-c7bf-4815-8491-10f55428e817 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:16.195087 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbea4e02-c7bf-4815-8491-10f55428e817 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:16.202950 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbea4e02-c7bf-4815-8491-10f55428e817 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:16.293557 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbea4e02-c7bf-4815-8491-10f55428e817 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:16.294960 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbea4e02-c7bf-4815-8491-10f55428e817 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:16.295630 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-cbea4e02-c7bf-4815-8491-10f55428e817 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lazy-loading 'fault' on Instance uuid 74a44b0a-6c30-4b99-a071-adbc610df74d {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:16.734856 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cbea4e02-c7bf-4815-8491-10f55428e817 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:16.761400 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cbea4e02-c7bf-4815-8491-10f55428e817 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 200 len: 1452 microversion: 2.1 time: 0.578150 Jul 31 01:07:16.766012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cff2b341-1831-48f8-826a-bd97b3e1b8cd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:16.767618 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cff2b341-1831-48f8-826a-bd97b3e1b8cd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:16.778911 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 197/372] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:16 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 1452 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:16.780213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cff2b341-1831-48f8-826a-bd97b3e1b8cd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:16.781031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cff2b341-1831-48f8-826a-bd97b3e1b8cd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:16.786473 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cff2b341-1831-48f8-826a-bd97b3e1b8cd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:16.787424 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a600d275-caf4-4a5c-9241-b6a92c89d541 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:16.788118 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cff2b341-1831-48f8-826a-bd97b3e1b8cd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:16.793781 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a600d275-caf4-4a5c-9241-b6a92c89d541 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:16.814502 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a600d275-caf4-4a5c-9241-b6a92c89d541 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:16.820728 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a600d275-caf4-4a5c-9241-b6a92c89d541 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:16.825348 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a600d275-caf4-4a5c-9241-b6a92c89d541 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:16.827744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a600d275-caf4-4a5c-9241-b6a92c89d541 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:16.912123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a600d275-caf4-4a5c-9241-b6a92c89d541 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:07:17.112927 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a600d275-caf4-4a5c-9241-b6a92c89d541 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "DELETE /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 204 len: 0 microversion: 2.1 time: 0.328987 Jul 31 01:07:17.119242 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 198/373] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:07:16 2022] DELETE /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:07:17.127146 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c12dbad8-5829-4ed6-ad7e-c280dce74d11 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:17.127944 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c12dbad8-5829-4ed6-ad7e-c280dce74d11 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:17.137027 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c12dbad8-5829-4ed6-ad7e-c280dce74d11 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:17.137480 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c12dbad8-5829-4ed6-ad7e-c280dce74d11 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:17.138259 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c12dbad8-5829-4ed6-ad7e-c280dce74d11 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:17.138698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c12dbad8-5829-4ed6-ad7e-c280dce74d11 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:17.214180 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cff2b341-1831-48f8-826a-bd97b3e1b8cd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:17.229022 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cff2b341-1831-48f8-826a-bd97b3e1b8cd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1477 microversion: 2.1 time: 0.466531 Jul 31 01:07:17.231066 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 176/374] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:16 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1477 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:17.238434 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-92e52980-5411-4dfb-a1e5-a360a90a36b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:17.239539 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-92e52980-5411-4dfb-a1e5-a360a90a36b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:17.250706 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92e52980-5411-4dfb-a1e5-a360a90a36b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:17.251409 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92e52980-5411-4dfb-a1e5-a360a90a36b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:17.252471 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92e52980-5411-4dfb-a1e5-a360a90a36b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:17.253083 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92e52980-5411-4dfb-a1e5-a360a90a36b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:17.264819 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c12dbad8-5829-4ed6-ad7e-c280dce74d11 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:17.288561 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c12dbad8-5829-4ed6-ad7e-c280dce74d11 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:17.290432 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c12dbad8-5829-4ed6-ad7e-c280dce74d11 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:17.303994 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c12dbad8-5829-4ed6-ad7e-c280dce74d11 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.185575 Jul 31 01:07:17.319372 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 199/375] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:17 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:17.319372 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4356438b-fbe6-4715-b224-703ccb7bf858 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:17.319372 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4356438b-fbe6-4715-b224-703ccb7bf858 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:17.333248 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4356438b-fbe6-4715-b224-703ccb7bf858 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:17.333938 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4356438b-fbe6-4715-b224-703ccb7bf858 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:17.337563 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4356438b-fbe6-4715-b224-703ccb7bf858 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:17.338397 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4356438b-fbe6-4715-b224-703ccb7bf858 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:17.392856 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4356438b-fbe6-4715-b224-703ccb7bf858 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:17.393916 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4356438b-fbe6-4715-b224-703ccb7bf858 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:17.394394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-4356438b-fbe6-4715-b224-703ccb7bf858 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lazy-loading 'fault' on Instance uuid 74a44b0a-6c30-4b99-a071-adbc610df74d {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:17.717254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4356438b-fbe6-4715-b224-703ccb7bf858 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:17.723609 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-92e52980-5411-4dfb-a1e5-a360a90a36b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:17.729013 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4356438b-fbe6-4715-b224-703ccb7bf858 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 200 len: 1458 microversion: 2.1 time: 0.421101 Jul 31 01:07:17.742836 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 200/376] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:17 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 1458 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:17.744255 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-92e52980-5411-4dfb-a1e5-a360a90a36b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:17.748797 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-92e52980-5411-4dfb-a1e5-a360a90a36b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:17.752842 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-92e52980-5411-4dfb-a1e5-a360a90a36b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1361 microversion: 2.25 time: 0.519322 Jul 31 01:07:17.754036 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 177/377] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:17 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1361 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:18.153885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1ab10b4b-69ea-446f-8d94-d9b38b03f5d4 req-1d0ec6d8-8a48-4141-b0aa-737070da95c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2", "tag": "79b2e09a-8171-4f0d-adc4-3e2dbf769ce6"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:18.175509 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1ab10b4b-69ea-446f-8d94-d9b38b03f5d4 req-1d0ec6d8-8a48-4141-b0aa-737070da95c3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:18.175966 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1ab10b4b-69ea-446f-8d94-d9b38b03f5d4 req-1d0ec6d8-8a48-4141-b0aa-737070da95c3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:18.200554 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1ab10b4b-69ea-446f-8d94-d9b38b03f5d4 req-1d0ec6d8-8a48-4141-b0aa-737070da95c3 service nova] Creating event network-changed:79b2e09a-8171-4f0d-adc4-3e2dbf769ce6 for instance 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 on n-h1-master-1 Jul 31 01:07:18.209356 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1ab10b4b-69ea-446f-8d94-d9b38b03f5d4 req-1d0ec6d8-8a48-4141-b0aa-737070da95c3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058949 Jul 31 01:07:18.209991 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 201/378] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:18.252611 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ae1ba09-d51b-46c7-b50c-5ad1143db638 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:18.253136 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4ae1ba09-d51b-46c7-b50c-5ad1143db638 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:18.270991 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ae1ba09-d51b-46c7-b50c-5ad1143db638 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:18.271482 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ae1ba09-d51b-46c7-b50c-5ad1143db638 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:18.272291 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ae1ba09-d51b-46c7-b50c-5ad1143db638 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:18.272743 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ae1ba09-d51b-46c7-b50c-5ad1143db638 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:18.338147 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-610bce6f-a80a-4082-beee-bc5302a39164 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:18.338866 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-610bce6f-a80a-4082-beee-bc5302a39164 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:18.353762 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-610bce6f-a80a-4082-beee-bc5302a39164 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:18.354233 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-610bce6f-a80a-4082-beee-bc5302a39164 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:18.355039 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-610bce6f-a80a-4082-beee-bc5302a39164 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:18.355518 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-610bce6f-a80a-4082-beee-bc5302a39164 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:18.568154 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-610bce6f-a80a-4082-beee-bc5302a39164 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:18.580024 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-610bce6f-a80a-4082-beee-bc5302a39164 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:18.585885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-610bce6f-a80a-4082-beee-bc5302a39164 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:18.601648 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-610bce6f-a80a-4082-beee-bc5302a39164 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.273461 Jul 31 01:07:18.602247 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 202/379] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:18 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:07:18.648622 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4ae1ba09-d51b-46c7-b50c-5ad1143db638 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:18.660785 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4ae1ba09-d51b-46c7-b50c-5ad1143db638 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1477 microversion: 2.1 time: 0.412547 Jul 31 01:07:18.666036 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 178/380] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:18 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1477 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:18.750713 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1e22e84f-f1ba-4bd8-b02e-ee835168dd28 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:18.751650 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1e22e84f-f1ba-4bd8-b02e-ee835168dd28 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:18.764090 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e22e84f-f1ba-4bd8-b02e-ee835168dd28 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:18.764533 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e22e84f-f1ba-4bd8-b02e-ee835168dd28 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:18.765325 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e22e84f-f1ba-4bd8-b02e-ee835168dd28 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:18.765766 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e22e84f-f1ba-4bd8-b02e-ee835168dd28 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:18.777291 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-605fc18f-5864-405a-85fa-cd0c806307d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:18.778838 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-605fc18f-5864-405a-85fa-cd0c806307d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:18.788987 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-605fc18f-5864-405a-85fa-cd0c806307d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:18.790629 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-605fc18f-5864-405a-85fa-cd0c806307d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:18.792716 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-605fc18f-5864-405a-85fa-cd0c806307d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:18.793372 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-605fc18f-5864-405a-85fa-cd0c806307d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:18.848810 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e22e84f-f1ba-4bd8-b02e-ee835168dd28 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:18.849257 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e22e84f-f1ba-4bd8-b02e-ee835168dd28 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:18.855670 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-1e22e84f-f1ba-4bd8-b02e-ee835168dd28 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lazy-loading 'fault' on Instance uuid 74a44b0a-6c30-4b99-a071-adbc610df74d {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:19.100380 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-605fc18f-5864-405a-85fa-cd0c806307d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:19.110622 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-605fc18f-5864-405a-85fa-cd0c806307d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:19.117607 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-605fc18f-5864-405a-85fa-cd0c806307d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:19.118785 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-605fc18f-5864-405a-85fa-cd0c806307d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1361 microversion: 2.25 time: 0.345693 Jul 31 01:07:19.121682 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 179/381] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:18 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1361 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:19.289086 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1e22e84f-f1ba-4bd8-b02e-ee835168dd28 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:19.299373 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1e22e84f-f1ba-4bd8-b02e-ee835168dd28 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 200 len: 1458 microversion: 2.1 time: 0.553113 Jul 31 01:07:19.303954 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 203/382] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:18 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 1458 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:19.635879 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-878c64b0-36c1-4ecc-9b22-cb93a050e42e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:19.636856 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-878c64b0-36c1-4ecc-9b22-cb93a050e42e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:19.650753 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-878c64b0-36c1-4ecc-9b22-cb93a050e42e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:19.653370 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-878c64b0-36c1-4ecc-9b22-cb93a050e42e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:19.656449 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-878c64b0-36c1-4ecc-9b22-cb93a050e42e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:19.657658 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-878c64b0-36c1-4ecc-9b22-cb93a050e42e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:19.785058 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-878c64b0-36c1-4ecc-9b22-cb93a050e42e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:19.799786 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-878c64b0-36c1-4ecc-9b22-cb93a050e42e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:19.804922 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-878c64b0-36c1-4ecc-9b22-cb93a050e42e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:19.818349 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-878c64b0-36c1-4ecc-9b22-cb93a050e42e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.188668 Jul 31 01:07:19.822200 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 204/383] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:19 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:19.841215 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e97e2574-621f-4a01-bcb3-638d61d493d4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:19.842865 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e97e2574-621f-4a01-bcb3-638d61d493d4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:19.861002 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e97e2574-621f-4a01-bcb3-638d61d493d4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:19.861472 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e97e2574-621f-4a01-bcb3-638d61d493d4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:19.862270 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e97e2574-621f-4a01-bcb3-638d61d493d4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:19.865819 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e97e2574-621f-4a01-bcb3-638d61d493d4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.041640 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8b9816d6-310f-4786-a0e3-b951795db6e1 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Calling method '.version_select at 0x7fede5fde550>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:20.042433 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:20.042433 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:20.044842 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b9816d6-310f-4786-a0e3-b951795db6e1 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.045318 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b9816d6-310f-4786-a0e3-b951795db6e1 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.085090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b9816d6-310f-4786-a0e3-b951795db6e1 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.093339 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b9816d6-310f-4786-a0e3-b951795db6e1 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.117511 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b9816d6-310f-4786-a0e3-b951795db6e1 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.118207 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b9816d6-310f-4786-a0e3-b951795db6e1 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.124988 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8b9816d6-310f-4786-a0e3-b951795db6e1 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.560374 Jul 31 01:07:20.134096 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 180/384] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:07:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:20.139000 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8c295d89-d298-480b-b193-49d1ca1471a2 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Calling method '.version_select at 0x7fede5f581f0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:20.144991 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e97e2574-621f-4a01-bcb3-638d61d493d4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:20.145845 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:20.145845 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:20.148584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c295d89-d298-480b-b193-49d1ca1471a2 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.154460 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c295d89-d298-480b-b193-49d1ca1471a2 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.155063 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e97e2574-621f-4a01-bcb3-638d61d493d4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1477 microversion: 2.1 time: 0.330574 Jul 31 01:07:20.156657 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 205/385] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:19 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1477 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:20.163947 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-538c44d6-12be-4d9c-95fe-890825935f27 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:20.164574 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-538c44d6-12be-4d9c-95fe-890825935f27 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:20.171750 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-538c44d6-12be-4d9c-95fe-890825935f27 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.172202 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-538c44d6-12be-4d9c-95fe-890825935f27 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.173957 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-538c44d6-12be-4d9c-95fe-890825935f27 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.174404 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-538c44d6-12be-4d9c-95fe-890825935f27 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.194410 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c295d89-d298-480b-b193-49d1ca1471a2 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.194865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c295d89-d298-480b-b193-49d1ca1471a2 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.225784 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c295d89-d298-480b-b193-49d1ca1471a2 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.226371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c295d89-d298-480b-b193-49d1ca1471a2 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.241422 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8c295d89-d298-480b-b193-49d1ca1471a2 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.105895 Jul 31 01:07:20.242160 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 181/386] 10.222.0.45 () {58 vars in 1167 bytes} [Sun Jul 31 01:07:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:20.258458 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-01f94271-f359-40ef-9b0e-36d8aec0e68c tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Calling method '.version_select at 0x7fede5f58040>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:20.259607 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:20.259607 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:20.261065 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01f94271-f359-40ef-9b0e-36d8aec0e68c tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.261740 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01f94271-f359-40ef-9b0e-36d8aec0e68c tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.277875 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01f94271-f359-40ef-9b0e-36d8aec0e68c tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.278601 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01f94271-f359-40ef-9b0e-36d8aec0e68c tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.296520 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01f94271-f359-40ef-9b0e-36d8aec0e68c tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.297237 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01f94271-f359-40ef-9b0e-36d8aec0e68c tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.305140 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-01f94271-f359-40ef-9b0e-36d8aec0e68c tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050273 Jul 31 01:07:20.311983 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 182/387] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:07:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:07:20.317191 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0949ec6d-5537-4594-a847-219eca846392 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Calling method '.version_select at 0x7fede615bc10>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:20.318251 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:20.318251 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:20.330951 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0949ec6d-5537-4594-a847-219eca846392 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.332999 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0949ec6d-5537-4594-a847-219eca846392 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.359209 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0949ec6d-5537-4594-a847-219eca846392 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.359986 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0949ec6d-5537-4594-a847-219eca846392 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.386886 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0949ec6d-5537-4594-a847-219eca846392 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.073466 Jul 31 01:07:20.401081 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 183/388] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:07:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:20.408659 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-28d16a56-0ee3-4867-b706-8a73b3eb55d8 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:20.410079 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-28d16a56-0ee3-4867-b706-8a73b3eb55d8 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:20.424424 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28d16a56-0ee3-4867-b706-8a73b3eb55d8 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.426098 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28d16a56-0ee3-4867-b706-8a73b3eb55d8 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.431630 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28d16a56-0ee3-4867-b706-8a73b3eb55d8 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.432306 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28d16a56-0ee3-4867-b706-8a73b3eb55d8 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.503378 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28d16a56-0ee3-4867-b706-8a73b3eb55d8 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.504064 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28d16a56-0ee3-4867-b706-8a73b3eb55d8 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.504709 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-28d16a56-0ee3-4867-b706-8a73b3eb55d8 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lazy-loading 'fault' on Instance uuid 74a44b0a-6c30-4b99-a071-adbc610df74d {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:20.628977 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-28d16a56-0ee3-4867-b706-8a73b3eb55d8 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1994d455dd3e4143a14ab7f856929080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5d344212642b29dbc39c58f8895f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:20.643118 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-28d16a56-0ee3-4867-b706-8a73b3eb55d8 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 200 len: 1416 microversion: 2.1 time: 0.240145 Jul 31 01:07:20.643775 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 184/389] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:20 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 1416 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:20.673806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-106d65fb-a01b-4878-8314-763b9fab10f5 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Calling method '.version_select at 0x7fede5f1d8b0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:20.676480 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:20.676480 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:20.689577 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-106d65fb-a01b-4878-8314-763b9fab10f5 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.690039 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-106d65fb-a01b-4878-8314-763b9fab10f5 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.814546 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:20.826517 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-106d65fb-a01b-4878-8314-763b9fab10f5 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.173834 Jul 31 01:07:20.853943 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 185/390] 10.222.0.45 () {58 vars in 1179 bytes} [Sun Jul 31 01:07:20 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:20.870785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-594fbf69-6229-4ee1-ba7f-0b700568c702 req-438b1f28-2e77-475c-a0f6-db64c7ef1bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a44b0a-6c30-4b99-a071-adbc610df74d", "name": "network-vif-deleted", "tag": "998bd7c0-2efb-4942-b7a7-b7c146e8554b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:20.899508 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-594fbf69-6229-4ee1-ba7f-0b700568c702 req-438b1f28-2e77-475c-a0f6-db64c7ef1bc8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:20.901795 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-594fbf69-6229-4ee1-ba7f-0b700568c702 req-438b1f28-2e77-475c-a0f6-db64c7ef1bc8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:20.950109 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-594fbf69-6229-4ee1-ba7f-0b700568c702 req-438b1f28-2e77-475c-a0f6-db64c7ef1bc8 service nova] Creating event network-vif-deleted:998bd7c0-2efb-4942-b7a7-b7c146e8554b for instance 74a44b0a-6c30-4b99-a071-adbc610df74d on n-h2-master-1 Jul 31 01:07:20.964127 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-594fbf69-6229-4ee1-ba7f-0b700568c702 req-438b1f28-2e77-475c-a0f6-db64c7ef1bc8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105419 Jul 31 01:07:20.969097 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 186/391] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:20.984726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bdfbd868-7e52-4477-89a6-4d3cf466898f tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:20.985979 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bdfbd868-7e52-4477-89a6-4d3cf466898f tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:21.011405 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdfbd868-7e52-4477-89a6-4d3cf466898f tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:21.013129 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdfbd868-7e52-4477-89a6-4d3cf466898f tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:21.014002 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdfbd868-7e52-4477-89a6-4d3cf466898f tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:21.014449 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdfbd868-7e52-4477-89a6-4d3cf466898f tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:21.229234 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:21.281686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-538c44d6-12be-4d9c-95fe-890825935f27 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:21.293916 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-538c44d6-12be-4d9c-95fe-890825935f27 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:21.306224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-538c44d6-12be-4d9c-95fe-890825935f27 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:21.307914 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-538c44d6-12be-4d9c-95fe-890825935f27 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1361 microversion: 2.25 time: 1.149894 Jul 31 01:07:21.308842 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 206/392] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:20 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1361 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:21.314536 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ce0454aa-7338-4116-bcf2-d2e4e75bdaa8 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Calling method '.version_select at 0x7fede5e0f9d0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:21.317657 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:21.317657 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:21.319174 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce0454aa-7338-4116-bcf2-d2e4e75bdaa8 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:21.319809 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce0454aa-7338-4116-bcf2-d2e4e75bdaa8 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:21.349289 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce0454aa-7338-4116-bcf2-d2e4e75bdaa8 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:21.350050 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce0454aa-7338-4116-bcf2-d2e4e75bdaa8 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:21.366684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bdfbd868-7e52-4477-89a6-4d3cf466898f tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:21.380356 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce0454aa-7338-4116-bcf2-d2e4e75bdaa8 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:21.380897 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bdfbd868-7e52-4477-89a6-4d3cf466898f tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:21.381033 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce0454aa-7338-4116-bcf2-d2e4e75bdaa8 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:21.384855 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bdfbd868-7e52-4477-89a6-4d3cf466898f tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:21.388439 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ce0454aa-7338-4116-bcf2-d2e4e75bdaa8 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.078214 Jul 31 01:07:21.389382 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 207/393] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:07:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:21.395420 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d456fac4-cdbf-431f-90cf-65f3ea1365bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:21.396258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d456fac4-cdbf-431f-90cf-65f3ea1365bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:21.398503 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bdfbd868-7e52-4477-89a6-4d3cf466898f tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.427723 Jul 31 01:07:21.403162 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d456fac4-cdbf-431f-90cf-65f3ea1365bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:21.403871 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d456fac4-cdbf-431f-90cf-65f3ea1365bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:21.404831 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d456fac4-cdbf-431f-90cf-65f3ea1365bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:21.405640 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d456fac4-cdbf-431f-90cf-65f3ea1365bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:21.413087 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 187/394] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:20 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:21.430291 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-678a8a61-c35f-4a9f-8927-cf6fe6e34f72 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Calling method '.version_select at 0x7fede5f670d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:21.436101 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:21.436101 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:21.437812 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-678a8a61-c35f-4a9f-8927-cf6fe6e34f72 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:21.439380 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-678a8a61-c35f-4a9f-8927-cf6fe6e34f72 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:21.468017 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-678a8a61-c35f-4a9f-8927-cf6fe6e34f72 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:21.468483 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-678a8a61-c35f-4a9f-8927-cf6fe6e34f72 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:21.483494 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-678a8a61-c35f-4a9f-8927-cf6fe6e34f72 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.065647 Jul 31 01:07:21.484781 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 188/395] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:07:21 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:21.504103 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-397c6f90-1e50-4794-9ee0-ef9f6a9499a5 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Calling method '.version_select at 0x7fede61254c0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:21.506089 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:21.506089 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:21.511172 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-397c6f90-1e50-4794-9ee0-ef9f6a9499a5 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:21.514267 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-397c6f90-1e50-4794-9ee0-ef9f6a9499a5 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:21.592570 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-397c6f90-1e50-4794-9ee0-ef9f6a9499a5 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:21.593166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-397c6f90-1e50-4794-9ee0-ef9f6a9499a5 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:21.613810 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-397c6f90-1e50-4794-9ee0-ef9f6a9499a5 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.118432 Jul 31 01:07:21.614423 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 189/396] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:07:21 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:07:21.636980 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5548104a-690a-46c7-8cff-711ad20402e2 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Calling method '.version_select at 0x7fede5f67820>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:21.639549 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:21.639549 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:21.641273 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5548104a-690a-46c7-8cff-711ad20402e2 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:21.642589 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5548104a-690a-46c7-8cff-711ad20402e2 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:21.689166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5548104a-690a-46c7-8cff-711ad20402e2 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:21.689625 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5548104a-690a-46c7-8cff-711ad20402e2 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:21.707407 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5548104a-690a-46c7-8cff-711ad20402e2 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:21.708307 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5548104a-690a-46c7-8cff-711ad20402e2 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:21.739908 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5548104a-690a-46c7-8cff-711ad20402e2 tempest-HypervisorAdminTestJSON-1498035507 tempest-HypervisorAdminTestJSON-1498035507-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.109189 Jul 31 01:07:21.740806 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 190/397] 10.222.0.45 () {58 vars in 1173 bytes} [Sun Jul 31 01:07:21 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:21.764295 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-94e4f7b5-1730-494d-b2d6-1e5ce8b92521 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:21.765087 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-94e4f7b5-1730-494d-b2d6-1e5ce8b92521 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:21.774720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-94e4f7b5-1730-494d-b2d6-1e5ce8b92521 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:21.775193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-94e4f7b5-1730-494d-b2d6-1e5ce8b92521 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:21.776254 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-94e4f7b5-1730-494d-b2d6-1e5ce8b92521 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:21.776503 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-94e4f7b5-1730-494d-b2d6-1e5ce8b92521 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:21.817246 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-94e4f7b5-1730-494d-b2d6-1e5ce8b92521 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] HTTP exception thrown: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-94e4f7b5-1730-494d-b2d6-1e5ce8b92521 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Request method failure captured: Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d HTTP/1.1 Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWDtZ4dVDAxc4a82pIiBYzrX2WvfIKqnTlbBy50cIrMtLG3LhojWo-7hnBeHzS-aOSM1QPbc0kRay_5qMSbirXMDFkc5Gh92gylZBD_52df32W2e7mKCc1VoL9erv_KiFm2cKAWFCRA_Rr_zffUwJY3_9Ca4WfcLsXhoU4mOl19eIs Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 00d5d344212642b29dbc39c58f8895f3 Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:07:21.818941 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:07:21.820479 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_00d5d344212642b29dbc39c58f8895f3", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:21.820479 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:07:21.820479 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 00d5d344212642b29dbc39c58f8895f3 Jul 31 01:07:21.820479 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:07:21.820479 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-DeleteServersAdminTestJSON-1609993599-project Jul 31 01:07:21.820479 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:07:21.820479 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:07:21.820479 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 1994d455dd3e4143a14ab7f856929080 Jul 31 01:07:21.820479 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-DeleteServersAdminTestJSON-1609993599-project Jul 31 01:07:21.820479 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:07:21.820479 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. Jul 31 01:07:21.820479 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '74a44b0a-6c30-4b99-a071-adbc610df74d'} Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:21.821277 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. Jul 31 01:07:21.822624 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:21.823831 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-94e4f7b5-1730-494d-b2d6-1e5ce8b92521 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Returning 404 to user: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:21.823831 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-94e4f7b5-1730-494d-b2d6-1e5ce8b92521 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 404 len: 111 microversion: 2.1 time: 0.064927 Jul 31 01:07:21.823831 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 191/398] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:21 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:22.139318 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-89a88fff-e6af-4dd5-87e2-1efa9d58afb8 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Calling method '.version_select at 0x7fede5e559d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:22.144285 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:22.144285 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:22.148980 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89a88fff-e6af-4dd5-87e2-1efa9d58afb8 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.149711 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89a88fff-e6af-4dd5-87e2-1efa9d58afb8 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.150708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89a88fff-e6af-4dd5-87e2-1efa9d58afb8 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.151310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89a88fff-e6af-4dd5-87e2-1efa9d58afb8 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.197722 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-89a88fff-e6af-4dd5-87e2-1efa9d58afb8 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.375678 Jul 31 01:07:22.201000 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 192/399] 10.222.0.45 () {58 vars in 1128 bytes} [Sun Jul 31 01:07:21 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:22.208085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-33d4b3bb-5d1f-47a4-85ae-8b10dae91f73 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:22.209067 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-33d4b3bb-5d1f-47a4-85ae-8b10dae91f73 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:22.218311 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33d4b3bb-5d1f-47a4-85ae-8b10dae91f73 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.218957 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33d4b3bb-5d1f-47a4-85ae-8b10dae91f73 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.220591 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33d4b3bb-5d1f-47a4-85ae-8b10dae91f73 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.221195 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33d4b3bb-5d1f-47a4-85ae-8b10dae91f73 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.243180 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-33d4b3bb-5d1f-47a4-85ae-8b10dae91f73 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] HTTP exception thrown: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-33d4b3bb-5d1f-47a4-85ae-8b10dae91f73 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Request method failure captured: Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d HTTP/1.1 Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWDtZ4dVDAxc4a82pIiBYzrX2WvfIKqnTlbBy50cIrMtLG3LhojWo-7hnBeHzS-aOSM1QPbc0kRay_5qMSbirXMDFkc5Gh92gylZBD_52df32W2e7mKCc1VoL9erv_KiFm2cKAWFCRA_Rr_zffUwJY3_9Ca4WfcLsXhoU4mOl19eIs Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 00d5d344212642b29dbc39c58f8895f3 Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:07:22.244807 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:07:22.245980 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_00d5d344212642b29dbc39c58f8895f3", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:22.245980 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:07:22.245980 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 00d5d344212642b29dbc39c58f8895f3 Jul 31 01:07:22.245980 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:07:22.245980 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-DeleteServersAdminTestJSON-1609993599-project Jul 31 01:07:22.245980 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:07:22.245980 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:07:22.245980 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 1994d455dd3e4143a14ab7f856929080 Jul 31 01:07:22.245980 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-DeleteServersAdminTestJSON-1609993599-project Jul 31 01:07:22.245980 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:07:22.245980 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. Jul 31 01:07:22.245980 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '74a44b0a-6c30-4b99-a071-adbc610df74d'} Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:22.246630 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. Jul 31 01:07:22.247714 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.248841 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-33d4b3bb-5d1f-47a4-85ae-8b10dae91f73 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Returning 404 to user: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:22.248841 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-33d4b3bb-5d1f-47a4-85ae-8b10dae91f73 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "DELETE /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 404 len: 111 microversion: 2.1 time: 0.044069 Jul 31 01:07:22.261121 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 193/400] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:07:22 2022] DELETE /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:22.272497 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d456fac4-cdbf-431f-90cf-65f3ea1365bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:22.286746 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d456fac4-cdbf-431f-90cf-65f3ea1365bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1477 microversion: 2.1 time: 0.896010 Jul 31 01:07:22.301174 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 208/401] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:21 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1477 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:22.305925 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0877228d-e055-4e15-8aa6-396304500ce8 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Calling method '.version_select at 0x7fede5e55dc0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:22.312270 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e73da5a8-f2dc-420f-9506-228e11908ed1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:22.313238 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e73da5a8-f2dc-420f-9506-228e11908ed1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: 74a44b0a-6c30-4b99-a071-adbc610df74d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:22.314654 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:22.314654 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:22.317923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0877228d-e055-4e15-8aa6-396304500ce8 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.320475 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e73da5a8-f2dc-420f-9506-228e11908ed1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.320811 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0877228d-e055-4e15-8aa6-396304500ce8 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.321487 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e73da5a8-f2dc-420f-9506-228e11908ed1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.322445 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e73da5a8-f2dc-420f-9506-228e11908ed1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.323043 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e73da5a8-f2dc-420f-9506-228e11908ed1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.323469 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0877228d-e055-4e15-8aa6-396304500ce8 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.324085 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0877228d-e055-4e15-8aa6-396304500ce8 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.339893 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-e73da5a8-f2dc-420f-9506-228e11908ed1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] HTTP exception thrown: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e73da5a8-f2dc-420f-9506-228e11908ed1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Request method failure captured: Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d HTTP/1.1 Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dWDtZ4dVDAxc4a82pIiBYzrX2WvfIKqnTlbBy50cIrMtLG3LhojWo-7hnBeHzS-aOSM1QPbc0kRay_5qMSbirXMDFkc5Gh92gylZBD_52df32W2e7mKCc1VoL9erv_KiFm2cKAWFCRA_Rr_zffUwJY3_9Ca4WfcLsXhoU4mOl19eIs Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 00d5d344212642b29dbc39c58f8895f3 Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:07:22.351640 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:07:22.353433 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_00d5d344212642b29dbc39c58f8895f3", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:22.353433 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:07:22.353433 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 00d5d344212642b29dbc39c58f8895f3 Jul 31 01:07:22.353433 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:07:22.353433 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersAdminTestJSON-1609993599-project Jul 31 01:07:22.353433 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:07:22.353433 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:07:22.353433 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 1994d455dd3e4143a14ab7f856929080 Jul 31 01:07:22.353433 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersAdminTestJSON-1609993599-project Jul 31 01:07:22.353433 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:07:22.353433 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. Jul 31 01:07:22.353433 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '74a44b0a-6c30-4b99-a071-adbc610df74d'} Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:22.354270 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. Jul 31 01:07:22.355569 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.357614 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e73da5a8-f2dc-420f-9506-228e11908ed1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Returning 404 to user: Instance 74a44b0a-6c30-4b99-a071-adbc610df74d could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:22.358855 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e73da5a8-f2dc-420f-9506-228e11908ed1 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d" status: 404 len: 111 microversion: 2.1 time: 0.055989 Jul 31 01:07:22.360054 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 209/402] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:22 2022] GET /compute/v2.1/servers/74a44b0a-6c30-4b99-a071-adbc610df74d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:22.360752 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:22.369005 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4f212efb-9855-4e23-9da0-ee83c7d1c893 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:22.370272 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4f212efb-9855-4e23-9da0-ee83c7d1c893 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:22.384171 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0877228d-e055-4e15-8aa6-396304500ce8 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.121670 Jul 31 01:07:22.385243 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 194/403] 10.222.0.45 () {58 vars in 1139 bytes} [Sun Jul 31 01:07:22 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:22.392227 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7333fbae-da06-4ea6-ae46-c8bbe9accc9d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:22.392975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7333fbae-da06-4ea6-ae46-c8bbe9accc9d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:22.394808 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4f212efb-9855-4e23-9da0-ee83c7d1c893 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.395690 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4f212efb-9855-4e23-9da0-ee83c7d1c893 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.396726 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4f212efb-9855-4e23-9da0-ee83c7d1c893 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.397488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4f212efb-9855-4e23-9da0-ee83c7d1c893 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.400715 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7333fbae-da06-4ea6-ae46-c8bbe9accc9d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.401415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7333fbae-da06-4ea6-ae46-c8bbe9accc9d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.402512 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7333fbae-da06-4ea6-ae46-c8bbe9accc9d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.403168 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7333fbae-da06-4ea6-ae46-c8bbe9accc9d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.426871 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-7333fbae-da06-4ea6-ae46-c8bbe9accc9d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] HTTP exception thrown: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. Jul 31 01:07:22.436058 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7333fbae-da06-4ea6-ae46-c8bbe9accc9d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Request method failure captured: Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e HTTP/1.1 Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWDtZ4dVDAxc4a82pIiBYzrX2WvfIKqnTlbBy50cIrMtLG3LhojWo-7hnBeHzS-aOSM1QPbc0kRay_5qMSbirXMDFkc5Gh92gylZBD_52df32W2e7mKCc1VoL9erv_KiFm2cKAWFCRA_Rr_zffUwJY3_9Ca4WfcLsXhoU4mOl19eIs Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 00d5d344212642b29dbc39c58f8895f3 Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:07:22.440845 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:07:22.442559 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_00d5d344212642b29dbc39c58f8895f3", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:22.442559 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:07:22.442559 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 00d5d344212642b29dbc39c58f8895f3 Jul 31 01:07:22.442559 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:07:22.442559 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-DeleteServersAdminTestJSON-1609993599-project Jul 31 01:07:22.442559 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:07:22.442559 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:07:22.442559 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 1994d455dd3e4143a14ab7f856929080 Jul 31 01:07:22.442559 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-DeleteServersAdminTestJSON-1609993599-project Jul 31 01:07:22.442559 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:07:22.442559 n-d-master-1 devstack@n-api.service[119475]: exception: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. Jul 31 01:07:22.442559 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'cc1acc67-c73e-4481-9e5a-87c112dc026e'} Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:22.443429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. Jul 31 01:07:22.444739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.447963 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7333fbae-da06-4ea6-ae46-c8bbe9accc9d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Returning 404 to user: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:22.448602 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7333fbae-da06-4ea6-ae46-c8bbe9accc9d tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 404 len: 111 microversion: 2.1 time: 0.062128 Jul 31 01:07:22.449853 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 195/404] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:07:22 2022] DELETE /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:22.462029 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f44cb5d2-0a10-4df3-bbca-7700867bfad4 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Calling method '.version_select at 0x7fede5e558b0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:22.465153 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:22.465153 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:22.466816 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f44cb5d2-0a10-4df3-bbca-7700867bfad4 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.467626 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f44cb5d2-0a10-4df3-bbca-7700867bfad4 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.468575 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f44cb5d2-0a10-4df3-bbca-7700867bfad4 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.469288 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f44cb5d2-0a10-4df3-bbca-7700867bfad4 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.503144 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f44cb5d2-0a10-4df3-bbca-7700867bfad4 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.051929 Jul 31 01:07:22.504871 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 196/405] 10.222.0.45 () {58 vars in 1145 bytes} [Sun Jul 31 01:07:22 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:07:22.509994 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ccdab09-d117-4139-a708-66ea8c73ab53 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:22.510966 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4ccdab09-d117-4139-a708-66ea8c73ab53 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:22.520891 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ccdab09-d117-4139-a708-66ea8c73ab53 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.522004 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ccdab09-d117-4139-a708-66ea8c73ab53 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.523081 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ccdab09-d117-4139-a708-66ea8c73ab53 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.523832 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ccdab09-d117-4139-a708-66ea8c73ab53 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.660508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4ccdab09-d117-4139-a708-66ea8c73ab53 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:22.680324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4ccdab09-d117-4139-a708-66ea8c73ab53 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:22.683427 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4ccdab09-d117-4139-a708-66ea8c73ab53 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:22.697109 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4ccdab09-d117-4139-a708-66ea8c73ab53 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.190900 Jul 31 01:07:22.707799 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 197/406] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:22 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:22.715944 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cb07a81b-c4a8-427e-b720-900f85baa319 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:22.717944 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cb07a81b-c4a8-427e-b720-900f85baa319 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] [instance: cc1acc67-c73e-4481-9e5a-87c112dc026e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:22.732765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb07a81b-c4a8-427e-b720-900f85baa319 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.732982 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb07a81b-c4a8-427e-b720-900f85baa319 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.738628 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb07a81b-c4a8-427e-b720-900f85baa319 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.739242 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb07a81b-c4a8-427e-b720-900f85baa319 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.757390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4f212efb-9855-4e23-9da0-ee83c7d1c893 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:22.766825 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4f212efb-9855-4e23-9da0-ee83c7d1c893 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:22.779006 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4f212efb-9855-4e23-9da0-ee83c7d1c893 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:22.780406 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4f212efb-9855-4e23-9da0-ee83c7d1c893 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1361 microversion: 2.25 time: 0.418912 Jul 31 01:07:22.781197 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 210/407] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:22 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1361 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-cb07a81b-c4a8-427e-b720-900f85baa319 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] HTTP exception thrown: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cb07a81b-c4a8-427e-b720-900f85baa319 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Request method failure captured: Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e HTTP/1.1 Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWDtZ4dVDAxc4a82pIiBYzrX2WvfIKqnTlbBy50cIrMtLG3LhojWo-7hnBeHzS-aOSM1QPbc0kRay_5qMSbirXMDFkc5Gh92gylZBD_52df32W2e7mKCc1VoL9erv_KiFm2cKAWFCRA_Rr_zffUwJY3_9Ca4WfcLsXhoU4mOl19eIs Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 00d5d344212642b29dbc39c58f8895f3 Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:07:22.790395 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:07:22.792072 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/00d5d344212642b29dbc39c58f8895f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_00d5d344212642b29dbc39c58f8895f3", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:22.792072 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:07:22.792072 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 00d5d344212642b29dbc39c58f8895f3 Jul 31 01:07:22.792072 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1609993599 Jul 31 01:07:22.792072 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-DeleteServersAdminTestJSON-1609993599-project Jul 31 01:07:22.792072 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:07:22.792072 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:07:22.792072 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 1994d455dd3e4143a14ab7f856929080 Jul 31 01:07:22.792072 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-DeleteServersAdminTestJSON-1609993599-project Jul 31 01:07:22.792072 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:07:22.792072 n-d-master-1 devstack@n-api.service[119475]: exception: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. Jul 31 01:07:22.792072 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'cc1acc67-c73e-4481-9e5a-87c112dc026e'} Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:22.792861 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. Jul 31 01:07:22.794139 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:22.795263 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cb07a81b-c4a8-427e-b720-900f85baa319 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] Returning 404 to user: Instance cc1acc67-c73e-4481-9e5a-87c112dc026e could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:22.795263 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cb07a81b-c4a8-427e-b720-900f85baa319 tempest-DeleteServersAdminTestJSON-1609993599 tempest-DeleteServersAdminTestJSON-1609993599-project] 10.222.0.45 "GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e" status: 404 len: 111 microversion: 2.1 time: 0.084532 Jul 31 01:07:22.795263 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 198/408] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:22 2022] GET /compute/v2.1/servers/cc1acc67-c73e-4481-9e5a-87c112dc026e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:22.802496 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-17d5b56f-d18a-4e77-ac3e-0dad50284e29 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Calling method '.version_select at 0x7fede5fbbb80>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:22.802496 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:22.802496 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:22.802919 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17d5b56f-d18a-4e77-ac3e-0dad50284e29 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.803698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17d5b56f-d18a-4e77-ac3e-0dad50284e29 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.804747 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17d5b56f-d18a-4e77-ac3e-0dad50284e29 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.805277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17d5b56f-d18a-4e77-ac3e-0dad50284e29 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.838527 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-17d5b56f-d18a-4e77-ac3e-0dad50284e29 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.055603 Jul 31 01:07:22.839377 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 211/409] 10.222.0.45 () {58 vars in 1128 bytes} [Sun Jul 31 01:07:22 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:22.850766 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-30d4b253-6c97-4f9b-9395-c3f9937a2176 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Calling method '.version_select at 0x7fede5e9ba60>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:22.854311 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:22.854311 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:22.856724 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30d4b253-6c97-4f9b-9395-c3f9937a2176 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.857808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30d4b253-6c97-4f9b-9395-c3f9937a2176 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.858966 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30d4b253-6c97-4f9b-9395-c3f9937a2176 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.859599 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30d4b253-6c97-4f9b-9395-c3f9937a2176 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.900470 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-30d4b253-6c97-4f9b-9395-c3f9937a2176 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.052953 Jul 31 01:07:22.901339 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 199/410] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:07:22 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:07:22.913453 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d2103fe9-761d-4c3d-8d18-bf3a305bced3 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Calling method '.version_select at 0x7fede612eaf0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:22.916967 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:22.916967 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:22.920809 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2103fe9-761d-4c3d-8d18-bf3a305bced3 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.921264 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2103fe9-761d-4c3d-8d18-bf3a305bced3 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.922183 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2103fe9-761d-4c3d-8d18-bf3a305bced3 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:22.926720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2103fe9-761d-4c3d-8d18-bf3a305bced3 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:22.990764 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d2103fe9-761d-4c3d-8d18-bf3a305bced3 tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.081400 Jul 31 01:07:22.996415 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 212/411] 10.222.0.45 () {58 vars in 1128 bytes} [Sun Jul 31 01:07:22 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:23.006529 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-956a76f5-c5d7-4c23-9873-6eae2b803c0b tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Calling method '.version_select at 0x7fede5f583a0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:23.008148 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:23.008148 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:23.019533 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-956a76f5-c5d7-4c23-9873-6eae2b803c0b tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:23.020018 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-956a76f5-c5d7-4c23-9873-6eae2b803c0b tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:23.053751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-956a76f5-c5d7-4c23-9873-6eae2b803c0b tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:23.055375 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-956a76f5-c5d7-4c23-9873-6eae2b803c0b tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:23.107922 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-956a76f5-c5d7-4c23-9873-6eae2b803c0b tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts/n-h1-master-1" status: 200 len: 729 microversion: 2.1 time: 0.108086 Jul 31 01:07:23.112411 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 200/412] 10.222.0.45 () {58 vars in 1170 bytes} [Sun Jul 31 01:07:22 2022] GET /compute/v2.1/os-hosts/n-h1-master-1 => generated 729 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:07:23.129009 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-208f97cf-7ffd-455b-974a-25b75cc3d53e tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Calling method '.version_select at 0x7fede5fbb8b0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:23.132141 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:23.132141 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:23.157250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-208f97cf-7ffd-455b-974a-25b75cc3d53e tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:23.158042 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-208f97cf-7ffd-455b-974a-25b75cc3d53e tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:23.202114 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-208f97cf-7ffd-455b-974a-25b75cc3d53e tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:23.210912 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-208f97cf-7ffd-455b-974a-25b75cc3d53e tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:23.318850 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e9c60cc1-2854-4c82-b7d2-70ef24b952da tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:23.327924 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e9c60cc1-2854-4c82-b7d2-70ef24b952da tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:23.373634 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9c60cc1-2854-4c82-b7d2-70ef24b952da tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:23.376795 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9c60cc1-2854-4c82-b7d2-70ef24b952da tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:23.380757 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9c60cc1-2854-4c82-b7d2-70ef24b952da tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:23.385993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9c60cc1-2854-4c82-b7d2-70ef24b952da tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:23.389920 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-208f97cf-7ffd-455b-974a-25b75cc3d53e tempest-HostsAdminTestJSON-1922141905 tempest-HostsAdminTestJSON-1922141905-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts/n-h2-master-1" status: 200 len: 467 microversion: 2.1 time: 0.271168 Jul 31 01:07:23.419420 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 213/413] 10.222.0.45 () {58 vars in 1170 bytes} [Sun Jul 31 01:07:23 2022] GET /compute/v2.1/os-hosts/n-h2-master-1 => generated 467 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:23.726208 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-932c20f8-880a-4e8c-b481-4dcaf0df4eae tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:23.727308 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-932c20f8-880a-4e8c-b481-4dcaf0df4eae tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:23.736292 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-932c20f8-880a-4e8c-b481-4dcaf0df4eae tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:23.743503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-932c20f8-880a-4e8c-b481-4dcaf0df4eae tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:23.745307 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-932c20f8-880a-4e8c-b481-4dcaf0df4eae tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:23.746805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-932c20f8-880a-4e8c-b481-4dcaf0df4eae tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:23.799461 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e9c60cc1-2854-4c82-b7d2-70ef24b952da tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:23.810614 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e9c60cc1-2854-4c82-b7d2-70ef24b952da tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1477 microversion: 2.1 time: 0.499417 Jul 31 01:07:23.811881 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 201/414] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:23 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1477 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:23.826218 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9fd75985-9bee-4878-827e-fba9b35e7041 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:23.827135 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9fd75985-9bee-4878-827e-fba9b35e7041 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:23.836847 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9fd75985-9bee-4878-827e-fba9b35e7041 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:23.837963 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9fd75985-9bee-4878-827e-fba9b35e7041 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:23.838983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9fd75985-9bee-4878-827e-fba9b35e7041 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:23.839784 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9fd75985-9bee-4878-827e-fba9b35e7041 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:23.988088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-932c20f8-880a-4e8c-b481-4dcaf0df4eae tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:23.998316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-932c20f8-880a-4e8c-b481-4dcaf0df4eae tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:24.010592 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-932c20f8-880a-4e8c-b481-4dcaf0df4eae tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:24.020029 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-932c20f8-880a-4e8c-b481-4dcaf0df4eae tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.298315 Jul 31 01:07:24.021239 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 214/415] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:23 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:24.409083 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9fd75985-9bee-4878-827e-fba9b35e7041 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:24.433378 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9fd75985-9bee-4878-827e-fba9b35e7041 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:24.439823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9fd75985-9bee-4878-827e-fba9b35e7041 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:24.445821 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9fd75985-9bee-4878-827e-fba9b35e7041 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1361 microversion: 2.25 time: 0.632558 Jul 31 01:07:24.447202 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 202/416] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:23 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1361 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:24.834407 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9463d453-4fc5-4d3d-990f-61bd1238e7da tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:24.835671 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9463d453-4fc5-4d3d-990f-61bd1238e7da tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:24.848161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9463d453-4fc5-4d3d-990f-61bd1238e7da tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:24.848767 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9463d453-4fc5-4d3d-990f-61bd1238e7da tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:24.854830 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9463d453-4fc5-4d3d-990f-61bd1238e7da tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:24.855571 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9463d453-4fc5-4d3d-990f-61bd1238e7da tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:25.052281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a5787940-9bf3-43f3-8618-bdf55d233c35 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:25.052959 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a5787940-9bf3-43f3-8618-bdf55d233c35 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:25.072013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5787940-9bf3-43f3-8618-bdf55d233c35 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:25.072397 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5787940-9bf3-43f3-8618-bdf55d233c35 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:25.073194 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5787940-9bf3-43f3-8618-bdf55d233c35 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:25.073661 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5787940-9bf3-43f3-8618-bdf55d233c35 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:25.296876 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a5787940-9bf3-43f3-8618-bdf55d233c35 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:25.314477 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a5787940-9bf3-43f3-8618-bdf55d233c35 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:25.316032 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a5787940-9bf3-43f3-8618-bdf55d233c35 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:25.323447 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9463d453-4fc5-4d3d-990f-61bd1238e7da tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:25.334337 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a5787940-9bf3-43f3-8618-bdf55d233c35 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.287240 Jul 31 01:07:25.343481 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 203/417] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:25 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:07:25.353437 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9463d453-4fc5-4d3d-990f-61bd1238e7da tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1477 microversion: 2.1 time: 0.504162 Jul 31 01:07:25.354102 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 215/418] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:24 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1477 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:25.470002 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-10c824e4-1df5-413a-8110-867473638314 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:25.470529 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-10c824e4-1df5-413a-8110-867473638314 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:25.477074 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10c824e4-1df5-413a-8110-867473638314 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:25.477539 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10c824e4-1df5-413a-8110-867473638314 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:25.478355 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10c824e4-1df5-413a-8110-867473638314 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:25.478806 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10c824e4-1df5-413a-8110-867473638314 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:25.791662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-10c824e4-1df5-413a-8110-867473638314 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:25.811067 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-10c824e4-1df5-413a-8110-867473638314 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:25.837464 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-10c824e4-1df5-413a-8110-867473638314 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:25.841301 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-10c824e4-1df5-413a-8110-867473638314 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1361 microversion: 2.25 time: 0.375103 Jul 31 01:07:25.843634 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 204/419] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:25 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1361 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:26.369694 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-badf6605-fa25-46ab-88d9-b040e6d29d88 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:26.370394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-badf6605-fa25-46ab-88d9-b040e6d29d88 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:26.376394 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-787e9b4a-563a-4d9d-9fd2-cf9617a3a309 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:26.377396 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-787e9b4a-563a-4d9d-9fd2-cf9617a3a309 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:26.381764 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-badf6605-fa25-46ab-88d9-b040e6d29d88 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:26.382224 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-badf6605-fa25-46ab-88d9-b040e6d29d88 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:26.383019 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-badf6605-fa25-46ab-88d9-b040e6d29d88 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:26.383483 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-badf6605-fa25-46ab-88d9-b040e6d29d88 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:26.390264 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-787e9b4a-563a-4d9d-9fd2-cf9617a3a309 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:26.392607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-787e9b4a-563a-4d9d-9fd2-cf9617a3a309 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:26.400052 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-787e9b4a-563a-4d9d-9fd2-cf9617a3a309 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:26.401130 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-787e9b4a-563a-4d9d-9fd2-cf9617a3a309 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:26.793981 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-badf6605-fa25-46ab-88d9-b040e6d29d88 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:26.815639 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-badf6605-fa25-46ab-88d9-b040e6d29d88 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:26.817575 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-badf6605-fa25-46ab-88d9-b040e6d29d88 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:26.837103 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-badf6605-fa25-46ab-88d9-b040e6d29d88 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1446 microversion: 2.75 time: 0.471105 Jul 31 01:07:26.855508 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 216/420] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:26 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1446 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:26.868251 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-82e9ffde-0589-4ecc-b098-30cde72f6414 req-a31e2b0a-4140-4d08-bb48-848e39b70fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2", "name": "network-vif-plugged", "status": "completed", "tag": "79b2e09a-8171-4f0d-adc4-3e2dbf769ce6"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:26.911567 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-82e9ffde-0589-4ecc-b098-30cde72f6414 req-a31e2b0a-4140-4d08-bb48-848e39b70fb8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:26.912188 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-82e9ffde-0589-4ecc-b098-30cde72f6414 req-a31e2b0a-4140-4d08-bb48-848e39b70fb8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:26.969233 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-82e9ffde-0589-4ecc-b098-30cde72f6414 req-a31e2b0a-4140-4d08-bb48-848e39b70fb8 service nova] Creating event network-vif-plugged:79b2e09a-8171-4f0d-adc4-3e2dbf769ce6 for instance 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 on n-h1-master-1 Jul 31 01:07:26.985504 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-82e9ffde-0589-4ecc-b098-30cde72f6414 req-a31e2b0a-4140-4d08-bb48-848e39b70fb8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119047 Jul 31 01:07:26.987809 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 217/421] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:27.003089 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-28c13c46-43b0-43ff-8de6-a063f5ffd1f0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:27.003992 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-28c13c46-43b0-43ff-8de6-a063f5ffd1f0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:27.019598 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:27.021675 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28c13c46-43b0-43ff-8de6-a063f5ffd1f0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:27.024102 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28c13c46-43b0-43ff-8de6-a063f5ffd1f0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:27.026129 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28c13c46-43b0-43ff-8de6-a063f5ffd1f0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:27.027669 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28c13c46-43b0-43ff-8de6-a063f5ffd1f0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:27.099948 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-787e9b4a-563a-4d9d-9fd2-cf9617a3a309 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:27.136703 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-787e9b4a-563a-4d9d-9fd2-cf9617a3a309 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1477 microversion: 2.1 time: 0.757830 Jul 31 01:07:27.169567 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 205/422] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:26 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1477 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:27.455726 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-28c13c46-43b0-43ff-8de6-a063f5ffd1f0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:27.468806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-28c13c46-43b0-43ff-8de6-a063f5ffd1f0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:27.470920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-28c13c46-43b0-43ff-8de6-a063f5ffd1f0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:27.475040 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-28c13c46-43b0-43ff-8de6-a063f5ffd1f0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1361 microversion: 2.25 time: 0.483004 Jul 31 01:07:27.491811 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 218/423] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:26 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1361 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:27.598052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a8c88cce-4c5f-4fce-b761-0ed2a842b81e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:27.598944 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a8c88cce-4c5f-4fce-b761-0ed2a842b81e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:27.609460 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8c88cce-4c5f-4fce-b761-0ed2a842b81e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:27.611783 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8c88cce-4c5f-4fce-b761-0ed2a842b81e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:27.612752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8c88cce-4c5f-4fce-b761-0ed2a842b81e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:27.613509 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8c88cce-4c5f-4fce-b761-0ed2a842b81e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:27.650703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a8c88cce-4c5f-4fce-b761-0ed2a842b81e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:07:27.818049 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:27.827890 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a8c88cce-4c5f-4fce-b761-0ed2a842b81e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 204 len: 0 microversion: 2.1 time: 0.231776 Jul 31 01:07:27.827890 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 206/424] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:07:27 2022] DELETE /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:07:27.868030 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-21d250c7-21a8-4b21-9f27-2760f13e5e91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:27.868760 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-21d250c7-21a8-4b21-9f27-2760f13e5e91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:27.878880 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21d250c7-21a8-4b21-9f27-2760f13e5e91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:27.879369 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21d250c7-21a8-4b21-9f27-2760f13e5e91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:27.880167 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21d250c7-21a8-4b21-9f27-2760f13e5e91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:27.880612 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21d250c7-21a8-4b21-9f27-2760f13e5e91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:27.963628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-21d250c7-21a8-4b21-9f27-2760f13e5e91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:27.976053 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-21d250c7-21a8-4b21-9f27-2760f13e5e91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:27.978430 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-21d250c7-21a8-4b21-9f27-2760f13e5e91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:27.985797 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-21d250c7-21a8-4b21-9f27-2760f13e5e91 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1452 microversion: 2.75 time: 0.121737 Jul 31 01:07:27.986382 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 207/425] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:27 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:07:28.077625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-345a09e5-4ddf-4c38-bd57-40b313a3de65 req-eeae8be0-2038-49ca-a523-4c5104938652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "389e7feb-f45c-4e78-ad80-6a5d230e68ba", "name": "network-vif-unplugged", "status": "completed", "tag": "59525f1d-b7cd-4a9a-86cf-0466f0ad21ef"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:28.104056 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-345a09e5-4ddf-4c38-bd57-40b313a3de65 req-eeae8be0-2038-49ca-a523-4c5104938652 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:28.104686 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-345a09e5-4ddf-4c38-bd57-40b313a3de65 req-eeae8be0-2038-49ca-a523-4c5104938652 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:28.129618 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-345a09e5-4ddf-4c38-bd57-40b313a3de65 req-eeae8be0-2038-49ca-a523-4c5104938652 service nova] Creating event network-vif-unplugged:59525f1d-b7cd-4a9a-86cf-0466f0ad21ef for instance 389e7feb-f45c-4e78-ad80-6a5d230e68ba on n-h2-master-1 Jul 31 01:07:28.152836 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-345a09e5-4ddf-4c38-bd57-40b313a3de65 req-eeae8be0-2038-49ca-a523-4c5104938652 service nova] Instance 389e7feb-f45c-4e78-ad80-6a5d230e68ba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:07:28.171517 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-345a09e5-4ddf-4c38-bd57-40b313a3de65 req-eeae8be0-2038-49ca-a523-4c5104938652 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098130 Jul 31 01:07:28.172831 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 208/426] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:07:28.180146 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-276af0c2-c4a3-4772-b832-945b95bf2cc8 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1044574092", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "1005941521", "adminPass": "***", "networks": [{"uuid": "10f4e51d-9cd3-4323-a9ec-09ee36626e8f"}], "security_groups": [{"name": "tempest-securitygroup--1377524876"}], "key_name": "tempest-keypair-1989891644", "user_data": "}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:28.431030 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-276af0c2-c4a3-4772-b832-945b95bf2cc8 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] validate_networks() for [('10f4e51d-9cd3-4323-a9ec-09ee36626e8f', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:07:28.455613 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-26c4abf9-7869-4e7a-9c9d-b2320f0a1e1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-541076351", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "3d6735cc-8aac-4616-9429-654d8dcd9adc"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:28.559140 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-26c4abf9-7869-4e7a-9c9d-b2320f0a1e1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] validate_networks() for [('3d6735cc-8aac-4616-9429-654d8dcd9adc', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:07:29.562169 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-26c4abf9-7869-4e7a-9c9d-b2320f0a1e1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:07:29.564025 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-26c4abf9-7869-4e7a-9c9d-b2320f0a1e1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:07:29.564769 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-26c4abf9-7869-4e7a-9c9d-b2320f0a1e1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:07:29.565396 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-26c4abf9-7869-4e7a-9c9d-b2320f0a1e1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:07:29.566026 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-26c4abf9-7869-4e7a-9c9d-b2320f0a1e1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:07:29.588623 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26c4abf9-7869-4e7a-9c9d-b2320f0a1e1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:29.590197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26c4abf9-7869-4e7a-9c9d-b2320f0a1e1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:29.592449 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26c4abf9-7869-4e7a-9c9d-b2320f0a1e1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:29.594676 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26c4abf9-7869-4e7a-9c9d-b2320f0a1e1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:29.606460 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-276af0c2-c4a3-4772-b832-945b95bf2cc8 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:07:29.606940 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-276af0c2-c4a3-4772-b832-945b95bf2cc8 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:07:29.607481 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-276af0c2-c4a3-4772-b832-945b95bf2cc8 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:07:29.607909 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-276af0c2-c4a3-4772-b832-945b95bf2cc8 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:07:29.608332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-276af0c2-c4a3-4772-b832-945b95bf2cc8 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:07:29.641718 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-276af0c2-c4a3-4772-b832-945b95bf2cc8 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:29.642188 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-276af0c2-c4a3-4772-b832-945b95bf2cc8 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:29.643017 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-276af0c2-c4a3-4772-b832-945b95bf2cc8 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:29.644284 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-276af0c2-c4a3-4772-b832-945b95bf2cc8 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:29.667149 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-26c4abf9-7869-4e7a-9c9d-b2320f0a1e1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Getting quotas for project 5d8b0e81765c48039a523271670896d2. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:07:29.675305 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-26c4abf9-7869-4e7a-9c9d-b2320f0a1e1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Getting quotas for user 457bd8590d5040ef95854808b51c04d3 and project 5d8b0e81765c48039a523271670896d2. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:07:29.712469 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-276af0c2-c4a3-4772-b832-945b95bf2cc8 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Getting quotas for project 69a24d132da74cd0a21d1851711745c0. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:07:29.726180 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-26c4abf9-7869-4e7a-9c9d-b2320f0a1e1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:07:29.732326 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-276af0c2-c4a3-4772-b832-945b95bf2cc8 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Getting quotas for user 505f516270844b7e9d0f213c3ce3da6f and project 69a24d132da74cd0a21d1851711745c0. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:07:29.734099 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-26c4abf9-7869-4e7a-9c9d-b2320f0a1e1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:07:29.770008 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-276af0c2-c4a3-4772-b832-945b95bf2cc8 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:07:29.777059 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-276af0c2-c4a3-4772-b832-945b95bf2cc8 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:07:29.854897 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-26c4abf9-7869-4e7a-9c9d-b2320f0a1e1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.024696 Jul 31 01:07:29.856383 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 219/427] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:07:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:07:29.877078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b66cc954-be0d-4cb6-938a-d16888dcc756 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:29.878705 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b66cc954-be0d-4cb6-938a-d16888dcc756 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:29.890321 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-276af0c2-c4a3-4772-b832-945b95bf2cc8 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.715981 Jul 31 01:07:29.891209 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 209/428] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:07:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:07:29.904676 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-506d8889-de02-4ed9-95f0-d69f135191d9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:29.906284 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-506d8889-de02-4ed9-95f0-d69f135191d9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:29.908631 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b66cc954-be0d-4cb6-938a-d16888dcc756 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:29.910223 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b66cc954-be0d-4cb6-938a-d16888dcc756 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:29.912153 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b66cc954-be0d-4cb6-938a-d16888dcc756 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:29.913416 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b66cc954-be0d-4cb6-938a-d16888dcc756 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:29.914989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-506d8889-de02-4ed9-95f0-d69f135191d9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:29.915966 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-506d8889-de02-4ed9-95f0-d69f135191d9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:29.917092 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-506d8889-de02-4ed9-95f0-d69f135191d9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:29.918009 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-506d8889-de02-4ed9-95f0-d69f135191d9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:30.340105 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-506d8889-de02-4ed9-95f0-d69f135191d9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:30.360155 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-506d8889-de02-4ed9-95f0-d69f135191d9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:30.366382 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-506d8889-de02-4ed9-95f0-d69f135191d9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:30.368166 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-506d8889-de02-4ed9-95f0-d69f135191d9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1556 microversion: 2.25 time: 0.469460 Jul 31 01:07:30.370196 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 210/429] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:29 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1556 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:30.407805 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-81794c64-cf7a-46bb-a160-19b476618070 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:30.407805 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-81794c64-cf7a-46bb-a160-19b476618070 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:30.423310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81794c64-cf7a-46bb-a160-19b476618070 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:30.423804 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81794c64-cf7a-46bb-a160-19b476618070 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:30.426600 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81794c64-cf7a-46bb-a160-19b476618070 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:30.428660 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81794c64-cf7a-46bb-a160-19b476618070 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:30.441279 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b66cc954-be0d-4cb6-938a-d16888dcc756 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:30.452144 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b66cc954-be0d-4cb6-938a-d16888dcc756 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1476 microversion: 2.1 time: 0.592775 Jul 31 01:07:30.454245 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 220/430] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:29 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1476 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:30.469082 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8d25823a-b3ce-4536-8886-c1c033896efe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:30.471155 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8d25823a-b3ce-4536-8886-c1c033896efe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:30.585346 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8d25823a-b3ce-4536-8886-c1c033896efe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:30.601387 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8d25823a-b3ce-4536-8886-c1c033896efe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1210 microversion: 2.1 time: 0.143509 Jul 31 01:07:30.606409 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 221/431] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:30 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1210 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:30.620182 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4b7086b1-c9d6-4a5c-bb58-298dfeaf67ad tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:30.621079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4b7086b1-c9d6-4a5c-bb58-298dfeaf67ad tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:30.650203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-81794c64-cf7a-46bb-a160-19b476618070 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:30.671605 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-81794c64-cf7a-46bb-a160-19b476618070 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:30.676021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-81794c64-cf7a-46bb-a160-19b476618070 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:30.695045 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-81794c64-cf7a-46bb-a160-19b476618070 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1437 microversion: 2.75 time: 0.303560 Jul 31 01:07:30.697717 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 211/432] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:30 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1437 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:30.712048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-05f8aed0-6b67-47c6-9b4e-2c982981750d req-3286f25a-91a1-49a9-b2a0-6d912c658c92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "389e7feb-f45c-4e78-ad80-6a5d230e68ba", "tag": "59525f1d-b7cd-4a9a-86cf-0466f0ad21ef"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:30.738220 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-05f8aed0-6b67-47c6-9b4e-2c982981750d req-3286f25a-91a1-49a9-b2a0-6d912c658c92 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:30.741494 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-05f8aed0-6b67-47c6-9b4e-2c982981750d req-3286f25a-91a1-49a9-b2a0-6d912c658c92 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:30.762083 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-05f8aed0-6b67-47c6-9b4e-2c982981750d req-3286f25a-91a1-49a9-b2a0-6d912c658c92 service nova] Creating event network-changed:59525f1d-b7cd-4a9a-86cf-0466f0ad21ef for instance 389e7feb-f45c-4e78-ad80-6a5d230e68ba on n-h2-master-1 Jul 31 01:07:30.771451 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-05f8aed0-6b67-47c6-9b4e-2c982981750d req-3286f25a-91a1-49a9-b2a0-6d912c658c92 service nova] Instance 389e7feb-f45c-4e78-ad80-6a5d230e68ba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:07:30.783388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4b7086b1-c9d6-4a5c-bb58-298dfeaf67ad tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:30.799437 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4b7086b1-c9d6-4a5c-bb58-298dfeaf67ad tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 200 len: 1265 microversion: 2.1 time: 0.189075 Jul 31 01:07:30.800052 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 222/433] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:30 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:30.805580 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-05f8aed0-6b67-47c6-9b4e-2c982981750d req-3286f25a-91a1-49a9-b2a0-6d912c658c92 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105192 Jul 31 01:07:30.806946 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 212/434] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:31.180975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cc50ae3c-518e-436b-9722-ce4759d45b50 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:31.182427 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cc50ae3c-518e-436b-9722-ce4759d45b50 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:31.201788 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc50ae3c-518e-436b-9722-ce4759d45b50 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:31.204621 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc50ae3c-518e-436b-9722-ce4759d45b50 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:31.206560 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc50ae3c-518e-436b-9722-ce4759d45b50 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:31.208525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc50ae3c-518e-436b-9722-ce4759d45b50 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:31.431746 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0680e3cf-ed99-4144-9fa8-f9ce0564b6b0 tempest-HypervisorAdminV228Test-1798777174 tempest-HypervisorAdminV228Test-1798777174-project-admin] Calling method '.version_select at 0x7fede5e71940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:31.432815 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:31.432815 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:31.434474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0680e3cf-ed99-4144-9fa8-f9ce0564b6b0 tempest-HypervisorAdminV228Test-1798777174 tempest-HypervisorAdminV228Test-1798777174-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:31.435037 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0680e3cf-ed99-4144-9fa8-f9ce0564b6b0 tempest-HypervisorAdminV228Test-1798777174 tempest-HypervisorAdminV228Test-1798777174-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:31.456713 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0680e3cf-ed99-4144-9fa8-f9ce0564b6b0 tempest-HypervisorAdminV228Test-1798777174 tempest-HypervisorAdminV228Test-1798777174-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:31.457356 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0680e3cf-ed99-4144-9fa8-f9ce0564b6b0 tempest-HypervisorAdminV228Test-1798777174 tempest-HypervisorAdminV228Test-1798777174-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:31.470352 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0680e3cf-ed99-4144-9fa8-f9ce0564b6b0 tempest-HypervisorAdminV228Test-1798777174 tempest-HypervisorAdminV228Test-1798777174-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:31.471131 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0680e3cf-ed99-4144-9fa8-f9ce0564b6b0 tempest-HypervisorAdminV228Test-1798777174 tempest-HypervisorAdminV228Test-1798777174-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:31.480293 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0680e3cf-ed99-4144-9fa8-f9ce0564b6b0 tempest-HypervisorAdminV228Test-1798777174 tempest-HypervisorAdminV228Test-1798777174-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.665170 Jul 31 01:07:31.490579 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 223/435] 10.222.0.45 () {60 vars in 1187 bytes} [Sun Jul 31 01:07:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:07:31.764930 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:31.782465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-cc50ae3c-518e-436b-9722-ce4759d45b50 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'services' on Instance uuid 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:31.911748 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cc50ae3c-518e-436b-9722-ce4759d45b50 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 2048 microversion: 2.25 time: 1.102925 Jul 31 01:07:31.916566 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 213/436] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:30 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 2048 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:32.052813 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0f306572-729b-4b95-a357-79461887e541"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:32.055977 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:32.062459 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:32.062951 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:32.063793 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:32.064399 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:32.133026 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-15a3b96b-324a-4bb8-8632-b4e5e9349cea tempest-FlavorMetadataValidation-720542042 tempest-FlavorMetadataValidation-720542042-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-357001726", "id": 553985566, "os-flavor-access:is_public": "True"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:32.136344 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:32.136344 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:32.166767 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-15a3b96b-324a-4bb8-8632-b4e5e9349cea tempest-FlavorMetadataValidation-720542042 tempest-FlavorMetadataValidation-720542042-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.248781 Jul 31 01:07:32.167906 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 214/437] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:07:31 2022] POST /compute/v2.1/flavors => generated 467 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:07:32.174029 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-10043cd0-ce9c-48c3-a312-a9516ce26a9e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:32.174859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-10043cd0-ce9c-48c3-a312-a9516ce26a9e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:32.181847 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10043cd0-ce9c-48c3-a312-a9516ce26a9e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:32.182554 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10043cd0-ce9c-48c3-a312-a9516ce26a9e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:32.183533 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10043cd0-ce9c-48c3-a312-a9516ce26a9e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:32.184132 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10043cd0-ce9c-48c3-a312-a9516ce26a9e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:32.242381 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:07:32.242808 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:07:32.243287 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:07:32.243721 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:07:32.244313 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:07:32.390938 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:32.403840 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:32.404308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:32.409276 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:32.409930 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:32.432237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-10043cd0-ce9c-48c3-a312-a9516ce26a9e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:32.440816 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-10043cd0-ce9c-48c3-a312-a9516ce26a9e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1474 microversion: 2.1 time: 0.271657 Jul 31 01:07:32.443026 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 215/438] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:32 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1474 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:32.447880 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d1b7e20b-f92a-4e97-a3a3-d9ac32ba03d9 tempest-HypervisorAdminV228Test-1798777174 tempest-HypervisorAdminV228Test-1798777174-project-admin] Calling method '.version_select at 0x7fede5e9b430>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:32.448893 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:32.448893 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:32.450327 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d1b7e20b-f92a-4e97-a3a3-d9ac32ba03d9 tempest-HypervisorAdminV228Test-1798777174 tempest-HypervisorAdminV228Test-1798777174-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:32.450944 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d1b7e20b-f92a-4e97-a3a3-d9ac32ba03d9 tempest-HypervisorAdminV228Test-1798777174 tempest-HypervisorAdminV228Test-1798777174-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:32.466186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d1b7e20b-f92a-4e97-a3a3-d9ac32ba03d9 tempest-HypervisorAdminV228Test-1798777174 tempest-HypervisorAdminV228Test-1798777174-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:32.466878 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d1b7e20b-f92a-4e97-a3a3-d9ac32ba03d9 tempest-HypervisorAdminV228Test-1798777174 tempest-HypervisorAdminV228Test-1798777174-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:32.479185 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d1b7e20b-f92a-4e97-a3a3-d9ac32ba03d9 tempest-HypervisorAdminV228Test-1798777174 tempest-HypervisorAdminV228Test-1798777174-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.034775 Jul 31 01:07:32.480654 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 216/439] 10.222.0.45 () {60 vars in 1193 bytes} [Sun Jul 31 01:07:32 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:07:32.485858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-443c642b-aab3-4e6f-bcd4-015c2f5862c4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:32.486747 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-443c642b-aab3-4e6f-bcd4-015c2f5862c4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:32.512233 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-443c642b-aab3-4e6f-bcd4-015c2f5862c4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:32.512701 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-443c642b-aab3-4e6f-bcd4-015c2f5862c4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:32.513500 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-443c642b-aab3-4e6f-bcd4-015c2f5862c4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:32.513951 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-443c642b-aab3-4e6f-bcd4-015c2f5862c4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:32.735582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:32.778524 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-443c642b-aab3-4e6f-bcd4-015c2f5862c4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:32.788944 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-443c642b-aab3-4e6f-bcd4-015c2f5862c4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1262 microversion: 2.1 time: 0.306985 Jul 31 01:07:32.804865 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 217/440] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:32 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1262 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:32.810462 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-396676a7-c32a-48cb-8d35-2670a513fe1b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:32.811312 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-396676a7-c32a-48cb-8d35-2670a513fe1b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:32.818516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-396676a7-c32a-48cb-8d35-2670a513fe1b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:32.819212 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-396676a7-c32a-48cb-8d35-2670a513fe1b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:32.820199 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-396676a7-c32a-48cb-8d35-2670a513fe1b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:32.820801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-396676a7-c32a-48cb-8d35-2670a513fe1b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:32.892552 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e99aa1f9-a556-41e5-a94e-0c81a1f2e363 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324/action" status: 202 len: 1940 microversion: 2.75 time: 1.400012 Jul 31 01:07:32.895292 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 224/441] 10.222.0.45 () {62 vars in 1319 bytes} [Sun Jul 31 01:07:31 2022] POST /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324/action => generated 1940 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 31 01:07:32.916421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bcb06e80-e264-4a17-8462-a6f09465099e tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:32.917348 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bcb06e80-e264-4a17-8462-a6f09465099e tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:32.930825 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bcb06e80-e264-4a17-8462-a6f09465099e tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:32.936838 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-396676a7-c32a-48cb-8d35-2670a513fe1b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:32.942418 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bcb06e80-e264-4a17-8462-a6f09465099e tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:32.944747 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bcb06e80-e264-4a17-8462-a6f09465099e tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:32.945814 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bcb06e80-e264-4a17-8462-a6f09465099e tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:32.954198 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-396676a7-c32a-48cb-8d35-2670a513fe1b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 200 len: 1317 microversion: 2.1 time: 0.147219 Jul 31 01:07:32.961143 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 218/442] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:32 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:33.229030 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-bcb06e80-e264-4a17-8462-a6f09465099e tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'services' on Instance uuid 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:33.253711 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bcb06e80-e264-4a17-8462-a6f09465099e tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 2048 microversion: 2.25 time: 0.355739 Jul 31 01:07:33.266119 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 225/443] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:32 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 2048 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:33.276360 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3ed5bb99-466c-42c7-af72-f7069529d094 tempest-FlavorMetadataValidation-720542042 tempest-FlavorMetadataValidation-720542042-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:33.279857 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:33.279857 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:33.524425 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-309f39d6-9272-46b9-874e-7e0147d918a7 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Calling method '.version_select at 0x7fede5da1160>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:33.529260 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:33.529260 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:33.530354 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3ed5bb99-466c-42c7-af72-f7069529d094 tempest-FlavorMetadataValidation-720542042 tempest-FlavorMetadataValidation-720542042-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors/553985566/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.262335 Jul 31 01:07:33.535795 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 226/444] 10.222.0.45 () {62 vars in 1262 bytes} [Sun Jul 31 01:07:33 2022] POST /compute/v2.1/flavors/553985566/os-extra_specs => generated 62 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:33.536633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-309f39d6-9272-46b9-874e-7e0147d918a7 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:33.537539 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-309f39d6-9272-46b9-874e-7e0147d918a7 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:33.543313 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-0c4a7d07-8487-44a0-8e46-7443a6f5ca1e req-461ecfd2-d54b-4404-b976-5509cdd4f171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eccd8f8d-d332-4c4e-bef6-30de69b8f681", "name": "network-vif-deleted", "tag": "f7832bd1-893a-4d8d-a8db-89c1491322de"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:33.544948 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-309f39d6-9272-46b9-874e-7e0147d918a7 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:33.545412 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-309f39d6-9272-46b9-874e-7e0147d918a7 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:33.585213 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0c4a7d07-8487-44a0-8e46-7443a6f5ca1e req-461ecfd2-d54b-4404-b976-5509cdd4f171 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:33.585663 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0c4a7d07-8487-44a0-8e46-7443a6f5ca1e req-461ecfd2-d54b-4404-b976-5509cdd4f171 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:33.594622 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-309f39d6-9272-46b9-874e-7e0147d918a7 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.631676 Jul 31 01:07:33.595897 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 219/445] 10.222.0.45 () {58 vars in 1128 bytes} [Sun Jul 31 01:07:32 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:33.602732 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-34323f39-7dee-4843-aee9-4994e52e5695 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:33.603725 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-34323f39-7dee-4843-aee9-4994e52e5695 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:33.603838 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-0c4a7d07-8487-44a0-8e46-7443a6f5ca1e req-461ecfd2-d54b-4404-b976-5509cdd4f171 service nova] Creating event network-vif-deleted:f7832bd1-893a-4d8d-a8db-89c1491322de for instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 on n-h2-master-1 Jul 31 01:07:33.620483 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34323f39-7dee-4843-aee9-4994e52e5695 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:33.621511 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34323f39-7dee-4843-aee9-4994e52e5695 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:33.622792 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34323f39-7dee-4843-aee9-4994e52e5695 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:33.623455 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34323f39-7dee-4843-aee9-4994e52e5695 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:33.630834 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-0c4a7d07-8487-44a0-8e46-7443a6f5ca1e req-461ecfd2-d54b-4404-b976-5509cdd4f171 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092904 Jul 31 01:07:33.631476 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 227/446] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:33.649692 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a502a837-5983-4fcf-b00e-a5653b26a9d8 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:33.652382 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:33.652382 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:33.653716 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a502a837-5983-4fcf-b00e-a5653b26a9d8 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:33.654172 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a502a837-5983-4fcf-b00e-a5653b26a9d8 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:33.654976 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a502a837-5983-4fcf-b00e-a5653b26a9d8 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:33.655434 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a502a837-5983-4fcf-b00e-a5653b26a9d8 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:33.753401 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a502a837-5983-4fcf-b00e-a5653b26a9d8 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.120597 Jul 31 01:07:33.754019 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 228/447] 10.222.0.45 () {60 vars in 1217 bytes} [Sun Jul 31 01:07:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:07:33.776987 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a400374d-a449-47e5-ae7f-64a726614a59 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:33.776987 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a400374d-a449-47e5-ae7f-64a726614a59 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:33.802209 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a400374d-a449-47e5-ae7f-64a726614a59 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:33.802664 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a400374d-a449-47e5-ae7f-64a726614a59 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:33.804981 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a400374d-a449-47e5-ae7f-64a726614a59 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:33.804981 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a400374d-a449-47e5-ae7f-64a726614a59 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:33.858345 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-34323f39-7dee-4843-aee9-4994e52e5695 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:33.944602 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-34323f39-7dee-4843-aee9-4994e52e5695 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1927 microversion: 2.75 time: 0.347292 Jul 31 01:07:33.948348 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 220/448] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:33 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1927 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:33.959161 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-70a9f44e-1afa-447f-9d0c-744663532dc9 tempest-FlavorMetadataValidation-720542042 tempest-FlavorMetadataValidation-720542042-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:33.973765 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:33.973765 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:34.072594 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-70a9f44e-1afa-447f-9d0c-744663532dc9 tempest-FlavorMetadataValidation-720542042 tempest-FlavorMetadataValidation-720542042-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/553985566" status: 202 len: 0 microversion: 2.86 time: 0.122339 Jul 31 01:07:34.075317 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 221/449] 10.222.0.45 () {60 vars in 1199 bytes} [Sun Jul 31 01:07:33 2022] DELETE /compute/v2.1/flavors/553985566 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:07:34.196615 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a400374d-a449-47e5-ae7f-64a726614a59 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:34.207953 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a400374d-a449-47e5-ae7f-64a726614a59 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1474 microversion: 2.1 time: 0.451679 Jul 31 01:07:34.209409 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 229/450] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:33 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1474 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:34.218220 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e1f72f6f-c374-4b97-ab48-c90e970e3000 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:34.222368 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e1f72f6f-c374-4b97-ab48-c90e970e3000 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:34.231300 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e1f72f6f-c374-4b97-ab48-c90e970e3000 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:34.232781 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e1f72f6f-c374-4b97-ab48-c90e970e3000 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:34.233922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e1f72f6f-c374-4b97-ab48-c90e970e3000 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:34.234711 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e1f72f6f-c374-4b97-ab48-c90e970e3000 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:34.352042 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-e1f72f6f-c374-4b97-ab48-c90e970e3000 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'flavor' on Instance uuid 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:34.431840 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e1f72f6f-c374-4b97-ab48-c90e970e3000 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Going to try to live migrate instance to n-h2-master-1 {{(pid=119474) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 31 01:07:34.442296 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:34.704992 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1f1ed9de-4f55-471a-b371-357de0b3b6ca tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Calling method '.version_select at 0x7fede5e9b040>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:34.714224 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:34.714224 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:34.721065 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1f1ed9de-4f55-471a-b371-357de0b3b6ca tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '5e96f2eeef6d4c25971e8fa214241c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ac98ab4908474fb99f7c904a45ed1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1f1ed9de-4f55-471a-b371-357de0b3b6ca tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Request method failure captured: Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dXRXiHWswbnkeb5dYdW6p8vIAyagliAuWJ1unw2wzRIAnpa15tLsYfsvkRzV_zRi8RmuXvyEQhfXfhUORmYHEOFatv7tM2xDmxVrCOFYEEpSD6YPF44NdXv3x8qt7EGgneVmrmdbcmSvenAbxdqFwwI1xJOjk4zBwyTuZJOGvDKHwc Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 62ac98ab4908474fb99f7c904a45ed1c Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:07:34.730089 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:07:34.731330 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_62ac98ab4908474fb99f7c904a45ed1c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:34.731330 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:34.731330 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 62ac98ab4908474fb99f7c904a45ed1c Jul 31 01:07:34.731330 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:34.731330 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-HostsAdminNegativeTestJSON-4879321-project Jul 31 01:07:34.731330 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:07:34.731330 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:07:34.731330 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 5e96f2eeef6d4c25971e8fa214241c05 Jul 31 01:07:34.731330 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-HostsAdminNegativeTestJSON-4879321-project Jul 31 01:07:34.731330 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:07:34.731330 n-d-master-1 devstack@n-api.service[119475]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 31 01:07:34.731330 n-d-master-1 devstack@n-api.service[119475]: action_args: {} Jul 31 01:07:34.731330 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:34.731330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:07:34.740112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 31 01:07:34.744691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:34.747074 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1f1ed9de-4f55-471a-b371-357de0b3b6ca tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:34.747074 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1f1ed9de-4f55-471a-b371-357de0b3b6ca tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] 10.222.0.45 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.655311 Jul 31 01:07:34.747074 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 222/451] 10.222.0.45 () {58 vars in 1128 bytes} [Sun Jul 31 01:07:34 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 662 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:34.758602 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5ed96431-9639-4621-9b83-0e28234bea68 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:34.760801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5ed96431-9639-4621-9b83-0e28234bea68 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:34.784205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5ed96431-9639-4621-9b83-0e28234bea68 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:34.786556 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5ed96431-9639-4621-9b83-0e28234bea68 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:34.789250 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5ed96431-9639-4621-9b83-0e28234bea68 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:34.791190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5ed96431-9639-4621-9b83-0e28234bea68 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:35.070828 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5ed96431-9639-4621-9b83-0e28234bea68 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:35.087825 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5ed96431-9639-4621-9b83-0e28234bea68 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1268 microversion: 2.1 time: 0.342757 Jul 31 01:07:35.099718 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 223/452] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:34 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1268 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:35.105119 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-156ccc84-b580-4514-8f9d-5f3bd414702a tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:35.105890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-156ccc84-b580-4514-8f9d-5f3bd414702a tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:35.119574 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-156ccc84-b580-4514-8f9d-5f3bd414702a tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:35.121208 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-156ccc84-b580-4514-8f9d-5f3bd414702a tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:35.122610 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-156ccc84-b580-4514-8f9d-5f3bd414702a tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:35.123435 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-156ccc84-b580-4514-8f9d-5f3bd414702a tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:35.624722 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-156ccc84-b580-4514-8f9d-5f3bd414702a tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:35.640152 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-156ccc84-b580-4514-8f9d-5f3bd414702a tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 200 len: 1323 microversion: 2.1 time: 0.538032 Jul 31 01:07:35.641001 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 224/453] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:35 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 1323 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:35.654542 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-51360244-4471-447c-ba74-6b7bde37c8ef tempest-FlavorMetadataValidation-720542042 tempest-FlavorMetadataValidation-720542042-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:35.690752 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-51360244-4471-447c-ba74-6b7bde37c8ef tempest-FlavorMetadataValidation-720542042 tempest-FlavorMetadataValidation-720542042-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 6681 microversion: 2.86 time: 0.048407 Jul 31 01:07:35.704601 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 225/454] 10.222.0.45 () {60 vars in 1187 bytes} [Sun Jul 31 01:07:35 2022] GET /compute/v2.1/flavors/detail => generated 6681 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:35.715253 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c8ddcc40-be3d-4720-be43-0a5aed4ae7e5 tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Calling method '.version_select at 0x7fede5e1f8b0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:35.716247 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:35.716247 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:35.717278 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c8ddcc40-be3d-4720-be43-0a5aed4ae7e5 tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '5e96f2eeef6d4c25971e8fa214241c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ac98ab4908474fb99f7c904a45ed1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c8ddcc40-be3d-4720-be43-0a5aed4ae7e5 tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Request method failure captured: Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-hosts/n-d-master-1/reboot HTTP/1.1 Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dXRXiHWswbnkeb5dYdW6p8vIAyagliAuWJ1unw2wzRIAnpa15tLsYfsvkRzV_zRi8RmuXvyEQhfXfhUORmYHEOFatv7tM2xDmxVrCOFYEEpSD6YPF44NdXv3x8qt7EGgneVmrmdbcmSvenAbxdqFwwI1xJOjk4zBwyTuZJOGvDKHwc Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 62ac98ab4908474fb99f7c904a45ed1c Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:07:35.718846 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:07:35.720331 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_62ac98ab4908474fb99f7c904a45ed1c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:35.720331 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:35.720331 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 62ac98ab4908474fb99f7c904a45ed1c Jul 31 01:07:35.720331 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:35.720331 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-HostsAdminNegativeTestJSON-4879321-project Jul 31 01:07:35.720331 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:07:35.720331 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:07:35.720331 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 5e96f2eeef6d4c25971e8fa214241c05 Jul 31 01:07:35.720331 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-HostsAdminNegativeTestJSON-4879321-project Jul 31 01:07:35.720331 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:07:35.720331 n-d-master-1 devstack@n-api.service[119475]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 31 01:07:35.720331 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'n-d-master-1'} Jul 31 01:07:35.720331 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:07:35.721167 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 31 01:07:35.722410 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:35.723319 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c8ddcc40-be3d-4720-be43-0a5aed4ae7e5 tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:35.723319 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c8ddcc40-be3d-4720-be43-0a5aed4ae7e5 tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] 10.222.0.45 "GET /compute/v2.1/os-hosts/n-d-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.014406 Jul 31 01:07:35.725359 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 226/455] 10.222.0.45 () {58 vars in 1188 bytes} [Sun Jul 31 01:07:35 2022] GET /compute/v2.1/os-hosts/n-d-master-1/reboot => generated 111 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:35.730181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ac624a2c-6294-4259-ae84-e62ab6af4607 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:35.731045 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ac624a2c-6294-4259-ae84-e62ab6af4607 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:35.738825 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac624a2c-6294-4259-ae84-e62ab6af4607 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:35.739419 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac624a2c-6294-4259-ae84-e62ab6af4607 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:35.740487 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac624a2c-6294-4259-ae84-e62ab6af4607 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:35.740924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac624a2c-6294-4259-ae84-e62ab6af4607 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:35.939151 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-ac624a2c-6294-4259-ae84-e62ab6af4607 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:35.976357 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ac624a2c-6294-4259-ae84-e62ab6af4607 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1927 microversion: 2.75 time: 0.249798 Jul 31 01:07:35.980629 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 227/456] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:35 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1927 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:35.986744 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-078e8e9e-08d8-4f1c-9285-ca8f3743f7b7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:35.991563 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-078e8e9e-08d8-4f1c-9285-ca8f3743f7b7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:36.011286 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-078e8e9e-08d8-4f1c-9285-ca8f3743f7b7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:36.011758 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-078e8e9e-08d8-4f1c-9285-ca8f3743f7b7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:36.012571 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-078e8e9e-08d8-4f1c-9285-ca8f3743f7b7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:36.013012 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-078e8e9e-08d8-4f1c-9285-ca8f3743f7b7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:36.382937 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-078e8e9e-08d8-4f1c-9285-ca8f3743f7b7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:36.393604 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-078e8e9e-08d8-4f1c-9285-ca8f3743f7b7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1471 microversion: 2.1 time: 0.411543 Jul 31 01:07:36.394849 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 228/457] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:35 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1471 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:36.407897 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d8b4b603-ac56-4084-861f-05827722a27f tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Calling method '.version_select at 0x7fede5fde700>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:36.409014 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:36.409014 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:36.423755 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-d8b4b603-ac56-4084-861f-05827722a27f tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d8b4b603-ac56-4084-861f-05827722a27f tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Request method failure captured: Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dXTkSFL7DMiWL294HbkgC9JtVUjAoiKAgyGKxDGt6DutNH2Nvd9gF00Ebaw9pJB99B49aXCE4T-oaDls0L17IoRoRUL2ebjfeaEmjHprkLJ1-48po0mWD1-7vQ7-0-7IbRLGwpoVXr33h55dxVd05fPgo5J5XFzmmd2R3Poql4VFPA Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 9f8e3930935a4038b2a280d97c29b364 Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:07:36.428440 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:07:36.429783 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9f8e3930935a4038b2a280d97c29b364", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:36.429783 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:36.429783 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 9f8e3930935a4038b2a280d97c29b364 Jul 31 01:07:36.429783 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:36.429783 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-HostsAdminNegativeTestJSON-123426043-project-admin Jul 31 01:07:36.429783 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:07:36.429783 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:07:36.429783 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 99083ddc9d6a426f88a1c44cdcc36d34 Jul 31 01:07:36.429783 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-HostsAdminNegativeTestJSON-123426043-project-admin Jul 31 01:07:36.429783 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:07:36.429783 n-d-master-1 devstack@n-api.service[119475]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:36.429783 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'nonexistent_hostname'} Jul 31 01:07:36.429783 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:07:36.430789 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 31 01:07:36.432032 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:07:36.433130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:36.433130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:36.433130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:36.433130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:36.433130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:36.433130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:36.433130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:36.433130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:07:36.433130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:07:36.433130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:36.433130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:36.438382 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d8b4b603-ac56-4084-861f-05827722a27f tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:36.440346 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d8b4b603-ac56-4084-861f-05827722a27f tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.044137 Jul 31 01:07:36.442851 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 229/458] 10.222.0.45 () {58 vars in 1212 bytes} [Sun Jul 31 01:07:36 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:07:36.481784 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-15353bc6-916a-4041-a1ae-9f53c8978422 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:36.483861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-15353bc6-916a-4041-a1ae-9f53c8978422 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:36.503475 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-15353bc6-916a-4041-a1ae-9f53c8978422 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:36.504162 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-15353bc6-916a-4041-a1ae-9f53c8978422 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:36.506143 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-15353bc6-916a-4041-a1ae-9f53c8978422 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:36.506797 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-15353bc6-916a-4041-a1ae-9f53c8978422 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:37.009330 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-15353bc6-916a-4041-a1ae-9f53c8978422 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:37.023551 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-15353bc6-916a-4041-a1ae-9f53c8978422 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1310 microversion: 2.1 time: 0.573932 Jul 31 01:07:37.036985 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 230/459] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:36 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1310 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:37.036985 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fd17b480-3e3a-4a10-8bf5-a18bdafc310e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:37.038028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fd17b480-3e3a-4a10-8bf5-a18bdafc310e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:37.050488 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd17b480-3e3a-4a10-8bf5-a18bdafc310e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:37.051798 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd17b480-3e3a-4a10-8bf5-a18bdafc310e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:37.052707 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd17b480-3e3a-4a10-8bf5-a18bdafc310e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:37.053453 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd17b480-3e3a-4a10-8bf5-a18bdafc310e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:37.218974 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fd17b480-3e3a-4a10-8bf5-a18bdafc310e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "POST /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba/action" status: 204 len: 0 microversion: 2.1 time: 0.193276 Jul 31 01:07:37.220180 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 231/460] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:07:37 2022] POST /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba/action => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:07:37.229009 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fe8a29fe-ddca-465a-a245-30ca68075d81 tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Calling method '.version_select at 0x7fede5e9b1f0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:37.230131 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:37.230131 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:37.231624 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fe8a29fe-ddca-465a-a245-30ca68075d81 tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '5e96f2eeef6d4c25971e8fa214241c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ac98ab4908474fb99f7c904a45ed1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fe8a29fe-ddca-465a-a245-30ca68075d81 tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Request method failure captured: Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dXRXiHWswbnkeb5dYdW6p8vIAyagliAuWJ1unw2wzRIAnpa15tLsYfsvkRzV_zRi8RmuXvyEQhfXfhUORmYHEOFatv7tM2xDmxVrCOFYEEpSD6YPF44NdXv3x8qt7EGgneVmrmdbcmSvenAbxdqFwwI1xJOjk4zBwyTuZJOGvDKHwc Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 62ac98ab4908474fb99f7c904a45ed1c Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:07:37.233574 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:07:37.237229 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_62ac98ab4908474fb99f7c904a45ed1c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:37.237229 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:37.237229 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 62ac98ab4908474fb99f7c904a45ed1c Jul 31 01:07:37.237229 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:37.237229 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-HostsAdminNegativeTestJSON-4879321-project Jul 31 01:07:37.237229 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:07:37.237229 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:07:37.237229 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 5e96f2eeef6d4c25971e8fa214241c05 Jul 31 01:07:37.237229 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-HostsAdminNegativeTestJSON-4879321-project Jul 31 01:07:37.237229 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:07:37.237229 n-d-master-1 devstack@n-api.service[119475]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 31 01:07:37.237229 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'n-d-master-1'} Jul 31 01:07:37.237229 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:07:37.238005 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 31 01:07:37.239457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:37.242149 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fe8a29fe-ddca-465a-a245-30ca68075d81 tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:37.244492 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fe8a29fe-ddca-465a-a245-30ca68075d81 tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] 10.222.0.45 "GET /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 109 microversion: 2.1 time: 0.021743 Jul 31 01:07:37.245839 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 232/461] 10.222.0.45 () {58 vars in 1167 bytes} [Sun Jul 31 01:07:37 2022] GET /compute/v2.1/os-hosts/n-d-master-1 => generated 109 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:37.252502 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a90ba01c-8194-4c7a-bc57-6c614bb64388 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:37.253404 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a90ba01c-8194-4c7a-bc57-6c614bb64388 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:37.262195 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a90ba01c-8194-4c7a-bc57-6c614bb64388 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:37.262570 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a90ba01c-8194-4c7a-bc57-6c614bb64388 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:37.263487 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a90ba01c-8194-4c7a-bc57-6c614bb64388 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:37.264138 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a90ba01c-8194-4c7a-bc57-6c614bb64388 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:37.982633 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a90ba01c-8194-4c7a-bc57-6c614bb64388 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:37.991876 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a90ba01c-8194-4c7a-bc57-6c614bb64388 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 200 len: 1391 microversion: 2.1 time: 0.744693 Jul 31 01:07:37.995511 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 233/462] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:37 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 1391 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:38.008630 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-92257f76-476e-4f08-8627-b49ab4512ac5 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:38.009245 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-92257f76-476e-4f08-8627-b49ab4512ac5 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:38.023241 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92257f76-476e-4f08-8627-b49ab4512ac5 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:38.023997 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92257f76-476e-4f08-8627-b49ab4512ac5 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:38.025144 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92257f76-476e-4f08-8627-b49ab4512ac5 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:38.026332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92257f76-476e-4f08-8627-b49ab4512ac5 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:38.178976 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-92257f76-476e-4f08-8627-b49ab4512ac5 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:38.202514 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-92257f76-476e-4f08-8627-b49ab4512ac5 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1927 microversion: 2.75 time: 0.197528 Jul 31 01:07:38.205769 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 234/463] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:38 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1927 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:38.213877 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0ece35f5-2420-490a-9d88-27d1cf2ed4d1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:38.214657 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0ece35f5-2420-490a-9d88-27d1cf2ed4d1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:38.221692 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ece35f5-2420-490a-9d88-27d1cf2ed4d1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:38.222811 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ece35f5-2420-490a-9d88-27d1cf2ed4d1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:38.223830 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ece35f5-2420-490a-9d88-27d1cf2ed4d1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:38.224901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ece35f5-2420-490a-9d88-27d1cf2ed4d1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:38.596258 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e1f72f6f-c374-4b97-ab48-c90e970e3000 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2/action" status: 202 len: 0 microversion: 2.25 time: 4.385306 Jul 31 01:07:38.596922 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 230/464] 10.222.0.45 () {62 vars in 1319 bytes} [Sun Jul 31 01:07:34 2022] POST /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2/action => generated 0 bytes in 4387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:07:38.602006 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-08631a87-da1e-4366-b246-7a01cf860e11 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Calling method '.version_select at 0x7fede5b60160>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:38.602813 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:38.602813 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:38.635440 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-08631a87-da1e-4366-b246-7a01cf860e11 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-08631a87-da1e-4366-b246-7a01cf860e11 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Request method failure captured: Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXTkSFL7DMiWL294HbkgC9JtVUjAoiKAgyGKxDGt6DutNH2Nvd9gF00Ebaw9pJB99B49aXCE4T-oaDls0L17IoRoRUL2ebjfeaEmjHprkLJ1-48po0mWD1-7vQ7-0-7IbRLGwpoVXr33h55dxVd05fPgo5J5XFzmmd2R3Poql4VFPA Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 9f8e3930935a4038b2a280d97c29b364 Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:07:38.637626 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:07:38.638819 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9f8e3930935a4038b2a280d97c29b364", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:38.638819 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:38.638819 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 9f8e3930935a4038b2a280d97c29b364 Jul 31 01:07:38.638819 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:38.638819 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-HostsAdminNegativeTestJSON-123426043-project-admin Jul 31 01:07:38.638819 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:07:38.638819 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:07:38.638819 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 99083ddc9d6a426f88a1c44cdcc36d34 Jul 31 01:07:38.638819 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-HostsAdminNegativeTestJSON-123426043-project-admin Jul 31 01:07:38.638819 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:07:38.638819 n-d-master-1 devstack@n-api.service[119474]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:38.638819 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'nonexistent_hostname'} Jul 31 01:07:38.638819 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:38.639691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:38.640740 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:38.641825 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-08631a87-da1e-4366-b246-7a01cf860e11 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:38.641825 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-08631a87-da1e-4366-b246-7a01cf860e11 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.041031 Jul 31 01:07:38.641825 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 231/465] 10.222.0.45 () {58 vars in 1191 bytes} [Sun Jul 31 01:07:38 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:07:38.654332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-097ed591-d41f-48c7-82af-91c485038e21 req-9631aa6e-0bae-484b-b6d2-f7752213b69b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "328017bc-1f5e-4680-9c77-f5eefbce8135", "tag": "f6d2a872-7a8a-4fce-a428-700f7792e65f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:38.660075 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0ece35f5-2420-490a-9d88-27d1cf2ed4d1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:38.667049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-097ed591-d41f-48c7-82af-91c485038e21 req-9631aa6e-0bae-484b-b6d2-f7752213b69b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:38.668065 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-097ed591-d41f-48c7-82af-91c485038e21 req-9631aa6e-0bae-484b-b6d2-f7752213b69b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:38.676706 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0ece35f5-2420-490a-9d88-27d1cf2ed4d1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1471 microversion: 2.1 time: 0.465758 Jul 31 01:07:38.683748 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-097ed591-d41f-48c7-82af-91c485038e21 req-9631aa6e-0bae-484b-b6d2-f7752213b69b service nova] Creating event network-changed:f6d2a872-7a8a-4fce-a428-700f7792e65f for instance 328017bc-1f5e-4680-9c77-f5eefbce8135 on n-h2-master-1 Jul 31 01:07:38.687806 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 235/466] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:38 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1471 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:38.699100 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-097ed591-d41f-48c7-82af-91c485038e21 req-9631aa6e-0bae-484b-b6d2-f7752213b69b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053965 Jul 31 01:07:38.700168 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 232/467] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:38.707597 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-377129c3-7684-4a23-92d2-f67f7232d553 req-9895f2af-5049-43b0-b6c9-16a4e6d320ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "389e7feb-f45c-4e78-ad80-6a5d230e68ba", "name": "network-vif-plugged", "status": "completed", "tag": "59525f1d-b7cd-4a9a-86cf-0466f0ad21ef"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:38.708418 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-480bb6a2-2560-44e7-8eaf-063ff7969ac7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:38.709125 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-480bb6a2-2560-44e7-8eaf-063ff7969ac7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:38.717775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-480bb6a2-2560-44e7-8eaf-063ff7969ac7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:38.719443 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-480bb6a2-2560-44e7-8eaf-063ff7969ac7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:38.720850 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-480bb6a2-2560-44e7-8eaf-063ff7969ac7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:38.721286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-480bb6a2-2560-44e7-8eaf-063ff7969ac7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:38.723784 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-377129c3-7684-4a23-92d2-f67f7232d553 req-9895f2af-5049-43b0-b6c9-16a4e6d320ea service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:38.724384 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-377129c3-7684-4a23-92d2-f67f7232d553 req-9895f2af-5049-43b0-b6c9-16a4e6d320ea service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:38.736550 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:38.739240 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-377129c3-7684-4a23-92d2-f67f7232d553 req-9895f2af-5049-43b0-b6c9-16a4e6d320ea service nova] Creating event network-vif-plugged:59525f1d-b7cd-4a9a-86cf-0466f0ad21ef for instance 389e7feb-f45c-4e78-ad80-6a5d230e68ba on n-h2-master-1 Jul 31 01:07:38.746681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-377129c3-7684-4a23-92d2-f67f7232d553 req-9895f2af-5049-43b0-b6c9-16a4e6d320ea service nova] Instance 389e7feb-f45c-4e78-ad80-6a5d230e68ba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:07:38.760238 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-377129c3-7684-4a23-92d2-f67f7232d553 req-9895f2af-5049-43b0-b6c9-16a4e6d320ea service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070278 Jul 31 01:07:38.761259 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 236/468] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:39.141075 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d3518749-6511-463c-8119-6e3dba09b7ac tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Calling method '.version_select at 0x7fede5c9b310>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:39.143374 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:39.143374 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:39.144411 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3518749-6511-463c-8119-6e3dba09b7ac tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:39.144866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3518749-6511-463c-8119-6e3dba09b7ac tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:39.175608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3518749-6511-463c-8119-6e3dba09b7ac tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:39.176566 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3518749-6511-463c-8119-6e3dba09b7ac tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:39.217942 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3518749-6511-463c-8119-6e3dba09b7ac tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:39.218925 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3518749-6511-463c-8119-6e3dba09b7ac tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:39.229299 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d3518749-6511-463c-8119-6e3dba09b7ac tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.465039 Jul 31 01:07:39.230342 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 237/469] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:07:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:39.237021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-46f5f91c-0fde-4901-a233-be9255c29b2b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:39.237873 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-46f5f91c-0fde-4901-a233-be9255c29b2b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:39.244419 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46f5f91c-0fde-4901-a233-be9255c29b2b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:39.245082 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46f5f91c-0fde-4901-a233-be9255c29b2b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:39.245932 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46f5f91c-0fde-4901-a233-be9255c29b2b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:39.246471 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46f5f91c-0fde-4901-a233-be9255c29b2b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:39.396020 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-480bb6a2-2560-44e7-8eaf-063ff7969ac7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:39.403522 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-480bb6a2-2560-44e7-8eaf-063ff7969ac7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1310 microversion: 2.1 time: 0.701842 Jul 31 01:07:39.417335 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 233/470] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:38 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1310 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:39.422554 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-80734851-ae6b-45d9-acc2-3c33311d46bd tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Calling method '.version_select at 0x7fede5f819d0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:39.423733 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:39.423733 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:39.425165 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-80734851-ae6b-45d9-acc2-3c33311d46bd tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '5e96f2eeef6d4c25971e8fa214241c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ac98ab4908474fb99f7c904a45ed1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-80734851-ae6b-45d9-acc2-3c33311d46bd tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Request method failure captured: Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-hosts/n-d-master-1/shutdown HTTP/1.1 Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXRXiHWswbnkeb5dYdW6p8vIAyagliAuWJ1unw2wzRIAnpa15tLsYfsvkRzV_zRi8RmuXvyEQhfXfhUORmYHEOFatv7tM2xDmxVrCOFYEEpSD6YPF44NdXv3x8qt7EGgneVmrmdbcmSvenAbxdqFwwI1xJOjk4zBwyTuZJOGvDKHwc Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 62ac98ab4908474fb99f7c904a45ed1c Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:07:39.427033 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:07:39.428295 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_62ac98ab4908474fb99f7c904a45ed1c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:39.428295 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:39.428295 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 62ac98ab4908474fb99f7c904a45ed1c Jul 31 01:07:39.428295 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:39.428295 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-HostsAdminNegativeTestJSON-4879321-project Jul 31 01:07:39.428295 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:07:39.428295 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:07:39.428295 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 5e96f2eeef6d4c25971e8fa214241c05 Jul 31 01:07:39.428295 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-HostsAdminNegativeTestJSON-4879321-project Jul 31 01:07:39.428295 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:07:39.428295 n-d-master-1 devstack@n-api.service[119474]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 31 01:07:39.428295 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'n-d-master-1'} Jul 31 01:07:39.428295 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:07:39.429711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 31 01:07:39.430835 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:39.433573 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-80734851-ae6b-45d9-acc2-3c33311d46bd tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:39.434656 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-80734851-ae6b-45d9-acc2-3c33311d46bd tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] 10.222.0.45 "GET /compute/v2.1/os-hosts/n-d-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.015971 Jul 31 01:07:39.440763 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 234/471] 10.222.0.45 () {58 vars in 1194 bytes} [Sun Jul 31 01:07:39 2022] GET /compute/v2.1/os-hosts/n-d-master-1/shutdown => generated 113 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:39.447495 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-d2894333-5189-4893-8ba5-16e92c02a73b req-3a0597fd-e629-45e4-86b4-5f5374ad29bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff233d7d-7f8e-4283-a902-d08ed1a3fc1e", "tag": "fc8d9300-899d-427a-9306-149f14484267"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:39.460521 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d2894333-5189-4893-8ba5-16e92c02a73b req-3a0597fd-e629-45e4-86b4-5f5374ad29bd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:39.461121 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d2894333-5189-4893-8ba5-16e92c02a73b req-3a0597fd-e629-45e4-86b4-5f5374ad29bd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:39.474263 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-d2894333-5189-4893-8ba5-16e92c02a73b req-3a0597fd-e629-45e4-86b4-5f5374ad29bd service nova] Creating event network-changed:fc8d9300-899d-427a-9306-149f14484267 for instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e on n-h2-master-1 Jul 31 01:07:39.480266 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-d2894333-5189-4893-8ba5-16e92c02a73b req-3a0597fd-e629-45e4-86b4-5f5374ad29bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039043 Jul 31 01:07:39.481130 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 235/472] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:39.489451 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ee26606b-62e7-4798-93c9-1dbbc077f11e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:39.490386 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ee26606b-62e7-4798-93c9-1dbbc077f11e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:39.498440 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee26606b-62e7-4798-93c9-1dbbc077f11e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:39.499328 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee26606b-62e7-4798-93c9-1dbbc077f11e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:39.501004 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee26606b-62e7-4798-93c9-1dbbc077f11e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:39.502044 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee26606b-62e7-4798-93c9-1dbbc077f11e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:39.737464 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-46f5f91c-0fde-4901-a233-be9255c29b2b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:39.749077 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-46f5f91c-0fde-4901-a233-be9255c29b2b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:39.751516 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-46f5f91c-0fde-4901-a233-be9255c29b2b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:39.754163 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-46f5f91c-0fde-4901-a233-be9255c29b2b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1566 microversion: 2.25 time: 0.522587 Jul 31 01:07:39.755045 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 238/473] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:39 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1566 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:39.760698 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6c54d633-00d8-473d-97c5-5ffde13c88df tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:39.761767 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6c54d633-00d8-473d-97c5-5ffde13c88df tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:39.764984 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:39.767895 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:39.773150 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c54d633-00d8-473d-97c5-5ffde13c88df tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:39.774176 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c54d633-00d8-473d-97c5-5ffde13c88df tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:39.775797 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c54d633-00d8-473d-97c5-5ffde13c88df tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:39.776442 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c54d633-00d8-473d-97c5-5ffde13c88df tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:39.893574 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ee26606b-62e7-4798-93c9-1dbbc077f11e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:39.903060 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ee26606b-62e7-4798-93c9-1dbbc077f11e tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 200 len: 1391 microversion: 2.1 time: 0.420438 Jul 31 01:07:39.904056 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 236/474] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:39 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 1391 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:39.960803 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-6c54d633-00d8-473d-97c5-5ffde13c88df tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:39.988577 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6c54d633-00d8-473d-97c5-5ffde13c88df tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1927 microversion: 2.75 time: 0.231445 Jul 31 01:07:39.999982 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 239/475] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:39 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1927 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:40.012136 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-84593eec-d1d3-4672-847d-4ee4506de6d4 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Calling method '.version_select at 0x7fede5e9b280>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:40.012969 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:40.012969 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:40.022380 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-84593eec-d1d3-4672-847d-4ee4506de6d4 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-84593eec-d1d3-4672-847d-4ee4506de6d4 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Request method failure captured: Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dXTkSFL7DMiWL294HbkgC9JtVUjAoiKAgyGKxDGt6DutNH2Nvd9gF00Ebaw9pJB99B49aXCE4T-oaDls0L17IoRoRUL2ebjfeaEmjHprkLJ1-48po0mWD1-7vQ7-0-7IbRLGwpoVXr33h55dxVd05fPgo5J5XFzmmd2R3Poql4VFPA Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 9f8e3930935a4038b2a280d97c29b364 Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:07:40.024338 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:07:40.025641 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9f8e3930935a4038b2a280d97c29b364", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:40.025641 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.025641 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 9f8e3930935a4038b2a280d97c29b364 Jul 31 01:07:40.025641 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.025641 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-HostsAdminNegativeTestJSON-123426043-project-admin Jul 31 01:07:40.025641 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:07:40.025641 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:07:40.025641 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 99083ddc9d6a426f88a1c44cdcc36d34 Jul 31 01:07:40.025641 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-HostsAdminNegativeTestJSON-123426043-project-admin Jul 31 01:07:40.025641 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:07:40.025641 n-d-master-1 devstack@n-api.service[119475]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:40.025641 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'nonexistent_hostname'} Jul 31 01:07:40.025641 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:07:40.026386 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 31 01:07:40.027595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:07:40.031517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:40.031517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.031517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.031517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.031517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.031517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.031517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.031517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:07:40.031517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:07:40.031517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:40.031517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.031517 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-84593eec-d1d3-4672-847d-4ee4506de6d4 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:40.031517 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-84593eec-d1d3-4672-847d-4ee4506de6d4 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.024086 Jul 31 01:07:40.031517 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 240/476] 10.222.0.45 () {58 vars in 1218 bytes} [Sun Jul 31 01:07:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:07:40.032599 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-84f95ebd-0cf5-4ff4-ae43-a17eadcdf2e0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:40.032599 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-84f95ebd-0cf5-4ff4-ae43-a17eadcdf2e0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:40.038559 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-84f95ebd-0cf5-4ff4-ae43-a17eadcdf2e0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:40.039014 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-84f95ebd-0cf5-4ff4-ae43-a17eadcdf2e0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:40.039825 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-84f95ebd-0cf5-4ff4-ae43-a17eadcdf2e0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:40.040272 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-84f95ebd-0cf5-4ff4-ae43-a17eadcdf2e0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:40.185555 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d9d3f3f0-4fd9-4061-b8c9-994fd6d70547 tempest-HypervisorAdminNegativeUnderV252Test-189244682 tempest-HypervisorAdminNegativeUnderV252Test-189244682-project] Calling method '.version_select at 0x7fede5ce8d30>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:40.186900 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:40.186900 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:40.189878 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d9d3f3f0-4fd9-4061-b8c9-994fd6d70547 tempest-HypervisorAdminNegativeUnderV252Test-189244682 tempest-HypervisorAdminNegativeUnderV252Test-189244682-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'fae9d50939c8418f8e59424797bf208a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6850e805894f5592aa54e8894d24be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d9d3f3f0-4fd9-4061-b8c9-994fd6d70547 tempest-HypervisorAdminNegativeUnderV252Test-189244682 tempest-HypervisorAdminNegativeUnderV252Test-189244682-project] Request method failure captured: Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-hypervisors/n-h1-master-1/search HTTP/1.1 Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXZsurqdyCk7LD7USPQM7qGoDZT55ib21C0Ja1JuyZXQwssKZHLNdRr4XQ8e5bLaVUlkBCg80Ow7DXe0aCqI05iGcZWWhx5qiVlTfzuQrvowe3EomPgnoUNhmg6OqzOUP4HdqmyVogWwsBV3c3SpypK7hnByAMmf_whXYQHD-t8bPA Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 4b6850e805894f5592aa54e8894d24be Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-189244682 Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:07:40.193133 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:07:40.194780 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4b6850e805894f5592aa54e8894d24be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4b6850e805894f5592aa54e8894d24be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4b6850e805894f5592aa54e8894d24be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4b6850e805894f5592aa54e8894d24be", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:40.194780 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-189244682 Jul 31 01:07:40.194780 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 4b6850e805894f5592aa54e8894d24be Jul 31 01:07:40.194780 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-189244682 Jul 31 01:07:40.194780 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-189244682-project Jul 31 01:07:40.194780 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:07:40.194780 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:07:40.194780 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: fae9d50939c8418f8e59424797bf208a Jul 31 01:07:40.194780 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-189244682-project Jul 31 01:07:40.194780 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:07:40.194780 n-d-master-1 devstack@n-api.service[119474]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 31 01:07:40.194780 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'n-h1-master-1'} Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:07:40.196045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 31 01:07:40.197818 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.200659 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d9d3f3f0-4fd9-4061-b8c9-994fd6d70547 tempest-HypervisorAdminNegativeUnderV252Test-189244682 tempest-HypervisorAdminNegativeUnderV252Test-189244682-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:40.202035 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d9d3f3f0-4fd9-4061-b8c9-994fd6d70547 tempest-HypervisorAdminNegativeUnderV252Test-189244682 tempest-HypervisorAdminNegativeUnderV252Test-189244682-project] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.296679 Jul 31 01:07:40.202748 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 237/477] 10.222.0.45 () {58 vars in 1209 bytes} [Sun Jul 31 01:07:39 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 117 bytes in 298 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:40.209877 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b744f355-d8da-4027-91ff-18f033594933 tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Calling method '.version_select at 0x7fede5b7b700>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:40.211048 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:40.211048 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:40.212811 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b744f355-d8da-4027-91ff-18f033594933 tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '5e96f2eeef6d4c25971e8fa214241c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ac98ab4908474fb99f7c904a45ed1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b744f355-d8da-4027-91ff-18f033594933 tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Request method failure captured: Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-hosts/n-d-master-1/startup HTTP/1.1 Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXRXiHWswbnkeb5dYdW6p8vIAyagliAuWJ1unw2wzRIAnpa15tLsYfsvkRzV_zRi8RmuXvyEQhfXfhUORmYHEOFatv7tM2xDmxVrCOFYEEpSD6YPF44NdXv3x8qt7EGgneVmrmdbcmSvenAbxdqFwwI1xJOjk4zBwyTuZJOGvDKHwc Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 62ac98ab4908474fb99f7c904a45ed1c Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:07:40.215296 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:07:40.216934 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_62ac98ab4908474fb99f7c904a45ed1c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:40.216934 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:40.216934 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 62ac98ab4908474fb99f7c904a45ed1c Jul 31 01:07:40.216934 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:40.216934 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-HostsAdminNegativeTestJSON-4879321-project Jul 31 01:07:40.216934 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:07:40.216934 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:07:40.216934 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 5e96f2eeef6d4c25971e8fa214241c05 Jul 31 01:07:40.216934 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-HostsAdminNegativeTestJSON-4879321-project Jul 31 01:07:40.216934 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:07:40.216934 n-d-master-1 devstack@n-api.service[119474]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 31 01:07:40.216934 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'n-d-master-1'} Jul 31 01:07:40.216934 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:07:40.218252 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 31 01:07:40.222555 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.225114 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b744f355-d8da-4027-91ff-18f033594933 tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:40.225114 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b744f355-d8da-4027-91ff-18f033594933 tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] 10.222.0.45 "GET /compute/v2.1/os-hosts/n-d-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.012793 Jul 31 01:07:40.225114 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 238/478] 10.222.0.45 () {58 vars in 1191 bytes} [Sun Jul 31 01:07:40 2022] GET /compute/v2.1/os-hosts/n-d-master-1/startup => generated 110 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:40.225114 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-820112bd-4801-42d1-9654-fe58ae625320 tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Calling method '.version_select at 0x7fede609c8b0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:40.225114 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-820112bd-4801-42d1-9654-fe58ae625320 tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:40.226077 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-820112bd-4801-42d1-9654-fe58ae625320 tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:40.238704 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-820112bd-4801-42d1-9654-fe58ae625320 tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-820112bd-4801-42d1-9654-fe58ae625320 tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Request method failure captured: Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXaftwB6BRMeuoF12wwYmSwOEb5gVmGsbQaUQThscyBznBPNfc3w4iHw9dPWNtoLNnmip4iHzsdISLDorzM8Nh9AFSju4RtA8q71dvdjbs2G7BiZCCxuc0iF9K7Ddry7BsFeoG5p1xZUXl9RPKcfgYyvU0QhA8KX9TWTe64FhJFjHw Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 4f9d8e417b1a449c8e36ce857e95986e Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-140287736 Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:07:40.240082 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:07:40.241329 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f9d8e417b1a449c8e36ce857e95986e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f9d8e417b1a449c8e36ce857e95986e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f9d8e417b1a449c8e36ce857e95986e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f9d8e417b1a449c8e36ce857e95986e", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:40.241329 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-140287736 Jul 31 01:07:40.241329 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 4f9d8e417b1a449c8e36ce857e95986e Jul 31 01:07:40.241329 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-140287736 Jul 31 01:07:40.241329 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin Jul 31 01:07:40.241329 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:07:40.241329 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:07:40.241329 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 0bad2ac1bcff4925b1097c8167718a60 Jul 31 01:07:40.241329 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin Jul 31 01:07:40.241329 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:07:40.241329 n-d-master-1 devstack@n-api.service[119474]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 31 01:07:40.241329 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.242174 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.243254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.243254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:07:40.243254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:07:40.243254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 31 01:07:40.243254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.245154 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-820112bd-4801-42d1-9654-fe58ae625320 tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:40.246225 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-820112bd-4801-42d1-9654-fe58ae625320 tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.027993 Jul 31 01:07:40.247947 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 239/479] 10.222.0.45 () {58 vars in 1251 bytes} [Sun Jul 31 01:07:40 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:40.258695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c01df2bb-2b39-412f-8318-e8c37a627c3e tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Calling method '.version_select at 0x7fede5b7b3a0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:40.259007 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-84f95ebd-0cf5-4ff4-ae43-a17eadcdf2e0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:40.263324 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-84f95ebd-0cf5-4ff4-ae43-a17eadcdf2e0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1471 microversion: 2.1 time: 0.235677 Jul 31 01:07:40.263954 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 241/480] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:40 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1471 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:40.266907 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-c01df2bb-2b39-412f-8318-e8c37a627c3e tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c01df2bb-2b39-412f-8318-e8c37a627c3e tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Request method failure captured: Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXTkSFL7DMiWL294HbkgC9JtVUjAoiKAgyGKxDGt6DutNH2Nvd9gF00Ebaw9pJB99B49aXCE4T-oaDls0L17IoRoRUL2ebjfeaEmjHprkLJ1-48po0mWD1-7vQ7-0-7IbRLGwpoVXr33h55dxVd05fPgo5J5XFzmmd2R3Poql4VFPA Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 9f8e3930935a4038b2a280d97c29b364 Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:07:40.269323 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:07:40.270470 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9f8e3930935a4038b2a280d97c29b364", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:40.270470 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.270470 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 9f8e3930935a4038b2a280d97c29b364 Jul 31 01:07:40.270470 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.270470 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-HostsAdminNegativeTestJSON-123426043-project-admin Jul 31 01:07:40.270470 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:07:40.270470 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:07:40.270470 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 99083ddc9d6a426f88a1c44cdcc36d34 Jul 31 01:07:40.270470 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-HostsAdminNegativeTestJSON-123426043-project-admin Jul 31 01:07:40.270470 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:07:40.270470 n-d-master-1 devstack@n-api.service[119474]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:40.270470 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'nonexistent_hostname'} Jul 31 01:07:40.270470 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:07:40.271212 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 31 01:07:40.272306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:07:40.273421 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:40.273421 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.273421 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.273421 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.273421 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.273421 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.273421 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.273421 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:07:40.273421 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:07:40.273421 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:40.273421 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.274035 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-48839d11-b831-4c8d-b7f6-e02395426d0e tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Calling method '.version_select at 0x7fede5fde700>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:40.274124 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c01df2bb-2b39-412f-8318-e8c37a627c3e tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:40.274209 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:40.274209 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:40.274334 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c01df2bb-2b39-412f-8318-e8c37a627c3e tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.021323 Jul 31 01:07:40.274405 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48839d11-b831-4c8d-b7f6-e02395426d0e tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:40.274405 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48839d11-b831-4c8d-b7f6-e02395426d0e tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:40.276581 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 240/481] 10.222.0.45 () {58 vars in 1215 bytes} [Sun Jul 31 01:07:40 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:07:40.282404 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e3d87d41-8515-44f6-804a-ebb328ef6c47 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Action: 'update', calling method: .version_select at 0x7fede5b251f0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:40.292832 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48839d11-b831-4c8d-b7f6-e02395426d0e tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:40.293385 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48839d11-b831-4c8d-b7f6-e02395426d0e tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e3d87d41-8515-44f6-804a-ebb328ef6c47 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Request method failure captured: Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 51 Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXTkSFL7DMiWL294HbkgC9JtVUjAoiKAgyGKxDGt6DutNH2Nvd9gF00Ebaw9pJB99B49aXCE4T-oaDls0L17IoRoRUL2ebjfeaEmjHprkLJ1-48po0mWD1-7vQ7-0-7IbRLGwpoVXr33h55dxVd05fPgo5J5XFzmmd2R3Poql4VFPA Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 9f8e3930935a4038b2a280d97c29b364 Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:07:40.294095 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:07:40.295593 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9f8e3930935a4038b2a280d97c29b364", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:40.295593 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.295593 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 9f8e3930935a4038b2a280d97c29b364 Jul 31 01:07:40.295593 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.295593 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-HostsAdminNegativeTestJSON-123426043-project-admin Jul 31 01:07:40.295593 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:07:40.295593 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:07:40.295593 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 99083ddc9d6a426f88a1c44cdcc36d34 Jul 31 01:07:40.295593 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-HostsAdminNegativeTestJSON-123426043-project-admin Jul 31 01:07:40.295593 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:07:40.295593 n-d-master-1 devstack@n-api.service[119474]: {"status": "enable", "maintenance_mode": "invalid"} Jul 31 01:07:40.295593 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:07:40.295593 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'disable', Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'Enable', Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'Disable', Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance: Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'invalid' Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.297105 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.302355 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.303812 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.303812 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:07:40.303812 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:07:40.303812 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 31 01:07:40.303812 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.303812 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e3d87d41-8515-44f6-804a-ebb328ef6c47 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:40.303812 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e3d87d41-8515-44f6-804a-ebb328ef6c47 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 199 microversion: 2.1 time: 0.018909 Jul 31 01:07:40.303812 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 241/482] 10.222.0.45 () {60 vars in 1187 bytes} [Sun Jul 31 01:07:40 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 199 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:07:40.308037 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aebf2763-8f9c-44f2-beb8-44d01fb4c76c tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Action: 'update', calling method: .version_select at 0x7fede5b253a0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aebf2763-8f9c-44f2-beb8-44d01fb4c76c tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Request method failure captured: Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 51 Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXTkSFL7DMiWL294HbkgC9JtVUjAoiKAgyGKxDGt6DutNH2Nvd9gF00Ebaw9pJB99B49aXCE4T-oaDls0L17IoRoRUL2ebjfeaEmjHprkLJ1-48po0mWD1-7vQ7-0-7IbRLGwpoVXr33h55dxVd05fPgo5J5XFzmmd2R3Poql4VFPA Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 9f8e3930935a4038b2a280d97c29b364 Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:07:40.311870 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:07:40.314543 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9f8e3930935a4038b2a280d97c29b364", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:40.314543 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.314543 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 9f8e3930935a4038b2a280d97c29b364 Jul 31 01:07:40.314543 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.314543 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-HostsAdminNegativeTestJSON-123426043-project-admin Jul 31 01:07:40.314543 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:07:40.314543 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:07:40.314543 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 99083ddc9d6a426f88a1c44cdcc36d34 Jul 31 01:07:40.314543 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-HostsAdminNegativeTestJSON-123426043-project-admin Jul 31 01:07:40.314543 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:07:40.314543 n-d-master-1 devstack@n-api.service[119474]: {"status": "invalid", "maintenance_mode": "enable"} Jul 31 01:07:40.314543 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:07:40.314543 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'disable', Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'Enable', Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'Disable', Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance: Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'invalid' Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.316162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.320497 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.322347 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.322347 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:07:40.322347 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:07:40.322347 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 31 01:07:40.322347 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.322347 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aebf2763-8f9c-44f2-beb8-44d01fb4c76c tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:40.322347 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aebf2763-8f9c-44f2-beb8-44d01fb4c76c tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 189 microversion: 2.1 time: 0.010123 Jul 31 01:07:40.322347 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 242/483] 10.222.0.45 () {60 vars in 1187 bytes} [Sun Jul 31 01:07:40 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 189 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:07:40.322835 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48839d11-b831-4c8d-b7f6-e02395426d0e tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:40.322835 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48839d11-b831-4c8d-b7f6-e02395426d0e tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:40.329103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eda96edb-390a-40cc-8bec-60f09d3d766a tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Action: 'update', calling method: .version_select at 0x7fede5b43a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:40.331615 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-48839d11-b831-4c8d-b7f6-e02395426d0e tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.066186 Jul 31 01:07:40.332726 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 242/484] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:07:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:40.333527 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:40.333527 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:40.335652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eda96edb-390a-40cc-8bec-60f09d3d766a tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '5e96f2eeef6d4c25971e8fa214241c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ac98ab4908474fb99f7c904a45ed1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eda96edb-390a-40cc-8bec-60f09d3d766a tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Request method failure captured: Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 50 Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXRXiHWswbnkeb5dYdW6p8vIAyagliAuWJ1unw2wzRIAnpa15tLsYfsvkRzV_zRi8RmuXvyEQhfXfhUORmYHEOFatv7tM2xDmxVrCOFYEEpSD6YPF44NdXv3x8qt7EGgneVmrmdbcmSvenAbxdqFwwI1xJOjk4zBwyTuZJOGvDKHwc Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 62ac98ab4908474fb99f7c904a45ed1c Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:07:40.337413 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:07:40.338913 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/62ac98ab4908474fb99f7c904a45ed1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_62ac98ab4908474fb99f7c904a45ed1c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:40.338913 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:40.338913 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 62ac98ab4908474fb99f7c904a45ed1c Jul 31 01:07:40.338913 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-4879321 Jul 31 01:07:40.338913 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-HostsAdminNegativeTestJSON-4879321-project Jul 31 01:07:40.338913 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:07:40.338913 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:07:40.338913 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 5e96f2eeef6d4c25971e8fa214241c05 Jul 31 01:07:40.338913 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-HostsAdminNegativeTestJSON-4879321-project Jul 31 01:07:40.338913 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:07:40.338913 n-d-master-1 devstack@n-api.service[119474]: {"status": "enable", "maintenance_mode": "enable"} Jul 31 01:07:40.338913 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:07:40.338913 n-d-master-1 devstack@n-api.service[119474]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 31 01:07:40.338913 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:07:40.341947 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 31 01:07:40.343094 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.345196 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eda96edb-390a-40cc-8bec-60f09d3d766a tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:40.345196 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eda96edb-390a-40cc-8bec-60f09d3d766a tempest-HostsAdminNegativeTestJSON-4879321 tempest-HostsAdminNegativeTestJSON-4879321-project] 10.222.0.45 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 111 microversion: 2.1 time: 0.014323 Jul 31 01:07:40.345196 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 243/485] 10.222.0.45 () {60 vars in 1187 bytes} [Sun Jul 31 01:07:40 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:40.345638 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-152497ca-8815-4ba3-bdc4-7f7dee3e381b tempest-HypervisorAdminNegativeUnderV252Test-189244682 tempest-HypervisorAdminNegativeUnderV252Test-189244682-project] Calling method '.version_select at 0x7fede5cdaca0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:40.345638 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:40.345638 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:40.346558 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-152497ca-8815-4ba3-bdc4-7f7dee3e381b tempest-HypervisorAdminNegativeUnderV252Test-189244682 tempest-HypervisorAdminNegativeUnderV252Test-189244682-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'fae9d50939c8418f8e59424797bf208a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6850e805894f5592aa54e8894d24be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-152497ca-8815-4ba3-bdc4-7f7dee3e381b tempest-HypervisorAdminNegativeUnderV252Test-189244682 tempest-HypervisorAdminNegativeUnderV252Test-189244682-project] Request method failure captured: Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dXZsurqdyCk7LD7USPQM7qGoDZT55ib21C0Ja1JuyZXQwssKZHLNdRr4XQ8e5bLaVUlkBCg80Ow7DXe0aCqI05iGcZWWhx5qiVlTfzuQrvowe3EomPgnoUNhmg6OqzOUP4HdqmyVogWwsBV3c3SpypK7hnByAMmf_whXYQHD-t8bPA Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 4b6850e805894f5592aa54e8894d24be Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-189244682 Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:07:40.348319 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:07:40.351160 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4b6850e805894f5592aa54e8894d24be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4b6850e805894f5592aa54e8894d24be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4b6850e805894f5592aa54e8894d24be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4b6850e805894f5592aa54e8894d24be", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:40.351160 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-189244682 Jul 31 01:07:40.351160 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 4b6850e805894f5592aa54e8894d24be Jul 31 01:07:40.351160 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-189244682 Jul 31 01:07:40.351160 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-189244682-project Jul 31 01:07:40.351160 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:07:40.351160 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:07:40.351160 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: fae9d50939c8418f8e59424797bf208a Jul 31 01:07:40.351160 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-189244682-project Jul 31 01:07:40.351160 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:07:40.351160 n-d-master-1 devstack@n-api.service[119475]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 31 01:07:40.351160 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '1'} Jul 31 01:07:40.351160 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:07:40.353145 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 31 01:07:40.354557 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.356392 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-152497ca-8815-4ba3-bdc4-7f7dee3e381b tempest-HypervisorAdminNegativeUnderV252Test-189244682 tempest-HypervisorAdminNegativeUnderV252Test-189244682-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:40.356392 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-152497ca-8815-4ba3-bdc4-7f7dee3e381b tempest-HypervisorAdminNegativeUnderV252Test-189244682 tempest-HypervisorAdminNegativeUnderV252Test-189244682-project] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009257 Jul 31 01:07:40.356652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ae84111-c70b-4d5d-9f43-896766264367 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Action: 'update', calling method: .version_select at 0x7fede5b25b80>, body: {"status": null, "maintenance_mode": null} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:40.356791 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 243/486] 10.222.0.45 () {58 vars in 1176 bytes} [Sun Jul 31 01:07:40 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ae84111-c70b-4d5d-9f43-896766264367 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Request method failure captured: Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 42 Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXTkSFL7DMiWL294HbkgC9JtVUjAoiKAgyGKxDGt6DutNH2Nvd9gF00Ebaw9pJB99B49aXCE4T-oaDls0L17IoRoRUL2ebjfeaEmjHprkLJ1-48po0mWD1-7vQ7-0-7IbRLGwpoVXr33h55dxVd05fPgo5J5XFzmmd2R3Poql4VFPA Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 9f8e3930935a4038b2a280d97c29b364 Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:07:40.356920 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:07:40.360858 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9f8e3930935a4038b2a280d97c29b364", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:40.360858 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.360858 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 9f8e3930935a4038b2a280d97c29b364 Jul 31 01:07:40.360858 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.360858 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-HostsAdminNegativeTestJSON-123426043-project-admin Jul 31 01:07:40.360858 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:07:40.360858 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:07:40.360858 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 99083ddc9d6a426f88a1c44cdcc36d34 Jul 31 01:07:40.360858 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-HostsAdminNegativeTestJSON-123426043-project-admin Jul 31 01:07:40.360858 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:07:40.360858 n-d-master-1 devstack@n-api.service[119474]: {"status": null, "maintenance_mode": null} Jul 31 01:07:40.360858 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:07:40.360858 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 31 01:07:40.360858 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'n-d-master-1', 'body': {'status': None, 'maintenance_mode': None}} Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'disable', Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'Enable', Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'Disable', Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance: Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi None Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.363014 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.365465 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.366778 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:07:40.366778 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:07:40.366778 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 31 01:07:40.366778 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.366778 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ae84111-c70b-4d5d-9f43-896766264367 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:40.366778 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0ae84111-c70b-4d5d-9f43-896766264367 tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 127 microversion: 2.1 time: 0.010621 Jul 31 01:07:40.366778 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 244/487] 10.222.0.45 () {60 vars in 1187 bytes} [Sun Jul 31 01:07:40 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:07:40.372538 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-01d0b138-4a90-4be5-a4fd-8b724191280a tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Action: 'update', calling method: .version_select at 0x7fede5acc8b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:40.373332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3adca821-cd7d-4951-9b18-1a58143cf6aa tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Calling method '.version_select at 0x7fede5d30160>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:40.377621 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3adca821-cd7d-4951-9b18-1a58143cf6aa tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:40.378281 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.hosts [None req-01d0b138-4a90-4be5-a4fd-8b724191280a tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Enabling host nonexistent_hostname. Jul 31 01:07:40.378404 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3adca821-cd7d-4951-9b18-1a58143cf6aa tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:40.387492 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-01d0b138-4a90-4be5-a4fd-8b724191280a tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-01d0b138-4a90-4be5-a4fd-8b724191280a tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Request method failure captured: Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 50 Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXTkSFL7DMiWL294HbkgC9JtVUjAoiKAgyGKxDGt6DutNH2Nvd9gF00Ebaw9pJB99B49aXCE4T-oaDls0L17IoRoRUL2ebjfeaEmjHprkLJ1-48po0mWD1-7vQ7-0-7IbRLGwpoVXr33h55dxVd05fPgo5J5XFzmmd2R3Poql4VFPA Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 9f8e3930935a4038b2a280d97c29b364 Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:07:40.390100 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:07:40.392415 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9f8e3930935a4038b2a280d97c29b364"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9f8e3930935a4038b2a280d97c29b364", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:40.392415 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.392415 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 9f8e3930935a4038b2a280d97c29b364 Jul 31 01:07:40.392415 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-123426043 Jul 31 01:07:40.392415 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-HostsAdminNegativeTestJSON-123426043-project-admin Jul 31 01:07:40.392415 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:07:40.392415 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:07:40.392415 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 99083ddc9d6a426f88a1c44cdcc36d34 Jul 31 01:07:40.392415 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-HostsAdminNegativeTestJSON-123426043-project-admin Jul 31 01:07:40.392415 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:07:40.392415 n-d-master-1 devstack@n-api.service[119474]: {"status": "enable", "maintenance_mode": "enable"} Jul 31 01:07:40.392415 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:07:40.392415 n-d-master-1 devstack@n-api.service[119474]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:40.392415 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 31 01:07:40.393698 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:07:40.396429 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 31 01:07:40.397541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 31 01:07:40.397541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 31 01:07:40.397541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:07:40.397541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:40.397541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.397541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.397541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.397541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.397541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.397541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.397541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:07:40.397541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:07:40.397541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 31 01:07:40.397541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.397541 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-01d0b138-4a90-4be5-a4fd-8b724191280a tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:40.398517 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-01d0b138-4a90-4be5-a4fd-8b724191280a tempest-HostsAdminNegativeTestJSON-123426043 tempest-HostsAdminNegativeTestJSON-123426043-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.023591 Jul 31 01:07:40.398517 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 245/488] 10.222.0.45 () {60 vars in 1211 bytes} [Sun Jul 31 01:07:40 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-3adca821-cd7d-4951-9b18-1a58143cf6aa tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] HTTP exception thrown: No hypervisor matching 'ab26c850-28a1-4930-a8ad-5a79d6a77d97' could be found. Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3adca821-cd7d-4951-9b18-1a58143cf6aa tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Request method failure captured: Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-hypervisors/ab26c850-28a1-4930-a8ad-5a79d6a77d97/servers HTTP/1.1 Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dXaftwB6BRMeuoF12wwYmSwOEb5gVmGsbQaUQThscyBznBPNfc3w4iHw9dPWNtoLNnmip4iHzsdISLDorzM8Nh9AFSju4RtA8q71dvdjbs2G7BiZCCxuc0iF9K7Ddry7BsFeoG5p1xZUXl9RPKcfgYyvU0QhA8KX9TWTe64FhJFjHw Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 4f9d8e417b1a449c8e36ce857e95986e Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-140287736 Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:07:40.398661 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:07:40.401827 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f9d8e417b1a449c8e36ce857e95986e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f9d8e417b1a449c8e36ce857e95986e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f9d8e417b1a449c8e36ce857e95986e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f9d8e417b1a449c8e36ce857e95986e", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:40.401827 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-140287736 Jul 31 01:07:40.401827 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 4f9d8e417b1a449c8e36ce857e95986e Jul 31 01:07:40.401827 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-140287736 Jul 31 01:07:40.401827 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin Jul 31 01:07:40.401827 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:07:40.401827 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:07:40.401827 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 0bad2ac1bcff4925b1097c8167718a60 Jul 31 01:07:40.401827 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin Jul 31 01:07:40.401827 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:07:40.401827 n-d-master-1 devstack@n-api.service[119475]: exception: No hypervisor matching 'ab26c850-28a1-4930-a8ad-5a79d6a77d97' could be found. Jul 31 01:07:40.401827 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'ab26c850-28a1-4930-a8ad-5a79d6a77d97'} Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'ab26c850-28a1-4930-a8ad-5a79d6a77d97' could be found. Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.402618 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:40.404521 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:40.404521 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:40.404521 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:07:40.404521 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:07:40.404521 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'ab26c850-28a1-4930-a8ad-5a79d6a77d97' could be found. Jul 31 01:07:40.404521 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:40.404521 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3adca821-cd7d-4951-9b18-1a58143cf6aa tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] Returning 404 to user: No hypervisor matching 'ab26c850-28a1-4930-a8ad-5a79d6a77d97' could be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:40.404521 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3adca821-cd7d-4951-9b18-1a58143cf6aa tempest-HypervisorAdminNegativeUnderV252Test-140287736 tempest-HypervisorAdminNegativeUnderV252Test-140287736-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/ab26c850-28a1-4930-a8ad-5a79d6a77d97/servers" status: 404 len: 123 microversion: 2.1 time: 0.032513 Jul 31 01:07:40.404521 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 244/489] 10.222.0.45 () {58 vars in 1281 bytes} [Sun Jul 31 01:07:40 2022] GET /compute/v2.1/os-hypervisors/ab26c850-28a1-4930-a8ad-5a79d6a77d97/servers => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:40.425846 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9cd06627-4849-4d9d-a958-59411e577656 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:40.426599 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9cd06627-4849-4d9d-a958-59411e577656 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:40.432857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cd06627-4849-4d9d-a958-59411e577656 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:40.433546 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cd06627-4849-4d9d-a958-59411e577656 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:40.434528 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cd06627-4849-4d9d-a958-59411e577656 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:40.435158 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cd06627-4849-4d9d-a958-59411e577656 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:40.619287 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9cd06627-4849-4d9d-a958-59411e577656 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:40.627403 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9cd06627-4849-4d9d-a958-59411e577656 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1310 microversion: 2.1 time: 0.206290 Jul 31 01:07:40.628488 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 246/490] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:40 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1310 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:07:40.782809 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-542996bc-22e5-4c98-aa5d-82cdac2c0671 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:40.783566 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-542996bc-22e5-4c98-aa5d-82cdac2c0671 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:40.791653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-542996bc-22e5-4c98-aa5d-82cdac2c0671 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:40.795833 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-542996bc-22e5-4c98-aa5d-82cdac2c0671 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:40.796786 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-542996bc-22e5-4c98-aa5d-82cdac2c0671 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:40.801056 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-542996bc-22e5-4c98-aa5d-82cdac2c0671 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:40.927298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-46319c3d-b2ab-446a-8e0d-9a2e49e9e3f9 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:40.927987 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-46319c3d-b2ab-446a-8e0d-9a2e49e9e3f9 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:40.935742 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=10 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:40.945556 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46319c3d-b2ab-446a-8e0d-9a2e49e9e3f9 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:40.946882 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46319c3d-b2ab-446a-8e0d-9a2e49e9e3f9 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:40.947936 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46319c3d-b2ab-446a-8e0d-9a2e49e9e3f9 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:40.950237 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46319c3d-b2ab-446a-8e0d-9a2e49e9e3f9 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:41.166860 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-542996bc-22e5-4c98-aa5d-82cdac2c0671 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:41.179299 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-542996bc-22e5-4c98-aa5d-82cdac2c0671 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:41.181866 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-542996bc-22e5-4c98-aa5d-82cdac2c0671 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:41.183952 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-542996bc-22e5-4c98-aa5d-82cdac2c0671 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1566 microversion: 2.25 time: 0.405891 Jul 31 01:07:41.185470 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 245/491] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:40 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1566 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:41.191761 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-595dd746-0748-4b71-a766-1d83d6f61b41 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:41.193047 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-595dd746-0748-4b71-a766-1d83d6f61b41 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:41.200071 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-595dd746-0748-4b71-a766-1d83d6f61b41 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:41.200789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-595dd746-0748-4b71-a766-1d83d6f61b41 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:41.202073 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-595dd746-0748-4b71-a766-1d83d6f61b41 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:41.203272 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-595dd746-0748-4b71-a766-1d83d6f61b41 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:41.364383 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-46319c3d-b2ab-446a-8e0d-9a2e49e9e3f9 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:41.372544 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-46319c3d-b2ab-446a-8e0d-9a2e49e9e3f9 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 200 len: 1391 microversion: 2.1 time: 0.450917 Jul 31 01:07:41.386435 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 247/492] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:40 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 1391 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:41.393035 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c088a6c3-9120-42be-ab39-029e308c9008 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:41.393951 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c088a6c3-9120-42be-ab39-029e308c9008 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:41.401603 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c088a6c3-9120-42be-ab39-029e308c9008 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:41.402133 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c088a6c3-9120-42be-ab39-029e308c9008 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:41.403003 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c088a6c3-9120-42be-ab39-029e308c9008 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:41.403491 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c088a6c3-9120-42be-ab39-029e308c9008 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:41.467230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-595dd746-0748-4b71-a766-1d83d6f61b41 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:41.520621 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-595dd746-0748-4b71-a766-1d83d6f61b41 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1927 microversion: 2.75 time: 0.333456 Jul 31 01:07:41.537033 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 246/493] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:41 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1927 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:41.675439 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c088a6c3-9120-42be-ab39-029e308c9008 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:41.684628 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c088a6c3-9120-42be-ab39-029e308c9008 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1463 microversion: 2.1 time: 0.296511 Jul 31 01:07:41.686164 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 248/494] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:41 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1463 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:41.704590 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-52f0c897-42d0-4a26-b092-a6ab6984c43c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:41.705232 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-52f0c897-42d0-4a26-b092-a6ab6984c43c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:41.716826 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52f0c897-42d0-4a26-b092-a6ab6984c43c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:41.717652 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52f0c897-42d0-4a26-b092-a6ab6984c43c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:41.718529 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52f0c897-42d0-4a26-b092-a6ab6984c43c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:41.719035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52f0c897-42d0-4a26-b092-a6ab6984c43c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:41.722162 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6e90ed1a-a94e-49ca-9826-c6a58275c585 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Calling method '.version_select at 0x7fede5f67820>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:41.723199 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:41.723199 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:41.724850 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e90ed1a-a94e-49ca-9826-c6a58275c585 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:41.725531 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e90ed1a-a94e-49ca-9826-c6a58275c585 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:41.749822 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e90ed1a-a94e-49ca-9826-c6a58275c585 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:41.753995 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e90ed1a-a94e-49ca-9826-c6a58275c585 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:41.776118 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e90ed1a-a94e-49ca-9826-c6a58275c585 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:41.776821 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e90ed1a-a94e-49ca-9826-c6a58275c585 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:41.786869 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6e90ed1a-a94e-49ca-9826-c6a58275c585 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.248535 Jul 31 01:07:41.788031 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 247/495] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:07:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:41.792890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4f555589-c776-4b15-8669-ff8ccf185b9b tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:41.793735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4f555589-c776-4b15-8669-ff8ccf185b9b tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:41.808385 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f555589-c776-4b15-8669-ff8ccf185b9b tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:41.809082 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f555589-c776-4b15-8669-ff8ccf185b9b tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:41.810548 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f555589-c776-4b15-8669-ff8ccf185b9b tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:41.811817 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f555589-c776-4b15-8669-ff8ccf185b9b tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:41.991515 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-52f0c897-42d0-4a26-b092-a6ab6984c43c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:42.003845 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-52f0c897-42d0-4a26-b092-a6ab6984c43c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1310 microversion: 2.1 time: 0.311035 Jul 31 01:07:42.004441 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 249/496] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:41 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1310 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:42.016973 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4a419a06-cd93-4249-9959-a0c968932065 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Calling method '.version_select at 0x7fede5ce8dc0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:42.017766 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:42.017766 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:42.021467 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a419a06-cd93-4249-9959-a0c968932065 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.022705 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a419a06-cd93-4249-9959-a0c968932065 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:42.054096 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a419a06-cd93-4249-9959-a0c968932065 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.055429 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a419a06-cd93-4249-9959-a0c968932065 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:42.089514 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4f555589-c776-4b15-8669-ff8ccf185b9b tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1614 microversion: 2.1 time: 0.298654 Jul 31 01:07:42.104990 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 248/497] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:41 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1614 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:42.117246 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a419a06-cd93-4249-9959-a0c968932065 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.117693 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a419a06-cd93-4249-9959-a0c968932065 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:42.122884 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-588772d4-ba33-4a30-8f90-cbd73cd058e3 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Calling method '.version_select at 0x7fede5ca2dc0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:42.127501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-588772d4-ba33-4a30-8f90-cbd73cd058e3 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.127953 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-588772d4-ba33-4a30-8f90-cbd73cd058e3 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:42.129310 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4a419a06-cd93-4249-9959-a0c968932065 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers" status: 200 len: 275 microversion: 2.1 time: 0.122894 Jul 31 01:07:42.130670 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 250/498] 10.222.0.45 () {58 vars in 1212 bytes} [Sun Jul 31 01:07:42 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers => generated 275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:42.140858 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-588772d4-ba33-4a30-8f90-cbd73cd058e3 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.024683 Jul 31 01:07:42.142369 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 249/499] 10.222.0.45 () {58 vars in 1143 bytes} [Sun Jul 31 01:07:42 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:42.146577 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1fe43dac-1900-4ff4-8e67-eee4970b7dd6 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Calling method '.version_select at 0x7fede5b258b0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:42.147498 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:42.147498 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:42.149756 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fe43dac-1900-4ff4-8e67-eee4970b7dd6 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.151006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fe43dac-1900-4ff4-8e67-eee4970b7dd6 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:42.168413 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fe43dac-1900-4ff4-8e67-eee4970b7dd6 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.168771 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fe43dac-1900-4ff4-8e67-eee4970b7dd6 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:42.186222 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fe43dac-1900-4ff4-8e67-eee4970b7dd6 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.187540 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fe43dac-1900-4ff4-8e67-eee4970b7dd6 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:42.197204 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1fe43dac-1900-4ff4-8e67-eee4970b7dd6 tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.058203 Jul 31 01:07:42.198541 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 251/500] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:07:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:42.211210 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ecc34b8a-eff3-40ec-aded-ccddf9388fb4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:42.212014 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ecc34b8a-eff3-40ec-aded-ccddf9388fb4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:42.216966 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7966d74e-f72f-4ba0-961c-38c46cc1e1fb tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Calling method '.version_select at 0x7fede5b25280>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:42.218564 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:42.218564 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:42.220221 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7966d74e-f72f-4ba0-961c-38c46cc1e1fb tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.222078 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecc34b8a-eff3-40ec-aded-ccddf9388fb4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.222527 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7966d74e-f72f-4ba0-961c-38c46cc1e1fb tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:42.223545 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecc34b8a-eff3-40ec-aded-ccddf9388fb4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:42.224631 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecc34b8a-eff3-40ec-aded-ccddf9388fb4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.225361 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecc34b8a-eff3-40ec-aded-ccddf9388fb4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:42.247870 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7966d74e-f72f-4ba0-961c-38c46cc1e1fb tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.248796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7966d74e-f72f-4ba0-961c-38c46cc1e1fb tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:42.258625 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7966d74e-f72f-4ba0-961c-38c46cc1e1fb tempest-HypervisorAdminUnderV252Test-1844584009 tempest-HypervisorAdminUnderV252Test-1844584009-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.049083 Jul 31 01:07:42.267649 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 252/501] 10.222.0.45 () {58 vars in 1209 bytes} [Sun Jul 31 01:07:42 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 104 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:42.358172 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b1c17837-70d6-41fe-8f27-510885dbfd6c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-638651020", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:42.458179 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ecc34b8a-eff3-40ec-aded-ccddf9388fb4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:42.483488 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ecc34b8a-eff3-40ec-aded-ccddf9388fb4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:42.488621 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ecc34b8a-eff3-40ec-aded-ccddf9388fb4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:42.492477 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ecc34b8a-eff3-40ec-aded-ccddf9388fb4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1566 microversion: 2.25 time: 0.285144 Jul 31 01:07:42.494580 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 250/502] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:42 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1566 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:42.512170 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4037998d-1f47-41aa-8461-2775e6a960ba tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:42.513745 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4037998d-1f47-41aa-8461-2775e6a960ba tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:42.533849 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-b1c17837-70d6-41fe-8f27-510885dbfd6c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] validate_networks() for None {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:07:42.542950 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4037998d-1f47-41aa-8461-2775e6a960ba tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.543457 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4037998d-1f47-41aa-8461-2775e6a960ba tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:42.544439 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4037998d-1f47-41aa-8461-2775e6a960ba tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.544897 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4037998d-1f47-41aa-8461-2775e6a960ba tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:42.871553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4037998d-1f47-41aa-8461-2775e6a960ba tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:42.882810 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4037998d-1f47-41aa-8461-2775e6a960ba tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 200 len: 1391 microversion: 2.1 time: 0.383971 Jul 31 01:07:42.883748 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 251/503] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:42 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 1391 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:42.900930 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-33c64d06-d0b4-4a18-8afb-2eca076e3268 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:42.902037 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-33c64d06-d0b4-4a18-8afb-2eca076e3268 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:42.910536 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33c64d06-d0b4-4a18-8afb-2eca076e3268 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.910999 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33c64d06-d0b4-4a18-8afb-2eca076e3268 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:42.913309 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33c64d06-d0b4-4a18-8afb-2eca076e3268 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.917884 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33c64d06-d0b4-4a18-8afb-2eca076e3268 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:42.921055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b1c17837-70d6-41fe-8f27-510885dbfd6c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:07:42.921716 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b1c17837-70d6-41fe-8f27-510885dbfd6c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:07:42.923816 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b1c17837-70d6-41fe-8f27-510885dbfd6c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:07:42.924581 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b1c17837-70d6-41fe-8f27-510885dbfd6c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:07:42.925429 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b1c17837-70d6-41fe-8f27-510885dbfd6c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:07:42.930645 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:42.954043 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1c17837-70d6-41fe-8f27-510885dbfd6c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.954446 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1c17837-70d6-41fe-8f27-510885dbfd6c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:42.955287 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1c17837-70d6-41fe-8f27-510885dbfd6c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:42.957996 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1c17837-70d6-41fe-8f27-510885dbfd6c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:43.017772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-b1c17837-70d6-41fe-8f27-510885dbfd6c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Getting quotas for project 87496179e992473c991977e0e517460a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:07:43.029423 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-33c64d06-d0b4-4a18-8afb-2eca076e3268 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:43.037959 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-b1c17837-70d6-41fe-8f27-510885dbfd6c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Getting quotas for user 9a2a0f61c8304c9a9ad7af6120e83443 and project 87496179e992473c991977e0e517460a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:07:43.059711 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b1c17837-70d6-41fe-8f27-510885dbfd6c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:07:43.072265 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-33c64d06-d0b4-4a18-8afb-2eca076e3268 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1927 microversion: 2.75 time: 0.186612 Jul 31 01:07:43.078356 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b1c17837-70d6-41fe-8f27-510885dbfd6c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:07:43.079405 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 252/504] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:42 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1927 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:43.104018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-57030e1a-78e0-446f-9df2-b96ad490c047 req-b460d331-349b-4a25-b2c6-ab2f54ff1d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2", "name": "network-vif-unplugged", "status": "completed", "tag": "79b2e09a-8171-4f0d-adc4-3e2dbf769ce6"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:43.139279 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-57030e1a-78e0-446f-9df2-b96ad490c047 req-b460d331-349b-4a25-b2c6-ab2f54ff1d1e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:43.139777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-57030e1a-78e0-446f-9df2-b96ad490c047 req-b460d331-349b-4a25-b2c6-ab2f54ff1d1e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:43.158093 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b1c17837-70d6-41fe-8f27-510885dbfd6c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805004 Jul 31 01:07:43.158929 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 253/505] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:07:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:07:43.165317 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-52ee534e-ff85-465a-a80c-a2add283950e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:43.166287 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-52ee534e-ff85-465a-a80c-a2add283950e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:43.174494 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52ee534e-ff85-465a-a80c-a2add283950e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:43.175419 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52ee534e-ff85-465a-a80c-a2add283950e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:43.176434 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52ee534e-ff85-465a-a80c-a2add283950e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:43.177095 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52ee534e-ff85-465a-a80c-a2add283950e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:43.177207 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-57030e1a-78e0-446f-9df2-b96ad490c047 req-b460d331-349b-4a25-b2c6-ab2f54ff1d1e service nova] Creating event network-vif-unplugged:79b2e09a-8171-4f0d-adc4-3e2dbf769ce6 for instance 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 on n-h1-master-1 Jul 31 01:07:43.189376 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-57030e1a-78e0-446f-9df2-b96ad490c047 req-b460d331-349b-4a25-b2c6-ab2f54ff1d1e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108489 Jul 31 01:07:43.190018 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 253/506] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:43.201842 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f9ab6975-21f7-4466-880b-b156d12a2c80 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:43.204878 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f9ab6975-21f7-4466-880b-b156d12a2c80 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:43.345353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f9ab6975-21f7-4466-880b-b156d12a2c80 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:43.356742 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f9ab6975-21f7-4466-880b-b156d12a2c80 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1212 microversion: 2.1 time: 0.165082 Jul 31 01:07:43.375135 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 254/507] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:43 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1212 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:43.451101 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-52ee534e-ff85-465a-a80c-a2add283950e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:43.467825 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-52ee534e-ff85-465a-a80c-a2add283950e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1310 microversion: 2.1 time: 0.307138 Jul 31 01:07:43.468387 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 254/508] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:43 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1310 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:43.520281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0afc55b4-5469-4fb2-ace7-8b57ca83193f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:43.521987 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0afc55b4-5469-4fb2-ace7-8b57ca83193f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:43.537081 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0afc55b4-5469-4fb2-ace7-8b57ca83193f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:43.538903 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0afc55b4-5469-4fb2-ace7-8b57ca83193f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:43.541975 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0afc55b4-5469-4fb2-ace7-8b57ca83193f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:43.543044 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0afc55b4-5469-4fb2-ace7-8b57ca83193f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:43.585272 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=12 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:43.904777 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8e56c32f-0fb3-445c-9a1f-6f4f270dd422 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:43.905576 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8e56c32f-0fb3-445c-9a1f-6f4f270dd422 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:43.916871 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e56c32f-0fb3-445c-9a1f-6f4f270dd422 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:43.917329 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e56c32f-0fb3-445c-9a1f-6f4f270dd422 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:43.918140 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e56c32f-0fb3-445c-9a1f-6f4f270dd422 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:43.918667 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e56c32f-0fb3-445c-9a1f-6f4f270dd422 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:44.005131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0afc55b4-5469-4fb2-ace7-8b57ca83193f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:44.037348 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0afc55b4-5469-4fb2-ace7-8b57ca83193f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:44.044581 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0afc55b4-5469-4fb2-ace7-8b57ca83193f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:44.048819 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0afc55b4-5469-4fb2-ace7-8b57ca83193f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1566 microversion: 2.25 time: 0.532562 Jul 31 01:07:44.057878 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 255/509] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:43 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1566 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:44.110798 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7c7c41ba-b336-4011-958f-64b8562b5801 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:44.111822 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7c7c41ba-b336-4011-958f-64b8562b5801 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:44.133088 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c7c41ba-b336-4011-958f-64b8562b5801 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:44.133567 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c7c41ba-b336-4011-958f-64b8562b5801 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:44.134383 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c7c41ba-b336-4011-958f-64b8562b5801 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:44.134830 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c7c41ba-b336-4011-958f-64b8562b5801 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:44.397193 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-7c7c41ba-b336-4011-958f-64b8562b5801 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:44.438174 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8e56c32f-0fb3-445c-9a1f-6f4f270dd422 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:44.446928 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:44.448565 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8e56c32f-0fb3-445c-9a1f-6f4f270dd422 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 200 len: 1391 microversion: 2.1 time: 0.547946 Jul 31 01:07:44.457065 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 255/510] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:43 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 1391 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:07:44.462399 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-934d27f1-53e1-4347-a4ca-1fa85bb07ecf req-a03d2223-45a0-4ba0-a697-b2b84ed719be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328017bc-1f5e-4680-9c77-f5eefbce8135", "name": "network-vif-plugged", "status": "completed", "tag": "f6d2a872-7a8a-4fce-a428-700f7792e65f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:44.479697 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-934d27f1-53e1-4347-a4ca-1fa85bb07ecf req-a03d2223-45a0-4ba0-a697-b2b84ed719be service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:44.480402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-934d27f1-53e1-4347-a4ca-1fa85bb07ecf req-a03d2223-45a0-4ba0-a697-b2b84ed719be service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:44.490713 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7c7c41ba-b336-4011-958f-64b8562b5801 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1927 microversion: 2.75 time: 0.384726 Jul 31 01:07:44.503369 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 256/511] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:44 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1927 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:07:44.512393 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1fa7b2ea-272f-4475-8dc8-f987570bc309 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:44.513692 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-934d27f1-53e1-4347-a4ca-1fa85bb07ecf req-a03d2223-45a0-4ba0-a697-b2b84ed719be service nova] Creating event network-vif-plugged:f6d2a872-7a8a-4fce-a428-700f7792e65f for instance 328017bc-1f5e-4680-9c77-f5eefbce8135 on n-h2-master-1 Jul 31 01:07:44.515425 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1fa7b2ea-272f-4475-8dc8-f987570bc309 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:44.520317 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-934d27f1-53e1-4347-a4ca-1fa85bb07ecf req-a03d2223-45a0-4ba0-a697-b2b84ed719be service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061014 Jul 31 01:07:44.521887 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 256/512] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:44.528347 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f6986e67-5445-458e-8944-f5e4cea67d83 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:44.529258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f6986e67-5445-458e-8944-f5e4cea67d83 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:44.534018 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1fa7b2ea-272f-4475-8dc8-f987570bc309 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:44.536389 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1fa7b2ea-272f-4475-8dc8-f987570bc309 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:44.538726 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6986e67-5445-458e-8944-f5e4cea67d83 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:44.539469 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6986e67-5445-458e-8944-f5e4cea67d83 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:44.540464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6986e67-5445-458e-8944-f5e4cea67d83 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:44.540916 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6986e67-5445-458e-8944-f5e4cea67d83 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:44.541284 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1fa7b2ea-272f-4475-8dc8-f987570bc309 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:44.542793 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1fa7b2ea-272f-4475-8dc8-f987570bc309 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:44.682207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1fa7b2ea-272f-4475-8dc8-f987570bc309 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:44.722085 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1fa7b2ea-272f-4475-8dc8-f987570bc309 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1264 microversion: 2.1 time: 0.223573 Jul 31 01:07:44.727627 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 257/513] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:44 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:44.798315 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f6986e67-5445-458e-8944-f5e4cea67d83 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:44.812384 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f6986e67-5445-458e-8944-f5e4cea67d83 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1310 microversion: 2.1 time: 0.289084 Jul 31 01:07:44.813788 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 257/514] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:44 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1310 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:45.076257 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e4db824f-9919-450e-afa9-80eb93b8c6a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:45.078181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e4db824f-9919-450e-afa9-80eb93b8c6a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:45.096424 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4db824f-9919-450e-afa9-80eb93b8c6a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:45.097862 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4db824f-9919-450e-afa9-80eb93b8c6a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:45.103290 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4db824f-9919-450e-afa9-80eb93b8c6a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:45.105725 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4db824f-9919-450e-afa9-80eb93b8c6a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:45.243027 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7001a41b-4f52-4465-9853-c37a32bade79 req-5043c9d1-17b1-40c1-b115-fa008702fa29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2", "tag": "79b2e09a-8171-4f0d-adc4-3e2dbf769ce6"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:45.256313 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7001a41b-4f52-4465-9853-c37a32bade79 req-5043c9d1-17b1-40c1-b115-fa008702fa29 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:45.257304 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7001a41b-4f52-4465-9853-c37a32bade79 req-5043c9d1-17b1-40c1-b115-fa008702fa29 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:45.274451 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7001a41b-4f52-4465-9853-c37a32bade79 req-5043c9d1-17b1-40c1-b115-fa008702fa29 service nova] Creating event network-changed:79b2e09a-8171-4f0d-adc4-3e2dbf769ce6 for instance 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 on n-h1-master-1 Jul 31 01:07:45.284011 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7001a41b-4f52-4465-9853-c37a32bade79 req-5043c9d1-17b1-40c1-b115-fa008702fa29 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045135 Jul 31 01:07:45.284582 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 258/515] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:45.345710 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e4db824f-9919-450e-afa9-80eb93b8c6a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:45.352926 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e4db824f-9919-450e-afa9-80eb93b8c6a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:45.355193 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e4db824f-9919-450e-afa9-80eb93b8c6a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:45.356928 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e4db824f-9919-450e-afa9-80eb93b8c6a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1566 microversion: 2.25 time: 0.286971 Jul 31 01:07:45.358382 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 258/516] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:45 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1566 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:45.472550 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0e161c65-dcd2-4019-88b6-cd6f1134a2d0 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:45.473431 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0e161c65-dcd2-4019-88b6-cd6f1134a2d0 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:45.483278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e161c65-dcd2-4019-88b6-cd6f1134a2d0 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:45.483819 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e161c65-dcd2-4019-88b6-cd6f1134a2d0 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:45.484547 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e161c65-dcd2-4019-88b6-cd6f1134a2d0 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:45.488944 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e161c65-dcd2-4019-88b6-cd6f1134a2d0 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:45.521147 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-13eb83a6-ffab-42ea-a185-ecc2943bb54b tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:45.521759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-13eb83a6-ffab-42ea-a185-ecc2943bb54b tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:45.537321 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13eb83a6-ffab-42ea-a185-ecc2943bb54b tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:45.538342 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13eb83a6-ffab-42ea-a185-ecc2943bb54b tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:45.539946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13eb83a6-ffab-42ea-a185-ecc2943bb54b tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:45.543834 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13eb83a6-ffab-42ea-a185-ecc2943bb54b tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:45.804755 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-13eb83a6-ffab-42ea-a185-ecc2943bb54b tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:45.858016 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-13eb83a6-ffab-42ea-a185-ecc2943bb54b tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1927 microversion: 2.75 time: 0.341839 Jul 31 01:07:45.876081 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 259/517] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:45 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1927 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:45.904155 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-95ce01dc-b5bb-48a4-a83b-efc71d317f96 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:45.905403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-95ce01dc-b5bb-48a4-a83b-efc71d317f96 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:45.916583 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95ce01dc-b5bb-48a4-a83b-efc71d317f96 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:45.917843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95ce01dc-b5bb-48a4-a83b-efc71d317f96 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:45.919618 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95ce01dc-b5bb-48a4-a83b-efc71d317f96 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:45.921018 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95ce01dc-b5bb-48a4-a83b-efc71d317f96 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:45.977647 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e161c65-dcd2-4019-88b6-cd6f1134a2d0 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:45.982199 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:46.008386 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0e161c65-dcd2-4019-88b6-cd6f1134a2d0 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 200 len: 1391 microversion: 2.1 time: 0.540936 Jul 31 01:07:46.024788 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 259/518] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:45 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 1391 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:46.030711 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2b4b1e2e-27c9-4810-979f-cea9b0726b05 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:46.040662 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2b4b1e2e-27c9-4810-979f-cea9b0726b05 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:46.061857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b4b1e2e-27c9-4810-979f-cea9b0726b05 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:46.062577 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b4b1e2e-27c9-4810-979f-cea9b0726b05 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:46.064896 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b4b1e2e-27c9-4810-979f-cea9b0726b05 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:46.067331 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b4b1e2e-27c9-4810-979f-cea9b0726b05 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:46.154800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-95ce01dc-b5bb-48a4-a83b-efc71d317f96 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:46.163431 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-95ce01dc-b5bb-48a4-a83b-efc71d317f96 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1270 microversion: 2.1 time: 0.285614 Jul 31 01:07:46.166623 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 260/519] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:45 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1270 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:46.382558 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3da806fc-2aa9-4bee-a131-edc151aed4b6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:46.384250 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3da806fc-2aa9-4bee-a131-edc151aed4b6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:46.394728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3da806fc-2aa9-4bee-a131-edc151aed4b6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:46.397022 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3da806fc-2aa9-4bee-a131-edc151aed4b6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:46.398166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3da806fc-2aa9-4bee-a131-edc151aed4b6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:46.400838 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3da806fc-2aa9-4bee-a131-edc151aed4b6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:46.500149 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2b4b1e2e-27c9-4810-979f-cea9b0726b05 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:46.511439 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2b4b1e2e-27c9-4810-979f-cea9b0726b05 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1310 microversion: 2.1 time: 0.485126 Jul 31 01:07:46.524418 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 260/520] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:46 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1310 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:46.548584 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-a80e3279-dac0-464f-904b-a4d31189918f req-363003c8-86fc-421e-9ac2-c989efa1ff16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff233d7d-7f8e-4283-a902-d08ed1a3fc1e", "name": "network-vif-plugged", "status": "completed", "tag": "fc8d9300-899d-427a-9306-149f14484267"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:46.568776 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a80e3279-dac0-464f-904b-a4d31189918f req-363003c8-86fc-421e-9ac2-c989efa1ff16 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:46.569467 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a80e3279-dac0-464f-904b-a4d31189918f req-363003c8-86fc-421e-9ac2-c989efa1ff16 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:46.583092 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-a80e3279-dac0-464f-904b-a4d31189918f req-363003c8-86fc-421e-9ac2-c989efa1ff16 service nova] Creating event network-vif-plugged:fc8d9300-899d-427a-9306-149f14484267 for instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e on n-h2-master-1 Jul 31 01:07:46.591100 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-a80e3279-dac0-464f-904b-a4d31189918f req-363003c8-86fc-421e-9ac2-c989efa1ff16 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050510 Jul 31 01:07:46.597359 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 261/521] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:46.784966 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3da806fc-2aa9-4bee-a131-edc151aed4b6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:46.796375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3da806fc-2aa9-4bee-a131-edc151aed4b6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:46.798683 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3da806fc-2aa9-4bee-a131-edc151aed4b6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:46.800360 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3da806fc-2aa9-4bee-a131-edc151aed4b6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1566 microversion: 2.25 time: 0.422296 Jul 31 01:07:46.801082 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 261/522] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:46 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1566 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:07:46.911489 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d53f24a2-3e86-45a5-85d9-144cbde12c46 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:46.912800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d53f24a2-3e86-45a5-85d9-144cbde12c46 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:46.929296 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d53f24a2-3e86-45a5-85d9-144cbde12c46 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:46.931137 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d53f24a2-3e86-45a5-85d9-144cbde12c46 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:46.933734 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d53f24a2-3e86-45a5-85d9-144cbde12c46 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:46.935741 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d53f24a2-3e86-45a5-85d9-144cbde12c46 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:47.029176 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4775b06a-6013-4f30-88ef-ed9b8108a4bf tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:47.030320 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4775b06a-6013-4f30-88ef-ed9b8108a4bf tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:47.042571 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4775b06a-6013-4f30-88ef-ed9b8108a4bf tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:47.043034 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4775b06a-6013-4f30-88ef-ed9b8108a4bf tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:47.043872 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4775b06a-6013-4f30-88ef-ed9b8108a4bf tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:47.050501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4775b06a-6013-4f30-88ef-ed9b8108a4bf tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:47.133250 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-d53f24a2-3e86-45a5-85d9-144cbde12c46 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:47.184396 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d53f24a2-3e86-45a5-85d9-144cbde12c46 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1927 microversion: 2.75 time: 0.274750 Jul 31 01:07:47.185286 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 262/523] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:46 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1927 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:47.331601 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4775b06a-6013-4f30-88ef-ed9b8108a4bf tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:47.343859 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4775b06a-6013-4f30-88ef-ed9b8108a4bf tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 200 len: 1391 microversion: 2.1 time: 0.316852 Jul 31 01:07:47.349603 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 262/524] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:47 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 1391 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:07:47.361492 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-59243da8-0048-4c5a-a0e2-f94a90da01ca tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:47.362500 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-59243da8-0048-4c5a-a0e2-f94a90da01ca tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:47.370991 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-59243da8-0048-4c5a-a0e2-f94a90da01ca tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:47.371720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-59243da8-0048-4c5a-a0e2-f94a90da01ca tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:47.372751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-59243da8-0048-4c5a-a0e2-f94a90da01ca tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:47.373471 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-59243da8-0048-4c5a-a0e2-f94a90da01ca tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:47.573087 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-59243da8-0048-4c5a-a0e2-f94a90da01ca tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:47.583924 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-59243da8-0048-4c5a-a0e2-f94a90da01ca tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1312 microversion: 2.1 time: 0.232906 Jul 31 01:07:47.599227 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 263/525] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:47 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1312 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:47.605266 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-53e3dd59-6db8-4e9c-a3f4-3b810387a049 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:47.606489 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-53e3dd59-6db8-4e9c-a3f4-3b810387a049 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:47.615551 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53e3dd59-6db8-4e9c-a3f4-3b810387a049 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:47.616316 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53e3dd59-6db8-4e9c-a3f4-3b810387a049 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:47.617935 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53e3dd59-6db8-4e9c-a3f4-3b810387a049 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:47.618551 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53e3dd59-6db8-4e9c-a3f4-3b810387a049 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:47.695520 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-73c05622-c030-4f0c-9412-8a34c4cb536a tempest-NetworksTest-1362491566 tempest-NetworksTest-1362491566-project-admin] Calling method '.version_select at 0x7fede5b43a60>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:47.909418 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-53e3dd59-6db8-4e9c-a3f4-3b810387a049 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:47.924144 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-53e3dd59-6db8-4e9c-a3f4-3b810387a049 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1492 microversion: 2.1 time: 0.323275 Jul 31 01:07:47.924758 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 264/526] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:47 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1492 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:47.941461 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-96cc6a8d-d46e-430c-99a7-014042241cb2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:47.942485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-96cc6a8d-d46e-430c-99a7-014042241cb2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:47.956616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96cc6a8d-d46e-430c-99a7-014042241cb2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:47.960904 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96cc6a8d-d46e-430c-99a7-014042241cb2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:47.961922 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96cc6a8d-d46e-430c-99a7-014042241cb2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:47.963533 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96cc6a8d-d46e-430c-99a7-014042241cb2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:47.980780 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-73c05622-c030-4f0c-9412-8a34c4cb536a tempest-NetworksTest-1362491566 tempest-NetworksTest-1362491566-project-admin] 10.222.0.45 "GET /compute/v2.1/os-networks" status: 200 len: 6064 microversion: 2.1 time: 0.789968 Jul 31 01:07:47.981915 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 263/527] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:07:47 2022] GET /compute/v2.1/os-networks => generated 6064 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:48.167901 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-96cc6a8d-d46e-430c-99a7-014042241cb2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:48.177395 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-96cc6a8d-d46e-430c-99a7-014042241cb2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:48.179720 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-96cc6a8d-d46e-430c-99a7-014042241cb2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:48.180961 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-96cc6a8d-d46e-430c-99a7-014042241cb2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1566 microversion: 2.25 time: 0.251117 Jul 31 01:07:48.181846 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 265/528] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:47 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1566 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:48.199575 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-435360ed-03cd-46a0-92d8-e985ec229701 tempest-NetworksTest-1362491566 tempest-NetworksTest-1362491566-project-admin] Calling method '.version_select at 0x7fede5c6c3a0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:48.320451 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-435360ed-03cd-46a0-92d8-e985ec229701 tempest-NetworksTest-1362491566 tempest-NetworksTest-1362491566-project-admin] 10.222.0.45 "GET /compute/v2.1/os-networks/0abb2289-fd48-4bf1-9c02-0622852045a3" status: 200 len: 652 microversion: 2.1 time: 0.136793 Jul 31 01:07:48.321061 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 266/529] 10.222.0.45 () {58 vars in 1248 bytes} [Sun Jul 31 01:07:48 2022] GET /compute/v2.1/os-networks/0abb2289-fd48-4bf1-9c02-0622852045a3 => generated 652 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:48.330691 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-c24cbe23-7e5a-4d82-b1da-5a260e05019e req-d2ca625c-6e46-49d9-b04b-6bfd2dc2367e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4faaeb8d-01fd-456a-b887-c5cf7ba7051b", "tag": "ad7e118b-a003-47c7-8563-67c45bdc1cce"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:48.344059 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c24cbe23-7e5a-4d82-b1da-5a260e05019e req-d2ca625c-6e46-49d9-b04b-6bfd2dc2367e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:48.345435 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c24cbe23-7e5a-4d82-b1da-5a260e05019e req-d2ca625c-6e46-49d9-b04b-6bfd2dc2367e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:48.358551 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-c24cbe23-7e5a-4d82-b1da-5a260e05019e req-d2ca625c-6e46-49d9-b04b-6bfd2dc2367e service nova] Creating event network-changed:ad7e118b-a003-47c7-8563-67c45bdc1cce for instance 4faaeb8d-01fd-456a-b887-c5cf7ba7051b on n-h2-master-1 Jul 31 01:07:48.364271 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-c24cbe23-7e5a-4d82-b1da-5a260e05019e req-d2ca625c-6e46-49d9-b04b-6bfd2dc2367e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041582 Jul 31 01:07:48.365075 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 267/530] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:48.370175 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-557d1514-589a-4c9c-8d21-5a88ed00a2ba tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:48.370813 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-557d1514-589a-4c9c-8d21-5a88ed00a2ba tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:48.380349 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-557d1514-589a-4c9c-8d21-5a88ed00a2ba tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:48.381043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-557d1514-589a-4c9c-8d21-5a88ed00a2ba tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:48.382130 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-557d1514-589a-4c9c-8d21-5a88ed00a2ba tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:48.383262 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-557d1514-589a-4c9c-8d21-5a88ed00a2ba tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:48.480059 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ea68ce0-b7cc-4489-93b1-400f5509a0a8 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:48.480966 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0ea68ce0-b7cc-4489-93b1-400f5509a0a8 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:48.493541 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ea68ce0-b7cc-4489-93b1-400f5509a0a8 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:48.494877 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ea68ce0-b7cc-4489-93b1-400f5509a0a8 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:48.495804 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-557d1514-589a-4c9c-8d21-5a88ed00a2ba tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:48.497062 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ea68ce0-b7cc-4489-93b1-400f5509a0a8 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:48.497508 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ea68ce0-b7cc-4489-93b1-400f5509a0a8 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:48.513714 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-557d1514-589a-4c9c-8d21-5a88ed00a2ba tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1927 microversion: 2.75 time: 0.147258 Jul 31 01:07:48.514566 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 268/531] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:48 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1927 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:48.519669 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1b1651b9-dee6-48e7-9a9b-6b7b8dc79542 tempest-NetworksTest-1362491566 tempest-NetworksTest-1362491566-project-admin] Calling method '.version_select at 0x7fede5c6c3a0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:48.734905 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1b1651b9-dee6-48e7-9a9b-6b7b8dc79542 tempest-NetworksTest-1362491566 tempest-NetworksTest-1362491566-project-admin] 10.222.0.45 "GET /compute/v2.1/os-networks" status: 200 len: 6064 microversion: 2.1 time: 0.219012 Jul 31 01:07:48.735636 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 269/532] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:07:48 2022] GET /compute/v2.1/os-networks => generated 6064 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:48.744356 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-37de81ec-e586-4159-8297-bb23b3577d36 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:48.745056 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-37de81ec-e586-4159-8297-bb23b3577d36 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:48.757558 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0ea68ce0-b7cc-4489-93b1-400f5509a0a8 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1643 microversion: 2.1 time: 0.774221 Jul 31 01:07:48.759014 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 264/533] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:47 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1643 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:48.759195 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37de81ec-e586-4159-8297-bb23b3577d36 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:48.759694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37de81ec-e586-4159-8297-bb23b3577d36 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:48.760563 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37de81ec-e586-4159-8297-bb23b3577d36 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:48.761175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37de81ec-e586-4159-8297-bb23b3577d36 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:48.764020 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-41e12b28-291c-413c-b23e-2effa8cfe43a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:48.764817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-41e12b28-291c-413c-b23e-2effa8cfe43a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:48.773708 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41e12b28-291c-413c-b23e-2effa8cfe43a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:48.774386 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41e12b28-291c-413c-b23e-2effa8cfe43a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:48.775324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41e12b28-291c-413c-b23e-2effa8cfe43a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:48.775978 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41e12b28-291c-413c-b23e-2effa8cfe43a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:49.031899 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-41e12b28-291c-413c-b23e-2effa8cfe43a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:49.047011 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-41e12b28-291c-413c-b23e-2effa8cfe43a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1312 microversion: 2.1 time: 0.285944 Jul 31 01:07:49.048454 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 265/534] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:48 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1312 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:49.059544 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-37de81ec-e586-4159-8297-bb23b3577d36 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:49.063702 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eb3851cd-ac68-4a99-b837-d661f0480f52 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:49.064559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eb3851cd-ac68-4a99-b837-d661f0480f52 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:49.073120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb3851cd-ac68-4a99-b837-d661f0480f52 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:49.073335 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-37de81ec-e586-4159-8297-bb23b3577d36 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 200 len: 1591 microversion: 2.1 time: 0.332582 Jul 31 01:07:49.075231 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 270/535] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:48 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 1591 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:49.084831 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb3851cd-ac68-4a99-b837-d661f0480f52 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:49.086963 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb3851cd-ac68-4a99-b837-d661f0480f52 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:49.087445 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb3851cd-ac68-4a99-b837-d661f0480f52 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:49.387057 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a9b6d444-9060-4665-8a4f-c8b12f709d12 tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Action: 'update', calling method: .version_select at 0x7fede5ca2af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:49.469440 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9b6d444-9060-4665-8a4f-c8b12f709d12 tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:49.470048 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9b6d444-9060-4665-8a4f-c8b12f709d12 tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:49.470970 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9b6d444-9060-4665-8a4f-c8b12f709d12 tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:49.471629 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9b6d444-9060-4665-8a4f-c8b12f709d12 tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:49.539699 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a9b6d444-9060-4665-8a4f-c8b12f709d12 tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/6ffb035234ff4ef99846cad3f2ac672b" status: 200 len: 240 microversion: 2.36 time: 0.462907 Jul 31 01:07:49.540604 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 271/536] 10.222.0.45 () {62 vars in 1303 bytes} [Sun Jul 31 01:07:49 2022] PUT /compute/v2.1/os-quota-sets/6ffb035234ff4ef99846cad3f2ac672b => generated 240 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:07:49.686592 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d7d8e331-c75c-4cc2-b0f5-41a1e87c4c77 tempest-InstanceUsageAuditLogNegativeTestJSON-1680552142 tempest-InstanceUsageAuditLogNegativeTestJSON-1680552142-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:49.687436 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:49.687436 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:49.690270 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-d7d8e331-c75c-4cc2-b0f5-41a1e87c4c77 tempest-InstanceUsageAuditLogNegativeTestJSON-1680552142 tempest-InstanceUsageAuditLogNegativeTestJSON-1680552142-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d7d8e331-c75c-4cc2-b0f5-41a1e87c4c77 tempest-InstanceUsageAuditLogNegativeTestJSON-1680552142 tempest-InstanceUsageAuditLogNegativeTestJSON-1680552142-project-admin] Request method failure captured: Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dXk-6lIs_f73O4Bn7aSfddB-na4rec-defo5PqgA4eCjmJmPGxZnaxUxRo3_wHSxS3FzeUGOar8kM5B1540J5Dyuqk3dSFBNZJEo3X-6V-_BofHQojygnK0MV4SjbJAzJh0a39t_nc25XzUgHMg5aNF53RsEqgizHi9x2xiMpu0Lxg Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: b9730ac419dc4fa3a24b796ef572ae9c Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1680552142 Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:07:49.705768 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:07:49.707508 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9730ac419dc4fa3a24b796ef572ae9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b9730ac419dc4fa3a24b796ef572ae9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b9730ac419dc4fa3a24b796ef572ae9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b9730ac419dc4fa3a24b796ef572ae9c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:49.707508 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1680552142 Jul 31 01:07:49.707508 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: b9730ac419dc4fa3a24b796ef572ae9c Jul 31 01:07:49.707508 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1680552142 Jul 31 01:07:49.707508 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1680552142-project-admin Jul 31 01:07:49.707508 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:07:49.707508 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:07:49.707508 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 340e66e3df0341aa9a3a482c77b58de3 Jul 31 01:07:49.707508 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1680552142-project-admin Jul 31 01:07:49.707508 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:07:49.707508 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid timestamp for date invalid_time Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'invalid_time'} Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:49.708347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:49.709443 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 31 01:07:49.709443 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 31 01:07:49.709443 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 31 01:07:49.709443 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:49.709443 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:49.709443 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:49.709443 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:49.709443 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:49.709443 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:49.709443 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:07:49.709443 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:07:49.709443 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 31 01:07:49.709443 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:49.709443 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d7d8e331-c75c-4cc2-b0f5-41a1e87c4c77 tempest-InstanceUsageAuditLogNegativeTestJSON-1680552142 tempest-InstanceUsageAuditLogNegativeTestJSON-1680552142-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:49.709443 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d7d8e331-c75c-4cc2-b0f5-41a1e87c4c77 tempest-InstanceUsageAuditLogNegativeTestJSON-1680552142 tempest-InstanceUsageAuditLogNegativeTestJSON-1680552142-project-admin] 10.222.0.45 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.159325 Jul 31 01:07:49.715037 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 272/537] 10.222.0.45 () {58 vars in 1224 bytes} [Sun Jul 31 01:07:49 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 31 01:07:49.720251 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-49b00208-7111-4cab-9467-f43cffe3c26b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:49.720747 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-49b00208-7111-4cab-9467-f43cffe3c26b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:49.728802 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49b00208-7111-4cab-9467-f43cffe3c26b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:49.729249 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49b00208-7111-4cab-9467-f43cffe3c26b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:49.730257 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49b00208-7111-4cab-9467-f43cffe3c26b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:49.730842 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49b00208-7111-4cab-9467-f43cffe3c26b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:49.767024 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eb3851cd-ac68-4a99-b837-d661f0480f52 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1643 microversion: 2.1 time: 0.716448 Jul 31 01:07:49.768441 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 266/538] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:49 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1643 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:49.775496 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-839691a3-13e3-4af3-a776-1cb6a63643a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:49.776400 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-839691a3-13e3-4af3-a776-1cb6a63643a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:49.783918 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-839691a3-13e3-4af3-a776-1cb6a63643a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:49.784507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-839691a3-13e3-4af3-a776-1cb6a63643a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:49.785559 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-839691a3-13e3-4af3-a776-1cb6a63643a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:49.786125 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-839691a3-13e3-4af3-a776-1cb6a63643a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:49.972738 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-49b00208-7111-4cab-9467-f43cffe3c26b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.256354 Jul 31 01:07:49.973542 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 273/539] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:07:49 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e/os-interface => generated 285 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:49.978540 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b376b451-81dc-4534-b730-a80e947f00a0 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:49.979488 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b376b451-81dc-4534-b730-a80e947f00a0 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:49.986827 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b376b451-81dc-4534-b730-a80e947f00a0 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:49.987391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b376b451-81dc-4534-b730-a80e947f00a0 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:49.988396 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b376b451-81dc-4534-b730-a80e947f00a0 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:49.989101 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b376b451-81dc-4534-b730-a80e947f00a0 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:50.165205 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-b376b451-81dc-4534-b730-a80e947f00a0 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:50.191150 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b376b451-81dc-4534-b730-a80e947f00a0 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1927 microversion: 2.75 time: 0.215972 Jul 31 01:07:50.192108 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 274/540] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:49 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1927 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:50.196803 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fcb685c7-8ff9-4e36-ac7f-4c5b1319ef62 tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Calling method '.version_select at 0x7fede5e9baf0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:50.307628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-839691a3-13e3-4af3-a776-1cb6a63643a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:50.327950 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-839691a3-13e3-4af3-a776-1cb6a63643a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:50.330186 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-839691a3-13e3-4af3-a776-1cb6a63643a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:50.333375 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-839691a3-13e3-4af3-a776-1cb6a63643a6 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1566 microversion: 2.25 time: 0.562719 Jul 31 01:07:50.335112 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 267/541] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:49 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1566 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:50.495313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fcb685c7-8ff9-4e36-ac7f-4c5b1319ef62 tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:50.496134 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fcb685c7-8ff9-4e36-ac7f-4c5b1319ef62 tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:50.497645 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fcb685c7-8ff9-4e36-ac7f-4c5b1319ef62 tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:50.498455 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fcb685c7-8ff9-4e36-ac7f-4c5b1319ef62 tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:50.543179 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fcb685c7-8ff9-4e36-ac7f-4c5b1319ef62 tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/6ffb035234ff4ef99846cad3f2ac672b/detail" status: 200 len: 672 microversion: 2.36 time: 0.349524 Jul 31 01:07:50.544302 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 275/542] 10.222.0.45 () {60 vars in 1304 bytes} [Sun Jul 31 01:07:50 2022] GET /compute/v2.1/os-quota-sets/6ffb035234ff4ef99846cad3f2ac672b/detail => generated 672 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:07:50.560280 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2b941aec-bb19-41db-a8da-51dc2be1688c tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826 tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:50.561246 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:50.561246 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:07:50.562421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2b941aec-bb19-41db-a8da-51dc2be1688c tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826 tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'f7727b1275084eb9a18cedb4cba328fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8068c42332a406fb090974bc279f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:50.563207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d69cf0c7-018b-4196-9378-de7df9a7ca4c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:50.568126 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:50.568126 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:50.571550 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d69cf0c7-018b-4196-9378-de7df9a7ca4c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:50.573123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d69cf0c7-018b-4196-9378-de7df9a7ca4c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2b941aec-bb19-41db-a8da-51dc2be1688c tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826 tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826-project] Request method failure captured: Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXjCVNqAfEa3Bl95wPpDZ7GvnHqdogSQdE26LvBMXvK-rXVZenBEEiIh6UZ3GpmyL0cMjK0sLMm3F4Dtjty3el8eGoB_lqaYArVZWccXE6GN3xWxma_FD27Pamx8PRRcoZhOarcW5RDaY9_m2K7GWwLglG_YVMg-XEyx1xPTu_aVTg Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: d8068c42332a406fb090974bc279f708 Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826 Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:07:50.574565 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:07:50.577298 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d8068c42332a406fb090974bc279f708"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d8068c42332a406fb090974bc279f708"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d8068c42332a406fb090974bc279f708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d8068c42332a406fb090974bc279f708", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:50.577298 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826 Jul 31 01:07:50.577298 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: d8068c42332a406fb090974bc279f708 Jul 31 01:07:50.577298 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826 Jul 31 01:07:50.577298 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826-project Jul 31 01:07:50.577298 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:07:50.577298 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:07:50.577298 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f7727b1275084eb9a18cedb4cba328fc Jul 31 01:07:50.577298 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826-project Jul 31 01:07:50.577298 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:07:50.577298 n-d-master-1 devstack@n-api.service[119474]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: action_args: {} Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:07:50.579226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:07:50.581902 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2b941aec-bb19-41db-a8da-51dc2be1688c tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826 tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:50.589000 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d69cf0c7-018b-4196-9378-de7df9a7ca4c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:50.589000 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d69cf0c7-018b-4196-9378-de7df9a7ca4c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:50.601362 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2b941aec-bb19-41db-a8da-51dc2be1688c tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826 tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826-project] 10.222.0.45 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.264730 Jul 31 01:07:50.601966 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 268/543] 10.222.0.45 () {58 vars in 1185 bytes} [Sun Jul 31 01:07:50 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 266 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:50.619143 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e6708ff8-0de6-4aa2-9a0b-8ed54b606f24 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:50.632635 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e6708ff8-0de6-4aa2-9a0b-8ed54b606f24 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:50.654879 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6708ff8-0de6-4aa2-9a0b-8ed54b606f24 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:50.655374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6708ff8-0de6-4aa2-9a0b-8ed54b606f24 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:50.660328 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6708ff8-0de6-4aa2-9a0b-8ed54b606f24 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:50.660792 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6708ff8-0de6-4aa2-9a0b-8ed54b606f24 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:50.673645 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:50.694849 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d69cf0c7-018b-4196-9378-de7df9a7ca4c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.148405 Jul 31 01:07:50.697082 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 276/544] 10.222.0.45 () {58 vars in 1176 bytes} [Sun Jul 31 01:07:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:50.707544 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c7920ea5-4288-491f-835e-77bd4914a0a1 tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826 tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:50.709820 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:07:50.709820 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:07:50.712660 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c7920ea5-4288-491f-835e-77bd4914a0a1 tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826 tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'f7727b1275084eb9a18cedb4cba328fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8068c42332a406fb090974bc279f708', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c7920ea5-4288-491f-835e-77bd4914a0a1 tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826 tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826-project] Request method failure captured: Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-31%2001:07:50 HTTP/1.1 Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dXjCVNqAfEa3Bl95wPpDZ7GvnHqdogSQdE26LvBMXvK-rXVZenBEEiIh6UZ3GpmyL0cMjK0sLMm3F4Dtjty3el8eGoB_lqaYArVZWccXE6GN3xWxma_FD27Pamx8PRRcoZhOarcW5RDaY9_m2K7GWwLglG_YVMg-XEyx1xPTu_aVTg Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: d8068c42332a406fb090974bc279f708 Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826 Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:07:50.720103 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:07:50.722973 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d8068c42332a406fb090974bc279f708"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d8068c42332a406fb090974bc279f708"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d8068c42332a406fb090974bc279f708"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d8068c42332a406fb090974bc279f708", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:07:50.722973 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826 Jul 31 01:07:50.722973 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: d8068c42332a406fb090974bc279f708 Jul 31 01:07:50.722973 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826 Jul 31 01:07:50.722973 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826-project Jul 31 01:07:50.722973 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:07:50.722973 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:07:50.722973 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f7727b1275084eb9a18cedb4cba328fc Jul 31 01:07:50.722973 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826-project Jul 31 01:07:50.722973 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:07:50.722973 n-d-master-1 devstack@n-api.service[119475]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '2022-07-31 01:07:50'} Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:07:50.724409 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:07:50.727064 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:07:50.727064 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:07:50.727064 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:07:50.727064 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:07:50.727064 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:07:50.727064 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 31 01:07:50.727064 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:50.727064 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:07:50.727064 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:50.727064 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:07:50.727064 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:07:50.727064 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:07:50.727064 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:07:50.727064 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:07:50.727064 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 31 01:07:50.727064 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:07:50.730983 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c7920ea5-4288-491f-835e-77bd4914a0a1 tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826 tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:07:50.732674 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c7920ea5-4288-491f-835e-77bd4914a0a1 tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826 tempest-InstanceUsageAuditLogNegativeTestJSON-2071372826-project] 10.222.0.45 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-31 01:07:50" status: 403 len: 128 microversion: 2.1 time: 0.033469 Jul 31 01:07:50.733774 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 277/545] 10.222.0.45 () {58 vars in 1251 bytes} [Sun Jul 31 01:07:50 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-31%2001%3A07%3A50 => generated 128 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:07:50.745733 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b66f5a2b-5347-4072-a6ab-583349270cf2 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:50.751209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b66f5a2b-5347-4072-a6ab-583349270cf2 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:50.764671 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b66f5a2b-5347-4072-a6ab-583349270cf2 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:50.765722 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b66f5a2b-5347-4072-a6ab-583349270cf2 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:50.768525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b66f5a2b-5347-4072-a6ab-583349270cf2 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:50.769489 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b66f5a2b-5347-4072-a6ab-583349270cf2 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:50.985115 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-b66f5a2b-5347-4072-a6ab-583349270cf2 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lazy-loading 'flavor' on Instance uuid 328017bc-1f5e-4680-9c77-f5eefbce8135 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:51.163311 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b66f5a2b-5347-4072-a6ab-583349270cf2 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Going to try to live migrate instance to n-h1-master-1 {{(pid=119475) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 31 01:07:51.238667 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:51.294309 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e6708ff8-0de6-4aa2-9a0b-8ed54b606f24 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:51.313437 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e6708ff8-0de6-4aa2-9a0b-8ed54b606f24 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1312 microversion: 2.1 time: 0.707579 Jul 31 01:07:51.317360 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 269/546] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:50 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1312 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:51.324318 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e6a80473-d981-47ff-bf5a-ef4ebd6a880e tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Action: 'update', calling method: .version_select at 0x7fede5b43d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:51.821536 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a80473-d981-47ff-bf5a-ef4ebd6a880e tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:51.824976 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a80473-d981-47ff-bf5a-ef4ebd6a880e tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:51.826231 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a80473-d981-47ff-bf5a-ef4ebd6a880e tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:51.829528 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a80473-d981-47ff-bf5a-ef4ebd6a880e tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:51.849843 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=11 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:51.942134 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a80473-d981-47ff-bf5a-ef4ebd6a880e tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:51.942605 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a80473-d981-47ff-bf5a-ef4ebd6a880e tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:51.943451 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a80473-d981-47ff-bf5a-ef4ebd6a880e tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:51.944089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a80473-d981-47ff-bf5a-ef4ebd6a880e tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:52.062447 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e6a80473-d981-47ff-bf5a-ef4ebd6a880e tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/6ffb035234ff4ef99846cad3f2ac672b?user_id=1f90909ede044fd498bb41eba0e6fb57" status: 200 len: 240 microversion: 2.36 time: 0.742723 Jul 31 01:07:52.071754 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 270/547] 10.222.0.45 () {62 vars in 1384 bytes} [Sun Jul 31 01:07:51 2022] PUT /compute/v2.1/os-quota-sets/6ffb035234ff4ef99846cad3f2ac672b?user_id=1f90909ede044fd498bb41eba0e6fb57 => generated 240 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:07:52.076872 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-03f78716-dfa8-4366-81db-c8515a765da1 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:52.077829 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-03f78716-dfa8-4366-81db-c8515a765da1 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:52.085525 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03f78716-dfa8-4366-81db-c8515a765da1 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:52.086122 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03f78716-dfa8-4366-81db-c8515a765da1 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:52.087030 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03f78716-dfa8-4366-81db-c8515a765da1 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:52.087592 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03f78716-dfa8-4366-81db-c8515a765da1 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:52.254164 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-03f78716-dfa8-4366-81db-c8515a765da1 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:52.280811 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-03f78716-dfa8-4366-81db-c8515a765da1 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1927 microversion: 2.75 time: 0.207659 Jul 31 01:07:52.282543 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 271/548] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:52 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1927 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:52.287843 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9b8a6305-ae4d-4e81-a427-e612bd31dcb1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:52.288693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9b8a6305-ae4d-4e81-a427-e612bd31dcb1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:52.298286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9b8a6305-ae4d-4e81-a427-e612bd31dcb1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:52.299627 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9b8a6305-ae4d-4e81-a427-e612bd31dcb1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:52.301159 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9b8a6305-ae4d-4e81-a427-e612bd31dcb1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:52.302511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9b8a6305-ae4d-4e81-a427-e612bd31dcb1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:52.688700 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9b8a6305-ae4d-4e81-a427-e612bd31dcb1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:52.707665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9b8a6305-ae4d-4e81-a427-e612bd31dcb1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:52.712017 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9b8a6305-ae4d-4e81-a427-e612bd31dcb1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:52.714819 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9b8a6305-ae4d-4e81-a427-e612bd31dcb1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1566 microversion: 2.25 time: 0.430145 Jul 31 01:07:52.716031 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 272/549] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:52 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1566 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:52.735545 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c54ff690-9f76-44da-9379-17e724361933 tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] Calling method '.version_select at 0x7fede5b431f0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:53.121823 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c54ff690-9f76-44da-9379-17e724361933 tempest-QuotasAdminTestV236-719240689 tempest-QuotasAdminTestV236-719240689-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/6ffb035234ff4ef99846cad3f2ac672b?user_id=1f90909ede044fd498bb41eba0e6fb57" status: 200 len: 282 microversion: 2.36 time: 0.403606 Jul 31 01:07:53.123469 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 273/550] 10.222.0.45 () {60 vars in 1364 bytes} [Sun Jul 31 01:07:52 2022] GET /compute/v2.1/os-quota-sets/6ffb035234ff4ef99846cad3f2ac672b?user_id=1f90909ede044fd498bb41eba0e6fb57 => generated 282 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:07:53.147146 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f046be8e-a89c-49dd-93c7-da5696feafd5 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:53.150236 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f046be8e-a89c-49dd-93c7-da5696feafd5 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:53.175836 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f046be8e-a89c-49dd-93c7-da5696feafd5 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:53.178033 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f046be8e-a89c-49dd-93c7-da5696feafd5 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:53.180449 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f046be8e-a89c-49dd-93c7-da5696feafd5 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:53.181482 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f046be8e-a89c-49dd-93c7-da5696feafd5 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:53.685865 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f046be8e-a89c-49dd-93c7-da5696feafd5 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:53.715521 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f046be8e-a89c-49dd-93c7-da5696feafd5 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 200 len: 1591 microversion: 2.1 time: 0.589714 Jul 31 01:07:53.716590 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 274/551] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:53 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 1591 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:53.726257 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-d7042331-f0ab-4bba-b1e5-1b76d5275b13 req-330f4ebe-7b57-4f29-a569-fb200c9e27a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff233d7d-7f8e-4283-a902-d08ed1a3fc1e", "tag": "fc8d9300-899d-427a-9306-149f14484267"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:53.777353 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d7042331-f0ab-4bba-b1e5-1b76d5275b13 req-330f4ebe-7b57-4f29-a569-fb200c9e27a5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:53.778201 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d7042331-f0ab-4bba-b1e5-1b76d5275b13 req-330f4ebe-7b57-4f29-a569-fb200c9e27a5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:53.840658 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-d7042331-f0ab-4bba-b1e5-1b76d5275b13 req-330f4ebe-7b57-4f29-a569-fb200c9e27a5 service nova] Creating event network-changed:fc8d9300-899d-427a-9306-149f14484267 for instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e on n-h2-master-1 Jul 31 01:07:53.852612 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-d7042331-f0ab-4bba-b1e5-1b76d5275b13 req-330f4ebe-7b57-4f29-a569-fb200c9e27a5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133556 Jul 31 01:07:53.854349 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 275/552] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:53.874362 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5806596e-23dc-4f5f-b068-151ae9d0df10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:53.877106 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5806596e-23dc-4f5f-b068-151ae9d0df10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:53.892793 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5806596e-23dc-4f5f-b068-151ae9d0df10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:53.894006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5806596e-23dc-4f5f-b068-151ae9d0df10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:53.895761 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5806596e-23dc-4f5f-b068-151ae9d0df10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:53.896998 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5806596e-23dc-4f5f-b068-151ae9d0df10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:54.724280 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b66f5a2b-5347-4072-a6ab-583349270cf2 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135/action" status: 202 len: 0 microversion: 2.1 time: 3.979917 Jul 31 01:07:54.730834 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 278/553] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:07:50 2022] POST /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135/action => generated 0 bytes in 3995 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:07:54.752635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3fe1fb8f-6e57-4b65-a8d2-2f2d36ae9d50 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:54.755627 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3fe1fb8f-6e57-4b65-a8d2-2f2d36ae9d50 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:54.786766 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3fe1fb8f-6e57-4b65-a8d2-2f2d36ae9d50 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:54.792236 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3fe1fb8f-6e57-4b65-a8d2-2f2d36ae9d50 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:54.794691 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3fe1fb8f-6e57-4b65-a8d2-2f2d36ae9d50 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:54.799812 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3fe1fb8f-6e57-4b65-a8d2-2f2d36ae9d50 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:54.816976 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5806596e-23dc-4f5f-b068-151ae9d0df10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:54.844751 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5806596e-23dc-4f5f-b068-151ae9d0df10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1312 microversion: 2.1 time: 0.985164 Jul 31 01:07:54.858790 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 276/554] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:53 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1312 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:54.866427 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-765e753a-1e48-4db3-8d1a-c9ccd4d8febe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:54.867359 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-765e753a-1e48-4db3-8d1a-c9ccd4d8febe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:54.924439 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-765e753a-1e48-4db3-8d1a-c9ccd4d8febe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:54.927889 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-765e753a-1e48-4db3-8d1a-c9ccd4d8febe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:54.932774 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-765e753a-1e48-4db3-8d1a-c9ccd4d8febe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:54.938466 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-765e753a-1e48-4db3-8d1a-c9ccd4d8febe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:55.271265 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-3fe1fb8f-6e57-4b65-a8d2-2f2d36ae9d50 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:55.323380 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3fe1fb8f-6e57-4b65-a8d2-2f2d36ae9d50 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1927 microversion: 2.75 time: 0.589508 Jul 31 01:07:55.326241 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 279/555] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:54 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1927 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:55.337697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a3c828ae-b93b-4381-934f-cb41792a094b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:55.339692 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a3c828ae-b93b-4381-934f-cb41792a094b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:55.366673 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3c828ae-b93b-4381-934f-cb41792a094b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:55.367958 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3c828ae-b93b-4381-934f-cb41792a094b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:55.369819 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3c828ae-b93b-4381-934f-cb41792a094b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:55.371568 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3c828ae-b93b-4381-934f-cb41792a094b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:55.595163 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-765e753a-1e48-4db3-8d1a-c9ccd4d8febe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:55.638088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-765e753a-1e48-4db3-8d1a-c9ccd4d8febe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:55.644101 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-765e753a-1e48-4db3-8d1a-c9ccd4d8febe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:55.651953 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-765e753a-1e48-4db3-8d1a-c9ccd4d8febe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1556 microversion: 2.25 time: 0.791146 Jul 31 01:07:55.664953 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 277/556] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:54 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1556 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:55.885700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a3c828ae-b93b-4381-934f-cb41792a094b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:55.895741 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a3c828ae-b93b-4381-934f-cb41792a094b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1502 microversion: 2.1 time: 0.567202 Jul 31 01:07:55.904158 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 280/557] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:55 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1502 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:55.922260 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-caca04ba-22ed-4810-9067-3676c89212d5 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '.version_select at 0x7fede5d30790>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:55.926701 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-caca04ba-22ed-4810-9067-3676c89212d5 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:55.927491 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-caca04ba-22ed-4810-9067-3676c89212d5 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:55.948706 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-caca04ba-22ed-4810-9067-3676c89212d5 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 1770 microversion: 2.25 time: 0.030079 Jul 31 01:07:55.957201 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 281/558] 10.222.0.45 () {60 vars in 1184 bytes} [Sun Jul 31 01:07:55 2022] GET /compute/v2.1/os-migrations => generated 1770 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:55.975502 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-12ad2f99-049f-43cc-8e10-1c599b96ff62 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:55.978023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-12ad2f99-049f-43cc-8e10-1c599b96ff62 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:55.992376 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12ad2f99-049f-43cc-8e10-1c599b96ff62 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:55.996124 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12ad2f99-049f-43cc-8e10-1c599b96ff62 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:55.997149 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12ad2f99-049f-43cc-8e10-1c599b96ff62 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:55.997587 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12ad2f99-049f-43cc-8e10-1c599b96ff62 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:56.071087 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-36fc6690-a0bc-4d6d-b366-d17bf03d778f tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Calling method '.version_select at 0x7fede5a4d3a0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:56.657797 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-36fc6690-a0bc-4d6d-b366-d17bf03d778f tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/3671373839c540179dc92fd659c3bfd4" status: 200 len: 371 microversion: 2.1 time: 0.991084 Jul 31 01:07:56.659496 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 278/559] 10.222.0.45 () {58 vars in 1242 bytes} [Sun Jul 31 01:07:55 2022] GET /compute/v2.1/os-quota-sets/3671373839c540179dc92fd659c3bfd4 => generated 371 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:56.680578 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-12ad2f99-049f-43cc-8e10-1c599b96ff62 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:56.700287 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-12ad2f99-049f-43cc-8e10-1c599b96ff62 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1312 microversion: 2.1 time: 0.740980 Jul 31 01:07:56.716344 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c0fadc77-daf0-4ba4-95e4-083549cca008 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:56.716344 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c0fadc77-daf0-4ba4-95e4-083549cca008 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:56.717999 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 282/560] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:55 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1312 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:56.734652 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-86727c9b-a7fb-4ce5-afab-fc7b0645a250 req-aa6292a2-d2d5-4740-bbd6-b45df2b68487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4faaeb8d-01fd-456a-b887-c5cf7ba7051b", "name": "network-vif-plugged", "status": "completed", "tag": "ad7e118b-a003-47c7-8563-67c45bdc1cce"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:56.736071 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0fadc77-daf0-4ba4-95e4-083549cca008 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:56.737379 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0fadc77-daf0-4ba4-95e4-083549cca008 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:56.738710 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0fadc77-daf0-4ba4-95e4-083549cca008 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:56.739499 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0fadc77-daf0-4ba4-95e4-083549cca008 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:56.770319 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-86727c9b-a7fb-4ce5-afab-fc7b0645a250 req-aa6292a2-d2d5-4740-bbd6-b45df2b68487 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:56.772307 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-86727c9b-a7fb-4ce5-afab-fc7b0645a250 req-aa6292a2-d2d5-4740-bbd6-b45df2b68487 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:56.835172 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-86727c9b-a7fb-4ce5-afab-fc7b0645a250 req-aa6292a2-d2d5-4740-bbd6-b45df2b68487 service nova] Creating event network-vif-plugged:ad7e118b-a003-47c7-8563-67c45bdc1cce for instance 4faaeb8d-01fd-456a-b887-c5cf7ba7051b on n-h2-master-1 Jul 31 01:07:56.860890 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-86727c9b-a7fb-4ce5-afab-fc7b0645a250 req-aa6292a2-d2d5-4740-bbd6-b45df2b68487 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139655 Jul 31 01:07:56.864615 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 283/561] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:56.876211 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0911ffac-4f3a-4a51-95df-151d0cf3ba4e tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:56.878093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0911ffac-4f3a-4a51-95df-151d0cf3ba4e tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:56.892867 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0911ffac-4f3a-4a51-95df-151d0cf3ba4e tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:56.894897 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0911ffac-4f3a-4a51-95df-151d0cf3ba4e tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:56.896773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0911ffac-4f3a-4a51-95df-151d0cf3ba4e tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:56.897347 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0911ffac-4f3a-4a51-95df-151d0cf3ba4e tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:57.243387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-0911ffac-4f3a-4a51-95df-151d0cf3ba4e tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:57.299172 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0911ffac-4f3a-4a51-95df-151d0cf3ba4e tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1927 microversion: 2.75 time: 0.431702 Jul 31 01:07:57.300407 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 284/562] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:56 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1927 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:57.310882 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-36d3ef94-caf3-4310-9188-74ef70c756db tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Action: 'update', calling method: .version_select at 0x7fede5b40700>, body: {"quota_set": {"ram": "5120"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:57.416411 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-c0fadc77-daf0-4ba4-95e4-083549cca008 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'services' on Instance uuid 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:57.446941 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c0fadc77-daf0-4ba4-95e4-083549cca008 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 2048 microversion: 2.25 time: 0.784479 Jul 31 01:07:57.448062 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 279/563] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:56 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 2048 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:57.457505 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a2a8e0f4-6671-47ed-a4cf-22b60bd8fa3b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:57.458999 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a2a8e0f4-6671-47ed-a4cf-22b60bd8fa3b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:57.482108 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a2a8e0f4-6671-47ed-a4cf-22b60bd8fa3b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:57.483100 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a2a8e0f4-6671-47ed-a4cf-22b60bd8fa3b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:57.484993 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a2a8e0f4-6671-47ed-a4cf-22b60bd8fa3b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:57.486084 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a2a8e0f4-6671-47ed-a4cf-22b60bd8fa3b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:57.840997 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a2a8e0f4-6671-47ed-a4cf-22b60bd8fa3b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:57.845067 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:57.854860 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a2a8e0f4-6671-47ed-a4cf-22b60bd8fa3b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1502 microversion: 2.1 time: 0.405188 Jul 31 01:07:57.855775 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 280/564] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:57 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1502 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:57.863803 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-49143a70-0586-462f-a0de-efd43863db10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:57.864817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-49143a70-0586-462f-a0de-efd43863db10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:57.872429 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49143a70-0586-462f-a0de-efd43863db10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:57.873865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49143a70-0586-462f-a0de-efd43863db10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:57.875947 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49143a70-0586-462f-a0de-efd43863db10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:57.877431 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49143a70-0586-462f-a0de-efd43863db10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:57.882855 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36d3ef94-caf3-4310-9188-74ef70c756db tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:57.883322 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36d3ef94-caf3-4310-9188-74ef70c756db tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:57.885066 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36d3ef94-caf3-4310-9188-74ef70c756db tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:57.885578 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36d3ef94-caf3-4310-9188-74ef70c756db tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:57.964482 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-36d3ef94-caf3-4310-9188-74ef70c756db tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/3671373839c540179dc92fd659c3bfd4" status: 200 len: 328 microversion: 2.1 time: 0.661913 Jul 31 01:07:57.973488 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 285/565] 10.222.0.45 () {60 vars in 1262 bytes} [Sun Jul 31 01:07:57 2022] PUT /compute/v2.1/os-quota-sets/3671373839c540179dc92fd659c3bfd4 => generated 328 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:57.979242 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-59c6f5f0-bade-467b-b016-6846df267bab tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1552904284", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "3c2be060-a5dd-4923-9ec8-26881bd84082"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:58.052106 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-59c6f5f0-bade-467b-b016-6846df267bab tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] validate_networks() for [('3c2be060-a5dd-4923-9ec8-26881bd84082', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:07:58.253681 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-49143a70-0586-462f-a0de-efd43863db10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:58.263763 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-49143a70-0586-462f-a0de-efd43863db10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1312 microversion: 2.1 time: 0.406310 Jul 31 01:07:58.279855 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 281/566] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:57 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1312 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:58.286860 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8d31c741-6c98-401e-80c3-5375cc768744 tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:58.305360 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8d31c741-6c98-401e-80c3-5375cc768744 tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-quota-sets/3671373839c540179dc92fd659c3bfd4" status: 202 len: 0 microversion: 2.1 time: 0.022788 Jul 31 01:07:58.307038 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 282/567] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:07:58 2022] DELETE /compute/v2.1/os-quota-sets/3671373839c540179dc92fd659c3bfd4 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:07:58.319621 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fea5c8c6-90ea-460c-8efa-2aa96da05088 tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Calling method '.version_select at 0x7fede5b434c0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:58.635426 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:58.650500 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fea5c8c6-90ea-460c-8efa-2aa96da05088 tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/3671373839c540179dc92fd659c3bfd4" status: 200 len: 371 microversion: 2.1 time: 0.338489 Jul 31 01:07:58.651789 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 283/568] 10.222.0.45 () {58 vars in 1242 bytes} [Sun Jul 31 01:07:58 2022] GET /compute/v2.1/os-quota-sets/3671373839c540179dc92fd659c3bfd4 => generated 371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:58.657861 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4d952d36-11d6-4e9f-be4d-c468f37a2c54 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:58.658649 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4d952d36-11d6-4e9f-be4d-c468f37a2c54 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:58.666359 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d952d36-11d6-4e9f-be4d-c468f37a2c54 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:58.667122 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d952d36-11d6-4e9f-be4d-c468f37a2c54 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:58.668433 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d952d36-11d6-4e9f-be4d-c468f37a2c54 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:58.669626 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d952d36-11d6-4e9f-be4d-c468f37a2c54 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:59.090985 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-4d952d36-11d6-4e9f-be4d-c468f37a2c54 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:07:59.121758 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4d952d36-11d6-4e9f-be4d-c468f37a2c54 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1927 microversion: 2.75 time: 0.468348 Jul 31 01:07:59.122851 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 284/569] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:58 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1927 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:07:59.132339 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-5adc064b-0a91-4ec2-8f92-4839e8beb7a6 req-47ae83eb-95eb-45f8-aefc-51b0c0e912e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328017bc-1f5e-4680-9c77-f5eefbce8135", "name": "network-vif-unplugged", "status": "completed", "tag": "f6d2a872-7a8a-4fce-a428-700f7792e65f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:59.150992 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-5adc064b-0a91-4ec2-8f92-4839e8beb7a6 req-47ae83eb-95eb-45f8-aefc-51b0c0e912e9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:59.152208 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-5adc064b-0a91-4ec2-8f92-4839e8beb7a6 req-47ae83eb-95eb-45f8-aefc-51b0c0e912e9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:59.177302 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-5adc064b-0a91-4ec2-8f92-4839e8beb7a6 req-47ae83eb-95eb-45f8-aefc-51b0c0e912e9 service nova] Creating event network-vif-unplugged:f6d2a872-7a8a-4fce-a428-700f7792e65f for instance 328017bc-1f5e-4680-9c77-f5eefbce8135 on n-h2-master-1 Jul 31 01:07:59.194340 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-5adc064b-0a91-4ec2-8f92-4839e8beb7a6 req-47ae83eb-95eb-45f8-aefc-51b0c0e912e9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068635 Jul 31 01:07:59.196686 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 285/570] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:59.210466 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-551a1e44-284f-4030-a751-7839d15e2fe5 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:59.212155 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-551a1e44-284f-4030-a751-7839d15e2fe5 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:59.225201 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-551a1e44-284f-4030-a751-7839d15e2fe5 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:59.226034 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-551a1e44-284f-4030-a751-7839d15e2fe5 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:59.228161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-551a1e44-284f-4030-a751-7839d15e2fe5 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:59.229919 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-551a1e44-284f-4030-a751-7839d15e2fe5 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:59.256007 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-59c6f5f0-bade-467b-b016-6846df267bab tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:07:59.256768 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-59c6f5f0-bade-467b-b016-6846df267bab tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:07:59.257799 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-59c6f5f0-bade-467b-b016-6846df267bab tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:07:59.258636 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-59c6f5f0-bade-467b-b016-6846df267bab tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:07:59.259867 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-59c6f5f0-bade-467b-b016-6846df267bab tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:07:59.274520 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-59c6f5f0-bade-467b-b016-6846df267bab tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:59.275277 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-59c6f5f0-bade-467b-b016-6846df267bab tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:59.276947 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-59c6f5f0-bade-467b-b016-6846df267bab tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:59.277423 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-59c6f5f0-bade-467b-b016-6846df267bab tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:59.306966 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-59c6f5f0-bade-467b-b016-6846df267bab tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Getting quotas for project 5881381d95ec452eb516c0c7ad826a08. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:07:59.312089 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-59c6f5f0-bade-467b-b016-6846df267bab tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Getting quotas for user cd6eb7e316f54ff386eaa598df805de9 and project 5881381d95ec452eb516c0c7ad826a08. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:07:59.326725 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-59c6f5f0-bade-467b-b016-6846df267bab tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:07:59.331131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-59c6f5f0-bade-467b-b016-6846df267bab tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:07:59.424085 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-59c6f5f0-bade-467b-b016-6846df267bab tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.449046 Jul 31 01:07:59.437375 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 286/571] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:07:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1463 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 01:07:59.449085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-826495fb-7642-4b0e-9599-10c72f50d359 tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Calling method '.version_select at 0x7fede5b18f70>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:59.521136 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-551a1e44-284f-4030-a751-7839d15e2fe5 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:59.546153 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-551a1e44-284f-4030-a751-7839d15e2fe5 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1502 microversion: 2.1 time: 0.344763 Jul 31 01:07:59.549668 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 286/572] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:59 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1502 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:59.562678 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-11d78d17-59c4-4721-a22c-a06399125bba tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:59.572953 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-11d78d17-59c4-4721-a22c-a06399125bba tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:59.608909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-11d78d17-59c4-4721-a22c-a06399125bba tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:59.609615 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-11d78d17-59c4-4721-a22c-a06399125bba tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:59.617087 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-11d78d17-59c4-4721-a22c-a06399125bba tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:59.617862 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-11d78d17-59c4-4721-a22c-a06399125bba tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:59.826871 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-826495fb-7642-4b0e-9599-10c72f50d359 tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/a957aecd79874f00a9bfb71913a8150f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.387911 Jul 31 01:07:59.839557 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 287/573] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 01:07:59 2022] GET /compute/v2.1/os-quota-sets/a957aecd79874f00a9bfb71913a8150f/defaults => generated 371 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:07:59.847064 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e77ecbc-47c6-40d0-a322-bb7ef17f4fef tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:07:59.848024 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3e77ecbc-47c6-40d0-a322-bb7ef17f4fef tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:59.869287 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-11d78d17-59c4-4721-a22c-a06399125bba tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:59.878360 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-11d78d17-59c4-4721-a22c-a06399125bba tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1462 microversion: 2.1 time: 0.324730 Jul 31 01:07:59.879484 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 287/574] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:07:59 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1462 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:07:59.917197 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7129b71b-4778-4b5d-8ecf-010ccf12af0a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:07:59.922009 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7129b71b-4778-4b5d-8ecf-010ccf12af0a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:07:59.936945 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7129b71b-4778-4b5d-8ecf-010ccf12af0a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:59.940583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7129b71b-4778-4b5d-8ecf-010ccf12af0a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:59.943014 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7129b71b-4778-4b5d-8ecf-010ccf12af0a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:07:59.944207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7129b71b-4778-4b5d-8ecf-010ccf12af0a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:07:59.959916 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e77ecbc-47c6-40d0-a322-bb7ef17f4fef tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:59.971609 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e77ecbc-47c6-40d0-a322-bb7ef17f4fef tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:59.973963 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e77ecbc-47c6-40d0-a322-bb7ef17f4fef tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:07:59.975649 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3e77ecbc-47c6-40d0-a322-bb7ef17f4fef tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1262 microversion: 2.25 time: 0.133883 Jul 31 01:07:59.976759 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 288/575] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:07:59 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1262 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:00.136507 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7129b71b-4778-4b5d-8ecf-010ccf12af0a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:00.147442 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7129b71b-4778-4b5d-8ecf-010ccf12af0a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Old instance type m1.heat2, new instance type m1.heat {{(pid=119474) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 31 01:08:00.150974 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-32ea9063-01b0-4cd0-b1e2-6f26447e515a tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:00.151615 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-32ea9063-01b0-4cd0-b1e2-6f26447e515a tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:00.167584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-32ea9063-01b0-4cd0-b1e2-6f26447e515a tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:00.167826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-7129b71b-4778-4b5d-8ecf-010ccf12af0a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:08:00.168267 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-7129b71b-4778-4b5d-8ecf-010ccf12af0a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:08:00.168682 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-32ea9063-01b0-4cd0-b1e2-6f26447e515a tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:00.168997 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-7129b71b-4778-4b5d-8ecf-010ccf12af0a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:08:00.169669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-7129b71b-4778-4b5d-8ecf-010ccf12af0a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:08:00.170487 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-7129b71b-4778-4b5d-8ecf-010ccf12af0a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:08:00.170634 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-32ea9063-01b0-4cd0-b1e2-6f26447e515a tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:00.171060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-32ea9063-01b0-4cd0-b1e2-6f26447e515a tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:00.296332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-32ea9063-01b0-4cd0-b1e2-6f26447e515a tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:08:00.322890 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-32ea9063-01b0-4cd0-b1e2-6f26447e515a tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1933 microversion: 2.75 time: 0.176509 Jul 31 01:08:00.324089 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 289/576] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:00 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1933 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:00.325287 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7129b71b-4778-4b5d-8ecf-010ccf12af0a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "POST /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b/action" status: 202 len: 0 microversion: 2.1 time: 0.421832 Jul 31 01:08:00.329794 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 288/577] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:07:59 2022] POST /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:08:00.334093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4d47398a-149a-418b-b951-79bc4b1bc406 tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Action: 'update', calling method: .version_select at 0x7fede5bc9a60>, body: {"quota_set": {"ram": "5120"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:00.343301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0366b331-de37-483d-becb-00a2ba6a5d46 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:00.345772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0366b331-de37-483d-becb-00a2ba6a5d46 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:00.364740 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0366b331-de37-483d-becb-00a2ba6a5d46 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:00.366216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0366b331-de37-483d-becb-00a2ba6a5d46 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:00.368460 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0366b331-de37-483d-becb-00a2ba6a5d46 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:00.372126 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0366b331-de37-483d-becb-00a2ba6a5d46 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:00.644874 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0366b331-de37-483d-becb-00a2ba6a5d46 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:00.657024 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0366b331-de37-483d-becb-00a2ba6a5d46 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1471 microversion: 2.1 time: 0.324226 Jul 31 01:08:00.670814 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 289/578] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:00 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1471 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:00.682011 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d5c5a642-b67b-4f7c-964b-a3fca6c50cbf tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:00.684050 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d5c5a642-b67b-4f7c-964b-a3fca6c50cbf tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:00.701471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5c5a642-b67b-4f7c-964b-a3fca6c50cbf tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:00.704369 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5c5a642-b67b-4f7c-964b-a3fca6c50cbf tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:00.706510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d47398a-149a-418b-b951-79bc4b1bc406 tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:00.707088 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d47398a-149a-418b-b951-79bc4b1bc406 tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:00.707703 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5c5a642-b67b-4f7c-964b-a3fca6c50cbf tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:00.708162 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d47398a-149a-418b-b951-79bc4b1bc406 tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:00.708493 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d47398a-149a-418b-b951-79bc4b1bc406 tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:00.709821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5c5a642-b67b-4f7c-964b-a3fca6c50cbf tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:00.840962 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4d47398a-149a-418b-b951-79bc4b1bc406 tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/6b241bbc11544543b020797095f1c67a" status: 200 len: 328 microversion: 2.1 time: 0.515507 Jul 31 01:08:00.847388 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 290/579] 10.222.0.45 () {60 vars in 1262 bytes} [Sun Jul 31 01:08:00 2022] PUT /compute/v2.1/os-quota-sets/6b241bbc11544543b020797095f1c67a => generated 328 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:00.863138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7000ddf-5a50-4c18-94cc-c230e560b83c tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Calling method '.version_select at 0x7fede5cb53a0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:01.080063 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d5c5a642-b67b-4f7c-964b-a3fca6c50cbf tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:01.094258 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d5c5a642-b67b-4f7c-964b-a3fca6c50cbf tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1502 microversion: 2.1 time: 0.421398 Jul 31 01:08:01.095376 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 290/580] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:00 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1502 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:01.103890 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e28875b1-238a-4714-b67a-94fcbc0a7a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:01.105019 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e28875b1-238a-4714-b67a-94fcbc0a7a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:01.124641 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e28875b1-238a-4714-b67a-94fcbc0a7a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:01.125135 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e28875b1-238a-4714-b67a-94fcbc0a7a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:01.126795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e28875b1-238a-4714-b67a-94fcbc0a7a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:01.127221 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e28875b1-238a-4714-b67a-94fcbc0a7a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:01.185722 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7000ddf-5a50-4c18-94cc-c230e560b83c tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:01.186181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7000ddf-5a50-4c18-94cc-c230e560b83c tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:01.187003 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7000ddf-5a50-4c18-94cc-c230e560b83c tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:01.187482 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7000ddf-5a50-4c18-94cc-c230e560b83c tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:01.210140 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a7000ddf-5a50-4c18-94cc-c230e560b83c tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/6b241bbc11544543b020797095f1c67a/detail" status: 200 len: 916 microversion: 2.1 time: 0.353800 Jul 31 01:08:01.210767 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 291/581] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:08:00 2022] GET /compute/v2.1/os-quota-sets/6b241bbc11544543b020797095f1c67a/detail => generated 916 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:08:01.247447 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e28875b1-238a-4714-b67a-94fcbc0a7a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:01.264492 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e28875b1-238a-4714-b67a-94fcbc0a7a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:01.269115 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e28875b1-238a-4714-b67a-94fcbc0a7a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:01.271722 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e28875b1-238a-4714-b67a-94fcbc0a7a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1314 microversion: 2.25 time: 0.174615 Jul 31 01:08:01.276627 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 291/582] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:01 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:01.296092 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dd9d2bd5-d210-427e-a524-e4c8d51acb35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-131788481", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:01.298164 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-38b43231-caa9-4a06-9f0e-e5310d1a52ca req-df7eb4c2-c688-4f6f-87ce-ebbe6320dde9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "328017bc-1f5e-4680-9c77-f5eefbce8135", "tag": "f6d2a872-7a8a-4fce-a428-700f7792e65f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:01.335580 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-38b43231-caa9-4a06-9f0e-e5310d1a52ca req-df7eb4c2-c688-4f6f-87ce-ebbe6320dde9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:01.336319 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-38b43231-caa9-4a06-9f0e-e5310d1a52ca req-df7eb4c2-c688-4f6f-87ce-ebbe6320dde9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:01.359372 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-38b43231-caa9-4a06-9f0e-e5310d1a52ca req-df7eb4c2-c688-4f6f-87ce-ebbe6320dde9 service nova] Creating event network-changed:f6d2a872-7a8a-4fce-a428-700f7792e65f for instance 328017bc-1f5e-4680-9c77-f5eefbce8135 on n-h2-master-1 Jul 31 01:08:01.366244 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-38b43231-caa9-4a06-9f0e-e5310d1a52ca req-df7eb4c2-c688-4f6f-87ce-ebbe6320dde9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088785 Jul 31 01:08:01.371428 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 292/583] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:01.378032 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5511de32-6f96-495d-8cc2-d30cd2c9a385 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:01.378809 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5511de32-6f96-495d-8cc2-d30cd2c9a385 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:01.382557 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-dd9d2bd5-d210-427e-a524-e4c8d51acb35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:08:01.388860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5511de32-6f96-495d-8cc2-d30cd2c9a385 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:01.389289 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5511de32-6f96-495d-8cc2-d30cd2c9a385 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:01.390979 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5511de32-6f96-495d-8cc2-d30cd2c9a385 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:01.391902 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5511de32-6f96-495d-8cc2-d30cd2c9a385 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:01.599224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-5511de32-6f96-495d-8cc2-d30cd2c9a385 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:08:01.634778 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5511de32-6f96-495d-8cc2-d30cd2c9a385 tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1933 microversion: 2.75 time: 0.261720 Jul 31 01:08:01.635917 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 293/584] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:01 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1933 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:01.648357 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ed26784a-bec4-4aac-a53e-d0cc29c2c08c tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Action: 'update', calling method: .version_select at 0x7fede5a5a550>, body: {"quota_set": {"ram": "2048"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:01.737885 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed26784a-bec4-4aac-a53e-d0cc29c2c08c tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:01.738699 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed26784a-bec4-4aac-a53e-d0cc29c2c08c tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:01.739659 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed26784a-bec4-4aac-a53e-d0cc29c2c08c tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:01.740277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed26784a-bec4-4aac-a53e-d0cc29c2c08c tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:01.792924 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed26784a-bec4-4aac-a53e-d0cc29c2c08c tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:01.793360 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed26784a-bec4-4aac-a53e-d0cc29c2c08c tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:01.794379 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed26784a-bec4-4aac-a53e-d0cc29c2c08c tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:01.794852 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed26784a-bec4-4aac-a53e-d0cc29c2c08c tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:01.898924 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ed26784a-bec4-4aac-a53e-d0cc29c2c08c tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/6b241bbc11544543b020797095f1c67a?user_id=323a261c33da42aca9e526303c681a30" status: 200 len: 328 microversion: 2.1 time: 0.260750 Jul 31 01:08:01.900403 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 294/585] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:08:01 2022] PUT /compute/v2.1/os-quota-sets/6b241bbc11544543b020797095f1c67a?user_id=323a261c33da42aca9e526303c681a30 => generated 328 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:01.910498 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-54b4a94a-682f-4678-b975-4312471553a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:01.911707 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-54b4a94a-682f-4678-b975-4312471553a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:01.930675 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-dd9d2bd5-d210-427e-a524-e4c8d51acb35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:08:01.931467 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-dd9d2bd5-d210-427e-a524-e4c8d51acb35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:08:01.932354 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-dd9d2bd5-d210-427e-a524-e4c8d51acb35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:08:01.933365 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-dd9d2bd5-d210-427e-a524-e4c8d51acb35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:08:01.934896 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-dd9d2bd5-d210-427e-a524-e4c8d51acb35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:08:01.936078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-54b4a94a-682f-4678-b975-4312471553a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:01.951812 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-54b4a94a-682f-4678-b975-4312471553a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:01.955250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-54b4a94a-682f-4678-b975-4312471553a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:01.955950 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd9d2bd5-d210-427e-a524-e4c8d51acb35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:01.956504 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd9d2bd5-d210-427e-a524-e4c8d51acb35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:01.957001 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-54b4a94a-682f-4678-b975-4312471553a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:01.957360 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd9d2bd5-d210-427e-a524-e4c8d51acb35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:01.957861 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd9d2bd5-d210-427e-a524-e4c8d51acb35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:01.994021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-dd9d2bd5-d210-427e-a524-e4c8d51acb35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:02.005945 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-dd9d2bd5-d210-427e-a524-e4c8d51acb35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:02.028024 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dd9d2bd5-d210-427e-a524-e4c8d51acb35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:08:02.030307 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dd9d2bd5-d210-427e-a524-e4c8d51acb35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:08:02.105719 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dd9d2bd5-d210-427e-a524-e4c8d51acb35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893141 Jul 31 01:08:02.113351 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 292/586] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:08:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:08:02.129960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5c5d1ca2-742c-46dd-b86d-90b6438a3f54 tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Calling method '.version_select at 0x7fede5b52790>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:02.319553 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:02.325997 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5c5d1ca2-742c-46dd-b86d-90b6438a3f54 tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/6b241bbc11544543b020797095f1c67a?user_id=323a261c33da42aca9e526303c681a30" status: 200 len: 370 microversion: 2.1 time: 0.204315 Jul 31 01:08:02.327845 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 293/587] 10.222.0.45 () {58 vars in 1323 bytes} [Sun Jul 31 01:08:02 2022] GET /compute/v2.1/os-quota-sets/6b241bbc11544543b020797095f1c67a?user_id=323a261c33da42aca9e526303c681a30 => generated 370 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:02.340122 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-39317af4-6f84-4b38-b97a-2a348bbe9212 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:02.342283 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-39317af4-6f84-4b38-b97a-2a348bbe9212 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:02.528746 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-39317af4-6f84-4b38-b97a-2a348bbe9212 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:02.546089 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-39317af4-6f84-4b38-b97a-2a348bbe9212 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1216 microversion: 2.1 time: 0.213227 Jul 31 01:08:02.551233 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 294/588] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:02 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1216 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:02.582222 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f2627ede-976f-4124-b9ac-b72a3e878d49 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:02.591783 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f2627ede-976f-4124-b9ac-b72a3e878d49 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:02.618295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2627ede-976f-4124-b9ac-b72a3e878d49 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:02.620257 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2627ede-976f-4124-b9ac-b72a3e878d49 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:02.621913 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-54b4a94a-682f-4678-b975-4312471553a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:02.622910 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2627ede-976f-4124-b9ac-b72a3e878d49 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:02.627395 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2627ede-976f-4124-b9ac-b72a3e878d49 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:02.651645 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-54b4a94a-682f-4678-b975-4312471553a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1471 microversion: 2.1 time: 0.741170 Jul 31 01:08:02.653428 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 295/589] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:01 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1471 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:02.690639 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-69d31301-5c33-4e94-9642-9e097baae81f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:02.693963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-69d31301-5c33-4e94-9642-9e097baae81f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:02.715090 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69d31301-5c33-4e94-9642-9e097baae81f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:02.716356 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69d31301-5c33-4e94-9642-9e097baae81f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:02.718332 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69d31301-5c33-4e94-9642-9e097baae81f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:02.720924 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69d31301-5c33-4e94-9642-9e097baae81f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:03.026748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-69d31301-5c33-4e94-9642-9e097baae81f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:03.051300 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-69d31301-5c33-4e94-9642-9e097baae81f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:03.053939 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-69d31301-5c33-4e94-9642-9e097baae81f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:03.073466 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-69d31301-5c33-4e94-9642-9e097baae81f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1320 microversion: 2.25 time: 0.390968 Jul 31 01:08:03.074819 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 296/590] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:02 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1320 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:03.111075 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-02da709f-817f-4563-aa29-1f230f4eb5ac tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:03.116893 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-02da709f-817f-4563-aa29-1f230f4eb5ac tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:03.147387 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02da709f-817f-4563-aa29-1f230f4eb5ac tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:03.151231 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02da709f-817f-4563-aa29-1f230f4eb5ac tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:03.157362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02da709f-817f-4563-aa29-1f230f4eb5ac tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:03.163583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02da709f-817f-4563-aa29-1f230f4eb5ac tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:03.377866 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f2627ede-976f-4124-b9ac-b72a3e878d49 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:03.380852 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-02da709f-817f-4563-aa29-1f230f4eb5ac tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] Lazy-loading 'services' on Instance uuid 2a1ae1fd-3106-462c-98a7-573cdf9bf324 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:08:03.391557 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f2627ede-976f-4124-b9ac-b72a3e878d49 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1502 microversion: 2.1 time: 0.838163 Jul 31 01:08:03.399595 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 295/591] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:02 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1502 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:03.404437 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dd2ef592-21da-4231-89a4-5784dbd11155 tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Calling method '.version_select at 0x7fede5e1f790>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:03.404622 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-02da709f-817f-4563-aa29-1f230f4eb5ac tempest-ServersAdmin275Test-1447515231 tempest-ServersAdmin275Test-1447515231-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1918 microversion: 2.75 time: 0.313603 Jul 31 01:08:03.414101 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 297/592] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:03 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1918 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:03.457485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95b9780e-fc19-41cf-bdb8-aa7270dda34b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:03.458363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-95b9780e-fc19-41cf-bdb8-aa7270dda34b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:03.470006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95b9780e-fc19-41cf-bdb8-aa7270dda34b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:03.470805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95b9780e-fc19-41cf-bdb8-aa7270dda34b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:03.472296 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95b9780e-fc19-41cf-bdb8-aa7270dda34b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:03.473064 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95b9780e-fc19-41cf-bdb8-aa7270dda34b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:03.510107 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-95b9780e-fc19-41cf-bdb8-aa7270dda34b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:08:03.515279 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:03.689828 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-95b9780e-fc19-41cf-bdb8-aa7270dda34b tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 204 len: 0 microversion: 2.75 time: 0.240485 Jul 31 01:08:03.690876 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 298/593] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:08:03 2022] DELETE /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:08:03.698220 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-70c2612a-9e7b-4d6a-b05a-95c9c7392dd8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:03.699004 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-70c2612a-9e7b-4d6a-b05a-95c9c7392dd8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:03.706417 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70c2612a-9e7b-4d6a-b05a-95c9c7392dd8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:03.707775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70c2612a-9e7b-4d6a-b05a-95c9c7392dd8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:03.707775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70c2612a-9e7b-4d6a-b05a-95c9c7392dd8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:03.708212 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70c2612a-9e7b-4d6a-b05a-95c9c7392dd8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:03.744539 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dd2ef592-21da-4231-89a4-5784dbd11155 tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/a957aecd79874f00a9bfb71913a8150f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.343322 Jul 31 01:08:03.745571 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 296/594] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 01:08:03 2022] GET /compute/v2.1/os-quota-sets/a957aecd79874f00a9bfb71913a8150f/defaults => generated 371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:03.777044 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-12924cf9-a1b4-4bd7-841e-23aa0d5b00b3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:03.778736 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-12924cf9-a1b4-4bd7-841e-23aa0d5b00b3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:03.788777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12924cf9-a1b4-4bd7-841e-23aa0d5b00b3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:03.789465 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12924cf9-a1b4-4bd7-841e-23aa0d5b00b3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:03.791331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12924cf9-a1b4-4bd7-841e-23aa0d5b00b3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:03.792418 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12924cf9-a1b4-4bd7-841e-23aa0d5b00b3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:03.934695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-70c2612a-9e7b-4d6a-b05a-95c9c7392dd8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:03.952343 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-70c2612a-9e7b-4d6a-b05a-95c9c7392dd8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1220 microversion: 2.1 time: 0.259410 Jul 31 01:08:03.960139 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 299/595] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:03 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1220 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:03.970658 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-18f43489-228f-4a0d-9808-44bf8fe0477e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:03.971682 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-18f43489-228f-4a0d-9808-44bf8fe0477e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:03.981286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18f43489-228f-4a0d-9808-44bf8fe0477e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:03.982010 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18f43489-228f-4a0d-9808-44bf8fe0477e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:03.982950 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18f43489-228f-4a0d-9808-44bf8fe0477e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:03.983551 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18f43489-228f-4a0d-9808-44bf8fe0477e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:04.184586 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-18f43489-228f-4a0d-9808-44bf8fe0477e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:04.211667 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-18f43489-228f-4a0d-9808-44bf8fe0477e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:04.216014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-18f43489-228f-4a0d-9808-44bf8fe0477e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:04.228585 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-18f43489-228f-4a0d-9808-44bf8fe0477e tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1443 microversion: 2.75 time: 0.266501 Jul 31 01:08:04.229591 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 300/596] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:03 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1443 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:04.240790 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b65e9f49-5cef-4e8f-ae3c-39afc591535f tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Action: 'update', calling method: .version_select at 0x7fede59945e0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:04.363962 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b65e9f49-5cef-4e8f-ae3c-39afc591535f tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:04.365123 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b65e9f49-5cef-4e8f-ae3c-39afc591535f tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:04.366714 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b65e9f49-5cef-4e8f-ae3c-39afc591535f tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:04.367429 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b65e9f49-5cef-4e8f-ae3c-39afc591535f tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:04.482149 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-12924cf9-a1b4-4bd7-841e-23aa0d5b00b3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:04.505272 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-12924cf9-a1b4-4bd7-841e-23aa0d5b00b3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1471 microversion: 2.1 time: 0.757796 Jul 31 01:08:04.506896 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 297/597] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:03 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1471 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:04.514411 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d8e530db-eced-4db6-908d-3e1f10a61ebc tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:04.516728 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d8e530db-eced-4db6-908d-3e1f10a61ebc tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:04.528774 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8e530db-eced-4db6-908d-3e1f10a61ebc tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:04.529983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8e530db-eced-4db6-908d-3e1f10a61ebc tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:04.533171 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8e530db-eced-4db6-908d-3e1f10a61ebc tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:04.534293 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8e530db-eced-4db6-908d-3e1f10a61ebc tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:04.637162 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:04.801818 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b65e9f49-5cef-4e8f-ae3c-39afc591535f tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/a957aecd79874f00a9bfb71913a8150f" status: 200 len: 329 microversion: 2.1 time: 0.570076 Jul 31 01:08:04.819987 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 301/598] 10.222.0.45 () {60 vars in 1263 bytes} [Sun Jul 31 01:08:04 2022] PUT /compute/v2.1/os-quota-sets/a957aecd79874f00a9bfb71913a8150f => generated 329 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:04.830972 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a982de96-d6f7-40c2-9460-3d07e15407ef tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:04.834400 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a982de96-d6f7-40c2-9460-3d07e15407ef tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:04.852455 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a982de96-d6f7-40c2-9460-3d07e15407ef tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:04.868385 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a982de96-d6f7-40c2-9460-3d07e15407ef tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:04.872988 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a982de96-d6f7-40c2-9460-3d07e15407ef tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:04.876839 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a982de96-d6f7-40c2-9460-3d07e15407ef tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:04.999247 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d8e530db-eced-4db6-908d-3e1f10a61ebc tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:05.025531 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d8e530db-eced-4db6-908d-3e1f10a61ebc tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:05.029156 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d8e530db-eced-4db6-908d-3e1f10a61ebc tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:05.031865 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d8e530db-eced-4db6-908d-3e1f10a61ebc tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1362 microversion: 2.25 time: 0.522738 Jul 31 01:08:05.033976 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 298/599] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:04 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1362 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:05.043315 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-05b20ed3-b2c4-4990-af81-25bfdf73794d tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Action: 'update', calling method: .version_select at 0x7fede5b52c10>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:05.183542 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05b20ed3-b2c4-4990-af81-25bfdf73794d tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:05.184340 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05b20ed3-b2c4-4990-af81-25bfdf73794d tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:05.185836 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05b20ed3-b2c4-4990-af81-25bfdf73794d tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:05.186626 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05b20ed3-b2c4-4990-af81-25bfdf73794d tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:05.363762 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a982de96-d6f7-40c2-9460-3d07e15407ef tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:05.380932 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a982de96-d6f7-40c2-9460-3d07e15407ef tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1502 microversion: 2.1 time: 0.559745 Jul 31 01:08:05.381601 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 302/600] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:04 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1502 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:05.392903 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b6950f18-41fb-4c69-9a4c-7d70d55a1468 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:05.394088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b6950f18-41fb-4c69-9a4c-7d70d55a1468 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:05.408440 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6950f18-41fb-4c69-9a4c-7d70d55a1468 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:05.409556 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6950f18-41fb-4c69-9a4c-7d70d55a1468 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:05.410926 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6950f18-41fb-4c69-9a4c-7d70d55a1468 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:05.411781 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6950f18-41fb-4c69-9a4c-7d70d55a1468 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:05.596853 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b6950f18-41fb-4c69-9a4c-7d70d55a1468 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:05.609057 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b6950f18-41fb-4c69-9a4c-7d70d55a1468 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1274 microversion: 2.1 time: 0.225568 Jul 31 01:08:05.610556 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 303/601] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:05 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1274 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:05.623379 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-90d481ba-dcce-4615-b38e-ebee70475fd6 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:05.625180 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-90d481ba-dcce-4615-b38e-ebee70475fd6 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:05.639218 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90d481ba-dcce-4615-b38e-ebee70475fd6 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:05.640336 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90d481ba-dcce-4615-b38e-ebee70475fd6 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:05.642579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90d481ba-dcce-4615-b38e-ebee70475fd6 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:05.643488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90d481ba-dcce-4615-b38e-ebee70475fd6 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:05.799500 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-90d481ba-dcce-4615-b38e-ebee70475fd6 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:05.818391 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-90d481ba-dcce-4615-b38e-ebee70475fd6 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:05.822875 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-90d481ba-dcce-4615-b38e-ebee70475fd6 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '136afabc79b34d7890d97563a12c9807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be9a55220414df38304fd11004f2a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:05.835328 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-90d481ba-dcce-4615-b38e-ebee70475fd6 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 200 len: 1443 microversion: 2.75 time: 0.222964 Jul 31 01:08:05.842001 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 304/602] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:05 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 1443 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:05.862171 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9fb7a958-c12d-4baa-80d2-576b4eb4ead4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:05.866643 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9fb7a958-c12d-4baa-80d2-576b4eb4ead4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:05.879932 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-05b20ed3-b2c4-4990-af81-25bfdf73794d tempest-QuotasAdminTestJSON-1677805230 tempest-QuotasAdminTestJSON-1677805230-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/a957aecd79874f00a9bfb71913a8150f" status: 200 len: 329 microversion: 2.1 time: 0.842722 Jul 31 01:08:05.891384 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 299/603] 10.222.0.45 () {60 vars in 1263 bytes} [Sun Jul 31 01:08:05 2022] PUT /compute/v2.1/os-quota-sets/a957aecd79874f00a9bfb71913a8150f => generated 329 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:05.891851 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9fb7a958-c12d-4baa-80d2-576b4eb4ead4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:05.892601 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9fb7a958-c12d-4baa-80d2-576b4eb4ead4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:05.894049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9fb7a958-c12d-4baa-80d2-576b4eb4ead4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:05.895701 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9fb7a958-c12d-4baa-80d2-576b4eb4ead4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:06.084040 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0192a107-a9b7-453f-a7c8-2f61ae26fb50 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:06.091264 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0192a107-a9b7-453f-a7c8-2f61ae26fb50 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:06.109262 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0192a107-a9b7-453f-a7c8-2f61ae26fb50 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:06.110328 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0192a107-a9b7-453f-a7c8-2f61ae26fb50 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:06.114358 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0192a107-a9b7-453f-a7c8-2f61ae26fb50 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:06.115581 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0192a107-a9b7-453f-a7c8-2f61ae26fb50 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:07.071660 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9fb7a958-c12d-4baa-80d2-576b4eb4ead4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:07.089031 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9fb7a958-c12d-4baa-80d2-576b4eb4ead4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1471 microversion: 2.1 time: 1.242928 Jul 31 01:08:07.090511 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 305/604] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:05 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1471 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:07.112327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3563c02c-34d1-40f1-a344-2161cd668bce tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:07.116871 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3563c02c-34d1-40f1-a344-2161cd668bce tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:07.135038 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3563c02c-34d1-40f1-a344-2161cd668bce tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:07.136693 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3563c02c-34d1-40f1-a344-2161cd668bce tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:07.138447 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3563c02c-34d1-40f1-a344-2161cd668bce tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:07.139545 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3563c02c-34d1-40f1-a344-2161cd668bce tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:07.358233 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0192a107-a9b7-453f-a7c8-2f61ae26fb50 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:07.370092 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0192a107-a9b7-453f-a7c8-2f61ae26fb50 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:07.372329 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0192a107-a9b7-453f-a7c8-2f61ae26fb50 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:07.375867 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0192a107-a9b7-453f-a7c8-2f61ae26fb50 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1362 microversion: 2.25 time: 1.300616 Jul 31 01:08:07.375867 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 300/605] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:06 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1362 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:07.380740 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4df6358d-45a8-41f4-b21d-cff1ddfcda3d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:07.382040 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4df6358d-45a8-41f4-b21d-cff1ddfcda3d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:07.389465 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4df6358d-45a8-41f4-b21d-cff1ddfcda3d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:07.390035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4df6358d-45a8-41f4-b21d-cff1ddfcda3d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:07.391012 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4df6358d-45a8-41f4-b21d-cff1ddfcda3d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:07.391944 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4df6358d-45a8-41f4-b21d-cff1ddfcda3d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:07.620872 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3563c02c-34d1-40f1-a344-2161cd668bce tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:07.669058 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3563c02c-34d1-40f1-a344-2161cd668bce tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1502 microversion: 2.1 time: 0.570049 Jul 31 01:08:07.683504 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 306/606] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:07 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1502 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:07.684832 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6bcb3928-8400-4783-8923-897707936249 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:07.685782 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6bcb3928-8400-4783-8923-897707936249 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] [instance: 2a1ae1fd-3106-462c-98a7-573cdf9bf324] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:07.705507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6bcb3928-8400-4783-8923-897707936249 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:07.705507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6bcb3928-8400-4783-8923-897707936249 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:07.705507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6bcb3928-8400-4783-8923-897707936249 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:07.709310 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6bcb3928-8400-4783-8923-897707936249 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:07.743156 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-6bcb3928-8400-4783-8923-897707936249 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] HTTP exception thrown: Instance 2a1ae1fd-3106-462c-98a7-573cdf9bf324 could not be found. Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6bcb3928-8400-4783-8923-897707936249 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Request method failure captured: Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 HTTP/1.1 Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dWpKv0sZ749UJqPB4OyM2WBSd4DLhpALeWeXVJ9TzCcleGYZbNwif5NFuvGCri5I4pXT7MkC5QXgBbaiw4xfVJJETHbs9NcosQMEepfbIyWB-zbeI_iCGpTsJpak0sRq73J2Ka8zr0mGbCjvgwU4mnVKLvkrjhcztJLxDTJTXIt1_c Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: X-Openstack-Nova-Api-Version: 2.75 Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 7be9a55220414df38304fd11004f2a9a Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersAdmin275Test-1336335277 Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:08:07.745012 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:08:07.747806 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7be9a55220414df38304fd11004f2a9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7be9a55220414df38304fd11004f2a9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7be9a55220414df38304fd11004f2a9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7be9a55220414df38304fd11004f2a9a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:08:07.747806 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersAdmin275Test-1336335277 Jul 31 01:08:07.747806 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 7be9a55220414df38304fd11004f2a9a Jul 31 01:08:07.747806 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersAdmin275Test-1336335277 Jul 31 01:08:07.747806 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersAdmin275Test-1336335277-project Jul 31 01:08:07.747806 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:08:07.747806 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:08:07.747806 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 136afabc79b34d7890d97563a12c9807 Jul 31 01:08:07.747806 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersAdmin275Test-1336335277-project Jul 31 01:08:07.747806 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:08:07.747806 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 2a1ae1fd-3106-462c-98a7-573cdf9bf324 could not be found. Jul 31 01:08:07.747806 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '2a1ae1fd-3106-462c-98a7-573cdf9bf324'} Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a1ae1fd-3106-462c-98a7-573cdf9bf324 could not be found. Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:08:07.749532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a1ae1fd-3106-462c-98a7-573cdf9bf324 could not be found. Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a1ae1fd-3106-462c-98a7-573cdf9bf324 could not be found. Jul 31 01:08:07.754109 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:07.761630 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6bcb3928-8400-4783-8923-897707936249 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] Returning 404 to user: Instance 2a1ae1fd-3106-462c-98a7-573cdf9bf324 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:08:07.761630 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6bcb3928-8400-4783-8923-897707936249 tempest-ServersAdmin275Test-1336335277 tempest-ServersAdmin275Test-1336335277-project] 10.222.0.45 "GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324" status: 404 len: 111 microversion: 2.75 time: 0.074914 Jul 31 01:08:07.761630 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 307/607] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:07 2022] GET /compute/v2.1/servers/2a1ae1fd-3106-462c-98a7-573cdf9bf324 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:08:07.948698 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4df6358d-45a8-41f4-b21d-cff1ddfcda3d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:07.981243 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4df6358d-45a8-41f4-b21d-cff1ddfcda3d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1316 microversion: 2.1 time: 0.603139 Jul 31 01:08:07.990866 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 301/608] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:07 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1316 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:08.118976 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-285f5b40-db40-4f9a-b11e-b0c156c3a572 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:08.121551 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-285f5b40-db40-4f9a-b11e-b0c156c3a572 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:08.151836 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-285f5b40-db40-4f9a-b11e-b0c156c3a572 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:08.152986 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-285f5b40-db40-4f9a-b11e-b0c156c3a572 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:08.156370 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-285f5b40-db40-4f9a-b11e-b0c156c3a572 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:08.158752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-285f5b40-db40-4f9a-b11e-b0c156c3a572 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:08.469607 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f1e0048b-3c4b-4675-9474-81d2d6e6451c tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Action: 'update', calling method: .version_select at 0x7fede59b73a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:08.657373 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1e0048b-3c4b-4675-9474-81d2d6e6451c tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:08.658191 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1e0048b-3c4b-4675-9474-81d2d6e6451c tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:08.659768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1e0048b-3c4b-4675-9474-81d2d6e6451c tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:08.660539 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1e0048b-3c4b-4675-9474-81d2d6e6451c tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:08.707838 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-285f5b40-db40-4f9a-b11e-b0c156c3a572 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:08.762369 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-285f5b40-db40-4f9a-b11e-b0c156c3a572 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1476 microversion: 2.1 time: 0.649344 Jul 31 01:08:08.774160 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 302/609] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:08 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1476 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:08:08.779811 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f1e0048b-3c4b-4675-9474-81d2d6e6451c tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/c1f4edcdf89f489a935c5709e099ada6" status: 200 len: 148 microversion: 2.57 time: 1.015538 Jul 31 01:08:08.780945 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 308/610] 10.222.0.45 () {62 vars in 1303 bytes} [Sun Jul 31 01:08:07 2022] PUT /compute/v2.1/os-quota-sets/c1f4edcdf89f489a935c5709e099ada6 => generated 148 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:08:08.787644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eb927481-97b6-4fe8-b57b-2735e48e6cb7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:08.788507 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eb927481-97b6-4fe8-b57b-2735e48e6cb7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:08.794098 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-31bb7e25-d2f0-410f-bccb-01addf3d57ff tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:08.796186 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-31bb7e25-d2f0-410f-bccb-01addf3d57ff tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:08.809039 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb927481-97b6-4fe8-b57b-2735e48e6cb7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:08.809419 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31bb7e25-d2f0-410f-bccb-01addf3d57ff tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:08.809668 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb927481-97b6-4fe8-b57b-2735e48e6cb7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:08.810308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb927481-97b6-4fe8-b57b-2735e48e6cb7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:08.810753 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb927481-97b6-4fe8-b57b-2735e48e6cb7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:08.811236 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31bb7e25-d2f0-410f-bccb-01addf3d57ff tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:08.812762 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31bb7e25-d2f0-410f-bccb-01addf3d57ff tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:08.814060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31bb7e25-d2f0-410f-bccb-01addf3d57ff tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:08.865603 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:09.474132 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eb927481-97b6-4fe8-b57b-2735e48e6cb7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:09.505066 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eb927481-97b6-4fe8-b57b-2735e48e6cb7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1502 microversion: 2.1 time: 0.722394 Jul 31 01:08:09.506886 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 309/611] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:08 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1502 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:09.517422 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3bf852ee-7703-4ad0-a52e-01c81c081c0e tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Calling method '.version_select at 0x7fede5949040>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:09.519638 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-31bb7e25-d2f0-410f-bccb-01addf3d57ff tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:09.536719 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-31bb7e25-d2f0-410f-bccb-01addf3d57ff tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:09.538365 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-31bb7e25-d2f0-410f-bccb-01addf3d57ff tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:09.539559 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-31bb7e25-d2f0-410f-bccb-01addf3d57ff tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1362 microversion: 2.25 time: 0.762197 Jul 31 01:08:09.540479 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 303/612] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:08 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1362 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:09.552818 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-95ebcaf1-e0cf-41ee-bf6a-bb078296b642 req-eb7e2d6d-19a1-4fa4-a040-f8f2c15e6d82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4db5ff-45fe-4d51-809d-d8983072a691", "tag": "ef0fdb3a-4238-4134-9002-c9963f855ec6"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:09.573759 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-95ebcaf1-e0cf-41ee-bf6a-bb078296b642 req-eb7e2d6d-19a1-4fa4-a040-f8f2c15e6d82 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:09.592971 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-95ebcaf1-e0cf-41ee-bf6a-bb078296b642 req-eb7e2d6d-19a1-4fa4-a040-f8f2c15e6d82 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:09.641225 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-95ebcaf1-e0cf-41ee-bf6a-bb078296b642 req-eb7e2d6d-19a1-4fa4-a040-f8f2c15e6d82 service nova] Creating event network-changed:ef0fdb3a-4238-4134-9002-c9963f855ec6 for instance 2d4db5ff-45fe-4d51-809d-d8983072a691 on n-h1-master-1 Jul 31 01:08:09.658921 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-95ebcaf1-e0cf-41ee-bf6a-bb078296b642 req-eb7e2d6d-19a1-4fa4-a040-f8f2c15e6d82 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114321 Jul 31 01:08:09.669416 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 304/613] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:09.681075 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-25fa074c-1dad-4f5e-96df-fda1bed7c622 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:09.688913 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-25fa074c-1dad-4f5e-96df-fda1bed7c622 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:09.718182 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25fa074c-1dad-4f5e-96df-fda1bed7c622 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:09.721601 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25fa074c-1dad-4f5e-96df-fda1bed7c622 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:09.726695 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25fa074c-1dad-4f5e-96df-fda1bed7c622 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:09.728139 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25fa074c-1dad-4f5e-96df-fda1bed7c622 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:10.248833 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3bf852ee-7703-4ad0-a52e-01c81c081c0e tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:10.249500 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3bf852ee-7703-4ad0-a52e-01c81c081c0e tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:10.251374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3bf852ee-7703-4ad0-a52e-01c81c081c0e tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:10.252204 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3bf852ee-7703-4ad0-a52e-01c81c081c0e tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:10.494571 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-25fa074c-1dad-4f5e-96df-fda1bed7c622 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:10.526167 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-25fa074c-1dad-4f5e-96df-fda1bed7c622 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1316 microversion: 2.1 time: 0.853659 Jul 31 01:08:10.527186 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 305/614] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:09 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1316 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:10.548371 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-978d36a8-c4e2-41e8-8408-f41e91017b66 req-f9d94def-bbc2-4859-81b0-ea27737a9bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "439c28bf-0712-481c-9dca-6d50f87fcfd9", "tag": "9f7d18a3-a076-4c90-b9fb-4dc8ebd95775"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:10.584985 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3bf852ee-7703-4ad0-a52e-01c81c081c0e tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/c1f4edcdf89f489a935c5709e099ada6/detail" status: 200 len: 463 microversion: 2.57 time: 1.075539 Jul 31 01:08:10.586667 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 310/615] 10.222.0.45 () {60 vars in 1304 bytes} [Sun Jul 31 01:08:09 2022] GET /compute/v2.1/os-quota-sets/c1f4edcdf89f489a935c5709e099ada6/detail => generated 463 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:08:10.598799 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-978d36a8-c4e2-41e8-8408-f41e91017b66 req-f9d94def-bbc2-4859-81b0-ea27737a9bf2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:10.599616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-978d36a8-c4e2-41e8-8408-f41e91017b66 req-f9d94def-bbc2-4859-81b0-ea27737a9bf2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:10.617573 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0408bcd6-40cf-4af0-8ac6-99b731d4e94d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:10.618212 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0408bcd6-40cf-4af0-8ac6-99b731d4e94d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:10.622164 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-978d36a8-c4e2-41e8-8408-f41e91017b66 req-f9d94def-bbc2-4859-81b0-ea27737a9bf2 service nova] Creating event network-changed:9f7d18a3-a076-4c90-b9fb-4dc8ebd95775 for instance 439c28bf-0712-481c-9dca-6d50f87fcfd9 on n-h2-master-1 Jul 31 01:08:10.626278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0408bcd6-40cf-4af0-8ac6-99b731d4e94d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:10.626820 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0408bcd6-40cf-4af0-8ac6-99b731d4e94d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:10.628634 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0408bcd6-40cf-4af0-8ac6-99b731d4e94d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:10.632769 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0408bcd6-40cf-4af0-8ac6-99b731d4e94d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:10.642602 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-978d36a8-c4e2-41e8-8408-f41e91017b66 req-f9d94def-bbc2-4859-81b0-ea27737a9bf2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094851 Jul 31 01:08:10.643943 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 306/616] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:10.654176 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-157309e8-b637-4056-8655-f4c7fa1dccf6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:10.655886 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-157309e8-b637-4056-8655-f4c7fa1dccf6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:10.668857 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-157309e8-b637-4056-8655-f4c7fa1dccf6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:10.669584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-157309e8-b637-4056-8655-f4c7fa1dccf6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:10.670967 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-157309e8-b637-4056-8655-f4c7fa1dccf6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:10.672120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-157309e8-b637-4056-8655-f4c7fa1dccf6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:10.932197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-157309e8-b637-4056-8655-f4c7fa1dccf6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:10.937718 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0408bcd6-40cf-4af0-8ac6-99b731d4e94d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:10.943999 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-157309e8-b637-4056-8655-f4c7fa1dccf6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1502 microversion: 2.1 time: 0.294379 Jul 31 01:08:10.944970 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 307/617] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:10 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1502 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:10.956811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a39233d7-52d5-411b-9e27-5fbf28ccdba5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:10.958137 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a39233d7-52d5-411b-9e27-5fbf28ccdba5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:10.961636 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0408bcd6-40cf-4af0-8ac6-99b731d4e94d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1476 microversion: 2.1 time: 0.373007 Jul 31 01:08:10.962313 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 311/618] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:10 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1476 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:10.981904 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a39233d7-52d5-411b-9e27-5fbf28ccdba5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:10.982450 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a39233d7-52d5-411b-9e27-5fbf28ccdba5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:10.983377 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a39233d7-52d5-411b-9e27-5fbf28ccdba5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:10.983957 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a39233d7-52d5-411b-9e27-5fbf28ccdba5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:11.151837 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7697700a-81b7-4f77-980f-2fccbd747816 tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Action: 'update', calling method: .version_select at 0x7fede59490d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:11.216628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a39233d7-52d5-411b-9e27-5fbf28ccdba5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:11.239078 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a39233d7-52d5-411b-9e27-5fbf28ccdba5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:11.242437 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a39233d7-52d5-411b-9e27-5fbf28ccdba5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:11.245091 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a39233d7-52d5-411b-9e27-5fbf28ccdba5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1362 microversion: 2.25 time: 0.298457 Jul 31 01:08:11.246313 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 308/619] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:10 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:11.554288 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7f237d9e-cb4f-4408-b46c-69d88042e110 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:11.559886 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7f237d9e-cb4f-4408-b46c-69d88042e110 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:11.568123 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:11.571690 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f237d9e-cb4f-4408-b46c-69d88042e110 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:11.572680 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f237d9e-cb4f-4408-b46c-69d88042e110 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:11.575308 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f237d9e-cb4f-4408-b46c-69d88042e110 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:11.576159 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f237d9e-cb4f-4408-b46c-69d88042e110 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:11.642890 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=83 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:11.651793 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7697700a-81b7-4f77-980f-2fccbd747816 tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:11.652641 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7697700a-81b7-4f77-980f-2fccbd747816 tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:11.653767 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7697700a-81b7-4f77-980f-2fccbd747816 tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:11.654442 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7697700a-81b7-4f77-980f-2fccbd747816 tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:11.714759 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7697700a-81b7-4f77-980f-2fccbd747816 tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:11.715551 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7697700a-81b7-4f77-980f-2fccbd747816 tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:11.716663 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7697700a-81b7-4f77-980f-2fccbd747816 tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:11.717338 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7697700a-81b7-4f77-980f-2fccbd747816 tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:11.821009 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7697700a-81b7-4f77-980f-2fccbd747816 tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/c1f4edcdf89f489a935c5709e099ada6?user_id=d66400ff03f1444ca2e5a0929726749a" status: 200 len: 148 microversion: 2.57 time: 0.676553 Jul 31 01:08:11.828779 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 312/620] 10.222.0.45 () {62 vars in 1384 bytes} [Sun Jul 31 01:08:11 2022] PUT /compute/v2.1/os-quota-sets/c1f4edcdf89f489a935c5709e099ada6?user_id=d66400ff03f1444ca2e5a0929726749a => generated 148 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 01:08:11.833789 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a928f1f6-f84d-4e3f-9f2f-13daed2e7f23 tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] Calling method '.version_select at 0x7fede5a4d310>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:12.070291 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7f237d9e-cb4f-4408-b46c-69d88042e110 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:12.100127 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7f237d9e-cb4f-4408-b46c-69d88042e110 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1316 microversion: 2.1 time: 0.554829 Jul 31 01:08:12.106680 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 309/621] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:11 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:08:12.112412 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b73721db-628f-48d2-a14f-84a71444cfe3 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:12.113189 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b73721db-628f-48d2-a14f-84a71444cfe3 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:12.120551 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b73721db-628f-48d2-a14f-84a71444cfe3 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:12.121164 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b73721db-628f-48d2-a14f-84a71444cfe3 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:12.122071 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b73721db-628f-48d2-a14f-84a71444cfe3 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:12.122642 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b73721db-628f-48d2-a14f-84a71444cfe3 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:12.310924 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a928f1f6-f84d-4e3f-9f2f-13daed2e7f23 tempest-QuotasAdminTestV257-1665206859 tempest-QuotasAdminTestV257-1665206859-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/c1f4edcdf89f489a935c5709e099ada6?user_id=d66400ff03f1444ca2e5a0929726749a" status: 200 len: 190 microversion: 2.57 time: 0.480154 Jul 31 01:08:12.313413 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 313/622] 10.222.0.45 () {60 vars in 1364 bytes} [Sun Jul 31 01:08:11 2022] GET /compute/v2.1/os-quota-sets/c1f4edcdf89f489a935c5709e099ada6?user_id=d66400ff03f1444ca2e5a0929726749a => generated 190 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:08:12.325395 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e8e82798-fd00-418a-aa2f-15951c43d3c7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:12.327483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e8e82798-fd00-418a-aa2f-15951c43d3c7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:12.349305 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8e82798-fd00-418a-aa2f-15951c43d3c7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:12.350956 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8e82798-fd00-418a-aa2f-15951c43d3c7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:12.352933 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8e82798-fd00-418a-aa2f-15951c43d3c7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:12.354491 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8e82798-fd00-418a-aa2f-15951c43d3c7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:12.974803 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b73721db-628f-48d2-a14f-84a71444cfe3 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:12.992137 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b73721db-628f-48d2-a14f-84a71444cfe3 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1492 microversion: 2.1 time: 0.883998 Jul 31 01:08:12.993096 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 310/623] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:12 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1492 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:12.998068 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0d420bbf-94bc-4168-a1b1-b5f00aef4499 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:12.998693 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0d420bbf-94bc-4168-a1b1-b5f00aef4499 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:13.008219 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d420bbf-94bc-4168-a1b1-b5f00aef4499 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:13.009090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d420bbf-94bc-4168-a1b1-b5f00aef4499 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:13.010149 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d420bbf-94bc-4168-a1b1-b5f00aef4499 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:13.010837 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d420bbf-94bc-4168-a1b1-b5f00aef4499 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:13.217462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e8e82798-fd00-418a-aa2f-15951c43d3c7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:13.226327 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e8e82798-fd00-418a-aa2f-15951c43d3c7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1476 microversion: 2.1 time: 0.911194 Jul 31 01:08:13.241082 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 314/624] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:12 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1476 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:13.361656 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0d420bbf-94bc-4168-a1b1-b5f00aef4499 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:13.381052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0d420bbf-94bc-4168-a1b1-b5f00aef4499 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:13.384503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0d420bbf-94bc-4168-a1b1-b5f00aef4499 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:13.386868 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0d420bbf-94bc-4168-a1b1-b5f00aef4499 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1362 microversion: 2.25 time: 0.392372 Jul 31 01:08:13.388112 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 311/625] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:12 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:13.397713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8bbc54c7-c157-4e28-92c9-0297fb9e4eb3 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '.version_select at 0x7fede5af5c10>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:13.405334 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8bbc54c7-c157-4e28-92c9-0297fb9e4eb3 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:13.406172 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8bbc54c7-c157-4e28-92c9-0297fb9e4eb3 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:13.424736 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8bbc54c7-c157-4e28-92c9-0297fb9e4eb3 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.034823 Jul 31 01:08:13.425754 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 312/626] 10.222.0.45 () {58 vars in 1143 bytes} [Sun Jul 31 01:08:13 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:13.435673 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4b43a21c-8475-4b42-897d-7c901685aeed tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:13.436848 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4b43a21c-8475-4b42-897d-7c901685aeed tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:13.447650 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b43a21c-8475-4b42-897d-7c901685aeed tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:13.448251 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b43a21c-8475-4b42-897d-7c901685aeed tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:13.449306 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b43a21c-8475-4b42-897d-7c901685aeed tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:13.450032 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b43a21c-8475-4b42-897d-7c901685aeed tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:13.697485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4b43a21c-8475-4b42-897d-7c901685aeed tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:13.714215 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4b43a21c-8475-4b42-897d-7c901685aeed tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1316 microversion: 2.1 time: 0.286097 Jul 31 01:08:13.727942 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 313/627] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:13 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:13.749625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3c5b567d-1f5f-4663-bc99-e32aa5546c80 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:13.750659 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3c5b567d-1f5f-4663-bc99-e32aa5546c80 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:13.763405 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c5b567d-1f5f-4663-bc99-e32aa5546c80 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:13.764717 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c5b567d-1f5f-4663-bc99-e32aa5546c80 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:13.766769 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c5b567d-1f5f-4663-bc99-e32aa5546c80 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:13.767987 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c5b567d-1f5f-4663-bc99-e32aa5546c80 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:13.809748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ccf95105-66db-45b1-abb0-7c94e18946c7 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Calling method '.version_select at 0x7fede5949790>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:13.880035 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-ccf95105-66db-45b1-abb0-7c94e18946c7 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] HTTP exception thrown: Image not found. Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ccf95105-66db-45b1-abb0-7c94e18946c7 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Request method failure captured: Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/images/23c79f8a-9345-4b85-b3f3-6cc1b1239f79/metadata/os_distro HTTP/1.1 Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dX8wrzf3a3BV8nw8GZWVnmkhxbGazLKCg5KT0zMz8PhzVvzkv2M8Gty5s3-vVbevJfd8QlZyprZVkloyvbDBfaEEsNNtbb0-f6jF5xITfitOHPztIZw-7nt-m9oCTE5LTzzvtvBq3dNXTqEm1iBcyy9gaN0FYLhkdFjPOiExGv4uXM Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 89c9348f5c35446a9e33a532c90ba240 Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:08:13.893766 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:08:13.896658 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_89c9348f5c35446a9e33a532c90ba240", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:08:13.896658 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:13.896658 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 89c9348f5c35446a9e33a532c90ba240 Jul 31 01:08:13.896658 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:13.896658 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesMetadataNegativeTestJSON-1515836947-project Jul 31 01:08:13.896658 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:08:13.896658 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:08:13.896658 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 3eac136df4764cdeaed9e361cdfa80e4 Jul 31 01:08:13.896658 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947-project Jul 31 01:08:13.896658 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:08:13.896658 n-d-master-1 devstack@n-api.service[119474]: exception: Image not found. Jul 31 01:08:13.896658 n-d-master-1 devstack@n-api.service[119474]: action_args: {'image_id': '23c79f8a-9345-4b85-b3f3-6cc1b1239f79', 'id': 'os_distro'} Jul 31 01:08:13.896658 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:08:13.898731 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 23c79f8a-9345-4b85-b3f3-6cc1b1239f79 Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:08:13.901132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 23c79f8a-9345-4b85-b3f3-6cc1b1239f79 could not be found. Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:08:13.903834 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:13.905428 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ccf95105-66db-45b1-abb0-7c94e18946c7 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Returning 404 to user: Image not found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:08:13.907286 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ccf95105-66db-45b1-abb0-7c94e18946c7 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] 10.222.0.45 "DELETE /compute/v2.1/images/23c79f8a-9345-4b85-b3f3-6cc1b1239f79/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.655992 Jul 31 01:08:13.907286 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 315/628] 10.222.0.45 () {58 vars in 1293 bytes} [Sun Jul 31 01:08:13 2022] DELETE /compute/v2.1/images/23c79f8a-9345-4b85-b3f3-6cc1b1239f79/metadata/os_distro => generated 62 bytes in 662 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:08:13.917534 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dc480ab3-c006-4241-bc13-9a0d9bda0b20 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Calling method '.version_select at 0x7fede5b25280>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:13.974994 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-dc480ab3-c006-4241-bc13-9a0d9bda0b20 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] HTTP exception thrown: Image not found. Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dc480ab3-c006-4241-bc13-9a0d9bda0b20 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Request method failure captured: Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/images/286b5561-e4ec-4e2d-a951-9ddfa159261e/metadata/os_version HTTP/1.1 Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dX8wrzf3a3BV8nw8GZWVnmkhxbGazLKCg5KT0zMz8PhzVvzkv2M8Gty5s3-vVbevJfd8QlZyprZVkloyvbDBfaEEsNNtbb0-f6jF5xITfitOHPztIZw-7nt-m9oCTE5LTzzvtvBq3dNXTqEm1iBcyy9gaN0FYLhkdFjPOiExGv4uXM Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 89c9348f5c35446a9e33a532c90ba240 Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:08:13.979669 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:08:13.981078 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_89c9348f5c35446a9e33a532c90ba240", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:08:13.981078 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:13.981078 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 89c9348f5c35446a9e33a532c90ba240 Jul 31 01:08:13.981078 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:13.981078 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesMetadataNegativeTestJSON-1515836947-project Jul 31 01:08:13.981078 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:08:13.981078 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:08:13.981078 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 3eac136df4764cdeaed9e361cdfa80e4 Jul 31 01:08:13.981078 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947-project Jul 31 01:08:13.981078 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:08:13.981078 n-d-master-1 devstack@n-api.service[119474]: exception: Image not found. Jul 31 01:08:13.981078 n-d-master-1 devstack@n-api.service[119474]: action_args: {'image_id': '286b5561-e4ec-4e2d-a951-9ddfa159261e', 'id': 'os_version'} Jul 31 01:08:13.981078 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:08:13.981823 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 286b5561-e4ec-4e2d-a951-9ddfa159261e Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:08:13.988526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 286b5561-e4ec-4e2d-a951-9ddfa159261e could not be found. Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:08:13.989802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:13.990882 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dc480ab3-c006-4241-bc13-9a0d9bda0b20 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Returning 404 to user: Image not found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:08:13.993330 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dc480ab3-c006-4241-bc13-9a0d9bda0b20 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] 10.222.0.45 "GET /compute/v2.1/images/286b5561-e4ec-4e2d-a951-9ddfa159261e/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.071463 Jul 31 01:08:13.993330 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 316/629] 10.222.0.45 () {58 vars in 1293 bytes} [Sun Jul 31 01:08:13 2022] GET /compute/v2.1/images/286b5561-e4ec-4e2d-a951-9ddfa159261e/metadata/os_version => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:08:13.996529 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-db0087d7-c62d-4a3c-8e76-7435f0f5a650 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Calling method '.version_select at 0x7fede5949160>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:14.036942 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-db0087d7-c62d-4a3c-8e76-7435f0f5a650 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] HTTP exception thrown: Image not found. Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-db0087d7-c62d-4a3c-8e76-7435f0f5a650 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Request method failure captured: Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/images/097b1bb9-c6a8-4a82-a47e-439ade9d20cc/metadata HTTP/1.1 Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dX8wrzf3a3BV8nw8GZWVnmkhxbGazLKCg5KT0zMz8PhzVvzkv2M8Gty5s3-vVbevJfd8QlZyprZVkloyvbDBfaEEsNNtbb0-f6jF5xITfitOHPztIZw-7nt-m9oCTE5LTzzvtvBq3dNXTqEm1iBcyy9gaN0FYLhkdFjPOiExGv4uXM Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 89c9348f5c35446a9e33a532c90ba240 Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:08:14.041538 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:08:14.044119 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_89c9348f5c35446a9e33a532c90ba240", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:08:14.044119 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:14.044119 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 89c9348f5c35446a9e33a532c90ba240 Jul 31 01:08:14.044119 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:14.044119 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesMetadataNegativeTestJSON-1515836947-project Jul 31 01:08:14.044119 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:08:14.044119 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:08:14.044119 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 3eac136df4764cdeaed9e361cdfa80e4 Jul 31 01:08:14.044119 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947-project Jul 31 01:08:14.044119 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:08:14.044119 n-d-master-1 devstack@n-api.service[119474]: exception: Image not found. Jul 31 01:08:14.044119 n-d-master-1 devstack@n-api.service[119474]: action_args: {'image_id': '097b1bb9-c6a8-4a82-a47e-439ade9d20cc'} Jul 31 01:08:14.044119 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:08:14.046306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 097b1bb9-c6a8-4a82-a47e-439ade9d20cc Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:08:14.048296 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 097b1bb9-c6a8-4a82-a47e-439ade9d20cc could not be found. Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:08:14.050532 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.055915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-db0087d7-c62d-4a3c-8e76-7435f0f5a650 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Returning 404 to user: Image not found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:08:14.060846 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-db0087d7-c62d-4a3c-8e76-7435f0f5a650 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] 10.222.0.45 "GET /compute/v2.1/images/097b1bb9-c6a8-4a82-a47e-439ade9d20cc/metadata" status: 404 len: 62 microversion: 2.1 time: 0.068281 Jul 31 01:08:14.067688 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 317/630] 10.222.0.45 () {58 vars in 1260 bytes} [Sun Jul 31 01:08:13 2022] GET /compute/v2.1/images/097b1bb9-c6a8-4a82-a47e-439ade9d20cc/metadata => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:08:14.080638 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3c5b567d-1f5f-4663-bc99-e32aa5546c80 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1643 microversion: 2.1 time: 0.350422 Jul 31 01:08:14.087704 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-559bd160-fae6-4d4a-87f6-a49c6ad02bb0 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Action: 'update_all', calling method: .version_select at 0x7fede59494c0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:14.092743 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 314/631] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:13 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1643 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:14.136331 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-559bd160-fae6-4d4a-87f6-a49c6ad02bb0 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] HTTP exception thrown: Image not found. Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-559bd160-fae6-4d4a-87f6-a49c6ad02bb0 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Request method failure captured: Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: request: PUT /compute/v2.1/images/e7d7b7c0-39ac-4f55-9755-ad54bb0a6595/metadata HTTP/1.1 Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 57 Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dX8wrzf3a3BV8nw8GZWVnmkhxbGazLKCg5KT0zMz8PhzVvzkv2M8Gty5s3-vVbevJfd8QlZyprZVkloyvbDBfaEEsNNtbb0-f6jF5xITfitOHPztIZw-7nt-m9oCTE5LTzzvtvBq3dNXTqEm1iBcyy9gaN0FYLhkdFjPOiExGv4uXM Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 89c9348f5c35446a9e33a532c90ba240 Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:08:14.145106 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:08:14.148114 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_89c9348f5c35446a9e33a532c90ba240", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:08:14.148114 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:14.148114 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 89c9348f5c35446a9e33a532c90ba240 Jul 31 01:08:14.148114 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:14.148114 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesMetadataNegativeTestJSON-1515836947-project Jul 31 01:08:14.148114 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:08:14.148114 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:08:14.148114 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 3eac136df4764cdeaed9e361cdfa80e4 Jul 31 01:08:14.148114 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947-project Jul 31 01:08:14.148114 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:08:14.148114 n-d-master-1 devstack@n-api.service[119474]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 31 01:08:14.148114 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:08:14.148114 n-d-master-1 devstack@n-api.service[119474]: exception: Image not found. Jul 31 01:08:14.148114 n-d-master-1 devstack@n-api.service[119474]: action_args: {'image_id': 'e7d7b7c0-39ac-4f55-9755-ad54bb0a6595', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:08:14.150538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e7d7b7c0-39ac-4f55-9755-ad54bb0a6595 Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:08:14.157500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e7d7b7c0-39ac-4f55-9755-ad54bb0a6595 could not be found. Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:08:14.162452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:08:14.167771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.174664 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-559bd160-fae6-4d4a-87f6-a49c6ad02bb0 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Returning 404 to user: Image not found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:08:14.176583 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-559bd160-fae6-4d4a-87f6-a49c6ad02bb0 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] 10.222.0.45 "PUT /compute/v2.1/images/e7d7b7c0-39ac-4f55-9755-ad54bb0a6595/metadata" status: 404 len: 62 microversion: 2.1 time: 0.101904 Jul 31 01:08:14.178368 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 318/632] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:08:14 2022] PUT /compute/v2.1/images/e7d7b7c0-39ac-4f55-9755-ad54bb0a6595/metadata => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:08:14.193442 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-df6fa1ee-fa17-4390-9253-68db05e5cceb tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Action: 'update', calling method: .version_select at 0x7fede5af5790>, body: {"meta": {"os_distro": "alt"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:14.289405 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e15007d4-6d70-4891-acb8-97bcc10c9c4e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:14.295051 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e15007d4-6d70-4891-acb8-97bcc10c9c4e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:14.361697 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e15007d4-6d70-4891-acb8-97bcc10c9c4e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:14.362485 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e15007d4-6d70-4891-acb8-97bcc10c9c4e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:14.366001 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-df6fa1ee-fa17-4390-9253-68db05e5cceb tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] HTTP exception thrown: Image not found. Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-df6fa1ee-fa17-4390-9253-68db05e5cceb tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Request method failure captured: Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: request: PUT /compute/v2.1/images/065eb303-234c-455c-b0df-8934f7dae3fb/metadata/os_distro HTTP/1.1 Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 30 Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dX8wrzf3a3BV8nw8GZWVnmkhxbGazLKCg5KT0zMz8PhzVvzkv2M8Gty5s3-vVbevJfd8QlZyprZVkloyvbDBfaEEsNNtbb0-f6jF5xITfitOHPztIZw-7nt-m9oCTE5LTzzvtvBq3dNXTqEm1iBcyy9gaN0FYLhkdFjPOiExGv4uXM Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 89c9348f5c35446a9e33a532c90ba240 Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:08:14.370430 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:08:14.373063 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_89c9348f5c35446a9e33a532c90ba240", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:08:14.373063 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:14.373063 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 89c9348f5c35446a9e33a532c90ba240 Jul 31 01:08:14.373063 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:14.373063 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesMetadataNegativeTestJSON-1515836947-project Jul 31 01:08:14.373063 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:08:14.373063 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:08:14.373063 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 3eac136df4764cdeaed9e361cdfa80e4 Jul 31 01:08:14.373063 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947-project Jul 31 01:08:14.373063 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:08:14.373063 n-d-master-1 devstack@n-api.service[119475]: {"meta": {"os_distro": "alt"}} Jul 31 01:08:14.373063 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:08:14.373063 n-d-master-1 devstack@n-api.service[119475]: exception: Image not found. Jul 31 01:08:14.373063 n-d-master-1 devstack@n-api.service[119475]: action_args: {'image_id': '065eb303-234c-455c-b0df-8934f7dae3fb', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:08:14.374798 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 065eb303-234c-455c-b0df-8934f7dae3fb Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:08:14.377880 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 065eb303-234c-455c-b0df-8934f7dae3fb could not be found. Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:08:14.380352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:08:14.382472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.390289 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-df6fa1ee-fa17-4390-9253-68db05e5cceb tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Returning 404 to user: Image not found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:08:14.390289 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-df6fa1ee-fa17-4390-9253-68db05e5cceb tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] 10.222.0.45 "PUT /compute/v2.1/images/065eb303-234c-455c-b0df-8934f7dae3fb/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.190681 Jul 31 01:08:14.390594 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e15007d4-6d70-4891-acb8-97bcc10c9c4e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:14.390594 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e15007d4-6d70-4891-acb8-97bcc10c9c4e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:14.391671 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 315/633] 10.222.0.45 () {60 vars in 1310 bytes} [Sun Jul 31 01:08:14 2022] PUT /compute/v2.1/images/065eb303-234c-455c-b0df-8934f7dae3fb/metadata/os_distro => generated 62 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:08:14.399726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-78835964-36ad-4f41-82dd-bef20043d4a9 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Action: 'create', calling method: .version_select at 0x7fede5a558b0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:14.464914 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-78835964-36ad-4f41-82dd-bef20043d4a9 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] HTTP exception thrown: Image not found. Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-78835964-36ad-4f41-82dd-bef20043d4a9 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Request method failure captured: Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/images/345ea909-40cd-4b7c-83f9-7c08652e11c5/metadata HTTP/1.1 Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 57 Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dX8wrzf3a3BV8nw8GZWVnmkhxbGazLKCg5KT0zMz8PhzVvzkv2M8Gty5s3-vVbevJfd8QlZyprZVkloyvbDBfaEEsNNtbb0-f6jF5xITfitOHPztIZw-7nt-m9oCTE5LTzzvtvBq3dNXTqEm1iBcyy9gaN0FYLhkdFjPOiExGv4uXM Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 89c9348f5c35446a9e33a532c90ba240 Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:08:14.469153 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:08:14.470397 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/89c9348f5c35446a9e33a532c90ba240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_89c9348f5c35446a9e33a532c90ba240", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:08:14.470397 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:14.470397 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 89c9348f5c35446a9e33a532c90ba240 Jul 31 01:08:14.470397 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947 Jul 31 01:08:14.470397 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesMetadataNegativeTestJSON-1515836947-project Jul 31 01:08:14.470397 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:08:14.470397 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:08:14.470397 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 3eac136df4764cdeaed9e361cdfa80e4 Jul 31 01:08:14.470397 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1515836947-project Jul 31 01:08:14.470397 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:08:14.470397 n-d-master-1 devstack@n-api.service[119475]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 31 01:08:14.470397 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:08:14.470397 n-d-master-1 devstack@n-api.service[119475]: exception: Image not found. Jul 31 01:08:14.470397 n-d-master-1 devstack@n-api.service[119475]: action_args: {'image_id': '345ea909-40cd-4b7c-83f9-7c08652e11c5', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:08:14.471234 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 345ea909-40cd-4b7c-83f9-7c08652e11c5 Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:08:14.472274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 345ea909-40cd-4b7c-83f9-7c08652e11c5 could not be found. Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:08:14.473393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:08:14.474472 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:14.475731 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-78835964-36ad-4f41-82dd-bef20043d4a9 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] Returning 404 to user: Image not found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:08:14.478183 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-78835964-36ad-4f41-82dd-bef20043d4a9 tempest-ImagesMetadataNegativeTestJSON-1515836947 tempest-ImagesMetadataNegativeTestJSON-1515836947-project] 10.222.0.45 "POST /compute/v2.1/images/345ea909-40cd-4b7c-83f9-7c08652e11c5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.084051 Jul 31 01:08:14.479364 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 316/634] 10.222.0.45 () {60 vars in 1281 bytes} [Sun Jul 31 01:08:14 2022] POST /compute/v2.1/images/345ea909-40cd-4b7c-83f9-7c08652e11c5/metadata => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:08:14.503436 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dfc12dcd-d320-4a94-afea-90da4cbc4fbd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-513113195", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "3d6735cc-8aac-4616-9429-654d8dcd9adc"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:14.660655 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-dfc12dcd-d320-4a94-afea-90da4cbc4fbd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] validate_networks() for [('3d6735cc-8aac-4616-9429-654d8dcd9adc', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:08:14.680666 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e15007d4-6d70-4891-acb8-97bcc10c9c4e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:14.694517 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e15007d4-6d70-4891-acb8-97bcc10c9c4e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1476 microversion: 2.1 time: 0.446955 Jul 31 01:08:14.696289 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 319/635] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:14 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1476 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:08:14.716464 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f2c13afe-193a-4fd6-8133-de3be048619f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:14.717422 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f2c13afe-193a-4fd6-8133-de3be048619f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:14.731404 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f2c13afe-193a-4fd6-8133-de3be048619f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:14.734360 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f2c13afe-193a-4fd6-8133-de3be048619f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:14.739137 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f2c13afe-193a-4fd6-8133-de3be048619f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:14.740159 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f2c13afe-193a-4fd6-8133-de3be048619f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:15.163178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f2c13afe-193a-4fd6-8133-de3be048619f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:15.176627 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f2c13afe-193a-4fd6-8133-de3be048619f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:15.181683 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f2c13afe-193a-4fd6-8133-de3be048619f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:15.182934 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f2c13afe-193a-4fd6-8133-de3be048619f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1362 microversion: 2.25 time: 0.485406 Jul 31 01:08:15.187382 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 320/636] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:14 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1362 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:15.206818 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=18 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:15.232779 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c848603f-99d9-4924-af98-6a3630005562 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:15.237621 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c848603f-99d9-4924-af98-6a3630005562 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:15.274658 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c848603f-99d9-4924-af98-6a3630005562 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:15.280085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c848603f-99d9-4924-af98-6a3630005562 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:15.282194 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c848603f-99d9-4924-af98-6a3630005562 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:15.283402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c848603f-99d9-4924-af98-6a3630005562 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:15.334720 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:15.833658 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c848603f-99d9-4924-af98-6a3630005562 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:15.841137 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-dfc12dcd-d320-4a94-afea-90da4cbc4fbd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:08:15.841899 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-dfc12dcd-d320-4a94-afea-90da4cbc4fbd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:08:15.843040 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-dfc12dcd-d320-4a94-afea-90da4cbc4fbd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:08:15.844020 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-dfc12dcd-d320-4a94-afea-90da4cbc4fbd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:08:15.845050 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-dfc12dcd-d320-4a94-afea-90da4cbc4fbd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:08:15.845661 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c848603f-99d9-4924-af98-6a3630005562 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1316 microversion: 2.1 time: 0.653024 Jul 31 01:08:15.856949 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=84 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:15.863067 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 321/637] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:15 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1316 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:15.887617 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dfc12dcd-d320-4a94-afea-90da4cbc4fbd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:15.890251 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dfc12dcd-d320-4a94-afea-90da4cbc4fbd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:15.898946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dfc12dcd-d320-4a94-afea-90da4cbc4fbd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:15.904514 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dfc12dcd-d320-4a94-afea-90da4cbc4fbd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:15.977262 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-dfc12dcd-d320-4a94-afea-90da4cbc4fbd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Getting quotas for project 5d8b0e81765c48039a523271670896d2. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:15.988776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-dfc12dcd-d320-4a94-afea-90da4cbc4fbd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Getting quotas for user 457bd8590d5040ef95854808b51c04d3 and project 5d8b0e81765c48039a523271670896d2. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:16.020732 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dfc12dcd-d320-4a94-afea-90da4cbc4fbd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:08:16.030199 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dfc12dcd-d320-4a94-afea-90da4cbc4fbd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:08:16.124357 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dfc12dcd-d320-4a94-afea-90da4cbc4fbd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.643523 Jul 31 01:08:16.136647 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 317/638] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:08:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:08:16.149086 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed0b8bcc-e7f3-41da-9c74-85f6296fa1ed tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:16.150582 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ed0b8bcc-e7f3-41da-9c74-85f6296fa1ed tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:16.165514 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed0b8bcc-e7f3-41da-9c74-85f6296fa1ed tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:16.166400 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed0b8bcc-e7f3-41da-9c74-85f6296fa1ed tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:16.168328 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed0b8bcc-e7f3-41da-9c74-85f6296fa1ed tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:16.169504 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed0b8bcc-e7f3-41da-9c74-85f6296fa1ed tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:16.475971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-388d0b37-9006-4f4a-b5b4-73813e7fc9bd tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-751910393", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:16.530207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ed0b8bcc-e7f3-41da-9c74-85f6296fa1ed tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:16.562119 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ed0b8bcc-e7f3-41da-9c74-85f6296fa1ed tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1476 microversion: 2.1 time: 0.419519 Jul 31 01:08:16.565346 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 318/639] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:16 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1476 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:16.587742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1b805cd2-824f-4761-910a-53ef3bf9ee2a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:16.589774 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1b805cd2-824f-4761-910a-53ef3bf9ee2a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:16.608566 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-388d0b37-9006-4f4a-b5b4-73813e7fc9bd tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] validate_networks() for None {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:08:16.808598 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1b805cd2-824f-4761-910a-53ef3bf9ee2a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:16.836255 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1b805cd2-824f-4761-910a-53ef3bf9ee2a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1210 microversion: 2.1 time: 0.262297 Jul 31 01:08:16.842724 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 319/640] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:16 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1210 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:16.865248 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-05318ec1-85b1-40d0-ab13-93579a83ec36 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:16.873883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-05318ec1-85b1-40d0-ab13-93579a83ec36 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:16.901230 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05318ec1-85b1-40d0-ab13-93579a83ec36 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:16.911127 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05318ec1-85b1-40d0-ab13-93579a83ec36 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:16.913613 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05318ec1-85b1-40d0-ab13-93579a83ec36 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:16.914663 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05318ec1-85b1-40d0-ab13-93579a83ec36 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:17.141712 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-388d0b37-9006-4f4a-b5b4-73813e7fc9bd tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:08:17.142132 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-388d0b37-9006-4f4a-b5b4-73813e7fc9bd tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:08:17.142609 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-388d0b37-9006-4f4a-b5b4-73813e7fc9bd tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:08:17.144355 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-388d0b37-9006-4f4a-b5b4-73813e7fc9bd tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:08:17.145103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-388d0b37-9006-4f4a-b5b4-73813e7fc9bd tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:08:17.176925 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-388d0b37-9006-4f4a-b5b4-73813e7fc9bd tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:17.193334 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-388d0b37-9006-4f4a-b5b4-73813e7fc9bd tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:17.196535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-388d0b37-9006-4f4a-b5b4-73813e7fc9bd tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:17.197048 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-388d0b37-9006-4f4a-b5b4-73813e7fc9bd tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:17.249047 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-388d0b37-9006-4f4a-b5b4-73813e7fc9bd tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Getting quotas for project e1c4dd30e2494fe6af680f0a99d70c5f. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:17.261093 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-388d0b37-9006-4f4a-b5b4-73813e7fc9bd tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Getting quotas for user aff3051461a1428a8cd7f730269ab0b3 and project e1c4dd30e2494fe6af680f0a99d70c5f. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:17.267995 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=92 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:17.296184 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-388d0b37-9006-4f4a-b5b4-73813e7fc9bd tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:08:17.299180 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-388d0b37-9006-4f4a-b5b4-73813e7fc9bd tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:08:17.315139 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-05318ec1-85b1-40d0-ab13-93579a83ec36 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:17.355901 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-05318ec1-85b1-40d0-ab13-93579a83ec36 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:17.364888 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-05318ec1-85b1-40d0-ab13-93579a83ec36 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:17.368894 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-05318ec1-85b1-40d0-ab13-93579a83ec36 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1362 microversion: 2.25 time: 0.520800 Jul 31 01:08:17.370969 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 320/641] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:16 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1362 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:17.380519 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-09f919c5-3429-49f0-b35d-79f5fdf38dd0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:17.383410 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-09f919c5-3429-49f0-b35d-79f5fdf38dd0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:17.404770 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-388d0b37-9006-4f4a-b5b4-73813e7fc9bd tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.539986 Jul 31 01:08:17.412388 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 322/642] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:08:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:08:17.423139 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1c584306-4ec6-4e96-8e04-6c7542f45098 req-360d3ff6-7395-49bc-a3fb-ce2ce3493254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4db5ff-45fe-4d51-809d-d8983072a691", "name": "network-vif-plugged", "status": "completed", "tag": "ef0fdb3a-4238-4134-9002-c9963f855ec6"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:17.427545 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09f919c5-3429-49f0-b35d-79f5fdf38dd0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:17.428379 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09f919c5-3429-49f0-b35d-79f5fdf38dd0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:17.429941 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09f919c5-3429-49f0-b35d-79f5fdf38dd0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:17.431000 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09f919c5-3429-49f0-b35d-79f5fdf38dd0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:17.445833 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1c584306-4ec6-4e96-8e04-6c7542f45098 req-360d3ff6-7395-49bc-a3fb-ce2ce3493254 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:17.446283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1c584306-4ec6-4e96-8e04-6c7542f45098 req-360d3ff6-7395-49bc-a3fb-ce2ce3493254 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:17.476037 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1c584306-4ec6-4e96-8e04-6c7542f45098 req-360d3ff6-7395-49bc-a3fb-ce2ce3493254 service nova] Creating event network-vif-plugged:ef0fdb3a-4238-4134-9002-c9963f855ec6 for instance 2d4db5ff-45fe-4d51-809d-d8983072a691 on n-h1-master-1 Jul 31 01:08:17.498235 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1c584306-4ec6-4e96-8e04-6c7542f45098 req-360d3ff6-7395-49bc-a3fb-ce2ce3493254 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080503 Jul 31 01:08:17.500791 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 323/643] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:17.515034 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4287d988-f104-44ef-8a7c-fe3eec332b34 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:17.517384 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4287d988-f104-44ef-8a7c-fe3eec332b34 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:17.827148 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4287d988-f104-44ef-8a7c-fe3eec332b34 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:17.847955 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4287d988-f104-44ef-8a7c-fe3eec332b34 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073" status: 200 len: 1221 microversion: 2.1 time: 0.344996 Jul 31 01:08:17.849024 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 324/644] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:17 2022] GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073 => generated 1221 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:17.870454 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aad17266-baa0-4611-aa42-1ba17bf5decb tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:17.871431 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aad17266-baa0-4611-aa42-1ba17bf5decb tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:17.885827 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aad17266-baa0-4611-aa42-1ba17bf5decb tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:17.887018 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aad17266-baa0-4611-aa42-1ba17bf5decb tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:17.889153 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aad17266-baa0-4611-aa42-1ba17bf5decb tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:17.890169 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aad17266-baa0-4611-aa42-1ba17bf5decb tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:18.037655 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-09f919c5-3429-49f0-b35d-79f5fdf38dd0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:18.051701 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-09f919c5-3429-49f0-b35d-79f5fdf38dd0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1316 microversion: 2.1 time: 0.672683 Jul 31 01:08:18.052474 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 321/645] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:17 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1316 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:18.058716 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0cdd20c8-4b71-4cb3-9d94-8fa8989e4d9a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:18.063272 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0cdd20c8-4b71-4cb3-9d94-8fa8989e4d9a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:18.086572 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0cdd20c8-4b71-4cb3-9d94-8fa8989e4d9a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:18.087589 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0cdd20c8-4b71-4cb3-9d94-8fa8989e4d9a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:18.089905 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0cdd20c8-4b71-4cb3-9d94-8fa8989e4d9a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:18.090588 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0cdd20c8-4b71-4cb3-9d94-8fa8989e4d9a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:18.220565 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0cdd20c8-4b71-4cb3-9d94-8fa8989e4d9a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:18.228651 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0cdd20c8-4b71-4cb3-9d94-8fa8989e4d9a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1270 microversion: 2.1 time: 0.174467 Jul 31 01:08:18.233821 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 322/646] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:18 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:18.255910 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-aad17266-baa0-4611-aa42-1ba17bf5decb tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:18.264512 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aad17266-baa0-4611-aa42-1ba17bf5decb tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1476 microversion: 2.1 time: 0.413857 Jul 31 01:08:18.270253 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 325/647] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:17 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1476 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:18.405188 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-87739b97-ae76-4187-bdec-abc8b019ecc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:18.406473 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-87739b97-ae76-4187-bdec-abc8b019ecc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:18.426016 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-87739b97-ae76-4187-bdec-abc8b019ecc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:18.426812 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-87739b97-ae76-4187-bdec-abc8b019ecc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:18.429495 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-87739b97-ae76-4187-bdec-abc8b019ecc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:18.431823 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-87739b97-ae76-4187-bdec-abc8b019ecc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:18.725372 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-87739b97-ae76-4187-bdec-abc8b019ecc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:18.741307 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-87739b97-ae76-4187-bdec-abc8b019ecc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:18.745085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-87739b97-ae76-4187-bdec-abc8b019ecc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:18.748068 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-87739b97-ae76-4187-bdec-abc8b019ecc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1362 microversion: 2.25 time: 0.352705 Jul 31 01:08:18.751587 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 323/648] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:18 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:18.882351 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1ad88d5d-73be-4197-9499-dca724c73958 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:18.884200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1ad88d5d-73be-4197-9499-dca724c73958 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:18.920945 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ad88d5d-73be-4197-9499-dca724c73958 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:18.922388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ad88d5d-73be-4197-9499-dca724c73958 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:18.923639 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ad88d5d-73be-4197-9499-dca724c73958 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:18.924729 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ad88d5d-73be-4197-9499-dca724c73958 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:19.052586 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1ad88d5d-73be-4197-9499-dca724c73958 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:19.067893 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1ad88d5d-73be-4197-9499-dca724c73958 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073" status: 200 len: 1217 microversion: 2.1 time: 0.201809 Jul 31 01:08:19.068755 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 326/649] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:18 2022] GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073 => generated 1217 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:19.089975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-085d7183-0e45-4b09-8719-f35f3e63b116 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:19.097741 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-085d7183-0e45-4b09-8719-f35f3e63b116 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:19.129718 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-085d7183-0e45-4b09-8719-f35f3e63b116 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:19.137396 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-085d7183-0e45-4b09-8719-f35f3e63b116 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:19.140666 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-085d7183-0e45-4b09-8719-f35f3e63b116 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:19.141810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-085d7183-0e45-4b09-8719-f35f3e63b116 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:19.261124 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f6020ca9-9ccc-4710-bcb2-2fddedaba446 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:19.268488 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f6020ca9-9ccc-4710-bcb2-2fddedaba446 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:19.295387 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6020ca9-9ccc-4710-bcb2-2fddedaba446 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:19.296163 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6020ca9-9ccc-4710-bcb2-2fddedaba446 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:19.299603 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6020ca9-9ccc-4710-bcb2-2fddedaba446 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:19.300373 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6020ca9-9ccc-4710-bcb2-2fddedaba446 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:19.438865 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f6020ca9-9ccc-4710-bcb2-2fddedaba446 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:19.448672 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f6020ca9-9ccc-4710-bcb2-2fddedaba446 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1268 microversion: 2.1 time: 0.196085 Jul 31 01:08:19.455861 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 327/650] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:19 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1268 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:19.461336 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-29f39245-0dc6-4f9e-9e4d-6675b97c1202 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:19.462547 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-29f39245-0dc6-4f9e-9e4d-6675b97c1202 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:19.473931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-29f39245-0dc6-4f9e-9e4d-6675b97c1202 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:19.474812 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-29f39245-0dc6-4f9e-9e4d-6675b97c1202 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:19.495224 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-29f39245-0dc6-4f9e-9e4d-6675b97c1202 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:19.496175 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-29f39245-0dc6-4f9e-9e4d-6675b97c1202 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:19.696423 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-085d7183-0e45-4b09-8719-f35f3e63b116 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:19.714397 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-085d7183-0e45-4b09-8719-f35f3e63b116 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1316 microversion: 2.1 time: 0.642161 Jul 31 01:08:19.715000 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 324/651] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:19 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1316 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:19.720368 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f5c46f8a-31c2-4204-b833-d76a6e8755fc req-31d6b8e1-fe77-431c-a63f-57e2c316ba5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439c28bf-0712-481c-9dca-6d50f87fcfd9", "name": "network-vif-plugged", "status": "completed", "tag": "9f7d18a3-a076-4c90-b9fb-4dc8ebd95775"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:19.741735 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f5c46f8a-31c2-4204-b833-d76a6e8755fc req-31d6b8e1-fe77-431c-a63f-57e2c316ba5b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:19.742480 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f5c46f8a-31c2-4204-b833-d76a6e8755fc req-31d6b8e1-fe77-431c-a63f-57e2c316ba5b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:19.772484 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f5c46f8a-31c2-4204-b833-d76a6e8755fc req-31d6b8e1-fe77-431c-a63f-57e2c316ba5b service nova] Creating event network-vif-plugged:9f7d18a3-a076-4c90-b9fb-4dc8ebd95775 for instance 439c28bf-0712-481c-9dca-6d50f87fcfd9 on n-h2-master-1 Jul 31 01:08:19.787578 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f5c46f8a-31c2-4204-b833-d76a6e8755fc req-31d6b8e1-fe77-431c-a63f-57e2c316ba5b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070095 Jul 31 01:08:19.792875 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 325/652] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:19.803689 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d23ac967-3f20-440e-8305-3a007ee98e24 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:19.804410 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d23ac967-3f20-440e-8305-3a007ee98e24 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:19.811661 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d23ac967-3f20-440e-8305-3a007ee98e24 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:19.812506 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d23ac967-3f20-440e-8305-3a007ee98e24 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:19.814284 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d23ac967-3f20-440e-8305-3a007ee98e24 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:19.815001 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d23ac967-3f20-440e-8305-3a007ee98e24 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:19.839452 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:20.066815 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-29f39245-0dc6-4f9e-9e4d-6675b97c1202 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:20.086447 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-29f39245-0dc6-4f9e-9e4d-6675b97c1202 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1476 microversion: 2.1 time: 0.628889 Jul 31 01:08:20.087157 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 328/653] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:19 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1476 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:20.112727 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f7c45f69-92ce-4fcd-add4-88daaff5adea tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:20.113545 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f7c45f69-92ce-4fcd-add4-88daaff5adea tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:20.125903 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7c45f69-92ce-4fcd-add4-88daaff5adea tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:20.131631 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7c45f69-92ce-4fcd-add4-88daaff5adea tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:20.133010 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7c45f69-92ce-4fcd-add4-88daaff5adea tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:20.133674 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7c45f69-92ce-4fcd-add4-88daaff5adea tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:20.388941 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f7c45f69-92ce-4fcd-add4-88daaff5adea tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:20.427307 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f7c45f69-92ce-4fcd-add4-88daaff5adea tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073" status: 200 len: 1281 microversion: 2.1 time: 0.313350 Jul 31 01:08:20.428131 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 329/654] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:20 2022] GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073 => generated 1281 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:20.455960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d23ac967-3f20-440e-8305-3a007ee98e24 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:20.478658 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d23ac967-3f20-440e-8305-3a007ee98e24 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:20.480749 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d23ac967-3f20-440e-8305-3a007ee98e24 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:20.482248 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d23ac967-3f20-440e-8305-3a007ee98e24 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1557 microversion: 2.25 time: 0.687312 Jul 31 01:08:20.483436 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 326/655] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:19 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1557 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:20.526574 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3a0deca5-b0ab-4531-8480-253ce56b469b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:20.527802 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3a0deca5-b0ab-4531-8480-253ce56b469b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:20.529901 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a648d73f-8f57-4a22-b327-1541d9df0c2d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:20.532903 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a648d73f-8f57-4a22-b327-1541d9df0c2d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:20.542175 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a0deca5-b0ab-4531-8480-253ce56b469b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:20.543059 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a0deca5-b0ab-4531-8480-253ce56b469b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:20.544609 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a0deca5-b0ab-4531-8480-253ce56b469b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:20.545379 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a0deca5-b0ab-4531-8480-253ce56b469b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:20.586585 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a648d73f-8f57-4a22-b327-1541d9df0c2d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:20.587806 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a648d73f-8f57-4a22-b327-1541d9df0c2d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:20.590923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a648d73f-8f57-4a22-b327-1541d9df0c2d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:20.592083 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a648d73f-8f57-4a22-b327-1541d9df0c2d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:21.181763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-a648d73f-8f57-4a22-b327-1541d9df0c2d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'services' on Instance uuid 2d4db5ff-45fe-4d51-809d-d8983072a691 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:08:21.255907 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a648d73f-8f57-4a22-b327-1541d9df0c2d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 2050 microversion: 2.25 time: 0.732537 Jul 31 01:08:21.275586 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 327/656] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:20 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 2050 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:21.312892 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ec08e64a-4eea-4e8b-8960-0b24d4b90ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:21.318340 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ec08e64a-4eea-4e8b-8960-0b24d4b90ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:21.382173 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec08e64a-4eea-4e8b-8960-0b24d4b90ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:21.382974 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec08e64a-4eea-4e8b-8960-0b24d4b90ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:21.384519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec08e64a-4eea-4e8b-8960-0b24d4b90ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:21.385307 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec08e64a-4eea-4e8b-8960-0b24d4b90ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:21.539495 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3a0deca5-b0ab-4531-8480-253ce56b469b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:21.600463 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3a0deca5-b0ab-4531-8480-253ce56b469b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1310 microversion: 2.1 time: 1.106703 Jul 31 01:08:21.601421 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 330/657] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:20 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1310 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:21.642326 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7f979bc0-fab6-43bf-b28b-159352836767 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:21.646485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7f979bc0-fab6-43bf-b28b-159352836767 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:21.675085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f979bc0-fab6-43bf-b28b-159352836767 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:21.676976 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f979bc0-fab6-43bf-b28b-159352836767 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:21.681994 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f979bc0-fab6-43bf-b28b-159352836767 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:21.683103 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f979bc0-fab6-43bf-b28b-159352836767 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:22.542320 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ec08e64a-4eea-4e8b-8960-0b24d4b90ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:22.595786 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ec08e64a-4eea-4e8b-8960-0b24d4b90ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1316 microversion: 2.1 time: 1.295769 Jul 31 01:08:22.597385 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 328/658] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:21 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1316 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:22.620315 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6ad01b77-28aa-43fc-9f36-257d98197592 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:22.626859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6ad01b77-28aa-43fc-9f36-257d98197592 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:22.654501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6ad01b77-28aa-43fc-9f36-257d98197592 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:22.655290 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6ad01b77-28aa-43fc-9f36-257d98197592 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:22.657335 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6ad01b77-28aa-43fc-9f36-257d98197592 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:22.658345 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6ad01b77-28aa-43fc-9f36-257d98197592 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:22.875950 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7f979bc0-fab6-43bf-b28b-159352836767 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:22.925434 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7f979bc0-fab6-43bf-b28b-159352836767 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1476 microversion: 2.1 time: 1.289271 Jul 31 01:08:22.927439 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 331/659] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:21 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1476 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:22.938826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c2268e2d-faa4-412f-b23e-14ab476e0de6 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:22.940569 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c2268e2d-faa4-412f-b23e-14ab476e0de6 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:22.954670 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c2268e2d-faa4-412f-b23e-14ab476e0de6 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:22.956018 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c2268e2d-faa4-412f-b23e-14ab476e0de6 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:22.957755 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c2268e2d-faa4-412f-b23e-14ab476e0de6 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:22.958902 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c2268e2d-faa4-412f-b23e-14ab476e0de6 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:23.733868 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c2268e2d-faa4-412f-b23e-14ab476e0de6 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:23.747777 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c2268e2d-faa4-412f-b23e-14ab476e0de6 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073" status: 200 len: 1279 microversion: 2.1 time: 0.818321 Jul 31 01:08:23.749015 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 332/660] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:22 2022] GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073 => generated 1279 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:23.776475 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ff088dff-ef56-4638-aad0-cb1e776cd546 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:23.777996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ff088dff-ef56-4638-aad0-cb1e776cd546 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:23.791843 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff088dff-ef56-4638-aad0-cb1e776cd546 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:23.792330 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff088dff-ef56-4638-aad0-cb1e776cd546 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:23.793403 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff088dff-ef56-4638-aad0-cb1e776cd546 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:23.794056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff088dff-ef56-4638-aad0-cb1e776cd546 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:24.126140 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-6ad01b77-28aa-43fc-9f36-257d98197592 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'services' on Instance uuid 2d4db5ff-45fe-4d51-809d-d8983072a691 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:08:24.145942 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6ad01b77-28aa-43fc-9f36-257d98197592 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 2050 microversion: 2.25 time: 1.546712 Jul 31 01:08:24.146846 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 329/661] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:22 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 2050 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:24.152196 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6e55a77d-0fcc-4048-abb0-0076a286ea40 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:24.153010 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6e55a77d-0fcc-4048-abb0-0076a286ea40 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:24.159660 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e55a77d-0fcc-4048-abb0-0076a286ea40 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:24.160408 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e55a77d-0fcc-4048-abb0-0076a286ea40 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:24.161364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e55a77d-0fcc-4048-abb0-0076a286ea40 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:24.161966 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e55a77d-0fcc-4048-abb0-0076a286ea40 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:24.505295 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ff088dff-ef56-4638-aad0-cb1e776cd546 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:24.539769 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ff088dff-ef56-4638-aad0-cb1e776cd546 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1310 microversion: 2.1 time: 0.760955 Jul 31 01:08:24.541661 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 333/662] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:23 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1310 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:24.551522 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b3300aa5-eda7-494c-bd09-c715d8dc6b07 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:24.555440 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b3300aa5-eda7-494c-bd09-c715d8dc6b07 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:24.580196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3300aa5-eda7-494c-bd09-c715d8dc6b07 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:24.581002 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3300aa5-eda7-494c-bd09-c715d8dc6b07 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:24.582456 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3300aa5-eda7-494c-bd09-c715d8dc6b07 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:24.583499 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3300aa5-eda7-494c-bd09-c715d8dc6b07 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:24.993224 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6e55a77d-0fcc-4048-abb0-0076a286ea40 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:25.008409 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6e55a77d-0fcc-4048-abb0-0076a286ea40 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1466 microversion: 2.1 time: 0.860188 Jul 31 01:08:25.011998 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 330/663] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:24 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1466 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:25.030106 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d85fa975-490a-4049-970a-0ad6013efa44 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:25.033373 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:08:25.033373 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:08:25.035111 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d85fa975-490a-4049-970a-0ad6013efa44 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:25.035810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d85fa975-490a-4049-970a-0ad6013efa44 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:25.040577 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d85fa975-490a-4049-970a-0ad6013efa44 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:25.041288 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d85fa975-490a-4049-970a-0ad6013efa44 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:25.100956 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d85fa975-490a-4049-970a-0ad6013efa44 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.081770 Jul 31 01:08:25.103211 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 331/664] 10.222.0.45 () {60 vars in 1217 bytes} [Sun Jul 31 01:08:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:08:25.112249 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-df6457f5-cebb-4edb-9e3a-56f34d0128f0 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:25.120576 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-df6457f5-cebb-4edb-9e3a-56f34d0128f0 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:25.130146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df6457f5-cebb-4edb-9e3a-56f34d0128f0 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:25.131136 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df6457f5-cebb-4edb-9e3a-56f34d0128f0 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:25.134517 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df6457f5-cebb-4edb-9e3a-56f34d0128f0 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:25.134982 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df6457f5-cebb-4edb-9e3a-56f34d0128f0 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:25.492493 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b3300aa5-eda7-494c-bd09-c715d8dc6b07 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:25.504311 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b3300aa5-eda7-494c-bd09-c715d8dc6b07 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1476 microversion: 2.1 time: 0.960756 Jul 31 01:08:25.508950 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 334/665] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:24 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1476 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:25.939171 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f31a0de4-81b2-481c-8393-506b3ed554fb tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:25.943450 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f31a0de4-81b2-481c-8393-506b3ed554fb tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:25.973755 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f31a0de4-81b2-481c-8393-506b3ed554fb tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:25.974819 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f31a0de4-81b2-481c-8393-506b3ed554fb tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:25.977730 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f31a0de4-81b2-481c-8393-506b3ed554fb tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:25.978600 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f31a0de4-81b2-481c-8393-506b3ed554fb tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:25.990413 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-df6457f5-cebb-4edb-9e3a-56f34d0128f0 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:26.026823 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-df6457f5-cebb-4edb-9e3a-56f34d0128f0 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073" status: 200 len: 1321 microversion: 2.1 time: 0.921509 Jul 31 01:08:26.032694 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 332/666] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:25 2022] GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073 => generated 1321 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:26.077564 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-899105f7-9471-4030-8a49-063971be67c8 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:26.080658 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-899105f7-9471-4030-8a49-063971be67c8 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:26.107978 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-899105f7-9471-4030-8a49-063971be67c8 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:26.108788 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-899105f7-9471-4030-8a49-063971be67c8 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:26.120583 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-899105f7-9471-4030-8a49-063971be67c8 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:26.121425 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-899105f7-9471-4030-8a49-063971be67c8 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:26.296170 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-899105f7-9471-4030-8a49-063971be67c8 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691/action" status: 202 len: 0 microversion: 2.25 time: 0.244076 Jul 31 01:08:26.299400 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 333/667] 10.222.0.45 () {62 vars in 1319 bytes} [Sun Jul 31 01:08:26 2022] POST /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:08:26.320532 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-b0538d73-53cd-4d4f-ac3b-241568f6e0bb req-f106e8bd-6adf-4b7f-b026-d99d9fc3f8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aafa66e0-8207-4875-947e-48fe17082af0", "tag": "81c9c6b7-7555-43c6-a140-9176296ddace"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:26.363913 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b0538d73-53cd-4d4f-ac3b-241568f6e0bb req-f106e8bd-6adf-4b7f-b026-d99d9fc3f8b6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:26.364486 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b0538d73-53cd-4d4f-ac3b-241568f6e0bb req-f106e8bd-6adf-4b7f-b026-d99d9fc3f8b6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:26.403363 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-b0538d73-53cd-4d4f-ac3b-241568f6e0bb req-f106e8bd-6adf-4b7f-b026-d99d9fc3f8b6 service nova] Creating event network-changed:81c9c6b7-7555-43c6-a140-9176296ddace for instance aafa66e0-8207-4875-947e-48fe17082af0 on n-h1-master-1 Jul 31 01:08:26.421328 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-b0538d73-53cd-4d4f-ac3b-241568f6e0bb req-f106e8bd-6adf-4b7f-b026-d99d9fc3f8b6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111154 Jul 31 01:08:26.422876 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 334/668] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:26.432855 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-22a43ac2-3713-4ecd-97de-c5442a715b4b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:26.438332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-22a43ac2-3713-4ecd-97de-c5442a715b4b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:26.455052 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22a43ac2-3713-4ecd-97de-c5442a715b4b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:26.456976 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22a43ac2-3713-4ecd-97de-c5442a715b4b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:26.459467 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22a43ac2-3713-4ecd-97de-c5442a715b4b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:26.462528 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22a43ac2-3713-4ecd-97de-c5442a715b4b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:26.826712 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:27.152474 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-22a43ac2-3713-4ecd-97de-c5442a715b4b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:27.168511 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-22a43ac2-3713-4ecd-97de-c5442a715b4b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1310 microversion: 2.1 time: 0.743207 Jul 31 01:08:27.183379 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 335/669] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:26 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1310 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:27.191310 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc9c001e-688a-40f3-bb4c-9449b417a989 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:27.193070 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc9c001e-688a-40f3-bb4c-9449b417a989 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:27.201471 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc9c001e-688a-40f3-bb4c-9449b417a989 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:27.202322 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc9c001e-688a-40f3-bb4c-9449b417a989 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:27.203436 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc9c001e-688a-40f3-bb4c-9449b417a989 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:27.204150 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc9c001e-688a-40f3-bb4c-9449b417a989 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:27.225865 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=22 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:27.626099 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f31a0de4-81b2-481c-8393-506b3ed554fb tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1617 microversion: 2.1 time: 2.115019 Jul 31 01:08:27.627062 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 335/670] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:25 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1617 bytes in 2117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:27.644420 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8fd6b660-04ff-4d27-8d4b-8ab3cc22ff7e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:27.644924 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8fd6b660-04ff-4d27-8d4b-8ab3cc22ff7e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:27.651668 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fd6b660-04ff-4d27-8d4b-8ab3cc22ff7e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:27.652584 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fd6b660-04ff-4d27-8d4b-8ab3cc22ff7e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:27.663035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fd6b660-04ff-4d27-8d4b-8ab3cc22ff7e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:27.663982 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fd6b660-04ff-4d27-8d4b-8ab3cc22ff7e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:27.840621 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=23 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:27.916018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-fc9c001e-688a-40f3-bb4c-9449b417a989 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'services' on Instance uuid 2d4db5ff-45fe-4d51-809d-d8983072a691 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:08:27.932287 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc9c001e-688a-40f3-bb4c-9449b417a989 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 2035 microversion: 2.25 time: 0.746532 Jul 31 01:08:27.933466 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 336/671] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:27 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 2035 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:27.953016 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-54368389-4536-46a2-b2ce-0fbb88d4b7d5 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:27.954536 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-54368389-4536-46a2-b2ce-0fbb88d4b7d5 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:27.964720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54368389-4536-46a2-b2ce-0fbb88d4b7d5 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:27.965198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54368389-4536-46a2-b2ce-0fbb88d4b7d5 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:27.966041 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54368389-4536-46a2-b2ce-0fbb88d4b7d5 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:27.966701 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54368389-4536-46a2-b2ce-0fbb88d4b7d5 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:28.125127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8fd6b660-04ff-4d27-8d4b-8ab3cc22ff7e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:28.142275 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8fd6b660-04ff-4d27-8d4b-8ab3cc22ff7e tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1476 microversion: 2.1 time: 0.513808 Jul 31 01:08:28.144423 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 336/672] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:27 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1476 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:28.162697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f6a4430-67a1-47ec-824a-abda7ad9fdb0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Action: 'create', calling method: .version_select at 0x7fede5ab2310>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-590843425", "policies": ["affinity"]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:28.182059 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-6f6a4430-67a1-47ec-824a-abda7ad9fdb0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:28.188386 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-6f6a4430-67a1-47ec-824a-abda7ad9fdb0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:28.261515 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-6f6a4430-67a1-47ec-824a-abda7ad9fdb0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:28.268761 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-6f6a4430-67a1-47ec-824a-abda7ad9fdb0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:28.289189 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6f6a4430-67a1-47ec-824a-abda7ad9fdb0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.142948 Jul 31 01:08:28.290112 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 337/673] 10.222.0.45 () {60 vars in 1174 bytes} [Sun Jul 31 01:08:28 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:28.296664 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-88713d84-82fa-4f9a-bb85-1a0932f87058 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Calling method '.version_select at 0x7fede5b431f0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:28.319297 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-54368389-4536-46a2-b2ce-0fbb88d4b7d5 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:28.339641 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-54368389-4536-46a2-b2ce-0fbb88d4b7d5 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073" status: 200 len: 1321 microversion: 2.1 time: 0.397861 Jul 31 01:08:28.355764 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 337/674] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:27 2022] GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073 => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:28.368319 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-88713d84-82fa-4f9a-bb85-1a0932f87058 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "GET /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b" status: 200 len: 636 microversion: 2.1 time: 0.073332 Jul 31 01:08:28.369134 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 338/675] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:08:28 2022] GET /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b => generated 636 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:28.372136 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e25c9b84-8e6f-43fe-8c91-140f9d7f840c tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:28.377611 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-83191750-c2e6-4d3c-b579-c24b6d874bb0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:28.380604 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e25c9b84-8e6f-43fe-8c91-140f9d7f840c tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:28.382189 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-83191750-c2e6-4d3c-b579-c24b6d874bb0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:28.391819 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e25c9b84-8e6f-43fe-8c91-140f9d7f840c tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:28.392459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e25c9b84-8e6f-43fe-8c91-140f9d7f840c tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:28.393500 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e25c9b84-8e6f-43fe-8c91-140f9d7f840c tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:28.394048 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e25c9b84-8e6f-43fe-8c91-140f9d7f840c tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:28.402669 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83191750-c2e6-4d3c-b579-c24b6d874bb0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:28.403244 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83191750-c2e6-4d3c-b579-c24b6d874bb0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:28.404166 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83191750-c2e6-4d3c-b579-c24b6d874bb0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:28.404929 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83191750-c2e6-4d3c-b579-c24b6d874bb0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:28.476302 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-e25c9b84-8e6f-43fe-8c91-140f9d7f840c tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'flavor' on Instance uuid 2d4db5ff-45fe-4d51-809d-d8983072a691 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:08:28.493744 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e25c9b84-8e6f-43fe-8c91-140f9d7f840c tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Going to try to live migrate instance to n-h2-master-1 {{(pid=119475) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 31 01:08:28.980594 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-83191750-c2e6-4d3c-b579-c24b6d874bb0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:28.999487 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-83191750-c2e6-4d3c-b579-c24b6d874bb0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1310 microversion: 2.1 time: 0.628418 Jul 31 01:08:29.000914 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 339/676] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:28 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1310 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:29.305492 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f540ed5f-e349-42d9-bc14-9929e57dc74c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Action: 'create', calling method: .version_select at 0x7fede5b64b80>, body: {"keypair": {"name": "tempest-keypair-1549772805", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb7TF8e6YgsKTduvslZ8Jg8DWHhTE3vsMzJBudDQ/aRmhuVoRJvh5ImNxb/IYQNdSgJ5TrF2WYTD31okpqtwV3ioOppwCIOiYTVdB89IERW2+Zks+8/QHQCtDVAfCZ1iA=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:29.337134 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-f540ed5f-e349-42d9-bc14-9929e57dc74c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Getting quotas for project 8234bed9d80f482ba5865459a5eba429. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:29.343417 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-f540ed5f-e349-42d9-bc14-9929e57dc74c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Getting quotas for user a59a6d0b6e8c4a239bf1b7ba80bdb68d and project 8234bed9d80f482ba5865459a5eba429. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:29.386320 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f540ed5f-e349-42d9-bc14-9929e57dc74c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.379758 Jul 31 01:08:29.405625 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 340/677] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:08:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:29.425685 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9b6170ba-5f11-44a6-9845-893df36462e4 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Action: 'update_all', calling method: .version_select at 0x7fede7fe18b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:29.563915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9b6170ba-5f11-44a6-9845-893df36462e4 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:29.576692 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9b6170ba-5f11-44a6-9845-893df36462e4 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for user ca2be0c08715470db62372816df208af and project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:30.256791 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9b6170ba-5f11-44a6-9845-893df36462e4 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "PUT /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.848527 Jul 31 01:08:30.265521 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 341/678] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:08:29 2022] PUT /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata => generated 61 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:08:30.274137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-de8ef14d-a4b7-4ee7-a3f4-3b054c2d1f92 req-85a51461-600b-46dd-8c5d-99dc454a4a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377d997f-f860-480f-b712-6be34358d073", "tag": "28a7d1f5-562e-42f5-8a21-e230c7de688a"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:30.292189 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-de8ef14d-a4b7-4ee7-a3f4-3b054c2d1f92 req-85a51461-600b-46dd-8c5d-99dc454a4a69 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:30.292946 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-de8ef14d-a4b7-4ee7-a3f4-3b054c2d1f92 req-85a51461-600b-46dd-8c5d-99dc454a4a69 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:30.313875 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-de8ef14d-a4b7-4ee7-a3f4-3b054c2d1f92 req-85a51461-600b-46dd-8c5d-99dc454a4a69 service nova] Creating event network-changed:28a7d1f5-562e-42f5-8a21-e230c7de688a for instance 377d997f-f860-480f-b712-6be34358d073 on n-h1-master-1 Jul 31 01:08:30.325891 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-de8ef14d-a4b7-4ee7-a3f4-3b054c2d1f92 req-85a51461-600b-46dd-8c5d-99dc454a4a69 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058252 Jul 31 01:08:30.327607 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 342/679] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:30.342453 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1050796421", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8bea6e9f-64e7-4c71-8a12-631589460836"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:30.446080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] validate_networks() for None {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:08:30.744815 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:08:30.745532 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:08:30.746128 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:08:30.746695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:08:30.747270 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:08:30.785021 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:30.785820 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:30.788460 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:30.791690 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:30.831305 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:30.842867 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:30.867523 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:30.877924 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Going to run 2 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:08:30.885986 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:08:30.981406 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119474) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 31 01:08:31.038523 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:31.051728 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:31.222895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:31.239380 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:31.275917 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=1aa29e77-13fc-46d3-9b2b-8f38833f1fa9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:08:31.386864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:31.391527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:31.483081 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:31.490594 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:31.560938 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5a3c5de6-976c-4a45-bb06-1c9ea12228b0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.228839 Jul 31 01:08:31.562030 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 343/680] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:08:30 2022] POST /compute/v2.1/servers => generated 32 bytes in 1234 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 31 01:08:31.572756 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bd506ad6-7c7d-4432-bf62-8066c5d88b61 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:31.574042 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bd506ad6-7c7d-4432-bf62-8066c5d88b61 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:31.582903 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd506ad6-7c7d-4432-bf62-8066c5d88b61 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:31.583788 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd506ad6-7c7d-4432-bf62-8066c5d88b61 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:31.584924 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd506ad6-7c7d-4432-bf62-8066c5d88b61 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:31.585615 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd506ad6-7c7d-4432-bf62-8066c5d88b61 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:31.937270 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bd506ad6-7c7d-4432-bf62-8066c5d88b61 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:31.960770 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bd506ad6-7c7d-4432-bf62-8066c5d88b61 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1476 microversion: 2.1 time: 0.396860 Jul 31 01:08:31.981185 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 344/681] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:31 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1476 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:32.003619 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e5caa6d2-0f66-492a-b3b5-4f8a5a17e968 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:32.005218 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e5caa6d2-0f66-492a-b3b5-4f8a5a17e968 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:32.022625 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5caa6d2-0f66-492a-b3b5-4f8a5a17e968 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:32.023723 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5caa6d2-0f66-492a-b3b5-4f8a5a17e968 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:32.025614 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5caa6d2-0f66-492a-b3b5-4f8a5a17e968 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:32.026728 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5caa6d2-0f66-492a-b3b5-4f8a5a17e968 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:32.103200 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e25c9b84-8e6f-43fe-8c91-140f9d7f840c tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691/action" status: 202 len: 0 microversion: 2.25 time: 3.745053 Jul 31 01:08:32.104564 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 338/682] 10.222.0.45 () {62 vars in 1319 bytes} [Sun Jul 31 01:08:28 2022] POST /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691/action => generated 0 bytes in 3748 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:08:32.122612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-23580d02-9564-472d-a269-ce2cec39a0e6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:32.126622 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-23580d02-9564-472d-a269-ce2cec39a0e6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:32.146707 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23580d02-9564-472d-a269-ce2cec39a0e6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:32.147232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23580d02-9564-472d-a269-ce2cec39a0e6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:32.151720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23580d02-9564-472d-a269-ce2cec39a0e6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:32.153202 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23580d02-9564-472d-a269-ce2cec39a0e6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:32.385082 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e5caa6d2-0f66-492a-b3b5-4f8a5a17e968 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:32.390395 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:32.398462 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e5caa6d2-0f66-492a-b3b5-4f8a5a17e968 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073" status: 200 len: 1321 microversion: 2.1 time: 0.415761 Jul 31 01:08:32.399260 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 345/683] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:31 2022] GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073 => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:32.406132 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0d7ec603-b36d-4b18-959c-0e03d387b477 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Calling method '.version_select at 0x7fede5b43e50>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:32.440705 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-23580d02-9564-472d-a269-ce2cec39a0e6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:32.455676 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-23580d02-9564-472d-a269-ce2cec39a0e6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1310 microversion: 2.1 time: 0.348595 Jul 31 01:08:32.456888 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 339/684] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:32 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1310 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:32.464885 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-238d0d7c-b712-48ef-b894-283955210ff9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:32.477377 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-238d0d7c-b712-48ef-b894-283955210ff9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:32.480714 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-238d0d7c-b712-48ef-b894-283955210ff9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Searching by: {'deleted': False, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:08:32.519817 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-238d0d7c-b712-48ef-b894-283955210ff9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:32.520767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-238d0d7c-b712-48ef-b894-283955210ff9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:32.522847 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-238d0d7c-b712-48ef-b894-283955210ff9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:32.523635 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-238d0d7c-b712-48ef-b894-283955210ff9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:32.711200 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:32.722886 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.multi_cell_list [None req-238d0d7c-b712-48ef-b894-283955210ff9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119475) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:08:32.841239 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-238d0d7c-b712-48ef-b894-283955210ff9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.382774 Jul 31 01:08:32.841577 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0d7ec603-b36d-4b18-959c-0e03d387b477 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "DELETE /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.441042 Jul 31 01:08:32.842235 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 340/685] 10.222.0.45 () {58 vars in 1125 bytes} [Sun Jul 31 01:08:32 2022] GET /compute/v2.1/servers => generated 1003 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:32.843224 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 346/686] 10.222.0.45 () {58 vars in 1296 bytes} [Sun Jul 31 01:08:32 2022] DELETE /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata/os_version => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:08:32.848240 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-35279125", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4e9a6189-e0eb-4a6a-b88e-951bd95b09b7"}], "security_groups": [{"name": "tempest-securitygroup--1067126775"}], "key_name": "tempest-keypair-1549772805", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:32.853012 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7cd7583d-e0ae-4626-8941-b1a378974e65 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:32.854154 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7cd7583d-e0ae-4626-8941-b1a378974e65 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:32.863248 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7cd7583d-e0ae-4626-8941-b1a378974e65 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:32.863733 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7cd7583d-e0ae-4626-8941-b1a378974e65 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:32.864847 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7cd7583d-e0ae-4626-8941-b1a378974e65 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:32.865536 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7cd7583d-e0ae-4626-8941-b1a378974e65 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:33.130563 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] validate_networks() for [('4e9a6189-e0eb-4a6a-b88e-951bd95b09b7', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:08:33.258542 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7cd7583d-e0ae-4626-8941-b1a378974e65 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:33.267946 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7cd7583d-e0ae-4626-8941-b1a378974e65 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:33.273672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7cd7583d-e0ae-4626-8941-b1a378974e65 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:33.276847 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7cd7583d-e0ae-4626-8941-b1a378974e65 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1567 microversion: 2.25 time: 0.432196 Jul 31 01:08:33.278977 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 347/687] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:32 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1567 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:33.289829 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e396d281-f804-4fc8-ab7d-3039ba807153 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Calling method '.version_select at 0x7fede5994940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:33.408815 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e396d281-f804-4fc8-ab7d-3039ba807153 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "GET /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata" status: 200 len: 37 microversion: 2.1 time: 0.128403 Jul 31 01:08:33.410230 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 348/688] 10.222.0.45 () {58 vars in 1260 bytes} [Sun Jul 31 01:08:33 2022] GET /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata => generated 37 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:08:33.415638 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-53b2d4a2-f767-4635-b0de-3022a04c61f1 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:33.419112 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-53b2d4a2-f767-4635-b0de-3022a04c61f1 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:33.426394 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53b2d4a2-f767-4635-b0de-3022a04c61f1 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:33.427248 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53b2d4a2-f767-4635-b0de-3022a04c61f1 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:33.428359 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53b2d4a2-f767-4635-b0de-3022a04c61f1 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:33.429050 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53b2d4a2-f767-4635-b0de-3022a04c61f1 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:33.721980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-53b2d4a2-f767-4635-b0de-3022a04c61f1 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:33.740333 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-53b2d4a2-f767-4635-b0de-3022a04c61f1 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 200 len: 1215 microversion: 2.1 time: 0.328108 Jul 31 01:08:33.741609 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 349/689] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:33 2022] GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 1215 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:33.750843 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-263af8c5-6998-47cb-8e8f-dffd1d22330d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:33.760343 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-263af8c5-6998-47cb-8e8f-dffd1d22330d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:33.774973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-263af8c5-6998-47cb-8e8f-dffd1d22330d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:33.775799 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-263af8c5-6998-47cb-8e8f-dffd1d22330d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:33.776907 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-263af8c5-6998-47cb-8e8f-dffd1d22330d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:33.777422 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-263af8c5-6998-47cb-8e8f-dffd1d22330d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:34.026977 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Getting quotas for project 8234bed9d80f482ba5865459a5eba429. Resources: dict_keys(['metadata_items']) {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:34.029425 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-263af8c5-6998-47cb-8e8f-dffd1d22330d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:34.033443 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Getting quotas for user a59a6d0b6e8c4a239bf1b7ba80bdb68d and project 8234bed9d80f482ba5865459a5eba429. Resources: dict_keys(['metadata_items']) {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:34.041163 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-263af8c5-6998-47cb-8e8f-dffd1d22330d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1475 microversion: 2.1 time: 0.298044 Jul 31 01:08:34.042790 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 350/690] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:33 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1475 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:34.055543 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bb0a33a7-aa26-487e-9274-36548f0c7e17 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Action: 'update_all', calling method: .version_select at 0x7fede6025280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:34.058483 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:08:34.059143 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:08:34.060006 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:08:34.060598 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:08:34.061221 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:08:34.073765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:34.074238 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:34.075094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:34.075734 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:34.099439 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Getting quotas for project 8234bed9d80f482ba5865459a5eba429. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:34.105801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Getting quotas for user a59a6d0b6e8c4a239bf1b7ba80bdb68d and project 8234bed9d80f482ba5865459a5eba429. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:34.127702 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-bb0a33a7-aa26-487e-9274-36548f0c7e17 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:34.130712 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:08:34.133431 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:08:34.137628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-bb0a33a7-aa26-487e-9274-36548f0c7e17 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for user ca2be0c08715470db62372816df208af and project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:34.148467 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:34.194081 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7e606c48-3afe-42d5-a136-2fa30e330db4 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.350357 Jul 31 01:08:34.195019 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 341/691] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:08:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:08:34.200342 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4e6320aa-653f-4015-b561-f65859804c1d tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:34.201321 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4e6320aa-653f-4015-b561-f65859804c1d tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:34.236434 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e6320aa-653f-4015-b561-f65859804c1d tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:34.237520 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e6320aa-653f-4015-b561-f65859804c1d tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:34.240615 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e6320aa-653f-4015-b561-f65859804c1d tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:34.242055 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e6320aa-653f-4015-b561-f65859804c1d tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:34.701324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4e6320aa-653f-4015-b561-f65859804c1d tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:34.765263 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4e6320aa-653f-4015-b561-f65859804c1d tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073" status: 200 len: 1321 microversion: 2.1 time: 0.568499 Jul 31 01:08:34.771582 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 342/692] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:34 2022] GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073 => generated 1321 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:34.789382 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3f292f1a-728b-4161-a04c-4451787e0a2a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:34.793102 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3f292f1a-728b-4161-a04c-4451787e0a2a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:34.824055 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f292f1a-728b-4161-a04c-4451787e0a2a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:34.826335 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f292f1a-728b-4161-a04c-4451787e0a2a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:34.831543 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f292f1a-728b-4161-a04c-4451787e0a2a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:34.840965 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f292f1a-728b-4161-a04c-4451787e0a2a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:35.217446 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bb0a33a7-aa26-487e-9274-36548f0c7e17 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "PUT /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata" status: 200 len: 61 microversion: 2.1 time: 1.172526 Jul 31 01:08:35.218553 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 351/693] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:08:34 2022] PUT /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata => generated 61 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:08:35.239111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-c47326be-1ab3-4f7c-97ef-c5fb7f5c3b04 req-19fbfc46-5a6b-4c24-90b4-cf5ed2aa8c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aafa66e0-8207-4875-947e-48fe17082af0", "name": "network-vif-plugged", "status": "completed", "tag": "81c9c6b7-7555-43c6-a140-9176296ddace"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:35.285216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c47326be-1ab3-4f7c-97ef-c5fb7f5c3b04 req-19fbfc46-5a6b-4c24-90b4-cf5ed2aa8c95 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:35.286487 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c47326be-1ab3-4f7c-97ef-c5fb7f5c3b04 req-19fbfc46-5a6b-4c24-90b4-cf5ed2aa8c95 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:35.335624 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-c47326be-1ab3-4f7c-97ef-c5fb7f5c3b04 req-19fbfc46-5a6b-4c24-90b4-cf5ed2aa8c95 service nova] Creating event network-vif-plugged:81c9c6b7-7555-43c6-a140-9176296ddace for instance aafa66e0-8207-4875-947e-48fe17082af0 on n-h1-master-1 Jul 31 01:08:35.356756 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-c47326be-1ab3-4f7c-97ef-c5fb7f5c3b04 req-19fbfc46-5a6b-4c24-90b4-cf5ed2aa8c95 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134702 Jul 31 01:08:35.357882 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 352/694] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:35.374504 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d53a42ae-e9bb-424c-ac25-138f134136f5 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:35.389157 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d53a42ae-e9bb-424c-ac25-138f134136f5 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:35.756208 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d53a42ae-e9bb-424c-ac25-138f134136f5 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:35.768832 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d53a42ae-e9bb-424c-ac25-138f134136f5 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 200 len: 1276 microversion: 2.1 time: 0.402177 Jul 31 01:08:35.770713 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 353/695] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:35 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 1276 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:35.782990 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-69e569e5-cad4-4012-b827-d2cc490d0be1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:35.784105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-69e569e5-cad4-4012-b827-d2cc490d0be1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:35.811912 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69e569e5-cad4-4012-b827-d2cc490d0be1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:35.817363 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69e569e5-cad4-4012-b827-d2cc490d0be1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:35.821387 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69e569e5-cad4-4012-b827-d2cc490d0be1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:35.824739 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69e569e5-cad4-4012-b827-d2cc490d0be1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:36.027048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3f292f1a-728b-4161-a04c-4451787e0a2a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:36.041257 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3f292f1a-728b-4161-a04c-4451787e0a2a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1310 microversion: 2.1 time: 1.267534 Jul 31 01:08:36.042971 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 343/696] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:34 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1310 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:36.049531 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-14d45122-266f-4bb6-b72a-8868fe315af3 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:36.050923 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-14d45122-266f-4bb6-b72a-8868fe315af3 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:36.059317 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14d45122-266f-4bb6-b72a-8868fe315af3 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:36.060155 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14d45122-266f-4bb6-b72a-8868fe315af3 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:36.061053 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14d45122-266f-4bb6-b72a-8868fe315af3 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:36.061532 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14d45122-266f-4bb6-b72a-8868fe315af3 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:36.181765 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-14d45122-266f-4bb6-b72a-8868fe315af3 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:36.191952 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-14d45122-266f-4bb6-b72a-8868fe315af3 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 200 len: 1277 microversion: 2.1 time: 0.147510 Jul 31 01:08:36.192940 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 344/697] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:36 2022] GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:36.198437 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d3960ccc-9383-4df5-b2b5-0698d3a89ca6 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:36.200987 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d3960ccc-9383-4df5-b2b5-0698d3a89ca6 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:36.208581 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3960ccc-9383-4df5-b2b5-0698d3a89ca6 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:36.209460 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3960ccc-9383-4df5-b2b5-0698d3a89ca6 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:36.211172 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3960ccc-9383-4df5-b2b5-0698d3a89ca6 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:36.211913 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3960ccc-9383-4df5-b2b5-0698d3a89ca6 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:36.263005 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d3960ccc-9383-4df5-b2b5-0698d3a89ca6 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:08:36.317462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-69e569e5-cad4-4012-b827-d2cc490d0be1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:36.349910 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-69e569e5-cad4-4012-b827-d2cc490d0be1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:36.354456 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-69e569e5-cad4-4012-b827-d2cc490d0be1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:36.356990 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-69e569e5-cad4-4012-b827-d2cc490d0be1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1567 microversion: 2.25 time: 0.584482 Jul 31 01:08:36.371402 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 354/698] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:35 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1567 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:36.376780 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d7c9b046-15f8-427f-88a1-5d92493efc7d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:36.376780 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d7c9b046-15f8-427f-88a1-5d92493efc7d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:36.394192 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7c9b046-15f8-427f-88a1-5d92493efc7d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:36.395260 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7c9b046-15f8-427f-88a1-5d92493efc7d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:36.397628 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7c9b046-15f8-427f-88a1-5d92493efc7d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:36.398776 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7c9b046-15f8-427f-88a1-5d92493efc7d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:36.607136 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d3960ccc-9383-4df5-b2b5-0698d3a89ca6 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 204 len: 0 microversion: 2.1 time: 0.412089 Jul 31 01:08:36.608134 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 345/699] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:08:36 2022] DELETE /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:08:36.619323 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c9054707-f70f-41d9-8eeb-8f5400092aa1 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Calling method '.version_select at 0x7fede5973790>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:36.716464 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c9054707-f70f-41d9-8eeb-8f5400092aa1 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "GET /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.106311 Jul 31 01:08:36.717959 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 346/700] 10.222.0.45 () {58 vars in 1290 bytes} [Sun Jul 31 01:08:36 2022] GET /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata/os_distro => generated 33 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:08:36.728313 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3bcc34e7-6a39-4ca1-bea8-31a8ac1ecd89 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:36.731001 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3bcc34e7-6a39-4ca1-bea8-31a8ac1ecd89 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:36.748205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bcc34e7-6a39-4ca1-bea8-31a8ac1ecd89 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:36.749279 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bcc34e7-6a39-4ca1-bea8-31a8ac1ecd89 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:36.751390 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bcc34e7-6a39-4ca1-bea8-31a8ac1ecd89 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:36.752487 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bcc34e7-6a39-4ca1-bea8-31a8ac1ecd89 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:36.771677 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d7c9b046-15f8-427f-88a1-5d92493efc7d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:36.787328 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d7c9b046-15f8-427f-88a1-5d92493efc7d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1475 microversion: 2.1 time: 0.423151 Jul 31 01:08:36.788869 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 355/701] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:36 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1475 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:36.805996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8b7f85fc-7329-4f29-b052-9231ffe56608 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:36.806638 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8b7f85fc-7329-4f29-b052-9231ffe56608 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:36.822177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b7f85fc-7329-4f29-b052-9231ffe56608 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:36.822983 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b7f85fc-7329-4f29-b052-9231ffe56608 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:36.824538 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b7f85fc-7329-4f29-b052-9231ffe56608 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:36.825777 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b7f85fc-7329-4f29-b052-9231ffe56608 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:37.247628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3bcc34e7-6a39-4ca1-bea8-31a8ac1ecd89 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:37.261804 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3bcc34e7-6a39-4ca1-bea8-31a8ac1ecd89 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073" status: 200 len: 1321 microversion: 2.1 time: 0.542243 Jul 31 01:08:37.262854 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 347/702] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:36 2022] GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073 => generated 1321 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:37.270199 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2120657d-25e8-4e0a-ac6c-9ca8135cbe18 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Action: 'update_all', calling method: .version_select at 0x7fede5b26790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:37.324470 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8b7f85fc-7329-4f29-b052-9231ffe56608 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:37.336567 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8b7f85fc-7329-4f29-b052-9231ffe56608 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 200 len: 1716 microversion: 2.1 time: 0.546368 Jul 31 01:08:37.338288 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 356/703] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:36 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 1716 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:37.350208 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4320da39-6f5e-46dc-83fd-47e607da9dcc tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:37.350823 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4320da39-6f5e-46dc-83fd-47e607da9dcc tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:37.367943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-2120657d-25e8-4e0a-ac6c-9ca8135cbe18 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:37.370277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4320da39-6f5e-46dc-83fd-47e607da9dcc tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:37.370737 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4320da39-6f5e-46dc-83fd-47e607da9dcc tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:37.371561 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4320da39-6f5e-46dc-83fd-47e607da9dcc tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:37.371997 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4320da39-6f5e-46dc-83fd-47e607da9dcc tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:37.377901 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-2120657d-25e8-4e0a-ac6c-9ca8135cbe18 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for user ca2be0c08715470db62372816df208af and project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:37.545823 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4320da39-6f5e-46dc-83fd-47e607da9dcc tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:37.557126 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4320da39-6f5e-46dc-83fd-47e607da9dcc tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 200 len: 1334 microversion: 2.1 time: 0.218863 Jul 31 01:08:37.558079 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 357/704] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:37 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 1334 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:37.570504 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-97e6965e-e321-4fe1-a9e0-24749a1e6348 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:37.571608 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-97e6965e-e321-4fe1-a9e0-24749a1e6348 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:37.591683 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97e6965e-e321-4fe1-a9e0-24749a1e6348 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:37.592305 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97e6965e-e321-4fe1-a9e0-24749a1e6348 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:37.593493 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97e6965e-e321-4fe1-a9e0-24749a1e6348 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:37.594334 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97e6965e-e321-4fe1-a9e0-24749a1e6348 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:37.690145 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2120657d-25e8-4e0a-ac6c-9ca8135cbe18 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "PUT /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.425913 Jul 31 01:08:37.690812 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 348/705] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:08:37 2022] PUT /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata => generated 61 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:08:37.697744 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4b43d9e2-e31d-4145-8440-00ea9eb04839 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:37.698511 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4b43d9e2-e31d-4145-8440-00ea9eb04839 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:37.706389 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b43d9e2-e31d-4145-8440-00ea9eb04839 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:37.706685 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b43d9e2-e31d-4145-8440-00ea9eb04839 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:37.707493 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b43d9e2-e31d-4145-8440-00ea9eb04839 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:37.707938 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b43d9e2-e31d-4145-8440-00ea9eb04839 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:37.835229 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4b43d9e2-e31d-4145-8440-00ea9eb04839 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:37.843432 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4b43d9e2-e31d-4145-8440-00ea9eb04839 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 200 len: 1277 microversion: 2.1 time: 0.151376 Jul 31 01:08:37.857624 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 349/706] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:37 2022] GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:37.863109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-225fd187-3558-42d8-81ea-645c1d788989 req-ba91f9fc-ff68-4372-bc9c-2ee49309a3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4db5ff-45fe-4d51-809d-d8983072a691", "name": "network-vif-unplugged", "status": "completed", "tag": "ef0fdb3a-4238-4134-9002-c9963f855ec6"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:37.872878 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-225fd187-3558-42d8-81ea-645c1d788989 req-ba91f9fc-ff68-4372-bc9c-2ee49309a3c6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:37.873321 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-225fd187-3558-42d8-81ea-645c1d788989 req-ba91f9fc-ff68-4372-bc9c-2ee49309a3c6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:37.886531 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-225fd187-3558-42d8-81ea-645c1d788989 req-ba91f9fc-ff68-4372-bc9c-2ee49309a3c6 service nova] Creating event network-vif-unplugged:ef0fdb3a-4238-4134-9002-c9963f855ec6 for instance 2d4db5ff-45fe-4d51-809d-d8983072a691 on n-h1-master-1 Jul 31 01:08:37.892034 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-225fd187-3558-42d8-81ea-645c1d788989 req-ba91f9fc-ff68-4372-bc9c-2ee49309a3c6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033030 Jul 31 01:08:37.893077 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 350/707] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:37.899695 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eb2d61aa-f159-48c7-8714-914c8d38bf9f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:37.900534 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eb2d61aa-f159-48c7-8714-914c8d38bf9f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:37.908275 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb2d61aa-f159-48c7-8714-914c8d38bf9f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:37.908869 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb2d61aa-f159-48c7-8714-914c8d38bf9f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:37.909756 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb2d61aa-f159-48c7-8714-914c8d38bf9f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:37.910254 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb2d61aa-f159-48c7-8714-914c8d38bf9f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:38.111537 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-97e6965e-e321-4fe1-a9e0-24749a1e6348 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:38.121830 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-97e6965e-e321-4fe1-a9e0-24749a1e6348 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1310 microversion: 2.1 time: 0.562383 Jul 31 01:08:38.122452 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 358/708] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:37 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1310 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:38.147041 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-38c8d9f5-4087-427d-a446-b97d375a8845 req-edda9859-46bc-494b-8422-dbd2b6051d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377d997f-f860-480f-b712-6be34358d073", "name": "network-vif-plugged", "status": "completed", "tag": "28a7d1f5-562e-42f5-8a21-e230c7de688a"}, {"server_uuid": "4faaeb8d-01fd-456a-b887-c5cf7ba7051b", "name": "network-vif-unplugged", "status": "completed", "tag": "ad7e118b-a003-47c7-8563-67c45bdc1cce"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:38.170575 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-38c8d9f5-4087-427d-a446-b97d375a8845 req-edda9859-46bc-494b-8422-dbd2b6051d03 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:38.172555 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-38c8d9f5-4087-427d-a446-b97d375a8845 req-edda9859-46bc-494b-8422-dbd2b6051d03 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:38.215330 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-38c8d9f5-4087-427d-a446-b97d375a8845 req-edda9859-46bc-494b-8422-dbd2b6051d03 service nova] Creating event network-vif-plugged:28a7d1f5-562e-42f5-8a21-e230c7de688a for instance 377d997f-f860-480f-b712-6be34358d073 on n-h1-master-1 Jul 31 01:08:38.216348 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-38c8d9f5-4087-427d-a446-b97d375a8845 req-edda9859-46bc-494b-8422-dbd2b6051d03 service nova] Creating event network-vif-unplugged:ad7e118b-a003-47c7-8563-67c45bdc1cce for instance 4faaeb8d-01fd-456a-b887-c5cf7ba7051b on n-h2-master-1 Jul 31 01:08:38.232960 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-38c8d9f5-4087-427d-a446-b97d375a8845 req-edda9859-46bc-494b-8422-dbd2b6051d03 service nova] Instance 4faaeb8d-01fd-456a-b887-c5cf7ba7051b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:08:38.252249 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-38c8d9f5-4087-427d-a446-b97d375a8845 req-edda9859-46bc-494b-8422-dbd2b6051d03 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.128205 Jul 31 01:08:38.255755 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 359/709] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:38.264683 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f7b4767-a7e4-469c-a3f8-5109c4553c29 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Calling method '.version_select at 0x7fede5f16670>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:38.302301 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eb2d61aa-f159-48c7-8714-914c8d38bf9f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:38.312955 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eb2d61aa-f159-48c7-8714-914c8d38bf9f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:38.314697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eb2d61aa-f159-48c7-8714-914c8d38bf9f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:38.316095 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eb2d61aa-f159-48c7-8714-914c8d38bf9f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1567 microversion: 2.25 time: 0.421745 Jul 31 01:08:38.316741 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 351/710] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:37 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1567 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:38.341866 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-35f069ec-392b-440d-9623-74737a5f8ec8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:38.342506 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-35f069ec-392b-440d-9623-74737a5f8ec8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:38.363272 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6f7b4767-a7e4-469c-a3f8-5109c4553c29 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "GET /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.102530 Jul 31 01:08:38.364189 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35f069ec-392b-440d-9623-74737a5f8ec8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:38.364189 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35f069ec-392b-440d-9623-74737a5f8ec8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:38.375655 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35f069ec-392b-440d-9623-74737a5f8ec8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:38.375655 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35f069ec-392b-440d-9623-74737a5f8ec8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:38.376155 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 360/711] 10.222.0.45 () {58 vars in 1260 bytes} [Sun Jul 31 01:08:38 2022] GET /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata => generated 61 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:08:38.387960 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-70d5ab79-dbaf-4614-b1ea-bf9172786e7a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:38.393525 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-70d5ab79-dbaf-4614-b1ea-bf9172786e7a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:38.411024 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70d5ab79-dbaf-4614-b1ea-bf9172786e7a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:38.411640 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70d5ab79-dbaf-4614-b1ea-bf9172786e7a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:38.414173 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70d5ab79-dbaf-4614-b1ea-bf9172786e7a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:38.415238 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70d5ab79-dbaf-4614-b1ea-bf9172786e7a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:39.170376 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-70d5ab79-dbaf-4614-b1ea-bf9172786e7a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:39.192500 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-70d5ab79-dbaf-4614-b1ea-bf9172786e7a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073" status: 200 len: 1321 microversion: 2.1 time: 0.824023 Jul 31 01:08:39.194029 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 361/712] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:38 2022] GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073 => generated 1321 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:39.199728 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-014f8310-4b47-4213-ba99-edbfbb0f004f tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:39.200653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-014f8310-4b47-4213-ba99-edbfbb0f004f tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:39.210307 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-35f069ec-392b-440d-9623-74737a5f8ec8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:39.220836 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-014f8310-4b47-4213-ba99-edbfbb0f004f tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:39.221306 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-014f8310-4b47-4213-ba99-edbfbb0f004f tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:39.222117 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-014f8310-4b47-4213-ba99-edbfbb0f004f tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:39.222561 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-014f8310-4b47-4213-ba99-edbfbb0f004f tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:39.223775 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-35f069ec-392b-440d-9623-74737a5f8ec8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1473 microversion: 2.1 time: 0.890872 Jul 31 01:08:39.225096 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 352/713] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:38 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1473 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:39.232976 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-14676e31-343f-49ba-b8f8-5b21968eaf1f tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Action: 'update_all', calling method: .version_select at 0x7fede5b26820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:39.315777 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-14676e31-343f-49ba-b8f8-5b21968eaf1f tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:39.320814 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-14676e31-343f-49ba-b8f8-5b21968eaf1f tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for user ca2be0c08715470db62372816df208af and project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:39.411909 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-014f8310-4b47-4213-ba99-edbfbb0f004f tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '505f516270844b7e9d0f213c3ce3da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a24d132da74cd0a21d1851711745c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:39.430590 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-014f8310-4b47-4213-ba99-edbfbb0f004f tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 200 len: 1648 microversion: 2.1 time: 0.235152 Jul 31 01:08:39.431449 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 362/714] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:39 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 1648 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:39.438364 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9a4ddba4-f5c1-4cd3-ad59-aa30fab834e8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:39.439255 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9a4ddba4-f5c1-4cd3-ad59-aa30fab834e8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:39.442413 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:39.450527 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a4ddba4-f5c1-4cd3-ad59-aa30fab834e8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:39.452229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a4ddba4-f5c1-4cd3-ad59-aa30fab834e8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:39.453558 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a4ddba4-f5c1-4cd3-ad59-aa30fab834e8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:39.454020 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a4ddba4-f5c1-4cd3-ad59-aa30fab834e8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:39.519620 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-14676e31-343f-49ba-b8f8-5b21968eaf1f tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "PUT /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.292967 Jul 31 01:08:39.527476 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 353/715] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:08:39 2022] PUT /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata => generated 61 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:08:39.532706 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-00307946-b4f8-4b75-b35f-2dec8895bcae tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:39.533378 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-00307946-b4f8-4b75-b35f-2dec8895bcae tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:39.540407 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00307946-b4f8-4b75-b35f-2dec8895bcae tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:39.541220 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00307946-b4f8-4b75-b35f-2dec8895bcae tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:39.541921 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00307946-b4f8-4b75-b35f-2dec8895bcae tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:39.542942 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00307946-b4f8-4b75-b35f-2dec8895bcae tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:39.555205 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9a4ddba4-f5c1-4cd3-ad59-aa30fab834e8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:39.585574 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9a4ddba4-f5c1-4cd3-ad59-aa30fab834e8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 200 len: 1334 microversion: 2.1 time: 0.151956 Jul 31 01:08:39.593083 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 363/716] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:39 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 1334 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:39.605501 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-33db5512-eecf-4079-9053-3f06e10162d6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:39.606424 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-33db5512-eecf-4079-9053-3f06e10162d6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:39.620517 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33db5512-eecf-4079-9053-3f06e10162d6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:39.620980 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33db5512-eecf-4079-9053-3f06e10162d6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:39.621792 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33db5512-eecf-4079-9053-3f06e10162d6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:39.622229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33db5512-eecf-4079-9053-3f06e10162d6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:40.257245 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-00307946-b4f8-4b75-b35f-2dec8895bcae tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:40.271688 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-33db5512-eecf-4079-9053-3f06e10162d6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:40.273774 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-00307946-b4f8-4b75-b35f-2dec8895bcae tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 200 len: 1319 microversion: 2.1 time: 0.750437 Jul 31 01:08:40.278886 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 354/717] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:39 2022] GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 1319 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:40.286043 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-33db5512-eecf-4079-9053-3f06e10162d6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1493 microversion: 2.1 time: 0.691625 Jul 31 01:08:40.286644 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 364/718] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:39 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1493 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:40.290929 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0f31870d-a8f2-4384-8c0a-a28cbd1ba9ea tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:40.292901 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0f31870d-a8f2-4384-8c0a-a28cbd1ba9ea tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:40.304835 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eda33b73-d860-4104-b371-ddc406870a5c tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Action: 'update_all', calling method: .version_select at 0x7fede5b64b80>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:40.310306 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f31870d-a8f2-4384-8c0a-a28cbd1ba9ea tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:40.311587 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f31870d-a8f2-4384-8c0a-a28cbd1ba9ea tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:40.314369 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f31870d-a8f2-4384-8c0a-a28cbd1ba9ea tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:40.315185 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f31870d-a8f2-4384-8c0a-a28cbd1ba9ea tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:40.398621 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-eda33b73-d860-4104-b371-ddc406870a5c tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:40.406278 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-eda33b73-d860-4104-b371-ddc406870a5c tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for user ca2be0c08715470db62372816df208af and project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:40.812268 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:40.823481 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0f31870d-a8f2-4384-8c0a-a28cbd1ba9ea tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:40.834046 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0f31870d-a8f2-4384-8c0a-a28cbd1ba9ea tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:40.863739 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0f31870d-a8f2-4384-8c0a-a28cbd1ba9ea tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:40.869117 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0f31870d-a8f2-4384-8c0a-a28cbd1ba9ea tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1567 microversion: 2.25 time: 0.585929 Jul 31 01:08:40.869569 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 355/719] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:40 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1567 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:40.890465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-7774c947-3d59-4949-b01b-57258c4404e7 req-46c3c2b8-0d8c-454d-b6ef-5e78d805db5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4db5ff-45fe-4d51-809d-d8983072a691", "tag": "ef0fdb3a-4238-4134-9002-c9963f855ec6"}, {"name": "network-changed", "server_uuid": "1aa29e77-13fc-46d3-9b2b-8f38833f1fa9", "tag": "2b605aa9-7b84-4f1e-aade-328fc0be9446"}, {"server_uuid": "ff233d7d-7f8e-4283-a902-d08ed1a3fc1e", "name": "network-vif-deleted", "tag": "fc8d9300-899d-427a-9306-149f14484267"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:40.905983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7774c947-3d59-4949-b01b-57258c4404e7 req-46c3c2b8-0d8c-454d-b6ef-5e78d805db5c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:40.906474 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7774c947-3d59-4949-b01b-57258c4404e7 req-46c3c2b8-0d8c-454d-b6ef-5e78d805db5c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:40.909740 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eda33b73-d860-4104-b371-ddc406870a5c tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "PUT /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata" status: 200 len: 64 microversion: 2.1 time: 0.621986 Jul 31 01:08:40.910462 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 365/720] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:08:40 2022] PUT /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata => generated 64 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:08:40.918943 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-107be6d0-1684-46f0-9872-1a15e63a12c4 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:40.919725 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-107be6d0-1684-46f0-9872-1a15e63a12c4 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:40.922694 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-7774c947-3d59-4949-b01b-57258c4404e7 req-46c3c2b8-0d8c-454d-b6ef-5e78d805db5c service nova] Creating event network-changed:ef0fdb3a-4238-4134-9002-c9963f855ec6 for instance 2d4db5ff-45fe-4d51-809d-d8983072a691 on n-h1-master-1 Jul 31 01:08:40.923477 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-7774c947-3d59-4949-b01b-57258c4404e7 req-46c3c2b8-0d8c-454d-b6ef-5e78d805db5c service nova] Creating event network-changed:2b605aa9-7b84-4f1e-aade-328fc0be9446 for instance 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 on n-h2-master-1 Jul 31 01:08:40.924194 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-7774c947-3d59-4949-b01b-57258c4404e7 req-46c3c2b8-0d8c-454d-b6ef-5e78d805db5c service nova] Creating event network-vif-deleted:fc8d9300-899d-427a-9306-149f14484267 for instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e on n-h2-master-1 Jul 31 01:08:40.934904 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-107be6d0-1684-46f0-9872-1a15e63a12c4 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:40.936280 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-107be6d0-1684-46f0-9872-1a15e63a12c4 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:40.937050 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-7774c947-3d59-4949-b01b-57258c4404e7 req-46c3c2b8-0d8c-454d-b6ef-5e78d805db5c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.065166 Jul 31 01:08:40.938467 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 356/721] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:40.941844 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-107be6d0-1684-46f0-9872-1a15e63a12c4 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:40.942836 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-107be6d0-1684-46f0-9872-1a15e63a12c4 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:40.946269 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c301ce16-c83d-402f-8299-e4a174f661a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:40.947000 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c301ce16-c83d-402f-8299-e4a174f661a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:40.956455 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c301ce16-c83d-402f-8299-e4a174f661a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:40.956921 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c301ce16-c83d-402f-8299-e4a174f661a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:40.957738 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c301ce16-c83d-402f-8299-e4a174f661a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:40.958193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c301ce16-c83d-402f-8299-e4a174f661a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:41.488046 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-107be6d0-1684-46f0-9872-1a15e63a12c4 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:41.496275 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-107be6d0-1684-46f0-9872-1a15e63a12c4 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073" status: 200 len: 1471 microversion: 2.1 time: 0.584006 Jul 31 01:08:41.496869 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 366/722] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:40 2022] GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073 => generated 1471 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:41.501565 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-541474ca-fb50-4638-931f-1071c4b682c6 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:41.502232 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-541474ca-fb50-4638-931f-1071c4b682c6 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:41.512670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c301ce16-c83d-402f-8299-e4a174f661a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:41.522758 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-541474ca-fb50-4638-931f-1071c4b682c6 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:41.523238 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-541474ca-fb50-4638-931f-1071c4b682c6 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:41.532245 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c301ce16-c83d-402f-8299-e4a174f661a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1470 microversion: 2.1 time: 0.590806 Jul 31 01:08:41.532557 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-541474ca-fb50-4638-931f-1071c4b682c6 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:41.533197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-541474ca-fb50-4638-931f-1071c4b682c6 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:41.534270 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 357/723] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:40 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1470 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:41.543306 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d2bc746e-6b37-4abc-bb8c-81f89d3c3001 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:41.544152 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d2bc746e-6b37-4abc-bb8c-81f89d3c3001 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:41.566738 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2bc746e-6b37-4abc-bb8c-81f89d3c3001 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:41.567821 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2bc746e-6b37-4abc-bb8c-81f89d3c3001 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:41.569718 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2bc746e-6b37-4abc-bb8c-81f89d3c3001 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:41.570493 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2bc746e-6b37-4abc-bb8c-81f89d3c3001 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:41.599007 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-d2bc746e-6b37-4abc-bb8c-81f89d3c3001 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] HTTP exception thrown: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d2bc746e-6b37-4abc-bb8c-81f89d3c3001 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Request method failure captured: Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e HTTP/1.1 Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dV3W3bPWJFeh7BzewxnKx-yPYdY4kESjfLYhHoJ3FsmKwSi1Gdt2ksRHer5P8rLiMUD1xi4zlqJIih21v7EspIW2fC4VvfKK5_Db3b0mCcaoc1ZEWNB2TJSFg6PCa-R24HlEU15Hr3EU5EFb7NsJ72P3E4-1jKFHtGqFrehWAuUjd8 Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 69a24d132da74cd0a21d1851711745c0 Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:08:41.601216 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:08:41.608305 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_69a24d132da74cd0a21d1851711745c0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:08:41.608305 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:41.608305 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 69a24d132da74cd0a21d1851711745c0 Jul 31 01:08:41.608305 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:41.608305 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1947983447-project Jul 31 01:08:41.608305 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:08:41.608305 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:08:41.608305 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 505f516270844b7e9d0f213c3ce3da6f Jul 31 01:08:41.608305 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447-project Jul 31 01:08:41.608305 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:08:41.608305 n-d-master-1 devstack@n-api.service[119475]: exception: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. Jul 31 01:08:41.608305 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'ff233d7d-7f8e-4283-a902-d08ed1a3fc1e'} Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:08:41.609193 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. Jul 31 01:08:41.611333 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:41.612545 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d2bc746e-6b37-4abc-bb8c-81f89d3c3001 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Returning 404 to user: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:08:41.612545 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d2bc746e-6b37-4abc-bb8c-81f89d3c3001 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 404 len: 111 microversion: 2.1 time: 0.066683 Jul 31 01:08:41.612545 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 358/724] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:41 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:08:41.617244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-21116461-4617-4c4a-ba97-08be007b3f77 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:41.618057 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-21116461-4617-4c4a-ba97-08be007b3f77 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:41.624585 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21116461-4617-4c4a-ba97-08be007b3f77 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:41.625717 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21116461-4617-4c4a-ba97-08be007b3f77 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:41.626629 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21116461-4617-4c4a-ba97-08be007b3f77 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:41.627123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21116461-4617-4c4a-ba97-08be007b3f77 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:42.052203 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-541474ca-fb50-4638-931f-1071c4b682c6 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1644 microversion: 2.1 time: 0.554217 Jul 31 01:08:42.062436 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 367/725] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:41 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1644 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:42.076368 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-30f8ebce-8e44-42f2-9926-34dfcdd1139e tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Calling method '.version_select at 0x7fede5a5aaf0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:42.130250 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-30f8ebce-8e44-42f2-9926-34dfcdd1139e tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "GET /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata" status: 200 len: 64 microversion: 2.1 time: 0.063596 Jul 31 01:08:42.131085 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 368/726] 10.222.0.45 () {58 vars in 1260 bytes} [Sun Jul 31 01:08:42 2022] GET /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata => generated 64 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:08:42.137929 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-114c31ba-ea92-4bc4-9b41-d97585fa08a9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:42.139091 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-114c31ba-ea92-4bc4-9b41-d97585fa08a9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:42.140879 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-21116461-4617-4c4a-ba97-08be007b3f77 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:42.149295 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-114c31ba-ea92-4bc4-9b41-d97585fa08a9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:42.150106 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-114c31ba-ea92-4bc4-9b41-d97585fa08a9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:42.151139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-114c31ba-ea92-4bc4-9b41-d97585fa08a9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:42.151835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-114c31ba-ea92-4bc4-9b41-d97585fa08a9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:42.159951 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-21116461-4617-4c4a-ba97-08be007b3f77 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 200 len: 1402 microversion: 2.1 time: 0.555067 Jul 31 01:08:42.162629 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 359/727] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:41 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 1402 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:42.435127 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4cce49fe-480c-40a7-91f7-b071dd4a292c tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:42.436688 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4cce49fe-480c-40a7-91f7-b071dd4a292c tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] [instance: 844aa028-581e-4699-bc96-c1a8022a2655] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:42.447396 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-4cce49fe-480c-40a7-91f7-b071dd4a292c tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] HTTP exception thrown: Instance 844aa028-581e-4699-bc96-c1a8022a2655 could not be found. Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4cce49fe-480c-40a7-91f7-b071dd4a292c tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Request method failure captured: Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/844aa028-581e-4699-bc96-c1a8022a2655/action HTTP/1.1 Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 15 Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dX-GRvZdwWUVnCrAfLHpVH9uyj9kMqQ6DKJmmJTATSIUZ9PPd5VUrhHMqXstrUNj0P182JtAKKx0IG24mURZF315gfCef3mHWXnxMf9oUmA0Bq818GvAKE_4ycoYXyD6SDDcOwyjYLBjpCM8f90I0joAvx-HdaedlhPkSoPpDv5mx8 Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: acdf8ed0cf8b4c5db6ccf0ee53dc1290 Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1903736053 Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:08:42.451051 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:08:42.453961 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/acdf8ed0cf8b4c5db6ccf0ee53dc1290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/acdf8ed0cf8b4c5db6ccf0ee53dc1290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/acdf8ed0cf8b4c5db6ccf0ee53dc1290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_acdf8ed0cf8b4c5db6ccf0ee53dc1290", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:08:42.453961 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1903736053 Jul 31 01:08:42.453961 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: acdf8ed0cf8b4c5db6ccf0ee53dc1290 Jul 31 01:08:42.453961 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1903736053 Jul 31 01:08:42.453961 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersAdminNegativeTestJSON-1903736053-project-admin Jul 31 01:08:42.453961 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:08:42.453961 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:08:42.453961 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 4d64cb480dc24b6a8d2b9ef67866f2a2 Jul 31 01:08:42.453961 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1903736053-project-admin Jul 31 01:08:42.453961 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:08:42.453961 n-d-master-1 devstack@n-api.service[119475]: {"migrate": {}} Jul 31 01:08:42.453961 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:08:42.453961 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 844aa028-581e-4699-bc96-c1a8022a2655 could not be found. Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '844aa028-581e-4699-bc96-c1a8022a2655', 'body': {'migrate': {}}} Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 844aa028-581e-4699-bc96-c1a8022a2655 could not be found. Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:08:42.454776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 844aa028-581e-4699-bc96-c1a8022a2655 could not be found. Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 844aa028-581e-4699-bc96-c1a8022a2655 could not be found. Jul 31 01:08:42.456067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:42.457096 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4cce49fe-480c-40a7-91f7-b071dd4a292c tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Returning 404 to user: Instance 844aa028-581e-4699-bc96-c1a8022a2655 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:08:42.457096 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4cce49fe-480c-40a7-91f7-b071dd4a292c tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/844aa028-581e-4699-bc96-c1a8022a2655/action" status: 404 len: 111 microversion: 2.1 time: 0.288731 Jul 31 01:08:42.457960 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 360/728] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:08:42 2022] POST /compute/v2.1/servers/844aa028-581e-4699-bc96-c1a8022a2655/action => generated 111 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:08:42.468563 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7725d808-d0ed-49b0-bb45-2a30d7196799 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:42.470655 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7725d808-d0ed-49b0-bb45-2a30d7196799 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:42.492647 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7725d808-d0ed-49b0-bb45-2a30d7196799 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:42.493497 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7725d808-d0ed-49b0-bb45-2a30d7196799 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:42.496920 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7725d808-d0ed-49b0-bb45-2a30d7196799 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:42.497743 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7725d808-d0ed-49b0-bb45-2a30d7196799 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:42.590722 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:42.701705 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7725d808-d0ed-49b0-bb45-2a30d7196799 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "POST /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b/action" status: 204 len: 0 microversion: 2.1 time: 0.241027 Jul 31 01:08:42.707536 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 361/729] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:08:42 2022] POST /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b/action => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:08:42.726314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3756f34a-8267-40c8-8601-0bf83d763614 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:42.730069 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3756f34a-8267-40c8-8601-0bf83d763614 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:42.745136 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3756f34a-8267-40c8-8601-0bf83d763614 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:42.746343 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3756f34a-8267-40c8-8601-0bf83d763614 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:42.748258 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3756f34a-8267-40c8-8601-0bf83d763614 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:42.749338 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3756f34a-8267-40c8-8601-0bf83d763614 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:42.778812 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-3756f34a-8267-40c8-8601-0bf83d763614 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] HTTP exception thrown: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3756f34a-8267-40c8-8601-0bf83d763614 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Request method failure captured: Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 HTTP/1.1 Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dV3W3bPWJFeh7BzewxnKx-yPYdY4kESjfLYhHoJ3FsmKwSi1Gdt2ksRHer5P8rLiMUD1xi4zlqJIih21v7EspIW2fC4VvfKK5_Db3b0mCcaoc1ZEWNB2TJSFg6PCa-R24HlEU15Hr3EU5EFb7NsJ72P3E4-1jKFHtGqFrehWAuUjd8 Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 69a24d132da74cd0a21d1851711745c0 Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:08:42.784393 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:08:42.786753 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_69a24d132da74cd0a21d1851711745c0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:08:42.786753 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:42.786753 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 69a24d132da74cd0a21d1851711745c0 Jul 31 01:08:42.786753 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:42.786753 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1947983447-project Jul 31 01:08:42.786753 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:08:42.786753 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:08:42.786753 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 505f516270844b7e9d0f213c3ce3da6f Jul 31 01:08:42.786753 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447-project Jul 31 01:08:42.786753 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:08:42.786753 n-d-master-1 devstack@n-api.service[119475]: exception: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:42.786753 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'eccd8f8d-d332-4c4e-bef6-30de69b8f681'} Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:08:42.788524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:42.790841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:42.796464 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3756f34a-8267-40c8-8601-0bf83d763614 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Returning 404 to user: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:08:42.798837 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3756f34a-8267-40c8-8601-0bf83d763614 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 404 len: 111 microversion: 2.1 time: 0.089073 Jul 31 01:08:42.800789 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 362/730] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:08:42 2022] DELETE /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:08:42.811388 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c9f3a2fc-c41b-4b7c-9a44-adba6bd3162d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:42.814496 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c9f3a2fc-c41b-4b7c-9a44-adba6bd3162d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:42.827745 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9f3a2fc-c41b-4b7c-9a44-adba6bd3162d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:42.829600 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9f3a2fc-c41b-4b7c-9a44-adba6bd3162d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:42.832953 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9f3a2fc-c41b-4b7c-9a44-adba6bd3162d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:42.834125 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9f3a2fc-c41b-4b7c-9a44-adba6bd3162d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:43.251490 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-114c31ba-ea92-4bc4-9b41-d97585fa08a9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:43.273537 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-114c31ba-ea92-4bc4-9b41-d97585fa08a9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 200 len: 1319 microversion: 2.1 time: 1.139703 Jul 31 01:08:43.275795 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 369/731] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:42 2022] GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 1319 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:43.297458 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2a844aa4-1d20-47b8-b8cd-1a77197ebd71 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:43.298446 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2a844aa4-1d20-47b8-b8cd-1a77197ebd71 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:43.314932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2a844aa4-1d20-47b8-b8cd-1a77197ebd71 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:43.315744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2a844aa4-1d20-47b8-b8cd-1a77197ebd71 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:43.317189 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2a844aa4-1d20-47b8-b8cd-1a77197ebd71 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:43.318254 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2a844aa4-1d20-47b8-b8cd-1a77197ebd71 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:43.351842 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:43.548485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c9f3a2fc-c41b-4b7c-9a44-adba6bd3162d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:43.560075 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c9f3a2fc-c41b-4b7c-9a44-adba6bd3162d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:43.563203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c9f3a2fc-c41b-4b7c-9a44-adba6bd3162d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:43.565071 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c9f3a2fc-c41b-4b7c-9a44-adba6bd3162d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1567 microversion: 2.25 time: 0.762526 Jul 31 01:08:43.579628 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 363/732] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:42 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1567 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:43.585467 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d0451eff-a6f2-42ad-ac8e-ea7556ac1688 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Action: 'update_all', calling method: .version_select at 0x7fede5b65d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:43.680497 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-d0451eff-a6f2-42ad-ac8e-ea7556ac1688 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:43.686310 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-d0451eff-a6f2-42ad-ac8e-ea7556ac1688 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for user ca2be0c08715470db62372816df208af and project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:43.728136 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2a844aa4-1d20-47b8-b8cd-1a77197ebd71 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1644 microversion: 2.1 time: 0.450495 Jul 31 01:08:43.729814 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 370/733] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:43 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1644 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:43.737836 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-c2fb30e1-de5a-4266-9186-0c6f0ed64393 req-506be080-e8a0-4427-b603-09940cb032cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bdd9c6c-52f8-4b5c-84f7-967f02739459", "tag": "5d949b6a-7201-4176-9f2b-07df89c17ca9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:43.751069 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c2fb30e1-de5a-4266-9186-0c6f0ed64393 req-506be080-e8a0-4427-b603-09940cb032cf service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:43.764362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c2fb30e1-de5a-4266-9186-0c6f0ed64393 req-506be080-e8a0-4427-b603-09940cb032cf service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:43.791768 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-c2fb30e1-de5a-4266-9186-0c6f0ed64393 req-506be080-e8a0-4427-b603-09940cb032cf service nova] Creating event network-changed:5d949b6a-7201-4176-9f2b-07df89c17ca9 for instance 6bdd9c6c-52f8-4b5c-84f7-967f02739459 on n-h2-master-1 Jul 31 01:08:43.801172 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-c2fb30e1-de5a-4266-9186-0c6f0ed64393 req-506be080-e8a0-4427-b603-09940cb032cf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068922 Jul 31 01:08:43.802907 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 371/734] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:43.822782 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1cfbec57-3884-434c-be46-fc0a4450cf48 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:43.825055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1cfbec57-3884-434c-be46-fc0a4450cf48 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:43.841655 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cfbec57-3884-434c-be46-fc0a4450cf48 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:43.843821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cfbec57-3884-434c-be46-fc0a4450cf48 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:43.846779 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cfbec57-3884-434c-be46-fc0a4450cf48 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:43.848034 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cfbec57-3884-434c-be46-fc0a4450cf48 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:44.087412 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:44.139969 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1cfbec57-3884-434c-be46-fc0a4450cf48 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:44.150107 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1cfbec57-3884-434c-be46-fc0a4450cf48 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1470 microversion: 2.1 time: 0.340859 Jul 31 01:08:44.150858 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 372/735] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:43 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1470 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:44.156195 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-70bc4f42-259a-4413-bcfa-46d003aec812 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1961614302", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:44.238828 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d0451eff-a6f2-42ad-ac8e-ea7556ac1688 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "PUT /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.658826 Jul 31 01:08:44.239803 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-70bc4f42-259a-4413-bcfa-46d003aec812 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] validate_networks() for None {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:08:44.245975 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 364/736] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:08:43 2022] PUT /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata => generated 61 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:08:44.250125 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e06c54e-1c05-41ce-b5e5-d0ec621e5e00 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:44.251578 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1e06c54e-1c05-41ce-b5e5-d0ec621e5e00 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:44.263396 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e06c54e-1c05-41ce-b5e5-d0ec621e5e00 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:44.264690 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e06c54e-1c05-41ce-b5e5-d0ec621e5e00 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:44.266740 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e06c54e-1c05-41ce-b5e5-d0ec621e5e00 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:44.268119 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e06c54e-1c05-41ce-b5e5-d0ec621e5e00 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:44.295855 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-1e06c54e-1c05-41ce-b5e5-d0ec621e5e00 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] HTTP exception thrown: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e06c54e-1c05-41ce-b5e5-d0ec621e5e00 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Request method failure captured: Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 HTTP/1.1 Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dV3W3bPWJFeh7BzewxnKx-yPYdY4kESjfLYhHoJ3FsmKwSi1Gdt2ksRHer5P8rLiMUD1xi4zlqJIih21v7EspIW2fC4VvfKK5_Db3b0mCcaoc1ZEWNB2TJSFg6PCa-R24HlEU15Hr3EU5EFb7NsJ72P3E4-1jKFHtGqFrehWAuUjd8 Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 69a24d132da74cd0a21d1851711745c0 Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:08:44.299094 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:08:44.301777 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_69a24d132da74cd0a21d1851711745c0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:08:44.301777 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:44.301777 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 69a24d132da74cd0a21d1851711745c0 Jul 31 01:08:44.301777 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:44.301777 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1947983447-project Jul 31 01:08:44.301777 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:08:44.301777 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:08:44.301777 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 505f516270844b7e9d0f213c3ce3da6f Jul 31 01:08:44.301777 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447-project Jul 31 01:08:44.301777 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:08:44.301777 n-d-master-1 devstack@n-api.service[119475]: exception: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:44.301777 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'eccd8f8d-d332-4c4e-bef6-30de69b8f681'} Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:08:44.303154 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:44.313587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:08:44.316012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e06c54e-1c05-41ce-b5e5-d0ec621e5e00 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Returning 404 to user: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:08:44.316012 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1e06c54e-1c05-41ce-b5e5-d0ec621e5e00 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 404 len: 111 microversion: 2.1 time: 0.059100 Jul 31 01:08:44.316012 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 365/737] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:44 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:08:44.316012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-196fdfa8-b575-406a-92b7-787b4c652694 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:44.316012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-196fdfa8-b575-406a-92b7-787b4c652694 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:44.316654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-196fdfa8-b575-406a-92b7-787b4c652694 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:44.316654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-196fdfa8-b575-406a-92b7-787b4c652694 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:44.321089 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-196fdfa8-b575-406a-92b7-787b4c652694 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:44.321274 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-196fdfa8-b575-406a-92b7-787b4c652694 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:44.588635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-196fdfa8-b575-406a-92b7-787b4c652694 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:44.603380 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-196fdfa8-b575-406a-92b7-787b4c652694 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 200 len: 1402 microversion: 2.1 time: 0.300340 Jul 31 01:08:44.604664 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 366/738] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:44 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 1402 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:44.613149 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f17701e4-24ca-4814-833d-f9382aaaf54b tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:44.617955 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:08:44.617955 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:08:44.620471 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f17701e4-24ca-4814-833d-f9382aaaf54b tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:44.621860 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f17701e4-24ca-4814-833d-f9382aaaf54b tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:44.623565 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f17701e4-24ca-4814-833d-f9382aaaf54b tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:44.624454 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f17701e4-24ca-4814-833d-f9382aaaf54b tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:44.651010 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f17701e4-24ca-4814-833d-f9382aaaf54b tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044577 Jul 31 01:08:44.651784 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 367/739] 10.222.0.45 () {58 vars in 1176 bytes} [Sun Jul 31 01:08:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:44.664438 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a2d6e78f-6a02-4025-8e59-5dea1a2fbdb5 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Action: 'update', calling method: .version_select at 0x7fede5b678b0>, body: {"meta": {"os_version": "alt"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:44.671049 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-70bc4f42-259a-4413-bcfa-46d003aec812 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:08:44.672056 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-70bc4f42-259a-4413-bcfa-46d003aec812 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:08:44.673390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-70bc4f42-259a-4413-bcfa-46d003aec812 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:08:44.674433 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-70bc4f42-259a-4413-bcfa-46d003aec812 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:08:44.675471 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-70bc4f42-259a-4413-bcfa-46d003aec812 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:08:44.701621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70bc4f42-259a-4413-bcfa-46d003aec812 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:44.701997 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70bc4f42-259a-4413-bcfa-46d003aec812 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:44.702949 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70bc4f42-259a-4413-bcfa-46d003aec812 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:44.704254 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70bc4f42-259a-4413-bcfa-46d003aec812 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:44.721707 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-a2d6e78f-6a02-4025-8e59-5dea1a2fbdb5 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:44.726468 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-a2d6e78f-6a02-4025-8e59-5dea1a2fbdb5 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for user ca2be0c08715470db62372816df208af and project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:44.727218 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-70bc4f42-259a-4413-bcfa-46d003aec812 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Getting quotas for project e1c4dd30e2494fe6af680f0a99d70c5f. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:44.733277 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-70bc4f42-259a-4413-bcfa-46d003aec812 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Getting quotas for user aff3051461a1428a8cd7f730269ab0b3 and project e1c4dd30e2494fe6af680f0a99d70c5f. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:44.748883 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-70bc4f42-259a-4413-bcfa-46d003aec812 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:08:44.751708 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-70bc4f42-259a-4413-bcfa-46d003aec812 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:08:44.805966 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-70bc4f42-259a-4413-bcfa-46d003aec812 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653882 Jul 31 01:08:44.813301 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 373/740] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:08:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:08:44.819896 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f4567c43-e096-4b69-9717-531067a4d4ea tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:44.820903 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f4567c43-e096-4b69-9717-531067a4d4ea tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:44.828977 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4567c43-e096-4b69-9717-531067a4d4ea tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:44.829691 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4567c43-e096-4b69-9717-531067a4d4ea tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:44.830897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4567c43-e096-4b69-9717-531067a4d4ea tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:44.831610 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4567c43-e096-4b69-9717-531067a4d4ea tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:44.990547 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f4567c43-e096-4b69-9717-531067a4d4ea tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:45.001488 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f4567c43-e096-4b69-9717-531067a4d4ea tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 200 len: 1319 microversion: 2.1 time: 0.186452 Jul 31 01:08:45.002679 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 374/741] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:44 2022] GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:45.007890 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e2c87cff-d8b1-4b1b-bcca-4b544d1ef2db tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '.version_select at 0x7fede5994940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:45.034604 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e2c87cff-d8b1-4b1b-bcca-4b544d1ef2db tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989891644" status: 202 len: 0 microversion: 2.1 time: 0.030547 Jul 31 01:08:45.036272 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 375/742] 10.222.0.45 () {58 vars in 1221 bytes} [Sun Jul 31 01:08:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989891644 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:08:45.042892 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8447a2ff-8c50-4b6e-bdac-9cacf21f059f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:45.043863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8447a2ff-8c50-4b6e-bdac-9cacf21f059f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:45.052985 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8447a2ff-8c50-4b6e-bdac-9cacf21f059f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:45.053912 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8447a2ff-8c50-4b6e-bdac-9cacf21f059f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:45.055804 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8447a2ff-8c50-4b6e-bdac-9cacf21f059f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:45.056585 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8447a2ff-8c50-4b6e-bdac-9cacf21f059f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:45.153684 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a2d6e78f-6a02-4025-8e59-5dea1a2fbdb5 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "PUT /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.492710 Jul 31 01:08:45.159884 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 368/743] 10.222.0.45 () {60 vars in 1313 bytes} [Sun Jul 31 01:08:44 2022] PUT /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata/os_version => generated 31 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:08:45.169827 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-066b3a49-ed74-485b-93f3-331771939c03 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:45.170530 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-066b3a49-ed74-485b-93f3-331771939c03 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:45.180478 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-066b3a49-ed74-485b-93f3-331771939c03 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:45.181094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-066b3a49-ed74-485b-93f3-331771939c03 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:45.182020 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-066b3a49-ed74-485b-93f3-331771939c03 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:45.182607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-066b3a49-ed74-485b-93f3-331771939c03 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:45.288540 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-066b3a49-ed74-485b-93f3-331771939c03 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0/action" status: 202 len: 0 microversion: 2.1 time: 0.126336 Jul 31 01:08:45.294633 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 369/744] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:08:45 2022] POST /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:08:45.326294 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed882a04-4b99-4cee-8a45-c361cc3ae84a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:45.333748 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ed882a04-4b99-4cee-8a45-c361cc3ae84a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:45.374355 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8447a2ff-8c50-4b6e-bdac-9cacf21f059f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:45.385682 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8447a2ff-8c50-4b6e-bdac-9cacf21f059f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:45.394144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8447a2ff-8c50-4b6e-bdac-9cacf21f059f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:45.401011 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8447a2ff-8c50-4b6e-bdac-9cacf21f059f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1567 microversion: 2.25 time: 0.360961 Jul 31 01:08:45.415566 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 376/745] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:45 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1567 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:45.438582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d367076d-2dd6-4784-9254-27891eae1629 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Calling method '.version_select at 0x7fede5b60280>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:45.507461 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d367076d-2dd6-4784-9254-27891eae1629 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "GET /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata" status: 200 len: 58 microversion: 2.1 time: 0.094618 Jul 31 01:08:45.508505 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 377/746] 10.222.0.45 () {58 vars in 1260 bytes} [Sun Jul 31 01:08:45 2022] GET /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata => generated 58 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:08:45.528492 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c36f74b5-d369-4ee5-bcf4-2f33d82b0a43 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:45.530052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c36f74b5-d369-4ee5-bcf4-2f33d82b0a43 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:45.550388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c36f74b5-d369-4ee5-bcf4-2f33d82b0a43 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:45.550867 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c36f74b5-d369-4ee5-bcf4-2f33d82b0a43 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:45.551729 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c36f74b5-d369-4ee5-bcf4-2f33d82b0a43 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:45.552902 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c36f74b5-d369-4ee5-bcf4-2f33d82b0a43 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:45.676434 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ed882a04-4b99-4cee-8a45-c361cc3ae84a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:45.709849 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ed882a04-4b99-4cee-8a45-c361cc3ae84a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa" status: 200 len: 1222 microversion: 2.1 time: 0.404385 Jul 31 01:08:45.712469 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 370/747] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:45 2022] GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa => generated 1222 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:45.741614 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-911481e3-a3b1-4b5c-a411-6bda5969c844 req-fb2fee4b-cfff-4f97-9fc5-69f1629a4b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4faaeb8d-01fd-456a-b887-c5cf7ba7051b", "name": "network-vif-plugged", "status": "completed", "tag": "ad7e118b-a003-47c7-8563-67c45bdc1cce"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:45.831411 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-911481e3-a3b1-4b5c-a411-6bda5969c844 req-fb2fee4b-cfff-4f97-9fc5-69f1629a4b66 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:45.839408 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-911481e3-a3b1-4b5c-a411-6bda5969c844 req-fb2fee4b-cfff-4f97-9fc5-69f1629a4b66 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:45.914271 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-911481e3-a3b1-4b5c-a411-6bda5969c844 req-fb2fee4b-cfff-4f97-9fc5-69f1629a4b66 service nova] Creating event network-vif-plugged:ad7e118b-a003-47c7-8563-67c45bdc1cce for instance 4faaeb8d-01fd-456a-b887-c5cf7ba7051b on n-h2-master-1 Jul 31 01:08:45.951665 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-911481e3-a3b1-4b5c-a411-6bda5969c844 req-fb2fee4b-cfff-4f97-9fc5-69f1629a4b66 service nova] Instance 4faaeb8d-01fd-456a-b887-c5cf7ba7051b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:08:45.997072 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-911481e3-a3b1-4b5c-a411-6bda5969c844 req-fb2fee4b-cfff-4f97-9fc5-69f1629a4b66 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276549 Jul 31 01:08:46.002175 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 371/748] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:46.034262 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ef19991-e104-490b-b2f4-d41d0b0bbf13 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:46.037538 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4ef19991-e104-490b-b2f4-d41d0b0bbf13 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:46.080565 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ef19991-e104-490b-b2f4-d41d0b0bbf13 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:46.087671 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ef19991-e104-490b-b2f4-d41d0b0bbf13 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:46.090183 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ef19991-e104-490b-b2f4-d41d0b0bbf13 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:46.090354 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ef19991-e104-490b-b2f4-d41d0b0bbf13 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:46.106693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c36f74b5-d369-4ee5-bcf4-2f33d82b0a43 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:46.142454 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c36f74b5-d369-4ee5-bcf4-2f33d82b0a43 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1470 microversion: 2.1 time: 0.632138 Jul 31 01:08:46.145278 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 378/749] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:45 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1470 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:46.164881 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6398ad67-9141-4ba0-a155-debec754fa65 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Action: 'update_all', calling method: .version_select at 0x7fede5f16040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:46.255161 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-6398ad67-9141-4ba0-a155-debec754fa65 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:46.266195 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-6398ad67-9141-4ba0-a155-debec754fa65 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for user ca2be0c08715470db62372816df208af and project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:46.719627 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4ef19991-e104-490b-b2f4-d41d0b0bbf13 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1629 microversion: 2.1 time: 0.712691 Jul 31 01:08:46.722585 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 372/750] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:46 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1629 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:46.732929 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3bf9d4b5-63f2-4615-9993-1727729e6307 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:46.733818 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3bf9d4b5-63f2-4615-9993-1727729e6307 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:46.742075 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bf9d4b5-63f2-4615-9993-1727729e6307 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:46.742804 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bf9d4b5-63f2-4615-9993-1727729e6307 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:46.743809 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bf9d4b5-63f2-4615-9993-1727729e6307 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:46.744446 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bf9d4b5-63f2-4615-9993-1727729e6307 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:46.915430 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3bf9d4b5-63f2-4615-9993-1727729e6307 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:46.925229 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3bf9d4b5-63f2-4615-9993-1727729e6307 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 200 len: 1402 microversion: 2.1 time: 0.203349 Jul 31 01:08:46.925819 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 373/751] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:46 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 1402 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:46.931043 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-9576dbbf-ff3c-4ed3-a990-9d84899835d2 req-a265e685-ffa7-4023-96aa-7a54392c11f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "899b694f-3e79-4d06-8dc4-2dedec20fc64", "tag": "97974ade-06ae-421e-b9a4-299f02c8d56b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:46.938865 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:46.946013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9576dbbf-ff3c-4ed3-a990-9d84899835d2 req-a265e685-ffa7-4023-96aa-7a54392c11f4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:46.946632 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9576dbbf-ff3c-4ed3-a990-9d84899835d2 req-a265e685-ffa7-4023-96aa-7a54392c11f4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:46.963431 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6398ad67-9141-4ba0-a155-debec754fa65 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "PUT /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.812096 Jul 31 01:08:46.964708 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 379/752] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:08:46 2022] PUT /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata => generated 61 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:08:46.975530 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d50c69d9-143b-443a-9648-40bd8e7679dc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:46.976665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d50c69d9-143b-443a-9648-40bd8e7679dc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:46.977186 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-9576dbbf-ff3c-4ed3-a990-9d84899835d2 req-a265e685-ffa7-4023-96aa-7a54392c11f4 service nova] Creating event network-changed:97974ade-06ae-421e-b9a4-299f02c8d56b for instance 899b694f-3e79-4d06-8dc4-2dedec20fc64 on n-h1-master-1 Jul 31 01:08:46.985216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d50c69d9-143b-443a-9648-40bd8e7679dc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:46.985740 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-9576dbbf-ff3c-4ed3-a990-9d84899835d2 req-a265e685-ffa7-4023-96aa-7a54392c11f4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058703 Jul 31 01:08:46.986260 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d50c69d9-143b-443a-9648-40bd8e7679dc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:46.986405 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 374/753] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:46.987475 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d50c69d9-143b-443a-9648-40bd8e7679dc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:46.988188 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d50c69d9-143b-443a-9648-40bd8e7679dc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:47.001445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-efb94565-74d7-4d3f-909c-eba21a7cd5a0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:47.002146 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-efb94565-74d7-4d3f-909c-eba21a7cd5a0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:47.009630 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efb94565-74d7-4d3f-909c-eba21a7cd5a0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:47.010086 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efb94565-74d7-4d3f-909c-eba21a7cd5a0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:47.010875 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efb94565-74d7-4d3f-909c-eba21a7cd5a0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:47.011553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efb94565-74d7-4d3f-909c-eba21a7cd5a0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:47.498547 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-efb94565-74d7-4d3f-909c-eba21a7cd5a0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:47.533800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-efb94565-74d7-4d3f-909c-eba21a7cd5a0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:47.537846 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-efb94565-74d7-4d3f-909c-eba21a7cd5a0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:47.539688 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-efb94565-74d7-4d3f-909c-eba21a7cd5a0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1567 microversion: 2.25 time: 0.543148 Jul 31 01:08:47.540657 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 375/754] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:46 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1567 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:47.547317 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b9f256bc-150e-4c55-aca3-e67bd0a861b7 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:47.548203 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d50c69d9-143b-443a-9648-40bd8e7679dc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:47.550025 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b9f256bc-150e-4c55-aca3-e67bd0a861b7 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:47.560746 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d50c69d9-143b-443a-9648-40bd8e7679dc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 200 len: 1319 microversion: 2.1 time: 0.590282 Jul 31 01:08:47.561863 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 380/755] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:46 2022] GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 1319 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:47.567537 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9f256bc-150e-4c55-aca3-e67bd0a861b7 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:47.568927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ca4b1e8c-24ed-4b0c-bce4-30db9065bb1c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:47.569179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9f256bc-150e-4c55-aca3-e67bd0a861b7 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:47.572289 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9f256bc-150e-4c55-aca3-e67bd0a861b7 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:47.573101 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9f256bc-150e-4c55-aca3-e67bd0a861b7 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:47.575248 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ca4b1e8c-24ed-4b0c-bce4-30db9065bb1c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:47.598110 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca4b1e8c-24ed-4b0c-bce4-30db9065bb1c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:47.598565 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca4b1e8c-24ed-4b0c-bce4-30db9065bb1c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:47.599389 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca4b1e8c-24ed-4b0c-bce4-30db9065bb1c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:47.599834 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca4b1e8c-24ed-4b0c-bce4-30db9065bb1c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:47.641407 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-ca4b1e8c-24ed-4b0c-bce4-30db9065bb1c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lazy-loading 'flavor' on Instance uuid aafa66e0-8207-4875-947e-48fe17082af0 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:08:47.660491 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ca4b1e8c-24ed-4b0c-bce4-30db9065bb1c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Going to try to live migrate instance to n-h2-master-1 {{(pid=119474) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 31 01:08:47.673870 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b9f256bc-150e-4c55-aca3-e67bd0a861b7 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:47.683320 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b9f256bc-150e-4c55-aca3-e67bd0a861b7 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa" status: 200 len: 1280 microversion: 2.1 time: 0.141161 Jul 31 01:08:47.696940 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 376/756] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:47 2022] GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa => generated 1280 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:47.706930 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7825075f-b35f-4b62-a922-7330e3b0e36c tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Action: 'create', calling method: .version_select at 0x7fede5973790>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:47.819203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7825075f-b35f-4b62-a922-7330e3b0e36c tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:47.830290 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7825075f-b35f-4b62-a922-7330e3b0e36c tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Getting quotas for user ca2be0c08715470db62372816df208af and project 94ff44ca4a1d4313a24d5b2a1f8bfe2f. Resources: dict_keys(['metadata_items']) {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:48.401156 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7825075f-b35f-4b62-a922-7330e3b0e36c tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "POST /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata" status: 200 len: 85 microversion: 2.1 time: 0.701779 Jul 31 01:08:48.409473 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 377/757] 10.222.0.45 () {60 vars in 1281 bytes} [Sun Jul 31 01:08:47 2022] POST /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata => generated 85 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:08:48.412957 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6a525c4c-2c3a-4bf6-975a-a5cee535af8c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:48.414032 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6a525c4c-2c3a-4bf6-975a-a5cee535af8c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:48.427085 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a525c4c-2c3a-4bf6-975a-a5cee535af8c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:48.427953 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a525c4c-2c3a-4bf6-975a-a5cee535af8c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:48.429413 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a525c4c-2c3a-4bf6-975a-a5cee535af8c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:48.430195 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a525c4c-2c3a-4bf6-975a-a5cee535af8c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:48.675429 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6a525c4c-2c3a-4bf6-975a-a5cee535af8c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:48.684184 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6a525c4c-2c3a-4bf6-975a-a5cee535af8c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1462 microversion: 2.1 time: 0.279842 Jul 31 01:08:48.696603 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 378/758] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:48 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1462 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:48.709551 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0fe21b01-4d74-4117-a64b-85d4a4549451 tempest-ServersWithSpecificFlavorTestJSON-1056725628 tempest-ServersWithSpecificFlavorTestJSON-1056725628-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:48.711757 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:08:48.711757 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:08:48.753271 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0fe21b01-4d74-4117-a64b-85d4a4549451 tempest-ServersWithSpecificFlavorTestJSON-1056725628 tempest-ServersWithSpecificFlavorTestJSON-1056725628-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/140579913" status: 202 len: 0 microversion: 2.1 time: 0.041043 Jul 31 01:08:48.761063 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 379/759] 10.222.0.45 () {58 vars in 1158 bytes} [Sun Jul 31 01:08:48 2022] DELETE /compute/v2.1/flavors/140579913 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:08:48.782209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c5dade15-37ef-430d-8eeb-ed08063d4cae tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:48.783262 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c5dade15-37ef-430d-8eeb-ed08063d4cae tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:48.795044 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5dade15-37ef-430d-8eeb-ed08063d4cae tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:48.796432 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5dade15-37ef-430d-8eeb-ed08063d4cae tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:48.797524 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5dade15-37ef-430d-8eeb-ed08063d4cae tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:48.798154 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5dade15-37ef-430d-8eeb-ed08063d4cae tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:49.022607 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c5dade15-37ef-430d-8eeb-ed08063d4cae tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:49.031280 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c5dade15-37ef-430d-8eeb-ed08063d4cae tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 200 len: 1402 microversion: 2.1 time: 0.268690 Jul 31 01:08:49.057121 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 380/760] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:48 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 1402 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:49.074023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-74596768-235d-4a5e-a5d9-b07764b9ede1 req-13e6866d-89fd-4c13-80de-35caa41cb287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa29e77-13fc-46d3-9b2b-8f38833f1fa9", "name": "network-vif-plugged", "status": "completed", "tag": "2b605aa9-7b84-4f1e-aade-328fc0be9446"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:49.094800 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-74596768-235d-4a5e-a5d9-b07764b9ede1 req-13e6866d-89fd-4c13-80de-35caa41cb287 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:49.095261 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-74596768-235d-4a5e-a5d9-b07764b9ede1 req-13e6866d-89fd-4c13-80de-35caa41cb287 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:49.108521 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-74596768-235d-4a5e-a5d9-b07764b9ede1 req-13e6866d-89fd-4c13-80de-35caa41cb287 service nova] Creating event network-vif-plugged:2b605aa9-7b84-4f1e-aade-328fc0be9446 for instance 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 on n-h2-master-1 Jul 31 01:08:49.114559 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-74596768-235d-4a5e-a5d9-b07764b9ede1 req-13e6866d-89fd-4c13-80de-35caa41cb287 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052440 Jul 31 01:08:49.115374 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 381/761] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:49.121701 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3ebc9431-dfb1-4ffc-a592-70fbef56a655 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] Calling method '.version_select at 0x7fede5a555e0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:49.196146 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3ebc9431-dfb1-4ffc-a592-70fbef56a655 tempest-ImagesMetadataTestJSON-1997110026 tempest-ImagesMetadataTestJSON-1997110026-project] 10.222.0.45 "GET /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata" status: 200 len: 85 microversion: 2.1 time: 0.079019 Jul 31 01:08:49.197319 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 382/762] 10.222.0.45 () {58 vars in 1260 bytes} [Sun Jul 31 01:08:49 2022] GET /compute/v2.1/images/2c4823fd-472e-4b78-ba3f-199a868e101b/metadata => generated 85 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:08:49.202792 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b06623b1-5d9a-44f3-b04b-cb70d8a2522a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:49.212418 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b06623b1-5d9a-44f3-b04b-cb70d8a2522a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:49.220586 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b06623b1-5d9a-44f3-b04b-cb70d8a2522a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:49.221045 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b06623b1-5d9a-44f3-b04b-cb70d8a2522a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:49.221995 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b06623b1-5d9a-44f3-b04b-cb70d8a2522a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:49.222438 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b06623b1-5d9a-44f3-b04b-cb70d8a2522a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:49.447730 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b06623b1-5d9a-44f3-b04b-cb70d8a2522a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:49.475010 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b06623b1-5d9a-44f3-b04b-cb70d8a2522a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:49.480570 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b06623b1-5d9a-44f3-b04b-cb70d8a2522a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:49.485213 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b06623b1-5d9a-44f3-b04b-cb70d8a2522a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1542 microversion: 2.25 time: 0.285417 Jul 31 01:08:49.492148 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 383/763] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:49 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1542 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:49.498265 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3f874a42-21ab-41c8-8a41-97d962044102 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:49.498898 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3f874a42-21ab-41c8-8a41-97d962044102 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:49.510163 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f874a42-21ab-41c8-8a41-97d962044102 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:49.510803 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f874a42-21ab-41c8-8a41-97d962044102 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:49.512550 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f874a42-21ab-41c8-8a41-97d962044102 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:49.513022 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f874a42-21ab-41c8-8a41-97d962044102 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:49.774165 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3f874a42-21ab-41c8-8a41-97d962044102 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:49.813209 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3f874a42-21ab-41c8-8a41-97d962044102 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 200 len: 1319 microversion: 2.1 time: 0.318008 Jul 31 01:08:49.814337 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 384/764] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:49 2022] GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:49.835077 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6b366902-b2cc-444b-a263-7f5872ea424d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:49.839890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6b366902-b2cc-444b-a263-7f5872ea424d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:49.862981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b366902-b2cc-444b-a263-7f5872ea424d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:49.863612 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b366902-b2cc-444b-a263-7f5872ea424d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:49.864531 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b366902-b2cc-444b-a263-7f5872ea424d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:49.864989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b366902-b2cc-444b-a263-7f5872ea424d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:50.085238 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6b366902-b2cc-444b-a263-7f5872ea424d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:50.092152 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:50.100029 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6b366902-b2cc-444b-a263-7f5872ea424d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1462 microversion: 2.1 time: 0.283508 Jul 31 01:08:50.112425 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 385/765] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:49 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1462 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:50.127253 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a43e394f-198c-44b2-9b2b-f0500b3ae35a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:50.127925 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a43e394f-198c-44b2-9b2b-f0500b3ae35a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:50.135690 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a43e394f-198c-44b2-9b2b-f0500b3ae35a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:50.136143 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a43e394f-198c-44b2-9b2b-f0500b3ae35a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:50.137166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a43e394f-198c-44b2-9b2b-f0500b3ae35a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:50.137880 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a43e394f-198c-44b2-9b2b-f0500b3ae35a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:50.520586 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a43e394f-198c-44b2-9b2b-f0500b3ae35a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:50.547860 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a43e394f-198c-44b2-9b2b-f0500b3ae35a tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa" status: 200 len: 1322 microversion: 2.1 time: 0.433308 Jul 31 01:08:50.564079 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 386/766] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:50 2022] GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:50.586846 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f9ac73ed-cce3-474f-82b7-0f2d40f1af6e tempest-ServersWithSpecificFlavorTestJSON-1056725628 tempest-ServersWithSpecificFlavorTestJSON-1056725628-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:50.660241 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f9ac73ed-cce3-474f-82b7-0f2d40f1af6e tempest-ServersWithSpecificFlavorTestJSON-1056725628 tempest-ServersWithSpecificFlavorTestJSON-1056725628-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.093916 Jul 31 01:08:50.668100 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 387/767] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:08:50 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:50.686150 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-271e8602-9a26-4cb6-9fd8-c063e45ef36c tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '.version_select at 0x7fede5b67c10>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:50.722714 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-271e8602-9a26-4cb6-9fd8-c063e45ef36c tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:50.724905 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-271e8602-9a26-4cb6-9fd8-c063e45ef36c tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:50.752357 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-271e8602-9a26-4cb6-9fd8-c063e45ef36c tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 2494 microversion: 2.25 time: 0.074414 Jul 31 01:08:50.754460 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 388/768] 10.222.0.45 () {60 vars in 1184 bytes} [Sun Jul 31 01:08:50 2022] GET /compute/v2.1/os-migrations => generated 2494 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:50.781805 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6c990053-6cad-457a-86d8-15a42aa68dd2 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:50.784213 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6c990053-6cad-457a-86d8-15a42aa68dd2 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:50.808337 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c990053-6cad-457a-86d8-15a42aa68dd2 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:50.809278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c990053-6cad-457a-86d8-15a42aa68dd2 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:50.811177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c990053-6cad-457a-86d8-15a42aa68dd2 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:50.813083 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c990053-6cad-457a-86d8-15a42aa68dd2 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:51.220866 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6c990053-6cad-457a-86d8-15a42aa68dd2 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:51.233702 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6c990053-6cad-457a-86d8-15a42aa68dd2 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 200 len: 1402 microversion: 2.1 time: 0.477000 Jul 31 01:08:51.235190 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 389/769] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:50 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 1402 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:51.248592 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-db97748f-8819-4bfd-9f3c-7e1007500d20 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Action: 'create', calling method: .version_select at 0x7fede5c3f5e0>, body: {"keypair": {"name": "tempest-keypair-1795578892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvsryxpTUq+gGE5oqmyHtdV7jMWcmDsygjZyGE/h203YZMZhON80ASLaNQBoWI/NfJJO4LUX/ON6QU+/zvohj7KOafihJW/d5+86IOM9cK19uiXWRjwcdDlutU8dEVD/g=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:51.308588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-db97748f-8819-4bfd-9f3c-7e1007500d20 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Getting quotas for project 87496179e992473c991977e0e517460a. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:51.314990 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-db97748f-8819-4bfd-9f3c-7e1007500d20 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Getting quotas for user 9a2a0f61c8304c9a9ad7af6120e83443 and project 87496179e992473c991977e0e517460a. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:51.316291 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ca4b1e8c-24ed-4b0c-bce4-30db9065bb1c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0/action" status: 202 len: 0 microversion: 2.1 time: 3.752740 Jul 31 01:08:51.316922 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 381/770] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:08:47 2022] POST /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0/action => generated 0 bytes in 3754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:08:51.328818 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7d758f43-c148-4066-a10d-ffb353a03051 req-d1200b40-cf0c-43ae-b587-8b626f99c8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f37a0b-3c88-4abf-a832-d7e0230276aa", "tag": "8d10cd1f-c6a6-47b6-9490-4951f6a0ea77"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:51.345657 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7d758f43-c148-4066-a10d-ffb353a03051 req-d1200b40-cf0c-43ae-b587-8b626f99c8e4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:51.346289 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7d758f43-c148-4066-a10d-ffb353a03051 req-d1200b40-cf0c-43ae-b587-8b626f99c8e4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:51.351070 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-db97748f-8819-4bfd-9f3c-7e1007500d20 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113953 Jul 31 01:08:51.352161 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 390/771] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:08:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:51.358389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-175cf587-b203-4160-81b8-b7db4f7f34da tempest-ServersWithSpecificFlavorTestJSON-1056725628 tempest-ServersWithSpecificFlavorTestJSON-1056725628-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:51.359750 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:08:51.359750 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:08:51.361201 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7d758f43-c148-4066-a10d-ffb353a03051 req-d1200b40-cf0c-43ae-b587-8b626f99c8e4 service nova] Creating event network-changed:8d10cd1f-c6a6-47b6-9490-4951f6a0ea77 for instance a1f37a0b-3c88-4abf-a832-d7e0230276aa on n-h1-master-1 Jul 31 01:08:51.368404 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7d758f43-c148-4066-a10d-ffb353a03051 req-d1200b40-cf0c-43ae-b587-8b626f99c8e4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044868 Jul 31 01:08:51.369247 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 382/772] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:51.376289 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-34299192-7785-49b9-b6a9-2d7b2850125d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:51.377902 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-34299192-7785-49b9-b6a9-2d7b2850125d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:51.388018 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-175cf587-b203-4160-81b8-b7db4f7f34da tempest-ServersWithSpecificFlavorTestJSON-1056725628 tempest-ServersWithSpecificFlavorTestJSON-1056725628-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1005941521" status: 202 len: 0 microversion: 2.1 time: 0.033811 Jul 31 01:08:51.389139 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 391/773] 10.222.0.45 () {58 vars in 1161 bytes} [Sun Jul 31 01:08:51 2022] DELETE /compute/v2.1/flavors/1005941521 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:08:51.390194 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-34299192-7785-49b9-b6a9-2d7b2850125d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:51.391630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-34299192-7785-49b9-b6a9-2d7b2850125d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:51.392950 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-34299192-7785-49b9-b6a9-2d7b2850125d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:51.393714 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-34299192-7785-49b9-b6a9-2d7b2850125d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:51.397736 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-181a3bb4-4694-4d2d-9bb7-9de8a4df52c6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:51.398438 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-181a3bb4-4694-4d2d-9bb7-9de8a4df52c6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:51.409777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-181a3bb4-4694-4d2d-9bb7-9de8a4df52c6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:51.410412 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-181a3bb4-4694-4d2d-9bb7-9de8a4df52c6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:51.411467 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-181a3bb4-4694-4d2d-9bb7-9de8a4df52c6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:51.412088 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-181a3bb4-4694-4d2d-9bb7-9de8a4df52c6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:51.733815 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-181a3bb4-4694-4d2d-9bb7-9de8a4df52c6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:51.742085 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-181a3bb4-4694-4d2d-9bb7-9de8a4df52c6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 200 len: 1319 microversion: 2.1 time: 0.351698 Jul 31 01:08:51.742886 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 392/774] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:51 2022] GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:51.743145 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-34299192-7785-49b9-b6a9-2d7b2850125d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'services' on Instance uuid 2d4db5ff-45fe-4d51-809d-d8983072a691 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:08:51.762653 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-621d1422-1861-48bc-9da9-02fd92f7308d req-a1afd986-d73c-4d9b-b835-7e7ffa6448b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899b694f-3e79-4d06-8dc4-2dedec20fc64", "name": "network-vif-plugged", "status": "completed", "tag": "97974ade-06ae-421e-b9a4-299f02c8d56b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:51.780358 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-621d1422-1861-48bc-9da9-02fd92f7308d req-a1afd986-d73c-4d9b-b835-7e7ffa6448b9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:51.780605 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-34299192-7785-49b9-b6a9-2d7b2850125d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 2035 microversion: 2.25 time: 0.409174 Jul 31 01:08:51.781366 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 383/775] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:08:51 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 2035 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:08:51.781869 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-621d1422-1861-48bc-9da9-02fd92f7308d req-a1afd986-d73c-4d9b-b835-7e7ffa6448b9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:51.789371 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-19ca38da-fdab-4a50-83e4-9efeab1bedee tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:51.790314 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-19ca38da-fdab-4a50-83e4-9efeab1bedee tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:51.804528 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-621d1422-1861-48bc-9da9-02fd92f7308d req-a1afd986-d73c-4d9b-b835-7e7ffa6448b9 service nova] Creating event network-vif-plugged:97974ade-06ae-421e-b9a4-299f02c8d56b for instance 899b694f-3e79-4d06-8dc4-2dedec20fc64 on n-h1-master-1 Jul 31 01:08:51.812237 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-19ca38da-fdab-4a50-83e4-9efeab1bedee tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:51.813784 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-621d1422-1861-48bc-9da9-02fd92f7308d req-a1afd986-d73c-4d9b-b835-7e7ffa6448b9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055393 Jul 31 01:08:51.813994 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-19ca38da-fdab-4a50-83e4-9efeab1bedee tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:51.815320 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-19ca38da-fdab-4a50-83e4-9efeab1bedee tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:51.815641 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 393/776] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:51.821306 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-19ca38da-fdab-4a50-83e4-9efeab1bedee tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:51.838239 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-64b6f848-d14c-44e1-afda-e3e3018fd899 tempest-ServersWithSpecificFlavorTestJSON-1056725628 tempest-ServersWithSpecificFlavorTestJSON-1056725628-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:51.888148 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-64b6f848-d14c-44e1-afda-e3e3018fd899 tempest-ServersWithSpecificFlavorTestJSON-1056725628 tempest-ServersWithSpecificFlavorTestJSON-1056725628-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069663 Jul 31 01:08:51.889697 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 394/777] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:08:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:51.904927 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2ed86f14-07a6-4074-9f55-e8eebfba98b2 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:51.908360 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2ed86f14-07a6-4074-9f55-e8eebfba98b2 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:51.929167 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ed86f14-07a6-4074-9f55-e8eebfba98b2 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:51.930002 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ed86f14-07a6-4074-9f55-e8eebfba98b2 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:51.931613 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ed86f14-07a6-4074-9f55-e8eebfba98b2 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:51.932415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ed86f14-07a6-4074-9f55-e8eebfba98b2 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:52.184815 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-19ca38da-fdab-4a50-83e4-9efeab1bedee tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:52.219198 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-19ca38da-fdab-4a50-83e4-9efeab1bedee tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1503 microversion: 2.1 time: 0.436106 Jul 31 01:08:52.219694 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 384/778] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:51 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1503 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:52.240364 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1b25ed1b-ceee-43fa-befb-fc153a801d2e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Action: 'create', calling method: .version_select at 0x7fede58d7ee0>, body: {"keypair": {"name": "tempest-keypair-1314929671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbeqMYR7n+uoK34eiBDhBhr9OJjGCJgVs8La08QTcOuEBzzI04aW10wc6iANEJIJZFMh2Iw9ddOtfoiiCbYcRJeKUU7OjPMu/SUav2/E//rGoWEtywC/QV5ddWnUpmNXA=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:52.281135 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-1b25ed1b-ceee-43fa-befb-fc153a801d2e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Getting quotas for project 5881381d95ec452eb516c0c7ad826a08. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:08:52.284060 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2ed86f14-07a6-4074-9f55-e8eebfba98b2 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:52.287029 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-1b25ed1b-ceee-43fa-befb-fc153a801d2e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Getting quotas for user cd6eb7e316f54ff386eaa598df805de9 and project 5881381d95ec452eb516c0c7ad826a08. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:08:52.331413 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1b25ed1b-ceee-43fa-befb-fc153a801d2e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.106937 Jul 31 01:08:52.342020 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 385/779] 10.222.0.45 () {62 vars in 1200 bytes} [Sun Jul 31 01:08:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 31 01:08:52.342020 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e89c83c9-86cb-44b7-a33d-96adfec4e41d tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:52.342020 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e89c83c9-86cb-44b7-a33d-96adfec4e41d tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:52.343465 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2ed86f14-07a6-4074-9f55-e8eebfba98b2 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa" status: 200 len: 1322 microversion: 2.1 time: 0.445684 Jul 31 01:08:52.343465 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 395/780] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:51 2022] GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:52.367869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e89c83c9-86cb-44b7-a33d-96adfec4e41d tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:52.372894 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e89c83c9-86cb-44b7-a33d-96adfec4e41d tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:52.377869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e89c83c9-86cb-44b7-a33d-96adfec4e41d tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:52.379057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e89c83c9-86cb-44b7-a33d-96adfec4e41d tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:52.396272 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3c08bc1e-cf31-47cb-8648-00db5464e22f tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:52.402833 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3c08bc1e-cf31-47cb-8648-00db5464e22f tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:52.438400 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-e89c83c9-86cb-44b7-a33d-96adfec4e41d tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] HTTP exception thrown: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e89c83c9-86cb-44b7-a33d-96adfec4e41d tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Request method failure captured: Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e HTTP/1.1 Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dV3W3bPWJFeh7BzewxnKx-yPYdY4kESjfLYhHoJ3FsmKwSi1Gdt2ksRHer5P8rLiMUD1xi4zlqJIih21v7EspIW2fC4VvfKK5_Db3b0mCcaoc1ZEWNB2TJSFg6PCa-R24HlEU15Hr3EU5EFb7NsJ72P3E4-1jKFHtGqFrehWAuUjd8 Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 69a24d132da74cd0a21d1851711745c0 Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:08:52.443477 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:08:52.445027 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_69a24d132da74cd0a21d1851711745c0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:08:52.445027 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:52.445027 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 69a24d132da74cd0a21d1851711745c0 Jul 31 01:08:52.445027 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:52.445027 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1947983447-project Jul 31 01:08:52.445027 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:08:52.445027 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:08:52.445027 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 505f516270844b7e9d0f213c3ce3da6f Jul 31 01:08:52.445027 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447-project Jul 31 01:08:52.445027 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:08:52.445027 n-d-master-1 devstack@n-api.service[119474]: exception: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. Jul 31 01:08:52.445027 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'ff233d7d-7f8e-4283-a902-d08ed1a3fc1e'} Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:08:52.445741 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. Jul 31 01:08:52.448541 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.453674 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c08bc1e-cf31-47cb-8648-00db5464e22f tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:52.453832 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e89c83c9-86cb-44b7-a33d-96adfec4e41d tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Returning 404 to user: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:08:52.453974 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c08bc1e-cf31-47cb-8648-00db5464e22f tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:52.454110 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e89c83c9-86cb-44b7-a33d-96adfec4e41d tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 404 len: 111 microversion: 2.1 time: 0.111292 Jul 31 01:08:52.454232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c08bc1e-cf31-47cb-8648-00db5464e22f tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:52.454386 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 386/781] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:08:52 2022] DELETE /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:08:52.457396 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c08bc1e-cf31-47cb-8648-00db5464e22f tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:52.462343 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6424d271-676e-4d6f-92ef-6b14f1cc2091 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:52.462994 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6424d271-676e-4d6f-92ef-6b14f1cc2091 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: ff233d7d-7f8e-4283-a902-d08ed1a3fc1e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:52.490162 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6424d271-676e-4d6f-92ef-6b14f1cc2091 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:52.494776 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6424d271-676e-4d6f-92ef-6b14f1cc2091 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:52.496471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6424d271-676e-4d6f-92ef-6b14f1cc2091 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:52.497214 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6424d271-676e-4d6f-92ef-6b14f1cc2091 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:52.525565 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-6424d271-676e-4d6f-92ef-6b14f1cc2091 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] HTTP exception thrown: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6424d271-676e-4d6f-92ef-6b14f1cc2091 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Request method failure captured: Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e HTTP/1.1 Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dV3W3bPWJFeh7BzewxnKx-yPYdY4kESjfLYhHoJ3FsmKwSi1Gdt2ksRHer5P8rLiMUD1xi4zlqJIih21v7EspIW2fC4VvfKK5_Db3b0mCcaoc1ZEWNB2TJSFg6PCa-R24HlEU15Hr3EU5EFb7NsJ72P3E4-1jKFHtGqFrehWAuUjd8 Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 69a24d132da74cd0a21d1851711745c0 Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:08:52.530204 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:08:52.532472 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_69a24d132da74cd0a21d1851711745c0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:08:52.532472 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:52.532472 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 69a24d132da74cd0a21d1851711745c0 Jul 31 01:08:52.532472 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:52.532472 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1947983447-project Jul 31 01:08:52.532472 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:08:52.532472 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:08:52.532472 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 505f516270844b7e9d0f213c3ce3da6f Jul 31 01:08:52.532472 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447-project Jul 31 01:08:52.532472 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:08:52.532472 n-d-master-1 devstack@n-api.service[119474]: exception: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. Jul 31 01:08:52.532472 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'ff233d7d-7f8e-4283-a902-d08ed1a3fc1e'} Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:08:52.533379 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. Jul 31 01:08:52.534929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.536145 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6424d271-676e-4d6f-92ef-6b14f1cc2091 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Returning 404 to user: Instance ff233d7d-7f8e-4283-a902-d08ed1a3fc1e could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:08:52.538076 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6424d271-676e-4d6f-92ef-6b14f1cc2091 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e" status: 404 len: 111 microversion: 2.1 time: 0.083593 Jul 31 01:08:52.543115 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 387/782] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:52 2022] GET /compute/v2.1/servers/ff233d7d-7f8e-4283-a902-d08ed1a3fc1e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:08:52.554936 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1b1c8eaa-6c7b-4427-835a-1abad68c3f5b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:52.555901 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1b1c8eaa-6c7b-4427-835a-1abad68c3f5b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:52.573708 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b1c8eaa-6c7b-4427-835a-1abad68c3f5b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:52.574469 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b1c8eaa-6c7b-4427-835a-1abad68c3f5b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:52.576367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b1c8eaa-6c7b-4427-835a-1abad68c3f5b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:52.579694 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b1c8eaa-6c7b-4427-835a-1abad68c3f5b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:52.621276 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-1b1c8eaa-6c7b-4427-835a-1abad68c3f5b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] HTTP exception thrown: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1b1c8eaa-6c7b-4427-835a-1abad68c3f5b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Request method failure captured: Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 HTTP/1.1 Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dV3W3bPWJFeh7BzewxnKx-yPYdY4kESjfLYhHoJ3FsmKwSi1Gdt2ksRHer5P8rLiMUD1xi4zlqJIih21v7EspIW2fC4VvfKK5_Db3b0mCcaoc1ZEWNB2TJSFg6PCa-R24HlEU15Hr3EU5EFb7NsJ72P3E4-1jKFHtGqFrehWAuUjd8 Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 69a24d132da74cd0a21d1851711745c0 Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:08:52.625853 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:08:52.627165 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_69a24d132da74cd0a21d1851711745c0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:08:52.627165 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:52.627165 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 69a24d132da74cd0a21d1851711745c0 Jul 31 01:08:52.627165 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:52.627165 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1947983447-project Jul 31 01:08:52.627165 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:08:52.627165 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:08:52.627165 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 505f516270844b7e9d0f213c3ce3da6f Jul 31 01:08:52.627165 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447-project Jul 31 01:08:52.627165 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:08:52.627165 n-d-master-1 devstack@n-api.service[119474]: exception: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:52.627165 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'eccd8f8d-d332-4c4e-bef6-30de69b8f681'} Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:08:52.628128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:52.629937 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.633003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1b1c8eaa-6c7b-4427-835a-1abad68c3f5b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Returning 404 to user: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:08:52.633003 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1b1c8eaa-6c7b-4427-835a-1abad68c3f5b tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 404 len: 111 microversion: 2.1 time: 0.083199 Jul 31 01:08:52.635644 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 388/783] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:08:52 2022] DELETE /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:08:52.648536 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f55aa3ad-e4dd-45b6-ba0d-371a14d5c744 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:52.650920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f55aa3ad-e4dd-45b6-ba0d-371a14d5c744 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] [instance: eccd8f8d-d332-4c4e-bef6-30de69b8f681] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:52.665425 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f55aa3ad-e4dd-45b6-ba0d-371a14d5c744 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:52.670749 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f55aa3ad-e4dd-45b6-ba0d-371a14d5c744 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:52.673807 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f55aa3ad-e4dd-45b6-ba0d-371a14d5c744 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:52.676757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f55aa3ad-e4dd-45b6-ba0d-371a14d5c744 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:52.700736 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-f55aa3ad-e4dd-45b6-ba0d-371a14d5c744 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] HTTP exception thrown: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f55aa3ad-e4dd-45b6-ba0d-371a14d5c744 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Request method failure captured: Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 HTTP/1.1 Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dV3W3bPWJFeh7BzewxnKx-yPYdY4kESjfLYhHoJ3FsmKwSi1Gdt2ksRHer5P8rLiMUD1xi4zlqJIih21v7EspIW2fC4VvfKK5_Db3b0mCcaoc1ZEWNB2TJSFg6PCa-R24HlEU15Hr3EU5EFb7NsJ72P3E4-1jKFHtGqFrehWAuUjd8 Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 69a24d132da74cd0a21d1851711745c0 Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:08:52.703558 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:08:52.704854 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/69a24d132da74cd0a21d1851711745c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_69a24d132da74cd0a21d1851711745c0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:08:52.704854 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:52.704854 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 69a24d132da74cd0a21d1851711745c0 Jul 31 01:08:52.704854 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447 Jul 31 01:08:52.704854 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1947983447-project Jul 31 01:08:52.704854 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:08:52.704854 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:08:52.704854 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 505f516270844b7e9d0f213c3ce3da6f Jul 31 01:08:52.704854 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1947983447-project Jul 31 01:08:52.704854 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:08:52.704854 n-d-master-1 devstack@n-api.service[119474]: exception: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:52.704854 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'eccd8f8d-d332-4c4e-bef6-30de69b8f681'} Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:08:52.705607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. Jul 31 01:08:52.706758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:08:52.709097 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f55aa3ad-e4dd-45b6-ba0d-371a14d5c744 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] Returning 404 to user: Instance eccd8f8d-d332-4c4e-bef6-30de69b8f681 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:08:52.709530 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f55aa3ad-e4dd-45b6-ba0d-371a14d5c744 tempest-ServersWithSpecificFlavorTestJSON-1947983447 tempest-ServersWithSpecificFlavorTestJSON-1947983447-project] 10.222.0.45 "GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681" status: 404 len: 111 microversion: 2.1 time: 0.070288 Jul 31 01:08:52.713763 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 389/784] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:52 2022] GET /compute/v2.1/servers/eccd8f8d-d332-4c4e-bef6-30de69b8f681 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:08:52.767933 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-62f36035-c39c-4800-93f2-2d2f2323590c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:52.769887 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-62f36035-c39c-4800-93f2-2d2f2323590c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:52.782143 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62f36035-c39c-4800-93f2-2d2f2323590c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:52.782987 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62f36035-c39c-4800-93f2-2d2f2323590c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:52.784166 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62f36035-c39c-4800-93f2-2d2f2323590c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:52.785316 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62f36035-c39c-4800-93f2-2d2f2323590c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:53.693397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-62f36035-c39c-4800-93f2-2d2f2323590c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:53.701745 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3c08bc1e-cf31-47cb-8648-00db5464e22f tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:53.717261 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-62f36035-c39c-4800-93f2-2d2f2323590c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 200 len: 1319 microversion: 2.1 time: 0.956775 Jul 31 01:08:53.719753 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 390/785] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:52 2022] GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 1319 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:53.729099 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c6c218f9-358d-44dc-bf7b-7d33fe8a3767 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:53.729376 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3c08bc1e-cf31-47cb-8648-00db5464e22f tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 200 len: 1402 microversion: 2.1 time: 1.384843 Jul 31 01:08:53.730415 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c6c218f9-358d-44dc-bf7b-7d33fe8a3767 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:53.731658 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 396/786] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:52 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 1402 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:53.744380 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6c218f9-358d-44dc-bf7b-7d33fe8a3767 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:53.746732 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6c218f9-358d-44dc-bf7b-7d33fe8a3767 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:53.747593 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-accc66db-dd8b-489e-8fc8-19f20fb30118 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:53.749115 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-accc66db-dd8b-489e-8fc8-19f20fb30118 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:53.750613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6c218f9-358d-44dc-bf7b-7d33fe8a3767 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:53.752584 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6c218f9-358d-44dc-bf7b-7d33fe8a3767 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:53.773744 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-accc66db-dd8b-489e-8fc8-19f20fb30118 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:53.774966 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-accc66db-dd8b-489e-8fc8-19f20fb30118 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:53.779286 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-accc66db-dd8b-489e-8fc8-19f20fb30118 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:53.781975 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-accc66db-dd8b-489e-8fc8-19f20fb30118 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:54.119941 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c6c218f9-358d-44dc-bf7b-7d33fe8a3767 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:54.131481 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-accc66db-dd8b-489e-8fc8-19f20fb30118 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:54.137948 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c6c218f9-358d-44dc-bf7b-7d33fe8a3767 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1503 microversion: 2.1 time: 0.415780 Jul 31 01:08:54.139598 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 391/787] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:53 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1503 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:54.153602 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-accc66db-dd8b-489e-8fc8-19f20fb30118 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa" status: 200 len: 1322 microversion: 2.1 time: 0.417759 Jul 31 01:08:54.171387 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 397/788] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:53 2022] GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:54.171786 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-901b0591-5123-4688-a9c3-d3f8b81142aa req-689ef8e5-921f-4055-8355-c8f369955076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bdd9c6c-52f8-4b5c-84f7-967f02739459", "name": "network-vif-plugged", "status": "completed", "tag": "5d949b6a-7201-4176-9f2b-07df89c17ca9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:54.188812 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-901b0591-5123-4688-a9c3-d3f8b81142aa req-689ef8e5-921f-4055-8355-c8f369955076 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:54.189513 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-901b0591-5123-4688-a9c3-d3f8b81142aa req-689ef8e5-921f-4055-8355-c8f369955076 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:54.216636 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-901b0591-5123-4688-a9c3-d3f8b81142aa req-689ef8e5-921f-4055-8355-c8f369955076 service nova] Creating event network-vif-plugged:5d949b6a-7201-4176-9f2b-07df89c17ca9 for instance 6bdd9c6c-52f8-4b5c-84f7-967f02739459 on n-h2-master-1 Jul 31 01:08:54.222547 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-901b0591-5123-4688-a9c3-d3f8b81142aa req-689ef8e5-921f-4055-8355-c8f369955076 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071867 Jul 31 01:08:54.223444 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 392/789] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:54.746339 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-08a37aa9-cf3d-406b-a755-7959d04712da tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:54.751235 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:54.752879 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-08a37aa9-cf3d-406b-a755-7959d04712da tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:54.756090 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e12db137-7993-4fa6-9ade-e9fcf44fcb58 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:54.756803 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e12db137-7993-4fa6-9ade-e9fcf44fcb58 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:54.763426 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:54.764025 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e12db137-7993-4fa6-9ade-e9fcf44fcb58 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:54.764664 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e12db137-7993-4fa6-9ade-e9fcf44fcb58 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:54.765686 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e12db137-7993-4fa6-9ade-e9fcf44fcb58 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:54.766331 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e12db137-7993-4fa6-9ade-e9fcf44fcb58 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:54.781737 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08a37aa9-cf3d-406b-a755-7959d04712da tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:54.782613 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08a37aa9-cf3d-406b-a755-7959d04712da tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:54.784114 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08a37aa9-cf3d-406b-a755-7959d04712da tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:54.784942 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08a37aa9-cf3d-406b-a755-7959d04712da tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:55.005759 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e12db137-7993-4fa6-9ade-e9fcf44fcb58 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:55.027721 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e12db137-7993-4fa6-9ade-e9fcf44fcb58 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 200 len: 1402 microversion: 2.1 time: 0.277199 Jul 31 01:08:55.048876 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 393/790] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:54 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 1402 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:08:55.082357 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-08a37aa9-cf3d-406b-a755-7959d04712da tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:55.091667 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-08a37aa9-cf3d-406b-a755-7959d04712da tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 200 len: 1319 microversion: 2.1 time: 0.352978 Jul 31 01:08:55.092730 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 398/791] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:54 2022] GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:55.165741 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a20e3554-dd27-4caa-a0fd-6d37f7e23e89 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:55.166918 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a20e3554-dd27-4caa-a0fd-6d37f7e23e89 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:55.180110 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a20e3554-dd27-4caa-a0fd-6d37f7e23e89 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:55.180927 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a20e3554-dd27-4caa-a0fd-6d37f7e23e89 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:55.182343 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a20e3554-dd27-4caa-a0fd-6d37f7e23e89 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:55.183111 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a20e3554-dd27-4caa-a0fd-6d37f7e23e89 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:55.194231 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:55.195811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-93bb0c28-2e91-4fb1-94a0-48c2e193ce94 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:55.196685 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-93bb0c28-2e91-4fb1-94a0-48c2e193ce94 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:55.204093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-93bb0c28-2e91-4fb1-94a0-48c2e193ce94 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:55.204636 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-93bb0c28-2e91-4fb1-94a0-48c2e193ce94 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:55.205626 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-93bb0c28-2e91-4fb1-94a0-48c2e193ce94 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:55.206047 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-93bb0c28-2e91-4fb1-94a0-48c2e193ce94 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:55.631619 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-93bb0c28-2e91-4fb1-94a0-48c2e193ce94 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:55.653377 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-93bb0c28-2e91-4fb1-94a0-48c2e193ce94 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa" status: 200 len: 1322 microversion: 2.1 time: 0.462121 Jul 31 01:08:55.667092 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 399/792] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:55 2022] GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa => generated 1322 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:08:55.735021 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a20e3554-dd27-4caa-a0fd-6d37f7e23e89 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:55.747722 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a20e3554-dd27-4caa-a0fd-6d37f7e23e89 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1503 microversion: 2.1 time: 0.588910 Jul 31 01:08:55.748892 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 394/793] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:55 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1503 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:56.065926 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c8f8a1da-9400-4d45-a5df-63d5c0ddcba7 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:56.066753 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c8f8a1da-9400-4d45-a5df-63d5c0ddcba7 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:56.080310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8f8a1da-9400-4d45-a5df-63d5c0ddcba7 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:56.080873 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8f8a1da-9400-4d45-a5df-63d5c0ddcba7 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:56.083055 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8f8a1da-9400-4d45-a5df-63d5c0ddcba7 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:56.083639 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8f8a1da-9400-4d45-a5df-63d5c0ddcba7 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:56.115924 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aa64a7ee-34e8-4873-9caf-0b7924b8a57a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:56.116825 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aa64a7ee-34e8-4873-9caf-0b7924b8a57a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:56.122740 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:56.130913 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa64a7ee-34e8-4873-9caf-0b7924b8a57a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:56.131889 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa64a7ee-34e8-4873-9caf-0b7924b8a57a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:56.133430 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa64a7ee-34e8-4873-9caf-0b7924b8a57a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:56.134159 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa64a7ee-34e8-4873-9caf-0b7924b8a57a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:56.529888 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c8f8a1da-9400-4d45-a5df-63d5c0ddcba7 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:56.548797 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-aa64a7ee-34e8-4873-9caf-0b7924b8a57a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:56.552143 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c8f8a1da-9400-4d45-a5df-63d5c0ddcba7 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 200 len: 1589 microversion: 2.1 time: 0.485644 Jul 31 01:08:56.562846 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aa64a7ee-34e8-4873-9caf-0b7924b8a57a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 200 len: 1319 microversion: 2.1 time: 0.453736 Jul 31 01:08:56.579483 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 395/794] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:56 2022] GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 1319 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:56.587622 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aef21645-da48-41b0-8660-d04b4fe23e9a tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Calling method '.version_select at 0x7fede58d7550>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:56.595421 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 400/795] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:56 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 1589 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:56.618807 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2bb4cef1-6daa-4af5-b535-d9077494a53c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:56.619695 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aef21645-da48-41b0-8660-d04b4fe23e9a tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:56.620463 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aef21645-da48-41b0-8660-d04b4fe23e9a tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:56.633054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2bb4cef1-6daa-4af5-b535-d9077494a53c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:56.646871 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aef21645-da48-41b0-8660-d04b4fe23e9a tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.065885 Jul 31 01:08:56.651016 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bb4cef1-6daa-4af5-b535-d9077494a53c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:56.651864 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bb4cef1-6daa-4af5-b535-d9077494a53c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:56.652960 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bb4cef1-6daa-4af5-b535-d9077494a53c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:56.653659 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bb4cef1-6daa-4af5-b535-d9077494a53c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:56.672370 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 396/796] 10.222.0.45 () {58 vars in 1143 bytes} [Sun Jul 31 01:08:56 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:56.677700 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ce634d12-b527-4794-b5cc-678d355dc563 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:56.678690 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ce634d12-b527-4794-b5cc-678d355dc563 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:56.690079 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce634d12-b527-4794-b5cc-678d355dc563 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:56.693116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce634d12-b527-4794-b5cc-678d355dc563 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:56.694683 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce634d12-b527-4794-b5cc-678d355dc563 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:56.696299 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce634d12-b527-4794-b5cc-678d355dc563 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:56.858802 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2bb4cef1-6daa-4af5-b535-d9077494a53c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.254126 Jul 31 01:08:56.860552 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 401/797] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:08:56 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64/os-interface => generated 284 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:56.865925 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c8af034c-c625-4374-a286-187a987b5aa6 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:56.882322 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c8af034c-c625-4374-a286-187a987b5aa6 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020202 Jul 31 01:08:56.883971 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 402/798] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:08:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:56.896212 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7ca1ac48-c72d-4e89-be45-9822e0082e87 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:56.899331 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7ca1ac48-c72d-4e89-be45-9822e0082e87 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:56.908870 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ca1ac48-c72d-4e89-be45-9822e0082e87 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:56.909817 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ca1ac48-c72d-4e89-be45-9822e0082e87 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:56.910982 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ca1ac48-c72d-4e89-be45-9822e0082e87 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:56.911781 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ca1ac48-c72d-4e89-be45-9822e0082e87 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:57.394385 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ce634d12-b527-4794-b5cc-678d355dc563 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:57.414760 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ce634d12-b527-4794-b5cc-678d355dc563 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa" status: 200 len: 1322 microversion: 2.1 time: 0.740769 Jul 31 01:08:57.416050 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 397/799] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:56 2022] GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa => generated 1322 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:57.439402 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-126e46e0-fe0b-484d-b00e-0ae5568656ce tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1632894205", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:57.454342 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:08:57.454342 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:08:57.490465 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-126e46e0-fe0b-484d-b00e-0ae5568656ce tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.059547 Jul 31 01:08:57.503392 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 398/800] 10.222.0.45 () {60 vars in 1146 bytes} [Sun Jul 31 01:08:57 2022] POST /compute/v2.1/flavors => generated 499 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:57.509817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-8cc18886-98fc-41e4-adbb-5d0335bea707 req-5d2b0fc3-58ec-4109-9ada-8739d3a91e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f37a0b-3c88-4abf-a832-d7e0230276aa", "name": "network-vif-plugged", "status": "completed", "tag": "8d10cd1f-c6a6-47b6-9490-4951f6a0ea77"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:57.521125 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8cc18886-98fc-41e4-adbb-5d0335bea707 req-5d2b0fc3-58ec-4109-9ada-8739d3a91e63 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:57.521572 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8cc18886-98fc-41e4-adbb-5d0335bea707 req-5d2b0fc3-58ec-4109-9ada-8739d3a91e63 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:57.535287 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-8cc18886-98fc-41e4-adbb-5d0335bea707 req-5d2b0fc3-58ec-4109-9ada-8739d3a91e63 service nova] Creating event network-vif-plugged:8d10cd1f-c6a6-47b6-9490-4951f6a0ea77 for instance a1f37a0b-3c88-4abf-a832-d7e0230276aa on n-h1-master-1 Jul 31 01:08:57.541667 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-8cc18886-98fc-41e4-adbb-5d0335bea707 req-5d2b0fc3-58ec-4109-9ada-8739d3a91e63 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040930 Jul 31 01:08:57.542897 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 399/801] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:57.548772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ac376e71-fa28-4200-95ca-ebe143f925fb tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:57.569794 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ac376e71-fa28-4200-95ca-ebe143f925fb tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025381 Jul 31 01:08:57.571072 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 400/802] 10.222.0.45 () {58 vars in 1182 bytes} [Sun Jul 31 01:08:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:08:57.586075 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-519ebcb4-e7b8-4877-8953-b2f631c75a93 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:57.587295 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-519ebcb4-e7b8-4877-8953-b2f631c75a93 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:57.603052 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-519ebcb4-e7b8-4877-8953-b2f631c75a93 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:57.604727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-519ebcb4-e7b8-4877-8953-b2f631c75a93 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:57.605812 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-519ebcb4-e7b8-4877-8953-b2f631c75a93 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:57.607267 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-519ebcb4-e7b8-4877-8953-b2f631c75a93 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:58.053342 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7ca1ac48-c72d-4e89-be45-9822e0082e87 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:58.074319 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7ca1ac48-c72d-4e89-be45-9822e0082e87 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1503 microversion: 2.1 time: 1.188318 Jul 31 01:08:58.079914 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 403/803] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:56 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1503 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:58.107388 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-0c6786ae-4ecd-461a-9812-b1baac393e99 req-176c25c0-6050-43cc-a913-c39e4f9d4880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aafa66e0-8207-4875-947e-48fe17082af0", "name": "network-vif-unplugged", "status": "completed", "tag": "81c9c6b7-7555-43c6-a140-9176296ddace"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:58.165525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0c6786ae-4ecd-461a-9812-b1baac393e99 req-176c25c0-6050-43cc-a913-c39e4f9d4880 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:58.166392 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0c6786ae-4ecd-461a-9812-b1baac393e99 req-176c25c0-6050-43cc-a913-c39e4f9d4880 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:58.204747 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-0c6786ae-4ecd-461a-9812-b1baac393e99 req-176c25c0-6050-43cc-a913-c39e4f9d4880 service nova] Creating event network-vif-unplugged:81c9c6b7-7555-43c6-a140-9176296ddace for instance aafa66e0-8207-4875-947e-48fe17082af0 on n-h1-master-1 Jul 31 01:08:58.212341 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-0c6786ae-4ecd-461a-9812-b1baac393e99 req-176c25c0-6050-43cc-a913-c39e4f9d4880 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129875 Jul 31 01:08:58.213665 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 404/804] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:08:58.218903 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-519ebcb4-e7b8-4877-8953-b2f631c75a93 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:58.220111 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-18ff4c0d-ba6b-45b8-9953-62fbcdce9df2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1967027347", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "cc9c4f28-4a5f-4609-a490-30b8f831043a"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:08:58.234009 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-519ebcb4-e7b8-4877-8953-b2f631c75a93 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 200 len: 1468 microversion: 2.1 time: 0.652216 Jul 31 01:08:58.261533 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 401/805] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:57 2022] GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 1468 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:08:58.293936 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f178ad31-497d-4ed8-bcd6-ede9a39256ed tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:58.295137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f178ad31-497d-4ed8-bcd6-ede9a39256ed tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:58.298927 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-18ff4c0d-ba6b-45b8-9953-62fbcdce9df2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:08:58.313455 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f178ad31-497d-4ed8-bcd6-ede9a39256ed tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:58.315654 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f178ad31-497d-4ed8-bcd6-ede9a39256ed tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:58.318699 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f178ad31-497d-4ed8-bcd6-ede9a39256ed tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:58.319848 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f178ad31-497d-4ed8-bcd6-ede9a39256ed tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:59.663429 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f178ad31-497d-4ed8-bcd6-ede9a39256ed tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:08:59.715683 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f178ad31-497d-4ed8-bcd6-ede9a39256ed tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/1aa29e77-13fc-46d3-9b2b-8f38833f1fa9" status: 200 len: 1469 microversion: 2.1 time: 1.435067 Jul 31 01:08:59.718101 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 402/806] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:58 2022] GET /compute/v2.1/servers/1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 => generated 1469 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:08:59.737126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b4403f35-198a-43fa-9adb-7c5499e82f1f tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:08:59.738572 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b4403f35-198a-43fa-9adb-7c5499e82f1f tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:08:59.762468 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4403f35-198a-43fa-9adb-7c5499e82f1f tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:59.766089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4403f35-198a-43fa-9adb-7c5499e82f1f tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:08:59.769012 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4403f35-198a-43fa-9adb-7c5499e82f1f tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:08:59.770129 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4403f35-198a-43fa-9adb-7c5499e82f1f tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:00.502131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-18ff4c0d-ba6b-45b8-9953-62fbcdce9df2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:09:00.502974 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-18ff4c0d-ba6b-45b8-9953-62fbcdce9df2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:09:00.505872 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-18ff4c0d-ba6b-45b8-9953-62fbcdce9df2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:09:00.506687 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-18ff4c0d-ba6b-45b8-9953-62fbcdce9df2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:09:00.508680 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-18ff4c0d-ba6b-45b8-9953-62fbcdce9df2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:09:00.526578 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=37 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:00.538969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18ff4c0d-ba6b-45b8-9953-62fbcdce9df2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:00.539937 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18ff4c0d-ba6b-45b8-9953-62fbcdce9df2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:00.542796 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18ff4c0d-ba6b-45b8-9953-62fbcdce9df2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:00.543509 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18ff4c0d-ba6b-45b8-9953-62fbcdce9df2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:00.604222 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b4403f35-198a-43fa-9adb-7c5499e82f1f tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:00.604529 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-18ff4c0d-ba6b-45b8-9953-62fbcdce9df2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Getting quotas for project 87496179e992473c991977e0e517460a. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:00.612917 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b4403f35-198a-43fa-9adb-7c5499e82f1f tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa" status: 200 len: 1322 microversion: 2.1 time: 0.892562 Jul 31 01:09:00.613529 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 403/807] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:08:59 2022] GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa => generated 1322 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:00.616807 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-18ff4c0d-ba6b-45b8-9953-62fbcdce9df2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Getting quotas for user 9a2a0f61c8304c9a9ad7af6120e83443 and project 87496179e992473c991977e0e517460a. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:00.631095 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2636e6b0-4643-4d5a-a439-3d241924a3a1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-772692812", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "3c2be060-a5dd-4923-9ec8-26881bd84082"}], "security_groups": [{"name": "tempest-securitygroup--549019769"}], "key_name": "tempest-keypair-1314929671", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:00.663416 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-18ff4c0d-ba6b-45b8-9953-62fbcdce9df2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:09:00.665683 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-18ff4c0d-ba6b-45b8-9953-62fbcdce9df2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:09:00.818261 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-18ff4c0d-ba6b-45b8-9953-62fbcdce9df2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.602283 Jul 31 01:09:00.833094 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 405/808] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:08:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:09:00.843093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-60e4fe02-f6b9-4937-bdb1-744a9e48c9de tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:00.844942 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-60e4fe02-f6b9-4937-bdb1-744a9e48c9de tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:00.853049 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:00.856588 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-60e4fe02-f6b9-4937-bdb1-744a9e48c9de tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:00.857483 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-60e4fe02-f6b9-4937-bdb1-744a9e48c9de tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:00.858777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-60e4fe02-f6b9-4937-bdb1-744a9e48c9de tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:00.860053 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-60e4fe02-f6b9-4937-bdb1-744a9e48c9de tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:01.069203 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-2636e6b0-4643-4d5a-a439-3d241924a3a1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] validate_networks() for [('3c2be060-a5dd-4923-9ec8-26881bd84082', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:09:01.427023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-60e4fe02-f6b9-4937-bdb1-744a9e48c9de tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:01.441449 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-60e4fe02-f6b9-4937-bdb1-744a9e48c9de tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1503 microversion: 2.1 time: 0.604015 Jul 31 01:09:01.442057 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 406/809] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:00 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1503 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:01.463035 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-acfa10cb-86c8-4212-8031-4d96f870bca8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:01.470501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-acfa10cb-86c8-4212-8031-4d96f870bca8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:01.480887 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-acfa10cb-86c8-4212-8031-4d96f870bca8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Searching by: {'reservation_id': 'r-her8dvnb', 'deleted': False, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:09:01.488791 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-acfa10cb-86c8-4212-8031-4d96f870bca8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:01.490678 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-acfa10cb-86c8-4212-8031-4d96f870bca8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:01.492423 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-acfa10cb-86c8-4212-8031-4d96f870bca8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:01.493186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-acfa10cb-86c8-4212-8031-4d96f870bca8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:01.680266 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.multi_cell_list [None req-acfa10cb-86c8-4212-8031-4d96f870bca8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119475) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:09:01.804725 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-acfa10cb-86c8-4212-8031-4d96f870bca8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:01.815431 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-acfa10cb-86c8-4212-8031-4d96f870bca8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:01.816145 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-acfa10cb-86c8-4212-8031-4d96f870bca8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:02.301249 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=62 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:02.732627 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-acfa10cb-86c8-4212-8031-4d96f870bca8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/detail?reservation_id=r-her8dvnb" status: 200 len: 2930 microversion: 2.1 time: 1.274477 Jul 31 01:09:02.733278 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 407/810] 10.222.0.45 () {58 vars in 1197 bytes} [Sun Jul 31 01:09:01 2022] GET /compute/v2.1/servers/detail?reservation_id=r-her8dvnb => generated 2930 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:02.738323 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-9bd896ea-8860-484d-981f-6804565cea8a req-fe5f0f71-7aab-40e0-8622-0c985ebf4c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aafa66e0-8207-4875-947e-48fe17082af0", "tag": "81c9c6b7-7555-43c6-a140-9176296ddace"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:02.769856 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9bd896ea-8860-484d-981f-6804565cea8a req-fe5f0f71-7aab-40e0-8622-0c985ebf4c1a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:02.770572 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9bd896ea-8860-484d-981f-6804565cea8a req-fe5f0f71-7aab-40e0-8622-0c985ebf4c1a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:02.783074 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-9bd896ea-8860-484d-981f-6804565cea8a req-fe5f0f71-7aab-40e0-8622-0c985ebf4c1a service nova] Creating event network-changed:81c9c6b7-7555-43c6-a140-9176296ddace for instance aafa66e0-8207-4875-947e-48fe17082af0 on n-h1-master-1 Jul 31 01:09:02.789521 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-9bd896ea-8860-484d-981f-6804565cea8a req-fe5f0f71-7aab-40e0-8622-0c985ebf4c1a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054174 Jul 31 01:09:02.790694 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 408/811] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:02.797697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-afebe7b5-3a21-47c6-ab56-77b6979e4d18 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:02.798800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-afebe7b5-3a21-47c6-ab56-77b6979e4d18 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:02.806415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-afebe7b5-3a21-47c6-ab56-77b6979e4d18 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:02.807302 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-afebe7b5-3a21-47c6-ab56-77b6979e4d18 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:02.808767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-afebe7b5-3a21-47c6-ab56-77b6979e4d18 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:02.809503 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-afebe7b5-3a21-47c6-ab56-77b6979e4d18 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:03.021411 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-afebe7b5-3a21-47c6-ab56-77b6979e4d18 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:03.034890 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-afebe7b5-3a21-47c6-ab56-77b6979e4d18 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1331 microversion: 2.1 time: 0.242366 Jul 31 01:09:03.052611 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 409/812] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:02 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1331 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:03.059624 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7b151d33-bdf0-4b8a-9e8d-e9a3c9a99ecf tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:03.062904 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7b151d33-bdf0-4b8a-9e8d-e9a3c9a99ecf tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:03.073179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b151d33-bdf0-4b8a-9e8d-e9a3c9a99ecf tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:03.074056 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b151d33-bdf0-4b8a-9e8d-e9a3c9a99ecf tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:03.075010 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b151d33-bdf0-4b8a-9e8d-e9a3c9a99ecf tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:03.075652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b151d33-bdf0-4b8a-9e8d-e9a3c9a99ecf tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:03.114689 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:03.361888 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-2636e6b0-4643-4d5a-a439-3d241924a3a1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:09:03.362980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-2636e6b0-4643-4d5a-a439-3d241924a3a1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:09:03.363700 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-2636e6b0-4643-4d5a-a439-3d241924a3a1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:09:03.364311 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-2636e6b0-4643-4d5a-a439-3d241924a3a1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:09:03.365130 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-2636e6b0-4643-4d5a-a439-3d241924a3a1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:09:03.382949 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2636e6b0-4643-4d5a-a439-3d241924a3a1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:03.385612 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2636e6b0-4643-4d5a-a439-3d241924a3a1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:03.389365 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2636e6b0-4643-4d5a-a439-3d241924a3a1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:03.393844 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2636e6b0-4643-4d5a-a439-3d241924a3a1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:03.438213 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-2636e6b0-4643-4d5a-a439-3d241924a3a1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Getting quotas for project 5881381d95ec452eb516c0c7ad826a08. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:03.453778 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-2636e6b0-4643-4d5a-a439-3d241924a3a1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Getting quotas for user cd6eb7e316f54ff386eaa598df805de9 and project 5881381d95ec452eb516c0c7ad826a08. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:03.487504 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2636e6b0-4643-4d5a-a439-3d241924a3a1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:09:03.490184 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2636e6b0-4643-4d5a-a439-3d241924a3a1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:09:03.595389 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2636e6b0-4643-4d5a-a439-3d241924a3a1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 2.974318 Jul 31 01:09:03.598734 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 404/813] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:09:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 2981 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 01:09:03.610498 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f68e0fa9-718e-4533-85a3-f92d701acc0f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:03.613640 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f68e0fa9-718e-4533-85a3-f92d701acc0f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:03.633820 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f68e0fa9-718e-4533-85a3-f92d701acc0f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:03.634539 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f68e0fa9-718e-4533-85a3-f92d701acc0f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:03.635378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f68e0fa9-718e-4533-85a3-f92d701acc0f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:03.635831 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f68e0fa9-718e-4533-85a3-f92d701acc0f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:03.878184 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7b151d33-bdf0-4b8a-9e8d-e9a3c9a99ecf tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:03.896332 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7b151d33-bdf0-4b8a-9e8d-e9a3c9a99ecf tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa" status: 200 len: 1471 microversion: 2.1 time: 0.841297 Jul 31 01:09:03.897267 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 410/814] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:03 2022] GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa => generated 1471 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:03.915006 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6a4de016-db0f-4ad8-abc7-3049905b3c3f tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:03.920197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6a4de016-db0f-4ad8-abc7-3049905b3c3f tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:03.953977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a4de016-db0f-4ad8-abc7-3049905b3c3f tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:03.954818 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a4de016-db0f-4ad8-abc7-3049905b3c3f tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:03.959005 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a4de016-db0f-4ad8-abc7-3049905b3c3f tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:03.960311 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a4de016-db0f-4ad8-abc7-3049905b3c3f tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:04.358529 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f68e0fa9-718e-4533-85a3-f92d701acc0f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:04.387977 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f68e0fa9-718e-4533-85a3-f92d701acc0f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1503 microversion: 2.1 time: 0.785680 Jul 31 01:09:04.415120 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 405/815] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:03 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1503 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:04.446075 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-97891272-5218-412f-b912-a27c85b11403 req-a4950836-4944-40c9-8abe-437a0f43208a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "899b694f-3e79-4d06-8dc4-2dedec20fc64", "tag": "97974ade-06ae-421e-b9a4-299f02c8d56b"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:04.474561 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-97891272-5218-412f-b912-a27c85b11403 req-a4950836-4944-40c9-8abe-437a0f43208a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:04.475992 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-97891272-5218-412f-b912-a27c85b11403 req-a4950836-4944-40c9-8abe-437a0f43208a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:04.513233 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-97891272-5218-412f-b912-a27c85b11403 req-a4950836-4944-40c9-8abe-437a0f43208a service nova] Creating event network-changed:97974ade-06ae-421e-b9a4-299f02c8d56b for instance 899b694f-3e79-4d06-8dc4-2dedec20fc64 on n-h1-master-1 Jul 31 01:09:04.534022 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-97891272-5218-412f-b912-a27c85b11403 req-a4950836-4944-40c9-8abe-437a0f43208a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116202 Jul 31 01:09:04.540473 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 406/816] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:04.568039 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-61651abd-960c-496a-8f28-90340ec0070f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:04.598971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.compute.server_groups [None req-61651abd-960c-496a-8f28-90340ec0070f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Querying cell b79bbab3-22fe-4aca-b591-999750c84479(cell1) for 2 instances {{(pid=119474) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 31 01:09:04.601187 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61651abd-960c-496a-8f28-90340ec0070f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:04.601368 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61651abd-960c-496a-8f28-90340ec0070f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:04.667894 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-61651abd-960c-496a-8f28-90340ec0070f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups/8bea6e9f-64e7-4c71-8a12-631589460836" status: 200 len: 265 microversion: 2.1 time: 0.123202 Jul 31 01:09:04.669645 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 407/817] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:09:04 2022] GET /compute/v2.1/os-server-groups/8bea6e9f-64e7-4c71-8a12-631589460836 => generated 265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:04.681663 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1d6117bc-bc9d-47f1-abad-3adac7ebcbbe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:04.684163 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1d6117bc-bc9d-47f1-abad-3adac7ebcbbe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:04.699145 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d6117bc-bc9d-47f1-abad-3adac7ebcbbe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:04.701403 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d6117bc-bc9d-47f1-abad-3adac7ebcbbe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:04.705671 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d6117bc-bc9d-47f1-abad-3adac7ebcbbe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:04.708174 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d6117bc-bc9d-47f1-abad-3adac7ebcbbe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:05.055651 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1d6117bc-bc9d-47f1-abad-3adac7ebcbbe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:05.083981 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1d6117bc-bc9d-47f1-abad-3adac7ebcbbe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:05.087650 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1d6117bc-bc9d-47f1-abad-3adac7ebcbbe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:05.091712 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1d6117bc-bc9d-47f1-abad-3adac7ebcbbe tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1289 microversion: 2.25 time: 0.419296 Jul 31 01:09:05.110163 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 408/818] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:09:04 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1289 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:09:05.119145 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aad31efe-7ccf-4f04-b8f1-994e28d3b160 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:05.119145 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aad31efe-7ccf-4f04-b8f1-994e28d3b160 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:05.139402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aad31efe-7ccf-4f04-b8f1-994e28d3b160 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:05.139964 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aad31efe-7ccf-4f04-b8f1-994e28d3b160 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:05.140814 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aad31efe-7ccf-4f04-b8f1-994e28d3b160 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:05.141255 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aad31efe-7ccf-4f04-b8f1-994e28d3b160 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:05.194342 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-aad31efe-7ccf-4f04-b8f1-994e28d3b160 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lazy-loading 'flavor' on Instance uuid a1f37a0b-3c88-4abf-a832-d7e0230276aa {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:09:05.392503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6a4de016-db0f-4ad8-abc7-3049905b3c3f tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:05.407580 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6a4de016-db0f-4ad8-abc7-3049905b3c3f tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 200 len: 1589 microversion: 2.1 time: 1.509116 Jul 31 01:09:05.414096 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aad31efe-7ccf-4f04-b8f1-994e28d3b160 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa/action" status: 202 len: 0 microversion: 2.1 time: 0.301358 Jul 31 01:09:05.415806 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 411/819] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:03 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 1589 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:05.417627 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 409/820] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:09:05 2022] POST /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:09:05.429575 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6b4720f4-14f6-41af-8b2e-aaafd9e557b6 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:05.430798 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6b4720f4-14f6-41af-8b2e-aaafd9e557b6 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:05.432291 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0f9f47ef-cf96-4e0d-adeb-82c5f38cbf17 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:05.432943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0f9f47ef-cf96-4e0d-adeb-82c5f38cbf17 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:05.441694 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b4720f4-14f6-41af-8b2e-aaafd9e557b6 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:05.442606 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b4720f4-14f6-41af-8b2e-aaafd9e557b6 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:05.443974 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b4720f4-14f6-41af-8b2e-aaafd9e557b6 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:05.444651 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b4720f4-14f6-41af-8b2e-aaafd9e557b6 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:05.453985 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f9f47ef-cf96-4e0d-adeb-82c5f38cbf17 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:05.454458 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f9f47ef-cf96-4e0d-adeb-82c5f38cbf17 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:05.455305 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f9f47ef-cf96-4e0d-adeb-82c5f38cbf17 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:05.455799 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f9f47ef-cf96-4e0d-adeb-82c5f38cbf17 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:05.670955 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0f9f47ef-cf96-4e0d-adeb-82c5f38cbf17 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:05.679075 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0f9f47ef-cf96-4e0d-adeb-82c5f38cbf17 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1337 microversion: 2.1 time: 0.261955 Jul 31 01:09:05.693033 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 412/821] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:05 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1337 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:05.708497 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7fab6145-0934-4c24-9ff2-0f28e03d66d7 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:05.709141 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7fab6145-0934-4c24-9ff2-0f28e03d66d7 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:05.716331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fab6145-0934-4c24-9ff2-0f28e03d66d7 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:05.717056 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fab6145-0934-4c24-9ff2-0f28e03d66d7 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:05.718172 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fab6145-0934-4c24-9ff2-0f28e03d66d7 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:05.719445 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fab6145-0934-4c24-9ff2-0f28e03d66d7 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:05.982234 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6b4720f4-14f6-41af-8b2e-aaafd9e557b6 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 200 len: 1619 microversion: 2.1 time: 0.563027 Jul 31 01:09:05.982987 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 410/822] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:05 2022] GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 1619 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:06.008641 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8132853d-8ec9-4e10-bf73-67b9bf061e33 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:06.009672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8132853d-8ec9-4e10-bf73-67b9bf061e33 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:06.027573 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8132853d-8ec9-4e10-bf73-67b9bf061e33 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:06.031077 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8132853d-8ec9-4e10-bf73-67b9bf061e33 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:06.032947 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8132853d-8ec9-4e10-bf73-67b9bf061e33 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:06.034936 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8132853d-8ec9-4e10-bf73-67b9bf061e33 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:06.921276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8132853d-8ec9-4e10-bf73-67b9bf061e33 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:06.938961 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8132853d-8ec9-4e10-bf73-67b9bf061e33 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1503 microversion: 2.1 time: 0.944402 Jul 31 01:09:06.939989 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 411/823] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:05 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1503 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:06.958530 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a919fa55-9e35-41db-bcdf-ec85ce125046 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:06.959469 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a919fa55-9e35-41db-bcdf-ec85ce125046 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] [instance: 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:06.967288 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a919fa55-9e35-41db-bcdf-ec85ce125046 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:06.968031 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a919fa55-9e35-41db-bcdf-ec85ce125046 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:06.970154 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a919fa55-9e35-41db-bcdf-ec85ce125046 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:06.971130 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a919fa55-9e35-41db-bcdf-ec85ce125046 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:07.791139 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7fab6145-0934-4c24-9ff2-0f28e03d66d7 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa" status: 200 len: 1630 microversion: 2.1 time: 2.096255 Jul 31 01:09:07.818965 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 413/824] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:05 2022] GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa => generated 1630 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:07.836438 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fdc2b9fa-49df-4036-b510-d48cbe9e2521 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:07.837844 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fdc2b9fa-49df-4036-b510-d48cbe9e2521 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:07.851682 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fdc2b9fa-49df-4036-b510-d48cbe9e2521 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:07.852602 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fdc2b9fa-49df-4036-b510-d48cbe9e2521 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:07.853919 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fdc2b9fa-49df-4036-b510-d48cbe9e2521 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:07.854614 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fdc2b9fa-49df-4036-b510-d48cbe9e2521 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:08.007042 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a919fa55-9e35-41db-bcdf-ec85ce125046 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/1aa29e77-13fc-46d3-9b2b-8f38833f1fa9" status: 200 len: 1620 microversion: 2.1 time: 1.047469 Jul 31 01:09:08.009370 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 412/825] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:06 2022] GET /compute/v2.1/servers/1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 => generated 1620 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:08.061644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ad5e8bba-b865-494c-8e22-316f6c7040c9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:08.062598 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ad5e8bba-b865-494c-8e22-316f6c7040c9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:08.075048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fdc2b9fa-49df-4036-b510-d48cbe9e2521 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:08.090234 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad5e8bba-b865-494c-8e22-316f6c7040c9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:08.091320 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad5e8bba-b865-494c-8e22-316f6c7040c9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:08.092954 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad5e8bba-b865-494c-8e22-316f6c7040c9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:08.093421 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad5e8bba-b865-494c-8e22-316f6c7040c9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:08.094289 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fdc2b9fa-49df-4036-b510-d48cbe9e2521 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:08.097394 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fdc2b9fa-49df-4036-b510-d48cbe9e2521 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:08.104657 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fdc2b9fa-49df-4036-b510-d48cbe9e2521 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1343 microversion: 2.25 time: 0.281020 Jul 31 01:09:08.108306 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 414/826] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:09:07 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1343 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:09:08.116571 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6466f09e-9dcb-41ad-a5b7-52822c2a521f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:08.119954 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6466f09e-9dcb-41ad-a5b7-52822c2a521f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:08.138753 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6466f09e-9dcb-41ad-a5b7-52822c2a521f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:08.139739 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6466f09e-9dcb-41ad-a5b7-52822c2a521f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:08.142906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6466f09e-9dcb-41ad-a5b7-52822c2a521f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:08.143895 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6466f09e-9dcb-41ad-a5b7-52822c2a521f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:08.772356 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ad5e8bba-b865-494c-8e22-316f6c7040c9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:08.784806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6466f09e-9dcb-41ad-a5b7-52822c2a521f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:08.793211 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ad5e8bba-b865-494c-8e22-316f6c7040c9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1379 microversion: 2.1 time: 0.780792 Jul 31 01:09:08.793823 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 413/827] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:08 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1379 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:08.799244 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9bfb502e-5d5a-43fd-8c61-0f0c0b6da15f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Action: 'create', calling method: .version_select at 0x7fede58ec9d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1206356218", "policies": ["anti-affinity"]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:08.801783 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6466f09e-9dcb-41ad-a5b7-52822c2a521f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1503 microversion: 2.1 time: 0.692140 Jul 31 01:09:08.816183 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 415/828] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:08 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1503 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:08.829666 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-5ce42c64-c482-44e5-ae3a-1ff9a661d812 req-f8aaeb75-8829-499e-b885-3d5e1dca43fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228dc464-015e-46f4-bec0-9f81a1dc15d2", "tag": "9a86b1f7-6a8e-4f86-8208-6993e348a723"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:08.861079 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5ce42c64-c482-44e5-ae3a-1ff9a661d812 req-f8aaeb75-8829-499e-b885-3d5e1dca43fc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:08.861517 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5ce42c64-c482-44e5-ae3a-1ff9a661d812 req-f8aaeb75-8829-499e-b885-3d5e1dca43fc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:08.884492 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-5ce42c64-c482-44e5-ae3a-1ff9a661d812 req-f8aaeb75-8829-499e-b885-3d5e1dca43fc service nova] Creating event network-changed:9a86b1f7-6a8e-4f86-8208-6993e348a723 for instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 on n-h2-master-1 Jul 31 01:09:08.885101 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9bfb502e-5d5a-43fd-8c61-0f0c0b6da15f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:08.892260 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-5ce42c64-c482-44e5-ae3a-1ff9a661d812 req-f8aaeb75-8829-499e-b885-3d5e1dca43fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074621 Jul 31 01:09:08.892872 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 416/829] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:08.896283 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9bfb502e-5d5a-43fd-8c61-0f0c0b6da15f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:08.903712 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1c36aa61-a48b-4a20-8fad-6d1a1089b3b2 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:08.904462 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1c36aa61-a48b-4a20-8fad-6d1a1089b3b2 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:08.923913 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c36aa61-a48b-4a20-8fad-6d1a1089b3b2 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:08.924393 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c36aa61-a48b-4a20-8fad-6d1a1089b3b2 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:08.925208 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c36aa61-a48b-4a20-8fad-6d1a1089b3b2 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:08.925663 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c36aa61-a48b-4a20-8fad-6d1a1089b3b2 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:09.038500 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9bfb502e-5d5a-43fd-8c61-0f0c0b6da15f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:09.057337 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9bfb502e-5d5a-43fd-8c61-0f0c0b6da15f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:09.091158 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9bfb502e-5d5a-43fd-8c61-0f0c0b6da15f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.296028 Jul 31 01:09:09.092214 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 414/830] 10.222.0.45 () {60 vars in 1174 bytes} [Sun Jul 31 01:09:08 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:09.157463 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-830e53bb-b0dc-4463-9519-7f6ba261ba07 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:09.158160 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-830e53bb-b0dc-4463-9519-7f6ba261ba07 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:09.176743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-830e53bb-b0dc-4463-9519-7f6ba261ba07 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:09.177239 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-830e53bb-b0dc-4463-9519-7f6ba261ba07 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:09.180014 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-830e53bb-b0dc-4463-9519-7f6ba261ba07 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:09.180560 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-830e53bb-b0dc-4463-9519-7f6ba261ba07 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:09.195024 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:09.385634 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-830e53bb-b0dc-4463-9519-7f6ba261ba07 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:09.403766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-830e53bb-b0dc-4463-9519-7f6ba261ba07 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:09.409452 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-830e53bb-b0dc-4463-9519-7f6ba261ba07 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:09.411498 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-830e53bb-b0dc-4463-9519-7f6ba261ba07 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1343 microversion: 2.25 time: 0.261454 Jul 31 01:09:09.427438 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 415/831] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:09:09 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1343 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:09:09.447684 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1993245110", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "7ddb39b3-d430-4b24-9798-46b98528ce49"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:09.451536 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1c36aa61-a48b-4a20-8fad-6d1a1089b3b2 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa" status: 200 len: 1613 microversion: 2.1 time: 0.551453 Jul 31 01:09:09.461239 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 417/832] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:08 2022] GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa => generated 1613 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:09.486940 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f9e13cc3-1d0e-4d61-80e6-dd4618fe6503 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:09.489238 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f9e13cc3-1d0e-4d61-80e6-dd4618fe6503 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:09.500710 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9e13cc3-1d0e-4d61-80e6-dd4618fe6503 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:09.502497 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9e13cc3-1d0e-4d61-80e6-dd4618fe6503 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:09.504633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9e13cc3-1d0e-4d61-80e6-dd4618fe6503 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:09.505251 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9e13cc3-1d0e-4d61-80e6-dd4618fe6503 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:09.600928 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-f9e13cc3-1d0e-4d61-80e6-dd4618fe6503 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] HTTP exception thrown: Cannot 'migrate' instance a1f37a0b-3c88-4abf-a832-d7e0230276aa while it is in vm_state suspended Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f9e13cc3-1d0e-4d61-80e6-dd4618fe6503 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Request method failure captured: Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa/action HTTP/1.1 Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 15 Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dX-GRvZdwWUVnCrAfLHpVH9uyj9kMqQ6DKJmmJTATSIUZ9PPd5VUrhHMqXstrUNj0P182JtAKKx0IG24mURZF315gfCef3mHWXnxMf9oUmA0Bq818GvAKE_4ycoYXyD6SDDcOwyjYLBjpCM8f90I0joAvx-HdaedlhPkSoPpDv5mx8 Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: acdf8ed0cf8b4c5db6ccf0ee53dc1290 Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1903736053 Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:09:09.603067 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:09:09.604694 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/acdf8ed0cf8b4c5db6ccf0ee53dc1290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/acdf8ed0cf8b4c5db6ccf0ee53dc1290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/acdf8ed0cf8b4c5db6ccf0ee53dc1290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_acdf8ed0cf8b4c5db6ccf0ee53dc1290", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:09:09.604694 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1903736053 Jul 31 01:09:09.604694 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: acdf8ed0cf8b4c5db6ccf0ee53dc1290 Jul 31 01:09:09.604694 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1903736053 Jul 31 01:09:09.604694 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersAdminNegativeTestJSON-1903736053-project-admin Jul 31 01:09:09.604694 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:09:09.604694 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:09:09.604694 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 4d64cb480dc24b6a8d2b9ef67866f2a2 Jul 31 01:09:09.604694 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1903736053-project-admin Jul 31 01:09:09.604694 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:09:09.604694 n-d-master-1 devstack@n-api.service[119475]: {"migrate": {}} Jul 31 01:09:09.604694 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:09:09.604694 n-d-master-1 devstack@n-api.service[119475]: exception: Cannot 'migrate' instance a1f37a0b-3c88-4abf-a832-d7e0230276aa while it is in vm_state suspended Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'a1f37a0b-3c88-4abf-a832-d7e0230276aa', 'body': {'migrate': {}}} Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a1f37a0b-3c88-4abf-a832-d7e0230276aa in vm_state suspended. Cannot resize while the instance is in this state. Jul 31 01:09:09.606317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance a1f37a0b-3c88-4abf-a832-d7e0230276aa while it is in vm_state suspended Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.607983 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:09.610100 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:09.610100 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:09.610100 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:09:09.610100 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:09:09.610100 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance a1f37a0b-3c88-4abf-a832-d7e0230276aa while it is in vm_state suspended Jul 31 01:09:09.610100 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.612559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f9e13cc3-1d0e-4d61-80e6-dd4618fe6503 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Returning 409 to user: Cannot 'migrate' instance a1f37a0b-3c88-4abf-a832-d7e0230276aa while it is in vm_state suspended {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:09:09.613712 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f9e13cc3-1d0e-4d61-80e6-dd4618fe6503 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa/action" status: 409 len: 148 microversion: 2.1 time: 0.134972 Jul 31 01:09:09.615011 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 418/833] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:09:09 2022] POST /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa/action => generated 148 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:09:09.634800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2c977bc1-e079-481e-9117-3de48b9a0051 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2c977bc1-e079-481e-9117-3de48b9a0051 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Request method failure captured: Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073/action HTTP/1.1 Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 39 Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dX-GRvZdwWUVnCrAfLHpVH9uyj9kMqQ6DKJmmJTATSIUZ9PPd5VUrhHMqXstrUNj0P182JtAKKx0IG24mURZF315gfCef3mHWXnxMf9oUmA0Bq818GvAKE_4ycoYXyD6SDDcOwyjYLBjpCM8f90I0joAvx-HdaedlhPkSoPpDv5mx8 Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: acdf8ed0cf8b4c5db6ccf0ee53dc1290 Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1903736053 Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:09:09.640844 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:09:09.642341 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/acdf8ed0cf8b4c5db6ccf0ee53dc1290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/acdf8ed0cf8b4c5db6ccf0ee53dc1290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/acdf8ed0cf8b4c5db6ccf0ee53dc1290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_acdf8ed0cf8b4c5db6ccf0ee53dc1290", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:09:09.642341 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1903736053 Jul 31 01:09:09.642341 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: acdf8ed0cf8b4c5db6ccf0ee53dc1290 Jul 31 01:09:09.642341 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1903736053 Jul 31 01:09:09.642341 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersAdminNegativeTestJSON-1903736053-project-admin Jul 31 01:09:09.642341 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:09:09.642341 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:09:09.642341 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 4d64cb480dc24b6a8d2b9ef67866f2a2 Jul 31 01:09:09.642341 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1903736053-project-admin Jul 31 01:09:09.642341 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:09:09.642341 n-d-master-1 devstack@n-api.service[119475]: {"os-resetState": {"state": "invalid"}} Jul 31 01:09:09.642341 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '377d997f-f860-480f-b712-6be34358d073', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'invalid' Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:09.643389 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:09:09.646176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 31 01:09:09.647670 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.649614 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2c977bc1-e079-481e-9117-3de48b9a0051 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:09:09.651414 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2c977bc1-e079-481e-9117-3de48b9a0051 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073/action" status: 400 len: 144 microversion: 2.1 time: 0.028708 Jul 31 01:09:09.653503 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 419/834] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:09:09 2022] POST /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073/action => generated 144 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:09:09.666177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] validate_networks() for None {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:09:09.670390 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d1974f2f-f73a-4690-8e74-5ff6d6e3c410 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d1974f2f-f73a-4690-8e74-5ff6d6e3c410 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Request method failure captured: Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073/action HTTP/1.1 Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 31 Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dX-GRvZdwWUVnCrAfLHpVH9uyj9kMqQ6DKJmmJTATSIUZ9PPd5VUrhHMqXstrUNj0P182JtAKKx0IG24mURZF315gfCef3mHWXnxMf9oUmA0Bq818GvAKE_4ycoYXyD6SDDcOwyjYLBjpCM8f90I0joAvx-HdaedlhPkSoPpDv5mx8 Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: acdf8ed0cf8b4c5db6ccf0ee53dc1290 Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1903736053 Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:09:09.679692 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:09:09.681401 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/acdf8ed0cf8b4c5db6ccf0ee53dc1290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/acdf8ed0cf8b4c5db6ccf0ee53dc1290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/acdf8ed0cf8b4c5db6ccf0ee53dc1290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_acdf8ed0cf8b4c5db6ccf0ee53dc1290", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:09:09.681401 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1903736053 Jul 31 01:09:09.681401 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: acdf8ed0cf8b4c5db6ccf0ee53dc1290 Jul 31 01:09:09.681401 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1903736053 Jul 31 01:09:09.681401 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersAdminNegativeTestJSON-1903736053-project-admin Jul 31 01:09:09.681401 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:09:09.681401 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:09:09.681401 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 4d64cb480dc24b6a8d2b9ef67866f2a2 Jul 31 01:09:09.681401 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1903736053-project-admin Jul 31 01:09:09.681401 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:09:09.681401 n-d-master-1 devstack@n-api.service[119475]: {"os-resetState": {"state": 1}} Jul 31 01:09:09.681401 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:09:09.681401 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '377d997f-f860-480f-b712-6be34358d073', 'body': {'os-resetState': {'state': 1}}} Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 1 Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:09:09.682329 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 31 01:09:09.684061 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.689094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d1974f2f-f73a-4690-8e74-5ff6d6e3c410 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:09:09.690358 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d1974f2f-f73a-4690-8e74-5ff6d6e3c410 tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073/action" status: 400 len: 120 microversion: 2.1 time: 0.028967 Jul 31 01:09:09.692905 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 420/835] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:09:09 2022] POST /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073/action => generated 120 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:09:09.705699 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb60250d-e227-4fe8-80ac-5c5c0e1af4bc tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:09.711645 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fb60250d-e227-4fe8-80ac-5c5c0e1af4bc tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Failed to fetch instance by id 999 {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2928}} Jul 31 01:09:09.712714 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-fb60250d-e227-4fe8-80ac-5c5c0e1af4bc tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb60250d-e227-4fe8-80ac-5c5c0e1af4bc tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Request method failure captured: Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 37 Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dX-GRvZdwWUVnCrAfLHpVH9uyj9kMqQ6DKJmmJTATSIUZ9PPd5VUrhHMqXstrUNj0P182JtAKKx0IG24mURZF315gfCef3mHWXnxMf9oUmA0Bq818GvAKE_4ycoYXyD6SDDcOwyjYLBjpCM8f90I0joAvx-HdaedlhPkSoPpDv5mx8 Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: acdf8ed0cf8b4c5db6ccf0ee53dc1290 Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1903736053 Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:09:09.716472 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:09:09.718298 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/acdf8ed0cf8b4c5db6ccf0ee53dc1290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/acdf8ed0cf8b4c5db6ccf0ee53dc1290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/acdf8ed0cf8b4c5db6ccf0ee53dc1290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_acdf8ed0cf8b4c5db6ccf0ee53dc1290", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:09:09.718298 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1903736053 Jul 31 01:09:09.718298 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: acdf8ed0cf8b4c5db6ccf0ee53dc1290 Jul 31 01:09:09.718298 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1903736053 Jul 31 01:09:09.718298 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersAdminNegativeTestJSON-1903736053-project-admin Jul 31 01:09:09.718298 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:09:09.718298 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:09:09.718298 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 4d64cb480dc24b6a8d2b9ef67866f2a2 Jul 31 01:09:09.718298 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1903736053-project-admin Jul 31 01:09:09.718298 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:09:09.718298 n-d-master-1 devstack@n-api.service[119475]: {"os-resetState": {"state": "error"}} Jul 31 01:09:09.718298 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:09:09.718298 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 999 could not be found. Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:09:09.719810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 31 01:09:09.721318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 31 01:09:09.721318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:09:09.721318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:09:09.721318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 31 01:09:09.721318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.721318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:09.721318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.721318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:09.721318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:09.721318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:09.721318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:09:09.721318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:09:09.721318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 31 01:09:09.721318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:09.722424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb60250d-e227-4fe8-80ac-5c5c0e1af4bc tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:09:09.724097 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fb60250d-e227-4fe8-80ac-5c5c0e1af4bc tempest-ServersAdminNegativeTestJSON-1903736053 tempest-ServersAdminNegativeTestJSON-1903736053-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.022277 Jul 31 01:09:09.733763 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 421/836] 10.222.0.45 () {60 vars in 1179 bytes} [Sun Jul 31 01:09:09 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:09:09.743880 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4d5d9650-a09d-43ba-96f8-ea2d46f77b85 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:09.744768 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4d5d9650-a09d-43ba-96f8-ea2d46f77b85 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:09.758403 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d5d9650-a09d-43ba-96f8-ea2d46f77b85 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:09.759103 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d5d9650-a09d-43ba-96f8-ea2d46f77b85 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:09.761019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d5d9650-a09d-43ba-96f8-ea2d46f77b85 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:09.761776 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d5d9650-a09d-43ba-96f8-ea2d46f77b85 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:09.812141 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4d5d9650-a09d-43ba-96f8-ea2d46f77b85 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:09:10.027284 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4d5d9650-a09d-43ba-96f8-ea2d46f77b85 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa" status: 204 len: 0 microversion: 2.1 time: 0.290980 Jul 31 01:09:10.028495 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 422/837] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:09:09 2022] DELETE /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:09:10.050743 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3149e7bd-0e81-421c-a284-4ed7fd238d40 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:10.051898 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3149e7bd-0e81-421c-a284-4ed7fd238d40 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:10.080652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3149e7bd-0e81-421c-a284-4ed7fd238d40 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:10.081292 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3149e7bd-0e81-421c-a284-4ed7fd238d40 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:10.082416 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3149e7bd-0e81-421c-a284-4ed7fd238d40 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:10.082950 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3149e7bd-0e81-421c-a284-4ed7fd238d40 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:10.629341 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:09:10.630398 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:09:10.631051 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:09:10.631669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:09:10.632263 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:09:10.652840 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3149e7bd-0e81-421c-a284-4ed7fd238d40 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:10.659315 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:10.661171 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:10.662846 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3149e7bd-0e81-421c-a284-4ed7fd238d40 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1379 microversion: 2.1 time: 0.624368 Jul 31 01:09:10.663676 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 423/838] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:10 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1379 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:10.664214 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:10.664833 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:10.671131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fd4f4d2a-5b44-4e5a-a5b4-1e18029ba5e7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:10.671817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fd4f4d2a-5b44-4e5a-a5b4-1e18029ba5e7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:10.696637 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd4f4d2a-5b44-4e5a-a5b4-1e18029ba5e7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:10.698135 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd4f4d2a-5b44-4e5a-a5b4-1e18029ba5e7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:10.699201 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd4f4d2a-5b44-4e5a-a5b4-1e18029ba5e7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:10.700012 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd4f4d2a-5b44-4e5a-a5b4-1e18029ba5e7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:10.715652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:10.724057 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:10.750322 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Going to run 2 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:09:10.758899 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 4348d2b8-83d0-4ed1-a5db-c1c19d0948fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:09:10.793101 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:10.869849 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:10.880149 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:10.933981 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fd4f4d2a-5b44-4e5a-a5b4-1e18029ba5e7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:10.947393 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fd4f4d2a-5b44-4e5a-a5b4-1e18029ba5e7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1503 microversion: 2.1 time: 0.282188 Jul 31 01:09:10.948871 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 424/839] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:10 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:10.954300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3fdc0ffc-935f-46a6-bae7-97b8c9c0f177 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:10.954934 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3fdc0ffc-935f-46a6-bae7-97b8c9c0f177 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:10.962635 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3fdc0ffc-935f-46a6-bae7-97b8c9c0f177 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:10.963470 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3fdc0ffc-935f-46a6-bae7-97b8c9c0f177 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:10.964479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3fdc0ffc-935f-46a6-bae7-97b8c9c0f177 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:10.965371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3fdc0ffc-935f-46a6-bae7-97b8c9c0f177 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:10.978360 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:10.985390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:11.006454 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=4348d2b8-83d0-4ed1-a5db-c1c19d0948fa,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:09:11.076798 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:11.086817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:11.186126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:11.196472 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:11.214187 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3fdc0ffc-935f-46a6-bae7-97b8c9c0f177 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:11.238140 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3fdc0ffc-935f-46a6-bae7-97b8c9c0f177 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa" status: 200 len: 1468 microversion: 2.1 time: 0.286586 Jul 31 01:09:11.243984 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 425/840] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:10 2022] GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa => generated 1468 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:11.261847 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ae75dd3d-c06e-4c88-9a84-9043917837db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:11.263786 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ae75dd3d-c06e-4c88-9a84-9043917837db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:11.295543 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae75dd3d-c06e-4c88-9a84-9043917837db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:11.296294 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-30c6d05d-bec5-40b1-a623-d4cc4a453673 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.862540 Jul 31 01:09:11.296482 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae75dd3d-c06e-4c88-9a84-9043917837db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:11.298497 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae75dd3d-c06e-4c88-9a84-9043917837db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:11.299534 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae75dd3d-c06e-4c88-9a84-9043917837db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:11.301995 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 416/841] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:09:09 2022] POST /compute/v2.1/servers => generated 32 bytes in 1873 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 31 01:09:11.569642 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ed307cec-b436-4bff-88c1-52c1ab31408d tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Action: 'create', calling method: .version_select at 0x7fede5986b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1799330002", "description": "tempest-description-1850425986"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:11.572207 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:11.802298 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=7 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:12.201683 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ae75dd3d-c06e-4c88-9a84-9043917837db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:12.227396 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ae75dd3d-c06e-4c88-9a84-9043917837db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:12.239556 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ae75dd3d-c06e-4c88-9a84-9043917837db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:12.246906 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ae75dd3d-c06e-4c88-9a84-9043917837db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1410 microversion: 2.25 time: 0.997764 Jul 31 01:09:12.248428 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 426/842] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:09:11 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1410 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:09:12.265043 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8a55b065-f76c-4f03-bc2f-7f12e312f43a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:12.277210 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8a55b065-f76c-4f03-bc2f-7f12e312f43a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:12.283778 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8a55b065-f76c-4f03-bc2f-7f12e312f43a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Searching by: {'deleted': False, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:09:12.321364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a55b065-f76c-4f03-bc2f-7f12e312f43a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:12.321667 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a55b065-f76c-4f03-bc2f-7f12e312f43a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:12.334440 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a55b065-f76c-4f03-bc2f-7f12e312f43a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:12.335155 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a55b065-f76c-4f03-bc2f-7f12e312f43a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:12.392654 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.multi_cell_list [None req-8a55b065-f76c-4f03-bc2f-7f12e312f43a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=119475) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:09:12.454104 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8a55b065-f76c-4f03-bc2f-7f12e312f43a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.202873 Jul 31 01:09:12.461084 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 427/843] 10.222.0.45 () {58 vars in 1125 bytes} [Sun Jul 31 01:09:12 2022] GET /compute/v2.1/servers => generated 1665 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:12.473270 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-620c743d-b5f7-4b3e-9376-6e4798c0e1bc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:12.483982 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-620c743d-b5f7-4b3e-9376-6e4798c0e1bc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:12.500040 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-620c743d-b5f7-4b3e-9376-6e4798c0e1bc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:12.500953 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-620c743d-b5f7-4b3e-9376-6e4798c0e1bc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:12.503153 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-620c743d-b5f7-4b3e-9376-6e4798c0e1bc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:12.507727 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-620c743d-b5f7-4b3e-9376-6e4798c0e1bc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:13.279046 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ed307cec-b436-4bff-88c1-52c1ab31408d tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.975343 Jul 31 01:09:13.280282 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 417/844] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:09:11 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:13.298571 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-620c743d-b5f7-4b3e-9376-6e4798c0e1bc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:13.308838 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3d8b85de-df1a-4cfb-b3ce-1952cd06914d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:13.317214 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3d8b85de-df1a-4cfb-b3ce-1952cd06914d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:13.323410 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-620c743d-b5f7-4b3e-9376-6e4798c0e1bc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1379 microversion: 2.1 time: 0.851441 Jul 31 01:09:13.325298 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 428/845] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:12 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1379 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:13.330639 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dcec5a6a-bc7c-440b-993b-d4072983cf37 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:13.337381 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dcec5a6a-bc7c-440b-993b-d4072983cf37 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:13.349370 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dcec5a6a-bc7c-440b-993b-d4072983cf37 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:13.350140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dcec5a6a-bc7c-440b-993b-d4072983cf37 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:13.351163 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dcec5a6a-bc7c-440b-993b-d4072983cf37 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:13.356105 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dcec5a6a-bc7c-440b-993b-d4072983cf37 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:13.361595 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d8b85de-df1a-4cfb-b3ce-1952cd06914d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:13.367246 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d8b85de-df1a-4cfb-b3ce-1952cd06914d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:13.367595 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:13.371352 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d8b85de-df1a-4cfb-b3ce-1952cd06914d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:13.372381 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d8b85de-df1a-4cfb-b3ce-1952cd06914d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:14.003707 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dcec5a6a-bc7c-440b-993b-d4072983cf37 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:14.016917 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dcec5a6a-bc7c-440b-993b-d4072983cf37 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa" status: 200 len: 1468 microversion: 2.1 time: 0.690026 Jul 31 01:09:14.017457 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 429/846] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:13 2022] GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa => generated 1468 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:14.024300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5372f39e-e77e-4524-99e4-f9f1fda83ebe tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:14.024937 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5372f39e-e77e-4524-99e4-f9f1fda83ebe tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:14.033867 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5372f39e-e77e-4524-99e4-f9f1fda83ebe tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:14.034645 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5372f39e-e77e-4524-99e4-f9f1fda83ebe tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:14.035678 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5372f39e-e77e-4524-99e4-f9f1fda83ebe tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:14.036295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5372f39e-e77e-4524-99e4-f9f1fda83ebe tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:14.075061 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3d8b85de-df1a-4cfb-b3ce-1952cd06914d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:14.115967 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3d8b85de-df1a-4cfb-b3ce-1952cd06914d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1478 microversion: 2.1 time: 0.833798 Jul 31 01:09:14.118127 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 418/847] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:13 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1478 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:14.134516 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1e6b34f8-7f21-486d-a258-1776a01fb1a2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:14.147166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1e6b34f8-7f21-486d-a258-1776a01fb1a2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:14.182440 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e6b34f8-7f21-486d-a258-1776a01fb1a2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:14.189769 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e6b34f8-7f21-486d-a258-1776a01fb1a2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:14.191708 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e6b34f8-7f21-486d-a258-1776a01fb1a2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:14.201547 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e6b34f8-7f21-486d-a258-1776a01fb1a2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:14.209882 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5372f39e-e77e-4524-99e4-f9f1fda83ebe tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:14.224184 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5372f39e-e77e-4524-99e4-f9f1fda83ebe tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7" status: 200 len: 1271 microversion: 2.1 time: 0.205605 Jul 31 01:09:14.228182 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 430/848] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:14 2022] GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7 => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:14.241867 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-825c2f40-f1b9-4f1f-9c1a-57aa2f7980a2 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Action: 'create', calling method: .version_select at 0x7fede5f67940>, body: {"security_group_rule": {"parent_group_id": "3af1f232-4a0d-4e5b-828a-785ae08a0d92", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:15.665660 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1e6b34f8-7f21-486d-a258-1776a01fb1a2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:15.692949 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1e6b34f8-7f21-486d-a258-1776a01fb1a2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:15.697905 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1e6b34f8-7f21-486d-a258-1776a01fb1a2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:15.702149 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1e6b34f8-7f21-486d-a258-1776a01fb1a2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1410 microversion: 2.25 time: 1.582029 Jul 31 01:09:15.704278 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 419/849] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:09:14 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1410 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:09:15.725636 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-6adace2d-63f3-4bdd-9aeb-4f81380346de req-b5b2767d-27be-403b-89b5-d3c5decc9a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011dbabc-56cc-4f90-be60-972ffeb468b1", "tag": "4bf6b045-f27a-43d0-a436-872ac90dc24a"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:15.751181 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-6adace2d-63f3-4bdd-9aeb-4f81380346de req-b5b2767d-27be-403b-89b5-d3c5decc9a3b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:15.753974 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-6adace2d-63f3-4bdd-9aeb-4f81380346de req-b5b2767d-27be-403b-89b5-d3c5decc9a3b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:15.780868 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-6adace2d-63f3-4bdd-9aeb-4f81380346de req-b5b2767d-27be-403b-89b5-d3c5decc9a3b service nova] Creating event network-changed:4bf6b045-f27a-43d0-a436-872ac90dc24a for instance 011dbabc-56cc-4f90-be60-972ffeb468b1 on n-h1-master-1 Jul 31 01:09:15.800236 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-6adace2d-63f3-4bdd-9aeb-4f81380346de req-b5b2767d-27be-403b-89b5-d3c5decc9a3b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093611 Jul 31 01:09:15.801628 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 420/850] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:15.845496 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ec589269-a8a4-4a7c-960e-739ef04ec315 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '.version_select at 0x7fede5d9e310>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:15.855230 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-825c2f40-f1b9-4f1f-9c1a-57aa2f7980a2 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.624413 Jul 31 01:09:15.856337 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 431/851] 10.222.0.45 () {60 vars in 1195 bytes} [Sun Jul 31 01:09:14 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:15.873165 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec589269-a8a4-4a7c-960e-739ef04ec315 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:15.874208 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec589269-a8a4-4a7c-960e-739ef04ec315 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:15.876770 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-34c7f0ec-a83f-4577-9656-21a155c261cc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:15.880994 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-34c7f0ec-a83f-4577-9656-21a155c261cc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:15.916724 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34c7f0ec-a83f-4577-9656-21a155c261cc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:15.918574 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34c7f0ec-a83f-4577-9656-21a155c261cc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:15.921649 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ec589269-a8a4-4a7c-960e-739ef04ec315 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.100211 Jul 31 01:09:15.924714 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34c7f0ec-a83f-4577-9656-21a155c261cc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:15.928344 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34c7f0ec-a83f-4577-9656-21a155c261cc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:15.931166 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 421/852] 10.222.0.45 () {58 vars in 1143 bytes} [Sun Jul 31 01:09:15 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:15.945290 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-22cb70e7-e9cf-4398-a6a7-b27a2e2e398c tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:15.965256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-22cb70e7-e9cf-4398-a6a7-b27a2e2e398c tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:15.979475 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22cb70e7-e9cf-4398-a6a7-b27a2e2e398c tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:15.979923 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22cb70e7-e9cf-4398-a6a7-b27a2e2e398c tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:15.982013 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22cb70e7-e9cf-4398-a6a7-b27a2e2e398c tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:15.992122 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22cb70e7-e9cf-4398-a6a7-b27a2e2e398c tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:16.064814 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22cb70e7-e9cf-4398-a6a7-b27a2e2e398c tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:16.065526 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22cb70e7-e9cf-4398-a6a7-b27a2e2e398c tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:16.066267 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-22cb70e7-e9cf-4398-a6a7-b27a2e2e398c tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lazy-loading 'fault' on Instance uuid a1f37a0b-3c88-4abf-a832-d7e0230276aa {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:09:16.187557 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-22cb70e7-e9cf-4398-a6a7-b27a2e2e398c tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:16.204366 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-22cb70e7-e9cf-4398-a6a7-b27a2e2e398c tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa" status: 200 len: 1312 microversion: 2.1 time: 0.265992 Jul 31 01:09:16.204979 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 422/853] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:15 2022] GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa => generated 1312 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:16.234113 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-51c7cfcd-d0fb-4a11-bb73-e6c428e21898 req-a8c51a7a-0a0f-45c8-8889-84e70e5d8242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f37a0b-3c88-4abf-a832-d7e0230276aa", "name": "network-vif-deleted", "tag": "8d10cd1f-c6a6-47b6-9490-4951f6a0ea77"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:16.263617 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-51c7cfcd-d0fb-4a11-bb73-e6c428e21898 req-a8c51a7a-0a0f-45c8-8889-84e70e5d8242 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:16.264503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-51c7cfcd-d0fb-4a11-bb73-e6c428e21898 req-a8c51a7a-0a0f-45c8-8889-84e70e5d8242 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:16.294150 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-51c7cfcd-d0fb-4a11-bb73-e6c428e21898 req-a8c51a7a-0a0f-45c8-8889-84e70e5d8242 service nova] Creating event network-vif-deleted:8d10cd1f-c6a6-47b6-9490-4951f6a0ea77 for instance a1f37a0b-3c88-4abf-a832-d7e0230276aa on n-h1-master-1 Jul 31 01:09:16.305443 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-51c7cfcd-d0fb-4a11-bb73-e6c428e21898 req-a8c51a7a-0a0f-45c8-8889-84e70e5d8242 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084153 Jul 31 01:09:16.307143 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 423/854] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:16.316501 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c2038cfe-fb19-474b-ac2a-36b710a950c9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:16.317325 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c2038cfe-fb19-474b-ac2a-36b710a950c9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:16.334815 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c2038cfe-fb19-474b-ac2a-36b710a950c9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:16.335202 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c2038cfe-fb19-474b-ac2a-36b710a950c9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:16.336094 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c2038cfe-fb19-474b-ac2a-36b710a950c9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:16.336717 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c2038cfe-fb19-474b-ac2a-36b710a950c9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:16.509967 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c2038cfe-fb19-474b-ac2a-36b710a950c9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:16.568646 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c2038cfe-fb19-474b-ac2a-36b710a950c9 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7" status: 200 len: 1277 microversion: 2.1 time: 0.236910 Jul 31 01:09:16.576884 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 424/855] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:16 2022] GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7 => generated 1277 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:16.595393 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5dc9c97a-5827-4c0b-b4fc-5f543ac40d09 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Action: 'create', calling method: .version_select at 0x7fede58b4040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1266351979", "description": "tempest-description-52384095"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:16.595565 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-34c7f0ec-a83f-4577-9656-21a155c261cc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:16.611834 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-34c7f0ec-a83f-4577-9656-21a155c261cc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1379 microversion: 2.1 time: 0.753244 Jul 31 01:09:16.627956 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 432/856] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:15 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1379 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:16.666552 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cc114c0b-0020-49ea-936f-b35cf5c7258e tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:16.667940 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cc114c0b-0020-49ea-936f-b35cf5c7258e tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:16.682176 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc114c0b-0020-49ea-936f-b35cf5c7258e tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:16.683023 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc114c0b-0020-49ea-936f-b35cf5c7258e tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:16.684515 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc114c0b-0020-49ea-936f-b35cf5c7258e tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:16.685695 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc114c0b-0020-49ea-936f-b35cf5c7258e tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:17.195306 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cc114c0b-0020-49ea-936f-b35cf5c7258e tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1629 microversion: 2.1 time: 0.563208 Jul 31 01:09:17.196504 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 433/857] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:16 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1629 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:17.232873 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-89244740-b17a-4986-8946-2bbea67ed23c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:17.236156 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-89244740-b17a-4986-8946-2bbea67ed23c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:17.253295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89244740-b17a-4986-8946-2bbea67ed23c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:17.254963 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89244740-b17a-4986-8946-2bbea67ed23c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:17.260175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89244740-b17a-4986-8946-2bbea67ed23c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:17.261466 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89244740-b17a-4986-8946-2bbea67ed23c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:17.328590 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5dc9c97a-5827-4c0b-b4fc-5f543ac40d09 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.749058 Jul 31 01:09:17.329858 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 425/858] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:09:16 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:17.347407 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c500ee47-74a3-40a0-b9ee-7db3f64d9439 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:17.352469 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c500ee47-74a3-40a0-b9ee-7db3f64d9439 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: a1f37a0b-3c88-4abf-a832-d7e0230276aa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:17.363201 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c500ee47-74a3-40a0-b9ee-7db3f64d9439 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:17.363676 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c500ee47-74a3-40a0-b9ee-7db3f64d9439 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:17.367199 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c500ee47-74a3-40a0-b9ee-7db3f64d9439 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:17.367536 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c500ee47-74a3-40a0-b9ee-7db3f64d9439 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:17.403823 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-c500ee47-74a3-40a0-b9ee-7db3f64d9439 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] HTTP exception thrown: Instance a1f37a0b-3c88-4abf-a832-d7e0230276aa could not be found. Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c500ee47-74a3-40a0-b9ee-7db3f64d9439 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Request method failure captured: Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa HTTP/1.1 Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dX8aPKYbWY-kfm8Kdg6Kz2QTGZo_EowhYB7vixsVfuUtDbEWMoAmUamdJoIhfl5ZejTjQEgBE0bHUxjKrWo3It5BStI2R-bfGJyrBaWhvkLFtT3WfWh1KuOJJv4Grrb0iDD4vmzpn-5G2ro64TDFDFYXsu-I8-3dphd_BC3ksU8xg0 Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e1c4dd30e2494fe6af680f0a99d70c5f Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-52532419 Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:09:17.409116 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:09:17.410768 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1c4dd30e2494fe6af680f0a99d70c5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1c4dd30e2494fe6af680f0a99d70c5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e1c4dd30e2494fe6af680f0a99d70c5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e1c4dd30e2494fe6af680f0a99d70c5f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:09:17.410768 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersAdminNegativeTestJSON-52532419 Jul 31 01:09:17.410768 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e1c4dd30e2494fe6af680f0a99d70c5f Jul 31 01:09:17.410768 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-52532419 Jul 31 01:09:17.410768 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersAdminNegativeTestJSON-52532419-project Jul 31 01:09:17.410768 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:09:17.410768 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:09:17.410768 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: aff3051461a1428a8cd7f730269ab0b3 Jul 31 01:09:17.410768 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersAdminNegativeTestJSON-52532419-project Jul 31 01:09:17.410768 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:09:17.410768 n-d-master-1 devstack@n-api.service[119474]: exception: Instance a1f37a0b-3c88-4abf-a832-d7e0230276aa could not be found. Jul 31 01:09:17.410768 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'a1f37a0b-3c88-4abf-a832-d7e0230276aa'} Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1f37a0b-3c88-4abf-a832-d7e0230276aa could not be found. Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:09:17.411727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1f37a0b-3c88-4abf-a832-d7e0230276aa could not be found. Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1f37a0b-3c88-4abf-a832-d7e0230276aa could not be found. Jul 31 01:09:17.414007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:17.419772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c500ee47-74a3-40a0-b9ee-7db3f64d9439 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Returning 404 to user: Instance a1f37a0b-3c88-4abf-a832-d7e0230276aa could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:09:17.425555 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c500ee47-74a3-40a0-b9ee-7db3f64d9439 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa" status: 404 len: 111 microversion: 2.1 time: 0.086603 Jul 31 01:09:17.427057 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 426/859] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:17 2022] GET /compute/v2.1/servers/a1f37a0b-3c88-4abf-a832-d7e0230276aa => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:09:17.437980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3588bc0d-10c0-44bf-b710-0bf81794d2f2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Action: 'create', calling method: .version_select at 0x7fede58b4af0>, body: {"keypair": {"name": "tempest-keypair-1150729010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa3pbNjx8A9W0G8abmRU1l4cAd3wzYcgYtId/ssYl3PAfOjsV9+hto6Q9fT7h/lXDQTfAyyniVczthx5INuym92hVxRkNgPsPjp8sFmkD9EaFgRsa5TISoqfQ9LVjVKbA=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:17.483280 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-3588bc0d-10c0-44bf-b710-0bf81794d2f2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Getting quotas for project 5d8b0e81765c48039a523271670896d2. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:17.492790 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-3588bc0d-10c0-44bf-b710-0bf81794d2f2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Getting quotas for user 457bd8590d5040ef95854808b51c04d3 and project 5d8b0e81765c48039a523271670896d2. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:17.550702 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3588bc0d-10c0-44bf-b710-0bf81794d2f2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121324 Jul 31 01:09:17.552298 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 427/860] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:09:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:17.571178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-442fb1b0-3336-4e5b-9f20-42774b6b389e tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Action: 'create', calling method: .version_select at 0x7fede5994c10>, body: {"security_group_rule": {"parent_group_id": "c988c9d6-177d-4f2e-b10f-3e471905367e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:17.704414 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-89244740-b17a-4986-8946-2bbea67ed23c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:17.717973 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-89244740-b17a-4986-8946-2bbea67ed23c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:17.723919 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-89244740-b17a-4986-8946-2bbea67ed23c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:17.725564 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-89244740-b17a-4986-8946-2bbea67ed23c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1410 microversion: 2.25 time: 0.515206 Jul 31 01:09:17.726369 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 434/861] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:09:17 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1410 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:09:17.739978 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b4dd1bb9-d559-405b-9873-e36a768ef91f tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:17.740871 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b4dd1bb9-d559-405b-9873-e36a768ef91f tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:17.750688 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4dd1bb9-d559-405b-9873-e36a768ef91f tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:17.751638 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4dd1bb9-d559-405b-9873-e36a768ef91f tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:17.753432 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4dd1bb9-d559-405b-9873-e36a768ef91f tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:17.754203 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4dd1bb9-d559-405b-9873-e36a768ef91f tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:17.786254 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b4dd1bb9-d559-405b-9873-e36a768ef91f tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:09:17.936912 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b4dd1bb9-d559-405b-9873-e36a768ef91f tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "DELETE /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073" status: 204 len: 0 microversion: 2.1 time: 0.206812 Jul 31 01:09:17.938404 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 435/862] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:09:17 2022] DELETE /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:09:17.949592 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-79d61c41-d9de-40e0-a432-3701b33ac0f6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:17.950611 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-79d61c41-d9de-40e0-a432-3701b33ac0f6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:17.959702 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-79d61c41-d9de-40e0-a432-3701b33ac0f6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:17.960785 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-79d61c41-d9de-40e0-a432-3701b33ac0f6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:17.962291 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-79d61c41-d9de-40e0-a432-3701b33ac0f6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:17.963553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-79d61c41-d9de-40e0-a432-3701b33ac0f6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:18.746576 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-442fb1b0-3336-4e5b-9f20-42774b6b389e tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.192564 Jul 31 01:09:18.758070 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 428/863] 10.222.0.45 () {60 vars in 1195 bytes} [Sun Jul 31 01:09:17 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:18.764401 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a11e9a09-3dc6-4ece-8735-63b5301c7f5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:18.765041 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a11e9a09-3dc6-4ece-8735-63b5301c7f5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:18.790261 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a11e9a09-3dc6-4ece-8735-63b5301c7f5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:18.790712 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a11e9a09-3dc6-4ece-8735-63b5301c7f5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:18.794615 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a11e9a09-3dc6-4ece-8735-63b5301c7f5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:18.795173 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a11e9a09-3dc6-4ece-8735-63b5301c7f5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:18.817081 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-79d61c41-d9de-40e0-a432-3701b33ac0f6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:18.838879 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-79d61c41-d9de-40e0-a432-3701b33ac0f6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7" status: 200 len: 1319 microversion: 2.1 time: 0.894950 Jul 31 01:09:18.858763 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 436/864] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:17 2022] GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7 => generated 1319 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:18.890026 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f1e7bec7-d764-4022-88aa-d578d4aae2c1 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:18.893880 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f1e7bec7-d764-4022-88aa-d578d4aae2c1 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:18.914843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1e7bec7-d764-4022-88aa-d578d4aae2c1 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:18.919707 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1e7bec7-d764-4022-88aa-d578d4aae2c1 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:18.920978 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1e7bec7-d764-4022-88aa-d578d4aae2c1 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:18.922566 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1e7bec7-d764-4022-88aa-d578d4aae2c1 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:19.428086 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f1e7bec7-d764-4022-88aa-d578d4aae2c1 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:19.451921 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f1e7bec7-d764-4022-88aa-d578d4aae2c1 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073" status: 200 len: 1477 microversion: 2.1 time: 0.591076 Jul 31 01:09:19.473158 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 437/865] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:18 2022] GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073 => generated 1477 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:19.491419 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-17a8b7c8-b767-4628-ac12-4f42aa8fff1c req-177ac4c9-fc3e-4915-abc4-ea08e5aa9ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228dc464-015e-46f4-bec0-9f81a1dc15d2", "name": "network-vif-plugged", "status": "completed", "tag": "9a86b1f7-6a8e-4f86-8208-6993e348a723"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:19.514830 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-17a8b7c8-b767-4628-ac12-4f42aa8fff1c req-177ac4c9-fc3e-4915-abc4-ea08e5aa9ff8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:19.516085 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-17a8b7c8-b767-4628-ac12-4f42aa8fff1c req-177ac4c9-fc3e-4915-abc4-ea08e5aa9ff8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:19.599710 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-17a8b7c8-b767-4628-ac12-4f42aa8fff1c req-177ac4c9-fc3e-4915-abc4-ea08e5aa9ff8 service nova] Creating event network-vif-plugged:9a86b1f7-6a8e-4f86-8208-6993e348a723 for instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 on n-h2-master-1 Jul 31 01:09:19.616216 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-17a8b7c8-b767-4628-ac12-4f42aa8fff1c req-177ac4c9-fc3e-4915-abc4-ea08e5aa9ff8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134373 Jul 31 01:09:19.618997 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 438/866] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:19.633614 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-57086b64-2af3-4368-8449-ded035d12022 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Action: 'create', calling method: .version_select at 0x7fede5c9b820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-990881461", "description": "tempest-description-1040676358"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:19.988753 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a11e9a09-3dc6-4ece-8735-63b5301c7f5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:20.007065 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a11e9a09-3dc6-4ece-8735-63b5301c7f5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1379 microversion: 2.1 time: 1.245995 Jul 31 01:09:20.012979 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 429/867] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:18 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1379 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:20.028943 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-70faf4f3-5fa2-440f-895e-e08af49dfe93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:20.030049 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-70faf4f3-5fa2-440f-895e-e08af49dfe93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:20.044705 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70faf4f3-5fa2-440f-895e-e08af49dfe93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:20.048077 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70faf4f3-5fa2-440f-895e-e08af49dfe93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:20.049213 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70faf4f3-5fa2-440f-895e-e08af49dfe93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:20.051451 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70faf4f3-5fa2-440f-895e-e08af49dfe93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:20.675021 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-70faf4f3-5fa2-440f-895e-e08af49dfe93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:20.687076 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:20.699178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-70faf4f3-5fa2-440f-895e-e08af49dfe93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:20.705721 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-70faf4f3-5fa2-440f-895e-e08af49dfe93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:20.707964 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-70faf4f3-5fa2-440f-895e-e08af49dfe93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1410 microversion: 2.25 time: 0.693204 Jul 31 01:09:20.709291 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 430/868] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:09:20 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1410 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:09:20.722428 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-29419af3-46f7-4054-8686-27dde894da34 req-364d5dbe-611e-4642-8bc5-cbeb18b8b558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4348d2b8-83d0-4ed1-a5db-c1c19d0948fa", "tag": "caeac7e0-bb03-4fd5-86ff-b2e76cb264fc"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:20.761534 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-29419af3-46f7-4054-8686-27dde894da34 req-364d5dbe-611e-4642-8bc5-cbeb18b8b558 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:20.764291 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-29419af3-46f7-4054-8686-27dde894da34 req-364d5dbe-611e-4642-8bc5-cbeb18b8b558 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:20.789812 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-57086b64-2af3-4368-8449-ded035d12022 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.168558 Jul 31 01:09:20.790463 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 439/869] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:09:19 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:20.795564 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-12179828-1238-43f2-8360-5bd2555f3689 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:20.796839 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-12179828-1238-43f2-8360-5bd2555f3689 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:20.810817 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-29419af3-46f7-4054-8686-27dde894da34 req-364d5dbe-611e-4642-8bc5-cbeb18b8b558 service nova] Creating event network-changed:caeac7e0-bb03-4fd5-86ff-b2e76cb264fc for instance 4348d2b8-83d0-4ed1-a5db-c1c19d0948fa on n-h2-master-1 Jul 31 01:09:20.823527 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12179828-1238-43f2-8360-5bd2555f3689 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:20.824010 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12179828-1238-43f2-8360-5bd2555f3689 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:20.833306 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12179828-1238-43f2-8360-5bd2555f3689 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:20.833807 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12179828-1238-43f2-8360-5bd2555f3689 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:20.834851 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-29419af3-46f7-4054-8686-27dde894da34 req-364d5dbe-611e-4642-8bc5-cbeb18b8b558 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123486 Jul 31 01:09:20.843244 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 431/870] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:20.865419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e4d85fb4-f08f-48c2-8d77-dbeb0d5145da tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:20.871229 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e4d85fb4-f08f-48c2-8d77-dbeb0d5145da tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:20.905865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4d85fb4-f08f-48c2-8d77-dbeb0d5145da tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:20.908009 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4d85fb4-f08f-48c2-8d77-dbeb0d5145da tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:20.911458 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4d85fb4-f08f-48c2-8d77-dbeb0d5145da tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:20.913668 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4d85fb4-f08f-48c2-8d77-dbeb0d5145da tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:21.552387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-12179828-1238-43f2-8360-5bd2555f3689 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:21.572821 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-12179828-1238-43f2-8360-5bd2555f3689 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7" status: 200 len: 1319 microversion: 2.1 time: 0.781234 Jul 31 01:09:21.575637 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 440/871] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:20 2022] GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7 => generated 1319 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:21.580781 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5fc1cc25-3115-43ed-ad51-572f196c8b84 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Action: 'create', calling method: .version_select at 0x7fede5c9bdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1607058144", "description": "tempest-description-304406180"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:21.595200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e4d85fb4-f08f-48c2-8d77-dbeb0d5145da tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff3051461a1428a8cd7f730269ab0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c4dd30e2494fe6af680f0a99d70c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:21.618283 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e4d85fb4-f08f-48c2-8d77-dbeb0d5145da tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073" status: 200 len: 1477 microversion: 2.1 time: 0.771985 Jul 31 01:09:21.619206 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 432/872] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:20 2022] GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073 => generated 1477 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:21.625612 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d7cdd065-bd0e-4a5f-aa06-ba44d15b6cb5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:21.626596 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d7cdd065-bd0e-4a5f-aa06-ba44d15b6cb5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:21.636818 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7cdd065-bd0e-4a5f-aa06-ba44d15b6cb5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:21.637421 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7cdd065-bd0e-4a5f-aa06-ba44d15b6cb5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:21.638330 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7cdd065-bd0e-4a5f-aa06-ba44d15b6cb5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:21.639006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7cdd065-bd0e-4a5f-aa06-ba44d15b6cb5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:21.994901 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d7cdd065-bd0e-4a5f-aa06-ba44d15b6cb5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:22.010396 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d7cdd065-bd0e-4a5f-aa06-ba44d15b6cb5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1379 microversion: 2.1 time: 0.389159 Jul 31 01:09:22.011988 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 433/873] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:21 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1379 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:22.082129 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5fc1cc25-3115-43ed-ad51-572f196c8b84 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.504367 Jul 31 01:09:22.085185 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 441/874] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:09:21 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:22.131778 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8d4fb1d9-b6b4-4757-9887-fb2e67745c64 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-985655443", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "3d6735cc-8aac-4616-9429-654d8dcd9adc"}], "security_groups": [{"name": "tempest-securitygroup--1178079948"}], "key_name": "tempest-keypair-1150729010", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:22.359714 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:22.376896 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-8d4fb1d9-b6b4-4757-9887-fb2e67745c64 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] validate_networks() for [('3d6735cc-8aac-4616-9429-654d8dcd9adc', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:09:22.378299 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1c9c2d55-77ab-41ae-96de-bdcb38e76460 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Calling method '.version_select at 0x7fede5994670>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:22.381154 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:22.381154 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:09:22.382384 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c9c2d55-77ab-41ae-96de-bdcb38e76460 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:22.382843 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c9c2d55-77ab-41ae-96de-bdcb38e76460 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:22.414031 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c9c2d55-77ab-41ae-96de-bdcb38e76460 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:22.414832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c9c2d55-77ab-41ae-96de-bdcb38e76460 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:22.463510 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c9c2d55-77ab-41ae-96de-bdcb38e76460 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:22.464067 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c9c2d55-77ab-41ae-96de-bdcb38e76460 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:22.477321 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c9c2d55-77ab-41ae-96de-bdcb38e76460 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:22.478034 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c9c2d55-77ab-41ae-96de-bdcb38e76460 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:22.531917 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:22.536047 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c9c2d55-77ab-41ae-96de-bdcb38e76460 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:22.537527 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c9c2d55-77ab-41ae-96de-bdcb38e76460 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:22.552038 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1c9c2d55-77ab-41ae-96de-bdcb38e76460 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2786 microversion: 2.53 time: 0.524968 Jul 31 01:09:22.565369 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 434/875] 10.222.0.45 () {60 vars in 1243 bytes} [Sun Jul 31 01:09:22 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2786 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:09:22.570038 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-d6a3c469-4938-45b3-94b7-8f0782791242 req-2eb840ec-6985-4703-b1e0-ff1555e09eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011dbabc-56cc-4f90-be60-972ffeb468b1", "name": "network-vif-plugged", "status": "completed", "tag": "4bf6b045-f27a-43d0-a436-872ac90dc24a"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:22.582154 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d6a3c469-4938-45b3-94b7-8f0782791242 req-2eb840ec-6985-4703-b1e0-ff1555e09eb9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:22.582601 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d6a3c469-4938-45b3-94b7-8f0782791242 req-2eb840ec-6985-4703-b1e0-ff1555e09eb9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:22.598781 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-d6a3c469-4938-45b3-94b7-8f0782791242 req-2eb840ec-6985-4703-b1e0-ff1555e09eb9 service nova] Creating event network-vif-plugged:4bf6b045-f27a-43d0-a436-872ac90dc24a for instance 011dbabc-56cc-4f90-be60-972ffeb468b1 on n-h1-master-1 Jul 31 01:09:22.604700 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-d6a3c469-4938-45b3-94b7-8f0782791242 req-2eb840ec-6985-4703-b1e0-ff1555e09eb9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039530 Jul 31 01:09:22.605933 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 435/876] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:22.615725 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-73e9ca66-f78a-45ea-9994-066cc36b675e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:22.617011 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-73e9ca66-f78a-45ea-9994-066cc36b675e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:22.625696 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73e9ca66-f78a-45ea-9994-066cc36b675e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:22.626614 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73e9ca66-f78a-45ea-9994-066cc36b675e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:22.627861 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73e9ca66-f78a-45ea-9994-066cc36b675e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:22.628438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73e9ca66-f78a-45ea-9994-066cc36b675e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:23.130286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-73e9ca66-f78a-45ea-9994-066cc36b675e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:23.140123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-73e9ca66-f78a-45ea-9994-066cc36b675e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:23.142132 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-73e9ca66-f78a-45ea-9994-066cc36b675e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:23.143424 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-73e9ca66-f78a-45ea-9994-066cc36b675e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1410 microversion: 2.25 time: 0.535277 Jul 31 01:09:23.144176 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 436/877] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:09:22 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1410 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:09:23.149145 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-f810c51e-7bdf-417c-956b-c3a36e3f7546 req-6edd84df-4975-4855-aded-014f75609993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377d997f-f860-480f-b712-6be34358d073", "name": "network-vif-deleted", "tag": "28a7d1f5-562e-42f5-8a21-e230c7de688a"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:23.160950 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f810c51e-7bdf-417c-956b-c3a36e3f7546 req-6edd84df-4975-4855-aded-014f75609993 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:23.161642 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f810c51e-7bdf-417c-956b-c3a36e3f7546 req-6edd84df-4975-4855-aded-014f75609993 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:23.175274 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-f810c51e-7bdf-417c-956b-c3a36e3f7546 req-6edd84df-4975-4855-aded-014f75609993 service nova] Creating event network-vif-deleted:28a7d1f5-562e-42f5-8a21-e230c7de688a for instance 377d997f-f860-480f-b712-6be34358d073 on n-h1-master-1 Jul 31 01:09:23.181834 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-f810c51e-7bdf-417c-956b-c3a36e3f7546 req-6edd84df-4975-4855-aded-014f75609993 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035845 Jul 31 01:09:23.183473 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 437/878] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:23.190437 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3385d577-a8f9-4924-87ab-9690a7655176 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Action: 'create', calling method: .version_select at 0x7fede5a5a040>, body: {"security_group_rule": {"parent_group_id": "4b1d89d6-bc3e-4212-aafc-584404c7b228", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "662ddc6c-1494-4af7-baa4-0ee570b5f4e9"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:23.324557 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8d4fb1d9-b6b4-4757-9887-fb2e67745c64 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:09:23.325335 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8d4fb1d9-b6b4-4757-9887-fb2e67745c64 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:09:23.325610 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8d4fb1d9-b6b4-4757-9887-fb2e67745c64 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:09:23.326073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8d4fb1d9-b6b4-4757-9887-fb2e67745c64 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:09:23.326664 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8d4fb1d9-b6b4-4757-9887-fb2e67745c64 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:09:23.337216 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d4fb1d9-b6b4-4757-9887-fb2e67745c64 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:23.337786 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d4fb1d9-b6b4-4757-9887-fb2e67745c64 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:23.338685 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d4fb1d9-b6b4-4757-9887-fb2e67745c64 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:23.339249 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d4fb1d9-b6b4-4757-9887-fb2e67745c64 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:23.358591 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-8d4fb1d9-b6b4-4757-9887-fb2e67745c64 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Getting quotas for project 5d8b0e81765c48039a523271670896d2. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:23.363861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-8d4fb1d9-b6b4-4757-9887-fb2e67745c64 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Getting quotas for user 457bd8590d5040ef95854808b51c04d3 and project 5d8b0e81765c48039a523271670896d2. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:23.376609 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8d4fb1d9-b6b4-4757-9887-fb2e67745c64 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:09:23.378834 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8d4fb1d9-b6b4-4757-9887-fb2e67745c64 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:09:23.427874 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8d4fb1d9-b6b4-4757-9887-fb2e67745c64 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.335490 Jul 31 01:09:23.428766 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 442/879] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:09:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:09:23.433316 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f6aec40f-2141-444c-b294-a05099695530 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Calling method '.version_select at 0x7fede600a820>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:23.436209 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:23.436209 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:09:23.438765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6aec40f-2141-444c-b294-a05099695530 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:23.438765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6aec40f-2141-444c-b294-a05099695530 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:23.457537 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6aec40f-2141-444c-b294-a05099695530 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:23.457998 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6aec40f-2141-444c-b294-a05099695530 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:23.488164 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6aec40f-2141-444c-b294-a05099695530 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:23.488733 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6aec40f-2141-444c-b294-a05099695530 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:23.501144 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6aec40f-2141-444c-b294-a05099695530 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:23.501736 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6aec40f-2141-444c-b294-a05099695530 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:23.550654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6aec40f-2141-444c-b294-a05099695530 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:23.551367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6aec40f-2141-444c-b294-a05099695530 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:23.571018 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3385d577-a8f9-4924-87ab-9690a7655176 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.386576 Jul 31 01:09:23.580550 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 438/880] 10.222.0.45 () {60 vars in 1195 bytes} [Sun Jul 31 01:09:23 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:23.583690 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f6aec40f-2141-444c-b294-a05099695530 tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1397 microversion: 2.53 time: 0.153444 Jul 31 01:09:23.586120 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8b1c9cfb-61f6-4bb3-bd48-6105e8f98841 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:23.587058 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8b1c9cfb-61f6-4bb3-bd48-6105e8f98841 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:23.594510 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 443/881] 10.222.0.45 () {60 vars in 1222 bytes} [Sun Jul 31 01:09:23 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1397 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:09:23.597592 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b1c9cfb-61f6-4bb3-bd48-6105e8f98841 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:23.598857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b1c9cfb-61f6-4bb3-bd48-6105e8f98841 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:23.600453 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6aed7352-beda-42b9-b926-42eb7ffd75d9 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:23.601335 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6aed7352-beda-42b9-b926-42eb7ffd75d9 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] [instance: 377d997f-f860-480f-b712-6be34358d073] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:23.603360 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b1c9cfb-61f6-4bb3-bd48-6105e8f98841 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:23.604901 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b1c9cfb-61f6-4bb3-bd48-6105e8f98841 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:23.605466 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:23.611951 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6aed7352-beda-42b9-b926-42eb7ffd75d9 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:23.612789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6aed7352-beda-42b9-b926-42eb7ffd75d9 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:23.614208 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6aed7352-beda-42b9-b926-42eb7ffd75d9 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:23.615276 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6aed7352-beda-42b9-b926-42eb7ffd75d9 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:23.639375 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-6aed7352-beda-42b9-b926-42eb7ffd75d9 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] HTTP exception thrown: Instance 377d997f-f860-480f-b712-6be34358d073 could not be found. Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6aed7352-beda-42b9-b926-42eb7ffd75d9 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Request method failure captured: Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073 HTTP/1.1 Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dX8aPKYbWY-kfm8Kdg6Kz2QTGZo_EowhYB7vixsVfuUtDbEWMoAmUamdJoIhfl5ZejTjQEgBE0bHUxjKrWo3It5BStI2R-bfGJyrBaWhvkLFtT3WfWh1KuOJJv4Grrb0iDD4vmzpn-5G2ro64TDFDFYXsu-I8-3dphd_BC3ksU8xg0 Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: e1c4dd30e2494fe6af680f0a99d70c5f Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-52532419 Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:09:23.642561 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:09:23.645491 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1c4dd30e2494fe6af680f0a99d70c5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e1c4dd30e2494fe6af680f0a99d70c5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e1c4dd30e2494fe6af680f0a99d70c5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e1c4dd30e2494fe6af680f0a99d70c5f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:09:23.645491 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersAdminNegativeTestJSON-52532419 Jul 31 01:09:23.645491 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: e1c4dd30e2494fe6af680f0a99d70c5f Jul 31 01:09:23.645491 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-52532419 Jul 31 01:09:23.645491 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersAdminNegativeTestJSON-52532419-project Jul 31 01:09:23.645491 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:09:23.645491 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:09:23.645491 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: aff3051461a1428a8cd7f730269ab0b3 Jul 31 01:09:23.645491 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersAdminNegativeTestJSON-52532419-project Jul 31 01:09:23.645491 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:09:23.645491 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 377d997f-f860-480f-b712-6be34358d073 could not be found. Jul 31 01:09:23.645491 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '377d997f-f860-480f-b712-6be34358d073'} Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 377d997f-f860-480f-b712-6be34358d073 could not be found. Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:09:23.647553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 377d997f-f860-480f-b712-6be34358d073 could not be found. Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 377d997f-f860-480f-b712-6be34358d073 could not be found. Jul 31 01:09:23.650605 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:23.653576 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6aed7352-beda-42b9-b926-42eb7ffd75d9 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] Returning 404 to user: Instance 377d997f-f860-480f-b712-6be34358d073 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:09:23.653576 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6aed7352-beda-42b9-b926-42eb7ffd75d9 tempest-ServersAdminNegativeTestJSON-52532419 tempest-ServersAdminNegativeTestJSON-52532419-project] 10.222.0.45 "GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073" status: 404 len: 111 microversion: 2.1 time: 0.048521 Jul 31 01:09:23.653576 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 444/882] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:23 2022] GET /compute/v2.1/servers/377d997f-f860-480f-b712-6be34358d073 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:09:23.653576 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5da0fd48-6bb7-458b-8261-fdc6e4ec0957 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:23.654911 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5da0fd48-6bb7-458b-8261-fdc6e4ec0957 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:23.662201 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5da0fd48-6bb7-458b-8261-fdc6e4ec0957 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:23.662765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5da0fd48-6bb7-458b-8261-fdc6e4ec0957 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:23.663431 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5da0fd48-6bb7-458b-8261-fdc6e4ec0957 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:23.663887 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5da0fd48-6bb7-458b-8261-fdc6e4ec0957 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:23.972305 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8b1c9cfb-61f6-4bb3-bd48-6105e8f98841 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:23.986438 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8b1c9cfb-61f6-4bb3-bd48-6105e8f98841 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7" status: 200 len: 1319 microversion: 2.1 time: 0.404325 Jul 31 01:09:23.987297 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 439/883] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:23 2022] GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7 => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:23.992411 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ad92b555-8c09-4bae-b47f-832dae9b766e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:23.993168 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ad92b555-8c09-4bae-b47f-832dae9b766e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:24.001006 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5da0fd48-6bb7-458b-8261-fdc6e4ec0957 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:24.015274 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5da0fd48-6bb7-458b-8261-fdc6e4ec0957 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1528 microversion: 2.1 time: 0.365896 Jul 31 01:09:24.015903 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 445/884] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:23 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1528 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:24.020802 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6ffb54c3-2f1d-499a-b123-af601797c2bb tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Action: 'create', calling method: .version_select at 0x7fede5b3d040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-91739838", "description": "tempest-description-265005667"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:24.065582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ad92b555-8c09-4bae-b47f-832dae9b766e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:24.077056 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ad92b555-8c09-4bae-b47f-832dae9b766e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1234 microversion: 2.1 time: 0.088082 Jul 31 01:09:24.090967 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 440/885] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:23 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1234 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:24.095875 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-58a26dde-e86c-4ded-b56d-23873b0980bb tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Calling method '.version_select at 0x7fede5986670>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:24.098692 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:24.098692 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:09:24.099997 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58a26dde-e86c-4ded-b56d-23873b0980bb tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:24.100505 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58a26dde-e86c-4ded-b56d-23873b0980bb tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:24.120812 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58a26dde-e86c-4ded-b56d-23873b0980bb tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:24.121261 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58a26dde-e86c-4ded-b56d-23873b0980bb tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:24.124660 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:24.129527 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-58a26dde-e86c-4ded-b56d-23873b0980bb tempest-HypervisorAdminV253TestBase-1298898527 tempest-HypervisorAdminV253TestBase-1298898527-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors/8067e9c1-12b0-41a7-bdba-9fa5eac68054" status: 200 len: 792 microversion: 2.53 time: 0.049236 Jul 31 01:09:24.130465 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 441/886] 10.222.0.45 () {60 vars in 1298 bytes} [Sun Jul 31 01:09:24 2022] GET /compute/v2.1/os-hypervisors/8067e9c1-12b0-41a7-bdba-9fa5eac68054 => generated 792 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:09:24.135927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fb59d444-46d4-47a9-8d00-774f0353592c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:24.136533 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fb59d444-46d4-47a9-8d00-774f0353592c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:24.151994 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb59d444-46d4-47a9-8d00-774f0353592c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:24.153137 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb59d444-46d4-47a9-8d00-774f0353592c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:24.154069 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb59d444-46d4-47a9-8d00-774f0353592c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:24.154520 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb59d444-46d4-47a9-8d00-774f0353592c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:24.279481 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6ffb54c3-2f1d-499a-b123-af601797c2bb tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.262237 Jul 31 01:09:24.289939 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 446/887] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:09:24 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:24.295706 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1b39c433-6256-4bab-ac52-e2bc9132acee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:24.297389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1b39c433-6256-4bab-ac52-e2bc9132acee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:24.305006 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b39c433-6256-4bab-ac52-e2bc9132acee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:24.305735 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b39c433-6256-4bab-ac52-e2bc9132acee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:24.306688 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b39c433-6256-4bab-ac52-e2bc9132acee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:24.307269 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b39c433-6256-4bab-ac52-e2bc9132acee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:24.374486 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fb59d444-46d4-47a9-8d00-774f0353592c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:24.385920 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fb59d444-46d4-47a9-8d00-774f0353592c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1528 microversion: 2.1 time: 0.254368 Jul 31 01:09:24.387477 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 442/888] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:24 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1528 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:24.393822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-42dfe12f-d57d-4fd7-b31a-99baa7905c80 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Action: 'create', calling method: .version_select at 0x7fede58e90d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2068912369", "description": "tempest-description-456332857"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:24.512895 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1b39c433-6256-4bab-ac52-e2bc9132acee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:24.525040 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1b39c433-6256-4bab-ac52-e2bc9132acee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:24.526696 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1b39c433-6256-4bab-ac52-e2bc9132acee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:24.528534 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1b39c433-6256-4bab-ac52-e2bc9132acee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1410 microversion: 2.25 time: 0.237289 Jul 31 01:09:24.529585 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 447/889] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:09:24 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1410 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:09:24.534798 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d0929fd1-ea32-4064-b604-432f3bfd93b2 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:24.535783 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:24.535783 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:09:24.555109 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d0929fd1-ea32-4064-b604-432f3bfd93b2 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/cc9c4f28-4a5f-4609-a490-30b8f831043a" status: 202 len: 0 microversion: 2.1 time: 0.024166 Jul 31 01:09:24.559321 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 448/890] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:09:24 2022] DELETE /compute/v2.1/flavors/cc9c4f28-4a5f-4609-a490-30b8f831043a => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:09:24.565281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e9c598fc-42e9-46c7-90a8-99a9846d7d5a tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:24.596643 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e9c598fc-42e9-46c7-90a8-99a9846d7d5a tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035302 Jul 31 01:09:24.597628 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 449/891] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:09:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:24.618094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-49178725-99d7-440b-8e34-016b0c3528f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:24.621976 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-49178725-99d7-440b-8e34-016b0c3528f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:24.632548 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49178725-99d7-440b-8e34-016b0c3528f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:24.633343 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49178725-99d7-440b-8e34-016b0c3528f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:24.634850 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49178725-99d7-440b-8e34-016b0c3528f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:24.636313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49178725-99d7-440b-8e34-016b0c3528f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:24.714654 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-42dfe12f-d57d-4fd7-b31a-99baa7905c80 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.325911 Jul 31 01:09:24.716438 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 443/892] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:09:24 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:24.729312 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f7766eb8-2ba9-44c4-a35f-7cbffc9c278f tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Action: 'create', calling method: .version_select at 0x7fede5986b80>, body: {"security_group_rule": {"parent_group_id": "b0cdbf78-b81f-4e1b-86c6-0feb2a40b711", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "512d7cfb-9449-4c7b-97be-da38548f477c"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:24.772168 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-49178725-99d7-440b-8e34-016b0c3528f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:24.784466 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-49178725-99d7-440b-8e34-016b0c3528f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Old instance type tempest-test_resize_flavor_-1632894205, new instance type m1.heat {{(pid=119475) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 31 01:09:24.796031 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:24.810251 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-49178725-99d7-440b-8e34-016b0c3528f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:09:24.810846 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-49178725-99d7-440b-8e34-016b0c3528f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:09:24.811353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-49178725-99d7-440b-8e34-016b0c3528f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:09:24.811776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-49178725-99d7-440b-8e34-016b0c3528f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:09:24.812808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-49178725-99d7-440b-8e34-016b0c3528f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:09:24.997648 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-49178725-99d7-440b-8e34-016b0c3528f3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "POST /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2/action" status: 202 len: 0 microversion: 2.1 time: 0.383762 Jul 31 01:09:25.007020 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 450/893] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:09:24 2022] POST /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:09:25.012291 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fa0164b8-e103-4219-80b9-16c0ef50f2d5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:25.012923 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fa0164b8-e103-4219-80b9-16c0ef50f2d5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:25.033609 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fa0164b8-e103-4219-80b9-16c0ef50f2d5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:25.039834 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fa0164b8-e103-4219-80b9-16c0ef50f2d5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:25.040798 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fa0164b8-e103-4219-80b9-16c0ef50f2d5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:25.041261 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fa0164b8-e103-4219-80b9-16c0ef50f2d5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:25.158227 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f7766eb8-2ba9-44c4-a35f-7cbffc9c278f tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.433599 Jul 31 01:09:25.158829 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 444/894] 10.222.0.45 () {60 vars in 1195 bytes} [Sun Jul 31 01:09:24 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:25.169997 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5ab8e85e-66a0-44a4-a6b8-573ac3516ed3 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:25.169997 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5ab8e85e-66a0-44a4-a6b8-573ac3516ed3 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:25.175824 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ab8e85e-66a0-44a4-a6b8-573ac3516ed3 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:25.176288 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ab8e85e-66a0-44a4-a6b8-573ac3516ed3 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:25.203633 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ab8e85e-66a0-44a4-a6b8-573ac3516ed3 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:25.207317 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ab8e85e-66a0-44a4-a6b8-573ac3516ed3 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:25.479452 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fa0164b8-e103-4219-80b9-16c0ef50f2d5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:25.489536 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fa0164b8-e103-4219-80b9-16c0ef50f2d5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1537 microversion: 2.1 time: 0.481230 Jul 31 01:09:25.504431 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 451/895] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:25 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1537 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:25.513060 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e9d323a-c45e-4bc3-a8c1-7e30730e5885 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:25.514096 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3e9d323a-c45e-4bc3-a8c1-7e30730e5885 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:25.537745 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e9d323a-c45e-4bc3-a8c1-7e30730e5885 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:25.540096 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e9d323a-c45e-4bc3-a8c1-7e30730e5885 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:25.541129 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e9d323a-c45e-4bc3-a8c1-7e30730e5885 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:25.542504 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e9d323a-c45e-4bc3-a8c1-7e30730e5885 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:25.646060 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5ab8e85e-66a0-44a4-a6b8-573ac3516ed3 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:25.658442 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5ab8e85e-66a0-44a4-a6b8-573ac3516ed3 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7" status: 200 len: 1319 microversion: 2.1 time: 0.498462 Jul 31 01:09:25.660308 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 445/896] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:25 2022] GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7 => generated 1319 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:25.669129 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-139a50e3-3567-4473-bc86-6087046f8088 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Calling method '.version_select at 0x7fede58e90d0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:25.740294 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e9d323a-c45e-4bc3-a8c1-7e30730e5885 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:25.757084 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3e9d323a-c45e-4bc3-a8c1-7e30730e5885 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1286 microversion: 2.1 time: 0.249464 Jul 31 01:09:25.758114 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 452/897] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:25 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1286 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:25.764960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-bc5cc9c9-35e7-4cbf-bee7-e1f1e603d89a req-c0e29658-89d5-4813-9570-9f78e14073b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de60c7a5-098d-44cb-99f0-1dc80f148df7", "tag": "eb60d01b-0896-4be2-ba48-c007231e1541"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:25.782541 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-bc5cc9c9-35e7-4cbf-bee7-e1f1e603d89a req-c0e29658-89d5-4813-9570-9f78e14073b5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:25.783619 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-bc5cc9c9-35e7-4cbf-bee7-e1f1e603d89a req-c0e29658-89d5-4813-9570-9f78e14073b5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:25.802285 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-bc5cc9c9-35e7-4cbf-bee7-e1f1e603d89a req-c0e29658-89d5-4813-9570-9f78e14073b5 service nova] Creating event network-changed:eb60d01b-0896-4be2-ba48-c007231e1541 for instance de60c7a5-098d-44cb-99f0-1dc80f148df7 on n-h1-master-1 Jul 31 01:09:25.809287 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-bc5cc9c9-35e7-4cbf-bee7-e1f1e603d89a req-c0e29658-89d5-4813-9570-9f78e14073b5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049132 Jul 31 01:09:25.810557 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 453/898] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:25.818682 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b1166b08-ac45-4c4a-b85f-886fbc40f2ca tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:25.820438 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b1166b08-ac45-4c4a-b85f-886fbc40f2ca tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:25.829910 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b1166b08-ac45-4c4a-b85f-886fbc40f2ca tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:25.830376 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b1166b08-ac45-4c4a-b85f-886fbc40f2ca tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:25.834295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b1166b08-ac45-4c4a-b85f-886fbc40f2ca tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:25.835166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b1166b08-ac45-4c4a-b85f-886fbc40f2ca tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:26.784352 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b1166b08-ac45-4c4a-b85f-886fbc40f2ca tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:26.799754 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b1166b08-ac45-4c4a-b85f-886fbc40f2ca tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:26.802329 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b1166b08-ac45-4c4a-b85f-886fbc40f2ca tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:26.803642 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b1166b08-ac45-4c4a-b85f-886fbc40f2ca tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1605 microversion: 2.25 time: 0.991709 Jul 31 01:09:26.804497 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 454/899] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:09:25 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1605 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:09:26.817702 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-b8a40ed1-f1ba-42e2-b6d3-b6198854cc51 req-097a3cfa-c24e-475f-bffb-b17e4f55a91c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4348d2b8-83d0-4ed1-a5db-c1c19d0948fa", "name": "network-vif-plugged", "status": "completed", "tag": "caeac7e0-bb03-4fd5-86ff-b2e76cb264fc"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:26.849513 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b8a40ed1-f1ba-42e2-b6d3-b6198854cc51 req-097a3cfa-c24e-475f-bffb-b17e4f55a91c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:26.851024 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b8a40ed1-f1ba-42e2-b6d3-b6198854cc51 req-097a3cfa-c24e-475f-bffb-b17e4f55a91c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:26.871027 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-b8a40ed1-f1ba-42e2-b6d3-b6198854cc51 req-097a3cfa-c24e-475f-bffb-b17e4f55a91c service nova] Creating event network-vif-plugged:caeac7e0-bb03-4fd5-86ff-b2e76cb264fc for instance 4348d2b8-83d0-4ed1-a5db-c1c19d0948fa on n-h2-master-1 Jul 31 01:09:26.881217 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-b8a40ed1-f1ba-42e2-b6d3-b6198854cc51 req-097a3cfa-c24e-475f-bffb-b17e4f55a91c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073949 Jul 31 01:09:26.884913 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 455/900] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:26.899520 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-359f0bf1-80e4-47e2-a9e5-8a77d9b424a1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:26.900960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-359f0bf1-80e4-47e2-a9e5-8a77d9b424a1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:26.911906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-359f0bf1-80e4-47e2-a9e5-8a77d9b424a1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:26.912750 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-359f0bf1-80e4-47e2-a9e5-8a77d9b424a1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:26.914021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-359f0bf1-80e4-47e2-a9e5-8a77d9b424a1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:26.914736 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-359f0bf1-80e4-47e2-a9e5-8a77d9b424a1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:27.193442 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-139a50e3-3567-4473-bc86-6087046f8088 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/512d7cfb-9449-4c7b-97be-da38548f477c" status: 202 len: 0 microversion: 2.1 time: 1.530615 Jul 31 01:09:27.194022 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 446/901] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:09:25 2022] DELETE /compute/v2.1/os-security-groups/512d7cfb-9449-4c7b-97be-da38548f477c => generated 0 bytes in 1533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:09:27.201037 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3e4d2e29-a7b6-4028-aea6-fb0a327d7ec8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:27.201667 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3e4d2e29-a7b6-4028-aea6-fb0a327d7ec8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:27.222323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e4d2e29-a7b6-4028-aea6-fb0a327d7ec8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:27.226599 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e4d2e29-a7b6-4028-aea6-fb0a327d7ec8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:27.229718 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e4d2e29-a7b6-4028-aea6-fb0a327d7ec8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:27.233576 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e4d2e29-a7b6-4028-aea6-fb0a327d7ec8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:27.496230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-359f0bf1-80e4-47e2-a9e5-8a77d9b424a1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:27.512006 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-359f0bf1-80e4-47e2-a9e5-8a77d9b424a1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1537 microversion: 2.1 time: 0.624171 Jul 31 01:09:27.515531 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 456/902] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:26 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1537 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:27.522684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-004891ad-fe35-4ac3-8db9-0b763a6c31a1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:27.523717 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-004891ad-fe35-4ac3-8db9-0b763a6c31a1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:27.538394 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-004891ad-fe35-4ac3-8db9-0b763a6c31a1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:27.543231 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-004891ad-fe35-4ac3-8db9-0b763a6c31a1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:27.550193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-004891ad-fe35-4ac3-8db9-0b763a6c31a1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:27.553734 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-004891ad-fe35-4ac3-8db9-0b763a6c31a1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:27.605085 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3e4d2e29-a7b6-4028-aea6-fb0a327d7ec8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:27.619152 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3e4d2e29-a7b6-4028-aea6-fb0a327d7ec8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7" status: 200 len: 1319 microversion: 2.1 time: 0.422676 Jul 31 01:09:27.620474 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 447/903] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:27 2022] GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7 => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:27.627846 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-305c4526-c269-4e89-93c6-16ea27d12f74 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:27.628342 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-305c4526-c269-4e89-93c6-16ea27d12f74 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:27.639139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-305c4526-c269-4e89-93c6-16ea27d12f74 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:27.639628 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-305c4526-c269-4e89-93c6-16ea27d12f74 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:27.640502 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-305c4526-c269-4e89-93c6-16ea27d12f74 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:27.641402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-305c4526-c269-4e89-93c6-16ea27d12f74 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:27.802167 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-004891ad-fe35-4ac3-8db9-0b763a6c31a1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:27.812288 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-004891ad-fe35-4ac3-8db9-0b763a6c31a1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1292 microversion: 2.1 time: 0.295022 Jul 31 01:09:27.828088 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 457/904] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:27 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1292 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:27.833324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ca21b9be-e813-4de3-a575-f451263ecd22 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Calling method '.version_select at 0x7fede57a6b80>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:27.934231 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-305c4526-c269-4e89-93c6-16ea27d12f74 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.310686 Jul 31 01:09:27.936811 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 448/905] 10.222.0.45 () {60 vars in 1316 bytes} [Sun Jul 31 01:09:27 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-interface => generated 284 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:09:28.220436 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ca21b9be-e813-4de3-a575-f451263ecd22 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/b0cdbf78-b81f-4e1b-86c6-0feb2a40b711" status: 200 len: 245 microversion: 2.1 time: 0.390301 Jul 31 01:09:28.233129 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 458/906] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 01:09:27 2022] GET /compute/v2.1/os-security-groups/b0cdbf78-b81f-4e1b-86c6-0feb2a40b711 => generated 245 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:28.241618 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ae03e991-990f-44c0-9c77-892349e9b84d tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Action: 'create', calling method: .version_select at 0x7fede57a6f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1376886431", "description": "tempest-description-2121570045"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:28.262861 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-964eaabc-f9ac-4200-b2da-caf3f83fb577 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Action: 'create', calling method: .version_select at 0x7fede5986940>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMNBhROvYE5gtXsARuIfG2SknU1gh3znuQK0685zUKKQOapCe+Pmec8sZWKzWS1+RY93WRZ0R9DPrmktBnBtjaSmHxe9kyo5Gx4WD3pErYiFoOavJNLkLK2mrvvxTdKVg=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-964eaabc-f9ac-4200-b2da-caf3f83fb577 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Request method failure captured: Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 257 Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dZH--RoP2d5Le2SR6rVDVVgWSgD79JhJbixwpqm1EMpUTsj_UHuIpOZun_BgOhE9Z0tjBZI0kiLQsgpqcFDumsMAPJt2hElf0frcoc6xX85vM1q8VLKVHrONkeKnYL6YNejueEGdkEtHRLMOFKnIot23iarhsVaZg7tTDHfMj8_itQ Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: b7a8a0edc75b4eb3bf0aac593c767e0f Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:09:28.279983 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:09:28.282349 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b7a8a0edc75b4eb3bf0aac593c767e0f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:09:28.282349 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:28.282349 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: b7a8a0edc75b4eb3bf0aac593c767e0f Jul 31 01:09:28.282349 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:28.282349 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-KeyPairsNegativeTestJSON-2060683752-project Jul 31 01:09:28.282349 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:09:28.282349 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:09:28.282349 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 7ab6d6fc0aee4b1a85ace3ac65e90cdc Jul 31 01:09:28.282349 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2060683752-project Jul 31 01:09:28.282349 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:09:28.282349 n-d-master-1 devstack@n-api.service[119474]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMNBhROvYE5gtXsARuIfG2SknU1gh3znuQK0685zUKKQOapCe+Pmec8sZWKzWS1+RY93WRZ0R9DPrmktBnBtjaSmHxe9kyo5Gx4WD3pErYiFoOavJNLkLK2mrvvxTdKVg=="}} Jul 31 01:09:28.282349 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMNBhROvYE5gtXsARuIfG2SknU1gh3znuQK0685zUKKQOapCe+Pmec8sZWKzWS1+RY93WRZ0R9DPrmktBnBtjaSmHxe9kyo5Gx4WD3pErYiFoOavJNLkLK2mrvvxTdKVg=='}}} Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:09:28.283208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'minLength': 1, Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:09:28.285749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:09:28.289289 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:09:28.293195 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Jul 31 01:09:28.293195 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.293195 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-964eaabc-f9ac-4200-b2da-caf3f83fb577 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:09:28.293195 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-964eaabc-f9ac-4200-b2da-caf3f83fb577 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.351003 Jul 31 01:09:28.293195 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 449/907] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:09:27 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 353 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:09:28.315664 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9eb799c3-441f-4da2-bc28-a7a55f07fe3d tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Action: 'create', calling method: .version_select at 0x7fede58b4700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-141191954", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:28.368399 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9eb799c3-441f-4da2-bc28-a7a55f07fe3d tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Getting quotas for project b7a8a0edc75b4eb3bf0aac593c767e0f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:28.383634 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9eb799c3-441f-4da2-bc28-a7a55f07fe3d tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Getting quotas for user 7ab6d6fc0aee4b1a85ace3ac65e90cdc and project b7a8a0edc75b4eb3bf0aac593c767e0f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:28.433345 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-9eb799c3-441f-4da2-bc28-a7a55f07fe3d tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9eb799c3-441f-4da2-bc28-a7a55f07fe3d tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Request method failure captured: Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 2166 Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dZH--RoP2d5Le2SR6rVDVVgWSgD79JhJbixwpqm1EMpUTsj_UHuIpOZun_BgOhE9Z0tjBZI0kiLQsgpqcFDumsMAPJt2hElf0frcoc6xX85vM1q8VLKVHrONkeKnYL6YNejueEGdkEtHRLMOFKnIot23iarhsVaZg7tTDHfMj8_itQ Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: b7a8a0edc75b4eb3bf0aac593c767e0f Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b7a8a0edc75b4eb3bf0aac593c767e0f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: b7a8a0edc75b4eb3bf0aac593c767e0f Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-KeyPairsNegativeTestJSON-2060683752-project Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 7ab6d6fc0aee4b1a85ace3ac65e90cdc Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2060683752-project Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-141191954", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:09:28.445522 n-d-master-1 devstack@n-api.service[119474]: exception: Keypair data is invalid: failed to generate fingerprint Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-141191954', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:09:28.448375 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 31 01:09:28.457246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.462325 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9eb799c3-441f-4da2-bc28-a7a55f07fe3d tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:09:28.462325 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9eb799c3-441f-4da2-bc28-a7a55f07fe3d tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.164930 Jul 31 01:09:28.462325 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 450/908] 10.222.0.45 () {60 vars in 1160 bytes} [Sun Jul 31 01:09:28 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:28.475774 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5e0f8ea8-7225-4f34-ac33-ac47ad87b6b2 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Action: 'create', calling method: .version_select at 0x7fede584caf0>, body: {"keypair": {"name": "tempest-keypair-189015618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGREbraF3hheaQyl4v4/eJ3/8SdYDNojA9UQdI/+oIeX/FFh2WDRrE6jy3eypT3LwZ5IEXM7clrHidELX/zHgSrlQpOOvZU3NPFmiYhEB9mJA4naS7TLv1MP5BQkSF/3Rw=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:28.505249 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5e0f8ea8-7225-4f34-ac33-ac47ad87b6b2 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Getting quotas for project b7a8a0edc75b4eb3bf0aac593c767e0f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:28.512071 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5e0f8ea8-7225-4f34-ac33-ac47ad87b6b2 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Getting quotas for user 7ab6d6fc0aee4b1a85ace3ac65e90cdc and project b7a8a0edc75b4eb3bf0aac593c767e0f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:28.559592 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5e0f8ea8-7225-4f34-ac33-ac47ad87b6b2 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087850 Jul 31 01:09:28.562876 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 451/909] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:09:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:28.570886 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0b10a778-fbb0-45e0-b29d-2c177e98bd3f tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:28.574904 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0b10a778-fbb0-45e0-b29d-2c177e98bd3f tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:28.589500 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b10a778-fbb0-45e0-b29d-2c177e98bd3f tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:28.590500 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b10a778-fbb0-45e0-b29d-2c177e98bd3f tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:28.591806 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b10a778-fbb0-45e0-b29d-2c177e98bd3f tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:28.592499 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b10a778-fbb0-45e0-b29d-2c177e98bd3f tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:28.773767 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ae03e991-990f-44c0-9c77-892349e9b84d tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.537487 Jul 31 01:09:28.784942 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 459/910] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:09:28 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:28.802559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e4045dbc-6f85-4ac6-87b5-20a2394a9547 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Action: 'create', calling method: .version_select at 0x7fede57af790>, body: {"keypair": {"name": "tempest-keypair-189015618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1hiy6NKxUxmtdsmkQsQxicDAnt3ds/oIegvwrb3lk6LQ1qs7zFwnNFOf6TYy+NZmLrnEn0Hp21gycq6Yja49Pg02UmWr6lrdsxczQz3lxkATjgmFd71cfjU02Ic3vlWg=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:28.864806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-e4045dbc-6f85-4ac6-87b5-20a2394a9547 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Getting quotas for project b7a8a0edc75b4eb3bf0aac593c767e0f. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:28.882834 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-e4045dbc-6f85-4ac6-87b5-20a2394a9547 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Getting quotas for user 7ab6d6fc0aee4b1a85ace3ac65e90cdc and project b7a8a0edc75b4eb3bf0aac593c767e0f. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:28.889699 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0b10a778-fbb0-45e0-b29d-2c177e98bd3f tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:28.917163 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0b10a778-fbb0-45e0-b29d-2c177e98bd3f tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1537 microversion: 2.1 time: 0.350022 Jul 31 01:09:28.920722 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 452/911] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:28 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1537 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:28.943582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-249871d8-140f-4f89-b0a2-c668ce140d4a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:28.948569 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-249871d8-140f-4f89-b0a2-c668ce140d4a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:28.952000 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-e4045dbc-6f85-4ac6-87b5-20a2394a9547 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] HTTP exception thrown: Key pair 'tempest-keypair-189015618' already exists. Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e4045dbc-6f85-4ac6-87b5-20a2394a9547 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Request method failure captured: Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 272 Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dZH--RoP2d5Le2SR6rVDVVgWSgD79JhJbixwpqm1EMpUTsj_UHuIpOZun_BgOhE9Z0tjBZI0kiLQsgpqcFDumsMAPJt2hElf0frcoc6xX85vM1q8VLKVHrONkeKnYL6YNejueEGdkEtHRLMOFKnIot23iarhsVaZg7tTDHfMj8_itQ Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: b7a8a0edc75b4eb3bf0aac593c767e0f Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b7a8a0edc75b4eb3bf0aac593c767e0f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: b7a8a0edc75b4eb3bf0aac593c767e0f Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-KeyPairsNegativeTestJSON-2060683752-project Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 7ab6d6fc0aee4b1a85ace3ac65e90cdc Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2060683752-project Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: {"keypair": {"name": "tempest-keypair-189015618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1hiy6NKxUxmtdsmkQsQxicDAnt3ds/oIegvwrb3lk6LQ1qs7zFwnNFOf6TYy+NZmLrnEn0Hp21gycq6Yja49Pg02UmWr6lrdsxczQz3lxkATjgmFd71cfjU02Ic3vlWg=="}} Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: exception: Key pair 'tempest-keypair-189015618' already exists. Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-189015618', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1hiy6NKxUxmtdsmkQsQxicDAnt3ds/oIegvwrb3lk6LQ1qs7zFwnNFOf6TYy+NZmLrnEn0Hp21gycq6Yja49Pg02UmWr6lrdsxczQz3lxkATjgmFd71cfjU02Ic3vlWg=='}}} Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result.read() Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '7ab6d6fc0aee4b1a85ace3ac65e90cdc-tempest-keypair-189015618' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 31 01:09:28.960976 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi session.flush() Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result.read() Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 31 01:09:28.969299 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '7ab6d6fc0aee4b1a85ace3ac65e90cdc-tempest-keypair-189015618' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 31, 1, 9, 28, 937554), 'updated_at': None, 'name': 'tempest-keypair-189015618', 'user_id': '7ab6d6fc0aee4b1a85ace3ac65e90cdc', 'fingerprint': 'a7:3f:52:12:5d:e3:17:50:45:51:99:7d:5e:5e:c1:fc', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1hiy6NKxUxmtdsmkQsQxicDAnt3ds/oIegvwrb3lk6LQ1qs7zFwnNFOf6TYy+NZmLrnEn0Hp21gycq6Yja49Pg02UmWr6lrdsxczQz3lxkATjgmFd71cfjU02Ic3vlWg==', 'type': 'ssh'}] Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6730, in import_key_pair Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi keypair.create() Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._create() Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-189015618' already exists. Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 31 01:09:28.980018 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-189015618' already exists. Jul 31 01:09:28.995737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.995737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:28.995737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.995737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:28.995737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:28.995737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:28.995737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:09:28.995737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:09:28.995737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-189015618' already exists. Jul 31 01:09:28.995737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:09:28.995737 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e4045dbc-6f85-4ac6-87b5-20a2394a9547 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Returning 409 to user: Key pair 'tempest-keypair-189015618' already exists. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:09:28.995737 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e4045dbc-6f85-4ac6-87b5-20a2394a9547 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.170274 Jul 31 01:09:28.995737 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 460/912] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:09:28 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:09:28.995737 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6fd4c18c-e0bc-47f2-bed1-1b07dc25be3b tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Action: 'create', calling method: .version_select at 0x7fede57a6790>, body: {"security_group_rule": {"parent_group_id": "4f29fd3d-2527-4f8c-857c-4657c327a37d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:28.998431 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-249871d8-140f-4f89-b0a2-c668ce140d4a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:28.998944 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-249871d8-140f-4f89-b0a2-c668ce140d4a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:29.000974 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-249871d8-140f-4f89-b0a2-c668ce140d4a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:29.002141 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-249871d8-140f-4f89-b0a2-c668ce140d4a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:29.454088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-249871d8-140f-4f89-b0a2-c668ce140d4a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:29.464797 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-249871d8-140f-4f89-b0a2-c668ce140d4a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7" status: 200 len: 1319 microversion: 2.1 time: 0.539453 Jul 31 01:09:29.466286 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 453/913] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:28 2022] GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7 => generated 1319 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:29.471799 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bd83a090-3d1f-4ab3-92a8-f769a5c66499 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:29.472667 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bd83a090-3d1f-4ab3-92a8-f769a5c66499 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:29.481340 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd83a090-3d1f-4ab3-92a8-f769a5c66499 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:29.481982 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd83a090-3d1f-4ab3-92a8-f769a5c66499 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:29.482949 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd83a090-3d1f-4ab3-92a8-f769a5c66499 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:29.483783 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd83a090-3d1f-4ab3-92a8-f769a5c66499 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:29.825582 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6fd4c18c-e0bc-47f2-bed1-1b07dc25be3b tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.850593 Jul 31 01:09:29.827003 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 461/914] 10.222.0.45 () {60 vars in 1195 bytes} [Sun Jul 31 01:09:28 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:29.834343 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ce95edcc-b070-4154-be0c-f0b585146856 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Calling method '.version_select at 0x7fede5a7bb80>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:29.862627 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ce95edcc-b070-4154-be0c-f0b585146856 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-189015618" status: 202 len: 0 microversion: 2.1 time: 0.034223 Jul 31 01:09:29.863031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bd83a090-3d1f-4ab3-92a8-f769a5c66499 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:29.864161 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 462/915] 10.222.0.45 () {58 vars in 1218 bytes} [Sun Jul 31 01:09:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-189015618 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:09:29.870883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-8ce95bc5-187f-4ff5-9961-1d863f97605e req-e647658c-2211-438f-b252-c3a2a42c59ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de60c7a5-098d-44cb-99f0-1dc80f148df7", "name": "network-vif-plugged", "status": "completed", "tag": "eb60d01b-0896-4be2-ba48-c007231e1541"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:29.884237 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8ce95bc5-187f-4ff5-9961-1d863f97605e req-e647658c-2211-438f-b252-c3a2a42c59ed service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:29.885213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8ce95bc5-187f-4ff5-9961-1d863f97605e req-e647658c-2211-438f-b252-c3a2a42c59ed service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:29.895490 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bd83a090-3d1f-4ab3-92a8-f769a5c66499 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1360 microversion: 2.1 time: 0.427696 Jul 31 01:09:29.897741 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 454/916] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:29 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1360 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:29.913419 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-8ce95bc5-187f-4ff5-9961-1d863f97605e req-e647658c-2211-438f-b252-c3a2a42c59ed service nova] Creating event network-vif-plugged:eb60d01b-0896-4be2-ba48-c007231e1541 for instance de60c7a5-098d-44cb-99f0-1dc80f148df7 on n-h1-master-1 Jul 31 01:09:29.919837 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-8ce95bc5-187f-4ff5-9961-1d863f97605e req-e647658c-2211-438f-b252-c3a2a42c59ed service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054045 Jul 31 01:09:29.921406 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 463/917] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:29.927870 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-683b6a15-59e6-4fe4-b08f-d90f7eeaac25 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Action: 'create', calling method: .version_select at 0x7fede57b14c0>, body: {"security_group_rule": {"parent_group_id": "4f29fd3d-2527-4f8c-857c-4657c327a37d", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:30.051302 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-97f7181e-c12b-4e5e-bbdd-dd96c80654e7 tempest-InstanceUsageAuditLogTestJSON-605971893 tempest-InstanceUsageAuditLogTestJSON-605971893-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:30.052530 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:30.052530 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:09:30.076308 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-97f7181e-c12b-4e5e-bbdd-dd96c80654e7 tempest-InstanceUsageAuditLogTestJSON-605971893 tempest-InstanceUsageAuditLogTestJSON-605971893-project-admin] 10.222.0.45 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-31 01:09:29" status: 200 len: 318 microversion: 2.1 time: 0.176475 Jul 31 01:09:30.077263 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 455/918] 10.222.0.45 () {58 vars in 1251 bytes} [Sun Jul 31 01:09:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-31%2001%3A09%3A29 => generated 318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:30.090406 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ddb6e7b1-a680-49fa-946a-d74e6ea09475 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Action: 'create', calling method: .version_select at 0x7fede5994ca0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPclRZ9ajo+MV1wAkDnKXoRBv7xL4xD8XkhqL4kihZfMicuR1FGOjzT+t3d5uJrFHzcbcWl6+L9OgTwdtsBJNEZvsxMOW5BKMTVxJN4hGdxXMHGYLybRuKy2YL/fpum1kw=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ddb6e7b1-a680-49fa-946a-d74e6ea09475 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Request method failure captured: Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 247 Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dZH--RoP2d5Le2SR6rVDVVgWSgD79JhJbixwpqm1EMpUTsj_UHuIpOZun_BgOhE9Z0tjBZI0kiLQsgpqcFDumsMAPJt2hElf0frcoc6xX85vM1q8VLKVHrONkeKnYL6YNejueEGdkEtHRLMOFKnIot23iarhsVaZg7tTDHfMj8_itQ Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: b7a8a0edc75b4eb3bf0aac593c767e0f Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b7a8a0edc75b4eb3bf0aac593c767e0f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: b7a8a0edc75b4eb3bf0aac593c767e0f Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-KeyPairsNegativeTestJSON-2060683752-project Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 7ab6d6fc0aee4b1a85ace3ac65e90cdc Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2060683752-project Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPclRZ9ajo+MV1wAkDnKXoRBv7xL4xD8XkhqL4kihZfMicuR1FGOjzT+t3d5uJrFHzcbcWl6+L9OgTwdtsBJNEZvsxMOW5BKMTVxJN4hGdxXMHGYLybRuKy2YL/fpum1kw=="}} Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPclRZ9ajo+MV1wAkDnKXoRBv7xL4xD8XkhqL4kihZfMicuR1FGOjzT+t3d5uJrFHzcbcWl6+L9OgTwdtsBJNEZvsxMOW5BKMTVxJN4hGdxXMHGYLybRuKy2YL/fpum1kw=='}}} Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi '' Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:09:30.094973 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:09:30.099188 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:09:30.099188 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:09:30.099188 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:09:30.099188 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:09:30.099188 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 31 01:09:30.099188 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.099188 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:30.099188 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.099188 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:30.099188 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:30.099188 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:30.099188 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:09:30.099188 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:09:30.099188 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 31 01:09:30.099188 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.102350 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ddb6e7b1-a680-49fa-946a-d74e6ea09475 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:09:30.103301 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ddb6e7b1-a680-49fa-946a-d74e6ea09475 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.024761 Jul 31 01:09:30.104053 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 456/919] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:09:30 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:09:30.113559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e15c2402-1358-4596-a5e7-a7f4086e7d86 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:30.114397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e15c2402-1358-4596-a5e7-a7f4086e7d86 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:30.122406 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e15c2402-1358-4596-a5e7-a7f4086e7d86 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:30.122865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e15c2402-1358-4596-a5e7-a7f4086e7d86 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:30.123897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e15c2402-1358-4596-a5e7-a7f4086e7d86 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:30.124343 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e15c2402-1358-4596-a5e7-a7f4086e7d86 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:30.486679 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e15c2402-1358-4596-a5e7-a7f4086e7d86 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:30.495010 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e15c2402-1358-4596-a5e7-a7f4086e7d86 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1537 microversion: 2.1 time: 0.389342 Jul 31 01:09:30.496082 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 457/920] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:30 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1537 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:30.511931 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c9270256-dc16-40b6-bcb8-a1703e78ae6e tempest-InstanceUsageAuditLogTestJSON-605971893 tempest-InstanceUsageAuditLogTestJSON-605971893-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:30.512748 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:30.512748 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:09:30.533650 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c9270256-dc16-40b6-bcb8-a1703e78ae6e tempest-InstanceUsageAuditLogTestJSON-605971893 tempest-InstanceUsageAuditLogTestJSON-605971893-project-admin] 10.222.0.45 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.035997 Jul 31 01:09:30.542982 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 458/921] 10.222.0.45 () {58 vars in 1185 bytes} [Sun Jul 31 01:09:30 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:30.542982 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-24c9f0e5-aea2-4a58-85ad-33a5d1c35204 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Action: 'create', calling method: .version_select at 0x7fede588fa60>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1710808614", "public_key": " "}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:30.568982 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-24c9f0e5-aea2-4a58-85ad-33a5d1c35204 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Getting quotas for project b7a8a0edc75b4eb3bf0aac593c767e0f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:30.575977 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-24c9f0e5-aea2-4a58-85ad-33a5d1c35204 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Getting quotas for user 7ab6d6fc0aee4b1a85ace3ac65e90cdc and project b7a8a0edc75b4eb3bf0aac593c767e0f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:30.606391 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-24c9f0e5-aea2-4a58-85ad-33a5d1c35204 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-24c9f0e5-aea2-4a58-85ad-33a5d1c35204 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Request method failure captured: Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 95 Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dZH--RoP2d5Le2SR6rVDVVgWSgD79JhJbixwpqm1EMpUTsj_UHuIpOZun_BgOhE9Z0tjBZI0kiLQsgpqcFDumsMAPJt2hElf0frcoc6xX85vM1q8VLKVHrONkeKnYL6YNejueEGdkEtHRLMOFKnIot23iarhsVaZg7tTDHfMj8_itQ Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: b7a8a0edc75b4eb3bf0aac593c767e0f Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b7a8a0edc75b4eb3bf0aac593c767e0f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: b7a8a0edc75b4eb3bf0aac593c767e0f Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-KeyPairsNegativeTestJSON-2060683752-project Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 7ab6d6fc0aee4b1a85ace3ac65e90cdc Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2060683752-project Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1710808614", "public_key": " "}} Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: exception: Keypair data is invalid: failed to generate fingerprint Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1710808614', 'public_key': ' '}}} Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:30.608275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-24c9f0e5-aea2-4a58-85ad-33a5d1c35204 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:09:30.614298 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-24c9f0e5-aea2-4a58-85ad-33a5d1c35204 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.074033 Jul 31 01:09:30.617634 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-683b6a15-59e6-4fe4-b08f-d90f7eeaac25 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.686257 Jul 31 01:09:30.617774 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 459/922] 10.222.0.45 () {60 vars in 1158 bytes} [Sun Jul 31 01:09:30 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:30.618828 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 464/923] 10.222.0.45 () {60 vars in 1195 bytes} [Sun Jul 31 01:09:29 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:30.627130 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-75d674e4-b548-41ac-a4d6-f7639828fb0b req-1ace1d4d-ecd5-4fac-bc1a-cc5ad52c4750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011dbabc-56cc-4f90-be60-972ffeb468b1", "tag": "4bf6b045-f27a-43d0-a436-872ac90dc24a"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:30.629739 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e0069166-b16d-4c23-ac63-a0f1f3991dd8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:30.630576 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e0069166-b16d-4c23-ac63-a0f1f3991dd8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:30.638229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-75d674e4-b548-41ac-a4d6-f7639828fb0b req-1ace1d4d-ecd5-4fac-bc1a-cc5ad52c4750 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:30.638693 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-75d674e4-b548-41ac-a4d6-f7639828fb0b req-1ace1d4d-ecd5-4fac-bc1a-cc5ad52c4750 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:30.642652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e0069166-b16d-4c23-ac63-a0f1f3991dd8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:30.647756 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e0069166-b16d-4c23-ac63-a0f1f3991dd8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:30.649773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e0069166-b16d-4c23-ac63-a0f1f3991dd8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:30.651386 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e0069166-b16d-4c23-ac63-a0f1f3991dd8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:30.658409 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-75d674e4-b548-41ac-a4d6-f7639828fb0b req-1ace1d4d-ecd5-4fac-bc1a-cc5ad52c4750 service nova] Creating event network-changed:4bf6b045-f27a-43d0-a436-872ac90dc24a for instance 011dbabc-56cc-4f90-be60-972ffeb468b1 on n-h1-master-1 Jul 31 01:09:30.666736 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-75d674e4-b548-41ac-a4d6-f7639828fb0b req-1ace1d4d-ecd5-4fac-bc1a-cc5ad52c4750 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047133 Jul 31 01:09:30.667358 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 460/924] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:30.684501 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0c6f6380-acca-418f-8e31-8b6d7ab0a27b tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Action: 'create', calling method: .version_select at 0x7fede5994f70>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnRpf6dqsBnJeka/VCUZCuMNimhYZydVBK4vhbnxkDHmYqzgpWLZvVwuuvvX9/t+Oi4pbaqRfXbx+iWEDRpcVkuXYuwjrSQ0wzCCfMkC0L9fiEHpuitKoW63BLrr1hffQ=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0c6f6380-acca-418f-8e31-8b6d7ab0a27b tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Request method failure captured: Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 507 Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dZH--RoP2d5Le2SR6rVDVVgWSgD79JhJbixwpqm1EMpUTsj_UHuIpOZun_BgOhE9Z0tjBZI0kiLQsgpqcFDumsMAPJt2hElf0frcoc6xX85vM1q8VLKVHrONkeKnYL6YNejueEGdkEtHRLMOFKnIot23iarhsVaZg7tTDHfMj8_itQ Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: b7a8a0edc75b4eb3bf0aac593c767e0f Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b7a8a0edc75b4eb3bf0aac593c767e0f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: b7a8a0edc75b4eb3bf0aac593c767e0f Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-KeyPairsNegativeTestJSON-2060683752-project Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 7ab6d6fc0aee4b1a85ace3ac65e90cdc Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2060683752-project Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnRpf6dqsBnJeka/VCUZCuMNimhYZydVBK4vhbnxkDHmYqzgpWLZvVwuuvvX9/t+Oi4pbaqRfXbx+iWEDRpcVkuXYuwjrSQ0wzCCfMkC0L9fiEHpuitKoW63BLrr1hffQ=="}} Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnRpf6dqsBnJeka/VCUZCuMNimhYZydVBK4vhbnxkDHmYqzgpWLZvVwuuvvX9/t+Oi4pbaqRfXbx+iWEDRpcVkuXYuwjrSQ0wzCCfMkC0L9fiEHpuitKoW63BLrr1hffQ=='}}} Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 31 01:09:30.689272 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0c6f6380-acca-418f-8e31-8b6d7ab0a27b tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:09:30.692640 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0c6f6380-acca-418f-8e31-8b6d7ab0a27b tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.020567 Jul 31 01:09:30.700354 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 461/925] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:09:30 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:09:30.717949 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4eeef647-1d2d-4194-bc25-737134efd0ff tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Calling method '.version_select at 0x7fede58d7550>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:30.859061 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4eeef647-1d2d-4194-bc25-737134efd0ff tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/4f29fd3d-2527-4f8c-857c-4657c327a37d" status: 200 len: 665 microversion: 2.1 time: 0.157533 Jul 31 01:09:30.860680 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 462/926] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 01:09:30 2022] GET /compute/v2.1/os-security-groups/4f29fd3d-2527-4f8c-857c-4657c327a37d => generated 665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:30.867587 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d0b7b64c-7181-4ef0-aafc-e5361fb9de11 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Action: 'create', calling method: .version_select at 0x7fede587bdc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1220334296", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:30.895590 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-d0b7b64c-7181-4ef0-aafc-e5361fb9de11 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Getting quotas for project b7a8a0edc75b4eb3bf0aac593c767e0f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:30.905918 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-d0b7b64c-7181-4ef0-aafc-e5361fb9de11 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Getting quotas for user 7ab6d6fc0aee4b1a85ace3ac65e90cdc and project b7a8a0edc75b4eb3bf0aac593c767e0f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:30.918489 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e0069166-b16d-4c23-ac63-a0f1f3991dd8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:30.927176 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e0069166-b16d-4c23-ac63-a0f1f3991dd8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7" status: 200 len: 1319 microversion: 2.1 time: 0.306917 Jul 31 01:09:30.928238 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 465/927] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:30 2022] GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:30.933100 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-b5c56435-d0ac-4656-a7dc-6378c2bd93cf req-be04ec47-02c2-4d55-810c-8849d104fe80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "502a7c35-a8fe-4ace-85d5-bb115f8423fa", "tag": "c430395e-d6b3-4f00-927f-f84a47151b4c"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:30.933335 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-d0b7b64c-7181-4ef0-aafc-e5361fb9de11 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d0b7b64c-7181-4ef0-aafc-e5361fb9de11 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Request method failure captured: Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 118 Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dZH--RoP2d5Le2SR6rVDVVgWSgD79JhJbixwpqm1EMpUTsj_UHuIpOZun_BgOhE9Z0tjBZI0kiLQsgpqcFDumsMAPJt2hElf0frcoc6xX85vM1q8VLKVHrONkeKnYL6YNejueEGdkEtHRLMOFKnIot23iarhsVaZg7tTDHfMj8_itQ Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: b7a8a0edc75b4eb3bf0aac593c767e0f Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b7a8a0edc75b4eb3bf0aac593c767e0f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: b7a8a0edc75b4eb3bf0aac593c767e0f Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-KeyPairsNegativeTestJSON-2060683752-project Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 7ab6d6fc0aee4b1a85ace3ac65e90cdc Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2060683752-project Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1220334296", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: exception: Keypair data is invalid: failed to generate fingerprint Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1220334296', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Jul 31 01:09:30.935734 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d0b7b64c-7181-4ef0-aafc-e5361fb9de11 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d0b7b64c-7181-4ef0-aafc-e5361fb9de11 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.076398 Jul 31 01:09:30.943556 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 463/928] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:09:30 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:30.952630 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-278e51e0-82f9-466b-b801-0ffc5327105f tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Calling method '.version_select at 0x7fede58ecdc0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:30.953670 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b5c56435-d0ac-4656-a7dc-6378c2bd93cf req-be04ec47-02c2-4d55-810c-8849d104fe80 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:30.954220 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b5c56435-d0ac-4656-a7dc-6378c2bd93cf req-be04ec47-02c2-4d55-810c-8849d104fe80 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:30.966089 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-b5c56435-d0ac-4656-a7dc-6378c2bd93cf req-be04ec47-02c2-4d55-810c-8849d104fe80 service nova] Creating event network-changed:c430395e-d6b3-4f00-927f-f84a47151b4c for instance 502a7c35-a8fe-4ace-85d5-bb115f8423fa on n-h1-master-1 Jul 31 01:09:30.973850 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-b5c56435-d0ac-4656-a7dc-6378c2bd93cf req-be04ec47-02c2-4d55-810c-8849d104fe80 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043521 Jul 31 01:09:30.974481 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 466/929] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:30.981668 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3248c0f4-96ef-43e8-8e79-e4591c335f3e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:30.982518 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3248c0f4-96ef-43e8-8e79-e4591c335f3e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:30.991144 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3248c0f4-96ef-43e8-8e79-e4591c335f3e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:30.992166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3248c0f4-96ef-43e8-8e79-e4591c335f3e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:30.997368 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3248c0f4-96ef-43e8-8e79-e4591c335f3e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:30.998070 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3248c0f4-96ef-43e8-8e79-e4591c335f3e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:31.304991 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-278e51e0-82f9-466b-b801-0ffc5327105f tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-group-rules/22d0cd21-9d95-4d97-8c74-d42578e1bfa9" status: 202 len: 0 microversion: 2.1 time: 0.363515 Jul 31 01:09:31.305811 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 464/930] 10.222.0.45 () {58 vars in 1287 bytes} [Sun Jul 31 01:09:30 2022] DELETE /compute/v2.1/os-security-group-rules/22d0cd21-9d95-4d97-8c74-d42578e1bfa9 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:09:31.315162 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3248c0f4-96ef-43e8-8e79-e4591c335f3e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:31.315309 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-078d5978-7dde-40ee-a5db-18ef209e0ec9 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Calling method '.version_select at 0x7fede7fc6040>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:31.339594 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3248c0f4-96ef-43e8-8e79-e4591c335f3e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1360 microversion: 2.1 time: 0.359792 Jul 31 01:09:31.340860 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 467/931] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:30 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1360 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:31.345881 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bc6f7e8d-cec8-4b0c-ae0c-bc44d603bb0e tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Calling method '.version_select at 0x7fede57b1dc0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:31.354603 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-078d5978-7dde-40ee-a5db-18ef209e0ec9 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1097207167 not found for user 7ab6d6fc0aee4b1a85ace3ac65e90cdc Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-078d5978-7dde-40ee-a5db-18ef209e0ec9 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Request method failure captured: Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1097207167 HTTP/1.1 Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dZH--RoP2d5Le2SR6rVDVVgWSgD79JhJbixwpqm1EMpUTsj_UHuIpOZun_BgOhE9Z0tjBZI0kiLQsgpqcFDumsMAPJt2hElf0frcoc6xX85vM1q8VLKVHrONkeKnYL6YNejueEGdkEtHRLMOFKnIot23iarhsVaZg7tTDHfMj8_itQ Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: b7a8a0edc75b4eb3bf0aac593c767e0f Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b7a8a0edc75b4eb3bf0aac593c767e0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b7a8a0edc75b4eb3bf0aac593c767e0f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: b7a8a0edc75b4eb3bf0aac593c767e0f Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2060683752 Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-KeyPairsNegativeTestJSON-2060683752-project Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 7ab6d6fc0aee4b1a85ace3ac65e90cdc Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2060683752-project Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: exception: Keypair tempest-keypair-non-existent-1097207167 not found for user 7ab6d6fc0aee4b1a85ace3ac65e90cdc Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'tempest-keypair-non-existent-1097207167'} Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6814, in delete_key_pair Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6835, in get_key_pair Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1097207167 not found for user 7ab6d6fc0aee4b1a85ace3ac65e90cdc Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:31.356966 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1097207167 not found for user 7ab6d6fc0aee4b1a85ace3ac65e90cdc Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1097207167 not found for user 7ab6d6fc0aee4b1a85ace3ac65e90cdc Jul 31 01:09:31.361636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:31.365234 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-078d5978-7dde-40ee-a5db-18ef209e0ec9 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1097207167 not found for user 7ab6d6fc0aee4b1a85ace3ac65e90cdc {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:09:31.366361 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-078d5978-7dde-40ee-a5db-18ef209e0ec9 tempest-KeyPairsNegativeTestJSON-2060683752 tempest-KeyPairsNegativeTestJSON-2060683752-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1097207167" status: 404 len: 145 microversion: 2.1 time: 0.056623 Jul 31 01:09:31.367668 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 465/932] 10.222.0.45 () {58 vars in 1260 bytes} [Sun Jul 31 01:09:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1097207167 => generated 145 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:09:31.518816 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-33e0d014-b402-4591-9ce9-29c44e4cf2c9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:31.519727 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-33e0d014-b402-4591-9ce9-29c44e4cf2c9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:31.532154 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33e0d014-b402-4591-9ce9-29c44e4cf2c9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:31.532942 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33e0d014-b402-4591-9ce9-29c44e4cf2c9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:31.534205 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33e0d014-b402-4591-9ce9-29c44e4cf2c9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:31.534980 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33e0d014-b402-4591-9ce9-29c44e4cf2c9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:32.278096 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-33e0d014-b402-4591-9ce9-29c44e4cf2c9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:32.288355 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-33e0d014-b402-4591-9ce9-29c44e4cf2c9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1542 microversion: 2.1 time: 0.774194 Jul 31 01:09:32.288947 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 466/933] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:31 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1542 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:09:32.295061 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5939f0cc-60e9-46ed-b456-bde0d569b8a5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:32.295960 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5939f0cc-60e9-46ed-b456-bde0d569b8a5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:32.309346 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5939f0cc-60e9-46ed-b456-bde0d569b8a5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:32.310120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5939f0cc-60e9-46ed-b456-bde0d569b8a5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:32.310943 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5939f0cc-60e9-46ed-b456-bde0d569b8a5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:32.311451 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5939f0cc-60e9-46ed-b456-bde0d569b8a5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:32.543212 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bc6f7e8d-cec8-4b0c-ae0c-bc44d603bb0e tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/4f29fd3d-2527-4f8c-857c-4657c327a37d" status: 202 len: 0 microversion: 2.1 time: 1.200714 Jul 31 01:09:32.544289 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 468/934] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:09:31 2022] DELETE /compute/v2.1/os-security-groups/4f29fd3d-2527-4f8c-857c-4657c327a37d => generated 0 bytes in 1203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:09:32.568884 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-24d1bd3f-6558-445e-8c39-00eb17250154 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:32.572261 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-24d1bd3f-6558-445e-8c39-00eb17250154 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:32.596219 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24d1bd3f-6558-445e-8c39-00eb17250154 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:32.597118 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24d1bd3f-6558-445e-8c39-00eb17250154 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:32.598421 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24d1bd3f-6558-445e-8c39-00eb17250154 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:32.598960 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24d1bd3f-6558-445e-8c39-00eb17250154 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:32.772732 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5939f0cc-60e9-46ed-b456-bde0d569b8a5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:32.783291 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5939f0cc-60e9-46ed-b456-bde0d569b8a5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7" status: 200 len: 1469 microversion: 2.1 time: 0.492987 Jul 31 01:09:32.784719 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 467/935] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:32 2022] GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7 => generated 1469 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:32.791766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f6a2544b-553b-4665-afc6-d1cafbd84517 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Calling method '.version_select at 0x7fede58b4700>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:32.933112 n-d-master-1 devstack@n-api.service[119474]: DEBUG neutronclient.v2_0.client [None req-f6a2544b-553b-4665-afc6-d1cafbd84517 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 512d7cfb-9449-4c7b-97be-da38548f477c does not exist", "detail": ""}} {{(pid=119474) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:09:32.934407 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.security_group_api [None req-f6a2544b-553b-4665-afc6-d1cafbd84517 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Neutron security group 512d7cfb-9449-4c7b-97be-da38548f477c not found {{(pid=119474) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 31 01:09:32.935099 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-f6a2544b-553b-4665-afc6-d1cafbd84517 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] HTTP exception thrown: Security group 512d7cfb-9449-4c7b-97be-da38548f477c does not exist Jul 31 01:09:32.935099 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-0ec0f6d1-c84c-4041-8fcd-3a614e4b8205'] Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f6a2544b-553b-4665-afc6-d1cafbd84517 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Request method failure captured: Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/os-security-groups/512d7cfb-9449-4c7b-97be-da38548f477c HTTP/1.1 Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dY23vOLfauCkwbVv2xwdXlcD9bLGBmy_1r6x_sElIijug2zC0DWydysLHNK3-Pt2PRu6Tk4NaYX5uQAbJb6dN7s8ZpXHZynyDS7w80jKgG_17HJmUv8VCzh7W8AQJUFAsqJ5CajIDP0WebQu0o5fcyRkQ3O_fHob-P6J6qLsxA6diI Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 1d24cb91c88242d39f121e8df385a819 Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1925874247 Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1d24cb91c88242d39f121e8df385a819"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1d24cb91c88242d39f121e8df385a819"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1d24cb91c88242d39f121e8df385a819"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1d24cb91c88242d39f121e8df385a819", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1925874247 Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 1d24cb91c88242d39f121e8df385a819 Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1925874247 Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-SecurityGroupRulesTestJSON-1925874247-project Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 3b69b18cebee469e87dde3a31cd8e6c7 Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1925874247-project Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: exception: Security group 512d7cfb-9449-4c7b-97be-da38548f477c does not exist Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-0ec0f6d1-c84c-4041-8fcd-3a614e4b8205'] Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '512d7cfb-9449-4c7b-97be-da38548f477c'} Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:09:32.947216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 512d7cfb-9449-4c7b-97be-da38548f477c does not exist Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ec0f6d1-c84c-4041-8fcd-3a614e4b8205'] Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 512d7cfb-9449-4c7b-97be-da38548f477c does not exist Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ec0f6d1-c84c-4041-8fcd-3a614e4b8205'] Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 512d7cfb-9449-4c7b-97be-da38548f477c does not exist Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ec0f6d1-c84c-4041-8fcd-3a614e4b8205'] Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 512d7cfb-9449-4c7b-97be-da38548f477c does not exist Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ec0f6d1-c84c-4041-8fcd-3a614e4b8205'] Jul 31 01:09:32.951101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:32.956611 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f6a2544b-553b-4665-afc6-d1cafbd84517 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Returning 404 to user: Security group 512d7cfb-9449-4c7b-97be-da38548f477c does not exist Jul 31 01:09:32.956611 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-0ec0f6d1-c84c-4041-8fcd-3a614e4b8205'] {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:09:32.957782 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f6a2544b-553b-4665-afc6-d1cafbd84517 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/512d7cfb-9449-4c7b-97be-da38548f477c" status: 404 len: 194 microversion: 2.1 time: 0.171583 Jul 31 01:09:32.958657 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 468/936] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:09:32 2022] DELETE /compute/v2.1/os-security-groups/512d7cfb-9449-4c7b-97be-da38548f477c => generated 194 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:09:32.966785 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1099b5bf-a456-4238-b4f1-6196d7008ec5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:32.967696 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1099b5bf-a456-4238-b4f1-6196d7008ec5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 4348d2b8-83d0-4ed1-a5db-c1c19d0948fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:32.980736 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1099b5bf-a456-4238-b4f1-6196d7008ec5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:32.980736 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1099b5bf-a456-4238-b4f1-6196d7008ec5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:32.981403 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1099b5bf-a456-4238-b4f1-6196d7008ec5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:32.981956 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1099b5bf-a456-4238-b4f1-6196d7008ec5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:33.041092 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-24d1bd3f-6558-445e-8c39-00eb17250154 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:33.051038 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-24d1bd3f-6558-445e-8c39-00eb17250154 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1360 microversion: 2.1 time: 0.504169 Jul 31 01:09:33.065462 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 469/937] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:32 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1360 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:33.070640 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-045d9c1f-3ddb-4871-b367-bf39f4f47e9c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:33.076519 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-045d9c1f-3ddb-4871-b367-bf39f4f47e9c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:33.077517 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-045d9c1f-3ddb-4871-b367-bf39f4f47e9c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Searching by: {'deleted': False, 'project_id': '8234bed9d80f482ba5865459a5eba429'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:09:33.088269 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-045d9c1f-3ddb-4871-b367-bf39f4f47e9c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:33.088747 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-045d9c1f-3ddb-4871-b367-bf39f4f47e9c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:33.089684 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-045d9c1f-3ddb-4871-b367-bf39f4f47e9c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:33.090653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-045d9c1f-3ddb-4871-b367-bf39f4f47e9c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:33.125384 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.multi_cell_list [None req-045d9c1f-3ddb-4871-b367-bf39f4f47e9c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119475) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:09:33.167604 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-045d9c1f-3ddb-4871-b367-bf39f4f47e9c tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 338 microversion: 2.1 time: 0.100279 Jul 31 01:09:33.171506 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 470/938] 10.222.0.45 () {58 vars in 1125 bytes} [Sun Jul 31 01:09:33 2022] GET /compute/v2.1/servers => generated 338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:33.177068 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c6956225-0728-4e4e-aec3-5f7225d366fa tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Calling method '.version_select at 0x7fede5e2fca0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:33.385188 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1099b5bf-a456-4238-b4f1-6196d7008ec5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:33.394528 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1099b5bf-a456-4238-b4f1-6196d7008ec5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/4348d2b8-83d0-4ed1-a5db-c1c19d0948fa" status: 200 len: 1469 microversion: 2.1 time: 0.434720 Jul 31 01:09:33.409430 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 469/939] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:32 2022] GET /compute/v2.1/servers/4348d2b8-83d0-4ed1-a5db-c1c19d0948fa => generated 1469 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:33.416714 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-17a57927-9759-49fe-8df3-e71240a419a8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:33.422760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-17a57927-9759-49fe-8df3-e71240a419a8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:33.424382 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-17a57927-9759-49fe-8df3-e71240a419a8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Searching by: {'deleted': False, 'project_id': '8234bed9d80f482ba5865459a5eba429'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:09:33.433000 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17a57927-9759-49fe-8df3-e71240a419a8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:33.433802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17a57927-9759-49fe-8df3-e71240a419a8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:33.434959 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17a57927-9759-49fe-8df3-e71240a419a8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:33.435699 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17a57927-9759-49fe-8df3-e71240a419a8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:33.542531 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-17a57927-9759-49fe-8df3-e71240a419a8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:09:33.668286 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=67 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:33.680383 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-17a57927-9759-49fe-8df3-e71240a419a8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:33.683108 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c6956225-0728-4e4e-aec3-5f7225d366fa tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/b0cdbf78-b81f-4e1b-86c6-0feb2a40b711" status: 202 len: 0 microversion: 2.1 time: 0.510128 Jul 31 01:09:33.683600 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17a57927-9759-49fe-8df3-e71240a419a8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:33.683720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17a57927-9759-49fe-8df3-e71240a419a8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:33.688737 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 471/940] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:09:33 2022] DELETE /compute/v2.1/os-security-groups/b0cdbf78-b81f-4e1b-86c6-0feb2a40b711 => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:09:33.694176 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8073463c-0e4e-46a9-9061-ffbca67dd022 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:33.695616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8073463c-0e4e-46a9-9061-ffbca67dd022 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:33.703420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8073463c-0e4e-46a9-9061-ffbca67dd022 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:33.704554 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8073463c-0e4e-46a9-9061-ffbca67dd022 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:33.705702 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8073463c-0e4e-46a9-9061-ffbca67dd022 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:33.706376 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8073463c-0e4e-46a9-9061-ffbca67dd022 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:33.899483 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-17a57927-9759-49fe-8df3-e71240a419a8 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.489634 Jul 31 01:09:33.900585 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 470/941] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:09:33 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:33.941628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8073463c-0e4e-46a9-9061-ffbca67dd022 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:33.953027 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8073463c-0e4e-46a9-9061-ffbca67dd022 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1542 microversion: 2.1 time: 0.262772 Jul 31 01:09:33.954788 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 472/942] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:33 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1542 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:33.962933 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-75983571-f5ae-4827-b2f3-e893e005d778 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:33.972399 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-75983571-f5ae-4827-b2f3-e893e005d778 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:33.973172 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-75983571-f5ae-4827-b2f3-e893e005d778 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Searching by: {'reservation_id': 'r-3reoyoyy', 'deleted': False, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:09:33.979198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75983571-f5ae-4827-b2f3-e893e005d778 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:33.979636 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75983571-f5ae-4827-b2f3-e893e005d778 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:33.980414 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75983571-f5ae-4827-b2f3-e893e005d778 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:33.980865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75983571-f5ae-4827-b2f3-e893e005d778 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:34.088258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.multi_cell_list [None req-75983571-f5ae-4827-b2f3-e893e005d778 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119475) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:09:34.162709 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-75983571-f5ae-4827-b2f3-e893e005d778 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:34.170686 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75983571-f5ae-4827-b2f3-e893e005d778 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:34.171141 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75983571-f5ae-4827-b2f3-e893e005d778 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:34.264534 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0bae0ea6-aaa2-4761-a9c4-0f319f135141 tempest-AbsoluteLimitsTestJSON-1541344083 tempest-AbsoluteLimitsTestJSON-1541344083-project] Calling method '.version_select at 0x7fede57bde50>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:34.278403 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0bae0ea6-aaa2-4761-a9c4-0f319f135141 tempest-AbsoluteLimitsTestJSON-1541344083 tempest-AbsoluteLimitsTestJSON-1541344083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:34.278853 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0bae0ea6-aaa2-4761-a9c4-0f319f135141 tempest-AbsoluteLimitsTestJSON-1541344083 tempest-AbsoluteLimitsTestJSON-1541344083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:34.279872 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0bae0ea6-aaa2-4761-a9c4-0f319f135141 tempest-AbsoluteLimitsTestJSON-1541344083 tempest-AbsoluteLimitsTestJSON-1541344083-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:34.280473 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0bae0ea6-aaa2-4761-a9c4-0f319f135141 tempest-AbsoluteLimitsTestJSON-1541344083 tempest-AbsoluteLimitsTestJSON-1541344083-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:34.301853 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0bae0ea6-aaa2-4761-a9c4-0f319f135141 tempest-AbsoluteLimitsTestJSON-1541344083 tempest-AbsoluteLimitsTestJSON-1541344083-project] 10.222.0.45 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.399735 Jul 31 01:09:34.302460 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 471/943] 10.222.0.45 () {58 vars in 1122 bytes} [Sun Jul 31 01:09:33 2022] GET /compute/v2.1/limits => generated 511 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:34.314065 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8679d3c1-ed65-481c-9fac-46bfdd1baf2f tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Calling method '.version_select at 0x7fede57bd5e0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:34.319757 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-75983571-f5ae-4827-b2f3-e893e005d778 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/detail?reservation_id=r-3reoyoyy" status: 200 len: 2931 microversion: 2.1 time: 0.361940 Jul 31 01:09:34.336137 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 473/944] 10.222.0.45 () {58 vars in 1197 bytes} [Sun Jul 31 01:09:33 2022] GET /compute/v2.1/servers/detail?reservation_id=r-3reoyoyy => generated 2931 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:34.344323 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5e7f3d41-1753-4d0c-87a4-11e22728fb01 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:34.353739 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5e7f3d41-1753-4d0c-87a4-11e22728fb01 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016314 Jul 31 01:09:34.354720 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 474/945] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:09:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:34.360563 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1dac47fc-40c6-4844-a284-30cec07d666a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:34.361522 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1dac47fc-40c6-4844-a284-30cec07d666a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:34.369165 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1dac47fc-40c6-4844-a284-30cec07d666a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:34.369930 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1dac47fc-40c6-4844-a284-30cec07d666a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:34.370636 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1dac47fc-40c6-4844-a284-30cec07d666a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:34.371371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1dac47fc-40c6-4844-a284-30cec07d666a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:34.626036 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1dac47fc-40c6-4844-a284-30cec07d666a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:34.635612 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1dac47fc-40c6-4844-a284-30cec07d666a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1360 microversion: 2.1 time: 0.279570 Jul 31 01:09:34.636802 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 475/946] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:34 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1360 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:34.642224 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-55c7ed71-35ef-4b75-a578-6144b64d2b73 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:34.675708 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.compute.server_groups [None req-55c7ed71-35ef-4b75-a578-6144b64d2b73 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Querying cell b79bbab3-22fe-4aca-b591-999750c84479(cell1) for 2 instances {{(pid=119475) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 31 01:09:34.676551 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55c7ed71-35ef-4b75-a578-6144b64d2b73 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:34.676999 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55c7ed71-35ef-4b75-a578-6144b64d2b73 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:34.691973 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8679d3c1-ed65-481c-9fac-46bfdd1baf2f tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/662ddc6c-1494-4af7-baa4-0ee570b5f4e9" status: 202 len: 0 microversion: 2.1 time: 0.387750 Jul 31 01:09:34.696083 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 472/947] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:09:34 2022] DELETE /compute/v2.1/os-security-groups/662ddc6c-1494-4af7-baa4-0ee570b5f4e9 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:09:34.707899 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c1e0355a-5746-4c89-97ea-a403a0c556e2 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Calling method '.version_select at 0x7fede5994550>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:34.715375 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-55c7ed71-35ef-4b75-a578-6144b64d2b73 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups/7ddb39b3-d430-4b24-9798-46b98528ce49" status: 200 len: 271 microversion: 2.1 time: 0.076627 Jul 31 01:09:34.716209 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 476/948] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:09:34 2022] GET /compute/v2.1/os-server-groups/7ddb39b3-d430-4b24-9798-46b98528ce49 => generated 271 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:34.731780 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0609b0db-6850-450b-8f24-4c1d15e6b08f tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:34.732634 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0609b0db-6850-450b-8f24-4c1d15e6b08f tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:34.742484 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0609b0db-6850-450b-8f24-4c1d15e6b08f tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:34.744131 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0609b0db-6850-450b-8f24-4c1d15e6b08f tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:34.745309 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0609b0db-6850-450b-8f24-4c1d15e6b08f tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:34.745855 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0609b0db-6850-450b-8f24-4c1d15e6b08f tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:34.753194 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:35.005881 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0609b0db-6850-450b-8f24-4c1d15e6b08f tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7" status: 200 len: 1620 microversion: 2.1 time: 0.279765 Jul 31 01:09:35.007927 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 477/949] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:34 2022] GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7 => generated 1620 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:09:35.018505 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-91f29b6d-cc9c-4266-ba28-4da20d5c40ac tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:35.019198 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-91f29b6d-cc9c-4266-ba28-4da20d5c40ac tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:35.027828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-91f29b6d-cc9c-4266-ba28-4da20d5c40ac tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:35.028697 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-91f29b6d-cc9c-4266-ba28-4da20d5c40ac tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:35.029735 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-91f29b6d-cc9c-4266-ba28-4da20d5c40ac tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:35.030690 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-91f29b6d-cc9c-4266-ba28-4da20d5c40ac tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:35.063604 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-91f29b6d-cc9c-4266-ba28-4da20d5c40ac tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:09:35.136694 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c1e0355a-5746-4c89-97ea-a403a0c556e2 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/4b1d89d6-bc3e-4212-aafc-584404c7b228" status: 202 len: 0 microversion: 2.1 time: 0.438817 Jul 31 01:09:35.137846 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 473/950] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:09:34 2022] DELETE /compute/v2.1/os-security-groups/4b1d89d6-bc3e-4212-aafc-584404c7b228 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 01:09:35.144800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2df06113-2491-4360-976a-e1a4b48160d0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:35.145876 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2df06113-2491-4360-976a-e1a4b48160d0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:35.161735 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2df06113-2491-4360-976a-e1a4b48160d0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:35.163715 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2df06113-2491-4360-976a-e1a4b48160d0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:35.165092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2df06113-2491-4360-976a-e1a4b48160d0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:35.167522 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2df06113-2491-4360-976a-e1a4b48160d0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:35.186202 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-91f29b6d-cc9c-4266-ba28-4da20d5c40ac tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "DELETE /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 204 len: 0 microversion: 2.1 time: 0.173948 Jul 31 01:09:35.186202 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 478/951] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:09:35 2022] DELETE /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:09:35.195956 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e6041293-5452-4cc1-abc5-9bfa54f87fd4 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:35.199167 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e6041293-5452-4cc1-abc5-9bfa54f87fd4 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] [instance: 4348d2b8-83d0-4ed1-a5db-c1c19d0948fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:35.212513 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6041293-5452-4cc1-abc5-9bfa54f87fd4 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:35.214431 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6041293-5452-4cc1-abc5-9bfa54f87fd4 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:35.217353 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6041293-5452-4cc1-abc5-9bfa54f87fd4 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:35.218682 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6041293-5452-4cc1-abc5-9bfa54f87fd4 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:35.400298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2df06113-2491-4360-976a-e1a4b48160d0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:35.412300 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2df06113-2491-4360-976a-e1a4b48160d0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1542 microversion: 2.1 time: 0.272954 Jul 31 01:09:35.413284 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 474/952] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:35 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1542 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:35.418469 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-12132648-24ac-4c1e-86e5-f6e42a40424b tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Calling method '.version_select at 0x7fede56eaee0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:35.485849 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e6041293-5452-4cc1-abc5-9bfa54f87fd4 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/4348d2b8-83d0-4ed1-a5db-c1c19d0948fa" status: 200 len: 1620 microversion: 2.1 time: 0.299466 Jul 31 01:09:35.489345 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 479/953] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:35 2022] GET /compute/v2.1/servers/4348d2b8-83d0-4ed1-a5db-c1c19d0948fa => generated 1620 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:35.736392 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-12132648-24ac-4c1e-86e5-f6e42a40424b tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/c988c9d6-177d-4f2e-b10f-3e471905367e" status: 202 len: 0 microversion: 2.1 time: 0.319008 Jul 31 01:09:35.741104 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 475/954] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:09:35 2022] DELETE /compute/v2.1/os-security-groups/c988c9d6-177d-4f2e-b10f-3e471905367e => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:09:35.750955 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a781d810-f391-4d90-901c-dd488b4a69cb tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:35.754789 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a781d810-f391-4d90-901c-dd488b4a69cb tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:35.775365 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a781d810-f391-4d90-901c-dd488b4a69cb tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:35.775843 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a781d810-f391-4d90-901c-dd488b4a69cb tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:35.776916 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a781d810-f391-4d90-901c-dd488b4a69cb tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:35.777665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a781d810-f391-4d90-901c-dd488b4a69cb tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:35.872701 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-525d6adf-d75e-44e9-829f-8c03bde969de tempest-QuotaClassesAdminTestJSON-330094726 tempest-QuotaClassesAdminTestJSON-330094726-project-admin] Calling method '.version_select at 0x7fede5911550>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:35.874516 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:35.874516 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:09:35.890807 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-525d6adf-d75e-44e9-829f-8c03bde969de tempest-QuotaClassesAdminTestJSON-330094726 tempest-QuotaClassesAdminTestJSON-330094726-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.400137 Jul 31 01:09:35.891831 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 480/955] 10.222.0.45 () {58 vars in 1185 bytes} [Sun Jul 31 01:09:35 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:35.897170 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ff819330-2781-4eff-843b-2a635481d992 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:35.897891 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ff819330-2781-4eff-843b-2a635481d992 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:35.905915 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff819330-2781-4eff-843b-2a635481d992 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:35.906817 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff819330-2781-4eff-843b-2a635481d992 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:35.908353 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff819330-2781-4eff-843b-2a635481d992 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:35.909252 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff819330-2781-4eff-843b-2a635481d992 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:36.092511 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a781d810-f391-4d90-901c-dd488b4a69cb tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:36.106328 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a781d810-f391-4d90-901c-dd488b4a69cb tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 200 len: 1714 microversion: 2.1 time: 0.362893 Jul 31 01:09:36.107820 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 476/956] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:35 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 1714 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:36.137001 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2e16de24-1941-43d7-bd0b-94ea45d0f012 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] Calling method '.version_select at 0x7fede56ea040>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:36.178672 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ff819330-2781-4eff-843b-2a635481d992 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:36.192659 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ff819330-2781-4eff-843b-2a635481d992 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1360 microversion: 2.1 time: 0.299473 Jul 31 01:09:36.194962 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 481/957] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:35 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1360 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:36.205328 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d0e9e02c-fb2b-44fd-bb6b-d821a558cab4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1864359687", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "439c28bf-0712-481c-9dca-6d50f87fcfd9"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:36.304782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-d0e9e02c-fb2b-44fd-bb6b-d821a558cab4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:09:36.512846 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2e16de24-1941-43d7-bd0b-94ea45d0f012 tempest-SecurityGroupRulesTestJSON-1925874247 tempest-SecurityGroupRulesTestJSON-1925874247-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/3af1f232-4a0d-4e5b-828a-785ae08a0d92" status: 202 len: 0 microversion: 2.1 time: 0.391277 Jul 31 01:09:36.513421 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 477/958] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:09:36 2022] DELETE /compute/v2.1/os-security-groups/3af1f232-4a0d-4e5b-828a-785ae08a0d92 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:09:36.527724 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f9927bdc-bcaf-4a66-b4a9-847f5fc58e05 tempest-QuotaClassesAdminTestJSON-330094726 tempest-QuotaClassesAdminTestJSON-330094726-project-admin] Action: 'update', calling method: .version_select at 0x7fede56eaaf0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:36.531803 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:36.531803 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:09:36.597154 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:36.704667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-d0e9e02c-fb2b-44fd-bb6b-d821a558cab4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:09:36.705055 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-d0e9e02c-fb2b-44fd-bb6b-d821a558cab4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:09:36.705714 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-d0e9e02c-fb2b-44fd-bb6b-d821a558cab4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:09:36.706279 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-d0e9e02c-fb2b-44fd-bb6b-d821a558cab4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:09:36.706845 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-d0e9e02c-fb2b-44fd-bb6b-d821a558cab4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:09:36.722682 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d0e9e02c-fb2b-44fd-bb6b-d821a558cab4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:36.728789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d0e9e02c-fb2b-44fd-bb6b-d821a558cab4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:36.730498 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d0e9e02c-fb2b-44fd-bb6b-d821a558cab4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:36.733377 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d0e9e02c-fb2b-44fd-bb6b-d821a558cab4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:36.777551 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-d0e9e02c-fb2b-44fd-bb6b-d821a558cab4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:36.784647 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-d0e9e02c-fb2b-44fd-bb6b-d821a558cab4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:36.792006 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:36.827575 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d0e9e02c-fb2b-44fd-bb6b-d821a558cab4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:09:36.832784 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d0e9e02c-fb2b-44fd-bb6b-d821a558cab4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:09:36.931087 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d0e9e02c-fb2b-44fd-bb6b-d821a558cab4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733892 Jul 31 01:09:36.932505 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 482/959] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:09:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:09:36.949709 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f9bb9f31-ad76-4df9-a464-b34a47a54437 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:36.953972 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f9bb9f31-ad76-4df9-a464-b34a47a54437 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:36.971045 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9bb9f31-ad76-4df9-a464-b34a47a54437 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:36.972373 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9bb9f31-ad76-4df9-a464-b34a47a54437 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:36.974660 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9bb9f31-ad76-4df9-a464-b34a47a54437 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:36.974893 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9bb9f31-ad76-4df9-a464-b34a47a54437 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:37.095560 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f9927bdc-bcaf-4a66-b4a9-847f5fc58e05 tempest-QuotaClassesAdminTestJSON-330094726 tempest-QuotaClassesAdminTestJSON-330094726-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.580753 Jul 31 01:09:37.099653 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 478/960] 10.222.0.45 () {60 vars in 1206 bytes} [Sun Jul 31 01:09:36 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:37.285557 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ae94ad26-382b-4e74-8323-0ef6f0afd6e2 tempest-AZV2TestJSON-1104909877 tempest-AZV2TestJSON-1104909877-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:37.287421 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae94ad26-382b-4e74-8323-0ef6f0afd6e2 tempest-AZV2TestJSON-1104909877 tempest-AZV2TestJSON-1104909877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:37.288023 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae94ad26-382b-4e74-8323-0ef6f0afd6e2 tempest-AZV2TestJSON-1104909877 tempest-AZV2TestJSON-1104909877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:37.289562 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae94ad26-382b-4e74-8323-0ef6f0afd6e2 tempest-AZV2TestJSON-1104909877 tempest-AZV2TestJSON-1104909877-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:37.290103 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae94ad26-382b-4e74-8323-0ef6f0afd6e2 tempest-AZV2TestJSON-1104909877 tempest-AZV2TestJSON-1104909877-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:37.348593 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ae94ad26-382b-4e74-8323-0ef6f0afd6e2 tempest-AZV2TestJSON-1104909877 tempest-AZV2TestJSON-1104909877-project] 10.222.0.45 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.247021 Jul 31 01:09:37.351222 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 479/961] 10.222.0.45 () {58 vars in 1164 bytes} [Sun Jul 31 01:09:37 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:09:37.380437 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-70c0dd00-37fd-4428-aecf-497397016031 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:37.385139 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-70c0dd00-37fd-4428-aecf-497397016031 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:37.605723 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-70c0dd00-37fd-4428-aecf-497397016031 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:37.613947 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-70c0dd00-37fd-4428-aecf-497397016031 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 200 len: 1217 microversion: 2.1 time: 0.260165 Jul 31 01:09:37.614752 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 480/962] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:37 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 1217 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:37.624694 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e460adf8-6e86-4b46-9361-f378e2f75fd6 tempest-QuotaClassesAdminTestJSON-330094726 tempest-QuotaClassesAdminTestJSON-330094726-project-admin] Calling method '.version_select at 0x7fede567b700>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:37.625537 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:37.625537 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:09:37.650345 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e460adf8-6e86-4b46-9361-f378e2f75fd6 tempest-QuotaClassesAdminTestJSON-330094726 tempest-QuotaClassesAdminTestJSON-330094726-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.029991 Jul 31 01:09:37.658736 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 481/963] 10.222.0.45 () {58 vars in 1185 bytes} [Sun Jul 31 01:09:37 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:37.666388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9761ea91-476c-419b-924e-920b3d804a26 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:37.669000 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9761ea91-476c-419b-924e-920b3d804a26 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:37.694955 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9761ea91-476c-419b-924e-920b3d804a26 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:37.694955 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9761ea91-476c-419b-924e-920b3d804a26 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:37.695833 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9761ea91-476c-419b-924e-920b3d804a26 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:37.696286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9761ea91-476c-419b-924e-920b3d804a26 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:37.777926 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f9bb9f31-ad76-4df9-a464-b34a47a54437 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:37.791938 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f9bb9f31-ad76-4df9-a464-b34a47a54437 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1542 microversion: 2.1 time: 0.858426 Jul 31 01:09:37.793158 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 483/964] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:36 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1542 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:37.800070 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ec4c669b-3bb7-4f82-9e4e-751a711deba8 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:37.801193 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ec4c669b-3bb7-4f82-9e4e-751a711deba8 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:37.819923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec4c669b-3bb7-4f82-9e4e-751a711deba8 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:37.820780 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec4c669b-3bb7-4f82-9e4e-751a711deba8 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:37.824152 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec4c669b-3bb7-4f82-9e4e-751a711deba8 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:37.826439 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec4c669b-3bb7-4f82-9e4e-751a711deba8 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:38.573016 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9761ea91-476c-419b-924e-920b3d804a26 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:38.583756 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9761ea91-476c-419b-924e-920b3d804a26 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 200 len: 1714 microversion: 2.1 time: 0.923662 Jul 31 01:09:38.584497 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 482/965] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:37 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 1714 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:38.589518 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bdc2829e-3a0d-4e5c-9008-86fc4fd04082 tempest-QuotaClassesAdminTestJSON-330094726 tempest-QuotaClassesAdminTestJSON-330094726-project-admin] Action: 'update', calling method: .version_select at 0x7fede567b3a0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:38.593300 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:09:38.593300 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:09:38.719470 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ec4c669b-3bb7-4f82-9e4e-751a711deba8 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:38.727906 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ec4c669b-3bb7-4f82-9e4e-751a711deba8 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1360 microversion: 2.1 time: 0.932621 Jul 31 01:09:38.743133 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 484/966] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:37 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1360 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:38.749581 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-354267b1-ce14-43db-b9d5-a1b64edd8ba2 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:38.750738 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-354267b1-ce14-43db-b9d5-a1b64edd8ba2 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:38.757647 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-354267b1-ce14-43db-b9d5-a1b64edd8ba2 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:38.758541 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-354267b1-ce14-43db-b9d5-a1b64edd8ba2 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:38.759688 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-354267b1-ce14-43db-b9d5-a1b64edd8ba2 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:38.761415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-354267b1-ce14-43db-b9d5-a1b64edd8ba2 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:38.776516 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bdc2829e-3a0d-4e5c-9008-86fc4fd04082 tempest-QuotaClassesAdminTestJSON-330094726 tempest-QuotaClassesAdminTestJSON-330094726-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.190401 Jul 31 01:09:38.777136 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 483/967] 10.222.0.45 () {60 vars in 1206 bytes} [Sun Jul 31 01:09:38 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:38.814656 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f27bb158-7207-46cb-9318-97d9402043c7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:38.816530 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f27bb158-7207-46cb-9318-97d9402043c7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:38.839371 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f27bb158-7207-46cb-9318-97d9402043c7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:38.846389 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f27bb158-7207-46cb-9318-97d9402043c7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:38.848858 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f27bb158-7207-46cb-9318-97d9402043c7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:38.851568 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f27bb158-7207-46cb-9318-97d9402043c7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:38.870279 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:39.173686 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-354267b1-ce14-43db-b9d5-a1b64edd8ba2 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:39.192566 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-354267b1-ce14-43db-b9d5-a1b64edd8ba2 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 200 len: 1269 microversion: 2.1 time: 0.444531 Jul 31 01:09:39.197082 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 485/968] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:38 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 1269 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:39.317921 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-600fc3e3-6e9e-4339-b6b4-e6433aa517e3 req-7d7f365b-b9e9-4de7-9e03-8e93f29af58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502a7c35-a8fe-4ace-85d5-bb115f8423fa", "name": "network-vif-plugged", "status": "completed", "tag": "c430395e-d6b3-4f00-927f-f84a47151b4c"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:39.345984 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-600fc3e3-6e9e-4339-b6b4-e6433aa517e3 req-7d7f365b-b9e9-4de7-9e03-8e93f29af58f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:39.348596 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-600fc3e3-6e9e-4339-b6b4-e6433aa517e3 req-7d7f365b-b9e9-4de7-9e03-8e93f29af58f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:39.398204 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-600fc3e3-6e9e-4339-b6b4-e6433aa517e3 req-7d7f365b-b9e9-4de7-9e03-8e93f29af58f service nova] Creating event network-vif-plugged:c430395e-d6b3-4f00-927f-f84a47151b4c for instance 502a7c35-a8fe-4ace-85d5-bb115f8423fa on n-h1-master-1 Jul 31 01:09:39.419079 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-600fc3e3-6e9e-4339-b6b4-e6433aa517e3 req-7d7f365b-b9e9-4de7-9e03-8e93f29af58f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104605 Jul 31 01:09:39.422489 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 486/969] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:39.611683 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f2816f78-8ef8-4404-9277-ca9f24bf4c61 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:39.614367 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f2816f78-8ef8-4404-9277-ca9f24bf4c61 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:39.635614 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2816f78-8ef8-4404-9277-ca9f24bf4c61 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:39.638222 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2816f78-8ef8-4404-9277-ca9f24bf4c61 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:39.639796 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2816f78-8ef8-4404-9277-ca9f24bf4c61 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:39.642696 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2816f78-8ef8-4404-9277-ca9f24bf4c61 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:39.754658 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f27bb158-7207-46cb-9318-97d9402043c7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:39.768933 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f27bb158-7207-46cb-9318-97d9402043c7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1542 microversion: 2.1 time: 0.958471 Jul 31 01:09:39.771676 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 484/970] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:38 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1542 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:39.782594 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-79aea410-8d3c-4014-907b-3903a72f282b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:39.788732 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-79aea410-8d3c-4014-907b-3903a72f282b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:39.798353 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:INSERT=12,nova_api:SELECT=65,nova_api:UPDATE=23 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:39.802722 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79aea410-8d3c-4014-907b-3903a72f282b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:39.805087 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79aea410-8d3c-4014-907b-3903a72f282b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:39.811471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79aea410-8d3c-4014-907b-3903a72f282b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:39.813149 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79aea410-8d3c-4014-907b-3903a72f282b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:40.051085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f2816f78-8ef8-4404-9277-ca9f24bf4c61 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:40.076474 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f2816f78-8ef8-4404-9277-ca9f24bf4c61 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 200 len: 1646 microversion: 2.1 time: 0.461143 Jul 31 01:09:40.081811 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 487/971] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:39 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 1646 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:09:40.217764 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bd3b02c1-e1bf-4826-8713-437a0a06552e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:40.218612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bd3b02c1-e1bf-4826-8713-437a0a06552e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:40.230724 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd3b02c1-e1bf-4826-8713-437a0a06552e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:40.232805 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd3b02c1-e1bf-4826-8713-437a0a06552e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:40.237374 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd3b02c1-e1bf-4826-8713-437a0a06552e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:40.240019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd3b02c1-e1bf-4826-8713-437a0a06552e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:40.333156 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-79aea410-8d3c-4014-907b-3903a72f282b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:40.355912 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-79aea410-8d3c-4014-907b-3903a72f282b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1360 microversion: 2.1 time: 0.581149 Jul 31 01:09:40.357832 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 485/972] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:39 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1360 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:40.383572 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bd3b02c1-e1bf-4826-8713-437a0a06552e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:40.433716 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bd3b02c1-e1bf-4826-8713-437a0a06552e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 200 len: 1275 microversion: 2.1 time: 0.217670 Jul 31 01:09:40.441806 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 488/973] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:40 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:09:40.622780 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-2a8cfd27-4557-46b7-ae51-cb8c38e443e4 req-3021cc09-ca66-46c7-abe0-686efffc2295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899b694f-3e79-4d06-8dc4-2dedec20fc64", "name": "network-vif-deleted", "tag": "97974ade-06ae-421e-b9a4-299f02c8d56b"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:40.644621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2a8cfd27-4557-46b7-ae51-cb8c38e443e4 req-3021cc09-ca66-46c7-abe0-686efffc2295 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:40.646411 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2a8cfd27-4557-46b7-ae51-cb8c38e443e4 req-3021cc09-ca66-46c7-abe0-686efffc2295 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:40.684081 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-2a8cfd27-4557-46b7-ae51-cb8c38e443e4 req-3021cc09-ca66-46c7-abe0-686efffc2295 service nova] Creating event network-vif-deleted:97974ade-06ae-421e-b9a4-299f02c8d56b for instance 899b694f-3e79-4d06-8dc4-2dedec20fc64 on n-h1-master-1 Jul 31 01:09:40.701807 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-2a8cfd27-4557-46b7-ae51-cb8c38e443e4 req-3021cc09-ca66-46c7-abe0-686efffc2295 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083511 Jul 31 01:09:40.704845 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 486/974] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:40.820697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-19325071-87bc-4421-b3b1-6bfe0374afc9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:40.822654 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-19325071-87bc-4421-b3b1-6bfe0374afc9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:40.844809 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19325071-87bc-4421-b3b1-6bfe0374afc9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:40.850176 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19325071-87bc-4421-b3b1-6bfe0374afc9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:40.855084 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19325071-87bc-4421-b3b1-6bfe0374afc9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:40.856832 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19325071-87bc-4421-b3b1-6bfe0374afc9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:41.105955 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-60b87204-43b2-4af8-a313-8d1277cced65 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:41.106991 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-60b87204-43b2-4af8-a313-8d1277cced65 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:41.127791 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60b87204-43b2-4af8-a313-8d1277cced65 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:41.128401 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60b87204-43b2-4af8-a313-8d1277cced65 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:41.129602 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60b87204-43b2-4af8-a313-8d1277cced65 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:41.130366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60b87204-43b2-4af8-a313-8d1277cced65 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:41.230081 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60b87204-43b2-4af8-a313-8d1277cced65 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:41.232695 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60b87204-43b2-4af8-a313-8d1277cced65 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:41.233773 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-60b87204-43b2-4af8-a313-8d1277cced65 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lazy-loading 'fault' on Instance uuid 899b694f-3e79-4d06-8dc4-2dedec20fc64 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:09:41.509687 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-60b87204-43b2-4af8-a313-8d1277cced65 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a6d0b6e8c4a239bf1b7ba80bdb68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8234bed9d80f482ba5865459a5eba429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:41.529818 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-60b87204-43b2-4af8-a313-8d1277cced65 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 200 len: 1366 microversion: 2.1 time: 0.427076 Jul 31 01:09:41.532180 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 487/975] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:41 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 1366 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:41.538651 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9cd37624-3d79-43da-8423-a9dcdbca7027 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:41.539575 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9cd37624-3d79-43da-8423-a9dcdbca7027 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:41.552180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cd37624-3d79-43da-8423-a9dcdbca7027 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:41.553111 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cd37624-3d79-43da-8423-a9dcdbca7027 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:41.554364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cd37624-3d79-43da-8423-a9dcdbca7027 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:41.555021 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cd37624-3d79-43da-8423-a9dcdbca7027 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:41.575125 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-19325071-87bc-4421-b3b1-6bfe0374afc9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:41.589839 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-19325071-87bc-4421-b3b1-6bfe0374afc9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1542 microversion: 2.1 time: 0.801371 Jul 31 01:09:41.598217 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 489/976] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:40 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1542 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:41.612706 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-294a0218-8f5f-4efa-a9b0-fc63ce9ef37f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:41.613344 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-294a0218-8f5f-4efa-a9b0-fc63ce9ef37f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:41.647662 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-294a0218-8f5f-4efa-a9b0-fc63ce9ef37f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:41.652359 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-294a0218-8f5f-4efa-a9b0-fc63ce9ef37f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:41.677123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-294a0218-8f5f-4efa-a9b0-fc63ce9ef37f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:41.686568 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-294a0218-8f5f-4efa-a9b0-fc63ce9ef37f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:42.067869 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-294a0218-8f5f-4efa-a9b0-fc63ce9ef37f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:42.088172 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-294a0218-8f5f-4efa-a9b0-fc63ce9ef37f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 200 len: 1275 microversion: 2.1 time: 0.488762 Jul 31 01:09:42.092974 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 490/977] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:41 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 1275 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:42.164316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9cd37624-3d79-43da-8423-a9dcdbca7027 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:42.178206 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9cd37624-3d79-43da-8423-a9dcdbca7027 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1543 microversion: 2.1 time: 0.644080 Jul 31 01:09:42.179153 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 488/978] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:41 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1543 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:42.243106 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9860d92f-e160-4915-89b6-389b8fdefdd1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:42.244290 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9860d92f-e160-4915-89b6-389b8fdefdd1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:42.267284 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9860d92f-e160-4915-89b6-389b8fdefdd1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:42.270306 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9860d92f-e160-4915-89b6-389b8fdefdd1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:42.271394 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9860d92f-e160-4915-89b6-389b8fdefdd1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:42.271945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9860d92f-e160-4915-89b6-389b8fdefdd1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:42.569464 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-709fae67-625b-4437-a639-f69813f94d27 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:42.569464 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-709fae67-625b-4437-a639-f69813f94d27 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] [instance: 899b694f-3e79-4d06-8dc4-2dedec20fc64] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:42.581518 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-709fae67-625b-4437-a639-f69813f94d27 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:42.582129 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-709fae67-625b-4437-a639-f69813f94d27 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:42.584665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-709fae67-625b-4437-a639-f69813f94d27 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:42.587180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-709fae67-625b-4437-a639-f69813f94d27 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:42.637477 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-709fae67-625b-4437-a639-f69813f94d27 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] HTTP exception thrown: Instance 899b694f-3e79-4d06-8dc4-2dedec20fc64 could not be found. Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-709fae67-625b-4437-a639-f69813f94d27 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Request method failure captured: Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 HTTP/1.1 Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dYMRrHv_jj-hTnxmaLIQJ60ecOfuGpNfsDiP-X0jHagHJXRImM_RvUkWebTo3517nJLUZ0RBfD7Iq10CaIlAVzYsQpX0RlVDlLVXJP4q_JwPhgTCPl-KjTNNoq3pteYykylubgzMfLDjyTcX5mY831nK4YoXc2EoSHL9arwv_K7bH0 Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 8234bed9d80f482ba5865459a5eba429 Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersTestManualDisk-987890439 Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8234bed9d80f482ba5865459a5eba429"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8234bed9d80f482ba5865459a5eba429"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8234bed9d80f482ba5865459a5eba429"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8234bed9d80f482ba5865459a5eba429", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersTestManualDisk-987890439 Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 8234bed9d80f482ba5865459a5eba429 Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersTestManualDisk-987890439 Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersTestManualDisk-987890439-project Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: a59a6d0b6e8c4a239bf1b7ba80bdb68d Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersTestManualDisk-987890439-project Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 899b694f-3e79-4d06-8dc4-2dedec20fc64 could not be found. Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '899b694f-3e79-4d06-8dc4-2dedec20fc64'} Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899b694f-3e79-4d06-8dc4-2dedec20fc64 could not be found. Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899b694f-3e79-4d06-8dc4-2dedec20fc64 could not be found. Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:09:42.639573 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:42.644696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:09:42.644696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:09:42.644696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:09:42.644696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:09:42.644696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:09:42.644696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899b694f-3e79-4d06-8dc4-2dedec20fc64 could not be found. Jul 31 01:09:42.644696 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:09:42.648832 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-709fae67-625b-4437-a639-f69813f94d27 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Returning 404 to user: Instance 899b694f-3e79-4d06-8dc4-2dedec20fc64 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:09:42.655865 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-709fae67-625b-4437-a639-f69813f94d27 tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64" status: 404 len: 111 microversion: 2.1 time: 0.105519 Jul 31 01:09:42.656930 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 489/979] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:42 2022] GET /compute/v2.1/servers/899b694f-3e79-4d06-8dc4-2dedec20fc64 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:09:42.662145 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e52b8a67-b82f-4cf6-88cd-cc7580f58672 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:42.669722 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e52b8a67-b82f-4cf6-88cd-cc7580f58672 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:42.689708 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e52b8a67-b82f-4cf6-88cd-cc7580f58672 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:42.693135 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e52b8a67-b82f-4cf6-88cd-cc7580f58672 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:42.694832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e52b8a67-b82f-4cf6-88cd-cc7580f58672 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:42.695582 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e52b8a67-b82f-4cf6-88cd-cc7580f58672 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:42.738777 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9860d92f-e160-4915-89b6-389b8fdefdd1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.520206 Jul 31 01:09:42.756214 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 491/980] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:09:42 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-interface => generated 285 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:42.766593 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4da895d2-3afb-43d8-a000-8ebc0ed7906e tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] Calling method '.version_select at 0x7fede57b1dc0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:42.814453 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4da895d2-3afb-43d8-a000-8ebc0ed7906e tempest-ServersTestManualDisk-987890439 tempest-ServersTestManualDisk-987890439-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1549772805" status: 202 len: 0 microversion: 2.1 time: 0.056263 Jul 31 01:09:42.816526 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 492/981] 10.222.0.45 () {58 vars in 1221 bytes} [Sun Jul 31 01:09:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1549772805 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:09:43.128776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eb8d0094-3ad3-4821-9de9-95207a7d1256 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:43.129806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eb8d0094-3ad3-4821-9de9-95207a7d1256 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:43.157204 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb8d0094-3ad3-4821-9de9-95207a7d1256 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:43.158743 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb8d0094-3ad3-4821-9de9-95207a7d1256 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:43.160050 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb8d0094-3ad3-4821-9de9-95207a7d1256 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:43.160751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb8d0094-3ad3-4821-9de9-95207a7d1256 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:43.352408 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e52b8a67-b82f-4cf6-88cd-cc7580f58672 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:43.361909 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e52b8a67-b82f-4cf6-88cd-cc7580f58672 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1542 microversion: 2.1 time: 0.703618 Jul 31 01:09:43.362480 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 490/982] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:42 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1542 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:43.802845 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eb8d0094-3ad3-4821-9de9-95207a7d1256 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:43.818108 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eb8d0094-3ad3-4821-9de9-95207a7d1256 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 200 len: 1317 microversion: 2.1 time: 0.695460 Jul 31 01:09:43.821719 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 493/983] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:43 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 1317 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:44.383306 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-db3df631-82d4-4578-ba92-f2d1df386693 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:44.384727 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-db3df631-82d4-4578-ba92-f2d1df386693 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:44.404792 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db3df631-82d4-4578-ba92-f2d1df386693 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:44.406357 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db3df631-82d4-4578-ba92-f2d1df386693 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:44.409617 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db3df631-82d4-4578-ba92-f2d1df386693 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:44.410474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db3df631-82d4-4578-ba92-f2d1df386693 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:44.845547 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ee617ab2-e297-4b97-8ba5-4950d171c0fc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:44.846249 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ee617ab2-e297-4b97-8ba5-4950d171c0fc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:44.859465 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee617ab2-e297-4b97-8ba5-4950d171c0fc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:44.861277 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee617ab2-e297-4b97-8ba5-4950d171c0fc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:44.862159 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee617ab2-e297-4b97-8ba5-4950d171c0fc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:44.862619 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee617ab2-e297-4b97-8ba5-4950d171c0fc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:45.039377 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-db3df631-82d4-4578-ba92-f2d1df386693 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:45.053391 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-db3df631-82d4-4578-ba92-f2d1df386693 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1542 microversion: 2.1 time: 0.673655 Jul 31 01:09:45.054563 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 491/984] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:44 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1542 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:45.300572 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ee617ab2-e297-4b97-8ba5-4950d171c0fc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:45.308982 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ee617ab2-e297-4b97-8ba5-4950d171c0fc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 200 len: 1317 microversion: 2.1 time: 0.470000 Jul 31 01:09:45.323643 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 494/985] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:44 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 1317 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:45.922227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-9f021cec-4373-4437-8cca-c417f7291d21 req-821b6397-035a-44dc-ac7e-960977e3f7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "502a7c35-a8fe-4ace-85d5-bb115f8423fa", "tag": "c430395e-d6b3-4f00-927f-f84a47151b4c"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:45.964811 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9f021cec-4373-4437-8cca-c417f7291d21 req-821b6397-035a-44dc-ac7e-960977e3f7b3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:45.965839 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9f021cec-4373-4437-8cca-c417f7291d21 req-821b6397-035a-44dc-ac7e-960977e3f7b3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:46.034476 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-9f021cec-4373-4437-8cca-c417f7291d21 req-821b6397-035a-44dc-ac7e-960977e3f7b3 service nova] Creating event network-changed:c430395e-d6b3-4f00-927f-f84a47151b4c for instance 502a7c35-a8fe-4ace-85d5-bb115f8423fa on n-h1-master-1 Jul 31 01:09:46.053390 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-9f021cec-4373-4437-8cca-c417f7291d21 req-821b6397-035a-44dc-ac7e-960977e3f7b3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138677 Jul 31 01:09:46.054014 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 492/986] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:09:46.091661 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-41210a1b-1f21-4f89-9c27-f00431b9b3e1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:46.092298 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-41210a1b-1f21-4f89-9c27-f00431b9b3e1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:46.110263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-41210a1b-1f21-4f89-9c27-f00431b9b3e1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:46.110732 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-41210a1b-1f21-4f89-9c27-f00431b9b3e1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:46.111593 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-41210a1b-1f21-4f89-9c27-f00431b9b3e1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:46.112046 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-41210a1b-1f21-4f89-9c27-f00431b9b3e1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:46.331243 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-07b419f1-b304-40c6-a90b-c17e19c8802f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:46.332305 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-07b419f1-b304-40c6-a90b-c17e19c8802f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:46.344658 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07b419f1-b304-40c6-a90b-c17e19c8802f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:46.345389 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07b419f1-b304-40c6-a90b-c17e19c8802f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:46.346394 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07b419f1-b304-40c6-a90b-c17e19c8802f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:46.347003 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07b419f1-b304-40c6-a90b-c17e19c8802f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:46.744390 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:46.807830 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=20 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:46.914193 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-41210a1b-1f21-4f89-9c27-f00431b9b3e1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:46.930327 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:46.934163 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-41210a1b-1f21-4f89-9c27-f00431b9b3e1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1542 microversion: 2.1 time: 0.847542 Jul 31 01:09:46.935470 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 495/987] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:46 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1542 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:47.203845 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-07b419f1-b304-40c6-a90b-c17e19c8802f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:47.221371 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-07b419f1-b304-40c6-a90b-c17e19c8802f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 200 len: 1317 microversion: 2.1 time: 0.888862 Jul 31 01:09:47.234988 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 493/988] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:46 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 1317 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:47.955899 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cbdce28c-18cd-4c5e-994f-8183b27077f0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:47.956529 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cbdce28c-18cd-4c5e-994f-8183b27077f0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:47.971956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cbdce28c-18cd-4c5e-994f-8183b27077f0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:47.972733 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cbdce28c-18cd-4c5e-994f-8183b27077f0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:47.973830 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cbdce28c-18cd-4c5e-994f-8183b27077f0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:47.975064 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cbdce28c-18cd-4c5e-994f-8183b27077f0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:48.199498 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-6bb75d99-6fea-4a6b-b90a-b67a2e0d3b59 req-5a5de2bb-e226-408d-b1cd-ed00dcbe4053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee3254c-a165-4285-86f1-c9d1d7a81e4f", "tag": "ec3696c1-fc35-410b-b1de-dee47f614ca2"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:48.208180 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:48.224119 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-6bb75d99-6fea-4a6b-b90a-b67a2e0d3b59 req-5a5de2bb-e226-408d-b1cd-ed00dcbe4053 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:48.224827 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-6bb75d99-6fea-4a6b-b90a-b67a2e0d3b59 req-5a5de2bb-e226-408d-b1cd-ed00dcbe4053 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:48.243613 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-6bb75d99-6fea-4a6b-b90a-b67a2e0d3b59 req-5a5de2bb-e226-408d-b1cd-ed00dcbe4053 service nova] Creating event network-changed:ec3696c1-fc35-410b-b1de-dee47f614ca2 for instance 9ee3254c-a165-4285-86f1-c9d1d7a81e4f on n-h1-master-1 Jul 31 01:09:48.250079 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-6bb75d99-6fea-4a6b-b90a-b67a2e0d3b59 req-5a5de2bb-e226-408d-b1cd-ed00dcbe4053 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054352 Jul 31 01:09:48.253713 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 494/989] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:09:48.265126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9e2d366e-a2ab-4807-93ca-bb730600946f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:48.266500 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9e2d366e-a2ab-4807-93ca-bb730600946f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:48.277901 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e2d366e-a2ab-4807-93ca-bb730600946f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:48.278702 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e2d366e-a2ab-4807-93ca-bb730600946f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:48.279850 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e2d366e-a2ab-4807-93ca-bb730600946f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:48.280445 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e2d366e-a2ab-4807-93ca-bb730600946f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:48.732925 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9e2d366e-a2ab-4807-93ca-bb730600946f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:48.746473 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9e2d366e-a2ab-4807-93ca-bb730600946f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 200 len: 1317 microversion: 2.1 time: 0.490810 Jul 31 01:09:48.752407 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 495/990] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:48 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:48.778380 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cbdce28c-18cd-4c5e-994f-8183b27077f0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:48.788928 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cbdce28c-18cd-4c5e-994f-8183b27077f0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1541 microversion: 2.1 time: 0.836739 Jul 31 01:09:48.803893 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 496/991] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:47 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1541 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:49.486874 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-0e484b79-03df-4dff-b1a9-caf271d0466a req-57ca3f26-54b0-4565-9a9d-70ee6e538f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228dc464-015e-46f4-bec0-9f81a1dc15d2", "name": "network-vif-unplugged", "status": "completed", "tag": "9a86b1f7-6a8e-4f86-8208-6993e348a723"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:49.546594 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=47,nova_cell0:UPDATE=12 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:49.574854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0e484b79-03df-4dff-b1a9-caf271d0466a req-57ca3f26-54b0-4565-9a9d-70ee6e538f42 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:49.576588 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0e484b79-03df-4dff-b1a9-caf271d0466a req-57ca3f26-54b0-4565-9a9d-70ee6e538f42 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:49.608044 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-0e484b79-03df-4dff-b1a9-caf271d0466a req-57ca3f26-54b0-4565-9a9d-70ee6e538f42 service nova] Creating event network-vif-unplugged:9a86b1f7-6a8e-4f86-8208-6993e348a723 for instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 on n-h1-master-1 Jul 31 01:09:49.621099 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-0e484b79-03df-4dff-b1a9-caf271d0466a req-57ca3f26-54b0-4565-9a9d-70ee6e538f42 service nova] Instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:09:49.642531 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-0e484b79-03df-4dff-b1a9-caf271d0466a req-57ca3f26-54b0-4565-9a9d-70ee6e538f42 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166090 Jul 31 01:09:49.644370 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 496/992] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:49.786208 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e6e76777-6763-4029-90b1-86875eca0b08 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:49.786745 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e6e76777-6763-4029-90b1-86875eca0b08 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:49.794036 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6e76777-6763-4029-90b1-86875eca0b08 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:49.794798 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6e76777-6763-4029-90b1-86875eca0b08 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:49.796894 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6e76777-6763-4029-90b1-86875eca0b08 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:49.797530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6e76777-6763-4029-90b1-86875eca0b08 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:49.812485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ddbdd1dc-11e0-490b-8672-bf2ffff0431d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:49.813668 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ddbdd1dc-11e0-490b-8672-bf2ffff0431d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:49.829974 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddbdd1dc-11e0-490b-8672-bf2ffff0431d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:49.830704 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddbdd1dc-11e0-490b-8672-bf2ffff0431d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:49.831768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddbdd1dc-11e0-490b-8672-bf2ffff0431d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:49.832407 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddbdd1dc-11e0-490b-8672-bf2ffff0431d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:50.396881 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e6e76777-6763-4029-90b1-86875eca0b08 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:50.409000 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e6e76777-6763-4029-90b1-86875eca0b08 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 200 len: 1317 microversion: 2.1 time: 0.624530 Jul 31 01:09:50.409910 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 497/993] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:49 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 1317 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:50.570616 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ddbdd1dc-11e0-490b-8672-bf2ffff0431d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:50.582130 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ddbdd1dc-11e0-490b-8672-bf2ffff0431d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1541 microversion: 2.1 time: 0.774352 Jul 31 01:09:50.582732 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 497/994] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:49 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1541 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:09:51.453169 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-79886901-b388-4af7-8744-d7ab05096729 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:51.458029 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-79886901-b388-4af7-8744-d7ab05096729 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:51.500748 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-79886901-b388-4af7-8744-d7ab05096729 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:51.502791 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-79886901-b388-4af7-8744-d7ab05096729 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:51.504726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-79886901-b388-4af7-8744-d7ab05096729 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:51.505820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-79886901-b388-4af7-8744-d7ab05096729 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:51.626569 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bba397fd-ea1f-40d7-8512-628ab27f07bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:51.637928 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bba397fd-ea1f-40d7-8512-628ab27f07bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:51.665012 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bba397fd-ea1f-40d7-8512-628ab27f07bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:51.685179 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bba397fd-ea1f-40d7-8512-628ab27f07bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:51.694676 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bba397fd-ea1f-40d7-8512-628ab27f07bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:51.696623 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bba397fd-ea1f-40d7-8512-628ab27f07bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:53.470181 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bba397fd-ea1f-40d7-8512-628ab27f07bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:53.503732 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bba397fd-ea1f-40d7-8512-628ab27f07bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1541 microversion: 2.1 time: 1.898495 Jul 31 01:09:53.530611 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 498/995] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:51 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1541 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:53.542299 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-8958b041-567b-4556-9839-37361dcecce6 req-054e2d87-5fa7-447a-a093-bb870c900796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228dc464-015e-46f4-bec0-9f81a1dc15d2", "tag": "9a86b1f7-6a8e-4f86-8208-6993e348a723"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:53.594368 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8958b041-567b-4556-9839-37361dcecce6 req-054e2d87-5fa7-447a-a093-bb870c900796 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:53.595212 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8958b041-567b-4556-9839-37361dcecce6 req-054e2d87-5fa7-447a-a093-bb870c900796 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:53.628534 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-8958b041-567b-4556-9839-37361dcecce6 req-054e2d87-5fa7-447a-a093-bb870c900796 service nova] Creating event network-changed:9a86b1f7-6a8e-4f86-8208-6993e348a723 for instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 on n-h1-master-1 Jul 31 01:09:53.652305 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-8958b041-567b-4556-9839-37361dcecce6 req-054e2d87-5fa7-447a-a093-bb870c900796 service nova] Instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:09:53.661483 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-79886901-b388-4af7-8744-d7ab05096729 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:53.671648 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-8958b041-567b-4556-9839-37361dcecce6 req-054e2d87-5fa7-447a-a093-bb870c900796 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138491 Jul 31 01:09:53.673874 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-79886901-b388-4af7-8744-d7ab05096729 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 200 len: 1317 microversion: 2.1 time: 2.228119 Jul 31 01:09:53.674063 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 499/996] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:53.675266 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 498/997] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:51 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 1317 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:54.553566 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-809da228-4dc6-4c78-92d8-de0f11cef2f6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:54.554234 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-809da228-4dc6-4c78-92d8-de0f11cef2f6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:54.568112 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-809da228-4dc6-4c78-92d8-de0f11cef2f6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:54.568876 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-809da228-4dc6-4c78-92d8-de0f11cef2f6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:54.571289 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-809da228-4dc6-4c78-92d8-de0f11cef2f6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:54.575813 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-809da228-4dc6-4c78-92d8-de0f11cef2f6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:54.715806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7ddff13d-ffb8-4168-bf64-0a19b9173e07 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:54.718194 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7ddff13d-ffb8-4168-bf64-0a19b9173e07 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:54.758535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ddff13d-ffb8-4168-bf64-0a19b9173e07 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:54.760857 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ddff13d-ffb8-4168-bf64-0a19b9173e07 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:54.766363 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ddff13d-ffb8-4168-bf64-0a19b9173e07 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:54.768939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ddff13d-ffb8-4168-bf64-0a19b9173e07 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:55.233105 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7ddff13d-ffb8-4168-bf64-0a19b9173e07 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:55.271964 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7ddff13d-ffb8-4168-bf64-0a19b9173e07 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 200 len: 1317 microversion: 2.1 time: 0.569348 Jul 31 01:09:55.286302 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 499/998] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:54 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 1317 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:55.674456 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b890deea-f6d0-4978-b5a6-dd6d0fc089cb tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Action: 'create', calling method: .version_select at 0x7fede5676b80>, body: {"keypair": {"name": "tempest-keypair-840635721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6J1QHOqLmZMR8dGL6FQuBY308+buDZWQTYH+NzSHQ72Z/HkZ7t/h3PqFOceBZifCUFMaBwzTh24Hw1zPECm5c3gVJ/sOwxgnPNefB+W1AuBx556i0cUekJhO6TEO1JbA=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:55.686064 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-809da228-4dc6-4c78-92d8-de0f11cef2f6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:55.739624 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-809da228-4dc6-4c78-92d8-de0f11cef2f6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1473 microversion: 2.1 time: 1.191205 Jul 31 01:09:55.751136 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-b890deea-f6d0-4978-b5a6-dd6d0fc089cb tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Getting quotas for project 3e3cc749a4a34731b3035b320af81cd4. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:55.771140 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-b890deea-f6d0-4978-b5a6-dd6d0fc089cb tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Getting quotas for user 2eb298a85d524f1d9f3a2138636a2773 and project 3e3cc749a4a34731b3035b320af81cd4. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:55.776595 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 500/999] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:54 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1473 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:09:55.823057 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-a11b669f-df00-47be-ba82-20119fe795f9 req-7f149959-5c88-4ce1-b364-ae4f32f657a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee3254c-a165-4285-86f1-c9d1d7a81e4f", "name": "network-vif-plugged", "status": "completed", "tag": "ec3696c1-fc35-410b-b1de-dee47f614ca2"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:55.883479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a11b669f-df00-47be-ba82-20119fe795f9 req-7f149959-5c88-4ce1-b364-ae4f32f657a0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:55.886343 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a11b669f-df00-47be-ba82-20119fe795f9 req-7f149959-5c88-4ce1-b364-ae4f32f657a0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:55.908114 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b890deea-f6d0-4978-b5a6-dd6d0fc089cb tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.541691 Jul 31 01:09:55.910212 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 500/1000] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:09:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:09:55.959712 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-a11b669f-df00-47be-ba82-20119fe795f9 req-7f149959-5c88-4ce1-b364-ae4f32f657a0 service nova] Creating event network-vif-plugged:ec3696c1-fc35-410b-b1de-dee47f614ca2 for instance 9ee3254c-a165-4285-86f1-c9d1d7a81e4f on n-h1-master-1 Jul 31 01:09:55.976241 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-a11b669f-df00-47be-ba82-20119fe795f9 req-7f149959-5c88-4ce1-b364-ae4f32f657a0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189642 Jul 31 01:09:55.978913 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 501/1001] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:09:56.310695 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cf1bd49b-e8d2-4984-9f2c-119806a16760 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:56.315654 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cf1bd49b-e8d2-4984-9f2c-119806a16760 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:56.330317 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf1bd49b-e8d2-4984-9f2c-119806a16760 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:56.331625 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf1bd49b-e8d2-4984-9f2c-119806a16760 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:56.334936 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf1bd49b-e8d2-4984-9f2c-119806a16760 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:56.335721 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf1bd49b-e8d2-4984-9f2c-119806a16760 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:56.779016 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3a06b03a-a295-4ccc-9746-8daa7f50a816 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:56.783864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3a06b03a-a295-4ccc-9746-8daa7f50a816 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:56.799657 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a06b03a-a295-4ccc-9746-8daa7f50a816 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:56.804296 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a06b03a-a295-4ccc-9746-8daa7f50a816 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:56.806220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a06b03a-a295-4ccc-9746-8daa7f50a816 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:56.808080 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a06b03a-a295-4ccc-9746-8daa7f50a816 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:57.742940 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cf1bd49b-e8d2-4984-9f2c-119806a16760 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:57.762956 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cf1bd49b-e8d2-4984-9f2c-119806a16760 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 200 len: 1317 microversion: 2.1 time: 1.456185 Jul 31 01:09:57.763754 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 501/1002] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:56 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 1317 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:57.822489 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3a06b03a-a295-4ccc-9746-8daa7f50a816 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:57.846728 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3a06b03a-a295-4ccc-9746-8daa7f50a816 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1470 microversion: 2.1 time: 1.072769 Jul 31 01:09:57.850445 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 502/1003] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:56 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1470 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:57.877413 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ef765ff2-edfa-45df-a1d8-bd51e64c1754 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:09:57.879150 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ef765ff2-edfa-45df-a1d8-bd51e64c1754 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:57.887911 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef765ff2-edfa-45df-a1d8-bd51e64c1754 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:57.888674 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef765ff2-edfa-45df-a1d8-bd51e64c1754 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:57.891175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef765ff2-edfa-45df-a1d8-bd51e64c1754 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:57.892054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef765ff2-edfa-45df-a1d8-bd51e64c1754 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:57.973787 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef765ff2-edfa-45df-a1d8-bd51e64c1754 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:57.974715 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef765ff2-edfa-45df-a1d8-bd51e64c1754 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:57.977027 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef765ff2-edfa-45df-a1d8-bd51e64c1754 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:57.977693 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef765ff2-edfa-45df-a1d8-bd51e64c1754 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:58.036223 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-ef765ff2-edfa-45df-a1d8-bd51e64c1754 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Getting quotas for project 87496179e992473c991977e0e517460a. Resources: {'cores', 'ram'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:09:58.057427 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-ef765ff2-edfa-45df-a1d8-bd51e64c1754 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Getting quotas for user 9a2a0f61c8304c9a9ad7af6120e83443 and project 87496179e992473c991977e0e517460a. Resources: {'cores', 'ram'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:09:58.335677 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ef765ff2-edfa-45df-a1d8-bd51e64c1754 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "POST /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2/action" status: 202 len: 0 microversion: 2.1 time: 0.464786 Jul 31 01:09:58.336202 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 502/1004] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:09:57 2022] POST /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:09:58.348223 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-51566df0-61e0-488d-a841-21bb47b615ce tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:58.348968 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-51566df0-61e0-488d-a841-21bb47b615ce tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:58.365721 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-51566df0-61e0-488d-a841-21bb47b615ce tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:58.366179 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-51566df0-61e0-488d-a841-21bb47b615ce tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:58.366973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-51566df0-61e0-488d-a841-21bb47b615ce tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:58.367622 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-51566df0-61e0-488d-a841-21bb47b615ce tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:58.839559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c727ab6b-5292-4a04-97b6-8f794972ac38 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:58.842758 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c727ab6b-5292-4a04-97b6-8f794972ac38 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:58.872365 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c727ab6b-5292-4a04-97b6-8f794972ac38 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:58.873681 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c727ab6b-5292-4a04-97b6-8f794972ac38 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:58.875588 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c727ab6b-5292-4a04-97b6-8f794972ac38 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:58.876740 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c727ab6b-5292-4a04-97b6-8f794972ac38 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:58.894338 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-51566df0-61e0-488d-a841-21bb47b615ce tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:58.930894 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-51566df0-61e0-488d-a841-21bb47b615ce tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1469 microversion: 2.1 time: 0.586154 Jul 31 01:09:58.935577 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 503/1005] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:58 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1469 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:59.740171 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c727ab6b-5292-4a04-97b6-8f794972ac38 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:09:59.788894 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c727ab6b-5292-4a04-97b6-8f794972ac38 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 200 len: 1466 microversion: 2.1 time: 0.990969 Jul 31 01:09:59.811698 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 503/1006] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:58 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 1466 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:09:59.832038 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-53645a4e-aaf5-4319-9c43-e3081285f4ca tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:59.832996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-53645a4e-aaf5-4319-9c43-e3081285f4ca tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:59.853591 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53645a4e-aaf5-4319-9c43-e3081285f4ca tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:59.857492 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53645a4e-aaf5-4319-9c43-e3081285f4ca tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:59.859667 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53645a4e-aaf5-4319-9c43-e3081285f4ca tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:59.862141 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53645a4e-aaf5-4319-9c43-e3081285f4ca tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:59.922336 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:59.962606 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4c3ea872-b8d8-4bae-970c-ec34a84bf142 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:09:59.964526 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4c3ea872-b8d8-4bae-970c-ec34a84bf142 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:09:59.977121 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c3ea872-b8d8-4bae-970c-ec34a84bf142 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:59.978107 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c3ea872-b8d8-4bae-970c-ec34a84bf142 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:09:59.980418 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c3ea872-b8d8-4bae-970c-ec34a84bf142 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:09:59.981314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c3ea872-b8d8-4bae-970c-ec34a84bf142 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:00.520530 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-53645a4e-aaf5-4319-9c43-e3081285f4ca tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 200 len: 1617 microversion: 2.1 time: 0.699025 Jul 31 01:10:00.545751 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 504/1007] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:59 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 1617 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:00.627452 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4c3ea872-b8d8-4bae-970c-ec34a84bf142 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:00.698623 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4c3ea872-b8d8-4bae-970c-ec34a84bf142 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1469 microversion: 2.1 time: 0.743205 Jul 31 01:10:00.733080 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 504/1008] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:09:59 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1469 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:00.844039 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b1466bf7-ebdb-42d0-b418-96eee3b4fa06 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-877946499", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["439c28bf-0712-481c-9dca-6d50f87fcfd9"]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:00.974546 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-b1466bf7-ebdb-42d0-b418-96eee3b4fa06 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] validate_networks() for None {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:10:01.746991 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f728631c-ce9d-4d30-89ae-0b970935e727 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:01.748012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f728631c-ce9d-4d30-89ae-0b970935e727 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:01.765181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f728631c-ce9d-4d30-89ae-0b970935e727 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:01.766272 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f728631c-ce9d-4d30-89ae-0b970935e727 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:01.767481 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f728631c-ce9d-4d30-89ae-0b970935e727 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:01.768124 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f728631c-ce9d-4d30-89ae-0b970935e727 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:01.851731 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b1466bf7-ebdb-42d0-b418-96eee3b4fa06 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:10:01.852988 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b1466bf7-ebdb-42d0-b418-96eee3b4fa06 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:10:01.854287 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b1466bf7-ebdb-42d0-b418-96eee3b4fa06 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:10:01.856491 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b1466bf7-ebdb-42d0-b418-96eee3b4fa06 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:10:01.857686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b1466bf7-ebdb-42d0-b418-96eee3b4fa06 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:10:01.923256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1466bf7-ebdb-42d0-b418-96eee3b4fa06 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:01.924908 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1466bf7-ebdb-42d0-b418-96eee3b4fa06 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:01.932271 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1466bf7-ebdb-42d0-b418-96eee3b4fa06 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:01.936474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1466bf7-ebdb-42d0-b418-96eee3b4fa06 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:01.999632 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-b1466bf7-ebdb-42d0-b418-96eee3b4fa06 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:10:02.017840 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-b1466bf7-ebdb-42d0-b418-96eee3b4fa06 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:10:02.057266 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b1466bf7-ebdb-42d0-b418-96eee3b4fa06 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:10:02.067935 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b1466bf7-ebdb-42d0-b418-96eee3b4fa06 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:10:02.306816 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f728631c-ce9d-4d30-89ae-0b970935e727 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:02.330198 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f728631c-ce9d-4d30-89ae-0b970935e727 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1469 microversion: 2.1 time: 0.587180 Jul 31 01:10:02.338574 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b1466bf7-ebdb-42d0-b418-96eee3b4fa06 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.498837 Jul 31 01:10:02.340418 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 505/1009] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:01 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1469 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:02.362929 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 505/1010] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:10:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:10:02.377997 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-826454a0-ac21-44ee-83a8-91a5d708ab44 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:02.382274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-826454a0-ac21-44ee-83a8-91a5d708ab44 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:02.809900 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-826454a0-ac21-44ee-83a8-91a5d708ab44 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:02.843586 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-826454a0-ac21-44ee-83a8-91a5d708ab44 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1216 microversion: 2.1 time: 0.482601 Jul 31 01:10:02.857397 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 506/1011] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:02 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1216 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:10:03.367532 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f07ff9e7-1332-4676-b535-bfcb1c894218 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:03.368505 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f07ff9e7-1332-4676-b535-bfcb1c894218 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:03.404320 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f07ff9e7-1332-4676-b535-bfcb1c894218 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:03.410730 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f07ff9e7-1332-4676-b535-bfcb1c894218 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:03.414834 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f07ff9e7-1332-4676-b535-bfcb1c894218 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:03.417576 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f07ff9e7-1332-4676-b535-bfcb1c894218 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:03.905812 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a8c17a5d-a047-44e3-89d5-fe00fc4e6f39 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:03.911050 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a8c17a5d-a047-44e3-89d5-fe00fc4e6f39 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:04.016201 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8c17a5d-a047-44e3-89d5-fe00fc4e6f39 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:04.017503 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8c17a5d-a047-44e3-89d5-fe00fc4e6f39 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:04.022530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8c17a5d-a047-44e3-89d5-fe00fc4e6f39 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:04.024663 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8c17a5d-a047-44e3-89d5-fe00fc4e6f39 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:04.178509 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f07ff9e7-1332-4676-b535-bfcb1c894218 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:04.224995 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f07ff9e7-1332-4676-b535-bfcb1c894218 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1469 microversion: 2.1 time: 0.865820 Jul 31 01:10:04.227400 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 506/1012] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:03 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1469 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:10:04.391709 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a8c17a5d-a047-44e3-89d5-fe00fc4e6f39 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:04.406961 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a8c17a5d-a047-44e3-89d5-fe00fc4e6f39 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1220 microversion: 2.1 time: 0.513778 Jul 31 01:10:04.407726 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 507/1013] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:03 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1220 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:10:04.901292 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e137bc4d-91c9-4085-a20f-06c5a9a97dc8 req-28d1d9c1-7cd8-4ff4-aa2d-3b6f975cdac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228dc464-015e-46f4-bec0-9f81a1dc15d2", "name": "network-vif-plugged", "status": "completed", "tag": "9a86b1f7-6a8e-4f86-8208-6993e348a723"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:04.975059 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e137bc4d-91c9-4085-a20f-06c5a9a97dc8 req-28d1d9c1-7cd8-4ff4-aa2d-3b6f975cdac0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:04.988605 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e137bc4d-91c9-4085-a20f-06c5a9a97dc8 req-28d1d9c1-7cd8-4ff4-aa2d-3b6f975cdac0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:05.005145 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ca31af15-f6d8-405e-b852-d74ba96cada4 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:05.006286 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ca31af15-f6d8-405e-b852-d74ba96cada4 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:05.053627 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca31af15-f6d8-405e-b852-d74ba96cada4 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:05.058011 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca31af15-f6d8-405e-b852-d74ba96cada4 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:05.067284 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca31af15-f6d8-405e-b852-d74ba96cada4 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:05.070457 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca31af15-f6d8-405e-b852-d74ba96cada4 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:05.085670 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e137bc4d-91c9-4085-a20f-06c5a9a97dc8 req-28d1d9c1-7cd8-4ff4-aa2d-3b6f975cdac0 service nova] Creating event network-vif-plugged:9a86b1f7-6a8e-4f86-8208-6993e348a723 for instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 on n-h1-master-1 Jul 31 01:10:05.121876 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-e137bc4d-91c9-4085-a20f-06c5a9a97dc8 req-28d1d9c1-7cd8-4ff4-aa2d-3b6f975cdac0 service nova] Instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:10:05.172627 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e137bc4d-91c9-4085-a20f-06c5a9a97dc8 req-28d1d9c1-7cd8-4ff4-aa2d-3b6f975cdac0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276255 Jul 31 01:10:05.176867 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 507/1014] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:10:05.250937 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-811a1edd-babf-45e6-b6fa-cd21adf108d4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:05.252090 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-811a1edd-babf-45e6-b6fa-cd21adf108d4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:05.267290 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-811a1edd-babf-45e6-b6fa-cd21adf108d4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:05.269558 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-811a1edd-babf-45e6-b6fa-cd21adf108d4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:05.272303 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-811a1edd-babf-45e6-b6fa-cd21adf108d4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:05.273139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-811a1edd-babf-45e6-b6fa-cd21adf108d4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:05.783778 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-ca31af15-f6d8-405e-b852-d74ba96cada4 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'services' on Instance uuid 011dbabc-56cc-4f90-be60-972ffeb468b1 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:10:05.865547 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ca31af15-f6d8-405e-b852-d74ba96cada4 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 2342 microversion: 2.25 time: 0.868420 Jul 31 01:10:05.866155 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 508/1015] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:10:04 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 2342 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:10:05.904201 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0bb5a0fd-f98e-4f47-97e8-bb655e39f73b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:05.910296 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0bb5a0fd-f98e-4f47-97e8-bb655e39f73b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:05.933794 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bb5a0fd-f98e-4f47-97e8-bb655e39f73b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:05.935519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bb5a0fd-f98e-4f47-97e8-bb655e39f73b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:05.943477 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bb5a0fd-f98e-4f47-97e8-bb655e39f73b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:05.946053 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bb5a0fd-f98e-4f47-97e8-bb655e39f73b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:06.164395 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-811a1edd-babf-45e6-b6fa-cd21adf108d4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:06.173171 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-811a1edd-babf-45e6-b6fa-cd21adf108d4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1469 microversion: 2.1 time: 0.926407 Jul 31 01:10:06.183962 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 508/1016] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:05 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1469 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:10:06.190084 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-abcd321b-4051-4b6f-92e6-d30fec8ecf58 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:06.192892 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:10:06.192892 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:10:06.194208 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abcd321b-4051-4b6f-92e6-d30fec8ecf58 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:06.194675 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abcd321b-4051-4b6f-92e6-d30fec8ecf58 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:06.209433 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0bb5a0fd-f98e-4f47-97e8-bb655e39f73b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:06.217742 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abcd321b-4051-4b6f-92e6-d30fec8ecf58 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:06.218455 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abcd321b-4051-4b6f-92e6-d30fec8ecf58 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:06.220476 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0bb5a0fd-f98e-4f47-97e8-bb655e39f73b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1274 microversion: 2.1 time: 0.317165 Jul 31 01:10:06.221731 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 509/1017] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:05 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1274 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:06.314145 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-abcd321b-4051-4b6f-92e6-d30fec8ecf58 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.128593 Jul 31 01:10:06.335711 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 509/1018] 10.222.0.45 () {60 vars in 1217 bytes} [Sun Jul 31 01:10:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:10:06.721144 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bcd90f1f-4080-461a-a519-a2e800948e65 tempest-FloatingIPDetailsNegativeTestJSON-1400437092 tempest-FloatingIPDetailsNegativeTestJSON-1400437092-project] Calling method '.version_select at 0x7fede563b280>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:06.846609 n-d-master-1 devstack@n-api.service[119475]: DEBUG neutronclient.v2_0.client [None req-bcd90f1f-4080-461a-a519-a2e800948e65 tempest-FloatingIPDetailsNegativeTestJSON-1400437092 tempest-FloatingIPDetailsNegativeTestJSON-1400437092-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 69e7213a-41e5-48ac-b474-498c0f03f3eb could not be found", "detail": ""}} {{(pid=119475) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:10:06.847782 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-bcd90f1f-4080-461a-a519-a2e800948e65 tempest-FloatingIPDetailsNegativeTestJSON-1400437092 tempest-FloatingIPDetailsNegativeTestJSON-1400437092-project] HTTP exception thrown: Floating IP not found for ID 69e7213a-41e5-48ac-b474-498c0f03f3eb Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bcd90f1f-4080-461a-a519-a2e800948e65 tempest-FloatingIPDetailsNegativeTestJSON-1400437092 tempest-FloatingIPDetailsNegativeTestJSON-1400437092-project] Request method failure captured: Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-floating-ips/69e7213a-41e5-48ac-b474-498c0f03f3eb HTTP/1.1 Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dZt43J2GtkhGm-VB-fYicVdlc8XiNezjPGX-HthMRm-GK2chFPQmbx9hYzbwW72PuHuGxfZ26igxm-G6sDQMdYzjOWGfscHaVwrkEESMa5ha9Iv7MNo19yBhPMqkQ_EIRQ-Ul6qhvAcTibY6iPjEtzZkpqp0wjBmzUvpjJtOWb8Eg0 Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 95ab412341c94ec78797b83b56bb5a66 Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1400437092 Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/95ab412341c94ec78797b83b56bb5a66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/95ab412341c94ec78797b83b56bb5a66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/95ab412341c94ec78797b83b56bb5a66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_95ab412341c94ec78797b83b56bb5a66", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1400437092 Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 95ab412341c94ec78797b83b56bb5a66 Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1400437092 Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1400437092-project Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 73ef91469aa24b1899b5ef0c0d567f91 Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1400437092-project Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: exception: Floating IP not found for ID 69e7213a-41e5-48ac-b474-498c0f03f3eb Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '69e7213a-41e5-48ac-b474-498c0f03f3eb'} Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 69e7213a-41e5-48ac-b474-498c0f03f3eb could not be found Jul 31 01:10:06.852235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7a90c8b-1544-4cd1-bc68-b419ce3d452a'] Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 69e7213a-41e5-48ac-b474-498c0f03f3eb. Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 69e7213a-41e5-48ac-b474-498c0f03f3eb Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 69e7213a-41e5-48ac-b474-498c0f03f3eb Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:10:06.857273 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bcd90f1f-4080-461a-a519-a2e800948e65 tempest-FloatingIPDetailsNegativeTestJSON-1400437092 tempest-FloatingIPDetailsNegativeTestJSON-1400437092-project] Returning 404 to user: Floating IP not found for ID 69e7213a-41e5-48ac-b474-498c0f03f3eb {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:10:06.862594 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bcd90f1f-4080-461a-a519-a2e800948e65 tempest-FloatingIPDetailsNegativeTestJSON-1400437092 tempest-FloatingIPDetailsNegativeTestJSON-1400437092-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ips/69e7213a-41e5-48ac-b474-498c0f03f3eb" status: 404 len: 111 microversion: 2.1 time: 0.636047 Jul 31 01:10:06.862594 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 510/1019] 10.222.0.45 () {58 vars in 1260 bytes} [Sun Jul 31 01:10:06 2022] GET /compute/v2.1/os-floating-ips/69e7213a-41e5-48ac-b474-498c0f03f3eb => generated 111 bytes in 640 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:10:07.259888 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fda6fe07-9c87-4d43-aab1-7b065a7b760e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:07.262321 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8d641dd9-6d3e-47f3-b6b2-36d33c403c89 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:07.266093 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8d641dd9-6d3e-47f3-b6b2-36d33c403c89 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:07.273612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fda6fe07-9c87-4d43-aab1-7b065a7b760e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:07.294776 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:07.324998 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d641dd9-6d3e-47f3-b6b2-36d33c403c89 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:07.333938 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d641dd9-6d3e-47f3-b6b2-36d33c403c89 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:07.344145 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d641dd9-6d3e-47f3-b6b2-36d33c403c89 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:07.347507 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fda6fe07-9c87-4d43-aab1-7b065a7b760e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:07.348331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fda6fe07-9c87-4d43-aab1-7b065a7b760e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:07.348996 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d641dd9-6d3e-47f3-b6b2-36d33c403c89 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:07.350059 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fda6fe07-9c87-4d43-aab1-7b065a7b760e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:07.353339 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fda6fe07-9c87-4d43-aab1-7b065a7b760e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:07.731956 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fda6fe07-9c87-4d43-aab1-7b065a7b760e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:07.775020 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fda6fe07-9c87-4d43-aab1-7b065a7b760e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1274 microversion: 2.1 time: 0.521286 Jul 31 01:10:07.776354 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 511/1020] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:07 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1274 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:08.811001 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0514036c-1693-4aa2-82a0-9041b6d3e4eb tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:08.812256 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0514036c-1693-4aa2-82a0-9041b6d3e4eb tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:08.824278 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:08.846316 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0514036c-1693-4aa2-82a0-9041b6d3e4eb tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:08.846994 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0514036c-1693-4aa2-82a0-9041b6d3e4eb tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:08.853521 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0514036c-1693-4aa2-82a0-9041b6d3e4eb tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:08.854426 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0514036c-1693-4aa2-82a0-9041b6d3e4eb tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:08.953726 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:09.550510 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0514036c-1693-4aa2-82a0-9041b6d3e4eb tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:09.595700 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0514036c-1693-4aa2-82a0-9041b6d3e4eb tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1274 microversion: 2.1 time: 0.792422 Jul 31 01:10:09.596827 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 512/1021] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:08 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1274 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:09.715463 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8d641dd9-6d3e-47f3-b6b2-36d33c403c89 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:09.758133 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8d641dd9-6d3e-47f3-b6b2-36d33c403c89 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1535 microversion: 2.1 time: 2.529739 Jul 31 01:10:09.772894 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 510/1022] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:07 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1535 bytes in 2548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:09.776012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-d6cb8988-f32e-4128-baaf-593b88f73421 req-13373856-aaa6-474e-b795-cedb0e37c1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228dc464-015e-46f4-bec0-9f81a1dc15d2", "name": "network-vif-unplugged", "status": "completed", "tag": "9a86b1f7-6a8e-4f86-8208-6993e348a723"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:09.823944 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d6cb8988-f32e-4128-baaf-593b88f73421 req-13373856-aaa6-474e-b795-cedb0e37c1ee service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:09.826040 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d6cb8988-f32e-4128-baaf-593b88f73421 req-13373856-aaa6-474e-b795-cedb0e37c1ee service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:09.883964 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-d6cb8988-f32e-4128-baaf-593b88f73421 req-13373856-aaa6-474e-b795-cedb0e37c1ee service nova] Creating event network-vif-unplugged:9a86b1f7-6a8e-4f86-8208-6993e348a723 for instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 on n-h2-master-1 Jul 31 01:10:09.903537 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-d6cb8988-f32e-4128-baaf-593b88f73421 req-13373856-aaa6-474e-b795-cedb0e37c1ee service nova] Instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:10:09.939913 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-d6cb8988-f32e-4128-baaf-593b88f73421 req-13373856-aaa6-474e-b795-cedb0e37c1ee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173471 Jul 31 01:10:09.947168 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 513/1023] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:10:10.625131 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a748b1ec-7fbb-4e3f-8f47-2282630b870c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:10.626030 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a748b1ec-7fbb-4e3f-8f47-2282630b870c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:10.630799 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:10.644935 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a748b1ec-7fbb-4e3f-8f47-2282630b870c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:10.662727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a748b1ec-7fbb-4e3f-8f47-2282630b870c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:10.663999 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a748b1ec-7fbb-4e3f-8f47-2282630b870c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:10.664642 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a748b1ec-7fbb-4e3f-8f47-2282630b870c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:10.804082 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cfb3e8cb-8f50-40fc-bc59-d8ec7fecb218 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:10.805132 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cfb3e8cb-8f50-40fc-bc59-d8ec7fecb218 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:10.821386 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfb3e8cb-8f50-40fc-bc59-d8ec7fecb218 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:10.822707 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfb3e8cb-8f50-40fc-bc59-d8ec7fecb218 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:10.824479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfb3e8cb-8f50-40fc-bc59-d8ec7fecb218 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:10.826154 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfb3e8cb-8f50-40fc-bc59-d8ec7fecb218 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:10.845596 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a748b1ec-7fbb-4e3f-8f47-2282630b870c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:10.862018 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a748b1ec-7fbb-4e3f-8f47-2282630b870c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1274 microversion: 2.1 time: 0.240789 Jul 31 01:10:10.875035 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 511/1024] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:10 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1274 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:11.080675 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d8d460d0-9d56-4b98-959a-774378151eb7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be1a1dac-60e9-4a6f-911c-0a7b5d0e52e4", "device": "/dev/xvdb"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:11.083715 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d8d460d0-9d56-4b98-959a-774378151eb7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:11.102537 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8d460d0-9d56-4b98-959a-774378151eb7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:11.102995 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8d460d0-9d56-4b98-959a-774378151eb7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:11.103895 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8d460d0-9d56-4b98-959a-774378151eb7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:11.104538 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8d460d0-9d56-4b98-959a-774378151eb7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:11.736158 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cfb3e8cb-8f50-40fc-bc59-d8ec7fecb218 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:11.748672 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cfb3e8cb-8f50-40fc-bc59-d8ec7fecb218 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1535 microversion: 2.1 time: 0.953223 Jul 31 01:10:11.752170 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 514/1025] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:10 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1535 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:11.884203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ecac3916-50e3-4a79-ab84-785a8cfe8f1d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:11.885285 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ecac3916-50e3-4a79-ab84-785a8cfe8f1d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:11.910062 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecac3916-50e3-4a79-ab84-785a8cfe8f1d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:11.912112 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecac3916-50e3-4a79-ab84-785a8cfe8f1d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:11.914649 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecac3916-50e3-4a79-ab84-785a8cfe8f1d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:11.915971 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecac3916-50e3-4a79-ab84-785a8cfe8f1d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:11.975167 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d8d460d0-9d56-4b98-959a-774378151eb7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "POST /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.895567 Jul 31 01:10:11.988734 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 512/1026] 10.222.0.45 () {62 vars in 1364 bytes} [Sun Jul 31 01:10:11 2022] POST /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-volume_attachments => generated 194 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:10:12.333559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-fa87b9f7-c67e-4e72-9400-4d44d08ee302 req-435e799b-a279-418f-83a5-b92c45855b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228dc464-015e-46f4-bec0-9f81a1dc15d2", "tag": "9a86b1f7-6a8e-4f86-8208-6993e348a723"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:12.458208 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:12.475112 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fa87b9f7-c67e-4e72-9400-4d44d08ee302 req-435e799b-a279-418f-83a5-b92c45855b2e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:12.475947 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fa87b9f7-c67e-4e72-9400-4d44d08ee302 req-435e799b-a279-418f-83a5-b92c45855b2e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:12.514399 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-fa87b9f7-c67e-4e72-9400-4d44d08ee302 req-435e799b-a279-418f-83a5-b92c45855b2e service nova] Creating event network-changed:9a86b1f7-6a8e-4f86-8208-6993e348a723 for instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 on n-h2-master-1 Jul 31 01:10:12.534765 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-fa87b9f7-c67e-4e72-9400-4d44d08ee302 req-435e799b-a279-418f-83a5-b92c45855b2e service nova] Instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:10:12.573463 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-fa87b9f7-c67e-4e72-9400-4d44d08ee302 req-435e799b-a279-418f-83a5-b92c45855b2e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.252077 Jul 31 01:10:12.579137 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 513/1027] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:10:12.782904 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-045b2af5-aaeb-4905-8e20-67c26b7dee89 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:12.783788 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-045b2af5-aaeb-4905-8e20-67c26b7dee89 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:12.809025 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-045b2af5-aaeb-4905-8e20-67c26b7dee89 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:12.809920 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-045b2af5-aaeb-4905-8e20-67c26b7dee89 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:12.811046 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-045b2af5-aaeb-4905-8e20-67c26b7dee89 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:12.811835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-045b2af5-aaeb-4905-8e20-67c26b7dee89 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:12.818470 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:13.378220 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ecac3916-50e3-4a79-ab84-785a8cfe8f1d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:13.404551 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ecac3916-50e3-4a79-ab84-785a8cfe8f1d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1316 microversion: 2.1 time: 1.525072 Jul 31 01:10:13.409380 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 515/1028] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:11 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1316 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:13.889737 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-045b2af5-aaeb-4905-8e20-67c26b7dee89 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:13.904591 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-045b2af5-aaeb-4905-8e20-67c26b7dee89 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1535 microversion: 2.1 time: 1.126740 Jul 31 01:10:13.905482 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 514/1029] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:12 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1535 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:14.445987 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1d31951f-4e34-4d12-a82e-f8525cac2159 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:14.450041 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1d31951f-4e34-4d12-a82e-f8525cac2159 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:14.484883 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d31951f-4e34-4d12-a82e-f8525cac2159 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:14.485960 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d31951f-4e34-4d12-a82e-f8525cac2159 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:14.487118 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d31951f-4e34-4d12-a82e-f8525cac2159 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:14.487869 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d31951f-4e34-4d12-a82e-f8525cac2159 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:14.934626 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-12552a87-9df6-4bf8-b96e-d3894e932d7a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:14.936393 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-12552a87-9df6-4bf8-b96e-d3894e932d7a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:14.964070 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12552a87-9df6-4bf8-b96e-d3894e932d7a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:14.966848 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12552a87-9df6-4bf8-b96e-d3894e932d7a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:14.970366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12552a87-9df6-4bf8-b96e-d3894e932d7a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:14.973819 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12552a87-9df6-4bf8-b96e-d3894e932d7a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:16.180047 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-12552a87-9df6-4bf8-b96e-d3894e932d7a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:16.199546 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-12552a87-9df6-4bf8-b96e-d3894e932d7a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1535 microversion: 2.1 time: 1.258641 Jul 31 01:10:16.212007 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 515/1030] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:14 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1535 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:16.513400 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1d31951f-4e34-4d12-a82e-f8525cac2159 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:16.534737 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1d31951f-4e34-4d12-a82e-f8525cac2159 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1316 microversion: 2.1 time: 2.093622 Jul 31 01:10:16.560911 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 516/1031] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:14 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1316 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:16.593121 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:16.738433 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-13b33f7e-0132-4f83-a517-df977164dd7d tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'create', calling method: .version_select at 0x7fede555bb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1869873908", "description": "tempest-description-1020389048"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:16.963067 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-c99d3bd5-5568-4679-8a43-bb51b5c2a20b req-5d5e58ae-f72e-4ccb-b09d-bf3a3bd4ad88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75d60c14-7940-40cd-9ec3-090eea335022", "tag": "864029d3-8f9e-4023-9933-55c86cc3c1a1"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:16.982278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c99d3bd5-5568-4679-8a43-bb51b5c2a20b req-5d5e58ae-f72e-4ccb-b09d-bf3a3bd4ad88 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:16.982739 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c99d3bd5-5568-4679-8a43-bb51b5c2a20b req-5d5e58ae-f72e-4ccb-b09d-bf3a3bd4ad88 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:17.017885 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-c99d3bd5-5568-4679-8a43-bb51b5c2a20b req-5d5e58ae-f72e-4ccb-b09d-bf3a3bd4ad88 service nova] Creating event network-changed:864029d3-8f9e-4023-9933-55c86cc3c1a1 for instance 75d60c14-7940-40cd-9ec3-090eea335022 on n-h1-master-1 Jul 31 01:10:17.037346 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-c99d3bd5-5568-4679-8a43-bb51b5c2a20b req-5d5e58ae-f72e-4ccb-b09d-bf3a3bd4ad88 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079346 Jul 31 01:10:17.037974 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 517/1032] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:10:17.229316 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b8956a0c-cf5e-425d-8abf-1b43da1fcb63 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:17.230307 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b8956a0c-cf5e-425d-8abf-1b43da1fcb63 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:17.255975 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b8956a0c-cf5e-425d-8abf-1b43da1fcb63 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:17.256955 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b8956a0c-cf5e-425d-8abf-1b43da1fcb63 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:17.258207 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b8956a0c-cf5e-425d-8abf-1b43da1fcb63 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:17.258912 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b8956a0c-cf5e-425d-8abf-1b43da1fcb63 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:17.854128 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-13b33f7e-0132-4f83-a517-df977164dd7d tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.266157 Jul 31 01:10:17.867391 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 516/1033] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:10:16 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:10:17.890415 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-312f6912-f64f-4e70-97ee-8c1604af92ba tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:17.891963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-312f6912-f64f-4e70-97ee-8c1604af92ba tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:17.924983 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-312f6912-f64f-4e70-97ee-8c1604af92ba tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:17.926043 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-312f6912-f64f-4e70-97ee-8c1604af92ba tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:17.930445 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-312f6912-f64f-4e70-97ee-8c1604af92ba tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:17.941596 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-312f6912-f64f-4e70-97ee-8c1604af92ba tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:18.173391 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b8956a0c-cf5e-425d-8abf-1b43da1fcb63 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:18.206037 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b8956a0c-cf5e-425d-8abf-1b43da1fcb63 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1535 microversion: 2.1 time: 0.974186 Jul 31 01:10:18.229909 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 518/1034] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:17 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1535 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:18.242053 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8c994fe0-5623-4b5e-b8ef-69f7227bf4f6 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'create', calling method: .version_select at 0x7fede5522d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-809693973", "description": "tempest-description-2009615423"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:19.694063 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-312f6912-f64f-4e70-97ee-8c1604af92ba tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:19.707147 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-312f6912-f64f-4e70-97ee-8c1604af92ba tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1316 microversion: 2.1 time: 1.833094 Jul 31 01:10:19.709313 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 517/1035] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:17 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1316 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:19.736572 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f8b343ae-fcca-4cfd-9d7d-f12243e0827d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:19.738032 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f8b343ae-fcca-4cfd-9d7d-f12243e0827d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:19.756960 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8b343ae-fcca-4cfd-9d7d-f12243e0827d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:19.757995 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8b343ae-fcca-4cfd-9d7d-f12243e0827d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:19.759077 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8b343ae-fcca-4cfd-9d7d-f12243e0827d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:19.762711 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8b343ae-fcca-4cfd-9d7d-f12243e0827d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:21.141017 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8c994fe0-5623-4b5e-b8ef-69f7227bf4f6 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.911126 Jul 31 01:10:21.143972 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 519/1036] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:10:18 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:10:21.162076 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b3f593a9-ecd4-420c-91aa-c7419fd6442c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:21.166490 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b3f593a9-ecd4-420c-91aa-c7419fd6442c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:21.202432 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3f593a9-ecd4-420c-91aa-c7419fd6442c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:21.203731 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3f593a9-ecd4-420c-91aa-c7419fd6442c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:21.205113 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3f593a9-ecd4-420c-91aa-c7419fd6442c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:21.205905 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3f593a9-ecd4-420c-91aa-c7419fd6442c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:21.447216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f8b343ae-fcca-4cfd-9d7d-f12243e0827d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:21.465440 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f8b343ae-fcca-4cfd-9d7d-f12243e0827d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1528 microversion: 2.1 time: 1.739494 Jul 31 01:10:21.467591 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 518/1037] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:19 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1528 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:21.480092 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c862d27-b5bd-4a1a-a3d9-bfa850cd2f4f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-282895157", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "8a88c042-780b-4f0a-8083-c923e331d642"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:21.725464 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-2c862d27-b5bd-4a1a-a3d9-bfa850cd2f4f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] validate_networks() for [('8a88c042-780b-4f0a-8083-c923e331d642', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:10:21.774868 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b3f593a9-ecd4-420c-91aa-c7419fd6442c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:21.784946 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b3f593a9-ecd4-420c-91aa-c7419fd6442c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1316 microversion: 2.1 time: 0.639067 Jul 31 01:10:21.785542 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 520/1038] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:21 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1316 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:21.793048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8fe7a28b-05a7-4e80-b023-31ff8f90ceb4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:21.809683 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8fe7a28b-05a7-4e80-b023-31ff8f90ceb4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:21.828542 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fe7a28b-05a7-4e80-b023-31ff8f90ceb4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:21.829391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fe7a28b-05a7-4e80-b023-31ff8f90ceb4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:21.830443 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fe7a28b-05a7-4e80-b023-31ff8f90ceb4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:21.831218 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fe7a28b-05a7-4e80-b023-31ff8f90ceb4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:22.469496 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8fe7a28b-05a7-4e80-b023-31ff8f90ceb4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:22.489873 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8fe7a28b-05a7-4e80-b023-31ff8f90ceb4 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1528 microversion: 2.1 time: 0.700646 Jul 31 01:10:22.494039 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 521/1039] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:21 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1528 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:22.532583 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f31888d6-56c2-4ca4-b429-34f49ca8c7e7 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:22.544753 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:10:22.544753 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:10:22.558348 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-f31888d6-56c2-4ca4-b429-34f49ca8c7e7 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] HTTP exception thrown: Flavor cc9c4f28-4a5f-4609-a490-30b8f831043a could not be found. Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f31888d6-56c2-4ca4-b429-34f49ca8c7e7 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Request method failure captured: Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/flavors/cc9c4f28-4a5f-4609-a490-30b8f831043a HTTP/1.1 Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWQd2rLIkWma0DR8qpbYu6FeEopG3im_k0Az4nepLptXTLmYnWdFub7CJnTw7szkBp38i5jNw6_0tvOmOdzGmRzSfObO9-pW2D1cAO82k82GNHj2IDfWShPE-3tgg3JnzqHnGQ6TuZ697bPwgPkA0JRTvxywbuYNKWfTXAoXnRt1QY Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: d524a3978c454fb791ef231d147ca14a Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-MigrationsAdminTest-516171973 Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d524a3978c454fb791ef231d147ca14a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d524a3978c454fb791ef231d147ca14a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d524a3978c454fb791ef231d147ca14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d524a3978c454fb791ef231d147ca14a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-MigrationsAdminTest-516171973 Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: d524a3978c454fb791ef231d147ca14a Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-MigrationsAdminTest-516171973 Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-MigrationsAdminTest-516171973-project-admin Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 3a7cac3afc994979bb4ddb916f2619b7 Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-MigrationsAdminTest-516171973-project-admin Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: exception: Flavor cc9c4f28-4a5f-4609-a490-30b8f831043a could not be found. Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'cc9c4f28-4a5f-4609-a490-30b8f831043a'} Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor cc9c4f28-4a5f-4609-a490-30b8f831043a could not be found. Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor cc9c4f28-4a5f-4609-a490-30b8f831043a could not be found. Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:10:22.565882 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:10:22.570711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:10:22.570711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:10:22.570711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:10:22.570711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:10:22.570711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:10:22.570711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:10:22.570711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor cc9c4f28-4a5f-4609-a490-30b8f831043a could not be found. Jul 31 01:10:22.570711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:10:22.572270 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f31888d6-56c2-4ca4-b429-34f49ca8c7e7 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Returning 404 to user: Flavor cc9c4f28-4a5f-4609-a490-30b8f831043a could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:10:22.574330 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f31888d6-56c2-4ca4-b429-34f49ca8c7e7 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/cc9c4f28-4a5f-4609-a490-30b8f831043a" status: 404 len: 109 microversion: 2.1 time: 0.044676 Jul 31 01:10:22.575221 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 522/1040] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:10:22 2022] DELETE /compute/v2.1/flavors/cc9c4f28-4a5f-4609-a490-30b8f831043a => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:10:22.806186 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-54d87b60-ed5f-469f-9780-b18e93b04830 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:22.807398 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-54d87b60-ed5f-469f-9780-b18e93b04830 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:22.833839 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54d87b60-ed5f-469f-9780-b18e93b04830 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:22.834600 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54d87b60-ed5f-469f-9780-b18e93b04830 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:22.835959 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54d87b60-ed5f-469f-9780-b18e93b04830 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:22.836601 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54d87b60-ed5f-469f-9780-b18e93b04830 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:23.373175 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-54d87b60-ed5f-469f-9780-b18e93b04830 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:23.403126 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-54d87b60-ed5f-469f-9780-b18e93b04830 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1316 microversion: 2.1 time: 0.599605 Jul 31 01:10:23.405042 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 523/1041] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:22 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1316 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:10:23.415103 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6b2fdcc4-47ae-450d-b9be-4fb40c4e29be tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1283505228", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:23.502797 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-6b2fdcc4-47ae-450d-b9be-4fb40c4e29be tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:10:23.953483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-2c862d27-b5bd-4a1a-a3d9-bfa850cd2f4f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:10:23.954284 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-2c862d27-b5bd-4a1a-a3d9-bfa850cd2f4f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:10:23.954979 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-2c862d27-b5bd-4a1a-a3d9-bfa850cd2f4f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:10:23.955674 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-2c862d27-b5bd-4a1a-a3d9-bfa850cd2f4f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:10:23.956199 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-2c862d27-b5bd-4a1a-a3d9-bfa850cd2f4f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:10:23.986464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c862d27-b5bd-4a1a-a3d9-bfa850cd2f4f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:23.989433 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c862d27-b5bd-4a1a-a3d9-bfa850cd2f4f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:23.991605 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c862d27-b5bd-4a1a-a3d9-bfa850cd2f4f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:23.995086 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c862d27-b5bd-4a1a-a3d9-bfa850cd2f4f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:24.066133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-2c862d27-b5bd-4a1a-a3d9-bfa850cd2f4f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Getting quotas for project a45cfeb1ce9844c5bf16e975af312ba0. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:10:24.099987 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-2c862d27-b5bd-4a1a-a3d9-bfa850cd2f4f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Getting quotas for user e3e6a158c3884c8db5a66fe80e71527d and project a45cfeb1ce9844c5bf16e975af312ba0. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:10:24.187451 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2c862d27-b5bd-4a1a-a3d9-bfa850cd2f4f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:10:24.201843 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2c862d27-b5bd-4a1a-a3d9-bfa850cd2f4f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:10:24.335559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-6b2fdcc4-47ae-450d-b9be-4fb40c4e29be tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:10:24.336286 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-6b2fdcc4-47ae-450d-b9be-4fb40c4e29be tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:10:24.336784 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-6b2fdcc4-47ae-450d-b9be-4fb40c4e29be tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:10:24.337210 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-6b2fdcc4-47ae-450d-b9be-4fb40c4e29be tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:10:24.337943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-6b2fdcc4-47ae-450d-b9be-4fb40c4e29be tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:10:24.359896 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2c862d27-b5bd-4a1a-a3d9-bfa850cd2f4f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.889858 Jul 31 01:10:24.360581 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 519/1042] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:10:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:10:24.384943 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b2fdcc4-47ae-450d-b9be-4fb40c4e29be tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:24.385413 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b2fdcc4-47ae-450d-b9be-4fb40c4e29be tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:24.391415 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d4fc98f2-779a-4688-9e5e-af006ce24d35 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:24.392405 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d4fc98f2-779a-4688-9e5e-af006ce24d35 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:24.392863 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b2fdcc4-47ae-450d-b9be-4fb40c4e29be tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:24.393626 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b2fdcc4-47ae-450d-b9be-4fb40c4e29be tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:24.481240 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-6b2fdcc4-47ae-450d-b9be-4fb40c4e29be tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Getting quotas for project 87496179e992473c991977e0e517460a. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:10:24.501156 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-6b2fdcc4-47ae-450d-b9be-4fb40c4e29be tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Getting quotas for user 9a2a0f61c8304c9a9ad7af6120e83443 and project 87496179e992473c991977e0e517460a. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:10:24.543249 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6b2fdcc4-47ae-450d-b9be-4fb40c4e29be tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:10:24.568328 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6b2fdcc4-47ae-450d-b9be-4fb40c4e29be tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:10:24.697384 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6b2fdcc4-47ae-450d-b9be-4fb40c4e29be tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.285881 Jul 31 01:10:24.698124 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 524/1043] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:10:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:10:24.705352 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d4fc98f2-779a-4688-9e5e-af006ce24d35 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:24.708054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1a22669b-3ed1-4643-8eaa-17e7843f0fad tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:24.715196 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1a22669b-3ed1-4643-8eaa-17e7843f0fad tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:24.727330 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d4fc98f2-779a-4688-9e5e-af006ce24d35 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f" status: 200 len: 1215 microversion: 2.1 time: 0.359503 Jul 31 01:10:24.730865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a22669b-3ed1-4643-8eaa-17e7843f0fad tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:24.741032 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a22669b-3ed1-4643-8eaa-17e7843f0fad tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:24.742810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a22669b-3ed1-4643-8eaa-17e7843f0fad tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:24.746544 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a22669b-3ed1-4643-8eaa-17e7843f0fad tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:24.753641 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 520/1044] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:24 2022] GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f => generated 1215 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:24.803275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ccc683af-6492-4761-8f8b-a83bc9ff98e6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:24.806342 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ccc683af-6492-4761-8f8b-a83bc9ff98e6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:25.001167 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ccc683af-6492-4761-8f8b-a83bc9ff98e6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:25.013641 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ccc683af-6492-4761-8f8b-a83bc9ff98e6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1213 microversion: 2.1 time: 0.244539 Jul 31 01:10:25.053486 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 521/1045] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:24 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1213 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:25.217615 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1a22669b-3ed1-4643-8eaa-17e7843f0fad tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:25.229449 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1a22669b-3ed1-4643-8eaa-17e7843f0fad tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1316 microversion: 2.1 time: 0.528297 Jul 31 01:10:25.231868 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 525/1046] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:24 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1316 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:25.780315 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-be961071-37e0-45cb-aa07-e51d18b818ef tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:25.784955 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-be961071-37e0-45cb-aa07-e51d18b818ef tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:26.037839 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-59ffc6cd-7e4c-4093-885b-ece50a259671 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:26.039123 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-59ffc6cd-7e4c-4093-885b-ece50a259671 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:26.828619 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-59ffc6cd-7e4c-4093-885b-ece50a259671 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:26.829674 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-be961071-37e0-45cb-aa07-e51d18b818ef tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:26.850614 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-59ffc6cd-7e4c-4093-885b-ece50a259671 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1213 microversion: 2.1 time: 0.816926 Jul 31 01:10:26.867700 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-be961071-37e0-45cb-aa07-e51d18b818ef tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f" status: 200 len: 1215 microversion: 2.1 time: 1.078162 Jul 31 01:10:26.869919 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 526/1047] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:26 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1213 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:10:26.871760 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 522/1048] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:25 2022] GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f => generated 1215 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:26.876803 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cec7e898-78fb-4d87-9adb-1417ff0bf343 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:26.877794 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cec7e898-78fb-4d87-9adb-1417ff0bf343 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:26.885628 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cec7e898-78fb-4d87-9adb-1417ff0bf343 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:26.887248 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cec7e898-78fb-4d87-9adb-1417ff0bf343 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:26.888506 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cec7e898-78fb-4d87-9adb-1417ff0bf343 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:26.889202 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cec7e898-78fb-4d87-9adb-1417ff0bf343 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:27.291975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cec7e898-78fb-4d87-9adb-1417ff0bf343 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:27.302845 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cec7e898-78fb-4d87-9adb-1417ff0bf343 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1316 microversion: 2.1 time: 0.431431 Jul 31 01:10:27.309762 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 527/1049] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:26 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1316 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:27.790788 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-6872644e-9dac-41e7-babc-5fd25bbaa801 req-8dfcdae5-da3f-45b2-bba7-9356401753f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228dc464-015e-46f4-bec0-9f81a1dc15d2", "name": "network-vif-plugged", "status": "completed", "tag": "9a86b1f7-6a8e-4f86-8208-6993e348a723"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:27.833244 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-6872644e-9dac-41e7-babc-5fd25bbaa801 req-8dfcdae5-da3f-45b2-bba7-9356401753f4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:27.834116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-6872644e-9dac-41e7-babc-5fd25bbaa801 req-8dfcdae5-da3f-45b2-bba7-9356401753f4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:27.880719 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-6872644e-9dac-41e7-babc-5fd25bbaa801 req-8dfcdae5-da3f-45b2-bba7-9356401753f4 service nova] Creating event network-vif-plugged:9a86b1f7-6a8e-4f86-8208-6993e348a723 for instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 on n-h2-master-1 Jul 31 01:10:27.883701 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c4aad1c0-c547-4636-8040-d3a89901ae36 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:27.885231 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c4aad1c0-c547-4636-8040-d3a89901ae36 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:27.893450 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-6872644e-9dac-41e7-babc-5fd25bbaa801 req-8dfcdae5-da3f-45b2-bba7-9356401753f4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108252 Jul 31 01:10:27.896348 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 523/1050] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:10:27.908554 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c4aad1c0-c547-4636-8040-d3a89901ae36 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:27.917347 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c4aad1c0-c547-4636-8040-d3a89901ae36 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:27.920072 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c4aad1c0-c547-4636-8040-d3a89901ae36 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:27.927838 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6748c8f3-a58f-4f96-9f6a-6147c6eae9a7 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:27.928906 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6748c8f3-a58f-4f96-9f6a-6147c6eae9a7 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:27.929042 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c4aad1c0-c547-4636-8040-d3a89901ae36 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:27.938139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6748c8f3-a58f-4f96-9f6a-6147c6eae9a7 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:27.939073 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6748c8f3-a58f-4f96-9f6a-6147c6eae9a7 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:27.940167 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6748c8f3-a58f-4f96-9f6a-6147c6eae9a7 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:27.940806 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6748c8f3-a58f-4f96-9f6a-6147c6eae9a7 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:28.238813 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6748c8f3-a58f-4f96-9f6a-6147c6eae9a7 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:28.251707 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c4aad1c0-c547-4636-8040-d3a89901ae36 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:28.253694 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6748c8f3-a58f-4f96-9f6a-6147c6eae9a7 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f" status: 200 len: 1273 microversion: 2.1 time: 0.352838 Jul 31 01:10:28.257031 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 524/1051] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:27 2022] GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f => generated 1273 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:28.281580 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c4aad1c0-c547-4636-8040-d3a89901ae36 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1273 microversion: 2.1 time: 0.409488 Jul 31 01:10:28.285488 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 528/1052] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:27 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1273 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:28.332175 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2334c683-be97-40ef-a818-0dcc033a7318 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:28.334215 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2334c683-be97-40ef-a818-0dcc033a7318 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:28.355552 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2334c683-be97-40ef-a818-0dcc033a7318 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:28.356913 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2334c683-be97-40ef-a818-0dcc033a7318 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:28.359278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2334c683-be97-40ef-a818-0dcc033a7318 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:28.361092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2334c683-be97-40ef-a818-0dcc033a7318 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:28.826978 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2334c683-be97-40ef-a818-0dcc033a7318 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:28.839276 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2334c683-be97-40ef-a818-0dcc033a7318 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1316 microversion: 2.1 time: 0.512409 Jul 31 01:10:28.849745 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 525/1053] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:28 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1316 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:28.869573 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f68c55a6-3e6e-4663-a96c-16cdc820d2c7 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:28.871548 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f68c55a6-3e6e-4663-a96c-16cdc820d2c7 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:28.892939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f68c55a6-3e6e-4663-a96c-16cdc820d2c7 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:28.894385 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f68c55a6-3e6e-4663-a96c-16cdc820d2c7 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:28.897395 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f68c55a6-3e6e-4663-a96c-16cdc820d2c7 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:28.904777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f68c55a6-3e6e-4663-a96c-16cdc820d2c7 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:29.300216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bf683f0c-04b7-423f-855a-d0681557d8d5 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:29.301844 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bf683f0c-04b7-423f-855a-d0681557d8d5 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:29.322941 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf683f0c-04b7-423f-855a-d0681557d8d5 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:29.325089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf683f0c-04b7-423f-855a-d0681557d8d5 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:29.326870 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf683f0c-04b7-423f-855a-d0681557d8d5 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:29.329253 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf683f0c-04b7-423f-855a-d0681557d8d5 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:29.454832 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f68c55a6-3e6e-4663-a96c-16cdc820d2c7 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1812 microversion: 2.1 time: 0.592667 Jul 31 01:10:29.456204 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 529/1054] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:28 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1812 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:29.465302 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c90ac422-e3ec-4de6-8ea8-838c7b983ed9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:29.466182 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c90ac422-e3ec-4de6-8ea8-838c7b983ed9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:29.478771 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c90ac422-e3ec-4de6-8ea8-838c7b983ed9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:29.479918 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c90ac422-e3ec-4de6-8ea8-838c7b983ed9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:29.481316 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c90ac422-e3ec-4de6-8ea8-838c7b983ed9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:29.482172 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c90ac422-e3ec-4de6-8ea8-838c7b983ed9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:29.626437 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bf683f0c-04b7-423f-855a-d0681557d8d5 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:29.641991 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bf683f0c-04b7-423f-855a-d0681557d8d5 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f" status: 200 len: 1273 microversion: 2.1 time: 0.347294 Jul 31 01:10:29.657780 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 526/1055] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:29 2022] GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f => generated 1273 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:29.663935 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2b4f5d31-813e-4c8a-950c-adc3c6e2d2cf tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:29.667946 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:10:29.667946 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:10:29.669966 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b4f5d31-813e-4c8a-950c-adc3c6e2d2cf tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:29.670737 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b4f5d31-813e-4c8a-950c-adc3c6e2d2cf tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:29.672012 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b4f5d31-813e-4c8a-950c-adc3c6e2d2cf tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:29.672769 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b4f5d31-813e-4c8a-950c-adc3c6e2d2cf tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:29.705663 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:29.744157 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c90ac422-e3ec-4de6-8ea8-838c7b983ed9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:29.746717 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2b4f5d31-813e-4c8a-950c-adc3c6e2d2cf tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.087333 Jul 31 01:10:29.747849 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 527/1056] 10.222.0.45 () {58 vars in 1176 bytes} [Sun Jul 31 01:10:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:10:29.786436 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c90ac422-e3ec-4de6-8ea8-838c7b983ed9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1271 microversion: 2.1 time: 0.308662 Jul 31 01:10:29.786436 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 530/1057] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:29 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1271 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:29.861545 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-55cd81e4-b50c-41b8-b86e-542b2ea7807c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:29.862961 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-55cd81e4-b50c-41b8-b86e-542b2ea7807c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:29.875390 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-55cd81e4-b50c-41b8-b86e-542b2ea7807c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:29.880774 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-55cd81e4-b50c-41b8-b86e-542b2ea7807c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:29.882054 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-55cd81e4-b50c-41b8-b86e-542b2ea7807c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:29.882778 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-55cd81e4-b50c-41b8-b86e-542b2ea7807c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:29.931291 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-6509d38e-c2d8-4e11-bdd5-e991769610fa req-fb6770d0-f898-4414-8644-9fea90bf4b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75d60c14-7940-40cd-9ec3-090eea335022", "name": "network-vif-plugged", "status": "completed", "tag": "864029d3-8f9e-4023-9933-55c86cc3c1a1"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:29.964433 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6509d38e-c2d8-4e11-bdd5-e991769610fa req-fb6770d0-f898-4414-8644-9fea90bf4b63 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:29.972742 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6509d38e-c2d8-4e11-bdd5-e991769610fa req-fb6770d0-f898-4414-8644-9fea90bf4b63 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:30.033776 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-6509d38e-c2d8-4e11-bdd5-e991769610fa req-fb6770d0-f898-4414-8644-9fea90bf4b63 service nova] Creating event network-vif-plugged:864029d3-8f9e-4023-9933-55c86cc3c1a1 for instance 75d60c14-7940-40cd-9ec3-090eea335022 on n-h1-master-1 Jul 31 01:10:30.052833 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-6509d38e-c2d8-4e11-bdd5-e991769610fa req-fb6770d0-f898-4414-8644-9fea90bf4b63 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124836 Jul 31 01:10:30.055836 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 531/1058] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:10:30.578928 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-55cd81e4-b50c-41b8-b86e-542b2ea7807c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:30.594061 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-55cd81e4-b50c-41b8-b86e-542b2ea7807c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1316 microversion: 2.1 time: 0.737142 Jul 31 01:10:30.606191 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 528/1059] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:29 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1316 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:30.670161 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f3e0eb0d-75ac-4889-b053-305396588377 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:30.670935 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f3e0eb0d-75ac-4889-b053-305396588377 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:30.700681 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3e0eb0d-75ac-4889-b053-305396588377 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:30.701525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3e0eb0d-75ac-4889-b053-305396588377 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:30.705395 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3e0eb0d-75ac-4889-b053-305396588377 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:30.707568 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3e0eb0d-75ac-4889-b053-305396588377 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:30.810091 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-81e406af-0cbc-41ce-9713-e7c31bff0bf7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:30.813926 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-81e406af-0cbc-41ce-9713-e7c31bff0bf7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:30.845115 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81e406af-0cbc-41ce-9713-e7c31bff0bf7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:30.845763 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81e406af-0cbc-41ce-9713-e7c31bff0bf7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:30.846832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81e406af-0cbc-41ce-9713-e7c31bff0bf7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:30.852803 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81e406af-0cbc-41ce-9713-e7c31bff0bf7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:31.033476 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f3e0eb0d-75ac-4889-b053-305396588377 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:31.047837 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f3e0eb0d-75ac-4889-b053-305396588377 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f" status: 200 len: 1273 microversion: 2.1 time: 0.383434 Jul 31 01:10:31.051716 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 532/1060] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:30 2022] GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f => generated 1273 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:31.118914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-81e406af-0cbc-41ce-9713-e7c31bff0bf7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:31.134219 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-81e406af-0cbc-41ce-9713-e7c31bff0bf7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1271 microversion: 2.1 time: 0.329567 Jul 31 01:10:31.136078 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 529/1061] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:30 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1271 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:31.624211 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9c5af2b1-f74d-45bf-a26e-7d99c3d24289 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:31.625120 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9c5af2b1-f74d-45bf-a26e-7d99c3d24289 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:31.639680 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c5af2b1-f74d-45bf-a26e-7d99c3d24289 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:31.641082 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c5af2b1-f74d-45bf-a26e-7d99c3d24289 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:31.644669 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c5af2b1-f74d-45bf-a26e-7d99c3d24289 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:31.645381 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c5af2b1-f74d-45bf-a26e-7d99c3d24289 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:32.071593 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-39d56106-1812-41c6-8b55-4b18b31aaa18 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:32.073226 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-39d56106-1812-41c6-8b55-4b18b31aaa18 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:32.083467 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39d56106-1812-41c6-8b55-4b18b31aaa18 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:32.084301 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39d56106-1812-41c6-8b55-4b18b31aaa18 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:32.089000 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39d56106-1812-41c6-8b55-4b18b31aaa18 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:32.089881 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39d56106-1812-41c6-8b55-4b18b31aaa18 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:32.446085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9c5af2b1-f74d-45bf-a26e-7d99c3d24289 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:32.465365 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9c5af2b1-f74d-45bf-a26e-7d99c3d24289 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1316 microversion: 2.1 time: 0.845361 Jul 31 01:10:32.474043 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 533/1062] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:31 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1316 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:32.495215 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-895f81dc-24f4-4d79-a447-78da908eb0dd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:32.503451 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-895f81dc-24f4-4d79-a447-78da908eb0dd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:32.534841 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-895f81dc-24f4-4d79-a447-78da908eb0dd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:32.538812 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-895f81dc-24f4-4d79-a447-78da908eb0dd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:32.542296 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-895f81dc-24f4-4d79-a447-78da908eb0dd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:32.545087 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-895f81dc-24f4-4d79-a447-78da908eb0dd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:32.569725 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:32.739246 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-39d56106-1812-41c6-8b55-4b18b31aaa18 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:32.754516 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-39d56106-1812-41c6-8b55-4b18b31aaa18 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f" status: 200 len: 1315 microversion: 2.1 time: 0.684806 Jul 31 01:10:32.756029 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 530/1063] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:32 2022] GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:10:33.068443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2b00096e-de9b-4781-8000-0a9e67d61bf1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "382917a5-c82f-4992-a11e-ee87404429b0", "device": "/dev/xvdb"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:33.068443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2b00096e-de9b-4781-8000-0a9e67d61bf1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:33.086757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b00096e-de9b-4781-8000-0a9e67d61bf1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:33.086757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b00096e-de9b-4781-8000-0a9e67d61bf1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:33.086757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b00096e-de9b-4781-8000-0a9e67d61bf1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:33.086757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b00096e-de9b-4781-8000-0a9e67d61bf1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:33.193935 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-895f81dc-24f4-4d79-a447-78da908eb0dd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:33.207201 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-895f81dc-24f4-4d79-a447-78da908eb0dd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1313 microversion: 2.1 time: 0.728687 Jul 31 01:10:33.215070 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 534/1064] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:32 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1313 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:33.495840 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-17c89c0c-c3a7-4cd5-b814-224fcd2cdd01 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:33.497044 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-17c89c0c-c3a7-4cd5-b814-224fcd2cdd01 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:33.513910 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17c89c0c-c3a7-4cd5-b814-224fcd2cdd01 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:33.519798 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17c89c0c-c3a7-4cd5-b814-224fcd2cdd01 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:33.520809 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17c89c0c-c3a7-4cd5-b814-224fcd2cdd01 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:33.521519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17c89c0c-c3a7-4cd5-b814-224fcd2cdd01 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:34.229078 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2b00096e-de9b-4781-8000-0a9e67d61bf1 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "POST /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.171738 Jul 31 01:10:34.239916 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 531/1065] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:10:33 2022] POST /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments => generated 194 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:10:34.256301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bfc51ba0-ff17-46fb-8c67-e908589f2829 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:34.261062 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bfc51ba0-ff17-46fb-8c67-e908589f2829 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:34.280472 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfc51ba0-ff17-46fb-8c67-e908589f2829 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:34.286096 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfc51ba0-ff17-46fb-8c67-e908589f2829 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:34.286967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfc51ba0-ff17-46fb-8c67-e908589f2829 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:34.295250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfc51ba0-ff17-46fb-8c67-e908589f2829 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:34.418073 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:34.488343 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-17c89c0c-c3a7-4cd5-b814-224fcd2cdd01 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:34.512367 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-17c89c0c-c3a7-4cd5-b814-224fcd2cdd01 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1465 microversion: 2.1 time: 1.021784 Jul 31 01:10:34.514099 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 535/1066] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:33 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1465 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:10:34.524589 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a1173455-166d-4c32-9a7e-d960f7c559ea tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:34.526204 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a1173455-166d-4c32-9a7e-d960f7c559ea tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:34.534082 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1173455-166d-4c32-9a7e-d960f7c559ea tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:34.534839 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1173455-166d-4c32-9a7e-d960f7c559ea tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:34.535924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1173455-166d-4c32-9a7e-d960f7c559ea tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:34.536710 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1173455-166d-4c32-9a7e-d960f7c559ea tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:35.643023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a1173455-166d-4c32-9a7e-d960f7c559ea tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:35.660751 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a1173455-166d-4c32-9a7e-d960f7c559ea tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1313 microversion: 2.1 time: 1.144804 Jul 31 01:10:35.661654 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bfc51ba0-ff17-46fb-8c67-e908589f2829 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:35.667521 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 536/1067] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:34 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1313 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:35.688656 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bfc51ba0-ff17-46fb-8c67-e908589f2829 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f" status: 200 len: 1315 microversion: 2.1 time: 1.447215 Jul 31 01:10:35.689226 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-146d1823-ea0a-4581-b639-4c40edb32ed3 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:35.690211 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-146d1823-ea0a-4581-b639-4c40edb32ed3 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:35.690766 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 532/1068] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:34 2022] GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f => generated 1315 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:35.708657 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8860a3f7-af41-4371-992f-4909480b5c7f tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:35.710625 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8860a3f7-af41-4371-992f-4909480b5c7f tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:35.726423 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-146d1823-ea0a-4581-b639-4c40edb32ed3 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:35.726869 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-146d1823-ea0a-4581-b639-4c40edb32ed3 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:35.734378 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-146d1823-ea0a-4581-b639-4c40edb32ed3 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:35.734746 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8860a3f7-af41-4371-992f-4909480b5c7f tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:35.735974 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-146d1823-ea0a-4581-b639-4c40edb32ed3 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:35.737203 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8860a3f7-af41-4371-992f-4909480b5c7f tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:35.738869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8860a3f7-af41-4371-992f-4909480b5c7f tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:35.741016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8860a3f7-af41-4371-992f-4909480b5c7f tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:36.416061 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-146d1823-ea0a-4581-b639-4c40edb32ed3 tempest-ServersOnMultiNodesTest-8331078 tempest-ServersOnMultiNodesTest-8331078-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1616 microversion: 2.1 time: 0.745021 Jul 31 01:10:36.417263 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 537/1069] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:35 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1616 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:36.432470 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-e6850d34-c7f0-467f-862c-2839fdef46e7 req-26383cb2-3c08-45f8-bd10-db2b8eb62ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2786dc8b-517e-4c01-be66-c7959ff8972f", "tag": "e58b02f2-5ad0-4d5c-8b46-97753614753b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:36.462416 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e6850d34-c7f0-467f-862c-2839fdef46e7 req-26383cb2-3c08-45f8-bd10-db2b8eb62ea9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:36.462877 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e6850d34-c7f0-467f-862c-2839fdef46e7 req-26383cb2-3c08-45f8-bd10-db2b8eb62ea9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:36.501799 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-e6850d34-c7f0-467f-862c-2839fdef46e7 req-26383cb2-3c08-45f8-bd10-db2b8eb62ea9 service nova] Creating event network-changed:e58b02f2-5ad0-4d5c-8b46-97753614753b for instance 2786dc8b-517e-4c01-be66-c7959ff8972f on n-h2-master-1 Jul 31 01:10:36.509702 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-e6850d34-c7f0-467f-862c-2839fdef46e7 req-26383cb2-3c08-45f8-bd10-db2b8eb62ea9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089943 Jul 31 01:10:36.511012 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 538/1070] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:10:36.635814 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a206823-71e2-4b6f-9fb9-b46897c27ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1580225993", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "439c28bf-0712-481c-9dca-6d50f87fcfd9"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:36.648602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-8860a3f7-af41-4371-992f-4909480b5c7f tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'services' on Instance uuid 011dbabc-56cc-4f90-be60-972ffeb468b1 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:10:36.701878 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8860a3f7-af41-4371-992f-4909480b5c7f tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 2420 microversion: 2.25 time: 1.006028 Jul 31 01:10:36.708377 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 533/1071] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:10:35 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 2420 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:10:36.718945 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d2f63277-898e-4b40-a2fc-44b543a45960 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:36.721787 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d2f63277-898e-4b40-a2fc-44b543a45960 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:36.739388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2f63277-898e-4b40-a2fc-44b543a45960 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:36.740468 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2f63277-898e-4b40-a2fc-44b543a45960 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:36.742699 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2f63277-898e-4b40-a2fc-44b543a45960 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:36.743421 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2f63277-898e-4b40-a2fc-44b543a45960 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:36.831396 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-9a206823-71e2-4b6f-9fb9-b46897c27ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:10:36.853894 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=12 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:36.859549 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:37.100805 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d2f63277-898e-4b40-a2fc-44b543a45960 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:37.110353 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d2f63277-898e-4b40-a2fc-44b543a45960 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1313 microversion: 2.1 time: 0.399860 Jul 31 01:10:37.122751 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 534/1072] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:36 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:37.136544 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a5e64510-99b4-4ecb-8899-2f0fe6a3e810 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:37.143888 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a5e64510-99b4-4ecb-8899-2f0fe6a3e810 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:37.158482 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a5e64510-99b4-4ecb-8899-2f0fe6a3e810 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:37.159361 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a5e64510-99b4-4ecb-8899-2f0fe6a3e810 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:37.160450 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a5e64510-99b4-4ecb-8899-2f0fe6a3e810 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:37.161149 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a5e64510-99b4-4ecb-8899-2f0fe6a3e810 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:38.221887 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a5e64510-99b4-4ecb-8899-2f0fe6a3e810 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:38.237455 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a5e64510-99b4-4ecb-8899-2f0fe6a3e810 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f" status: 200 len: 1315 microversion: 2.1 time: 1.106923 Jul 31 01:10:38.242484 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 535/1073] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:37 2022] GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f => generated 1315 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:38.260921 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-41b6b51e-4004-4797-9577-d257595c3a0d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:38.278337 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-41b6b51e-4004-4797-9577-d257595c3a0d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:38.288167 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41b6b51e-4004-4797-9577-d257595c3a0d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:38.289926 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41b6b51e-4004-4797-9577-d257595c3a0d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:38.291286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41b6b51e-4004-4797-9577-d257595c3a0d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:38.292259 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41b6b51e-4004-4797-9577-d257595c3a0d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:38.372566 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-41b6b51e-4004-4797-9577-d257595c3a0d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'flavor' on Instance uuid 011dbabc-56cc-4f90-be60-972ffeb468b1 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:10:38.392829 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-41b6b51e-4004-4797-9577-d257595c3a0d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Going to try to live migrate instance to n-h2-master-1 {{(pid=119474) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 31 01:10:38.580770 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9a206823-71e2-4b6f-9fb9-b46897c27ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:10:38.581255 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9a206823-71e2-4b6f-9fb9-b46897c27ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:10:38.581731 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9a206823-71e2-4b6f-9fb9-b46897c27ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:10:38.582459 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9a206823-71e2-4b6f-9fb9-b46897c27ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:10:38.582859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9a206823-71e2-4b6f-9fb9-b46897c27ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:10:38.589298 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:38.603888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a206823-71e2-4b6f-9fb9-b46897c27ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:38.605119 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a206823-71e2-4b6f-9fb9-b46897c27ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:38.609332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a206823-71e2-4b6f-9fb9-b46897c27ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:38.612165 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a206823-71e2-4b6f-9fb9-b46897c27ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:38.711079 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-9a206823-71e2-4b6f-9fb9-b46897c27ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:10:38.735164 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-9a206823-71e2-4b6f-9fb9-b46897c27ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Getting quotas for user 0fad0a50973b44149c18ca2b76bfab36 and project ba602c4ed5b94aad996ef8c95d3436ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:10:38.797081 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9a206823-71e2-4b6f-9fb9-b46897c27ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:10:38.819410 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9a206823-71e2-4b6f-9fb9-b46897c27ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:10:39.045702 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9a206823-71e2-4b6f-9fb9-b46897c27ca5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.412685 Jul 31 01:10:39.062040 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 539/1074] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:10:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:10:39.113347 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f9d6e846-6c69-4ae3-a2e4-4da81f243bca tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:39.114460 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f9d6e846-6c69-4ae3-a2e4-4da81f243bca tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:39.184777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9d6e846-6c69-4ae3-a2e4-4da81f243bca tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:39.185364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9d6e846-6c69-4ae3-a2e4-4da81f243bca tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:39.203808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9d6e846-6c69-4ae3-a2e4-4da81f243bca tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:39.204764 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9d6e846-6c69-4ae3-a2e4-4da81f243bca tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:39.694102 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:39.964897 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f9d6e846-6c69-4ae3-a2e4-4da81f243bca tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:39.979031 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f9d6e846-6c69-4ae3-a2e4-4da81f243bca tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1313 microversion: 2.1 time: 0.915291 Jul 31 01:10:39.980715 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 540/1075] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:39 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1313 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:40.007103 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c260db1f-e27a-417a-bb18-ed844d1cd485 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1101567207", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "893a17e7-3442-4e0c-982a-05767fdb8329"}, {"uuid": "642e3172-c1c7-4ec3-9aba-db44ca391f36"}, {"uuid": "893a17e7-3442-4e0c-982a-05767fdb8329"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:40.152529 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-c260db1f-e27a-417a-bb18-ed844d1cd485 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] validate_networks() for [('893a17e7-3442-4e0c-982a-05767fdb8329', None, None, None, None, None), ('642e3172-c1c7-4ec3-9aba-db44ca391f36', None, None, None, None, None), ('893a17e7-3442-4e0c-982a-05767fdb8329', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:10:41.850758 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-41b6b51e-4004-4797-9577-d257595c3a0d tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/action" status: 202 len: 0 microversion: 2.25 time: 3.605958 Jul 31 01:10:41.856798 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 536/1076] 10.222.0.45 () {62 vars in 1319 bytes} [Sun Jul 31 01:10:38 2022] POST /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/action => generated 0 bytes in 3613 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:10:41.868062 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-ce4ba5b6-d654-48e5-b151-3d23c6c8609b req-a8850002-ea41-4328-a9c0-331fd38041ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eafdd229-897b-4b1f-adfc-3d7bb4fef7a0", "tag": "5ee707da-030a-4991-809c-69f12af3f140"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:41.904887 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:41.915682 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-ce4ba5b6-d654-48e5-b151-3d23c6c8609b req-a8850002-ea41-4328-a9c0-331fd38041ab service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:41.922358 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-ce4ba5b6-d654-48e5-b151-3d23c6c8609b req-a8850002-ea41-4328-a9c0-331fd38041ab service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:41.953671 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-ce4ba5b6-d654-48e5-b151-3d23c6c8609b req-a8850002-ea41-4328-a9c0-331fd38041ab service nova] Creating event network-changed:5ee707da-030a-4991-809c-69f12af3f140 for instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 on n-h2-master-1 Jul 31 01:10:41.963662 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-ce4ba5b6-d654-48e5-b151-3d23c6c8609b req-a8850002-ea41-4328-a9c0-331fd38041ab service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103830 Jul 31 01:10:41.965322 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 537/1077] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:10:41.976704 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-211cc81e-710f-4f60-9ca9-b31c71541dc6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:41.977692 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-211cc81e-710f-4f60-9ca9-b31c71541dc6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:41.994461 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-211cc81e-710f-4f60-9ca9-b31c71541dc6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:41.995571 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-211cc81e-710f-4f60-9ca9-b31c71541dc6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:41.996751 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-211cc81e-710f-4f60-9ca9-b31c71541dc6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:41.997394 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-211cc81e-710f-4f60-9ca9-b31c71541dc6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:42.307014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-211cc81e-710f-4f60-9ca9-b31c71541dc6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:42.316481 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-211cc81e-710f-4f60-9ca9-b31c71541dc6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1269 microversion: 2.1 time: 0.345904 Jul 31 01:10:42.318593 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 538/1078] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:41 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1269 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:42.323715 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1f04e67d-350c-4e7d-9008-5f74b80c1f61 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:42.340459 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1f04e67d-350c-4e7d-9008-5f74b80c1f61 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:42.361577 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f04e67d-350c-4e7d-9008-5f74b80c1f61 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:42.362064 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f04e67d-350c-4e7d-9008-5f74b80c1f61 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:42.362876 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f04e67d-350c-4e7d-9008-5f74b80c1f61 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:42.363768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f04e67d-350c-4e7d-9008-5f74b80c1f61 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:43.489899 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1f04e67d-350c-4e7d-9008-5f74b80c1f61 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:43.510293 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1f04e67d-350c-4e7d-9008-5f74b80c1f61 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f" status: 200 len: 1315 microversion: 2.1 time: 1.190215 Jul 31 01:10:43.511763 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 539/1079] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:42 2022] GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f => generated 1315 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:43.525371 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3d31636a-1cd9-495e-8cf5-760a0293b076 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:43.526373 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3d31636a-1cd9-495e-8cf5-760a0293b076 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:43.547110 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d31636a-1cd9-495e-8cf5-760a0293b076 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:43.550218 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d31636a-1cd9-495e-8cf5-760a0293b076 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:43.556451 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d31636a-1cd9-495e-8cf5-760a0293b076 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:43.560111 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d31636a-1cd9-495e-8cf5-760a0293b076 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:44.097191 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-c260db1f-e27a-417a-bb18-ed844d1cd485 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:10:44.097825 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-c260db1f-e27a-417a-bb18-ed844d1cd485 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:10:44.098250 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-c260db1f-e27a-417a-bb18-ed844d1cd485 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:10:44.098669 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-c260db1f-e27a-417a-bb18-ed844d1cd485 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:10:44.099094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-c260db1f-e27a-417a-bb18-ed844d1cd485 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:10:44.125655 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c260db1f-e27a-417a-bb18-ed844d1cd485 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:44.137832 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c260db1f-e27a-417a-bb18-ed844d1cd485 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:44.141320 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c260db1f-e27a-417a-bb18-ed844d1cd485 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:44.145272 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c260db1f-e27a-417a-bb18-ed844d1cd485 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:44.260927 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-c260db1f-e27a-417a-bb18-ed844d1cd485 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Getting quotas for project 531072622a6d4b10b902ac7644c6a7ad. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:10:44.276639 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-c260db1f-e27a-417a-bb18-ed844d1cd485 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Getting quotas for user 246145364b854ab7bb4fdaffcfa238d8 and project 531072622a6d4b10b902ac7644c6a7ad. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:10:44.338642 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c260db1f-e27a-417a-bb18-ed844d1cd485 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:10:44.342439 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c260db1f-e27a-417a-bb18-ed844d1cd485 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:10:44.508134 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c260db1f-e27a-417a-bb18-ed844d1cd485 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.512003 Jul 31 01:10:44.514567 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 541/1080] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:10:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 4520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:10:44.561418 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-409aac97-3f66-4cd5-b990-8b4665458973 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:44.571142 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-409aac97-3f66-4cd5-b990-8b4665458973 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:44.591630 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-409aac97-3f66-4cd5-b990-8b4665458973 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:44.594381 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-409aac97-3f66-4cd5-b990-8b4665458973 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:44.596010 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-409aac97-3f66-4cd5-b990-8b4665458973 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:44.598775 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-409aac97-3f66-4cd5-b990-8b4665458973 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:45.376514 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3d31636a-1cd9-495e-8cf5-760a0293b076 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:45.408320 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3d31636a-1cd9-495e-8cf5-760a0293b076 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1313 microversion: 2.1 time: 1.891514 Jul 31 01:10:45.429219 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 540/1081] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:43 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1313 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:45.454234 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-504c6b67-7955-49f1-8d72-b4ce03ebef0d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:45.455020 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-504c6b67-7955-49f1-8d72-b4ce03ebef0d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:45.490302 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-504c6b67-7955-49f1-8d72-b4ce03ebef0d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:45.498838 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-504c6b67-7955-49f1-8d72-b4ce03ebef0d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:45.503528 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-504c6b67-7955-49f1-8d72-b4ce03ebef0d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:45.505876 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-504c6b67-7955-49f1-8d72-b4ce03ebef0d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:45.628688 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:46.912604 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-409aac97-3f66-4cd5-b990-8b4665458973 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:46.934688 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-409aac97-3f66-4cd5-b990-8b4665458973 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:46.938602 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-409aac97-3f66-4cd5-b990-8b4665458973 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:46.945131 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-409aac97-3f66-4cd5-b990-8b4665458973 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 2.425607 Jul 31 01:10:46.945951 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 542/1082] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:10:44 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 2430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:10:46.954824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d02fc278-e4cc-4c41-9520-f35c55624888 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:46.966358 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d02fc278-e4cc-4c41-9520-f35c55624888 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:46.997050 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d02fc278-e4cc-4c41-9520-f35c55624888 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:47.002071 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d02fc278-e4cc-4c41-9520-f35c55624888 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:47.003087 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d02fc278-e4cc-4c41-9520-f35c55624888 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:47.004367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d02fc278-e4cc-4c41-9520-f35c55624888 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:47.034660 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-504c6b67-7955-49f1-8d72-b4ce03ebef0d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:47.074119 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-504c6b67-7955-49f1-8d72-b4ce03ebef0d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 1.642027 Jul 31 01:10:47.088414 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 541/1083] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:45 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:47.107302 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f9d55ed4-d993-4c8c-b4f8-74b003455c64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:47.107978 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f9d55ed4-d993-4c8c-b4f8-74b003455c64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:47.145247 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9d55ed4-d993-4c8c-b4f8-74b003455c64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:47.147876 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9d55ed4-d993-4c8c-b4f8-74b003455c64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:47.159078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9d55ed4-d993-4c8c-b4f8-74b003455c64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:47.162390 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9d55ed4-d993-4c8c-b4f8-74b003455c64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:47.343918 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d02fc278-e4cc-4c41-9520-f35c55624888 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:47.356533 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d02fc278-e4cc-4c41-9520-f35c55624888 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1273 microversion: 2.1 time: 0.407901 Jul 31 01:10:47.357649 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 543/1084] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:46 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1273 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:47.365735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3819710-f43a-4b30-9092-a0bdd3ebd9b2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:47.371625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3819710-f43a-4b30-9092-a0bdd3ebd9b2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:47.396643 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3819710-f43a-4b30-9092-a0bdd3ebd9b2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:47.400583 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3819710-f43a-4b30-9092-a0bdd3ebd9b2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:47.403791 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3819710-f43a-4b30-9092-a0bdd3ebd9b2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:47.404389 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3819710-f43a-4b30-9092-a0bdd3ebd9b2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:47.824670 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f9d55ed4-d993-4c8c-b4f8-74b003455c64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:47.834423 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f9d55ed4-d993-4c8c-b4f8-74b003455c64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f" status: 200 len: 1315 microversion: 2.1 time: 0.744804 Jul 31 01:10:47.837406 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 542/1085] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:47 2022] GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f => generated 1315 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:47.850144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1150014785", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "9c7d9989-344c-4aef-ab6c-43ab1bfc1232"}], "security_groups": [{"name": "tempest-securitygroup--575181183"}], "key_name": "tempest-keypair-840635721", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "fd6c273f-caf5-4279-873b-3abfa5a0bd8d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:48.236272 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3819710-f43a-4b30-9092-a0bdd3ebd9b2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:48.249954 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3819710-f43a-4b30-9092-a0bdd3ebd9b2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1313 microversion: 2.1 time: 0.890941 Jul 31 01:10:48.255270 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 544/1086] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:47 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1313 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:48.263181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f2a090a4-02fc-44a2-9d15-bc648fbbd9d4 req-a059280a-b4fe-4eef-9a89-d2cc69640f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2786dc8b-517e-4c01-be66-c7959ff8972f", "name": "network-vif-plugged", "status": "completed", "tag": "e58b02f2-5ad0-4d5c-8b46-97753614753b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:48.278175 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] validate_networks() for [('9c7d9989-344c-4aef-ab6c-43ab1bfc1232', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:10:48.294449 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f2a090a4-02fc-44a2-9d15-bc648fbbd9d4 req-a059280a-b4fe-4eef-9a89-d2cc69640f69 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:48.295373 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f2a090a4-02fc-44a2-9d15-bc648fbbd9d4 req-a059280a-b4fe-4eef-9a89-d2cc69640f69 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:48.310445 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f2a090a4-02fc-44a2-9d15-bc648fbbd9d4 req-a059280a-b4fe-4eef-9a89-d2cc69640f69 service nova] Creating event network-vif-plugged:e58b02f2-5ad0-4d5c-8b46-97753614753b for instance 2786dc8b-517e-4c01-be66-c7959ff8972f on n-h2-master-1 Jul 31 01:10:48.317474 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f2a090a4-02fc-44a2-9d15-bc648fbbd9d4 req-a059280a-b4fe-4eef-9a89-d2cc69640f69 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060386 Jul 31 01:10:48.319642 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 545/1087] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:10:48.326250 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-62a89366-e186-4344-8a1a-81167f442494 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:48.328016 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-62a89366-e186-4344-8a1a-81167f442494 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:48.337059 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-62a89366-e186-4344-8a1a-81167f442494 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:48.337920 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-62a89366-e186-4344-8a1a-81167f442494 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:48.339027 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-62a89366-e186-4344-8a1a-81167f442494 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:48.339799 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-62a89366-e186-4344-8a1a-81167f442494 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:49.132693 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-62a89366-e186-4344-8a1a-81167f442494 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:49.147036 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-62a89366-e186-4344-8a1a-81167f442494 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:49.156380 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-62a89366-e186-4344-8a1a-81167f442494 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:49.158088 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-62a89366-e186-4344-8a1a-81167f442494 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.836906 Jul 31 01:10:49.161861 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 546/1088] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:10:48 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:10:49.197765 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-43a22934-1eac-4932-9071-777e281db8ff tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:49.200839 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-43a22934-1eac-4932-9071-777e281db8ff tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:49.217779 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43a22934-1eac-4932-9071-777e281db8ff tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:49.219202 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43a22934-1eac-4932-9071-777e281db8ff tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:49.222143 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43a22934-1eac-4932-9071-777e281db8ff tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:49.223248 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43a22934-1eac-4932-9071-777e281db8ff tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:49.855802 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-43a22934-1eac-4932-9071-777e281db8ff tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:49.867019 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-43a22934-1eac-4932-9071-777e281db8ff tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 0.689409 Jul 31 01:10:49.868395 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 547/1089] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:49 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:49.877358 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-93095b95-a74d-4c85-a641-107942183429 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:49.879293 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-93095b95-a74d-4c85-a641-107942183429 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:49.899992 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-93095b95-a74d-4c85-a641-107942183429 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:49.901251 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-93095b95-a74d-4c85-a641-107942183429 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:49.903258 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-93095b95-a74d-4c85-a641-107942183429 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:49.904628 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-93095b95-a74d-4c85-a641-107942183429 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:49.908917 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Getting quotas for project 3e3cc749a4a34731b3035b320af81cd4. Resources: dict_keys(['metadata_items']) {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:10:49.925034 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Getting quotas for user 2eb298a85d524f1d9f3a2138636a2773 and project 3e3cc749a4a34731b3035b320af81cd4. Resources: dict_keys(['metadata_items']) {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:10:49.939203 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:10:49.939871 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:10:49.940527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:10:49.941326 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:10:49.941912 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:10:49.958372 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:49.964030 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:49.965202 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:49.965808 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:50.013383 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Getting quotas for project 3e3cc749a4a34731b3035b320af81cd4. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:10:50.028826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Getting quotas for user 2eb298a85d524f1d9f3a2138636a2773 and project 3e3cc749a4a34731b3035b320af81cd4. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:10:50.139846 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:10:50.142465 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fd6c273f-caf5-4279-873b-3abfa5a0bd8d',volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:10:50.172473 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-93095b95-a74d-4c85-a641-107942183429 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:50.197171 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-93095b95-a74d-4c85-a641-107942183429 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1313 microversion: 2.1 time: 0.326214 Jul 31 01:10:50.198028 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 548/1090] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:49 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:50.226684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-257c862d-743c-4462-a730-2ba9df844c5b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:50.229300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-257c862d-743c-4462-a730-2ba9df844c5b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:50.254271 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-257c862d-743c-4462-a730-2ba9df844c5b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:50.256320 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-257c862d-743c-4462-a730-2ba9df844c5b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:50.267051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-257c862d-743c-4462-a730-2ba9df844c5b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:50.268859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-257c862d-743c-4462-a730-2ba9df844c5b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:50.450985 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-43eed964-b3ad-48fe-bbae-c38524f14b4f tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.609945 Jul 31 01:10:50.451940 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 543/1091] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:10:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 2612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:10:50.457730 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e0295f0c-2a13-4b81-b9cf-bd39e5e4dad1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:50.459068 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e0295f0c-2a13-4b81-b9cf-bd39e5e4dad1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:50.475884 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0295f0c-2a13-4b81-b9cf-bd39e5e4dad1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:50.476854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0295f0c-2a13-4b81-b9cf-bd39e5e4dad1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:50.477920 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0295f0c-2a13-4b81-b9cf-bd39e5e4dad1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:50.478528 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0295f0c-2a13-4b81-b9cf-bd39e5e4dad1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:50.863202 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-257c862d-743c-4462-a730-2ba9df844c5b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:50.912851 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-257c862d-743c-4462-a730-2ba9df844c5b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f" status: 200 len: 1315 microversion: 2.1 time: 0.697279 Jul 31 01:10:50.914165 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 549/1092] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:50 2022] GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f => generated 1315 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:51.061222 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e0295f0c-2a13-4b81-b9cf-bd39e5e4dad1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:51.076766 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e0295f0c-2a13-4b81-b9cf-bd39e5e4dad1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1313 microversion: 2.1 time: 0.620266 Jul 31 01:10:51.107224 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 544/1093] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:50 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1313 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:51.126189 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-ac67c564-7eef-4a68-a6b9-dddeef734461 req-ae76e088-a21f-4820-98cc-7933d7c206d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "916bad28-8c22-4c07-8f60-f25d28729294", "tag": "c511a289-6d4a-4bd8-ad7e-ad1436331405"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:51.142463 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-ac67c564-7eef-4a68-a6b9-dddeef734461 req-ae76e088-a21f-4820-98cc-7933d7c206d9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:51.143386 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-ac67c564-7eef-4a68-a6b9-dddeef734461 req-ae76e088-a21f-4820-98cc-7933d7c206d9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:51.172294 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-ac67c564-7eef-4a68-a6b9-dddeef734461 req-ae76e088-a21f-4820-98cc-7933d7c206d9 service nova] Creating event network-changed:c511a289-6d4a-4bd8-ad7e-ad1436331405 for instance 916bad28-8c22-4c07-8f60-f25d28729294 on n-h2-master-1 Jul 31 01:10:51.179850 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-ac67c564-7eef-4a68-a6b9-dddeef734461 req-ae76e088-a21f-4820-98cc-7933d7c206d9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066096 Jul 31 01:10:51.181460 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 545/1094] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:10:51.189531 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3cca2f81-ff10-4328-ba41-6c7363e0fa82 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:51.190966 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3cca2f81-ff10-4328-ba41-6c7363e0fa82 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:51.199032 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3cca2f81-ff10-4328-ba41-6c7363e0fa82 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:51.200007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3cca2f81-ff10-4328-ba41-6c7363e0fa82 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:51.201242 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3cca2f81-ff10-4328-ba41-6c7363e0fa82 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:51.201942 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3cca2f81-ff10-4328-ba41-6c7363e0fa82 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:51.293034 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bd51b742-96fd-4169-bfaa-7ccc201cef7b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-378410363", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "6202340f-0183-4051-846c-d255fe21d994"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:51.419581 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-bd51b742-96fd-4169-bfaa-7ccc201cef7b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] validate_networks() for [('6202340f-0183-4051-846c-d255fe21d994', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:10:51.736933 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3cca2f81-ff10-4328-ba41-6c7363e0fa82 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:51.775225 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3cca2f81-ff10-4328-ba41-6c7363e0fa82 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:51.795283 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3cca2f81-ff10-4328-ba41-6c7363e0fa82 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:51.801073 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3cca2f81-ff10-4328-ba41-6c7363e0fa82 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.615591 Jul 31 01:10:51.804869 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 546/1095] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:10:51 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:10:51.855445 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-960d9ec9-824b-4b32-969e-d32dcd299150 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:51.857866 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-960d9ec9-824b-4b32-969e-d32dcd299150 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:51.878951 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-960d9ec9-824b-4b32-969e-d32dcd299150 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:51.884316 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-960d9ec9-824b-4b32-969e-d32dcd299150 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:51.885292 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-960d9ec9-824b-4b32-969e-d32dcd299150 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:51.891042 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-960d9ec9-824b-4b32-969e-d32dcd299150 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:52.055550 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-960d9ec9-824b-4b32-969e-d32dcd299150 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:52.071101 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-960d9ec9-824b-4b32-969e-d32dcd299150 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1163 microversion: 2.1 time: 0.245404 Jul 31 01:10:52.073002 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 547/1096] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:51 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1163 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:52.077871 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7a6d89de-4e00-4315-baa8-d4e10631ae9f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:52.088194 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7a6d89de-4e00-4315-baa8-d4e10631ae9f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:52.101313 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a6d89de-4e00-4315-baa8-d4e10631ae9f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:52.102147 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a6d89de-4e00-4315-baa8-d4e10631ae9f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:52.103675 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a6d89de-4e00-4315-baa8-d4e10631ae9f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:52.104347 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a6d89de-4e00-4315-baa8-d4e10631ae9f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:52.296621 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-bd51b742-96fd-4169-bfaa-7ccc201cef7b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:10:52.298411 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-bd51b742-96fd-4169-bfaa-7ccc201cef7b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:10:52.299131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-bd51b742-96fd-4169-bfaa-7ccc201cef7b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:10:52.299756 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-bd51b742-96fd-4169-bfaa-7ccc201cef7b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:10:52.300584 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-bd51b742-96fd-4169-bfaa-7ccc201cef7b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:10:52.324140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd51b742-96fd-4169-bfaa-7ccc201cef7b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:52.325599 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd51b742-96fd-4169-bfaa-7ccc201cef7b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:52.326903 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd51b742-96fd-4169-bfaa-7ccc201cef7b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:52.327685 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd51b742-96fd-4169-bfaa-7ccc201cef7b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:52.378149 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-bd51b742-96fd-4169-bfaa-7ccc201cef7b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Getting quotas for project 3fb526f587384fdea1a06d8b3b685dcf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:10:52.398258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-bd51b742-96fd-4169-bfaa-7ccc201cef7b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Getting quotas for user f4352f9b8762490e9187e28e8c9cd58e and project 3fb526f587384fdea1a06d8b3b685dcf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:10:52.410523 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7a6d89de-4e00-4315-baa8-d4e10631ae9f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:52.425065 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7a6d89de-4e00-4315-baa8-d4e10631ae9f tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 0.350771 Jul 31 01:10:52.436695 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 548/1097] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:52 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:52.436695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-68d3e1fc-a384-427a-830a-58558488808e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:52.436695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-68d3e1fc-a384-427a-830a-58558488808e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:52.449357 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68d3e1fc-a384-427a-830a-58558488808e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:52.450015 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bd51b742-96fd-4169-bfaa-7ccc201cef7b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:10:52.450317 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68d3e1fc-a384-427a-830a-58558488808e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:52.451241 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68d3e1fc-a384-427a-830a-58558488808e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:52.451821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68d3e1fc-a384-427a-830a-58558488808e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:52.454807 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bd51b742-96fd-4169-bfaa-7ccc201cef7b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:10:52.541458 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bd51b742-96fd-4169-bfaa-7ccc201cef7b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.623900 Jul 31 01:10:52.547087 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 550/1098] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:10:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:10:52.564696 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-50a0b3dc-9b65-4a50-b710-aee46ad5f87f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:52.565676 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-50a0b3dc-9b65-4a50-b710-aee46ad5f87f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:52.575037 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-50a0b3dc-9b65-4a50-b710-aee46ad5f87f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:52.580189 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-50a0b3dc-9b65-4a50-b710-aee46ad5f87f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:52.581214 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-50a0b3dc-9b65-4a50-b710-aee46ad5f87f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:52.581826 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-50a0b3dc-9b65-4a50-b710-aee46ad5f87f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:54.462709 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-50a0b3dc-9b65-4a50-b710-aee46ad5f87f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:54.472984 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-50a0b3dc-9b65-4a50-b710-aee46ad5f87f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f" status: 200 len: 1504 microversion: 2.1 time: 1.923872 Jul 31 01:10:54.473595 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 551/1099] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:52 2022] GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f => generated 1504 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:54.474171 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-68d3e1fc-a384-427a-830a-58558488808e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:54.481366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4aeecf76-edcc-435c-87ed-f4dced1b8735 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:54.482381 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4aeecf76-edcc-435c-87ed-f4dced1b8735 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:54.496876 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-68d3e1fc-a384-427a-830a-58558488808e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1355 microversion: 2.1 time: 2.069479 Jul 31 01:10:54.498297 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 549/1100] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:52 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1355 bytes in 2071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:54.503833 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4aeecf76-edcc-435c-87ed-f4dced1b8735 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:54.504308 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4aeecf76-edcc-435c-87ed-f4dced1b8735 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:54.505300 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4aeecf76-edcc-435c-87ed-f4dced1b8735 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:54.505752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4aeecf76-edcc-435c-87ed-f4dced1b8735 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:54.506262 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-68496457-5590-4c13-a685-500b817a5b57 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:54.506894 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-68496457-5590-4c13-a685-500b817a5b57 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:54.523499 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68496457-5590-4c13-a685-500b817a5b57 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:54.523957 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68496457-5590-4c13-a685-500b817a5b57 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:54.524756 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68496457-5590-4c13-a685-500b817a5b57 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:54.529660 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68496457-5590-4c13-a685-500b817a5b57 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:55.325905 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4aeecf76-edcc-435c-87ed-f4dced1b8735 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1858 microversion: 2.1 time: 0.848016 Jul 31 01:10:55.332892 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 552/1101] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:54 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1858 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:55.339987 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4bb7b47d-108a-4aa9-95eb-f54d78e770cb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:55.340457 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4bb7b47d-108a-4aa9-95eb-f54d78e770cb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:55.355418 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4bb7b47d-108a-4aa9-95eb-f54d78e770cb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:55.355891 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4bb7b47d-108a-4aa9-95eb-f54d78e770cb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:55.359642 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4bb7b47d-108a-4aa9-95eb-f54d78e770cb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:55.360324 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4bb7b47d-108a-4aa9-95eb-f54d78e770cb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:55.478584 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-68496457-5590-4c13-a685-500b817a5b57 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:55.520697 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-68496457-5590-4c13-a685-500b817a5b57 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1313 microversion: 2.1 time: 1.018209 Jul 31 01:10:55.528272 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 550/1102] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:54 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1313 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:55.546361 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e2880a4c-a807-43fd-8ccf-ef8c0bc2081f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:55.553244 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e2880a4c-a807-43fd-8ccf-ef8c0bc2081f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:55.576518 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2880a4c-a807-43fd-8ccf-ef8c0bc2081f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:55.578278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2880a4c-a807-43fd-8ccf-ef8c0bc2081f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:55.580149 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2880a4c-a807-43fd-8ccf-ef8c0bc2081f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:55.581210 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2880a4c-a807-43fd-8ccf-ef8c0bc2081f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:55.876515 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4bb7b47d-108a-4aa9-95eb-f54d78e770cb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:55.888856 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4bb7b47d-108a-4aa9-95eb-f54d78e770cb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 200 len: 1265 microversion: 2.1 time: 0.554546 Jul 31 01:10:55.897905 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 553/1103] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:55 2022] GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 1265 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:55.907093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-455467ea-6198-4273-aa81-9406400bdace tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:55.915711 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-455467ea-6198-4273-aa81-9406400bdace tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:55.942828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-455467ea-6198-4273-aa81-9406400bdace tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:55.945728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-455467ea-6198-4273-aa81-9406400bdace tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:55.954094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-455467ea-6198-4273-aa81-9406400bdace tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:55.954717 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-455467ea-6198-4273-aa81-9406400bdace tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:55.965550 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:56.264299 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-455467ea-6198-4273-aa81-9406400bdace tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:56.287653 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-455467ea-6198-4273-aa81-9406400bdace tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1237 microversion: 2.1 time: 0.388017 Jul 31 01:10:56.301569 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 554/1104] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:55 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1237 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:56.319791 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-6b681fd1-2b45-484c-8167-5857deff8b5f req-d1ccf146-8b0d-4f94-91a7-66872c713ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eafdd229-897b-4b1f-adfc-3d7bb4fef7a0", "name": "network-vif-plugged", "status": "completed", "tag": "5ee707da-030a-4991-809c-69f12af3f140"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:56.334326 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6b681fd1-2b45-484c-8167-5857deff8b5f req-d1ccf146-8b0d-4f94-91a7-66872c713ad4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:56.335202 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6b681fd1-2b45-484c-8167-5857deff8b5f req-d1ccf146-8b0d-4f94-91a7-66872c713ad4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:56.353633 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-6b681fd1-2b45-484c-8167-5857deff8b5f req-d1ccf146-8b0d-4f94-91a7-66872c713ad4 service nova] Creating event network-vif-plugged:5ee707da-030a-4991-809c-69f12af3f140 for instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 on n-h2-master-1 Jul 31 01:10:56.362478 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-6b681fd1-2b45-484c-8167-5857deff8b5f req-d1ccf146-8b0d-4f94-91a7-66872c713ad4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058697 Jul 31 01:10:56.363711 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 555/1105] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:10:56.378975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-310f7c7e-de6d-48a0-92e2-2a15d3ceca8e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:56.380234 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-310f7c7e-de6d-48a0-92e2-2a15d3ceca8e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:56.388138 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-310f7c7e-de6d-48a0-92e2-2a15d3ceca8e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:56.388976 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-310f7c7e-de6d-48a0-92e2-2a15d3ceca8e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:56.391459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-310f7c7e-de6d-48a0-92e2-2a15d3ceca8e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:56.392935 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-310f7c7e-de6d-48a0-92e2-2a15d3ceca8e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:56.806840 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e2880a4c-a807-43fd-8ccf-ef8c0bc2081f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:56.863402 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e2880a4c-a807-43fd-8ccf-ef8c0bc2081f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:56.869474 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e2880a4c-a807-43fd-8ccf-ef8c0bc2081f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:56.880004 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e2880a4c-a807-43fd-8ccf-ef8c0bc2081f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 1.341919 Jul 31 01:10:56.881021 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 551/1106] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:10:55 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:10:56.886374 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-955a93ef-494b-47f2-b369-64bfd77612c2 req-ee750bae-9099-4f6f-8d17-45fd0695c5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8660466c-0119-4cc7-8da1-e48e22f2c088", "tag": "174a4d1b-d42d-41f3-86c8-1031d7e0dd4e"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:56.907163 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-955a93ef-494b-47f2-b369-64bfd77612c2 req-ee750bae-9099-4f6f-8d17-45fd0695c5e9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:56.907899 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-955a93ef-494b-47f2-b369-64bfd77612c2 req-ee750bae-9099-4f6f-8d17-45fd0695c5e9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:56.925603 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-955a93ef-494b-47f2-b369-64bfd77612c2 req-ee750bae-9099-4f6f-8d17-45fd0695c5e9 service nova] Creating event network-changed:174a4d1b-d42d-41f3-86c8-1031d7e0dd4e for instance 8660466c-0119-4cc7-8da1-e48e22f2c088 on n-h1-master-1 Jul 31 01:10:56.938102 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-955a93ef-494b-47f2-b369-64bfd77612c2 req-ee750bae-9099-4f6f-8d17-45fd0695c5e9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055433 Jul 31 01:10:56.939876 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 552/1107] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:10:56.947380 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3d726334-b668-48a1-ad4d-69a828b478ee tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1869873908"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:56.948802 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3d726334-b668-48a1-ad4d-69a828b478ee tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:56.966987 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d726334-b668-48a1-ad4d-69a828b478ee tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:56.968086 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d726334-b668-48a1-ad4d-69a828b478ee tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:56.969128 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d726334-b668-48a1-ad4d-69a828b478ee tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:56.970388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d726334-b668-48a1-ad4d-69a828b478ee tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:57.280032 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-310f7c7e-de6d-48a0-92e2-2a15d3ceca8e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:10:57.288443 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-310f7c7e-de6d-48a0-92e2-2a15d3ceca8e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 0.916813 Jul 31 01:10:57.302282 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 556/1108] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:56 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:10:57.307589 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f1022c0f-652b-41cf-a52a-2a0e8a6f3f5f tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:10:57.310579 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f1022c0f-652b-41cf-a52a-2a0e8a6f3f5f tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:57.326335 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1022c0f-652b-41cf-a52a-2a0e8a6f3f5f tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:57.330629 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1022c0f-652b-41cf-a52a-2a0e8a6f3f5f tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:57.331678 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1022c0f-652b-41cf-a52a-2a0e8a6f3f5f tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:57.332197 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1022c0f-652b-41cf-a52a-2a0e8a6f3f5f tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:57.410616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-f1022c0f-652b-41cf-a52a-2a0e8a6f3f5f tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lazy-loading 'flavor' on Instance uuid 502a7c35-a8fe-4ace-85d5-bb115f8423fa {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:10:57.430244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f1022c0f-652b-41cf-a52a-2a0e8a6f3f5f tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Going to try to live migrate instance to n-h2-master-1 {{(pid=119475) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 31 01:10:57.433785 n-d-master-1 devstack@n-api.service[119474]: INFO nova.network.security_group_api [None req-3d726334-b668-48a1-ad4d-69a828b478ee tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Adding security group 9745103a-0266-49af-a15e-a1e91bec5662 to port e58b02f2-5ad0-4d5c-8b46-97753614753b Jul 31 01:10:59.843279 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f1022c0f-652b-41cf-a52a-2a0e8a6f3f5f tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/action" status: 202 len: 0 microversion: 2.1 time: 2.538716 Jul 31 01:10:59.844544 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 557/1109] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:10:57 2022] POST /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/action => generated 0 bytes in 2541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:10:59.849375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bf84c0b9-a8f3-44d7-9898-f3ee0d0b7b05 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:59.850131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bf84c0b9-a8f3-44d7-9898-f3ee0d0b7b05 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:59.855009 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3d726334-b668-48a1-ad4d-69a828b478ee tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "POST /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f/action" status: 202 len: 0 microversion: 2.1 time: 2.912513 Jul 31 01:10:59.855570 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 553/1110] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:10:56 2022] POST /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f/action => generated 0 bytes in 2915 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:10:59.863758 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4785f563-ca03-48a9-9030-9db0cd4dc42a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:10:59.865178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4785f563-ca03-48a9-9030-9db0cd4dc42a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:10:59.880067 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4785f563-ca03-48a9-9030-9db0cd4dc42a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:59.881216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4785f563-ca03-48a9-9030-9db0cd4dc42a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:59.882118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4785f563-ca03-48a9-9030-9db0cd4dc42a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:59.883881 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf84c0b9-a8f3-44d7-9898-f3ee0d0b7b05 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:59.884366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4785f563-ca03-48a9-9030-9db0cd4dc42a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:59.899719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf84c0b9-a8f3-44d7-9898-f3ee0d0b7b05 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:59.900605 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf84c0b9-a8f3-44d7-9898-f3ee0d0b7b05 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:10:59.901051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf84c0b9-a8f3-44d7-9898-f3ee0d0b7b05 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:10:59.986971 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:00.050027 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=10 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:00.474470 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4785f563-ca03-48a9-9030-9db0cd4dc42a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:00.483228 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bf84c0b9-a8f3-44d7-9898-f3ee0d0b7b05 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:00.487647 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4785f563-ca03-48a9-9030-9db0cd4dc42a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1463 microversion: 2.1 time: 0.628428 Jul 31 01:11:00.491054 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 554/1111] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:59 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1463 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:00.498085 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0006c46a-3fd8-42a3-84b8-e4c3751a9f1c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:00.498716 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0006c46a-3fd8-42a3-84b8-e4c3751a9f1c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:00.516326 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bf84c0b9-a8f3-44d7-9898-f3ee0d0b7b05 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1355 microversion: 2.1 time: 0.666903 Jul 31 01:11:00.520400 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 558/1112] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:10:59 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1355 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:00.524616 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0006c46a-3fd8-42a3-84b8-e4c3751a9f1c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:00.525103 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0006c46a-3fd8-42a3-84b8-e4c3751a9f1c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:00.529435 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0006c46a-3fd8-42a3-84b8-e4c3751a9f1c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:00.530047 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0006c46a-3fd8-42a3-84b8-e4c3751a9f1c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:00.542476 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a0176c21-d684-4a45-9586-b7aaf8d5bc0b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:00.544059 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a0176c21-d684-4a45-9586-b7aaf8d5bc0b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:00.556617 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0176c21-d684-4a45-9586-b7aaf8d5bc0b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:00.557835 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0176c21-d684-4a45-9586-b7aaf8d5bc0b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:00.559614 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0176c21-d684-4a45-9586-b7aaf8d5bc0b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:00.560836 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0176c21-d684-4a45-9586-b7aaf8d5bc0b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:01.207887 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0006c46a-3fd8-42a3-84b8-e4c3751a9f1c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:01.220691 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0006c46a-3fd8-42a3-84b8-e4c3751a9f1c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 200 len: 1307 microversion: 2.1 time: 0.728246 Jul 31 01:11:01.221258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a0176c21-d684-4a45-9586-b7aaf8d5bc0b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:01.221648 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 555/1113] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:00 2022] GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 1307 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:01.226848 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8fd7c476-2971-4f7a-be31-50199ce443db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:01.227559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8fd7c476-2971-4f7a-be31-50199ce443db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:01.234959 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fd7c476-2971-4f7a-be31-50199ce443db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:01.235447 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fd7c476-2971-4f7a-be31-50199ce443db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:01.236420 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fd7c476-2971-4f7a-be31-50199ce443db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:01.236869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fd7c476-2971-4f7a-be31-50199ce443db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:01.267243 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a0176c21-d684-4a45-9586-b7aaf8d5bc0b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1304 microversion: 2.1 time: 0.742410 Jul 31 01:11:01.268846 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 559/1114] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:00 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1304 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:01.275434 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-be381b6a-5a42-49ae-94b5-537073019318 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:01.276153 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-be381b6a-5a42-49ae-94b5-537073019318 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:01.301895 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be381b6a-5a42-49ae-94b5-537073019318 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:01.302487 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be381b6a-5a42-49ae-94b5-537073019318 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:01.304096 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be381b6a-5a42-49ae-94b5-537073019318 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:01.304984 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be381b6a-5a42-49ae-94b5-537073019318 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:01.546294 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8fd7c476-2971-4f7a-be31-50199ce443db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:01.563586 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8fd7c476-2971-4f7a-be31-50199ce443db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:01.573088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8fd7c476-2971-4f7a-be31-50199ce443db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:01.576758 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8fd7c476-2971-4f7a-be31-50199ce443db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.353738 Jul 31 01:11:01.579221 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 556/1115] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:01 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:01.590781 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-fb3f60ef-5dea-4075-a553-dc9391e2b20c req-1cd409be-8ab7-441d-abb4-87195741d3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916bad28-8c22-4c07-8f60-f25d28729294", "name": "network-vif-plugged", "status": "completed", "tag": "c511a289-6d4a-4bd8-ad7e-ad1436331405"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:01.613021 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fb3f60ef-5dea-4075-a553-dc9391e2b20c req-1cd409be-8ab7-441d-abb4-87195741d3c1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:01.614089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fb3f60ef-5dea-4075-a553-dc9391e2b20c req-1cd409be-8ab7-441d-abb4-87195741d3c1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:01.640444 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-fb3f60ef-5dea-4075-a553-dc9391e2b20c req-1cd409be-8ab7-441d-abb4-87195741d3c1 service nova] Creating event network-vif-plugged:c511a289-6d4a-4bd8-ad7e-ad1436331405 for instance 916bad28-8c22-4c07-8f60-f25d28729294 on n-h2-master-1 Jul 31 01:11:01.647799 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-fb3f60ef-5dea-4075-a553-dc9391e2b20c req-1cd409be-8ab7-441d-abb4-87195741d3c1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066446 Jul 31 01:11:01.649538 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 557/1116] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:01.656673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-98c2f5cb-42cb-41d4-a113-63e2e62e1038 req-60f4d695-559c-4ffa-a682-a6f0bbcdd753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8660466c-0119-4cc7-8da1-e48e22f2c088", "tag": "082830c6-d3e7-4858-b04e-daea65512750"}, {"name": "network-changed", "server_uuid": "8660466c-0119-4cc7-8da1-e48e22f2c088", "tag": "fd2629bf-3368-49d5-bbc6-a5f5dfff4006"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:01.663551 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-be381b6a-5a42-49ae-94b5-537073019318 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:01.676134 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-98c2f5cb-42cb-41d4-a113-63e2e62e1038 req-60f4d695-559c-4ffa-a682-a6f0bbcdd753 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:01.676867 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-98c2f5cb-42cb-41d4-a113-63e2e62e1038 req-60f4d695-559c-4ffa-a682-a6f0bbcdd753 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:01.678161 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-be381b6a-5a42-49ae-94b5-537073019318 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 0.405126 Jul 31 01:11:01.679115 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 560/1117] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:01 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:01.698653 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f9443073-35ef-4469-b30d-8c8fdcf6be31 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:01.701806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f9443073-35ef-4469-b30d-8c8fdcf6be31 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:01.735004 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9443073-35ef-4469-b30d-8c8fdcf6be31 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:01.738910 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9443073-35ef-4469-b30d-8c8fdcf6be31 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:01.740544 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9443073-35ef-4469-b30d-8c8fdcf6be31 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:01.741013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9443073-35ef-4469-b30d-8c8fdcf6be31 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:01.750652 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-98c2f5cb-42cb-41d4-a113-63e2e62e1038 req-60f4d695-559c-4ffa-a682-a6f0bbcdd753 service nova] Creating event network-changed:082830c6-d3e7-4858-b04e-daea65512750 for instance 8660466c-0119-4cc7-8da1-e48e22f2c088 on n-h1-master-1 Jul 31 01:11:01.751910 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-98c2f5cb-42cb-41d4-a113-63e2e62e1038 req-60f4d695-559c-4ffa-a682-a6f0bbcdd753 service nova] Creating event network-changed:fd2629bf-3368-49d5-bbc6-a5f5dfff4006 for instance 8660466c-0119-4cc7-8da1-e48e22f2c088 on n-h1-master-1 Jul 31 01:11:01.766120 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-98c2f5cb-42cb-41d4-a113-63e2e62e1038 req-60f4d695-559c-4ffa-a682-a6f0bbcdd753 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.111593 Jul 31 01:11:01.768412 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 558/1118] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:01.779519 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5a92536e-b66f-4994-9ec6-5c7dc577fa6b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-809693973"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:01.780203 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5a92536e-b66f-4994-9ec6-5c7dc577fa6b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:01.789286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a92536e-b66f-4994-9ec6-5c7dc577fa6b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:01.789751 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a92536e-b66f-4994-9ec6-5c7dc577fa6b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:01.791054 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a92536e-b66f-4994-9ec6-5c7dc577fa6b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:01.792820 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a92536e-b66f-4994-9ec6-5c7dc577fa6b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:02.035247 n-d-master-1 devstack@n-api.service[119474]: INFO nova.network.security_group_api [None req-5a92536e-b66f-4994-9ec6-5c7dc577fa6b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Adding security group 82d66dca-1737-4b68-a629-0520417d23ab to port e58b02f2-5ad0-4d5c-8b46-97753614753b Jul 31 01:11:02.068886 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f9443073-35ef-4469-b30d-8c8fdcf6be31 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:02.084535 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f9443073-35ef-4469-b30d-8c8fdcf6be31 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.403457 Jul 31 01:11:02.085887 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 561/1119] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:01 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:02.094468 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-ba41ba7e-6f5a-46eb-93ac-218b0c7aafbc req-3051d5cb-1a7c-4cd1-9d5f-3d327cd1694a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2786dc8b-517e-4c01-be66-c7959ff8972f", "tag": "e58b02f2-5ad0-4d5c-8b46-97753614753b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:02.114267 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ba41ba7e-6f5a-46eb-93ac-218b0c7aafbc req-3051d5cb-1a7c-4cd1-9d5f-3d327cd1694a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:02.114975 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ba41ba7e-6f5a-46eb-93ac-218b0c7aafbc req-3051d5cb-1a7c-4cd1-9d5f-3d327cd1694a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:02.139293 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-ba41ba7e-6f5a-46eb-93ac-218b0c7aafbc req-3051d5cb-1a7c-4cd1-9d5f-3d327cd1694a service nova] Creating event network-changed:e58b02f2-5ad0-4d5c-8b46-97753614753b for instance 2786dc8b-517e-4c01-be66-c7959ff8972f on n-h2-master-1 Jul 31 01:11:02.145628 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-ba41ba7e-6f5a-46eb-93ac-218b0c7aafbc req-3051d5cb-1a7c-4cd1-9d5f-3d327cd1694a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058186 Jul 31 01:11:02.146548 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 562/1120] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:02.152535 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-10f4cd6f-5f85-4662-9210-24a36ee1b4fe tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:02.153700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-10f4cd6f-5f85-4662-9210-24a36ee1b4fe tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:02.161218 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10f4cd6f-5f85-4662-9210-24a36ee1b4fe tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:02.161708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10f4cd6f-5f85-4662-9210-24a36ee1b4fe tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:02.162568 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10f4cd6f-5f85-4662-9210-24a36ee1b4fe tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:02.163017 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10f4cd6f-5f85-4662-9210-24a36ee1b4fe tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:02.353713 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:02.425294 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=18 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:02.701078 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-10f4cd6f-5f85-4662-9210-24a36ee1b4fe tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1614 microversion: 2.1 time: 0.553048 Jul 31 01:11:02.701674 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 563/1121] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:02 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1614 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:02.707127 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6a78a6f6-97ca-403c-a7d7-0bc65ce90e4b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:02.708045 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6a78a6f6-97ca-403c-a7d7-0bc65ce90e4b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:02.714254 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a78a6f6-97ca-403c-a7d7-0bc65ce90e4b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:02.714965 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a78a6f6-97ca-403c-a7d7-0bc65ce90e4b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:02.715806 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a78a6f6-97ca-403c-a7d7-0bc65ce90e4b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:02.716255 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a78a6f6-97ca-403c-a7d7-0bc65ce90e4b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:03.421856 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6a78a6f6-97ca-403c-a7d7-0bc65ce90e4b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:03.431387 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6a78a6f6-97ca-403c-a7d7-0bc65ce90e4b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1355 microversion: 2.1 time: 0.727854 Jul 31 01:11:03.432004 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 564/1122] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:02 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1355 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:03.439192 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-69c5b55a-d20f-4f7b-afd8-9b821bd9be11 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:03.441481 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-69c5b55a-d20f-4f7b-afd8-9b821bd9be11 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:03.454781 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69c5b55a-d20f-4f7b-afd8-9b821bd9be11 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:03.455831 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69c5b55a-d20f-4f7b-afd8-9b821bd9be11 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:03.459807 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69c5b55a-d20f-4f7b-afd8-9b821bd9be11 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:03.460813 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69c5b55a-d20f-4f7b-afd8-9b821bd9be11 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:03.682324 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5a92536e-b66f-4994-9ec6-5c7dc577fa6b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "POST /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f/action" status: 202 len: 0 microversion: 2.1 time: 1.911758 Jul 31 01:11:03.683520 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 559/1123] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:11:01 2022] POST /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f/action => generated 0 bytes in 1914 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:11:03.689591 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95dc8cdf-577a-452a-9cca-f0e15ffca912 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:03.690352 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-95dc8cdf-577a-452a-9cca-f0e15ffca912 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:03.697348 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95dc8cdf-577a-452a-9cca-f0e15ffca912 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:03.697934 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95dc8cdf-577a-452a-9cca-f0e15ffca912 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:03.699005 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95dc8cdf-577a-452a-9cca-f0e15ffca912 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:03.699589 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95dc8cdf-577a-452a-9cca-f0e15ffca912 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:04.046347 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-69c5b55a-d20f-4f7b-afd8-9b821bd9be11 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:04.057680 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-69c5b55a-d20f-4f7b-afd8-9b821bd9be11 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 200 len: 1307 microversion: 2.1 time: 0.623240 Jul 31 01:11:04.058661 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 565/1124] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:03 2022] GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 1307 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:04.065775 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ec7b2b57-e5b8-41bd-930a-06a086a17847 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:04.067230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ec7b2b57-e5b8-41bd-930a-06a086a17847 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:04.074487 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec7b2b57-e5b8-41bd-930a-06a086a17847 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:04.075287 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec7b2b57-e5b8-41bd-930a-06a086a17847 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:04.076825 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec7b2b57-e5b8-41bd-930a-06a086a17847 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:04.078204 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec7b2b57-e5b8-41bd-930a-06a086a17847 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:04.086371 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-95dc8cdf-577a-452a-9cca-f0e15ffca912 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:04.095796 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-95dc8cdf-577a-452a-9cca-f0e15ffca912 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1292 microversion: 2.1 time: 0.410819 Jul 31 01:11:04.096391 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 560/1125] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:03 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1292 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:04.108718 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1d035e61-0c1e-49fe-9c52-040b41bc5898 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:04.109696 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1d035e61-0c1e-49fe-9c52-040b41bc5898 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:04.116141 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d035e61-0c1e-49fe-9c52-040b41bc5898 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:04.116604 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d035e61-0c1e-49fe-9c52-040b41bc5898 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:04.117717 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d035e61-0c1e-49fe-9c52-040b41bc5898 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:04.118116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d035e61-0c1e-49fe-9c52-040b41bc5898 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:04.304280 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ec7b2b57-e5b8-41bd-930a-06a086a17847 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:04.313917 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1d035e61-0c1e-49fe-9c52-040b41bc5898 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:04.315536 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ec7b2b57-e5b8-41bd-930a-06a086a17847 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:04.317185 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ec7b2b57-e5b8-41bd-930a-06a086a17847 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:04.319405 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ec7b2b57-e5b8-41bd-930a-06a086a17847 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.258441 Jul 31 01:11:04.319405 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 566/1126] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:04 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:04.324194 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3ae685a2-b5d6-45f3-a27e-f009340cd9d3 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:04.324774 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3ae685a2-b5d6-45f3-a27e-f009340cd9d3 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:04.331497 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ae685a2-b5d6-45f3-a27e-f009340cd9d3 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:04.331953 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ae685a2-b5d6-45f3-a27e-f009340cd9d3 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:04.332993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ae685a2-b5d6-45f3-a27e-f009340cd9d3 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:04.333607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ae685a2-b5d6-45f3-a27e-f009340cd9d3 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:04.337445 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1d035e61-0c1e-49fe-9c52-040b41bc5898 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 0.232413 Jul 31 01:11:04.338398 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 561/1127] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:04 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:04.344417 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2f9d1574-6d11-4e96-8699-89709fa5a7c4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:04.345457 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2f9d1574-6d11-4e96-8699-89709fa5a7c4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:04.351821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2f9d1574-6d11-4e96-8699-89709fa5a7c4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:04.352367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2f9d1574-6d11-4e96-8699-89709fa5a7c4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:04.353221 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2f9d1574-6d11-4e96-8699-89709fa5a7c4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:04.353719 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2f9d1574-6d11-4e96-8699-89709fa5a7c4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:04.358209 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:04.369820 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3ae685a2-b5d6-45f3-a27e-f009340cd9d3 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3a7cac3afc994979bb4ddb916f2619b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd524a3978c454fb791ef231d147ca14a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:04.370754 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3ae685a2-b5d6-45f3-a27e-f009340cd9d3 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] flavor_id is None. Assuming migration. {{(pid=119475) resize /opt/stack/nova/nova/compute/api.py:4144}} Jul 31 01:11:04.371421 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3ae685a2-b5d6-45f3-a27e-f009340cd9d3 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119475) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 31 01:11:04.550337 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2f9d1574-6d11-4e96-8699-89709fa5a7c4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:04.566420 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2f9d1574-6d11-4e96-8699-89709fa5a7c4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.226801 Jul 31 01:11:04.567001 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 562/1128] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:04 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:04.575042 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f71a4c1-e7e6-4fc7-add8-6b6253f14aed tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:04.575713 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6f71a4c1-e7e6-4fc7-add8-6b6253f14aed tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:04.582384 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f71a4c1-e7e6-4fc7-add8-6b6253f14aed tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:04.583021 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f71a4c1-e7e6-4fc7-add8-6b6253f14aed tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:04.584628 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f71a4c1-e7e6-4fc7-add8-6b6253f14aed tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:04.584938 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:04.585383 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f71a4c1-e7e6-4fc7-add8-6b6253f14aed tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:04.706728 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3ae685a2-b5d6-45f3-a27e-f009340cd9d3 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0/action" status: 202 len: 0 microversion: 2.1 time: 0.385564 Jul 31 01:11:04.707871 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 567/1129] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:11:04 2022] POST /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:11:04.716092 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-1aa5a770-9156-4216-9146-0242ea72efe1 req-5424ab27-a56a-4ac0-bb1b-08d34af02bfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "451cf12b-e061-4c6c-8b43-40cee9ddcc1c", "tag": "e424fe72-c4fb-4577-bbaa-a66dd860365f"}, {"name": "network-changed", "server_uuid": "59f16639-427f-42f0-abe2-19c1106f59e3", "tag": "6b987620-a1fd-4b4e-b5c2-5ca6e5557ebf"}, {"name": "network-changed", "server_uuid": "2786dc8b-517e-4c01-be66-c7959ff8972f", "tag": "e58b02f2-5ad0-4d5c-8b46-97753614753b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:04.728826 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1aa5a770-9156-4216-9146-0242ea72efe1 req-5424ab27-a56a-4ac0-bb1b-08d34af02bfc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:04.729281 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1aa5a770-9156-4216-9146-0242ea72efe1 req-5424ab27-a56a-4ac0-bb1b-08d34af02bfc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:04.747064 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1aa5a770-9156-4216-9146-0242ea72efe1 req-5424ab27-a56a-4ac0-bb1b-08d34af02bfc service nova] Creating event network-changed:e424fe72-c4fb-4577-bbaa-a66dd860365f for instance 451cf12b-e061-4c6c-8b43-40cee9ddcc1c on n-h1-master-1 Jul 31 01:11:04.747626 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1aa5a770-9156-4216-9146-0242ea72efe1 req-5424ab27-a56a-4ac0-bb1b-08d34af02bfc service nova] Creating event network-changed:6b987620-a1fd-4b4e-b5c2-5ca6e5557ebf for instance 59f16639-427f-42f0-abe2-19c1106f59e3 on n-h1-master-1 Jul 31 01:11:04.748208 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1aa5a770-9156-4216-9146-0242ea72efe1 req-5424ab27-a56a-4ac0-bb1b-08d34af02bfc service nova] Creating event network-changed:e58b02f2-5ad0-4d5c-8b46-97753614753b for instance 2786dc8b-517e-4c01-be66-c7959ff8972f on n-h2-master-1 Jul 31 01:11:04.761419 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-1aa5a770-9156-4216-9146-0242ea72efe1 req-5424ab27-a56a-4ac0-bb1b-08d34af02bfc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.051622 Jul 31 01:11:04.762167 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 568/1130] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:04.767678 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-00a67c7b-3448-416b-a62c-f9480ad12424 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:04.768318 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-00a67c7b-3448-416b-a62c-f9480ad12424 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:04.776283 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00a67c7b-3448-416b-a62c-f9480ad12424 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:04.776726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00a67c7b-3448-416b-a62c-f9480ad12424 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:04.777725 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00a67c7b-3448-416b-a62c-f9480ad12424 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:04.778170 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00a67c7b-3448-416b-a62c-f9480ad12424 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:04.783780 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:04.816664 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6f71a4c1-e7e6-4fc7-add8-6b6253f14aed tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.245454 Jul 31 01:11:04.817429 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 563/1131] 10.222.0.45 () {58 vars in 1293 bytes} [Sun Jul 31 01:11:04 2022] GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f/os-security-groups => generated 1158 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:04.822916 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-58845b65-4264-43f5-a72b-3f853d345f07 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:04.823851 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-58845b65-4264-43f5-a72b-3f853d345f07 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:04.831091 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58845b65-4264-43f5-a72b-3f853d345f07 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:04.831583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58845b65-4264-43f5-a72b-3f853d345f07 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:04.832512 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58845b65-4264-43f5-a72b-3f853d345f07 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:04.832871 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58845b65-4264-43f5-a72b-3f853d345f07 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:05.005818 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-00a67c7b-3448-416b-a62c-f9480ad12424 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:05.015294 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-00a67c7b-3448-416b-a62c-f9480ad12424 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1355 microversion: 2.1 time: 0.251827 Jul 31 01:11:05.016392 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 569/1132] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:04 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1355 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:05.021845 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dee5d97b-0b99-463e-a36a-9aca4bd2aa3f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'create', calling method: .version_select at 0x7fede5640af0>, body: {"security_group": {"name": " tempest-securitygroup -2032634113 ", "description": "tempest-description-201806348"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:05.035712 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-58845b65-4264-43f5-a72b-3f853d345f07 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:05.043384 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-58845b65-4264-43f5-a72b-3f853d345f07 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1472 microversion: 2.1 time: 0.224444 Jul 31 01:11:05.044085 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 564/1133] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:04 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1472 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:05.085759 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5928ca0f-6cb0-4890-9ec7-e4f7fabc4cdb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:05.085759 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5928ca0f-6cb0-4890-9ec7-e4f7fabc4cdb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:05.091908 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5928ca0f-6cb0-4890-9ec7-e4f7fabc4cdb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:05.092613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5928ca0f-6cb0-4890-9ec7-e4f7fabc4cdb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:05.094309 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5928ca0f-6cb0-4890-9ec7-e4f7fabc4cdb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:05.095028 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5928ca0f-6cb0-4890-9ec7-e4f7fabc4cdb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:05.267673 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dee5d97b-0b99-463e-a36a-9aca4bd2aa3f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.249866 Jul 31 01:11:05.268130 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 570/1134] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:11:05 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:05.272785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ff4a10fe-22ee-4091-b5f1-2ed30ab4d12b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:05.273635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ff4a10fe-22ee-4091-b5f1-2ed30ab4d12b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:05.281786 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff4a10fe-22ee-4091-b5f1-2ed30ab4d12b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:05.282481 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff4a10fe-22ee-4091-b5f1-2ed30ab4d12b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:05.283303 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff4a10fe-22ee-4091-b5f1-2ed30ab4d12b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:05.283777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff4a10fe-22ee-4091-b5f1-2ed30ab4d12b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:05.432249 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5928ca0f-6cb0-4890-9ec7-e4f7fabc4cdb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:05.446363 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5928ca0f-6cb0-4890-9ec7-e4f7fabc4cdb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 200 len: 1307 microversion: 2.1 time: 0.370320 Jul 31 01:11:05.447486 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 565/1135] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:05 2022] GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 1307 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:11:05.468437 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a62dfb62-dcc8-421c-b530-adf5df8d3d01 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede5543ee0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:05.672186 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a62dfb62-dcc8-421c-b530-adf5df8d3d01 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/18e69f31-9ecd-4070-867f-e69ed19078e1" status: 200 len: 223 microversion: 2.1 time: 0.207532 Jul 31 01:11:05.673030 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 566/1136] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 01:11:05 2022] GET /compute/v2.1/os-security-groups/18e69f31-9ecd-4070-867f-e69ed19078e1 => generated 223 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:05.680753 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5f13187f-234c-497c-b734-d0f13f721af1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:05.680950 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ff4a10fe-22ee-4091-b5f1-2ed30ab4d12b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:05.682654 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5f13187f-234c-497c-b734-d0f13f721af1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:05.691160 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f13187f-234c-497c-b734-d0f13f721af1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:05.691480 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ff4a10fe-22ee-4091-b5f1-2ed30ab4d12b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1292 microversion: 2.1 time: 0.422229 Jul 31 01:11:05.692702 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f13187f-234c-497c-b734-d0f13f721af1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:05.693653 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f13187f-234c-497c-b734-d0f13f721af1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:05.695112 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f13187f-234c-497c-b734-d0f13f721af1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:05.709289 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 571/1137] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:05 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1292 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:05.715924 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-76ccd36d-f611-45ea-a95d-c28616080016 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:05.721284 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-76ccd36d-f611-45ea-a95d-c28616080016 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:05.733680 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76ccd36d-f611-45ea-a95d-c28616080016 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:05.734055 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76ccd36d-f611-45ea-a95d-c28616080016 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:05.734851 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76ccd36d-f611-45ea-a95d-c28616080016 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:05.738146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76ccd36d-f611-45ea-a95d-c28616080016 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:06.163740 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5f13187f-234c-497c-b734-d0f13f721af1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:06.173806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5f13187f-234c-497c-b734-d0f13f721af1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:06.175363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5f13187f-234c-497c-b734-d0f13f721af1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:06.176539 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5f13187f-234c-497c-b734-d0f13f721af1 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.501818 Jul 31 01:11:06.190389 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 567/1138] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:05 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:06.190389 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f42a4b6d-edd5-4b54-8b86-e5a7efb791bc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:06.190389 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f42a4b6d-edd5-4b54-8b86-e5a7efb791bc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:06.190389 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f42a4b6d-edd5-4b54-8b86-e5a7efb791bc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:06.190389 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f42a4b6d-edd5-4b54-8b86-e5a7efb791bc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:06.190389 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f42a4b6d-edd5-4b54-8b86-e5a7efb791bc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:06.190971 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f42a4b6d-edd5-4b54-8b86-e5a7efb791bc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:06.200836 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-76ccd36d-f611-45ea-a95d-c28616080016 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:06.208530 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-76ccd36d-f611-45ea-a95d-c28616080016 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 0.496434 Jul 31 01:11:06.209122 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 572/1139] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:05 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:06.216348 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-48a94d61-33c6-4c16-974b-b09f200a6623 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede54fd700>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:06.388473 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f42a4b6d-edd5-4b54-8b86-e5a7efb791bc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:06.396836 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f42a4b6d-edd5-4b54-8b86-e5a7efb791bc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.218707 Jul 31 01:11:06.397419 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 568/1140] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:06 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:06.402424 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c0a2498f-e1aa-401e-8484-11eb6abaae70 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:06.403413 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c0a2498f-e1aa-401e-8484-11eb6abaae70 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:06.410094 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0a2498f-e1aa-401e-8484-11eb6abaae70 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:06.411238 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0a2498f-e1aa-401e-8484-11eb6abaae70 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:06.412202 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0a2498f-e1aa-401e-8484-11eb6abaae70 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:06.412799 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0a2498f-e1aa-401e-8484-11eb6abaae70 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:06.726017 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-48a94d61-33c6-4c16-974b-b09f200a6623 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/18e69f31-9ecd-4070-867f-e69ed19078e1" status: 202 len: 0 microversion: 2.1 time: 0.514171 Jul 31 01:11:06.727430 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 573/1141] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:11:06 2022] DELETE /compute/v2.1/os-security-groups/18e69f31-9ecd-4070-867f-e69ed19078e1 => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:11:06.732178 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-47eeb544-30d1-44d7-854c-4b87bab28e2d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:06.732838 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-47eeb544-30d1-44d7-854c-4b87bab28e2d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:06.738887 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47eeb544-30d1-44d7-854c-4b87bab28e2d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:06.739353 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47eeb544-30d1-44d7-854c-4b87bab28e2d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:06.740181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47eeb544-30d1-44d7-854c-4b87bab28e2d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:06.740615 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47eeb544-30d1-44d7-854c-4b87bab28e2d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:06.852999 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c0a2498f-e1aa-401e-8484-11eb6abaae70 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:06.864275 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c0a2498f-e1aa-401e-8484-11eb6abaae70 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1355 microversion: 2.1 time: 0.465575 Jul 31 01:11:06.864999 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 569/1142] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:06 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1355 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:06.883920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8be604dc-4bf1-4e62-8a54-7f37d7065f34 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:06.884532 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8be604dc-4bf1-4e62-8a54-7f37d7065f34 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:06.891874 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8be604dc-4bf1-4e62-8a54-7f37d7065f34 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:06.892333 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8be604dc-4bf1-4e62-8a54-7f37d7065f34 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:06.893185 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8be604dc-4bf1-4e62-8a54-7f37d7065f34 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:06.893628 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8be604dc-4bf1-4e62-8a54-7f37d7065f34 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:07.063814 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-47eeb544-30d1-44d7-854c-4b87bab28e2d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:07.072132 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-47eeb544-30d1-44d7-854c-4b87bab28e2d tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1472 microversion: 2.1 time: 0.343345 Jul 31 01:11:07.072872 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 574/1143] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:06 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1472 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:07.079535 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d6a41bb6-ddce-4e8e-8ca3-a9d6aeb95dcf tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:07.080491 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d6a41bb6-ddce-4e8e-8ca3-a9d6aeb95dcf tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:07.087777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d6a41bb6-ddce-4e8e-8ca3-a9d6aeb95dcf tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:07.088242 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d6a41bb6-ddce-4e8e-8ca3-a9d6aeb95dcf tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:07.089051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d6a41bb6-ddce-4e8e-8ca3-a9d6aeb95dcf tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:07.089501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d6a41bb6-ddce-4e8e-8ca3-a9d6aeb95dcf tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:07.113128 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8be604dc-4bf1-4e62-8a54-7f37d7065f34 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:07.125104 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8be604dc-4bf1-4e62-8a54-7f37d7065f34 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 200 len: 1307 microversion: 2.1 time: 0.244210 Jul 31 01:11:07.135009 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 570/1144] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:06 2022] GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 1307 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:07.135009 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b0404a51-5a43-40a3-bb3f-003564798d5e tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede5535c10>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:07.199753 n-d-master-1 devstack@n-api.service[119474]: DEBUG neutronclient.v2_0.client [None req-b0404a51-5a43-40a3-bb3f-003564798d5e tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 18e69f31-9ecd-4070-867f-e69ed19078e1 does not exist", "detail": ""}} {{(pid=119474) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:11:07.200372 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.security_group_api [None req-b0404a51-5a43-40a3-bb3f-003564798d5e tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Neutron security group 18e69f31-9ecd-4070-867f-e69ed19078e1 not found {{(pid=119474) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 31 01:11:07.200864 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-b0404a51-5a43-40a3-bb3f-003564798d5e tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] HTTP exception thrown: Security group 18e69f31-9ecd-4070-867f-e69ed19078e1 does not exist Jul 31 01:11:07.200864 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-6a4bb258-8dc0-4e81-8425-0e8d5d166958'] Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b0404a51-5a43-40a3-bb3f-003564798d5e tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Request method failure captured: Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-security-groups/18e69f31-9ecd-4070-867f-e69ed19078e1 HTTP/1.1 Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dZ4RROZmvNHgk8nkEPCHEOtKeymvD8aJkYSffUh8bqh37RpmNHALtgJw0W3wgMu6HJwqcBFxL8fLuKg63WTseMOWT3m6KTBzl-wHxPxejmdZtFZxPmexVFKQ3mNYzDtb_uVYFrMpBX3R40pkmpf04xAyZo3K5gfwBnL_o_UQmcBzKE Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a45cfeb1ce9844c5bf16e975af312ba0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: e3e6a158c3884c8db5a66fe80e71527d Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: exception: Security group 18e69f31-9ecd-4070-867f-e69ed19078e1 does not exist Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-6a4bb258-8dc0-4e81-8425-0e8d5d166958'] Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '18e69f31-9ecd-4070-867f-e69ed19078e1'} Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:11:07.203652 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 18e69f31-9ecd-4070-867f-e69ed19078e1 does not exist Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a4bb258-8dc0-4e81-8425-0e8d5d166958'] Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 18e69f31-9ecd-4070-867f-e69ed19078e1 does not exist Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a4bb258-8dc0-4e81-8425-0e8d5d166958'] Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 18e69f31-9ecd-4070-867f-e69ed19078e1 does not exist Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a4bb258-8dc0-4e81-8425-0e8d5d166958'] Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 18e69f31-9ecd-4070-867f-e69ed19078e1 does not exist Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a4bb258-8dc0-4e81-8425-0e8d5d166958'] Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b0404a51-5a43-40a3-bb3f-003564798d5e tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Returning 404 to user: Security group 18e69f31-9ecd-4070-867f-e69ed19078e1 does not exist Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-6a4bb258-8dc0-4e81-8425-0e8d5d166958'] {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b0404a51-5a43-40a3-bb3f-003564798d5e tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/18e69f31-9ecd-4070-867f-e69ed19078e1" status: 404 len: 194 microversion: 2.1 time: 0.077911 Jul 31 01:11:07.207838 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 571/1145] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 01:11:07 2022] GET /compute/v2.1/os-security-groups/18e69f31-9ecd-4070-867f-e69ed19078e1 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:11:07.211514 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4ec125cb-68ab-4791-a481-0b08746a0e5d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:07.211514 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4ec125cb-68ab-4791-a481-0b08746a0e5d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:07.219012 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ec125cb-68ab-4791-a481-0b08746a0e5d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:07.219462 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ec125cb-68ab-4791-a481-0b08746a0e5d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:07.220251 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ec125cb-68ab-4791-a481-0b08746a0e5d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:07.220686 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ec125cb-68ab-4791-a481-0b08746a0e5d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:07.721812 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d6a41bb6-ddce-4e8e-8ca3-a9d6aeb95dcf tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:07.731987 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d6a41bb6-ddce-4e8e-8ca3-a9d6aeb95dcf tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1292 microversion: 2.1 time: 0.657950 Jul 31 01:11:07.733868 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 575/1146] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:07 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1292 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:07.743554 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-697b48b5-24ce-43f7-9caf-4b6144269a48 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'create', calling method: .version_select at 0x7fede55834c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1728889985", "description": "tempest-description-1666293171"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:07.820336 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4ec125cb-68ab-4791-a481-0b08746a0e5d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:07.833376 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4ec125cb-68ab-4791-a481-0b08746a0e5d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:07.835682 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4ec125cb-68ab-4791-a481-0b08746a0e5d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:07.838218 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4ec125cb-68ab-4791-a481-0b08746a0e5d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.631538 Jul 31 01:11:07.839001 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 572/1147] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:07 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:07.849234 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bf4a9601-64b0-4b33-a898-29776581dafc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:07.850443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bf4a9601-64b0-4b33-a898-29776581dafc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:07.862801 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf4a9601-64b0-4b33-a898-29776581dafc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:07.864343 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf4a9601-64b0-4b33-a898-29776581dafc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:07.866570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf4a9601-64b0-4b33-a898-29776581dafc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:07.868520 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf4a9601-64b0-4b33-a898-29776581dafc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:08.188044 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-697b48b5-24ce-43f7-9caf-4b6144269a48 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.452330 Jul 31 01:11:08.188954 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 576/1148] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:11:07 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:08.197016 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2cde1995-fd6d-4253-b6fc-d2e0035e0152 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:08.198745 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2cde1995-fd6d-4253-b6fc-d2e0035e0152 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:08.206217 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bf4a9601-64b0-4b33-a898-29776581dafc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:08.209823 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cde1995-fd6d-4253-b6fc-d2e0035e0152 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:08.209823 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cde1995-fd6d-4253-b6fc-d2e0035e0152 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:08.210460 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cde1995-fd6d-4253-b6fc-d2e0035e0152 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:08.210896 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cde1995-fd6d-4253-b6fc-d2e0035e0152 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:08.222720 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bf4a9601-64b0-4b33-a898-29776581dafc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 0.381982 Jul 31 01:11:08.223525 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 573/1149] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:07 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:08.235794 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f10ed4a6-0f2f-4829-a3b3-ba9a45b95230 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:08.237537 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f10ed4a6-0f2f-4829-a3b3-ba9a45b95230 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:08.250694 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f10ed4a6-0f2f-4829-a3b3-ba9a45b95230 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:08.251582 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f10ed4a6-0f2f-4829-a3b3-ba9a45b95230 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:08.253079 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f10ed4a6-0f2f-4829-a3b3-ba9a45b95230 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:08.253894 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f10ed4a6-0f2f-4829-a3b3-ba9a45b95230 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:08.511995 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2cde1995-fd6d-4253-b6fc-d2e0035e0152 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:08.525337 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2cde1995-fd6d-4253-b6fc-d2e0035e0152 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.334815 Jul 31 01:11:08.526055 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 577/1150] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:08 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:08.529053 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f10ed4a6-0f2f-4829-a3b3-ba9a45b95230 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:08.532671 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-345a4745-e8d8-4f5c-ad47-15252b9bd2ad tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:08.533726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-345a4745-e8d8-4f5c-ad47-15252b9bd2ad tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:08.544454 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f10ed4a6-0f2f-4829-a3b3-ba9a45b95230 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1355 microversion: 2.1 time: 0.318104 Jul 31 01:11:08.547777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-345a4745-e8d8-4f5c-ad47-15252b9bd2ad tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:08.548659 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-345a4745-e8d8-4f5c-ad47-15252b9bd2ad tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:08.551520 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-345a4745-e8d8-4f5c-ad47-15252b9bd2ad tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:08.552428 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-345a4745-e8d8-4f5c-ad47-15252b9bd2ad tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:08.575782 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 574/1151] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:08 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1355 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:08.583035 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3f991c7c-5206-46d1-9c8d-083fb1b726e9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:08.584138 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3f991c7c-5206-46d1-9c8d-083fb1b726e9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:08.591557 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f991c7c-5206-46d1-9c8d-083fb1b726e9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:08.592078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f991c7c-5206-46d1-9c8d-083fb1b726e9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:08.593872 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f991c7c-5206-46d1-9c8d-083fb1b726e9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:08.594535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f991c7c-5206-46d1-9c8d-083fb1b726e9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:08.777892 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-345a4745-e8d8-4f5c-ad47-15252b9bd2ad tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:08.788206 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-345a4745-e8d8-4f5c-ad47-15252b9bd2ad tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1472 microversion: 2.1 time: 0.261023 Jul 31 01:11:08.789121 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 578/1152] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:08 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:08.794391 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b7bfa186-3910-4230-9288-222573c0badf tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'create', calling method: .version_select at 0x7fede563ba60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1928586391", "description": "tempest-description-2045344707"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:08.825142 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3f991c7c-5206-46d1-9c8d-083fb1b726e9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:08.837849 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3f991c7c-5206-46d1-9c8d-083fb1b726e9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 200 len: 1307 microversion: 2.1 time: 0.256918 Jul 31 01:11:08.837849 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 575/1153] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:08 2022] GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 1307 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:08.839990 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-835fd805-f101-40e9-a35e-0208c68e5ec4 req-6eb9a314-a60d-414b-9d3b-3ef6d4d77c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8660466c-0119-4cc7-8da1-e48e22f2c088", "name": "network-vif-plugged", "status": "completed", "tag": "fd2629bf-3368-49d5-bbc6-a5f5dfff4006"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:08.850818 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-835fd805-f101-40e9-a35e-0208c68e5ec4 req-6eb9a314-a60d-414b-9d3b-3ef6d4d77c07 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:08.851518 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-835fd805-f101-40e9-a35e-0208c68e5ec4 req-6eb9a314-a60d-414b-9d3b-3ef6d4d77c07 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:08.865600 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-835fd805-f101-40e9-a35e-0208c68e5ec4 req-6eb9a314-a60d-414b-9d3b-3ef6d4d77c07 service nova] Creating event network-vif-plugged:fd2629bf-3368-49d5-bbc6-a5f5dfff4006 for instance 8660466c-0119-4cc7-8da1-e48e22f2c088 on n-h1-master-1 Jul 31 01:11:08.870844 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-835fd805-f101-40e9-a35e-0208c68e5ec4 req-6eb9a314-a60d-414b-9d3b-3ef6d4d77c07 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034345 Jul 31 01:11:08.871483 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 576/1154] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:08.877805 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-884fe9ce-1a14-47c3-bf3b-c81d6e21cccc tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:08.878750 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-884fe9ce-1a14-47c3-bf3b-c81d6e21cccc tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:08.881004 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:08.888217 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-884fe9ce-1a14-47c3-bf3b-c81d6e21cccc tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:08.888674 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-884fe9ce-1a14-47c3-bf3b-c81d6e21cccc tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:08.889448 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-884fe9ce-1a14-47c3-bf3b-c81d6e21cccc tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:08.890653 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-884fe9ce-1a14-47c3-bf3b-c81d6e21cccc tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:09.030922 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b7bfa186-3910-4230-9288-222573c0badf tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.240488 Jul 31 01:11:09.032303 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 579/1155] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:11:08 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:09.054788 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7150fabf-7d0a-4309-b7db-0b5303993350 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:09.059454 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7150fabf-7d0a-4309-b7db-0b5303993350 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:09.067222 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7150fabf-7d0a-4309-b7db-0b5303993350 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:09.067734 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7150fabf-7d0a-4309-b7db-0b5303993350 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:09.068530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7150fabf-7d0a-4309-b7db-0b5303993350 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:09.069220 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7150fabf-7d0a-4309-b7db-0b5303993350 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:09.106292 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-884fe9ce-1a14-47c3-bf3b-c81d6e21cccc tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:09.125679 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-884fe9ce-1a14-47c3-bf3b-c81d6e21cccc tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1292 microversion: 2.1 time: 0.252522 Jul 31 01:11:09.126337 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 577/1156] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:08 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1292 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:09.134367 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c3012814-7be6-472e-a589-ded22158330b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'create', calling method: .version_select at 0x7fede5535f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1856269257", "description": "tempest-description-302078719"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:09.274933 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7150fabf-7d0a-4309-b7db-0b5303993350 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:09.285331 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7150fabf-7d0a-4309-b7db-0b5303993350 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:09.286806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7150fabf-7d0a-4309-b7db-0b5303993350 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:09.288045 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7150fabf-7d0a-4309-b7db-0b5303993350 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.253639 Jul 31 01:11:09.288608 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 580/1157] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:09 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:09.293523 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f522c1aa-9085-4482-9823-36c8bd4b69c0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:09.294147 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f522c1aa-9085-4482-9823-36c8bd4b69c0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:09.300577 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f522c1aa-9085-4482-9823-36c8bd4b69c0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:09.301169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f522c1aa-9085-4482-9823-36c8bd4b69c0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:09.302197 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f522c1aa-9085-4482-9823-36c8bd4b69c0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:09.302800 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f522c1aa-9085-4482-9823-36c8bd4b69c0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:09.388275 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c3012814-7be6-472e-a589-ded22158330b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.259725 Jul 31 01:11:09.388876 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 578/1158] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:11:09 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:09.402113 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7e567b9a-c8fa-4590-b6eb-96fa7943a89f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede552e040>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:09.520759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f522c1aa-9085-4482-9823-36c8bd4b69c0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:09.529779 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f522c1aa-9085-4482-9823-36c8bd4b69c0 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 0.239767 Jul 31 01:11:09.531664 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 581/1159] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:09 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:09.558159 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e21ddbf6-a0b4-4180-9af6-a1259d357d2b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:09.559519 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e21ddbf6-a0b4-4180-9af6-a1259d357d2b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:09.568914 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e21ddbf6-a0b4-4180-9af6-a1259d357d2b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:09.569638 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e21ddbf6-a0b4-4180-9af6-a1259d357d2b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:09.571049 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e21ddbf6-a0b4-4180-9af6-a1259d357d2b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:09.571568 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e21ddbf6-a0b4-4180-9af6-a1259d357d2b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:09.759078 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7e567b9a-c8fa-4590-b6eb-96fa7943a89f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups" status: 200 len: 1835 microversion: 2.1 time: 0.360686 Jul 31 01:11:09.760015 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 579/1160] 10.222.0.45 () {58 vars in 1158 bytes} [Sun Jul 31 01:11:09 2022] GET /compute/v2.1/os-security-groups => generated 1835 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:09.765327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-07fde217-5580-4b95-a743-1b5746f188c7 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:09.765939 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-07fde217-5580-4b95-a743-1b5746f188c7 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:09.773078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07fde217-5580-4b95-a743-1b5746f188c7 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:09.773523 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07fde217-5580-4b95-a743-1b5746f188c7 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:09.774303 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07fde217-5580-4b95-a743-1b5746f188c7 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:09.774737 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07fde217-5580-4b95-a743-1b5746f188c7 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:09.783694 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e21ddbf6-a0b4-4180-9af6-a1259d357d2b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:09.793025 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e21ddbf6-a0b4-4180-9af6-a1259d357d2b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.244517 Jul 31 01:11:09.793941 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 582/1161] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:09 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:09.799299 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-82f83a8b-dddc-49ea-9dcd-7b2a1ac0b5ff tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede54c2f70>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:09.995838 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-07fde217-5580-4b95-a743-1b5746f188c7 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:10.005371 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-07fde217-5580-4b95-a743-1b5746f188c7 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1355 microversion: 2.1 time: 0.244319 Jul 31 01:11:10.007360 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 580/1162] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:09 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1355 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:10.011491 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-785c4743-9aea-48e3-a07b-2993b39922a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:10.011928 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-785c4743-9aea-48e3-a07b-2993b39922a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:10.019101 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-785c4743-9aea-48e3-a07b-2993b39922a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:10.019676 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-785c4743-9aea-48e3-a07b-2993b39922a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:10.020649 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-785c4743-9aea-48e3-a07b-2993b39922a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:10.021088 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-785c4743-9aea-48e3-a07b-2993b39922a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:10.163949 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-82f83a8b-dddc-49ea-9dcd-7b2a1ac0b5ff tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/66606709-92e8-4290-a2ca-147abb9009be" status: 202 len: 0 microversion: 2.1 time: 0.368459 Jul 31 01:11:10.164999 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 583/1163] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:11:09 2022] DELETE /compute/v2.1/os-security-groups/66606709-92e8-4290-a2ca-147abb9009be => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:11:10.173943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1fbbf956-c897-4941-acef-f75276e54b7f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:10.174699 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1fbbf956-c897-4941-acef-f75276e54b7f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:10.185745 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1fbbf956-c897-4941-acef-f75276e54b7f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:10.186412 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1fbbf956-c897-4941-acef-f75276e54b7f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:10.188425 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1fbbf956-c897-4941-acef-f75276e54b7f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:10.189253 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1fbbf956-c897-4941-acef-f75276e54b7f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:10.199887 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-785c4743-9aea-48e3-a07b-2993b39922a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:10.212703 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-785c4743-9aea-48e3-a07b-2993b39922a0 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1472 microversion: 2.1 time: 0.204114 Jul 31 01:11:10.219316 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 581/1164] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:10 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1472 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:10.226318 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4c47f32b-d21c-4f40-8221-4d51b4addc3b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:10.227076 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4c47f32b-d21c-4f40-8221-4d51b4addc3b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:10.234209 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c47f32b-d21c-4f40-8221-4d51b4addc3b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:10.234769 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c47f32b-d21c-4f40-8221-4d51b4addc3b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:10.235789 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c47f32b-d21c-4f40-8221-4d51b4addc3b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:10.236311 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c47f32b-d21c-4f40-8221-4d51b4addc3b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:10.404829 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1fbbf956-c897-4941-acef-f75276e54b7f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:10.423790 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1fbbf956-c897-4941-acef-f75276e54b7f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 200 len: 1307 microversion: 2.1 time: 0.256854 Jul 31 01:11:10.434021 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 584/1165] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:10 2022] GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 1307 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:10.434409 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4c47f32b-d21c-4f40-8221-4d51b4addc3b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:10.440318 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-707cb378-2f4c-4183-86c3-06d026e233cd tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede54c2af0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:10.444015 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4c47f32b-d21c-4f40-8221-4d51b4addc3b tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1292 microversion: 2.1 time: 0.222916 Jul 31 01:11:10.444974 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 582/1166] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:10 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1292 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:10.450222 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b49f397e-a30c-4e6a-a757-213a122a28a7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:10.451446 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b49f397e-a30c-4e6a-a757-213a122a28a7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:10.458670 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b49f397e-a30c-4e6a-a757-213a122a28a7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:10.460146 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b49f397e-a30c-4e6a-a757-213a122a28a7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:10.461022 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b49f397e-a30c-4e6a-a757-213a122a28a7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:10.461591 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b49f397e-a30c-4e6a-a757-213a122a28a7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:10.479192 n-d-master-1 devstack@n-api.service[119475]: DEBUG neutronclient.v2_0.client [None req-707cb378-2f4c-4183-86c3-06d026e233cd tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 66606709-92e8-4290-a2ca-147abb9009be does not exist", "detail": ""}} {{(pid=119475) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:11:10.479848 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.security_group_api [None req-707cb378-2f4c-4183-86c3-06d026e233cd tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Neutron security group 66606709-92e8-4290-a2ca-147abb9009be not found {{(pid=119475) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 31 01:11:10.480380 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-707cb378-2f4c-4183-86c3-06d026e233cd tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] HTTP exception thrown: Security group 66606709-92e8-4290-a2ca-147abb9009be does not exist Jul 31 01:11:10.480380 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-b6015bd7-afd9-4ad5-b4a3-f629ac86d525'] Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-707cb378-2f4c-4183-86c3-06d026e233cd tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Request method failure captured: Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-security-groups/66606709-92e8-4290-a2ca-147abb9009be HTTP/1.1 Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dZ4RROZmvNHgk8nkEPCHEOtKeymvD8aJkYSffUh8bqh37RpmNHALtgJw0W3wgMu6HJwqcBFxL8fLuKg63WTseMOWT3m6KTBzl-wHxPxejmdZtFZxPmexVFKQ3mNYzDtb_uVYFrMpBX3R40pkmpf04xAyZo3K5gfwBnL_o_UQmcBzKE Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a45cfeb1ce9844c5bf16e975af312ba0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: e3e6a158c3884c8db5a66fe80e71527d Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: exception: Security group 66606709-92e8-4290-a2ca-147abb9009be does not exist Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-b6015bd7-afd9-4ad5-b4a3-f629ac86d525'] Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '66606709-92e8-4290-a2ca-147abb9009be'} Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:11:10.483026 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 66606709-92e8-4290-a2ca-147abb9009be does not exist Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6015bd7-afd9-4ad5-b4a3-f629ac86d525'] Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 66606709-92e8-4290-a2ca-147abb9009be does not exist Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6015bd7-afd9-4ad5-b4a3-f629ac86d525'] Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 66606709-92e8-4290-a2ca-147abb9009be does not exist Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6015bd7-afd9-4ad5-b4a3-f629ac86d525'] Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 66606709-92e8-4290-a2ca-147abb9009be does not exist Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6015bd7-afd9-4ad5-b4a3-f629ac86d525'] Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-707cb378-2f4c-4183-86c3-06d026e233cd tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Returning 404 to user: Security group 66606709-92e8-4290-a2ca-147abb9009be does not exist Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-b6015bd7-afd9-4ad5-b4a3-f629ac86d525'] {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-707cb378-2f4c-4183-86c3-06d026e233cd tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/66606709-92e8-4290-a2ca-147abb9009be" status: 404 len: 194 microversion: 2.1 time: 0.060115 Jul 31 01:11:10.491182 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 585/1167] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 01:11:10 2022] GET /compute/v2.1/os-security-groups/66606709-92e8-4290-a2ca-147abb9009be => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:11:10.496006 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dd8c043d-9460-42cf-be96-e71a56b76715 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede543e280>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:10.686492 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b49f397e-a30c-4e6a-a757-213a122a28a7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:10.690809 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:10.699962 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b49f397e-a30c-4e6a-a757-213a122a28a7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:10.701665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b49f397e-a30c-4e6a-a757-213a122a28a7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:10.703358 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b49f397e-a30c-4e6a-a757-213a122a28a7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.257484 Jul 31 01:11:10.704968 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 583/1168] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:10 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:10.710095 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7008996f-4cec-4480-9e3b-3b277b5dcf15 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:10.710873 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7008996f-4cec-4480-9e3b-3b277b5dcf15 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:10.718339 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7008996f-4cec-4480-9e3b-3b277b5dcf15 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:10.719225 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7008996f-4cec-4480-9e3b-3b277b5dcf15 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:10.720324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7008996f-4cec-4480-9e3b-3b277b5dcf15 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:10.720870 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7008996f-4cec-4480-9e3b-3b277b5dcf15 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:10.894594 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dd8c043d-9460-42cf-be96-e71a56b76715 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/d1a1347a-e95f-450d-b1fb-eda6b1636383" status: 202 len: 0 microversion: 2.1 time: 0.402067 Jul 31 01:11:10.895515 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 586/1169] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:11:10 2022] DELETE /compute/v2.1/os-security-groups/d1a1347a-e95f-450d-b1fb-eda6b1636383 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 01:11:10.901509 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-14737952-e83c-4238-b2e8-c590978112cd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:10.902518 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-14737952-e83c-4238-b2e8-c590978112cd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:10.912064 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14737952-e83c-4238-b2e8-c590978112cd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:10.912791 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14737952-e83c-4238-b2e8-c590978112cd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:10.913892 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14737952-e83c-4238-b2e8-c590978112cd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:10.914866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14737952-e83c-4238-b2e8-c590978112cd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:10.946013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7008996f-4cec-4480-9e3b-3b277b5dcf15 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:10.953918 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7008996f-4cec-4480-9e3b-3b277b5dcf15 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 0.247481 Jul 31 01:11:10.954875 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 584/1170] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:10 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:10.959644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8281f4a6-91af-4c6f-a22b-e99abe607ba4 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede5533790>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:10.996954 n-d-master-1 devstack@n-api.service[119474]: DEBUG neutronclient.v2_0.client [None req-8281f4a6-91af-4c6f-a22b-e99abe607ba4 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d1a1347a-e95f-450d-b1fb-eda6b1636383 does not exist", "detail": ""}} {{(pid=119474) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:11:10.997548 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.security_group_api [None req-8281f4a6-91af-4c6f-a22b-e99abe607ba4 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Neutron security group d1a1347a-e95f-450d-b1fb-eda6b1636383 not found {{(pid=119474) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 31 01:11:10.998054 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-8281f4a6-91af-4c6f-a22b-e99abe607ba4 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] HTTP exception thrown: Security group d1a1347a-e95f-450d-b1fb-eda6b1636383 does not exist Jul 31 01:11:10.998054 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-e04391ec-2c65-4927-838a-e87e530b0e0c'] Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8281f4a6-91af-4c6f-a22b-e99abe607ba4 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Request method failure captured: Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-security-groups/d1a1347a-e95f-450d-b1fb-eda6b1636383 HTTP/1.1 Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dZ4RROZmvNHgk8nkEPCHEOtKeymvD8aJkYSffUh8bqh37RpmNHALtgJw0W3wgMu6HJwqcBFxL8fLuKg63WTseMOWT3m6KTBzl-wHxPxejmdZtFZxPmexVFKQ3mNYzDtb_uVYFrMpBX3R40pkmpf04xAyZo3K5gfwBnL_o_UQmcBzKE Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a45cfeb1ce9844c5bf16e975af312ba0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: e3e6a158c3884c8db5a66fe80e71527d Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: exception: Security group d1a1347a-e95f-450d-b1fb-eda6b1636383 does not exist Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-e04391ec-2c65-4927-838a-e87e530b0e0c'] Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'd1a1347a-e95f-450d-b1fb-eda6b1636383'} Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:11:11.000277 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d1a1347a-e95f-450d-b1fb-eda6b1636383 does not exist Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e04391ec-2c65-4927-838a-e87e530b0e0c'] Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d1a1347a-e95f-450d-b1fb-eda6b1636383 does not exist Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e04391ec-2c65-4927-838a-e87e530b0e0c'] Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d1a1347a-e95f-450d-b1fb-eda6b1636383 does not exist Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e04391ec-2c65-4927-838a-e87e530b0e0c'] Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d1a1347a-e95f-450d-b1fb-eda6b1636383 does not exist Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e04391ec-2c65-4927-838a-e87e530b0e0c'] Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8281f4a6-91af-4c6f-a22b-e99abe607ba4 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Returning 404 to user: Security group d1a1347a-e95f-450d-b1fb-eda6b1636383 does not exist Jul 31 01:11:11.003935 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-e04391ec-2c65-4927-838a-e87e530b0e0c'] {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:11:11.007199 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8281f4a6-91af-4c6f-a22b-e99abe607ba4 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/d1a1347a-e95f-450d-b1fb-eda6b1636383" status: 404 len: 194 microversion: 2.1 time: 0.048214 Jul 31 01:11:11.007199 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 585/1171] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 01:11:10 2022] GET /compute/v2.1/os-security-groups/d1a1347a-e95f-450d-b1fb-eda6b1636383 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:11:11.014157 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-785877cc-39c7-4a54-8115-d0b2c703a93d req-206e86e3-3d56-44d7-8b1c-75e0056b912e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8660466c-0119-4cc7-8da1-e48e22f2c088", "name": "network-vif-plugged", "status": "completed", "tag": "082830c6-d3e7-4858-b04e-daea65512750"}, {"server_uuid": "8660466c-0119-4cc7-8da1-e48e22f2c088", "name": "network-vif-plugged", "status": "completed", "tag": "174a4d1b-d42d-41f3-86c8-1031d7e0dd4e"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:11.038026 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-785877cc-39c7-4a54-8115-d0b2c703a93d req-206e86e3-3d56-44d7-8b1c-75e0056b912e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:11.038860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-785877cc-39c7-4a54-8115-d0b2c703a93d req-206e86e3-3d56-44d7-8b1c-75e0056b912e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:11.054141 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-785877cc-39c7-4a54-8115-d0b2c703a93d req-206e86e3-3d56-44d7-8b1c-75e0056b912e service nova] Creating event network-vif-plugged:082830c6-d3e7-4858-b04e-daea65512750 for instance 8660466c-0119-4cc7-8da1-e48e22f2c088 on n-h1-master-1 Jul 31 01:11:11.054662 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-785877cc-39c7-4a54-8115-d0b2c703a93d req-206e86e3-3d56-44d7-8b1c-75e0056b912e service nova] Creating event network-vif-plugged:174a4d1b-d42d-41f3-86c8-1031d7e0dd4e for instance 8660466c-0119-4cc7-8da1-e48e22f2c088 on n-h1-master-1 Jul 31 01:11:11.060363 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-785877cc-39c7-4a54-8115-d0b2c703a93d req-206e86e3-3d56-44d7-8b1c-75e0056b912e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052934 Jul 31 01:11:11.061521 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 586/1172] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:11.066937 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ba68ae3b-0d30-4088-93f4-ee77a8cf3d90 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede55335e0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:11.141173 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-14737952-e83c-4238-b2e8-c590978112cd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:11.150419 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-14737952-e83c-4238-b2e8-c590978112cd tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.253394 Jul 31 01:11:11.151663 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 587/1173] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:10 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:11.162761 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bee5613b-992f-4ba9-8076-2347e4bb8e83 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:11.163847 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bee5613b-992f-4ba9-8076-2347e4bb8e83 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:11.170674 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bee5613b-992f-4ba9-8076-2347e4bb8e83 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:11.172029 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bee5613b-992f-4ba9-8076-2347e4bb8e83 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:11.172851 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bee5613b-992f-4ba9-8076-2347e4bb8e83 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:11.173295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bee5613b-992f-4ba9-8076-2347e4bb8e83 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:11.448757 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bee5613b-992f-4ba9-8076-2347e4bb8e83 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:11.457089 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bee5613b-992f-4ba9-8076-2347e4bb8e83 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1355 microversion: 2.1 time: 0.304144 Jul 31 01:11:11.457794 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 588/1174] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:11 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1355 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:11.469458 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4e3ee5de-8aa8-4da2-a8f4-7c95ccc43974 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:11.470502 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4e3ee5de-8aa8-4da2-a8f4-7c95ccc43974 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:11.477865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e3ee5de-8aa8-4da2-a8f4-7c95ccc43974 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:11.478614 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e3ee5de-8aa8-4da2-a8f4-7c95ccc43974 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:11.479621 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e3ee5de-8aa8-4da2-a8f4-7c95ccc43974 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:11.480127 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e3ee5de-8aa8-4da2-a8f4-7c95ccc43974 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:11.483951 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ba68ae3b-0d30-4088-93f4-ee77a8cf3d90 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/d62f4c97-5391-480e-8948-db2957f27022" status: 202 len: 0 microversion: 2.1 time: 0.419231 Jul 31 01:11:11.494107 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 587/1175] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:11:11 2022] DELETE /compute/v2.1/os-security-groups/d62f4c97-5391-480e-8948-db2957f27022 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:11:11.500736 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-669eadce-8d99-47d0-9578-5b29b262a110 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:11.500848 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-669eadce-8d99-47d0-9578-5b29b262a110 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:11.520771 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-669eadce-8d99-47d0-9578-5b29b262a110 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:11.521093 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-669eadce-8d99-47d0-9578-5b29b262a110 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:11.522035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-669eadce-8d99-47d0-9578-5b29b262a110 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:11.522298 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-669eadce-8d99-47d0-9578-5b29b262a110 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:11.698776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4e3ee5de-8aa8-4da2-a8f4-7c95ccc43974 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:11.707541 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4e3ee5de-8aa8-4da2-a8f4-7c95ccc43974 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1472 microversion: 2.1 time: 0.243476 Jul 31 01:11:11.708148 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 589/1176] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:11 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:11.712869 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d3976503-c74f-4a6f-8d57-87b4dd9f7cf7 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:11.714315 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d3976503-c74f-4a6f-8d57-87b4dd9f7cf7 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:11.721338 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3976503-c74f-4a6f-8d57-87b4dd9f7cf7 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:11.722129 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3976503-c74f-4a6f-8d57-87b4dd9f7cf7 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:11.723183 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3976503-c74f-4a6f-8d57-87b4dd9f7cf7 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:11.723821 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3976503-c74f-4a6f-8d57-87b4dd9f7cf7 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:11.743474 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-669eadce-8d99-47d0-9578-5b29b262a110 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:11.753997 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-669eadce-8d99-47d0-9578-5b29b262a110 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 200 len: 1307 microversion: 2.1 time: 0.258639 Jul 31 01:11:11.754582 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 588/1177] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:11 2022] GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 1307 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:11.759565 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-98de1dc1-5257-4854-a054-f4b79c2b99c8 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede5533940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:11.809675 n-d-master-1 devstack@n-api.service[119474]: DEBUG neutronclient.v2_0.client [None req-98de1dc1-5257-4854-a054-f4b79c2b99c8 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d62f4c97-5391-480e-8948-db2957f27022 does not exist", "detail": ""}} {{(pid=119474) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:11:11.810272 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.security_group_api [None req-98de1dc1-5257-4854-a054-f4b79c2b99c8 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Neutron security group d62f4c97-5391-480e-8948-db2957f27022 not found {{(pid=119474) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 31 01:11:11.810787 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-98de1dc1-5257-4854-a054-f4b79c2b99c8 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] HTTP exception thrown: Security group d62f4c97-5391-480e-8948-db2957f27022 does not exist Jul 31 01:11:11.810787 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-60541f92-48e7-4e22-81a3-a6aae9af5e55'] Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-98de1dc1-5257-4854-a054-f4b79c2b99c8 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Request method failure captured: Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-security-groups/d62f4c97-5391-480e-8948-db2957f27022 HTTP/1.1 Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dZ4RROZmvNHgk8nkEPCHEOtKeymvD8aJkYSffUh8bqh37RpmNHALtgJw0W3wgMu6HJwqcBFxL8fLuKg63WTseMOWT3m6KTBzl-wHxPxejmdZtFZxPmexVFKQ3mNYzDtb_uVYFrMpBX3R40pkmpf04xAyZo3K5gfwBnL_o_UQmcBzKE Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a45cfeb1ce9844c5bf16e975af312ba0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: e3e6a158c3884c8db5a66fe80e71527d Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: exception: Security group d62f4c97-5391-480e-8948-db2957f27022 does not exist Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-60541f92-48e7-4e22-81a3-a6aae9af5e55'] Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'd62f4c97-5391-480e-8948-db2957f27022'} Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:11:11.814431 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d62f4c97-5391-480e-8948-db2957f27022 does not exist Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60541f92-48e7-4e22-81a3-a6aae9af5e55'] Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d62f4c97-5391-480e-8948-db2957f27022 does not exist Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60541f92-48e7-4e22-81a3-a6aae9af5e55'] Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d62f4c97-5391-480e-8948-db2957f27022 does not exist Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60541f92-48e7-4e22-81a3-a6aae9af5e55'] Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d62f4c97-5391-480e-8948-db2957f27022 does not exist Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60541f92-48e7-4e22-81a3-a6aae9af5e55'] Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-98de1dc1-5257-4854-a054-f4b79c2b99c8 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Returning 404 to user: Security group d62f4c97-5391-480e-8948-db2957f27022 does not exist Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-60541f92-48e7-4e22-81a3-a6aae9af5e55'] {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-98de1dc1-5257-4854-a054-f4b79c2b99c8 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/d62f4c97-5391-480e-8948-db2957f27022" status: 404 len: 194 microversion: 2.1 time: 0.059027 Jul 31 01:11:11.819032 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 589/1178] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 01:11:11 2022] GET /compute/v2.1/os-security-groups/d62f4c97-5391-480e-8948-db2957f27022 => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:11:11.823950 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6605aa0c-e8c1-49e8-a34c-becca2634eaa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:11.823950 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6605aa0c-e8c1-49e8-a34c-becca2634eaa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:11.831977 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6605aa0c-e8c1-49e8-a34c-becca2634eaa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:11.832444 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6605aa0c-e8c1-49e8-a34c-becca2634eaa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:11.833221 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6605aa0c-e8c1-49e8-a34c-becca2634eaa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:11.833659 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6605aa0c-e8c1-49e8-a34c-becca2634eaa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:11.923058 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d3976503-c74f-4a6f-8d57-87b4dd9f7cf7 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:11.931312 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d3976503-c74f-4a6f-8d57-87b4dd9f7cf7 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1292 microversion: 2.1 time: 0.222080 Jul 31 01:11:11.932090 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 590/1179] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:11 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1292 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:11.938022 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-09ed67ff-e681-4cfc-b9ee-adb5202f2369 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede5c9ba60>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:12.046389 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6605aa0c-e8c1-49e8-a34c-becca2634eaa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:12.059510 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6605aa0c-e8c1-49e8-a34c-becca2634eaa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:12.062454 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6605aa0c-e8c1-49e8-a34c-becca2634eaa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:12.064827 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6605aa0c-e8c1-49e8-a34c-becca2634eaa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.245104 Jul 31 01:11:12.065410 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 590/1180] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:11 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:12.070097 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0dd64ee3-00e1-47e1-b635-5e742d18375e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:12.070695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0dd64ee3-00e1-47e1-b635-5e742d18375e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:12.077212 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0dd64ee3-00e1-47e1-b635-5e742d18375e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:12.077994 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0dd64ee3-00e1-47e1-b635-5e742d18375e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:12.078749 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0dd64ee3-00e1-47e1-b635-5e742d18375e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:12.079377 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0dd64ee3-00e1-47e1-b635-5e742d18375e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:12.254752 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-09ed67ff-e681-4cfc-b9ee-adb5202f2369 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.321332 Jul 31 01:11:12.255677 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 591/1181] 10.222.0.45 () {58 vars in 1158 bytes} [Sun Jul 31 01:11:11 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:12.260840 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-53d1c81f-62a3-4603-81e5-4731f5f3311e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:12.261579 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-53d1c81f-62a3-4603-81e5-4731f5f3311e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:12.271097 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53d1c81f-62a3-4603-81e5-4731f5f3311e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:12.271611 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53d1c81f-62a3-4603-81e5-4731f5f3311e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:12.272412 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53d1c81f-62a3-4603-81e5-4731f5f3311e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:12.272853 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53d1c81f-62a3-4603-81e5-4731f5f3311e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:12.273612 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0dd64ee3-00e1-47e1-b635-5e742d18375e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:12.281411 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0dd64ee3-00e1-47e1-b635-5e742d18375e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 0.214933 Jul 31 01:11:12.282092 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 591/1182] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:12 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:12.293648 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-08c80d78-7ce4-4c46-af38-a759eaf7ad61 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'create', calling method: .version_select at 0x7fede5543790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1295112335", "description": "tempest-description-1696686151"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:12.495462 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-53d1c81f-62a3-4603-81e5-4731f5f3311e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:12.504219 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-53d1c81f-62a3-4603-81e5-4731f5f3311e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.246942 Jul 31 01:11:12.504818 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 592/1183] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:12 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:12.509340 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0da8dfe4-b118-403c-8ed3-932fe89653a4 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:12.510014 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0da8dfe4-b118-403c-8ed3-932fe89653a4 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:12.522569 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0da8dfe4-b118-403c-8ed3-932fe89653a4 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:12.523028 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0da8dfe4-b118-403c-8ed3-932fe89653a4 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:12.524027 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0da8dfe4-b118-403c-8ed3-932fe89653a4 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:12.524475 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0da8dfe4-b118-403c-8ed3-932fe89653a4 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:12.573409 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-08c80d78-7ce4-4c46-af38-a759eaf7ad61 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.287098 Jul 31 01:11:12.574394 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 592/1184] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:11:12 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:12.587719 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-19bae54a-18f3-4ef7-b928-8ab66e7f77a7 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'create', calling method: .version_select at 0x7fede5533790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1537973729", "description": "tempest-description-333909502"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:12.754670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0da8dfe4-b118-403c-8ed3-932fe89653a4 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:12.758449 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:12.763183 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0da8dfe4-b118-403c-8ed3-932fe89653a4 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1355 microversion: 2.1 time: 0.257335 Jul 31 01:11:12.764009 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 593/1185] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:12 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1355 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:12.769420 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ba8ab913-03a1-4466-a9e1-a3550d7253bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:12.771617 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ba8ab913-03a1-4466-a9e1-a3550d7253bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:12.778676 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ba8ab913-03a1-4466-a9e1-a3550d7253bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:12.779134 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ba8ab913-03a1-4466-a9e1-a3550d7253bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:12.780088 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ba8ab913-03a1-4466-a9e1-a3550d7253bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:12.781149 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ba8ab913-03a1-4466-a9e1-a3550d7253bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:12.892111 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-19bae54a-18f3-4ef7-b928-8ab66e7f77a7 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.308943 Jul 31 01:11:12.903388 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 593/1186] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:11:12 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:11:12.903388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ff65511f-8872-485a-9e35-25021f69f820 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:12.903388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ff65511f-8872-485a-9e35-25021f69f820 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:12.909537 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff65511f-8872-485a-9e35-25021f69f820 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:12.909537 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff65511f-8872-485a-9e35-25021f69f820 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:12.910044 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff65511f-8872-485a-9e35-25021f69f820 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:12.910564 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff65511f-8872-485a-9e35-25021f69f820 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:13.000489 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ba8ab913-03a1-4466-a9e1-a3550d7253bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:13.008901 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ba8ab913-03a1-4466-a9e1-a3550d7253bd tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1472 microversion: 2.1 time: 0.243989 Jul 31 01:11:13.009554 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 594/1187] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:12 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:13.015431 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-006bda4e-213c-420f-a9c5-9a154cd6abfc tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:13.017013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-006bda4e-213c-420f-a9c5-9a154cd6abfc tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:13.024125 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-006bda4e-213c-420f-a9c5-9a154cd6abfc tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:13.024769 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-006bda4e-213c-420f-a9c5-9a154cd6abfc tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:13.025647 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-006bda4e-213c-420f-a9c5-9a154cd6abfc tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:13.026194 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-006bda4e-213c-420f-a9c5-9a154cd6abfc tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:13.177653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ff65511f-8872-485a-9e35-25021f69f820 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:13.185969 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ff65511f-8872-485a-9e35-25021f69f820 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 200 len: 1307 microversion: 2.1 time: 0.291757 Jul 31 01:11:13.187029 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 594/1188] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:12 2022] GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 1307 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:13.192649 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9f48dccf-0f35-4815-bf84-d1f874c451fa tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-413502423", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "8a88c042-780b-4f0a-8083-c923e331d642"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:13.207362 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-006bda4e-213c-420f-a9c5-9a154cd6abfc tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:13.216080 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-006bda4e-213c-420f-a9c5-9a154cd6abfc tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1292 microversion: 2.1 time: 0.204613 Jul 31 01:11:13.216502 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 595/1189] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:13 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1292 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:13.221561 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-06490064-b1be-4456-b310-605fc22de21f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:13.222372 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-06490064-b1be-4456-b310-605fc22de21f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:13.228841 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06490064-b1be-4456-b310-605fc22de21f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:13.229300 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06490064-b1be-4456-b310-605fc22de21f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:13.230096 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06490064-b1be-4456-b310-605fc22de21f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:13.230542 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06490064-b1be-4456-b310-605fc22de21f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:13.269377 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-9f48dccf-0f35-4815-bf84-d1f874c451fa tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] validate_networks() for [('8a88c042-780b-4f0a-8083-c923e331d642', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:11:13.456002 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-06490064-b1be-4456-b310-605fc22de21f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:13.465214 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-06490064-b1be-4456-b310-605fc22de21f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:13.466834 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-06490064-b1be-4456-b310-605fc22de21f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:13.468401 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-06490064-b1be-4456-b310-605fc22de21f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.250951 Jul 31 01:11:13.469061 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 596/1190] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:13 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:13.473727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-42832ef4-9e5a-46c2-907f-0777e52e6d0b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:13.474447 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-42832ef4-9e5a-46c2-907f-0777e52e6d0b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:13.480632 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42832ef4-9e5a-46c2-907f-0777e52e6d0b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:13.481094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42832ef4-9e5a-46c2-907f-0777e52e6d0b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:13.481893 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42832ef4-9e5a-46c2-907f-0777e52e6d0b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:13.482479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42832ef4-9e5a-46c2-907f-0777e52e6d0b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:13.794447 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-42832ef4-9e5a-46c2-907f-0777e52e6d0b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:13.803575 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-42832ef4-9e5a-46c2-907f-0777e52e6d0b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 0.333352 Jul 31 01:11:13.804977 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 597/1191] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:13 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:13.813035 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1d0af71d-8773-46b2-8d34-81c09d5a1b25 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:13.814578 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1d0af71d-8773-46b2-8d34-81c09d5a1b25 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:13.822730 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d0af71d-8773-46b2-8d34-81c09d5a1b25 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:13.823164 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d0af71d-8773-46b2-8d34-81c09d5a1b25 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:13.824358 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d0af71d-8773-46b2-8d34-81c09d5a1b25 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:13.824481 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d0af71d-8773-46b2-8d34-81c09d5a1b25 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:13.870085 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-9f48dccf-0f35-4815-bf84-d1f874c451fa tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:11:13.870581 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-9f48dccf-0f35-4815-bf84-d1f874c451fa tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:11:13.870927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-9f48dccf-0f35-4815-bf84-d1f874c451fa tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:11:13.871332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-9f48dccf-0f35-4815-bf84-d1f874c451fa tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:11:13.871760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-9f48dccf-0f35-4815-bf84-d1f874c451fa tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:11:13.881856 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f48dccf-0f35-4815-bf84-d1f874c451fa tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:13.882312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f48dccf-0f35-4815-bf84-d1f874c451fa tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:13.883122 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f48dccf-0f35-4815-bf84-d1f874c451fa tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:13.883593 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f48dccf-0f35-4815-bf84-d1f874c451fa tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:13.901369 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9f48dccf-0f35-4815-bf84-d1f874c451fa tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Getting quotas for project a45cfeb1ce9844c5bf16e975af312ba0. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:11:13.907809 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9f48dccf-0f35-4815-bf84-d1f874c451fa tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Getting quotas for user e3e6a158c3884c8db5a66fe80e71527d and project a45cfeb1ce9844c5bf16e975af312ba0. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:11:13.926218 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9f48dccf-0f35-4815-bf84-d1f874c451fa tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:11:13.928970 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9f48dccf-0f35-4815-bf84-d1f874c451fa tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:11:13.974294 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1d0af71d-8773-46b2-8d34-81c09d5a1b25 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:13.982825 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1d0af71d-8773-46b2-8d34-81c09d5a1b25 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.176589 Jul 31 01:11:13.986885 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 598/1192] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:13 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:13.989142 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9f48dccf-0f35-4815-bf84-d1f874c451fa tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800910 Jul 31 01:11:13.999227 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 595/1193] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:11:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:11:13.999227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e70bf5d5-bdb7-4d4b-8d0f-551c68cda2a4 req-ab6f60ae-5862-4c8a-a147-d7ecf363344c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f16639-427f-42f0-abe2-19c1106f59e3", "name": "network-vif-plugged", "status": "completed", "tag": "6b987620-a1fd-4b4e-b5c2-5ca6e5557ebf"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:13.999938 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-800e53dd-31fa-455a-a776-5de28eb17c4a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:14.000268 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-800e53dd-31fa-455a-a776-5de28eb17c4a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:14.006878 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-800e53dd-31fa-455a-a776-5de28eb17c4a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.007564 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-800e53dd-31fa-455a-a776-5de28eb17c4a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:14.008590 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-800e53dd-31fa-455a-a776-5de28eb17c4a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.009140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-800e53dd-31fa-455a-a776-5de28eb17c4a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:14.020709 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e70bf5d5-bdb7-4d4b-8d0f-551c68cda2a4 req-ab6f60ae-5862-4c8a-a147-d7ecf363344c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.021154 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e70bf5d5-bdb7-4d4b-8d0f-551c68cda2a4 req-ab6f60ae-5862-4c8a-a147-d7ecf363344c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:14.038379 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e70bf5d5-bdb7-4d4b-8d0f-551c68cda2a4 req-ab6f60ae-5862-4c8a-a147-d7ecf363344c service nova] Creating event network-vif-plugged:6b987620-a1fd-4b4e-b5c2-5ca6e5557ebf for instance 59f16639-427f-42f0-abe2-19c1106f59e3 on n-h1-master-1 Jul 31 01:11:14.050253 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e70bf5d5-bdb7-4d4b-8d0f-551c68cda2a4 req-ab6f60ae-5862-4c8a-a147-d7ecf363344c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055075 Jul 31 01:11:14.060852 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 596/1194] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:14.060852 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0c524998-eda2-4db4-95ca-800c57d3876e tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:14.060852 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0c524998-eda2-4db4-95ca-800c57d3876e tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:14.173125 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0c524998-eda2-4db4-95ca-800c57d3876e tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:14.189145 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0c524998-eda2-4db4-95ca-800c57d3876e tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1215 microversion: 2.1 time: 0.133461 Jul 31 01:11:14.200072 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 597/1195] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:14 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1215 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:14.211134 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-edb24946-0559-4b5f-b819-b06d08d7f2ec tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:14.212109 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-edb24946-0559-4b5f-b819-b06d08d7f2ec tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:14.221079 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-edb24946-0559-4b5f-b819-b06d08d7f2ec tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.221869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-edb24946-0559-4b5f-b819-b06d08d7f2ec tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:14.222865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-edb24946-0559-4b5f-b819-b06d08d7f2ec tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.223654 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-edb24946-0559-4b5f-b819-b06d08d7f2ec tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:14.343430 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-800e53dd-31fa-455a-a776-5de28eb17c4a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:14.357989 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-800e53dd-31fa-455a-a776-5de28eb17c4a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1804 microversion: 2.1 time: 0.368013 Jul 31 01:11:14.358850 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 599/1196] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:13 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1804 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:14.363317 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2b050841-b8d5-44be-acfd-13e31977fe42 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:14.364267 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2b050841-b8d5-44be-acfd-13e31977fe42 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:14.371414 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b050841-b8d5-44be-acfd-13e31977fe42 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.372300 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b050841-b8d5-44be-acfd-13e31977fe42 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:14.373300 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b050841-b8d5-44be-acfd-13e31977fe42 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.373731 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b050841-b8d5-44be-acfd-13e31977fe42 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:14.551215 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-edb24946-0559-4b5f-b819-b06d08d7f2ec tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:14.559818 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-edb24946-0559-4b5f-b819-b06d08d7f2ec tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1472 microversion: 2.1 time: 0.358220 Jul 31 01:11:14.561659 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 598/1197] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:14 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1472 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:14.581264 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-513fc86a-3cab-48ce-bcb9-bacd64738d44 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:14.582198 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-513fc86a-3cab-48ce-bcb9-bacd64738d44 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:14.584189 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2b050841-b8d5-44be-acfd-13e31977fe42 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:14.590124 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-513fc86a-3cab-48ce-bcb9-bacd64738d44 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.590599 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-513fc86a-3cab-48ce-bcb9-bacd64738d44 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:14.591428 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-513fc86a-3cab-48ce-bcb9-bacd64738d44 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.591786 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2b050841-b8d5-44be-acfd-13e31977fe42 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 200 len: 1307 microversion: 2.1 time: 0.232077 Jul 31 01:11:14.591900 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-513fc86a-3cab-48ce-bcb9-bacd64738d44 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:14.592375 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 600/1198] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:14 2022] GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 1307 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:14.598134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2054f152-4e76-4c87-b75d-c53b36ec2c47 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:14.598635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2054f152-4e76-4c87-b75d-c53b36ec2c47 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:14.605060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2054f152-4e76-4c87-b75d-c53b36ec2c47 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.605797 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2054f152-4e76-4c87-b75d-c53b36ec2c47 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:14.606814 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2054f152-4e76-4c87-b75d-c53b36ec2c47 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.607404 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2054f152-4e76-4c87-b75d-c53b36ec2c47 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:14.635357 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2054f152-4e76-4c87-b75d-c53b36ec2c47 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088/ips" status: 200 len: 217 microversion: 2.1 time: 0.040774 Jul 31 01:11:14.643045 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 601/1199] 10.222.0.45 () {58 vars in 1248 bytes} [Sun Jul 31 01:11:14 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088/ips => generated 217 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:14.646889 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-915694e1-300a-45a6-bc90-6cfb407f8640 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:14.647583 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-915694e1-300a-45a6-bc90-6cfb407f8640 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:14.654120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-915694e1-300a-45a6-bc90-6cfb407f8640 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.654581 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-915694e1-300a-45a6-bc90-6cfb407f8640 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:14.655533 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-915694e1-300a-45a6-bc90-6cfb407f8640 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.656020 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-915694e1-300a-45a6-bc90-6cfb407f8640 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:14.742276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-513fc86a-3cab-48ce-bcb9-bacd64738d44 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:14.751868 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-513fc86a-3cab-48ce-bcb9-bacd64738d44 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1292 microversion: 2.1 time: 0.188783 Jul 31 01:11:14.752475 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 599/1200] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:14 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1292 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:14.757310 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5b9862fe-6dfb-4129-9254-88d57e21d63c tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:14.757821 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5b9862fe-6dfb-4129-9254-88d57e21d63c tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:14.770340 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b9862fe-6dfb-4129-9254-88d57e21d63c tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.770898 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b9862fe-6dfb-4129-9254-88d57e21d63c tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:14.771967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b9862fe-6dfb-4129-9254-88d57e21d63c tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.772416 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b9862fe-6dfb-4129-9254-88d57e21d63c tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:14.808104 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5b9862fe-6dfb-4129-9254-88d57e21d63c tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:11:14.894505 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5b9862fe-6dfb-4129-9254-88d57e21d63c tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 204 len: 0 microversion: 2.1 time: 0.140761 Jul 31 01:11:14.895206 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 600/1201] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:11:14 2022] DELETE /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:11:14.900224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fce1c0e7-a203-4d4d-9dd4-667c5a675672 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:14.900927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fce1c0e7-a203-4d4d-9dd4-667c5a675672 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:14.907502 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fce1c0e7-a203-4d4d-9dd4-667c5a675672 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.907955 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fce1c0e7-a203-4d4d-9dd4-667c5a675672 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:14.908728 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fce1c0e7-a203-4d4d-9dd4-667c5a675672 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:14.909163 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fce1c0e7-a203-4d4d-9dd4-667c5a675672 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:15.052109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-915694e1-300a-45a6-bc90-6cfb407f8640 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:15.060569 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-915694e1-300a-45a6-bc90-6cfb407f8640 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:15.062039 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-915694e1-300a-45a6-bc90-6cfb407f8640 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:15.063251 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-915694e1-300a-45a6-bc90-6cfb407f8640 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.426046 Jul 31 01:11:15.063854 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 602/1202] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:14 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:15.068716 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5686cdfb-1e65-4b3f-9caa-4f57385df279 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:15.069336 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5686cdfb-1e65-4b3f-9caa-4f57385df279 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:15.075329 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5686cdfb-1e65-4b3f-9caa-4f57385df279 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:15.075828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5686cdfb-1e65-4b3f-9caa-4f57385df279 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:15.076613 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5686cdfb-1e65-4b3f-9caa-4f57385df279 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:15.077562 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5686cdfb-1e65-4b3f-9caa-4f57385df279 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:15.080028 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fce1c0e7-a203-4d4d-9dd4-667c5a675672 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:15.087666 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fce1c0e7-a203-4d4d-9dd4-667c5a675672 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 0.191275 Jul 31 01:11:15.088327 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 601/1203] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:14 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:15.093793 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ecc6201c-9de5-407b-895d-018fc97b063e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:15.094661 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ecc6201c-9de5-407b-895d-018fc97b063e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:15.101826 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecc6201c-9de5-407b-895d-018fc97b063e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:15.102282 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecc6201c-9de5-407b-895d-018fc97b063e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:15.103056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecc6201c-9de5-407b-895d-018fc97b063e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:15.103655 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecc6201c-9de5-407b-895d-018fc97b063e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:15.302599 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5686cdfb-1e65-4b3f-9caa-4f57385df279 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:15.310098 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ecc6201c-9de5-407b-895d-018fc97b063e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:15.315857 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5686cdfb-1e65-4b3f-9caa-4f57385df279 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1810 microversion: 2.1 time: 0.249911 Jul 31 01:11:15.316654 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 603/1204] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:15 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1810 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:15.322160 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-09f5c200-66fb-4046-924e-d12b81831953 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:15.323022 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-09f5c200-66fb-4046-924e-d12b81831953 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:15.330688 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ecc6201c-9de5-407b-895d-018fc97b063e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.241031 Jul 31 01:11:15.331252 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 602/1205] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:15 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:15.331633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09f5c200-66fb-4046-924e-d12b81831953 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:15.332013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09f5c200-66fb-4046-924e-d12b81831953 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:15.333136 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09f5c200-66fb-4046-924e-d12b81831953 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:15.333974 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09f5c200-66fb-4046-924e-d12b81831953 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:15.418457 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-09f5c200-66fb-4046-924e-d12b81831953 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:15.425934 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-09f5c200-66fb-4046-924e-d12b81831953 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1211 microversion: 2.1 time: 0.108129 Jul 31 01:11:15.426490 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 604/1206] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:15 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:15.582173 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-151ccec2-b9ec-4bc7-bc14-fa65f9a42fae tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:15.582785 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-151ccec2-b9ec-4bc7-bc14-fa65f9a42fae tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:15.589591 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-151ccec2-b9ec-4bc7-bc14-fa65f9a42fae tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:15.590356 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-151ccec2-b9ec-4bc7-bc14-fa65f9a42fae tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:15.590793 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-151ccec2-b9ec-4bc7-bc14-fa65f9a42fae tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:15.591223 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-151ccec2-b9ec-4bc7-bc14-fa65f9a42fae tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:15.613177 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f0ef6266-ab00-4886-ada5-03d5cfa74687 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:15.614107 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f0ef6266-ab00-4886-ada5-03d5cfa74687 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:15.620508 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0ef6266-ab00-4886-ada5-03d5cfa74687 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:15.620968 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0ef6266-ab00-4886-ada5-03d5cfa74687 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:15.621763 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0ef6266-ab00-4886-ada5-03d5cfa74687 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:15.622215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0ef6266-ab00-4886-ada5-03d5cfa74687 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:15.795518 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-151ccec2-b9ec-4bc7-bc14-fa65f9a42fae tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:15.803414 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-151ccec2-b9ec-4bc7-bc14-fa65f9a42fae tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1472 microversion: 2.1 time: 0.225798 Jul 31 01:11:15.803990 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 603/1207] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:15 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1472 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:15.808555 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e6f45fb9-1135-4cfc-ac54-bdc164649da2 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:15.809164 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e6f45fb9-1135-4cfc-ac54-bdc164649da2 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:15.812934 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f0ef6266-ab00-4886-ada5-03d5cfa74687 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:15.818796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6f45fb9-1135-4cfc-ac54-bdc164649da2 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:15.819403 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6f45fb9-1135-4cfc-ac54-bdc164649da2 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:15.820277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6f45fb9-1135-4cfc-ac54-bdc164649da2 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:15.820618 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f0ef6266-ab00-4886-ada5-03d5cfa74687 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 200 len: 1307 microversion: 2.1 time: 0.211270 Jul 31 01:11:15.820728 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6f45fb9-1135-4cfc-ac54-bdc164649da2 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:15.821196 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 605/1208] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:15 2022] GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 1307 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:11:15.965669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e6f45fb9-1135-4cfc-ac54-bdc164649da2 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:15.974106 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e6f45fb9-1135-4cfc-ac54-bdc164649da2 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1292 microversion: 2.1 time: 0.169154 Jul 31 01:11:15.974672 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 604/1209] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:15 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1292 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:16.075965 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-6d5cb17d-1efa-48ff-80b6-326c8b4c3e4b req-baa32851-15e7-45c2-9c10-f25b3700f346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451cf12b-e061-4c6c-8b43-40cee9ddcc1c", "name": "network-vif-plugged", "status": "completed", "tag": "e424fe72-c4fb-4577-bbaa-a66dd860365f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:16.086877 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6d5cb17d-1efa-48ff-80b6-326c8b4c3e4b req-baa32851-15e7-45c2-9c10-f25b3700f346 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:16.087093 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6e50c819-4c59-4bc2-8aac-3c881bf055eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:16.087358 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6d5cb17d-1efa-48ff-80b6-326c8b4c3e4b req-baa32851-15e7-45c2-9c10-f25b3700f346 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:16.087719 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6e50c819-4c59-4bc2-8aac-3c881bf055eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:16.094665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e50c819-4c59-4bc2-8aac-3c881bf055eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:16.095116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e50c819-4c59-4bc2-8aac-3c881bf055eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:16.096050 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e50c819-4c59-4bc2-8aac-3c881bf055eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:16.096367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e50c819-4c59-4bc2-8aac-3c881bf055eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:16.099280 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-6d5cb17d-1efa-48ff-80b6-326c8b4c3e4b req-baa32851-15e7-45c2-9c10-f25b3700f346 service nova] Creating event network-vif-plugged:e424fe72-c4fb-4577-bbaa-a66dd860365f for instance 451cf12b-e061-4c6c-8b43-40cee9ddcc1c on n-h1-master-1 Jul 31 01:11:16.104505 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-6d5cb17d-1efa-48ff-80b6-326c8b4c3e4b req-baa32851-15e7-45c2-9c10-f25b3700f346 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032230 Jul 31 01:11:16.105108 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 606/1210] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:16.110241 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3c8d5df6-22d4-45ff-98e0-5af12c0d54e6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:16.110939 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3c8d5df6-22d4-45ff-98e0-5af12c0d54e6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:16.117278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c8d5df6-22d4-45ff-98e0-5af12c0d54e6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:16.117810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c8d5df6-22d4-45ff-98e0-5af12c0d54e6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:16.118621 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c8d5df6-22d4-45ff-98e0-5af12c0d54e6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:16.119065 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c8d5df6-22d4-45ff-98e0-5af12c0d54e6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:16.298679 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6e50c819-4c59-4bc2-8aac-3c881bf055eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:16.305820 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3c8d5df6-22d4-45ff-98e0-5af12c0d54e6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:16.307612 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6e50c819-4c59-4bc2-8aac-3c881bf055eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:16.309198 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6e50c819-4c59-4bc2-8aac-3c881bf055eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:16.310380 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6e50c819-4c59-4bc2-8aac-3c881bf055eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.227113 Jul 31 01:11:16.310936 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 605/1211] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:16 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:11:16.314540 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3c8d5df6-22d4-45ff-98e0-5af12c0d54e6 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 0.208143 Jul 31 01:11:16.315199 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 607/1212] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:16 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:16.337882 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6cd93be6-7834-451b-a290-428982f60791 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:16.338428 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6cd93be6-7834-451b-a290-428982f60791 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:16.344809 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6cd93be6-7834-451b-a290-428982f60791 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:16.345260 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6cd93be6-7834-451b-a290-428982f60791 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:16.346025 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6cd93be6-7834-451b-a290-428982f60791 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:16.346502 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6cd93be6-7834-451b-a290-428982f60791 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:16.352711 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c1b8c1de-5c8b-4c7a-b38d-3568b632be05 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:16.353445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c1b8c1de-5c8b-4c7a-b38d-3568b632be05 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:16.359488 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1b8c1de-5c8b-4c7a-b38d-3568b632be05 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:16.360021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1b8c1de-5c8b-4c7a-b38d-3568b632be05 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:16.360876 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1b8c1de-5c8b-4c7a-b38d-3568b632be05 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:16.361400 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1b8c1de-5c8b-4c7a-b38d-3568b632be05 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:16.554869 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6cd93be6-7834-451b-a290-428982f60791 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:16.558617 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:16.565233 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6cd93be6-7834-451b-a290-428982f60791 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1810 microversion: 2.1 time: 0.231122 Jul 31 01:11:16.566284 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 606/1213] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:16 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1810 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:16.571148 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4bbab2f9-4c1e-409e-99fe-f6b56c762047 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:16.571421 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c1b8c1de-5c8b-4c7a-b38d-3568b632be05 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:16.572015 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4bbab2f9-4c1e-409e-99fe-f6b56c762047 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:16.578882 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4bbab2f9-4c1e-409e-99fe-f6b56c762047 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:16.579367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4bbab2f9-4c1e-409e-99fe-f6b56c762047 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:16.580148 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4bbab2f9-4c1e-409e-99fe-f6b56c762047 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:16.580768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4bbab2f9-4c1e-409e-99fe-f6b56c762047 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:16.580891 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c1b8c1de-5c8b-4c7a-b38d-3568b632be05 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.231723 Jul 31 01:11:16.581235 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 608/1214] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:16 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:11:16.644506 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4bbab2f9-4c1e-409e-99fe-f6b56c762047 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:16.651852 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4bbab2f9-4c1e-409e-99fe-f6b56c762047 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1267 microversion: 2.1 time: 0.084497 Jul 31 01:11:16.652416 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 607/1215] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:16 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:16.825206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-25ee3933-fa8b-4e26-b84b-a4cc834f6e32 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:16.825826 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-25ee3933-fa8b-4e26-b84b-a4cc834f6e32 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:16.831966 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25ee3933-fa8b-4e26-b84b-a4cc834f6e32 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:16.832425 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25ee3933-fa8b-4e26-b84b-a4cc834f6e32 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:16.833304 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25ee3933-fa8b-4e26-b84b-a4cc834f6e32 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:16.833735 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25ee3933-fa8b-4e26-b84b-a4cc834f6e32 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:16.840836 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-616b6c98-a070-4cf1-8a69-cfd631bd64b0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:16.841446 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-616b6c98-a070-4cf1-8a69-cfd631bd64b0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:16.848496 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-616b6c98-a070-4cf1-8a69-cfd631bd64b0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:16.848938 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-616b6c98-a070-4cf1-8a69-cfd631bd64b0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:16.849706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-616b6c98-a070-4cf1-8a69-cfd631bd64b0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:16.850129 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-616b6c98-a070-4cf1-8a69-cfd631bd64b0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:17.041876 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-25ee3933-fa8b-4e26-b84b-a4cc834f6e32 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:17.049577 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-25ee3933-fa8b-4e26-b84b-a4cc834f6e32 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1472 microversion: 2.1 time: 0.228173 Jul 31 01:11:17.050528 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 609/1216] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:16 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:17.055784 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4b49251d-3f94-400a-a50c-c23d74a26bf2 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:17.056504 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4b49251d-3f94-400a-a50c-c23d74a26bf2 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:17.056693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-616b6c98-a070-4cf1-8a69-cfd631bd64b0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:17.062967 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b49251d-3f94-400a-a50c-c23d74a26bf2 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:17.063543 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b49251d-3f94-400a-a50c-c23d74a26bf2 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:17.064335 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b49251d-3f94-400a-a50c-c23d74a26bf2 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:17.064455 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-616b6c98-a070-4cf1-8a69-cfd631bd64b0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 200 len: 1307 microversion: 2.1 time: 0.227424 Jul 31 01:11:17.064786 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b49251d-3f94-400a-a50c-c23d74a26bf2 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:17.065039 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 608/1217] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:16 2022] GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 1307 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:11:17.204776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4b49251d-3f94-400a-a50c-c23d74a26bf2 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:17.212564 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4b49251d-3f94-400a-a50c-c23d74a26bf2 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1292 microversion: 2.1 time: 0.161091 Jul 31 01:11:17.213381 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 610/1218] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:17 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1292 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:17.334396 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-15deefc9-63a3-4d19-a062-60ec2910a786 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:17.335131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-792e3275-d364-4409-8d29-9e6e7982ed6d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:17.335280 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-15deefc9-63a3-4d19-a062-60ec2910a786 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:17.335790 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-792e3275-d364-4409-8d29-9e6e7982ed6d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:17.341929 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15deefc9-63a3-4d19-a062-60ec2910a786 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:17.342118 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-792e3275-d364-4409-8d29-9e6e7982ed6d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:17.342396 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-792e3275-d364-4409-8d29-9e6e7982ed6d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:17.344256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15deefc9-63a3-4d19-a062-60ec2910a786 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:17.344395 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-792e3275-d364-4409-8d29-9e6e7982ed6d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:17.344771 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-792e3275-d364-4409-8d29-9e6e7982ed6d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:17.344997 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15deefc9-63a3-4d19-a062-60ec2910a786 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:17.345571 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15deefc9-63a3-4d19-a062-60ec2910a786 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:17.363059 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:17.543051 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-15deefc9-63a3-4d19-a062-60ec2910a786 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:17.547197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-792e3275-d364-4409-8d29-9e6e7982ed6d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:17.551629 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-15deefc9-63a3-4d19-a062-60ec2910a786 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:17.553237 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-15deefc9-63a3-4d19-a062-60ec2910a786 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:17.554345 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-15deefc9-63a3-4d19-a062-60ec2910a786 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.224013 Jul 31 01:11:17.555094 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 609/1219] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:17 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:17.557329 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-792e3275-d364-4409-8d29-9e6e7982ed6d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 0.224471 Jul 31 01:11:17.559249 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 611/1220] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:17 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:11:17.587997 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8af7cf38-65e6-4e07-85d9-7d1e3d1dce26 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:17.588672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8af7cf38-65e6-4e07-85d9-7d1e3d1dce26 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:17.597261 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8af7cf38-65e6-4e07-85d9-7d1e3d1dce26 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:17.597722 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8af7cf38-65e6-4e07-85d9-7d1e3d1dce26 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:17.598513 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8af7cf38-65e6-4e07-85d9-7d1e3d1dce26 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:17.598951 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8af7cf38-65e6-4e07-85d9-7d1e3d1dce26 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:17.605143 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3dcf3a6-ee89-45af-9766-68394bf02116 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:17.615952 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3dcf3a6-ee89-45af-9766-68394bf02116 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:17.623632 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3dcf3a6-ee89-45af-9766-68394bf02116 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:17.624612 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3dcf3a6-ee89-45af-9766-68394bf02116 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:17.625505 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3dcf3a6-ee89-45af-9766-68394bf02116 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:17.625963 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3dcf3a6-ee89-45af-9766-68394bf02116 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:18.351955 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8af7cf38-65e6-4e07-85d9-7d1e3d1dce26 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:18.362555 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8af7cf38-65e6-4e07-85d9-7d1e3d1dce26 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1810 microversion: 2.1 time: 0.778322 Jul 31 01:11:18.363142 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 610/1221] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:17 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1810 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:18.368055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-beaf5017-2a08-4bf1-a3ce-2ed98643e1a1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:18.368881 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-beaf5017-2a08-4bf1-a3ce-2ed98643e1a1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:18.375275 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-beaf5017-2a08-4bf1-a3ce-2ed98643e1a1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:18.376001 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-beaf5017-2a08-4bf1-a3ce-2ed98643e1a1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:18.376944 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-beaf5017-2a08-4bf1-a3ce-2ed98643e1a1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:18.377643 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-beaf5017-2a08-4bf1-a3ce-2ed98643e1a1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:18.385678 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3dcf3a6-ee89-45af-9766-68394bf02116 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:18.395198 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3dcf3a6-ee89-45af-9766-68394bf02116 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.796553 Jul 31 01:11:18.396143 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 612/1222] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:17 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:11:18.402027 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d13176b7-220d-4688-962e-775f1905dfd1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:18.402866 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d13176b7-220d-4688-962e-775f1905dfd1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:18.413177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d13176b7-220d-4688-962e-775f1905dfd1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:18.413875 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d13176b7-220d-4688-962e-775f1905dfd1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:18.414931 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d13176b7-220d-4688-962e-775f1905dfd1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:18.415781 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d13176b7-220d-4688-962e-775f1905dfd1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:18.757615 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-beaf5017-2a08-4bf1-a3ce-2ed98643e1a1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:18.771486 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-beaf5017-2a08-4bf1-a3ce-2ed98643e1a1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1315 microversion: 2.1 time: 0.406715 Jul 31 01:11:18.772297 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 611/1223] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:18 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:18.783963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fceb7b81-1698-4204-98a6-4fb8b056224b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:18.788125 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fceb7b81-1698-4204-98a6-4fb8b056224b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:18.796352 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fceb7b81-1698-4204-98a6-4fb8b056224b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:18.797148 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fceb7b81-1698-4204-98a6-4fb8b056224b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:18.798995 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fceb7b81-1698-4204-98a6-4fb8b056224b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:18.800369 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fceb7b81-1698-4204-98a6-4fb8b056224b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:18.818491 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d13176b7-220d-4688-962e-775f1905dfd1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:18.842900 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d13176b7-220d-4688-962e-775f1905dfd1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1472 microversion: 2.1 time: 0.445081 Jul 31 01:11:18.848025 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 613/1224] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:18 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1472 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:18.863458 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-07a1e83b-a900-4e72-b375-23e701a02930 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:18.865174 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-07a1e83b-a900-4e72-b375-23e701a02930 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:18.875889 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07a1e83b-a900-4e72-b375-23e701a02930 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:18.877261 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07a1e83b-a900-4e72-b375-23e701a02930 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:18.878304 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07a1e83b-a900-4e72-b375-23e701a02930 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:18.880913 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07a1e83b-a900-4e72-b375-23e701a02930 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:19.082779 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fceb7b81-1698-4204-98a6-4fb8b056224b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:19.091915 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fceb7b81-1698-4204-98a6-4fb8b056224b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 200 len: 1487 microversion: 2.1 time: 0.318329 Jul 31 01:11:19.103559 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 612/1225] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:18 2022] GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 1487 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:19.103559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2cabdda1-2738-461b-ab6f-30cc23a86f84 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:19.103559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2cabdda1-2738-461b-ab6f-30cc23a86f84 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:19.107236 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cabdda1-2738-461b-ab6f-30cc23a86f84 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:19.108043 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cabdda1-2738-461b-ab6f-30cc23a86f84 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:19.109057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cabdda1-2738-461b-ab6f-30cc23a86f84 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:19.109511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cabdda1-2738-461b-ab6f-30cc23a86f84 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:19.215546 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-07a1e83b-a900-4e72-b375-23e701a02930 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:19.224803 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-07a1e83b-a900-4e72-b375-23e701a02930 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1292 microversion: 2.1 time: 0.373346 Jul 31 01:11:19.225895 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 614/1226] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:18 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1292 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:19.231145 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b4f50abf-33bc-4bcc-9a52-93e2f5daeb0e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:19.231831 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b4f50abf-33bc-4bcc-9a52-93e2f5daeb0e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:19.239846 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4f50abf-33bc-4bcc-9a52-93e2f5daeb0e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:19.240409 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4f50abf-33bc-4bcc-9a52-93e2f5daeb0e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:19.241320 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4f50abf-33bc-4bcc-9a52-93e2f5daeb0e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:19.242285 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4f50abf-33bc-4bcc-9a52-93e2f5daeb0e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:19.527814 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2cabdda1-2738-461b-ab6f-30cc23a86f84 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:19.541144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2cabdda1-2738-461b-ab6f-30cc23a86f84 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:19.544267 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2cabdda1-2738-461b-ab6f-30cc23a86f84 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:19.546504 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2cabdda1-2738-461b-ab6f-30cc23a86f84 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.451480 Jul 31 01:11:19.547405 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 613/1227] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:19 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:19.580230 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3f7aa5df-527a-414c-9069-530b06458d7d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:19.581069 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3f7aa5df-527a-414c-9069-530b06458d7d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:19.589517 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f7aa5df-527a-414c-9069-530b06458d7d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:19.590272 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f7aa5df-527a-414c-9069-530b06458d7d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:19.591423 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f7aa5df-527a-414c-9069-530b06458d7d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:19.592092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f7aa5df-527a-414c-9069-530b06458d7d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:19.607850 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b4f50abf-33bc-4bcc-9a52-93e2f5daeb0e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:19.618787 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b4f50abf-33bc-4bcc-9a52-93e2f5daeb0e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 0.391769 Jul 31 01:11:19.619428 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 615/1228] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:19 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:19.625908 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-16e3bf64-0cc6-4233-aa50-3beb30f1024e req-86d1226f-19c3-45b0-baac-e5694693a417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8660466c-0119-4cc7-8da1-e48e22f2c088", "name": "network-vif-deleted", "tag": "fd2629bf-3368-49d5-bbc6-a5f5dfff4006"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:19.641334 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-16e3bf64-0cc6-4233-aa50-3beb30f1024e req-86d1226f-19c3-45b0-baac-e5694693a417 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:19.642153 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-16e3bf64-0cc6-4233-aa50-3beb30f1024e req-86d1226f-19c3-45b0-baac-e5694693a417 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:19.658715 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-16e3bf64-0cc6-4233-aa50-3beb30f1024e req-86d1226f-19c3-45b0-baac-e5694693a417 service nova] Creating event network-vif-deleted:fd2629bf-3368-49d5-bbc6-a5f5dfff4006 for instance 8660466c-0119-4cc7-8da1-e48e22f2c088 on n-h1-master-1 Jul 31 01:11:19.666218 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-16e3bf64-0cc6-4233-aa50-3beb30f1024e req-86d1226f-19c3-45b0-baac-e5694693a417 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045005 Jul 31 01:11:19.668640 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 616/1229] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:19.676630 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bad0d00c-c1f9-4216-babe-6c90d969084a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:19.677430 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bad0d00c-c1f9-4216-babe-6c90d969084a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:19.686996 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bad0d00c-c1f9-4216-babe-6c90d969084a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:19.691029 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bad0d00c-c1f9-4216-babe-6c90d969084a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:19.692463 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bad0d00c-c1f9-4216-babe-6c90d969084a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:19.695408 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bad0d00c-c1f9-4216-babe-6c90d969084a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:19.726290 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3f7aa5df-527a-414c-9069-530b06458d7d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "POST /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3/action" status: 202 len: 0 microversion: 2.1 time: 0.176862 Jul 31 01:11:19.732249 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 614/1230] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:11:19 2022] POST /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:11:19.740980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4c1d1fe8-9080-4911-8783-b91e628fcb2b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:19.742027 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4c1d1fe8-9080-4911-8783-b91e628fcb2b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:19.751928 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c1d1fe8-9080-4911-8783-b91e628fcb2b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:19.752808 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c1d1fe8-9080-4911-8783-b91e628fcb2b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:19.754467 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c1d1fe8-9080-4911-8783-b91e628fcb2b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:19.755309 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c1d1fe8-9080-4911-8783-b91e628fcb2b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:20.189484 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bad0d00c-c1f9-4216-babe-6c90d969084a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:20.200073 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4c1d1fe8-9080-4911-8783-b91e628fcb2b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:20.208802 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bad0d00c-c1f9-4216-babe-6c90d969084a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1789 microversion: 2.1 time: 0.538394 Jul 31 01:11:20.215808 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 617/1231] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:19 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1789 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:20.216050 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4c1d1fe8-9080-4911-8783-b91e628fcb2b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.477952 Jul 31 01:11:20.216050 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 615/1232] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:19 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:20.231488 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c5e7f6cc-37c0-4dec-a7ed-beb46fdc4768 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:20.232503 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c5e7f6cc-37c0-4dec-a7ed-beb46fdc4768 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:20.236967 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-6b7d753d-4778-4a86-8b71-156aa6bf2313 req-0fcce9fb-2013-4b1c-9bcb-4521e2777f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011dbabc-56cc-4f90-be60-972ffeb468b1", "name": "network-vif-unplugged", "status": "completed", "tag": "4bf6b045-f27a-43d0-a436-872ac90dc24a"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:20.243776 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5e7f6cc-37c0-4dec-a7ed-beb46fdc4768 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:20.244839 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5e7f6cc-37c0-4dec-a7ed-beb46fdc4768 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:20.245938 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5e7f6cc-37c0-4dec-a7ed-beb46fdc4768 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:20.246709 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5e7f6cc-37c0-4dec-a7ed-beb46fdc4768 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:20.260378 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6b7d753d-4778-4a86-8b71-156aa6bf2313 req-0fcce9fb-2013-4b1c-9bcb-4521e2777f94 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:20.261204 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6b7d753d-4778-4a86-8b71-156aa6bf2313 req-0fcce9fb-2013-4b1c-9bcb-4521e2777f94 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:20.288319 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-6b7d753d-4778-4a86-8b71-156aa6bf2313 req-0fcce9fb-2013-4b1c-9bcb-4521e2777f94 service nova] Creating event network-vif-unplugged:4bf6b045-f27a-43d0-a436-872ac90dc24a for instance 011dbabc-56cc-4f90-be60-972ffeb468b1 on n-h1-master-1 Jul 31 01:11:20.297585 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-6b7d753d-4778-4a86-8b71-156aa6bf2313 req-0fcce9fb-2013-4b1c-9bcb-4521e2777f94 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084177 Jul 31 01:11:20.298713 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 618/1233] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:20.304663 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d1e8f3b1-aeea-4c3f-9719-39459c11ff57 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:20.305689 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d1e8f3b1-aeea-4c3f-9719-39459c11ff57 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:20.313365 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d1e8f3b1-aeea-4c3f-9719-39459c11ff57 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:20.313826 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d1e8f3b1-aeea-4c3f-9719-39459c11ff57 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:20.314624 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d1e8f3b1-aeea-4c3f-9719-39459c11ff57 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:20.315073 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d1e8f3b1-aeea-4c3f-9719-39459c11ff57 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:20.647940 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c5e7f6cc-37c0-4dec-a7ed-beb46fdc4768 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:20.658566 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c5e7f6cc-37c0-4dec-a7ed-beb46fdc4768 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 200 len: 1472 microversion: 2.1 time: 0.444006 Jul 31 01:11:20.659157 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 616/1234] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:20 2022] GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 1472 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:20.690462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-57a3e6d2-f27e-4aaf-aed1-8e7e8d6e59c8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:20.691603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-57a3e6d2-f27e-4aaf-aed1-8e7e8d6e59c8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:20.699489 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57a3e6d2-f27e-4aaf-aed1-8e7e8d6e59c8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:20.700390 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57a3e6d2-f27e-4aaf-aed1-8e7e8d6e59c8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:20.701476 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57a3e6d2-f27e-4aaf-aed1-8e7e8d6e59c8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:20.702203 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57a3e6d2-f27e-4aaf-aed1-8e7e8d6e59c8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:20.753776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d1e8f3b1-aeea-4c3f-9719-39459c11ff57 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:20.764962 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d1e8f3b1-aeea-4c3f-9719-39459c11ff57 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1315 microversion: 2.1 time: 0.464661 Jul 31 01:11:20.765568 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 619/1235] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:20 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:20.770714 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-52f4103a-cd22-46ce-9a72-2531b002a86e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:20.776891 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-52f4103a-cd22-46ce-9a72-2531b002a86e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:20.797975 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52f4103a-cd22-46ce-9a72-2531b002a86e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:20.797975 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52f4103a-cd22-46ce-9a72-2531b002a86e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:20.801720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52f4103a-cd22-46ce-9a72-2531b002a86e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:20.801841 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52f4103a-cd22-46ce-9a72-2531b002a86e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:21.196341 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-52f4103a-cd22-46ce-9a72-2531b002a86e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:21.209526 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-52f4103a-cd22-46ce-9a72-2531b002a86e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1483 microversion: 2.1 time: 0.438329 Jul 31 01:11:21.216021 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 620/1236] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:20 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1483 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:21.218742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-57a3e6d2-f27e-4aaf-aed1-8e7e8d6e59c8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:21.228845 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-31b60fe9-b55e-42bb-b10f-e307dbc69b4f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:21.230397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-31b60fe9-b55e-42bb-b10f-e307dbc69b4f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:21.236003 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-57a3e6d2-f27e-4aaf-aed1-8e7e8d6e59c8 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1472 microversion: 2.1 time: 0.552365 Jul 31 01:11:21.239784 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31b60fe9-b55e-42bb-b10f-e307dbc69b4f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:21.240597 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31b60fe9-b55e-42bb-b10f-e307dbc69b4f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:21.242036 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31b60fe9-b55e-42bb-b10f-e307dbc69b4f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:21.242717 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31b60fe9-b55e-42bb-b10f-e307dbc69b4f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:21.254175 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 617/1237] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:20 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1472 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:21.264178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-550f0aea-6fe4-4450-8bdf-f8da6bb2089d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:21.267423 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-550f0aea-6fe4-4450-8bdf-f8da6bb2089d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:21.284722 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-550f0aea-6fe4-4450-8bdf-f8da6bb2089d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:21.285757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-550f0aea-6fe4-4450-8bdf-f8da6bb2089d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:21.287840 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-550f0aea-6fe4-4450-8bdf-f8da6bb2089d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:21.288020 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-550f0aea-6fe4-4450-8bdf-f8da6bb2089d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:21.629724 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-31b60fe9-b55e-42bb-b10f-e307dbc69b4f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:21.640059 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-31b60fe9-b55e-42bb-b10f-e307dbc69b4f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:21.642050 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-31b60fe9-b55e-42bb-b10f-e307dbc69b4f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:21.643424 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-31b60fe9-b55e-42bb-b10f-e307dbc69b4f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.426371 Jul 31 01:11:21.644225 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 621/1238] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:21 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:21.654127 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-af6b0f92-f82a-4aad-827d-443b9dd7191e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1002116245"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:21.660353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-af6b0f92-f82a-4aad-827d-443b9dd7191e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:21.676370 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af6b0f92-f82a-4aad-827d-443b9dd7191e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:21.677154 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af6b0f92-f82a-4aad-827d-443b9dd7191e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:21.678993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af6b0f92-f82a-4aad-827d-443b9dd7191e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:21.679400 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-550f0aea-6fe4-4450-8bdf-f8da6bb2089d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:21.680024 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af6b0f92-f82a-4aad-827d-443b9dd7191e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:21.692463 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-550f0aea-6fe4-4450-8bdf-f8da6bb2089d tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1317 microversion: 2.1 time: 0.436530 Jul 31 01:11:21.693879 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 618/1239] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:21 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:21.702602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21f7229e-d39c-4d5b-be59-890ac097888c tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:21.703607 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-21f7229e-d39c-4d5b-be59-890ac097888c tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:21.713071 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21f7229e-d39c-4d5b-be59-890ac097888c tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:21.714211 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21f7229e-d39c-4d5b-be59-890ac097888c tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:21.715576 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21f7229e-d39c-4d5b-be59-890ac097888c tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:21.716549 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21f7229e-d39c-4d5b-be59-890ac097888c tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:21.909119 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-21f7229e-d39c-4d5b-be59-890ac097888c tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.213722 Jul 31 01:11:21.910079 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 619/1240] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:11:21 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:21.919316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8b11fc0f-dac7-42f4-9c03-19f75f58808b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:21.922380 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8b11fc0f-dac7-42f4-9c03-19f75f58808b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:21.954207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b11fc0f-dac7-42f4-9c03-19f75f58808b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:21.954607 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b11fc0f-dac7-42f4-9c03-19f75f58808b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:21.956325 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b11fc0f-dac7-42f4-9c03-19f75f58808b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:21.957991 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b11fc0f-dac7-42f4-9c03-19f75f58808b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:22.056069 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-af6b0f92-f82a-4aad-827d-443b9dd7191e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "POST /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3/action" status: 202 len: 0 microversion: 2.1 time: 0.409658 Jul 31 01:11:22.058014 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 622/1241] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:11:21 2022] POST /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 31 01:11:22.071970 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-d90faf76-d1d3-4765-ae4b-bf4382b8dddc req-18b0ecb1-f90e-4766-825f-b92759695040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8660466c-0119-4cc7-8da1-e48e22f2c088", "name": "network-vif-unplugged", "status": "completed", "tag": "174a4d1b-d42d-41f3-86c8-1031d7e0dd4e"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:22.072862 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8b11fc0f-dac7-42f4-9c03-19f75f58808b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:22.089751 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8b11fc0f-dac7-42f4-9c03-19f75f58808b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1612 microversion: 2.1 time: 0.175853 Jul 31 01:11:22.090046 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d90faf76-d1d3-4765-ae4b-bf4382b8dddc req-18b0ecb1-f90e-4766-825f-b92759695040 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:22.091087 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d90faf76-d1d3-4765-ae4b-bf4382b8dddc req-18b0ecb1-f90e-4766-825f-b92759695040 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:22.091407 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 620/1242] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:21 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1612 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:22.102047 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c1e6fdfa-7328-47a1-b40a-c84b5cefa8ae tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:22.103868 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c1e6fdfa-7328-47a1-b40a-c84b5cefa8ae tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:22.117705 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1e6fdfa-7328-47a1-b40a-c84b5cefa8ae tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:22.117992 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-d90faf76-d1d3-4765-ae4b-bf4382b8dddc req-18b0ecb1-f90e-4766-825f-b92759695040 service nova] Creating event network-vif-unplugged:174a4d1b-d42d-41f3-86c8-1031d7e0dd4e for instance 8660466c-0119-4cc7-8da1-e48e22f2c088 on n-h1-master-1 Jul 31 01:11:22.118891 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1e6fdfa-7328-47a1-b40a-c84b5cefa8ae tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:22.120662 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1e6fdfa-7328-47a1-b40a-c84b5cefa8ae tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:22.121578 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1e6fdfa-7328-47a1-b40a-c84b5cefa8ae tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:22.127764 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-d90faf76-d1d3-4765-ae4b-bf4382b8dddc req-18b0ecb1-f90e-4766-825f-b92759695040 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066919 Jul 31 01:11:22.129107 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 623/1243] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:22.137945 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-0e29cac9-4f5e-4951-8a16-2fbf757273f0 req-5f863741-8173-4ac1-b34e-b794153d72fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8660466c-0119-4cc7-8da1-e48e22f2c088", "name": "network-vif-deleted", "tag": "082830c6-d3e7-4858-b04e-daea65512750"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:22.156349 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0e29cac9-4f5e-4951-8a16-2fbf757273f0 req-5f863741-8173-4ac1-b34e-b794153d72fb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:22.157143 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0e29cac9-4f5e-4951-8a16-2fbf757273f0 req-5f863741-8173-4ac1-b34e-b794153d72fb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:22.178621 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-0e29cac9-4f5e-4951-8a16-2fbf757273f0 req-5f863741-8173-4ac1-b34e-b794153d72fb service nova] Creating event network-vif-deleted:082830c6-d3e7-4858-b04e-daea65512750 for instance 8660466c-0119-4cc7-8da1-e48e22f2c088 on n-h1-master-1 Jul 31 01:11:22.187770 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-0e29cac9-4f5e-4951-8a16-2fbf757273f0 req-5f863741-8173-4ac1-b34e-b794153d72fb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056208 Jul 31 01:11:22.192625 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 624/1244] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:22.203419 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c78e1e44-a604-412d-b87b-12d3917381f1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:22.204819 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c78e1e44-a604-412d-b87b-12d3917381f1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:22.210490 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:22.219991 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c78e1e44-a604-412d-b87b-12d3917381f1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:22.220794 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c78e1e44-a604-412d-b87b-12d3917381f1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:22.222232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c78e1e44-a604-412d-b87b-12d3917381f1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:22.223041 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c78e1e44-a604-412d-b87b-12d3917381f1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:22.466530 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c1e6fdfa-7328-47a1-b40a-c84b5cefa8ae tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:22.486142 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c1e6fdfa-7328-47a1-b40a-c84b5cefa8ae tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.389948 Jul 31 01:11:22.488667 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 621/1245] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:22 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:22.524345 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d14d36c3-e190-494c-bbc1-8ac9676e06c7 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede5535c10>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:22.586930 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c78e1e44-a604-412d-b87b-12d3917381f1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:22.598639 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c78e1e44-a604-412d-b87b-12d3917381f1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1315 microversion: 2.1 time: 0.403897 Jul 31 01:11:22.609107 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d14d36c3-e190-494c-bbc1-8ac9676e06c7 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.116780 Jul 31 01:11:22.617785 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 622/1246] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:22 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:22.623286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ae7a8780-757c-497a-af93-fe00b51c3dc5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:22.624786 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ae7a8780-757c-497a-af93-fe00b51c3dc5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:22.628985 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 625/1247] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:22 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:22.637746 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae7a8780-757c-497a-af93-fe00b51c3dc5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:22.638222 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae7a8780-757c-497a-af93-fe00b51c3dc5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:22.639040 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-15b9fb10-13f5-4beb-bfe2-28f7123ca017 req-cf5674f8-91dc-4c50-a953-27a1bc63d52f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011dbabc-56cc-4f90-be60-972ffeb468b1", "tag": "4bf6b045-f27a-43d0-a436-872ac90dc24a"}, {"name": "network-changed", "server_uuid": "4ca134f6-3529-47bd-830d-0ab1b9b69775", "tag": "892a1aa4-8477-4cee-9b84-a969a734fcbf"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:22.640053 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae7a8780-757c-497a-af93-fe00b51c3dc5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:22.640528 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae7a8780-757c-497a-af93-fe00b51c3dc5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:22.656756 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-15b9fb10-13f5-4beb-bfe2-28f7123ca017 req-cf5674f8-91dc-4c50-a953-27a1bc63d52f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:22.657878 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-15b9fb10-13f5-4beb-bfe2-28f7123ca017 req-cf5674f8-91dc-4c50-a953-27a1bc63d52f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:22.681374 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-15b9fb10-13f5-4beb-bfe2-28f7123ca017 req-cf5674f8-91dc-4c50-a953-27a1bc63d52f service nova] Creating event network-changed:4bf6b045-f27a-43d0-a436-872ac90dc24a for instance 011dbabc-56cc-4f90-be60-972ffeb468b1 on n-h1-master-1 Jul 31 01:11:22.682301 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-15b9fb10-13f5-4beb-bfe2-28f7123ca017 req-cf5674f8-91dc-4c50-a953-27a1bc63d52f service nova] Creating event network-changed:892a1aa4-8477-4cee-9b84-a969a734fcbf for instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 on n-h1-master-1 Jul 31 01:11:22.694197 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-15b9fb10-13f5-4beb-bfe2-28f7123ca017 req-cf5674f8-91dc-4c50-a953-27a1bc63d52f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.062350 Jul 31 01:11:22.696038 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 626/1248] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:22.705828 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c7f269b1-2ace-467d-9ac2-eb65730f1c91 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:22.707013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c7f269b1-2ace-467d-9ac2-eb65730f1c91 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:22.716729 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7f269b1-2ace-467d-9ac2-eb65730f1c91 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:22.717243 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7f269b1-2ace-467d-9ac2-eb65730f1c91 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:22.718753 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7f269b1-2ace-467d-9ac2-eb65730f1c91 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:22.719392 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7f269b1-2ace-467d-9ac2-eb65730f1c91 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:22.979570 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c7f269b1-2ace-467d-9ac2-eb65730f1c91 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:22.982859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ae7a8780-757c-497a-af93-fe00b51c3dc5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:22.987831 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:22.993710 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ae7a8780-757c-497a-af93-fe00b51c3dc5 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1472 microversion: 2.1 time: 0.374369 Jul 31 01:11:22.995535 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 623/1249] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:22 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1472 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:22.999029 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c7f269b1-2ace-467d-9ac2-eb65730f1c91 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:23.001023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c7f269b1-2ace-467d-9ac2-eb65730f1c91 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:23.001176 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5ee92a68-004b-4588-a546-8549fa55d395 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:23.001919 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5ee92a68-004b-4588-a546-8549fa55d395 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:23.002319 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c7f269b1-2ace-467d-9ac2-eb65730f1c91 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.303602 Jul 31 01:11:23.009923 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:23.011698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ee92a68-004b-4588-a546-8549fa55d395 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:23.012308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ee92a68-004b-4588-a546-8549fa55d395 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:23.013275 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ee92a68-004b-4588-a546-8549fa55d395 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:23.013917 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ee92a68-004b-4588-a546-8549fa55d395 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:23.018846 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 627/1250] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:22 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:23.118865 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-76ac97a1-9c86-487c-8f4c-c56b6711ffc9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:23.119937 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-76ac97a1-9c86-487c-8f4c-c56b6711ffc9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:23.138589 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76ac97a1-9c86-487c-8f4c-c56b6711ffc9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:23.139057 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76ac97a1-9c86-487c-8f4c-c56b6711ffc9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:23.139933 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76ac97a1-9c86-487c-8f4c-c56b6711ffc9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:23.140374 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76ac97a1-9c86-487c-8f4c-c56b6711ffc9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:23.205652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76ac97a1-9c86-487c-8f4c-c56b6711ffc9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:23.206388 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76ac97a1-9c86-487c-8f4c-c56b6711ffc9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:23.206852 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-76ac97a1-9c86-487c-8f4c-c56b6711ffc9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lazy-loading 'fault' on Instance uuid 8660466c-0119-4cc7-8da1-e48e22f2c088 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:11:23.266503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-76ac97a1-9c86-487c-8f4c-c56b6711ffc9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:23.275593 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-76ac97a1-9c86-487c-8f4c-c56b6711ffc9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 200 len: 1303 microversion: 2.1 time: 0.163564 Jul 31 01:11:23.276797 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 628/1251] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:23 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 1303 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:23.292066 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5ee92a68-004b-4588-a546-8549fa55d395 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:23.304497 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5ee92a68-004b-4588-a546-8549fa55d395 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1261 microversion: 2.1 time: 0.307632 Jul 31 01:11:23.305444 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 624/1252] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:22 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1261 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:23.516618 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a00a1121-4dd1-4fee-8720-602e44864f1e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:23.517757 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a00a1121-4dd1-4fee-8720-602e44864f1e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:23.541471 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a00a1121-4dd1-4fee-8720-602e44864f1e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:23.542207 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a00a1121-4dd1-4fee-8720-602e44864f1e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:23.543321 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a00a1121-4dd1-4fee-8720-602e44864f1e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:23.544064 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a00a1121-4dd1-4fee-8720-602e44864f1e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:23.549613 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7c17de28-bfc6-407f-84a8-e409621644de tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:23.551196 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7c17de28-bfc6-407f-84a8-e409621644de tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:23.567570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7c17de28-bfc6-407f-84a8-e409621644de tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:23.569202 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7c17de28-bfc6-407f-84a8-e409621644de tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:23.572598 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7c17de28-bfc6-407f-84a8-e409621644de tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:23.573721 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7c17de28-bfc6-407f-84a8-e409621644de tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:23.821404 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a00a1121-4dd1-4fee-8720-602e44864f1e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:23.827914 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:23.840436 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a00a1121-4dd1-4fee-8720-602e44864f1e tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.331094 Jul 31 01:11:23.842464 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 629/1253] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:23 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:11:23.867165 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-011424b9-6ce9-4327-83ff-ca270d6ce20a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede55220d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:23.891851 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:24.005309 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-011424b9-6ce9-4327-83ff-ca270d6ce20a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.157969 Jul 31 01:11:24.007218 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 630/1254] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:23 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:24.016984 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a0eb88d7-ec77-4dda-b027-213772cd6eba tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:24.018569 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a0eb88d7-ec77-4dda-b027-213772cd6eba tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:24.037149 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0eb88d7-ec77-4dda-b027-213772cd6eba tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:24.042170 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0eb88d7-ec77-4dda-b027-213772cd6eba tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:24.045361 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0eb88d7-ec77-4dda-b027-213772cd6eba tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:24.046955 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0eb88d7-ec77-4dda-b027-213772cd6eba tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:24.166195 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7c17de28-bfc6-407f-84a8-e409621644de tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:24.181519 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7c17de28-bfc6-407f-84a8-e409621644de tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1483 microversion: 2.1 time: 0.635485 Jul 31 01:11:24.195381 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 625/1255] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:23 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1483 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:24.208058 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a855c248-fa93-4e28-9fdf-384b35c31043 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:24.209918 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a855c248-fa93-4e28-9fdf-384b35c31043 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:24.221071 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=8 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:24.235416 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a855c248-fa93-4e28-9fdf-384b35c31043 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:24.236925 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a855c248-fa93-4e28-9fdf-384b35c31043 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:24.238649 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a855c248-fa93-4e28-9fdf-384b35c31043 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:24.241165 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a855c248-fa93-4e28-9fdf-384b35c31043 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:24.455200 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a0eb88d7-ec77-4dda-b027-213772cd6eba tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:24.471742 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a0eb88d7-ec77-4dda-b027-213772cd6eba tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1315 microversion: 2.1 time: 0.461866 Jul 31 01:11:24.473555 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 631/1256] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:24 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:24.482505 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-22a70423-c9f1-4543-a580-4ea368e1736a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:24.483746 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-22a70423-c9f1-4543-a580-4ea368e1736a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:24.494321 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22a70423-c9f1-4543-a580-4ea368e1736a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:24.494893 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22a70423-c9f1-4543-a580-4ea368e1736a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:24.495984 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22a70423-c9f1-4543-a580-4ea368e1736a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:24.496761 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22a70423-c9f1-4543-a580-4ea368e1736a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:24.613857 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a855c248-fa93-4e28-9fdf-384b35c31043 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:24.628624 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a855c248-fa93-4e28-9fdf-384b35c31043 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:24.630953 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a855c248-fa93-4e28-9fdf-384b35c31043 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:24.632849 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a855c248-fa93-4e28-9fdf-384b35c31043 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.447781 Jul 31 01:11:24.647760 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 626/1257] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:24 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:24.752628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7da10a7f-d6d3-465a-b08f-e3287a71605b req-a5795f10-72a6-4481-a839-91dbef038792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8660466c-0119-4cc7-8da1-e48e22f2c088", "name": "network-vif-deleted", "tag": "174a4d1b-d42d-41f3-86c8-1031d7e0dd4e"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:24.763464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7da10a7f-d6d3-465a-b08f-e3287a71605b req-a5795f10-72a6-4481-a839-91dbef038792 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:24.764010 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7da10a7f-d6d3-465a-b08f-e3287a71605b req-a5795f10-72a6-4481-a839-91dbef038792 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:24.764939 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-22a70423-c9f1-4543-a580-4ea368e1736a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:24.777848 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7da10a7f-d6d3-465a-b08f-e3287a71605b req-a5795f10-72a6-4481-a839-91dbef038792 service nova] Creating event network-vif-deleted:174a4d1b-d42d-41f3-86c8-1031d7e0dd4e for instance 8660466c-0119-4cc7-8da1-e48e22f2c088 on n-h1-master-1 Jul 31 01:11:24.780360 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-22a70423-c9f1-4543-a580-4ea368e1736a tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1477 microversion: 2.1 time: 0.304880 Jul 31 01:11:24.782475 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 632/1258] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:24 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1477 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:24.791771 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b45a4dbd-7bf1-4f89-809e-11519c3ae92b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:24.792895 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b45a4dbd-7bf1-4f89-809e-11519c3ae92b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:24.795150 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7da10a7f-d6d3-465a-b08f-e3287a71605b req-a5795f10-72a6-4481-a839-91dbef038792 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145203 Jul 31 01:11:24.798574 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 627/1259] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:24.805631 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b45a4dbd-7bf1-4f89-809e-11519c3ae92b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:24.806367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b45a4dbd-7bf1-4f89-809e-11519c3ae92b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:24.807940 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b45a4dbd-7bf1-4f89-809e-11519c3ae92b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:24.808701 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b45a4dbd-7bf1-4f89-809e-11519c3ae92b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:24.812438 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b311332d-c0af-4e62-8aa3-091cd664a75a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:24.813319 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b311332d-c0af-4e62-8aa3-091cd664a75a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:24.820137 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b311332d-c0af-4e62-8aa3-091cd664a75a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:24.820602 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b311332d-c0af-4e62-8aa3-091cd664a75a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:24.821465 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b311332d-c0af-4e62-8aa3-091cd664a75a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:24.821975 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b311332d-c0af-4e62-8aa3-091cd664a75a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:24.839034 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-b45a4dbd-7bf1-4f89-809e-11519c3ae92b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] HTTP exception thrown: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b45a4dbd-7bf1-4f89-809e-11519c3ae92b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Request method failure captured: Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 HTTP/1.1 Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5daEn6_dmgBUhg1iaYA_4nmkPLTYfYug2V-YMYPbFrprYZqIthsTZbRXKKxeWxSuhElq_3oSaHw3hM3T8_MGcOp1FZUsIJ11iM1KyytPFiOiAy7Di5oEM-hSY5hpkL1C7sTS76yh-kEiOOwae2N-TAQXEhDscJ-jhXkB1BpK362IdgA Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 531072622a6d4b10b902ac7644c6a7ad Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestMultiNic-448049166 Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_531072622a6d4b10b902ac7644c6a7ad", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestMultiNic-448049166 Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 531072622a6d4b10b902ac7644c6a7ad Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestMultiNic-448049166 Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestMultiNic-448049166-project Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 246145364b854ab7bb4fdaffcfa238d8 Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestMultiNic-448049166-project Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '8660466c-0119-4cc7-8da1-e48e22f2c088'} Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:24.842395 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:24.849532 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:24.849532 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:24.849532 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:24.849532 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:11:24.849532 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:11:24.849532 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. Jul 31 01:11:24.849532 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:24.849532 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b45a4dbd-7bf1-4f89-809e-11519c3ae92b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Returning 404 to user: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:11:24.849532 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b45a4dbd-7bf1-4f89-809e-11519c3ae92b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 404 len: 111 microversion: 2.1 time: 0.061210 Jul 31 01:11:24.849532 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 633/1260] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:24 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:11:24.862273 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-cdabe812-cc12-47e8-8943-06a9fbc2d716 req-5898f232-fbc0-42ff-a36d-e41e8cff9036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "451cf12b-e061-4c6c-8b43-40cee9ddcc1c", "tag": "e424fe72-c4fb-4577-bbaa-a66dd860365f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:24.880811 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-cdabe812-cc12-47e8-8943-06a9fbc2d716 req-5898f232-fbc0-42ff-a36d-e41e8cff9036 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:24.881625 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-cdabe812-cc12-47e8-8943-06a9fbc2d716 req-5898f232-fbc0-42ff-a36d-e41e8cff9036 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:24.905400 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-cdabe812-cc12-47e8-8943-06a9fbc2d716 req-5898f232-fbc0-42ff-a36d-e41e8cff9036 service nova] Creating event network-changed:e424fe72-c4fb-4577-bbaa-a66dd860365f for instance 451cf12b-e061-4c6c-8b43-40cee9ddcc1c on n-h1-master-1 Jul 31 01:11:24.915042 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-cdabe812-cc12-47e8-8943-06a9fbc2d716 req-5898f232-fbc0-42ff-a36d-e41e8cff9036 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064316 Jul 31 01:11:24.916340 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 634/1261] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:24.926385 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-26ca27f4-6d94-4fc9-a269-ea7a308d401f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:24.927739 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-26ca27f4-6d94-4fc9-a269-ea7a308d401f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:24.940328 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-26ca27f4-6d94-4fc9-a269-ea7a308d401f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:24.941126 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-26ca27f4-6d94-4fc9-a269-ea7a308d401f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:24.942797 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-26ca27f4-6d94-4fc9-a269-ea7a308d401f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:24.944276 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-26ca27f4-6d94-4fc9-a269-ea7a308d401f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:25.729301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b311332d-c0af-4e62-8aa3-091cd664a75a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:25.740842 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b311332d-c0af-4e62-8aa3-091cd664a75a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1261 microversion: 2.1 time: 0.940183 Jul 31 01:11:25.741891 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 628/1262] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:24 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1261 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:25.751013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2d34d19c-9239-4119-be0e-5a61694cb0f8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede557b4c0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:25.820243 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2d34d19c-9239-4119-be0e-5a61694cb0f8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.076834 Jul 31 01:11:25.820868 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 629/1263] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:25 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:25.826054 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ddb3c83-436a-4f96-86b7-dac790f01677 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:25.826673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0ddb3c83-436a-4f96-86b7-dac790f01677 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:25.833962 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ddb3c83-436a-4f96-86b7-dac790f01677 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:25.834470 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ddb3c83-436a-4f96-86b7-dac790f01677 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:25.835284 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ddb3c83-436a-4f96-86b7-dac790f01677 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:25.835922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ddb3c83-436a-4f96-86b7-dac790f01677 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:25.836374 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-26ca27f4-6d94-4fc9-a269-ea7a308d401f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:25.849116 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-26ca27f4-6d94-4fc9-a269-ea7a308d401f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.930876 Jul 31 01:11:25.849899 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 635/1264] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:24 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:25.870309 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c92fb0a3-f72f-4be4-af57-f50b94e1572c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:25.871433 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c92fb0a3-f72f-4be4-af57-f50b94e1572c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:25.878758 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c92fb0a3-f72f-4be4-af57-f50b94e1572c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:25.879227 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c92fb0a3-f72f-4be4-af57-f50b94e1572c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:25.880136 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c92fb0a3-f72f-4be4-af57-f50b94e1572c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:25.880662 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c92fb0a3-f72f-4be4-af57-f50b94e1572c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:26.212116 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0ddb3c83-436a-4f96-86b7-dac790f01677 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:26.223127 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0ddb3c83-436a-4f96-86b7-dac790f01677 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1315 microversion: 2.1 time: 0.400729 Jul 31 01:11:26.224634 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 630/1265] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:25 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:26.312331 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c92fb0a3-f72f-4be4-af57-f50b94e1572c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:26.337347 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c92fb0a3-f72f-4be4-af57-f50b94e1572c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:26.339715 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c92fb0a3-f72f-4be4-af57-f50b94e1572c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:26.341967 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c92fb0a3-f72f-4be4-af57-f50b94e1572c tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.481189 Jul 31 01:11:26.344151 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 636/1266] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:25 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:26.406308 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-64679008-6ee6-404e-bce4-ac91fa9bb35b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:26.407255 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-64679008-6ee6-404e-bce4-ac91fa9bb35b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:26.415638 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-64679008-6ee6-404e-bce4-ac91fa9bb35b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:26.416275 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-64679008-6ee6-404e-bce4-ac91fa9bb35b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:26.417370 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-64679008-6ee6-404e-bce4-ac91fa9bb35b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:26.418073 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-64679008-6ee6-404e-bce4-ac91fa9bb35b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:26.773304 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-093d2546-3db3-4377-aca6-d2959db8b142 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:26.774095 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-093d2546-3db3-4377-aca6-d2959db8b142 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:26.784182 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-093d2546-3db3-4377-aca6-d2959db8b142 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:26.785842 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-093d2546-3db3-4377-aca6-d2959db8b142 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:26.786971 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-093d2546-3db3-4377-aca6-d2959db8b142 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:26.787715 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-093d2546-3db3-4377-aca6-d2959db8b142 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:26.903918 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-64679008-6ee6-404e-bce4-ac91fa9bb35b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:26.914011 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-64679008-6ee6-404e-bce4-ac91fa9bb35b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1477 microversion: 2.1 time: 0.687704 Jul 31 01:11:26.915544 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 631/1267] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:26 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1477 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:26.922673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6dd1629d-2d47-44cf-b268-bea353e9b564 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa84940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:26.965397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-093d2546-3db3-4377-aca6-d2959db8b142 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:26.990811 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-093d2546-3db3-4377-aca6-d2959db8b142 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1219 microversion: 2.1 time: 0.221242 Jul 31 01:11:26.998463 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6dd1629d-2d47-44cf-b268-bea353e9b564 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.081510 Jul 31 01:11:27.000460 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 632/1268] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:26 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:27.007965 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b3537c6a-7c3f-452c-bb8b-1446b1b16244 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:27.008796 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b3537c6a-7c3f-452c-bb8b-1446b1b16244 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:27.017983 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3537c6a-7c3f-452c-bb8b-1446b1b16244 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:27.018638 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3537c6a-7c3f-452c-bb8b-1446b1b16244 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:27.019598 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3537c6a-7c3f-452c-bb8b-1446b1b16244 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:27.020311 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3537c6a-7c3f-452c-bb8b-1446b1b16244 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:27.029007 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 637/1269] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:26 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1219 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:11:27.037262 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-203d2ad4-5f83-45a2-8859-9ec8b223f766 req-303eb9cd-837d-4f2f-ad67-7793ece0947d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916bad28-8c22-4c07-8f60-f25d28729294", "name": "network-vif-deleted", "tag": "c511a289-6d4a-4bd8-ad7e-ad1436331405"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:27.077914 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-203d2ad4-5f83-45a2-8859-9ec8b223f766 req-303eb9cd-837d-4f2f-ad67-7793ece0947d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:27.078366 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-203d2ad4-5f83-45a2-8859-9ec8b223f766 req-303eb9cd-837d-4f2f-ad67-7793ece0947d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:27.097871 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.compute.server_external_events [req-203d2ad4-5f83-45a2-8859-9ec8b223f766 req-303eb9cd-837d-4f2f-ad67-7793ece0947d service nova] Unable to find a host for instance 916bad28-8c22-4c07-8f60-f25d28729294. Dropping event network-vif-deleted {{(pid=119475) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 31 01:11:27.099550 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-203d2ad4-5f83-45a2-8859-9ec8b223f766 req-303eb9cd-837d-4f2f-ad67-7793ece0947d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.069125 Jul 31 01:11:27.100960 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 638/1270] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 71 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 31 01:11:27.255042 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0d80a31c-53a8-49eb-be2b-91ffa05b17af tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:27.263599 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0d80a31c-53a8-49eb-be2b-91ffa05b17af tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:27.279717 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d80a31c-53a8-49eb-be2b-91ffa05b17af tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:27.280234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d80a31c-53a8-49eb-be2b-91ffa05b17af tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:27.281080 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d80a31c-53a8-49eb-be2b-91ffa05b17af tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:27.281529 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d80a31c-53a8-49eb-be2b-91ffa05b17af tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:27.429497 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b3537c6a-7c3f-452c-bb8b-1446b1b16244 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:27.438781 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b3537c6a-7c3f-452c-bb8b-1446b1b16244 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.436022 Jul 31 01:11:27.439393 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 633/1271] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:27 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:27.468705 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bead1212-7667-4a9e-8796-cae6aacb15e4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:27.469737 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bead1212-7667-4a9e-8796-cae6aacb15e4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:27.476578 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bead1212-7667-4a9e-8796-cae6aacb15e4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:27.477316 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bead1212-7667-4a9e-8796-cae6aacb15e4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:27.478323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bead1212-7667-4a9e-8796-cae6aacb15e4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:27.478990 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bead1212-7667-4a9e-8796-cae6aacb15e4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:27.634668 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0d80a31c-53a8-49eb-be2b-91ffa05b17af tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:27.646314 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0d80a31c-53a8-49eb-be2b-91ffa05b17af tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1315 microversion: 2.1 time: 0.394402 Jul 31 01:11:27.660067 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 639/1272] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:27 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:27.811883 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bead1212-7667-4a9e-8796-cae6aacb15e4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:27.827723 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bead1212-7667-4a9e-8796-cae6aacb15e4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:27.829642 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bead1212-7667-4a9e-8796-cae6aacb15e4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:27.831061 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bead1212-7667-4a9e-8796-cae6aacb15e4 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.381472 Jul 31 01:11:27.847918 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 634/1273] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:27 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:27.948304 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b1d0c192-6f17-4934-a2c8-0a54fcb93ce1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:27.949470 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b1d0c192-6f17-4934-a2c8-0a54fcb93ce1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:27.964109 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b1d0c192-6f17-4934-a2c8-0a54fcb93ce1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:27.964909 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b1d0c192-6f17-4934-a2c8-0a54fcb93ce1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:27.966832 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b1d0c192-6f17-4934-a2c8-0a54fcb93ce1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:27.969049 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b1d0c192-6f17-4934-a2c8-0a54fcb93ce1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:28.016014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95350013-a4e3-474c-9d00-c9ebcd7a09bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa918b0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:28.121163 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-95350013-a4e3-474c-9d00-c9ebcd7a09bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.110491 Jul 31 01:11:28.129724 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 635/1274] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:28 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:28.130177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7ae8ce39-f257-43df-85c8-79b6aea62094 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:28.131140 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7ae8ce39-f257-43df-85c8-79b6aea62094 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:28.145684 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ae8ce39-f257-43df-85c8-79b6aea62094 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:28.146819 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ae8ce39-f257-43df-85c8-79b6aea62094 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:28.148403 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ae8ce39-f257-43df-85c8-79b6aea62094 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:28.149100 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ae8ce39-f257-43df-85c8-79b6aea62094 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:28.209619 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ae8ce39-f257-43df-85c8-79b6aea62094 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:28.210113 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ae8ce39-f257-43df-85c8-79b6aea62094 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:28.210869 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-7ae8ce39-f257-43df-85c8-79b6aea62094 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lazy-loading 'fault' on Instance uuid 916bad28-8c22-4c07-8f60-f25d28729294 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:11:28.233981 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b1d0c192-6f17-4934-a2c8-0a54fcb93ce1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:28.244150 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b1d0c192-6f17-4934-a2c8-0a54fcb93ce1 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1477 microversion: 2.1 time: 0.301388 Jul 31 01:11:28.248572 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 640/1275] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:27 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1477 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:11:28.254892 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-c2d76e50-924a-4dd9-be11-e8d599e86ceb req-9c78e5b2-9bc8-4026-b522-5899477736b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca134f6-3529-47bd-830d-0ab1b9b69775", "name": "network-vif-plugged", "status": "completed", "tag": "892a1aa4-8477-4cee-9b84-a969a734fcbf"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:28.271406 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c2d76e50-924a-4dd9-be11-e8d599e86ceb req-9c78e5b2-9bc8-4026-b522-5899477736b0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:28.273903 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c2d76e50-924a-4dd9-be11-e8d599e86ceb req-9c78e5b2-9bc8-4026-b522-5899477736b0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:28.290617 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-c2d76e50-924a-4dd9-be11-e8d599e86ceb req-9c78e5b2-9bc8-4026-b522-5899477736b0 service nova] Creating event network-vif-plugged:892a1aa4-8477-4cee-9b84-a969a734fcbf for instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 on n-h1-master-1 Jul 31 01:11:28.296940 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-c2d76e50-924a-4dd9-be11-e8d599e86ceb req-9c78e5b2-9bc8-4026-b522-5899477736b0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045854 Jul 31 01:11:28.297679 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 641/1276] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:28.298718 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7ae8ce39-f257-43df-85c8-79b6aea62094 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:28.311236 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7ae8ce39-f257-43df-85c8-79b6aea62094 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 200 len: 1409 microversion: 2.1 time: 0.187485 Jul 31 01:11:28.312596 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 636/1277] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:28 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 1409 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:28.336993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-73d7e375-7cc8-40c2-95e9-720750920114 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:28.337635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-73d7e375-7cc8-40c2-95e9-720750920114 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:28.345944 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73d7e375-7cc8-40c2-95e9-720750920114 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:28.346819 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73d7e375-7cc8-40c2-95e9-720750920114 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:28.347938 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73d7e375-7cc8-40c2-95e9-720750920114 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:28.348801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73d7e375-7cc8-40c2-95e9-720750920114 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:28.383027 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-73d7e375-7cc8-40c2-95e9-720750920114 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:11:28.447667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-73d7e375-7cc8-40c2-95e9-720750920114 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Doing local delete in cell b79bbab3-22fe-4aca-b591-999750c84479(cell1) {{(pid=119475) _delete /opt/stack/nova/nova/compute/api.py:2491}} Jul 31 01:11:28.449146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73d7e375-7cc8-40c2-95e9-720750920114 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:28.450038 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73d7e375-7cc8-40c2-95e9-720750920114 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:28.450812 n-d-master-1 devstack@n-api.service[119475]: WARNING nova.compute.api [None req-73d7e375-7cc8-40c2-95e9-720750920114 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] instance's host None is down, deleting from database Jul 31 01:11:28.458112 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-73d7e375-7cc8-40c2-95e9-720750920114 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] deallocate_for_instance() {{(pid=119475) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 31 01:11:28.464413 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8bf7f8bd-a781-4871-b90d-05830dd1ff8b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:28.465152 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8bf7f8bd-a781-4871-b90d-05830dd1ff8b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:28.479804 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8bf7f8bd-a781-4871-b90d-05830dd1ff8b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:28.480510 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8bf7f8bd-a781-4871-b90d-05830dd1ff8b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:28.481381 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8bf7f8bd-a781-4871-b90d-05830dd1ff8b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:28.484716 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8bf7f8bd-a781-4871-b90d-05830dd1ff8b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:28.532993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-73d7e375-7cc8-40c2-95e9-720750920114 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Instance cache missing network info. {{(pid=119475) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 31 01:11:28.552773 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-73d7e375-7cc8-40c2-95e9-720750920114 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Updating instance_info_cache with network_info: [] {{(pid=119475) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 31 01:11:28.774259 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8bf7f8bd-a781-4871-b90d-05830dd1ff8b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:28.784357 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8bf7f8bd-a781-4871-b90d-05830dd1ff8b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.327716 Jul 31 01:11:28.785332 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 637/1278] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:28 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:28.790695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ad0a6ea0-e9e2-4387-b94f-6c0737b8b0ad tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:28.791829 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ad0a6ea0-e9e2-4387-b94f-6c0737b8b0ad tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:28.800830 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad0a6ea0-e9e2-4387-b94f-6c0737b8b0ad tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:28.801560 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad0a6ea0-e9e2-4387-b94f-6c0737b8b0ad tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:28.802549 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad0a6ea0-e9e2-4387-b94f-6c0737b8b0ad tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:28.803815 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad0a6ea0-e9e2-4387-b94f-6c0737b8b0ad tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:29.039445 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ad0a6ea0-e9e2-4387-b94f-6c0737b8b0ad tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:29.048105 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ad0a6ea0-e9e2-4387-b94f-6c0737b8b0ad tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1315 microversion: 2.1 time: 0.261378 Jul 31 01:11:29.048992 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 638/1279] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:28 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:29.054047 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-17599c1d-5163-4af2-8b35-cf35de911b21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:29.054659 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-17599c1d-5163-4af2-8b35-cf35de911b21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:29.061300 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17599c1d-5163-4af2-8b35-cf35de911b21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:29.061783 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17599c1d-5163-4af2-8b35-cf35de911b21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:29.062582 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17599c1d-5163-4af2-8b35-cf35de911b21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:29.063023 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17599c1d-5163-4af2-8b35-cf35de911b21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:29.119622 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-73d7e375-7cc8-40c2-95e9-720750920114 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "DELETE /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 204 len: 0 microversion: 2.1 time: 0.786970 Jul 31 01:11:29.126161 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 642/1280] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:11:28 2022] DELETE /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:11:29.135632 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-efd34284-47d2-46f6-a3f6-1c21366fcb92 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:29.136787 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-efd34284-47d2-46f6-a3f6-1c21366fcb92 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 916bad28-8c22-4c07-8f60-f25d28729294] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:29.146024 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efd34284-47d2-46f6-a3f6-1c21366fcb92 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:29.146521 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efd34284-47d2-46f6-a3f6-1c21366fcb92 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:29.147324 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efd34284-47d2-46f6-a3f6-1c21366fcb92 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:29.147970 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efd34284-47d2-46f6-a3f6-1c21366fcb92 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:29.169255 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-efd34284-47d2-46f6-a3f6-1c21366fcb92 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] HTTP exception thrown: Instance 916bad28-8c22-4c07-8f60-f25d28729294 could not be found. Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-efd34284-47d2-46f6-a3f6-1c21366fcb92 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Request method failure captured: Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 HTTP/1.1 Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dXvczrjV93XGTog32ZhLWWtba7dtc274nDtU8E1Fg1kaFfSFTu1mOthIsPp5iOJofIsjlZdSwTbjyj2LE7DPBnmjox8fqRCUbcXosGLpS7nCLvEC8_927gD0PLQuRdewtttI4lKyEun5DpT6VtlLkZ534cOYIJ9M_YWbga0UOFAT7s Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: ba602c4ed5b94aad996ef8c95d3436ba Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ba602c4ed5b94aad996ef8c95d3436ba", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: ba602c4ed5b94aad996ef8c95d3436ba Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersOnMultiNodesTest-46531715-project Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 0fad0a50973b44149c18ca2b76bfab36 Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersOnMultiNodesTest-46531715-project Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 916bad28-8c22-4c07-8f60-f25d28729294 could not be found. Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '916bad28-8c22-4c07-8f60-f25d28729294'} Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 916bad28-8c22-4c07-8f60-f25d28729294 could not be found. Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 916bad28-8c22-4c07-8f60-f25d28729294 could not be found. Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:29.171140 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:29.177663 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:29.177663 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:29.177663 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:29.177663 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:11:29.177663 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:11:29.177663 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 916bad28-8c22-4c07-8f60-f25d28729294 could not be found. Jul 31 01:11:29.177663 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:29.177663 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-efd34284-47d2-46f6-a3f6-1c21366fcb92 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Returning 404 to user: Instance 916bad28-8c22-4c07-8f60-f25d28729294 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:11:29.177663 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-efd34284-47d2-46f6-a3f6-1c21366fcb92 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294" status: 404 len: 111 microversion: 2.1 time: 0.044783 Jul 31 01:11:29.179175 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 643/1281] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:29 2022] GET /compute/v2.1/servers/916bad28-8c22-4c07-8f60-f25d28729294 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:11:29.197993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-03e2f59c-1dee-464b-ae00-97488d873cc0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede5612ca0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:29.277899 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-03e2f59c-1dee-464b-ae00-97488d873cc0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.097161 Jul 31 01:11:29.287754 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 644/1282] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:29 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:29.287754 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-aef38677-6eba-4a2d-adb7-ae6dcea54c9a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:29.287754 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-aef38677-6eba-4a2d-adb7-ae6dcea54c9a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:29.288355 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-17599c1d-5163-4af2-8b35-cf35de911b21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:29.294933 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aef38677-6eba-4a2d-adb7-ae6dcea54c9a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:29.295580 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aef38677-6eba-4a2d-adb7-ae6dcea54c9a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:29.297440 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aef38677-6eba-4a2d-adb7-ae6dcea54c9a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:29.297964 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aef38677-6eba-4a2d-adb7-ae6dcea54c9a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:29.312917 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-17599c1d-5163-4af2-8b35-cf35de911b21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:29.314799 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-17599c1d-5163-4af2-8b35-cf35de911b21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:29.316195 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-17599c1d-5163-4af2-8b35-cf35de911b21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.265923 Jul 31 01:11:29.316904 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 639/1283] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:29 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:29.322088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3fd98d7d-4257-47c9-b2db-3c4f0619d69b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:29.322866 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3fd98d7d-4257-47c9-b2db-3c4f0619d69b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:29.330174 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3fd98d7d-4257-47c9-b2db-3c4f0619d69b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:29.330786 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3fd98d7d-4257-47c9-b2db-3c4f0619d69b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:29.331708 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3fd98d7d-4257-47c9-b2db-3c4f0619d69b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:29.332404 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3fd98d7d-4257-47c9-b2db-3c4f0619d69b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:29.348226 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-aef38677-6eba-4a2d-adb7-ae6dcea54c9a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:11:29.352333 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=15,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:29.510090 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-aef38677-6eba-4a2d-adb7-ae6dcea54c9a tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "DELETE /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 204 len: 0 microversion: 2.1 time: 0.228937 Jul 31 01:11:29.511289 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 645/1284] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:11:29 2022] DELETE /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:11:29.527018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-83713ccc-17e9-4cdd-beab-24611b8b1508 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:29.528575 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-83713ccc-17e9-4cdd-beab-24611b8b1508 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:29.540584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83713ccc-17e9-4cdd-beab-24611b8b1508 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:29.541423 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83713ccc-17e9-4cdd-beab-24611b8b1508 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:29.542757 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83713ccc-17e9-4cdd-beab-24611b8b1508 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:29.544314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83713ccc-17e9-4cdd-beab-24611b8b1508 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:29.555183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3fd98d7d-4257-47c9-b2db-3c4f0619d69b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:29.564630 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3fd98d7d-4257-47c9-b2db-3c4f0619d69b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1477 microversion: 2.1 time: 0.246295 Jul 31 01:11:29.571740 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 640/1285] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:29 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1477 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:29.777928 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-83713ccc-17e9-4cdd-beab-24611b8b1508 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:29.788144 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-83713ccc-17e9-4cdd-beab-24611b8b1508 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1471 microversion: 2.1 time: 0.268926 Jul 31 01:11:29.789172 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 646/1286] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:29 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1471 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:29.814589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7a433242-5d6b-4250-8ea8-fe406317f5d4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:29.816079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7a433242-5d6b-4250-8ea8-fe406317f5d4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:29.829932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a433242-5d6b-4250-8ea8-fe406317f5d4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:29.830863 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a433242-5d6b-4250-8ea8-fe406317f5d4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:29.832465 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a433242-5d6b-4250-8ea8-fe406317f5d4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:29.833345 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a433242-5d6b-4250-8ea8-fe406317f5d4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:29.993276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7a433242-5d6b-4250-8ea8-fe406317f5d4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:30.008726 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7a433242-5d6b-4250-8ea8-fe406317f5d4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.201581 Jul 31 01:11:30.009668 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 641/1287] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:29 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:30.074488 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-27d041b3-6ae1-4707-9b98-7050804ce7a2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:30.075217 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-27d041b3-6ae1-4707-9b98-7050804ce7a2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:30.083075 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27d041b3-6ae1-4707-9b98-7050804ce7a2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:30.083552 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27d041b3-6ae1-4707-9b98-7050804ce7a2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:30.084348 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27d041b3-6ae1-4707-9b98-7050804ce7a2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:30.084788 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27d041b3-6ae1-4707-9b98-7050804ce7a2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:30.302825 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b681f556-0d6c-4a24-844e-1b3ed9038af7 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa801f0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:30.325251 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-27d041b3-6ae1-4707-9b98-7050804ce7a2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:30.337777 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-27d041b3-6ae1-4707-9b98-7050804ce7a2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1315 microversion: 2.1 time: 0.266579 Jul 31 01:11:30.349519 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 647/1288] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:30 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:30.354158 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b681f556-0d6c-4a24-844e-1b3ed9038af7 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.055107 Jul 31 01:11:30.355621 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 642/1289] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:30 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:11:30.360575 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ece99e82-575d-4773-a2b1-b36e960318f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:30.361435 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ece99e82-575d-4773-a2b1-b36e960318f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:30.368869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ece99e82-575d-4773-a2b1-b36e960318f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:30.369626 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ece99e82-575d-4773-a2b1-b36e960318f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:30.370739 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ece99e82-575d-4773-a2b1-b36e960318f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:30.371430 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ece99e82-575d-4773-a2b1-b36e960318f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:30.378779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2194f825-98c2-456a-9efa-3a6f864e90d7 req-1ad02d99-b006-4d80-a2d1-841231ed65e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f16639-427f-42f0-abe2-19c1106f59e3", "name": "network-vif-plugged", "status": "completed", "tag": "6b987620-a1fd-4b4e-b5c2-5ca6e5557ebf"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:30.397419 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2194f825-98c2-456a-9efa-3a6f864e90d7 req-1ad02d99-b006-4d80-a2d1-841231ed65e8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:30.398333 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2194f825-98c2-456a-9efa-3a6f864e90d7 req-1ad02d99-b006-4d80-a2d1-841231ed65e8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:30.417022 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2194f825-98c2-456a-9efa-3a6f864e90d7 req-1ad02d99-b006-4d80-a2d1-841231ed65e8 service nova] Creating event network-vif-plugged:6b987620-a1fd-4b4e-b5c2-5ca6e5557ebf for instance 59f16639-427f-42f0-abe2-19c1106f59e3 on n-h1-master-1 Jul 31 01:11:30.426188 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2194f825-98c2-456a-9efa-3a6f864e90d7 req-1ad02d99-b006-4d80-a2d1-841231ed65e8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073549 Jul 31 01:11:30.427887 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 648/1290] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:30.604919 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8b78623b-bddb-4aac-a9cf-f67764bb00d7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:30.606187 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8b78623b-bddb-4aac-a9cf-f67764bb00d7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:30.614859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b78623b-bddb-4aac-a9cf-f67764bb00d7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:30.615619 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b78623b-bddb-4aac-a9cf-f67764bb00d7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:30.616553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b78623b-bddb-4aac-a9cf-f67764bb00d7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:30.617074 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b78623b-bddb-4aac-a9cf-f67764bb00d7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:30.736993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ece99e82-575d-4773-a2b1-b36e960318f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:30.746765 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ece99e82-575d-4773-a2b1-b36e960318f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:30.749879 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ece99e82-575d-4773-a2b1-b36e960318f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:30.751618 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ece99e82-575d-4773-a2b1-b36e960318f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.395066 Jul 31 01:11:30.752834 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 643/1291] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:30 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:30.813138 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7eb3f651-fa02-4dce-98c6-054437bf0043 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:30.814250 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7eb3f651-fa02-4dce-98c6-054437bf0043 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:30.824261 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7eb3f651-fa02-4dce-98c6-054437bf0043 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:30.825057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7eb3f651-fa02-4dce-98c6-054437bf0043 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:30.826188 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7eb3f651-fa02-4dce-98c6-054437bf0043 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:30.826881 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7eb3f651-fa02-4dce-98c6-054437bf0043 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:30.907556 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8b78623b-bddb-4aac-a9cf-f67764bb00d7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:30.922862 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8b78623b-bddb-4aac-a9cf-f67764bb00d7 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1477 microversion: 2.1 time: 0.322320 Jul 31 01:11:30.923546 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 649/1292] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:30 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1477 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:11:31.037504 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-640a8510-73c2-4f67-8ad5-919869cfbd79 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:31.038268 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-640a8510-73c2-4f67-8ad5-919869cfbd79 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:31.042105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7eb3f651-fa02-4dce-98c6-054437bf0043 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:31.051566 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-640a8510-73c2-4f67-8ad5-919869cfbd79 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:31.053260 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:31.054119 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-640a8510-73c2-4f67-8ad5-919869cfbd79 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:31.055974 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-640a8510-73c2-4f67-8ad5-919869cfbd79 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:31.056733 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-640a8510-73c2-4f67-8ad5-919869cfbd79 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:31.059391 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7eb3f651-fa02-4dce-98c6-054437bf0043 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1471 microversion: 2.1 time: 0.252955 Jul 31 01:11:31.075595 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 644/1293] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:30 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1471 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:31.233133 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-640a8510-73c2-4f67-8ad5-919869cfbd79 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:31.243818 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-640a8510-73c2-4f67-8ad5-919869cfbd79 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.211634 Jul 31 01:11:31.244601 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 650/1294] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:31 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:11:31.382659 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7e48589d-606a-49ef-ba47-73a6d28cd0e2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:31.383488 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b23218e7-85a0-493c-bd01-de10c9505586 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede5759f70>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:31.385043 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7e48589d-606a-49ef-ba47-73a6d28cd0e2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:31.412956 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e48589d-606a-49ef-ba47-73a6d28cd0e2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:31.416324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e48589d-606a-49ef-ba47-73a6d28cd0e2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:31.418202 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e48589d-606a-49ef-ba47-73a6d28cd0e2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:31.419312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e48589d-606a-49ef-ba47-73a6d28cd0e2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:31.512398 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b23218e7-85a0-493c-bd01-de10c9505586 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.136481 Jul 31 01:11:31.515904 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 651/1295] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:31 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:31.534824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9c27fa11-d021-4d1a-9759-244773c8562b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1290499844", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "1b138715-d812-4fe2-8f63-23c53f988980"}, {"uuid": "966896b4-68c8-44f5-957e-9245159aa3e2"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:31.661269 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-9c27fa11-d021-4d1a-9759-244773c8562b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] validate_networks() for [('1b138715-d812-4fe2-8f63-23c53f988980', None, None, None, None, None), ('966896b4-68c8-44f5-957e-9245159aa3e2', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:11:31.828635 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7e48589d-606a-49ef-ba47-73a6d28cd0e2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:31.844506 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7e48589d-606a-49ef-ba47-73a6d28cd0e2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1315 microversion: 2.1 time: 0.478043 Jul 31 01:11:31.845609 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 645/1296] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:31 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:31.861655 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dce2b106-18cd-4837-826b-d250e762a031 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:31.862587 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dce2b106-18cd-4837-826b-d250e762a031 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:31.874481 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dce2b106-18cd-4837-826b-d250e762a031 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:31.875321 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dce2b106-18cd-4837-826b-d250e762a031 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:31.877004 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dce2b106-18cd-4837-826b-d250e762a031 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:31.877895 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dce2b106-18cd-4837-826b-d250e762a031 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:32.189262 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dce2b106-18cd-4837-826b-d250e762a031 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:32.212227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dce2b106-18cd-4837-826b-d250e762a031 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:32.214461 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dce2b106-18cd-4837-826b-d250e762a031 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:32.216522 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dce2b106-18cd-4837-826b-d250e762a031 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.368991 Jul 31 01:11:32.217454 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 646/1297] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:31 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:32.231729 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1df49086-6de5-4d00-b20b-e26ca5564018 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:32.243179 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1df49086-6de5-4d00-b20b-e26ca5564018 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:32.261850 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1df49086-6de5-4d00-b20b-e26ca5564018 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:32.264325 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1df49086-6de5-4d00-b20b-e26ca5564018 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:32.270311 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1df49086-6de5-4d00-b20b-e26ca5564018 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:32.271572 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1df49086-6de5-4d00-b20b-e26ca5564018 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:32.758399 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1df49086-6de5-4d00-b20b-e26ca5564018 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:32.770497 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1df49086-6de5-4d00-b20b-e26ca5564018 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1477 microversion: 2.1 time: 0.548772 Jul 31 01:11:32.800172 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 647/1298] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:32 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1477 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:32.818067 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-74e420d8-cce9-4264-a13e-e8bcb58ce449 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:32.819803 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-74e420d8-cce9-4264-a13e-e8bcb58ce449 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:32.830227 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74e420d8-cce9-4264-a13e-e8bcb58ce449 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:32.831548 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74e420d8-cce9-4264-a13e-e8bcb58ce449 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:32.833005 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74e420d8-cce9-4264-a13e-e8bcb58ce449 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:32.834060 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74e420d8-cce9-4264-a13e-e8bcb58ce449 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:33.200336 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-74e420d8-cce9-4264-a13e-e8bcb58ce449 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:33.214306 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-74e420d8-cce9-4264-a13e-e8bcb58ce449 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1471 microversion: 2.1 time: 0.410139 Jul 31 01:11:33.227772 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 648/1299] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:32 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1471 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:33.228094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9c27fa11-d021-4d1a-9759-244773c8562b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:11:33.228094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9c27fa11-d021-4d1a-9759-244773c8562b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:11:33.228094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9c27fa11-d021-4d1a-9759-244773c8562b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:11:33.229131 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-91afe5aa-6fc4-4190-bcc6-f46bd5da2117 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:33.233138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9c27fa11-d021-4d1a-9759-244773c8562b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:11:33.233466 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-91afe5aa-6fc4-4190-bcc6-f46bd5da2117 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:33.233701 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9c27fa11-d021-4d1a-9759-244773c8562b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:11:33.233871 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91afe5aa-6fc4-4190-bcc6-f46bd5da2117 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:33.238049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91afe5aa-6fc4-4190-bcc6-f46bd5da2117 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:33.238049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91afe5aa-6fc4-4190-bcc6-f46bd5da2117 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:33.238049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91afe5aa-6fc4-4190-bcc6-f46bd5da2117 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:33.246584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c27fa11-d021-4d1a-9759-244773c8562b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:33.247138 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c27fa11-d021-4d1a-9759-244773c8562b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:33.248164 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c27fa11-d021-4d1a-9759-244773c8562b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:33.248777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c27fa11-d021-4d1a-9759-244773c8562b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:33.274481 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-9c27fa11-d021-4d1a-9759-244773c8562b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Getting quotas for project 531072622a6d4b10b902ac7644c6a7ad. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:11:33.282902 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-9c27fa11-d021-4d1a-9759-244773c8562b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Getting quotas for user 246145364b854ab7bb4fdaffcfa238d8 and project 531072622a6d4b10b902ac7644c6a7ad. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:11:33.299214 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9c27fa11-d021-4d1a-9759-244773c8562b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:11:33.312835 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9c27fa11-d021-4d1a-9759-244773c8562b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:11:33.395141 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9c27fa11-d021-4d1a-9759-244773c8562b tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.867974 Jul 31 01:11:33.396544 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 652/1300] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:11:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:11:33.402117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6fdd1674-4a7b-431f-8030-8c32d5507929 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede5612ca0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:33.490699 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6fdd1674-4a7b-431f-8030-8c32d5507929 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.092329 Jul 31 01:11:33.492791 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 653/1301] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:33 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:33.508957 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4d4f4dc0-eff3-4cba-afd6-7d815c5b21cb tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:33.510240 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4d4f4dc0-eff3-4cba-afd6-7d815c5b21cb tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:33.521138 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-91afe5aa-6fc4-4190-bcc6-f46bd5da2117 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:33.524483 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d4f4dc0-eff3-4cba-afd6-7d815c5b21cb tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:33.525726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d4f4dc0-eff3-4cba-afd6-7d815c5b21cb tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:33.527677 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d4f4dc0-eff3-4cba-afd6-7d815c5b21cb tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:33.529223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d4f4dc0-eff3-4cba-afd6-7d815c5b21cb tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:33.532064 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-91afe5aa-6fc4-4190-bcc6-f46bd5da2117 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.312864 Jul 31 01:11:33.533008 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 649/1302] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:33 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:33.538372 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e3779a0c-8338-4533-8d2d-7e75cf92be73 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:33.539075 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e3779a0c-8338-4533-8d2d-7e75cf92be73 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:33.555365 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3779a0c-8338-4533-8d2d-7e75cf92be73 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:33.556226 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3779a0c-8338-4533-8d2d-7e75cf92be73 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:33.558736 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3779a0c-8338-4533-8d2d-7e75cf92be73 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:33.564846 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3779a0c-8338-4533-8d2d-7e75cf92be73 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:34.511200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e3779a0c-8338-4533-8d2d-7e75cf92be73 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:34.531696 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e3779a0c-8338-4533-8d2d-7e75cf92be73 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:34.537538 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e3779a0c-8338-4533-8d2d-7e75cf92be73 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:34.542352 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e3779a0c-8338-4533-8d2d-7e75cf92be73 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 1.007861 Jul 31 01:11:34.543505 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 650/1303] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:33 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:34.566019 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-387fd0be-5cd7-476e-a5c8-c1724eac9f69 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:34.567144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-387fd0be-5cd7-476e-a5c8-c1724eac9f69 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:34.584924 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-387fd0be-5cd7-476e-a5c8-c1724eac9f69 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:34.585665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-387fd0be-5cd7-476e-a5c8-c1724eac9f69 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:34.587047 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-387fd0be-5cd7-476e-a5c8-c1724eac9f69 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:34.587802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-387fd0be-5cd7-476e-a5c8-c1724eac9f69 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:34.778928 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4d4f4dc0-eff3-4cba-afd6-7d815c5b21cb tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:34.794135 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4d4f4dc0-eff3-4cba-afd6-7d815c5b21cb tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1315 microversion: 2.1 time: 1.299710 Jul 31 01:11:34.794769 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 654/1304] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:33 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1315 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:34.800183 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fff96142-5bba-4e44-9795-49c172017499 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:34.801081 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fff96142-5bba-4e44-9795-49c172017499 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:34.833410 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fff96142-5bba-4e44-9795-49c172017499 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:34.834193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fff96142-5bba-4e44-9795-49c172017499 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:34.835573 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fff96142-5bba-4e44-9795-49c172017499 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:34.836298 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fff96142-5bba-4e44-9795-49c172017499 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:34.858775 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-387fd0be-5cd7-476e-a5c8-c1724eac9f69 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:34.878517 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-387fd0be-5cd7-476e-a5c8-c1724eac9f69 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1209 microversion: 2.1 time: 0.327922 Jul 31 01:11:34.880324 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 651/1305] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:34 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1209 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:34.903263 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-25aa5984-6ee8-45ab-9a4c-0982a8db74de tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:34.904164 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-25aa5984-6ee8-45ab-9a4c-0982a8db74de tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:34.925306 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25aa5984-6ee8-45ab-9a4c-0982a8db74de tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:34.927067 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25aa5984-6ee8-45ab-9a4c-0982a8db74de tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:34.928810 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25aa5984-6ee8-45ab-9a4c-0982a8db74de tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:34.929554 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25aa5984-6ee8-45ab-9a4c-0982a8db74de tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:35.525985 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-25aa5984-6ee8-45ab-9a4c-0982a8db74de tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:35.539285 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-25aa5984-6ee8-45ab-9a4c-0982a8db74de tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1471 microversion: 2.1 time: 0.657158 Jul 31 01:11:35.539999 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 652/1306] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:34 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1471 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:35.556276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-06604ed2-88ef-48e2-9eb4-a4619532738c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa9f3a0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:35.556968 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fff96142-5bba-4e44-9795-49c172017499 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:35.576463 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fff96142-5bba-4e44-9795-49c172017499 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1477 microversion: 2.1 time: 0.780133 Jul 31 01:11:35.577511 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 655/1307] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:34 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1477 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:35.596512 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d96e8de8-0f78-499c-9b77-e69f13011fa9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:35.597320 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d96e8de8-0f78-499c-9b77-e69f13011fa9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:35.606574 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d96e8de8-0f78-499c-9b77-e69f13011fa9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:35.610451 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d96e8de8-0f78-499c-9b77-e69f13011fa9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:35.611723 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d96e8de8-0f78-499c-9b77-e69f13011fa9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:35.615064 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d96e8de8-0f78-499c-9b77-e69f13011fa9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:35.685770 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-06604ed2-88ef-48e2-9eb4-a4619532738c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.143832 Jul 31 01:11:35.687227 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 653/1308] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:35 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:35.695121 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a3b3dea7-0375-40ad-9be1-57dc5c02b6eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:35.696543 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a3b3dea7-0375-40ad-9be1-57dc5c02b6eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:35.707131 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3b3dea7-0375-40ad-9be1-57dc5c02b6eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:35.708631 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3b3dea7-0375-40ad-9be1-57dc5c02b6eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:35.709799 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3b3dea7-0375-40ad-9be1-57dc5c02b6eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:35.710608 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3b3dea7-0375-40ad-9be1-57dc5c02b6eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:36.071228 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d96e8de8-0f78-499c-9b77-e69f13011fa9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:36.082935 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d96e8de8-0f78-499c-9b77-e69f13011fa9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.501801 Jul 31 01:11:36.088538 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 656/1309] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:35 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:36.094295 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-13809ad2-b4ee-4b59-b80e-1496063187ca tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:36.107077 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-13809ad2-b4ee-4b59-b80e-1496063187ca tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:36.122910 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a3b3dea7-0375-40ad-9be1-57dc5c02b6eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:36.131219 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13809ad2-b4ee-4b59-b80e-1496063187ca tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:36.137579 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13809ad2-b4ee-4b59-b80e-1496063187ca tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:36.145422 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a3b3dea7-0375-40ad-9be1-57dc5c02b6eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:36.153159 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13809ad2-b4ee-4b59-b80e-1496063187ca tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:36.154032 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13809ad2-b4ee-4b59-b80e-1496063187ca tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:36.162838 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a3b3dea7-0375-40ad-9be1-57dc5c02b6eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:36.164582 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a3b3dea7-0375-40ad-9be1-57dc5c02b6eb tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 0.474888 Jul 31 01:11:36.167790 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 654/1310] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:35 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:36.191766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f21aab13-d406-4308-9f45-ed4393659641 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:36.192740 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f21aab13-d406-4308-9f45-ed4393659641 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:36.211992 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f21aab13-d406-4308-9f45-ed4393659641 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:36.220155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f21aab13-d406-4308-9f45-ed4393659641 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:36.221227 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f21aab13-d406-4308-9f45-ed4393659641 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:36.223897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f21aab13-d406-4308-9f45-ed4393659641 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:36.434661 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f21aab13-d406-4308-9f45-ed4393659641 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:36.449875 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f21aab13-d406-4308-9f45-ed4393659641 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1273 microversion: 2.1 time: 0.280669 Jul 31 01:11:36.467051 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 655/1311] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:36 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1273 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:36.578843 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a88c8dfb-3c72-4e58-a802-b632e364892b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:36.586927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a88c8dfb-3c72-4e58-a802-b632e364892b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:36.600281 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a88c8dfb-3c72-4e58-a802-b632e364892b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:36.601070 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a88c8dfb-3c72-4e58-a802-b632e364892b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:36.602666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a88c8dfb-3c72-4e58-a802-b632e364892b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:36.603314 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a88c8dfb-3c72-4e58-a802-b632e364892b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:36.716850 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a88c8dfb-3c72-4e58-a802-b632e364892b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:36.758763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-13809ad2-b4ee-4b59-b80e-1496063187ca tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:36.761707 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a88c8dfb-3c72-4e58-a802-b632e364892b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 200 len: 1429 microversion: 2.1 time: 0.181968 Jul 31 01:11:36.775907 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-13809ad2-b4ee-4b59-b80e-1496063187ca tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1315 microversion: 2.1 time: 0.684542 Jul 31 01:11:36.775907 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 657/1312] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:36 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:36.783030 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 656/1313] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:36 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 1429 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:36.783829 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f663dd08-8176-497c-a79c-d73b79567dcb tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:36.785875 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f663dd08-8176-497c-a79c-d73b79567dcb tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:36.799072 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-8f83c511-0fe8-4e96-8a5f-a3d3dfb7bb16 req-39a50740-835f-4d7f-80c1-e0f2e80f22d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75d60c14-7940-40cd-9ec3-090eea335022", "name": "network-vif-deleted", "tag": "864029d3-8f9e-4023-9933-55c86cc3c1a1"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:36.803712 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f663dd08-8176-497c-a79c-d73b79567dcb tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:36.804388 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f663dd08-8176-497c-a79c-d73b79567dcb tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:36.805726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f663dd08-8176-497c-a79c-d73b79567dcb tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:36.806184 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f663dd08-8176-497c-a79c-d73b79567dcb tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:36.836446 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8f83c511-0fe8-4e96-8a5f-a3d3dfb7bb16 req-39a50740-835f-4d7f-80c1-e0f2e80f22d2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:36.836446 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8f83c511-0fe8-4e96-8a5f-a3d3dfb7bb16 req-39a50740-835f-4d7f-80c1-e0f2e80f22d2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:36.892841 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-8f83c511-0fe8-4e96-8a5f-a3d3dfb7bb16 req-39a50740-835f-4d7f-80c1-e0f2e80f22d2 service nova] Creating event network-vif-deleted:864029d3-8f9e-4023-9933-55c86cc3c1a1 for instance 75d60c14-7940-40cd-9ec3-090eea335022 on n-h1-master-1 Jul 31 01:11:36.918613 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-8f83c511-0fe8-4e96-8a5f-a3d3dfb7bb16 req-39a50740-835f-4d7f-80c1-e0f2e80f22d2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133089 Jul 31 01:11:36.922853 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 657/1314] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:36.948660 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-435416d0-90a4-4355-be12-bc0af2ccc844 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa27280>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:37.090837 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-435416d0-90a4-4355-be12-bc0af2ccc844 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.150048 Jul 31 01:11:37.092221 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 658/1315] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:36 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:37.126336 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9a28f63a-fb6d-4057-8a99-fdc651a0b095 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:37.129176 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9a28f63a-fb6d-4057-8a99-fdc651a0b095 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:37.166618 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a28f63a-fb6d-4057-8a99-fdc651a0b095 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:37.175753 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a28f63a-fb6d-4057-8a99-fdc651a0b095 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:37.176953 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a28f63a-fb6d-4057-8a99-fdc651a0b095 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:37.177531 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a28f63a-fb6d-4057-8a99-fdc651a0b095 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:37.399149 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f663dd08-8176-497c-a79c-d73b79567dcb tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:37.421717 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f663dd08-8176-497c-a79c-d73b79567dcb tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1477 microversion: 2.1 time: 0.639806 Jul 31 01:11:37.425674 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 658/1316] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:36 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1477 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:37.449130 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-df7cf97c-0ae4-4f6b-b865-781373972e33 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:37.457052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-df7cf97c-0ae4-4f6b-b865-781373972e33 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:37.495790 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df7cf97c-0ae4-4f6b-b865-781373972e33 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:37.496320 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df7cf97c-0ae4-4f6b-b865-781373972e33 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:37.501078 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df7cf97c-0ae4-4f6b-b865-781373972e33 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:37.502694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df7cf97c-0ae4-4f6b-b865-781373972e33 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:37.863763 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9a28f63a-fb6d-4057-8a99-fdc651a0b095 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:37.909762 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9a28f63a-fb6d-4057-8a99-fdc651a0b095 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.780128 Jul 31 01:11:37.931494 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 659/1317] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:37 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:11:37.951074 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-69009e22-4cf7-4f5f-b941-f96327c4f95c tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:37.952691 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-69009e22-4cf7-4f5f-b941-f96327c4f95c tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:37.963832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69009e22-4cf7-4f5f-b941-f96327c4f95c tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:37.965283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69009e22-4cf7-4f5f-b941-f96327c4f95c tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:37.967039 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69009e22-4cf7-4f5f-b941-f96327c4f95c tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:37.968596 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69009e22-4cf7-4f5f-b941-f96327c4f95c tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:38.351166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-69009e22-4cf7-4f5f-b941-f96327c4f95c tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:38.368404 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-69009e22-4cf7-4f5f-b941-f96327c4f95c tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1271 microversion: 2.1 time: 0.433074 Jul 31 01:11:38.385742 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 660/1318] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:37 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1271 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:38.393335 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d86d5faa-1dc1-48fa-a589-7e0a1a6f89bd tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:38.394350 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d86d5faa-1dc1-48fa-a589-7e0a1a6f89bd tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 75d60c14-7940-40cd-9ec3-090eea335022] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:38.407914 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d86d5faa-1dc1-48fa-a589-7e0a1a6f89bd tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:38.408712 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d86d5faa-1dc1-48fa-a589-7e0a1a6f89bd tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:38.409745 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d86d5faa-1dc1-48fa-a589-7e0a1a6f89bd tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:38.410552 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d86d5faa-1dc1-48fa-a589-7e0a1a6f89bd tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:38.440618 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-d86d5faa-1dc1-48fa-a589-7e0a1a6f89bd tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] HTTP exception thrown: Instance 75d60c14-7940-40cd-9ec3-090eea335022 could not be found. Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d86d5faa-1dc1-48fa-a589-7e0a1a6f89bd tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Request method failure captured: Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 HTTP/1.1 Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXvczrjV93XGTog32ZhLWWtba7dtc274nDtU8E1Fg1kaFfSFTu1mOthIsPp5iOJofIsjlZdSwTbjyj2LE7DPBnmjox8fqRCUbcXosGLpS7nCLvEC8_927gD0PLQuRdewtttI4lKyEun5DpT6VtlLkZ534cOYIJ9M_YWbga0UOFAT7s Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: ba602c4ed5b94aad996ef8c95d3436ba Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ba602c4ed5b94aad996ef8c95d3436ba", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: ba602c4ed5b94aad996ef8c95d3436ba Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersOnMultiNodesTest-46531715-project Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 0fad0a50973b44149c18ca2b76bfab36 Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersOnMultiNodesTest-46531715-project Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 75d60c14-7940-40cd-9ec3-090eea335022 could not be found. Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '75d60c14-7940-40cd-9ec3-090eea335022'} Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75d60c14-7940-40cd-9ec3-090eea335022 could not be found. Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75d60c14-7940-40cd-9ec3-090eea335022 could not be found. Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:38.444845 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:38.453211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:38.453211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:38.453211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:38.453211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:11:38.453211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:11:38.453211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75d60c14-7940-40cd-9ec3-090eea335022 could not be found. Jul 31 01:11:38.453211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:38.454259 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-df7cf97c-0ae4-4f6b-b865-781373972e33 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:38.456727 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d86d5faa-1dc1-48fa-a589-7e0a1a6f89bd tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Returning 404 to user: Instance 75d60c14-7940-40cd-9ec3-090eea335022 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:11:38.458444 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d86d5faa-1dc1-48fa-a589-7e0a1a6f89bd tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022" status: 404 len: 111 microversion: 2.1 time: 0.070751 Jul 31 01:11:38.459472 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-df7cf97c-0ae4-4f6b-b865-781373972e33 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:38.461319 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-df7cf97c-0ae4-4f6b-b865-781373972e33 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:38.465021 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 661/1319] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:38 2022] GET /compute/v2.1/servers/75d60c14-7940-40cd-9ec3-090eea335022 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:11:38.470197 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-df7cf97c-0ae4-4f6b-b865-781373972e33 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1812 microversion: 2.25 time: 1.039939 Jul 31 01:11:38.471108 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 659/1320] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:37 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1812 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:38.476152 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8276c4a0-d2a3-4019-ac8d-af94223f0d5f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:38.477395 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8276c4a0-d2a3-4019-ac8d-af94223f0d5f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:38.487920 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a594941e-d444-46e7-b4f9-e3499fde7b3b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede5e1f940>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:38.499169 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8276c4a0-d2a3-4019-ac8d-af94223f0d5f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:38.500193 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8276c4a0-d2a3-4019-ac8d-af94223f0d5f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:38.502046 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8276c4a0-d2a3-4019-ac8d-af94223f0d5f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:38.503464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8276c4a0-d2a3-4019-ac8d-af94223f0d5f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:38.586114 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a594941e-d444-46e7-b4f9-e3499fde7b3b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.113560 Jul 31 01:11:38.586625 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 660/1321] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:38 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:38.603824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-16e2266b-f2b6-4269-9be2-72cee0ab2e10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:38.604595 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-16e2266b-f2b6-4269-9be2-72cee0ab2e10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:38.621466 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16e2266b-f2b6-4269-9be2-72cee0ab2e10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:38.622265 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16e2266b-f2b6-4269-9be2-72cee0ab2e10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:38.623409 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16e2266b-f2b6-4269-9be2-72cee0ab2e10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:38.623890 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16e2266b-f2b6-4269-9be2-72cee0ab2e10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:38.997758 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8276c4a0-d2a3-4019-ac8d-af94223f0d5f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:39.009753 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8276c4a0-d2a3-4019-ac8d-af94223f0d5f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1504 microversion: 2.1 time: 0.542475 Jul 31 01:11:39.024152 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 662/1322] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:38 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1504 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:39.040576 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-97cf0efc-bf8b-4f76-8933-031e25672dbc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:39.041609 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-97cf0efc-bf8b-4f76-8933-031e25672dbc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:39.057902 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97cf0efc-bf8b-4f76-8933-031e25672dbc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:39.059193 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97cf0efc-bf8b-4f76-8933-031e25672dbc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:39.060596 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97cf0efc-bf8b-4f76-8933-031e25672dbc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:39.066804 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97cf0efc-bf8b-4f76-8933-031e25672dbc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:39.122901 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-97cf0efc-bf8b-4f76-8933-031e25672dbc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:11:39.201082 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:39.315289 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-97cf0efc-bf8b-4f76-8933-031e25672dbc tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 204 len: 0 microversion: 2.1 time: 0.289248 Jul 31 01:11:39.316396 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 663/1323] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:11:39 2022] DELETE /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:11:39.322257 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fd20c007-6adf-4899-8a61-75df7591a0fe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:39.322984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fd20c007-6adf-4899-8a61-75df7591a0fe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:39.345914 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd20c007-6adf-4899-8a61-75df7591a0fe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:39.346387 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd20c007-6adf-4899-8a61-75df7591a0fe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:39.347266 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd20c007-6adf-4899-8a61-75df7591a0fe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:39.347884 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd20c007-6adf-4899-8a61-75df7591a0fe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:39.545534 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-16e2266b-f2b6-4269-9be2-72cee0ab2e10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:39.573392 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-16e2266b-f2b6-4269-9be2-72cee0ab2e10 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1476 microversion: 2.1 time: 0.985656 Jul 31 01:11:39.576784 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 661/1324] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:38 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1476 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:39.603763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-36ca6424-69e9-4754-a443-18a0483bdb2b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1295112335"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:39.604335 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-36ca6424-69e9-4754-a443-18a0483bdb2b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:39.616686 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36ca6424-69e9-4754-a443-18a0483bdb2b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:39.620122 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36ca6424-69e9-4754-a443-18a0483bdb2b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:39.620985 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36ca6424-69e9-4754-a443-18a0483bdb2b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:39.623046 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36ca6424-69e9-4754-a443-18a0483bdb2b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:39.881432 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fd20c007-6adf-4899-8a61-75df7591a0fe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:39.918410 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fd20c007-6adf-4899-8a61-75df7591a0fe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.600160 Jul 31 01:11:39.919323 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 664/1325] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:39 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:39.926668 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-98ce57db-fc1e-41fd-8a3d-eaf88ed0f758 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:39.927826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-98ce57db-fc1e-41fd-8a3d-eaf88ed0f758 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:39.939056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98ce57db-fc1e-41fd-8a3d-eaf88ed0f758 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:39.939603 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98ce57db-fc1e-41fd-8a3d-eaf88ed0f758 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:39.941118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98ce57db-fc1e-41fd-8a3d-eaf88ed0f758 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:39.941927 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98ce57db-fc1e-41fd-8a3d-eaf88ed0f758 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:39.993925 n-d-master-1 devstack@n-api.service[119475]: INFO nova.network.security_group_api [None req-36ca6424-69e9-4754-a443-18a0483bdb2b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Adding security group 579b1ee4-17da-43d9-8126-f1350c83531a to port 892a1aa4-8477-4cee-9b84-a969a734fcbf Jul 31 01:11:41.108710 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-98ce57db-fc1e-41fd-8a3d-eaf88ed0f758 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:41.135946 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-98ce57db-fc1e-41fd-8a3d-eaf88ed0f758 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 200 len: 1472 microversion: 2.1 time: 1.215377 Jul 31 01:11:41.136908 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 665/1326] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:39 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 1472 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:41.143973 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8e41f230-b473-4803-8500-e580c6ecee11 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:41.145140 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8e41f230-b473-4803-8500-e580c6ecee11 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:41.175300 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e41f230-b473-4803-8500-e580c6ecee11 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:41.175300 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e41f230-b473-4803-8500-e580c6ecee11 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:41.175300 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e41f230-b473-4803-8500-e580c6ecee11 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:41.177761 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e41f230-b473-4803-8500-e580c6ecee11 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:42.374057 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8e41f230-b473-4803-8500-e580c6ecee11 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:42.388295 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8e41f230-b473-4803-8500-e580c6ecee11 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1313 microversion: 2.1 time: 1.249841 Jul 31 01:11:42.389079 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 666/1327] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:41 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1313 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:42.406114 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c467f2cc-f572-4c06-ac55-99d2add92593 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:42.406960 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c467f2cc-f572-4c06-ac55-99d2add92593 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:42.419405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c467f2cc-f572-4c06-ac55-99d2add92593 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:42.420177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c467f2cc-f572-4c06-ac55-99d2add92593 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:42.421553 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c467f2cc-f572-4c06-ac55-99d2add92593 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:42.423235 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c467f2cc-f572-4c06-ac55-99d2add92593 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:42.910662 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-36ca6424-69e9-4754-a443-18a0483bdb2b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "POST /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775/action" status: 202 len: 0 microversion: 2.1 time: 3.314765 Jul 31 01:11:42.911310 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 662/1328] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:11:39 2022] POST /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775/action => generated 0 bytes in 3334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:11:42.918259 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-043e2e86-1bf9-4921-89f1-725b50907b1b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede57b1d30>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:42.999534 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-043e2e86-1bf9-4921-89f1-725b50907b1b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.086315 Jul 31 01:11:43.000143 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 663/1329] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:42 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:43.016324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-b7222773-e1d2-4423-9d74-d9da7b4f0c20 req-402158e3-9c91-405c-9cbf-8a69b0cb1936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eafdd229-897b-4b1f-adfc-3d7bb4fef7a0", "name": "network-vif-unplugged", "status": "completed", "tag": "5ee707da-030a-4991-809c-69f12af3f140"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:43.055283 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c467f2cc-f572-4c06-ac55-99d2add92593 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:43.073167 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b7222773-e1d2-4423-9d74-d9da7b4f0c20 req-402158e3-9c91-405c-9cbf-8a69b0cb1936 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:43.073641 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b7222773-e1d2-4423-9d74-d9da7b4f0c20 req-402158e3-9c91-405c-9cbf-8a69b0cb1936 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:43.076859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c467f2cc-f572-4c06-ac55-99d2add92593 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:43.079013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c467f2cc-f572-4c06-ac55-99d2add92593 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:43.080301 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c467f2cc-f572-4c06-ac55-99d2add92593 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1802 microversion: 2.25 time: 0.679796 Jul 31 01:11:43.081184 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 667/1330] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:42 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1802 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:43.086518 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ffeaf41b-1434-457c-8f1d-8c9ab2c84767 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:43.087123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ffeaf41b-1434-457c-8f1d-8c9ab2c84767 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:43.103062 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ffeaf41b-1434-457c-8f1d-8c9ab2c84767 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:43.108716 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ffeaf41b-1434-457c-8f1d-8c9ab2c84767 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:43.110507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ffeaf41b-1434-457c-8f1d-8c9ab2c84767 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:43.116127 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ffeaf41b-1434-457c-8f1d-8c9ab2c84767 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:43.123718 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-b7222773-e1d2-4423-9d74-d9da7b4f0c20 req-402158e3-9c91-405c-9cbf-8a69b0cb1936 service nova] Creating event network-vif-unplugged:5ee707da-030a-4991-809c-69f12af3f140 for instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 on n-h1-master-1 Jul 31 01:11:43.145048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-b7222773-e1d2-4423-9d74-d9da7b4f0c20 req-402158e3-9c91-405c-9cbf-8a69b0cb1936 service nova] Instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:11:43.197468 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-b7222773-e1d2-4423-9d74-d9da7b4f0c20 req-402158e3-9c91-405c-9cbf-8a69b0cb1936 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.185409 Jul 31 01:11:43.200489 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 664/1331] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:43.209329 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d8bf7c10-6419-4524-8db2-9bd298783885 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:43.210448 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d8bf7c10-6419-4524-8db2-9bd298783885 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:43.232174 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8bf7c10-6419-4524-8db2-9bd298783885 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:43.232820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8bf7c10-6419-4524-8db2-9bd298783885 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:43.234193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8bf7c10-6419-4524-8db2-9bd298783885 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:43.234647 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8bf7c10-6419-4524-8db2-9bd298783885 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:43.266600 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:43.301447 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:43.736104 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d8bf7c10-6419-4524-8db2-9bd298783885 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:43.768875 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d8bf7c10-6419-4524-8db2-9bd298783885 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.566534 Jul 31 01:11:43.769801 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 665/1332] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:43 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:43.880077 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ffeaf41b-1434-457c-8f1d-8c9ab2c84767 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:43.889222 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ffeaf41b-1434-457c-8f1d-8c9ab2c84767 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1476 microversion: 2.1 time: 0.806973 Jul 31 01:11:43.890380 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 668/1333] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:43 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1476 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:43.905012 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7e25aea6-b2d0-4758-8149-aff6f54fe615 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:43.907771 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7e25aea6-b2d0-4758-8149-aff6f54fe615 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:43.931160 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e25aea6-b2d0-4758-8149-aff6f54fe615 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:43.931948 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e25aea6-b2d0-4758-8149-aff6f54fe615 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:43.932964 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e25aea6-b2d0-4758-8149-aff6f54fe615 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:43.933731 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e25aea6-b2d0-4758-8149-aff6f54fe615 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:43.948063 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-7c023b94-28a1-4a2e-8dcf-9c0627b3fa28 req-4337fffa-8d3e-42c5-9931-6fec8b78f1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011dbabc-56cc-4f90-be60-972ffeb468b1", "tag": "4bf6b045-f27a-43d0-a436-872ac90dc24a"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:43.966035 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:43.983297 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7c023b94-28a1-4a2e-8dcf-9c0627b3fa28 req-4337fffa-8d3e-42c5-9931-6fec8b78f1e4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:43.984925 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7c023b94-28a1-4a2e-8dcf-9c0627b3fa28 req-4337fffa-8d3e-42c5-9931-6fec8b78f1e4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:44.024699 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-7c023b94-28a1-4a2e-8dcf-9c0627b3fa28 req-4337fffa-8d3e-42c5-9931-6fec8b78f1e4 service nova] Creating event network-changed:4bf6b045-f27a-43d0-a436-872ac90dc24a for instance 011dbabc-56cc-4f90-be60-972ffeb468b1 on n-h1-master-1 Jul 31 01:11:44.039529 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-7c023b94-28a1-4a2e-8dcf-9c0627b3fa28 req-4337fffa-8d3e-42c5-9931-6fec8b78f1e4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267340 Jul 31 01:11:44.042521 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 666/1334] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:44.079723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e2fbe31-88e0-4e4f-9720-3ae50b8b94ff tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede5911550>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:44.931636 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7e25aea6-b2d0-4758-8149-aff6f54fe615 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:44.953217 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7e25aea6-b2d0-4758-8149-aff6f54fe615 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 200 len: 1472 microversion: 2.1 time: 1.050844 Jul 31 01:11:44.954199 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 669/1335] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:43 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 1472 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:44.961965 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9e94e14b-ecc2-4ecf-8602-17d88cce6778 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '.version_select at 0x7fedeaa53a60>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:44.975127 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e94e14b-ecc2-4ecf-8602-17d88cce6778 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:44.976534 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e94e14b-ecc2-4ecf-8602-17d88cce6778 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:45.010893 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9e94e14b-ecc2-4ecf-8602-17d88cce6778 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 4474 microversion: 2.25 time: 0.053998 Jul 31 01:11:45.014178 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 670/1336] 10.222.0.45 () {60 vars in 1184 bytes} [Sun Jul 31 01:11:44 2022] GET /compute/v2.1/os-migrations => generated 4474 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:45.020663 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bc847a57-28bd-4879-998a-6f7ca719671d tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:45.021592 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bc847a57-28bd-4879-998a-6f7ca719671d tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:45.045015 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc847a57-28bd-4879-998a-6f7ca719671d tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:45.047438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc847a57-28bd-4879-998a-6f7ca719671d tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:45.048720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc847a57-28bd-4879-998a-6f7ca719671d tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:45.051847 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc847a57-28bd-4879-998a-6f7ca719671d tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:45.944118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bc847a57-28bd-4879-998a-6f7ca719671d tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:45.957886 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bc847a57-28bd-4879-998a-6f7ca719671d tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1334 microversion: 2.1 time: 0.941214 Jul 31 01:11:45.974351 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 671/1337] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:45 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1334 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:45.979254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c8c28efd-3ff3-4e55-9599-5650f1187a2a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa53ca0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:46.060774 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c8c28efd-3ff3-4e55-9599-5650f1187a2a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.085121 Jul 31 01:11:46.067377 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 672/1338] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:45 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:46.077390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-98012c4e-1e8d-482c-ade2-15df8b3baacc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:46.078133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-98012c4e-1e8d-482c-ade2-15df8b3baacc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:46.098931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98012c4e-1e8d-482c-ade2-15df8b3baacc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:46.105970 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98012c4e-1e8d-482c-ade2-15df8b3baacc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:46.107081 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98012c4e-1e8d-482c-ade2-15df8b3baacc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:46.107612 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98012c4e-1e8d-482c-ade2-15df8b3baacc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:46.242748 n-d-master-1 devstack@n-api.service[119475]: DEBUG neutronclient.v2_0.client [None req-3e2fbe31-88e0-4e4f-9720-3ae50b8b94ff tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 579b1ee4-17da-43d9-8126-f1350c83531a in use.", "detail": ""}} {{(pid=119475) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:11:46.243627 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-3e2fbe31-88e0-4e4f-9720-3ae50b8b94ff tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] HTTP exception thrown: Security Group 579b1ee4-17da-43d9-8126-f1350c83531a in use. Jul 31 01:11:46.243627 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-91774cb3-5d5c-43fe-bd26-8e0829b44b5a'] Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e2fbe31-88e0-4e4f-9720-3ae50b8b94ff tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Request method failure captured: Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/os-security-groups/579b1ee4-17da-43d9-8126-f1350c83531a HTTP/1.1 Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dZ4RROZmvNHgk8nkEPCHEOtKeymvD8aJkYSffUh8bqh37RpmNHALtgJw0W3wgMu6HJwqcBFxL8fLuKg63WTseMOWT3m6KTBzl-wHxPxejmdZtFZxPmexVFKQ3mNYzDtb_uVYFrMpBX3R40pkmpf04xAyZo3K5gfwBnL_o_UQmcBzKE Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a45cfeb1ce9844c5bf16e975af312ba0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: e3e6a158c3884c8db5a66fe80e71527d Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: exception: Security Group 579b1ee4-17da-43d9-8126-f1350c83531a in use. Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-91774cb3-5d5c-43fe-bd26-8e0829b44b5a'] Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '579b1ee4-17da-43d9-8126-f1350c83531a'} Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:11:46.246397 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 579b1ee4-17da-43d9-8126-f1350c83531a in use. Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91774cb3-5d5c-43fe-bd26-8e0829b44b5a'] Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 579b1ee4-17da-43d9-8126-f1350c83531a in use. Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91774cb3-5d5c-43fe-bd26-8e0829b44b5a'] Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 579b1ee4-17da-43d9-8126-f1350c83531a in use. Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91774cb3-5d5c-43fe-bd26-8e0829b44b5a'] Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 579b1ee4-17da-43d9-8126-f1350c83531a in use. Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91774cb3-5d5c-43fe-bd26-8e0829b44b5a'] Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e2fbe31-88e0-4e4f-9720-3ae50b8b94ff tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Returning 400 to user: Security Group 579b1ee4-17da-43d9-8126-f1350c83531a in use. Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-91774cb3-5d5c-43fe-bd26-8e0829b44b5a'] {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3e2fbe31-88e0-4e4f-9720-3ae50b8b94ff tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/579b1ee4-17da-43d9-8126-f1350c83531a" status: 400 len: 185 microversion: 2.1 time: 2.183472 Jul 31 01:11:46.253165 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 667/1339] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:11:44 2022] DELETE /compute/v2.1/os-security-groups/579b1ee4-17da-43d9-8126-f1350c83531a => generated 185 bytes in 2186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:11:46.262652 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-99616703-bcd4-4e49-b2c6-7b35477e9394 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:46.263484 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-99616703-bcd4-4e49-b2c6-7b35477e9394 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:46.283819 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99616703-bcd4-4e49-b2c6-7b35477e9394 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:46.284232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99616703-bcd4-4e49-b2c6-7b35477e9394 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:46.286731 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99616703-bcd4-4e49-b2c6-7b35477e9394 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:46.287192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99616703-bcd4-4e49-b2c6-7b35477e9394 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:46.350139 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:46.605675 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-98012c4e-1e8d-482c-ade2-15df8b3baacc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:46.616194 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-98012c4e-1e8d-482c-ade2-15df8b3baacc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.553044 Jul 31 01:11:46.618414 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 673/1340] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:46 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:46.628712 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7e7d5561-6bee-4216-bd9e-fc43bc5233d1 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:46.632054 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7e7d5561-6bee-4216-bd9e-fc43bc5233d1 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:46.646473 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e7d5561-6bee-4216-bd9e-fc43bc5233d1 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:46.648912 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e7d5561-6bee-4216-bd9e-fc43bc5233d1 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:46.650563 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e7d5561-6bee-4216-bd9e-fc43bc5233d1 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:46.657594 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e7d5561-6bee-4216-bd9e-fc43bc5233d1 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:46.755770 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-99616703-bcd4-4e49-b2c6-7b35477e9394 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:46.768190 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-99616703-bcd4-4e49-b2c6-7b35477e9394 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1474 microversion: 2.1 time: 0.514733 Jul 31 01:11:46.768821 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 668/1341] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:46 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1474 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:46.786337 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-cbea8d14-8ef5-4203-91d3-30eac3965d54 req-1b384cee-eefe-4baa-91aa-5b8003687413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca134f6-3529-47bd-830d-0ab1b9b69775", "tag": "892a1aa4-8477-4cee-9b84-a969a734fcbf"}, {"name": "network-changed", "server_uuid": "eafdd229-897b-4b1f-adfc-3d7bb4fef7a0", "tag": "5ee707da-030a-4991-809c-69f12af3f140"}, {"server_uuid": "9ee3254c-a165-4285-86f1-c9d1d7a81e4f", "name": "network-vif-deleted", "tag": "ec3696c1-fc35-410b-b1de-dee47f614ca2"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:46.808319 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-cbea8d14-8ef5-4203-91d3-30eac3965d54 req-1b384cee-eefe-4baa-91aa-5b8003687413 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:46.808801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-cbea8d14-8ef5-4203-91d3-30eac3965d54 req-1b384cee-eefe-4baa-91aa-5b8003687413 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:46.849070 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-cbea8d14-8ef5-4203-91d3-30eac3965d54 req-1b384cee-eefe-4baa-91aa-5b8003687413 service nova] Creating event network-changed:892a1aa4-8477-4cee-9b84-a969a734fcbf for instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 on n-h1-master-1 Jul 31 01:11:46.849588 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-cbea8d14-8ef5-4203-91d3-30eac3965d54 req-1b384cee-eefe-4baa-91aa-5b8003687413 service nova] Creating event network-changed:5ee707da-030a-4991-809c-69f12af3f140 for instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 on n-h1-master-1 Jul 31 01:11:46.850101 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-cbea8d14-8ef5-4203-91d3-30eac3965d54 req-1b384cee-eefe-4baa-91aa-5b8003687413 service nova] Creating event network-vif-deleted:ec3696c1-fc35-410b-b1de-dee47f614ca2 for instance 9ee3254c-a165-4285-86f1-c9d1d7a81e4f on n-h1-master-1 Jul 31 01:11:46.864448 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-cbea8d14-8ef5-4203-91d3-30eac3965d54 req-1b384cee-eefe-4baa-91aa-5b8003687413 service nova] Instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:11:46.912069 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-cbea8d14-8ef5-4203-91d3-30eac3965d54 req-1b384cee-eefe-4baa-91aa-5b8003687413 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.139822 Jul 31 01:11:46.913175 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 669/1342] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:46.922356 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d2542a0a-c52c-4733-aec4-1d56d14d1a94 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:46.923681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d2542a0a-c52c-4733-aec4-1d56d14d1a94 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 9ee3254c-a165-4285-86f1-c9d1d7a81e4f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:46.961669 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2542a0a-c52c-4733-aec4-1d56d14d1a94 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:46.966234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2542a0a-c52c-4733-aec4-1d56d14d1a94 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:46.968790 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2542a0a-c52c-4733-aec4-1d56d14d1a94 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:46.969378 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2542a0a-c52c-4733-aec4-1d56d14d1a94 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:47.012137 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-d2542a0a-c52c-4733-aec4-1d56d14d1a94 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] HTTP exception thrown: Instance 9ee3254c-a165-4285-86f1-c9d1d7a81e4f could not be found. Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d2542a0a-c52c-4733-aec4-1d56d14d1a94 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Request method failure captured: Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f HTTP/1.1 Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dXvczrjV93XGTog32ZhLWWtba7dtc274nDtU8E1Fg1kaFfSFTu1mOthIsPp5iOJofIsjlZdSwTbjyj2LE7DPBnmjox8fqRCUbcXosGLpS7nCLvEC8_927gD0PLQuRdewtttI4lKyEun5DpT6VtlLkZ534cOYIJ9M_YWbga0UOFAT7s Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: ba602c4ed5b94aad996ef8c95d3436ba Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ba602c4ed5b94aad996ef8c95d3436ba", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: ba602c4ed5b94aad996ef8c95d3436ba Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersOnMultiNodesTest-46531715-project Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 0fad0a50973b44149c18ca2b76bfab36 Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersOnMultiNodesTest-46531715-project Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 9ee3254c-a165-4285-86f1-c9d1d7a81e4f could not be found. Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '9ee3254c-a165-4285-86f1-c9d1d7a81e4f'} Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee3254c-a165-4285-86f1-c9d1d7a81e4f could not be found. Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee3254c-a165-4285-86f1-c9d1d7a81e4f could not be found. Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:47.014130 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:47.019817 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:47.019817 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:47.019817 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:47.019817 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:11:47.019817 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:11:47.019817 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee3254c-a165-4285-86f1-c9d1d7a81e4f could not be found. Jul 31 01:11:47.019817 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:47.019817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d2542a0a-c52c-4733-aec4-1d56d14d1a94 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Returning 404 to user: Instance 9ee3254c-a165-4285-86f1-c9d1d7a81e4f could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:11:47.019817 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d2542a0a-c52c-4733-aec4-1d56d14d1a94 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f" status: 404 len: 111 microversion: 2.1 time: 0.102709 Jul 31 01:11:47.023651 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-7e7d5561-6bee-4216-bd9e-fc43bc5233d1 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'services' on Instance uuid 011dbabc-56cc-4f90-be60-972ffeb468b1 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:11:47.025572 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 670/1343] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:46 2022] GET /compute/v2.1/servers/9ee3254c-a165-4285-86f1-c9d1d7a81e4f => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:11:47.038686 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb912553-a61e-44fb-8d3f-e9821704e7e1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:47.047580 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fb912553-a61e-44fb-8d3f-e9821704e7e1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:47.064968 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7e7d5561-6bee-4216-bd9e-fc43bc5233d1 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 2420 microversion: 2.25 time: 0.439667 Jul 31 01:11:47.066707 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb912553-a61e-44fb-8d3f-e9821704e7e1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:47.066999 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb912553-a61e-44fb-8d3f-e9821704e7e1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:47.080430 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb912553-a61e-44fb-8d3f-e9821704e7e1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:47.080430 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb912553-a61e-44fb-8d3f-e9821704e7e1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:47.081304 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 674/1344] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:11:46 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 2420 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:11:47.105165 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b9a0a184-6248-41bb-9c2d-5bc208e54279 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:47.106126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b9a0a184-6248-41bb-9c2d-5bc208e54279 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:47.120613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9a0a184-6248-41bb-9c2d-5bc208e54279 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:47.122438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9a0a184-6248-41bb-9c2d-5bc208e54279 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:47.125745 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9a0a184-6248-41bb-9c2d-5bc208e54279 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:47.126407 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9a0a184-6248-41bb-9c2d-5bc208e54279 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:47.281969 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fb912553-a61e-44fb-8d3f-e9821704e7e1 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "POST /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775/action" status: 202 len: 0 microversion: 2.1 time: 0.254683 Jul 31 01:11:47.285679 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 671/1345] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:11:47 2022] POST /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:11:47.299993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e799956c-7437-4f05-91a0-8418e70e8fb5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:47.300593 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e799956c-7437-4f05-91a0-8418e70e8fb5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 4348d2b8-83d0-4ed1-a5db-c1c19d0948fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:47.316302 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e799956c-7437-4f05-91a0-8418e70e8fb5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:47.319531 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e799956c-7437-4f05-91a0-8418e70e8fb5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:47.321048 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e799956c-7437-4f05-91a0-8418e70e8fb5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:47.321934 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e799956c-7437-4f05-91a0-8418e70e8fb5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:47.420863 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e799956c-7437-4f05-91a0-8418e70e8fb5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 4348d2b8-83d0-4ed1-a5db-c1c19d0948fa] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:11:47.636749 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e799956c-7437-4f05-91a0-8418e70e8fb5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4348d2b8-83d0-4ed1-a5db-c1c19d0948fa" status: 204 len: 0 microversion: 2.1 time: 0.349011 Jul 31 01:11:47.640995 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 672/1346] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:11:47 2022] DELETE /compute/v2.1/servers/4348d2b8-83d0-4ed1-a5db-c1c19d0948fa => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:11:47.653845 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-704f9d84-6bcb-4e00-892c-a666d61d058c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede5a734c0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:47.708171 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b9a0a184-6248-41bb-9c2d-5bc208e54279 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:47.716521 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b9a0a184-6248-41bb-9c2d-5bc208e54279 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1334 microversion: 2.1 time: 0.633847 Jul 31 01:11:47.737019 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 675/1347] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:47 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1334 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:47.770074 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-58429563-e124-4813-abd1-a88054240a47 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:47.770827 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-58429563-e124-4813-abd1-a88054240a47 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:47.781285 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58429563-e124-4813-abd1-a88054240a47 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:47.781733 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58429563-e124-4813-abd1-a88054240a47 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:47.782534 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58429563-e124-4813-abd1-a88054240a47 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:47.782977 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58429563-e124-4813-abd1-a88054240a47 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:47.783788 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-704f9d84-6bcb-4e00-892c-a666d61d058c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.141214 Jul 31 01:11:47.786478 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 673/1348] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:47 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:47.819500 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7b97b303-e33d-415e-85f9-5a884277929a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:47.823416 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7b97b303-e33d-415e-85f9-5a884277929a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:47.837346 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b97b303-e33d-415e-85f9-5a884277929a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:47.837812 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b97b303-e33d-415e-85f9-5a884277929a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:47.838981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b97b303-e33d-415e-85f9-5a884277929a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:47.849121 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b97b303-e33d-415e-85f9-5a884277929a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:48.010211 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-58429563-e124-4813-abd1-a88054240a47 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lazy-loading 'services' on Instance uuid 011dbabc-56cc-4f90-be60-972ffeb468b1 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:11:48.272505 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-58429563-e124-4813-abd1-a88054240a47 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "DELETE /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-volume_attachments/be1a1dac-60e9-4a6f-911c-0a7b5d0e52e4" status: 202 len: 0 microversion: 2.25 time: 0.526133 Jul 31 01:11:48.274471 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 676/1349] 10.222.0.45 () {60 vars in 1457 bytes} [Sun Jul 31 01:11:47 2022] DELETE /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-volume_attachments/be1a1dac-60e9-4a6f-911c-0a7b5d0e52e4 => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:11:48.290301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d5ddc357-7994-4b0a-818c-0950041df7a4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:48.296770 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d5ddc357-7994-4b0a-818c-0950041df7a4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:48.319744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5ddc357-7994-4b0a-818c-0950041df7a4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:48.321751 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5ddc357-7994-4b0a-818c-0950041df7a4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:48.323954 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5ddc357-7994-4b0a-818c-0950041df7a4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:48.326950 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5ddc357-7994-4b0a-818c-0950041df7a4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:48.603513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7b97b303-e33d-415e-85f9-5a884277929a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:48.622209 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7b97b303-e33d-415e-85f9-5a884277929a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1575 microversion: 2.1 time: 0.824035 Jul 31 01:11:48.623181 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 674/1350] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:47 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1575 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:48.664024 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0d47255d-0fe0-4939-859b-7e04cd08d414 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:48.664616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0d47255d-0fe0-4939-859b-7e04cd08d414 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:48.685183 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d47255d-0fe0-4939-859b-7e04cd08d414 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:48.687261 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d47255d-0fe0-4939-859b-7e04cd08d414 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:48.689494 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d47255d-0fe0-4939-859b-7e04cd08d414 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:48.692211 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d47255d-0fe0-4939-859b-7e04cd08d414 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:48.776353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0d47255d-0fe0-4939-859b-7e04cd08d414 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:11:48.931899 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d5ddc357-7994-4b0a-818c-0950041df7a4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:48.948269 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d5ddc357-7994-4b0a-818c-0950041df7a4 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.671716 Jul 31 01:11:48.963027 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 677/1351] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:48 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:48.984276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8f7b118f-8d53-43a5-b7e7-dc92148b1317 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:49.001127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8f7b118f-8d53-43a5-b7e7-dc92148b1317 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:49.005847 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:49.031584 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f7b118f-8d53-43a5-b7e7-dc92148b1317 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:49.032111 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f7b118f-8d53-43a5-b7e7-dc92148b1317 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:49.033231 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f7b118f-8d53-43a5-b7e7-dc92148b1317 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:49.035094 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f7b118f-8d53-43a5-b7e7-dc92148b1317 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:49.088970 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0d47255d-0fe0-4939-859b-7e04cd08d414 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "DELETE /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7" status: 204 len: 0 microversion: 2.1 time: 0.437468 Jul 31 01:11:49.095161 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 675/1352] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:11:48 2022] DELETE /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:11:49.110142 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-97f25e3c-f769-4c0a-8caa-069def5c1b2e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:49.128383 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-97f25e3c-f769-4c0a-8caa-069def5c1b2e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:49.141492 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97f25e3c-f769-4c0a-8caa-069def5c1b2e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:49.142205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97f25e3c-f769-4c0a-8caa-069def5c1b2e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:49.143208 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97f25e3c-f769-4c0a-8caa-069def5c1b2e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:49.144076 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97f25e3c-f769-4c0a-8caa-069def5c1b2e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:49.182435 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-97f25e3c-f769-4c0a-8caa-069def5c1b2e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.085071 Jul 31 01:11:49.183136 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 676/1353] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:11:49 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:11:49.188606 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-62049247-0332-4ed2-8f89-f2a718ec5d64 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:49.189345 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-62049247-0332-4ed2-8f89-f2a718ec5d64 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:49.197955 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-62049247-0332-4ed2-8f89-f2a718ec5d64 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:49.198590 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-62049247-0332-4ed2-8f89-f2a718ec5d64 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:49.199468 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-62049247-0332-4ed2-8f89-f2a718ec5d64 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:49.200001 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-62049247-0332-4ed2-8f89-f2a718ec5d64 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:49.928116 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8f7b118f-8d53-43a5-b7e7-dc92148b1317 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:49.939147 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8f7b118f-8d53-43a5-b7e7-dc92148b1317 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1471 microversion: 2.1 time: 0.973052 Jul 31 01:11:49.940105 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 678/1354] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:48 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1471 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:49.945957 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-98b1efe9-4ab3-4d9b-bc4d-5b73e63dcd25 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa40f70>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:50.026970 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-62049247-0332-4ed2-8f89-f2a718ec5d64 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:50.042403 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-62049247-0332-4ed2-8f89-f2a718ec5d64 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1334 microversion: 2.1 time: 0.856733 Jul 31 01:11:50.044713 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 677/1355] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:49 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1334 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:50.052890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-70e86373-6897-4b9d-9beb-107509f39a21 req-6c880d4a-5d6c-416a-9c55-887299e0ff39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1f8550-6240-420b-8abf-9b5e9a8ebc2e", "tag": "bf4873a9-1b81-48c0-bd3c-75d71fb62cd0"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:50.066897 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-70e86373-6897-4b9d-9beb-107509f39a21 req-6c880d4a-5d6c-416a-9c55-887299e0ff39 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:50.067993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-70e86373-6897-4b9d-9beb-107509f39a21 req-6c880d4a-5d6c-416a-9c55-887299e0ff39 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:50.089052 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-70e86373-6897-4b9d-9beb-107509f39a21 req-6c880d4a-5d6c-416a-9c55-887299e0ff39 service nova] Creating event network-changed:bf4873a9-1b81-48c0-bd3c-75d71fb62cd0 for instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e on n-h2-master-1 Jul 31 01:11:50.098266 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-70e86373-6897-4b9d-9beb-107509f39a21 req-6c880d4a-5d6c-416a-9c55-887299e0ff39 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050429 Jul 31 01:11:50.099872 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 678/1356] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:50.106438 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-29a5c883-5db2-49ef-9a81-a1cfc9477fa4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:50.107665 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-29a5c883-5db2-49ef-9a81-a1cfc9477fa4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 4348d2b8-83d0-4ed1-a5db-c1c19d0948fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:50.142462 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-98b1efe9-4ab3-4d9b-bc4d-5b73e63dcd25 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.193306 Jul 31 01:11:50.147160 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 679/1357] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:49 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:50.149031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29a5c883-5db2-49ef-9a81-a1cfc9477fa4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:50.150866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29a5c883-5db2-49ef-9a81-a1cfc9477fa4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:50.155106 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29a5c883-5db2-49ef-9a81-a1cfc9477fa4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:50.156428 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29a5c883-5db2-49ef-9a81-a1cfc9477fa4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:50.163285 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-babe80aa-527e-4673-a7c1-b5a2de0c0091 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:50.180725 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-babe80aa-527e-4673-a7c1-b5a2de0c0091 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:50.236441 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-babe80aa-527e-4673-a7c1-b5a2de0c0091 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:50.248044 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-babe80aa-527e-4673-a7c1-b5a2de0c0091 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:50.254285 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-babe80aa-527e-4673-a7c1-b5a2de0c0091 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:50.265391 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-babe80aa-527e-4673-a7c1-b5a2de0c0091 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:50.741374 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-29a5c883-5db2-49ef-9a81-a1cfc9477fa4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:50.758006 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-29a5c883-5db2-49ef-9a81-a1cfc9477fa4 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/4348d2b8-83d0-4ed1-a5db-c1c19d0948fa" status: 200 len: 1475 microversion: 2.1 time: 0.656448 Jul 31 01:11:50.771448 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 679/1358] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:50 2022] GET /compute/v2.1/servers/4348d2b8-83d0-4ed1-a5db-c1c19d0948fa => generated 1475 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:50.781768 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f5ad8a8c-64d7-4799-92c0-db06a5e48c08 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:50.782704 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f5ad8a8c-64d7-4799-92c0-db06a5e48c08 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:50.790022 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5ad8a8c-64d7-4799-92c0-db06a5e48c08 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:50.790942 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5ad8a8c-64d7-4799-92c0-db06a5e48c08 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:50.792477 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5ad8a8c-64d7-4799-92c0-db06a5e48c08 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:50.793173 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5ad8a8c-64d7-4799-92c0-db06a5e48c08 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:51.117771 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f5ad8a8c-64d7-4799-92c0-db06a5e48c08 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "POST /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0/action" status: 202 len: 0 microversion: 2.1 time: 0.341160 Jul 31 01:11:51.122248 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 680/1359] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:11:50 2022] POST /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:11:51.133783 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-002bdb4a-47a7-489b-b25e-1093130d44cb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:51.134600 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-002bdb4a-47a7-489b-b25e-1093130d44cb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:51.154252 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-002bdb4a-47a7-489b-b25e-1093130d44cb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:51.162521 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-002bdb4a-47a7-489b-b25e-1093130d44cb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:51.162926 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-002bdb4a-47a7-489b-b25e-1093130d44cb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:51.163218 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-002bdb4a-47a7-489b-b25e-1093130d44cb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:51.249773 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:51.408844 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-babe80aa-527e-4673-a7c1-b5a2de0c0091 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:51.442661 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-babe80aa-527e-4673-a7c1-b5a2de0c0091 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1575 microversion: 2.1 time: 1.292027 Jul 31 01:11:51.444971 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 680/1360] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:50 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1575 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:51.514196 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3b0d39df-21bd-4534-b62d-d8ceaba232e0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:51.530348 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3b0d39df-21bd-4534-b62d-d8ceaba232e0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:51.572646 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b0d39df-21bd-4534-b62d-d8ceaba232e0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:51.574288 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b0d39df-21bd-4534-b62d-d8ceaba232e0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:51.579008 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b0d39df-21bd-4534-b62d-d8ceaba232e0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:51.585671 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b0d39df-21bd-4534-b62d-d8ceaba232e0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:51.693902 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:51.817293 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3b0d39df-21bd-4534-b62d-d8ceaba232e0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.355936 Jul 31 01:11:51.827643 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 681/1361] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:11:51 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-volume_attachments => generated 197 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:11:51.851553 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3e815a8f-1f08-4996-9010-63606b70ad0e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:51.852744 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3e815a8f-1f08-4996-9010-63606b70ad0e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:51.890585 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e815a8f-1f08-4996-9010-63606b70ad0e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:51.895524 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e815a8f-1f08-4996-9010-63606b70ad0e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:51.899620 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e815a8f-1f08-4996-9010-63606b70ad0e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:51.908790 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e815a8f-1f08-4996-9010-63606b70ad0e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:51.986466 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-002bdb4a-47a7-489b-b25e-1093130d44cb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:52.005422 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-002bdb4a-47a7-489b-b25e-1093130d44cb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.881477 Jul 31 01:11:52.006032 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 681/1362] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:51 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:52.043724 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ab6a43e8-79eb-43b7-a978-f6268f58f0ba tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:52.044703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ab6a43e8-79eb-43b7-a978-f6268f58f0ba tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:52.057704 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab6a43e8-79eb-43b7-a978-f6268f58f0ba tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:52.058454 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab6a43e8-79eb-43b7-a978-f6268f58f0ba tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:52.059494 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab6a43e8-79eb-43b7-a978-f6268f58f0ba tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:52.060184 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab6a43e8-79eb-43b7-a978-f6268f58f0ba tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:53.328915 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ab6a43e8-79eb-43b7-a978-f6268f58f0ba tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:53.340329 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ab6a43e8-79eb-43b7-a978-f6268f58f0ba tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1470 microversion: 2.1 time: 1.331447 Jul 31 01:11:53.351444 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 682/1363] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:52 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1470 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:53.367372 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bfbf4588-3cc7-46de-86c9-df6d83dfb77b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede5632a60>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:53.473810 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bfbf4588-3cc7-46de-86c9-df6d83dfb77b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.128440 Jul 31 01:11:53.480813 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 683/1364] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:53 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:53.492523 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3e815a8f-1f08-4996-9010-63606b70ad0e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:53.504672 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3e815a8f-1f08-4996-9010-63606b70ad0e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1334 microversion: 2.1 time: 1.673122 Jul 31 01:11:53.521385 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f5b8af44-0e84-46fb-a720-4a7f1ee005a7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:53.524751 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f5b8af44-0e84-46fb-a720-4a7f1ee005a7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 4348d2b8-83d0-4ed1-a5db-c1c19d0948fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:53.528465 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 682/1365] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:51 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1334 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:53.548871 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5b8af44-0e84-46fb-a720-4a7f1ee005a7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:53.549728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5b8af44-0e84-46fb-a720-4a7f1ee005a7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:53.550801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5b8af44-0e84-46fb-a720-4a7f1ee005a7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:53.551588 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5b8af44-0e84-46fb-a720-4a7f1ee005a7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:53.556778 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-d9beca66-8227-44fb-b4ad-d60e87d2dde1 req-8046600e-2ecb-48a9-ae84-a155487605f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1f8550-6240-420b-8abf-9b5e9a8ebc2e", "tag": "7550470f-2bfc-4a0c-9188-0112084064b5"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:53.604593 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-f5b8af44-0e84-46fb-a720-4a7f1ee005a7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] HTTP exception thrown: Instance 4348d2b8-83d0-4ed1-a5db-c1c19d0948fa could not be found. Jul 31 01:11:53.605515 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d9beca66-8227-44fb-b4ad-d60e87d2dde1 req-8046600e-2ecb-48a9-ae84-a155487605f0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:53.605973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d9beca66-8227-44fb-b4ad-d60e87d2dde1 req-8046600e-2ecb-48a9-ae84-a155487605f0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f5b8af44-0e84-46fb-a720-4a7f1ee005a7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Request method failure captured: Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/4348d2b8-83d0-4ed1-a5db-c1c19d0948fa HTTP/1.1 Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dXvczrjV93XGTog32ZhLWWtba7dtc274nDtU8E1Fg1kaFfSFTu1mOthIsPp5iOJofIsjlZdSwTbjyj2LE7DPBnmjox8fqRCUbcXosGLpS7nCLvEC8_927gD0PLQuRdewtttI4lKyEun5DpT6VtlLkZ534cOYIJ9M_YWbga0UOFAT7s Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: ba602c4ed5b94aad996ef8c95d3436ba Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ba602c4ed5b94aad996ef8c95d3436ba", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: ba602c4ed5b94aad996ef8c95d3436ba Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersOnMultiNodesTest-46531715-project Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 0fad0a50973b44149c18ca2b76bfab36 Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersOnMultiNodesTest-46531715-project Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 4348d2b8-83d0-4ed1-a5db-c1c19d0948fa could not be found. Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '4348d2b8-83d0-4ed1-a5db-c1c19d0948fa'} Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4348d2b8-83d0-4ed1-a5db-c1c19d0948fa could not be found. Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4348d2b8-83d0-4ed1-a5db-c1c19d0948fa could not be found. Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:53.612607 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:53.617947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:53.617947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:53.617947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:53.617947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:11:53.617947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:11:53.617947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4348d2b8-83d0-4ed1-a5db-c1c19d0948fa could not be found. Jul 31 01:11:53.617947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:11:53.622864 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f5b8af44-0e84-46fb-a720-4a7f1ee005a7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Returning 404 to user: Instance 4348d2b8-83d0-4ed1-a5db-c1c19d0948fa could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:11:53.624497 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f5b8af44-0e84-46fb-a720-4a7f1ee005a7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/4348d2b8-83d0-4ed1-a5db-c1c19d0948fa" status: 404 len: 111 microversion: 2.1 time: 0.142251 Jul 31 01:11:53.625592 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 684/1366] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:53 2022] GET /compute/v2.1/servers/4348d2b8-83d0-4ed1-a5db-c1c19d0948fa => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:11:53.637284 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-6dc36112-69da-4a16-97a6-2fe96e46433a req-29abedb5-cd5b-4aa3-bcc8-8bb61b056f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4348d2b8-83d0-4ed1-a5db-c1c19d0948fa", "name": "network-vif-deleted", "tag": "caeac7e0-bb03-4fd5-86ff-b2e76cb264fc"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:53.669244 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6dc36112-69da-4a16-97a6-2fe96e46433a req-29abedb5-cd5b-4aa3-bcc8-8bb61b056f42 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:53.671519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6dc36112-69da-4a16-97a6-2fe96e46433a req-29abedb5-cd5b-4aa3-bcc8-8bb61b056f42 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:53.684060 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-d9beca66-8227-44fb-b4ad-d60e87d2dde1 req-8046600e-2ecb-48a9-ae84-a155487605f0 service nova] Creating event network-changed:7550470f-2bfc-4a0c-9188-0112084064b5 for instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e on n-h2-master-1 Jul 31 01:11:53.701419 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-d9beca66-8227-44fb-b4ad-d60e87d2dde1 req-8046600e-2ecb-48a9-ae84-a155487605f0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166930 Jul 31 01:11:53.709017 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-6dc36112-69da-4a16-97a6-2fe96e46433a req-29abedb5-cd5b-4aa3-bcc8-8bb61b056f42 service nova] Creating event network-vif-deleted:caeac7e0-bb03-4fd5-86ff-b2e76cb264fc for instance 4348d2b8-83d0-4ed1-a5db-c1c19d0948fa on n-h2-master-1 Jul 31 01:11:53.709392 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 683/1367] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:53.727497 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-6dc36112-69da-4a16-97a6-2fe96e46433a req-29abedb5-cd5b-4aa3-bcc8-8bb61b056f42 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094849 Jul 31 01:11:53.729613 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 685/1368] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:53.733924 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a3ee3076-a641-4b19-94a0-64c7b8d7ef96 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:53.737600 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a3ee3076-a641-4b19-94a0-64c7b8d7ef96 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:53.744035 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-431a9e46-7f80-4142-acde-98e3aca57143 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:53.748946 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-431a9e46-7f80-4142-acde-98e3aca57143 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:53.774813 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-431a9e46-7f80-4142-acde-98e3aca57143 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:53.777087 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-431a9e46-7f80-4142-acde-98e3aca57143 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:53.778215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-431a9e46-7f80-4142-acde-98e3aca57143 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:53.778670 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3ee3076-a641-4b19-94a0-64c7b8d7ef96 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:53.780609 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-431a9e46-7f80-4142-acde-98e3aca57143 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:53.782399 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3ee3076-a641-4b19-94a0-64c7b8d7ef96 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:53.784691 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3ee3076-a641-4b19-94a0-64c7b8d7ef96 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:53.789445 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3ee3076-a641-4b19-94a0-64c7b8d7ef96 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:53.918382 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-431a9e46-7f80-4142-acde-98e3aca57143 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.187283 Jul 31 01:11:53.927569 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 686/1369] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:11:53 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:11:53.937450 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-84a42095-80e2-4266-a7f8-6cd69dc3f66b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:53.938375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-84a42095-80e2-4266-a7f8-6cd69dc3f66b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:53.950769 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-84a42095-80e2-4266-a7f8-6cd69dc3f66b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:53.951413 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-84a42095-80e2-4266-a7f8-6cd69dc3f66b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:53.954512 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-84a42095-80e2-4266-a7f8-6cd69dc3f66b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:53.954512 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-84a42095-80e2-4266-a7f8-6cd69dc3f66b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:54.660361 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a3ee3076-a641-4b19-94a0-64c7b8d7ef96 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:54.672625 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a3ee3076-a641-4b19-94a0-64c7b8d7ef96 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1575 microversion: 2.1 time: 0.957003 Jul 31 01:11:54.687099 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 684/1370] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:53 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1575 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:54.697544 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0d358d92-10b3-4b16-ad15-f26aee6a200b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:54.698179 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0d358d92-10b3-4b16-ad15-f26aee6a200b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:54.713414 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d358d92-10b3-4b16-ad15-f26aee6a200b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:54.716491 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d358d92-10b3-4b16-ad15-f26aee6a200b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:54.719147 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d358d92-10b3-4b16-ad15-f26aee6a200b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:54.720650 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d358d92-10b3-4b16-ad15-f26aee6a200b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:54.757834 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-84a42095-80e2-4266-a7f8-6cd69dc3f66b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:54.777991 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-84a42095-80e2-4266-a7f8-6cd69dc3f66b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.845813 Jul 31 01:11:54.780989 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 687/1371] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:53 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:54.902855 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-bc72569d-f705-4e6a-8ff8-24e5310f5e3a req-4d0ed415-9953-459d-9e5d-481900131009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eafdd229-897b-4b1f-adfc-3d7bb4fef7a0", "name": "network-vif-plugged", "status": "completed", "tag": "5ee707da-030a-4991-809c-69f12af3f140"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:54.936267 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-bc72569d-f705-4e6a-8ff8-24e5310f5e3a req-4d0ed415-9953-459d-9e5d-481900131009 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:54.947395 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-bc72569d-f705-4e6a-8ff8-24e5310f5e3a req-4d0ed415-9953-459d-9e5d-481900131009 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:54.979947 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-bc72569d-f705-4e6a-8ff8-24e5310f5e3a req-4d0ed415-9953-459d-9e5d-481900131009 service nova] Creating event network-vif-plugged:5ee707da-030a-4991-809c-69f12af3f140 for instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 on n-h1-master-1 Jul 31 01:11:54.989555 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-bc72569d-f705-4e6a-8ff8-24e5310f5e3a req-4d0ed415-9953-459d-9e5d-481900131009 service nova] Instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:11:55.016662 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-bc72569d-f705-4e6a-8ff8-24e5310f5e3a req-4d0ed415-9953-459d-9e5d-481900131009 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234070 Jul 31 01:11:55.020320 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 688/1372] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:55.026319 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc60fde0-3e6f-4c23-bb6c-d0f7644dc182 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:55.027039 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc60fde0-3e6f-4c23-bb6c-d0f7644dc182 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:55.034692 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc60fde0-3e6f-4c23-bb6c-d0f7644dc182 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:55.035521 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc60fde0-3e6f-4c23-bb6c-d0f7644dc182 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:55.036345 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc60fde0-3e6f-4c23-bb6c-d0f7644dc182 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:55.036795 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc60fde0-3e6f-4c23-bb6c-d0f7644dc182 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:55.396768 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0d358d92-10b3-4b16-ad15-f26aee6a200b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:55.408811 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0d358d92-10b3-4b16-ad15-f26aee6a200b tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7" status: 200 len: 1475 microversion: 2.1 time: 0.720441 Jul 31 01:11:55.409955 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 685/1373] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:54 2022] GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7 => generated 1475 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:55.415332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d8d1004f-31ca-4ecd-85c4-df0d0ec8c50d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede552e310>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:55.472826 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d8d1004f-31ca-4ecd-85c4-df0d0ec8c50d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.061412 Jul 31 01:11:55.473679 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 686/1374] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:55 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:55.480601 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2e152100-d1ac-459e-bfa7-29a4f62185c9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:55.481460 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2e152100-d1ac-459e-bfa7-29a4f62185c9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:55.491706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e152100-d1ac-459e-bfa7-29a4f62185c9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:55.492410 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e152100-d1ac-459e-bfa7-29a4f62185c9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:55.494216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e152100-d1ac-459e-bfa7-29a4f62185c9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:55.494848 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e152100-d1ac-459e-bfa7-29a4f62185c9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:56.039211 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fc60fde0-3e6f-4c23-bb6c-d0f7644dc182 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:56.050486 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc60fde0-3e6f-4c23-bb6c-d0f7644dc182 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1470 microversion: 2.1 time: 1.028829 Jul 31 01:11:56.062710 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 689/1375] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:55 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1470 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:56.072178 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c94753d8-a52b-4024-a3fd-ff81f9d09de3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:56.074572 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c94753d8-a52b-4024-a3fd-ff81f9d09de3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:56.082654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c94753d8-a52b-4024-a3fd-ff81f9d09de3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:56.083106 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c94753d8-a52b-4024-a3fd-ff81f9d09de3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:56.084074 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c94753d8-a52b-4024-a3fd-ff81f9d09de3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:56.084535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c94753d8-a52b-4024-a3fd-ff81f9d09de3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:56.152599 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c94753d8-a52b-4024-a3fd-ff81f9d09de3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.086530 Jul 31 01:11:56.154215 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 690/1376] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:11:56 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:11:56.159886 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b0866645-c21a-4284-852a-9f49f6719ab2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:56.160570 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b0866645-c21a-4284-852a-9f49f6719ab2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:56.167802 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0866645-c21a-4284-852a-9f49f6719ab2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:56.168313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0866645-c21a-4284-852a-9f49f6719ab2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:56.169103 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0866645-c21a-4284-852a-9f49f6719ab2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:56.169544 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0866645-c21a-4284-852a-9f49f6719ab2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:56.305729 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2e152100-d1ac-459e-bfa7-29a4f62185c9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:56.318759 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2e152100-d1ac-459e-bfa7-29a4f62185c9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1334 microversion: 2.1 time: 0.842918 Jul 31 01:11:56.319634 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 687/1377] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:55 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1334 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:56.338183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-40e3773c-677a-4a2b-8ceb-2dddc89070d9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:56.340877 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-40e3773c-677a-4a2b-8ceb-2dddc89070d9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:56.363089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-40e3773c-677a-4a2b-8ceb-2dddc89070d9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:56.363942 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-40e3773c-677a-4a2b-8ceb-2dddc89070d9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:56.364980 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-40e3773c-677a-4a2b-8ceb-2dddc89070d9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:56.365638 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-40e3773c-677a-4a2b-8ceb-2dddc89070d9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:56.437609 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b0866645-c21a-4284-852a-9f49f6719ab2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:56.499668 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b0866645-c21a-4284-852a-9f49f6719ab2 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1573 microversion: 2.1 time: 0.339806 Jul 31 01:11:56.503368 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 691/1378] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:56 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1573 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:56.533025 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2e1c83ca-5c1d-434c-9250-68dcbd011dae req-51d0471d-bddd-419a-bc1e-205c1bb86178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de60c7a5-098d-44cb-99f0-1dc80f148df7", "name": "network-vif-deleted", "tag": "eb60d01b-0896-4be2-ba48-c007231e1541"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:56.565629 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2e1c83ca-5c1d-434c-9250-68dcbd011dae req-51d0471d-bddd-419a-bc1e-205c1bb86178 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:56.569634 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2e1c83ca-5c1d-434c-9250-68dcbd011dae req-51d0471d-bddd-419a-bc1e-205c1bb86178 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:56.603109 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2e1c83ca-5c1d-434c-9250-68dcbd011dae req-51d0471d-bddd-419a-bc1e-205c1bb86178 service nova] Creating event network-vif-deleted:eb60d01b-0896-4be2-ba48-c007231e1541 for instance de60c7a5-098d-44cb-99f0-1dc80f148df7 on n-h1-master-1 Jul 31 01:11:56.625048 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2e1c83ca-5c1d-434c-9250-68dcbd011dae req-51d0471d-bddd-419a-bc1e-205c1bb86178 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120118 Jul 31 01:11:56.626407 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 692/1379] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:56.632569 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-582443ce-447b-4667-ad9a-5bd9df7b4a35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:56.634601 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-582443ce-447b-4667-ad9a-5bd9df7b4a35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:56.645526 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-582443ce-447b-4667-ad9a-5bd9df7b4a35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:56.646348 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-582443ce-447b-4667-ad9a-5bd9df7b4a35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:56.648421 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-582443ce-447b-4667-ad9a-5bd9df7b4a35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:56.656348 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-582443ce-447b-4667-ad9a-5bd9df7b4a35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:56.735405 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-582443ce-447b-4667-ad9a-5bd9df7b4a35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:56.735891 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-582443ce-447b-4667-ad9a-5bd9df7b4a35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:56.736367 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-582443ce-447b-4667-ad9a-5bd9df7b4a35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lazy-loading 'fault' on Instance uuid de60c7a5-098d-44cb-99f0-1dc80f148df7 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:11:56.901302 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-582443ce-447b-4667-ad9a-5bd9df7b4a35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:56.918931 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-582443ce-447b-4667-ad9a-5bd9df7b4a35 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7" status: 200 len: 1309 microversion: 2.1 time: 0.291058 Jul 31 01:11:56.920243 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 693/1380] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:56 2022] GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7 => generated 1309 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:56.928038 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eec89a58-810c-43ed-b111-c0d1d079f08d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede5af58b0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:56.999394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-40e3773c-677a-4a2b-8ceb-2dddc89070d9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:57.025065 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-40e3773c-677a-4a2b-8ceb-2dddc89070d9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.702042 Jul 31 01:11:57.028864 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 688/1381] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:56 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:57.042284 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eec89a58-810c-43ed-b111-c0d1d079f08d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.120404 Jul 31 01:11:57.046177 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 694/1382] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:56 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:57.048601 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-72910f99-6167-43d8-83b2-b8d5c349bcaf tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1537973729"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:57.049721 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-72910f99-6167-43d8-83b2-b8d5c349bcaf tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:57.060810 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72910f99-6167-43d8-83b2-b8d5c349bcaf tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:57.062329 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72910f99-6167-43d8-83b2-b8d5c349bcaf tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:57.063594 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72910f99-6167-43d8-83b2-b8d5c349bcaf tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:57.064252 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72910f99-6167-43d8-83b2-b8d5c349bcaf tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:57.075466 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fd42198d-7356-4f99-9921-ee8d59548bdc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:57.076106 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fd42198d-7356-4f99-9921-ee8d59548bdc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:57.088895 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd42198d-7356-4f99-9921-ee8d59548bdc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:57.089367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd42198d-7356-4f99-9921-ee8d59548bdc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:57.094491 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd42198d-7356-4f99-9921-ee8d59548bdc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:57.095029 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd42198d-7356-4f99-9921-ee8d59548bdc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:57.486550 n-d-master-1 devstack@n-api.service[119474]: INFO nova.network.security_group_api [None req-72910f99-6167-43d8-83b2-b8d5c349bcaf tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Adding security group 4630e85a-7518-407e-8bf8-95e79e92512d to port 892a1aa4-8477-4cee-9b84-a969a734fcbf Jul 31 01:11:57.757491 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fd42198d-7356-4f99-9921-ee8d59548bdc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:57.784694 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fd42198d-7356-4f99-9921-ee8d59548bdc tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1470 microversion: 2.1 time: 0.709441 Jul 31 01:11:57.821379 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 695/1383] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:57 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1470 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:57.834590 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-310dde88-5fc0-41ba-9ffa-94881da0d4e3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:57.839870 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-310dde88-5fc0-41ba-9ffa-94881da0d4e3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:57.871741 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-310dde88-5fc0-41ba-9ffa-94881da0d4e3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:57.885664 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-310dde88-5fc0-41ba-9ffa-94881da0d4e3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:57.891882 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-310dde88-5fc0-41ba-9ffa-94881da0d4e3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:57.895913 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-310dde88-5fc0-41ba-9ffa-94881da0d4e3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:58.141176 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-310dde88-5fc0-41ba-9ffa-94881da0d4e3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.303940 Jul 31 01:11:58.146532 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 696/1384] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:11:57 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-volume_attachments => generated 197 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:11:58.161528 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e4ac6a35-4986-4275-a5b6-868a49df4990 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:58.163681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e4ac6a35-4986-4275-a5b6-868a49df4990 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:58.188802 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4ac6a35-4986-4275-a5b6-868a49df4990 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:58.189994 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4ac6a35-4986-4275-a5b6-868a49df4990 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:58.191295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4ac6a35-4986-4275-a5b6-868a49df4990 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:58.192102 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4ac6a35-4986-4275-a5b6-868a49df4990 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:59.080102 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e4ac6a35-4986-4275-a5b6-868a49df4990 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:11:59.145011 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e4ac6a35-4986-4275-a5b6-868a49df4990 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1334 microversion: 2.1 time: 0.991097 Jul 31 01:11:59.147938 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 697/1385] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:58 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1334 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:59.196130 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-ecd35b94-ac0c-41b0-bfc6-4e1cc01377c2 req-a0d40dd7-e795-4d37-a1c0-20d438e2baab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502a7c35-a8fe-4ace-85d5-bb115f8423fa", "name": "network-vif-unplugged", "status": "completed", "tag": "c430395e-d6b3-4f00-927f-f84a47151b4c"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:11:59.216026 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ecd35b94-ac0c-41b0-bfc6-4e1cc01377c2 req-a0d40dd7-e795-4d37-a1c0-20d438e2baab service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:59.216588 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ecd35b94-ac0c-41b0-bfc6-4e1cc01377c2 req-a0d40dd7-e795-4d37-a1c0-20d438e2baab service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:59.263906 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-72910f99-6167-43d8-83b2-b8d5c349bcaf tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "POST /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775/action" status: 202 len: 0 microversion: 2.1 time: 2.233210 Jul 31 01:11:59.265402 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 689/1386] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:11:57 2022] POST /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775/action => generated 0 bytes in 2236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:11:59.282948 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-72122993-e8f5-4348-83dd-25f506631786 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:59.287072 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-72122993-e8f5-4348-83dd-25f506631786 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: de60c7a5-098d-44cb-99f0-1dc80f148df7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:59.310049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72122993-e8f5-4348-83dd-25f506631786 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:59.310970 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72122993-e8f5-4348-83dd-25f506631786 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:59.312060 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72122993-e8f5-4348-83dd-25f506631786 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:59.313021 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72122993-e8f5-4348-83dd-25f506631786 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:59.333625 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-72122993-e8f5-4348-83dd-25f506631786 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] HTTP exception thrown: Instance de60c7a5-098d-44cb-99f0-1dc80f148df7 could not be found. Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-72122993-e8f5-4348-83dd-25f506631786 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Request method failure captured: Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7 HTTP/1.1 Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXvczrjV93XGTog32ZhLWWtba7dtc274nDtU8E1Fg1kaFfSFTu1mOthIsPp5iOJofIsjlZdSwTbjyj2LE7DPBnmjox8fqRCUbcXosGLpS7nCLvEC8_927gD0PLQuRdewtttI4lKyEun5DpT6VtlLkZ534cOYIJ9M_YWbga0UOFAT7s Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: ba602c4ed5b94aad996ef8c95d3436ba Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ba602c4ed5b94aad996ef8c95d3436ba", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: ba602c4ed5b94aad996ef8c95d3436ba Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersOnMultiNodesTest-46531715-project Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 0fad0a50973b44149c18ca2b76bfab36 Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersOnMultiNodesTest-46531715-project Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: exception: Instance de60c7a5-098d-44cb-99f0-1dc80f148df7 could not be found. Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'de60c7a5-098d-44cb-99f0-1dc80f148df7'} Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de60c7a5-098d-44cb-99f0-1dc80f148df7 could not be found. Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de60c7a5-098d-44cb-99f0-1dc80f148df7 could not be found. Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:11:59.336368 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:59.340605 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:11:59.340605 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:11:59.340605 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:11:59.340605 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:11:59.340605 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:11:59.340605 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de60c7a5-098d-44cb-99f0-1dc80f148df7 could not be found. Jul 31 01:11:59.340605 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:11:59.341061 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-ecd35b94-ac0c-41b0-bfc6-4e1cc01377c2 req-a0d40dd7-e795-4d37-a1c0-20d438e2baab service nova] Creating event network-vif-unplugged:c430395e-d6b3-4f00-927f-f84a47151b4c for instance 502a7c35-a8fe-4ace-85d5-bb115f8423fa on n-h1-master-1 Jul 31 01:11:59.343940 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-72122993-e8f5-4348-83dd-25f506631786 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Returning 404 to user: Instance de60c7a5-098d-44cb-99f0-1dc80f148df7 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:11:59.345142 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-72122993-e8f5-4348-83dd-25f506631786 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7" status: 404 len: 111 microversion: 2.1 time: 0.078594 Jul 31 01:11:59.346247 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 690/1387] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:59 2022] GET /compute/v2.1/servers/de60c7a5-098d-44cb-99f0-1dc80f148df7 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:11:59.351484 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-60e69922-bc4e-4be6-8a3c-6f66761d6a1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:59.352398 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-60e69922-bc4e-4be6-8a3c-6f66761d6a1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:59.357553 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-ecd35b94-ac0c-41b0-bfc6-4e1cc01377c2 req-a0d40dd7-e795-4d37-a1c0-20d438e2baab service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.202872 Jul 31 01:11:59.360155 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 698/1388] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:11:59.361364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60e69922-bc4e-4be6-8a3c-6f66761d6a1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:59.362684 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60e69922-bc4e-4be6-8a3c-6f66761d6a1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:59.364366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60e69922-bc4e-4be6-8a3c-6f66761d6a1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:59.365004 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60e69922-bc4e-4be6-8a3c-6f66761d6a1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:59.385231 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8f18aa15-c67b-4583-96dd-3d1d542a8ed5 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede5e77940>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:59.503872 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8f18aa15-c67b-4583-96dd-3d1d542a8ed5 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1412 microversion: 2.1 time: 0.141957 Jul 31 01:11:59.505072 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 699/1389] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:11:59 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1412 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:11:59.513421 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b5a80c47-857a-4d7d-9745-bbc7879f8456 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:11:59.518716 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b5a80c47-857a-4d7d-9745-bbc7879f8456 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:11:59.548110 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5a80c47-857a-4d7d-9745-bbc7879f8456 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:59.548956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5a80c47-857a-4d7d-9745-bbc7879f8456 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:11:59.550063 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5a80c47-857a-4d7d-9745-bbc7879f8456 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:11:59.554726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5a80c47-857a-4d7d-9745-bbc7879f8456 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:00.174128 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-60e69922-bc4e-4be6-8a3c-6f66761d6a1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:00.194204 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-60e69922-bc4e-4be6-8a3c-6f66761d6a1f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.846465 Jul 31 01:12:00.195547 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 691/1390] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:59 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:00.219606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-90432ce7-b73b-41f1-afff-7f73f8442d3b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:00.229848 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-90432ce7-b73b-41f1-afff-7f73f8442d3b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:00.255862 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90432ce7-b73b-41f1-afff-7f73f8442d3b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:00.256956 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90432ce7-b73b-41f1-afff-7f73f8442d3b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:00.258512 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90432ce7-b73b-41f1-afff-7f73f8442d3b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:00.259501 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90432ce7-b73b-41f1-afff-7f73f8442d3b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:00.306205 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-90432ce7-b73b-41f1-afff-7f73f8442d3b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.108951 Jul 31 01:12:00.308401 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 692/1391] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:12:00 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:00.363166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a8e1d9b5-b74b-4199-9b0d-6dafe0684ece tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fedeaa400d0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:00.406573 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b5a80c47-857a-4d7d-9745-bbc7879f8456 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:00.427829 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b5a80c47-857a-4d7d-9745-bbc7879f8456 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1470 microversion: 2.1 time: 0.917429 Jul 31 01:12:00.431841 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 700/1392] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:11:59 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1470 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:00.446889 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-1ce5d56e-7427-4517-83bd-c86c25536d19 req-ce7e9e77-833a-47e9-a2a5-a6857155c95b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca134f6-3529-47bd-830d-0ab1b9b69775", "tag": "892a1aa4-8477-4cee-9b84-a969a734fcbf"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:00.478000 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1ce5d56e-7427-4517-83bd-c86c25536d19 req-ce7e9e77-833a-47e9-a2a5-a6857155c95b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:00.480069 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1ce5d56e-7427-4517-83bd-c86c25536d19 req-ce7e9e77-833a-47e9-a2a5-a6857155c95b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:00.528686 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1ce5d56e-7427-4517-83bd-c86c25536d19 req-ce7e9e77-833a-47e9-a2a5-a6857155c95b service nova] Creating event network-changed:892a1aa4-8477-4cee-9b84-a969a734fcbf for instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 on n-h1-master-1 Jul 31 01:12:00.575448 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-1ce5d56e-7427-4517-83bd-c86c25536d19 req-ce7e9e77-833a-47e9-a2a5-a6857155c95b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109099 Jul 31 01:12:00.576752 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 701/1393] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:00.595854 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-75c89bb1-c863-45d0-a766-70ceb3f60933 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:00.653805 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-75c89bb1-c863-45d0-a766-70ceb3f60933 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/7ddb39b3-d430-4b24-9798-46b98528ce49" status: 204 len: 0 microversion: 2.1 time: 0.072523 Jul 31 01:12:00.655564 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 702/1394] 10.222.0.45 () {58 vars in 1266 bytes} [Sun Jul 31 01:12:00 2022] DELETE /compute/v2.1/os-server-groups/7ddb39b3-d430-4b24-9798-46b98528ce49 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:12:00.666336 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-02dc273e-b457-438a-91f9-8c01e9eb9459 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:00.667153 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-02dc273e-b457-438a-91f9-8c01e9eb9459 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:00.676223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-02dc273e-b457-438a-91f9-8c01e9eb9459 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:00.677070 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-02dc273e-b457-438a-91f9-8c01e9eb9459 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:00.678392 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-02dc273e-b457-438a-91f9-8c01e9eb9459 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:00.679016 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-02dc273e-b457-438a-91f9-8c01e9eb9459 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:00.779245 n-d-master-1 devstack@n-api.service[119474]: DEBUG neutronclient.v2_0.client [None req-a8e1d9b5-b74b-4199-9b0d-6dafe0684ece tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 4630e85a-7518-407e-8bf8-95e79e92512d in use.", "detail": ""}} {{(pid=119474) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:12:00.780608 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-a8e1d9b5-b74b-4199-9b0d-6dafe0684ece tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] HTTP exception thrown: Security Group 4630e85a-7518-407e-8bf8-95e79e92512d in use. Jul 31 01:12:00.780608 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-6afe5b77-0ed0-4fbd-a2bb-fef424ee8296'] Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a8e1d9b5-b74b-4199-9b0d-6dafe0684ece tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Request method failure captured: Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/os-security-groups/4630e85a-7518-407e-8bf8-95e79e92512d HTTP/1.1 Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dZ4RROZmvNHgk8nkEPCHEOtKeymvD8aJkYSffUh8bqh37RpmNHALtgJw0W3wgMu6HJwqcBFxL8fLuKg63WTseMOWT3m6KTBzl-wHxPxejmdZtFZxPmexVFKQ3mNYzDtb_uVYFrMpBX3R40pkmpf04xAyZo3K5gfwBnL_o_UQmcBzKE Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a45cfeb1ce9844c5bf16e975af312ba0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: e3e6a158c3884c8db5a66fe80e71527d Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: exception: Security Group 4630e85a-7518-407e-8bf8-95e79e92512d in use. Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-6afe5b77-0ed0-4fbd-a2bb-fef424ee8296'] Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '4630e85a-7518-407e-8bf8-95e79e92512d'} Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:12:00.789470 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 4630e85a-7518-407e-8bf8-95e79e92512d in use. Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6afe5b77-0ed0-4fbd-a2bb-fef424ee8296'] Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 4630e85a-7518-407e-8bf8-95e79e92512d in use. Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6afe5b77-0ed0-4fbd-a2bb-fef424ee8296'] Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 4630e85a-7518-407e-8bf8-95e79e92512d in use. Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6afe5b77-0ed0-4fbd-a2bb-fef424ee8296'] Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 4630e85a-7518-407e-8bf8-95e79e92512d in use. Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6afe5b77-0ed0-4fbd-a2bb-fef424ee8296'] Jul 31 01:12:00.795656 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:00.805722 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a8e1d9b5-b74b-4199-9b0d-6dafe0684ece tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Returning 400 to user: Security Group 4630e85a-7518-407e-8bf8-95e79e92512d in use. Jul 31 01:12:00.805722 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-6afe5b77-0ed0-4fbd-a2bb-fef424ee8296'] {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:00.812876 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a8e1d9b5-b74b-4199-9b0d-6dafe0684ece tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/4630e85a-7518-407e-8bf8-95e79e92512d" status: 400 len: 185 microversion: 2.1 time: 0.500575 Jul 31 01:12:00.814556 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 693/1395] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:12:00 2022] DELETE /compute/v2.1/os-security-groups/4630e85a-7518-407e-8bf8-95e79e92512d => generated 185 bytes in 505 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:12:00.833863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6d6dfdb2-8dc7-4ee7-91e7-cf856df1617e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa27700>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:00.985570 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6d6dfdb2-8dc7-4ee7-91e7-cf856df1617e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1421 microversion: 2.1 time: 0.162772 Jul 31 01:12:00.996134 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 694/1396] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:12:00 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1421 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:01.004098 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8bcfaf9f-9521-4d16-b054-3ba21d410d44 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:01.005209 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8bcfaf9f-9521-4d16-b054-3ba21d410d44 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:01.014630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8bcfaf9f-9521-4d16-b054-3ba21d410d44 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:01.015371 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8bcfaf9f-9521-4d16-b054-3ba21d410d44 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:01.017381 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8bcfaf9f-9521-4d16-b054-3ba21d410d44 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:01.018767 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8bcfaf9f-9521-4d16-b054-3ba21d410d44 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:01.057807 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8bcfaf9f-9521-4d16-b054-3ba21d410d44 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:12:01.157796 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-02dc273e-b457-438a-91f9-8c01e9eb9459 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:01.171860 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-02dc273e-b457-438a-91f9-8c01e9eb9459 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1334 microversion: 2.1 time: 0.511886 Jul 31 01:12:01.172486 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 703/1397] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:00 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1334 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:01.210568 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed04c9e3-28e8-4a9d-adec-a52931f226d0 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:01.212607 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ed04c9e3-28e8-4a9d-adec-a52931f226d0 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:01.230546 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed04c9e3-28e8-4a9d-adec-a52931f226d0 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:01.230546 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed04c9e3-28e8-4a9d-adec-a52931f226d0 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:01.231284 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed04c9e3-28e8-4a9d-adec-a52931f226d0 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:01.231929 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed04c9e3-28e8-4a9d-adec-a52931f226d0 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:01.239878 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8bcfaf9f-9521-4d16-b054-3ba21d410d44 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1aa29e77-13fc-46d3-9b2b-8f38833f1fa9" status: 204 len: 0 microversion: 2.1 time: 0.239478 Jul 31 01:12:01.241074 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 695/1398] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:12:00 2022] DELETE /compute/v2.1/servers/1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:12:01.261447 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-760b6b92-cdb7-4e8c-b4a3-713b6c93e4e6 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea9ec670>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:01.299207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ed04c9e3-28e8-4a9d-adec-a52931f226d0 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:12:01.321773 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-760b6b92-cdb7-4e8c-b4a3-713b6c93e4e6 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 200 len: 1421 microversion: 2.1 time: 0.079020 Jul 31 01:12:01.323813 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 696/1399] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:12:01 2022] GET /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 1421 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:01.332631 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b954fdf8-73dc-4628-9fd7-749801b3ad9f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:01.334030 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b954fdf8-73dc-4628-9fd7-749801b3ad9f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:01.343438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b954fdf8-73dc-4628-9fd7-749801b3ad9f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:01.344900 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b954fdf8-73dc-4628-9fd7-749801b3ad9f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:01.346840 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b954fdf8-73dc-4628-9fd7-749801b3ad9f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:01.347632 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b954fdf8-73dc-4628-9fd7-749801b3ad9f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:01.381142 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:01.481352 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ed04c9e3-28e8-4a9d-adec-a52931f226d0 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 204 len: 0 microversion: 2.1 time: 0.293137 Jul 31 01:12:01.490689 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 704/1400] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:12:01 2022] DELETE /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:12:01.501974 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-44301cfd-5ad0-4fa9-aec1-8bd89c0b939e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:01.503094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-44301cfd-5ad0-4fa9-aec1-8bd89c0b939e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:01.514597 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44301cfd-5ad0-4fa9-aec1-8bd89c0b939e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:01.515461 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44301cfd-5ad0-4fa9-aec1-8bd89c0b939e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:01.516911 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44301cfd-5ad0-4fa9-aec1-8bd89c0b939e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:01.518364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44301cfd-5ad0-4fa9-aec1-8bd89c0b939e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:01.583857 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-44301cfd-5ad0-4fa9-aec1-8bd89c0b939e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:12:01.657084 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b954fdf8-73dc-4628-9fd7-749801b3ad9f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:01.669452 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b954fdf8-73dc-4628-9fd7-749801b3ad9f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.344004 Jul 31 01:12:01.685851 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 697/1401] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:01 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:01.686503 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:01.687739 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-efbbb44e-4757-47c7-8839-5382623835b6 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea9ece50>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:01.708077 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-44301cfd-5ad0-4fa9-aec1-8bd89c0b939e tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 204 len: 0 microversion: 2.1 time: 0.215107 Jul 31 01:12:01.708930 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 705/1402] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:12:01 2022] DELETE /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:12:01.714588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-8cf25f3b-d55d-419e-b8f4-eedf43f8be1d req-9fb99914-b944-4d93-bd8f-8121431b1811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "502a7c35-a8fe-4ace-85d5-bb115f8423fa", "tag": "c430395e-d6b3-4f00-927f-f84a47151b4c"}, {"server_uuid": "eafdd229-897b-4b1f-adfc-3d7bb4fef7a0", "name": "network-vif-unplugged", "status": "completed", "tag": "5ee707da-030a-4991-809c-69f12af3f140"}, {"name": "network-changed", "server_uuid": "eafdd229-897b-4b1f-adfc-3d7bb4fef7a0", "tag": "5ee707da-030a-4991-809c-69f12af3f140"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:01.730981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8cf25f3b-d55d-419e-b8f4-eedf43f8be1d req-9fb99914-b944-4d93-bd8f-8121431b1811 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:01.731774 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8cf25f3b-d55d-419e-b8f4-eedf43f8be1d req-9fb99914-b944-4d93-bd8f-8121431b1811 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:01.764199 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-8cf25f3b-d55d-419e-b8f4-eedf43f8be1d req-9fb99914-b944-4d93-bd8f-8121431b1811 service nova] Creating event network-changed:c430395e-d6b3-4f00-927f-f84a47151b4c for instance 502a7c35-a8fe-4ace-85d5-bb115f8423fa on n-h1-master-1 Jul 31 01:12:01.764906 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-8cf25f3b-d55d-419e-b8f4-eedf43f8be1d req-9fb99914-b944-4d93-bd8f-8121431b1811 service nova] Creating event network-vif-unplugged:5ee707da-030a-4991-809c-69f12af3f140 for instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 on n-h2-master-1 Jul 31 01:12:01.765760 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-8cf25f3b-d55d-419e-b8f4-eedf43f8be1d req-9fb99914-b944-4d93-bd8f-8121431b1811 service nova] Creating event network-changed:5ee707da-030a-4991-809c-69f12af3f140 for instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 on n-h2-master-1 Jul 31 01:12:01.777434 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-8cf25f3b-d55d-419e-b8f4-eedf43f8be1d req-9fb99914-b944-4d93-bd8f-8121431b1811 service nova] Instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:12:01.802830 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-8cf25f3b-d55d-419e-b8f4-eedf43f8be1d req-9fb99914-b944-4d93-bd8f-8121431b1811 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.091982 Jul 31 01:12:01.804677 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 706/1403] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:01.814013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-acec4121-b471-4643-90ca-2415822d8105 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:01.815629 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-acec4121-b471-4643-90ca-2415822d8105 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:01.825460 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-acec4121-b471-4643-90ca-2415822d8105 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:01.826165 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-acec4121-b471-4643-90ca-2415822d8105 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:01.827519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-acec4121-b471-4643-90ca-2415822d8105 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:01.827972 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-acec4121-b471-4643-90ca-2415822d8105 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:02.020817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-acec4121-b471-4643-90ca-2415822d8105 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:02.029530 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-acec4121-b471-4643-90ca-2415822d8105 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1470 microversion: 2.1 time: 0.223293 Jul 31 01:12:02.030214 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 707/1404] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:01 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1470 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:02.035632 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0426000b-882c-497f-83b4-1c8457293a02 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:02.036226 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0426000b-882c-497f-83b4-1c8457293a02 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:02.049743 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0426000b-882c-497f-83b4-1c8457293a02 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:02.049743 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0426000b-882c-497f-83b4-1c8457293a02 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:02.049743 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0426000b-882c-497f-83b4-1c8457293a02 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:02.049743 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0426000b-882c-497f-83b4-1c8457293a02 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:02.274754 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0426000b-882c-497f-83b4-1c8457293a02 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:02.288781 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0426000b-882c-497f-83b4-1c8457293a02 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1648 microversion: 2.1 time: 0.257293 Jul 31 01:12:02.299556 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 708/1405] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:02 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1648 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:02.299556 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1d802b61-2b15-4373-89c4-28db34452ac5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:02.299556 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1d802b61-2b15-4373-89c4-28db34452ac5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:02.309640 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d802b61-2b15-4373-89c4-28db34452ac5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:02.310307 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d802b61-2b15-4373-89c4-28db34452ac5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:02.311156 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d802b61-2b15-4373-89c4-28db34452ac5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:02.311754 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d802b61-2b15-4373-89c4-28db34452ac5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:02.337638 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-efbbb44e-4757-47c7-8839-5382623835b6 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "DELETE /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 204 len: 0 microversion: 2.1 time: 0.659862 Jul 31 01:12:02.338283 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 698/1406] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:01 2022] DELETE /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:12:02.344717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aa1fe6ff-adaa-4c1f-a95b-1cfad2b2e4e3 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:02.345336 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aa1fe6ff-adaa-4c1f-a95b-1cfad2b2e4e3 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:02.352931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa1fe6ff-adaa-4c1f-a95b-1cfad2b2e4e3 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:02.355725 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa1fe6ff-adaa-4c1f-a95b-1cfad2b2e4e3 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:02.357094 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa1fe6ff-adaa-4c1f-a95b-1cfad2b2e4e3 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:02.357552 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa1fe6ff-adaa-4c1f-a95b-1cfad2b2e4e3 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:02.612918 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1d802b61-2b15-4373-89c4-28db34452ac5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:02.616796 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-aa1fe6ff-adaa-4c1f-a95b-1cfad2b2e4e3 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:02.621712 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1d802b61-2b15-4373-89c4-28db34452ac5 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/1aa29e77-13fc-46d3-9b2b-8f38833f1fa9" status: 200 len: 1475 microversion: 2.1 time: 0.330957 Jul 31 01:12:02.622895 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 709/1407] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:02 2022] GET /compute/v2.1/servers/1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 => generated 1475 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:02.628021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6a1c9005-222d-4519-92e4-ef0af2c6a43b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:02.629058 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6a1c9005-222d-4519-92e4-ef0af2c6a43b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:02.637097 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aa1fe6ff-adaa-4c1f-a95b-1cfad2b2e4e3 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1334 microversion: 2.1 time: 0.297726 Jul 31 01:12:02.637836 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 699/1408] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:02 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1334 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:02.638111 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a1c9005-222d-4519-92e4-ef0af2c6a43b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:02.639219 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a1c9005-222d-4519-92e4-ef0af2c6a43b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:02.640589 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a1c9005-222d-4519-92e4-ef0af2c6a43b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:02.641031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a1c9005-222d-4519-92e4-ef0af2c6a43b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:02.697444 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6a1c9005-222d-4519-92e4-ef0af2c6a43b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:12:02.709014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5d068967-6f0c-4fef-8257-b9f1f703f914 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:02.709999 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5d068967-6f0c-4fef-8257-b9f1f703f914 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:02.720975 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d068967-6f0c-4fef-8257-b9f1f703f914 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:02.721406 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d068967-6f0c-4fef-8257-b9f1f703f914 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:02.722680 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d068967-6f0c-4fef-8257-b9f1f703f914 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:02.723533 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d068967-6f0c-4fef-8257-b9f1f703f914 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:02.814613 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6a1c9005-222d-4519-92e4-ef0af2c6a43b tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "DELETE /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 204 len: 0 microversion: 2.1 time: 0.189990 Jul 31 01:12:02.815725 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 710/1409] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:12:02 2022] DELETE /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:12:02.892883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-38d6062f-5e49-4856-8d3d-07ffff533aff tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-424300295", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "6202340f-0183-4051-846c-d255fe21d994"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:02.911465 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5d068967-6f0c-4fef-8257-b9f1f703f914 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:02.926142 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5d068967-6f0c-4fef-8257-b9f1f703f914 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.220702 Jul 31 01:12:02.927202 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 700/1410] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:02 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:12:02.964923 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-38d6062f-5e49-4856-8d3d-07ffff533aff tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] validate_networks() for [('6202340f-0183-4051-846c-d255fe21d994', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:12:03.051372 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c61e3a88-992c-48dd-bd68-708953ffc1f9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:03.052250 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c61e3a88-992c-48dd-bd68-708953ffc1f9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:03.059652 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c61e3a88-992c-48dd-bd68-708953ffc1f9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:03.060348 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c61e3a88-992c-48dd-bd68-708953ffc1f9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:03.061740 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c61e3a88-992c-48dd-bd68-708953ffc1f9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:03.062398 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c61e3a88-992c-48dd-bd68-708953ffc1f9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:03.355971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c61e3a88-992c-48dd-bd68-708953ffc1f9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:03.375289 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c61e3a88-992c-48dd-bd68-708953ffc1f9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1470 microversion: 2.1 time: 0.328230 Jul 31 01:12:03.376251 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 701/1411] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:03 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1470 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:12:03.381905 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-ef2ccaec-f918-46ab-b4b4-5ca6d93445a4 req-5979ee65-22c3-4351-88d6-c5649e902fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f16639-427f-42f0-abe2-19c1106f59e3", "name": "network-vif-unplugged", "status": "completed", "tag": "6b987620-a1fd-4b4e-b5c2-5ca6e5557ebf"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:03.392819 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-ef2ccaec-f918-46ab-b4b4-5ca6d93445a4 req-5979ee65-22c3-4351-88d6-c5649e902fe6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:03.393638 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-ef2ccaec-f918-46ab-b4b4-5ca6d93445a4 req-5979ee65-22c3-4351-88d6-c5649e902fe6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:03.412194 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-ef2ccaec-f918-46ab-b4b4-5ca6d93445a4 req-5979ee65-22c3-4351-88d6-c5649e902fe6 service nova] Creating event network-vif-unplugged:6b987620-a1fd-4b4e-b5c2-5ca6e5557ebf for instance 59f16639-427f-42f0-abe2-19c1106f59e3 on n-h1-master-1 Jul 31 01:12:03.421645 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-ef2ccaec-f918-46ab-b4b4-5ca6d93445a4 req-5979ee65-22c3-4351-88d6-c5649e902fe6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042269 Jul 31 01:12:03.422691 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 702/1412] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:03.432930 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b42eea39-2965-4183-be23-9f57f0019eea tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:03.434768 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b42eea39-2965-4183-be23-9f57f0019eea tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:03.447963 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b42eea39-2965-4183-be23-9f57f0019eea tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:03.448802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b42eea39-2965-4183-be23-9f57f0019eea tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:03.450300 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b42eea39-2965-4183-be23-9f57f0019eea tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:03.451141 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b42eea39-2965-4183-be23-9f57f0019eea tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:03.704213 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-38d6062f-5e49-4856-8d3d-07ffff533aff tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:12:03.705010 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-38d6062f-5e49-4856-8d3d-07ffff533aff tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:12:03.705191 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-38d6062f-5e49-4856-8d3d-07ffff533aff tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:12:03.705502 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-38d6062f-5e49-4856-8d3d-07ffff533aff tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:12:03.706241 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-38d6062f-5e49-4856-8d3d-07ffff533aff tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:12:03.720496 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38d6062f-5e49-4856-8d3d-07ffff533aff tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:03.722694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38d6062f-5e49-4856-8d3d-07ffff533aff tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:03.726119 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38d6062f-5e49-4856-8d3d-07ffff533aff tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:03.726924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38d6062f-5e49-4856-8d3d-07ffff533aff tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:03.776588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-38d6062f-5e49-4856-8d3d-07ffff533aff tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Getting quotas for project 3fb526f587384fdea1a06d8b3b685dcf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:12:03.799773 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-38d6062f-5e49-4856-8d3d-07ffff533aff tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Getting quotas for user f4352f9b8762490e9187e28e8c9cd58e and project 3fb526f587384fdea1a06d8b3b685dcf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:12:03.814280 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b42eea39-2965-4183-be23-9f57f0019eea tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:03.822045 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:03.834401 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b42eea39-2965-4183-be23-9f57f0019eea tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1648 microversion: 2.1 time: 0.408994 Jul 31 01:12:03.847902 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-38d6062f-5e49-4856-8d3d-07ffff533aff tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:12:03.849384 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 703/1413] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:03 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1648 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:03.859722 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-38d6062f-5e49-4856-8d3d-07ffff533aff tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:12:03.875002 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-549b5a66-b220-4a90-8961-8d9649913448 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:03.875680 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-549b5a66-b220-4a90-8961-8d9649913448 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:03.883874 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-549b5a66-b220-4a90-8961-8d9649913448 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:03.884374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-549b5a66-b220-4a90-8961-8d9649913448 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:03.886048 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-549b5a66-b220-4a90-8961-8d9649913448 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:03.886500 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-549b5a66-b220-4a90-8961-8d9649913448 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:04.033418 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-38d6062f-5e49-4856-8d3d-07ffff533aff tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.148962 Jul 31 01:12:04.042676 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 711/1414] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:12:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 01:12:04.050724 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-66c16cb0-7623-4488-8399-0bc99dc1be0a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:04.051921 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-66c16cb0-7623-4488-8399-0bc99dc1be0a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:04.069290 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-66c16cb0-7623-4488-8399-0bc99dc1be0a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:04.070002 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-66c16cb0-7623-4488-8399-0bc99dc1be0a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:04.071133 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-66c16cb0-7623-4488-8399-0bc99dc1be0a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:04.071858 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-66c16cb0-7623-4488-8399-0bc99dc1be0a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:04.147995 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-549b5a66-b220-4a90-8961-8d9649913448 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:04.164742 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-549b5a66-b220-4a90-8961-8d9649913448 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/1aa29e77-13fc-46d3-9b2b-8f38833f1fa9" status: 200 len: 1475 microversion: 2.1 time: 0.313336 Jul 31 01:12:04.166409 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 704/1415] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:03 2022] GET /compute/v2.1/servers/1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 => generated 1475 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:04.175868 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7c144454-010a-4e2d-8563-b2647a481e93 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:04.177216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7c144454-010a-4e2d-8563-b2647a481e93 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:04.184667 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7c144454-010a-4e2d-8563-b2647a481e93 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:04.185581 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7c144454-010a-4e2d-8563-b2647a481e93 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:04.187782 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7c144454-010a-4e2d-8563-b2647a481e93 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:04.189230 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7c144454-010a-4e2d-8563-b2647a481e93 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:04.586948 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-66c16cb0-7623-4488-8399-0bc99dc1be0a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:04.601039 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-66c16cb0-7623-4488-8399-0bc99dc1be0a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1334 microversion: 2.1 time: 0.556414 Jul 31 01:12:04.606960 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 712/1416] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:04 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1334 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:04.615167 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-462acd80-9979-4d86-9c82-6b547b2a524d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:04.616253 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-462acd80-9979-4d86-9c82-6b547b2a524d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:04.826303 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7c144454-010a-4e2d-8563-b2647a481e93 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:04.839049 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7c144454-010a-4e2d-8563-b2647a481e93 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.669407 Jul 31 01:12:04.851834 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 705/1417] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:04 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:04.857390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b36cb0da-ba7b-4c34-87a3-9d43c5284065 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:04.858840 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b36cb0da-ba7b-4c34-87a3-9d43c5284065 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:04.876681 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b36cb0da-ba7b-4c34-87a3-9d43c5284065 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:04.877465 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b36cb0da-ba7b-4c34-87a3-9d43c5284065 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:04.878470 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b36cb0da-ba7b-4c34-87a3-9d43c5284065 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:04.879089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b36cb0da-ba7b-4c34-87a3-9d43c5284065 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:04.894602 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-462acd80-9979-4d86-9c82-6b547b2a524d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:04.909390 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-462acd80-9979-4d86-9c82-6b547b2a524d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1207 microversion: 2.1 time: 0.299907 Jul 31 01:12:04.911173 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 713/1418] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:04 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1207 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:04.916728 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc6a7f2c-db26-44e0-bbad-c885b8143d12 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:04.917353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc6a7f2c-db26-44e0-bbad-c885b8143d12 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:04.937024 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc6a7f2c-db26-44e0-bbad-c885b8143d12 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:04.953448 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc6a7f2c-db26-44e0-bbad-c885b8143d12 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:04.956051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc6a7f2c-db26-44e0-bbad-c885b8143d12 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:04.956529 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc6a7f2c-db26-44e0-bbad-c885b8143d12 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:05.376634 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b36cb0da-ba7b-4c34-87a3-9d43c5284065 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:05.392207 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b36cb0da-ba7b-4c34-87a3-9d43c5284065 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1470 microversion: 2.1 time: 0.536920 Jul 31 01:12:05.394835 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 706/1419] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:04 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1470 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:05.412041 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e1ba7366-330e-40a9-a994-9194d5db7739 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:05.413328 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e1ba7366-330e-40a9-a994-9194d5db7739 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:05.441581 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e1ba7366-330e-40a9-a994-9194d5db7739 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:05.442418 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e1ba7366-330e-40a9-a994-9194d5db7739 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:05.443872 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e1ba7366-330e-40a9-a994-9194d5db7739 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:05.444720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e1ba7366-330e-40a9-a994-9194d5db7739 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:06.118921 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fc6a7f2c-db26-44e0-bbad-c885b8143d12 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:06.136383 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc6a7f2c-db26-44e0-bbad-c885b8143d12 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1648 microversion: 2.1 time: 1.224001 Jul 31 01:12:06.139475 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 714/1420] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:04 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1648 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:06.160593 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-0265cd3f-4476-4fe4-bceb-10842c71651f req-ed195f1b-75dd-4baf-b540-5f8e1d728b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1f8550-6240-420b-8abf-9b5e9a8ebc2e", "name": "network-vif-plugged", "status": "completed", "tag": "7550470f-2bfc-4a0c-9188-0112084064b5"}, {"server_uuid": "6d1f8550-6240-420b-8abf-9b5e9a8ebc2e", "name": "network-vif-plugged", "status": "completed", "tag": "bf4873a9-1b81-48c0-bd3c-75d71fb62cd0"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:06.174607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0265cd3f-4476-4fe4-bceb-10842c71651f req-ed195f1b-75dd-4baf-b540-5f8e1d728b19 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:06.175475 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0265cd3f-4476-4fe4-bceb-10842c71651f req-ed195f1b-75dd-4baf-b540-5f8e1d728b19 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:06.192151 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-0265cd3f-4476-4fe4-bceb-10842c71651f req-ed195f1b-75dd-4baf-b540-5f8e1d728b19 service nova] Creating event network-vif-plugged:7550470f-2bfc-4a0c-9188-0112084064b5 for instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e on n-h2-master-1 Jul 31 01:12:06.193397 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-0265cd3f-4476-4fe4-bceb-10842c71651f req-ed195f1b-75dd-4baf-b540-5f8e1d728b19 service nova] Creating event network-vif-plugged:bf4873a9-1b81-48c0-bd3c-75d71fb62cd0 for instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e on n-h2-master-1 Jul 31 01:12:06.206193 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-0265cd3f-4476-4fe4-bceb-10842c71651f req-ed195f1b-75dd-4baf-b540-5f8e1d728b19 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052126 Jul 31 01:12:06.207228 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 715/1421] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:06.228918 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dc8edba4-7c71-4d92-a2a9-60fb52b4bfc0 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:06.229961 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dc8edba4-7c71-4d92-a2a9-60fb52b4bfc0 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:06.247608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc8edba4-7c71-4d92-a2a9-60fb52b4bfc0 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:06.248365 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc8edba4-7c71-4d92-a2a9-60fb52b4bfc0 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:06.249782 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc8edba4-7c71-4d92-a2a9-60fb52b4bfc0 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:06.250251 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc8edba4-7c71-4d92-a2a9-60fb52b4bfc0 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:06.419823 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e1ba7366-330e-40a9-a994-9194d5db7739 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:06.440834 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e1ba7366-330e-40a9-a994-9194d5db7739 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/1aa29e77-13fc-46d3-9b2b-8f38833f1fa9" status: 200 len: 1475 microversion: 2.1 time: 1.043497 Jul 31 01:12:06.446011 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 707/1422] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:05 2022] GET /compute/v2.1/servers/1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 => generated 1475 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:06.460571 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-71d6670e-27d1-4a49-88a0-9f2356f4b629 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:06.465368 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-71d6670e-27d1-4a49-88a0-9f2356f4b629 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:06.489071 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-71d6670e-27d1-4a49-88a0-9f2356f4b629 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:06.490401 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-71d6670e-27d1-4a49-88a0-9f2356f4b629 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:06.492214 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-71d6670e-27d1-4a49-88a0-9f2356f4b629 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:06.492971 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-71d6670e-27d1-4a49-88a0-9f2356f4b629 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:08.313867 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dc8edba4-7c71-4d92-a2a9-60fb52b4bfc0 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:08.335110 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dc8edba4-7c71-4d92-a2a9-60fb52b4bfc0 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1334 microversion: 2.1 time: 2.123715 Jul 31 01:12:08.345009 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 716/1423] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:06 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1334 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:08.354914 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cdd23104-c14b-4f63-b420-cbebe248edde tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:08.371182 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cdd23104-c14b-4f63-b420-cbebe248edde tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:08.410685 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdd23104-c14b-4f63-b420-cbebe248edde tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:08.414346 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdd23104-c14b-4f63-b420-cbebe248edde tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:08.414346 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdd23104-c14b-4f63-b420-cbebe248edde tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:08.428143 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdd23104-c14b-4f63-b420-cbebe248edde tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:08.457895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-71d6670e-27d1-4a49-88a0-9f2356f4b629 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:08.478289 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-71d6670e-27d1-4a49-88a0-9f2356f4b629 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 2.026805 Jul 31 01:12:08.479014 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 708/1424] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:06 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:08.484765 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e401a604-9d45-4825-abdd-ab752da7970b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:08.500835 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e401a604-9d45-4825-abdd-ab752da7970b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:08.517612 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e401a604-9d45-4825-abdd-ab752da7970b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:08.518135 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e401a604-9d45-4825-abdd-ab752da7970b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:08.520435 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e401a604-9d45-4825-abdd-ab752da7970b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:08.522623 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e401a604-9d45-4825-abdd-ab752da7970b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:08.845567 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cdd23104-c14b-4f63-b420-cbebe248edde tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:08.866288 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cdd23104-c14b-4f63-b420-cbebe248edde tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1265 microversion: 2.1 time: 0.518025 Jul 31 01:12:08.868701 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 717/1425] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:08 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1265 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:08.893485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-5e91a650-ccca-4716-934d-7ea45819d280 req-95ee4de8-79cb-4a6e-953a-af93b4c69a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa29e77-13fc-46d3-9b2b-8f38833f1fa9", "name": "network-vif-deleted", "tag": "2b605aa9-7b84-4f1e-aade-328fc0be9446"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:08.942566 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5e91a650-ccca-4716-934d-7ea45819d280 req-95ee4de8-79cb-4a6e-953a-af93b4c69a29 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:08.943372 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5e91a650-ccca-4716-934d-7ea45819d280 req-95ee4de8-79cb-4a6e-953a-af93b4c69a29 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:08.968739 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-5e91a650-ccca-4716-934d-7ea45819d280 req-95ee4de8-79cb-4a6e-953a-af93b4c69a29 service nova] Creating event network-vif-deleted:2b605aa9-7b84-4f1e-aade-328fc0be9446 for instance 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 on n-h2-master-1 Jul 31 01:12:08.999842 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-5e91a650-ccca-4716-934d-7ea45819d280 req-95ee4de8-79cb-4a6e-953a-af93b4c69a29 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124124 Jul 31 01:12:09.007630 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 718/1426] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:09.016485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cc94956c-2fe8-4fb3-92ab-4a0631ac360c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:09.022862 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cc94956c-2fe8-4fb3-92ab-4a0631ac360c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:09.064777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc94956c-2fe8-4fb3-92ab-4a0631ac360c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:09.065469 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc94956c-2fe8-4fb3-92ab-4a0631ac360c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:09.066437 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc94956c-2fe8-4fb3-92ab-4a0631ac360c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:09.066983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc94956c-2fe8-4fb3-92ab-4a0631ac360c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:09.329629 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cc94956c-2fe8-4fb3-92ab-4a0631ac360c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:09.339515 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cc94956c-2fe8-4fb3-92ab-4a0631ac360c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 200 len: 1468 microversion: 2.1 time: 0.330132 Jul 31 01:12:09.363255 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 719/1427] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:09 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 1468 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:09.369299 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-37fc01a0-3935-4ed0-80aa-c83a00b777b7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:09.370250 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-37fc01a0-3935-4ed0-80aa-c83a00b777b7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:09.381579 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37fc01a0-3935-4ed0-80aa-c83a00b777b7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:09.382385 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37fc01a0-3935-4ed0-80aa-c83a00b777b7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:09.383533 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37fc01a0-3935-4ed0-80aa-c83a00b777b7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:09.384207 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37fc01a0-3935-4ed0-80aa-c83a00b777b7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:09.418809 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-37fc01a0-3935-4ed0-80aa-c83a00b777b7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] HTTP exception thrown: Instance 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 could not be found. Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-37fc01a0-3935-4ed0-80aa-c83a00b777b7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Request method failure captured: Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 HTTP/1.1 Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dXvczrjV93XGTog32ZhLWWtba7dtc274nDtU8E1Fg1kaFfSFTu1mOthIsPp5iOJofIsjlZdSwTbjyj2LE7DPBnmjox8fqRCUbcXosGLpS7nCLvEC8_927gD0PLQuRdewtttI4lKyEun5DpT6VtlLkZ534cOYIJ9M_YWbga0UOFAT7s Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: ba602c4ed5b94aad996ef8c95d3436ba Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ba602c4ed5b94aad996ef8c95d3436ba", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: ba602c4ed5b94aad996ef8c95d3436ba Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersOnMultiNodesTest-46531715-project Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 0fad0a50973b44149c18ca2b76bfab36 Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersOnMultiNodesTest-46531715-project Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 could not be found. Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '1aa29e77-13fc-46d3-9b2b-8f38833f1fa9'} Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 could not be found. Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 could not be found. Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:09.424148 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:09.429581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:09.429581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:09.429581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:09.429581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:09.429581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:09.429581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 could not be found. Jul 31 01:12:09.429581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:09.437762 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-37fc01a0-3935-4ed0-80aa-c83a00b777b7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Returning 404 to user: Instance 1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:09.439172 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-37fc01a0-3935-4ed0-80aa-c83a00b777b7 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/1aa29e77-13fc-46d3-9b2b-8f38833f1fa9" status: 404 len: 111 microversion: 2.1 time: 0.073987 Jul 31 01:12:09.440321 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 720/1428] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:09 2022] GET /compute/v2.1/servers/1aa29e77-13fc-46d3-9b2b-8f38833f1fa9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:09.445482 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f8df3542-7334-443a-b9b9-eb950e9f38b9 req-e4e2f6d5-2c7a-481a-9484-fdae17b8004e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bdd9c6c-52f8-4b5c-84f7-967f02739459", "name": "network-vif-deleted", "tag": "5d949b6a-7201-4176-9f2b-07df89c17ca9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:09.464863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e401a604-9d45-4825-abdd-ab752da7970b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:09.477949 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e401a604-9d45-4825-abdd-ab752da7970b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1463 microversion: 2.1 time: 0.997629 Jul 31 01:12:09.489214 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 709/1429] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:08 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1463 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:09.493213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f8df3542-7334-443a-b9b9-eb950e9f38b9 req-e4e2f6d5-2c7a-481a-9484-fdae17b8004e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:09.497315 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a0d902fb-fd90-4fb1-9683-d12a981e2ab6 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:09.498284 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f8df3542-7334-443a-b9b9-eb950e9f38b9 req-e4e2f6d5-2c7a-481a-9484-fdae17b8004e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:09.509947 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a0d902fb-fd90-4fb1-9683-d12a981e2ab6 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:09.545163 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0d902fb-fd90-4fb1-9683-d12a981e2ab6 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:09.556857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0d902fb-fd90-4fb1-9683-d12a981e2ab6 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:09.556857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0d902fb-fd90-4fb1-9683-d12a981e2ab6 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:09.556857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0d902fb-fd90-4fb1-9683-d12a981e2ab6 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:09.557283 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:09.558622 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f8df3542-7334-443a-b9b9-eb950e9f38b9 req-e4e2f6d5-2c7a-481a-9484-fdae17b8004e service nova] Creating event network-vif-deleted:5d949b6a-7201-4176-9f2b-07df89c17ca9 for instance 6bdd9c6c-52f8-4b5c-84f7-967f02739459 on n-h2-master-1 Jul 31 01:12:09.593458 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f8df3542-7334-443a-b9b9-eb950e9f38b9 req-e4e2f6d5-2c7a-481a-9484-fdae17b8004e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151605 Jul 31 01:12:09.594421 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 721/1430] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:09.615252 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-538738e1-9bde-42ea-a071-86b2668e53cf tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:09.625169 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-538738e1-9bde-42ea-a071-86b2668e53cf tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:09.643722 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-538738e1-9bde-42ea-a071-86b2668e53cf tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:09.644516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-538738e1-9bde-42ea-a071-86b2668e53cf tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:09.645557 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-538738e1-9bde-42ea-a071-86b2668e53cf tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:09.652955 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-538738e1-9bde-42ea-a071-86b2668e53cf tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:09.716726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-538738e1-9bde-42ea-a071-86b2668e53cf tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:09.718012 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-538738e1-9bde-42ea-a071-86b2668e53cf tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:09.718662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-538738e1-9bde-42ea-a071-86b2668e53cf tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lazy-loading 'fault' on Instance uuid 6bdd9c6c-52f8-4b5c-84f7-967f02739459 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:12:09.927748 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-538738e1-9bde-42ea-a071-86b2668e53cf tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:09.950944 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-538738e1-9bde-42ea-a071-86b2668e53cf tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 200 len: 1309 microversion: 2.1 time: 0.353932 Jul 31 01:12:09.952526 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 722/1431] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:09 2022] GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 1309 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:09.962842 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-01131c99-d47b-4a69-95a7-38194cfc106a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:09.965052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-01131c99-d47b-4a69-95a7-38194cfc106a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:09.980919 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01131c99-d47b-4a69-95a7-38194cfc106a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:09.982202 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01131c99-d47b-4a69-95a7-38194cfc106a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:09.984242 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01131c99-d47b-4a69-95a7-38194cfc106a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:09.985039 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01131c99-d47b-4a69-95a7-38194cfc106a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:10.455178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a0d902fb-fd90-4fb1-9683-d12a981e2ab6 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:10.465507 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a0d902fb-fd90-4fb1-9683-d12a981e2ab6 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1334 microversion: 2.1 time: 0.972836 Jul 31 01:12:10.466237 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 710/1432] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:09 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1334 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:10.659215 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-01131c99-d47b-4a69-95a7-38194cfc106a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:10.683830 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-01131c99-d47b-4a69-95a7-38194cfc106a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.726507 Jul 31 01:12:10.687949 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 723/1433] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:09 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:10.711534 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0954712f-1b83-4730-91c8-e289117b69ed tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:10.730121 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0954712f-1b83-4730-91c8-e289117b69ed tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:10.732212 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a12f0cf0-bd73-40cf-ad6a-b5c7bc71eb70 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:10.734656 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0954712f-1b83-4730-91c8-e289117b69ed tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Searching by: {'deleted': False, 'project_id': '3e3cc749a4a34731b3035b320af81cd4'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:12:10.736110 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a12f0cf0-bd73-40cf-ad6a-b5c7bc71eb70 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:10.744780 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0954712f-1b83-4730-91c8-e289117b69ed tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:10.745365 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0954712f-1b83-4730-91c8-e289117b69ed tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:10.748938 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0954712f-1b83-4730-91c8-e289117b69ed tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:10.750193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0954712f-1b83-4730-91c8-e289117b69ed tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:10.752945 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a12f0cf0-bd73-40cf-ad6a-b5c7bc71eb70 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:10.754558 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a12f0cf0-bd73-40cf-ad6a-b5c7bc71eb70 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:10.757097 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a12f0cf0-bd73-40cf-ad6a-b5c7bc71eb70 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:10.758327 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a12f0cf0-bd73-40cf-ad6a-b5c7bc71eb70 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:10.791088 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.multi_cell_list [None req-0954712f-1b83-4730-91c8-e289117b69ed tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119475) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:12:10.901037 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0954712f-1b83-4730-91c8-e289117b69ed tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.210352 Jul 31 01:12:10.903251 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 724/1434] 10.222.0.45 () {58 vars in 1125 bytes} [Sun Jul 31 01:12:10 2022] GET /compute/v2.1/servers => generated 344 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:10.916533 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b00e2b43-eaba-4fcd-8a6d-b3d228f401e4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:10.918211 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b00e2b43-eaba-4fcd-8a6d-b3d228f401e4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:10.932491 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b00e2b43-eaba-4fcd-8a6d-b3d228f401e4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:10.934192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b00e2b43-eaba-4fcd-8a6d-b3d228f401e4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:10.936061 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b00e2b43-eaba-4fcd-8a6d-b3d228f401e4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:10.936417 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b00e2b43-eaba-4fcd-8a6d-b3d228f401e4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:11.279548 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b00e2b43-eaba-4fcd-8a6d-b3d228f401e4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:11.291204 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b00e2b43-eaba-4fcd-8a6d-b3d228f401e4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1265 microversion: 2.1 time: 0.384913 Jul 31 01:12:11.294472 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 725/1435] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:10 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1265 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:11.299693 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ffb69994-e625-493a-9e1d-cd279a351b4a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:11.300349 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ffb69994-e625-493a-9e1d-cd279a351b4a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:11.321943 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ffb69994-e625-493a-9e1d-cd279a351b4a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:11.322741 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ffb69994-e625-493a-9e1d-cd279a351b4a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:11.323978 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ffb69994-e625-493a-9e1d-cd279a351b4a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:11.324682 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ffb69994-e625-493a-9e1d-cd279a351b4a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:11.344633 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-ffb69994-e625-493a-9e1d-cd279a351b4a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] HTTP exception thrown: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ffb69994-e625-493a-9e1d-cd279a351b4a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Request method failure captured: Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 HTTP/1.1 Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dZ4RROZmvNHgk8nkEPCHEOtKeymvD8aJkYSffUh8bqh37RpmNHALtgJw0W3wgMu6HJwqcBFxL8fLuKg63WTseMOWT3m6KTBzl-wHxPxejmdZtFZxPmexVFKQ3mNYzDtb_uVYFrMpBX3R40pkmpf04xAyZo3K5gfwBnL_o_UQmcBzKE Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a45cfeb1ce9844c5bf16e975af312ba0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: e3e6a158c3884c8db5a66fe80e71527d Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '4ca134f6-3529-47bd-830d-0ab1b9b69775'} Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:11.349895 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:11.354414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:11.354414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:11.354414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:11.354414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:11.354414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:11.354414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. Jul 31 01:12:11.354414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:11.354414 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ffb69994-e625-493a-9e1d-cd279a351b4a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Returning 404 to user: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:11.354414 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ffb69994-e625-493a-9e1d-cd279a351b4a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 404 len: 111 microversion: 2.1 time: 0.056109 Jul 31 01:12:11.356106 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 726/1436] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:11 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:11.362688 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-76a4aa53-7470-4484-88a6-1ab4745104dd tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:11.368596 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-76a4aa53-7470-4484-88a6-1ab4745104dd tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:11.369389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-76a4aa53-7470-4484-88a6-1ab4745104dd tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Searching by: {'deleted': False, 'project_id': '3e3cc749a4a34731b3035b320af81cd4'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:12:11.378665 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76a4aa53-7470-4484-88a6-1ab4745104dd tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:11.379159 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76a4aa53-7470-4484-88a6-1ab4745104dd tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:11.380122 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76a4aa53-7470-4484-88a6-1ab4745104dd tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:11.380751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76a4aa53-7470-4484-88a6-1ab4745104dd tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:11.493435 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.multi_cell_list [None req-76a4aa53-7470-4484-88a6-1ab4745104dd tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119475) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:12:11.582711 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-76a4aa53-7470-4484-88a6-1ab4745104dd tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:11.593085 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76a4aa53-7470-4484-88a6-1ab4745104dd tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:11.595654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76a4aa53-7470-4484-88a6-1ab4745104dd tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:11.689702 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a12f0cf0-bd73-40cf-ad6a-b5c7bc71eb70 tempest-MigrationsAdminTest-516171973 tempest-MigrationsAdminTest-516171973-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1614 microversion: 2.1 time: 1.202048 Jul 31 01:12:11.690912 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 711/1437] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:10 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1614 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:11.697287 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-69da15fb-4529-4b3f-843d-31b2f1d72060 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:11.698071 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-69da15fb-4529-4b3f-843d-31b2f1d72060 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 6bdd9c6c-52f8-4b5c-84f7-967f02739459] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:11.709115 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69da15fb-4529-4b3f-843d-31b2f1d72060 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:11.710033 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69da15fb-4529-4b3f-843d-31b2f1d72060 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:11.711535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69da15fb-4529-4b3f-843d-31b2f1d72060 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:11.712645 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69da15fb-4529-4b3f-843d-31b2f1d72060 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:11.754354 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-69da15fb-4529-4b3f-843d-31b2f1d72060 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] HTTP exception thrown: Instance 6bdd9c6c-52f8-4b5c-84f7-967f02739459 could not be found. Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-69da15fb-4529-4b3f-843d-31b2f1d72060 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Request method failure captured: Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 HTTP/1.1 Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXvczrjV93XGTog32ZhLWWtba7dtc274nDtU8E1Fg1kaFfSFTu1mOthIsPp5iOJofIsjlZdSwTbjyj2LE7DPBnmjox8fqRCUbcXosGLpS7nCLvEC8_927gD0PLQuRdewtttI4lKyEun5DpT6VtlLkZ534cOYIJ9M_YWbga0UOFAT7s Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: ba602c4ed5b94aad996ef8c95d3436ba Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ba602c4ed5b94aad996ef8c95d3436ba", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: ba602c4ed5b94aad996ef8c95d3436ba Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersOnMultiNodesTest-46531715-project Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 0fad0a50973b44149c18ca2b76bfab36 Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersOnMultiNodesTest-46531715-project Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 6bdd9c6c-52f8-4b5c-84f7-967f02739459 could not be found. Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '6bdd9c6c-52f8-4b5c-84f7-967f02739459'} Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bdd9c6c-52f8-4b5c-84f7-967f02739459 could not be found. Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bdd9c6c-52f8-4b5c-84f7-967f02739459 could not be found. Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:11.757852 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:11.765586 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:11.765586 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:11.765586 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:11.765586 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:11.765586 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:11.765586 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bdd9c6c-52f8-4b5c-84f7-967f02739459 could not be found. Jul 31 01:12:11.765586 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:11.765586 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-69da15fb-4529-4b3f-843d-31b2f1d72060 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Returning 404 to user: Instance 6bdd9c6c-52f8-4b5c-84f7-967f02739459 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:11.768885 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-69da15fb-4529-4b3f-843d-31b2f1d72060 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459" status: 404 len: 111 microversion: 2.1 time: 0.075471 Jul 31 01:12:11.770335 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 712/1438] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:11 2022] GET /compute/v2.1/servers/6bdd9c6c-52f8-4b5c-84f7-967f02739459 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:11.782825 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-c4e7e93d-1d2e-4b46-92c4-2953f913109b req-2b0a0987-4a42-4dee-ace0-037588e0dd80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f16639-427f-42f0-abe2-19c1106f59e3", "name": "network-vif-deleted", "tag": "6b987620-a1fd-4b4e-b5c2-5ca6e5557ebf"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:11.805548 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c4e7e93d-1d2e-4b46-92c4-2953f913109b req-2b0a0987-4a42-4dee-ace0-037588e0dd80 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:11.806393 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c4e7e93d-1d2e-4b46-92c4-2953f913109b req-2b0a0987-4a42-4dee-ace0-037588e0dd80 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:11.831552 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-c4e7e93d-1d2e-4b46-92c4-2953f913109b req-2b0a0987-4a42-4dee-ace0-037588e0dd80 service nova] Creating event network-vif-deleted:6b987620-a1fd-4b4e-b5c2-5ca6e5557ebf for instance 59f16639-427f-42f0-abe2-19c1106f59e3 on n-h1-master-1 Jul 31 01:12:11.841414 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-c4e7e93d-1d2e-4b46-92c4-2953f913109b req-2b0a0987-4a42-4dee-ace0-037588e0dd80 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069046 Jul 31 01:12:11.843591 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 713/1439] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:11.854050 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-58348785-ac01-458b-90d3-91e4e761097b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede560a0d0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:12.096436 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-76a4aa53-7470-4484-88a6-1ab4745104dd tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.739086 Jul 31 01:12:12.097771 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 727/1440] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:12:11 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:12.102701 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-07355cfd-9ed8-4fce-9993-23214317efd9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:12.103580 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-07355cfd-9ed8-4fce-9993-23214317efd9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:12.111196 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07355cfd-9ed8-4fce-9993-23214317efd9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:12.111966 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07355cfd-9ed8-4fce-9993-23214317efd9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:12.112945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07355cfd-9ed8-4fce-9993-23214317efd9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:12.113561 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07355cfd-9ed8-4fce-9993-23214317efd9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:13.006413 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-07355cfd-9ed8-4fce-9993-23214317efd9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:13.031240 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-07355cfd-9ed8-4fce-9993-23214317efd9 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1668 microversion: 2.1 time: 0.931165 Jul 31 01:12:13.034565 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 728/1441] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:12 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1668 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:13.055707 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-1e713dfa-5575-40c4-a955-cd91b51a2db8 req-8db051bd-9220-4587-8978-70dd6745ed17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca134f6-3529-47bd-830d-0ab1b9b69775", "name": "network-vif-deleted", "tag": "892a1aa4-8477-4cee-9b84-a969a734fcbf"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:13.075795 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1e713dfa-5575-40c4-a955-cd91b51a2db8 req-8db051bd-9220-4587-8978-70dd6745ed17 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:13.076613 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1e713dfa-5575-40c4-a955-cd91b51a2db8 req-8db051bd-9220-4587-8978-70dd6745ed17 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:13.100286 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1e713dfa-5575-40c4-a955-cd91b51a2db8 req-8db051bd-9220-4587-8978-70dd6745ed17 service nova] Creating event network-vif-deleted:892a1aa4-8477-4cee-9b84-a969a734fcbf for instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 on n-h1-master-1 Jul 31 01:12:13.119588 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-1e713dfa-5575-40c4-a955-cd91b51a2db8 req-8db051bd-9220-4587-8978-70dd6745ed17 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079660 Jul 31 01:12:13.120956 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 729/1442] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:13.132883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6b4d0027-b62b-4c32-89dc-d0210deda47c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:13.134360 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6b4d0027-b62b-4c32-89dc-d0210deda47c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:13.151302 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b4d0027-b62b-4c32-89dc-d0210deda47c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:13.152421 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b4d0027-b62b-4c32-89dc-d0210deda47c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:13.153989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b4d0027-b62b-4c32-89dc-d0210deda47c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:13.154793 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b4d0027-b62b-4c32-89dc-d0210deda47c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:13.349613 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-58348785-ac01-458b-90d3-91e4e761097b tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/579b1ee4-17da-43d9-8126-f1350c83531a" status: 202 len: 0 microversion: 2.1 time: 1.502960 Jul 31 01:12:13.354389 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 714/1443] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:12:11 2022] DELETE /compute/v2.1/os-security-groups/579b1ee4-17da-43d9-8126-f1350c83531a => generated 0 bytes in 1510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:12:13.369785 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a647961a-5e25-4c34-89ff-d3b7a7124340 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:13.371309 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a647961a-5e25-4c34-89ff-d3b7a7124340 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:13.391211 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a647961a-5e25-4c34-89ff-d3b7a7124340 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:13.392621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a647961a-5e25-4c34-89ff-d3b7a7124340 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:13.394277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a647961a-5e25-4c34-89ff-d3b7a7124340 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:13.395358 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a647961a-5e25-4c34-89ff-d3b7a7124340 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:13.466396 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a647961a-5e25-4c34-89ff-d3b7a7124340 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:12:13.602661 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6b4d0027-b62b-4c32-89dc-d0210deda47c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:13.614470 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6b4d0027-b62b-4c32-89dc-d0210deda47c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.490831 Jul 31 01:12:13.616318 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 730/1444] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:13 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:13.623037 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-52bb4d78-2caf-48a7-ad01-dc8a05496c28 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:13.664324 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-52bb4d78-2caf-48a7-ad01-dc8a05496c28 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/8bea6e9f-64e7-4c71-8a12-631589460836" status: 204 len: 0 microversion: 2.1 time: 0.046525 Jul 31 01:12:13.665296 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 731/1445] 10.222.0.45 () {58 vars in 1266 bytes} [Sun Jul 31 01:12:13 2022] DELETE /compute/v2.1/os-server-groups/8bea6e9f-64e7-4c71-8a12-631589460836 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:12:13.671238 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a647961a-5e25-4c34-89ff-d3b7a7124340 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 204 len: 0 microversion: 2.1 time: 0.306510 Jul 31 01:12:13.673821 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7d739ea6-af10-4652-9ded-38fdb7782251 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:13.681547 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 715/1446] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:12:13 2022] DELETE /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:12:13.688179 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7d739ea6-af10-4652-9ded-38fdb7782251 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019511 Jul 31 01:12:13.694333 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-99170680-c08a-4eea-9616-f71e0e81b372 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:13.695523 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 732/1447] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:12:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:13.695725 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-99170680-c08a-4eea-9616-f71e0e81b372 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:13.706734 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-bcdd42e9-6f61-4b4a-a696-9587b6809b91 req-5be0f44d-3a78-4da0-bdff-ead71c8c3115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eafdd229-897b-4b1f-adfc-3d7bb4fef7a0", "name": "network-vif-plugged", "status": "completed", "tag": "5ee707da-030a-4991-809c-69f12af3f140"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:13.707089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99170680-c08a-4eea-9616-f71e0e81b372 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:13.707758 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99170680-c08a-4eea-9616-f71e0e81b372 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:13.709125 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99170680-c08a-4eea-9616-f71e0e81b372 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:13.710299 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99170680-c08a-4eea-9616-f71e0e81b372 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:13.725369 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-bcdd42e9-6f61-4b4a-a696-9587b6809b91 req-5be0f44d-3a78-4da0-bdff-ead71c8c3115 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:13.725873 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-bcdd42e9-6f61-4b4a-a696-9587b6809b91 req-5be0f44d-3a78-4da0-bdff-ead71c8c3115 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:13.744643 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-bcdd42e9-6f61-4b4a-a696-9587b6809b91 req-5be0f44d-3a78-4da0-bdff-ead71c8c3115 service nova] Creating event network-vif-plugged:5ee707da-030a-4991-809c-69f12af3f140 for instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 on n-h2-master-1 Jul 31 01:12:13.753025 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-bcdd42e9-6f61-4b4a-a696-9587b6809b91 req-5be0f44d-3a78-4da0-bdff-ead71c8c3115 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054972 Jul 31 01:12:13.754193 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 733/1448] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:13.760821 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0aaed57d-5ffa-46dc-94a4-2e1c42b0332e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:13.761431 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0aaed57d-5ffa-46dc-94a4-2e1c42b0332e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:13.791976 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0aaed57d-5ffa-46dc-94a4-2e1c42b0332e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:13.792739 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0aaed57d-5ffa-46dc-94a4-2e1c42b0332e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:13.794293 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0aaed57d-5ffa-46dc-94a4-2e1c42b0332e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:13.795019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0aaed57d-5ffa-46dc-94a4-2e1c42b0332e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:13.840017 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0aaed57d-5ffa-46dc-94a4-2e1c42b0332e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e/ips" status: 200 len: 178 microversion: 2.1 time: 0.083649 Jul 31 01:12:13.841490 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 734/1449] 10.222.0.45 () {58 vars in 1248 bytes} [Sun Jul 31 01:12:13 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e/ips => generated 178 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:13.852033 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6f381730-0142-4058-9727-3591c4c1dbba tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede567e160>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:14.086576 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-99170680-c08a-4eea-9616-f71e0e81b372 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:14.096412 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-99170680-c08a-4eea-9616-f71e0e81b372 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1307 microversion: 2.1 time: 0.412160 Jul 31 01:12:14.099151 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 716/1450] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:13 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1307 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:14.104243 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-262bd630-e368-4cee-bc39-94279319bf6c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:14.105032 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-262bd630-e368-4cee-bc39-94279319bf6c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:14.112777 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-262bd630-e368-4cee-bc39-94279319bf6c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:14.113547 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-262bd630-e368-4cee-bc39-94279319bf6c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:14.114538 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-262bd630-e368-4cee-bc39-94279319bf6c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:14.115259 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-262bd630-e368-4cee-bc39-94279319bf6c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:14.149595 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-262bd630-e368-4cee-bc39-94279319bf6c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:12:14.269230 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-262bd630-e368-4cee-bc39-94279319bf6c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "DELETE /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 204 len: 0 microversion: 2.1 time: 0.167923 Jul 31 01:12:14.271451 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 717/1451] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:12:14 2022] DELETE /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:12:14.284493 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5ef4ef8f-2943-4408-8697-352b98f88914 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:14.285233 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5ef4ef8f-2943-4408-8697-352b98f88914 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:14.297273 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ef4ef8f-2943-4408-8697-352b98f88914 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:14.297273 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ef4ef8f-2943-4408-8697-352b98f88914 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:14.297273 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ef4ef8f-2943-4408-8697-352b98f88914 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:14.297273 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ef4ef8f-2943-4408-8697-352b98f88914 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:14.371851 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6f381730-0142-4058-9727-3591c4c1dbba tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/4630e85a-7518-407e-8bf8-95e79e92512d" status: 202 len: 0 microversion: 2.1 time: 0.527792 Jul 31 01:12:14.373007 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 735/1452] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:12:13 2022] DELETE /compute/v2.1/os-security-groups/4630e85a-7518-407e-8bf8-95e79e92512d => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:12:14.380545 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-23fa4720-32dc-451d-bfa2-bdd5ec2fd9e6 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:14.381272 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-23fa4720-32dc-451d-bfa2-bdd5ec2fd9e6 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:14.388835 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23fa4720-32dc-451d-bfa2-bdd5ec2fd9e6 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:14.389560 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23fa4720-32dc-451d-bfa2-bdd5ec2fd9e6 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:14.390362 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23fa4720-32dc-451d-bfa2-bdd5ec2fd9e6 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:14.390816 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23fa4720-32dc-451d-bfa2-bdd5ec2fd9e6 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:14.425300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-23fa4720-32dc-451d-bfa2-bdd5ec2fd9e6 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:12:14.540289 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:14.571017 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-23fa4720-32dc-451d-bfa2-bdd5ec2fd9e6 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 204 len: 0 microversion: 2.1 time: 0.193786 Jul 31 01:12:14.571017 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 736/1453] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:12:14 2022] DELETE /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:12:14.581456 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5ef4ef8f-2943-4408-8697-352b98f88914 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:14.590244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-71157932-1e19-4dc1-b9f8-9350576d60ee tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:14.590244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-71157932-1e19-4dc1-b9f8-9350576d60ee tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:14.591452 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5ef4ef8f-2943-4408-8697-352b98f88914 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1469 microversion: 2.1 time: 0.313949 Jul 31 01:12:14.595954 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 718/1454] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:14 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1469 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:14.601449 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f5e1f194-39cf-4e53-8e01-bf9434b9ae0c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:14.604578 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71157932-1e19-4dc1-b9f8-9350576d60ee tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:14.605800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f5e1f194-39cf-4e53-8e01-bf9434b9ae0c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:14.605943 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71157932-1e19-4dc1-b9f8-9350576d60ee tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:14.607411 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71157932-1e19-4dc1-b9f8-9350576d60ee tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:14.608777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71157932-1e19-4dc1-b9f8-9350576d60ee tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:14.623498 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5e1f194-39cf-4e53-8e01-bf9434b9ae0c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:14.626123 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5e1f194-39cf-4e53-8e01-bf9434b9ae0c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:14.627300 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5e1f194-39cf-4e53-8e01-bf9434b9ae0c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:14.629103 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5e1f194-39cf-4e53-8e01-bf9434b9ae0c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:14.671434 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:14.687807 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-71157932-1e19-4dc1-b9f8-9350576d60ee tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:12:14.820279 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-71157932-1e19-4dc1-b9f8-9350576d60ee tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "DELETE /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 204 len: 0 microversion: 2.1 time: 0.242758 Jul 31 01:12:14.824629 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 737/1455] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:12:14 2022] DELETE /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:12:14.835996 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3ce66ec1-7b75-4d90-b24f-b6ba583c70ed tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'create', calling method: .version_select at 0x7fede5b65af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-688282374", "description": "tempest-description-127163058"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:15.110053 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f5e1f194-39cf-4e53-8e01-bf9434b9ae0c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:15.124314 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f5e1f194-39cf-4e53-8e01-bf9434b9ae0c tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1472 microversion: 2.1 time: 0.526691 Jul 31 01:12:15.126159 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 719/1456] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:14 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1472 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:15.137523 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dab38e1f-b63c-484a-a5ba-00afcf872548 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:15.138864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dab38e1f-b63c-484a-a5ba-00afcf872548 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:15.152359 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dab38e1f-b63c-484a-a5ba-00afcf872548 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:15.153005 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dab38e1f-b63c-484a-a5ba-00afcf872548 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:15.153868 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dab38e1f-b63c-484a-a5ba-00afcf872548 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:15.154309 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dab38e1f-b63c-484a-a5ba-00afcf872548 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:15.318714 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3ce66ec1-7b75-4d90-b24f-b6ba583c70ed tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.494029 Jul 31 01:12:15.319889 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 738/1457] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:12:14 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:15.332999 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a77d662f-8156-492d-9457-b26e635dfb61 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:15.336258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a77d662f-8156-492d-9457-b26e635dfb61 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:15.352148 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a77d662f-8156-492d-9457-b26e635dfb61 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:15.353324 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a77d662f-8156-492d-9457-b26e635dfb61 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:15.355328 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a77d662f-8156-492d-9457-b26e635dfb61 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:15.355793 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a77d662f-8156-492d-9457-b26e635dfb61 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:15.448035 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dab38e1f-b63c-484a-a5ba-00afcf872548 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:15.458412 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dab38e1f-b63c-484a-a5ba-00afcf872548 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1674 microversion: 2.1 time: 0.327957 Jul 31 01:12:15.472760 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 720/1458] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:15 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1674 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:15.472760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8f0be8aa-91fe-40cd-8677-40936fffdf67 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:15.472760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8f0be8aa-91fe-40cd-8677-40936fffdf67 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:15.473383 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f0be8aa-91fe-40cd-8677-40936fffdf67 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:15.473857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f0be8aa-91fe-40cd-8677-40936fffdf67 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:15.474545 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f0be8aa-91fe-40cd-8677-40936fffdf67 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:15.475006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f0be8aa-91fe-40cd-8677-40936fffdf67 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:15.654552 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a77d662f-8156-492d-9457-b26e635dfb61 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:15.669191 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a77d662f-8156-492d-9457-b26e635dfb61 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.346755 Jul 31 01:12:15.670171 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 739/1459] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:15 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:15.677174 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f902da36-1635-4cf6-869f-c4daddf4b2df tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:15.677891 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f902da36-1635-4cf6-869f-c4daddf4b2df tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:15.692173 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f902da36-1635-4cf6-869f-c4daddf4b2df tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:15.693081 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f902da36-1635-4cf6-869f-c4daddf4b2df tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:15.694898 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f902da36-1635-4cf6-869f-c4daddf4b2df tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:15.695725 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f902da36-1635-4cf6-869f-c4daddf4b2df tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:15.706129 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:15.714274 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8f0be8aa-91fe-40cd-8677-40936fffdf67 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:15.725321 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8f0be8aa-91fe-40cd-8677-40936fffdf67 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1608 microversion: 2.1 time: 0.264652 Jul 31 01:12:15.726918 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 721/1460] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:15 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1608 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:15.733976 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-804ea2c7-a4b7-4afe-8f86-6bd6e9609b59 req-a160f2f0-41a1-45ad-ba37-0936c3014318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37302988-1cb9-4dca-a5a5-93ff2a30316b", "tag": "8e0167ab-8d69-4a27-8750-640d68a6c8e5"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:15.759479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-804ea2c7-a4b7-4afe-8f86-6bd6e9609b59 req-a160f2f0-41a1-45ad-ba37-0936c3014318 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:15.760535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-804ea2c7-a4b7-4afe-8f86-6bd6e9609b59 req-a160f2f0-41a1-45ad-ba37-0936c3014318 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:15.778260 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-804ea2c7-a4b7-4afe-8f86-6bd6e9609b59 req-a160f2f0-41a1-45ad-ba37-0936c3014318 service nova] Creating event network-changed:8e0167ab-8d69-4a27-8750-640d68a6c8e5 for instance 37302988-1cb9-4dca-a5a5-93ff2a30316b on n-h1-master-1 Jul 31 01:12:15.785410 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-804ea2c7-a4b7-4afe-8f86-6bd6e9609b59 req-a160f2f0-41a1-45ad-ba37-0936c3014318 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056674 Jul 31 01:12:15.786146 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 722/1461] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:15.798006 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-88ee7dae-5c47-485a-880c-cfc26549fd3f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Action: 'update', calling method: .version_select at 0x7fede55a68b0>, body: {"security_group": {"name": "tempest-sg-hth-386565105", "description": "tempest-description-hth-2006218102"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:16.121973 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f902da36-1635-4cf6-869f-c4daddf4b2df tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:16.143292 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f902da36-1635-4cf6-869f-c4daddf4b2df tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1307 microversion: 2.1 time: 0.467015 Jul 31 01:12:16.153625 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 740/1462] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:15 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1307 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:16.162568 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6890fde3-2a33-419a-8cc7-24966ee69482 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:16.163488 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6890fde3-2a33-419a-8cc7-24966ee69482 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:16.173941 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6890fde3-2a33-419a-8cc7-24966ee69482 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:16.174717 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6890fde3-2a33-419a-8cc7-24966ee69482 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:16.176054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6890fde3-2a33-419a-8cc7-24966ee69482 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:16.176763 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6890fde3-2a33-419a-8cc7-24966ee69482 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:16.219958 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-88ee7dae-5c47-485a-880c-cfc26549fd3f tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "PUT /compute/v2.1/os-security-groups/90797d57-3c10-46d2-aec3-ffbc54def4f7" status: 200 len: 217 microversion: 2.1 time: 0.431697 Jul 31 01:12:16.240544 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 723/1463] 10.222.0.45 () {60 vars in 1290 bytes} [Sun Jul 31 01:12:15 2022] PUT /compute/v2.1/os-security-groups/90797d57-3c10-46d2-aec3-ffbc54def4f7 => generated 217 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:16.250933 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fedbe2ce-0db2-4da6-b766-00cb84edc1ea tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:16.253026 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fedbe2ce-0db2-4da6-b766-00cb84edc1ea tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:16.270879 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fedbe2ce-0db2-4da6-b766-00cb84edc1ea tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:16.271842 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fedbe2ce-0db2-4da6-b766-00cb84edc1ea tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:16.273528 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fedbe2ce-0db2-4da6-b766-00cb84edc1ea tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:16.274462 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fedbe2ce-0db2-4da6-b766-00cb84edc1ea tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:16.696703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6890fde3-2a33-419a-8cc7-24966ee69482 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:16.712039 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6890fde3-2a33-419a-8cc7-24966ee69482 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1469 microversion: 2.1 time: 0.555305 Jul 31 01:12:16.731378 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 741/1464] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:16 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1469 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:16.731378 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-38dcef79-b0ed-4bb3-827d-177e782f539d tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede5e55550>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:16.741626 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fedbe2ce-0db2-4da6-b766-00cb84edc1ea tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:16.754271 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fedbe2ce-0db2-4da6-b766-00cb84edc1ea tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1472 microversion: 2.1 time: 0.511607 Jul 31 01:12:16.755331 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 724/1465] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:16 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1472 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:16.768953 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1dcc3698-6544-42c6-bbb0-c223e8dd3894 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:16.770643 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1dcc3698-6544-42c6-bbb0-c223e8dd3894 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:16.788609 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1dcc3698-6544-42c6-bbb0-c223e8dd3894 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:16.789921 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1dcc3698-6544-42c6-bbb0-c223e8dd3894 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:16.791780 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1dcc3698-6544-42c6-bbb0-c223e8dd3894 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:16.792434 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1dcc3698-6544-42c6-bbb0-c223e8dd3894 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:17.047886 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-38dcef79-b0ed-4bb3-827d-177e782f539d tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/90797d57-3c10-46d2-aec3-ffbc54def4f7" status: 200 len: 217 microversion: 2.1 time: 0.330845 Jul 31 01:12:17.059522 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 742/1466] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 01:12:16 2022] GET /compute/v2.1/os-security-groups/90797d57-3c10-46d2-aec3-ffbc54def4f7 => generated 217 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:17.064117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f42ce447-040a-4216-9fad-2706075b0c94 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:17.065292 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f42ce447-040a-4216-9fad-2706075b0c94 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:17.078825 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f42ce447-040a-4216-9fad-2706075b0c94 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:17.079737 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f42ce447-040a-4216-9fad-2706075b0c94 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:17.081245 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f42ce447-040a-4216-9fad-2706075b0c94 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:17.081891 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f42ce447-040a-4216-9fad-2706075b0c94 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:17.164597 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1dcc3698-6544-42c6-bbb0-c223e8dd3894 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:17.195729 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1dcc3698-6544-42c6-bbb0-c223e8dd3894 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1674 microversion: 2.1 time: 0.436608 Jul 31 01:12:17.207458 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 725/1467] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:16 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1674 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:17.207458 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c3380b5c-5b9a-4c78-8ec4-d09826cf8cba tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:17.207961 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c3380b5c-5b9a-4c78-8ec4-d09826cf8cba tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:17.220458 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3380b5c-5b9a-4c78-8ec4-d09826cf8cba tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:17.221151 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3380b5c-5b9a-4c78-8ec4-d09826cf8cba tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:17.222514 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3380b5c-5b9a-4c78-8ec4-d09826cf8cba tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:17.223246 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3380b5c-5b9a-4c78-8ec4-d09826cf8cba tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:17.487458 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f42ce447-040a-4216-9fad-2706075b0c94 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:17.500081 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f42ce447-040a-4216-9fad-2706075b0c94 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 0.447677 Jul 31 01:12:17.511378 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 743/1468] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:17 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:17.511378 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ce4ee20c-405d-4412-a352-e41419b0c29d tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede5af59d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:17.628842 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c3380b5c-5b9a-4c78-8ec4-d09826cf8cba tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:17.638322 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c3380b5c-5b9a-4c78-8ec4-d09826cf8cba tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1608 microversion: 2.1 time: 0.439691 Jul 31 01:12:17.640430 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 726/1469] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:17 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1608 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:17.644507 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c3d59417-9cc3-4477-af38-18e93f0ef789 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:17.645218 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c3d59417-9cc3-4477-af38-18e93f0ef789 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:17.648476 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:17.652475 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3d59417-9cc3-4477-af38-18e93f0ef789 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:17.653461 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3d59417-9cc3-4477-af38-18e93f0ef789 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:17.654058 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3d59417-9cc3-4477-af38-18e93f0ef789 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:17.654715 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3d59417-9cc3-4477-af38-18e93f0ef789 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:18.445182 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c3d59417-9cc3-4477-af38-18e93f0ef789 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:18.480957 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c3d59417-9cc3-4477-af38-18e93f0ef789 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1307 microversion: 2.1 time: 0.839751 Jul 31 01:12:18.490010 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 727/1470] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:17 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1307 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:18.513935 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c277a07e-9ea8-4792-8cfa-69b8bc551359 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:18.518988 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c277a07e-9ea8-4792-8cfa-69b8bc551359 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:18.537302 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c277a07e-9ea8-4792-8cfa-69b8bc551359 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:18.538067 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c277a07e-9ea8-4792-8cfa-69b8bc551359 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:18.539118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c277a07e-9ea8-4792-8cfa-69b8bc551359 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:18.539803 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c277a07e-9ea8-4792-8cfa-69b8bc551359 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:19.028313 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ce4ee20c-405d-4412-a352-e41419b0c29d tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/90797d57-3c10-46d2-aec3-ffbc54def4f7" status: 202 len: 0 microversion: 2.1 time: 1.525896 Jul 31 01:12:19.032825 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 744/1471] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:12:17 2022] DELETE /compute/v2.1/os-security-groups/90797d57-3c10-46d2-aec3-ffbc54def4f7 => generated 0 bytes in 1531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:12:19.037897 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-caa02e9c-8561-4d02-a6a2-a8e11d7a1ab1 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:19.038859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-caa02e9c-8561-4d02-a6a2-a8e11d7a1ab1 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:19.054007 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-caa02e9c-8561-4d02-a6a2-a8e11d7a1ab1 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:19.060507 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-caa02e9c-8561-4d02-a6a2-a8e11d7a1ab1 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:19.061653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-caa02e9c-8561-4d02-a6a2-a8e11d7a1ab1 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:19.062308 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-caa02e9c-8561-4d02-a6a2-a8e11d7a1ab1 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:19.345138 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c277a07e-9ea8-4792-8cfa-69b8bc551359 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:19.376321 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c277a07e-9ea8-4792-8cfa-69b8bc551359 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1469 microversion: 2.1 time: 0.873573 Jul 31 01:12:19.391451 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 728/1472] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:18 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1469 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:19.391451 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-70b22ae6-d9b0-4d0e-80b9-9497206bb11a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:19.392519 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-70b22ae6-d9b0-4d0e-80b9-9497206bb11a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:19.415532 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70b22ae6-d9b0-4d0e-80b9-9497206bb11a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:19.416827 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70b22ae6-d9b0-4d0e-80b9-9497206bb11a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:19.419120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70b22ae6-d9b0-4d0e-80b9-9497206bb11a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:19.420356 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70b22ae6-d9b0-4d0e-80b9-9497206bb11a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:19.782314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-caa02e9c-8561-4d02-a6a2-a8e11d7a1ab1 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:19.806559 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-caa02e9c-8561-4d02-a6a2-a8e11d7a1ab1 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1472 microversion: 2.1 time: 0.772106 Jul 31 01:12:19.831130 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 745/1473] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:19 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1472 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:19.840508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2855d672-0c24-4101-9abc-55ad676136a5 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:19.841159 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2855d672-0c24-4101-9abc-55ad676136a5 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:19.855502 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2855d672-0c24-4101-9abc-55ad676136a5 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:19.856256 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2855d672-0c24-4101-9abc-55ad676136a5 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:19.857275 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2855d672-0c24-4101-9abc-55ad676136a5 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:19.857895 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2855d672-0c24-4101-9abc-55ad676136a5 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:20.325271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-70b22ae6-d9b0-4d0e-80b9-9497206bb11a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:20.343776 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-70b22ae6-d9b0-4d0e-80b9-9497206bb11a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1674 microversion: 2.1 time: 0.962863 Jul 31 01:12:20.344651 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 729/1474] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:19 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1674 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:20.378215 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a2e81779-4a74-472b-99ba-2aaffc022e85 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:20.378885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a2e81779-4a74-472b-99ba-2aaffc022e85 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:20.416165 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a2e81779-4a74-472b-99ba-2aaffc022e85 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:20.417003 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a2e81779-4a74-472b-99ba-2aaffc022e85 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:20.417888 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a2e81779-4a74-472b-99ba-2aaffc022e85 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:20.418348 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a2e81779-4a74-472b-99ba-2aaffc022e85 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:20.618553 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a2e81779-4a74-472b-99ba-2aaffc022e85 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:20.638424 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a2e81779-4a74-472b-99ba-2aaffc022e85 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1252 microversion: 2.1 time: 0.292616 Jul 31 01:12:20.639045 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 730/1475] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:20 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1252 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:20.659307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8704f72b-a7a5-4ef8-9726-716f7af5dd51 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:20.659855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8704f72b-a7a5-4ef8-9726-716f7af5dd51 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:20.727582 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8704f72b-a7a5-4ef8-9726-716f7af5dd51 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:20.728317 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8704f72b-a7a5-4ef8-9726-716f7af5dd51 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:20.729371 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8704f72b-a7a5-4ef8-9726-716f7af5dd51 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:20.730013 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8704f72b-a7a5-4ef8-9726-716f7af5dd51 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:20.774109 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-8704f72b-a7a5-4ef8-9726-716f7af5dd51 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] HTTP exception thrown: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8704f72b-a7a5-4ef8-9726-716f7af5dd51 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Request method failure captured: Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 HTTP/1.1 Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dZ4RROZmvNHgk8nkEPCHEOtKeymvD8aJkYSffUh8bqh37RpmNHALtgJw0W3wgMu6HJwqcBFxL8fLuKg63WTseMOWT3m6KTBzl-wHxPxejmdZtFZxPmexVFKQ3mNYzDtb_uVYFrMpBX3R40pkmpf04xAyZo3K5gfwBnL_o_UQmcBzKE Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a45cfeb1ce9844c5bf16e975af312ba0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: e3e6a158c3884c8db5a66fe80e71527d Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '4ca134f6-3529-47bd-830d-0ab1b9b69775'} Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:20.776246 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:20.781108 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. Jul 31 01:12:20.781108 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:20.781108 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:20.781108 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:20.781108 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:20.781108 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:20.781108 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:20.781108 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:20.781108 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:20.781108 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. Jul 31 01:12:20.781108 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:20.798207 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8704f72b-a7a5-4ef8-9726-716f7af5dd51 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Returning 404 to user: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:20.799611 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8704f72b-a7a5-4ef8-9726-716f7af5dd51 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 404 len: 111 microversion: 2.1 time: 0.146505 Jul 31 01:12:20.800581 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 731/1476] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:12:20 2022] DELETE /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:20.812920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-482fa977-8995-4dc8-82cc-c554f37792bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:20.813943 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-482fa977-8995-4dc8-82cc-c554f37792bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:20.830489 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-482fa977-8995-4dc8-82cc-c554f37792bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:20.833872 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-482fa977-8995-4dc8-82cc-c554f37792bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:20.838737 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-482fa977-8995-4dc8-82cc-c554f37792bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:20.839481 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-482fa977-8995-4dc8-82cc-c554f37792bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:20.880492 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2855d672-0c24-4101-9abc-55ad676136a5 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:20.894032 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2855d672-0c24-4101-9abc-55ad676136a5 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1717 microversion: 2.1 time: 1.061529 Jul 31 01:12:20.898116 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 746/1477] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:19 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1717 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:20.918735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-254acd38-cf80-447c-9486-25c420f5ea5c req-955c1fc0-bd49-4e6a-8447-c40563a79bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451cf12b-e061-4c6c-8b43-40cee9ddcc1c", "name": "network-vif-deleted", "tag": "e424fe72-c4fb-4577-bbaa-a66dd860365f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:20.955383 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-254acd38-cf80-447c-9486-25c420f5ea5c req-955c1fc0-bd49-4e6a-8447-c40563a79bf0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:20.956327 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-254acd38-cf80-447c-9486-25c420f5ea5c req-955c1fc0-bd49-4e6a-8447-c40563a79bf0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:20.996906 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-254acd38-cf80-447c-9486-25c420f5ea5c req-955c1fc0-bd49-4e6a-8447-c40563a79bf0 service nova] Creating event network-vif-deleted:e424fe72-c4fb-4577-bbaa-a66dd860365f for instance 451cf12b-e061-4c6c-8b43-40cee9ddcc1c on n-h1-master-1 Jul 31 01:12:21.012167 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-254acd38-cf80-447c-9486-25c420f5ea5c req-955c1fc0-bd49-4e6a-8447-c40563a79bf0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109830 Jul 31 01:12:21.013451 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 747/1478] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:21.022409 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-8667ca8f-0875-49bf-8a3a-c93eff8ff1e8 req-00bacce3-38df-4b15-a8e6-05fec12dac8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1f8550-6240-420b-8abf-9b5e9a8ebc2e", "name": "network-vif-deleted", "tag": "7550470f-2bfc-4a0c-9188-0112084064b5"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:21.048931 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8667ca8f-0875-49bf-8a3a-c93eff8ff1e8 req-00bacce3-38df-4b15-a8e6-05fec12dac8e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:21.053177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8667ca8f-0875-49bf-8a3a-c93eff8ff1e8 req-00bacce3-38df-4b15-a8e6-05fec12dac8e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:21.084938 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-8667ca8f-0875-49bf-8a3a-c93eff8ff1e8 req-00bacce3-38df-4b15-a8e6-05fec12dac8e service nova] Creating event network-vif-deleted:7550470f-2bfc-4a0c-9188-0112084064b5 for instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e on n-h2-master-1 Jul 31 01:12:21.094805 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-8667ca8f-0875-49bf-8a3a-c93eff8ff1e8 req-00bacce3-38df-4b15-a8e6-05fec12dac8e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078773 Jul 31 01:12:21.098369 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 748/1479] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:21.108808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9cde84ab-f6d7-4daf-8de5-588c4be84e5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:21.136925 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9cde84ab-f6d7-4daf-8de5-588c4be84e5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:21.162718 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9cde84ab-f6d7-4daf-8de5-588c4be84e5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:21.163648 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9cde84ab-f6d7-4daf-8de5-588c4be84e5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:21.164742 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9cde84ab-f6d7-4daf-8de5-588c4be84e5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:21.165432 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9cde84ab-f6d7-4daf-8de5-588c4be84e5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:21.354490 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9cde84ab-f6d7-4daf-8de5-588c4be84e5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:21.355712 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9cde84ab-f6d7-4daf-8de5-588c4be84e5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:21.360710 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-9cde84ab-f6d7-4daf-8de5-588c4be84e5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lazy-loading 'fault' on Instance uuid eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:12:21.424163 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:21.585983 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=10 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:21.622295 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9cde84ab-f6d7-4daf-8de5-588c4be84e5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:21.635940 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9cde84ab-f6d7-4daf-8de5-588c4be84e5b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 200 len: 1303 microversion: 2.1 time: 0.533648 Jul 31 01:12:21.652939 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 749/1480] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:21 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 1303 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:21.668970 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a1c8007-518c-4731-93cd-c95cabd0ad64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:21.691704 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9a1c8007-518c-4731-93cd-c95cabd0ad64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 4ca134f6-3529-47bd-830d-0ab1b9b69775] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:21.716826 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a1c8007-518c-4731-93cd-c95cabd0ad64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:21.722719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a1c8007-518c-4731-93cd-c95cabd0ad64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:21.722719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a1c8007-518c-4731-93cd-c95cabd0ad64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:21.722719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a1c8007-518c-4731-93cd-c95cabd0ad64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:21.761946 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-9a1c8007-518c-4731-93cd-c95cabd0ad64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] HTTP exception thrown: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a1c8007-518c-4731-93cd-c95cabd0ad64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Request method failure captured: Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 HTTP/1.1 Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dZ4RROZmvNHgk8nkEPCHEOtKeymvD8aJkYSffUh8bqh37RpmNHALtgJw0W3wgMu6HJwqcBFxL8fLuKg63WTseMOWT3m6KTBzl-wHxPxejmdZtFZxPmexVFKQ3mNYzDtb_uVYFrMpBX3R40pkmpf04xAyZo3K5gfwBnL_o_UQmcBzKE Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a45cfeb1ce9844c5bf16e975af312ba0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: e3e6a158c3884c8db5a66fe80e71527d Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '4ca134f6-3529-47bd-830d-0ab1b9b69775'} Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:21.768563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:21.786424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:21.786424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:21.786424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:21.786424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:21.786424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:21.786424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. Jul 31 01:12:21.786424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:21.786424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a1c8007-518c-4731-93cd-c95cabd0ad64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Returning 404 to user: Instance 4ca134f6-3529-47bd-830d-0ab1b9b69775 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:21.786424 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9a1c8007-518c-4731-93cd-c95cabd0ad64 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775" status: 404 len: 111 microversion: 2.1 time: 0.119830 Jul 31 01:12:21.786424 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 750/1481] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:21 2022] GET /compute/v2.1/servers/4ca134f6-3529-47bd-830d-0ab1b9b69775 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:21.791221 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-08bb8ec3-7a58-40f5-bff8-7f228fef83c8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:21.800792 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-482fa977-8995-4dc8-82cc-c554f37792bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:21.809165 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-08bb8ec3-7a58-40f5-bff8-7f228fef83c8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:21.811239 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-482fa977-8995-4dc8-82cc-c554f37792bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1307 microversion: 2.1 time: 1.008503 Jul 31 01:12:21.831396 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 732/1482] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:20 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1307 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:21.832481 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08bb8ec3-7a58-40f5-bff8-7f228fef83c8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:21.832481 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08bb8ec3-7a58-40f5-bff8-7f228fef83c8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:21.832481 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08bb8ec3-7a58-40f5-bff8-7f228fef83c8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:21.832481 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08bb8ec3-7a58-40f5-bff8-7f228fef83c8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:21.836756 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-16245d8e-366b-4aed-8f3c-74af5245b4e8 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:21.837862 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-16245d8e-366b-4aed-8f3c-74af5245b4e8 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:21.858693 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16245d8e-366b-4aed-8f3c-74af5245b4e8 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:21.861447 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16245d8e-366b-4aed-8f3c-74af5245b4e8 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:21.862693 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16245d8e-366b-4aed-8f3c-74af5245b4e8 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:21.871509 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16245d8e-366b-4aed-8f3c-74af5245b4e8 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:21.946781 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08bb8ec3-7a58-40f5-bff8-7f228fef83c8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:21.946781 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08bb8ec3-7a58-40f5-bff8-7f228fef83c8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:21.952394 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-08bb8ec3-7a58-40f5-bff8-7f228fef83c8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lazy-loading 'fault' on Instance uuid 439c28bf-0712-481c-9dca-6d50f87fcfd9 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:12:22.111889 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-16245d8e-366b-4aed-8f3c-74af5245b4e8 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246145364b854ab7bb4fdaffcfa238d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531072622a6d4b10b902ac7644c6a7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:22.126826 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-16245d8e-366b-4aed-8f3c-74af5245b4e8 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 200 len: 1455 microversion: 2.1 time: 0.311009 Jul 31 01:12:22.132289 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-08bb8ec3-7a58-40f5-bff8-7f228fef83c8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fad0a50973b44149c18ca2b76bfab36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba602c4ed5b94aad996ef8c95d3436ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:22.145157 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-08bb8ec3-7a58-40f5-bff8-7f228fef83c8 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 200 len: 1306 microversion: 2.1 time: 0.361787 Jul 31 01:12:22.150140 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 733/1483] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:21 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 1455 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:22.156240 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 751/1484] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:21 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 1306 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:22.169485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-349ea7ed-f044-40b4-9870-3759d8ce6056 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede5b52550>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:22.176230 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9e72e865-be41-4c1e-ac82-e5df565b8d28 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:22.177314 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9e72e865-be41-4c1e-ac82-e5df565b8d28 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:22.209902 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e72e865-be41-4c1e-ac82-e5df565b8d28 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:22.210900 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e72e865-be41-4c1e-ac82-e5df565b8d28 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:22.212756 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e72e865-be41-4c1e-ac82-e5df565b8d28 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:22.213640 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e72e865-be41-4c1e-ac82-e5df565b8d28 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:22.295602 n-d-master-1 devstack@n-api.service[119475]: DEBUG neutronclient.v2_0.client [None req-349ea7ed-f044-40b4-9870-3759d8ce6056 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4630e85a-7518-407e-8bf8-95e79e92512d does not exist", "detail": ""}} {{(pid=119475) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:12:22.296539 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.security_group_api [None req-349ea7ed-f044-40b4-9870-3759d8ce6056 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Neutron security group 4630e85a-7518-407e-8bf8-95e79e92512d not found {{(pid=119475) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 31 01:12:22.297233 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-349ea7ed-f044-40b4-9870-3759d8ce6056 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] HTTP exception thrown: Security group 4630e85a-7518-407e-8bf8-95e79e92512d does not exist Jul 31 01:12:22.297233 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-51521f0b-2000-454c-b3c8-ca60efd091ad'] Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-349ea7ed-f044-40b4-9870-3759d8ce6056 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Request method failure captured: Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/os-security-groups/4630e85a-7518-407e-8bf8-95e79e92512d HTTP/1.1 Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dZ4RROZmvNHgk8nkEPCHEOtKeymvD8aJkYSffUh8bqh37RpmNHALtgJw0W3wgMu6HJwqcBFxL8fLuKg63WTseMOWT3m6KTBzl-wHxPxejmdZtFZxPmexVFKQ3mNYzDtb_uVYFrMpBX3R40pkmpf04xAyZo3K5gfwBnL_o_UQmcBzKE Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a45cfeb1ce9844c5bf16e975af312ba0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: e3e6a158c3884c8db5a66fe80e71527d Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: exception: Security group 4630e85a-7518-407e-8bf8-95e79e92512d does not exist Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-51521f0b-2000-454c-b3c8-ca60efd091ad'] Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '4630e85a-7518-407e-8bf8-95e79e92512d'} Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:12:22.299407 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4630e85a-7518-407e-8bf8-95e79e92512d does not exist Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51521f0b-2000-454c-b3c8-ca60efd091ad'] Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4630e85a-7518-407e-8bf8-95e79e92512d does not exist Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51521f0b-2000-454c-b3c8-ca60efd091ad'] Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4630e85a-7518-407e-8bf8-95e79e92512d does not exist Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51521f0b-2000-454c-b3c8-ca60efd091ad'] Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4630e85a-7518-407e-8bf8-95e79e92512d does not exist Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51521f0b-2000-454c-b3c8-ca60efd091ad'] Jul 31 01:12:22.303771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.306562 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-349ea7ed-f044-40b4-9870-3759d8ce6056 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Returning 404 to user: Security group 4630e85a-7518-407e-8bf8-95e79e92512d does not exist Jul 31 01:12:22.306562 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-51521f0b-2000-454c-b3c8-ca60efd091ad'] {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:22.307831 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-349ea7ed-f044-40b4-9870-3759d8ce6056 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/4630e85a-7518-407e-8bf8-95e79e92512d" status: 404 len: 194 microversion: 2.1 time: 0.144550 Jul 31 01:12:22.311832 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 752/1485] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:12:22 2022] DELETE /compute/v2.1/os-security-groups/4630e85a-7518-407e-8bf8-95e79e92512d => generated 194 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:22.326487 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-871f456c-15ef-489a-a87f-fc69fafce84d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:22.328157 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-871f456c-15ef-489a-a87f-fc69fafce84d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:22.343554 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-871f456c-15ef-489a-a87f-fc69fafce84d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:22.347360 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-871f456c-15ef-489a-a87f-fc69fafce84d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:22.348499 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-871f456c-15ef-489a-a87f-fc69fafce84d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:22.349091 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-871f456c-15ef-489a-a87f-fc69fafce84d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:22.431900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9e72e865-be41-4c1e-ac82-e5df565b8d28 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:22.441418 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9e72e865-be41-4c1e-ac82-e5df565b8d28 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1252 microversion: 2.1 time: 0.289815 Jul 31 01:12:22.463627 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 734/1486] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:22 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1252 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:22.472183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e23972cb-066d-4b12-a8f9-fb22c0e69b5a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede55d8f70>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:22.702869 n-d-master-1 devstack@n-api.service[119474]: DEBUG neutronclient.v2_0.client [None req-e23972cb-066d-4b12-a8f9-fb22c0e69b5a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 579b1ee4-17da-43d9-8126-f1350c83531a does not exist", "detail": ""}} {{(pid=119474) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:12:22.704123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.security_group_api [None req-e23972cb-066d-4b12-a8f9-fb22c0e69b5a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Neutron security group 579b1ee4-17da-43d9-8126-f1350c83531a not found {{(pid=119474) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 31 01:12:22.705974 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-e23972cb-066d-4b12-a8f9-fb22c0e69b5a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] HTTP exception thrown: Security group 579b1ee4-17da-43d9-8126-f1350c83531a does not exist Jul 31 01:12:22.705974 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-971928fa-67d2-4bbc-b37c-cc0f9d7ad304'] Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e23972cb-066d-4b12-a8f9-fb22c0e69b5a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Request method failure captured: Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/os-security-groups/579b1ee4-17da-43d9-8126-f1350c83531a HTTP/1.1 Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dZ4RROZmvNHgk8nkEPCHEOtKeymvD8aJkYSffUh8bqh37RpmNHALtgJw0W3wgMu6HJwqcBFxL8fLuKg63WTseMOWT3m6KTBzl-wHxPxejmdZtFZxPmexVFKQ3mNYzDtb_uVYFrMpBX3R40pkmpf04xAyZo3K5gfwBnL_o_UQmcBzKE Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a45cfeb1ce9844c5bf16e975af312ba0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: e3e6a158c3884c8db5a66fe80e71527d Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: exception: Security group 579b1ee4-17da-43d9-8126-f1350c83531a does not exist Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-971928fa-67d2-4bbc-b37c-cc0f9d7ad304'] Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '579b1ee4-17da-43d9-8126-f1350c83531a'} Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:12:22.709774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 579b1ee4-17da-43d9-8126-f1350c83531a does not exist Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-971928fa-67d2-4bbc-b37c-cc0f9d7ad304'] Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 579b1ee4-17da-43d9-8126-f1350c83531a does not exist Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-971928fa-67d2-4bbc-b37c-cc0f9d7ad304'] Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 579b1ee4-17da-43d9-8126-f1350c83531a does not exist Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-971928fa-67d2-4bbc-b37c-cc0f9d7ad304'] Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 579b1ee4-17da-43d9-8126-f1350c83531a does not exist Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-971928fa-67d2-4bbc-b37c-cc0f9d7ad304'] Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e23972cb-066d-4b12-a8f9-fb22c0e69b5a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Returning 404 to user: Security group 579b1ee4-17da-43d9-8126-f1350c83531a does not exist Jul 31 01:12:22.713826 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-971928fa-67d2-4bbc-b37c-cc0f9d7ad304'] {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:22.716409 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e23972cb-066d-4b12-a8f9-fb22c0e69b5a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/579b1ee4-17da-43d9-8126-f1350c83531a" status: 404 len: 194 microversion: 2.1 time: 0.250581 Jul 31 01:12:22.716972 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 735/1487] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:12:22 2022] DELETE /compute/v2.1/os-security-groups/579b1ee4-17da-43d9-8126-f1350c83531a => generated 194 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:22.740670 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7d5b44b8-e77c-47a7-8b13-4ff1eecbb88b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:22.756386 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7d5b44b8-e77c-47a7-8b13-4ff1eecbb88b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: eafdd229-897b-4b1f-adfc-3d7bb4fef7a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:22.791302 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d5b44b8-e77c-47a7-8b13-4ff1eecbb88b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:22.797672 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d5b44b8-e77c-47a7-8b13-4ff1eecbb88b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:22.802496 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d5b44b8-e77c-47a7-8b13-4ff1eecbb88b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:22.804668 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d5b44b8-e77c-47a7-8b13-4ff1eecbb88b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:22.865069 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-7d5b44b8-e77c-47a7-8b13-4ff1eecbb88b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] HTTP exception thrown: Instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 could not be found. Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7d5b44b8-e77c-47a7-8b13-4ff1eecbb88b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Request method failure captured: Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 HTTP/1.1 Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dWOWPD3u0Fwp5dGWcnUSe7Du8BFrIy2qCUrbP0DPSdaXw9Dwq3xbMRWtIAN4LwWBFVr_wCpWuEP_7NOGIRZaJ2VmGob-JMnRAhEgQ-45R5DG3RUp1kLtZoUytKJiEJnQmYJhweNVBe5oJ_0Yz5MoBlDgNmyzYMTS1syAb7ShVLW-_0 Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 87496179e992473c991977e0e517460a Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-MigrationsAdminTest-1757285143 Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87496179e992473c991977e0e517460a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87496179e992473c991977e0e517460a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/87496179e992473c991977e0e517460a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_87496179e992473c991977e0e517460a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-MigrationsAdminTest-1757285143 Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 87496179e992473c991977e0e517460a Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-MigrationsAdminTest-1757285143 Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-MigrationsAdminTest-1757285143-project Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 9a2a0f61c8304c9a9ad7af6120e83443 Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-MigrationsAdminTest-1757285143-project Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: exception: Instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 could not be found. Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'eafdd229-897b-4b1f-adfc-3d7bb4fef7a0'} Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 could not be found. Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 could not be found. Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:22.868404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.872556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:22.872556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:22.872556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:22.872556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:22.872556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:22.872556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 could not be found. Jul 31 01:12:22.872556 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:22.872556 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7d5b44b8-e77c-47a7-8b13-4ff1eecbb88b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Returning 404 to user: Instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:22.872556 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7d5b44b8-e77c-47a7-8b13-4ff1eecbb88b tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0" status: 404 len: 111 microversion: 2.1 time: 0.143233 Jul 31 01:12:22.873443 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 736/1488] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:22 2022] GET /compute/v2.1/servers/eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:22.889084 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-013c2232-3411-439b-920f-12ea9474dc3a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fedeaa274c0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:23.010448 n-d-master-1 devstack@n-api.service[119474]: DEBUG neutronclient.v2_0.client [None req-013c2232-3411-439b-920f-12ea9474dc3a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d62f4c97-5391-480e-8948-db2957f27022 does not exist", "detail": ""}} {{(pid=119474) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:12:23.012376 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.security_group_api [None req-013c2232-3411-439b-920f-12ea9474dc3a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Neutron security group d62f4c97-5391-480e-8948-db2957f27022 not found {{(pid=119474) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 31 01:12:23.013599 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-013c2232-3411-439b-920f-12ea9474dc3a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] HTTP exception thrown: Security group d62f4c97-5391-480e-8948-db2957f27022 does not exist Jul 31 01:12:23.013599 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-315ebe8d-e47c-4fa6-8063-216358e8ca09'] Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-013c2232-3411-439b-920f-12ea9474dc3a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Request method failure captured: Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/os-security-groups/d62f4c97-5391-480e-8948-db2957f27022 HTTP/1.1 Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dZ4RROZmvNHgk8nkEPCHEOtKeymvD8aJkYSffUh8bqh37RpmNHALtgJw0W3wgMu6HJwqcBFxL8fLuKg63WTseMOWT3m6KTBzl-wHxPxejmdZtFZxPmexVFKQ3mNYzDtb_uVYFrMpBX3R40pkmpf04xAyZo3K5gfwBnL_o_UQmcBzKE Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a45cfeb1ce9844c5bf16e975af312ba0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: e3e6a158c3884c8db5a66fe80e71527d Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: exception: Security group d62f4c97-5391-480e-8948-db2957f27022 does not exist Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-315ebe8d-e47c-4fa6-8063-216358e8ca09'] Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'd62f4c97-5391-480e-8948-db2957f27022'} Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:12:23.019164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d62f4c97-5391-480e-8948-db2957f27022 does not exist Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-315ebe8d-e47c-4fa6-8063-216358e8ca09'] Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d62f4c97-5391-480e-8948-db2957f27022 does not exist Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-315ebe8d-e47c-4fa6-8063-216358e8ca09'] Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d62f4c97-5391-480e-8948-db2957f27022 does not exist Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-315ebe8d-e47c-4fa6-8063-216358e8ca09'] Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d62f4c97-5391-480e-8948-db2957f27022 does not exist Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-315ebe8d-e47c-4fa6-8063-216358e8ca09'] Jul 31 01:12:23.027508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.035498 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-013c2232-3411-439b-920f-12ea9474dc3a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Returning 404 to user: Security group d62f4c97-5391-480e-8948-db2957f27022 does not exist Jul 31 01:12:23.035498 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-315ebe8d-e47c-4fa6-8063-216358e8ca09'] {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:23.038075 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-013c2232-3411-439b-920f-12ea9474dc3a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/d62f4c97-5391-480e-8948-db2957f27022" status: 404 len: 194 microversion: 2.1 time: 0.161028 Jul 31 01:12:23.042717 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 737/1489] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:12:22 2022] DELETE /compute/v2.1/os-security-groups/d62f4c97-5391-480e-8948-db2957f27022 => generated 194 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:23.053305 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-871f456c-15ef-489a-a87f-fc69fafce84d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:23.079388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-40ad767e-5e59-455b-8ce2-beddf2c5767a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:23.080956 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-40ad767e-5e59-455b-8ce2-beddf2c5767a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:23.095883 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-871f456c-15ef-489a-a87f-fc69fafce84d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1707 microversion: 2.1 time: 0.783143 Jul 31 01:12:23.100848 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 753/1490] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:22 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1707 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:23.118017 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-40ad767e-5e59-455b-8ce2-beddf2c5767a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:23.123650 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-40ad767e-5e59-455b-8ce2-beddf2c5767a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:23.127505 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8ea5a4ce-cf6d-4369-b2dd-8475fb785fc3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:23.129047 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-40ad767e-5e59-455b-8ce2-beddf2c5767a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:23.130098 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-40ad767e-5e59-455b-8ce2-beddf2c5767a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:23.131461 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8ea5a4ce-cf6d-4369-b2dd-8475fb785fc3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:23.172303 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ea5a4ce-cf6d-4369-b2dd-8475fb785fc3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:23.172775 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ea5a4ce-cf6d-4369-b2dd-8475fb785fc3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:23.179681 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ea5a4ce-cf6d-4369-b2dd-8475fb785fc3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:23.180335 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ea5a4ce-cf6d-4369-b2dd-8475fb785fc3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:23.249537 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8ea5a4ce-cf6d-4369-b2dd-8475fb785fc3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:12:23.568948 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8ea5a4ce-cf6d-4369-b2dd-8475fb785fc3 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "DELETE /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 204 len: 0 microversion: 2.1 time: 0.463662 Jul 31 01:12:23.571454 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 754/1491] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:12:23 2022] DELETE /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:12:23.598691 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-acfa26e4-f368-4353-9b4f-c5a7bcad08b0 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede5b67790>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:23.688707 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-40ad767e-5e59-455b-8ce2-beddf2c5767a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:23.706975 n-d-master-1 devstack@n-api.service[119475]: DEBUG neutronclient.v2_0.client [None req-acfa26e4-f368-4353-9b4f-c5a7bcad08b0 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d1a1347a-e95f-450d-b1fb-eda6b1636383 does not exist", "detail": ""}} {{(pid=119475) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:12:23.708047 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.security_group_api [None req-acfa26e4-f368-4353-9b4f-c5a7bcad08b0 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Neutron security group d1a1347a-e95f-450d-b1fb-eda6b1636383 not found {{(pid=119475) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 31 01:12:23.708899 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-acfa26e4-f368-4353-9b4f-c5a7bcad08b0 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] HTTP exception thrown: Security group d1a1347a-e95f-450d-b1fb-eda6b1636383 does not exist Jul 31 01:12:23.708899 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-adc50b3f-38ce-4387-a9d4-2dddf4f1ffd0'] Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-acfa26e4-f368-4353-9b4f-c5a7bcad08b0 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Request method failure captured: Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/os-security-groups/d1a1347a-e95f-450d-b1fb-eda6b1636383 HTTP/1.1 Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dZ4RROZmvNHgk8nkEPCHEOtKeymvD8aJkYSffUh8bqh37RpmNHALtgJw0W3wgMu6HJwqcBFxL8fLuKg63WTseMOWT3m6KTBzl-wHxPxejmdZtFZxPmexVFKQ3mNYzDtb_uVYFrMpBX3R40pkmpf04xAyZo3K5gfwBnL_o_UQmcBzKE Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a45cfeb1ce9844c5bf16e975af312ba0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: e3e6a158c3884c8db5a66fe80e71527d Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: exception: Security group d1a1347a-e95f-450d-b1fb-eda6b1636383 does not exist Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-adc50b3f-38ce-4387-a9d4-2dddf4f1ffd0'] Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'd1a1347a-e95f-450d-b1fb-eda6b1636383'} Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:12:23.712854 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d1a1347a-e95f-450d-b1fb-eda6b1636383 does not exist Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adc50b3f-38ce-4387-a9d4-2dddf4f1ffd0'] Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d1a1347a-e95f-450d-b1fb-eda6b1636383 does not exist Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adc50b3f-38ce-4387-a9d4-2dddf4f1ffd0'] Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d1a1347a-e95f-450d-b1fb-eda6b1636383 does not exist Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adc50b3f-38ce-4387-a9d4-2dddf4f1ffd0'] Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d1a1347a-e95f-450d-b1fb-eda6b1636383 does not exist Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adc50b3f-38ce-4387-a9d4-2dddf4f1ffd0'] Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-acfa26e4-f368-4353-9b4f-c5a7bcad08b0 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Returning 404 to user: Security group d1a1347a-e95f-450d-b1fb-eda6b1636383 does not exist Jul 31 01:12:23.716843 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-adc50b3f-38ce-4387-a9d4-2dddf4f1ffd0'] {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:23.720479 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-acfa26e4-f368-4353-9b4f-c5a7bcad08b0 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/d1a1347a-e95f-450d-b1fb-eda6b1636383" status: 404 len: 194 microversion: 2.1 time: 0.142546 Jul 31 01:12:23.722149 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 755/1492] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:12:23 2022] DELETE /compute/v2.1/os-security-groups/d1a1347a-e95f-450d-b1fb-eda6b1636383 => generated 194 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:23.730089 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-40ad767e-5e59-455b-8ce2-beddf2c5767a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1307 microversion: 2.1 time: 0.684520 Jul 31 01:12:23.736224 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 738/1493] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:23 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1307 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:23.744970 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-e9c7d62b-6fb3-4183-b607-f8cfe2053c82 req-64b0e89c-5241-4e3f-a1c6-fdd875213310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439c28bf-0712-481c-9dca-6d50f87fcfd9", "name": "network-vif-deleted", "tag": "9f7d18a3-a076-4c90-b9fb-4dc8ebd95775"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:23.753428 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a0987f25-5006-45ca-910e-2e204994103c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '.version_select at 0x7fede557b5e0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:23.791860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0987f25-5006-45ca-910e-2e204994103c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:23.792891 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0987f25-5006-45ca-910e-2e204994103c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:23.814771 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e9c7d62b-6fb3-4183-b607-f8cfe2053c82 req-64b0e89c-5241-4e3f-a1c6-fdd875213310 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:23.815312 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e9c7d62b-6fb3-4183-b607-f8cfe2053c82 req-64b0e89c-5241-4e3f-a1c6-fdd875213310 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:23.834736 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a0987f25-5006-45ca-910e-2e204994103c tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 3493 microversion: 2.1 time: 0.096382 Jul 31 01:12:23.837665 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 739/1494] 10.222.0.45 () {58 vars in 1143 bytes} [Sun Jul 31 01:12:23 2022] GET /compute/v2.1/os-migrations => generated 3493 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:23.844963 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-e9c7d62b-6fb3-4183-b607-f8cfe2053c82 req-64b0e89c-5241-4e3f-a1c6-fdd875213310 service nova] Creating event network-vif-deleted:9f7d18a3-a076-4c90-b9fb-4dc8ebd95775 for instance 439c28bf-0712-481c-9dca-6d50f87fcfd9 on n-h2-master-1 Jul 31 01:12:23.849941 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3a5b5ba9-2926-45c2-bda5-8e5f1d53258a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:23.851315 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3a5b5ba9-2926-45c2-bda5-8e5f1d53258a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:23.867250 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-e9c7d62b-6fb3-4183-b607-f8cfe2053c82 req-64b0e89c-5241-4e3f-a1c6-fdd875213310 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142015 Jul 31 01:12:23.867946 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 756/1495] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:23.873911 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d526b9c2-7dcf-4b95-a408-cac1b0efaf32 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:23.876210 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d526b9c2-7dcf-4b95-a408-cac1b0efaf32 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] [instance: 439c28bf-0712-481c-9dca-6d50f87fcfd9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:23.881572 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a5b5ba9-2926-45c2-bda5-8e5f1d53258a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:23.882323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a5b5ba9-2926-45c2-bda5-8e5f1d53258a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:23.888426 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a5b5ba9-2926-45c2-bda5-8e5f1d53258a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:23.892381 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a5b5ba9-2926-45c2-bda5-8e5f1d53258a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:23.894090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d526b9c2-7dcf-4b95-a408-cac1b0efaf32 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:23.894313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d526b9c2-7dcf-4b95-a408-cac1b0efaf32 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:23.900491 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d526b9c2-7dcf-4b95-a408-cac1b0efaf32 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:23.903565 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d526b9c2-7dcf-4b95-a408-cac1b0efaf32 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:23.982731 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-3a5b5ba9-2926-45c2-bda5-8e5f1d53258a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] HTTP exception thrown: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. Jul 31 01:12:23.985897 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-d526b9c2-7dcf-4b95-a408-cac1b0efaf32 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] HTTP exception thrown: Instance 439c28bf-0712-481c-9dca-6d50f87fcfd9 could not be found. Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d526b9c2-7dcf-4b95-a408-cac1b0efaf32 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Request method failure captured: Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 HTTP/1.1 Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dXvczrjV93XGTog32ZhLWWtba7dtc274nDtU8E1Fg1kaFfSFTu1mOthIsPp5iOJofIsjlZdSwTbjyj2LE7DPBnmjox8fqRCUbcXosGLpS7nCLvEC8_927gD0PLQuRdewtttI4lKyEun5DpT6VtlLkZ534cOYIJ9M_YWbga0UOFAT7s Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: ba602c4ed5b94aad996ef8c95d3436ba Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ba602c4ed5b94aad996ef8c95d3436ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ba602c4ed5b94aad996ef8c95d3436ba", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: ba602c4ed5b94aad996ef8c95d3436ba Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-46531715 Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersOnMultiNodesTest-46531715-project Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 0fad0a50973b44149c18ca2b76bfab36 Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersOnMultiNodesTest-46531715-project Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 439c28bf-0712-481c-9dca-6d50f87fcfd9 could not be found. Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '439c28bf-0712-481c-9dca-6d50f87fcfd9'} Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 439c28bf-0712-481c-9dca-6d50f87fcfd9 could not be found. Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 439c28bf-0712-481c-9dca-6d50f87fcfd9 could not be found. Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:23.990776 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:24.003584 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:24.003584 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:24.003584 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:24.003584 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:24.003584 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:24.003584 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 439c28bf-0712-481c-9dca-6d50f87fcfd9 could not be found. Jul 31 01:12:24.003584 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:24.003584 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d526b9c2-7dcf-4b95-a408-cac1b0efaf32 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] Returning 404 to user: Instance 439c28bf-0712-481c-9dca-6d50f87fcfd9 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:24.003584 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d526b9c2-7dcf-4b95-a408-cac1b0efaf32 tempest-ServersOnMultiNodesTest-46531715 tempest-ServersOnMultiNodesTest-46531715-project] 10.222.0.45 "GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9" status: 404 len: 111 microversion: 2.1 time: 0.123497 Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3a5b5ba9-2926-45c2-bda5-8e5f1d53258a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Request method failure captured: Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e HTTP/1.1 Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5daEn6_dmgBUhg1iaYA_4nmkPLTYfYug2V-YMYPbFrprYZqIthsTZbRXKKxeWxSuhElq_3oSaHw3hM3T8_MGcOp1FZUsIJ11iM1KyytPFiOiAy7Di5oEM-hSY5hpkL1C7sTS76yh-kEiOOwae2N-TAQXEhDscJ-jhXkB1BpK362IdgA Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 531072622a6d4b10b902ac7644c6a7ad Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersTestMultiNic-448049166 Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_531072622a6d4b10b902ac7644c6a7ad", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersTestMultiNic-448049166 Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 531072622a6d4b10b902ac7644c6a7ad Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersTestMultiNic-448049166 Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersTestMultiNic-448049166-project Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 246145364b854ab7bb4fdaffcfa238d8 Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersTestMultiNic-448049166-project Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '6d1f8550-6240-420b-8abf-9b5e9a8ebc2e'} Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:24.005553 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:24.019269 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:24.019269 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:24.019269 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:24.019269 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:24.019269 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:24.019269 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. Jul 31 01:12:24.019269 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:24.019269 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3a5b5ba9-2926-45c2-bda5-8e5f1d53258a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Returning 404 to user: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:24.021353 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 757/1496] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:23 2022] GET /compute/v2.1/servers/439c28bf-0712-481c-9dca-6d50f87fcfd9 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:24.021572 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3a5b5ba9-2926-45c2-bda5-8e5f1d53258a tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 404 len: 111 microversion: 2.1 time: 0.167149 Jul 31 01:12:24.021572 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 740/1497] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:23 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:24.035030 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-acea8663-9b64-4a67-bd54-a86aa3593b0c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:24.035752 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-acea8663-9b64-4a67-bd54-a86aa3593b0c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:24.035926 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-330a0f98-30ea-44ce-8894-8b094b7509f0 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:24.036992 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-330a0f98-30ea-44ce-8894-8b094b7509f0 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:24.043923 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-acea8663-9b64-4a67-bd54-a86aa3593b0c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:24.044426 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-acea8663-9b64-4a67-bd54-a86aa3593b0c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:24.045678 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-acea8663-9b64-4a67-bd54-a86aa3593b0c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:24.046370 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-acea8663-9b64-4a67-bd54-a86aa3593b0c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:24.080858 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-330a0f98-30ea-44ce-8894-8b094b7509f0 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:24.082549 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-330a0f98-30ea-44ce-8894-8b094b7509f0 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:24.088022 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-330a0f98-30ea-44ce-8894-8b094b7509f0 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:24.090161 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-330a0f98-30ea-44ce-8894-8b094b7509f0 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:24.413023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-330a0f98-30ea-44ce-8894-8b094b7509f0 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:24.475330 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-330a0f98-30ea-44ce-8894-8b094b7509f0 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1252 microversion: 2.1 time: 0.442435 Jul 31 01:12:24.483930 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 758/1498] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:24 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1252 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:24.533828 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-dc598290-dafe-486b-aa33-b7925d2f8856 req-913433b1-33cf-4cb5-a5ed-cc695b01f98f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eafdd229-897b-4b1f-adfc-3d7bb4fef7a0", "name": "network-vif-deleted", "tag": "5ee707da-030a-4991-809c-69f12af3f140"}, {"server_uuid": "6d1f8550-6240-420b-8abf-9b5e9a8ebc2e", "name": "network-vif-deleted", "tag": "bf4873a9-1b81-48c0-bd3c-75d71fb62cd0"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:24.594711 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-dc598290-dafe-486b-aa33-b7925d2f8856 req-913433b1-33cf-4cb5-a5ed-cc695b01f98f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:24.604161 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-dc598290-dafe-486b-aa33-b7925d2f8856 req-913433b1-33cf-4cb5-a5ed-cc695b01f98f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:24.678607 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-dc598290-dafe-486b-aa33-b7925d2f8856 req-913433b1-33cf-4cb5-a5ed-cc695b01f98f service nova] Creating event network-vif-deleted:5ee707da-030a-4991-809c-69f12af3f140 for instance eafdd229-897b-4b1f-adfc-3d7bb4fef7a0 on n-h2-master-1 Jul 31 01:12:24.680222 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-dc598290-dafe-486b-aa33-b7925d2f8856 req-913433b1-33cf-4cb5-a5ed-cc695b01f98f service nova] Creating event network-vif-deleted:bf4873a9-1b81-48c0-bd3c-75d71fb62cd0 for instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e on n-h2-master-1 Jul 31 01:12:24.709806 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-dc598290-dafe-486b-aa33-b7925d2f8856 req-913433b1-33cf-4cb5-a5ed-cc695b01f98f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.219897 Jul 31 01:12:24.714972 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 759/1499] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:24.754170 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e57ce7fa-c4df-42d1-9efa-77cd1171d6e6 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede5a7b5e0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:24.769442 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-acea8663-9b64-4a67-bd54-a86aa3593b0c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:24.816766 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-acea8663-9b64-4a67-bd54-a86aa3593b0c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1534 microversion: 2.1 time: 0.794912 Jul 31 01:12:24.817815 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 741/1500] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:24 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1534 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:24.854451 n-d-master-1 devstack@n-api.service[119475]: DEBUG neutronclient.v2_0.client [None req-e57ce7fa-c4df-42d1-9efa-77cd1171d6e6 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 66606709-92e8-4290-a2ca-147abb9009be does not exist", "detail": ""}} {{(pid=119475) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:12:24.854991 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.security_group_api [None req-e57ce7fa-c4df-42d1-9efa-77cd1171d6e6 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Neutron security group 66606709-92e8-4290-a2ca-147abb9009be not found {{(pid=119475) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 31 01:12:24.855650 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-e57ce7fa-c4df-42d1-9efa-77cd1171d6e6 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] HTTP exception thrown: Security group 66606709-92e8-4290-a2ca-147abb9009be does not exist Jul 31 01:12:24.855650 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-21a2535c-df95-40fc-a4bd-64dcca777a70'] Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e57ce7fa-c4df-42d1-9efa-77cd1171d6e6 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Request method failure captured: Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/os-security-groups/66606709-92e8-4290-a2ca-147abb9009be HTTP/1.1 Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dZ4RROZmvNHgk8nkEPCHEOtKeymvD8aJkYSffUh8bqh37RpmNHALtgJw0W3wgMu6HJwqcBFxL8fLuKg63WTseMOWT3m6KTBzl-wHxPxejmdZtFZxPmexVFKQ3mNYzDtb_uVYFrMpBX3R40pkmpf04xAyZo3K5gfwBnL_o_UQmcBzKE Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a45cfeb1ce9844c5bf16e975af312ba0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: e3e6a158c3884c8db5a66fe80e71527d Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: exception: Security group 66606709-92e8-4290-a2ca-147abb9009be does not exist Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-21a2535c-df95-40fc-a4bd-64dcca777a70'] Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '66606709-92e8-4290-a2ca-147abb9009be'} Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:12:24.858877 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 66606709-92e8-4290-a2ca-147abb9009be does not exist Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21a2535c-df95-40fc-a4bd-64dcca777a70'] Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 66606709-92e8-4290-a2ca-147abb9009be does not exist Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21a2535c-df95-40fc-a4bd-64dcca777a70'] Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 66606709-92e8-4290-a2ca-147abb9009be does not exist Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21a2535c-df95-40fc-a4bd-64dcca777a70'] Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 66606709-92e8-4290-a2ca-147abb9009be does not exist Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21a2535c-df95-40fc-a4bd-64dcca777a70'] Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e57ce7fa-c4df-42d1-9efa-77cd1171d6e6 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Returning 404 to user: Security group 66606709-92e8-4290-a2ca-147abb9009be does not exist Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-21a2535c-df95-40fc-a4bd-64dcca777a70'] {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e57ce7fa-c4df-42d1-9efa-77cd1171d6e6 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/66606709-92e8-4290-a2ca-147abb9009be" status: 404 len: 194 microversion: 2.1 time: 0.144319 Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 760/1501] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:12:24 2022] DELETE /compute/v2.1/os-security-groups/66606709-92e8-4290-a2ca-147abb9009be => generated 194 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:24.871770 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-7acc23ca-5629-4662-bfe8-aa811432128b req-f99ae2aa-3cff-40f3-b8e9-e485b643c53b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37302988-1cb9-4dca-a5a5-93ff2a30316b", "name": "network-vif-plugged", "status": "completed", "tag": "8e0167ab-8d69-4a27-8750-640d68a6c8e5"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:24.882560 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-76875d6c-022c-4fb2-932e-a362651ef4b9 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:24.883771 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-76875d6c-022c-4fb2-932e-a362651ef4b9 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:24.909811 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7acc23ca-5629-4662-bfe8-aa811432128b req-f99ae2aa-3cff-40f3-b8e9-e485b643c53b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:24.911645 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7acc23ca-5629-4662-bfe8-aa811432128b req-f99ae2aa-3cff-40f3-b8e9-e485b643c53b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:24.933138 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-76875d6c-022c-4fb2-932e-a362651ef4b9 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:24.934772 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-76875d6c-022c-4fb2-932e-a362651ef4b9 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:24.937398 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-76875d6c-022c-4fb2-932e-a362651ef4b9 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:24.938885 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-76875d6c-022c-4fb2-932e-a362651ef4b9 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:24.958501 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-7acc23ca-5629-4662-bfe8-aa811432128b req-f99ae2aa-3cff-40f3-b8e9-e485b643c53b service nova] Creating event network-vif-plugged:8e0167ab-8d69-4a27-8750-640d68a6c8e5 for instance 37302988-1cb9-4dca-a5a5-93ff2a30316b on n-h1-master-1 Jul 31 01:12:24.974754 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-7acc23ca-5629-4662-bfe8-aa811432128b req-f99ae2aa-3cff-40f3-b8e9-e485b643c53b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112270 Jul 31 01:12:24.983511 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 761/1502] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:25.000800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1c6ed2d1-7cfd-408c-8040-dc1f5e70d229 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:25.004027 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1c6ed2d1-7cfd-408c-8040-dc1f5e70d229 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:25.023576 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c6ed2d1-7cfd-408c-8040-dc1f5e70d229 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:25.024268 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c6ed2d1-7cfd-408c-8040-dc1f5e70d229 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:25.027857 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c6ed2d1-7cfd-408c-8040-dc1f5e70d229 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:25.028911 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c6ed2d1-7cfd-408c-8040-dc1f5e70d229 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:25.074731 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:25.796595 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-76875d6c-022c-4fb2-932e-a362651ef4b9 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1858 microversion: 2.1 time: 0.972949 Jul 31 01:12:25.805072 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 742/1503] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:24 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1858 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:25.823595 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1f5e4155-3c73-400d-a1ab-2d13b2979138 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fedea9ec790>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:25.834417 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1c6ed2d1-7cfd-408c-8040-dc1f5e70d229 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:25.847553 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1c6ed2d1-7cfd-408c-8040-dc1f5e70d229 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1307 microversion: 2.1 time: 0.859423 Jul 31 01:12:25.855782 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 762/1504] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:24 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1307 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:25.861947 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0b85b38e-215a-46bc-ab3d-b7a17b6a5479 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:25.866599 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0b85b38e-215a-46bc-ab3d-b7a17b6a5479 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:25.881431 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b85b38e-215a-46bc-ab3d-b7a17b6a5479 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:25.882313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b85b38e-215a-46bc-ab3d-b7a17b6a5479 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:25.883448 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b85b38e-215a-46bc-ab3d-b7a17b6a5479 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:25.886391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b85b38e-215a-46bc-ab3d-b7a17b6a5479 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:25.918662 n-d-master-1 devstack@n-api.service[119474]: DEBUG neutronclient.v2_0.client [None req-1f5e4155-3c73-400d-a1ab-2d13b2979138 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 18e69f31-9ecd-4070-867f-e69ed19078e1 does not exist", "detail": ""}} {{(pid=119474) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:12:25.919927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.security_group_api [None req-1f5e4155-3c73-400d-a1ab-2d13b2979138 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Neutron security group 18e69f31-9ecd-4070-867f-e69ed19078e1 not found {{(pid=119474) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 31 01:12:25.920730 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-1f5e4155-3c73-400d-a1ab-2d13b2979138 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] HTTP exception thrown: Security group 18e69f31-9ecd-4070-867f-e69ed19078e1 does not exist Jul 31 01:12:25.920730 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-f06fbae7-443a-4924-bcb1-36547868c284'] Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1f5e4155-3c73-400d-a1ab-2d13b2979138 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Request method failure captured: Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/os-security-groups/18e69f31-9ecd-4070-867f-e69ed19078e1 HTTP/1.1 Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dZ4RROZmvNHgk8nkEPCHEOtKeymvD8aJkYSffUh8bqh37RpmNHALtgJw0W3wgMu6HJwqcBFxL8fLuKg63WTseMOWT3m6KTBzl-wHxPxejmdZtFZxPmexVFKQ3mNYzDtb_uVYFrMpBX3R40pkmpf04xAyZo3K5gfwBnL_o_UQmcBzKE Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a45cfeb1ce9844c5bf16e975af312ba0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: e3e6a158c3884c8db5a66fe80e71527d Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: exception: Security group 18e69f31-9ecd-4070-867f-e69ed19078e1 does not exist Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-f06fbae7-443a-4924-bcb1-36547868c284'] Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '18e69f31-9ecd-4070-867f-e69ed19078e1'} Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:12:25.922971 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 18e69f31-9ecd-4070-867f-e69ed19078e1 does not exist Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f06fbae7-443a-4924-bcb1-36547868c284'] Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 18e69f31-9ecd-4070-867f-e69ed19078e1 does not exist Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f06fbae7-443a-4924-bcb1-36547868c284'] Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 18e69f31-9ecd-4070-867f-e69ed19078e1 does not exist Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f06fbae7-443a-4924-bcb1-36547868c284'] Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 18e69f31-9ecd-4070-867f-e69ed19078e1 does not exist Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f06fbae7-443a-4924-bcb1-36547868c284'] Jul 31 01:12:25.926885 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:25.931052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1f5e4155-3c73-400d-a1ab-2d13b2979138 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Returning 404 to user: Security group 18e69f31-9ecd-4070-867f-e69ed19078e1 does not exist Jul 31 01:12:25.931052 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-f06fbae7-443a-4924-bcb1-36547868c284'] {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:25.932341 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1f5e4155-3c73-400d-a1ab-2d13b2979138 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/18e69f31-9ecd-4070-867f-e69ed19078e1" status: 404 len: 194 microversion: 2.1 time: 0.125861 Jul 31 01:12:25.933457 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 743/1505] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:12:25 2022] DELETE /compute/v2.1/os-security-groups/18e69f31-9ecd-4070-867f-e69ed19078e1 => generated 194 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:25.944563 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-407c4212-f064-494b-ae36-88ff685b83cd tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:25.947935 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-407c4212-f064-494b-ae36-88ff685b83cd tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:25.973854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-407c4212-f064-494b-ae36-88ff685b83cd tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:25.974841 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-407c4212-f064-494b-ae36-88ff685b83cd tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:25.976250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-407c4212-f064-494b-ae36-88ff685b83cd tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:25.977326 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-407c4212-f064-494b-ae36-88ff685b83cd tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:26.140574 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0b85b38e-215a-46bc-ab3d-b7a17b6a5479 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:26.158113 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0b85b38e-215a-46bc-ab3d-b7a17b6a5479 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1252 microversion: 2.1 time: 0.300641 Jul 31 01:12:26.160169 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 763/1506] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:25 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1252 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:26.182514 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b46b0fc1-023c-4da2-92cc-c37e8ee23e7c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:26.183239 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b46b0fc1-023c-4da2-92cc-c37e8ee23e7c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:26.202817 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b46b0fc1-023c-4da2-92cc-c37e8ee23e7c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:26.204402 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b46b0fc1-023c-4da2-92cc-c37e8ee23e7c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:26.208444 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b46b0fc1-023c-4da2-92cc-c37e8ee23e7c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:26.213008 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b46b0fc1-023c-4da2-92cc-c37e8ee23e7c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:26.233285 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:26.596187 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-407c4212-f064-494b-ae36-88ff685b83cd tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1858 microversion: 2.1 time: 0.660801 Jul 31 01:12:26.597458 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 744/1507] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:25 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1858 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:26.652215 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e9d56214-8377-4c43-9055-c1e784f1e180 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:26.653125 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e9d56214-8377-4c43-9055-c1e784f1e180 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:26.682561 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e9d56214-8377-4c43-9055-c1e784f1e180 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:26.684571 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e9d56214-8377-4c43-9055-c1e784f1e180 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:26.688536 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e9d56214-8377-4c43-9055-c1e784f1e180 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:26.689438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e9d56214-8377-4c43-9055-c1e784f1e180 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:26.826026 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e9d56214-8377-4c43-9055-c1e784f1e180 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:12:26.861213 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b46b0fc1-023c-4da2-92cc-c37e8ee23e7c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:26.886335 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b46b0fc1-023c-4da2-92cc-c37e8ee23e7c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1534 microversion: 2.1 time: 0.719674 Jul 31 01:12:26.894221 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 764/1508] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:26 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1534 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:26.921666 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ce035312-9f50-4a72-8790-1a213fb2b678 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:26.923314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ce035312-9f50-4a72-8790-1a213fb2b678 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:26.966562 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce035312-9f50-4a72-8790-1a213fb2b678 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:26.973056 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce035312-9f50-4a72-8790-1a213fb2b678 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:26.975413 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce035312-9f50-4a72-8790-1a213fb2b678 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:26.978514 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce035312-9f50-4a72-8790-1a213fb2b678 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:27.307238 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e9d56214-8377-4c43-9055-c1e784f1e180 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f" status: 204 len: 0 microversion: 2.1 time: 0.671112 Jul 31 01:12:27.310659 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 745/1509] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:12:26 2022] DELETE /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f => generated 0 bytes in 713 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:12:27.355753 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-021d5243-5ca8-4234-89f4-890f236de7ef tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:27.356869 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-021d5243-5ca8-4234-89f4-890f236de7ef tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:27.384098 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-021d5243-5ca8-4234-89f4-890f236de7ef tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:27.391624 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-021d5243-5ca8-4234-89f4-890f236de7ef tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:27.392818 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-021d5243-5ca8-4234-89f4-890f236de7ef tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:27.395532 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-021d5243-5ca8-4234-89f4-890f236de7ef tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:28.090187 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-021d5243-5ca8-4234-89f4-890f236de7ef tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:28.106292 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-021d5243-5ca8-4234-89f4-890f236de7ef tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1486 microversion: 2.1 time: 0.791886 Jul 31 01:12:28.106900 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 746/1510] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:27 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1486 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:28.120018 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6d2aaf77-0f74-4cba-b512-c961ed33b573 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:28.120552 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6d2aaf77-0f74-4cba-b512-c961ed33b573 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:28.129793 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d2aaf77-0f74-4cba-b512-c961ed33b573 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:28.130258 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d2aaf77-0f74-4cba-b512-c961ed33b573 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:28.131067 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d2aaf77-0f74-4cba-b512-c961ed33b573 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:28.140055 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d2aaf77-0f74-4cba-b512-c961ed33b573 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:28.211444 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-ce035312-9f50-4a72-8790-1a213fb2b678 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lazy-loading 'services' on Instance uuid 502a7c35-a8fe-4ace-85d5-bb115f8423fa {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:12:28.402098 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6d2aaf77-0f74-4cba-b512-c961ed33b573 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:28.425439 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6d2aaf77-0f74-4cba-b512-c961ed33b573 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1252 microversion: 2.1 time: 0.315717 Jul 31 01:12:28.438309 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 747/1511] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:28 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1252 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:28.450290 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-608cced0-9be2-4521-b6ab-4c9a9430747a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:28.451137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-608cced0-9be2-4521-b6ab-4c9a9430747a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:28.473813 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-608cced0-9be2-4521-b6ab-4c9a9430747a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:28.474857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-608cced0-9be2-4521-b6ab-4c9a9430747a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:28.476085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-608cced0-9be2-4521-b6ab-4c9a9430747a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:28.477330 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-608cced0-9be2-4521-b6ab-4c9a9430747a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:28.486377 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ce035312-9f50-4a72-8790-1a213fb2b678 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "DELETE /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments/382917a5-c82f-4992-a11e-ee87404429b0" status: 202 len: 0 microversion: 2.1 time: 1.589819 Jul 31 01:12:28.488230 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 765/1512] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 01:12:26 2022] DELETE /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments/382917a5-c82f-4992-a11e-ee87404429b0 => generated 0 bytes in 1593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:12:28.502807 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-a57025af-d53d-47e9-8a9f-7da1826567cd req-dcf56ace-140a-4cda-8024-ef0f02f3c7dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228dc464-015e-46f4-bec0-9f81a1dc15d2", "name": "network-vif-deleted", "tag": "9a86b1f7-6a8e-4f86-8208-6993e348a723"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:28.535273 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a57025af-d53d-47e9-8a9f-7da1826567cd req-dcf56ace-140a-4cda-8024-ef0f02f3c7dc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:28.537285 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a57025af-d53d-47e9-8a9f-7da1826567cd req-dcf56ace-140a-4cda-8024-ef0f02f3c7dc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:28.569695 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-a57025af-d53d-47e9-8a9f-7da1826567cd req-dcf56ace-140a-4cda-8024-ef0f02f3c7dc service nova] Creating event network-vif-deleted:9a86b1f7-6a8e-4f86-8208-6993e348a723 for instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 on n-h2-master-1 Jul 31 01:12:28.589258 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-a57025af-d53d-47e9-8a9f-7da1826567cd req-dcf56ace-140a-4cda-8024-ef0f02f3c7dc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096061 Jul 31 01:12:28.591629 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 766/1513] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:28.599299 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d5088cf0-59d7-4951-991d-f27ee72424e6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:28.601045 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d5088cf0-59d7-4951-991d-f27ee72424e6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:28.611092 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5088cf0-59d7-4951-991d-f27ee72424e6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:28.612142 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5088cf0-59d7-4951-991d-f27ee72424e6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:28.615983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5088cf0-59d7-4951-991d-f27ee72424e6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:28.618444 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5088cf0-59d7-4951-991d-f27ee72424e6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:28.693478 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5088cf0-59d7-4951-991d-f27ee72424e6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:28.693957 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5088cf0-59d7-4951-991d-f27ee72424e6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:28.694471 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-d5088cf0-59d7-4951-991d-f27ee72424e6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lazy-loading 'fault' on Instance uuid 228dc464-015e-46f4-bec0-9f81a1dc15d2 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:12:29.147018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d5088cf0-59d7-4951-991d-f27ee72424e6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:29.160218 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d5088cf0-59d7-4951-991d-f27ee72424e6 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 200 len: 1369 microversion: 2.1 time: 0.566731 Jul 31 01:12:29.160874 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 767/1514] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:28 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 1369 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:29.180196 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ce4ab83e-1a67-4491-a8d8-457b8498ef02 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:29.209787 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce4ab83e-1a67-4491-a8d8-457b8498ef02 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:29.210259 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce4ab83e-1a67-4491-a8d8-457b8498ef02 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:29.338512 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ce4ab83e-1a67-4491-a8d8-457b8498ef02 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Going to try to stop instance {{(pid=119475) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 01:12:29.411752 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ce4ab83e-1a67-4491-a8d8-457b8498ef02 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "POST /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b/action" status: 202 len: 0 microversion: 2.1 time: 0.243534 Jul 31 01:12:29.431496 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 768/1515] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:12:29 2022] POST /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:12:29.450357 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-04ff30e0-4b23-4a5b-8f4a-92041ebdacf0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:29.455624 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-04ff30e0-4b23-4a5b-8f4a-92041ebdacf0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:29.467092 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04ff30e0-4b23-4a5b-8f4a-92041ebdacf0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:29.468189 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04ff30e0-4b23-4a5b-8f4a-92041ebdacf0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:29.470109 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04ff30e0-4b23-4a5b-8f4a-92041ebdacf0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:29.470848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04ff30e0-4b23-4a5b-8f4a-92041ebdacf0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:29.484624 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-608cced0-9be2-4521-b6ab-4c9a9430747a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:29.501061 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-608cced0-9be2-4521-b6ab-4c9a9430747a tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f" status: 200 len: 1647 microversion: 2.1 time: 1.056890 Jul 31 01:12:29.553196 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 748/1516] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:28 2022] GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f => generated 1647 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:29.575305 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e8add7c6-dfa5-44b9-99b5-676da8a8175c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:29.592800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e8add7c6-dfa5-44b9-99b5-676da8a8175c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:29.613647 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8add7c6-dfa5-44b9-99b5-676da8a8175c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:29.614743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8add7c6-dfa5-44b9-99b5-676da8a8175c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:29.624283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8add7c6-dfa5-44b9-99b5-676da8a8175c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:29.624283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8add7c6-dfa5-44b9-99b5-676da8a8175c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:29.639794 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-04ff30e0-4b23-4a5b-8f4a-92041ebdacf0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203314 Jul 31 01:12:29.639794 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 769/1517] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:12:29 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:29.659236 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-13402e8b-c348-4831-81dc-c3e96efa61ec tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:29.660641 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-13402e8b-c348-4831-81dc-c3e96efa61ec tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:29.679138 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13402e8b-c348-4831-81dc-c3e96efa61ec tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:29.682017 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13402e8b-c348-4831-81dc-c3e96efa61ec tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:29.683234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13402e8b-c348-4831-81dc-c3e96efa61ec tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:29.683845 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13402e8b-c348-4831-81dc-c3e96efa61ec tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:30.334033 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-13402e8b-c348-4831-81dc-c3e96efa61ec tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:30.348516 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-13402e8b-c348-4831-81dc-c3e96efa61ec tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1252 microversion: 2.1 time: 0.708310 Jul 31 01:12:30.349494 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 770/1518] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:29 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1252 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:30.373404 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-223664e0-88b4-40a9-8880-d14a2aea3aab tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:30.374718 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-223664e0-88b4-40a9-8880-d14a2aea3aab tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 228dc464-015e-46f4-bec0-9f81a1dc15d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:30.398825 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-223664e0-88b4-40a9-8880-d14a2aea3aab tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:30.399675 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-223664e0-88b4-40a9-8880-d14a2aea3aab tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:30.404760 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-223664e0-88b4-40a9-8880-d14a2aea3aab tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:30.405645 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-223664e0-88b4-40a9-8880-d14a2aea3aab tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:30.488117 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-223664e0-88b4-40a9-8880-d14a2aea3aab tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] HTTP exception thrown: Instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 could not be found. Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-223664e0-88b4-40a9-8880-d14a2aea3aab tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Request method failure captured: Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 HTTP/1.1 Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWOWPD3u0Fwp5dGWcnUSe7Du8BFrIy2qCUrbP0DPSdaXw9Dwq3xbMRWtIAN4LwWBFVr_wCpWuEP_7NOGIRZaJ2VmGob-JMnRAhEgQ-45R5DG3RUp1kLtZoUytKJiEJnQmYJhweNVBe5oJ_0Yz5MoBlDgNmyzYMTS1syAb7ShVLW-_0 Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 87496179e992473c991977e0e517460a Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-MigrationsAdminTest-1757285143 Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87496179e992473c991977e0e517460a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87496179e992473c991977e0e517460a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/87496179e992473c991977e0e517460a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_87496179e992473c991977e0e517460a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-MigrationsAdminTest-1757285143 Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 87496179e992473c991977e0e517460a Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-MigrationsAdminTest-1757285143 Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-MigrationsAdminTest-1757285143-project Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 9a2a0f61c8304c9a9ad7af6120e83443 Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-MigrationsAdminTest-1757285143-project Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 could not be found. Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '228dc464-015e-46f4-bec0-9f81a1dc15d2'} Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 could not be found. Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 could not be found. Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:30.491785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:30.505834 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:30.505834 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:30.505834 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:30.505834 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:30.505834 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:30.505834 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 could not be found. Jul 31 01:12:30.505834 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:30.505834 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-223664e0-88b4-40a9-8880-d14a2aea3aab tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Returning 404 to user: Instance 228dc464-015e-46f4-bec0-9f81a1dc15d2 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:30.505834 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-223664e0-88b4-40a9-8880-d14a2aea3aab tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2" status: 404 len: 111 microversion: 2.1 time: 0.144078 Jul 31 01:12:30.508868 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 771/1519] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:30 2022] GET /compute/v2.1/servers/228dc464-015e-46f4-bec0-9f81a1dc15d2 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:30.523079 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9071b755-24a5-436d-ad28-494a4c3a2f37 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '.version_select at 0x7fede523c430>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:30.604456 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9071b755-24a5-436d-ad28-494a4c3a2f37 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795578892" status: 202 len: 0 microversion: 2.1 time: 0.089803 Jul 31 01:12:30.612061 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 772/1520] 10.222.0.45 () {58 vars in 1221 bytes} [Sun Jul 31 01:12:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795578892 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:12:30.636607 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f1ce64c5-6cc8-448e-a0b4-257fe2339408 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:30.638118 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f1ce64c5-6cc8-448e-a0b4-257fe2339408 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:30.674783 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1ce64c5-6cc8-448e-a0b4-257fe2339408 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:30.675709 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1ce64c5-6cc8-448e-a0b4-257fe2339408 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:30.677167 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1ce64c5-6cc8-448e-a0b4-257fe2339408 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:30.682980 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1ce64c5-6cc8-448e-a0b4-257fe2339408 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:30.988269 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f1ce64c5-6cc8-448e-a0b4-257fe2339408 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e6a158c3884c8db5a66fe80e71527d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45cfeb1ce9844c5bf16e975af312ba0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:31.013692 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f1ce64c5-6cc8-448e-a0b4-257fe2339408 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f" status: 200 len: 1468 microversion: 2.1 time: 0.399457 Jul 31 01:12:31.019438 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 773/1521] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:30 2022] GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f => generated 1468 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:31.040706 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b6b1a954-9a88-453d-a8e8-af9a79fa004a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:31.052297 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b6b1a954-9a88-453d-a8e8-af9a79fa004a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:31.082930 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6b1a954-9a88-453d-a8e8-af9a79fa004a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:31.083743 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6b1a954-9a88-453d-a8e8-af9a79fa004a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:31.085211 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6b1a954-9a88-453d-a8e8-af9a79fa004a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:31.089564 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6b1a954-9a88-453d-a8e8-af9a79fa004a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:31.207298 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b6b1a954-9a88-453d-a8e8-af9a79fa004a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180731 Jul 31 01:12:31.208826 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 774/1522] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:12:31 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:31.220307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e8add7c6-dfa5-44b9-99b5-676da8a8175c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:31.239135 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e8add7c6-dfa5-44b9-99b5-676da8a8175c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1496 microversion: 2.1 time: 1.684537 Jul 31 01:12:31.240421 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 749/1523] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:29 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1496 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:31.252723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-67868a39-436d-468a-afec-55cde3903ff7 req-9521a6b6-9c9e-4b56-9cc7-bca9165ecbcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2786dc8b-517e-4c01-be66-c7959ff8972f", "name": "network-vif-deleted", "tag": "e58b02f2-5ad0-4d5c-8b46-97753614753b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:31.286530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-67868a39-436d-468a-afec-55cde3903ff7 req-9521a6b6-9c9e-4b56-9cc7-bca9165ecbcd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:31.287504 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-67868a39-436d-468a-afec-55cde3903ff7 req-9521a6b6-9c9e-4b56-9cc7-bca9165ecbcd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:31.380294 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-67868a39-436d-468a-afec-55cde3903ff7 req-9521a6b6-9c9e-4b56-9cc7-bca9165ecbcd service nova] Creating event network-vif-deleted:e58b02f2-5ad0-4d5c-8b46-97753614753b for instance 2786dc8b-517e-4c01-be66-c7959ff8972f on n-h2-master-1 Jul 31 01:12:31.387261 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f546a78e-b3a6-4dbb-8c33-3b72dc649140 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:31.387931 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f546a78e-b3a6-4dbb-8c33-3b72dc649140 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:31.400761 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f546a78e-b3a6-4dbb-8c33-3b72dc649140 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:31.401120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f546a78e-b3a6-4dbb-8c33-3b72dc649140 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:31.402120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f546a78e-b3a6-4dbb-8c33-3b72dc649140 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:31.402773 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f546a78e-b3a6-4dbb-8c33-3b72dc649140 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:31.404449 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-67868a39-436d-468a-afec-55cde3903ff7 req-9521a6b6-9c9e-4b56-9cc7-bca9165ecbcd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163645 Jul 31 01:12:31.406353 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 775/1524] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:31.599979 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f546a78e-b3a6-4dbb-8c33-3b72dc649140 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:31.634162 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f546a78e-b3a6-4dbb-8c33-3b72dc649140 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1252 microversion: 2.1 time: 0.251322 Jul 31 01:12:31.636453 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 750/1525] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:31 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1252 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:32.056136 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8b9131e7-ebbd-49be-954e-d9c6e126501c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:32.057359 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8b9131e7-ebbd-49be-954e-d9c6e126501c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] [instance: 2786dc8b-517e-4c01-be66-c7959ff8972f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:32.123112 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b9131e7-ebbd-49be-954e-d9c6e126501c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:32.124535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b9131e7-ebbd-49be-954e-d9c6e126501c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:32.125917 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b9131e7-ebbd-49be-954e-d9c6e126501c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:32.126715 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b9131e7-ebbd-49be-954e-d9c6e126501c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:32.179638 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2e81d3ef-cdb1-49ec-8abe-2f9973a3c7bf tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:32.180487 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2e81d3ef-cdb1-49ec-8abe-2f9973a3c7bf tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:32.206277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e81d3ef-cdb1-49ec-8abe-2f9973a3c7bf tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:32.207327 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e81d3ef-cdb1-49ec-8abe-2f9973a3c7bf tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:32.209485 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e81d3ef-cdb1-49ec-8abe-2f9973a3c7bf tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:32.210773 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e81d3ef-cdb1-49ec-8abe-2f9973a3c7bf tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:32.217999 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-8b9131e7-ebbd-49be-954e-d9c6e126501c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] HTTP exception thrown: Instance 2786dc8b-517e-4c01-be66-c7959ff8972f could not be found. Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8b9131e7-ebbd-49be-954e-d9c6e126501c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Request method failure captured: Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f HTTP/1.1 Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dZ4RROZmvNHgk8nkEPCHEOtKeymvD8aJkYSffUh8bqh37RpmNHALtgJw0W3wgMu6HJwqcBFxL8fLuKg63WTseMOWT3m6KTBzl-wHxPxejmdZtFZxPmexVFKQ3mNYzDtb_uVYFrMpBX3R40pkmpf04xAyZo3K5gfwBnL_o_UQmcBzKE Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a45cfeb1ce9844c5bf16e975af312ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a45cfeb1ce9844c5bf16e975af312ba0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a45cfeb1ce9844c5bf16e975af312ba0 Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1466918654 Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: e3e6a158c3884c8db5a66fe80e71527d Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-SecurityGroupsTestJSON-1466918654-project Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 2786dc8b-517e-4c01-be66-c7959ff8972f could not be found. Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '2786dc8b-517e-4c01-be66-c7959ff8972f'} Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2786dc8b-517e-4c01-be66-c7959ff8972f could not be found. Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2786dc8b-517e-4c01-be66-c7959ff8972f could not be found. Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:32.221827 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:32.229949 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:32.229949 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:32.229949 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:32.229949 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:32.229949 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:32.229949 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2786dc8b-517e-4c01-be66-c7959ff8972f could not be found. Jul 31 01:12:32.229949 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:32.237591 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8b9131e7-ebbd-49be-954e-d9c6e126501c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Returning 404 to user: Instance 2786dc8b-517e-4c01-be66-c7959ff8972f could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:32.248224 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8b9131e7-ebbd-49be-954e-d9c6e126501c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f" status: 404 len: 111 microversion: 2.1 time: 0.203412 Jul 31 01:12:32.254622 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 776/1526] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:32 2022] GET /compute/v2.1/servers/2786dc8b-517e-4c01-be66-c7959ff8972f => generated 111 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:32.270618 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-02ad96bb-51b8-4d76-a863-b9b359a283bb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:32.274805 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-02ad96bb-51b8-4d76-a863-b9b359a283bb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:32.280505 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-2e81d3ef-cdb1-49ec-8abe-2f9973a3c7bf tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] HTTP exception thrown: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2e81d3ef-cdb1-49ec-8abe-2f9973a3c7bf tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Request method failure captured: Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e HTTP/1.1 Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5daEn6_dmgBUhg1iaYA_4nmkPLTYfYug2V-YMYPbFrprYZqIthsTZbRXKKxeWxSuhElq_3oSaHw3hM3T8_MGcOp1FZUsIJ11iM1KyytPFiOiAy7Di5oEM-hSY5hpkL1C7sTS76yh-kEiOOwae2N-TAQXEhDscJ-jhXkB1BpK362IdgA Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 531072622a6d4b10b902ac7644c6a7ad Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersTestMultiNic-448049166 Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_531072622a6d4b10b902ac7644c6a7ad", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersTestMultiNic-448049166 Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 531072622a6d4b10b902ac7644c6a7ad Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersTestMultiNic-448049166 Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersTestMultiNic-448049166-project Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 246145364b854ab7bb4fdaffcfa238d8 Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersTestMultiNic-448049166-project Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '6d1f8550-6240-420b-8abf-9b5e9a8ebc2e'} Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:32.287093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. Jul 31 01:12:32.294615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:32.294615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:32.294615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:32.294615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:32.294615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:32.294615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:32.294615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:32.294615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:32.294615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. Jul 31 01:12:32.294615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:32.303626 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2e81d3ef-cdb1-49ec-8abe-2f9973a3c7bf tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Returning 404 to user: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:32.303626 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2e81d3ef-cdb1-49ec-8abe-2f9973a3c7bf tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 404 len: 111 microversion: 2.1 time: 0.128309 Jul 31 01:12:32.303626 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 751/1527] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:12:32 2022] DELETE /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:32.304428 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-02ad96bb-51b8-4d76-a863-b9b359a283bb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:32.304893 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-02ad96bb-51b8-4d76-a863-b9b359a283bb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:32.307985 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-02ad96bb-51b8-4d76-a863-b9b359a283bb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:32.312671 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e9bc38ff-a69c-4f87-b3b5-f6c9864510c3 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede5986a60>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:32.317507 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-02ad96bb-51b8-4d76-a863-b9b359a283bb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:32.394787 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-02ad96bb-51b8-4d76-a863-b9b359a283bb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138104 Jul 31 01:12:32.395713 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 777/1528] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:12:32 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:32.414899 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6db3bda6-7413-4cee-a5c3-f380d8bd05e2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:32.415572 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6db3bda6-7413-4cee-a5c3-f380d8bd05e2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:32.429690 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6db3bda6-7413-4cee-a5c3-f380d8bd05e2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:32.430292 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6db3bda6-7413-4cee-a5c3-f380d8bd05e2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:32.431123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6db3bda6-7413-4cee-a5c3-f380d8bd05e2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:32.431607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6db3bda6-7413-4cee-a5c3-f380d8bd05e2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:32.942376 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6db3bda6-7413-4cee-a5c3-f380d8bd05e2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:32.967970 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6db3bda6-7413-4cee-a5c3-f380d8bd05e2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1496 microversion: 2.1 time: 0.555805 Jul 31 01:12:32.985468 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 778/1529] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:32 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1496 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:33.013013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a906b094-765b-458d-ad55-cf304ef14134 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:33.014865 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a906b094-765b-458d-ad55-cf304ef14134 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:33.052536 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a906b094-765b-458d-ad55-cf304ef14134 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:33.053003 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a906b094-765b-458d-ad55-cf304ef14134 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:33.053888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a906b094-765b-458d-ad55-cf304ef14134 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:33.054407 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a906b094-765b-458d-ad55-cf304ef14134 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:33.085879 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-a906b094-765b-458d-ad55-cf304ef14134 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] HTTP exception thrown: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a906b094-765b-458d-ad55-cf304ef14134 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Request method failure captured: Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e HTTP/1.1 Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5daEn6_dmgBUhg1iaYA_4nmkPLTYfYug2V-YMYPbFrprYZqIthsTZbRXKKxeWxSuhElq_3oSaHw3hM3T8_MGcOp1FZUsIJ11iM1KyytPFiOiAy7Di5oEM-hSY5hpkL1C7sTS76yh-kEiOOwae2N-TAQXEhDscJ-jhXkB1BpK362IdgA Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 531072622a6d4b10b902ac7644c6a7ad Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestMultiNic-448049166 Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_531072622a6d4b10b902ac7644c6a7ad", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestMultiNic-448049166 Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 531072622a6d4b10b902ac7644c6a7ad Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestMultiNic-448049166 Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestMultiNic-448049166-project Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 246145364b854ab7bb4fdaffcfa238d8 Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestMultiNic-448049166-project Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '6d1f8550-6240-420b-8abf-9b5e9a8ebc2e'} Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:33.087587 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:33.093319 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:33.093319 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:33.093319 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:33.093319 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:33.093319 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:33.093319 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. Jul 31 01:12:33.093319 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:33.093319 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a906b094-765b-458d-ad55-cf304ef14134 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Returning 404 to user: Instance 6d1f8550-6240-420b-8abf-9b5e9a8ebc2e could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:33.093319 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a906b094-765b-458d-ad55-cf304ef14134 tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e" status: 404 len: 111 microversion: 2.1 time: 0.101601 Jul 31 01:12:33.093319 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 779/1530] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:32 2022] GET /compute/v2.1/servers/6d1f8550-6240-420b-8abf-9b5e9a8ebc2e => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:33.096629 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0ad00662-dbf3-49b3-8881-5e9d614d1dfa tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:33.097632 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0ad00662-dbf3-49b3-8881-5e9d614d1dfa tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:33.106949 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ad00662-dbf3-49b3-8881-5e9d614d1dfa tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:33.107373 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ad00662-dbf3-49b3-8881-5e9d614d1dfa tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:33.110612 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ad00662-dbf3-49b3-8881-5e9d614d1dfa tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:33.111637 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ad00662-dbf3-49b3-8881-5e9d614d1dfa tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:33.159472 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:33.169339 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ad00662-dbf3-49b3-8881-5e9d614d1dfa tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:33.170105 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ad00662-dbf3-49b3-8881-5e9d614d1dfa tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:33.170812 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-0ad00662-dbf3-49b3-8881-5e9d614d1dfa tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lazy-loading 'fault' on Instance uuid 451cf12b-e061-4c6c-8b43-40cee9ddcc1c {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:12:33.341610 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0ad00662-dbf3-49b3-8881-5e9d614d1dfa tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb298a85d524f1d9f3a2138636a2773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3cc749a4a34731b3035b320af81cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:33.362384 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0ad00662-dbf3-49b3-8881-5e9d614d1dfa tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 200 len: 1257 microversion: 2.1 time: 0.270720 Jul 31 01:12:33.363397 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 780/1531] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:33 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 1257 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:33.368645 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-46eef960-9647-450c-b0a5-f805e17cd00e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:33.369243 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-46eef960-9647-450c-b0a5-f805e17cd00e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:33.385209 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46eef960-9647-450c-b0a5-f805e17cd00e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:33.385771 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46eef960-9647-450c-b0a5-f805e17cd00e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:33.386684 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46eef960-9647-450c-b0a5-f805e17cd00e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:33.387218 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46eef960-9647-450c-b0a5-f805e17cd00e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:33.412608 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-46eef960-9647-450c-b0a5-f805e17cd00e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] HTTP exception thrown: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-46eef960-9647-450c-b0a5-f805e17cd00e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Request method failure captured: Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 HTTP/1.1 Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5daEn6_dmgBUhg1iaYA_4nmkPLTYfYug2V-YMYPbFrprYZqIthsTZbRXKKxeWxSuhElq_3oSaHw3hM3T8_MGcOp1FZUsIJ11iM1KyytPFiOiAy7Di5oEM-hSY5hpkL1C7sTS76yh-kEiOOwae2N-TAQXEhDscJ-jhXkB1BpK362IdgA Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 531072622a6d4b10b902ac7644c6a7ad Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestMultiNic-448049166 Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_531072622a6d4b10b902ac7644c6a7ad", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestMultiNic-448049166 Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 531072622a6d4b10b902ac7644c6a7ad Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestMultiNic-448049166 Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestMultiNic-448049166-project Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 246145364b854ab7bb4fdaffcfa238d8 Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestMultiNic-448049166-project Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '8660466c-0119-4cc7-8da1-e48e22f2c088'} Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:33.415272 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. Jul 31 01:12:33.422136 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:33.422136 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:33.422136 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:33.422136 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:33.422136 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:33.422136 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:33.422136 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:33.422136 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:33.422136 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. Jul 31 01:12:33.422136 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:33.424476 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-46eef960-9647-450c-b0a5-f805e17cd00e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Returning 404 to user: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:33.425673 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-46eef960-9647-450c-b0a5-f805e17cd00e tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 404 len: 111 microversion: 2.1 time: 0.061069 Jul 31 01:12:33.426493 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 781/1532] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:12:33 2022] DELETE /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:33.432334 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-02548a68-854b-4e60-a976-2602bd434717 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:33.435295 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-02548a68-854b-4e60-a976-2602bd434717 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:33.443631 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-02548a68-854b-4e60-a976-2602bd434717 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:33.444758 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-02548a68-854b-4e60-a976-2602bd434717 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:33.446181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-02548a68-854b-4e60-a976-2602bd434717 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:33.446965 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-02548a68-854b-4e60-a976-2602bd434717 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:33.500137 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-02548a68-854b-4e60-a976-2602bd434717 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072234 Jul 31 01:12:33.500817 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 782/1533] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:12:33 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:33.506100 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8e21de19-6b3a-4d4f-86e1-5ee90ba4c0cd tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:33.508798 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8e21de19-6b3a-4d4f-86e1-5ee90ba4c0cd tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] [instance: 8660466c-0119-4cc7-8da1-e48e22f2c088] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:33.517675 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e21de19-6b3a-4d4f-86e1-5ee90ba4c0cd tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:33.518540 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e21de19-6b3a-4d4f-86e1-5ee90ba4c0cd tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:33.519793 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e21de19-6b3a-4d4f-86e1-5ee90ba4c0cd tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:33.520566 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e21de19-6b3a-4d4f-86e1-5ee90ba4c0cd tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:33.549779 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-8e21de19-6b3a-4d4f-86e1-5ee90ba4c0cd tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] HTTP exception thrown: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8e21de19-6b3a-4d4f-86e1-5ee90ba4c0cd tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Request method failure captured: Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 HTTP/1.1 Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5daEn6_dmgBUhg1iaYA_4nmkPLTYfYug2V-YMYPbFrprYZqIthsTZbRXKKxeWxSuhElq_3oSaHw3hM3T8_MGcOp1FZUsIJ11iM1KyytPFiOiAy7Di5oEM-hSY5hpkL1C7sTS76yh-kEiOOwae2N-TAQXEhDscJ-jhXkB1BpK362IdgA Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 531072622a6d4b10b902ac7644c6a7ad Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestMultiNic-448049166 Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/531072622a6d4b10b902ac7644c6a7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_531072622a6d4b10b902ac7644c6a7ad", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestMultiNic-448049166 Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 531072622a6d4b10b902ac7644c6a7ad Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestMultiNic-448049166 Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestMultiNic-448049166-project Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 246145364b854ab7bb4fdaffcfa238d8 Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestMultiNic-448049166-project Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '8660466c-0119-4cc7-8da1-e48e22f2c088'} Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:33.563013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:33.567238 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:33.567238 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:33.567238 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:33.567238 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:33.567238 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:33.567238 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. Jul 31 01:12:33.567238 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:33.578978 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8e21de19-6b3a-4d4f-86e1-5ee90ba4c0cd tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] Returning 404 to user: Instance 8660466c-0119-4cc7-8da1-e48e22f2c088 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:33.580933 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8e21de19-6b3a-4d4f-86e1-5ee90ba4c0cd tempest-ServersTestMultiNic-448049166 tempest-ServersTestMultiNic-448049166-project] 10.222.0.45 "GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088" status: 404 len: 111 microversion: 2.1 time: 0.078306 Jul 31 01:12:33.581989 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 783/1534] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:33 2022] GET /compute/v2.1/servers/8660466c-0119-4cc7-8da1-e48e22f2c088 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:33.660180 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e9bc38ff-a69c-4f87-b3b5-f6c9864510c3 tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/82d66dca-1737-4b68-a629-0520417d23ab" status: 202 len: 0 microversion: 2.1 time: 1.354556 Jul 31 01:12:33.661456 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 752/1535] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:12:32 2022] DELETE /compute/v2.1/os-security-groups/82d66dca-1737-4b68-a629-0520417d23ab => generated 0 bytes in 1358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:12:33.672216 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9b04a2c5-96d6-4e18-809f-50334c5fff9c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] Calling method '.version_select at 0x7fede52d0f70>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:34.016206 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-697f431b-5146-4d77-afc1-c6d90234abe2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:34.016831 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-697f431b-5146-4d77-afc1-c6d90234abe2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:34.038880 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-697f431b-5146-4d77-afc1-c6d90234abe2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:34.039494 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-697f431b-5146-4d77-afc1-c6d90234abe2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:34.045116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-697f431b-5146-4d77-afc1-c6d90234abe2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:34.045829 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-697f431b-5146-4d77-afc1-c6d90234abe2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:34.982492 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-697f431b-5146-4d77-afc1-c6d90234abe2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:34.998122 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-697f431b-5146-4d77-afc1-c6d90234abe2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1496 microversion: 2.1 time: 0.987081 Jul 31 01:12:34.999441 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 753/1536] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:34 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1496 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:12:35.021455 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e5756caf-bbab-4b54-b351-b63bfa7ff53e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:35.022855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e5756caf-bbab-4b54-b351-b63bfa7ff53e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] [instance: 451cf12b-e061-4c6c-8b43-40cee9ddcc1c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:35.046401 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5756caf-bbab-4b54-b351-b63bfa7ff53e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:35.047215 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5756caf-bbab-4b54-b351-b63bfa7ff53e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:35.054665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5756caf-bbab-4b54-b351-b63bfa7ff53e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:35.055718 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5756caf-bbab-4b54-b351-b63bfa7ff53e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:35.070700 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9b04a2c5-96d6-4e18-809f-50334c5fff9c tempest-SecurityGroupsTestJSON-1466918654 tempest-SecurityGroupsTestJSON-1466918654-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/9745103a-0266-49af-a15e-a1e91bec5662" status: 202 len: 0 microversion: 2.1 time: 1.403340 Jul 31 01:12:35.072031 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 784/1537] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:12:33 2022] DELETE /compute/v2.1/os-security-groups/9745103a-0266-49af-a15e-a1e91bec5662 => generated 0 bytes in 1406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:12:35.095761 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ef76014d-86a5-4c8f-8d5b-e4703aff4b1d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:35.098202 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ef76014d-86a5-4c8f-8d5b-e4703aff4b1d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:35.108914 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-e5756caf-bbab-4b54-b351-b63bfa7ff53e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] HTTP exception thrown: Instance 451cf12b-e061-4c6c-8b43-40cee9ddcc1c could not be found. Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e5756caf-bbab-4b54-b351-b63bfa7ff53e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Request method failure captured: Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c HTTP/1.1 Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dZjHBS6_u0CBda8epCrs-Ek1WFTOrE2pH94mET92mDJB_isl-PAJKxEd9Av4dGFUBVnPVU-oCWW1EApU0pfdsbb3eB2UYXoPJeHu5xTqHq0wxK5YtQXFMZDj1ScI4VxkQitczNI0WjjZk-SA_J2GJAb8BHGqK6Eol590NoPM4AYRqQ Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 3e3cc749a4a34731b3035b320af81cd4 Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersTestBootFromVolume-1762050303 Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3e3cc749a4a34731b3035b320af81cd4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3e3cc749a4a34731b3035b320af81cd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3e3cc749a4a34731b3035b320af81cd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3e3cc749a4a34731b3035b320af81cd4", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersTestBootFromVolume-1762050303 Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 3e3cc749a4a34731b3035b320af81cd4 Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1762050303 Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersTestBootFromVolume-1762050303-project Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 2eb298a85d524f1d9f3a2138636a2773 Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersTestBootFromVolume-1762050303-project Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 451cf12b-e061-4c6c-8b43-40cee9ddcc1c could not be found. Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '451cf12b-e061-4c6c-8b43-40cee9ddcc1c'} Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 451cf12b-e061-4c6c-8b43-40cee9ddcc1c could not be found. Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 451cf12b-e061-4c6c-8b43-40cee9ddcc1c could not be found. Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:35.110751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:35.120226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:35.120226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:35.120226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:35.120226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:35.120226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:35.120226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 451cf12b-e061-4c6c-8b43-40cee9ddcc1c could not be found. Jul 31 01:12:35.120226 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:35.120226 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e5756caf-bbab-4b54-b351-b63bfa7ff53e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Returning 404 to user: Instance 451cf12b-e061-4c6c-8b43-40cee9ddcc1c could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:35.120226 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e5756caf-bbab-4b54-b351-b63bfa7ff53e tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c" status: 404 len: 111 microversion: 2.1 time: 0.098825 Jul 31 01:12:35.120226 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 754/1538] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:35 2022] GET /compute/v2.1/servers/451cf12b-e061-4c6c-8b43-40cee9ddcc1c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:35.120226 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b859e2f3-bd81-4666-bb25-e46d0a59d908 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:35.120226 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b859e2f3-bd81-4666-bb25-e46d0a59d908 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:35.129169 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b859e2f3-bd81-4666-bb25-e46d0a59d908 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:35.129981 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b859e2f3-bd81-4666-bb25-e46d0a59d908 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:35.130887 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b859e2f3-bd81-4666-bb25-e46d0a59d908 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:35.131355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b859e2f3-bd81-4666-bb25-e46d0a59d908 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:35.158086 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef76014d-86a5-4c8f-8d5b-e4703aff4b1d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:35.158929 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef76014d-86a5-4c8f-8d5b-e4703aff4b1d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:35.160410 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef76014d-86a5-4c8f-8d5b-e4703aff4b1d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:35.161203 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef76014d-86a5-4c8f-8d5b-e4703aff4b1d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:35.189951 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b859e2f3-bd81-4666-bb25-e46d0a59d908 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:12:35.252687 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:35.305575 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ef76014d-86a5-4c8f-8d5b-e4703aff4b1d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.219484 Jul 31 01:12:35.313792 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 785/1539] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:12:35 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments => generated 197 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:35.340242 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d225b35d-7d1f-4e3c-843e-86186d8e1456 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] Calling method '.version_select at 0x7fede5224550>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:35.407786 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d225b35d-7d1f-4e3c-843e-86186d8e1456 tempest-ServersTestBootFromVolume-1762050303 tempest-ServersTestBootFromVolume-1762050303-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-840635721" status: 202 len: 0 microversion: 2.1 time: 0.096860 Jul 31 01:12:35.408536 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 786/1540] 10.222.0.45 () {58 vars in 1218 bytes} [Sun Jul 31 01:12:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-840635721 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:12:35.412433 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b859e2f3-bd81-4666-bb25-e46d0a59d908 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 204 len: 0 microversion: 2.1 time: 0.297586 Jul 31 01:12:35.413994 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 755/1541] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:12:35 2022] DELETE /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:12:35.442000 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d9974f6e-2737-465f-90a0-b63fd875a92f tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:35.444601 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d9974f6e-2737-465f-90a0-b63fd875a92f tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:35.462399 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9974f6e-2737-465f-90a0-b63fd875a92f tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:35.463307 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9974f6e-2737-465f-90a0-b63fd875a92f tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:35.464450 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9974f6e-2737-465f-90a0-b63fd875a92f tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:35.464989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9974f6e-2737-465f-90a0-b63fd875a92f tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:35.789025 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d9974f6e-2737-465f-90a0-b63fd875a92f tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:35.800358 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d9974f6e-2737-465f-90a0-b63fd875a92f tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1468 microversion: 2.1 time: 0.377713 Jul 31 01:12:35.818041 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 787/1542] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:35 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1468 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:36.027564 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ac075359-4000-4576-8a19-a352e8bccc6d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:36.028871 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ac075359-4000-4576-8a19-a352e8bccc6d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:36.048879 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac075359-4000-4576-8a19-a352e8bccc6d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:36.055922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac075359-4000-4576-8a19-a352e8bccc6d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:36.059937 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac075359-4000-4576-8a19-a352e8bccc6d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:36.060869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac075359-4000-4576-8a19-a352e8bccc6d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:36.321109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cfd3b4ee-c9eb-46f7-ae04-5a7d5921fe00 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:36.323635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cfd3b4ee-c9eb-46f7-ae04-5a7d5921fe00 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:36.345200 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfd3b4ee-c9eb-46f7-ae04-5a7d5921fe00 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:36.345774 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfd3b4ee-c9eb-46f7-ae04-5a7d5921fe00 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:36.346680 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfd3b4ee-c9eb-46f7-ae04-5a7d5921fe00 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:36.347198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfd3b4ee-c9eb-46f7-ae04-5a7d5921fe00 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:36.425228 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cfd3b4ee-c9eb-46f7-ae04-5a7d5921fe00 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108124 Jul 31 01:12:36.431554 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 788/1543] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:12:36 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:36.596549 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ac075359-4000-4576-8a19-a352e8bccc6d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:36.623332 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ac075359-4000-4576-8a19-a352e8bccc6d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1496 microversion: 2.1 time: 0.601803 Jul 31 01:12:36.631538 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 756/1544] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:36 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1496 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:36.824484 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-77e8c932-738c-4c84-a399-bc126b176331 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:36.825135 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-77e8c932-738c-4c84-a399-bc126b176331 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:36.835459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77e8c932-738c-4c84-a399-bc126b176331 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:36.835924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77e8c932-738c-4c84-a399-bc126b176331 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:36.836742 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77e8c932-738c-4c84-a399-bc126b176331 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:36.837191 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77e8c932-738c-4c84-a399-bc126b176331 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:37.160725 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-12373cf3-3dfe-44b5-b1dd-52dece58974a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1156453006", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "3c2be060-a5dd-4923-9ec8-26881bd84082"}], "block_device_mapping_v2": [{"uuid": "13cb3cea-a797-4d36-8de7-00bba359a560", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:37.233427 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-77e8c932-738c-4c84-a399-bc126b176331 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:37.244234 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-12373cf3-3dfe-44b5-b1dd-52dece58974a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] validate_networks() for [('3c2be060-a5dd-4923-9ec8-26881bd84082', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:12:37.245015 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-77e8c932-738c-4c84-a399-bc126b176331 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1468 microversion: 2.1 time: 0.425736 Jul 31 01:12:37.251814 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 789/1545] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:36 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1468 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:37.440106 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bf0c4b68-5f24-4d38-a7b8-0c9f3ff5673b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:37.442492 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bf0c4b68-5f24-4d38-a7b8-0c9f3ff5673b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:37.468266 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf0c4b68-5f24-4d38-a7b8-0c9f3ff5673b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:37.468728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf0c4b68-5f24-4d38-a7b8-0c9f3ff5673b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:37.470882 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf0c4b68-5f24-4d38-a7b8-0c9f3ff5673b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:37.475137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf0c4b68-5f24-4d38-a7b8-0c9f3ff5673b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:37.552425 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bf0c4b68-5f24-4d38-a7b8-0c9f3ff5673b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119078 Jul 31 01:12:37.559654 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 790/1546] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:12:37 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:12:37.651759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-abcfad06-65f5-4892-afac-2fa39834e17f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:37.652389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-abcfad06-65f5-4892-afac-2fa39834e17f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:37.659198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abcfad06-65f5-4892-afac-2fa39834e17f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:37.659952 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abcfad06-65f5-4892-afac-2fa39834e17f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:37.661186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abcfad06-65f5-4892-afac-2fa39834e17f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:37.661871 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abcfad06-65f5-4892-afac-2fa39834e17f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:38.665214 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-abcfad06-65f5-4892-afac-2fa39834e17f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:38.696105 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-abcfad06-65f5-4892-afac-2fa39834e17f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1496 microversion: 2.1 time: 1.046922 Jul 31 01:12:38.716874 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 791/1547] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:37 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1496 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:12:38.735846 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e4cd299a-1f09-448e-a68c-7b545c059040 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:38.737664 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e4cd299a-1f09-448e-a68c-7b545c059040 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:38.757982 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4cd299a-1f09-448e-a68c-7b545c059040 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:38.758706 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4cd299a-1f09-448e-a68c-7b545c059040 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:38.759759 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4cd299a-1f09-448e-a68c-7b545c059040 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:38.760363 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4cd299a-1f09-448e-a68c-7b545c059040 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:38.939391 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 01:12:38.941167 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 01:12:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.45) !!! Jul 31 01:12:39.131474 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-12373cf3-3dfe-44b5-b1dd-52dece58974a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:12:39.132812 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-12373cf3-3dfe-44b5-b1dd-52dece58974a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:12:39.134799 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-12373cf3-3dfe-44b5-b1dd-52dece58974a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:12:39.135878 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-12373cf3-3dfe-44b5-b1dd-52dece58974a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:12:39.139257 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-12373cf3-3dfe-44b5-b1dd-52dece58974a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:12:39.154183 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12373cf3-3dfe-44b5-b1dd-52dece58974a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:39.155003 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12373cf3-3dfe-44b5-b1dd-52dece58974a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:39.156159 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12373cf3-3dfe-44b5-b1dd-52dece58974a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:39.156810 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12373cf3-3dfe-44b5-b1dd-52dece58974a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:39.181513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-12373cf3-3dfe-44b5-b1dd-52dece58974a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Getting quotas for project 5881381d95ec452eb516c0c7ad826a08. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:12:39.190658 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-12373cf3-3dfe-44b5-b1dd-52dece58974a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Getting quotas for user cd6eb7e316f54ff386eaa598df805de9 and project 5881381d95ec452eb516c0c7ad826a08. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:12:39.275151 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e4cd299a-1f09-448e-a68c-7b545c059040 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:39.293465 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e4cd299a-1f09-448e-a68c-7b545c059040 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 200 len: 1468 microversion: 2.1 time: 0.573629 Jul 31 01:12:39.296148 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 792/1548] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:38 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 1468 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:39.310645 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-12373cf3-3dfe-44b5-b1dd-52dece58974a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:12:39.313951 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-12373cf3-3dfe-44b5-b1dd-52dece58974a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='13cb3cea-a797-4d36-8de7-00bba359a560',volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:12:39.323537 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b4045a2f-1b96-464e-adaa-5271ffbd9a9d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:39.331368 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b4045a2f-1b96-464e-adaa-5271ffbd9a9d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:39.346692 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4045a2f-1b96-464e-adaa-5271ffbd9a9d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:39.349712 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4045a2f-1b96-464e-adaa-5271ffbd9a9d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:39.359292 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4045a2f-1b96-464e-adaa-5271ffbd9a9d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:39.360079 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4045a2f-1b96-464e-adaa-5271ffbd9a9d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:39.485285 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b4045a2f-1b96-464e-adaa-5271ffbd9a9d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185218 Jul 31 01:12:39.487403 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 793/1549] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:12:39 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:39.500057 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-14416346-b4e6-42c0-a0f6-4e4a12deca15 req-651906b5-e94e-4e9d-a924-7dedcb9d8788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4faaeb8d-01fd-456a-b887-c5cf7ba7051b", "name": "network-vif-deleted", "tag": "ad7e118b-a003-47c7-8563-67c45bdc1cce"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:39.516250 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-14416346-b4e6-42c0-a0f6-4e4a12deca15 req-651906b5-e94e-4e9d-a924-7dedcb9d8788 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:39.520754 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-14416346-b4e6-42c0-a0f6-4e4a12deca15 req-651906b5-e94e-4e9d-a924-7dedcb9d8788 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:39.574812 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-14416346-b4e6-42c0-a0f6-4e4a12deca15 req-651906b5-e94e-4e9d-a924-7dedcb9d8788 service nova] Creating event network-vif-deleted:ad7e118b-a003-47c7-8563-67c45bdc1cce for instance 4faaeb8d-01fd-456a-b887-c5cf7ba7051b on n-h2-master-1 Jul 31 01:12:39.594449 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-14416346-b4e6-42c0-a0f6-4e4a12deca15 req-651906b5-e94e-4e9d-a924-7dedcb9d8788 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104519 Jul 31 01:12:39.605346 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 794/1550] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:39.691238 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-12373cf3-3dfe-44b5-b1dd-52dece58974a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.534824 Jul 31 01:12:39.691844 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 757/1551] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:12:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2537 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 31 01:12:39.703688 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed451a2d-3699-49d7-94ed-8dc19a054d42 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:39.704387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ed451a2d-3699-49d7-94ed-8dc19a054d42 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:39.737423 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-011f67c8-b16c-4829-8536-8e9caf9be13f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:39.738328 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-011f67c8-b16c-4829-8536-8e9caf9be13f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:39.754474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-011f67c8-b16c-4829-8536-8e9caf9be13f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:39.755128 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-011f67c8-b16c-4829-8536-8e9caf9be13f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:39.756966 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-011f67c8-b16c-4829-8536-8e9caf9be13f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:39.757843 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-011f67c8-b16c-4829-8536-8e9caf9be13f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:40.024662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ed451a2d-3699-49d7-94ed-8dc19a054d42 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:40.035107 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ed451a2d-3699-49d7-94ed-8dc19a054d42 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:40.042318 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ed451a2d-3699-49d7-94ed-8dc19a054d42 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:40.043700 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ed451a2d-3699-49d7-94ed-8dc19a054d42 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1104 microversion: 2.25 time: 0.344659 Jul 31 01:12:40.059440 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 795/1552] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:12:39 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1104 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:12:40.325211 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb2d6d22-183f-4482-a962-6cb76f5425b9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:40.325848 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fb2d6d22-183f-4482-a962-6cb76f5425b9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 4faaeb8d-01fd-456a-b887-c5cf7ba7051b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:40.339314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb2d6d22-183f-4482-a962-6cb76f5425b9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:40.339795 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb2d6d22-183f-4482-a962-6cb76f5425b9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:40.340604 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb2d6d22-183f-4482-a962-6cb76f5425b9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:40.341045 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb2d6d22-183f-4482-a962-6cb76f5425b9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:40.394459 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-fb2d6d22-183f-4482-a962-6cb76f5425b9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] HTTP exception thrown: Instance 4faaeb8d-01fd-456a-b887-c5cf7ba7051b could not be found. Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb2d6d22-183f-4482-a962-6cb76f5425b9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Request method failure captured: Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b HTTP/1.1 Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWOWPD3u0Fwp5dGWcnUSe7Du8BFrIy2qCUrbP0DPSdaXw9Dwq3xbMRWtIAN4LwWBFVr_wCpWuEP_7NOGIRZaJ2VmGob-JMnRAhEgQ-45R5DG3RUp1kLtZoUytKJiEJnQmYJhweNVBe5oJ_0Yz5MoBlDgNmyzYMTS1syAb7ShVLW-_0 Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 87496179e992473c991977e0e517460a Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-MigrationsAdminTest-1757285143 Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87496179e992473c991977e0e517460a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87496179e992473c991977e0e517460a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/87496179e992473c991977e0e517460a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_87496179e992473c991977e0e517460a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-MigrationsAdminTest-1757285143 Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 87496179e992473c991977e0e517460a Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-MigrationsAdminTest-1757285143 Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-MigrationsAdminTest-1757285143-project Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 9a2a0f61c8304c9a9ad7af6120e83443 Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-MigrationsAdminTest-1757285143-project Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 4faaeb8d-01fd-456a-b887-c5cf7ba7051b could not be found. Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '4faaeb8d-01fd-456a-b887-c5cf7ba7051b'} Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4faaeb8d-01fd-456a-b887-c5cf7ba7051b could not be found. Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4faaeb8d-01fd-456a-b887-c5cf7ba7051b could not be found. Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:40.396320 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:40.407723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:40.407723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:40.407723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:40.407723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:40.407723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:40.407723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4faaeb8d-01fd-456a-b887-c5cf7ba7051b could not be found. Jul 31 01:12:40.407723 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:12:40.407723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb2d6d22-183f-4482-a962-6cb76f5425b9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Returning 404 to user: Instance 4faaeb8d-01fd-456a-b887-c5cf7ba7051b could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:40.407723 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fb2d6d22-183f-4482-a962-6cb76f5425b9 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b" status: 404 len: 111 microversion: 2.1 time: 0.076569 Jul 31 01:12:40.407723 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 796/1553] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:40 2022] GET /compute/v2.1/servers/4faaeb8d-01fd-456a-b887-c5cf7ba7051b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:12:40.409535 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a502a651-211f-4097-b12f-33afb032cb38 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:40.411574 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a502a651-211f-4097-b12f-33afb032cb38 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:40.419990 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a502a651-211f-4097-b12f-33afb032cb38 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:40.421305 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a502a651-211f-4097-b12f-33afb032cb38 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:40.424526 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a502a651-211f-4097-b12f-33afb032cb38 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:40.425320 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a502a651-211f-4097-b12f-33afb032cb38 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:40.487985 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a502a651-211f-4097-b12f-33afb032cb38 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:12:40.538592 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-011f67c8-b16c-4829-8536-8e9caf9be13f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:40.559959 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-011f67c8-b16c-4829-8536-8e9caf9be13f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1496 microversion: 2.1 time: 0.814643 Jul 31 01:12:40.579378 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 758/1554] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:39 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1496 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:12:40.579378 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-863470d2-3301-48d2-8c1a-047b6674dbeb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:40.579378 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-863470d2-3301-48d2-8c1a-047b6674dbeb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:40.598551 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-863470d2-3301-48d2-8c1a-047b6674dbeb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:40.600227 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-863470d2-3301-48d2-8c1a-047b6674dbeb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:40.601215 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-863470d2-3301-48d2-8c1a-047b6674dbeb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:40.601782 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-863470d2-3301-48d2-8c1a-047b6674dbeb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:40.655615 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:40.658575 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-863470d2-3301-48d2-8c1a-047b6674dbeb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088849 Jul 31 01:12:40.663650 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a502a651-211f-4097-b12f-33afb032cb38 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "DELETE /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 204 len: 0 microversion: 2.1 time: 0.258254 Jul 31 01:12:40.664602 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 797/1555] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:12:40 2022] DELETE /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:12:40.665011 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 759/1556] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:12:40 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:12:40.676471 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-776050bd-9ada-44f8-b493-a1129948bbb2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:40.677858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-776050bd-9ada-44f8-b493-a1129948bbb2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:40.685381 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-776050bd-9ada-44f8-b493-a1129948bbb2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:40.686241 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-776050bd-9ada-44f8-b493-a1129948bbb2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:40.687867 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-776050bd-9ada-44f8-b493-a1129948bbb2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:40.688554 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-776050bd-9ada-44f8-b493-a1129948bbb2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:41.067093 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6fc694b8-a6b4-464e-88e8-85dfa27820aa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:41.068146 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6fc694b8-a6b4-464e-88e8-85dfa27820aa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:41.115286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6fc694b8-a6b4-464e-88e8-85dfa27820aa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:41.117770 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6fc694b8-a6b4-464e-88e8-85dfa27820aa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:41.118749 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6fc694b8-a6b4-464e-88e8-85dfa27820aa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:41.134190 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6fc694b8-a6b4-464e-88e8-85dfa27820aa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:41.332985 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6fc694b8-a6b4-464e-88e8-85dfa27820aa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:41.364984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6fc694b8-a6b4-464e-88e8-85dfa27820aa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:41.370748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6fc694b8-a6b4-464e-88e8-85dfa27820aa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:41.376471 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6fc694b8-a6b4-464e-88e8-85dfa27820aa tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1233 microversion: 2.25 time: 0.313933 Jul 31 01:12:41.380874 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 760/1557] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:12:41 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1233 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:12:41.402517 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-776050bd-9ada-44f8-b493-a1129948bbb2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:41.415109 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-776050bd-9ada-44f8-b493-a1129948bbb2 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1469 microversion: 2.1 time: 0.745955 Jul 31 01:12:41.419856 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 798/1558] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:40 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1469 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:12:41.608628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1646939a-2d93-4587-8efc-ca50aff818ba tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:41.610012 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1646939a-2d93-4587-8efc-ca50aff818ba tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:41.621059 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1646939a-2d93-4587-8efc-ca50aff818ba tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:41.622663 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1646939a-2d93-4587-8efc-ca50aff818ba tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:41.625929 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1646939a-2d93-4587-8efc-ca50aff818ba tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:41.626659 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1646939a-2d93-4587-8efc-ca50aff818ba tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:42.415692 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6132af11-21c2-42a1-9f0f-29f386330447 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:42.416340 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6132af11-21c2-42a1-9f0f-29f386330447 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:42.441162 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6132af11-21c2-42a1-9f0f-29f386330447 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:42.444285 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6132af11-21c2-42a1-9f0f-29f386330447 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:42.448808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6132af11-21c2-42a1-9f0f-29f386330447 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:42.451512 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6132af11-21c2-42a1-9f0f-29f386330447 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:42.785720 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6132af11-21c2-42a1-9f0f-29f386330447 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:42.797438 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6132af11-21c2-42a1-9f0f-29f386330447 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:42.807438 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6132af11-21c2-42a1-9f0f-29f386330447 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:42.810894 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6132af11-21c2-42a1-9f0f-29f386330447 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1251 microversion: 2.25 time: 0.400521 Jul 31 01:12:42.818370 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 799/1559] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:12:42 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1251 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:12:42.824929 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f9d569e6-fc2f-4129-beb3-230071b01a54 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:42.827371 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f9d569e6-fc2f-4129-beb3-230071b01a54 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:42.843033 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9d569e6-fc2f-4129-beb3-230071b01a54 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:42.843555 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9d569e6-fc2f-4129-beb3-230071b01a54 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:42.844364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9d569e6-fc2f-4129-beb3-230071b01a54 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:42.845080 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9d569e6-fc2f-4129-beb3-230071b01a54 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:42.946061 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1646939a-2d93-4587-8efc-ca50aff818ba tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:42.964600 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1646939a-2d93-4587-8efc-ca50aff818ba tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1496 microversion: 2.1 time: 1.355820 Jul 31 01:12:42.980419 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 761/1560] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:41 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1496 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:43.862403 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-30a250df-ff51-4ba7-9bc4-fe0cedbb450f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:43.864874 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-30a250df-ff51-4ba7-9bc4-fe0cedbb450f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:43.900677 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30a250df-ff51-4ba7-9bc4-fe0cedbb450f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:43.906718 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30a250df-ff51-4ba7-9bc4-fe0cedbb450f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:43.912153 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30a250df-ff51-4ba7-9bc4-fe0cedbb450f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:43.913547 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30a250df-ff51-4ba7-9bc4-fe0cedbb450f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:44.324191 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-30a250df-ff51-4ba7-9bc4-fe0cedbb450f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:44.351927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-30a250df-ff51-4ba7-9bc4-fe0cedbb450f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:44.362194 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-30a250df-ff51-4ba7-9bc4-fe0cedbb450f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:44.370165 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-30a250df-ff51-4ba7-9bc4-fe0cedbb450f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1251 microversion: 2.25 time: 0.518928 Jul 31 01:12:44.377301 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 762/1561] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:12:43 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1251 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:12:44.397726 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-227e94ed-a7d4-4011-b46e-657955cbddef tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:44.408479 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-227e94ed-a7d4-4011-b46e-657955cbddef tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:44.429003 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-227e94ed-a7d4-4011-b46e-657955cbddef tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:44.430849 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-227e94ed-a7d4-4011-b46e-657955cbddef tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:44.432380 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-227e94ed-a7d4-4011-b46e-657955cbddef tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:44.434098 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-227e94ed-a7d4-4011-b46e-657955cbddef tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:44.547554 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f9d569e6-fc2f-4129-beb3-230071b01a54 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:44.555781 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f9d569e6-fc2f-4129-beb3-230071b01a54 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1469 microversion: 2.1 time: 1.736170 Jul 31 01:12:44.562876 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 800/1562] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:42 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1469 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:44.837463 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-227e94ed-a7d4-4011-b46e-657955cbddef tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:44.852160 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-227e94ed-a7d4-4011-b46e-657955cbddef tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1496 microversion: 2.1 time: 0.473466 Jul 31 01:12:44.852880 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 763/1563] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:44 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1496 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:45.236719 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-229a550c-76e6-4676-8bc9-9c49dc00b53e req-f46c6499-a579-4674-94e0-bc3317517bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "389e7feb-f45c-4e78-ad80-6a5d230e68ba", "name": "network-vif-deleted", "tag": "59525f1d-b7cd-4a9a-86cf-0466f0ad21ef"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:45.261734 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-229a550c-76e6-4676-8bc9-9c49dc00b53e req-f46c6499-a579-4674-94e0-bc3317517bfa service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:45.267486 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-229a550c-76e6-4676-8bc9-9c49dc00b53e req-f46c6499-a579-4674-94e0-bc3317517bfa service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:45.305358 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-229a550c-76e6-4676-8bc9-9c49dc00b53e req-f46c6499-a579-4674-94e0-bc3317517bfa service nova] Creating event network-vif-deleted:59525f1d-b7cd-4a9a-86cf-0466f0ad21ef for instance 389e7feb-f45c-4e78-ad80-6a5d230e68ba on n-h2-master-1 Jul 31 01:12:45.322953 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-229a550c-76e6-4676-8bc9-9c49dc00b53e req-f46c6499-a579-4674-94e0-bc3317517bfa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090458 Jul 31 01:12:45.324506 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 801/1564] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:45.402354 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d69c76c1-5271-46a4-a0cf-5417126153a8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:45.403619 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d69c76c1-5271-46a4-a0cf-5417126153a8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:45.462511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d69c76c1-5271-46a4-a0cf-5417126153a8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:45.471215 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d69c76c1-5271-46a4-a0cf-5417126153a8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:45.477404 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d69c76c1-5271-46a4-a0cf-5417126153a8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:45.478891 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d69c76c1-5271-46a4-a0cf-5417126153a8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:45.584674 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7515719b-71ce-40d2-a3f1-e921f42e3a81 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:45.586016 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7515719b-71ce-40d2-a3f1-e921f42e3a81 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:45.604628 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7515719b-71ce-40d2-a3f1-e921f42e3a81 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:45.611218 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7515719b-71ce-40d2-a3f1-e921f42e3a81 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:45.612284 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7515719b-71ce-40d2-a3f1-e921f42e3a81 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:45.616397 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7515719b-71ce-40d2-a3f1-e921f42e3a81 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:45.699086 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7515719b-71ce-40d2-a3f1-e921f42e3a81 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:45.704755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7515719b-71ce-40d2-a3f1-e921f42e3a81 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:45.706439 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-7515719b-71ce-40d2-a3f1-e921f42e3a81 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lazy-loading 'fault' on Instance uuid 389e7feb-f45c-4e78-ad80-6a5d230e68ba {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:12:45.933273 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7515719b-71ce-40d2-a3f1-e921f42e3a81 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2a0f61c8304c9a9ad7af6120e83443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87496179e992473c991977e0e517460a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:45.973195 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7515719b-71ce-40d2-a3f1-e921f42e3a81 tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 200 len: 1303 microversion: 2.1 time: 0.393344 Jul 31 01:12:45.978702 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 802/1565] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:45 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 1303 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:12:45.988837 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d69c76c1-5271-46a4-a0cf-5417126153a8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:46.000665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d69c76c1-5271-46a4-a0cf-5417126153a8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:46.002187 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d69c76c1-5271-46a4-a0cf-5417126153a8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:46.003385 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d69c76c1-5271-46a4-a0cf-5417126153a8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1251 microversion: 2.25 time: 0.605428 Jul 31 01:12:46.003547 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1a8e940f-32f5-4f2b-a70a-a7ac2e1f26b4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:46.005134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1a8e940f-32f5-4f2b-a70a-a7ac2e1f26b4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:46.019707 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 764/1566] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:12:45 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1251 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:12:46.029230 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a8e940f-32f5-4f2b-a70a-a7ac2e1f26b4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:46.037122 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a8e940f-32f5-4f2b-a70a-a7ac2e1f26b4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:46.040278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a8e940f-32f5-4f2b-a70a-a7ac2e1f26b4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:46.041510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a8e940f-32f5-4f2b-a70a-a7ac2e1f26b4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:46.761772 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1a8e940f-32f5-4f2b-a70a-a7ac2e1f26b4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:46.770184 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:46.779054 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1a8e940f-32f5-4f2b-a70a-a7ac2e1f26b4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1496 microversion: 2.1 time: 0.794862 Jul 31 01:12:46.784925 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 803/1567] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:45 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1496 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:47.000122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c0046d5d-664e-415c-8883-b89dbf51f22c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:47.000915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c0046d5d-664e-415c-8883-b89dbf51f22c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] [instance: 389e7feb-f45c-4e78-ad80-6a5d230e68ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:47.032851 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0046d5d-664e-415c-8883-b89dbf51f22c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:47.037225 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0046d5d-664e-415c-8883-b89dbf51f22c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:47.046621 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-97da28ac-dc81-47ba-9658-76131e3c07d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:47.047396 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-97da28ac-dc81-47ba-9658-76131e3c07d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:47.051967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0046d5d-664e-415c-8883-b89dbf51f22c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:47.056279 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0046d5d-664e-415c-8883-b89dbf51f22c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:47.072147 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97da28ac-dc81-47ba-9658-76131e3c07d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:47.075223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97da28ac-dc81-47ba-9658-76131e3c07d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:47.077362 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97da28ac-dc81-47ba-9658-76131e3c07d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:47.077843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97da28ac-dc81-47ba-9658-76131e3c07d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:47.136837 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-c0046d5d-664e-415c-8883-b89dbf51f22c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] HTTP exception thrown: Instance 389e7feb-f45c-4e78-ad80-6a5d230e68ba could not be found. Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c0046d5d-664e-415c-8883-b89dbf51f22c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Request method failure captured: Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba HTTP/1.1 Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dWOWPD3u0Fwp5dGWcnUSe7Du8BFrIy2qCUrbP0DPSdaXw9Dwq3xbMRWtIAN4LwWBFVr_wCpWuEP_7NOGIRZaJ2VmGob-JMnRAhEgQ-45R5DG3RUp1kLtZoUytKJiEJnQmYJhweNVBe5oJ_0Yz5MoBlDgNmyzYMTS1syAb7ShVLW-_0 Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 87496179e992473c991977e0e517460a Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-MigrationsAdminTest-1757285143 Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87496179e992473c991977e0e517460a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/87496179e992473c991977e0e517460a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/87496179e992473c991977e0e517460a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_87496179e992473c991977e0e517460a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-MigrationsAdminTest-1757285143 Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 87496179e992473c991977e0e517460a Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-MigrationsAdminTest-1757285143 Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-MigrationsAdminTest-1757285143-project Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 9a2a0f61c8304c9a9ad7af6120e83443 Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-MigrationsAdminTest-1757285143-project Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 389e7feb-f45c-4e78-ad80-6a5d230e68ba could not be found. Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '389e7feb-f45c-4e78-ad80-6a5d230e68ba'} Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 389e7feb-f45c-4e78-ad80-6a5d230e68ba could not be found. Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 389e7feb-f45c-4e78-ad80-6a5d230e68ba could not be found. Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:12:47.146275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:47.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:12:47.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:12:47.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:12:47.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:12:47.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:12:47.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 389e7feb-f45c-4e78-ad80-6a5d230e68ba could not be found. Jul 31 01:12:47.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:12:47.151292 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c0046d5d-664e-415c-8883-b89dbf51f22c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] Returning 404 to user: Instance 389e7feb-f45c-4e78-ad80-6a5d230e68ba could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:12:47.151292 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c0046d5d-664e-415c-8883-b89dbf51f22c tempest-MigrationsAdminTest-1757285143 tempest-MigrationsAdminTest-1757285143-project] 10.222.0.45 "GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba" status: 404 len: 111 microversion: 2.1 time: 0.155972 Jul 31 01:12:47.152612 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 765/1568] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:46 2022] GET /compute/v2.1/servers/389e7feb-f45c-4e78-ad80-6a5d230e68ba => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:12:47.815943 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cb9f2a81-a8a0-4d66-913a-3c1d2372c34e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:47.816667 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cb9f2a81-a8a0-4d66-913a-3c1d2372c34e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:47.830360 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:47.838499 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9f2a81-a8a0-4d66-913a-3c1d2372c34e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:47.845627 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9f2a81-a8a0-4d66-913a-3c1d2372c34e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:47.859037 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9f2a81-a8a0-4d66-913a-3c1d2372c34e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:47.859856 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9f2a81-a8a0-4d66-913a-3c1d2372c34e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:47.914333 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-97da28ac-dc81-47ba-9658-76131e3c07d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:47.959242 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-97da28ac-dc81-47ba-9658-76131e3c07d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:47.968616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-97da28ac-dc81-47ba-9658-76131e3c07d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:47.984318 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-97da28ac-dc81-47ba-9658-76131e3c07d3 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1293 microversion: 2.25 time: 0.930272 Jul 31 01:12:47.997137 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 804/1569] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:12:47 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1293 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:12:48.420701 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cb9f2a81-a8a0-4d66-913a-3c1d2372c34e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:48.432491 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cb9f2a81-a8a0-4d66-913a-3c1d2372c34e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1496 microversion: 2.1 time: 0.620882 Jul 31 01:12:48.437243 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 766/1570] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:47 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1496 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:12:49.038119 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6e4ae9c3-6730-45e0-a067-5b35477e9714 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:49.052546 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6e4ae9c3-6730-45e0-a067-5b35477e9714 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:49.087207 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e4ae9c3-6730-45e0-a067-5b35477e9714 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:49.088701 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e4ae9c3-6730-45e0-a067-5b35477e9714 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:49.093127 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e4ae9c3-6730-45e0-a067-5b35477e9714 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:49.093879 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e4ae9c3-6730-45e0-a067-5b35477e9714 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:49.458697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-85733230-6302-430d-94d0-406f43a3dc1c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:49.460499 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-85733230-6302-430d-94d0-406f43a3dc1c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:49.472520 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:49.474634 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:49.481621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85733230-6302-430d-94d0-406f43a3dc1c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:49.482775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85733230-6302-430d-94d0-406f43a3dc1c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:49.487492 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85733230-6302-430d-94d0-406f43a3dc1c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:49.493220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85733230-6302-430d-94d0-406f43a3dc1c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:49.725403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6e4ae9c3-6730-45e0-a067-5b35477e9714 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:49.800934 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6e4ae9c3-6730-45e0-a067-5b35477e9714 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:49.843573 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6e4ae9c3-6730-45e0-a067-5b35477e9714 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:49.858696 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6e4ae9c3-6730-45e0-a067-5b35477e9714 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1293 microversion: 2.25 time: 0.831937 Jul 31 01:12:49.863172 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 805/1571] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:12:49 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1293 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:12:50.039175 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-85733230-6302-430d-94d0-406f43a3dc1c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:50.071841 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-85733230-6302-430d-94d0-406f43a3dc1c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1496 microversion: 2.1 time: 0.617875 Jul 31 01:12:50.073717 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 767/1572] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:49 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1496 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:50.899847 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-12548ab2-ce84-4fb9-800a-ea35be78f849 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:50.900513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-12548ab2-ce84-4fb9-800a-ea35be78f849 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:50.906014 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:50.917636 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12548ab2-ce84-4fb9-800a-ea35be78f849 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:50.921774 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12548ab2-ce84-4fb9-800a-ea35be78f849 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:50.932607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12548ab2-ce84-4fb9-800a-ea35be78f849 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:50.933371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12548ab2-ce84-4fb9-800a-ea35be78f849 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:51.100537 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7d639997-d6b5-49d3-96b5-cdc5617ec689 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:51.102137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7d639997-d6b5-49d3-96b5-cdc5617ec689 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:51.117565 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d639997-d6b5-49d3-96b5-cdc5617ec689 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:51.124315 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d639997-d6b5-49d3-96b5-cdc5617ec689 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:51.125600 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d639997-d6b5-49d3-96b5-cdc5617ec689 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:51.126255 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d639997-d6b5-49d3-96b5-cdc5617ec689 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:51.498243 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-12548ab2-ce84-4fb9-800a-ea35be78f849 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:51.522801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-12548ab2-ce84-4fb9-800a-ea35be78f849 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:51.525846 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-12548ab2-ce84-4fb9-800a-ea35be78f849 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:51.530985 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-12548ab2-ce84-4fb9-800a-ea35be78f849 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1293 microversion: 2.25 time: 0.644273 Jul 31 01:12:51.532174 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 806/1573] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:12:50 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1293 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:12:51.616450 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7d639997-d6b5-49d3-96b5-cdc5617ec689 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:51.626214 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7d639997-d6b5-49d3-96b5-cdc5617ec689 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1496 microversion: 2.1 time: 0.533520 Jul 31 01:12:51.631378 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 768/1574] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:51 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1496 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:52.573352 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e57577d-622e-435f-b916-889ecf7ddd2a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:52.574255 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3e57577d-622e-435f-b916-889ecf7ddd2a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:52.584741 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e57577d-622e-435f-b916-889ecf7ddd2a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:52.589044 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e57577d-622e-435f-b916-889ecf7ddd2a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:52.590052 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e57577d-622e-435f-b916-889ecf7ddd2a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:52.591837 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e57577d-622e-435f-b916-889ecf7ddd2a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:52.654554 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d2449050-913a-4a6d-bfc8-909599444bbe tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:52.656231 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d2449050-913a-4a6d-bfc8-909599444bbe tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:52.678043 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2449050-913a-4a6d-bfc8-909599444bbe tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:52.678775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2449050-913a-4a6d-bfc8-909599444bbe tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:52.680473 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2449050-913a-4a6d-bfc8-909599444bbe tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:52.681172 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2449050-913a-4a6d-bfc8-909599444bbe tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:53.092709 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d2449050-913a-4a6d-bfc8-909599444bbe tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:53.128283 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e57577d-622e-435f-b916-889ecf7ddd2a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:53.138212 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d2449050-913a-4a6d-bfc8-909599444bbe tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1496 microversion: 2.1 time: 0.491655 Jul 31 01:12:53.160071 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 769/1575] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:52 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1496 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:12:53.187857 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e57577d-622e-435f-b916-889ecf7ddd2a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:53.204287 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e57577d-622e-435f-b916-889ecf7ddd2a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:53.208051 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3e57577d-622e-435f-b916-889ecf7ddd2a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1293 microversion: 2.25 time: 0.657785 Jul 31 01:12:53.212070 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 807/1576] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:12:52 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1293 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:12:54.204622 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b83b9bf6-9aaf-4c8a-9716-2bb3463833a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:54.213426 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b83b9bf6-9aaf-4c8a-9716-2bb3463833a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:54.239360 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ca1d3c39-56f8-4e44-9317-aa6bc6134a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:54.240139 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ca1d3c39-56f8-4e44-9317-aa6bc6134a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:54.263086 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca1d3c39-56f8-4e44-9317-aa6bc6134a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:54.270535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca1d3c39-56f8-4e44-9317-aa6bc6134a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:54.271589 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca1d3c39-56f8-4e44-9317-aa6bc6134a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:54.284505 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca1d3c39-56f8-4e44-9317-aa6bc6134a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:54.293555 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b83b9bf6-9aaf-4c8a-9716-2bb3463833a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:54.302275 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b83b9bf6-9aaf-4c8a-9716-2bb3463833a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:54.306237 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b83b9bf6-9aaf-4c8a-9716-2bb3463833a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:54.319078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b83b9bf6-9aaf-4c8a-9716-2bb3463833a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:54.777416 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b83b9bf6-9aaf-4c8a-9716-2bb3463833a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:54.801899 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b83b9bf6-9aaf-4c8a-9716-2bb3463833a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1496 microversion: 2.1 time: 0.618268 Jul 31 01:12:54.834347 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 770/1577] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:54 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1496 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:55.226134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ca1d3c39-56f8-4e44-9317-aa6bc6134a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:55.246701 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ca1d3c39-56f8-4e44-9317-aa6bc6134a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:55.265261 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ca1d3c39-56f8-4e44-9317-aa6bc6134a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:55.277747 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ca1d3c39-56f8-4e44-9317-aa6bc6134a66 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1293 microversion: 2.25 time: 1.034359 Jul 31 01:12:55.279114 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 808/1578] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:12:54 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1293 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:12:55.336353 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-b351a0c3-a2d2-4ad9-8106-fb69b104eaba req-fab96857-fd25-47a9-8daa-66987fe4c479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b17392cf-3f17-483a-89cb-0d7bb436bca7", "tag": "67a0c9d8-8bc9-4aab-8068-662a2a37147f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:55.466699 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b351a0c3-a2d2-4ad9-8106-fb69b104eaba req-fab96857-fd25-47a9-8daa-66987fe4c479 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:55.470618 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b351a0c3-a2d2-4ad9-8106-fb69b104eaba req-fab96857-fd25-47a9-8daa-66987fe4c479 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:55.521533 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-b351a0c3-a2d2-4ad9-8106-fb69b104eaba req-fab96857-fd25-47a9-8daa-66987fe4c479 service nova] Creating event network-changed:67a0c9d8-8bc9-4aab-8068-662a2a37147f for instance b17392cf-3f17-483a-89cb-0d7bb436bca7 on n-h2-master-1 Jul 31 01:12:55.543577 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-b351a0c3-a2d2-4ad9-8106-fb69b104eaba req-fab96857-fd25-47a9-8daa-66987fe4c479 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237428 Jul 31 01:12:55.551219 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 771/1579] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:12:55.882761 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3b2bc936-c0a9-4fdb-8a3d-b48a2de1b0b8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:55.884214 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3b2bc936-c0a9-4fdb-8a3d-b48a2de1b0b8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:55.940794 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b2bc936-c0a9-4fdb-8a3d-b48a2de1b0b8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:55.941585 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b2bc936-c0a9-4fdb-8a3d-b48a2de1b0b8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:55.961313 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b2bc936-c0a9-4fdb-8a3d-b48a2de1b0b8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:55.962115 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b2bc936-c0a9-4fdb-8a3d-b48a2de1b0b8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:56.161076 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-38041816-a6e5-42d1-b654-1f2e721ffad0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1705120255", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:56.293346 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-38041816-a6e5-42d1-b654-1f2e721ffad0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:12:56.617150 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b2bc936-c0a9-4fdb-8a3d-b48a2de1b0b8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:56.630156 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3b2bc936-c0a9-4fdb-8a3d-b48a2de1b0b8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 200 len: 1473 microversion: 2.1 time: 0.776717 Jul 31 01:12:56.630784 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 772/1580] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:55 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 1473 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:56.669635 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b33848b0-fd88-4f4c-b5c3-62faf4e40a54 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:56.671298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b33848b0-fd88-4f4c-b5c3-62faf4e40a54 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:56.687489 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b33848b0-fd88-4f4c-b5c3-62faf4e40a54 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:56.688366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b33848b0-fd88-4f4c-b5c3-62faf4e40a54 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:56.692052 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b33848b0-fd88-4f4c-b5c3-62faf4e40a54 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:56.696431 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b33848b0-fd88-4f4c-b5c3-62faf4e40a54 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:57.043310 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b33848b0-fd88-4f4c-b5c3-62faf4e40a54 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:57.092651 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b33848b0-fd88-4f4c-b5c3-62faf4e40a54 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:57.101559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b33848b0-fd88-4f4c-b5c3-62faf4e40a54 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:57.104657 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b33848b0-fd88-4f4c-b5c3-62faf4e40a54 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1281 microversion: 2.25 time: 0.450946 Jul 31 01:12:57.105942 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 773/1581] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:12:56 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1281 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:12:57.143175 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5c6cbb18-8095-4fa8-b6d8-1283537904b2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-487454938"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:12:57.146992 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5c6cbb18-8095-4fa8-b6d8-1283537904b2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:57.186346 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c6cbb18-8095-4fa8-b6d8-1283537904b2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:57.186901 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c6cbb18-8095-4fa8-b6d8-1283537904b2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:57.188547 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c6cbb18-8095-4fa8-b6d8-1283537904b2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:57.189360 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c6cbb18-8095-4fa8-b6d8-1283537904b2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:57.390375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-38041816-a6e5-42d1-b654-1f2e721ffad0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:12:57.390375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-38041816-a6e5-42d1-b654-1f2e721ffad0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:12:57.391279 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-38041816-a6e5-42d1-b654-1f2e721ffad0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:12:57.391279 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-38041816-a6e5-42d1-b654-1f2e721ffad0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:12:57.391779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-38041816-a6e5-42d1-b654-1f2e721ffad0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:12:57.412854 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38041816-a6e5-42d1-b654-1f2e721ffad0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:57.413185 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38041816-a6e5-42d1-b654-1f2e721ffad0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:57.414045 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38041816-a6e5-42d1-b654-1f2e721ffad0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:57.414497 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38041816-a6e5-42d1-b654-1f2e721ffad0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:57.487252 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-38041816-a6e5-42d1-b654-1f2e721ffad0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Getting quotas for project b51fbd8d735c432a84a34b80e031a3af. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:12:57.495997 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-38041816-a6e5-42d1-b654-1f2e721ffad0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Getting quotas for user f2383ce7f1ea4189bb12e91334ad3b6d and project b51fbd8d735c432a84a34b80e031a3af. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:12:57.531033 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-38041816-a6e5-42d1-b654-1f2e721ffad0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:12:57.533922 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-38041816-a6e5-42d1-b654-1f2e721ffad0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:12:57.671239 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-38041816-a6e5-42d1-b654-1f2e721ffad0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.917943 Jul 31 01:12:57.672642 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 809/1582] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:12:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 01:12:57.693829 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-63f44454-8975-428b-af28-5bb3e9e04862 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:57.698536 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-63f44454-8975-428b-af28-5bb3e9e04862 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:57.811381 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5c6cbb18-8095-4fa8-b6d8-1283537904b2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "POST /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b/action" status: 202 len: 0 microversion: 2.1 time: 0.688920 Jul 31 01:12:57.819569 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 774/1583] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:12:57 2022] POST /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b/action => generated 0 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 31 01:12:57.841443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4baef40a-0788-4325-9699-28cc44d0b3af tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede58b41f0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:57.924867 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4baef40a-0788-4325-9699-28cc44d0b3af tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1411 microversion: 2.1 time: 0.100738 Jul 31 01:12:57.935025 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 775/1584] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:12:57 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1411 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:58.046727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-63f44454-8975-428b-af28-5bb3e9e04862 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:58.083890 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-63f44454-8975-428b-af28-5bb3e9e04862 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1223 microversion: 2.1 time: 0.399669 Jul 31 01:12:58.084764 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 810/1585] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:57 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1223 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:58.141836 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-03a2dad3-88c2-4292-97e1-52fdf7607887 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:58.141836 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-03a2dad3-88c2-4292-97e1-52fdf7607887 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:58.161897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03a2dad3-88c2-4292-97e1-52fdf7607887 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:58.162147 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03a2dad3-88c2-4292-97e1-52fdf7607887 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:58.163016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03a2dad3-88c2-4292-97e1-52fdf7607887 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:58.163465 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03a2dad3-88c2-4292-97e1-52fdf7607887 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:58.945255 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6c007b8c-591d-49b0-a237-8e21c432a497 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede51ef8b0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:59.070431 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6c007b8c-591d-49b0-a237-8e21c432a497 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1411 microversion: 2.1 time: 0.131054 Jul 31 01:12:59.074535 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 811/1586] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:12:58 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1411 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:59.125399 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-64b2a6c0-087f-4ad1-af21-0b9db9184dd6 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:12:59.129287 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-64b2a6c0-087f-4ad1-af21-0b9db9184dd6 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:12:59.167758 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64b2a6c0-087f-4ad1-af21-0b9db9184dd6 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:59.168867 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64b2a6c0-087f-4ad1-af21-0b9db9184dd6 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:59.170897 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64b2a6c0-087f-4ad1-af21-0b9db9184dd6 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:12:59.171814 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64b2a6c0-087f-4ad1-af21-0b9db9184dd6 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:12:59.821396 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-64b2a6c0-087f-4ad1-af21-0b9db9184dd6 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:59.854306 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-64b2a6c0-087f-4ad1-af21-0b9db9184dd6 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1219 microversion: 2.1 time: 0.736863 Jul 31 01:12:59.871938 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 812/1587] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:12:59 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1219 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:12:59.956052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-03a2dad3-88c2-4292-97e1-52fdf7607887 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:59.993576 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-03a2dad3-88c2-4292-97e1-52fdf7607887 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:12:59.996899 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-03a2dad3-88c2-4292-97e1-52fdf7607887 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:00.001957 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-03a2dad3-88c2-4292-97e1-52fdf7607887 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1281 microversion: 2.25 time: 1.866027 Jul 31 01:13:00.008487 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 776/1588] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:12:58 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1281 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:00.094313 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4b8b1733-9593-476d-a6be-dc483ea79378 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede52040d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:00.321758 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4b8b1733-9593-476d-a6be-dc483ea79378 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1411 microversion: 2.1 time: 0.234825 Jul 31 01:13:00.327330 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 813/1589] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:13:00 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1411 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:00.891478 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6b5ba573-b4ae-45bf-b6d3-28c1b5a8774c tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:00.892451 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6b5ba573-b4ae-45bf-b6d3-28c1b5a8774c tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:00.909700 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b5ba573-b4ae-45bf-b6d3-28c1b5a8774c tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:00.910673 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b5ba573-b4ae-45bf-b6d3-28c1b5a8774c tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:00.913209 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b5ba573-b4ae-45bf-b6d3-28c1b5a8774c tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:00.915144 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b5ba573-b4ae-45bf-b6d3-28c1b5a8774c tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:00.997385 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:01.028543 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-71a259aa-abbf-445b-a927-ef714353cbe9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:01.030247 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-71a259aa-abbf-445b-a927-ef714353cbe9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:01.052278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71a259aa-abbf-445b-a927-ef714353cbe9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:01.057837 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71a259aa-abbf-445b-a927-ef714353cbe9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:01.060129 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71a259aa-abbf-445b-a927-ef714353cbe9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:01.066055 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71a259aa-abbf-445b-a927-ef714353cbe9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:01.410332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6b5ba573-b4ae-45bf-b6d3-28c1b5a8774c tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:01.421049 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6b5ba573-b4ae-45bf-b6d3-28c1b5a8774c tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1281 microversion: 2.1 time: 0.533810 Jul 31 01:13:01.427978 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 777/1590] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:00 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1281 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:01.433421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-834d69ee-40db-4a39-b8a6-942fe012156f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede588f700>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:01.660784 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-834d69ee-40db-4a39-b8a6-942fe012156f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1411 microversion: 2.1 time: 0.231100 Jul 31 01:13:01.661744 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 778/1591] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:13:01 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1411 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:02.461281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-71a259aa-abbf-445b-a927-ef714353cbe9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:02.480128 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3282c611-6b9b-4bc1-b354-4028b6e89ec7 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:02.480779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-71a259aa-abbf-445b-a927-ef714353cbe9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:02.481722 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3282c611-6b9b-4bc1-b354-4028b6e89ec7 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:02.490598 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-71a259aa-abbf-445b-a927-ef714353cbe9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:02.500199 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-71a259aa-abbf-445b-a927-ef714353cbe9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1281 microversion: 2.25 time: 1.475482 Jul 31 01:13:02.509723 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 814/1592] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:01 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1281 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:02.512265 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3282c611-6b9b-4bc1-b354-4028b6e89ec7 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:02.514014 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3282c611-6b9b-4bc1-b354-4028b6e89ec7 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:02.515308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3282c611-6b9b-4bc1-b354-4028b6e89ec7 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:02.516104 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3282c611-6b9b-4bc1-b354-4028b6e89ec7 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:02.674613 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3282c611-6b9b-4bc1-b354-4028b6e89ec7 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:02.682014 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-43aba780-aa66-4b0a-ae43-dfdc5937d0d4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaaa6040>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:02.702384 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3282c611-6b9b-4bc1-b354-4028b6e89ec7 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1281 microversion: 2.1 time: 0.238188 Jul 31 01:13:02.705436 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 779/1593] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:02 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1281 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:13:03.548897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d7f300b8-a84b-4dfd-8767-bcc884c46356 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:03.568442 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d7f300b8-a84b-4dfd-8767-bcc884c46356 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:03.633691 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7f300b8-a84b-4dfd-8767-bcc884c46356 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:03.651258 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7f300b8-a84b-4dfd-8767-bcc884c46356 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:03.654121 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7f300b8-a84b-4dfd-8767-bcc884c46356 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:03.655430 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7f300b8-a84b-4dfd-8767-bcc884c46356 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:05.553892 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d7f300b8-a84b-4dfd-8767-bcc884c46356 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:05.604951 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d7f300b8-a84b-4dfd-8767-bcc884c46356 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:05.611769 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d7f300b8-a84b-4dfd-8767-bcc884c46356 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:05.625184 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d7f300b8-a84b-4dfd-8767-bcc884c46356 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1281 microversion: 2.25 time: 2.083094 Jul 31 01:13:05.627932 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 780/1594] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:03 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1281 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:05.678082 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e35970ed-62dd-4c30-a72d-7f96e98e9ba9 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:05.679493 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e35970ed-62dd-4c30-a72d-7f96e98e9ba9 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:05.714893 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e35970ed-62dd-4c30-a72d-7f96e98e9ba9 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:05.715993 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e35970ed-62dd-4c30-a72d-7f96e98e9ba9 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:05.720721 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e35970ed-62dd-4c30-a72d-7f96e98e9ba9 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:05.723252 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e35970ed-62dd-4c30-a72d-7f96e98e9ba9 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:05.975738 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e35970ed-62dd-4c30-a72d-7f96e98e9ba9 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:06.002674 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e35970ed-62dd-4c30-a72d-7f96e98e9ba9 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1281 microversion: 2.1 time: 0.356778 Jul 31 01:13:06.006440 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 781/1595] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:05 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1281 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:06.671251 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-baa35547-b306-488e-b1fe-a86d48e6213b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:06.672308 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-baa35547-b306-488e-b1fe-a86d48e6213b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:06.689482 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-baa35547-b306-488e-b1fe-a86d48e6213b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:06.689482 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-baa35547-b306-488e-b1fe-a86d48e6213b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:06.694710 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-baa35547-b306-488e-b1fe-a86d48e6213b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:06.700395 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-baa35547-b306-488e-b1fe-a86d48e6213b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:07.450859 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:08.054087 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:08.497144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-baa35547-b306-488e-b1fe-a86d48e6213b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:08.525319 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-baa35547-b306-488e-b1fe-a86d48e6213b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:08.541199 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-baa35547-b306-488e-b1fe-a86d48e6213b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:08.567723 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-baa35547-b306-488e-b1fe-a86d48e6213b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1281 microversion: 2.25 time: 1.876220 Jul 31 01:13:08.580199 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 782/1596] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:06 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1281 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:13:08.626962 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-557c2c59-0d12-44e3-97bf-55e2eb37cb2a tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:08.628358 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-557c2c59-0d12-44e3-97bf-55e2eb37cb2a tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:08.685311 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-557c2c59-0d12-44e3-97bf-55e2eb37cb2a tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:08.686828 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-557c2c59-0d12-44e3-97bf-55e2eb37cb2a tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:08.703627 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-557c2c59-0d12-44e3-97bf-55e2eb37cb2a tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:08.704980 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-557c2c59-0d12-44e3-97bf-55e2eb37cb2a tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:10.177903 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-43aba780-aa66-4b0a-ae43-dfdc5937d0d4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1411 microversion: 2.1 time: 7.501603 Jul 31 01:13:10.178623 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 815/1597] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:13:02 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1411 bytes in 7503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:10.200405 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-39dadd6f-9b4a-4dc4-9501-60d9a88521c3 req-a800c6a1-b4c2-4f15-b3dd-71a79bb3ae18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37302988-1cb9-4dca-a5a5-93ff2a30316b", "name": "network-vif-plugged", "status": "completed", "tag": "8e0167ab-8d69-4a27-8750-640d68a6c8e5"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:10.238712 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:10.260626 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-39dadd6f-9b4a-4dc4-9501-60d9a88521c3 req-a800c6a1-b4c2-4f15-b3dd-71a79bb3ae18 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:10.264493 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-39dadd6f-9b4a-4dc4-9501-60d9a88521c3 req-a800c6a1-b4c2-4f15-b3dd-71a79bb3ae18 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:10.322263 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-39dadd6f-9b4a-4dc4-9501-60d9a88521c3 req-a800c6a1-b4c2-4f15-b3dd-71a79bb3ae18 service nova] Creating event network-vif-plugged:8e0167ab-8d69-4a27-8750-640d68a6c8e5 for instance 37302988-1cb9-4dca-a5a5-93ff2a30316b on n-h1-master-1 Jul 31 01:13:10.347699 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-39dadd6f-9b4a-4dc4-9501-60d9a88521c3 req-a800c6a1-b4c2-4f15-b3dd-71a79bb3ae18 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167429 Jul 31 01:13:10.348242 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 816/1598] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:10.414608 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0b126bd7-6151-4ea8-9114-d39978ff7bee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:10.418181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0b126bd7-6151-4ea8-9114-d39978ff7bee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:10.433734 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b126bd7-6151-4ea8-9114-d39978ff7bee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:10.438878 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b126bd7-6151-4ea8-9114-d39978ff7bee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:10.458781 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b126bd7-6151-4ea8-9114-d39978ff7bee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:10.460754 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b126bd7-6151-4ea8-9114-d39978ff7bee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:10.772004 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-557c2c59-0d12-44e3-97bf-55e2eb37cb2a tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:10.825036 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-557c2c59-0d12-44e3-97bf-55e2eb37cb2a tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1323 microversion: 2.1 time: 2.244429 Jul 31 01:13:10.834720 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 783/1599] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:08 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1323 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:11.224313 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c9cb9e21-dfa8-4af9-ba3f-15644f51c6ae tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede5d9e160>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:11.656713 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c9cb9e21-dfa8-4af9-ba3f-15644f51c6ae tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1411 microversion: 2.1 time: 0.458372 Jul 31 01:13:11.684420 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 784/1600] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:13:11 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1411 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:13:11.872355 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b9fa98d4-3814-436a-a86a-7970f1c97625 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:11.890169 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b9fa98d4-3814-436a-a86a-7970f1c97625 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:11.942849 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9fa98d4-3814-436a-a86a-7970f1c97625 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:11.943320 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9fa98d4-3814-436a-a86a-7970f1c97625 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:11.944192 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9fa98d4-3814-436a-a86a-7970f1c97625 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:11.944650 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9fa98d4-3814-436a-a86a-7970f1c97625 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:14.246835 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0b126bd7-6151-4ea8-9114-d39978ff7bee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:14.268847 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0b126bd7-6151-4ea8-9114-d39978ff7bee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:14.278096 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0b126bd7-6151-4ea8-9114-d39978ff7bee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:14.280355 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0b126bd7-6151-4ea8-9114-d39978ff7bee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1281 microversion: 2.25 time: 3.930417 Jul 31 01:13:14.281690 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 817/1601] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:10 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1281 bytes in 3933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:14.298608 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3b80e916-3877-44d3-bca2-12c14953dbd2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa6ea60>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:14.402163 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b9fa98d4-3814-436a-a86a-7970f1c97625 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:14.431247 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3b80e916-3877-44d3-bca2-12c14953dbd2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1411 microversion: 2.1 time: 0.147412 Jul 31 01:13:14.432278 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 818/1602] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:13:14 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1411 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:14.437256 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b9fa98d4-3814-436a-a86a-7970f1c97625 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1323 microversion: 2.1 time: 2.578307 Jul 31 01:13:14.438420 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 785/1603] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:11 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1323 bytes in 2582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:13:15.310360 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3bc6735c-dfac-483f-bbf7-f449e54774ef tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:15.317801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3bc6735c-dfac-483f-bbf7-f449e54774ef tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:15.362274 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bc6735c-dfac-483f-bbf7-f449e54774ef tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:15.369371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bc6735c-dfac-483f-bbf7-f449e54774ef tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:15.378631 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bc6735c-dfac-483f-bbf7-f449e54774ef tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:15.380008 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bc6735c-dfac-483f-bbf7-f449e54774ef tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:15.454835 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7387f98c-884d-4354-9880-da0559db3ef7 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede59a7550>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:15.762274 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7387f98c-884d-4354-9880-da0559db3ef7 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1411 microversion: 2.1 time: 0.314651 Jul 31 01:13:15.768412 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 786/1604] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:13:15 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1411 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:15.802805 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5e9f36b1-7096-4a58-914c-49497cd014e3 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:15.833400 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5e9f36b1-7096-4a58-914c-49497cd014e3 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:15.864313 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5e9f36b1-7096-4a58-914c-49497cd014e3 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:15.865513 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5e9f36b1-7096-4a58-914c-49497cd014e3 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:15.867214 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5e9f36b1-7096-4a58-914c-49497cd014e3 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:15.868869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5e9f36b1-7096-4a58-914c-49497cd014e3 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:16.655167 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3bc6735c-dfac-483f-bbf7-f449e54774ef tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:16.684611 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3bc6735c-dfac-483f-bbf7-f449e54774ef tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:16.686424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3bc6735c-dfac-483f-bbf7-f449e54774ef tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:16.716498 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3bc6735c-dfac-483f-bbf7-f449e54774ef tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1281 microversion: 2.25 time: 1.414987 Jul 31 01:13:16.719827 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 819/1605] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:15 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1281 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:16.739100 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-febeb9cc-c142-48b1-90d2-0aa1259c5900 req-7d7fed65-5ffc-45a8-b35f-5b80deea23d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17392cf-3f17-483a-89cb-0d7bb436bca7", "name": "network-vif-plugged", "status": "completed", "tag": "67a0c9d8-8bc9-4aab-8068-662a2a37147f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:16.768230 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-febeb9cc-c142-48b1-90d2-0aa1259c5900 req-7d7fed65-5ffc-45a8-b35f-5b80deea23d8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:16.768728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-febeb9cc-c142-48b1-90d2-0aa1259c5900 req-7d7fed65-5ffc-45a8-b35f-5b80deea23d8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:16.845744 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-febeb9cc-c142-48b1-90d2-0aa1259c5900 req-7d7fed65-5ffc-45a8-b35f-5b80deea23d8 service nova] Creating event network-vif-plugged:67a0c9d8-8bc9-4aab-8068-662a2a37147f for instance b17392cf-3f17-483a-89cb-0d7bb436bca7 on n-h2-master-1 Jul 31 01:13:16.875730 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-febeb9cc-c142-48b1-90d2-0aa1259c5900 req-7d7fed65-5ffc-45a8-b35f-5b80deea23d8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137465 Jul 31 01:13:16.890042 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 820/1606] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:16.910734 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9581fdd2-9683-4c43-bbc4-049f37e90a33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede51ef790>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:17.179626 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9581fdd2-9683-4c43-bbc4-049f37e90a33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1411 microversion: 2.1 time: 0.285668 Jul 31 01:13:17.181505 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 821/1607] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:13:16 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1411 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:17.523653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5e9f36b1-7096-4a58-914c-49497cd014e3 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:17.554066 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5e9f36b1-7096-4a58-914c-49497cd014e3 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1323 microversion: 2.1 time: 1.778538 Jul 31 01:13:17.569379 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 787/1608] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:15 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1323 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:17.698779 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-962d81e6-6096-4b44-a84d-af8b8e08c56a req-f7c85720-2155-4dc4-91b2-c2f8ed48e366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51ac7d82-f95f-41a6-82e5-43c1c0138977", "tag": "b929d3d3-f845-4f8f-865c-6906eddc5cf3"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:17.742317 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-97be8ac8-f018-446f-b684-07cf07f3e4f6 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1393705015", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "6cd001ed-9f19-4fe7-95e8-3d75cf1a117c"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:17.770401 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-962d81e6-6096-4b44-a84d-af8b8e08c56a req-f7c85720-2155-4dc4-91b2-c2f8ed48e366 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:17.771720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-962d81e6-6096-4b44-a84d-af8b8e08c56a req-f7c85720-2155-4dc4-91b2-c2f8ed48e366 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:17.798733 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-962d81e6-6096-4b44-a84d-af8b8e08c56a req-f7c85720-2155-4dc4-91b2-c2f8ed48e366 service nova] Creating event network-changed:b929d3d3-f845-4f8f-865c-6906eddc5cf3 for instance 51ac7d82-f95f-41a6-82e5-43c1c0138977 on n-h1-master-1 Jul 31 01:13:17.818120 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-962d81e6-6096-4b44-a84d-af8b8e08c56a req-f7c85720-2155-4dc4-91b2-c2f8ed48e366 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127174 Jul 31 01:13:17.822674 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 788/1609] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:17.845131 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8482d077-1f58-4810-82fb-8abe4fa3d32b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:17.849048 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8482d077-1f58-4810-82fb-8abe4fa3d32b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:17.917565 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8482d077-1f58-4810-82fb-8abe4fa3d32b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:17.922398 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8482d077-1f58-4810-82fb-8abe4fa3d32b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:17.927693 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8482d077-1f58-4810-82fb-8abe4fa3d32b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:17.929445 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8482d077-1f58-4810-82fb-8abe4fa3d32b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:18.019648 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-97be8ac8-f018-446f-b684-07cf07f3e4f6 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] validate_networks() for [('6cd001ed-9f19-4fe7-95e8-3d75cf1a117c', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:13:19.995367 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8482d077-1f58-4810-82fb-8abe4fa3d32b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:20.004671 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8482d077-1f58-4810-82fb-8abe4fa3d32b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:20.016500 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8482d077-1f58-4810-82fb-8abe4fa3d32b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:20.020336 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8482d077-1f58-4810-82fb-8abe4fa3d32b tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1281 microversion: 2.25 time: 2.195432 Jul 31 01:13:20.031494 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 789/1610] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:17 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1281 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:20.037284 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ba85c296-859c-4635-9954-0370775adc8c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa09430>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:20.179016 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ba85c296-859c-4635-9954-0370775adc8c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1411 microversion: 2.1 time: 0.144455 Jul 31 01:13:20.180163 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 790/1611] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:13:20 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1411 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:20.196088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bfc8e969-59e3-4eff-b4be-c81927bb80c9 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:20.197602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bfc8e969-59e3-4eff-b4be-c81927bb80c9 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:20.210522 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=40 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:20.220888 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfc8e969-59e3-4eff-b4be-c81927bb80c9 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:20.222093 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfc8e969-59e3-4eff-b4be-c81927bb80c9 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:20.223678 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfc8e969-59e3-4eff-b4be-c81927bb80c9 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:20.225216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfc8e969-59e3-4eff-b4be-c81927bb80c9 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:20.972397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-97be8ac8-f018-446f-b684-07cf07f3e4f6 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:13:20.972940 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-97be8ac8-f018-446f-b684-07cf07f3e4f6 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:13:20.973321 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-97be8ac8-f018-446f-b684-07cf07f3e4f6 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:13:20.973746 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-97be8ac8-f018-446f-b684-07cf07f3e4f6 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:13:20.974170 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-97be8ac8-f018-446f-b684-07cf07f3e4f6 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:13:21.007096 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97be8ac8-f018-446f-b684-07cf07f3e4f6 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:21.007601 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97be8ac8-f018-446f-b684-07cf07f3e4f6 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:21.008429 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97be8ac8-f018-446f-b684-07cf07f3e4f6 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:21.008884 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97be8ac8-f018-446f-b684-07cf07f3e4f6 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:21.055997 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=61 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:21.075028 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bfc8e969-59e3-4eff-b4be-c81927bb80c9 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:21.087843 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bfc8e969-59e3-4eff-b4be-c81927bb80c9 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1323 microversion: 2.1 time: 0.906348 Jul 31 01:13:21.093871 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-97be8ac8-f018-446f-b684-07cf07f3e4f6 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Getting quotas for project 03431dbca9a24393bbfb2f51bfcff27e. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:13:21.099761 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 791/1612] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:20 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1323 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:21.122163 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-97be8ac8-f018-446f-b684-07cf07f3e4f6 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Getting quotas for user 755582e730334e69bb29408920a6625e and project 03431dbca9a24393bbfb2f51bfcff27e. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:13:21.132937 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7ff952ac-e7a2-4f53-83fd-40c769fa6b09 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:21.133571 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7ff952ac-e7a2-4f53-83fd-40c769fa6b09 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:21.167701 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ff952ac-e7a2-4f53-83fd-40c769fa6b09 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:21.167940 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-97be8ac8-f018-446f-b684-07cf07f3e4f6 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:13:21.171913 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ff952ac-e7a2-4f53-83fd-40c769fa6b09 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:21.172691 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-97be8ac8-f018-446f-b684-07cf07f3e4f6 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:13:21.173203 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ff952ac-e7a2-4f53-83fd-40c769fa6b09 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:21.173665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ff952ac-e7a2-4f53-83fd-40c769fa6b09 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:21.342247 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-97be8ac8-f018-446f-b684-07cf07f3e4f6 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.158468 Jul 31 01:13:21.355572 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 822/1613] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:13:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 4173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:13:21.363993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8665b5c1-ae2b-4703-92f4-1b4a776966a6 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa693a0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:21.592022 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8665b5c1-ae2b-4703-92f4-1b4a776966a6 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1411 microversion: 2.1 time: 0.235065 Jul 31 01:13:21.598071 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 823/1614] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:13:21 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1411 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:21.611891 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b3149540-0acc-4d80-9bd0-bb46d5caea7d tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:21.612535 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b3149540-0acc-4d80-9bd0-bb46d5caea7d tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:21.824049 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b3149540-0acc-4d80-9bd0-bb46d5caea7d tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755582e730334e69bb29408920a6625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431dbca9a24393bbfb2f51bfcff27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:21.831637 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b3149540-0acc-4d80-9bd0-bb46d5caea7d tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 200 len: 1225 microversion: 2.1 time: 0.232187 Jul 31 01:13:21.842724 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 824/1615] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:21 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 1225 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:22.117362 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-027cfcc3-4a3e-4e75-a7bb-673988841ed4 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:22.118899 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-027cfcc3-4a3e-4e75-a7bb-673988841ed4 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:22.145151 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-027cfcc3-4a3e-4e75-a7bb-673988841ed4 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:22.153773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-027cfcc3-4a3e-4e75-a7bb-673988841ed4 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:22.158741 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-027cfcc3-4a3e-4e75-a7bb-673988841ed4 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:22.171935 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-027cfcc3-4a3e-4e75-a7bb-673988841ed4 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:22.418778 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7ff952ac-e7a2-4f53-83fd-40c769fa6b09 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:22.438974 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7ff952ac-e7a2-4f53-83fd-40c769fa6b09 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:22.446402 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7ff952ac-e7a2-4f53-83fd-40c769fa6b09 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:22.453191 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7ff952ac-e7a2-4f53-83fd-40c769fa6b09 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1477 microversion: 2.25 time: 1.332181 Jul 31 01:13:22.473720 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 792/1616] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:21 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1477 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:22.757944 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b9128bf7-9d61-4344-99f7-eab35e5c8161 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:22.759258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b9128bf7-9d61-4344-99f7-eab35e5c8161 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:22.774038 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9128bf7-9d61-4344-99f7-eab35e5c8161 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:22.774563 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9128bf7-9d61-4344-99f7-eab35e5c8161 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:22.777797 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9128bf7-9d61-4344-99f7-eab35e5c8161 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:22.778277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9128bf7-9d61-4344-99f7-eab35e5c8161 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:23.404595 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-027cfcc3-4a3e-4e75-a7bb-673988841ed4 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:23.423656 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-027cfcc3-4a3e-4e75-a7bb-673988841ed4 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1323 microversion: 2.1 time: 1.306839 Jul 31 01:13:23.425750 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 825/1617] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:22 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1323 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:23.440742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1fbdceb8-dca7-43bd-8ecb-7af8bbde978c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaaa5280>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:23.547940 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1fbdceb8-dca7-43bd-8ecb-7af8bbde978c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1411 microversion: 2.1 time: 0.119672 Jul 31 01:13:23.548965 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 826/1618] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:13:23 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1411 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:23.564964 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-be47fd25-d18f-4334-af43-e0b649967e67 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:23.578267 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-be47fd25-d18f-4334-af43-e0b649967e67 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:23.615910 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be47fd25-d18f-4334-af43-e0b649967e67 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:23.619457 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be47fd25-d18f-4334-af43-e0b649967e67 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:23.624628 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be47fd25-d18f-4334-af43-e0b649967e67 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:23.629720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be47fd25-d18f-4334-af43-e0b649967e67 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:23.685096 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-b9128bf7-9d61-4344-99f7-eab35e5c8161 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'services' on Instance uuid b17392cf-3f17-483a-89cb-0d7bb436bca7 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:13:23.749941 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b9128bf7-9d61-4344-99f7-eab35e5c8161 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1970 microversion: 2.25 time: 1.270506 Jul 31 01:13:23.756143 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 793/1619] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:22 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1970 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:23.791198 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fbbebd74-27d8-4aef-8bff-b4b42aec5766 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:23.794688 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fbbebd74-27d8-4aef-8bff-b4b42aec5766 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:23.814566 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbbebd74-27d8-4aef-8bff-b4b42aec5766 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:23.822619 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbbebd74-27d8-4aef-8bff-b4b42aec5766 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:23.825072 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbbebd74-27d8-4aef-8bff-b4b42aec5766 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:23.831886 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbbebd74-27d8-4aef-8bff-b4b42aec5766 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:24.266633 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-be47fd25-d18f-4334-af43-e0b649967e67 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755582e730334e69bb29408920a6625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431dbca9a24393bbfb2f51bfcff27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:24.315433 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-be47fd25-d18f-4334-af43-e0b649967e67 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 200 len: 1277 microversion: 2.1 time: 0.753263 Jul 31 01:13:24.330116 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 827/1620] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:23 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 1277 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:24.456560 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e0a98088-de3f-448f-8711-791924e8c0cb tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:24.458078 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e0a98088-de3f-448f-8711-791924e8c0cb tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:24.475555 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e0a98088-de3f-448f-8711-791924e8c0cb tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:24.477685 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e0a98088-de3f-448f-8711-791924e8c0cb tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:24.485782 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e0a98088-de3f-448f-8711-791924e8c0cb tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:24.487043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e0a98088-de3f-448f-8711-791924e8c0cb tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:25.201825 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-fbbebd74-27d8-4aef-8bff-b4b42aec5766 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'services' on Instance uuid b17392cf-3f17-483a-89cb-0d7bb436bca7 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:13:25.242798 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fbbebd74-27d8-4aef-8bff-b4b42aec5766 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1970 microversion: 2.25 time: 1.462855 Jul 31 01:13:25.250888 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 794/1621] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:23 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1970 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:25.269300 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-17c73756-ef98-4820-8f7c-e4a96e499eaf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede60fba60>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:25.446897 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-17c73756-ef98-4820-8f7c-e4a96e499eaf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1411 microversion: 2.1 time: 0.187547 Jul 31 01:13:25.462338 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 795/1622] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:13:25 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1411 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:25.473852 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-47f08c7c-9f04-4e06-beeb-506d49afea39 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:25.483107 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:13:25.483107 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:13:25.490074 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47f08c7c-9f04-4e06-beeb-506d49afea39 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:25.490835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47f08c7c-9f04-4e06-beeb-506d49afea39 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:25.492786 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47f08c7c-9f04-4e06-beeb-506d49afea39 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:25.493718 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47f08c7c-9f04-4e06-beeb-506d49afea39 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:25.537112 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-47f08c7c-9f04-4e06-beeb-506d49afea39 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.069053 Jul 31 01:13:25.538323 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 796/1623] 10.222.0.45 () {60 vars in 1217 bytes} [Sun Jul 31 01:13:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:13:25.543261 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b90c4996-d2cf-4103-97ec-76d95ef951e2 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:25.544230 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b90c4996-d2cf-4103-97ec-76d95ef951e2 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:25.578871 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b90c4996-d2cf-4103-97ec-76d95ef951e2 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:25.580109 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b90c4996-d2cf-4103-97ec-76d95ef951e2 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:25.581139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b90c4996-d2cf-4103-97ec-76d95ef951e2 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:25.583210 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b90c4996-d2cf-4103-97ec-76d95ef951e2 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:25.958864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b90c4996-d2cf-4103-97ec-76d95ef951e2 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755582e730334e69bb29408920a6625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431dbca9a24393bbfb2f51bfcff27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:25.980881 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b90c4996-d2cf-4103-97ec-76d95ef951e2 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 200 len: 1283 microversion: 2.1 time: 0.441113 Jul 31 01:13:25.986652 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 797/1624] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:25 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 1283 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:26.005530 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0492e2aa-3751-4ed4-83f0-82e8bd0a9167 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:26.028996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0492e2aa-3751-4ed4-83f0-82e8bd0a9167 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:26.045878 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0492e2aa-3751-4ed4-83f0-82e8bd0a9167 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:26.050655 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0492e2aa-3751-4ed4-83f0-82e8bd0a9167 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:26.052364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0492e2aa-3751-4ed4-83f0-82e8bd0a9167 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:26.054407 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0492e2aa-3751-4ed4-83f0-82e8bd0a9167 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:26.164435 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-0492e2aa-3751-4ed4-83f0-82e8bd0a9167 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'flavor' on Instance uuid b17392cf-3f17-483a-89cb-0d7bb436bca7 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:13:26.198259 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0492e2aa-3751-4ed4-83f0-82e8bd0a9167 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Going to try to live migrate instance to n-h1-master-1 {{(pid=119474) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 31 01:13:26.423624 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:26.431209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e0a98088-de3f-448f-8711-791924e8c0cb tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:26.458092 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e0a98088-de3f-448f-8711-791924e8c0cb tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1323 microversion: 2.1 time: 2.015575 Jul 31 01:13:26.459011 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 828/1625] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:24 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1323 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:26.490192 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7544ffd3-c28c-48aa-bf85-255ea26b021c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa908b0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:26.616303 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7544ffd3-c28c-48aa-bf85-255ea26b021c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1411 microversion: 2.1 time: 0.142517 Jul 31 01:13:26.617141 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 829/1626] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:13:26 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1411 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:27.009212 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1187197b-17e1-45ff-80ce-b0f174e9ed99 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:27.009829 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1187197b-17e1-45ff-80ce-b0f174e9ed99 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:27.030672 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1187197b-17e1-45ff-80ce-b0f174e9ed99 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:27.031230 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1187197b-17e1-45ff-80ce-b0f174e9ed99 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:27.031980 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1187197b-17e1-45ff-80ce-b0f174e9ed99 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:27.032422 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1187197b-17e1-45ff-80ce-b0f174e9ed99 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:28.395710 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1187197b-17e1-45ff-80ce-b0f174e9ed99 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755582e730334e69bb29408920a6625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431dbca9a24393bbfb2f51bfcff27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:28.421188 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1187197b-17e1-45ff-80ce-b0f174e9ed99 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 200 len: 1283 microversion: 2.1 time: 1.400536 Jul 31 01:13:28.421880 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 830/1627] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:27 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 1283 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:13:28.442940 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-af800046-c3c4-4d5a-a90e-0f8a222dc1f0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:28.450785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-af800046-c3c4-4d5a-a90e-0f8a222dc1f0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:28.468367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af800046-c3c4-4d5a-a90e-0f8a222dc1f0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:28.469083 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af800046-c3c4-4d5a-a90e-0f8a222dc1f0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:28.470204 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af800046-c3c4-4d5a-a90e-0f8a222dc1f0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:28.471224 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af800046-c3c4-4d5a-a90e-0f8a222dc1f0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:29.615399 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-af800046-c3c4-4d5a-a90e-0f8a222dc1f0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:29.626383 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-af800046-c3c4-4d5a-a90e-0f8a222dc1f0 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1323 microversion: 2.1 time: 1.202050 Jul 31 01:13:29.631960 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 831/1628] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:28 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1323 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:29.669200 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-caec2642-7591-47d4-b03b-58d622ee18b8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa69d30>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:29.837754 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0492e2aa-3751-4ed4-83f0-82e8bd0a9167 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7/action" status: 202 len: 0 microversion: 2.25 time: 3.849452 Jul 31 01:13:29.839424 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 798/1629] 10.222.0.45 () {62 vars in 1319 bytes} [Sun Jul 31 01:13:25 2022] POST /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7/action => generated 0 bytes in 3852 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:13:29.875431 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-caec2642-7591-47d4-b03b-58d622ee18b8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1411 microversion: 2.1 time: 0.237109 Jul 31 01:13:29.933700 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 832/1630] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:13:29 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1411 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:29.941359 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d5628a1e-b1e9-4139-9812-c6be61329adc tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:29.962072 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d5628a1e-b1e9-4139-9812-c6be61329adc tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:29.992591 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5628a1e-b1e9-4139-9812-c6be61329adc tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:29.996423 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5628a1e-b1e9-4139-9812-c6be61329adc tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:30.008453 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5628a1e-b1e9-4139-9812-c6be61329adc tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:30.009169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5628a1e-b1e9-4139-9812-c6be61329adc tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:30.189526 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3a698d79-c3da-4e33-836d-ad8b04cd094e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Action: 'create', calling method: .version_select at 0x7fede5a5af70>, body: {"keypair": {"name": "tempest-keypair-1599966760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiFbF7oysUX732jTp7ek6nfWzXb9Br21Dabph/skc8gAgHfqJZZ3/t/1/31CBg/B/x74MDA10mWWzIgWHwTD4I0biDidirN6nEn5tlCZEQTivSpEQ71mFrceztmP8S90g=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:30.264067 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-3a698d79-c3da-4e33-836d-ad8b04cd094e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Getting quotas for project 47b342e518054a56b42112c5dec71b2f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:13:30.287092 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-3a698d79-c3da-4e33-836d-ad8b04cd094e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Getting quotas for user 6e5532c17656432182ae9da0d1e2ad67 and project 47b342e518054a56b42112c5dec71b2f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:13:30.402760 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3a698d79-c3da-4e33-836d-ad8b04cd094e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.561903 Jul 31 01:13:30.407960 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 799/1631] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:13:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:30.457333 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2a17b54c-8ed2-4a4f-9e5f-870164223101 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:30.461008 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2a17b54c-8ed2-4a4f-9e5f-870164223101 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:30.488839 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2a17b54c-8ed2-4a4f-9e5f-870164223101 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:30.489743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2a17b54c-8ed2-4a4f-9e5f-870164223101 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:30.494056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2a17b54c-8ed2-4a4f-9e5f-870164223101 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:30.496777 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2a17b54c-8ed2-4a4f-9e5f-870164223101 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:30.577507 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d5628a1e-b1e9-4139-9812-c6be61329adc tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755582e730334e69bb29408920a6625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431dbca9a24393bbfb2f51bfcff27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:30.601774 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d5628a1e-b1e9-4139-9812-c6be61329adc tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 200 len: 1325 microversion: 2.1 time: 0.664927 Jul 31 01:13:30.602728 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 833/1632] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:29 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 1325 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:30.616463 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2b320098-a64d-4ed3-b0c9-30ab14a1afdb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-855260558", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "3d6735cc-8aac-4616-9429-654d8dcd9adc"}], "block_device_mapping_v2": [{"uuid": "193a5c35-bfbd-450b-be06-28e5f16aa6cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:30.789546 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-2b320098-a64d-4ed3-b0c9-30ab14a1afdb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] validate_networks() for [('3d6735cc-8aac-4616-9429-654d8dcd9adc', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:13:31.057994 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:31.832782 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:32.796238 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2a17b54c-8ed2-4a4f-9e5f-870164223101 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:32.817244 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2a17b54c-8ed2-4a4f-9e5f-870164223101 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:32.832690 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2a17b54c-8ed2-4a4f-9e5f-870164223101 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:32.835361 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2a17b54c-8ed2-4a4f-9e5f-870164223101 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 2.425921 Jul 31 01:13:32.839728 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 800/1633] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:30 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 2431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:33.069214 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-42914e09-a48c-4815-92cd-f98f8a865ec0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-185903822", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "2153d85e-1939-47c1-8fb1-19b0a027c59d"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:33.267572 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-42914e09-a48c-4815-92cd-f98f8a865ec0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] validate_networks() for [('2153d85e-1939-47c1-8fb1-19b0a027c59d', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:13:34.599464 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-2b320098-a64d-4ed3-b0c9-30ab14a1afdb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:13:34.600139 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-2b320098-a64d-4ed3-b0c9-30ab14a1afdb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:13:34.600801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-2b320098-a64d-4ed3-b0c9-30ab14a1afdb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:13:34.601053 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-2b320098-a64d-4ed3-b0c9-30ab14a1afdb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:13:34.601508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-2b320098-a64d-4ed3-b0c9-30ab14a1afdb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:13:34.621349 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b320098-a64d-4ed3-b0c9-30ab14a1afdb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:34.621809 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b320098-a64d-4ed3-b0c9-30ab14a1afdb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:34.623237 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b320098-a64d-4ed3-b0c9-30ab14a1afdb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:34.623864 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b320098-a64d-4ed3-b0c9-30ab14a1afdb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:34.660586 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-2b320098-a64d-4ed3-b0c9-30ab14a1afdb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Getting quotas for project 5d8b0e81765c48039a523271670896d2. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:13:34.677445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-2b320098-a64d-4ed3-b0c9-30ab14a1afdb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Getting quotas for user 457bd8590d5040ef95854808b51c04d3 and project 5d8b0e81765c48039a523271670896d2. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:13:34.817337 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2b320098-a64d-4ed3-b0c9-30ab14a1afdb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:13:34.819908 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2b320098-a64d-4ed3-b0c9-30ab14a1afdb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='193a5c35-bfbd-450b-be06-28e5f16aa6cd',volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:13:35.236038 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2b320098-a64d-4ed3-b0c9-30ab14a1afdb tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.631245 Jul 31 01:13:35.246509 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 834/1634] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:13:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 4643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:13:35.254762 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-864cb663-15e5-41d9-bd6d-8a71c21aa69f tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:35.255425 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-864cb663-15e5-41d9-bd6d-8a71c21aa69f tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:35.296294 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-864cb663-15e5-41d9-bd6d-8a71c21aa69f tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:35.308623 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-864cb663-15e5-41d9-bd6d-8a71c21aa69f tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:35.309952 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-864cb663-15e5-41d9-bd6d-8a71c21aa69f tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:35.313872 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-864cb663-15e5-41d9-bd6d-8a71c21aa69f tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:35.509713 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:36.296545 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-42914e09-a48c-4815-92cd-f98f8a865ec0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:13:36.296965 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-42914e09-a48c-4815-92cd-f98f8a865ec0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:13:36.297442 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-42914e09-a48c-4815-92cd-f98f8a865ec0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:13:36.297852 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-42914e09-a48c-4815-92cd-f98f8a865ec0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:13:36.298216 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-864cb663-15e5-41d9-bd6d-8a71c21aa69f tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:36.298743 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-42914e09-a48c-4815-92cd-f98f8a865ec0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:13:36.328959 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42914e09-a48c-4815-92cd-f98f8a865ec0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:36.329459 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42914e09-a48c-4815-92cd-f98f8a865ec0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:36.330425 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42914e09-a48c-4815-92cd-f98f8a865ec0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:36.330869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42914e09-a48c-4815-92cd-f98f8a865ec0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:36.343879 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-864cb663-15e5-41d9-bd6d-8a71c21aa69f tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1323 microversion: 2.1 time: 1.091816 Jul 31 01:13:36.361681 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 835/1635] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:35 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1323 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:36.394190 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-da92fb6a-d763-4033-811d-bce0dc3a7b63 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede52a7700>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:36.438656 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-42914e09-a48c-4815-92cd-f98f8a865ec0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Getting quotas for project e07e3d3b4692403b9156329206bef6a2. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:13:36.455470 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-42914e09-a48c-4815-92cd-f98f8a865ec0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Getting quotas for user 6e69fe8a1e9446ed90f0f5115271eeab and project e07e3d3b4692403b9156329206bef6a2. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:13:36.490900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-42914e09-a48c-4815-92cd-f98f8a865ec0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:13:36.493462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-42914e09-a48c-4815-92cd-f98f8a865ec0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:13:36.504867 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-da92fb6a-d763-4033-811d-bce0dc3a7b63 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1420 microversion: 2.1 time: 0.137993 Jul 31 01:13:36.508845 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 836/1636] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:13:36 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:36.532642 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c699786f-2ff9-4bb3-826f-da7c271b59fa tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:36.536325 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c699786f-2ff9-4bb3-826f-da7c271b59fa tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:36.556984 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c699786f-2ff9-4bb3-826f-da7c271b59fa tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:36.558841 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c699786f-2ff9-4bb3-826f-da7c271b59fa tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:36.564058 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c699786f-2ff9-4bb3-826f-da7c271b59fa tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:36.565556 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c699786f-2ff9-4bb3-826f-da7c271b59fa tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:36.668179 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-42914e09-a48c-4815-92cd-f98f8a865ec0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.826821 Jul 31 01:13:36.669875 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 801/1637] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:13:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:13:36.678304 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e1e9d9ea-d006-4ac4-b568-cdbfe2b9dae4 req-e086e809-e9f1-4be6-8050-601098ada815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ac7d82-f95f-41a6-82e5-43c1c0138977", "name": "network-vif-plugged", "status": "completed", "tag": "b929d3d3-f845-4f8f-865c-6906eddc5cf3"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:36.704567 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e1e9d9ea-d006-4ac4-b568-cdbfe2b9dae4 req-e086e809-e9f1-4be6-8050-601098ada815 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:36.705761 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e1e9d9ea-d006-4ac4-b568-cdbfe2b9dae4 req-e086e809-e9f1-4be6-8050-601098ada815 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:36.751593 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e1e9d9ea-d006-4ac4-b568-cdbfe2b9dae4 req-e086e809-e9f1-4be6-8050-601098ada815 service nova] Creating event network-vif-plugged:b929d3d3-f845-4f8f-865c-6906eddc5cf3 for instance 51ac7d82-f95f-41a6-82e5-43c1c0138977 on n-h1-master-1 Jul 31 01:13:36.768887 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e1e9d9ea-d006-4ac4-b568-cdbfe2b9dae4 req-e086e809-e9f1-4be6-8050-601098ada815 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095845 Jul 31 01:13:36.772115 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 802/1638] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:36.791179 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8bfb241d-1a37-4058-8005-c64410c1c0f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:36.792319 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8bfb241d-1a37-4058-8005-c64410c1c0f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:36.804744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8bfb241d-1a37-4058-8005-c64410c1c0f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:36.805639 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8bfb241d-1a37-4058-8005-c64410c1c0f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:36.806824 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8bfb241d-1a37-4058-8005-c64410c1c0f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:36.807592 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8bfb241d-1a37-4058-8005-c64410c1c0f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:37.608367 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c699786f-2ff9-4bb3-826f-da7c271b59fa tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755582e730334e69bb29408920a6625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431dbca9a24393bbfb2f51bfcff27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:37.624171 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c699786f-2ff9-4bb3-826f-da7c271b59fa tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 200 len: 1325 microversion: 2.1 time: 1.112833 Jul 31 01:13:37.625407 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 837/1639] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:36 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 1325 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:37.634513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ae7313d-d00e-47ea-9bb4-2610d4185928 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1213351098", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "c4c7fd9f-1e9b-4ab4-be31-a5f8230a84b8"}], "security_groups": [{"name": "tempest-securitygroup--646725521"}], "key_name": "tempest-keypair-1599966760", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:37.754532 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8bfb241d-1a37-4058-8005-c64410c1c0f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:37.789184 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8bfb241d-1a37-4058-8005-c64410c1c0f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:37.790921 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8bfb241d-1a37-4058-8005-c64410c1c0f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:37.792289 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8bfb241d-1a37-4058-8005-c64410c1c0f2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 1.017933 Jul 31 01:13:37.792872 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 803/1640] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:36 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:37.837905 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-77d20f0d-c225-4971-baa0-355396f73263 req-281aecbd-bbe8-4537-9563-502dffe385ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c39424d9-338d-407b-822f-2ed61e7c0c65", "tag": "67f63173-236d-4edb-a5e5-e7680a8bb262"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:37.882488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-77d20f0d-c225-4971-baa0-355396f73263 req-281aecbd-bbe8-4537-9563-502dffe385ef service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:37.883485 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-77d20f0d-c225-4971-baa0-355396f73263 req-281aecbd-bbe8-4537-9563-502dffe385ef service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:37.903208 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-77d20f0d-c225-4971-baa0-355396f73263 req-281aecbd-bbe8-4537-9563-502dffe385ef service nova] Creating event network-changed:67f63173-236d-4edb-a5e5-e7680a8bb262 for instance c39424d9-338d-407b-822f-2ed61e7c0c65 on n-h1-master-1 Jul 31 01:13:37.910612 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-77d20f0d-c225-4971-baa0-355396f73263 req-281aecbd-bbe8-4537-9563-502dffe385ef service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099689 Jul 31 01:13:37.911951 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 804/1641] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:37.919606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-03c39687-2f84-4db3-b5d9-812a6ed9e1e8 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:37.920643 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-03c39687-2f84-4db3-b5d9-812a6ed9e1e8 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:37.927993 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03c39687-2f84-4db3-b5d9-812a6ed9e1e8 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:37.928751 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03c39687-2f84-4db3-b5d9-812a6ed9e1e8 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:37.929712 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03c39687-2f84-4db3-b5d9-812a6ed9e1e8 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:37.930373 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03c39687-2f84-4db3-b5d9-812a6ed9e1e8 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:38.089685 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-03c39687-2f84-4db3-b5d9-812a6ed9e1e8 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:38.105790 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-03c39687-2f84-4db3-b5d9-812a6ed9e1e8 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1168 microversion: 2.1 time: 0.192204 Jul 31 01:13:38.115729 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 805/1642] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:37 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1168 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:38.137895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5576baab-16e4-4e87-bbcf-a5f0d986193c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede59a7b80>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:38.240526 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5576baab-16e4-4e87-bbcf-a5f0d986193c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 200 len: 1420 microversion: 2.1 time: 0.113239 Jul 31 01:13:38.241582 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 806/1643] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:13:38 2022] GET /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:38.264708 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-90ecd5e9-e104-41f8-b724-3edf00ebbe61 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:38.265666 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-90ecd5e9-e104-41f8-b724-3edf00ebbe61 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:38.273253 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90ecd5e9-e104-41f8-b724-3edf00ebbe61 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:38.277649 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90ecd5e9-e104-41f8-b724-3edf00ebbe61 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:38.278903 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90ecd5e9-e104-41f8-b724-3edf00ebbe61 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:38.279649 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90ecd5e9-e104-41f8-b724-3edf00ebbe61 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:38.289273 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-4ae7313d-d00e-47ea-9bb4-2610d4185928 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] validate_networks() for [('c4c7fd9f-1e9b-4ab4-be31-a5f8230a84b8', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:13:38.754669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-90ecd5e9-e104-41f8-b724-3edf00ebbe61 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:38.774634 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-90ecd5e9-e104-41f8-b724-3edf00ebbe61 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1220 microversion: 2.1 time: 0.527776 Jul 31 01:13:38.775192 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 807/1644] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:38 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1220 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:38.800433 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-24ef97c9-80e3-4d1b-8e1f-3c0041049175 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:38.808312 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-24ef97c9-80e3-4d1b-8e1f-3c0041049175 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:38.846879 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-24ef97c9-80e3-4d1b-8e1f-3c0041049175 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:38.848748 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-24ef97c9-80e3-4d1b-8e1f-3c0041049175 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:38.850604 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-24ef97c9-80e3-4d1b-8e1f-3c0041049175 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:38.851859 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-24ef97c9-80e3-4d1b-8e1f-3c0041049175 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:39.636606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-24ef97c9-80e3-4d1b-8e1f-3c0041049175 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:39.651977 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-24ef97c9-80e3-4d1b-8e1f-3c0041049175 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1323 microversion: 2.1 time: 0.873131 Jul 31 01:13:39.658512 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 808/1645] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:38 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1323 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:39.664180 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7910817d-b689-4738-8888-79c261388ba1 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede561aca0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:39.734335 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4ae7313d-d00e-47ea-9bb4-2610d4185928 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:13:39.734827 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4ae7313d-d00e-47ea-9bb4-2610d4185928 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:13:39.735242 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4ae7313d-d00e-47ea-9bb4-2610d4185928 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:13:39.736002 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4ae7313d-d00e-47ea-9bb4-2610d4185928 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:13:39.736437 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4ae7313d-d00e-47ea-9bb4-2610d4185928 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:13:39.756880 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ae7313d-d00e-47ea-9bb4-2610d4185928 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:39.758767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ae7313d-d00e-47ea-9bb4-2610d4185928 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:39.760945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ae7313d-d00e-47ea-9bb4-2610d4185928 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:39.761470 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ae7313d-d00e-47ea-9bb4-2610d4185928 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:39.812727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-4ae7313d-d00e-47ea-9bb4-2610d4185928 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Getting quotas for project 47b342e518054a56b42112c5dec71b2f. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:13:39.828603 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-4ae7313d-d00e-47ea-9bb4-2610d4185928 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Getting quotas for user 6e5532c17656432182ae9da0d1e2ad67 and project 47b342e518054a56b42112c5dec71b2f. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:13:39.852874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4ae7313d-d00e-47ea-9bb4-2610d4185928 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:13:39.857592 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4ae7313d-d00e-47ea-9bb4-2610d4185928 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:13:40.043371 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4ae7313d-d00e-47ea-9bb4-2610d4185928 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.416335 Jul 31 01:13:40.050614 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 838/1646] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:13:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 2424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:13:40.084517 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7cd5baf-d5ae-451a-8eff-e33097bce592 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:40.085278 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a7cd5baf-d5ae-451a-8eff-e33097bce592 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:40.099903 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7cd5baf-d5ae-451a-8eff-e33097bce592 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:40.100965 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7cd5baf-d5ae-451a-8eff-e33097bce592 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:40.124009 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7cd5baf-d5ae-451a-8eff-e33097bce592 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:40.125189 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7cd5baf-d5ae-451a-8eff-e33097bce592 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:40.617394 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7910817d-b689-4738-8888-79c261388ba1 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "DELETE /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 204 len: 0 microversion: 2.1 time: 0.957115 Jul 31 01:13:40.622204 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 809/1647] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:39 2022] DELETE /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 0 bytes in 959 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:13:40.629859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-58326875-ff73-4c61-9d9e-b805a18e6fa7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:40.630655 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-58326875-ff73-4c61-9d9e-b805a18e6fa7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:40.659113 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58326875-ff73-4c61-9d9e-b805a18e6fa7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:40.659823 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58326875-ff73-4c61-9d9e-b805a18e6fa7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:40.660750 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58326875-ff73-4c61-9d9e-b805a18e6fa7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:40.662720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58326875-ff73-4c61-9d9e-b805a18e6fa7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:41.724583 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a7cd5baf-d5ae-451a-8eff-e33097bce592 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755582e730334e69bb29408920a6625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431dbca9a24393bbfb2f51bfcff27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:41.740532 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a7cd5baf-d5ae-451a-8eff-e33097bce592 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 200 len: 1325 microversion: 2.1 time: 1.680984 Jul 31 01:13:41.756177 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 839/1648] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:40 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 1325 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:41.761543 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e2b02ac3-d7bb-4ec6-94fb-0b19c6390598 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:41.765340 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e2b02ac3-d7bb-4ec6-94fb-0b19c6390598 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:41.770130 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=9 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:41.785515 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e2b02ac3-d7bb-4ec6-94fb-0b19c6390598 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:41.786440 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e2b02ac3-d7bb-4ec6-94fb-0b19c6390598 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:41.787678 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e2b02ac3-d7bb-4ec6-94fb-0b19c6390598 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:41.788419 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e2b02ac3-d7bb-4ec6-94fb-0b19c6390598 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:41.853443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-58326875-ff73-4c61-9d9e-b805a18e6fa7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:41.864885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-58326875-ff73-4c61-9d9e-b805a18e6fa7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:41.866737 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-58326875-ff73-4c61-9d9e-b805a18e6fa7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:41.868214 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-58326875-ff73-4c61-9d9e-b805a18e6fa7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 1.243927 Jul 31 01:13:41.869476 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 810/1649] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:40 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:41.887416 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8ba1d39b-d0d8-46b5-912a-53a5ddca5f61 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:41.889632 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8ba1d39b-d0d8-46b5-912a-53a5ddca5f61 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:41.910414 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ba1d39b-d0d8-46b5-912a-53a5ddca5f61 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:41.911901 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ba1d39b-d0d8-46b5-912a-53a5ddca5f61 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:41.913109 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ba1d39b-d0d8-46b5-912a-53a5ddca5f61 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:41.913796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ba1d39b-d0d8-46b5-912a-53a5ddca5f61 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:42.130695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8ba1d39b-d0d8-46b5-912a-53a5ddca5f61 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:42.144118 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8ba1d39b-d0d8-46b5-912a-53a5ddca5f61 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1274 microversion: 2.1 time: 0.269356 Jul 31 01:13:42.145912 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 811/1650] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:41 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1274 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:42.151514 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-90125c46-2120-472d-a759-439c624d3ade tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:42.161914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-90125c46-2120-472d-a759-439c624d3ade tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:42.178295 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90125c46-2120-472d-a759-439c624d3ade tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:42.179784 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90125c46-2120-472d-a759-439c624d3ade tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:42.180878 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90125c46-2120-472d-a759-439c624d3ade tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:42.181638 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90125c46-2120-472d-a759-439c624d3ade tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:42.364845 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-90125c46-2120-472d-a759-439c624d3ade tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:42.379531 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-90125c46-2120-472d-a759-439c624d3ade tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72" status: 200 len: 1312 microversion: 2.1 time: 0.229334 Jul 31 01:13:42.381560 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 812/1651] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:42 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72 => generated 1312 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:42.396180 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-571a5a88-24be-4dc3-9902-22a0addbf837 req-8407f4f6-d2a7-4cc2-9d22-86bff4716ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c64a12-7c3e-41f9-91d1-b82820b3cd08", "tag": "34a0bfd7-254c-4a84-8f10-da931e137ce2"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:42.420021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e2b02ac3-d7bb-4ec6-94fb-0b19c6390598 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:42.434204 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-571a5a88-24be-4dc3-9902-22a0addbf837 req-8407f4f6-d2a7-4cc2-9d22-86bff4716ece service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:42.435828 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e2b02ac3-d7bb-4ec6-94fb-0b19c6390598 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1210 microversion: 2.1 time: 0.674971 Jul 31 01:13:42.436155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-571a5a88-24be-4dc3-9902-22a0addbf837 req-8407f4f6-d2a7-4cc2-9d22-86bff4716ece service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:42.450180 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 840/1652] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:41 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1210 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:42.458892 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4b1b087f-6e5c-4952-b3ff-637d62babc39 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:42.460536 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4b1b087f-6e5c-4952-b3ff-637d62babc39 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:42.469083 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-571a5a88-24be-4dc3-9902-22a0addbf837 req-8407f4f6-d2a7-4cc2-9d22-86bff4716ece service nova] Creating event network-changed:34a0bfd7-254c-4a84-8f10-da931e137ce2 for instance f7c64a12-7c3e-41f9-91d1-b82820b3cd08 on n-h2-master-1 Jul 31 01:13:42.480733 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b1b087f-6e5c-4952-b3ff-637d62babc39 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:42.481221 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b1b087f-6e5c-4952-b3ff-637d62babc39 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:42.488169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b1b087f-6e5c-4952-b3ff-637d62babc39 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:42.491839 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b1b087f-6e5c-4952-b3ff-637d62babc39 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:42.502314 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-571a5a88-24be-4dc3-9902-22a0addbf837 req-8407f4f6-d2a7-4cc2-9d22-86bff4716ece service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118397 Jul 31 01:13:42.512457 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 813/1653] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:42.527791 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-843bea7a-56d2-414f-b2eb-863ed38f4826 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:42.528054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4b1b087f-6e5c-4952-b3ff-637d62babc39 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:13:42.540853 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-843bea7a-56d2-414f-b2eb-863ed38f4826 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:42.580943 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-843bea7a-56d2-414f-b2eb-863ed38f4826 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:42.591363 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-843bea7a-56d2-414f-b2eb-863ed38f4826 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:42.595087 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-843bea7a-56d2-414f-b2eb-863ed38f4826 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:42.596049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-843bea7a-56d2-414f-b2eb-863ed38f4826 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:42.682292 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4b1b087f-6e5c-4952-b3ff-637d62babc39 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "DELETE /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 204 len: 0 microversion: 2.1 time: 0.228146 Jul 31 01:13:42.689780 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 841/1654] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:13:42 2022] DELETE /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:13:42.703260 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-dd9d47b7-9912-4a46-858c-123af4c02cb1 req-51c8033a-3b8b-4f6a-b205-4b2e77302431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37302988-1cb9-4dca-a5a5-93ff2a30316b", "name": "network-vif-unplugged", "status": "completed", "tag": "8e0167ab-8d69-4a27-8750-640d68a6c8e5"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:42.734648 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-dd9d47b7-9912-4a46-858c-123af4c02cb1 req-51c8033a-3b8b-4f6a-b205-4b2e77302431 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:42.736013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-dd9d47b7-9912-4a46-858c-123af4c02cb1 req-51c8033a-3b8b-4f6a-b205-4b2e77302431 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:42.769315 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-dd9d47b7-9912-4a46-858c-123af4c02cb1 req-51c8033a-3b8b-4f6a-b205-4b2e77302431 service nova] Creating event network-vif-unplugged:8e0167ab-8d69-4a27-8750-640d68a6c8e5 for instance 37302988-1cb9-4dca-a5a5-93ff2a30316b on n-h1-master-1 Jul 31 01:13:42.776723 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-dd9d47b7-9912-4a46-858c-123af4c02cb1 req-51c8033a-3b8b-4f6a-b205-4b2e77302431 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084671 Jul 31 01:13:42.779651 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 842/1655] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:42.915192 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-636260e0-5263-46dc-b53e-9c9e77871c57 tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Calling method '.version_select at 0x7fede51ef430>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:43.121347 n-d-master-1 devstack@n-api.service[119475]: DEBUG neutronclient.v2_0.client [None req-636260e0-5263-46dc-b53e-9c9e77871c57 tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aa1b2d7e-105b-4deb-b91a-339951e3ff51 does not exist", "detail": ""}} {{(pid=119475) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:13:43.122109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.security_group_api [None req-636260e0-5263-46dc-b53e-9c9e77871c57 tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Neutron security group aa1b2d7e-105b-4deb-b91a-339951e3ff51 not found {{(pid=119475) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 31 01:13:43.122782 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-636260e0-5263-46dc-b53e-9c9e77871c57 tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] HTTP exception thrown: Security group aa1b2d7e-105b-4deb-b91a-339951e3ff51 does not exist Jul 31 01:13:43.122782 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-e6d8574a-a160-40c3-873e-8cdb5855cf4d'] Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-636260e0-5263-46dc-b53e-9c9e77871c57 tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Request method failure captured: Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/os-security-groups/aa1b2d7e-105b-4deb-b91a-339951e3ff51 HTTP/1.1 Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5ddGibIwMHbQfwcX9UWbCzhkBDxSXqw_tuG87zc1xmShL-zEiERzNefmPJc_37dnjUI_vCR4vsR_AGod3LQUBJHEw0ST3zEvTqBUwpbgpJ8DxwliDG_kJAQxv8iuDS2gG3iNC7Mp1iuoe-T5cf0ed5_OcRP11elsRNs6-97N2USelcA Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a1c5b0d919ae4b0aa08a3f674323cb86 Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2136851451 Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1c5b0d919ae4b0aa08a3f674323cb86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1c5b0d919ae4b0aa08a3f674323cb86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1c5b0d919ae4b0aa08a3f674323cb86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1c5b0d919ae4b0aa08a3f674323cb86", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2136851451 Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a1c5b0d919ae4b0aa08a3f674323cb86 Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2136851451 Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-SecurityGroupsNegativeTestJSON-2136851451-project Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 5d549a6c831a45c6916aec8897f1d877 Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2136851451-project Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: exception: Security group aa1b2d7e-105b-4deb-b91a-339951e3ff51 does not exist Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-e6d8574a-a160-40c3-873e-8cdb5855cf4d'] Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'aa1b2d7e-105b-4deb-b91a-339951e3ff51'} Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:13:43.125411 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aa1b2d7e-105b-4deb-b91a-339951e3ff51 does not exist Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6d8574a-a160-40c3-873e-8cdb5855cf4d'] Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aa1b2d7e-105b-4deb-b91a-339951e3ff51 does not exist Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6d8574a-a160-40c3-873e-8cdb5855cf4d'] Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aa1b2d7e-105b-4deb-b91a-339951e3ff51 does not exist Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6d8574a-a160-40c3-873e-8cdb5855cf4d'] Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aa1b2d7e-105b-4deb-b91a-339951e3ff51 does not exist Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6d8574a-a160-40c3-873e-8cdb5855cf4d'] Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-636260e0-5263-46dc-b53e-9c9e77871c57 tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Returning 404 to user: Security group aa1b2d7e-105b-4deb-b91a-339951e3ff51 does not exist Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-e6d8574a-a160-40c3-873e-8cdb5855cf4d'] {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:13:43.132267 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-636260e0-5263-46dc-b53e-9c9e77871c57 tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/aa1b2d7e-105b-4deb-b91a-339951e3ff51" status: 404 len: 194 microversion: 2.1 time: 0.348062 Jul 31 01:13:43.139901 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 843/1656] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:13:42 2022] DELETE /compute/v2.1/os-security-groups/aa1b2d7e-105b-4deb-b91a-339951e3ff51 => generated 194 bytes in 351 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:13:43.149238 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-20d5a79e-58a3-4f8e-8275-fc6acaa2becd tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:43.150197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-20d5a79e-58a3-4f8e-8275-fc6acaa2becd tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:43.169888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20d5a79e-58a3-4f8e-8275-fc6acaa2becd tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:43.173900 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20d5a79e-58a3-4f8e-8275-fc6acaa2becd tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:43.184011 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20d5a79e-58a3-4f8e-8275-fc6acaa2becd tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:43.184832 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20d5a79e-58a3-4f8e-8275-fc6acaa2becd tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:43.753632 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-843bea7a-56d2-414f-b2eb-863ed38f4826 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:43.772164 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-843bea7a-56d2-414f-b2eb-863ed38f4826 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1473 microversion: 2.1 time: 1.256621 Jul 31 01:13:43.775948 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 814/1657] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:42 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1473 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:43.795326 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5c24b8a3-4f60-4153-b609-495561710f79 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:43.801713 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5c24b8a3-4f60-4153-b609-495561710f79 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:43.804907 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-20d5a79e-58a3-4f8e-8275-fc6acaa2becd tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755582e730334e69bb29408920a6625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431dbca9a24393bbfb2f51bfcff27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:43.818764 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-20d5a79e-58a3-4f8e-8275-fc6acaa2becd tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 200 len: 1325 microversion: 2.1 time: 0.682972 Jul 31 01:13:43.819519 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 844/1658] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:43 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 1325 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:43.824762 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0689037f-85c8-4aa8-8acf-be4f8e858451 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1349669350", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "6202340f-0183-4051-846c-d255fe21d994"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:43.842343 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c24b8a3-4f60-4153-b609-495561710f79 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:43.845580 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c24b8a3-4f60-4153-b609-495561710f79 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:43.847973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c24b8a3-4f60-4153-b609-495561710f79 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:43.853659 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c24b8a3-4f60-4153-b609-495561710f79 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:43.974803 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-0689037f-85c8-4aa8-8acf-be4f8e858451 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] validate_networks() for [('6202340f-0183-4051-846c-d255fe21d994', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:13:44.763151 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5c24b8a3-4f60-4153-b609-495561710f79 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:44.772652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5c24b8a3-4f60-4153-b609-495561710f79 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:44.774344 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5c24b8a3-4f60-4153-b609-495561710f79 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:44.775738 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5c24b8a3-4f60-4153-b609-495561710f79 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 0.995584 Jul 31 01:13:44.783979 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 815/1659] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:43 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:44.795552 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d62b6ca4-268f-41d2-a53e-781a183ec7a2 tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.010125 Jul 31 01:13:44.808636 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 816/1660] 10.222.0.45 () {58 vars in 1164 bytes} [Sun Jul 31 01:13:44 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 31 01:13:44.829422 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-57dc968c-18b0-4330-8ef5-4339304da874 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:44.831258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-57dc968c-18b0-4330-8ef5-4339304da874 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:44.850316 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57dc968c-18b0-4330-8ef5-4339304da874 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:44.851153 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57dc968c-18b0-4330-8ef5-4339304da874 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:44.852424 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57dc968c-18b0-4330-8ef5-4339304da874 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:44.856490 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57dc968c-18b0-4330-8ef5-4339304da874 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:45.140407 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-57dc968c-18b0-4330-8ef5-4339304da874 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:45.153230 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-57dc968c-18b0-4330-8ef5-4339304da874 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1274 microversion: 2.1 time: 0.343189 Jul 31 01:13:45.157963 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 817/1661] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:44 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1274 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:45.170054 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-30277310-da9c-4400-99db-2baeb6e5aa64 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:45.175828 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-30277310-da9c-4400-99db-2baeb6e5aa64 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:45.195400 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30277310-da9c-4400-99db-2baeb6e5aa64 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:45.198529 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30277310-da9c-4400-99db-2baeb6e5aa64 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:45.199795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30277310-da9c-4400-99db-2baeb6e5aa64 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:45.208609 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30277310-da9c-4400-99db-2baeb6e5aa64 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:46.384126 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:46.481985 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=10 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:46.706374 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-30277310-da9c-4400-99db-2baeb6e5aa64 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:46.719093 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-30277310-da9c-4400-99db-2baeb6e5aa64 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72" status: 200 len: 1367 microversion: 2.1 time: 1.553639 Jul 31 01:13:46.737057 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 818/1662] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:45 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72 => generated 1367 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:46.751226 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-007ee72a-51ea-4734-93a8-6a6bd65ad4f2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:46.754034 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-007ee72a-51ea-4734-93a8-6a6bd65ad4f2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:46.769406 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-007ee72a-51ea-4734-93a8-6a6bd65ad4f2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:46.772289 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-007ee72a-51ea-4734-93a8-6a6bd65ad4f2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:46.773619 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-007ee72a-51ea-4734-93a8-6a6bd65ad4f2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:46.774159 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-007ee72a-51ea-4734-93a8-6a6bd65ad4f2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:46.800931 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-0689037f-85c8-4aa8-8acf-be4f8e858451 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:13:46.801462 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-0689037f-85c8-4aa8-8acf-be4f8e858451 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:13:46.802045 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-0689037f-85c8-4aa8-8acf-be4f8e858451 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:13:46.803094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-0689037f-85c8-4aa8-8acf-be4f8e858451 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:13:46.804276 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-0689037f-85c8-4aa8-8acf-be4f8e858451 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:13:46.827936 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0689037f-85c8-4aa8-8acf-be4f8e858451 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:46.831140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0689037f-85c8-4aa8-8acf-be4f8e858451 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:46.834868 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0689037f-85c8-4aa8-8acf-be4f8e858451 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:46.835924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0689037f-85c8-4aa8-8acf-be4f8e858451 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:46.885485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-0689037f-85c8-4aa8-8acf-be4f8e858451 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Getting quotas for project 3fb526f587384fdea1a06d8b3b685dcf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:13:46.894569 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-0689037f-85c8-4aa8-8acf-be4f8e858451 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Getting quotas for user f4352f9b8762490e9187e28e8c9cd58e and project 3fb526f587384fdea1a06d8b3b685dcf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:13:46.941714 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0689037f-85c8-4aa8-8acf-be4f8e858451 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:13:46.950256 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0689037f-85c8-4aa8-8acf-be4f8e858451 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:13:47.107808 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0689037f-85c8-4aa8-8acf-be4f8e858451 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.285789 Jul 31 01:13:47.109026 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 845/1663] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:13:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:13:47.126992 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1a8ea0df-7d22-4948-a8d5-52e3c06203ad tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:47.135824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1a8ea0df-7d22-4948-a8d5-52e3c06203ad tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:47.153093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a8ea0df-7d22-4948-a8d5-52e3c06203ad tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:47.160184 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a8ea0df-7d22-4948-a8d5-52e3c06203ad tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:47.162136 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a8ea0df-7d22-4948-a8d5-52e3c06203ad tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:47.162836 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a8ea0df-7d22-4948-a8d5-52e3c06203ad tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:47.217259 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1a8ea0df-7d22-4948-a8d5-52e3c06203ad tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1a8ea0df-7d22-4948-a8d5-52e3c06203ad tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Request method failure captured: Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977/diagnostics HTTP/1.1 Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dcVOGPMdFRjaflSjFyrHBZVKNs-UJ4HhAvBkIC81vOFWVifWLLDUfoB0QOUZfyuvVnCQIciOpm-nmn3y1oTl7tneC9RHLy79KYnuXrT8OJGElYHDLhLq82XpMsimK95MRED2oWcDqs3W7Tr_NDoQ4EB66THBhYCodJ0d5goy-0AR0k Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: b51fbd8d735c432a84a34b80e031a3af Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1340050263 Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b51fbd8d735c432a84a34b80e031a3af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b51fbd8d735c432a84a34b80e031a3af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b51fbd8d735c432a84a34b80e031a3af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b51fbd8d735c432a84a34b80e031a3af", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1340050263 Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: b51fbd8d735c432a84a34b80e031a3af Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1340050263 Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerDiagnosticsNegativeTest-1340050263-project Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f2383ce7f1ea4189bb12e91334ad3b6d Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1340050263-project Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: action_args: {'server_id': '51ac7d82-f95f-41a6-82e5-43c1c0138977'} Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:47.222440 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:47.234490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:13:47.234490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:13:47.234490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:13:47.234490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:13:47.234490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 31 01:13:47.234490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:47.238459 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-007ee72a-51ea-4734-93a8-6a6bd65ad4f2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:47.238955 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1a8ea0df-7d22-4948-a8d5-52e3c06203ad tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:13:47.240172 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1a8ea0df-7d22-4948-a8d5-52e3c06203ad tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.126417 Jul 31 01:13:47.241583 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 846/1664] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:13:47 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977/diagnostics => generated 117 bytes in 128 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:13:47.250512 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-c5ada88f-df7b-4d76-a4cc-7d2b621e35e2 req-53c7dae8-b8ba-4f04-ac27-ee7c660335f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1062351b-6cff-4363-a029-ddfbb14c6f72", "tag": "21c27aad-5f1a-4ce4-aa63-e68cdcf475fe"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:47.251422 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-007ee72a-51ea-4734-93a8-6a6bd65ad4f2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1210 microversion: 2.1 time: 0.512385 Jul 31 01:13:47.252019 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 819/1665] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:46 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1210 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:47.263078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2de36cc6-174d-429c-a25b-e436beb692bd tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Calling method '.version_select at 0x7fede5d9e9d0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:47.263765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c5ada88f-df7b-4d76-a4cc-7d2b621e35e2 req-53c7dae8-b8ba-4f04-ac27-ee7c660335f8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:47.265275 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c5ada88f-df7b-4d76-a4cc-7d2b621e35e2 req-53c7dae8-b8ba-4f04-ac27-ee7c660335f8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:47.319388 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-c5ada88f-df7b-4d76-a4cc-7d2b621e35e2 req-53c7dae8-b8ba-4f04-ac27-ee7c660335f8 service nova] Creating event network-changed:21c27aad-5f1a-4ce4-aa63-e68cdcf475fe for instance 1062351b-6cff-4363-a029-ddfbb14c6f72 on n-h2-master-1 Jul 31 01:13:47.332779 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-c5ada88f-df7b-4d76-a4cc-7d2b621e35e2 req-53c7dae8-b8ba-4f04-ac27-ee7c660335f8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086442 Jul 31 01:13:47.334054 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 847/1666] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:47.352090 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1f1e991e-b8b2-4862-a2e9-c1ea0b485443 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:47.353144 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1f1e991e-b8b2-4862-a2e9-c1ea0b485443 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:47.362785 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f1e991e-b8b2-4862-a2e9-c1ea0b485443 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:47.363600 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f1e991e-b8b2-4862-a2e9-c1ea0b485443 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:47.364616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f1e991e-b8b2-4862-a2e9-c1ea0b485443 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:47.370100 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f1e991e-b8b2-4862-a2e9-c1ea0b485443 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:47.401589 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:48.183437 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1f1e991e-b8b2-4862-a2e9-c1ea0b485443 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755582e730334e69bb29408920a6625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431dbca9a24393bbfb2f51bfcff27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:48.201537 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1f1e991e-b8b2-4862-a2e9-c1ea0b485443 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 200 len: 1325 microversion: 2.1 time: 0.865907 Jul 31 01:13:48.202938 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 848/1667] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:47 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 1325 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:48.208468 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-4790e53d-79da-4c23-9cd6-d57d29409620 req-0e0c6bfe-20f7-4a70-9c85-3034a3a6b819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39424d9-338d-407b-822f-2ed61e7c0c65", "name": "network-vif-plugged", "status": "completed", "tag": "67f63173-236d-4edb-a5e5-e7680a8bb262"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:48.242367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4790e53d-79da-4c23-9cd6-d57d29409620 req-0e0c6bfe-20f7-4a70-9c85-3034a3a6b819 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:48.255653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4790e53d-79da-4c23-9cd6-d57d29409620 req-0e0c6bfe-20f7-4a70-9c85-3034a3a6b819 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:48.285408 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-4790e53d-79da-4c23-9cd6-d57d29409620 req-0e0c6bfe-20f7-4a70-9c85-3034a3a6b819 service nova] Creating event network-vif-plugged:67f63173-236d-4edb-a5e5-e7680a8bb262 for instance c39424d9-338d-407b-822f-2ed61e7c0c65 on n-h1-master-1 Jul 31 01:13:48.302847 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-4790e53d-79da-4c23-9cd6-d57d29409620 req-0e0c6bfe-20f7-4a70-9c85-3034a3a6b819 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098115 Jul 31 01:13:48.304141 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 849/1668] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:48.352696 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b9c4e541-8e26-40b2-b239-e663f241be4e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:48.353437 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b9c4e541-8e26-40b2-b239-e663f241be4e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:48.368398 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2de36cc6-174d-429c-a25b-e436beb692bd tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.109671 Jul 31 01:13:48.371478 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 820/1669] 10.222.0.45 () {58 vars in 1158 bytes} [Sun Jul 31 01:13:47 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:48.371933 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9c4e541-8e26-40b2-b239-e663f241be4e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:48.373241 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9c4e541-8e26-40b2-b239-e663f241be4e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:48.374091 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9c4e541-8e26-40b2-b239-e663f241be4e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:48.374535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9c4e541-8e26-40b2-b239-e663f241be4e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:48.388814 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0b0f5ca0-d557-4c34-8845-47af3174e772 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:48.394549 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0b0f5ca0-d557-4c34-8845-47af3174e772 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:48.432792 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b0f5ca0-d557-4c34-8845-47af3174e772 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:48.433981 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b0f5ca0-d557-4c34-8845-47af3174e772 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:48.438668 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b0f5ca0-d557-4c34-8845-47af3174e772 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:48.439894 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b0f5ca0-d557-4c34-8845-47af3174e772 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:48.883923 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b9c4e541-8e26-40b2-b239-e663f241be4e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:48.900412 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b9c4e541-8e26-40b2-b239-e663f241be4e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:48.906720 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0b0f5ca0-d557-4c34-8845-47af3174e772 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:48.913291 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b9c4e541-8e26-40b2-b239-e663f241be4e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:48.914798 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b9c4e541-8e26-40b2-b239-e663f241be4e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 0.609106 Jul 31 01:13:48.921203 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0b0f5ca0-d557-4c34-8845-47af3174e772 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1316 microversion: 2.1 time: 0.546664 Jul 31 01:13:48.931590 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 850/1671] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:48 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:48.934673 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 821/1671] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:48 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1316 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:48.943216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c609cd96-81ff-43bb-b411-289a102ba460 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:48.943950 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c609cd96-81ff-43bb-b411-289a102ba460 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:48.946709 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bc4df0f3-0205-46a5-9f09-0f386504a2bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:48.947726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bc4df0f3-0205-46a5-9f09-0f386504a2bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:48.955715 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc4df0f3-0205-46a5-9f09-0f386504a2bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:48.956448 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c609cd96-81ff-43bb-b411-289a102ba460 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:48.956821 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc4df0f3-0205-46a5-9f09-0f386504a2bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:48.956974 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c609cd96-81ff-43bb-b411-289a102ba460 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:48.957791 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c609cd96-81ff-43bb-b411-289a102ba460 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:48.958282 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c609cd96-81ff-43bb-b411-289a102ba460 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:48.958597 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc4df0f3-0205-46a5-9f09-0f386504a2bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:48.959178 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc4df0f3-0205-46a5-9f09-0f386504a2bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:48.974651 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:49.011185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c609cd96-81ff-43bb-b411-289a102ba460 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:13:49.130949 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bc4df0f3-0205-46a5-9f09-0f386504a2bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:49.148732 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bc4df0f3-0205-46a5-9f09-0f386504a2bc tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d" status: 200 len: 1260 microversion: 2.1 time: 0.208062 Jul 31 01:13:49.150157 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 851/1672] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:48 2022] GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:49.157911 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-37f9e9e7-77dc-480c-8830-9c79c170366c req-c66b453c-81e3-4a97-a7a8-b9d7acd04f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37302988-1cb9-4dca-a5a5-93ff2a30316b", "name": "network-vif-deleted", "tag": "8e0167ab-8d69-4a27-8750-640d68a6c8e5"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:49.173160 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-37f9e9e7-77dc-480c-8830-9c79c170366c req-c66b453c-81e3-4a97-a7a8-b9d7acd04f3f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:49.173997 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-37f9e9e7-77dc-480c-8830-9c79c170366c req-c66b453c-81e3-4a97-a7a8-b9d7acd04f3f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:49.202639 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-37f9e9e7-77dc-480c-8830-9c79c170366c req-c66b453c-81e3-4a97-a7a8-b9d7acd04f3f service nova] Creating event network-vif-deleted:8e0167ab-8d69-4a27-8750-640d68a6c8e5 for instance 37302988-1cb9-4dca-a5a5-93ff2a30316b on n-h1-master-1 Jul 31 01:13:49.215146 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-37f9e9e7-77dc-480c-8830-9c79c170366c req-c66b453c-81e3-4a97-a7a8-b9d7acd04f3f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062046 Jul 31 01:13:49.218650 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 852/1673] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:49.219646 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c609cd96-81ff-43bb-b411-289a102ba460 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "DELETE /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 204 len: 0 microversion: 2.1 time: 0.282275 Jul 31 01:13:49.221427 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 822/1674] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:13:48 2022] DELETE /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:13:49.234041 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b9c4cd8f-7902-4232-b6d5-ffab93e1295e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:49.235240 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b9c4cd8f-7902-4232-b6d5-ffab93e1295e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:49.235550 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-42804a5f-ae6c-4f9e-99a9-146c7eeb48ce tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:49.236481 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-42804a5f-ae6c-4f9e-99a9-146c7eeb48ce tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:49.247946 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42804a5f-ae6c-4f9e-99a9-146c7eeb48ce tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:49.251160 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9c4cd8f-7902-4232-b6d5-ffab93e1295e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:49.251476 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9c4cd8f-7902-4232-b6d5-ffab93e1295e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:49.252345 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42804a5f-ae6c-4f9e-99a9-146c7eeb48ce tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:49.252848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9c4cd8f-7902-4232-b6d5-ffab93e1295e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:49.253768 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9c4cd8f-7902-4232-b6d5-ffab93e1295e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:49.254098 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42804a5f-ae6c-4f9e-99a9-146c7eeb48ce tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:49.255123 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42804a5f-ae6c-4f9e-99a9-146c7eeb48ce tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:49.578863 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b9c4cd8f-7902-4232-b6d5-ffab93e1295e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:49.594819 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b9c4cd8f-7902-4232-b6d5-ffab93e1295e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72" status: 200 len: 1367 microversion: 2.1 time: 0.372887 Jul 31 01:13:49.596023 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 853/1675] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:49 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:49.602295 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-42804a5f-ae6c-4f9e-99a9-146c7eeb48ce tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:49.603887 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-de1771aa-1f7a-4898-8f8e-4244be0995bf tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Calling method '.version_select at 0x7fede51e45e0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:49.622651 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-42804a5f-ae6c-4f9e-99a9-146c7eeb48ce tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1210 microversion: 2.1 time: 0.395519 Jul 31 01:13:49.623990 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 823/1676] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:49 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1210 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:49.633299 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7e974ca9-109b-4522-89fe-35311311951c tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:49.634941 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7e974ca9-109b-4522-89fe-35311311951c tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:49.646369 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e974ca9-109b-4522-89fe-35311311951c tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:49.647372 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e974ca9-109b-4522-89fe-35311311951c tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:49.648836 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e974ca9-109b-4522-89fe-35311311951c tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:49.649667 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e974ca9-109b-4522-89fe-35311311951c tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:49.913284 n-d-master-1 devstack@n-api.service[119475]: DEBUG neutronclient.v2_0.client [None req-de1771aa-1f7a-4898-8f8e-4244be0995bf tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119475) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:13:49.916010 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-de1771aa-1f7a-4898-8f8e-4244be0995bf tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 31 01:13:49.916010 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-a991f656-8bbb-474d-932c-c3352a79ee25'] Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-de1771aa-1f7a-4898-8f8e-4244be0995bf tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Request method failure captured: Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/os-security-groups/5dc92482-b172-4617-846a-a66f701d52d9 HTTP/1.1 Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5ddGibIwMHbQfwcX9UWbCzhkBDxSXqw_tuG87zc1xmShL-zEiERzNefmPJc_37dnjUI_vCR4vsR_AGod3LQUBJHEw0ST3zEvTqBUwpbgpJ8DxwliDG_kJAQxv8iuDS2gG3iNC7Mp1iuoe-T5cf0ed5_OcRP11elsRNs6-97N2USelcA Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a1c5b0d919ae4b0aa08a3f674323cb86 Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2136851451 Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1c5b0d919ae4b0aa08a3f674323cb86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1c5b0d919ae4b0aa08a3f674323cb86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1c5b0d919ae4b0aa08a3f674323cb86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1c5b0d919ae4b0aa08a3f674323cb86", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2136851451 Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a1c5b0d919ae4b0aa08a3f674323cb86 Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2136851451 Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-SecurityGroupsNegativeTestJSON-2136851451-project Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 5d549a6c831a45c6916aec8897f1d877 Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2136851451-project Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: exception: Insufficient rights for removing default security group. Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-a991f656-8bbb-474d-932c-c3352a79ee25'] Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '5dc92482-b172-4617-846a-a66f701d52d9'} Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:13:49.927372 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a991f656-8bbb-474d-932c-c3352a79ee25'] Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a991f656-8bbb-474d-932c-c3352a79ee25'] Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a991f656-8bbb-474d-932c-c3352a79ee25'] Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a991f656-8bbb-474d-932c-c3352a79ee25'] Jul 31 01:13:49.939979 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:49.952786 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-de1771aa-1f7a-4898-8f8e-4244be0995bf tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 31 01:13:49.952786 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-a991f656-8bbb-474d-932c-c3352a79ee25'] {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:13:49.957820 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-de1771aa-1f7a-4898-8f8e-4244be0995bf tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/5dc92482-b172-4617-846a-a66f701d52d9" status: 400 len: 182 microversion: 2.1 time: 0.360031 Jul 31 01:13:49.962622 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 854/1677] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:13:49 2022] DELETE /compute/v2.1/os-security-groups/5dc92482-b172-4617-846a-a66f701d52d9 => generated 182 bytes in 365 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:13:49.974111 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3331a12d-20b6-488b-aa32-49c822dc4a8c tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:49.976773 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3331a12d-20b6-488b-aa32-49c822dc4a8c tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:49.989332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7e974ca9-109b-4522-89fe-35311311951c tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:49.993535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3331a12d-20b6-488b-aa32-49c822dc4a8c tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:49.994201 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3331a12d-20b6-488b-aa32-49c822dc4a8c tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:49.995861 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3331a12d-20b6-488b-aa32-49c822dc4a8c tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:49.997612 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3331a12d-20b6-488b-aa32-49c822dc4a8c tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:50.003780 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7e974ca9-109b-4522-89fe-35311311951c tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1479 microversion: 2.1 time: 0.377417 Jul 31 01:13:50.019579 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 824/1678] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:49 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1479 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:50.035700 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e32b6c7f-d1ae-4d74-a2ee-aec5856a1147 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:50.036720 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e32b6c7f-d1ae-4d74-a2ee-aec5856a1147 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:50.048673 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e32b6c7f-d1ae-4d74-a2ee-aec5856a1147 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:50.049485 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e32b6c7f-d1ae-4d74-a2ee-aec5856a1147 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:50.050897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e32b6c7f-d1ae-4d74-a2ee-aec5856a1147 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:50.051733 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e32b6c7f-d1ae-4d74-a2ee-aec5856a1147 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:50.259994 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3331a12d-20b6-488b-aa32-49c822dc4a8c tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755582e730334e69bb29408920a6625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431dbca9a24393bbfb2f51bfcff27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:50.274371 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3331a12d-20b6-488b-aa32-49c822dc4a8c tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 200 len: 1325 microversion: 2.1 time: 0.310190 Jul 31 01:13:50.289171 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 855/1679] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:49 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 1325 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:50.297688 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-09e7f25c-e1c5-4bfd-b999-69f0ef66f09e tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:50.298328 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-09e7f25c-e1c5-4bfd-b999-69f0ef66f09e tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:50.302144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e32b6c7f-d1ae-4d74-a2ee-aec5856a1147 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:50.305899 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09e7f25c-e1c5-4bfd-b999-69f0ef66f09e tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:50.306601 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09e7f25c-e1c5-4bfd-b999-69f0ef66f09e tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:50.308339 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09e7f25c-e1c5-4bfd-b999-69f0ef66f09e tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:50.309124 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09e7f25c-e1c5-4bfd-b999-69f0ef66f09e tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:50.315753 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e32b6c7f-d1ae-4d74-a2ee-aec5856a1147 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:50.318867 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e32b6c7f-d1ae-4d74-a2ee-aec5856a1147 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:50.320736 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e32b6c7f-d1ae-4d74-a2ee-aec5856a1147 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 0.299734 Jul 31 01:13:50.330502 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 825/1680] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:50 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:50.346659 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4780c23f-4b5a-4374-97aa-ff37585ca4de tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Calling method '.version_select at 0x7fede5535310>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:50.432034 n-d-master-1 devstack@n-api.service[119474]: DEBUG neutronclient.v2_0.client [None req-4780c23f-4b5a-4374-97aa-ff37585ca4de tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 38013c45-7d42-4bfa-9347-dcb562518a43 does not exist", "detail": ""}} {{(pid=119474) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:13:50.433295 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.security_group_api [None req-4780c23f-4b5a-4374-97aa-ff37585ca4de tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Neutron security group 38013c45-7d42-4bfa-9347-dcb562518a43 not found {{(pid=119474) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 31 01:13:50.434116 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-4780c23f-4b5a-4374-97aa-ff37585ca4de tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] HTTP exception thrown: Security group 38013c45-7d42-4bfa-9347-dcb562518a43 does not exist Jul 31 01:13:50.434116 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-27523b92-1a07-4ccd-96f3-ba3ca06c9707'] Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4780c23f-4b5a-4374-97aa-ff37585ca4de tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Request method failure captured: Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-security-groups/38013c45-7d42-4bfa-9347-dcb562518a43 HTTP/1.1 Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5ddGibIwMHbQfwcX9UWbCzhkBDxSXqw_tuG87zc1xmShL-zEiERzNefmPJc_37dnjUI_vCR4vsR_AGod3LQUBJHEw0ST3zEvTqBUwpbgpJ8DxwliDG_kJAQxv8iuDS2gG3iNC7Mp1iuoe-T5cf0ed5_OcRP11elsRNs6-97N2USelcA Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: a1c5b0d919ae4b0aa08a3f674323cb86 Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2136851451 Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1c5b0d919ae4b0aa08a3f674323cb86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1c5b0d919ae4b0aa08a3f674323cb86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1c5b0d919ae4b0aa08a3f674323cb86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1c5b0d919ae4b0aa08a3f674323cb86", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2136851451 Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: a1c5b0d919ae4b0aa08a3f674323cb86 Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2136851451 Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-SecurityGroupsNegativeTestJSON-2136851451-project Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 5d549a6c831a45c6916aec8897f1d877 Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2136851451-project Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: exception: Security group 38013c45-7d42-4bfa-9347-dcb562518a43 does not exist Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-27523b92-1a07-4ccd-96f3-ba3ca06c9707'] Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '38013c45-7d42-4bfa-9347-dcb562518a43'} Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:13:50.437958 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 38013c45-7d42-4bfa-9347-dcb562518a43 does not exist Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27523b92-1a07-4ccd-96f3-ba3ca06c9707'] Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 38013c45-7d42-4bfa-9347-dcb562518a43 does not exist Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27523b92-1a07-4ccd-96f3-ba3ca06c9707'] Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 38013c45-7d42-4bfa-9347-dcb562518a43 does not exist Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27523b92-1a07-4ccd-96f3-ba3ca06c9707'] Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 38013c45-7d42-4bfa-9347-dcb562518a43 does not exist Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27523b92-1a07-4ccd-96f3-ba3ca06c9707'] Jul 31 01:13:50.443156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:13:50.448665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4780c23f-4b5a-4374-97aa-ff37585ca4de tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Returning 404 to user: Security group 38013c45-7d42-4bfa-9347-dcb562518a43 does not exist Jul 31 01:13:50.448665 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-27523b92-1a07-4ccd-96f3-ba3ca06c9707'] {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:13:50.450004 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4780c23f-4b5a-4374-97aa-ff37585ca4de tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups/38013c45-7d42-4bfa-9347-dcb562518a43" status: 404 len: 194 microversion: 2.1 time: 0.113459 Jul 31 01:13:50.450592 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 826/1681] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 01:13:50 2022] GET /compute/v2.1/os-security-groups/38013c45-7d42-4bfa-9347-dcb562518a43 => generated 194 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:13:50.456327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c3d7741-f33a-44e6-b3f6-462d92e10990 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:50.457123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2c3d7741-f33a-44e6-b3f6-462d92e10990 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:50.459888 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:50.473179 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c3d7741-f33a-44e6-b3f6-462d92e10990 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:50.474068 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c3d7741-f33a-44e6-b3f6-462d92e10990 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:50.475584 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c3d7741-f33a-44e6-b3f6-462d92e10990 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:50.476574 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c3d7741-f33a-44e6-b3f6-462d92e10990 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:50.538878 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-09e7f25c-e1c5-4bfd-b999-69f0ef66f09e tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:50.549325 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-09e7f25c-e1c5-4bfd-b999-69f0ef66f09e tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1316 microversion: 2.1 time: 0.259655 Jul 31 01:13:50.550088 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 856/1682] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:50 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:50.567683 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d3827051-84d3-473f-87ea-fcff7e313bb2 tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Action: 'update', calling method: .version_select at 0x7fedeaa694c0>, body: {"security_group": {"name": "tempest-sg-1754613496", "description": "tempest-description-1079978897"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:50.616698 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2c3d7741-f33a-44e6-b3f6-462d92e10990 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:50.626552 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2c3d7741-f33a-44e6-b3f6-462d92e10990 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d" status: 200 len: 1268 microversion: 2.1 time: 0.174641 Jul 31 01:13:50.627273 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 827/1683] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:50 2022] GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:50.632268 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6562ca1c-5ac6-47d7-b33f-727fb0829077 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:50.633593 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6562ca1c-5ac6-47d7-b33f-727fb0829077 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:50.641870 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6562ca1c-5ac6-47d7-b33f-727fb0829077 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:50.642608 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6562ca1c-5ac6-47d7-b33f-727fb0829077 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:50.644009 n-d-master-1 devstack@n-api.service[119475]: DEBUG neutronclient.v2_0.client [None req-d3827051-84d3-473f-87ea-fcff7e313bb2 tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 308a331e-014e-4fa7-8585-8b585dfd22ce does not exist", "detail": ""}} {{(pid=119475) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:13:50.644412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6562ca1c-5ac6-47d7-b33f-727fb0829077 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:50.645083 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6562ca1c-5ac6-47d7-b33f-727fb0829077 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:50.645773 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.security_group_api [None req-d3827051-84d3-473f-87ea-fcff7e313bb2 tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Neutron security group 308a331e-014e-4fa7-8585-8b585dfd22ce not found {{(pid=119475) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 31 01:13:50.646719 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-d3827051-84d3-473f-87ea-fcff7e313bb2 tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] HTTP exception thrown: Security group 308a331e-014e-4fa7-8585-8b585dfd22ce does not exist Jul 31 01:13:50.646719 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-cc271d0c-455d-4087-96be-bf4416c57334'] Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d3827051-84d3-473f-87ea-fcff7e313bb2 tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Request method failure captured: Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: request: PUT /compute/v2.1/os-security-groups/308a331e-014e-4fa7-8585-8b585dfd22ce HTTP/1.1 Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 102 Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5ddGibIwMHbQfwcX9UWbCzhkBDxSXqw_tuG87zc1xmShL-zEiERzNefmPJc_37dnjUI_vCR4vsR_AGod3LQUBJHEw0ST3zEvTqBUwpbgpJ8DxwliDG_kJAQxv8iuDS2gG3iNC7Mp1iuoe-T5cf0ed5_OcRP11elsRNs6-97N2USelcA Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a1c5b0d919ae4b0aa08a3f674323cb86 Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2136851451 Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1c5b0d919ae4b0aa08a3f674323cb86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1c5b0d919ae4b0aa08a3f674323cb86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1c5b0d919ae4b0aa08a3f674323cb86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1c5b0d919ae4b0aa08a3f674323cb86", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2136851451 Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a1c5b0d919ae4b0aa08a3f674323cb86 Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2136851451 Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-SecurityGroupsNegativeTestJSON-2136851451-project Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 5d549a6c831a45c6916aec8897f1d877 Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2136851451-project Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: {"security_group": {"name": "tempest-sg-1754613496", "description": "tempest-description-1079978897"}} Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: exception: Security group 308a331e-014e-4fa7-8585-8b585dfd22ce does not exist Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-cc271d0c-455d-4087-96be-bf4416c57334'] Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '308a331e-014e-4fa7-8585-8b585dfd22ce', 'body': {'security_group': {'name': 'tempest-sg-1754613496', 'description': 'tempest-description-1079978897'}}} Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:13:50.657297 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 308a331e-014e-4fa7-8585-8b585dfd22ce does not exist Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc271d0c-455d-4087-96be-bf4416c57334'] Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 308a331e-014e-4fa7-8585-8b585dfd22ce does not exist Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc271d0c-455d-4087-96be-bf4416c57334'] Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 308a331e-014e-4fa7-8585-8b585dfd22ce does not exist Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc271d0c-455d-4087-96be-bf4416c57334'] Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 308a331e-014e-4fa7-8585-8b585dfd22ce does not exist Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc271d0c-455d-4087-96be-bf4416c57334'] Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d3827051-84d3-473f-87ea-fcff7e313bb2 tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] Returning 404 to user: Security group 308a331e-014e-4fa7-8585-8b585dfd22ce does not exist Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: Neutron server returns request_ids: ['req-cc271d0c-455d-4087-96be-bf4416c57334'] {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d3827051-84d3-473f-87ea-fcff7e313bb2 tempest-SecurityGroupsNegativeTestJSON-2136851451 tempest-SecurityGroupsNegativeTestJSON-2136851451-project] 10.222.0.45 "PUT /compute/v2.1/os-security-groups/308a331e-014e-4fa7-8585-8b585dfd22ce" status: 404 len: 194 microversion: 2.1 time: 0.109507 Jul 31 01:13:50.664649 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 857/1684] 10.222.0.45 () {60 vars in 1290 bytes} [Sun Jul 31 01:13:50 2022] PUT /compute/v2.1/os-security-groups/308a331e-014e-4fa7-8585-8b585dfd22ce => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:13:50.675311 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6d9c1d7d-7b1f-4d27-a0dd-e85c1177d72d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:50.676518 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6d9c1d7d-7b1f-4d27-a0dd-e85c1177d72d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:50.687652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d9c1d7d-7b1f-4d27-a0dd-e85c1177d72d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:50.688865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d9c1d7d-7b1f-4d27-a0dd-e85c1177d72d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:50.690553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d9c1d7d-7b1f-4d27-a0dd-e85c1177d72d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:50.691227 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d9c1d7d-7b1f-4d27-a0dd-e85c1177d72d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:51.026178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6562ca1c-5ac6-47d7-b33f-727fb0829077 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:51.043728 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6562ca1c-5ac6-47d7-b33f-727fb0829077 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72" status: 200 len: 1367 microversion: 2.1 time: 0.408251 Jul 31 01:13:51.044751 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 828/1685] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:50 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72 => generated 1367 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:51.049705 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1407e221-65e4-4fc6-9d56-4c5baffc58e4 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:51.050317 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1407e221-65e4-4fc6-9d56-4c5baffc58e4 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:51.066688 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1407e221-65e4-4fc6-9d56-4c5baffc58e4 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:51.067252 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6d9c1d7d-7b1f-4d27-a0dd-e85c1177d72d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:51.067669 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1407e221-65e4-4fc6-9d56-4c5baffc58e4 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:51.069484 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1407e221-65e4-4fc6-9d56-4c5baffc58e4 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:51.074566 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1407e221-65e4-4fc6-9d56-4c5baffc58e4 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:51.086428 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6d9c1d7d-7b1f-4d27-a0dd-e85c1177d72d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1210 microversion: 2.1 time: 0.422096 Jul 31 01:13:51.099158 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 858/1686] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:50 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1210 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:51.250690 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-5f01b4b1-78b2-4aa3-beb7-5d463d55fa66 req-b0bcedb2-3f9c-44e9-9051-baa2d17c6000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42f5a418-18ef-4735-bea0-a0c123be5253", "tag": "bddb160a-16a2-4712-b3ca-74f0c5aff9fe"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:51.261190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5f01b4b1-78b2-4aa3-beb7-5d463d55fa66 req-b0bcedb2-3f9c-44e9-9051-baa2d17c6000 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:51.262435 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5f01b4b1-78b2-4aa3-beb7-5d463d55fa66 req-b0bcedb2-3f9c-44e9-9051-baa2d17c6000 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:51.276237 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-5f01b4b1-78b2-4aa3-beb7-5d463d55fa66 req-b0bcedb2-3f9c-44e9-9051-baa2d17c6000 service nova] Creating event network-changed:bddb160a-16a2-4712-b3ca-74f0c5aff9fe for instance 42f5a418-18ef-4735-bea0-a0c123be5253 on n-h1-master-1 Jul 31 01:13:51.281862 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-5f01b4b1-78b2-4aa3-beb7-5d463d55fa66 req-b0bcedb2-3f9c-44e9-9051-baa2d17c6000 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035360 Jul 31 01:13:51.283067 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 859/1687] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:13:51.289827 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-4e5208b9-da35-4840-9237-d4b343a1eea4 req-fd226618-674a-4fc4-b44d-cbe00482ac47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1062351b-6cff-4363-a029-ddfbb14c6f72", "name": "network-vif-plugged", "status": "completed", "tag": "21c27aad-5f1a-4ce4-aa63-e68cdcf475fe"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:51.303804 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4e5208b9-da35-4840-9237-d4b343a1eea4 req-fd226618-674a-4fc4-b44d-cbe00482ac47 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:51.304649 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4e5208b9-da35-4840-9237-d4b343a1eea4 req-fd226618-674a-4fc4-b44d-cbe00482ac47 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:51.319028 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-4e5208b9-da35-4840-9237-d4b343a1eea4 req-fd226618-674a-4fc4-b44d-cbe00482ac47 service nova] Creating event network-vif-plugged:21c27aad-5f1a-4ce4-aa63-e68cdcf475fe for instance 1062351b-6cff-4363-a029-ddfbb14c6f72 on n-h2-master-1 Jul 31 01:13:51.324368 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-4e5208b9-da35-4840-9237-d4b343a1eea4 req-fd226618-674a-4fc4-b44d-cbe00482ac47 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039678 Jul 31 01:13:51.326695 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 860/1688] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:51.336469 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0337be28-0c92-418b-bed8-f3934f94161a tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:51.337547 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0337be28-0c92-418b-bed8-f3934f94161a tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:51.355649 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0337be28-0c92-418b-bed8-f3934f94161a tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:51.356917 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0337be28-0c92-418b-bed8-f3934f94161a tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:51.357965 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0337be28-0c92-418b-bed8-f3934f94161a tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:51.358629 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0337be28-0c92-418b-bed8-f3934f94161a tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:51.846913 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1407e221-65e4-4fc6-9d56-4c5baffc58e4 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:51.854838 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1407e221-65e4-4fc6-9d56-4c5baffc58e4 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1479 microversion: 2.1 time: 0.808781 Jul 31 01:13:51.863519 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 829/1689] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:51 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1479 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:51.863519 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-14fb303b-33be-4905-ae46-66218233904d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:51.863519 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-14fb303b-33be-4905-ae46-66218233904d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:51.868821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-14fb303b-33be-4905-ae46-66218233904d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:51.869365 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-14fb303b-33be-4905-ae46-66218233904d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:51.870166 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-14fb303b-33be-4905-ae46-66218233904d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:51.870602 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-14fb303b-33be-4905-ae46-66218233904d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:52.140850 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0337be28-0c92-418b-bed8-f3934f94161a tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755582e730334e69bb29408920a6625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431dbca9a24393bbfb2f51bfcff27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:52.152533 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0337be28-0c92-418b-bed8-f3934f94161a tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 200 len: 1522 microversion: 2.1 time: 0.823849 Jul 31 01:13:52.154256 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 861/1690] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:51 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 1522 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:52.166781 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2bdc5290-0f4f-42eb-9253-bef74c45e95c tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:52.168512 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2bdc5290-0f4f-42eb-9253-bef74c45e95c tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:52.181602 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bdc5290-0f4f-42eb-9253-bef74c45e95c tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:52.183608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bdc5290-0f4f-42eb-9253-bef74c45e95c tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:52.185691 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bdc5290-0f4f-42eb-9253-bef74c45e95c tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:52.186243 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bdc5290-0f4f-42eb-9253-bef74c45e95c tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:52.850933 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-14fb303b-33be-4905-ae46-66218233904d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:52.860097 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-14fb303b-33be-4905-ae46-66218233904d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:52.862616 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-14fb303b-33be-4905-ae46-66218233904d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:52.863912 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-14fb303b-33be-4905-ae46-66218233904d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 1.007473 Jul 31 01:13:52.864500 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 830/1691] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:51 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:52.869224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-62b81e8e-447f-4b05-b863-eb7c5250c289 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:52.870326 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-62b81e8e-447f-4b05-b863-eb7c5250c289 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:52.878315 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62b81e8e-447f-4b05-b863-eb7c5250c289 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:52.879057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62b81e8e-447f-4b05-b863-eb7c5250c289 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:52.879930 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62b81e8e-447f-4b05-b863-eb7c5250c289 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:52.880562 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62b81e8e-447f-4b05-b863-eb7c5250c289 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:53.022045 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-62b81e8e-447f-4b05-b863-eb7c5250c289 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:53.029550 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-62b81e8e-447f-4b05-b863-eb7c5250c289 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d" status: 200 len: 1266 microversion: 2.1 time: 0.164043 Jul 31 01:13:53.030150 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 831/1692] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:52 2022] GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:53.034772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-baadb3c9-9978-41b2-88ea-f685c69ad13e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:53.035775 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-baadb3c9-9978-41b2-88ea-f685c69ad13e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:53.044636 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-baadb3c9-9978-41b2-88ea-f685c69ad13e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:53.045317 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-baadb3c9-9978-41b2-88ea-f685c69ad13e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:53.046361 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-baadb3c9-9978-41b2-88ea-f685c69ad13e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:53.046852 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-baadb3c9-9978-41b2-88ea-f685c69ad13e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:53.115580 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2bdc5290-0f4f-42eb-9253-bef74c45e95c tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:53.126049 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2bdc5290-0f4f-42eb-9253-bef74c45e95c tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1316 microversion: 2.1 time: 0.968246 Jul 31 01:13:53.126999 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 862/1693] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:52 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1316 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:53.145309 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-759b3af4-d44d-4411-959f-b674db12015a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:53.146301 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-759b3af4-d44d-4411-959f-b674db12015a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:53.153957 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-759b3af4-d44d-4411-959f-b674db12015a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:53.154753 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-759b3af4-d44d-4411-959f-b674db12015a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:53.156145 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-759b3af4-d44d-4411-959f-b674db12015a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:53.156805 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-759b3af4-d44d-4411-959f-b674db12015a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:53.657885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-baadb3c9-9978-41b2-88ea-f685c69ad13e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:53.665786 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-baadb3c9-9978-41b2-88ea-f685c69ad13e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72" status: 200 len: 1367 microversion: 2.1 time: 0.634566 Jul 31 01:13:53.666374 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 832/1694] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:53 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72 => generated 1367 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:53.671148 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2b1d0966-0ab4-4d4e-a1e4-263fd816bab3 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:53.672794 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2b1d0966-0ab4-4d4e-a1e4-263fd816bab3 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:53.678369 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b1d0966-0ab4-4d4e-a1e4-263fd816bab3 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:53.678837 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b1d0966-0ab4-4d4e-a1e4-263fd816bab3 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:53.679694 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b1d0966-0ab4-4d4e-a1e4-263fd816bab3 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:53.680125 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b1d0966-0ab4-4d4e-a1e4-263fd816bab3 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:53.696321 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-759b3af4-d44d-4411-959f-b674db12015a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:53.704392 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-2b1d0966-0ab4-4d4e-a1e4-263fd816bab3 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] HTTP exception thrown: Instance is not a member of specified network Jul 31 01:13:53.705720 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-759b3af4-d44d-4411-959f-b674db12015a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1198 microversion: 2.1 time: 0.577429 Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2b1d0966-0ab4-4d4e-a1e4-263fd816bab3 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Request method failure captured: Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65/ips/invalid HTTP/1.1 Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dcszE6-1XzDGq-pY8kp5ledF-l8WRIu50epVTkSRQQWV1b8tGvABPwXaJGGTRHLgNIRWWekzjBac7dHk2Y2HAHUTZ2hjwjyHpotBvSp5XVha1PiYGh9euZMVgbIcqeu4U3Mno4uh1ao7MWOSWxjVAvLMmKCi1nEiLPa5YkjcgazYmQ Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 03431dbca9a24393bbfb2f51bfcff27e Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1135799302 Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03431dbca9a24393bbfb2f51bfcff27e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03431dbca9a24393bbfb2f51bfcff27e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/03431dbca9a24393bbfb2f51bfcff27e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_03431dbca9a24393bbfb2f51bfcff27e", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1135799302 Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 03431dbca9a24393bbfb2f51bfcff27e Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1135799302 Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerAddressesNegativeTestJSON-1135799302-project Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 755582e730334e69bb29408920a6625e Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1135799302-project Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: exception: Instance is not a member of specified network Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: action_args: {'server_id': 'c39424d9-338d-407b-822f-2ed61e7c0c65', 'id': 'invalid'} Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 31 01:13:53.706263 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:13:53.711201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2b1d0966-0ab4-4d4e-a1e4-263fd816bab3 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:13:53.711201 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2b1d0966-0ab4-4d4e-a1e4-263fd816bab3 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.040197 Jul 31 01:13:53.711201 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 833/1695] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:13:53 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65/ips/invalid => generated 91 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:13:53.712816 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 863/1696] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:53 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1198 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:53.718800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fff9924f-6f7d-4442-97ad-884f06721916 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:53.719542 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fff9924f-6f7d-4442-97ad-884f06721916 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Failed to fetch instance by id 999 {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2928}} Jul 31 01:13:53.720448 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-fff9924f-6f7d-4442-97ad-884f06721916 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] HTTP exception thrown: Instance 999 could not be found. Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fff9924f-6f7d-4442-97ad-884f06721916 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Request method failure captured: Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dcszE6-1XzDGq-pY8kp5ledF-l8WRIu50epVTkSRQQWV1b8tGvABPwXaJGGTRHLgNIRWWekzjBac7dHk2Y2HAHUTZ2hjwjyHpotBvSp5XVha1PiYGh9euZMVgbIcqeu4U3Mno4uh1ao7MWOSWxjVAvLMmKCi1nEiLPa5YkjcgazYmQ Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 03431dbca9a24393bbfb2f51bfcff27e Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1135799302 Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03431dbca9a24393bbfb2f51bfcff27e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03431dbca9a24393bbfb2f51bfcff27e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/03431dbca9a24393bbfb2f51bfcff27e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_03431dbca9a24393bbfb2f51bfcff27e", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1135799302 Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 03431dbca9a24393bbfb2f51bfcff27e Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1135799302 Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerAddressesNegativeTestJSON-1135799302-project Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 755582e730334e69bb29408920a6625e Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1135799302-project Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 999 could not be found. Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: action_args: {'server_id': '999'} Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 31 01:13:53.722418 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:53.727315 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8b56794f-c960-49f1-a937-3288823c1f91 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:53.728184 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8b56794f-c960-49f1-a937-3288823c1f91 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:53.728577 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fff9924f-6f7d-4442-97ad-884f06721916 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:13:53.729639 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fff9924f-6f7d-4442-97ad-884f06721916 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.015543 Jul 31 01:13:53.730788 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 864/1697] 10.222.0.45 () {58 vars in 1149 bytes} [Sun Jul 31 01:13:53 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:13:53.735688 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b56794f-c960-49f1-a937-3288823c1f91 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:53.736432 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b56794f-c960-49f1-a937-3288823c1f91 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:53.737408 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b56794f-c960-49f1-a937-3288823c1f91 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:53.738024 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b56794f-c960-49f1-a937-3288823c1f91 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:53.740212 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-615fdfb0-1998-48f9-aab7-afe128c3dd52 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:53.740976 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-615fdfb0-1998-48f9-aab7-afe128c3dd52 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:53.750960 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-615fdfb0-1998-48f9-aab7-afe128c3dd52 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:53.751637 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-615fdfb0-1998-48f9-aab7-afe128c3dd52 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:53.752720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-615fdfb0-1998-48f9-aab7-afe128c3dd52 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:53.753274 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-615fdfb0-1998-48f9-aab7-afe128c3dd52 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:53.782707 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-615fdfb0-1998-48f9-aab7-afe128c3dd52 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:13:53.879100 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-615fdfb0-1998-48f9-aab7-afe128c3dd52 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 204 len: 0 microversion: 2.1 time: 0.142938 Jul 31 01:13:53.879769 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 865/1698] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:13:53 2022] DELETE /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:13:53.889670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b124490a-1bef-42c8-b7a2-7f7d0f33362c tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:53.890148 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b124490a-1bef-42c8-b7a2-7f7d0f33362c tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:53.891020 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8b56794f-c960-49f1-a937-3288823c1f91 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:53.898907 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b124490a-1bef-42c8-b7a2-7f7d0f33362c tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:53.899420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b124490a-1bef-42c8-b7a2-7f7d0f33362c tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:53.900028 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8b56794f-c960-49f1-a937-3288823c1f91 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1437 microversion: 2.1 time: 0.190776 Jul 31 01:13:53.900285 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b124490a-1bef-42c8-b7a2-7f7d0f33362c tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:53.900610 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 834/1699] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:53 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1437 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:53.900773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b124490a-1bef-42c8-b7a2-7f7d0f33362c tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:53.906448 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b1b90a05-7509-4a10-a167-e54a615a05b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:53.907001 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b1b90a05-7509-4a10-a167-e54a615a05b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:53.917060 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1b90a05-7509-4a10-a167-e54a615a05b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:53.917738 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1b90a05-7509-4a10-a167-e54a615a05b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:53.918732 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1b90a05-7509-4a10-a167-e54a615a05b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:53.919477 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1b90a05-7509-4a10-a167-e54a615a05b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:54.289401 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b124490a-1bef-42c8-b7a2-7f7d0f33362c tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755582e730334e69bb29408920a6625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431dbca9a24393bbfb2f51bfcff27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:54.298664 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b124490a-1bef-42c8-b7a2-7f7d0f33362c tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 200 len: 1528 microversion: 2.1 time: 0.414265 Jul 31 01:13:54.300285 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b1b90a05-7509-4a10-a167-e54a615a05b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:54.300622 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 866/1700] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:53 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 1528 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:13:54.312282 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-018ba31b-3bc7-4f2d-a760-21ca3c98031a req-983d38d8-0666-4dac-b0cb-ac4f5ff2727c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ac7d82-f95f-41a6-82e5-43c1c0138977", "name": "network-vif-deleted", "tag": "b929d3d3-f845-4f8f-865c-6906eddc5cf3"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:54.314321 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b1b90a05-7509-4a10-a167-e54a615a05b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:54.317193 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b1b90a05-7509-4a10-a167-e54a615a05b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:54.318834 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b1b90a05-7509-4a10-a167-e54a615a05b0 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 0.416933 Jul 31 01:13:54.320385 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 835/1701] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:53 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:54.325972 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c12444fe-afda-4832-8850-6a5271abd826 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:54.327109 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c12444fe-afda-4832-8850-6a5271abd826 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:54.336250 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-018ba31b-3bc7-4f2d-a760-21ca3c98031a req-983d38d8-0666-4dac-b0cb-ac4f5ff2727c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:54.337175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-018ba31b-3bc7-4f2d-a760-21ca3c98031a req-983d38d8-0666-4dac-b0cb-ac4f5ff2727c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:54.338668 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c12444fe-afda-4832-8850-6a5271abd826 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:54.339122 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c12444fe-afda-4832-8850-6a5271abd826 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:54.339935 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c12444fe-afda-4832-8850-6a5271abd826 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:54.340634 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c12444fe-afda-4832-8850-6a5271abd826 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:54.349813 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-018ba31b-3bc7-4f2d-a760-21ca3c98031a req-983d38d8-0666-4dac-b0cb-ac4f5ff2727c service nova] Creating event network-vif-deleted:b929d3d3-f845-4f8f-865c-6906eddc5cf3 for instance 51ac7d82-f95f-41a6-82e5-43c1c0138977 on n-h1-master-1 Jul 31 01:13:54.356825 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-018ba31b-3bc7-4f2d-a760-21ca3c98031a req-983d38d8-0666-4dac-b0cb-ac4f5ff2727c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054442 Jul 31 01:13:54.357666 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 867/1702] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:54.363650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-19b092f8-12a7-4d6e-9f09-805c07cfb30e tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:54.364466 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-19b092f8-12a7-4d6e-9f09-805c07cfb30e tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:54.371784 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19b092f8-12a7-4d6e-9f09-805c07cfb30e tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:54.373070 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19b092f8-12a7-4d6e-9f09-805c07cfb30e tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:54.373957 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19b092f8-12a7-4d6e-9f09-805c07cfb30e tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:54.374480 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19b092f8-12a7-4d6e-9f09-805c07cfb30e tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:54.718217 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c12444fe-afda-4832-8850-6a5271abd826 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:54.729694 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c12444fe-afda-4832-8850-6a5271abd826 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d" status: 200 len: 1308 microversion: 2.1 time: 0.408013 Jul 31 01:13:54.730433 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 836/1703] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:54 2022] GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d => generated 1308 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:54.746610 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a71f8acf-b6f0-4b94-9a9b-f2f02ed30a00 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:54.747773 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a71f8acf-b6f0-4b94-9a9b-f2f02ed30a00 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:54.757417 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-19b092f8-12a7-4d6e-9f09-805c07cfb30e tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:54.760225 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a71f8acf-b6f0-4b94-9a9b-f2f02ed30a00 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:54.760612 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a71f8acf-b6f0-4b94-9a9b-f2f02ed30a00 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:54.761399 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a71f8acf-b6f0-4b94-9a9b-f2f02ed30a00 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:54.764480 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a71f8acf-b6f0-4b94-9a9b-f2f02ed30a00 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:54.774379 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-19b092f8-12a7-4d6e-9f09-805c07cfb30e tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1316 microversion: 2.1 time: 0.413506 Jul 31 01:13:54.779234 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 868/1704] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:54 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1316 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:54.792355 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e867307e-0cbf-42e1-9d84-d3d72b0ce081 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:54.798879 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e867307e-0cbf-42e1-9d84-d3d72b0ce081 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:54.809708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e867307e-0cbf-42e1-9d84-d3d72b0ce081 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:54.810594 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e867307e-0cbf-42e1-9d84-d3d72b0ce081 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:54.812725 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e867307e-0cbf-42e1-9d84-d3d72b0ce081 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:54.813351 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e867307e-0cbf-42e1-9d84-d3d72b0ce081 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:55.530206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e867307e-0cbf-42e1-9d84-d3d72b0ce081 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:55.532607 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:55.537450 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a71f8acf-b6f0-4b94-9a9b-f2f02ed30a00 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:55.540042 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e867307e-0cbf-42e1-9d84-d3d72b0ce081 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1198 microversion: 2.1 time: 0.758437 Jul 31 01:13:55.541075 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 869/1705] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:54 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1198 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:55.546183 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-46665622-a3d7-42c0-ae72-3b65bb533a4a tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:55.546925 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-46665622-a3d7-42c0-ae72-3b65bb533a4a tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:55.559132 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a71f8acf-b6f0-4b94-9a9b-f2f02ed30a00 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72" status: 200 len: 1556 microversion: 2.1 time: 0.820680 Jul 31 01:13:55.579123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46665622-a3d7-42c0-ae72-3b65bb533a4a tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:55.579621 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46665622-a3d7-42c0-ae72-3b65bb533a4a tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:55.580183 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 837/1706] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:54 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72 => generated 1556 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:55.584236 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46665622-a3d7-42c0-ae72-3b65bb533a4a tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:55.587692 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46665622-a3d7-42c0-ae72-3b65bb533a4a tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:55.593819 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-817bb77b-5faf-4ed6-baf8-9cc5c3825ffa tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:55.594477 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-817bb77b-5faf-4ed6-baf8-9cc5c3825ffa tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:55.609603 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-817bb77b-5faf-4ed6-baf8-9cc5c3825ffa tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:55.610109 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-817bb77b-5faf-4ed6-baf8-9cc5c3825ffa tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:55.616147 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-817bb77b-5faf-4ed6-baf8-9cc5c3825ffa tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:55.616843 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-817bb77b-5faf-4ed6-baf8-9cc5c3825ffa tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:55.642912 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:55.745431 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-46665622-a3d7-42c0-ae72-3b65bb533a4a tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2383ce7f1ea4189bb12e91334ad3b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51fbd8d735c432a84a34b80e031a3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:55.754539 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-46665622-a3d7-42c0-ae72-3b65bb533a4a tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 200 len: 1308 microversion: 2.1 time: 0.212097 Jul 31 01:13:55.755236 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 870/1707] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:55 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 1308 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:55.763535 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb4f694d-01d9-4469-99fa-4e7fad70808e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:55.763535 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fb4f694d-01d9-4469-99fa-4e7fad70808e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:55.767847 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb4f694d-01d9-4469-99fa-4e7fad70808e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:55.768381 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb4f694d-01d9-4469-99fa-4e7fad70808e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:55.769414 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb4f694d-01d9-4469-99fa-4e7fad70808e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:55.769895 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb4f694d-01d9-4469-99fa-4e7fad70808e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:56.092512 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-817bb77b-5faf-4ed6-baf8-9cc5c3825ffa tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755582e730334e69bb29408920a6625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431dbca9a24393bbfb2f51bfcff27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:56.101238 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-817bb77b-5faf-4ed6-baf8-9cc5c3825ffa tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 200 len: 1528 microversion: 2.1 time: 0.519684 Jul 31 01:13:56.101832 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 838/1708] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:55 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 1528 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:56.109536 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c5214c82-0398-4065-8a79-e5f444b160c9 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:56.110282 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c5214c82-0398-4065-8a79-e5f444b160c9 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:56.117824 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5214c82-0398-4065-8a79-e5f444b160c9 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:56.118277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5214c82-0398-4065-8a79-e5f444b160c9 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:56.119299 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5214c82-0398-4065-8a79-e5f444b160c9 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:56.119938 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5214c82-0398-4065-8a79-e5f444b160c9 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:56.266995 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fb4f694d-01d9-4469-99fa-4e7fad70808e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:56.275506 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fb4f694d-01d9-4469-99fa-4e7fad70808e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:56.277020 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fb4f694d-01d9-4469-99fa-4e7fad70808e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:56.278719 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fb4f694d-01d9-4469-99fa-4e7fad70808e tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 0.521908 Jul 31 01:13:56.294626 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 871/1709] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:55 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:56.294626 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4315ea62-3489-4d84-8954-0ab2d4684c4e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:56.294626 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4315ea62-3489-4d84-8954-0ab2d4684c4e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:56.295235 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c5214c82-0398-4065-8a79-e5f444b160c9 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.186066 Jul 31 01:13:56.295331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4315ea62-3489-4d84-8954-0ab2d4684c4e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:56.295331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4315ea62-3489-4d84-8954-0ab2d4684c4e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:56.295802 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 839/1710] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:13:56 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:56.295888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4315ea62-3489-4d84-8954-0ab2d4684c4e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:56.296081 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4315ea62-3489-4d84-8954-0ab2d4684c4e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:56.302343 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-06958439-10f8-4f9f-bef5-a3070f0d7bd5 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:56.303158 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-06958439-10f8-4f9f-bef5-a3070f0d7bd5 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:56.310585 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06958439-10f8-4f9f-bef5-a3070f0d7bd5 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:56.311274 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06958439-10f8-4f9f-bef5-a3070f0d7bd5 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:56.312346 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06958439-10f8-4f9f-bef5-a3070f0d7bd5 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:56.313422 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06958439-10f8-4f9f-bef5-a3070f0d7bd5 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:56.870072 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:56.884927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-06958439-10f8-4f9f-bef5-a3070f0d7bd5 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:56.895356 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-06958439-10f8-4f9f-bef5-a3070f0d7bd5 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1316 microversion: 2.1 time: 0.599158 Jul 31 01:13:56.918144 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=18 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:13:56.933441 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 840/1711] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:56 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1316 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:56.946127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fdf7e0a4-0fef-4fe2-8c98-0b9b0b96b34a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:56.946925 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fdf7e0a4-0fef-4fe2-8c98-0b9b0b96b34a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:56.961701 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdf7e0a4-0fef-4fe2-8c98-0b9b0b96b34a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:56.967234 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdf7e0a4-0fef-4fe2-8c98-0b9b0b96b34a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:56.972046 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdf7e0a4-0fef-4fe2-8c98-0b9b0b96b34a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:56.973400 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdf7e0a4-0fef-4fe2-8c98-0b9b0b96b34a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:56.976906 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4315ea62-3489-4d84-8954-0ab2d4684c4e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:56.985224 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4315ea62-3489-4d84-8954-0ab2d4684c4e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d" status: 200 len: 1308 microversion: 2.1 time: 0.704409 Jul 31 01:13:56.992088 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 872/1712] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:56 2022] GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d => generated 1308 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:57.017219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a4fab332-20b9-4a49-821f-6b67d2cb8b36 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:57.017858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a4fab332-20b9-4a49-821f-6b67d2cb8b36 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] [instance: 51ac7d82-f95f-41a6-82e5-43c1c0138977] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:57.033116 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a4fab332-20b9-4a49-821f-6b67d2cb8b36 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:57.034059 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a4fab332-20b9-4a49-821f-6b67d2cb8b36 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:57.035695 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a4fab332-20b9-4a49-821f-6b67d2cb8b36 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:57.036422 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a4fab332-20b9-4a49-821f-6b67d2cb8b36 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:57.054188 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-a4fab332-20b9-4a49-821f-6b67d2cb8b36 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] HTTP exception thrown: Instance 51ac7d82-f95f-41a6-82e5-43c1c0138977 could not be found. Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a4fab332-20b9-4a49-821f-6b67d2cb8b36 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Request method failure captured: Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 HTTP/1.1 Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dcVOGPMdFRjaflSjFyrHBZVKNs-UJ4HhAvBkIC81vOFWVifWLLDUfoB0QOUZfyuvVnCQIciOpm-nmn3y1oTl7tneC9RHLy79KYnuXrT8OJGElYHDLhLq82XpMsimK95MRED2oWcDqs3W7Tr_NDoQ4EB66THBhYCodJ0d5goy-0AR0k Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: b51fbd8d735c432a84a34b80e031a3af Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1340050263 Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b51fbd8d735c432a84a34b80e031a3af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b51fbd8d735c432a84a34b80e031a3af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b51fbd8d735c432a84a34b80e031a3af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b51fbd8d735c432a84a34b80e031a3af", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1340050263 Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: b51fbd8d735c432a84a34b80e031a3af Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1340050263 Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerDiagnosticsNegativeTest-1340050263-project Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f2383ce7f1ea4189bb12e91334ad3b6d Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1340050263-project Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 51ac7d82-f95f-41a6-82e5-43c1c0138977 could not be found. Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '51ac7d82-f95f-41a6-82e5-43c1c0138977'} Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51ac7d82-f95f-41a6-82e5-43c1c0138977 could not be found. Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51ac7d82-f95f-41a6-82e5-43c1c0138977 could not be found. Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:57.056341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:13:57.061323 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:57.061323 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:13:57.061323 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:13:57.061323 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:13:57.061323 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:13:57.061323 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:13:57.061323 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51ac7d82-f95f-41a6-82e5-43c1c0138977 could not be found. Jul 31 01:13:57.061323 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:13:57.064229 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a4fab332-20b9-4a49-821f-6b67d2cb8b36 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] Returning 404 to user: Instance 51ac7d82-f95f-41a6-82e5-43c1c0138977 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:13:57.065322 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a4fab332-20b9-4a49-821f-6b67d2cb8b36 tempest-ServerDiagnosticsNegativeTest-1340050263 tempest-ServerDiagnosticsNegativeTest-1340050263-project] 10.222.0.45 "GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977" status: 404 len: 111 microversion: 2.1 time: 0.068975 Jul 31 01:13:57.066565 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 873/1713] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:56 2022] GET /compute/v2.1/servers/51ac7d82-f95f-41a6-82e5-43c1c0138977 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:13:57.124664 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-de8d07df-4064-4784-847f-afe37e405950 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:57.125963 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-de8d07df-4064-4784-847f-afe37e405950 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:57.133868 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-de8d07df-4064-4784-847f-afe37e405950 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:57.134875 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-de8d07df-4064-4784-847f-afe37e405950 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:57.136535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-de8d07df-4064-4784-847f-afe37e405950 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:57.137943 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-de8d07df-4064-4784-847f-afe37e405950 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:57.978288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fdf7e0a4-0fef-4fe2-8c98-0b9b0b96b34a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:57.992075 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fdf7e0a4-0fef-4fe2-8c98-0b9b0b96b34a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1198 microversion: 2.1 time: 1.056788 Jul 31 01:13:57.994315 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 841/1714] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:56 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1198 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:58.007223 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3b2920f8-0c34-4582-86ab-af501a67262a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:58.009992 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3b2920f8-0c34-4582-86ab-af501a67262a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:58.023549 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b2920f8-0c34-4582-86ab-af501a67262a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:58.027135 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b2920f8-0c34-4582-86ab-af501a67262a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:58.034512 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b2920f8-0c34-4582-86ab-af501a67262a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:58.035410 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b2920f8-0c34-4582-86ab-af501a67262a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:58.341010 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-de8d07df-4064-4784-847f-afe37e405950 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755582e730334e69bb29408920a6625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431dbca9a24393bbfb2f51bfcff27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:58.352893 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-de8d07df-4064-4784-847f-afe37e405950 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 200 len: 1528 microversion: 2.1 time: 1.233219 Jul 31 01:13:58.372440 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 874/1715] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:57 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 1528 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:13:58.381915 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-936b7333-2cbb-4e7a-8a6b-bfe0abfa541c req-eab408a8-8f73-456e-b1e5-838f6b53adc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1062351b-6cff-4363-a029-ddfbb14c6f72", "tag": "21c27aad-5f1a-4ce4-aa63-e68cdcf475fe"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:58.424527 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-936b7333-2cbb-4e7a-8a6b-bfe0abfa541c req-eab408a8-8f73-456e-b1e5-838f6b53adc9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:58.426076 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-936b7333-2cbb-4e7a-8a6b-bfe0abfa541c req-eab408a8-8f73-456e-b1e5-838f6b53adc9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:58.495940 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-936b7333-2cbb-4e7a-8a6b-bfe0abfa541c req-eab408a8-8f73-456e-b1e5-838f6b53adc9 service nova] Creating event network-changed:21c27aad-5f1a-4ce4-aa63-e68cdcf475fe for instance 1062351b-6cff-4363-a029-ddfbb14c6f72 on n-h2-master-1 Jul 31 01:13:58.517456 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-936b7333-2cbb-4e7a-8a6b-bfe0abfa541c req-eab408a8-8f73-456e-b1e5-838f6b53adc9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141006 Jul 31 01:13:58.519545 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 875/1716] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:58.531176 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6eae9668-d469-467f-99cc-78614020600c tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:58.547055 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6eae9668-d469-467f-99cc-78614020600c tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:58.566294 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6eae9668-d469-467f-99cc-78614020600c tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:58.567968 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6eae9668-d469-467f-99cc-78614020600c tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:58.571039 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6eae9668-d469-467f-99cc-78614020600c tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:58.572751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6eae9668-d469-467f-99cc-78614020600c tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:59.025462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b2920f8-0c34-4582-86ab-af501a67262a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:59.040275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b2920f8-0c34-4582-86ab-af501a67262a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:59.045177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b2920f8-0c34-4582-86ab-af501a67262a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:59.048998 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3b2920f8-0c34-4582-86ab-af501a67262a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 1.050621 Jul 31 01:13:59.051908 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 842/1717] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:13:57 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:13:59.079025 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-da8a1068-37f1-4490-8f5b-80d357e85394 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:59.080253 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-da8a1068-37f1-4490-8f5b-80d357e85394 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:59.088980 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da8a1068-37f1-4490-8f5b-80d357e85394 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:59.089707 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da8a1068-37f1-4490-8f5b-80d357e85394 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:59.091218 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da8a1068-37f1-4490-8f5b-80d357e85394 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:59.107426 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da8a1068-37f1-4490-8f5b-80d357e85394 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:59.409518 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6eae9668-d469-467f-99cc-78614020600c tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:59.421121 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6eae9668-d469-467f-99cc-78614020600c tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1316 microversion: 2.1 time: 0.898477 Jul 31 01:13:59.421938 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 876/1718] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:58 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1316 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:59.430946 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-3320533f-2da4-42b8-a6c9-39a0e1ff2912 req-d8143499-65bb-484d-bf48-3a9c718e9395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b840182-0fef-4cd6-be37-17f8a4f0025d", "tag": "f3011ab8-3ce2-4421-a217-91dc0c5473a2"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:13:59.456413 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3320533f-2da4-42b8-a6c9-39a0e1ff2912 req-d8143499-65bb-484d-bf48-3a9c718e9395 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:59.463395 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3320533f-2da4-42b8-a6c9-39a0e1ff2912 req-d8143499-65bb-484d-bf48-3a9c718e9395 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:59.494309 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-3320533f-2da4-42b8-a6c9-39a0e1ff2912 req-d8143499-65bb-484d-bf48-3a9c718e9395 service nova] Creating event network-changed:f3011ab8-3ce2-4421-a217-91dc0c5473a2 for instance 0b840182-0fef-4cd6-be37-17f8a4f0025d on n-h1-master-1 Jul 31 01:13:59.506337 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-3320533f-2da4-42b8-a6c9-39a0e1ff2912 req-d8143499-65bb-484d-bf48-3a9c718e9395 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082893 Jul 31 01:13:59.507358 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 877/1719] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:13:59.512816 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c7186d79-c6f1-46bd-9209-80542616b71c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:59.519941 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c7186d79-c6f1-46bd-9209-80542616b71c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:59.535770 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7186d79-c6f1-46bd-9209-80542616b71c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:59.536937 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7186d79-c6f1-46bd-9209-80542616b71c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:59.537764 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7186d79-c6f1-46bd-9209-80542616b71c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:59.538209 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7186d79-c6f1-46bd-9209-80542616b71c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:59.931545 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-da8a1068-37f1-4490-8f5b-80d357e85394 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:13:59.946061 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-da8a1068-37f1-4490-8f5b-80d357e85394 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d" status: 200 len: 1308 microversion: 2.1 time: 0.879120 Jul 31 01:13:59.946973 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 843/1720] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:59 2022] GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d => generated 1308 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:13:59.952186 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-53caff77-79d1-47a0-b00a-9674eb8bd8f0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:13:59.952811 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-53caff77-79d1-47a0-b00a-9674eb8bd8f0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:13:59.977055 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53caff77-79d1-47a0-b00a-9674eb8bd8f0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:59.977507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53caff77-79d1-47a0-b00a-9674eb8bd8f0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:13:59.978303 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53caff77-79d1-47a0-b00a-9674eb8bd8f0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:13:59.978742 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53caff77-79d1-47a0-b00a-9674eb8bd8f0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:00.327859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-53caff77-79d1-47a0-b00a-9674eb8bd8f0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755582e730334e69bb29408920a6625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431dbca9a24393bbfb2f51bfcff27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:00.347800 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-53caff77-79d1-47a0-b00a-9674eb8bd8f0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 200 len: 1486 microversion: 2.1 time: 0.394218 Jul 31 01:14:00.355720 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 844/1721] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:59 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 1486 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:00.365354 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-961afd09-5e04-49bb-9bd9-1fe520989eed req-e1cb98bc-49d9-4594-8445-e25f36c0ea5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f5a418-18ef-4735-bea0-a0c123be5253", "name": "network-vif-plugged", "status": "completed", "tag": "bddb160a-16a2-4712-b3ca-74f0c5aff9fe"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:00.383240 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-961afd09-5e04-49bb-9bd9-1fe520989eed req-e1cb98bc-49d9-4594-8445-e25f36c0ea5d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:00.385436 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-961afd09-5e04-49bb-9bd9-1fe520989eed req-e1cb98bc-49d9-4594-8445-e25f36c0ea5d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:00.407374 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-961afd09-5e04-49bb-9bd9-1fe520989eed req-e1cb98bc-49d9-4594-8445-e25f36c0ea5d service nova] Creating event network-vif-plugged:bddb160a-16a2-4712-b3ca-74f0c5aff9fe for instance 42f5a418-18ef-4735-bea0-a0c123be5253 on n-h1-master-1 Jul 31 01:14:00.412977 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-961afd09-5e04-49bb-9bd9-1fe520989eed req-e1cb98bc-49d9-4594-8445-e25f36c0ea5d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055362 Jul 31 01:14:00.414107 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 845/1722] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:14:00.429566 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-765ef804-97a9-49bb-8174-f9bf0a3f0307 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:00.430559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-765ef804-97a9-49bb-8174-f9bf0a3f0307 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:00.444280 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-765ef804-97a9-49bb-8174-f9bf0a3f0307 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:00.445723 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-765ef804-97a9-49bb-8174-f9bf0a3f0307 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:00.447312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-765ef804-97a9-49bb-8174-f9bf0a3f0307 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:00.448730 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-765ef804-97a9-49bb-8174-f9bf0a3f0307 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:00.459628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c7186d79-c6f1-46bd-9209-80542616b71c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:00.472028 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c7186d79-c6f1-46bd-9209-80542616b71c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1198 microversion: 2.1 time: 0.963248 Jul 31 01:14:00.488051 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 878/1723] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:13:59 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1198 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:00.496879 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9776836a-3080-43f1-8490-f8fdd8245ad5 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:00.499933 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9776836a-3080-43f1-8490-f8fdd8245ad5 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:00.511032 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9776836a-3080-43f1-8490-f8fdd8245ad5 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:00.513318 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9776836a-3080-43f1-8490-f8fdd8245ad5 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:00.514162 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9776836a-3080-43f1-8490-f8fdd8245ad5 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:00.514619 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9776836a-3080-43f1-8490-f8fdd8245ad5 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:00.971201 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9776836a-3080-43f1-8490-f8fdd8245ad5 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:00.975870 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-765ef804-97a9-49bb-8174-f9bf0a3f0307 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:00.989443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-765ef804-97a9-49bb-8174-f9bf0a3f0307 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:00.991174 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-765ef804-97a9-49bb-8174-f9bf0a3f0307 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:00.992464 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-765ef804-97a9-49bb-8174-f9bf0a3f0307 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 0.577158 Jul 31 01:14:00.993491 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 846/1724] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:00 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:00.994407 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9776836a-3080-43f1-8490-f8fdd8245ad5 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1316 microversion: 2.1 time: 0.505330 Jul 31 01:14:01.000124 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 879/1725] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:00 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1316 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:01.012231 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-12d45cbd-ad38-443d-953f-beaf5cd7dd12 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:01.013791 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-12d45cbd-ad38-443d-953f-beaf5cd7dd12 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:01.027179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12d45cbd-ad38-443d-953f-beaf5cd7dd12 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:01.028527 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12d45cbd-ad38-443d-953f-beaf5cd7dd12 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:01.030207 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12d45cbd-ad38-443d-953f-beaf5cd7dd12 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:01.030975 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12d45cbd-ad38-443d-953f-beaf5cd7dd12 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:01.032191 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7b47b876-802b-49dd-b0a5-ec03d75a1a56 req-2d21951d-dbcc-4c17-bd08-7ff6a0685bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17392cf-3f17-483a-89cb-0d7bb436bca7", "name": "network-vif-unplugged", "status": "completed", "tag": "67a0c9d8-8bc9-4aab-8068-662a2a37147f"}, {"name": "network-changed", "server_uuid": "b17392cf-3f17-483a-89cb-0d7bb436bca7", "tag": "67a0c9d8-8bc9-4aab-8068-662a2a37147f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:01.086853 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7b47b876-802b-49dd-b0a5-ec03d75a1a56 req-2d21951d-dbcc-4c17-bd08-7ff6a0685bc1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:01.087375 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7b47b876-802b-49dd-b0a5-ec03d75a1a56 req-2d21951d-dbcc-4c17-bd08-7ff6a0685bc1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:01.114155 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7b47b876-802b-49dd-b0a5-ec03d75a1a56 req-2d21951d-dbcc-4c17-bd08-7ff6a0685bc1 service nova] Creating event network-vif-unplugged:67a0c9d8-8bc9-4aab-8068-662a2a37147f for instance b17392cf-3f17-483a-89cb-0d7bb436bca7 on n-h2-master-1 Jul 31 01:14:01.122431 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7b47b876-802b-49dd-b0a5-ec03d75a1a56 req-2d21951d-dbcc-4c17-bd08-7ff6a0685bc1 service nova] Creating event network-changed:67a0c9d8-8bc9-4aab-8068-662a2a37147f for instance b17392cf-3f17-483a-89cb-0d7bb436bca7 on n-h2-master-1 Jul 31 01:14:01.134112 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7b47b876-802b-49dd-b0a5-ec03d75a1a56 req-2d21951d-dbcc-4c17-bd08-7ff6a0685bc1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.139380 Jul 31 01:14:01.136936 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 847/1726] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:14:01.371250 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3e66261d-d90b-4f1a-9052-a41edce7c749 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:01.372769 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3e66261d-d90b-4f1a-9052-a41edce7c749 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:01.387551 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e66261d-d90b-4f1a-9052-a41edce7c749 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:01.388063 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e66261d-d90b-4f1a-9052-a41edce7c749 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:01.388843 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e66261d-d90b-4f1a-9052-a41edce7c749 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:01.389480 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e66261d-d90b-4f1a-9052-a41edce7c749 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:01.433088 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-12d45cbd-ad38-443d-953f-beaf5cd7dd12 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:01.442787 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-12d45cbd-ad38-443d-953f-beaf5cd7dd12 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d" status: 200 len: 1308 microversion: 2.1 time: 0.441302 Jul 31 01:14:01.458132 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 880/1727] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:01 2022] GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:01.463208 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e66261d-d90b-4f1a-9052-a41edce7c749 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:01.463695 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e66261d-d90b-4f1a-9052-a41edce7c749 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:01.464156 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-3e66261d-d90b-4f1a-9052-a41edce7c749 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lazy-loading 'fault' on Instance uuid c39424d9-338d-407b-822f-2ed61e7c0c65 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:14:01.498254 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6464ef98-1114-400c-92ba-784e64af96c7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:01.498874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6464ef98-1114-400c-92ba-784e64af96c7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:01.501563 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:01.511895 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6464ef98-1114-400c-92ba-784e64af96c7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:01.524135 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6464ef98-1114-400c-92ba-784e64af96c7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:01.525339 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6464ef98-1114-400c-92ba-784e64af96c7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:01.525963 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6464ef98-1114-400c-92ba-784e64af96c7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:01.665001 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3e66261d-d90b-4f1a-9052-a41edce7c749 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755582e730334e69bb29408920a6625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03431dbca9a24393bbfb2f51bfcff27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:01.674053 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3e66261d-d90b-4f1a-9052-a41edce7c749 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 200 len: 1315 microversion: 2.1 time: 0.307786 Jul 31 01:14:01.678140 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 848/1728] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:01 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:01.695848 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-04a657ef-8f4a-4735-951d-8d5c61f1264c req-86252bd7-8aa7-4fea-8d2d-2fdc72328081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39424d9-338d-407b-822f-2ed61e7c0c65", "name": "network-vif-deleted", "tag": "67f63173-236d-4edb-a5e5-e7680a8bb262"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:01.716301 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-04a657ef-8f4a-4735-951d-8d5c61f1264c req-86252bd7-8aa7-4fea-8d2d-2fdc72328081 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:01.729512 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-04a657ef-8f4a-4735-951d-8d5c61f1264c req-86252bd7-8aa7-4fea-8d2d-2fdc72328081 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:01.751959 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-04a657ef-8f4a-4735-951d-8d5c61f1264c req-86252bd7-8aa7-4fea-8d2d-2fdc72328081 service nova] Creating event network-vif-deleted:67f63173-236d-4edb-a5e5-e7680a8bb262 for instance c39424d9-338d-407b-822f-2ed61e7c0c65 on n-h1-master-1 Jul 31 01:14:01.761239 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-04a657ef-8f4a-4735-951d-8d5c61f1264c req-86252bd7-8aa7-4fea-8d2d-2fdc72328081 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081173 Jul 31 01:14:01.762959 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 849/1729] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:14:01.908744 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6464ef98-1114-400c-92ba-784e64af96c7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:01.921026 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6464ef98-1114-400c-92ba-784e64af96c7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1198 microversion: 2.1 time: 0.426483 Jul 31 01:14:01.921980 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 881/1730] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:01 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1198 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:02.038843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ded2c821-6c02-4d67-a0f9-9a4318a8c8dc tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:02.040196 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ded2c821-6c02-4d67-a0f9-9a4318a8c8dc tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:02.041754 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-80f0e80f-2306-4710-a89d-0cb45af8c959 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:02.044835 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-80f0e80f-2306-4710-a89d-0cb45af8c959 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:02.072314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ded2c821-6c02-4d67-a0f9-9a4318a8c8dc tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:02.072828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ded2c821-6c02-4d67-a0f9-9a4318a8c8dc tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:02.075245 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80f0e80f-2306-4710-a89d-0cb45af8c959 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:02.079471 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ded2c821-6c02-4d67-a0f9-9a4318a8c8dc tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:02.080412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80f0e80f-2306-4710-a89d-0cb45af8c959 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:02.081110 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ded2c821-6c02-4d67-a0f9-9a4318a8c8dc tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:02.087896 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80f0e80f-2306-4710-a89d-0cb45af8c959 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:02.091493 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80f0e80f-2306-4710-a89d-0cb45af8c959 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:03.169044 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ded2c821-6c02-4d67-a0f9-9a4318a8c8dc tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:03.183571 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ded2c821-6c02-4d67-a0f9-9a4318a8c8dc tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1316 microversion: 2.1 time: 1.158860 Jul 31 01:14:03.185218 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 882/1731] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:02 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1316 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:03.205832 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-52aba13f-2cb6-4078-87f7-be0fb0d977bb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:03.210873 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-52aba13f-2cb6-4078-87f7-be0fb0d977bb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:03.239181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52aba13f-2cb6-4078-87f7-be0fb0d977bb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:03.240041 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52aba13f-2cb6-4078-87f7-be0fb0d977bb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:03.241542 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52aba13f-2cb6-4078-87f7-be0fb0d977bb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:03.247595 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52aba13f-2cb6-4078-87f7-be0fb0d977bb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:03.261011 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-80f0e80f-2306-4710-a89d-0cb45af8c959 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:03.282215 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-80f0e80f-2306-4710-a89d-0cb45af8c959 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:03.289364 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-80f0e80f-2306-4710-a89d-0cb45af8c959 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:03.291276 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-80f0e80f-2306-4710-a89d-0cb45af8c959 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 1.275933 Jul 31 01:14:03.295660 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 850/1732] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:02 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:03.632341 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a721d485-5080-47cc-a155-06a47d339a2b tempest-TenantUsagesNegativeTestJSON-685036289 tempest-TenantUsagesNegativeTestJSON-685036289-project-admin] 10.222.0.45 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-30T01%3A14%3A02.653866&end=2022-08-01T01%3A14%3A02.653866" status: 404 len: 112 microversion: - time: 0.333811 Jul 31 01:14:03.633237 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 851/1733] 10.222.0.45 () {58 vars in 1316 bytes} [Sun Jul 31 01:14:03 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-30T01%3A14%3A02.653866&end=2022-08-01T01%3A14%3A02.653866 => generated 112 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 31 01:14:03.647117 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dd8f27b1-e4dd-4100-8378-b887c0e609c0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:03.648631 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dd8f27b1-e4dd-4100-8378-b887c0e609c0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] [instance: c39424d9-338d-407b-822f-2ed61e7c0c65] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:03.660374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd8f27b1-e4dd-4100-8378-b887c0e609c0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:03.661378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd8f27b1-e4dd-4100-8378-b887c0e609c0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:03.662780 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd8f27b1-e4dd-4100-8378-b887c0e609c0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:03.663565 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd8f27b1-e4dd-4100-8378-b887c0e609c0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:03.700144 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-dd8f27b1-e4dd-4100-8378-b887c0e609c0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] HTTP exception thrown: Instance c39424d9-338d-407b-822f-2ed61e7c0c65 could not be found. Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dd8f27b1-e4dd-4100-8378-b887c0e609c0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Request method failure captured: Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 HTTP/1.1 Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dcszE6-1XzDGq-pY8kp5ledF-l8WRIu50epVTkSRQQWV1b8tGvABPwXaJGGTRHLgNIRWWekzjBac7dHk2Y2HAHUTZ2hjwjyHpotBvSp5XVha1PiYGh9euZMVgbIcqeu4U3Mno4uh1ao7MWOSWxjVAvLMmKCi1nEiLPa5YkjcgazYmQ Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 03431dbca9a24393bbfb2f51bfcff27e Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1135799302 Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03431dbca9a24393bbfb2f51bfcff27e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03431dbca9a24393bbfb2f51bfcff27e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/03431dbca9a24393bbfb2f51bfcff27e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_03431dbca9a24393bbfb2f51bfcff27e", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1135799302 Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 03431dbca9a24393bbfb2f51bfcff27e Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1135799302 Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerAddressesNegativeTestJSON-1135799302-project Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 755582e730334e69bb29408920a6625e Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1135799302-project Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: exception: Instance c39424d9-338d-407b-822f-2ed61e7c0c65 could not be found. Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'c39424d9-338d-407b-822f-2ed61e7c0c65'} Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c39424d9-338d-407b-822f-2ed61e7c0c65 could not be found. Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c39424d9-338d-407b-822f-2ed61e7c0c65 could not be found. Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:14:03.703253 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:14:03.709265 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:14:03.709265 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:14:03.709265 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:14:03.709265 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:14:03.709265 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:14:03.709265 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:14:03.709265 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c39424d9-338d-407b-822f-2ed61e7c0c65 could not be found. Jul 31 01:14:03.709265 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:14:03.711105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dd8f27b1-e4dd-4100-8378-b887c0e609c0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] Returning 404 to user: Instance c39424d9-338d-407b-822f-2ed61e7c0c65 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:14:03.713389 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dd8f27b1-e4dd-4100-8378-b887c0e609c0 tempest-ServerAddressesNegativeTestJSON-1135799302 tempest-ServerAddressesNegativeTestJSON-1135799302-project] 10.222.0.45 "GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65" status: 404 len: 111 microversion: 2.1 time: 0.078594 Jul 31 01:14:03.714796 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 852/1734] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:03 2022] GET /compute/v2.1/servers/c39424d9-338d-407b-822f-2ed61e7c0c65 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:14:03.721880 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-773dc95c-1454-408b-bea4-fdcba6c5139d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:03.722722 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-773dc95c-1454-408b-bea4-fdcba6c5139d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:03.729769 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-773dc95c-1454-408b-bea4-fdcba6c5139d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:03.730554 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-773dc95c-1454-408b-bea4-fdcba6c5139d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:03.732533 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-773dc95c-1454-408b-bea4-fdcba6c5139d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:03.733243 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-773dc95c-1454-408b-bea4-fdcba6c5139d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:03.758066 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-52aba13f-2cb6-4078-87f7-be0fb0d977bb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:03.769025 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-52aba13f-2cb6-4078-87f7-be0fb0d977bb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d" status: 200 len: 1308 microversion: 2.1 time: 0.580421 Jul 31 01:14:03.772569 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 883/1735] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:03 2022] GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d => generated 1308 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:03.807505 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b60af4ab-54a2-4c89-8d9c-75c580a814c5 tempest-TenantUsagesNegativeTestJSON-685036289 tempest-TenantUsagesNegativeTestJSON-685036289-project-admin] Calling method '.version_select at 0x7fedea9e8820>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:03.836600 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-b60af4ab-54a2-4c89-8d9c-75c580a814c5 tempest-TenantUsagesNegativeTestJSON-685036289 tempest-TenantUsagesNegativeTestJSON-685036289-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b60af4ab-54a2-4c89-8d9c-75c580a814c5 tempest-TenantUsagesNegativeTestJSON-685036289 tempest-TenantUsagesNegativeTestJSON-685036289-project-admin] Request method failure captured: Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-simple-tenant-usage/260cc7deabe648ef86d174aad10ed82d?start=2022-08-01T01%3A14%3A02.653866&end=2022-07-30T01%3A14%3A02.653866 HTTP/1.1 Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5ddaI0HX0Clc_GkdgsvB1bq4xgrfwP-8V5n3Mc4w0HLqVRh87OZjxUDj8EuMF_A_pdrN0BFBUyIwJMEayZ8t-4bI11GmBAwd5EjqbVrTcfv1x2EndSx6cZPvrSRQS9rCnC_E6acQQcUg0yvlUEoiKlksH-hQo4VkoZ1knhzfYv3PcoI Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 5d67c297278a40d7b61f207a4ea50f95 Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-685036289 Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5d67c297278a40d7b61f207a4ea50f95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5d67c297278a40d7b61f207a4ea50f95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5d67c297278a40d7b61f207a4ea50f95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5d67c297278a40d7b61f207a4ea50f95", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-685036289 Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 5d67c297278a40d7b61f207a4ea50f95 Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-685036289 Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TenantUsagesNegativeTestJSON-685036289-project-admin Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: a05a631a99384372bd4bb57e215cfb43 Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-685036289-project-admin Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid start time. The start time cannot occur after the end time. Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '260cc7deabe648ef86d174aad10ed82d'} Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 31 01:14:03.838713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:14:03.847816 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b60af4ab-54a2-4c89-8d9c-75c580a814c5 tempest-TenantUsagesNegativeTestJSON-685036289 tempest-TenantUsagesNegativeTestJSON-685036289-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:14:03.849009 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b60af4ab-54a2-4c89-8d9c-75c580a814c5 tempest-TenantUsagesNegativeTestJSON-685036289 tempest-TenantUsagesNegativeTestJSON-685036289-project-admin] 10.222.0.45 "GET /compute/v2.1/os-simple-tenant-usage/260cc7deabe648ef86d174aad10ed82d?start=2022-08-01T01%3A14%3A02.653866&end=2022-07-30T01%3A14%3A02.653866" status: 400 len: 111 microversion: 2.1 time: 0.056013 Jul 31 01:14:03.852286 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 884/1736] 10.222.0.45 () {58 vars in 1412 bytes} [Sun Jul 31 01:14:03 2022] GET /compute/v2.1/os-simple-tenant-usage/260cc7deabe648ef86d174aad10ed82d?start=2022-08-01T01%3A14%3A02.653866&end=2022-07-30T01%3A14%3A02.653866 => generated 111 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:14:03.861626 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-e1aa142c-c63c-457b-9597-2d79dfc7b03c req-300c6f0f-c7c3-4ae6-999c-849f27bc7e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c64a12-7c3e-41f9-91d1-b82820b3cd08", "name": "network-vif-plugged", "status": "completed", "tag": "34a0bfd7-254c-4a84-8f10-da931e137ce2"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:03.900619 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e1aa142c-c63c-457b-9597-2d79dfc7b03c req-300c6f0f-c7c3-4ae6-999c-849f27bc7e8a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:03.909024 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e1aa142c-c63c-457b-9597-2d79dfc7b03c req-300c6f0f-c7c3-4ae6-999c-849f27bc7e8a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:03.933261 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-e1aa142c-c63c-457b-9597-2d79dfc7b03c req-300c6f0f-c7c3-4ae6-999c-849f27bc7e8a service nova] Creating event network-vif-plugged:34a0bfd7-254c-4a84-8f10-da931e137ce2 for instance f7c64a12-7c3e-41f9-91d1-b82820b3cd08 on n-h2-master-1 Jul 31 01:14:03.950509 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-e1aa142c-c63c-457b-9597-2d79dfc7b03c req-300c6f0f-c7c3-4ae6-999c-849f27bc7e8a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095980 Jul 31 01:14:03.952063 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 885/1737] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:14:04.178732 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-697bf281-e00e-4c60-babe-4ac6baa42900 tempest-TenantUsagesNegativeTestJSON-2012834726 tempest-TenantUsagesNegativeTestJSON-2012834726-project] Calling method '.version_select at 0x7fedeaa07670>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:04.188037 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-697bf281-e00e-4c60-babe-4ac6baa42900 tempest-TenantUsagesNegativeTestJSON-2012834726 tempest-TenantUsagesNegativeTestJSON-2012834726-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '8a4f68964c84428c861cb4151e6a3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260cc7deabe648ef86d174aad10ed82d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-697bf281-e00e-4c60-babe-4ac6baa42900 tempest-TenantUsagesNegativeTestJSON-2012834726 tempest-TenantUsagesNegativeTestJSON-2012834726-project] Request method failure captured: Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-30T01%3A14%3A02.653866&end=2022-08-01T01%3A14%3A02.653866&detailed=1 HTTP/1.1 Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5ddZeBUoAEmFfTA5HQY-oQNeQ1Ev70_efPGzA_8VKDWWzugE48r4k5Oj0NkCYmmqmC0J6Ll3ecKDVUwzn21PbOI64KxoOk4ADA7n1JvByPPPOMkDa5dsqzQrgqhI0u9d-F_MIxzJooAliX2J9ansshJV51uUiylYfDolX7d8dtk3Hxk Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 260cc7deabe648ef86d174aad10ed82d Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2012834726 Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/260cc7deabe648ef86d174aad10ed82d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/260cc7deabe648ef86d174aad10ed82d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/260cc7deabe648ef86d174aad10ed82d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_260cc7deabe648ef86d174aad10ed82d", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2012834726 Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 260cc7deabe648ef86d174aad10ed82d Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2012834726 Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TenantUsagesNegativeTestJSON-2012834726-project Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 8a4f68964c84428c861cb4151e6a3b3a Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2012834726-project Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: action_args: {} Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:14:04.196978 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:14:04.202191 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 31 01:14:04.202191 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:14:04.202191 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:14:04.202191 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:14:04.202191 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:14:04.202191 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:14:04.202191 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:14:04.202191 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:14:04.202191 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:14:04.202191 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 31 01:14:04.202191 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:14:04.204745 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-697bf281-e00e-4c60-babe-4ac6baa42900 tempest-TenantUsagesNegativeTestJSON-2012834726 tempest-TenantUsagesNegativeTestJSON-2012834726-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:14:04.207854 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-697bf281-e00e-4c60-babe-4ac6baa42900 tempest-TenantUsagesNegativeTestJSON-2012834726 tempest-TenantUsagesNegativeTestJSON-2012834726-project] 10.222.0.45 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-30T01%3A14%3A02.653866&end=2022-08-01T01%3A14%3A02.653866&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.254190 Jul 31 01:14:04.208632 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 886/1738] 10.222.0.45 () {58 vars in 1335 bytes} [Sun Jul 31 01:14:03 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-30T01%3A14%3A02.653866&end=2022-08-01T01%3A14%3A02.653866&detailed=1 => generated 123 bytes in 256 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:14:04.242961 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bfe0f1a2-f707-41b5-8154-594736cfb0e0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:04.244116 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bfe0f1a2-f707-41b5-8154-594736cfb0e0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:04.260936 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bfe0f1a2-f707-41b5-8154-594736cfb0e0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:04.265582 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bfe0f1a2-f707-41b5-8154-594736cfb0e0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:04.267332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bfe0f1a2-f707-41b5-8154-594736cfb0e0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:04.267496 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-773dc95c-1454-408b-bea4-fdcba6c5139d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:04.268569 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bfe0f1a2-f707-41b5-8154-594736cfb0e0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:04.280400 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-773dc95c-1454-408b-bea4-fdcba6c5139d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1198 microversion: 2.1 time: 0.562693 Jul 31 01:14:04.281323 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 853/1739] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:03 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1198 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:04.327984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ab78994b-bdd9-4b22-b36c-f09f4ea82051 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:04.328860 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ab78994b-bdd9-4b22-b36c-f09f4ea82051 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:04.343784 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab78994b-bdd9-4b22-b36c-f09f4ea82051 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:04.344307 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab78994b-bdd9-4b22-b36c-f09f4ea82051 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:04.348784 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab78994b-bdd9-4b22-b36c-f09f4ea82051 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:04.349263 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab78994b-bdd9-4b22-b36c-f09f4ea82051 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:04.725547 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bfe0f1a2-f707-41b5-8154-594736cfb0e0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:04.738922 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bfe0f1a2-f707-41b5-8154-594736cfb0e0 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1505 microversion: 2.1 time: 0.509123 Jul 31 01:14:04.755363 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 887/1740] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:04 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1505 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:04.773069 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3bb59488-dedf-480a-9f4c-48ebfdc3d852 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:04.773630 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3bb59488-dedf-480a-9f4c-48ebfdc3d852 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:04.787865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bb59488-dedf-480a-9f4c-48ebfdc3d852 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:04.789189 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bb59488-dedf-480a-9f4c-48ebfdc3d852 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:04.792386 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bb59488-dedf-480a-9f4c-48ebfdc3d852 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:04.793092 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bb59488-dedf-480a-9f4c-48ebfdc3d852 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:04.803508 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ab78994b-bdd9-4b22-b36c-f09f4ea82051 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:04.823682 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ab78994b-bdd9-4b22-b36c-f09f4ea82051 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:04.829802 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ab78994b-bdd9-4b22-b36c-f09f4ea82051 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:04.835518 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ab78994b-bdd9-4b22-b36c-f09f4ea82051 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 0.514385 Jul 31 01:14:04.856346 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 854/1741] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:04 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:14:04.880645 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3bb59488-dedf-480a-9f4c-48ebfdc3d852 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:04.881910 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3bb59488-dedf-480a-9f4c-48ebfdc3d852 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253/os-instance-actions/req-42914e09-a48c-4815-92cd-f98f8a865ec0" status: 200 len: 313 microversion: 2.1 time: 0.113563 Jul 31 01:14:04.882801 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-23a25eee-eb66-4e49-9162-a2edbad59d18 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:04.883142 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 888/1742] 10.222.0.45 () {58 vars in 1419 bytes} [Sun Jul 31 01:14:04 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253/os-instance-actions/req-42914e09-a48c-4815-92cd-f98f8a865ec0 => generated 313 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:14:04.884830 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-23a25eee-eb66-4e49-9162-a2edbad59d18 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:04.893832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23a25eee-eb66-4e49-9162-a2edbad59d18 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:04.898613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23a25eee-eb66-4e49-9162-a2edbad59d18 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:04.906114 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6a1d7cf4-e8e7-4ac1-87ee-63d1328bec7b tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:04.908609 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6a1d7cf4-e8e7-4ac1-87ee-63d1328bec7b tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:04.915854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23a25eee-eb66-4e49-9162-a2edbad59d18 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:04.917870 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23a25eee-eb66-4e49-9162-a2edbad59d18 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:04.928581 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a1d7cf4-e8e7-4ac1-87ee-63d1328bec7b tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:04.929062 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a1d7cf4-e8e7-4ac1-87ee-63d1328bec7b tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:04.931749 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a1d7cf4-e8e7-4ac1-87ee-63d1328bec7b tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:04.932148 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a1d7cf4-e8e7-4ac1-87ee-63d1328bec7b tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:05.129562 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6a1d7cf4-e8e7-4ac1-87ee-63d1328bec7b tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "POST /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253/action" status: 202 len: 0 microversion: 2.1 time: 0.223679 Jul 31 01:14:05.131355 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 889/1743] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:14:04 2022] POST /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:14:05.146512 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c46655ac-54b4-4dc6-bcc6-6bbc703ddef8 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:05.148681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c46655ac-54b4-4dc6-bcc6-6bbc703ddef8 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:05.163391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c46655ac-54b4-4dc6-bcc6-6bbc703ddef8 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:05.166273 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c46655ac-54b4-4dc6-bcc6-6bbc703ddef8 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:05.166999 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c46655ac-54b4-4dc6-bcc6-6bbc703ddef8 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:05.167501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c46655ac-54b4-4dc6-bcc6-6bbc703ddef8 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:05.182827 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:05.469261 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-23a25eee-eb66-4e49-9162-a2edbad59d18 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:05.512467 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-23a25eee-eb66-4e49-9162-a2edbad59d18 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d" status: 200 len: 1308 microversion: 2.1 time: 0.645582 Jul 31 01:14:05.516450 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 855/1744] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:04 2022] GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d => generated 1308 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:05.542927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d196e130-d0ff-4e42-9f69-9e3d4cc8324d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:05.544925 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d196e130-d0ff-4e42-9f69-9e3d4cc8324d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:05.583891 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d196e130-d0ff-4e42-9f69-9e3d4cc8324d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:05.586050 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d196e130-d0ff-4e42-9f69-9e3d4cc8324d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:05.595374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d196e130-d0ff-4e42-9f69-9e3d4cc8324d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:05.597200 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d196e130-d0ff-4e42-9f69-9e3d4cc8324d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:05.822572 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c46655ac-54b4-4dc6-bcc6-6bbc703ddef8 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:05.841185 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c46655ac-54b4-4dc6-bcc6-6bbc703ddef8 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1507 microversion: 2.1 time: 0.704309 Jul 31 01:14:05.843012 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 890/1745] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:05 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1507 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:05.870726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3c44e7c9-92b0-494e-a8b6-fa95a2171789 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:05.871588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3c44e7c9-92b0-494e-a8b6-fa95a2171789 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:05.882650 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c44e7c9-92b0-494e-a8b6-fa95a2171789 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:05.886114 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c44e7c9-92b0-494e-a8b6-fa95a2171789 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:05.888602 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c44e7c9-92b0-494e-a8b6-fa95a2171789 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:05.889406 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c44e7c9-92b0-494e-a8b6-fa95a2171789 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:06.017412 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d196e130-d0ff-4e42-9f69-9e3d4cc8324d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:06.046056 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d196e130-d0ff-4e42-9f69-9e3d4cc8324d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1381 microversion: 2.1 time: 0.525170 Jul 31 01:14:06.047398 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 856/1746] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:05 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1381 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:06.239647 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3c44e7c9-92b0-494e-a8b6-fa95a2171789 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:06.253972 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3c44e7c9-92b0-494e-a8b6-fa95a2171789 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:06.257964 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3c44e7c9-92b0-494e-a8b6-fa95a2171789 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:06.266480 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3c44e7c9-92b0-494e-a8b6-fa95a2171789 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 0.397403 Jul 31 01:14:06.269107 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 891/1747] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:05 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:14:06.538995 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-372849d5-6450-446c-838f-384c17db205e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:06.539713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-372849d5-6450-446c-838f-384c17db205e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:06.551009 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-372849d5-6450-446c-838f-384c17db205e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:06.553630 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-372849d5-6450-446c-838f-384c17db205e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:06.556361 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-372849d5-6450-446c-838f-384c17db205e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:06.556869 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-372849d5-6450-446c-838f-384c17db205e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:06.602902 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-986bdbb6-dad3-4506-94b4-495a862a872e tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:06.603580 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-986bdbb6-dad3-4506-94b4-495a862a872e tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:06.616158 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-986bdbb6-dad3-4506-94b4-495a862a872e tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:06.616619 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-986bdbb6-dad3-4506-94b4-495a862a872e tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:06.622648 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-986bdbb6-dad3-4506-94b4-495a862a872e tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:06.625402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-986bdbb6-dad3-4506-94b4-495a862a872e tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:06.819112 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-372849d5-6450-446c-838f-384c17db205e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:06.831775 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-372849d5-6450-446c-838f-384c17db205e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d" status: 200 len: 1308 microversion: 2.1 time: 0.297079 Jul 31 01:14:06.832422 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 892/1748] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:06 2022] GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:06.864903 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f832e7f9-9e96-4057-8866-deafc147f5ba tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:06.866210 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f832e7f9-9e96-4057-8866-deafc147f5ba tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:06.876487 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f832e7f9-9e96-4057-8866-deafc147f5ba tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:06.876487 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f832e7f9-9e96-4057-8866-deafc147f5ba tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:06.881397 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-986bdbb6-dad3-4506-94b4-495a862a872e tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1532 microversion: 2.1 time: 0.814202 Jul 31 01:14:06.882401 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f832e7f9-9e96-4057-8866-deafc147f5ba tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:06.882996 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 857/1749] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:06 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1532 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:06.883737 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f832e7f9-9e96-4057-8866-deafc147f5ba tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:06.903732 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1655647d-0973-40a3-ab12-a199121303a3 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:06.904787 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1655647d-0973-40a3-ab12-a199121303a3 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:06.913276 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1655647d-0973-40a3-ab12-a199121303a3 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:06.914313 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1655647d-0973-40a3-ab12-a199121303a3 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:06.915823 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1655647d-0973-40a3-ab12-a199121303a3 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:06.916360 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1655647d-0973-40a3-ab12-a199121303a3 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:07.296553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f832e7f9-9e96-4057-8866-deafc147f5ba tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:07.309873 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f832e7f9-9e96-4057-8866-deafc147f5ba tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1507 microversion: 2.1 time: 0.449422 Jul 31 01:14:07.312270 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 893/1750] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:06 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1507 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:07.323314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-c5bc8518-95a4-4013-9033-fb5ed60b59d4 req-01f00d89-fa67-461a-832f-37768ba0f7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b840182-0fef-4cd6-be37-17f8a4f0025d", "name": "network-vif-plugged", "status": "completed", "tag": "f3011ab8-3ce2-4421-a217-91dc0c5473a2"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:07.330096 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:07.343202 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1655647d-0973-40a3-ab12-a199121303a3 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1532 microversion: 2.1 time: 0.444177 Jul 31 01:14:07.349983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c5bc8518-95a4-4013-9033-fb5ed60b59d4 req-01f00d89-fa67-461a-832f-37768ba0f7c4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:07.358429 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c5bc8518-95a4-4013-9033-fb5ed60b59d4 req-01f00d89-fa67-461a-832f-37768ba0f7c4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:07.361041 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 858/1751] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:06 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1532 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:14:07.380157 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1d52d181-6041-48f0-af8c-d525c1e82767 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:07.384861 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1d52d181-6041-48f0-af8c-d525c1e82767 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:07.400660 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d52d181-6041-48f0-af8c-d525c1e82767 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:07.404155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d52d181-6041-48f0-af8c-d525c1e82767 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:07.408825 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d52d181-6041-48f0-af8c-d525c1e82767 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:07.409573 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d52d181-6041-48f0-af8c-d525c1e82767 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:07.418267 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-c5bc8518-95a4-4013-9033-fb5ed60b59d4 req-01f00d89-fa67-461a-832f-37768ba0f7c4 service nova] Creating event network-vif-plugged:f3011ab8-3ce2-4421-a217-91dc0c5473a2 for instance 0b840182-0fef-4cd6-be37-17f8a4f0025d on n-h1-master-1 Jul 31 01:14:07.444392 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-c5bc8518-95a4-4013-9033-fb5ed60b59d4 req-01f00d89-fa67-461a-832f-37768ba0f7c4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128848 Jul 31 01:14:07.450595 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 894/1752] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:14:07.474226 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fd127362-726c-45c2-ba84-10d09fd21d75 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:07.491406 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:14:07.491406 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:14:07.499493 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd127362-726c-45c2-ba84-10d09fd21d75 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:07.502494 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd127362-726c-45c2-ba84-10d09fd21d75 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:07.508104 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd127362-726c-45c2-ba84-10d09fd21d75 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:07.513612 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd127362-726c-45c2-ba84-10d09fd21d75 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:07.590955 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fd127362-726c-45c2-ba84-10d09fd21d75 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.138018 Jul 31 01:14:07.593881 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 895/1753] 10.222.0.45 () {58 vars in 1176 bytes} [Sun Jul 31 01:14:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:14:07.638821 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7ebb3386-f54c-49b9-98bd-18ba098721f0 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:07.646744 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7ebb3386-f54c-49b9-98bd-18ba098721f0 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:07.675555 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ebb3386-f54c-49b9-98bd-18ba098721f0 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:07.678594 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ebb3386-f54c-49b9-98bd-18ba098721f0 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:07.686633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ebb3386-f54c-49b9-98bd-18ba098721f0 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:07.688143 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ebb3386-f54c-49b9-98bd-18ba098721f0 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:07.785975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-7ebb3386-f54c-49b9-98bd-18ba098721f0 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lazy-loading 'flavor' on Instance uuid f7c64a12-7c3e-41f9-91d1-b82820b3cd08 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:14:07.817423 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7ebb3386-f54c-49b9-98bd-18ba098721f0 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Going to try to live migrate instance to n-h1-master-1 {{(pid=119475) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 31 01:14:07.894802 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1d52d181-6041-48f0-af8c-d525c1e82767 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:07.905842 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1d52d181-6041-48f0-af8c-d525c1e82767 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:07.907411 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1d52d181-6041-48f0-af8c-d525c1e82767 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:07.908767 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1d52d181-6041-48f0-af8c-d525c1e82767 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 0.546392 Jul 31 01:14:07.909351 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 859/1754] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:07 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:07.924827 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-25281937-2df4-43b9-9a5b-9f03005db7e9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:07.936239 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-25281937-2df4-43b9-9a5b-9f03005db7e9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:07.942811 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25281937-2df4-43b9-9a5b-9f03005db7e9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:07.943382 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25281937-2df4-43b9-9a5b-9f03005db7e9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:07.944270 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25281937-2df4-43b9-9a5b-9f03005db7e9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:07.944795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25281937-2df4-43b9-9a5b-9f03005db7e9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:08.574735 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-25281937-2df4-43b9-9a5b-9f03005db7e9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:08.584466 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-25281937-2df4-43b9-9a5b-9f03005db7e9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d" status: 200 len: 1308 microversion: 2.1 time: 0.668154 Jul 31 01:14:08.600251 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 860/1755] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:07 2022] GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d => generated 1308 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:08.607188 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d0b66a63-e50a-44c1-8de3-90f3f20010d3 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:08.608169 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d0b66a63-e50a-44c1-8de3-90f3f20010d3 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:08.616483 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0b66a63-e50a-44c1-8de3-90f3f20010d3 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:08.617035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0b66a63-e50a-44c1-8de3-90f3f20010d3 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:08.618200 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0b66a63-e50a-44c1-8de3-90f3f20010d3 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:08.618837 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0b66a63-e50a-44c1-8de3-90f3f20010d3 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:08.986184 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d0b66a63-e50a-44c1-8de3-90f3f20010d3 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:09.003179 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d0b66a63-e50a-44c1-8de3-90f3f20010d3 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1505 microversion: 2.1 time: 0.401372 Jul 31 01:14:09.007372 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 861/1756] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:08 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:09.028449 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e11a5288-520f-48ed-bd6c-8f699d2da3a9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:09.029564 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e11a5288-520f-48ed-bd6c-8f699d2da3a9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:09.041172 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e11a5288-520f-48ed-bd6c-8f699d2da3a9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:09.043747 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e11a5288-520f-48ed-bd6c-8f699d2da3a9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:09.044815 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e11a5288-520f-48ed-bd6c-8f699d2da3a9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:09.045430 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e11a5288-520f-48ed-bd6c-8f699d2da3a9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:09.515010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e11a5288-520f-48ed-bd6c-8f699d2da3a9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:09.538288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e11a5288-520f-48ed-bd6c-8f699d2da3a9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:09.540910 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e11a5288-520f-48ed-bd6c-8f699d2da3a9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:09.542406 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e11a5288-520f-48ed-bd6c-8f699d2da3a9 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 0.531822 Jul 31 01:14:09.543918 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 862/1757] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:09 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:09.550349 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-81a869c0-dc1c-41cc-b3e5-7d178d6e8348 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '.version_select at 0x7fede5535310>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:09.551980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-81a869c0-dc1c-41cc-b3e5-7d178d6e8348 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:09.560009 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81a869c0-dc1c-41cc-b3e5-7d178d6e8348 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:09.560686 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81a869c0-dc1c-41cc-b3e5-7d178d6e8348 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:09.561810 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81a869c0-dc1c-41cc-b3e5-7d178d6e8348 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:09.562449 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81a869c0-dc1c-41cc-b3e5-7d178d6e8348 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:09.613742 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-81a869c0-dc1c-41cc-b3e5-7d178d6e8348 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.067955 Jul 31 01:14:09.616892 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 863/1758] 10.222.0.45 () {58 vars in 1296 bytes} [Sun Jul 31 01:14:09 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253/os-instance-actions => generated 611 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:14:09.628994 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d9b18933-2fed-4198-9667-b738cd81724a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:09.629637 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d9b18933-2fed-4198-9667-b738cd81724a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:09.647062 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d9b18933-2fed-4198-9667-b738cd81724a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:09.648314 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d9b18933-2fed-4198-9667-b738cd81724a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:09.649921 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d9b18933-2fed-4198-9667-b738cd81724a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:09.650590 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d9b18933-2fed-4198-9667-b738cd81724a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:10.165479 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d9b18933-2fed-4198-9667-b738cd81724a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:10.176983 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d9b18933-2fed-4198-9667-b738cd81724a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d" status: 200 len: 1488 microversion: 2.1 time: 0.558639 Jul 31 01:14:10.178417 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 864/1759] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:09 2022] GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d => generated 1488 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:10.184716 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-91e3f8d8-9406-4ed3-b392-a52673e32755 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:10.185586 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-91e3f8d8-9406-4ed3-b392-a52673e32755 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:10.192303 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91e3f8d8-9406-4ed3-b392-a52673e32755 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:10.192895 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91e3f8d8-9406-4ed3-b392-a52673e32755 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:10.193788 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91e3f8d8-9406-4ed3-b392-a52673e32755 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:10.196596 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91e3f8d8-9406-4ed3-b392-a52673e32755 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:10.238064 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-91e3f8d8-9406-4ed3-b392-a52673e32755 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:14:10.348930 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-91e3f8d8-9406-4ed3-b392-a52673e32755 tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "DELETE /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 204 len: 0 microversion: 2.1 time: 0.168074 Jul 31 01:14:10.350456 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 865/1760] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:14:10 2022] DELETE /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:14:10.623926 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-be8bc9dd-1b10-4c67-b675-9a717e3c1a49 tempest-FlavorsV2NegativeTest-1915542317 tempest-FlavorsV2NegativeTest-1915542317-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:10.640315 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-be8bc9dd-1b10-4c67-b675-9a717e3c1a49 tempest-FlavorsV2NegativeTest-1915542317 tempest-FlavorsV2NegativeTest-1915542317-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.287372 Jul 31 01:14:10.641236 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 866/1761] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:14:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:14:10.648288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-42eec5f4-8e53-4747-a421-ced917eabc6a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:10.649814 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-42eec5f4-8e53-4747-a421-ced917eabc6a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:10.666333 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42eec5f4-8e53-4747-a421-ced917eabc6a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:10.666803 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42eec5f4-8e53-4747-a421-ced917eabc6a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:10.667621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42eec5f4-8e53-4747-a421-ced917eabc6a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:10.668808 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42eec5f4-8e53-4747-a421-ced917eabc6a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:10.699192 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-42eec5f4-8e53-4747-a421-ced917eabc6a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lazy-loading 'flavor' on Instance uuid 0b840182-0fef-4cd6-be37-17f8a4f0025d {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:14:10.866772 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-42eec5f4-8e53-4747-a421-ced917eabc6a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "POST /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d/action" status: 202 len: 0 microversion: 2.1 time: 0.224220 Jul 31 01:14:10.874229 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 867/1762] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:14:10 2022] POST /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:14:10.901643 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d280d4ba-0c17-4f1a-b280-99d77fa682ee tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:10.904738 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d280d4ba-0c17-4f1a-b280-99d77fa682ee tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:10.925649 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d280d4ba-0c17-4f1a-b280-99d77fa682ee tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:10.926102 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d280d4ba-0c17-4f1a-b280-99d77fa682ee tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:10.926894 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d280d4ba-0c17-4f1a-b280-99d77fa682ee tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:10.927330 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d280d4ba-0c17-4f1a-b280-99d77fa682ee tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:11.907788 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d280d4ba-0c17-4f1a-b280-99d77fa682ee tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:11.916565 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d280d4ba-0c17-4f1a-b280-99d77fa682ee tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1511 microversion: 2.1 time: 1.038185 Jul 31 01:14:11.931033 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 868/1763] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:10 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1511 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:11.931033 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3a2178bb-ee69-4932-b373-7e5bc7e68a21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:11.931033 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3a2178bb-ee69-4932-b373-7e5bc7e68a21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:11.936803 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a2178bb-ee69-4932-b373-7e5bc7e68a21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:11.937478 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a2178bb-ee69-4932-b373-7e5bc7e68a21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:11.938341 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a2178bb-ee69-4932-b373-7e5bc7e68a21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:11.938854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a2178bb-ee69-4932-b373-7e5bc7e68a21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:12.438650 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3a2178bb-ee69-4932-b373-7e5bc7e68a21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:12.454140 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3a2178bb-ee69-4932-b373-7e5bc7e68a21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:12.457354 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3a2178bb-ee69-4932-b373-7e5bc7e68a21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:12.458599 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3a2178bb-ee69-4932-b373-7e5bc7e68a21 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1487 microversion: 2.25 time: 0.540343 Jul 31 01:14:12.472035 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 869/1764] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:11 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1487 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:12.487653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8f91ba70-79db-470b-a186-05fae320b259 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:12.488278 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8f91ba70-79db-470b-a186-05fae320b259 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:12.507238 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f91ba70-79db-470b-a186-05fae320b259 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:12.508188 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f91ba70-79db-470b-a186-05fae320b259 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:12.509235 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f91ba70-79db-470b-a186-05fae320b259 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:12.509936 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f91ba70-79db-470b-a186-05fae320b259 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:12.794891 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7ebb3386-f54c-49b9-98bd-18ba098721f0 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08/action" status: 202 len: 0 microversion: 2.1 time: 5.184824 Jul 31 01:14:12.797970 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 896/1765] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:14:07 2022] POST /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08/action => generated 0 bytes in 5189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:14:12.805505 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-43e6079d-2a45-42a0-bfcd-fc1d9da5b60b tempest-FlavorsV2NegativeTest-1915542317 tempest-FlavorsV2NegativeTest-1915542317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-237642642", "imageRef": "0a7a01e0-5bb6-4d4f-a0b5-717d2540f12f", "flavorRef": "452"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:12.888343 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8f91ba70-79db-470b-a186-05fae320b259 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:12.890228 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-43e6079d-2a45-42a0-bfcd-fc1d9da5b60b tempest-FlavorsV2NegativeTest-1915542317 tempest-FlavorsV2NegativeTest-1915542317-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:14:12.899450 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8f91ba70-79db-470b-a186-05fae320b259 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d" status: 200 len: 1479 microversion: 2.1 time: 0.425378 Jul 31 01:14:12.900069 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 870/1766] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:12 2022] GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d => generated 1479 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:12.926392 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-45156fce-68ad-4562-9c90-8a8e9671dc54 req-63a012be-cfa0-4a66-9b2a-ba8c8c51200a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f5a418-18ef-4735-bea0-a0c123be5253", "name": "network-vif-deleted", "tag": "bddb160a-16a2-4712-b3ca-74f0c5aff9fe"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:12.961683 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-45156fce-68ad-4562-9c90-8a8e9671dc54 req-63a012be-cfa0-4a66-9b2a-ba8c8c51200a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:12.962143 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-45156fce-68ad-4562-9c90-8a8e9671dc54 req-63a012be-cfa0-4a66-9b2a-ba8c8c51200a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:13.001083 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-45156fce-68ad-4562-9c90-8a8e9671dc54 req-63a012be-cfa0-4a66-9b2a-ba8c8c51200a service nova] Creating event network-vif-deleted:bddb160a-16a2-4712-b3ca-74f0c5aff9fe for instance 42f5a418-18ef-4735-bea0-a0c123be5253 on n-h1-master-1 Jul 31 01:14:13.007291 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-45156fce-68ad-4562-9c90-8a8e9671dc54 req-63a012be-cfa0-4a66-9b2a-ba8c8c51200a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102992 Jul 31 01:14:13.008970 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 871/1767] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:14:13.024202 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b70c5aaf-16bc-43a8-92dd-4aa8652d9f10 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:13.025657 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b70c5aaf-16bc-43a8-92dd-4aa8652d9f10 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:13.038190 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b70c5aaf-16bc-43a8-92dd-4aa8652d9f10 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:13.039293 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b70c5aaf-16bc-43a8-92dd-4aa8652d9f10 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:13.040676 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b70c5aaf-16bc-43a8-92dd-4aa8652d9f10 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:13.041334 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b70c5aaf-16bc-43a8-92dd-4aa8652d9f10 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:13.491914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b70c5aaf-16bc-43a8-92dd-4aa8652d9f10 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:13.511296 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b70c5aaf-16bc-43a8-92dd-4aa8652d9f10 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 0.499541 Jul 31 01:14:13.512968 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 872/1768] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:13 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:13.521435 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8124da56-2904-4761-a50a-64b573c9ba13 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-268850702"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:13.524556 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8124da56-2904-4761-a50a-64b573c9ba13 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:13.548664 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8124da56-2904-4761-a50a-64b573c9ba13 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:13.556784 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8124da56-2904-4761-a50a-64b573c9ba13 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:13.558207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8124da56-2904-4761-a50a-64b573c9ba13 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:13.561223 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8124da56-2904-4761-a50a-64b573c9ba13 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:13.595685 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-43e6079d-2a45-42a0-bfcd-fc1d9da5b60b tempest-FlavorsV2NegativeTest-1915542317 tempest-FlavorsV2NegativeTest-1915542317-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-43e6079d-2a45-42a0-bfcd-fc1d9da5b60b tempest-FlavorsV2NegativeTest-1915542317 tempest-FlavorsV2NegativeTest-1915542317-project] Request method failure captured: Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 142 Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5ddh4eiWVnehJzYYI90WLFr4-fD5_vbQaWLzwE7dk3xF8ojbNeXZUqAuT2vfk2Pr9LsrOVyCjPhjKPP5pM71I-d-6YE6g-Nw_CofRV18Rv_zJ7CeDfkAAXsIJvHjQEfzBM6Ea2ZcukloJBWdN13-r7SmyS5Khq6SlmjRYY-ynU20mIk Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a8c29309cbb94b94af28243997ec3d01 Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-FlavorsV2NegativeTest-1915542317 Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a8c29309cbb94b94af28243997ec3d01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a8c29309cbb94b94af28243997ec3d01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a8c29309cbb94b94af28243997ec3d01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a8c29309cbb94b94af28243997ec3d01", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-FlavorsV2NegativeTest-1915542317 Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a8c29309cbb94b94af28243997ec3d01 Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1915542317 Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-FlavorsV2NegativeTest-1915542317-project Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 83a6ba83d24844b9a4b40e207d44cb4e Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-FlavorsV2NegativeTest-1915542317-project Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-237642642", "imageRef": "0a7a01e0-5bb6-4d4f-a0b5-717d2540f12f", "flavorRef": "452"}} Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: exception: Flavor's memory is too small for requested image. Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-237642642', 'imageRef': '0a7a01e0-5bb6-4d4f-a0b5-717d2540f12f', 'flavorRef': '452'}}} Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1007, in _checks_for_create_and_rebuild Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 671, in _validate_flavor_image Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 739, in _validate_flavor_image_nostatus Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:14:13.601151 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-43e6079d-2a45-42a0-bfcd-fc1d9da5b60b tempest-FlavorsV2NegativeTest-1915542317 tempest-FlavorsV2NegativeTest-1915542317-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:14:13.606375 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-43e6079d-2a45-42a0-bfcd-fc1d9da5b60b tempest-FlavorsV2NegativeTest-1915542317 tempest-FlavorsV2NegativeTest-1915542317-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.805108 Jul 31 01:14:13.608539 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 897/1769] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:14:12 2022] POST /compute/v2.1/servers => generated 93 bytes in 808 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 31 01:14:13.630606 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8482ac4e-e9fe-4811-9d1a-56f63e37529d tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:13.632075 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8482ac4e-e9fe-4811-9d1a-56f63e37529d tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:13.666726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8482ac4e-e9fe-4811-9d1a-56f63e37529d tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:13.672501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8482ac4e-e9fe-4811-9d1a-56f63e37529d tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:13.673499 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8482ac4e-e9fe-4811-9d1a-56f63e37529d tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:13.673970 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8482ac4e-e9fe-4811-9d1a-56f63e37529d tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:13.738064 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:13.817582 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8482ac4e-e9fe-4811-9d1a-56f63e37529d tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:13.820314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8482ac4e-e9fe-4811-9d1a-56f63e37529d tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:13.822372 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-8482ac4e-e9fe-4811-9d1a-56f63e37529d tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lazy-loading 'fault' on Instance uuid 42f5a418-18ef-4735-bea0-a0c123be5253 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:14:13.898237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8482ac4e-e9fe-4811-9d1a-56f63e37529d tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e69fe8a1e9446ed90f0f5115271eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07e3d3b4692403b9156329206bef6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:13.914630 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8482ac4e-e9fe-4811-9d1a-56f63e37529d tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 200 len: 1306 microversion: 2.1 time: 0.306314 Jul 31 01:14:13.916794 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 898/1770] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:13 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 1306 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:13.934927 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-20bae926-fde2-45a5-83d2-063f677ea663 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:13.935593 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-20bae926-fde2-45a5-83d2-063f677ea663 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:13.953513 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20bae926-fde2-45a5-83d2-063f677ea663 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:13.954199 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20bae926-fde2-45a5-83d2-063f677ea663 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:13.955581 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20bae926-fde2-45a5-83d2-063f677ea663 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:13.956333 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20bae926-fde2-45a5-83d2-063f677ea663 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:14.261495 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8124da56-2904-4761-a50a-64b573c9ba13 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "POST /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d/action" status: 202 len: 0 microversion: 2.1 time: 0.746057 Jul 31 01:14:14.272953 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 873/1771] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:14:13 2022] POST /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d/action => generated 0 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 31 01:14:14.283742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-73055fea-b2ce-48f0-bb5b-690166db3ea9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea981af0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:14.388798 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-73055fea-b2ce-48f0-bb5b-690166db3ea9 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.112994 Jul 31 01:14:14.393658 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 874/1772] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:14 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:14.536854 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9a0503ea-bc6d-457a-9188-c4cc0de273f0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:14.539247 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9a0503ea-bc6d-457a-9188-c4cc0de273f0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:14.544201 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:14.582564 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a0503ea-bc6d-457a-9188-c4cc0de273f0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:14.583544 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a0503ea-bc6d-457a-9188-c4cc0de273f0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:14.588168 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a0503ea-bc6d-457a-9188-c4cc0de273f0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:14.589134 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a0503ea-bc6d-457a-9188-c4cc0de273f0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:14.598334 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-20bae926-fde2-45a5-83d2-063f677ea663 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:14.613369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-20bae926-fde2-45a5-83d2-063f677ea663 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:14.615192 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-20bae926-fde2-45a5-83d2-063f677ea663 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:14.616740 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-20bae926-fde2-45a5-83d2-063f677ea663 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1477 microversion: 2.25 time: 0.698918 Jul 31 01:14:14.620087 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 899/1773] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:13 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1477 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:14.651252 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6971475d-5992-42f1-91dc-b29efd869ba9 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '.version_select at 0x7fedeaa123a0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:14.659025 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6971475d-5992-42f1-91dc-b29efd869ba9 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:14.660018 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6971475d-5992-42f1-91dc-b29efd869ba9 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:14.683153 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6971475d-5992-42f1-91dc-b29efd869ba9 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 3866 microversion: 2.25 time: 0.039037 Jul 31 01:14:14.687380 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 900/1774] 10.222.0.45 () {60 vars in 1184 bytes} [Sun Jul 31 01:14:14 2022] GET /compute/v2.1/os-migrations => generated 3866 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:14:14.701530 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1ddf631d-27c3-4f11-a575-bc4fd95350f2 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:14.702454 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1ddf631d-27c3-4f11-a575-bc4fd95350f2 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:14.709841 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1ddf631d-27c3-4f11-a575-bc4fd95350f2 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:14.710937 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1ddf631d-27c3-4f11-a575-bc4fd95350f2 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:14.712758 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1ddf631d-27c3-4f11-a575-bc4fd95350f2 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:14.712758 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1ddf631d-27c3-4f11-a575-bc4fd95350f2 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:15.009907 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9a0503ea-bc6d-457a-9188-c4cc0de273f0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:15.023542 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9a0503ea-bc6d-457a-9188-c4cc0de273f0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 0.493863 Jul 31 01:14:15.023919 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-1ddf631d-27c3-4f11-a575-bc4fd95350f2 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] Lazy-loading 'services' on Instance uuid b17392cf-3f17-483a-89cb-0d7bb436bca7 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:14:15.035485 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 875/1775] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:14 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:14:15.035485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fe7e1601-63e0-4f25-a564-7af976acaeed tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:15.035485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fe7e1601-63e0-4f25-a564-7af976acaeed tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] [instance: 42f5a418-18ef-4735-bea0-a0c123be5253] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:15.041390 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe7e1601-63e0-4f25-a564-7af976acaeed tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:15.041390 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe7e1601-63e0-4f25-a564-7af976acaeed tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:15.041719 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe7e1601-63e0-4f25-a564-7af976acaeed tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:15.042284 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe7e1601-63e0-4f25-a564-7af976acaeed tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:15.044053 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1ddf631d-27c3-4f11-a575-bc4fd95350f2 tempest-LiveAutoBlockMigrationV225Test-974322192 tempest-LiveAutoBlockMigrationV225Test-974322192-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1970 microversion: 2.25 time: 0.346124 Jul 31 01:14:15.045014 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 901/1776] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:14 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1970 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:14:15.069502 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-fe7e1601-63e0-4f25-a564-7af976acaeed tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] HTTP exception thrown: Instance 42f5a418-18ef-4735-bea0-a0c123be5253 could not be found. Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fe7e1601-63e0-4f25-a564-7af976acaeed tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Request method failure captured: Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 HTTP/1.1 Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dc6-_fA8_Gjx79Cia7a1P_GkfvSofsltEFSxEylRVWolWyDiTUws4ldH6Ykd5jmCU-e7R21UC9RSwWDa9CwdLVv2lMkQkTqzoWm1fimJd6bOzd0ubYxxeApqJ3JyZsRfZdwoyzk4-WFBWqwq6zz1Ta8qg0wNEM5x015kCkeWbQcLU8 Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e07e3d3b4692403b9156329206bef6a2 Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-InstanceActionsTestJSON-1048498130 Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e07e3d3b4692403b9156329206bef6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e07e3d3b4692403b9156329206bef6a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e07e3d3b4692403b9156329206bef6a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e07e3d3b4692403b9156329206bef6a2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-InstanceActionsTestJSON-1048498130 Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e07e3d3b4692403b9156329206bef6a2 Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1048498130 Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-InstanceActionsTestJSON-1048498130-project Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 6e69fe8a1e9446ed90f0f5115271eeab Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-InstanceActionsTestJSON-1048498130-project Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 42f5a418-18ef-4735-bea0-a0c123be5253 could not be found. Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '42f5a418-18ef-4735-bea0-a0c123be5253'} Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42f5a418-18ef-4735-bea0-a0c123be5253 could not be found. Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42f5a418-18ef-4735-bea0-a0c123be5253 could not be found. Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:14:15.073485 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:14:15.084023 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:14:15.084023 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:14:15.084023 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:14:15.084023 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:14:15.084023 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:14:15.084023 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42f5a418-18ef-4735-bea0-a0c123be5253 could not be found. Jul 31 01:14:15.084023 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:14:15.087717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fe7e1601-63e0-4f25-a564-7af976acaeed tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] Returning 404 to user: Instance 42f5a418-18ef-4735-bea0-a0c123be5253 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:14:15.089606 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fe7e1601-63e0-4f25-a564-7af976acaeed tempest-InstanceActionsTestJSON-1048498130 tempest-InstanceActionsTestJSON-1048498130-project] 10.222.0.45 "GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253" status: 404 len: 111 microversion: 2.1 time: 0.062148 Jul 31 01:14:15.090694 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0225dcfb-cca7-4122-8fb2-14c073f91034 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:15.091570 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0225dcfb-cca7-4122-8fb2-14c073f91034 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:15.092777 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 876/1777] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:15 2022] GET /compute/v2.1/servers/42f5a418-18ef-4735-bea0-a0c123be5253 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:14:15.098737 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0225dcfb-cca7-4122-8fb2-14c073f91034 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:15.099511 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0225dcfb-cca7-4122-8fb2-14c073f91034 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:15.100550 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0225dcfb-cca7-4122-8fb2-14c073f91034 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:15.101095 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0225dcfb-cca7-4122-8fb2-14c073f91034 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:15.150014 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0225dcfb-cca7-4122-8fb2-14c073f91034 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:14:15.329934 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0225dcfb-cca7-4122-8fb2-14c073f91034 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 204 len: 0 microversion: 2.25 time: 0.244988 Jul 31 01:14:15.331070 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 902/1778] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:14:15 2022] DELETE /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 31 01:14:15.344822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6a7812e5-aae7-4bdb-81ed-9314a5b787db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:15.345771 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6a7812e5-aae7-4bdb-81ed-9314a5b787db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:15.354125 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a7812e5-aae7-4bdb-81ed-9314a5b787db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:15.354685 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a7812e5-aae7-4bdb-81ed-9314a5b787db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:15.356779 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a7812e5-aae7-4bdb-81ed-9314a5b787db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:15.357250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a7812e5-aae7-4bdb-81ed-9314a5b787db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:15.412796 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bcc4ef2b-6251-4d9d-8be8-5919c603acd2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaaa5dc0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:15.483808 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bcc4ef2b-6251-4d9d-8be8-5919c603acd2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.077110 Jul 31 01:14:15.494734 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 903/1779] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:15 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:15.779771 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6a7812e5-aae7-4bdb-81ed-9314a5b787db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:15.793875 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6a7812e5-aae7-4bdb-81ed-9314a5b787db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:15.801452 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6a7812e5-aae7-4bdb-81ed-9314a5b787db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:15.803013 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6a7812e5-aae7-4bdb-81ed-9314a5b787db tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1483 microversion: 2.25 time: 0.464328 Jul 31 01:14:15.806367 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 877/1780] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:15 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1483 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:16.075649 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9c18e5fe-e739-41ae-bd56-f7895ffff558 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:16.085246 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9c18e5fe-e739-41ae-bd56-f7895ffff558 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:16.113496 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c18e5fe-e739-41ae-bd56-f7895ffff558 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:16.116364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c18e5fe-e739-41ae-bd56-f7895ffff558 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:16.122281 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c18e5fe-e739-41ae-bd56-f7895ffff558 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:16.124236 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c18e5fe-e739-41ae-bd56-f7895ffff558 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:16.501203 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-70259de6-4709-4bdb-af93-65dfbbeb3cc7 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea944550>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:16.596644 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-70259de6-4709-4bdb-af93-65dfbbeb3cc7 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.099559 Jul 31 01:14:16.604052 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 878/1781] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:16 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:16.658893 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9c18e5fe-e739-41ae-bd56-f7895ffff558 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:16.672944 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9c18e5fe-e739-41ae-bd56-f7895ffff558 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 0.626295 Jul 31 01:14:16.685069 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 904/1782] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:16 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:16.837678 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f3ed91e4-0523-4a0d-83d2-80b064b30bad tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:16.838209 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f3ed91e4-0523-4a0d-83d2-80b064b30bad tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:16.851841 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3ed91e4-0523-4a0d-83d2-80b064b30bad tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:16.852297 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3ed91e4-0523-4a0d-83d2-80b064b30bad tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:16.864581 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3ed91e4-0523-4a0d-83d2-80b064b30bad tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:16.865329 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3ed91e4-0523-4a0d-83d2-80b064b30bad tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:17.294897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f3ed91e4-0523-4a0d-83d2-80b064b30bad tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:17.312101 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f3ed91e4-0523-4a0d-83d2-80b064b30bad tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:17.320228 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f3ed91e4-0523-4a0d-83d2-80b064b30bad tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:17.324452 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f3ed91e4-0523-4a0d-83d2-80b064b30bad tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1483 microversion: 2.25 time: 0.491388 Jul 31 01:14:17.348234 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 879/1783] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:16 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1483 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:17.478729 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-b12ca044-d7dd-43d9-b46a-d364ee81742d req-6fe1c602-458b-454f-9bde-0c6c9e09f288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b17392cf-3f17-483a-89cb-0d7bb436bca7", "name": "network-vif-deleted", "tag": "67a0c9d8-8bc9-4aab-8068-662a2a37147f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:17.503912 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b12ca044-d7dd-43d9-b46a-d364ee81742d req-6fe1c602-458b-454f-9bde-0c6c9e09f288 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:17.505301 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b12ca044-d7dd-43d9-b46a-d364ee81742d req-6fe1c602-458b-454f-9bde-0c6c9e09f288 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:17.540923 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:17.549574 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-b12ca044-d7dd-43d9-b46a-d364ee81742d req-6fe1c602-458b-454f-9bde-0c6c9e09f288 service nova] Creating event network-vif-deleted:67a0c9d8-8bc9-4aab-8068-662a2a37147f for instance b17392cf-3f17-483a-89cb-0d7bb436bca7 on n-h1-master-1 Jul 31 01:14:17.573837 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-b12ca044-d7dd-43d9-b46a-d364ee81742d req-6fe1c602-458b-454f-9bde-0c6c9e09f288 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099382 Jul 31 01:14:17.575903 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 905/1784] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:14:17.615070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c3a1493-f427-4f05-98fd-ff06c7382bf5 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea959ee0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:17.725785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0ec646e6-18f8-435f-9ee7-9f339adca441 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:17.731362 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0ec646e6-18f8-435f-9ee7-9f339adca441 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:17.739289 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2c3a1493-f427-4f05-98fd-ff06c7382bf5 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.127984 Jul 31 01:14:17.740986 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 880/1785] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:17 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:17.773121 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ec646e6-18f8-435f-9ee7-9f339adca441 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:17.785440 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ec646e6-18f8-435f-9ee7-9f339adca441 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:17.797534 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ec646e6-18f8-435f-9ee7-9f339adca441 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:17.798521 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ec646e6-18f8-435f-9ee7-9f339adca441 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:18.258442 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0ec646e6-18f8-435f-9ee7-9f339adca441 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:18.276241 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0ec646e6-18f8-435f-9ee7-9f339adca441 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 0.581635 Jul 31 01:14:18.287438 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 906/1786] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:17 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:18.363550 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ae48899d-8cc2-4bdd-8e61-44b0e3bb0d76 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:18.373213 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ae48899d-8cc2-4bdd-8e61-44b0e3bb0d76 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:18.384663 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae48899d-8cc2-4bdd-8e61-44b0e3bb0d76 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:18.385496 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae48899d-8cc2-4bdd-8e61-44b0e3bb0d76 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:18.390448 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae48899d-8cc2-4bdd-8e61-44b0e3bb0d76 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:18.391656 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae48899d-8cc2-4bdd-8e61-44b0e3bb0d76 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:18.757056 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-550235df-c5c9-4d2b-862d-27e9aa646b9a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa09c10>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:18.932745 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-550235df-c5c9-4d2b-862d-27e9aa646b9a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.180718 Jul 31 01:14:18.936388 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 907/1787] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:18 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:19.054103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ae48899d-8cc2-4bdd-8e61-44b0e3bb0d76 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:19.065322 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ae48899d-8cc2-4bdd-8e61-44b0e3bb0d76 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:19.067506 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ae48899d-8cc2-4bdd-8e61-44b0e3bb0d76 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:19.070462 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ae48899d-8cc2-4bdd-8e61-44b0e3bb0d76 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1266 microversion: 2.25 time: 0.719114 Jul 31 01:14:19.071611 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 881/1788] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:18 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1266 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:19.321131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cbdcb3b2-a144-4dbd-9039-e86e03a3b9cc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:19.322918 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cbdcb3b2-a144-4dbd-9039-e86e03a3b9cc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:19.341152 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cbdcb3b2-a144-4dbd-9039-e86e03a3b9cc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:19.359621 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cbdcb3b2-a144-4dbd-9039-e86e03a3b9cc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:19.360976 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cbdcb3b2-a144-4dbd-9039-e86e03a3b9cc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:19.361618 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cbdcb3b2-a144-4dbd-9039-e86e03a3b9cc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:19.403010 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:19.770326 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cbdcb3b2-a144-4dbd-9039-e86e03a3b9cc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:19.788660 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cbdcb3b2-a144-4dbd-9039-e86e03a3b9cc tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 0.490103 Jul 31 01:14:19.789512 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 908/1789] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:19 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:19.950207 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-17299a76-5b02-4ed3-bce5-df729c721dcf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea959e50>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:20.032976 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-17299a76-5b02-4ed3-bce5-df729c721dcf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.079500 Jul 31 01:14:20.043572 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 882/1790] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:19 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:14:20.097557 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3592eda7-1725-4765-b49e-5239f0b4a967 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:20.098782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3592eda7-1725-4765-b49e-5239f0b4a967 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:20.118166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3592eda7-1725-4765-b49e-5239f0b4a967 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:20.118974 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3592eda7-1725-4765-b49e-5239f0b4a967 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:20.121144 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3592eda7-1725-4765-b49e-5239f0b4a967 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:20.124505 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3592eda7-1725-4765-b49e-5239f0b4a967 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:20.291222 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3592eda7-1725-4765-b49e-5239f0b4a967 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:20.309130 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3592eda7-1725-4765-b49e-5239f0b4a967 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:20.316753 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3592eda7-1725-4765-b49e-5239f0b4a967 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:20.320011 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3592eda7-1725-4765-b49e-5239f0b4a967 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1266 microversion: 2.25 time: 0.229100 Jul 31 01:14:20.336428 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 909/1791] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:20 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:20.814070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e75fd35b-4cb9-46dd-9c24-fc6ce3d8ef7f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:20.815312 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e75fd35b-4cb9-46dd-9c24-fc6ce3d8ef7f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:20.826306 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e75fd35b-4cb9-46dd-9c24-fc6ce3d8ef7f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:20.838639 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e75fd35b-4cb9-46dd-9c24-fc6ce3d8ef7f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:20.842385 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e75fd35b-4cb9-46dd-9c24-fc6ce3d8ef7f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:20.845940 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e75fd35b-4cb9-46dd-9c24-fc6ce3d8ef7f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:21.057453 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3e455c9-7355-46dd-8c1a-76f62920d3ac tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa13ee0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:21.171108 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3e455c9-7355-46dd-8c1a-76f62920d3ac tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.121631 Jul 31 01:14:21.176660 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 910/1792] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:21 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:14:21.349635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c81835a5-7d42-40f6-aaf9-68acebb2e380 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:21.350270 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c81835a5-7d42-40f6-aaf9-68acebb2e380 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:21.363966 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c81835a5-7d42-40f6-aaf9-68acebb2e380 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:21.364433 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c81835a5-7d42-40f6-aaf9-68acebb2e380 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:21.365332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c81835a5-7d42-40f6-aaf9-68acebb2e380 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:21.365789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c81835a5-7d42-40f6-aaf9-68acebb2e380 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:21.398155 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e75fd35b-4cb9-46dd-9c24-fc6ce3d8ef7f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:21.413014 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e75fd35b-4cb9-46dd-9c24-fc6ce3d8ef7f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 0.604446 Jul 31 01:14:21.414012 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 883/1793] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:20 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:21.521754 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c81835a5-7d42-40f6-aaf9-68acebb2e380 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:21.535633 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c81835a5-7d42-40f6-aaf9-68acebb2e380 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:21.537855 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c81835a5-7d42-40f6-aaf9-68acebb2e380 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:21.542375 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c81835a5-7d42-40f6-aaf9-68acebb2e380 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1266 microversion: 2.25 time: 0.196632 Jul 31 01:14:21.544858 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 911/1794] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:21 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:14:22.084441 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-68444b10-82fb-4de7-bd3f-d796abd2e523 req-ed6a94f3-a9d2-4a2b-9ba0-57523cc5e650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b840182-0fef-4cd6-be37-17f8a4f0025d", "name": "network-vif-plugged", "status": "completed", "tag": "f3011ab8-3ce2-4421-a217-91dc0c5473a2"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:22.108927 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-68444b10-82fb-4de7-bd3f-d796abd2e523 req-ed6a94f3-a9d2-4a2b-9ba0-57523cc5e650 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:22.109385 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-68444b10-82fb-4de7-bd3f-d796abd2e523 req-ed6a94f3-a9d2-4a2b-9ba0-57523cc5e650 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:22.144750 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-68444b10-82fb-4de7-bd3f-d796abd2e523 req-ed6a94f3-a9d2-4a2b-9ba0-57523cc5e650 service nova] Creating event network-vif-plugged:f3011ab8-3ce2-4421-a217-91dc0c5473a2 for instance 0b840182-0fef-4cd6-be37-17f8a4f0025d on n-h1-master-1 Jul 31 01:14:22.163422 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-68444b10-82fb-4de7-bd3f-d796abd2e523 req-ed6a94f3-a9d2-4a2b-9ba0-57523cc5e650 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089531 Jul 31 01:14:22.169277 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 884/1795] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 31 01:14:22.192857 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d268c4bf-a76d-46a8-ae5e-43bb02451651 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede523c9d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:22.303809 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d268c4bf-a76d-46a8-ae5e-43bb02451651 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.114738 Jul 31 01:14:22.304468 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 912/1796] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:22 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:14:22.440971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2e237579-2437-460e-827d-f7141a4fc585 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:22.441973 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2e237579-2437-460e-827d-f7141a4fc585 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:22.454122 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e237579-2437-460e-827d-f7141a4fc585 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:22.454574 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e237579-2437-460e-827d-f7141a4fc585 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:22.455601 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e237579-2437-460e-827d-f7141a4fc585 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:22.456204 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e237579-2437-460e-827d-f7141a4fc585 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:22.570572 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-16533f16-b266-402c-a443-bfd0de6dcdc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:22.571209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-16533f16-b266-402c-a443-bfd0de6dcdc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:22.592277 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16533f16-b266-402c-a443-bfd0de6dcdc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:22.592758 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16533f16-b266-402c-a443-bfd0de6dcdc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:22.593592 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16533f16-b266-402c-a443-bfd0de6dcdc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:22.594045 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16533f16-b266-402c-a443-bfd0de6dcdc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:22.837609 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2e237579-2437-460e-827d-f7141a4fc585 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:22.850876 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2e237579-2437-460e-827d-f7141a4fc585 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 0.414699 Jul 31 01:14:22.859922 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 885/1797] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:22 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:22.862909 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-16533f16-b266-402c-a443-bfd0de6dcdc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:22.878088 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-16533f16-b266-402c-a443-bfd0de6dcdc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:22.890241 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-16533f16-b266-402c-a443-bfd0de6dcdc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:22.906661 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-16533f16-b266-402c-a443-bfd0de6dcdc7 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1266 microversion: 2.25 time: 0.333603 Jul 31 01:14:22.907627 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 913/1798] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:22 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1266 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:23.320618 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c9a3033d-a419-45c9-bb4d-43fa498402fd tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea97c700>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:23.420158 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c9a3033d-a419-45c9-bb4d-43fa498402fd tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.104588 Jul 31 01:14:23.421357 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 886/1799] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:23 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:23.882954 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-da1a48d1-6e1a-4e0f-a62a-f549b3e9e314 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:23.883957 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-da1a48d1-6e1a-4e0f-a62a-f549b3e9e314 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:23.906662 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da1a48d1-6e1a-4e0f-a62a-f549b3e9e314 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:23.907943 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da1a48d1-6e1a-4e0f-a62a-f549b3e9e314 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:23.908753 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da1a48d1-6e1a-4e0f-a62a-f549b3e9e314 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:23.911126 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da1a48d1-6e1a-4e0f-a62a-f549b3e9e314 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:23.936998 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-047e7a3a-3a96-42b5-8651-475c7acdcd57 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:23.937695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-047e7a3a-3a96-42b5-8651-475c7acdcd57 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:23.953271 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-047e7a3a-3a96-42b5-8651-475c7acdcd57 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:23.953738 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-047e7a3a-3a96-42b5-8651-475c7acdcd57 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:23.954542 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-047e7a3a-3a96-42b5-8651-475c7acdcd57 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:23.954987 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-047e7a3a-3a96-42b5-8651-475c7acdcd57 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:24.186823 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-047e7a3a-3a96-42b5-8651-475c7acdcd57 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:24.205629 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-047e7a3a-3a96-42b5-8651-475c7acdcd57 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:24.210773 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-047e7a3a-3a96-42b5-8651-475c7acdcd57 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:24.218235 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-047e7a3a-3a96-42b5-8651-475c7acdcd57 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1266 microversion: 2.25 time: 0.282014 Jul 31 01:14:24.219083 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 887/1800] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:23 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:14:24.435784 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95b294d0-eb26-4cc6-87df-50f6dca166d8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea9591f0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:24.512326 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-95b294d0-eb26-4cc6-87df-50f6dca166d8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.080710 Jul 31 01:14:24.520899 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 888/1801] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:24 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:14:24.695365 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-da1a48d1-6e1a-4e0f-a62a-f549b3e9e314 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:24.706683 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-da1a48d1-6e1a-4e0f-a62a-f549b3e9e314 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 0.836704 Jul 31 01:14:24.707525 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 914/1802] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:23 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:25.248645 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d8c9b2cb-2f6c-46e4-ba50-39fb55d5e7d2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:25.249303 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d8c9b2cb-2f6c-46e4-ba50-39fb55d5e7d2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:25.297247 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8c9b2cb-2f6c-46e4-ba50-39fb55d5e7d2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:25.301719 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8c9b2cb-2f6c-46e4-ba50-39fb55d5e7d2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:25.303226 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8c9b2cb-2f6c-46e4-ba50-39fb55d5e7d2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:25.304821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8c9b2cb-2f6c-46e4-ba50-39fb55d5e7d2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:25.529225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-136aac0d-2497-4b02-864d-e75a7bc4d2fb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa134c0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:25.570576 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d8c9b2cb-2f6c-46e4-ba50-39fb55d5e7d2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:25.586641 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d8c9b2cb-2f6c-46e4-ba50-39fb55d5e7d2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:25.590357 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d8c9b2cb-2f6c-46e4-ba50-39fb55d5e7d2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:25.603907 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d8c9b2cb-2f6c-46e4-ba50-39fb55d5e7d2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1266 microversion: 2.25 time: 0.361308 Jul 31 01:14:25.604569 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 889/1803] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:25 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1266 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:25.733956 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-471ed789-d418-4c52-a6a8-2d454b4caba6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:25.735389 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-471ed789-d418-4c52-a6a8-2d454b4caba6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:25.754277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-471ed789-d418-4c52-a6a8-2d454b4caba6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:25.757166 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-136aac0d-2497-4b02-864d-e75a7bc4d2fb tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.233025 Jul 31 01:14:25.764256 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 915/1804] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:25 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:25.765831 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-471ed789-d418-4c52-a6a8-2d454b4caba6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:25.768713 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-471ed789-d418-4c52-a6a8-2d454b4caba6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:25.770489 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-471ed789-d418-4c52-a6a8-2d454b4caba6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:26.393771 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-471ed789-d418-4c52-a6a8-2d454b4caba6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:26.403686 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-471ed789-d418-4c52-a6a8-2d454b4caba6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 0.677969 Jul 31 01:14:26.415365 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 890/1805] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:25 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:26.627999 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-81ddf047-fdc3-4126-8a99-e866dc5a242f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:26.628556 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-81ddf047-fdc3-4126-8a99-e866dc5a242f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:26.645672 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81ddf047-fdc3-4126-8a99-e866dc5a242f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:26.654950 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81ddf047-fdc3-4126-8a99-e866dc5a242f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:26.658860 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81ddf047-fdc3-4126-8a99-e866dc5a242f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:26.659665 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81ddf047-fdc3-4126-8a99-e866dc5a242f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:26.780108 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e1d848dd-eca5-45ec-a6ba-eac1e9c5109a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede5b43430>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:26.871609 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e1d848dd-eca5-45ec-a6ba-eac1e9c5109a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.097089 Jul 31 01:14:26.872558 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 891/1806] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:26 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:26.893579 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-81ddf047-fdc3-4126-8a99-e866dc5a242f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:26.925105 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-81ddf047-fdc3-4126-8a99-e866dc5a242f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:26.926752 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-81ddf047-fdc3-4126-8a99-e866dc5a242f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:26.929822 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-81ddf047-fdc3-4126-8a99-e866dc5a242f tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1266 microversion: 2.25 time: 0.305076 Jul 31 01:14:26.930798 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 916/1807] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:26 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:27.429238 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3c2c9aff-1388-4985-a14e-5bbe89e31686 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:27.430143 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3c2c9aff-1388-4985-a14e-5bbe89e31686 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:27.446561 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c2c9aff-1388-4985-a14e-5bbe89e31686 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:27.452878 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c2c9aff-1388-4985-a14e-5bbe89e31686 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:27.455028 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c2c9aff-1388-4985-a14e-5bbe89e31686 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:27.455902 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c2c9aff-1388-4985-a14e-5bbe89e31686 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:27.888164 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b399a479-a80b-4cc0-a4af-8aa2b6e94f51 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa07670>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:27.962232 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b399a479-a80b-4cc0-a4af-8aa2b6e94f51 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.078778 Jul 31 01:14:27.964824 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 917/1808] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:27 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:27.972735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2589f436-c2b7-443c-8e63-e2d5a297b9de tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:27.974781 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2589f436-c2b7-443c-8e63-e2d5a297b9de tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:28.000797 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2589f436-c2b7-443c-8e63-e2d5a297b9de tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:28.001679 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2589f436-c2b7-443c-8e63-e2d5a297b9de tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:28.003492 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2589f436-c2b7-443c-8e63-e2d5a297b9de tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:28.004324 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2589f436-c2b7-443c-8e63-e2d5a297b9de tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:28.968799 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2589f436-c2b7-443c-8e63-e2d5a297b9de tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:28.988048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2589f436-c2b7-443c-8e63-e2d5a297b9de tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:29.000513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2589f436-c2b7-443c-8e63-e2d5a297b9de tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:29.003461 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2589f436-c2b7-443c-8e63-e2d5a297b9de tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 200 len: 1189 microversion: 2.25 time: 1.037196 Jul 31 01:14:29.007123 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 918/1809] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:27 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 1189 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:29.027697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c69d32b6-7b21-4451-a1ac-dabaa0dfcf39 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa17430>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:29.167309 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c69d32b6-7b21-4451-a1ac-dabaa0dfcf39 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.156096 Jul 31 01:14:29.168497 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 919/1810] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:29 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:29.346432 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3c2c9aff-1388-4985-a14e-5bbe89e31686 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:29.364026 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3c2c9aff-1388-4985-a14e-5bbe89e31686 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 1.938683 Jul 31 01:14:29.366757 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 892/1811] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:27 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:14:30.034369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6e6eeb84-4739-4183-befa-96476591c2be tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:30.035141 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6e6eeb84-4739-4183-befa-96476591c2be tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: b17392cf-3f17-483a-89cb-0d7bb436bca7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:30.052331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e6eeb84-4739-4183-befa-96476591c2be tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:30.056431 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e6eeb84-4739-4183-befa-96476591c2be tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:30.058602 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e6eeb84-4739-4183-befa-96476591c2be tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:30.061834 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e6eeb84-4739-4183-befa-96476591c2be tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:30.123244 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-6e6eeb84-4739-4183-befa-96476591c2be tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] HTTP exception thrown: Instance b17392cf-3f17-483a-89cb-0d7bb436bca7 could not be found. Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6e6eeb84-4739-4183-befa-96476591c2be tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Request method failure captured: Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 HTTP/1.1 Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWrxaBaPbcg5WSdzYB0emymJbR3eQaayTh7lmhew9U2eOxlIFInfyW7ofznCm4cPAhWRUb7KhclCJ0IYIg0ODpjjRIxVHLTe8GgjJyV2xPzytF8tA6QAtZ6T0-erB_UxHDe-Utqj5G0rf_WNCN7wAoe-Km-7uilaCD58O4S7AIi0DU Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.25 Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 5881381d95ec452eb516c0c7ad826a08 Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-798817765 Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5881381d95ec452eb516c0c7ad826a08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5881381d95ec452eb516c0c7ad826a08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5881381d95ec452eb516c0c7ad826a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5881381d95ec452eb516c0c7ad826a08", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-798817765 Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 5881381d95ec452eb516c0c7ad826a08 Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-798817765 Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-LiveAutoBlockMigrationV225Test-798817765-project Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: cd6eb7e316f54ff386eaa598df805de9 Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-798817765-project Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: exception: Instance b17392cf-3f17-483a-89cb-0d7bb436bca7 could not be found. Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'b17392cf-3f17-483a-89cb-0d7bb436bca7'} Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b17392cf-3f17-483a-89cb-0d7bb436bca7 could not be found. Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b17392cf-3f17-483a-89cb-0d7bb436bca7 could not be found. Jul 31 01:14:30.130922 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:14:30.135675 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:14:30.135675 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:14:30.135675 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:14:30.135675 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:14:30.135675 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:14:30.135675 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:14:30.135675 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:14:30.135675 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b17392cf-3f17-483a-89cb-0d7bb436bca7 could not be found. Jul 31 01:14:30.135675 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:14:30.140878 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6e6eeb84-4739-4183-befa-96476591c2be tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Returning 404 to user: Instance b17392cf-3f17-483a-89cb-0d7bb436bca7 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:14:30.145349 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6e6eeb84-4739-4183-befa-96476591c2be tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7" status: 404 len: 111 microversion: 2.25 time: 0.114957 Jul 31 01:14:30.153167 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 920/1812] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:30 2022] GET /compute/v2.1/servers/b17392cf-3f17-483a-89cb-0d7bb436bca7 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:14:30.187138 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4416eef3-77eb-4bf2-a179-a12a2b7b7aad tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea907040>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:30.294472 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4416eef3-77eb-4bf2-a179-a12a2b7b7aad tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.112832 Jul 31 01:14:30.294917 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 893/1813] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:30 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:30.390261 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d4a5af71-3eec-4ee5-a900-28dbf0e4c86f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:30.391029 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d4a5af71-3eec-4ee5-a900-28dbf0e4c86f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:30.427284 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4a5af71-3eec-4ee5-a900-28dbf0e4c86f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:30.429086 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4a5af71-3eec-4ee5-a900-28dbf0e4c86f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:30.445191 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4a5af71-3eec-4ee5-a900-28dbf0e4c86f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:30.445970 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4a5af71-3eec-4ee5-a900-28dbf0e4c86f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:31.313839 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4bb8928b-4164-4b81-b832-670d8add2298 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea981b80>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:31.437941 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4bb8928b-4164-4b81-b832-670d8add2298 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.131471 Jul 31 01:14:31.439499 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 894/1814] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:31 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:31.622813 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d4a5af71-3eec-4ee5-a900-28dbf0e4c86f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:31.646413 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d4a5af71-3eec-4ee5-a900-28dbf0e4c86f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 1.261017 Jul 31 01:14:31.660114 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 921/1815] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:30 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:32.458451 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-66d21d82-df01-4774-8d37-f427541e9fc2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede5535310>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:32.600072 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-66d21d82-df01-4774-8d37-f427541e9fc2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.142889 Jul 31 01:14:32.601410 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 895/1816] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:32 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:32.682564 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-90eb87eb-b5a9-4f74-bbcb-ac090316d83d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:32.684794 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-90eb87eb-b5a9-4f74-bbcb-ac090316d83d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:32.687929 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:32.720598 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-90eb87eb-b5a9-4f74-bbcb-ac090316d83d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:32.729314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-90eb87eb-b5a9-4f74-bbcb-ac090316d83d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:32.733123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-90eb87eb-b5a9-4f74-bbcb-ac090316d83d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:32.736880 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-90eb87eb-b5a9-4f74-bbcb-ac090316d83d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:33.617732 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-75f4020c-08d7-46f2-a5c3-15a0347621b8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea981f70>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:33.811113 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-75f4020c-08d7-46f2-a5c3-15a0347621b8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.197655 Jul 31 01:14:33.812522 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 896/1817] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:33 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:34.828664 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f5c07fa9-dd68-49cc-a23d-4c429b7c1cab tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea9cc670>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:34.837128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-90eb87eb-b5a9-4f74-bbcb-ac090316d83d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:34.850220 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-90eb87eb-b5a9-4f74-bbcb-ac090316d83d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 2.172359 Jul 31 01:14:34.863466 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 922/1818] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:32 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 2178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:34.974765 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f5c07fa9-dd68-49cc-a23d-4c429b7c1cab tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.150110 Jul 31 01:14:34.977636 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 897/1819] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:34 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:35.878473 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8d0ba39e-6450-49cd-b455-49fa68837fa6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:35.879139 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8d0ba39e-6450-49cd-b455-49fa68837fa6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:35.894694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d0ba39e-6450-49cd-b455-49fa68837fa6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:35.895080 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d0ba39e-6450-49cd-b455-49fa68837fa6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:35.895921 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d0ba39e-6450-49cd-b455-49fa68837fa6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:35.896362 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d0ba39e-6450-49cd-b455-49fa68837fa6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:35.991420 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1638c7ca-493b-4e4a-a540-72a789201663 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea9811f0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:36.190483 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1638c7ca-493b-4e4a-a540-72a789201663 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.203984 Jul 31 01:14:36.191081 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 898/1820] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:35 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:37.208362 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d6791c70-c781-4a33-9a78-117488125d61 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea8fc790>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:37.315133 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d6791c70-c781-4a33-9a78-117488125d61 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.113257 Jul 31 01:14:37.317261 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 899/1821] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:37 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:14:37.341597 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-028500af-0c4e-42a6-baec-bf428140e56c tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d087270d-a8df-4a50-bbb9-d6cff281f5ae"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:37.354248 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-028500af-0c4e-42a6-baec-bf428140e56c tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:37.381675 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-028500af-0c4e-42a6-baec-bf428140e56c tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:37.382135 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-028500af-0c4e-42a6-baec-bf428140e56c tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:37.382961 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-028500af-0c4e-42a6-baec-bf428140e56c tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:37.396375 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-028500af-0c4e-42a6-baec-bf428140e56c tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:37.755967 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8d0ba39e-6450-49cd-b455-49fa68837fa6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:37.770130 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8d0ba39e-6450-49cd-b455-49fa68837fa6 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 1.896957 Jul 31 01:14:37.777560 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 923/1822] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:35 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:37.966279 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-028500af-0c4e-42a6-baec-bf428140e56c tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "POST /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.643098 Jul 31 01:14:37.973712 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 900/1823] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:14:37 2022] POST /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-volume_attachments => generated 194 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:14:38.333201 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e6580c48-dcef-4de2-b932-e79c3e3d9fac tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa17280>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:38.436822 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e6580c48-dcef-4de2-b932-e79c3e3d9fac tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.107810 Jul 31 01:14:38.447850 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 924/1824] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:38 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:38.793733 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bad9be87-6cdf-4b3e-accc-5570c727df06 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:38.794579 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bad9be87-6cdf-4b3e-accc-5570c727df06 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:38.830601 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bad9be87-6cdf-4b3e-accc-5570c727df06 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:38.831507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bad9be87-6cdf-4b3e-accc-5570c727df06 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:38.832364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bad9be87-6cdf-4b3e-accc-5570c727df06 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:38.841409 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bad9be87-6cdf-4b3e-accc-5570c727df06 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:39.457175 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0224faa9-f0a3-4316-9122-49b9fded8abf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa134c0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:39.607128 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0224faa9-f0a3-4316-9122-49b9fded8abf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.155572 Jul 31 01:14:39.617677 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 925/1825] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:39 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:40.623366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1c6890c3-843a-42cb-bde2-a9b6f5f6b385 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea9fbca0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:40.794170 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1c6890c3-843a-42cb-bde2-a9b6f5f6b385 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.175632 Jul 31 01:14:40.795088 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 926/1826] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:40 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:41.173417 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bad9be87-6cdf-4b3e-accc-5570c727df06 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:41.186885 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bad9be87-6cdf-4b3e-accc-5570c727df06 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 2.397796 Jul 31 01:14:41.190426 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 901/1827] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:38 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:41.809906 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-888470f5-b072-493a-b6e8-aaf2a12518f4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede523c5e0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:41.906215 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-888470f5-b072-493a-b6e8-aaf2a12518f4 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.099955 Jul 31 01:14:41.907843 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 927/1828] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:41 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:42.212010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-452cffe0-d187-41da-86c3-0286b008bbd7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:42.213497 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-452cffe0-d187-41da-86c3-0286b008bbd7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:42.225840 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-452cffe0-d187-41da-86c3-0286b008bbd7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:42.226716 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-452cffe0-d187-41da-86c3-0286b008bbd7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:42.231392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-452cffe0-d187-41da-86c3-0286b008bbd7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:42.232186 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-452cffe0-d187-41da-86c3-0286b008bbd7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:42.923785 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-452cffe0-d187-41da-86c3-0286b008bbd7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:42.936265 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-452cffe0-d187-41da-86c3-0286b008bbd7 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 0.727997 Jul 31 01:14:42.951738 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 902/1829] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:42 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:42.976031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-28a6de0c-cde6-48c6-a908-36c90df759af tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea8fcf70>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:43.114140 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-28a6de0c-cde6-48c6-a908-36c90df759af tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.160786 Jul 31 01:14:43.114636 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 903/1830] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:42 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:43.169616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cab4baa3-66de-4bf5-abd8-48bd9585a308 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1968994678", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "591b8849-3c5b-405c-b349-d673972b601d"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:43.304294 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-cab4baa3-66de-4bf5-abd8-48bd9585a308 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] validate_networks() for [('591b8849-3c5b-405c-b349-d673972b601d', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:14:43.509957 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1792500759", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "22ab67a7-03cf-45dc-b776-a9640b3e7972"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:43.693234 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] validate_networks() for [('22ab67a7-03cf-45dc-b776-a9640b3e7972', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:14:45.702445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-cab4baa3-66de-4bf5-abd8-48bd9585a308 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:14:45.703062 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-cab4baa3-66de-4bf5-abd8-48bd9585a308 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:14:45.703453 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-cab4baa3-66de-4bf5-abd8-48bd9585a308 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:14:45.703905 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-cab4baa3-66de-4bf5-abd8-48bd9585a308 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:14:45.704532 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-cab4baa3-66de-4bf5-abd8-48bd9585a308 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:14:45.737207 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cab4baa3-66de-4bf5-abd8-48bd9585a308 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:45.738018 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cab4baa3-66de-4bf5-abd8-48bd9585a308 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:45.739710 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cab4baa3-66de-4bf5-abd8-48bd9585a308 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:45.740382 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cab4baa3-66de-4bf5-abd8-48bd9585a308 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:45.827723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-cab4baa3-66de-4bf5-abd8-48bd9585a308 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Getting quotas for project 66c464605fa24a06a3d4e6107513a823. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:14:45.846731 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-cab4baa3-66de-4bf5-abd8-48bd9585a308 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Getting quotas for user 3657778c56d245c1b1c2081631cd4598 and project 66c464605fa24a06a3d4e6107513a823. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:14:45.897452 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cab4baa3-66de-4bf5-abd8-48bd9585a308 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:14:45.905785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cab4baa3-66de-4bf5-abd8-48bd9585a308 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:14:46.066800 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cab4baa3-66de-4bf5-abd8-48bd9585a308 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.660892 Jul 31 01:14:46.074207 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 928/1831] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:14:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3673 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 01:14:46.082695 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-32ce8d53-a6e1-42fb-b2a1-47755daba924 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:46.091270 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-32ce8d53-a6e1-42fb-b2a1-47755daba924 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:46.105366 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-32ce8d53-a6e1-42fb-b2a1-47755daba924 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:46.108573 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-32ce8d53-a6e1-42fb-b2a1-47755daba924 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:46.113331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-32ce8d53-a6e1-42fb-b2a1-47755daba924 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:46.114349 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-32ce8d53-a6e1-42fb-b2a1-47755daba924 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:46.177460 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:14:46.177937 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:14:46.178345 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:14:46.178752 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:14:46.179162 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:14:46.181344 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=32 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:46.219016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:46.219377 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:46.220446 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:46.220881 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:46.274469 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:46.340681 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Getting quotas for project f130aa9ed7364d0aad29cab48e63f0be. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:14:46.368212 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Getting quotas for user f4103d2981da44aea1ea8547f225b3b5 and project f130aa9ed7364d0aad29cab48e63f0be. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:14:46.445028 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:14:46.447329 n-d-master-1 devstack@n-api.service[119474]: WARNING nova.utils [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1792500759 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-179250075 Jul 31 01:14:46.454344 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:14:46.661091 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8d12fcaa-c82f-40ba-9918-c34220d9765d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.310829 Jul 31 01:14:46.686128 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 904/1832] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:14:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 01:14:46.697004 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9be6a4fa-e65d-451d-bc37-b18e6469078e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea931790>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:46.711033 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-32ce8d53-a6e1-42fb-b2a1-47755daba924 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:46.735943 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-32ce8d53-a6e1-42fb-b2a1-47755daba924 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 0.659039 Jul 31 01:14:46.740019 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 929/1833] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:46 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:46.759789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3a5347fa-3c9b-4dfb-81bd-f2bd4d5694c0 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:46.762134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3a5347fa-3c9b-4dfb-81bd-f2bd4d5694c0 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:46.800973 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9be6a4fa-e65d-451d-bc37-b18e6469078e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.113166 Jul 31 01:14:46.802974 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 905/1834] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:46 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:46.810850 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-02ed140e-6bae-46e4-b511-acb245e867ca tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:46.812015 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-02ed140e-6bae-46e4-b511-acb245e867ca tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:47.002018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3a5347fa-3c9b-4dfb-81bd-f2bd4d5694c0 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:47.016327 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3a5347fa-3c9b-4dfb-81bd-f2bd4d5694c0 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:47.021663 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3a5347fa-3c9b-4dfb-81bd-f2bd4d5694c0 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:47.034874 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3a5347fa-3c9b-4dfb-81bd-f2bd4d5694c0 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7" status: 200 len: 1262 microversion: 2.26 time: 0.289054 Jul 31 01:14:47.036001 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 930/1835] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:46 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7 => generated 1262 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:47.120391 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-02ed140e-6bae-46e4-b511-acb245e867ca tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4103d2981da44aea1ea8547f225b3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f130aa9ed7364d0aad29cab48e63f0be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:47.127624 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-02ed140e-6bae-46e4-b511-acb245e867ca tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553" status: 200 len: 1232 microversion: 2.1 time: 0.321998 Jul 31 01:14:47.130834 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 906/1836] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:46 2022] GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553 => generated 1232 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:47.774780 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ff4cd2a4-994e-4309-b967-a8784771772b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:47.777035 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ff4cd2a4-994e-4309-b967-a8784771772b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:47.792764 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff4cd2a4-994e-4309-b967-a8784771772b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:47.793899 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff4cd2a4-994e-4309-b967-a8784771772b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:47.795292 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff4cd2a4-994e-4309-b967-a8784771772b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:47.796929 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff4cd2a4-994e-4309-b967-a8784771772b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:47.829865 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-15ebc487-53b5-44ad-9fa1-db3feea4b467 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea916b80>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:47.998633 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-15ebc487-53b5-44ad-9fa1-db3feea4b467 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.182962 Jul 31 01:14:48.004056 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 907/1837] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:47 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:48.066061 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ec932e2c-9dec-4767-8a09-5d0a000b8346 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:48.067608 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ec932e2c-9dec-4767-8a09-5d0a000b8346 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:48.110250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec932e2c-9dec-4767-8a09-5d0a000b8346 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:48.111282 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec932e2c-9dec-4767-8a09-5d0a000b8346 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:48.112901 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec932e2c-9dec-4767-8a09-5d0a000b8346 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:48.123592 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec932e2c-9dec-4767-8a09-5d0a000b8346 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:48.470277 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ff4cd2a4-994e-4309-b967-a8784771772b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:48.488918 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ff4cd2a4-994e-4309-b967-a8784771772b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 0.717417 Jul 31 01:14:48.490077 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 931/1838] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:47 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:48.522139 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ceb48420-af16-40d5-bf62-43e3eb84c675 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:48.526567 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ceb48420-af16-40d5-bf62-43e3eb84c675 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:48.559271 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ceb48420-af16-40d5-bf62-43e3eb84c675 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:48.560057 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ceb48420-af16-40d5-bf62-43e3eb84c675 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:48.565837 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ceb48420-af16-40d5-bf62-43e3eb84c675 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:48.568385 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ceb48420-af16-40d5-bf62-43e3eb84c675 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:48.663218 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ec932e2c-9dec-4767-8a09-5d0a000b8346 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:48.686866 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ec932e2c-9dec-4767-8a09-5d0a000b8346 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:48.691036 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ec932e2c-9dec-4767-8a09-5d0a000b8346 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:48.704522 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ec932e2c-9dec-4767-8a09-5d0a000b8346 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7" status: 200 len: 1258 microversion: 2.26 time: 0.640578 Jul 31 01:14:48.715388 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 908/1839] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:48 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7 => generated 1258 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:48.872969 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ceb48420-af16-40d5-bf62-43e3eb84c675 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4103d2981da44aea1ea8547f225b3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f130aa9ed7364d0aad29cab48e63f0be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:48.900469 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ceb48420-af16-40d5-bf62-43e3eb84c675 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553" status: 200 len: 1236 microversion: 2.1 time: 0.400380 Jul 31 01:14:48.902401 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 932/1840] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:48 2022] GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553 => generated 1236 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:49.019010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1e6db2d0-f85b-4399-aa02-aeb1971a4d28 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea931b80>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:49.076746 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cfc43163-d5b7-4ab9-a2a7-79fc59b821cd tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:49.077509 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cfc43163-d5b7-4ab9-a2a7-79fc59b821cd tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:49.095527 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfc43163-d5b7-4ab9-a2a7-79fc59b821cd tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:49.098948 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfc43163-d5b7-4ab9-a2a7-79fc59b821cd tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:49.100981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfc43163-d5b7-4ab9-a2a7-79fc59b821cd tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:49.103788 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfc43163-d5b7-4ab9-a2a7-79fc59b821cd tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:49.134472 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1e6db2d0-f85b-4399-aa02-aeb1971a4d28 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.120435 Jul 31 01:14:49.135482 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 909/1841] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:49 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:49.212613 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cfc43163-d5b7-4ab9-a2a7-79fc59b821cd tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:14:49.521372 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-866436b9-797c-46b5-a4c5-d1bc36ceb3f9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:49.523567 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-866436b9-797c-46b5-a4c5-d1bc36ceb3f9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:49.529026 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cfc43163-d5b7-4ab9-a2a7-79fc59b821cd tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "DELETE /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 204 len: 0 microversion: 2.25 time: 0.453372 Jul 31 01:14:49.531583 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 933/1842] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:14:49 2022] DELETE /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:14:49.548772 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-866436b9-797c-46b5-a4c5-d1bc36ceb3f9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:49.550328 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-866436b9-797c-46b5-a4c5-d1bc36ceb3f9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:49.552315 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-866436b9-797c-46b5-a4c5-d1bc36ceb3f9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:49.553528 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7a7f5f9-95f7-49e3-b389-7b4cd33be07d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:49.554193 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-866436b9-797c-46b5-a4c5-d1bc36ceb3f9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:49.562093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a7a7f5f9-95f7-49e3-b389-7b4cd33be07d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:49.593093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7a7f5f9-95f7-49e3-b389-7b4cd33be07d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:49.595608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7a7f5f9-95f7-49e3-b389-7b4cd33be07d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:49.596761 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7a7f5f9-95f7-49e3-b389-7b4cd33be07d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:49.606613 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7a7f5f9-95f7-49e3-b389-7b4cd33be07d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:49.732507 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:50.188997 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-866436b9-797c-46b5-a4c5-d1bc36ceb3f9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:50.200004 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-866436b9-797c-46b5-a4c5-d1bc36ceb3f9 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 0.680944 Jul 31 01:14:50.213891 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 910/1843] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:49 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:50.232453 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a7a7f5f9-95f7-49e3-b389-7b4cd33be07d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:50.236171 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-540cc128-5a5d-4f0f-a906-7e3dbe103f30 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:50.236984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-540cc128-5a5d-4f0f-a906-7e3dbe103f30 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:50.269324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a7a7f5f9-95f7-49e3-b389-7b4cd33be07d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:50.272201 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-540cc128-5a5d-4f0f-a906-7e3dbe103f30 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:50.272711 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-540cc128-5a5d-4f0f-a906-7e3dbe103f30 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:50.276815 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a7a7f5f9-95f7-49e3-b389-7b4cd33be07d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:50.283511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-540cc128-5a5d-4f0f-a906-7e3dbe103f30 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:50.283982 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-540cc128-5a5d-4f0f-a906-7e3dbe103f30 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:50.293875 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a7a7f5f9-95f7-49e3-b389-7b4cd33be07d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1730 microversion: 2.25 time: 0.745227 Jul 31 01:14:50.344139 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 934/1844] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:49 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1730 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:50.362199 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-520c5277-6b6f-458a-a966-67c2964d3b03 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:50.367123 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-520c5277-6b6f-458a-a966-67c2964d3b03 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:50.385109 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-520c5277-6b6f-458a-a966-67c2964d3b03 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:50.386848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-520c5277-6b6f-458a-a966-67c2964d3b03 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:50.388322 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-520c5277-6b6f-458a-a966-67c2964d3b03 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:50.388955 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-520c5277-6b6f-458a-a966-67c2964d3b03 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:50.467620 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-540cc128-5a5d-4f0f-a906-7e3dbe103f30 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:50.478951 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-540cc128-5a5d-4f0f-a906-7e3dbe103f30 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:50.491938 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-540cc128-5a5d-4f0f-a906-7e3dbe103f30 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:50.494839 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-540cc128-5a5d-4f0f-a906-7e3dbe103f30 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7" status: 200 len: 1320 microversion: 2.26 time: 0.289998 Jul 31 01:14:50.500653 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 911/1845] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:50 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7 => generated 1320 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:50.506153 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-72980512-e3d5-4b22-b819-8effbe6ea1e0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea944700>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:50.668621 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-72980512-e3d5-4b22-b819-8effbe6ea1e0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1437 microversion: 2.1 time: 0.166293 Jul 31 01:14:50.669324 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 912/1846] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:50 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1437 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:50.829848 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-520c5277-6b6f-458a-a966-67c2964d3b03 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4103d2981da44aea1ea8547f225b3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f130aa9ed7364d0aad29cab48e63f0be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:50.846488 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-520c5277-6b6f-458a-a966-67c2964d3b03 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553" status: 200 len: 1292 microversion: 2.1 time: 0.501180 Jul 31 01:14:50.859416 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 935/1847] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:50 2022] GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553 => generated 1292 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:51.225055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5a683f61-9065-4102-b711-4d6166546b80 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:51.230939 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5a683f61-9065-4102-b711-4d6166546b80 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:51.256007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a683f61-9065-4102-b711-4d6166546b80 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:51.286179 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a683f61-9065-4102-b711-4d6166546b80 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:51.296286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a683f61-9065-4102-b711-4d6166546b80 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:51.309168 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a683f61-9065-4102-b711-4d6166546b80 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:51.357388 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0bad92dc-08b8-4abd-b39c-66ad11b36e0a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:51.358650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0bad92dc-08b8-4abd-b39c-66ad11b36e0a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:51.380413 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bad92dc-08b8-4abd-b39c-66ad11b36e0a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:51.381924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bad92dc-08b8-4abd-b39c-66ad11b36e0a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:51.384979 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bad92dc-08b8-4abd-b39c-66ad11b36e0a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:51.390560 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bad92dc-08b8-4abd-b39c-66ad11b36e0a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:53.230527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5a683f61-9065-4102-b711-4d6166546b80 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:53.240742 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5a683f61-9065-4102-b711-4d6166546b80 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 2.022787 Jul 31 01:14:53.250088 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 913/1848] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:51 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 2033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:14:53.281127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7220b11b-a9bc-48a2-bb21-82248bf185ed tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:53.281249 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7220b11b-a9bc-48a2-bb21-82248bf185ed tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:53.326957 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0bad92dc-08b8-4abd-b39c-66ad11b36e0a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:53.335079 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7220b11b-a9bc-48a2-bb21-82248bf185ed tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:53.335572 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7220b11b-a9bc-48a2-bb21-82248bf185ed tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:53.345212 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7220b11b-a9bc-48a2-bb21-82248bf185ed tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:53.345817 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7220b11b-a9bc-48a2-bb21-82248bf185ed tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:53.347545 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0bad92dc-08b8-4abd-b39c-66ad11b36e0a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:53.360318 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0bad92dc-08b8-4abd-b39c-66ad11b36e0a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:53.368078 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0bad92dc-08b8-4abd-b39c-66ad11b36e0a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1730 microversion: 2.25 time: 2.021161 Jul 31 01:14:53.373160 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 936/1849] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:51 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1730 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:53.405209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8fabf350-61d4-47c5-9b16-b6b1b81b9431 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea9c0b80>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:53.615390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7220b11b-a9bc-48a2-bb21-82248bf185ed tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:53.640634 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7220b11b-a9bc-48a2-bb21-82248bf185ed tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:53.646974 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7220b11b-a9bc-48a2-bb21-82248bf185ed tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:53.652232 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7220b11b-a9bc-48a2-bb21-82248bf185ed tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7" status: 200 len: 1320 microversion: 2.26 time: 0.385980 Jul 31 01:14:53.654362 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 914/1850] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:53 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7 => generated 1320 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:53.662560 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3d5337a8-a391-4c6b-9250-636ba4914885 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:53.663553 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3d5337a8-a391-4c6b-9250-636ba4914885 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:53.670642 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d5337a8-a391-4c6b-9250-636ba4914885 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:53.696422 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d5337a8-a391-4c6b-9250-636ba4914885 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:53.699954 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d5337a8-a391-4c6b-9250-636ba4914885 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:53.703437 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d5337a8-a391-4c6b-9250-636ba4914885 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:54.171869 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3d5337a8-a391-4c6b-9250-636ba4914885 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4103d2981da44aea1ea8547f225b3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f130aa9ed7364d0aad29cab48e63f0be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:54.183137 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3d5337a8-a391-4c6b-9250-636ba4914885 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553" status: 200 len: 1332 microversion: 2.1 time: 0.525409 Jul 31 01:14:54.186787 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 915/1851] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:53 2022] GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553 => generated 1332 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:54.286714 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-91a4a23a-63ef-4ae4-a0b3-51eb5dc27b1c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:54.288183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-91a4a23a-63ef-4ae4-a0b3-51eb5dc27b1c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:54.297979 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91a4a23a-63ef-4ae4-a0b3-51eb5dc27b1c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:54.306632 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91a4a23a-63ef-4ae4-a0b3-51eb5dc27b1c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:54.315966 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91a4a23a-63ef-4ae4-a0b3-51eb5dc27b1c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:54.319111 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91a4a23a-63ef-4ae4-a0b3-51eb5dc27b1c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:54.633149 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-91a4a23a-63ef-4ae4-a0b3-51eb5dc27b1c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:54.650398 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-91a4a23a-63ef-4ae4-a0b3-51eb5dc27b1c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 0.375539 Jul 31 01:14:54.653142 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 916/1852] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:54 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:54.678199 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8fabf350-61d4-47c5-9b16-b6b1b81b9431 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1446 microversion: 2.1 time: 1.303666 Jul 31 01:14:54.679207 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c31a6da2-6237-4824-84bb-dc6570d978ee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:54.697038 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c31a6da2-6237-4824-84bb-dc6570d978ee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:54.697177 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 937/1853] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:53 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1446 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:54.703750 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b9852662-bce2-4367-9b55-f86dee6afd81 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:54.715698 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b9852662-bce2-4367-9b55-f86dee6afd81 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:54.719195 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c31a6da2-6237-4824-84bb-dc6570d978ee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:54.723383 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c31a6da2-6237-4824-84bb-dc6570d978ee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:54.724630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c31a6da2-6237-4824-84bb-dc6570d978ee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:54.727326 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c31a6da2-6237-4824-84bb-dc6570d978ee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:54.743906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9852662-bce2-4367-9b55-f86dee6afd81 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:54.744596 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9852662-bce2-4367-9b55-f86dee6afd81 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:54.745973 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9852662-bce2-4367-9b55-f86dee6afd81 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:54.748600 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9852662-bce2-4367-9b55-f86dee6afd81 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:55.476672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c31a6da2-6237-4824-84bb-dc6570d978ee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:55.491123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c31a6da2-6237-4824-84bb-dc6570d978ee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:55.492716 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c31a6da2-6237-4824-84bb-dc6570d978ee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:55.499064 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c31a6da2-6237-4824-84bb-dc6570d978ee tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1730 microversion: 2.25 time: 0.841986 Jul 31 01:14:55.500062 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 917/1854] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:54 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1730 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:55.514152 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-61af4330-9abf-45bd-a661-ed5fa85fd83f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fede5535670>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:55.610774 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-61af4330-9abf-45bd-a661-ed5fa85fd83f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 200 len: 1446 microversion: 2.1 time: 0.108899 Jul 31 01:14:55.613367 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 918/1855] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:55 2022] GET /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 1446 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:55.619088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-69636e4b-67c6-4c3d-8e75-914fdc319fed tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:55.620421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-69636e4b-67c6-4c3d-8e75-914fdc319fed tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:55.641923 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69636e4b-67c6-4c3d-8e75-914fdc319fed tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:55.644071 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69636e4b-67c6-4c3d-8e75-914fdc319fed tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:55.651573 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69636e4b-67c6-4c3d-8e75-914fdc319fed tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:55.653770 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69636e4b-67c6-4c3d-8e75-914fdc319fed tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:55.690071 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b9852662-bce2-4367-9b55-f86dee6afd81 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:55.707723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b9852662-bce2-4367-9b55-f86dee6afd81 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:55.718351 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b9852662-bce2-4367-9b55-f86dee6afd81 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:55.722158 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b9852662-bce2-4367-9b55-f86dee6afd81 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7" status: 200 len: 1362 microversion: 2.26 time: 1.025861 Jul 31 01:14:55.725595 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 938/1856] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:54 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7 => generated 1362 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:55.734778 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7956920-8292-4973-add6-6357fea203a8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa07430>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:55.802086 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:56.145956 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-69636e4b-67c6-4c3d-8e75-914fdc319fed tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4103d2981da44aea1ea8547f225b3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f130aa9ed7364d0aad29cab48e63f0be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:56.176049 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-69636e4b-67c6-4c3d-8e75-914fdc319fed tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553" status: 200 len: 1332 microversion: 2.1 time: 0.554935 Jul 31 01:14:56.187388 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 919/1857] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:55 2022] GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553 => generated 1332 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:56.187388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3a017fb9-dd9d-424d-bf99-205c689653ea tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:56.187388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3a017fb9-dd9d-424d-bf99-205c689653ea tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:56.230789 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a017fb9-dd9d-424d-bf99-205c689653ea tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:56.235164 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a017fb9-dd9d-424d-bf99-205c689653ea tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:56.236240 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a017fb9-dd9d-424d-bf99-205c689653ea tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:56.238095 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a017fb9-dd9d-424d-bf99-205c689653ea tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:56.306475 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:57.011109 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:57.038904 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a7956920-8292-4973-add6-6357fea203a8 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "DELETE /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 204 len: 0 microversion: 2.1 time: 1.312006 Jul 31 01:14:57.039782 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 939/1858] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:55 2022] DELETE /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 0 bytes in 1314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:14:57.047640 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-80cfc495-0ab3-4b98-87ca-b85874ffed4a req-e5c71871-d774-4703-b5d8-6e0cefa04e31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b1a43c9-7310-4068-9b24-7ceb7c935553", "tag": "d19472c9-6b7c-4f7b-a72a-118ac2c23928"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:57.127401 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=8 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:57.142238 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-80cfc495-0ab3-4b98-87ca-b85874ffed4a req-e5c71871-d774-4703-b5d8-6e0cefa04e31 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:57.142711 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-80cfc495-0ab3-4b98-87ca-b85874ffed4a req-e5c71871-d774-4703-b5d8-6e0cefa04e31 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:57.222353 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-80cfc495-0ab3-4b98-87ca-b85874ffed4a req-e5c71871-d774-4703-b5d8-6e0cefa04e31 service nova] Creating event network-changed:d19472c9-6b7c-4f7b-a72a-118ac2c23928 for instance 9b1a43c9-7310-4068-9b24-7ceb7c935553 on n-h2-master-1 Jul 31 01:14:57.248687 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-80cfc495-0ab3-4b98-87ca-b85874ffed4a req-e5c71871-d774-4703-b5d8-6e0cefa04e31 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207240 Jul 31 01:14:57.255022 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 940/1859] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:14:57.277467 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5d7deaa9-837f-4a73-866c-7240670dbb93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:57.280342 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5d7deaa9-837f-4a73-866c-7240670dbb93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:57.329467 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d7deaa9-837f-4a73-866c-7240670dbb93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:57.336817 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d7deaa9-837f-4a73-866c-7240670dbb93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:57.338228 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d7deaa9-837f-4a73-866c-7240670dbb93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:57.339567 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d7deaa9-837f-4a73-866c-7240670dbb93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:57.423028 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d7deaa9-837f-4a73-866c-7240670dbb93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:57.423937 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d7deaa9-837f-4a73-866c-7240670dbb93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:57.424634 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-5d7deaa9-837f-4a73-866c-7240670dbb93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lazy-loading 'fault' on Instance uuid 011dbabc-56cc-4f90-be60-972ffeb468b1 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:14:57.543805 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3a017fb9-dd9d-424d-bf99-205c689653ea tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:57.558766 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3a017fb9-dd9d-424d-bf99-205c689653ea tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 1.379789 Jul 31 01:14:57.573212 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 920/1860] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:56 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:14:57.579440 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-20504736-854b-40cb-86e3-6531eb60ad7b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:57.604431 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-20504736-854b-40cb-86e3-6531eb60ad7b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:57.636570 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5d7deaa9-837f-4a73-866c-7240670dbb93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:57.654759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5d7deaa9-837f-4a73-866c-7240670dbb93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:57.657642 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-20504736-854b-40cb-86e3-6531eb60ad7b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:57.666341 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-20504736-854b-40cb-86e3-6531eb60ad7b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:57.669474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-20504736-854b-40cb-86e3-6531eb60ad7b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:57.672079 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5d7deaa9-837f-4a73-866c-7240670dbb93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:57.674000 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5d7deaa9-837f-4a73-866c-7240670dbb93 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 200 len: 1375 microversion: 2.25 time: 0.416801 Jul 31 01:14:57.675047 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-20504736-854b-40cb-86e3-6531eb60ad7b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:57.680866 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 941/1861] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:57 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 1375 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:57.703813 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-ae3cdd49-ac41-40e0-adae-56e32a9cf92b req-b1789419-112f-4b22-81ba-4145e4ebd700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011dbabc-56cc-4f90-be60-972ffeb468b1", "name": "network-vif-deleted", "tag": "4bf6b045-f27a-43d0-a436-872ac90dc24a"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:57.752727 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ae3cdd49-ac41-40e0-adae-56e32a9cf92b req-b1789419-112f-4b22-81ba-4145e4ebd700 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:57.773686 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ae3cdd49-ac41-40e0-adae-56e32a9cf92b req-b1789419-112f-4b22-81ba-4145e4ebd700 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:57.836085 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-ae3cdd49-ac41-40e0-adae-56e32a9cf92b req-b1789419-112f-4b22-81ba-4145e4ebd700 service nova] Creating event network-vif-deleted:4bf6b045-f27a-43d0-a436-872ac90dc24a for instance 011dbabc-56cc-4f90-be60-972ffeb468b1 on n-h1-master-1 Jul 31 01:14:57.857370 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-ae3cdd49-ac41-40e0-adae-56e32a9cf92b req-b1789419-112f-4b22-81ba-4145e4ebd700 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172097 Jul 31 01:14:57.864100 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 942/1862] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:14:57.883317 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-07414db8-9c7b-45ae-86c8-5db151c0f17e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:57.884314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-07414db8-9c7b-45ae-86c8-5db151c0f17e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:57.931127 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07414db8-9c7b-45ae-86c8-5db151c0f17e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:57.939212 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07414db8-9c7b-45ae-86c8-5db151c0f17e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:57.940479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07414db8-9c7b-45ae-86c8-5db151c0f17e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:57.942038 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07414db8-9c7b-45ae-86c8-5db151c0f17e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:58.036920 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-07414db8-9c7b-45ae-86c8-5db151c0f17e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:14:58.257971 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-07414db8-9c7b-45ae-86c8-5db151c0f17e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d" status: 204 len: 0 microversion: 2.1 time: 0.392221 Jul 31 01:14:58.263468 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 943/1863] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:14:57 2022] DELETE /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:14:58.297875 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2c973285-cdfd-488b-8778-d09006650a4d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:14:58.315988 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2c973285-cdfd-488b-8778-d09006650a4d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:14:58.340675 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c973285-cdfd-488b-8778-d09006650a4d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:58.342599 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c973285-cdfd-488b-8778-d09006650a4d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:58.344095 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c973285-cdfd-488b-8778-d09006650a4d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:14:58.347961 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c973285-cdfd-488b-8778-d09006650a4d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:14:59.635952 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-20504736-854b-40cb-86e3-6531eb60ad7b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:59.652901 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-20504736-854b-40cb-86e3-6531eb60ad7b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:59.669243 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-20504736-854b-40cb-86e3-6531eb60ad7b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:14:59.673752 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-20504736-854b-40cb-86e3-6531eb60ad7b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7" status: 200 len: 1362 microversion: 2.26 time: 2.099249 Jul 31 01:14:59.683750 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 921/1864] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:14:57 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7 => generated 1362 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:14:59.694303 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-05092fd3-2518-48e8-b793-23aabc6fda1f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2019475979", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "6202340f-0183-4051-846c-d255fe21d994"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:14:59.846637 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-05092fd3-2518-48e8-b793-23aabc6fda1f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] validate_networks() for [('6202340f-0183-4051-846c-d255fe21d994', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:15:00.520057 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2c973285-cdfd-488b-8778-d09006650a4d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4103d2981da44aea1ea8547f225b3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f130aa9ed7364d0aad29cab48e63f0be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:00.531478 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2c973285-cdfd-488b-8778-d09006650a4d tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553" status: 200 len: 1332 microversion: 2.1 time: 2.263368 Jul 31 01:15:00.564926 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 944/1865] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:14:58 2022] GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553 => generated 1332 bytes in 2301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:00.573867 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-33565e7f-d217-4a61-9b04-05a85d4923ae tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:00.584312 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-33565e7f-d217-4a61-9b04-05a85d4923ae tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:00.601944 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33565e7f-d217-4a61-9b04-05a85d4923ae tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:00.602889 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33565e7f-d217-4a61-9b04-05a85d4923ae tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:00.607651 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33565e7f-d217-4a61-9b04-05a85d4923ae tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:00.608379 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33565e7f-d217-4a61-9b04-05a85d4923ae tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:01.678820 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-33565e7f-d217-4a61-9b04-05a85d4923ae tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:01.688566 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-33565e7f-d217-4a61-9b04-05a85d4923ae tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 1.121840 Jul 31 01:15:01.711711 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 945/1866] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:00 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:01.728427 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c50658aa-901f-4d18-a17c-d8bb7578c0e5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:01.729368 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c50658aa-901f-4d18-a17c-d8bb7578c0e5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 011dbabc-56cc-4f90-be60-972ffeb468b1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:01.746020 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c50658aa-901f-4d18-a17c-d8bb7578c0e5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:01.746494 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c50658aa-901f-4d18-a17c-d8bb7578c0e5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:01.747313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c50658aa-901f-4d18-a17c-d8bb7578c0e5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:01.748365 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c50658aa-901f-4d18-a17c-d8bb7578c0e5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:01.783906 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-c50658aa-901f-4d18-a17c-d8bb7578c0e5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] HTTP exception thrown: Instance 011dbabc-56cc-4f90-be60-972ffeb468b1 could not be found. Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c50658aa-901f-4d18-a17c-d8bb7578c0e5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Request method failure captured: Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 HTTP/1.1 Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWrxaBaPbcg5WSdzYB0emymJbR3eQaayTh7lmhew9U2eOxlIFInfyW7ofznCm4cPAhWRUb7KhclCJ0IYIg0ODpjjRIxVHLTe8GgjJyV2xPzytF8tA6QAtZ6T0-erB_UxHDe-Utqj5G0rf_WNCN7wAoe-Km-7uilaCD58O4S7AIi0DU Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.25 Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 5881381d95ec452eb516c0c7ad826a08 Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-798817765 Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5881381d95ec452eb516c0c7ad826a08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5881381d95ec452eb516c0c7ad826a08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5881381d95ec452eb516c0c7ad826a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5881381d95ec452eb516c0c7ad826a08", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-798817765 Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 5881381d95ec452eb516c0c7ad826a08 Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-798817765 Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-LiveAutoBlockMigrationV225Test-798817765-project Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: cd6eb7e316f54ff386eaa598df805de9 Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-798817765-project Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 011dbabc-56cc-4f90-be60-972ffeb468b1 could not be found. Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '011dbabc-56cc-4f90-be60-972ffeb468b1'} Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011dbabc-56cc-4f90-be60-972ffeb468b1 could not be found. Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011dbabc-56cc-4f90-be60-972ffeb468b1 could not be found. Jul 31 01:15:01.802176 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:01.808149 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:01.808149 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:01.808149 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:01.808149 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:01.808149 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:01.808149 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:01.808149 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:01.808149 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011dbabc-56cc-4f90-be60-972ffeb468b1 could not be found. Jul 31 01:15:01.808149 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:01.808149 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c50658aa-901f-4d18-a17c-d8bb7578c0e5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Returning 404 to user: Instance 011dbabc-56cc-4f90-be60-972ffeb468b1 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:01.808149 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c50658aa-901f-4d18-a17c-d8bb7578c0e5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1" status: 404 len: 111 microversion: 2.25 time: 0.090577 Jul 31 01:15:01.814839 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 946/1867] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:15:01 2022] GET /compute/v2.1/servers/011dbabc-56cc-4f90-be60-972ffeb468b1 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:15:01.825897 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-86cb213c-f761-4fdb-97fb-3eaf8d13740b req-d2636741-dd97-4214-ab13-24f75aebc84d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c64a12-7c3e-41f9-91d1-b82820b3cd08", "name": "network-vif-unplugged", "status": "completed", "tag": "34a0bfd7-254c-4a84-8f10-da931e137ce2"}, {"name": "network-changed", "server_uuid": "88d862c0-3b17-44a3-a405-9c28427a3db7", "tag": "f9cdca3b-8174-4f00-84be-54b07393ab04"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:01.842699 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-86cb213c-f761-4fdb-97fb-3eaf8d13740b req-d2636741-dd97-4214-ab13-24f75aebc84d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:01.846186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-86cb213c-f761-4fdb-97fb-3eaf8d13740b req-d2636741-dd97-4214-ab13-24f75aebc84d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:01.868693 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-86cb213c-f761-4fdb-97fb-3eaf8d13740b req-d2636741-dd97-4214-ab13-24f75aebc84d service nova] Creating event network-vif-unplugged:34a0bfd7-254c-4a84-8f10-da931e137ce2 for instance f7c64a12-7c3e-41f9-91d1-b82820b3cd08 on n-h2-master-1 Jul 31 01:15:01.869869 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-86cb213c-f761-4fdb-97fb-3eaf8d13740b req-d2636741-dd97-4214-ab13-24f75aebc84d service nova] Creating event network-changed:f9cdca3b-8174-4f00-84be-54b07393ab04 for instance 88d862c0-3b17-44a3-a405-9c28427a3db7 on n-h2-master-1 Jul 31 01:15:01.879791 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-86cb213c-f761-4fdb-97fb-3eaf8d13740b req-d2636741-dd97-4214-ab13-24f75aebc84d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.061694 Jul 31 01:15:01.880728 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 947/1868] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:01.889698 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ca4adf40-977c-4e3c-a63d-d56f7fb5b2cf tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:01.890722 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ca4adf40-977c-4e3c-a63d-d56f7fb5b2cf tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:01.898842 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca4adf40-977c-4e3c-a63d-d56f7fb5b2cf tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:01.899760 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca4adf40-977c-4e3c-a63d-d56f7fb5b2cf tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:01.900523 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca4adf40-977c-4e3c-a63d-d56f7fb5b2cf tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:01.901365 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca4adf40-977c-4e3c-a63d-d56f7fb5b2cf tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:02.449009 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ca4adf40-977c-4e3c-a63d-d56f7fb5b2cf tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:02.462879 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ca4adf40-977c-4e3c-a63d-d56f7fb5b2cf tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:02.467594 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ca4adf40-977c-4e3c-a63d-d56f7fb5b2cf tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:02.480323 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ca4adf40-977c-4e3c-a63d-d56f7fb5b2cf tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7" status: 200 len: 1362 microversion: 2.26 time: 0.598156 Jul 31 01:15:02.480949 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 948/1869] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:15:01 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7 => generated 1362 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:15:02.485592 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-e0d4fe1c-e83f-402b-9863-14a241aa6689 req-164838c9-c824-444c-996c-5bb05f573ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b840182-0fef-4cd6-be37-17f8a4f0025d", "name": "network-vif-unplugged", "status": "completed", "tag": "f3011ab8-3ce2-4421-a217-91dc0c5473a2"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:02.505798 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e0d4fe1c-e83f-402b-9863-14a241aa6689 req-164838c9-c824-444c-996c-5bb05f573ae1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:02.506172 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e0d4fe1c-e83f-402b-9863-14a241aa6689 req-164838c9-c824-444c-996c-5bb05f573ae1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:02.538132 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-e0d4fe1c-e83f-402b-9863-14a241aa6689 req-164838c9-c824-444c-996c-5bb05f573ae1 service nova] Creating event network-vif-unplugged:f3011ab8-3ce2-4421-a217-91dc0c5473a2 for instance 0b840182-0fef-4cd6-be37-17f8a4f0025d on n-h1-master-1 Jul 31 01:15:02.545958 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-e0d4fe1c-e83f-402b-9863-14a241aa6689 req-164838c9-c824-444c-996c-5bb05f573ae1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063271 Jul 31 01:15:02.546702 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 949/1870] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:02.565323 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9404c6e7-5382-41f9-91d8-1350343b6cc2 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:02.567877 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9404c6e7-5382-41f9-91d8-1350343b6cc2 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:02.581362 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-05092fd3-2518-48e8-b793-23aabc6fda1f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:15:02.583074 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-05092fd3-2518-48e8-b793-23aabc6fda1f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:15:02.583774 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-05092fd3-2518-48e8-b793-23aabc6fda1f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:15:02.584970 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-05092fd3-2518-48e8-b793-23aabc6fda1f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:15:02.585580 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-05092fd3-2518-48e8-b793-23aabc6fda1f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:15:02.585714 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9404c6e7-5382-41f9-91d8-1350343b6cc2 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:02.586143 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9404c6e7-5382-41f9-91d8-1350343b6cc2 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:02.589864 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9404c6e7-5382-41f9-91d8-1350343b6cc2 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:02.592034 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9404c6e7-5382-41f9-91d8-1350343b6cc2 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:02.618579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-05092fd3-2518-48e8-b793-23aabc6fda1f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:02.622774 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-05092fd3-2518-48e8-b793-23aabc6fda1f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:02.626601 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-05092fd3-2518-48e8-b793-23aabc6fda1f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:02.627485 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-05092fd3-2518-48e8-b793-23aabc6fda1f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:02.662571 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-05092fd3-2518-48e8-b793-23aabc6fda1f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Getting quotas for project 3fb526f587384fdea1a06d8b3b685dcf. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:15:02.672647 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-05092fd3-2518-48e8-b793-23aabc6fda1f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Getting quotas for user f4352f9b8762490e9187e28e8c9cd58e and project 3fb526f587384fdea1a06d8b3b685dcf. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:15:02.690098 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-05092fd3-2518-48e8-b793-23aabc6fda1f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:15:02.692996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-05092fd3-2518-48e8-b793-23aabc6fda1f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:15:02.778837 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-05092fd3-2518-48e8-b793-23aabc6fda1f tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.093477 Jul 31 01:15:02.780270 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 922/1871] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:14:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:15:02.785554 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8d65243b-7258-4cca-848c-dc5f53c8f4f5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '.version_select at 0x7fedea9311f0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:02.811720 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8d65243b-7258-4cca-848c-dc5f53c8f4f5 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314929671" status: 204 len: 0 microversion: 2.25 time: 0.030002 Jul 31 01:15:02.812679 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 923/1872] 10.222.0.45 () {60 vars in 1262 bytes} [Sun Jul 31 01:15:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314929671 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:15:02.820462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1b8d06c4-e3ba-4148-8426-d20105346607 req-132b5cb1-9924-40a0-9d46-a48227153922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b840182-0fef-4cd6-be37-17f8a4f0025d", "name": "network-vif-deleted", "tag": "f3011ab8-3ce2-4421-a217-91dc0c5473a2"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:02.832041 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1b8d06c4-e3ba-4148-8426-d20105346607 req-132b5cb1-9924-40a0-9d46-a48227153922 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:02.833188 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1b8d06c4-e3ba-4148-8426-d20105346607 req-132b5cb1-9924-40a0-9d46-a48227153922 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:02.847308 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1b8d06c4-e3ba-4148-8426-d20105346607 req-132b5cb1-9924-40a0-9d46-a48227153922 service nova] Creating event network-vif-deleted:f3011ab8-3ce2-4421-a217-91dc0c5473a2 for instance 0b840182-0fef-4cd6-be37-17f8a4f0025d on n-h1-master-1 Jul 31 01:15:02.852806 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1b8d06c4-e3ba-4148-8426-d20105346607 req-132b5cb1-9924-40a0-9d46-a48227153922 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038551 Jul 31 01:15:02.854634 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 924/1873] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:02.860079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ab2887ff-8a75-4596-93c6-e30742c2bd88 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:02.861425 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ab2887ff-8a75-4596-93c6-e30742c2bd88 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:02.871300 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab2887ff-8a75-4596-93c6-e30742c2bd88 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:02.872214 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab2887ff-8a75-4596-93c6-e30742c2bd88 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:02.873302 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab2887ff-8a75-4596-93c6-e30742c2bd88 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:02.874033 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab2887ff-8a75-4596-93c6-e30742c2bd88 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:03.307288 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9404c6e7-5382-41f9-91d8-1350343b6cc2 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4103d2981da44aea1ea8547f225b3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f130aa9ed7364d0aad29cab48e63f0be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:03.331242 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9404c6e7-5382-41f9-91d8-1350343b6cc2 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553" status: 200 len: 1332 microversion: 2.1 time: 0.777762 Jul 31 01:15:03.335697 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 950/1874] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:02 2022] GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553 => generated 1332 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:03.353887 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0778716e-b897-4185-93ac-2d6acf03748e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:03.357594 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0778716e-b897-4185-93ac-2d6acf03748e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:03.362996 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:03.476479 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0778716e-b897-4185-93ac-2d6acf03748e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:03.483824 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0778716e-b897-4185-93ac-2d6acf03748e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429" status: 200 len: 1208 microversion: 2.1 time: 0.140948 Jul 31 01:15:03.485483 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 951/1875] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:03 2022] GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 => generated 1208 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:03.504905 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-25462e00-aa1d-4784-9217-f687812c3e6f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:03.505873 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-25462e00-aa1d-4784-9217-f687812c3e6f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:03.518343 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25462e00-aa1d-4784-9217-f687812c3e6f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:03.524070 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25462e00-aa1d-4784-9217-f687812c3e6f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:03.525656 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25462e00-aa1d-4784-9217-f687812c3e6f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:03.528648 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25462e00-aa1d-4784-9217-f687812c3e6f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:03.711119 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ab2887ff-8a75-4596-93c6-e30742c2bd88 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:03.720922 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ab2887ff-8a75-4596-93c6-e30742c2bd88 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 0.864772 Jul 31 01:15:03.729900 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 925/1876] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:02 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:04.009209 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-99ec3f08-0112-4e14-907d-30a62396913d req-379b827d-da7a-44ae-bfcc-9ff091abc0fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c64a12-7c3e-41f9-91d1-b82820b3cd08", "tag": "34a0bfd7-254c-4a84-8f10-da931e137ce2"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:04.067920 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-99ec3f08-0112-4e14-907d-30a62396913d req-379b827d-da7a-44ae-bfcc-9ff091abc0fa service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:04.069173 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-99ec3f08-0112-4e14-907d-30a62396913d req-379b827d-da7a-44ae-bfcc-9ff091abc0fa service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:04.093821 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-25462e00-aa1d-4784-9217-f687812c3e6f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:04.110569 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-25462e00-aa1d-4784-9217-f687812c3e6f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:04.114441 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-99ec3f08-0112-4e14-907d-30a62396913d req-379b827d-da7a-44ae-bfcc-9ff091abc0fa service nova] Creating event network-changed:34a0bfd7-254c-4a84-8f10-da931e137ce2 for instance f7c64a12-7c3e-41f9-91d1-b82820b3cd08 on n-h2-master-1 Jul 31 01:15:04.118520 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-25462e00-aa1d-4784-9217-f687812c3e6f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:04.138475 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-25462e00-aa1d-4784-9217-f687812c3e6f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7" status: 200 len: 1362 microversion: 2.26 time: 0.638101 Jul 31 01:15:04.156393 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 952/1877] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:15:03 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7 => generated 1362 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:15:04.158022 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-99ec3f08-0112-4e14-907d-30a62396913d req-379b827d-da7a-44ae-bfcc-9ff091abc0fa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144263 Jul 31 01:15:04.164122 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 926/1878] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:15:04.366042 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-254a1085-7fc9-4123-9b1a-50aa9963db25 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:04.372973 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-254a1085-7fc9-4123-9b1a-50aa9963db25 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:04.397800 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-254a1085-7fc9-4123-9b1a-50aa9963db25 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:04.399767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-254a1085-7fc9-4123-9b1a-50aa9963db25 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:04.404090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-254a1085-7fc9-4123-9b1a-50aa9963db25 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:04.408816 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-254a1085-7fc9-4123-9b1a-50aa9963db25 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:04.511509 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1d4f3937-6e7f-4c8b-b08e-90444e3cdd42 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:04.513047 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1d4f3937-6e7f-4c8b-b08e-90444e3cdd42 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:04.533399 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d4f3937-6e7f-4c8b-b08e-90444e3cdd42 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:04.536015 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d4f3937-6e7f-4c8b-b08e-90444e3cdd42 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:04.543636 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d4f3937-6e7f-4c8b-b08e-90444e3cdd42 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:04.546430 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d4f3937-6e7f-4c8b-b08e-90444e3cdd42 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:04.782403 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1d4f3937-6e7f-4c8b-b08e-90444e3cdd42 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:04.797813 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1d4f3937-6e7f-4c8b-b08e-90444e3cdd42 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429" status: 200 len: 1260 microversion: 2.1 time: 0.291019 Jul 31 01:15:04.813526 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 927/1879] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:04 2022] GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 => generated 1260 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:04.825122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a1ef297e-808a-4521-af15-02e5d56843e0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:04.828479 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a1ef297e-808a-4521-af15-02e5d56843e0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:04.846948 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1ef297e-808a-4521-af15-02e5d56843e0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:04.849323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1ef297e-808a-4521-af15-02e5d56843e0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:04.851056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1ef297e-808a-4521-af15-02e5d56843e0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:04.852859 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1ef297e-808a-4521-af15-02e5d56843e0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:06.287003 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-254a1085-7fc9-4123-9b1a-50aa9963db25 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4103d2981da44aea1ea8547f225b3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f130aa9ed7364d0aad29cab48e63f0be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:06.297086 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-254a1085-7fc9-4123-9b1a-50aa9963db25 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553" status: 200 len: 1332 microversion: 2.1 time: 1.938511 Jul 31 01:15:06.308905 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 953/1880] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:04 2022] GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553 => generated 1332 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:06.316351 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ce15694b-30d9-4921-a95f-0927685d2ed2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:06.317373 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ce15694b-30d9-4921-a95f-0927685d2ed2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:06.346682 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce15694b-30d9-4921-a95f-0927685d2ed2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:06.348049 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce15694b-30d9-4921-a95f-0927685d2ed2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:06.350330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce15694b-30d9-4921-a95f-0927685d2ed2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:06.351170 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce15694b-30d9-4921-a95f-0927685d2ed2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:06.749242 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a1ef297e-808a-4521-af15-02e5d56843e0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:06.761978 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a1ef297e-808a-4521-af15-02e5d56843e0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 1.947099 Jul 31 01:15:06.765580 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 928/1881] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:04 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:06.775142 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5cad3788-9fdf-4d93-83f3-27f3f9ae7588 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:06.781117 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5cad3788-9fdf-4d93-83f3-27f3f9ae7588 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:06.813374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5cad3788-9fdf-4d93-83f3-27f3f9ae7588 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:06.814176 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5cad3788-9fdf-4d93-83f3-27f3f9ae7588 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:06.823586 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5cad3788-9fdf-4d93-83f3-27f3f9ae7588 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:06.824047 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5cad3788-9fdf-4d93-83f3-27f3f9ae7588 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:06.944115 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5cad3788-9fdf-4d93-83f3-27f3f9ae7588 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:06.953821 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5cad3788-9fdf-4d93-83f3-27f3f9ae7588 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429" status: 200 len: 1266 microversion: 2.1 time: 0.186759 Jul 31 01:15:06.957299 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 929/1882] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:06 2022] GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:06.972598 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7aa347e5-5c33-4d5d-8da8-05f3faa43295 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:06.973206 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7aa347e5-5c33-4d5d-8da8-05f3faa43295 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:06.984727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7aa347e5-5c33-4d5d-8da8-05f3faa43295 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:06.985677 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7aa347e5-5c33-4d5d-8da8-05f3faa43295 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:06.986705 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7aa347e5-5c33-4d5d-8da8-05f3faa43295 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:06.987372 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7aa347e5-5c33-4d5d-8da8-05f3faa43295 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:06.992431 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ce15694b-30d9-4921-a95f-0927685d2ed2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:07.007448 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ce15694b-30d9-4921-a95f-0927685d2ed2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:07.012050 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ce15694b-30d9-4921-a95f-0927685d2ed2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:07.013784 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ce15694b-30d9-4921-a95f-0927685d2ed2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7" status: 200 len: 1362 microversion: 2.26 time: 0.703483 Jul 31 01:15:07.028535 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 954/1883] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:15:06 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7 => generated 1362 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:15:07.045027 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:07.050447 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7aa347e5-5c33-4d5d-8da8-05f3faa43295 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:15:07.153903 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7aa347e5-5c33-4d5d-8da8-05f3faa43295 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 204 len: 0 microversion: 2.25 time: 0.193027 Jul 31 01:15:07.156261 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 930/1884] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:15:06 2022] DELETE /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:15:07.165692 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b7ad50ca-fbb7-4ce8-8ff5-3d53f34d4dc2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:07.168493 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b7ad50ca-fbb7-4ce8-8ff5-3d53f34d4dc2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:07.176555 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7ad50ca-fbb7-4ce8-8ff5-3d53f34d4dc2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:07.177209 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7ad50ca-fbb7-4ce8-8ff5-3d53f34d4dc2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:07.178446 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7ad50ca-fbb7-4ce8-8ff5-3d53f34d4dc2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:07.179280 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7ad50ca-fbb7-4ce8-8ff5-3d53f34d4dc2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:07.184809 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:07.331828 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-50b64caa-51fa-4183-b4dd-e10e7c6bb27e tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:07.332727 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-50b64caa-51fa-4183-b4dd-e10e7c6bb27e tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:07.357021 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50b64caa-51fa-4183-b4dd-e10e7c6bb27e tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:07.368548 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50b64caa-51fa-4183-b4dd-e10e7c6bb27e tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:07.369503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50b64caa-51fa-4183-b4dd-e10e7c6bb27e tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:07.369993 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50b64caa-51fa-4183-b4dd-e10e7c6bb27e tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:08.072871 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b7ad50ca-fbb7-4ce8-8ff5-3d53f34d4dc2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:08.095274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b7ad50ca-fbb7-4ce8-8ff5-3d53f34d4dc2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:08.103231 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b7ad50ca-fbb7-4ce8-8ff5-3d53f34d4dc2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:08.105063 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b7ad50ca-fbb7-4ce8-8ff5-3d53f34d4dc2 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1548 microversion: 2.25 time: 0.944277 Jul 31 01:15:08.107867 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 955/1885] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:15:07 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1548 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:15:08.114786 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-c83ede25-9557-4c16-9086-6ebfa80d21e3 req-0fb0d0e6-0307-4c6c-bf47-4bd89eba8d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b1a43c9-7310-4068-9b24-7ceb7c935553", "name": "network-vif-plugged", "status": "completed", "tag": "d19472c9-6b7c-4f7b-a72a-118ac2c23928"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:08.142534 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c83ede25-9557-4c16-9086-6ebfa80d21e3 req-0fb0d0e6-0307-4c6c-bf47-4bd89eba8d91 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:08.142990 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c83ede25-9557-4c16-9086-6ebfa80d21e3 req-0fb0d0e6-0307-4c6c-bf47-4bd89eba8d91 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:08.159811 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-c83ede25-9557-4c16-9086-6ebfa80d21e3 req-0fb0d0e6-0307-4c6c-bf47-4bd89eba8d91 service nova] Creating event network-vif-plugged:d19472c9-6b7c-4f7b-a72a-118ac2c23928 for instance 9b1a43c9-7310-4068-9b24-7ceb7c935553 on n-h2-master-1 Jul 31 01:15:08.166076 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-c83ede25-9557-4c16-9086-6ebfa80d21e3 req-0fb0d0e6-0307-4c6c-bf47-4bd89eba8d91 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054847 Jul 31 01:15:08.167642 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 956/1886] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:08.174134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ff5c8f76-ce6c-4ad2-8e93-7f408534dd4b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:08.175317 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ff5c8f76-ce6c-4ad2-8e93-7f408534dd4b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:08.184205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff5c8f76-ce6c-4ad2-8e93-7f408534dd4b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:08.184702 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff5c8f76-ce6c-4ad2-8e93-7f408534dd4b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:08.185850 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff5c8f76-ce6c-4ad2-8e93-7f408534dd4b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:08.187089 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-50b64caa-51fa-4183-b4dd-e10e7c6bb27e tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4103d2981da44aea1ea8547f225b3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f130aa9ed7364d0aad29cab48e63f0be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:08.188682 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff5c8f76-ce6c-4ad2-8e93-7f408534dd4b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:08.201423 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-50b64caa-51fa-4183-b4dd-e10e7c6bb27e tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553" status: 200 len: 1332 microversion: 2.1 time: 0.875243 Jul 31 01:15:08.217127 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 931/1887] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:07 2022] GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553 => generated 1332 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:08.232687 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-613494b8-3c3a-4dca-9b3d-8eb3b5f06ae0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:08.237136 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-613494b8-3c3a-4dca-9b3d-8eb3b5f06ae0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:08.255158 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-613494b8-3c3a-4dca-9b3d-8eb3b5f06ae0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:08.257198 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-613494b8-3c3a-4dca-9b3d-8eb3b5f06ae0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:08.263103 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-613494b8-3c3a-4dca-9b3d-8eb3b5f06ae0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:08.265000 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-613494b8-3c3a-4dca-9b3d-8eb3b5f06ae0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:08.946531 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-613494b8-3c3a-4dca-9b3d-8eb3b5f06ae0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:08.960696 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-613494b8-3c3a-4dca-9b3d-8eb3b5f06ae0 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429" status: 200 len: 1266 microversion: 2.1 time: 0.738771 Jul 31 01:15:08.961344 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 932/1888] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:08 2022] GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 => generated 1266 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:08.974430 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a242a320-b0df-4363-a8d5-0b60a22156e2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:08.975903 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a242a320-b0df-4363-a8d5-0b60a22156e2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:09.005839 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a242a320-b0df-4363-a8d5-0b60a22156e2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:09.007038 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a242a320-b0df-4363-a8d5-0b60a22156e2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:09.008759 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a242a320-b0df-4363-a8d5-0b60a22156e2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:09.009752 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a242a320-b0df-4363-a8d5-0b60a22156e2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:09.245705 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ff5c8f76-ce6c-4ad2-8e93-7f408534dd4b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:09.262079 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ff5c8f76-ce6c-4ad2-8e93-7f408534dd4b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 1.092246 Jul 31 01:15:09.263742 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 957/1889] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:08 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:09.275730 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-bd01313a-3c9b-477b-a281-fd977d1e2ec4 req-587b40a8-caea-4aa5-8dfa-2fb3f619ec9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4db5ff-45fe-4d51-809d-d8983072a691", "name": "network-vif-deleted", "tag": "ef0fdb3a-4238-4134-9002-c9963f855ec6"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:09.293702 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-bd01313a-3c9b-477b-a281-fd977d1e2ec4 req-587b40a8-caea-4aa5-8dfa-2fb3f619ec9c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:09.295096 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-bd01313a-3c9b-477b-a281-fd977d1e2ec4 req-587b40a8-caea-4aa5-8dfa-2fb3f619ec9c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:09.313306 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-bd01313a-3c9b-477b-a281-fd977d1e2ec4 req-587b40a8-caea-4aa5-8dfa-2fb3f619ec9c service nova] Creating event network-vif-deleted:ef0fdb3a-4238-4134-9002-c9963f855ec6 for instance 2d4db5ff-45fe-4d51-809d-d8983072a691 on n-h2-master-1 Jul 31 01:15:09.321812 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-bd01313a-3c9b-477b-a281-fd977d1e2ec4 req-587b40a8-caea-4aa5-8dfa-2fb3f619ec9c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055692 Jul 31 01:15:09.323902 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 958/1890] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:09.522124 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a242a320-b0df-4363-a8d5-0b60a22156e2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:09.533989 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ab1ced8-51ed-4145-9049-156fc65c9706 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5700329b-b666-48f5-9adf-ca75a60377e3"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:09.536933 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4ab1ced8-51ed-4145-9049-156fc65c9706 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:09.537140 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a242a320-b0df-4363-a8d5-0b60a22156e2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:09.539141 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a242a320-b0df-4363-a8d5-0b60a22156e2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:09.543099 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a242a320-b0df-4363-a8d5-0b60a22156e2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7" status: 200 len: 1362 microversion: 2.26 time: 0.577380 Jul 31 01:15:09.547650 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 933/1891] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:15:08 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7 => generated 1362 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:15:09.552995 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-44088a7b-3bc8-4aaf-863c-7866a2832b8d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:09.553615 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-44088a7b-3bc8-4aaf-863c-7866a2832b8d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:09.571188 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ab1ced8-51ed-4145-9049-156fc65c9706 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:09.580321 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44088a7b-3bc8-4aaf-863c-7866a2832b8d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:09.580321 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44088a7b-3bc8-4aaf-863c-7866a2832b8d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:09.580321 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44088a7b-3bc8-4aaf-863c-7866a2832b8d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:09.580321 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44088a7b-3bc8-4aaf-863c-7866a2832b8d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:09.583675 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ab1ced8-51ed-4145-9049-156fc65c9706 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:09.584819 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ab1ced8-51ed-4145-9049-156fc65c9706 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:09.586828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ab1ced8-51ed-4145-9049-156fc65c9706 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:09.726056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44088a7b-3bc8-4aaf-863c-7866a2832b8d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:09.729166 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44088a7b-3bc8-4aaf-863c-7866a2832b8d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:09.729895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-44088a7b-3bc8-4aaf-863c-7866a2832b8d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lazy-loading 'fault' on Instance uuid 2d4db5ff-45fe-4d51-809d-d8983072a691 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:15:09.930557 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-44088a7b-3bc8-4aaf-863c-7866a2832b8d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:09.938246 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-4ab1ced8-51ed-4145-9049-156fc65c9706 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] HTTP exception thrown: Volume 5700329b-b666-48f5-9adf-ca75a60377e3 could not be found. Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ab1ced8-51ed-4145-9049-156fc65c9706 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] Request method failure captured: Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: request: PUT /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-volume_attachments/d087270d-a8df-4a50-bbb9-d6cff281f5ae HTTP/1.1 Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 74 Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dc4Mrn2OnsLHlFzOw4s7Lb3kD4N1y6SYCTnpNKG2FCUUL3qEdWQVUGu_biWEcDDNJxbLmb8-2OHKPNanBjV6QWGwU-lcT5mBKAPGb4mQP8BemYieNirdKudck0opI6gCJnwTI6rC-IVPep2qx8Zb-Qq0tcxe94zPK9lejR_qJ_jP0g Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 09f165a07e85477897cb0611bee41c4a Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-VolumesAdminNegativeTest-146834393 Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/09f165a07e85477897cb0611bee41c4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/09f165a07e85477897cb0611bee41c4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/09f165a07e85477897cb0611bee41c4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_09f165a07e85477897cb0611bee41c4a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-VolumesAdminNegativeTest-146834393 Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 09f165a07e85477897cb0611bee41c4a Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-146834393 Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-VolumesAdminNegativeTest-146834393-project-admin Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 1e2b7f01bb3d4b8e8466c3f9b993e06f Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-VolumesAdminNegativeTest-146834393-project-admin Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: {"volumeAttachment": {"volumeId": "5700329b-b666-48f5-9adf-ca75a60377e3"}} Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: exception: Volume 5700329b-b666-48f5-9adf-ca75a60377e3 could not be found. Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: action_args: {'server_id': '1062351b-6cff-4363-a029-ddfbb14c6f72', 'id': 'd087270d-a8df-4a50-bbb9-d6cff281f5ae', 'body': {'volumeAttachment': {'volumeId': '5700329b-b666-48f5-9adf-ca75a60377e3'}}} Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5700329b-b666-48f5-9adf-ca75a60377e3 could not be found. (HTTP 404) (Request-ID: req-4e8eccbb-8829-4e9f-bdc7-1fb53282f3fe) Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 01:15:09.944048 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5700329b-b666-48f5-9adf-ca75a60377e3 could not be found. Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 5700329b-b666-48f5-9adf-ca75a60377e3 could not be found. Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5700329b-b666-48f5-9adf-ca75a60377e3 could not be found. Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:09.950612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ab1ced8-51ed-4145-9049-156fc65c9706 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] Returning 400 to user: Volume 5700329b-b666-48f5-9adf-ca75a60377e3 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:09.955020 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-44088a7b-3bc8-4aaf-863c-7866a2832b8d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:09.955020 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-44088a7b-3bc8-4aaf-863c-7866a2832b8d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:09.955020 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-44088a7b-3bc8-4aaf-863c-7866a2832b8d tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 200 len: 1352 microversion: 2.25 time: 0.402061 Jul 31 01:15:09.955469 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4ab1ced8-51ed-4145-9049-156fc65c9706 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] 10.222.0.45 "PUT /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-volume_attachments/d087270d-a8df-4a50-bbb9-d6cff281f5ae" status: 400 len: 107 microversion: 2.1 time: 0.623901 Jul 31 01:15:09.955572 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 934/1892] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:15:09 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 1352 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:15:09.959377 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 959/1893] 10.222.0.45 () {60 vars in 1433 bytes} [Sun Jul 31 01:15:09 2022] PUT /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-volume_attachments/d087270d-a8df-4a50-bbb9-d6cff281f5ae => generated 107 bytes in 631 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:15:09.963726 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-362deaef-5328-4bc2-a2ac-da0ca7de25a1 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:09.964388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-362deaef-5328-4bc2-a2ac-da0ca7de25a1 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:09.984641 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-586ffb3b-c27f-4a6a-a032-90b3219a0e0e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:09.985672 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-586ffb3b-c27f-4a6a-a032-90b3219a0e0e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:09.986793 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-362deaef-5328-4bc2-a2ac-da0ca7de25a1 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:09.989642 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-362deaef-5328-4bc2-a2ac-da0ca7de25a1 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:09.992124 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-362deaef-5328-4bc2-a2ac-da0ca7de25a1 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:09.994256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-362deaef-5328-4bc2-a2ac-da0ca7de25a1 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:10.027814 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-586ffb3b-c27f-4a6a-a032-90b3219a0e0e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:10.029399 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-586ffb3b-c27f-4a6a-a032-90b3219a0e0e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:10.034208 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-586ffb3b-c27f-4a6a-a032-90b3219a0e0e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:10.035171 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-586ffb3b-c27f-4a6a-a032-90b3219a0e0e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:10.622533 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-362deaef-5328-4bc2-a2ac-da0ca7de25a1 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4103d2981da44aea1ea8547f225b3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f130aa9ed7364d0aad29cab48e63f0be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:10.630877 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-586ffb3b-c27f-4a6a-a032-90b3219a0e0e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:10.631519 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-362deaef-5328-4bc2-a2ac-da0ca7de25a1 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553" status: 200 len: 1332 microversion: 2.1 time: 0.674969 Jul 31 01:15:10.632350 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 935/1894] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:09 2022] GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553 => generated 1332 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:10.651500 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-586ffb3b-c27f-4a6a-a032-90b3219a0e0e tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429" status: 200 len: 1308 microversion: 2.1 time: 0.670957 Jul 31 01:15:10.652702 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 960/1895] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:09 2022] GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 => generated 1308 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:15:10.659977 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-696c9cff-44d3-42a1-95ef-ceb5a7b58abe tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:10.661556 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-696c9cff-44d3-42a1-95ef-ceb5a7b58abe tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:10.673469 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-696c9cff-44d3-42a1-95ef-ceb5a7b58abe tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:10.675030 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-696c9cff-44d3-42a1-95ef-ceb5a7b58abe tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:10.676065 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-696c9cff-44d3-42a1-95ef-ceb5a7b58abe tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:10.676778 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-696c9cff-44d3-42a1-95ef-ceb5a7b58abe tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:10.753583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e5bb3eb2-462a-4924-a788-57f040ded188 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-621620057", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "0ae91a1a-d28a-466e-aa59-f568ebc60f05"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:10.812184 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-696c9cff-44d3-42a1-95ef-ceb5a7b58abe tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lazy-loading 'services' on Instance uuid 1062351b-6cff-4363-a029-ddfbb14c6f72 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:15:10.873995 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-e5bb3eb2-462a-4924-a788-57f040ded188 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] validate_networks() for [('0ae91a1a-d28a-466e-aa59-f568ebc60f05', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:15:10.929310 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-696c9cff-44d3-42a1-95ef-ceb5a7b58abe tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-volume_attachments/d087270d-a8df-4a50-bbb9-d6cff281f5ae" status: 202 len: 0 microversion: 2.1 time: 0.274567 Jul 31 01:15:10.934544 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 961/1896] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 01:15:10 2022] DELETE /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-volume_attachments/d087270d-a8df-4a50-bbb9-d6cff281f5ae => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:15:10.941529 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e39e4798-48e6-4807-97cc-40de3b6ff17a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:10.942601 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e39e4798-48e6-4807-97cc-40de3b6ff17a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:10.952668 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e39e4798-48e6-4807-97cc-40de3b6ff17a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:10.953405 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e39e4798-48e6-4807-97cc-40de3b6ff17a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:10.954857 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e39e4798-48e6-4807-97cc-40de3b6ff17a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:10.955523 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e39e4798-48e6-4807-97cc-40de3b6ff17a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:11.331948 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e39e4798-48e6-4807-97cc-40de3b6ff17a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:11.343930 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e39e4798-48e6-4807-97cc-40de3b6ff17a tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1391 microversion: 2.1 time: 0.407493 Jul 31 01:15:11.357031 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 962/1897] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:10 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1391 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:11.379012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-73ed7389-d346-48e9-a6ab-9d1d32004e80 req-29ac439e-9756-4333-b7bd-0c6205de680f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d862c0-3b17-44a3-a405-9c28427a3db7", "name": "network-vif-plugged", "status": "completed", "tag": "f9cdca3b-8174-4f00-84be-54b07393ab04"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:11.425198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-73ed7389-d346-48e9-a6ab-9d1d32004e80 req-29ac439e-9756-4333-b7bd-0c6205de680f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:11.425661 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-73ed7389-d346-48e9-a6ab-9d1d32004e80 req-29ac439e-9756-4333-b7bd-0c6205de680f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:11.452512 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-73ed7389-d346-48e9-a6ab-9d1d32004e80 req-29ac439e-9756-4333-b7bd-0c6205de680f service nova] Creating event network-vif-plugged:f9cdca3b-8174-4f00-84be-54b07393ab04 for instance 88d862c0-3b17-44a3-a405-9c28427a3db7 on n-h2-master-1 Jul 31 01:15:11.473668 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-73ed7389-d346-48e9-a6ab-9d1d32004e80 req-29ac439e-9756-4333-b7bd-0c6205de680f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105377 Jul 31 01:15:11.473668 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 963/1898] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:11.493515 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-28e8d3c5-8af7-4297-b118-0fac1059ff18 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:11.495116 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-28e8d3c5-8af7-4297-b118-0fac1059ff18 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:11.502938 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28e8d3c5-8af7-4297-b118-0fac1059ff18 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:11.503301 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28e8d3c5-8af7-4297-b118-0fac1059ff18 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:11.504231 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28e8d3c5-8af7-4297-b118-0fac1059ff18 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:11.504842 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28e8d3c5-8af7-4297-b118-0fac1059ff18 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:12.479911 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-28e8d3c5-8af7-4297-b118-0fac1059ff18 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:12.520983 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-28e8d3c5-8af7-4297-b118-0fac1059ff18 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:12.531784 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-28e8d3c5-8af7-4297-b118-0fac1059ff18 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:12.544729 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-28e8d3c5-8af7-4297-b118-0fac1059ff18 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7" status: 200 len: 1362 microversion: 2.26 time: 1.055593 Jul 31 01:15:12.545859 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 964/1899] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:15:11 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7 => generated 1362 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:15:12.573169 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1a3657c9-e642-4724-83bc-6a62a33b63f7 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:12.580943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1a3657c9-e642-4724-83bc-6a62a33b63f7 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:12.595840 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a3657c9-e642-4724-83bc-6a62a33b63f7 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:12.596794 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a3657c9-e642-4724-83bc-6a62a33b63f7 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:12.599614 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a3657c9-e642-4724-83bc-6a62a33b63f7 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:12.600317 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a3657c9-e642-4724-83bc-6a62a33b63f7 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:12.646674 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:12.674426 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1a3657c9-e642-4724-83bc-6a62a33b63f7 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106372 Jul 31 01:15:12.675805 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 965/1900] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:15:12 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:12.682919 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-228146f9-ddee-4f24-bb5d-26b1489dfc35 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:12.684213 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:12.686586 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-228146f9-ddee-4f24-bb5d-26b1489dfc35 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 2d4db5ff-45fe-4d51-809d-d8983072a691] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:12.696246 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-228146f9-ddee-4f24-bb5d-26b1489dfc35 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:12.697616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-228146f9-ddee-4f24-bb5d-26b1489dfc35 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:12.698720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-228146f9-ddee-4f24-bb5d-26b1489dfc35 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:12.699732 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-228146f9-ddee-4f24-bb5d-26b1489dfc35 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:12.718089 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-228146f9-ddee-4f24-bb5d-26b1489dfc35 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] HTTP exception thrown: Instance 2d4db5ff-45fe-4d51-809d-d8983072a691 could not be found. Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-228146f9-ddee-4f24-bb5d-26b1489dfc35 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Request method failure captured: Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 HTTP/1.1 Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dWrxaBaPbcg5WSdzYB0emymJbR3eQaayTh7lmhew9U2eOxlIFInfyW7ofznCm4cPAhWRUb7KhclCJ0IYIg0ODpjjRIxVHLTe8GgjJyV2xPzytF8tA6QAtZ6T0-erB_UxHDe-Utqj5G0rf_WNCN7wAoe-Km-7uilaCD58O4S7AIi0DU Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.25 Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 5881381d95ec452eb516c0c7ad826a08 Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-798817765 Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5881381d95ec452eb516c0c7ad826a08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5881381d95ec452eb516c0c7ad826a08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5881381d95ec452eb516c0c7ad826a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5881381d95ec452eb516c0c7ad826a08", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-798817765 Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 5881381d95ec452eb516c0c7ad826a08 Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-798817765 Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-LiveAutoBlockMigrationV225Test-798817765-project Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: cd6eb7e316f54ff386eaa598df805de9 Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-798817765-project Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 2d4db5ff-45fe-4d51-809d-d8983072a691 could not be found. Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '2d4db5ff-45fe-4d51-809d-d8983072a691'} Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4db5ff-45fe-4d51-809d-d8983072a691 could not be found. Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4db5ff-45fe-4d51-809d-d8983072a691 could not be found. Jul 31 01:15:12.721841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:12.726644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:12.726644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:12.726644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:12.726644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:12.726644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:12.726644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:12.726644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:12.726644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4db5ff-45fe-4d51-809d-d8983072a691 could not be found. Jul 31 01:15:12.726644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:12.738039 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-228146f9-ddee-4f24-bb5d-26b1489dfc35 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Returning 404 to user: Instance 2d4db5ff-45fe-4d51-809d-d8983072a691 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:12.739988 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-228146f9-ddee-4f24-bb5d-26b1489dfc35 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691" status: 404 len: 111 microversion: 2.25 time: 0.062846 Jul 31 01:15:12.743459 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 966/1901] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:15:12 2022] GET /compute/v2.1/servers/2d4db5ff-45fe-4d51-809d-d8983072a691 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:15:12.757743 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-330043f9-5016-4304-89a9-43d094d1e185 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:12.761560 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-330043f9-5016-4304-89a9-43d094d1e185 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:12.765998 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e5bb3eb2-462a-4924-a788-57f040ded188 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:15:12.766469 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e5bb3eb2-462a-4924-a788-57f040ded188 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:15:12.767505 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e5bb3eb2-462a-4924-a788-57f040ded188 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:15:12.768133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e5bb3eb2-462a-4924-a788-57f040ded188 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:15:12.768797 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e5bb3eb2-462a-4924-a788-57f040ded188 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:15:12.795763 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5bb3eb2-462a-4924-a788-57f040ded188 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:12.797608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-330043f9-5016-4304-89a9-43d094d1e185 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:12.798593 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5bb3eb2-462a-4924-a788-57f040ded188 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:12.800634 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-330043f9-5016-4304-89a9-43d094d1e185 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:12.803296 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5bb3eb2-462a-4924-a788-57f040ded188 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:12.803942 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5bb3eb2-462a-4924-a788-57f040ded188 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:12.804551 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-330043f9-5016-4304-89a9-43d094d1e185 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:12.806065 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-330043f9-5016-4304-89a9-43d094d1e185 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:12.903530 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-e5bb3eb2-462a-4924-a788-57f040ded188 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Getting quotas for project 1f2913e9df964e9186f05716842e8321. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:15:12.915196 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-e5bb3eb2-462a-4924-a788-57f040ded188 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Getting quotas for user f3adb1960d5543bb8073dbe2dddd2c4e and project 1f2913e9df964e9186f05716842e8321. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:15:12.924602 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:12.954657 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e5bb3eb2-462a-4924-a788-57f040ded188 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:15:12.973297 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e5bb3eb2-462a-4924-a788-57f040ded188 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] [instance: d81ba01e-9ff4-4499-8f31-bc781c290180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:15:13.074426 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e5bb3eb2-462a-4924-a788-57f040ded188 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.440470 Jul 31 01:15:13.076000 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 936/1902] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:15:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:15:13.091082 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ad6fc3d9-51e5-465d-87a2-30221aef1c08 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:13.093079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ad6fc3d9-51e5-465d-87a2-30221aef1c08 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:13.109799 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad6fc3d9-51e5-465d-87a2-30221aef1c08 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:13.110270 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad6fc3d9-51e5-465d-87a2-30221aef1c08 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:13.111082 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad6fc3d9-51e5-465d-87a2-30221aef1c08 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:13.111562 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad6fc3d9-51e5-465d-87a2-30221aef1c08 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:13.483872 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:13.635678 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-330043f9-5016-4304-89a9-43d094d1e185 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4103d2981da44aea1ea8547f225b3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f130aa9ed7364d0aad29cab48e63f0be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:13.664461 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-330043f9-5016-4304-89a9-43d094d1e185 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553" status: 200 len: 1536 microversion: 2.1 time: 0.913027 Jul 31 01:15:13.665421 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 967/1903] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:12 2022] GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553 => generated 1536 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:13.677339 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-444739ba-99a4-4bcb-a3ae-cecab081eef2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:13.700006 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-444739ba-99a4-4bcb-a3ae-cecab081eef2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:13.716700 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-444739ba-99a4-4bcb-a3ae-cecab081eef2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:13.717167 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-444739ba-99a4-4bcb-a3ae-cecab081eef2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:13.722523 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-444739ba-99a4-4bcb-a3ae-cecab081eef2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:13.723745 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-444739ba-99a4-4bcb-a3ae-cecab081eef2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:14.241582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ad6fc3d9-51e5-465d-87a2-30221aef1c08 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:14.263255 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ad6fc3d9-51e5-465d-87a2-30221aef1c08 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429" status: 200 len: 1308 microversion: 2.1 time: 1.184180 Jul 31 01:15:14.272196 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 937/1904] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:13 2022] GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 => generated 1308 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:14.300816 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5de1a159-6d7d-4355-8efa-d62376fc551a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:14.304593 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5de1a159-6d7d-4355-8efa-d62376fc551a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:14.327823 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5de1a159-6d7d-4355-8efa-d62376fc551a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:14.328872 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5de1a159-6d7d-4355-8efa-d62376fc551a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:14.330270 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5de1a159-6d7d-4355-8efa-d62376fc551a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:14.331133 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5de1a159-6d7d-4355-8efa-d62376fc551a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:14.362800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5de1a159-6d7d-4355-8efa-d62376fc551a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:15:14.416890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-444739ba-99a4-4bcb-a3ae-cecab081eef2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:14.438493 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-444739ba-99a4-4bcb-a3ae-cecab081eef2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1381 microversion: 2.1 time: 0.761773 Jul 31 01:15:14.439059 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 968/1905] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:13 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1381 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:14.458586 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-ea4ced71-59f1-4639-8fd6-82ac2928923b req-48464253-b120-4acc-98f7-9d7c67814c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16fea13f-be07-4445-a8bc-a890b2ff8429", "tag": "3bc62765-ad76-49a9-a67e-6e53c60ec318"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:14.490687 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ea4ced71-59f1-4639-8fd6-82ac2928923b req-48464253-b120-4acc-98f7-9d7c67814c0e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:14.497602 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ea4ced71-59f1-4639-8fd6-82ac2928923b req-48464253-b120-4acc-98f7-9d7c67814c0e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:14.553917 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-ea4ced71-59f1-4639-8fd6-82ac2928923b req-48464253-b120-4acc-98f7-9d7c67814c0e service nova] Creating event network-changed:3bc62765-ad76-49a9-a67e-6e53c60ec318 for instance 16fea13f-be07-4445-a8bc-a890b2ff8429 on n-h1-master-1 Jul 31 01:15:14.574572 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-ea4ced71-59f1-4639-8fd6-82ac2928923b req-48464253-b120-4acc-98f7-9d7c67814c0e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129913 Jul 31 01:15:14.582602 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 969/1906] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:14.612205 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-405227b7-5064-4dc8-ace0-8aa7661a08d9 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:14.615214 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-405227b7-5064-4dc8-ace0-8aa7661a08d9 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] [instance: d81ba01e-9ff4-4499-8f31-bc781c290180] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:14.634158 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-405227b7-5064-4dc8-ace0-8aa7661a08d9 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:14.635060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-405227b7-5064-4dc8-ace0-8aa7661a08d9 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:14.636137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-405227b7-5064-4dc8-ace0-8aa7661a08d9 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:14.636864 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-405227b7-5064-4dc8-ace0-8aa7661a08d9 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:14.697078 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5de1a159-6d7d-4355-8efa-d62376fc551a tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 204 len: 0 microversion: 2.25 time: 0.408554 Jul 31 01:15:14.701349 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 938/1907] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:15:14 2022] DELETE /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:15:14.717459 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a8a273a0-e1fb-4ac2-b149-a2fb63e55ff9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:14.718756 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a8a273a0-e1fb-4ac2-b149-a2fb63e55ff9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:14.764522 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8a273a0-e1fb-4ac2-b149-a2fb63e55ff9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:14.765561 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8a273a0-e1fb-4ac2-b149-a2fb63e55ff9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:14.768696 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8a273a0-e1fb-4ac2-b149-a2fb63e55ff9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:14.769550 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8a273a0-e1fb-4ac2-b149-a2fb63e55ff9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:14.794950 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-405227b7-5064-4dc8-ace0-8aa7661a08d9 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3adb1960d5543bb8073dbe2dddd2c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2913e9df964e9186f05716842e8321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:14.820335 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-405227b7-5064-4dc8-ace0-8aa7661a08d9 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] 10.222.0.45 "GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180" status: 200 len: 1220 microversion: 2.1 time: 0.236162 Jul 31 01:15:14.821648 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 970/1908] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:14 2022] GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180 => generated 1220 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:14.828840 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c3f6298e-9c13-4548-868c-b22669b1713e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:14.832609 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c3f6298e-9c13-4548-868c-b22669b1713e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:14.854127 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3f6298e-9c13-4548-868c-b22669b1713e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:14.854905 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3f6298e-9c13-4548-868c-b22669b1713e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:14.856194 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3f6298e-9c13-4548-868c-b22669b1713e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:14.856847 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3f6298e-9c13-4548-868c-b22669b1713e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:14.896563 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c3f6298e-9c13-4548-868c-b22669b1713e tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072659 Jul 31 01:15:14.897486 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 971/1909] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:15:14 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:14.903026 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4a12e475-92b7-437e-b952-720d030b085b tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Action: 'create', calling method: .version_select at 0x7fedeaa09280>, body: {"pool": "0abb2289-fd48-4bf1-9c02-0622852045a3"} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:15.255775 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a8a273a0-e1fb-4ac2-b149-a2fb63e55ff9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:15.266298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a8a273a0-e1fb-4ac2-b149-a2fb63e55ff9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:15.268370 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a8a273a0-e1fb-4ac2-b149-a2fb63e55ff9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:15.270663 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a8a273a0-e1fb-4ac2-b149-a2fb63e55ff9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7" status: 200 len: 1545 microversion: 2.26 time: 0.567246 Jul 31 01:15:15.284176 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 939/1910] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:15:14 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7 => generated 1545 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:15:15.298426 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-92a0e2b0-3e11-43b8-babe-421b17412b98 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '.version_select at 0x7fedea944c10>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:15.304507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92a0e2b0-3e11-43b8-babe-421b17412b98 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:15.305664 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92a0e2b0-3e11-43b8-babe-421b17412b98 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:15.316794 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-92a0e2b0-3e11-43b8-babe-421b17412b98 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/os-migrations" status: 200 len: 1937 microversion: 2.1 time: 0.030656 Jul 31 01:15:15.327528 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 940/1911] 10.222.0.45 () {58 vars in 1143 bytes} [Sun Jul 31 01:15:15 2022] GET /compute/v2.1/os-migrations => generated 1937 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:15.332820 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1ffe959b-dbcc-48db-81af-9fb29bf5aab8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:15.333756 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1ffe959b-dbcc-48db-81af-9fb29bf5aab8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:15.343088 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ffe959b-dbcc-48db-81af-9fb29bf5aab8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:15.344052 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ffe959b-dbcc-48db-81af-9fb29bf5aab8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:15.345486 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ffe959b-dbcc-48db-81af-9fb29bf5aab8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:15.346177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ffe959b-dbcc-48db-81af-9fb29bf5aab8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:15.710773 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1ffe959b-dbcc-48db-81af-9fb29bf5aab8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:15.723938 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1ffe959b-dbcc-48db-81af-9fb29bf5aab8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:15.728586 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1ffe959b-dbcc-48db-81af-9fb29bf5aab8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd6eb7e316f54ff386eaa598df805de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5881381d95ec452eb516c0c7ad826a08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:15.733052 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1ffe959b-dbcc-48db-81af-9fb29bf5aab8 tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 200 len: 1562 microversion: 2.25 time: 0.404058 Jul 31 01:15:15.738572 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 941/1912] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:15:15 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 1562 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:15:15.750576 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-573f7803-2cc9-4b49-bf8b-2417cafdbd10 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:15.751671 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-573f7803-2cc9-4b49-bf8b-2417cafdbd10 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:15.771189 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-573f7803-2cc9-4b49-bf8b-2417cafdbd10 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:15.772116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-573f7803-2cc9-4b49-bf8b-2417cafdbd10 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:15.773134 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-573f7803-2cc9-4b49-bf8b-2417cafdbd10 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:15.773777 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-573f7803-2cc9-4b49-bf8b-2417cafdbd10 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:16.372534 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-573f7803-2cc9-4b49-bf8b-2417cafdbd10 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:16.388385 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-573f7803-2cc9-4b49-bf8b-2417cafdbd10 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429" status: 200 len: 1308 microversion: 2.1 time: 0.648021 Jul 31 01:15:16.390667 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 942/1913] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:15 2022] GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 => generated 1308 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:16.409104 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-823b1c47-6be8-4ede-a533-2be16d566280 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fedea8381f0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:16.431013 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-823b1c47-6be8-4ede-a533-2be16d566280 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:16.434271 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-823b1c47-6be8-4ede-a533-2be16d566280 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:16.435044 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-823b1c47-6be8-4ede-a533-2be16d566280 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:16.455887 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-823b1c47-6be8-4ede-a533-2be16d566280 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:16.456886 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-823b1c47-6be8-4ede-a533-2be16d566280 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:16.461290 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-823b1c47-6be8-4ede-a533-2be16d566280 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:16.462370 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-823b1c47-6be8-4ede-a533-2be16d566280 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:16.559703 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-823b1c47-6be8-4ede-a533-2be16d566280 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:16.560499 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-823b1c47-6be8-4ede-a533-2be16d566280 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:16.601167 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-823b1c47-6be8-4ede-a533-2be16d566280 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:16.604896 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-823b1c47-6be8-4ede-a533-2be16d566280 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:16.631797 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:16.680764 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-823b1c47-6be8-4ede-a533-2be16d566280 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lazy-loading 'flavor' on Instance uuid 88d862c0-3b17-44a3-a405-9c28427a3db7 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:15:16.703518 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-823b1c47-6be8-4ede-a533-2be16d566280 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "PUT /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags/tempest-tag-503643378" status: 201 len: 0 microversion: 2.26 time: 0.311014 Jul 31 01:15:16.704875 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 943/1914] 10.222.0.45 () {62 vars in 1377 bytes} [Sun Jul 31 01:15:16 2022] PUT /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags/tempest-tag-503643378 => generated 0 bytes in 313 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 31 01:15:16.714454 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-87abfa53-e207-419e-8119-ddcf0def17a4 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:16.715419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-87abfa53-e207-419e-8119-ddcf0def17a4 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:16.728370 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87abfa53-e207-419e-8119-ddcf0def17a4 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:16.730031 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87abfa53-e207-419e-8119-ddcf0def17a4 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:16.731659 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87abfa53-e207-419e-8119-ddcf0def17a4 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:16.732770 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87abfa53-e207-419e-8119-ddcf0def17a4 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:17.266475 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-87abfa53-e207-419e-8119-ddcf0def17a4 tempest-LiveMigrationTest-192657164 tempest-LiveMigrationTest-192657164-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1532 microversion: 2.1 time: 0.558851 Jul 31 01:15:17.280952 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 944/1915] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:16 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1532 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:17.298238 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7348daf0-87d6-4801-ba8f-10412d87946f tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:17.298866 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7348daf0-87d6-4801-ba8f-10412d87946f tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] [instance: d81ba01e-9ff4-4499-8f31-bc781c290180] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:17.306883 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7348daf0-87d6-4801-ba8f-10412d87946f tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:17.307668 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7348daf0-87d6-4801-ba8f-10412d87946f tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:17.308844 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7348daf0-87d6-4801-ba8f-10412d87946f tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:17.310639 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7348daf0-87d6-4801-ba8f-10412d87946f tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:17.847115 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7348daf0-87d6-4801-ba8f-10412d87946f tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3adb1960d5543bb8073dbe2dddd2c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2913e9df964e9186f05716842e8321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:17.870275 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7348daf0-87d6-4801-ba8f-10412d87946f tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] 10.222.0.45 "GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180" status: 200 len: 1324 microversion: 2.1 time: 0.582548 Jul 31 01:15:17.877189 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 945/1916] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:17 2022] GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180 => generated 1324 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:17.889561 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f6b6c757-ee1f-4f83-a035-8742ca717f65 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:17.903579 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f6b6c757-ee1f-4f83-a035-8742ca717f65 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:17.923275 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6b6c757-ee1f-4f83-a035-8742ca717f65 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:17.924045 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6b6c757-ee1f-4f83-a035-8742ca717f65 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:17.925586 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6b6c757-ee1f-4f83-a035-8742ca717f65 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:17.926301 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6b6c757-ee1f-4f83-a035-8742ca717f65 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:17.997245 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f6b6c757-ee1f-4f83-a035-8742ca717f65 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118680 Jul 31 01:15:18.003987 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 946/1917] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:15:17 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:18.010236 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c4639f4f-a446-497a-8a8a-f65b9d04af00 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fedea8d1940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:18.031585 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4639f4f-a446-497a-8a8a-f65b9d04af00 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:18.032524 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4639f4f-a446-497a-8a8a-f65b9d04af00 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:18.048510 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c4639f4f-a446-497a-8a8a-f65b9d04af00 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags/tempest-tag-503643378" status: 204 len: 0 microversion: 2.26 time: 0.042443 Jul 31 01:15:18.052949 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 947/1918] 10.222.0.45 () {60 vars in 1358 bytes} [Sun Jul 31 01:15:18 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags/tempest-tag-503643378 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:15:18.059958 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-955f83ed-e436-4c74-ac05-7697d5cacbde tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:18.061058 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-955f83ed-e436-4c74-ac05-7697d5cacbde tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] [instance: 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:18.081814 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-955f83ed-e436-4c74-ac05-7697d5cacbde tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:18.083103 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-955f83ed-e436-4c74-ac05-7697d5cacbde tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:18.084287 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-955f83ed-e436-4c74-ac05-7697d5cacbde tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:18.085060 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-955f83ed-e436-4c74-ac05-7697d5cacbde tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:18.124117 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-955f83ed-e436-4c74-ac05-7697d5cacbde tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] HTTP exception thrown: Instance 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 could not be found. Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-955f83ed-e436-4c74-ac05-7697d5cacbde tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Request method failure captured: Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 HTTP/1.1 Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dWrxaBaPbcg5WSdzYB0emymJbR3eQaayTh7lmhew9U2eOxlIFInfyW7ofznCm4cPAhWRUb7KhclCJ0IYIg0ODpjjRIxVHLTe8GgjJyV2xPzytF8tA6QAtZ6T0-erB_UxHDe-Utqj5G0rf_WNCN7wAoe-Km-7uilaCD58O4S7AIi0DU Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-Openstack-Nova-Api-Version: 2.25 Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 5881381d95ec452eb516c0c7ad826a08 Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-798817765 Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5881381d95ec452eb516c0c7ad826a08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5881381d95ec452eb516c0c7ad826a08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5881381d95ec452eb516c0c7ad826a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5881381d95ec452eb516c0c7ad826a08", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-798817765 Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 5881381d95ec452eb516c0c7ad826a08 Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-798817765 Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-LiveAutoBlockMigrationV225Test-798817765-project Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: cd6eb7e316f54ff386eaa598df805de9 Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-798817765-project Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 could not be found. Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2'} Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 could not be found. Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 could not be found. Jul 31 01:15:18.126691 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:18.132087 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:18.132087 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:18.132087 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:18.132087 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:18.132087 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:18.132087 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:18.132087 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:18.132087 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 could not be found. Jul 31 01:15:18.132087 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:18.139933 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-955f83ed-e436-4c74-ac05-7697d5cacbde tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] Returning 404 to user: Instance 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:18.142297 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-955f83ed-e436-4c74-ac05-7697d5cacbde tempest-LiveAutoBlockMigrationV225Test-798817765 tempest-LiveAutoBlockMigrationV225Test-798817765-project] 10.222.0.45 "GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2" status: 404 len: 111 microversion: 2.25 time: 0.087898 Jul 31 01:15:18.143393 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 948/1919] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:15:18 2022] GET /compute/v2.1/servers/0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:15:18.149657 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-267664f8-a0de-4170-a7f9-f5cf9751e47a req-ba2bf09c-6173-4893-8363-694ba4f94630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2", "name": "network-vif-deleted", "tag": "79b2e09a-8171-4f0d-adc4-3e2dbf769ce6"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:18.162472 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-267664f8-a0de-4170-a7f9-f5cf9751e47a req-ba2bf09c-6173-4893-8363-694ba4f94630 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:18.163389 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-267664f8-a0de-4170-a7f9-f5cf9751e47a req-ba2bf09c-6173-4893-8363-694ba4f94630 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:18.182098 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-267664f8-a0de-4170-a7f9-f5cf9751e47a req-ba2bf09c-6173-4893-8363-694ba4f94630 service nova] Creating event network-vif-deleted:79b2e09a-8171-4f0d-adc4-3e2dbf769ce6 for instance 0d0658a1-a4b5-4dcc-bfd9-caacc29daaa2 on n-h2-master-1 Jul 31 01:15:18.190163 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-267664f8-a0de-4170-a7f9-f5cf9751e47a req-ba2bf09c-6173-4893-8363-694ba4f94630 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044894 Jul 31 01:15:18.191050 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 949/1920] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:18.197971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c4c47b3-3fda-45b9-baa6-c1b642be62e0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:18.198850 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2c4c47b3-3fda-45b9-baa6-c1b642be62e0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:18.209951 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c4c47b3-3fda-45b9-baa6-c1b642be62e0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:18.210617 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c4c47b3-3fda-45b9-baa6-c1b642be62e0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:18.211648 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c4c47b3-3fda-45b9-baa6-c1b642be62e0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:18.212258 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c4c47b3-3fda-45b9-baa6-c1b642be62e0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:18.272760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2c4c47b3-3fda-45b9-baa6-c1b642be62e0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:15:18.477849 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2c4c47b3-3fda-45b9-baa6-c1b642be62e0 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 204 len: 0 microversion: 2.1 time: 0.283635 Jul 31 01:15:18.482234 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 950/1921] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:15:18 2022] DELETE /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:15:18.495014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c6e66195-8f51-4fed-9a20-8c80429473ee tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:18.495792 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c6e66195-8f51-4fed-9a20-8c80429473ee tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:18.515740 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6e66195-8f51-4fed-9a20-8c80429473ee tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:18.516172 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6e66195-8f51-4fed-9a20-8c80429473ee tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:18.517877 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6e66195-8f51-4fed-9a20-8c80429473ee tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:18.518335 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6e66195-8f51-4fed-9a20-8c80429473ee tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:19.229771 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c6e66195-8f51-4fed-9a20-8c80429473ee tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:19.259380 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c6e66195-8f51-4fed-9a20-8c80429473ee tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429" status: 200 len: 1308 microversion: 2.1 time: 0.775577 Jul 31 01:15:19.261018 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 951/1922] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:18 2022] GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 => generated 1308 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:19.271414 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-58d2c703-7cf3-4e89-bcfb-88e5e8c19660 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fedea838820>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:19.293558 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58d2c703-7cf3-4e89-bcfb-88e5e8c19660 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:19.294454 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58d2c703-7cf3-4e89-bcfb-88e5e8c19660 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:19.297048 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-58d2c703-7cf3-4e89-bcfb-88e5e8c19660 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:19.304264 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58d2c703-7cf3-4e89-bcfb-88e5e8c19660 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:19.305458 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58d2c703-7cf3-4e89-bcfb-88e5e8c19660 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:19.308599 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58d2c703-7cf3-4e89-bcfb-88e5e8c19660 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:19.309508 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58d2c703-7cf3-4e89-bcfb-88e5e8c19660 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:19.348419 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58d2c703-7cf3-4e89-bcfb-88e5e8c19660 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:19.349566 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58d2c703-7cf3-4e89-bcfb-88e5e8c19660 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:19.374378 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-58d2c703-7cf3-4e89-bcfb-88e5e8c19660 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lazy-loading 'flavor' on Instance uuid 88d862c0-3b17-44a3-a405-9c28427a3db7 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:15:19.422105 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-58d2c703-7cf3-4e89-bcfb-88e5e8c19660 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "DELETE /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags" status: 204 len: 0 microversion: 2.26 time: 0.159491 Jul 31 01:15:19.430707 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 952/1923] 10.222.0.45 () {60 vars in 1295 bytes} [Sun Jul 31 01:15:19 2022] DELETE /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:15:19.442607 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a7eb1eaa-0d73-44d9-b66a-ccf67d2e3371 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:19.443710 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a7eb1eaa-0d73-44d9-b66a-ccf67d2e3371 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:19.454827 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7eb1eaa-0d73-44d9-b66a-ccf67d2e3371 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:19.455449 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7eb1eaa-0d73-44d9-b66a-ccf67d2e3371 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:19.456458 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7eb1eaa-0d73-44d9-b66a-ccf67d2e3371 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:19.457092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7eb1eaa-0d73-44d9-b66a-ccf67d2e3371 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:19.548085 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4a12e475-92b7-437e-b952-720d030b085b tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.649107 Jul 31 01:15:19.548700 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 972/1924] 10.222.0.45 () {60 vars in 1170 bytes} [Sun Jul 31 01:15:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:19.554576 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-be3decb6-cbaf-4e01-89dd-a0f418862086 req-811d94bb-fd87-428d-87ba-c20b937bfae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d81ba01e-9ff4-4499-8f31-bc781c290180", "tag": "e52c0ed1-6216-4e41-b44c-16e1739167a6"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:19.584771 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-be3decb6-cbaf-4e01-89dd-a0f418862086 req-811d94bb-fd87-428d-87ba-c20b937bfae9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:19.585220 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-be3decb6-cbaf-4e01-89dd-a0f418862086 req-811d94bb-fd87-428d-87ba-c20b937bfae9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:19.606950 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-be3decb6-cbaf-4e01-89dd-a0f418862086 req-811d94bb-fd87-428d-87ba-c20b937bfae9 service nova] Creating event network-changed:e52c0ed1-6216-4e41-b44c-16e1739167a6 for instance d81ba01e-9ff4-4499-8f31-bc781c290180 on n-h1-master-1 Jul 31 01:15:19.613295 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-be3decb6-cbaf-4e01-89dd-a0f418862086 req-811d94bb-fd87-428d-87ba-c20b937bfae9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063304 Jul 31 01:15:19.614339 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 973/1925] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:19.622082 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-075e7bb4-ced3-44ec-ac99-701eb4db0d71 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:19.623086 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-075e7bb4-ced3-44ec-ac99-701eb4db0d71 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] [instance: d81ba01e-9ff4-4499-8f31-bc781c290180] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:19.632258 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-075e7bb4-ced3-44ec-ac99-701eb4db0d71 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:19.633076 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-075e7bb4-ced3-44ec-ac99-701eb4db0d71 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:19.634092 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-075e7bb4-ced3-44ec-ac99-701eb4db0d71 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:19.635043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-075e7bb4-ced3-44ec-ac99-701eb4db0d71 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:19.969780 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a7eb1eaa-0d73-44d9-b66a-ccf67d2e3371 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:19.983243 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a7eb1eaa-0d73-44d9-b66a-ccf67d2e3371 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1387 microversion: 2.1 time: 0.550446 Jul 31 01:15:19.983861 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 953/1926] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:19 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1387 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:19.988718 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1ba39ffd-03a8-440e-93a9-88f92108a13d tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:19.990989 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1ba39ffd-03a8-440e-93a9-88f92108a13d tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:20.021059 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ba39ffd-03a8-440e-93a9-88f92108a13d tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:20.023095 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ba39ffd-03a8-440e-93a9-88f92108a13d tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:20.027651 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ba39ffd-03a8-440e-93a9-88f92108a13d tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:20.031497 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ba39ffd-03a8-440e-93a9-88f92108a13d tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:20.044238 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-075e7bb4-ced3-44ec-ac99-701eb4db0d71 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3adb1960d5543bb8073dbe2dddd2c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2913e9df964e9186f05716842e8321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:20.052357 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-075e7bb4-ced3-44ec-ac99-701eb4db0d71 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] 10.222.0.45 "GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180" status: 200 len: 1324 microversion: 2.1 time: 0.436437 Jul 31 01:15:20.058078 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 974/1927] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:19 2022] GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180 => generated 1324 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:20.063438 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-35e277e3-fb73-4911-9f6b-769d76c8813f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fede5b26280>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:20.085843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35e277e3-fb73-4911-9f6b-769d76c8813f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:20.086671 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35e277e3-fb73-4911-9f6b-769d76c8813f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:20.118497 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-35e277e3-fb73-4911-9f6b-769d76c8813f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags" status: 200 len: 12 microversion: 2.26 time: 0.059015 Jul 31 01:15:20.120723 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1ba39ffd-03a8-440e-93a9-88f92108a13d tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.135586 Jul 31 01:15:20.125779 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 975/1928] 10.222.0.45 () {60 vars in 1292 bytes} [Sun Jul 31 01:15:20 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags => generated 12 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:20.128251 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 954/1929] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:15:19 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:15:20.137609 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-a41254c1-c830-4225-9c95-ff94dc8ae01e req-4281ce78-394b-4214-925f-b5dffe47be76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fea13f-be07-4445-a8bc-a890b2ff8429", "name": "network-vif-plugged", "status": "completed", "tag": "3bc62765-ad76-49a9-a67e-6e53c60ec318"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:20.142247 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d27567e7-35d7-4288-9135-89ca1f194ddc tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Action: 'action', calling method: .version_select at 0x7fede8359b80>, body: {"addFloatingIp": {"address": "172.35.6.139"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:20.146109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d27567e7-35d7-4288-9135-89ca1f194ddc tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:20.156546 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d27567e7-35d7-4288-9135-89ca1f194ddc tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:20.157472 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a41254c1-c830-4225-9c95-ff94dc8ae01e req-4281ce78-394b-4214-925f-b5dffe47be76 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:20.158471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a41254c1-c830-4225-9c95-ff94dc8ae01e req-4281ce78-394b-4214-925f-b5dffe47be76 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:20.160537 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d27567e7-35d7-4288-9135-89ca1f194ddc tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:20.163116 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d27567e7-35d7-4288-9135-89ca1f194ddc tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:20.166064 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d27567e7-35d7-4288-9135-89ca1f194ddc tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:20.175710 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-a41254c1-c830-4225-9c95-ff94dc8ae01e req-4281ce78-394b-4214-925f-b5dffe47be76 service nova] Creating event network-vif-plugged:3bc62765-ad76-49a9-a67e-6e53c60ec318 for instance 16fea13f-be07-4445-a8bc-a890b2ff8429 on n-h1-master-1 Jul 31 01:15:20.182629 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-a41254c1-c830-4225-9c95-ff94dc8ae01e req-4281ce78-394b-4214-925f-b5dffe47be76 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051378 Jul 31 01:15:20.184784 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 955/1930] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:20.197391 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a3ee7755-3290-473c-9edf-bfb0d5d72cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fedea9811f0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:20.216037 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3ee7755-3290-473c-9edf-bfb0d5d72cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:20.216407 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3ee7755-3290-473c-9edf-bfb0d5d72cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:20.217221 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a3ee7755-3290-473c-9edf-bfb0d5d72cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:20.224511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3ee7755-3290-473c-9edf-bfb0d5d72cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:20.225128 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3ee7755-3290-473c-9edf-bfb0d5d72cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:20.226214 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3ee7755-3290-473c-9edf-bfb0d5d72cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:20.226665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3ee7755-3290-473c-9edf-bfb0d5d72cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:20.267597 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3ee7755-3290-473c-9edf-bfb0d5d72cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:20.268245 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3ee7755-3290-473c-9edf-bfb0d5d72cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:20.279889 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3ee7755-3290-473c-9edf-bfb0d5d72cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:20.280349 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3ee7755-3290-473c-9edf-bfb0d5d72cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:20.316991 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-a3ee7755-3290-473c-9edf-bfb0d5d72cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lazy-loading 'flavor' on Instance uuid 88d862c0-3b17-44a3-a405-9c28427a3db7 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:15:20.340511 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a3ee7755-3290-473c-9edf-bfb0d5d72cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "PUT /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags/tempest-tag-953293390" status: 201 len: 0 microversion: 2.26 time: 0.149392 Jul 31 01:15:20.367866 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 956/1931] 10.222.0.45 () {62 vars in 1377 bytes} [Sun Jul 31 01:15:20 2022] PUT /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags/tempest-tag-953293390 => generated 0 bytes in 182 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 31 01:15:20.378444 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ca635872-45a1-4b23-a3be-c6568ee68ccf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:20.382256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ca635872-45a1-4b23-a3be-c6568ee68ccf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:20.397669 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca635872-45a1-4b23-a3be-c6568ee68ccf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:20.398030 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca635872-45a1-4b23-a3be-c6568ee68ccf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:20.402438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca635872-45a1-4b23-a3be-c6568ee68ccf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:20.402899 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca635872-45a1-4b23-a3be-c6568ee68ccf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:20.658319 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ca635872-45a1-4b23-a3be-c6568ee68ccf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:20.667804 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ca635872-45a1-4b23-a3be-c6568ee68ccf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429" status: 200 len: 1308 microversion: 2.1 time: 0.297678 Jul 31 01:15:20.668527 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d27567e7-35d7-4288-9135-89ca1f194ddc tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Acquired lock "refresh_cache-9b1a43c9-7310-4068-9b24-7ceb7c935553" {{(pid=119475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 01:15:20.682474 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 957/1932] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:20 2022] GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 => generated 1308 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:20.688396 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-61c7b859-f335-446e-8389-7dc6cfe3ec61 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fedea83dd30>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:20.699229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61c7b859-f335-446e-8389-7dc6cfe3ec61 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:20.700031 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61c7b859-f335-446e-8389-7dc6cfe3ec61 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:20.704043 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:RELEASE=2,nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:20.715832 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-61c7b859-f335-446e-8389-7dc6cfe3ec61 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags" status: 200 len: 35 microversion: 2.26 time: 0.031732 Jul 31 01:15:20.731921 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 958/1933] 10.222.0.45 () {60 vars in 1292 bytes} [Sun Jul 31 01:15:20 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags => generated 35 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:20.737326 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-467d7867-da6c-40bf-b17f-810a93a5865b req-94dad185-b742-4282-8a69-b58a3bff4477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c64a12-7c3e-41f9-91d1-b82820b3cd08", "name": "network-vif-deleted", "tag": "34a0bfd7-254c-4a84-8f10-da931e137ce2"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:20.756023 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-467d7867-da6c-40bf-b17f-810a93a5865b req-94dad185-b742-4282-8a69-b58a3bff4477 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:20.756480 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-467d7867-da6c-40bf-b17f-810a93a5865b req-94dad185-b742-4282-8a69-b58a3bff4477 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:20.786964 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-467d7867-da6c-40bf-b17f-810a93a5865b req-94dad185-b742-4282-8a69-b58a3bff4477 service nova] Creating event network-vif-deleted:34a0bfd7-254c-4a84-8f10-da931e137ce2 for instance f7c64a12-7c3e-41f9-91d1-b82820b3cd08 on n-h1-master-1 Jul 31 01:15:20.792492 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-467d7867-da6c-40bf-b17f-810a93a5865b req-94dad185-b742-4282-8a69-b58a3bff4477 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059185 Jul 31 01:15:20.794229 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 959/1934] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:20.803429 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f9486ede-9c8a-4a2b-9d49-5f5631798ffc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-141920790", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "c4c7fd9f-1e9b-4ab4-be31-a5f8230a84b8"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:20.873067 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-f9486ede-9c8a-4a2b-9d49-5f5631798ffc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] validate_networks() for [('c4c7fd9f-1e9b-4ab4-be31-a5f8230a84b8', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:15:22.666516 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-f9486ede-9c8a-4a2b-9d49-5f5631798ffc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:15:22.667167 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-f9486ede-9c8a-4a2b-9d49-5f5631798ffc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:15:22.667589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-f9486ede-9c8a-4a2b-9d49-5f5631798ffc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:15:22.668111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-f9486ede-9c8a-4a2b-9d49-5f5631798ffc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:15:22.668642 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-f9486ede-9c8a-4a2b-9d49-5f5631798ffc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:15:22.689043 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9486ede-9c8a-4a2b-9d49-5f5631798ffc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:22.691472 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9486ede-9c8a-4a2b-9d49-5f5631798ffc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:22.695968 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9486ede-9c8a-4a2b-9d49-5f5631798ffc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:22.697363 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9486ede-9c8a-4a2b-9d49-5f5631798ffc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:22.724446 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-f9486ede-9c8a-4a2b-9d49-5f5631798ffc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Getting quotas for project 47b342e518054a56b42112c5dec71b2f. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:15:22.730953 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-f9486ede-9c8a-4a2b-9d49-5f5631798ffc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Getting quotas for user 6e5532c17656432182ae9da0d1e2ad67 and project 47b342e518054a56b42112c5dec71b2f. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:15:22.749125 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f9486ede-9c8a-4a2b-9d49-5f5631798ffc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:15:22.752913 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f9486ede-9c8a-4a2b-9d49-5f5631798ffc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:15:22.815720 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f9486ede-9c8a-4a2b-9d49-5f5631798ffc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.017015 Jul 31 01:15:22.817220 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 960/1935] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:15:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:15:22.824157 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cb9b989f-dadc-4976-bbc2-bb6770e89c64 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fedea85bdc0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:22.833793 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9b989f-dadc-4976-bbc2-bb6770e89c64 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:22.834613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9b989f-dadc-4976-bbc2-bb6770e89c64 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:22.835365 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cb9b989f-dadc-4976-bbc2-bb6770e89c64 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:22.842742 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9b989f-dadc-4976-bbc2-bb6770e89c64 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:22.844381 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9b989f-dadc-4976-bbc2-bb6770e89c64 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:22.845720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9b989f-dadc-4976-bbc2-bb6770e89c64 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:22.846403 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9b989f-dadc-4976-bbc2-bb6770e89c64 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:22.896663 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9b989f-dadc-4976-bbc2-bb6770e89c64 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:22.897267 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9b989f-dadc-4976-bbc2-bb6770e89c64 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:22.946323 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-cb9b989f-dadc-4976-bbc2-bb6770e89c64 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lazy-loading 'flavor' on Instance uuid 88d862c0-3b17-44a3-a405-9c28427a3db7 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:15:22.990802 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cb9b989f-dadc-4976-bbc2-bb6770e89c64 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "DELETE /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags/tempest-tag-953293390" status: 204 len: 0 microversion: 2.26 time: 0.172046 Jul 31 01:15:22.996953 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 961/1936] 10.222.0.45 () {60 vars in 1361 bytes} [Sun Jul 31 01:15:22 2022] DELETE /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags/tempest-tag-953293390 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:15:23.008673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3f36fdbe-3d74-465a-8eeb-013b1b21df5f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:23.010153 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3f36fdbe-3d74-465a-8eeb-013b1b21df5f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:23.021638 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f36fdbe-3d74-465a-8eeb-013b1b21df5f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:23.022100 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f36fdbe-3d74-465a-8eeb-013b1b21df5f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:23.022878 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f36fdbe-3d74-465a-8eeb-013b1b21df5f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:23.023309 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f36fdbe-3d74-465a-8eeb-013b1b21df5f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:23.341502 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3f36fdbe-3d74-465a-8eeb-013b1b21df5f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:23.367365 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3f36fdbe-3d74-465a-8eeb-013b1b21df5f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1183 microversion: 2.1 time: 0.369002 Jul 31 01:15:23.372054 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 962/1937] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:22 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1183 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:23.382637 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-684bfe15-0f54-44cc-a930-4dbefc1458d6 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:23.390189 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-684bfe15-0f54-44cc-a930-4dbefc1458d6 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] [instance: d81ba01e-9ff4-4499-8f31-bc781c290180] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:23.418186 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-684bfe15-0f54-44cc-a930-4dbefc1458d6 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:23.419492 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-684bfe15-0f54-44cc-a930-4dbefc1458d6 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:23.423302 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-684bfe15-0f54-44cc-a930-4dbefc1458d6 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:23.427089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-684bfe15-0f54-44cc-a930-4dbefc1458d6 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:24.672444 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-684bfe15-0f54-44cc-a930-4dbefc1458d6 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3adb1960d5543bb8073dbe2dddd2c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2913e9df964e9186f05716842e8321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:24.683403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-d27567e7-35d7-4288-9135-89ca1f194ddc tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Building network info cache for instance {{(pid=119475) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 31 01:15:24.691964 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:24.693586 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-684bfe15-0f54-44cc-a930-4dbefc1458d6 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] 10.222.0.45 "GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180" status: 200 len: 1324 microversion: 2.1 time: 1.314289 Jul 31 01:15:24.704067 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 963/1938] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:23 2022] GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180 => generated 1324 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:24.715294 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-afd61000-ca6b-42b7-ac21-9e9596dd9970 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:24.716508 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-afd61000-ca6b-42b7-ac21-9e9596dd9970 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:24.741850 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-afd61000-ca6b-42b7-ac21-9e9596dd9970 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:24.748135 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-afd61000-ca6b-42b7-ac21-9e9596dd9970 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:24.760518 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-afd61000-ca6b-42b7-ac21-9e9596dd9970 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:24.761366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-afd61000-ca6b-42b7-ac21-9e9596dd9970 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:25.841044 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-afd61000-ca6b-42b7-ac21-9e9596dd9970 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:25.851252 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-afd61000-ca6b-42b7-ac21-9e9596dd9970 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429" status: 200 len: 1487 microversion: 2.1 time: 1.145581 Jul 31 01:15:25.852467 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 964/1939] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:24 2022] GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 => generated 1487 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:25.857324 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1c6cd744-0480-4111-b4f0-dcecb67bbe33 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:25.861821 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1c6cd744-0480-4111-b4f0-dcecb67bbe33 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:25.877274 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c6cd744-0480-4111-b4f0-dcecb67bbe33 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:25.880421 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c6cd744-0480-4111-b4f0-dcecb67bbe33 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:25.881426 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c6cd744-0480-4111-b4f0-dcecb67bbe33 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:25.882035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c6cd744-0480-4111-b4f0-dcecb67bbe33 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:26.070774 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1c6cd744-0480-4111-b4f0-dcecb67bbe33 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:26.084551 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1c6cd744-0480-4111-b4f0-dcecb67bbe33 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda" status: 200 len: 1275 microversion: 2.1 time: 0.230705 Jul 31 01:15:26.106952 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 965/1940] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:25 2022] GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda => generated 1275 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:26.127401 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4ae107f7-49cb-4ac5-ade5-5b8aff42c986 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fedea87e940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:26.139901 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ae107f7-49cb-4ac5-ade5-5b8aff42c986 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:26.155696 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ae107f7-49cb-4ac5-ade5-5b8aff42c986 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:26.186318 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4ae107f7-49cb-4ac5-ade5-5b8aff42c986 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags" status: 200 len: 12 microversion: 2.26 time: 0.071362 Jul 31 01:15:26.188904 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 966/1941] 10.222.0.45 () {60 vars in 1292 bytes} [Sun Jul 31 01:15:26 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags => generated 12 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:26.194191 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-248f2933-106d-4844-807d-86ba2e037724 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:26.199156 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-248f2933-106d-4844-807d-86ba2e037724 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:26.209870 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:26.214829 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-248f2933-106d-4844-807d-86ba2e037724 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:26.215388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-248f2933-106d-4844-807d-86ba2e037724 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:26.217388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-248f2933-106d-4844-807d-86ba2e037724 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:26.220041 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-248f2933-106d-4844-807d-86ba2e037724 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:26.377737 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-248f2933-106d-4844-807d-86ba2e037724 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:26.388751 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-248f2933-106d-4844-807d-86ba2e037724 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1183 microversion: 2.1 time: 0.197219 Jul 31 01:15:26.393826 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 967/1942] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:26 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:26.398954 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7e5ce02b-8704-4847-92e3-7a37d63b1768 req-ecf14e0b-994d-41bb-9da2-5da7a58e63c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b1a43c9-7310-4068-9b24-7ceb7c935553", "tag": "d19472c9-6b7c-4f7b-a72a-118ac2c23928"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:26.428801 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7e5ce02b-8704-4847-92e3-7a37d63b1768 req-ecf14e0b-994d-41bb-9da2-5da7a58e63c5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:26.429565 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7e5ce02b-8704-4847-92e3-7a37d63b1768 req-ecf14e0b-994d-41bb-9da2-5da7a58e63c5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:26.455149 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7e5ce02b-8704-4847-92e3-7a37d63b1768 req-ecf14e0b-994d-41bb-9da2-5da7a58e63c5 service nova] Creating event network-changed:d19472c9-6b7c-4f7b-a72a-118ac2c23928 for instance 9b1a43c9-7310-4068-9b24-7ceb7c935553 on n-h2-master-1 Jul 31 01:15:26.469097 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7e5ce02b-8704-4847-92e3-7a37d63b1768 req-ecf14e0b-994d-41bb-9da2-5da7a58e63c5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073510 Jul 31 01:15:26.473665 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 968/1943] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:26.489303 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-32d12338-f5a1-4c26-95a5-d9b4869a2b55 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:26.490789 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-32d12338-f5a1-4c26-95a5-d9b4869a2b55 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] [instance: d81ba01e-9ff4-4499-8f31-bc781c290180] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:26.504382 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-32d12338-f5a1-4c26-95a5-d9b4869a2b55 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:26.509356 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-32d12338-f5a1-4c26-95a5-d9b4869a2b55 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:26.511919 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-32d12338-f5a1-4c26-95a5-d9b4869a2b55 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:26.512722 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-32d12338-f5a1-4c26-95a5-d9b4869a2b55 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:26.922958 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-d27567e7-35d7-4288-9135-89ca1f194ddc tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Updating instance_info_cache with network_info: [{"id": "d19472c9-6b7c-4f7b-a72a-118ac2c23928", "address": "fa:16:3e:3e:21:cf", "network": {"id": "22ab67a7-03cf-45dc-b776-a9640b3e7972", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1239883627-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f130aa9ed7364d0aad29cab48e63f0be", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd19472c9-6b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119475) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 31 01:15:26.975002 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d27567e7-35d7-4288-9135-89ca1f194ddc tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Releasing lock "refresh_cache-9b1a43c9-7310-4068-9b24-7ceb7c935553" {{(pid=119475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 01:15:26.976233 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d27567e7-35d7-4288-9135-89ca1f194ddc tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "POST /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553/action" status: 202 len: 0 microversion: 2.1 time: 6.849028 Jul 31 01:15:26.978509 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 976/1944] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:15:20 2022] POST /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553/action => generated 0 bytes in 6852 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 31 01:15:26.992649 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cfc3c847-6882-4cda-9442-3c8abfae66e5 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-419808822"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:26.996468 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cfc3c847-6882-4cda-9442-3c8abfae66e5 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:27.006327 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfc3c847-6882-4cda-9442-3c8abfae66e5 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:27.007460 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfc3c847-6882-4cda-9442-3c8abfae66e5 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:27.009801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfc3c847-6882-4cda-9442-3c8abfae66e5 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:27.011510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfc3c847-6882-4cda-9442-3c8abfae66e5 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:27.024499 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-32d12338-f5a1-4c26-95a5-d9b4869a2b55 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3adb1960d5543bb8073dbe2dddd2c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2913e9df964e9186f05716842e8321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:27.038662 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-32d12338-f5a1-4c26-95a5-d9b4869a2b55 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] 10.222.0.45 "GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180" status: 200 len: 1324 microversion: 2.1 time: 0.563280 Jul 31 01:15:27.043577 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 969/1945] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:26 2022] GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180 => generated 1324 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:27.058194 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-11f24b14-788b-4bdb-a920-1c490e99232a req-e05cda3c-ec9b-4d1e-8369-e007ffde99a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d81ba01e-9ff4-4499-8f31-bc781c290180", "name": "network-vif-plugged", "status": "completed", "tag": "e52c0ed1-6216-4e41-b44c-16e1739167a6"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:27.077411 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-11f24b14-788b-4bdb-a920-1c490e99232a req-e05cda3c-ec9b-4d1e-8369-e007ffde99a6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:27.078259 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-11f24b14-788b-4bdb-a920-1c490e99232a req-e05cda3c-ec9b-4d1e-8369-e007ffde99a6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:27.107357 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-11f24b14-788b-4bdb-a920-1c490e99232a req-e05cda3c-ec9b-4d1e-8369-e007ffde99a6 service nova] Creating event network-vif-plugged:e52c0ed1-6216-4e41-b44c-16e1739167a6 for instance d81ba01e-9ff4-4499-8f31-bc781c290180 on n-h1-master-1 Jul 31 01:15:27.121119 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-11f24b14-788b-4bdb-a920-1c490e99232a req-e05cda3c-ec9b-4d1e-8369-e007ffde99a6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075657 Jul 31 01:15:27.128143 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 970/1946] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:27.145585 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cce1a7ba-4769-400f-8449-0e030cffe5a9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fedea851940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:27.156041 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cce1a7ba-4769-400f-8449-0e030cffe5a9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:27.156765 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cce1a7ba-4769-400f-8449-0e030cffe5a9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:27.157586 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cce1a7ba-4769-400f-8449-0e030cffe5a9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:27.168342 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cce1a7ba-4769-400f-8449-0e030cffe5a9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:27.169613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cce1a7ba-4769-400f-8449-0e030cffe5a9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:27.170799 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cce1a7ba-4769-400f-8449-0e030cffe5a9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:27.172102 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cce1a7ba-4769-400f-8449-0e030cffe5a9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:27.224932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cce1a7ba-4769-400f-8449-0e030cffe5a9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:27.225856 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cce1a7ba-4769-400f-8449-0e030cffe5a9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:27.246503 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-cce1a7ba-4769-400f-8449-0e030cffe5a9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lazy-loading 'flavor' on Instance uuid 88d862c0-3b17-44a3-a405-9c28427a3db7 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:15:27.281414 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cce1a7ba-4769-400f-8449-0e030cffe5a9 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "DELETE /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags" status: 204 len: 0 microversion: 2.26 time: 0.151840 Jul 31 01:15:27.284606 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 971/1947] 10.222.0.45 () {60 vars in 1295 bytes} [Sun Jul 31 01:15:27 2022] DELETE /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:15:27.297349 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ee0e46cf-c821-4f01-87c9-0822e33473fd tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Action: 'create', calling method: .version_select at 0x7fedea851310>, body: {"pool": "0abb2289-fd48-4bf1-9c02-0622852045a3"} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:27.393953 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cfc3c847-6882-4cda-9442-3c8abfae66e5 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "POST /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429/action" status: 202 len: 0 microversion: 2.1 time: 0.411764 Jul 31 01:15:27.395974 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 977/1948] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:15:26 2022] POST /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 31 01:15:27.403049 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-395f28cc-1310-41f4-a1ab-5db0e8f480f5 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:27.410423 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-395f28cc-1310-41f4-a1ab-5db0e8f480f5 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:27.424649 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-395f28cc-1310-41f4-a1ab-5db0e8f480f5 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:27.425369 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-395f28cc-1310-41f4-a1ab-5db0e8f480f5 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:27.426829 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-395f28cc-1310-41f4-a1ab-5db0e8f480f5 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:27.428205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-395f28cc-1310-41f4-a1ab-5db0e8f480f5 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:27.885334 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-395f28cc-1310-41f4-a1ab-5db0e8f480f5 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:27.899667 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-395f28cc-1310-41f4-a1ab-5db0e8f480f5 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda" status: 200 len: 1317 microversion: 2.1 time: 0.502156 Jul 31 01:15:27.913267 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 978/1949] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:27 2022] GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda => generated 1317 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:27.922978 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ec5bc10a-5bb1-4364-b2c2-35d09dac7d25 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fedea9fbf70>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:27.949112 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec5bc10a-5bb1-4364-b2c2-35d09dac7d25 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:27.950191 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec5bc10a-5bb1-4364-b2c2-35d09dac7d25 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:27.950919 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ec5bc10a-5bb1-4364-b2c2-35d09dac7d25 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:27.965946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec5bc10a-5bb1-4364-b2c2-35d09dac7d25 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:27.966662 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec5bc10a-5bb1-4364-b2c2-35d09dac7d25 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:27.968175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec5bc10a-5bb1-4364-b2c2-35d09dac7d25 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:27.970454 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec5bc10a-5bb1-4364-b2c2-35d09dac7d25 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:28.039110 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec5bc10a-5bb1-4364-b2c2-35d09dac7d25 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:28.052037 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec5bc10a-5bb1-4364-b2c2-35d09dac7d25 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:28.067450 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec5bc10a-5bb1-4364-b2c2-35d09dac7d25 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:28.067844 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec5bc10a-5bb1-4364-b2c2-35d09dac7d25 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:28.105391 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-ec5bc10a-5bb1-4364-b2c2-35d09dac7d25 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lazy-loading 'flavor' on Instance uuid 88d862c0-3b17-44a3-a405-9c28427a3db7 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:15:28.174055 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ec5bc10a-5bb1-4364-b2c2-35d09dac7d25 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "PUT /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags/tempest-tag-1363316308" status: 201 len: 0 microversion: 2.26 time: 0.259311 Jul 31 01:15:28.179064 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 979/1950] 10.222.0.45 () {62 vars in 1380 bytes} [Sun Jul 31 01:15:27 2022] PUT /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags/tempest-tag-1363316308 => generated 0 bytes in 261 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 31 01:15:28.187457 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f6231033-c363-4a89-acf6-58ab82d3c0c2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa15040>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:28.281610 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f6231033-c363-4a89-acf6-58ab82d3c0c2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/0c4b5677-2e38-4966-8d74-5b8e676e77e1" status: 200 len: 1411 microversion: 2.1 time: 0.102021 Jul 31 01:15:28.282555 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 980/1951] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:28 2022] GET /compute/v2.1/images/0c4b5677-2e38-4966-8d74-5b8e676e77e1 => generated 1411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:28.293741 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-345d4004-7cbd-4574-a54c-57030747ed07 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:28.294386 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-345d4004-7cbd-4574-a54c-57030747ed07 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:28.308186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-345d4004-7cbd-4574-a54c-57030747ed07 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:28.310863 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-345d4004-7cbd-4574-a54c-57030747ed07 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:28.313007 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-345d4004-7cbd-4574-a54c-57030747ed07 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:28.313485 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-345d4004-7cbd-4574-a54c-57030747ed07 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:28.460404 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-345d4004-7cbd-4574-a54c-57030747ed07 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:28.479031 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-345d4004-7cbd-4574-a54c-57030747ed07 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 200 len: 1183 microversion: 2.1 time: 0.193419 Jul 31 01:15:28.493001 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 981/1952] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:28 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 1183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:28.501102 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c9a382f7-cd23-4313-baf4-57f530f904df tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:28.502112 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c9a382f7-cd23-4313-baf4-57f530f904df tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] [instance: d81ba01e-9ff4-4499-8f31-bc781c290180] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:28.510183 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9a382f7-cd23-4313-baf4-57f530f904df tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:28.510904 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9a382f7-cd23-4313-baf4-57f530f904df tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:28.513035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9a382f7-cd23-4313-baf4-57f530f904df tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:28.513906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9a382f7-cd23-4313-baf4-57f530f904df tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:29.144625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c9a382f7-cd23-4313-baf4-57f530f904df tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3adb1960d5543bb8073dbe2dddd2c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2913e9df964e9186f05716842e8321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:29.160135 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c9a382f7-cd23-4313-baf4-57f530f904df tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] 10.222.0.45 "GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180" status: 200 len: 1324 microversion: 2.1 time: 0.664540 Jul 31 01:15:29.161732 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 982/1953] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:28 2022] GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180 => generated 1324 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:29.169365 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6875efdc-8abc-4b53-8037-438e48199281 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fedeaa12700>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:29.205275 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6875efdc-8abc-4b53-8037-438e48199281 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:29.207648 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6875efdc-8abc-4b53-8037-438e48199281 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:29.208931 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6875efdc-8abc-4b53-8037-438e48199281 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:29.222630 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6875efdc-8abc-4b53-8037-438e48199281 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:29.223959 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6875efdc-8abc-4b53-8037-438e48199281 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:29.226941 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6875efdc-8abc-4b53-8037-438e48199281 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:29.228735 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6875efdc-8abc-4b53-8037-438e48199281 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:29.301716 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6875efdc-8abc-4b53-8037-438e48199281 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:29.302187 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6875efdc-8abc-4b53-8037-438e48199281 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:29.337713 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6875efdc-8abc-4b53-8037-438e48199281 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:29.338322 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6875efdc-8abc-4b53-8037-438e48199281 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:29.405677 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-6875efdc-8abc-4b53-8037-438e48199281 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lazy-loading 'flavor' on Instance uuid 88d862c0-3b17-44a3-a405-9c28427a3db7 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:15:29.444396 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6875efdc-8abc-4b53-8037-438e48199281 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "PUT /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags/tempest-tag-44721228" status: 201 len: 0 microversion: 2.26 time: 0.279552 Jul 31 01:15:29.450778 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 983/1954] 10.222.0.45 () {62 vars in 1374 bytes} [Sun Jul 31 01:15:29 2022] PUT /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags/tempest-tag-44721228 => generated 0 bytes in 284 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Jul 31 01:15:29.455734 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bb64cde0-aae0-4065-8769-e04723eaae6a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa5a550>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:29.550182 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bb64cde0-aae0-4065-8769-e04723eaae6a tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/0c4b5677-2e38-4966-8d74-5b8e676e77e1" status: 200 len: 1411 microversion: 2.1 time: 0.102351 Jul 31 01:15:29.560321 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 984/1955] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:29 2022] GET /compute/v2.1/images/0c4b5677-2e38-4966-8d74-5b8e676e77e1 => generated 1411 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:29.569741 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-22a5e64a-b0f0-4a90-88c5-2dfdd46e62ec tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:29.570407 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-22a5e64a-b0f0-4a90-88c5-2dfdd46e62ec tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:29.611447 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22a5e64a-b0f0-4a90-88c5-2dfdd46e62ec tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:29.614344 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22a5e64a-b0f0-4a90-88c5-2dfdd46e62ec tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:29.615639 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22a5e64a-b0f0-4a90-88c5-2dfdd46e62ec tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:29.617284 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22a5e64a-b0f0-4a90-88c5-2dfdd46e62ec tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:30.294893 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-22a5e64a-b0f0-4a90-88c5-2dfdd46e62ec tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:30.308230 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-22a5e64a-b0f0-4a90-88c5-2dfdd46e62ec tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda" status: 200 len: 1317 microversion: 2.1 time: 0.746590 Jul 31 01:15:30.309194 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 985/1956] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:29 2022] GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda => generated 1317 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:30.330603 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b5b33ccc-a97f-4f98-9585-3db75bc246e5 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fedeaa4c4c0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:30.367999 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5b33ccc-a97f-4f98-9585-3db75bc246e5 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:30.369094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5b33ccc-a97f-4f98-9585-3db75bc246e5 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:30.369662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b5b33ccc-a97f-4f98-9585-3db75bc246e5 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:30.385694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5b33ccc-a97f-4f98-9585-3db75bc246e5 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:30.386564 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5b33ccc-a97f-4f98-9585-3db75bc246e5 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:30.387706 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5b33ccc-a97f-4f98-9585-3db75bc246e5 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:30.388426 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5b33ccc-a97f-4f98-9585-3db75bc246e5 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:30.433060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5b33ccc-a97f-4f98-9585-3db75bc246e5 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:30.433860 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5b33ccc-a97f-4f98-9585-3db75bc246e5 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:30.473057 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-b5b33ccc-a97f-4f98-9585-3db75bc246e5 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lazy-loading 'flavor' on Instance uuid 88d862c0-3b17-44a3-a405-9c28427a3db7 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:15:30.511120 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b5b33ccc-a97f-4f98-9585-3db75bc246e5 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "DELETE /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags" status: 204 len: 0 microversion: 2.26 time: 0.200360 Jul 31 01:15:30.515657 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 986/1957] 10.222.0.45 () {60 vars in 1295 bytes} [Sun Jul 31 01:15:30 2022] DELETE /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:15:30.526545 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-81a0525e-5a96-494f-8b65-babb4d9db58f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:30.528069 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-81a0525e-5a96-494f-8b65-babb4d9db58f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: f7c64a12-7c3e-41f9-91d1-b82820b3cd08] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:30.539190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81a0525e-5a96-494f-8b65-babb4d9db58f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:30.539992 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81a0525e-5a96-494f-8b65-babb4d9db58f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:30.541707 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81a0525e-5a96-494f-8b65-babb4d9db58f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:30.542651 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81a0525e-5a96-494f-8b65-babb4d9db58f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:30.580984 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-81a0525e-5a96-494f-8b65-babb4d9db58f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] HTTP exception thrown: Instance f7c64a12-7c3e-41f9-91d1-b82820b3cd08 could not be found. Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-81a0525e-5a96-494f-8b65-babb4d9db58f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Request method failure captured: Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 HTTP/1.1 Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dXEdSf0Gkqz-Q7EyzIARSzM1tpRTtdOPLVJpa2J_qG7mZevk6GyQhnm9QLedAKtTu6Y06b5WxqinOItA2pGoZRCBBMwYR0jYDk4R4zDfsetamH29xYHuyQ3EGk7WdvpJWGrmcKm3KNA09Pf_mn_e4YVu9YdikywxuH5yA8qcL45MZ0 Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 5d8b0e81765c48039a523271670896d2 Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-LiveMigrationTest-1058922785 Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5d8b0e81765c48039a523271670896d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5d8b0e81765c48039a523271670896d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5d8b0e81765c48039a523271670896d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5d8b0e81765c48039a523271670896d2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-LiveMigrationTest-1058922785 Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 5d8b0e81765c48039a523271670896d2 Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-LiveMigrationTest-1058922785 Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-LiveMigrationTest-1058922785-project Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 457bd8590d5040ef95854808b51c04d3 Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-LiveMigrationTest-1058922785-project Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: exception: Instance f7c64a12-7c3e-41f9-91d1-b82820b3cd08 could not be found. Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'f7c64a12-7c3e-41f9-91d1-b82820b3cd08'} Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7c64a12-7c3e-41f9-91d1-b82820b3cd08 could not be found. Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7c64a12-7c3e-41f9-91d1-b82820b3cd08 could not be found. Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:30.583738 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:30.588836 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:30.588836 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:30.588836 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:30.588836 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:30.588836 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:30.588836 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7c64a12-7c3e-41f9-91d1-b82820b3cd08 could not be found. Jul 31 01:15:30.588836 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:30.590435 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-81a0525e-5a96-494f-8b65-babb4d9db58f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Returning 404 to user: Instance f7c64a12-7c3e-41f9-91d1-b82820b3cd08 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:30.592105 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-81a0525e-5a96-494f-8b65-babb4d9db58f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08" status: 404 len: 111 microversion: 2.1 time: 0.074471 Jul 31 01:15:30.596069 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 987/1958] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:30 2022] GET /compute/v2.1/servers/f7c64a12-7c3e-41f9-91d1-b82820b3cd08 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:30.627129 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-853eb72f-24d6-40b7-95cb-9c813a179944 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa38790>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:30.978441 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-853eb72f-24d6-40b7-95cb-9c813a179944 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "DELETE /compute/v2.1/images/0c4b5677-2e38-4966-8d74-5b8e676e77e1" status: 204 len: 0 microversion: 2.1 time: 0.369936 Jul 31 01:15:30.982940 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 988/1959] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:30 2022] DELETE /compute/v2.1/images/0c4b5677-2e38-4966-8d74-5b8e676e77e1 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:15:30.988677 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-5d7ffce8-72c4-43b4-aa4b-750873ba4c23 req-0bac22d9-491c-4a2b-8c4b-6b22584bb825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa8017d-089a-4459-8d0d-4f746b868eda", "tag": "36fee2cc-f1b4-454c-9903-f979a420d46e"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:31.026214 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5d7ffce8-72c4-43b4-aa4b-750873ba4c23 req-0bac22d9-491c-4a2b-8c4b-6b22584bb825 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:31.027490 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5d7ffce8-72c4-43b4-aa4b-750873ba4c23 req-0bac22d9-491c-4a2b-8c4b-6b22584bb825 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:31.057154 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-5d7ffce8-72c4-43b4-aa4b-750873ba4c23 req-0bac22d9-491c-4a2b-8c4b-6b22584bb825 service nova] Creating event network-changed:36fee2cc-f1b4-454c-9903-f979a420d46e for instance 3fa8017d-089a-4459-8d0d-4f746b868eda on n-h2-master-1 Jul 31 01:15:31.098251 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-5d7ffce8-72c4-43b4-aa4b-750873ba4c23 req-0bac22d9-491c-4a2b-8c4b-6b22584bb825 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113500 Jul 31 01:15:31.102077 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 989/1960] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:31.110857 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4d9b4aa6-8b2c-4b88-8b5d-2bc07ae630d1 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:31.112314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4d9b4aa6-8b2c-4b88-8b5d-2bc07ae630d1 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] [instance: d81ba01e-9ff4-4499-8f31-bc781c290180] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:31.121208 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d9b4aa6-8b2c-4b88-8b5d-2bc07ae630d1 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:31.122559 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d9b4aa6-8b2c-4b88-8b5d-2bc07ae630d1 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:31.123999 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d9b4aa6-8b2c-4b88-8b5d-2bc07ae630d1 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:31.125000 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d9b4aa6-8b2c-4b88-8b5d-2bc07ae630d1 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:31.712862 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4d9b4aa6-8b2c-4b88-8b5d-2bc07ae630d1 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3adb1960d5543bb8073dbe2dddd2c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2913e9df964e9186f05716842e8321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:31.721659 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4d9b4aa6-8b2c-4b88-8b5d-2bc07ae630d1 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] 10.222.0.45 "GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180" status: 200 len: 1520 microversion: 2.1 time: 0.617636 Jul 31 01:15:31.722235 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 990/1961] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:31 2022] GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180 => generated 1520 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:31.734089 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5f8230ad-88e7-4103-89d2-f5c273f67e02 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fedeaa388b0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:31.755592 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5f8230ad-88e7-4103-89d2-f5c273f67e02 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:31.756326 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5f8230ad-88e7-4103-89d2-f5c273f67e02 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:31.780248 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5f8230ad-88e7-4103-89d2-f5c273f67e02 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags" status: 200 len: 12 microversion: 2.26 time: 0.053249 Jul 31 01:15:31.786052 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 991/1962] 10.222.0.45 () {60 vars in 1292 bytes} [Sun Jul 31 01:15:31 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags => generated 12 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:31.796191 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-66375dcf-11bc-43f5-9c1f-dd8a4e9fdb33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa38d30>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:31.841765 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-66375dcf-11bc-43f5-9c1f-dd8a4e9fdb33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] HTTP exception thrown: Image not found. Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-66375dcf-11bc-43f5-9c1f-dd8a4e9fdb33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Request method failure captured: Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/images/0c4b5677-2e38-4966-8d74-5b8e676e77e1 HTTP/1.1 Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5daZNzbVSRW_MAKMkrOAUUJIeGOi9uDUAoYvS0M7DAhBkdjeL_fmKLhMe2lVjGjEo1zF9tidtGcEORmw2CopMgy4S7BM-2ndIKS-4pmm3qBpWc0rC9OSGiFYwBerHUlvunP3Zg_ptMe0QNZytwKkR_27JMh9lTzzkZBoROoqi3pQMxY Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fb526f587384fdea1a06d8b3b685dcf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesTestJSON-161885913 Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f4352f9b8762490e9187e28e8c9cd58e Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: exception: Image not found. Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '0c4b5677-2e38-4966-8d74-5b8e676e77e1'} Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0c4b5677-2e38-4966-8d74-5b8e676e77e1 Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 31 01:15:31.857190 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c4b5677-2e38-4966-8d74-5b8e676e77e1 could not be found. Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:15:31.862691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:31.870008 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-66375dcf-11bc-43f5-9c1f-dd8a4e9fdb33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Returning 404 to user: Image not found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:31.871233 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-66375dcf-11bc-43f5-9c1f-dd8a4e9fdb33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/images/0c4b5677-2e38-4966-8d74-5b8e676e77e1" status: 404 len: 62 microversion: 2.1 time: 0.084099 Jul 31 01:15:31.875746 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 992/1963] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:15:31 2022] GET /compute/v2.1/images/0c4b5677-2e38-4966-8d74-5b8e676e77e1 => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:15:31.892186 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-848c03db-555b-4da8-a4ff-ab7af896d372 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:31.892841 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-848c03db-555b-4da8-a4ff-ab7af896d372 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:31.917662 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-848c03db-555b-4da8-a4ff-ab7af896d372 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:31.921654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-848c03db-555b-4da8-a4ff-ab7af896d372 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:31.922498 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-848c03db-555b-4da8-a4ff-ab7af896d372 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:31.922953 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-848c03db-555b-4da8-a4ff-ab7af896d372 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:31.992861 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=2,nova_cell1:RELEASE=3,nova_cell1:INSERT=3,nova_cell1:DELETE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:32.032527 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ee0e46cf-c821-4f01-87c9-0822e33473fd tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.745853 Jul 31 01:15:32.033470 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 972/1964] 10.222.0.45 () {60 vars in 1170 bytes} [Sun Jul 31 01:15:27 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:32.045538 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aba98b7c-0360-4eaf-9bbc-cdfd0bce2740 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:32.046108 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aba98b7c-0360-4eaf-9bbc-cdfd0bce2740 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] [instance: d81ba01e-9ff4-4499-8f31-bc781c290180] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:32.070116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aba98b7c-0360-4eaf-9bbc-cdfd0bce2740 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:32.070589 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aba98b7c-0360-4eaf-9bbc-cdfd0bce2740 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:32.071503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aba98b7c-0360-4eaf-9bbc-cdfd0bce2740 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:32.071953 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aba98b7c-0360-4eaf-9bbc-cdfd0bce2740 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:32.172185 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-aba98b7c-0360-4eaf-9bbc-cdfd0bce2740 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] HTTP exception thrown: Action 999 not found Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aba98b7c-0360-4eaf-9bbc-cdfd0bce2740 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Request method failure captured: Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180/os-instance-actions/999 HTTP/1.1 Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dedR_5kznTMVWebVIu6gDJAsioLb4SVc4a-YnAcqJSKvUnC9A61KGH2QLZd6pJyLPdWrZ9T0OQZgGrSXh16ERIrzGt2EpYZknQaYOiUZTnPa1tgChypVywAaGjDJEqlE6nDIZEvHr0NRDCviPqVnXw_X8Ex8umkgVsTCBOgNB9TmSk Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 1f2913e9df964e9186f05716842e8321 Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-471617812 Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1f2913e9df964e9186f05716842e8321"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1f2913e9df964e9186f05716842e8321"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1f2913e9df964e9186f05716842e8321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1f2913e9df964e9186f05716842e8321", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-471617812 Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 1f2913e9df964e9186f05716842e8321 Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-471617812 Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-InstanceActionsNegativeTestJSON-471617812-project Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f3adb1960d5543bb8073dbe2dddd2c4e Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-471617812-project Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: exception: Action 999 not found Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: action_args: {'server_id': 'd81ba01e-9ff4-4499-8f31-bc781c290180', 'id': '999'} Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 31 01:15:32.174785 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:32.180956 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aba98b7c-0360-4eaf-9bbc-cdfd0bce2740 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Returning 404 to user: Action 999 not found {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:32.182401 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aba98b7c-0360-4eaf-9bbc-cdfd0bce2740 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] 10.222.0.45 "GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.147322 Jul 31 01:15:32.183227 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 973/1965] 10.222.0.45 () {58 vars in 1308 bytes} [Sun Jul 31 01:15:32 2022] GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180/os-instance-actions/999 => generated 66 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:15:32.195529 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4c87ad77-697e-4ef0-863a-234c2eae630b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fedea944670>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:32.206031 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c87ad77-697e-4ef0-863a-234c2eae630b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:32.206787 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c87ad77-697e-4ef0-863a-234c2eae630b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:32.207494 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4c87ad77-697e-4ef0-863a-234c2eae630b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:32.225584 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c87ad77-697e-4ef0-863a-234c2eae630b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:32.226305 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c87ad77-697e-4ef0-863a-234c2eae630b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:32.227297 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c87ad77-697e-4ef0-863a-234c2eae630b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:32.228495 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c87ad77-697e-4ef0-863a-234c2eae630b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:32.251836 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-848c03db-555b-4da8-a4ff-ab7af896d372 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:32.260181 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-848c03db-555b-4da8-a4ff-ab7af896d372 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda" status: 200 len: 1317 microversion: 2.1 time: 0.383274 Jul 31 01:15:32.260755 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 993/1966] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:31 2022] GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:32.269474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c87ad77-697e-4ef0-863a-234c2eae630b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:32.270479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c87ad77-697e-4ef0-863a-234c2eae630b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:32.277157 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e9b36236-37d0-49c7-b223-4a45f5a71c00 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:32.277806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e9b36236-37d0-49c7-b223-4a45f5a71c00 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:32.290996 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9b36236-37d0-49c7-b223-4a45f5a71c00 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:32.291567 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-4c87ad77-697e-4ef0-863a-234c2eae630b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lazy-loading 'flavor' on Instance uuid 88d862c0-3b17-44a3-a405-9c28427a3db7 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:15:32.292858 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9b36236-37d0-49c7-b223-4a45f5a71c00 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:32.293875 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9b36236-37d0-49c7-b223-4a45f5a71c00 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:32.294500 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9b36236-37d0-49c7-b223-4a45f5a71c00 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:32.315472 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4c87ad77-697e-4ef0-863a-234c2eae630b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "DELETE /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags" status: 204 len: 0 microversion: 2.26 time: 0.125590 Jul 31 01:15:32.316553 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 974/1967] 10.222.0.45 () {60 vars in 1295 bytes} [Sun Jul 31 01:15:32 2022] DELETE /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:15:32.324125 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-bd821ba8-a8e6-4af4-8ea3-7d48ef18c774 req-514e550a-f443-4a83-8f32-a7347e259b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fea13f-be07-4445-a8bc-a890b2ff8429", "name": "network-vif-plugged", "status": "completed", "tag": "3bc62765-ad76-49a9-a67e-6e53c60ec318"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:32.339256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-bd821ba8-a8e6-4af4-8ea3-7d48ef18c774 req-514e550a-f443-4a83-8f32-a7347e259b76 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:32.339804 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-bd821ba8-a8e6-4af4-8ea3-7d48ef18c774 req-514e550a-f443-4a83-8f32-a7347e259b76 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:32.357111 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-bd821ba8-a8e6-4af4-8ea3-7d48ef18c774 req-514e550a-f443-4a83-8f32-a7347e259b76 service nova] Creating event network-vif-plugged:3bc62765-ad76-49a9-a67e-6e53c60ec318 for instance 16fea13f-be07-4445-a8bc-a890b2ff8429 on n-h1-master-1 Jul 31 01:15:32.362834 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-bd821ba8-a8e6-4af4-8ea3-7d48ef18c774 req-514e550a-f443-4a83-8f32-a7347e259b76 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044208 Jul 31 01:15:32.364148 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 975/1968] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:32.370123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ee06efb2-3973-4955-b0a1-a89ebd6d5609 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Action: 'action', calling method: .version_select at 0x7fede83c5d30>, body: {"addFloatingIp": {"address": "172.35.6.82"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:32.373989 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ee06efb2-3973-4955-b0a1-a89ebd6d5609 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:32.381231 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee06efb2-3973-4955-b0a1-a89ebd6d5609 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:32.381962 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee06efb2-3973-4955-b0a1-a89ebd6d5609 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:32.383049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee06efb2-3973-4955-b0a1-a89ebd6d5609 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:32.384434 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee06efb2-3973-4955-b0a1-a89ebd6d5609 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:32.486124 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee06efb2-3973-4955-b0a1-a89ebd6d5609 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Acquired lock "refresh_cache-9b1a43c9-7310-4068-9b24-7ceb7c935553" {{(pid=119474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 01:15:32.711608 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:32.740699 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=12 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:32.798202 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e9b36236-37d0-49c7-b223-4a45f5a71c00 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:32.811841 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e9b36236-37d0-49c7-b223-4a45f5a71c00 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429" status: 200 len: 1487 microversion: 2.1 time: 0.544616 Jul 31 01:15:32.816182 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 994/1969] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:32 2022] GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 => generated 1487 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:32.831898 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d0a331cb-c802-4afb-8f5c-2c5c8017065c tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Calling method '.version_select at 0x7fedeaa4c820>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:32.840350 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d0a331cb-c802-4afb-8f5c-2c5c8017065c tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] [instance: 26c9a03d-9ecc-4254-b782-79dfb31724b2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:32.850981 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-d0a331cb-c802-4afb-8f5c-2c5c8017065c tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] HTTP exception thrown: Instance 26c9a03d-9ecc-4254-b782-79dfb31724b2 could not be found. Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d0a331cb-c802-4afb-8f5c-2c5c8017065c tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Request method failure captured: Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/26c9a03d-9ecc-4254-b782-79dfb31724b2/os-instance-actions HTTP/1.1 Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dedR_5kznTMVWebVIu6gDJAsioLb4SVc4a-YnAcqJSKvUnC9A61KGH2QLZd6pJyLPdWrZ9T0OQZgGrSXh16ERIrzGt2EpYZknQaYOiUZTnPa1tgChypVywAaGjDJEqlE6nDIZEvHr0NRDCviPqVnXw_X8Ex8umkgVsTCBOgNB9TmSk Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 1f2913e9df964e9186f05716842e8321 Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-471617812 Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1f2913e9df964e9186f05716842e8321"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1f2913e9df964e9186f05716842e8321"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1f2913e9df964e9186f05716842e8321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1f2913e9df964e9186f05716842e8321", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-471617812 Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 1f2913e9df964e9186f05716842e8321 Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-471617812 Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-InstanceActionsNegativeTestJSON-471617812-project Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f3adb1960d5543bb8073dbe2dddd2c4e Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-471617812-project Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 26c9a03d-9ecc-4254-b782-79dfb31724b2 could not be found. Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: action_args: {'server_id': '26c9a03d-9ecc-4254-b782-79dfb31724b2'} Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c9a03d-9ecc-4254-b782-79dfb31724b2 could not be found. Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:32.853785 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:32.858567 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c9a03d-9ecc-4254-b782-79dfb31724b2 could not be found. Jul 31 01:15:32.858567 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:32.858567 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:32.858567 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:32.858567 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:32.858567 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:32.858567 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:32.858567 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:32.858567 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:32.858567 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c9a03d-9ecc-4254-b782-79dfb31724b2 could not be found. Jul 31 01:15:32.858567 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:32.861264 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d0a331cb-c802-4afb-8f5c-2c5c8017065c tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Returning 404 to user: Instance 26c9a03d-9ecc-4254-b782-79dfb31724b2 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:32.862392 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d0a331cb-c802-4afb-8f5c-2c5c8017065c tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] 10.222.0.45 "GET /compute/v2.1/servers/26c9a03d-9ecc-4254-b782-79dfb31724b2/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.043824 Jul 31 01:15:32.863719 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 995/1970] 10.222.0.45 () {58 vars in 1296 bytes} [Sun Jul 31 01:15:32 2022] GET /compute/v2.1/servers/26c9a03d-9ecc-4254-b782-79dfb31724b2/os-instance-actions => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:32.869914 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7b2190b5-4812-4c52-982b-27f774a375a2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fedeaa69c10>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:32.882385 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b2190b5-4812-4c52-982b-27f774a375a2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:32.883117 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b2190b5-4812-4c52-982b-27f774a375a2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:32.885056 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7b2190b5-4812-4c52-982b-27f774a375a2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:32.893018 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b2190b5-4812-4c52-982b-27f774a375a2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:32.893831 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b2190b5-4812-4c52-982b-27f774a375a2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:32.894789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b2190b5-4812-4c52-982b-27f774a375a2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:32.895415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b2190b5-4812-4c52-982b-27f774a375a2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:32.928708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b2190b5-4812-4c52-982b-27f774a375a2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:32.930108 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b2190b5-4812-4c52-982b-27f774a375a2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:32.942544 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b2190b5-4812-4c52-982b-27f774a375a2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:32.943298 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b2190b5-4812-4c52-982b-27f774a375a2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:32.976596 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-7b2190b5-4812-4c52-982b-27f774a375a2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lazy-loading 'flavor' on Instance uuid 88d862c0-3b17-44a3-a405-9c28427a3db7 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:15:33.008945 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7b2190b5-4812-4c52-982b-27f774a375a2 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "PUT /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags/tempest-tag-39424296" status: 201 len: 0 microversion: 2.26 time: 0.143621 Jul 31 01:15:33.014549 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 996/1971] 10.222.0.45 () {62 vars in 1374 bytes} [Sun Jul 31 01:15:32 2022] PUT /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags/tempest-tag-39424296 => generated 0 bytes in 150 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Jul 31 01:15:33.024120 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e4270d77-1822-488e-943a-26470883dc69 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:33.025233 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e4270d77-1822-488e-943a-26470883dc69 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:33.043684 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4270d77-1822-488e-943a-26470883dc69 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:33.048068 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4270d77-1822-488e-943a-26470883dc69 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:33.049129 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4270d77-1822-488e-943a-26470883dc69 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:33.049978 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4270d77-1822-488e-943a-26470883dc69 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:33.114338 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e4270d77-1822-488e-943a-26470883dc69 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:15:33.275087 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e4270d77-1822-488e-943a-26470883dc69 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "DELETE /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429" status: 204 len: 0 microversion: 2.1 time: 0.258514 Jul 31 01:15:33.276848 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 997/1972] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:15:33 2022] DELETE /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:15:33.291274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c88baf6e-64e8-47ca-afd4-90225ba009b6 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:33.291990 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c88baf6e-64e8-47ca-afd4-90225ba009b6 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] [instance: d81ba01e-9ff4-4499-8f31-bc781c290180] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:33.296983 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:33.302162 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c88baf6e-64e8-47ca-afd4-90225ba009b6 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:33.302633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c88baf6e-64e8-47ca-afd4-90225ba009b6 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:33.304335 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c88baf6e-64e8-47ca-afd4-90225ba009b6 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:33.304810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c88baf6e-64e8-47ca-afd4-90225ba009b6 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:33.345885 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c88baf6e-64e8-47ca-afd4-90225ba009b6 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] [instance: d81ba01e-9ff4-4499-8f31-bc781c290180] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:15:33.442658 n-d-master-1 devstack@n-api.service[119474]: DEBUG neutronclient.v2_0.client [None req-ee06efb2-3973-4955-b0a1-a89ebd6d5609 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.6.82 (ec6c96e6-91c3-4160-bc1b-0a3f8cd03273) with port d19472c9-6b7c-4f7b-a72a-118ac2c23928 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 0abb2289-fd48-4bf1-9c02-0622852045a3.", "detail": ""}} {{(pid=119474) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:15:33.443838 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee06efb2-3973-4955-b0a1-a89ebd6d5609 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Releasing lock "refresh_cache-9b1a43c9-7310-4068-9b24-7ceb7c935553" {{(pid=119474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 01:15:33.444573 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-ee06efb2-3973-4955-b0a1-a89ebd6d5609 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] HTTP exception thrown: Cannot associate floating IP 172.35.6.82 (ec6c96e6-91c3-4160-bc1b-0a3f8cd03273) with port d19472c9-6b7c-4f7b-a72a-118ac2c23928 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 0abb2289-fd48-4bf1-9c02-0622852045a3. Jul 31 01:15:33.444573 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-130eb9af-5a64-48bb-bd9f-20afc7948926'] Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ee06efb2-3973-4955-b0a1-a89ebd6d5609 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Request method failure captured: Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553/action HTTP/1.1 Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 45 Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5deCl4ZlFEyAdTg2sbxmSvq4fnDOFPMTJ6vVwSDxMZvTCKTuHmnFSDq3PSTW5MdYOYovAZHymCPCLFHIux9TQ58cOKywQdikdlB61b6S9QW2P59ONV1RcI72itpoP6t_e2bRbY_H4ruv7LgGTxL5h9geLWP9o5xNNuRziRtTrDejUU0 Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: f130aa9ed7364d0aad29cab48e63f0be Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f130aa9ed7364d0aad29cab48e63f0be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f130aa9ed7364d0aad29cab48e63f0be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f130aa9ed7364d0aad29cab48e63f0be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f130aa9ed7364d0aad29cab48e63f0be", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: f130aa9ed7364d0aad29cab48e63f0be Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f4103d2981da44aea1ea8547f225b3b5 Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: {"addFloatingIp": {"address": "172.35.6.82"}} Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: exception: Cannot associate floating IP 172.35.6.82 (ec6c96e6-91c3-4160-bc1b-0a3f8cd03273) with port d19472c9-6b7c-4f7b-a72a-118ac2c23928 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 0abb2289-fd48-4bf1-9c02-0622852045a3. Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-130eb9af-5a64-48bb-bd9f-20afc7948926'] Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '9b1a43c9-7310-4068-9b24-7ceb7c935553', 'body': {'addFloatingIp': {'address': '172.35.6.82'}}} Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:15:33.447934 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.6.82 (ec6c96e6-91c3-4160-bc1b-0a3f8cd03273) with port d19472c9-6b7c-4f7b-a72a-118ac2c23928 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 0abb2289-fd48-4bf1-9c02-0622852045a3. Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-130eb9af-5a64-48bb-bd9f-20afc7948926'] Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.6.82 (ec6c96e6-91c3-4160-bc1b-0a3f8cd03273) with port d19472c9-6b7c-4f7b-a72a-118ac2c23928 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 0abb2289-fd48-4bf1-9c02-0622852045a3. Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-130eb9af-5a64-48bb-bd9f-20afc7948926'] Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.6.82 (ec6c96e6-91c3-4160-bc1b-0a3f8cd03273) with port d19472c9-6b7c-4f7b-a72a-118ac2c23928 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 0abb2289-fd48-4bf1-9c02-0622852045a3. Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-130eb9af-5a64-48bb-bd9f-20afc7948926'] Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.6.82 (ec6c96e6-91c3-4160-bc1b-0a3f8cd03273) with port d19472c9-6b7c-4f7b-a72a-118ac2c23928 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 0abb2289-fd48-4bf1-9c02-0622852045a3. Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-130eb9af-5a64-48bb-bd9f-20afc7948926'] Jul 31 01:15:33.452906 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:33.466555 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ee06efb2-3973-4955-b0a1-a89ebd6d5609 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Returning 400 to user: Cannot associate floating IP 172.35.6.82 (ec6c96e6-91c3-4160-bc1b-0a3f8cd03273) with port d19472c9-6b7c-4f7b-a72a-118ac2c23928 using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 0abb2289-fd48-4bf1-9c02-0622852045a3. Jul 31 01:15:33.466555 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-130eb9af-5a64-48bb-bd9f-20afc7948926'] {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:33.466555 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ee06efb2-3973-4955-b0a1-a89ebd6d5609 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "POST /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553/action" status: 400 len: 380 microversion: 2.1 time: 1.084030 Jul 31 01:15:33.466555 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 976/1973] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:15:32 2022] POST /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553/action => generated 380 bytes in 1085 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:15:33.466555 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aeab8943-a48a-4907-b0d2-86ac03e8d416 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fedea8515e0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:33.502480 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c88baf6e-64e8-47ca-afd4-90225ba009b6 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180" status: 204 len: 0 microversion: 2.1 time: 0.223603 Jul 31 01:15:33.506121 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 998/1974] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:15:33 2022] DELETE /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:15:33.507872 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aeab8943-a48a-4907-b0d2-86ac03e8d416 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:33.510158 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aeab8943-a48a-4907-b0d2-86ac03e8d416 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:33.511779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d10d78c4-9ba7-4c0d-a4db-4ff59415492f tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:33.512347 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aeab8943-a48a-4907-b0d2-86ac03e8d416 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:33.512579 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d10d78c4-9ba7-4c0d-a4db-4ff59415492f tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:33.525458 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d10d78c4-9ba7-4c0d-a4db-4ff59415492f tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:33.526461 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d10d78c4-9ba7-4c0d-a4db-4ff59415492f tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:33.531773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d10d78c4-9ba7-4c0d-a4db-4ff59415492f tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:33.532685 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d10d78c4-9ba7-4c0d-a4db-4ff59415492f tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:33.534609 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aeab8943-a48a-4907-b0d2-86ac03e8d416 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:33.535392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aeab8943-a48a-4907-b0d2-86ac03e8d416 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:33.540449 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aeab8943-a48a-4907-b0d2-86ac03e8d416 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:33.541160 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aeab8943-a48a-4907-b0d2-86ac03e8d416 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:33.600129 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aeab8943-a48a-4907-b0d2-86ac03e8d416 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:33.603032 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aeab8943-a48a-4907-b0d2-86ac03e8d416 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:33.621229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aeab8943-a48a-4907-b0d2-86ac03e8d416 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:33.621998 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aeab8943-a48a-4907-b0d2-86ac03e8d416 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:33.625686 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:33.675556 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-aeab8943-a48a-4907-b0d2-86ac03e8d416 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lazy-loading 'flavor' on Instance uuid 88d862c0-3b17-44a3-a405-9c28427a3db7 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:15:33.700860 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aeab8943-a48a-4907-b0d2-86ac03e8d416 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "PUT /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags/tempest-tag-259278061" status: 201 len: 0 microversion: 2.26 time: 0.249752 Jul 31 01:15:33.701900 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 977/1975] 10.222.0.45 () {62 vars in 1377 bytes} [Sun Jul 31 01:15:33 2022] PUT /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags/tempest-tag-259278061 => generated 0 bytes in 251 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 31 01:15:33.712170 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ccfa1c15-2661-4d30-8ba1-b47c1b722c1d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea944670>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:33.771494 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-ccfa1c15-2661-4d30-8ba1-b47c1b722c1d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] HTTP exception thrown: Image not found. Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ccfa1c15-2661-4d30-8ba1-b47c1b722c1d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Request method failure captured: Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/images/0c4b5677-2e38-4966-8d74-5b8e676e77e1 HTTP/1.1 Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5daZNzbVSRW_MAKMkrOAUUJIeGOi9uDUAoYvS0M7DAhBkdjeL_fmKLhMe2lVjGjEo1zF9tidtGcEORmw2CopMgy4S7BM-2ndIKS-4pmm3qBpWc0rC9OSGiFYwBerHUlvunP3Zg_ptMe0QNZytwKkR_27JMh9lTzzkZBoROoqi3pQMxY Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fb526f587384fdea1a06d8b3b685dcf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesTestJSON-161885913 Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f4352f9b8762490e9187e28e8c9cd58e Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: exception: Image not found. Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '0c4b5677-2e38-4966-8d74-5b8e676e77e1'} Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0c4b5677-2e38-4966-8d74-5b8e676e77e1 to delete Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c4b5677-2e38-4966-8d74-5b8e676e77e1 could not be found. Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:33.773856 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:33.780593 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ccfa1c15-2661-4d30-8ba1-b47c1b722c1d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Returning 404 to user: Image not found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:33.784996 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ccfa1c15-2661-4d30-8ba1-b47c1b722c1d tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "DELETE /compute/v2.1/images/0c4b5677-2e38-4966-8d74-5b8e676e77e1" status: 404 len: 62 microversion: 2.1 time: 0.076440 Jul 31 01:15:33.785798 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 978/1976] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:33 2022] DELETE /compute/v2.1/images/0c4b5677-2e38-4966-8d74-5b8e676e77e1 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:15:33.818369 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9ad50a61-3be4-4a3e-97cd-4ab619eec417 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '.version_select at 0x7fedea8ed280>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:34.437735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d10d78c4-9ba7-4c0d-a4db-4ff59415492f tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:34.447920 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d10d78c4-9ba7-4c0d-a4db-4ff59415492f tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda" status: 200 len: 1317 microversion: 2.1 time: 0.943106 Jul 31 01:15:34.449600 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 999/1977] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:33 2022] GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda => generated 1317 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:34.470605 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-89cacf8d-53b9-4240-ae3e-07c361a6af97 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:34.474020 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-89cacf8d-53b9-4240-ae3e-07c361a6af97 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] [instance: d81ba01e-9ff4-4499-8f31-bc781c290180] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:34.502195 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89cacf8d-53b9-4240-ae3e-07c361a6af97 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:34.502801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89cacf8d-53b9-4240-ae3e-07c361a6af97 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:34.504310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89cacf8d-53b9-4240-ae3e-07c361a6af97 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:34.506520 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89cacf8d-53b9-4240-ae3e-07c361a6af97 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:35.062781 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-89cacf8d-53b9-4240-ae3e-07c361a6af97 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3adb1960d5543bb8073dbe2dddd2c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2913e9df964e9186f05716842e8321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:35.074038 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-89cacf8d-53b9-4240-ae3e-07c361a6af97 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] 10.222.0.45 "GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180" status: 200 len: 1526 microversion: 2.1 time: 0.620966 Jul 31 01:15:35.076915 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1000/1978] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:34 2022] GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180 => generated 1526 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:35.082322 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0c3dae4e-fd30-4c03-92e9-5d9ea8d81cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Action: 'update_all', calling method: .version_select at 0x7fedeaa38280>, body: {"tags": ["tempest-tag-1514137434", "tempest-tag-497248658"]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:35.109614 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c3dae4e-fd30-4c03-92e9-5d9ea8d81cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:35.111960 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c3dae4e-fd30-4c03-92e9-5d9ea8d81cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:35.114174 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0c3dae4e-fd30-4c03-92e9-5d9ea8d81cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:35.129287 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c3dae4e-fd30-4c03-92e9-5d9ea8d81cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:35.130558 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c3dae4e-fd30-4c03-92e9-5d9ea8d81cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:35.133181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c3dae4e-fd30-4c03-92e9-5d9ea8d81cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:35.134991 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c3dae4e-fd30-4c03-92e9-5d9ea8d81cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:35.190920 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c3dae4e-fd30-4c03-92e9-5d9ea8d81cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:35.193769 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c3dae4e-fd30-4c03-92e9-5d9ea8d81cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:35.236861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-0c3dae4e-fd30-4c03-92e9-5d9ea8d81cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lazy-loading 'flavor' on Instance uuid 88d862c0-3b17-44a3-a405-9c28427a3db7 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:15:35.255225 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0c3dae4e-fd30-4c03-92e9-5d9ea8d81cdb tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "PUT /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags" status: 200 len: 61 microversion: 2.26 time: 0.176887 Jul 31 01:15:35.256128 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1001/1979] 10.222.0.45 () {62 vars in 1312 bytes} [Sun Jul 31 01:15:35 2022] PUT /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags => generated 61 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:35.267098 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bae72366-6228-45c5-b197-e6e2cbb91a20 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:35.267662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bae72366-6228-45c5-b197-e6e2cbb91a20 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:35.275941 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bae72366-6228-45c5-b197-e6e2cbb91a20 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:35.276403 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bae72366-6228-45c5-b197-e6e2cbb91a20 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:35.277205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bae72366-6228-45c5-b197-e6e2cbb91a20 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:35.277650 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bae72366-6228-45c5-b197-e6e2cbb91a20 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:35.347288 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bae72366-6228-45c5-b197-e6e2cbb91a20 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:15:35.418081 n-d-master-1 devstack@n-api.service[119475]: INFO nova.compute.api [None req-bae72366-6228-45c5-b197-e6e2cbb91a20 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Instance is already in deleting state, ignoring this request Jul 31 01:15:35.419001 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bae72366-6228-45c5-b197-e6e2cbb91a20 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "DELETE /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429" status: 204 len: 0 microversion: 2.1 time: 0.156135 Jul 31 01:15:35.422434 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1002/1980] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:15:35 2022] DELETE /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:15:35.434721 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-988925e6-adf1-4e10-8380-e107ad4be75f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fedeaa69e50>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:35.454486 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-988925e6-adf1-4e10-8380-e107ad4be75f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:35.455138 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-988925e6-adf1-4e10-8380-e107ad4be75f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:35.472262 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=4,nova_cell1:RELEASE=1,nova_cell1:UPDATE=3,nova_cell1:DELETE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:35.474313 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-988925e6-adf1-4e10-8380-e107ad4be75f tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags" status: 200 len: 61 microversion: 2.26 time: 0.050683 Jul 31 01:15:35.480751 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1003/1981] 10.222.0.45 () {60 vars in 1292 bytes} [Sun Jul 31 01:15:35 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags => generated 61 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:35.486417 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-79e33d53-bbfd-441a-ae00-d01ba3487d98 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:35.487424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-79e33d53-bbfd-441a-ae00-d01ba3487d98 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:35.496976 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-79e33d53-bbfd-441a-ae00-d01ba3487d98 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:35.497447 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-79e33d53-bbfd-441a-ae00-d01ba3487d98 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:35.498287 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-79e33d53-bbfd-441a-ae00-d01ba3487d98 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:35.498866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-79e33d53-bbfd-441a-ae00-d01ba3487d98 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:36.172356 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-79e33d53-bbfd-441a-ae00-d01ba3487d98 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:36.191868 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-79e33d53-bbfd-441a-ae00-d01ba3487d98 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429" status: 200 len: 1493 microversion: 2.1 time: 0.709742 Jul 31 01:15:36.192513 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1004/1982] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:35 2022] GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 => generated 1493 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:36.220102 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e118d588-9373-421d-9757-71ae2b151036 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:36.220608 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e118d588-9373-421d-9757-71ae2b151036 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:36.239193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e118d588-9373-421d-9757-71ae2b151036 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:36.239707 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e118d588-9373-421d-9757-71ae2b151036 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:36.240472 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e118d588-9373-421d-9757-71ae2b151036 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:36.240915 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e118d588-9373-421d-9757-71ae2b151036 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:36.674403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e118d588-9373-421d-9757-71ae2b151036 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:36.686963 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e118d588-9373-421d-9757-71ae2b151036 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda" status: 200 len: 1317 microversion: 2.1 time: 0.480257 Jul 31 01:15:36.699363 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1005/1983] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:36 2022] GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:36.700903 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-502ecc9b-92d5-479c-bee7-9b58ec91b42b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '.version_select at 0x7fede523cdc0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:36.708810 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9ad50a61-3be4-4a3e-97cd-4ab619eec417 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/ec6c96e6-91c3-4160-bc1b-0a3f8cd03273" status: 202 len: 0 microversion: 2.1 time: 2.905701 Jul 31 01:15:36.713724 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-502ecc9b-92d5-479c-bee7-9b58ec91b42b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:36.713724 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-502ecc9b-92d5-479c-bee7-9b58ec91b42b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:36.714681 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 979/1984] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:15:33 2022] DELETE /compute/v2.1/os-floating-ips/ec6c96e6-91c3-4160-bc1b-0a3f8cd03273 => generated 0 bytes in 2928 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:15:36.716181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-502ecc9b-92d5-479c-bee7-9b58ec91b42b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:36.721318 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c3e69d48-0c02-4d0c-8265-83715fc99538 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:36.723825 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c3e69d48-0c02-4d0c-8265-83715fc99538 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] [instance: d81ba01e-9ff4-4499-8f31-bc781c290180] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:36.741166 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3e69d48-0c02-4d0c-8265-83715fc99538 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:36.741883 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3e69d48-0c02-4d0c-8265-83715fc99538 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:36.742176 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-502ecc9b-92d5-479c-bee7-9b58ec91b42b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:36.742640 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-502ecc9b-92d5-479c-bee7-9b58ec91b42b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:36.743786 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3e69d48-0c02-4d0c-8265-83715fc99538 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:36.744576 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3e69d48-0c02-4d0c-8265-83715fc99538 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:36.746907 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-502ecc9b-92d5-479c-bee7-9b58ec91b42b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:36.747499 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-502ecc9b-92d5-479c-bee7-9b58ec91b42b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:36.874387 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-502ecc9b-92d5-479c-bee7-9b58ec91b42b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:36.874770 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-502ecc9b-92d5-479c-bee7-9b58ec91b42b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:36.905971 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-502ecc9b-92d5-479c-bee7-9b58ec91b42b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lazy-loading 'flavor' on Instance uuid 88d862c0-3b17-44a3-a405-9c28427a3db7 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:15:36.937486 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-502ecc9b-92d5-479c-bee7-9b58ec91b42b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "DELETE /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags" status: 204 len: 0 microversion: 2.26 time: 0.248036 Jul 31 01:15:36.938490 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1006/1985] 10.222.0.45 () {60 vars in 1295 bytes} [Sun Jul 31 01:15:36 2022] DELETE /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7/tags => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:15:36.949145 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-c9dcc355-f39c-47e7-9bc4-3686485689fe req-a95793d8-815d-4576-8025-50f0b473fe83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fea13f-be07-4445-a8bc-a890b2ff8429", "name": "network-vif-unplugged", "status": "completed", "tag": "3bc62765-ad76-49a9-a67e-6e53c60ec318"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:36.976356 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c9dcc355-f39c-47e7-9bc4-3686485689fe req-a95793d8-815d-4576-8025-50f0b473fe83 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:36.976644 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c9dcc355-f39c-47e7-9bc4-3686485689fe req-a95793d8-815d-4576-8025-50f0b473fe83 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:37.005847 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-c9dcc355-f39c-47e7-9bc4-3686485689fe req-a95793d8-815d-4576-8025-50f0b473fe83 service nova] Creating event network-vif-unplugged:3bc62765-ad76-49a9-a67e-6e53c60ec318 for instance 16fea13f-be07-4445-a8bc-a890b2ff8429 on n-h1-master-1 Jul 31 01:15:37.021984 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-c9dcc355-f39c-47e7-9bc4-3686485689fe req-a95793d8-815d-4576-8025-50f0b473fe83 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076485 Jul 31 01:15:37.022997 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1007/1986] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:37.035034 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6a35098f-a797-4c90-a4ae-206b2240d0a5 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Action: 'action', calling method: .version_select at 0x7fede8359af0>, body: {"removeFloatingIp": {"address": "172.35.6.139"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:37.696704 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c3e69d48-0c02-4d0c-8265-83715fc99538 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3adb1960d5543bb8073dbe2dddd2c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2913e9df964e9186f05716842e8321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:37.709247 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c3e69d48-0c02-4d0c-8265-83715fc99538 tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] 10.222.0.45 "GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180" status: 200 len: 1526 microversion: 2.1 time: 0.990699 Jul 31 01:15:37.710548 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 980/1987] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:36 2022] GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180 => generated 1526 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:37.728324 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bc5e78f3-ffc3-431f-99b7-b9463253b72b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:37.730583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bc5e78f3-ffc3-431f-99b7-b9463253b72b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:37.751271 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc5e78f3-ffc3-431f-99b7-b9463253b72b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:37.751753 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc5e78f3-ffc3-431f-99b7-b9463253b72b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:37.758280 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc5e78f3-ffc3-431f-99b7-b9463253b72b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:37.758788 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc5e78f3-ffc3-431f-99b7-b9463253b72b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:37.823747 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bc5e78f3-ffc3-431f-99b7-b9463253b72b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:15:37.840553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6a35098f-a797-4c90-a4ae-206b2240d0a5 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:37.849525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a35098f-a797-4c90-a4ae-206b2240d0a5 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:37.850366 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a35098f-a797-4c90-a4ae-206b2240d0a5 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:37.853622 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a35098f-a797-4c90-a4ae-206b2240d0a5 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:37.854901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a35098f-a797-4c90-a4ae-206b2240d0a5 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:38.074979 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bc5e78f3-ffc3-431f-99b7-b9463253b72b tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "DELETE /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7" status: 204 len: 0 microversion: 2.26 time: 0.361478 Jul 31 01:15:38.075823 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 981/1988] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:15:37 2022] DELETE /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:15:38.094873 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9b148c85-502c-4e3a-ad22-735b3452a9d3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:38.097216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9b148c85-502c-4e3a-ad22-735b3452a9d3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:38.110026 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9b148c85-502c-4e3a-ad22-735b3452a9d3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:38.110795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9b148c85-502c-4e3a-ad22-735b3452a9d3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:38.111863 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9b148c85-502c-4e3a-ad22-735b3452a9d3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:38.112475 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9b148c85-502c-4e3a-ad22-735b3452a9d3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:38.452608 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9b148c85-502c-4e3a-ad22-735b3452a9d3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4352f9b8762490e9187e28e8c9cd58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb526f587384fdea1a06d8b3b685dcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:38.468371 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9b148c85-502c-4e3a-ad22-735b3452a9d3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429" status: 200 len: 1493 microversion: 2.1 time: 0.388044 Jul 31 01:15:38.474149 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 982/1989] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:38 2022] GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 => generated 1493 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:38.501188 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0b15e259-fc51-4986-a8d2-75291e94f63b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:38.502199 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0b15e259-fc51-4986-a8d2-75291e94f63b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:38.529102 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b15e259-fc51-4986-a8d2-75291e94f63b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:38.532462 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b15e259-fc51-4986-a8d2-75291e94f63b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:38.543670 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b15e259-fc51-4986-a8d2-75291e94f63b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:38.544469 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b15e259-fc51-4986-a8d2-75291e94f63b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:38.653888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a35098f-a797-4c90-a4ae-206b2240d0a5 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Acquired lock "refresh_cache-9b1a43c9-7310-4068-9b24-7ceb7c935553" {{(pid=119475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 01:15:38.680243 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0b15e259-fc51-4986-a8d2-75291e94f63b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:15:38.889394 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0b15e259-fc51-4986-a8d2-75291e94f63b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "DELETE /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 204 len: 0 microversion: 2.1 time: 0.406110 Jul 31 01:15:38.891725 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 983/1990] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:15:38 2022] DELETE /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:15:38.913509 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b2570751-937f-4783-b37b-e581e13ad9d2 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:38.920960 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b2570751-937f-4783-b37b-e581e13ad9d2 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:38.943227 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2570751-937f-4783-b37b-e581e13ad9d2 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:38.945262 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2570751-937f-4783-b37b-e581e13ad9d2 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:38.951361 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2570751-937f-4783-b37b-e581e13ad9d2 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:38.952245 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2570751-937f-4783-b37b-e581e13ad9d2 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:40.088195 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b2570751-937f-4783-b37b-e581e13ad9d2 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:40.098051 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b2570751-937f-4783-b37b-e581e13ad9d2 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda" status: 200 len: 1317 microversion: 2.1 time: 1.201384 Jul 31 01:15:40.105072 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 984/1991] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:38 2022] GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda => generated 1317 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:40.110199 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-527710d0-4183-4f7c-bf09-25e21916a943 req-40b50351-c1f0-428c-bc58-11c0993d6662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d81ba01e-9ff4-4499-8f31-bc781c290180", "name": "network-vif-deleted", "tag": "e52c0ed1-6216-4e41-b44c-16e1739167a6"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:40.134828 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-527710d0-4183-4f7c-bf09-25e21916a943 req-40b50351-c1f0-428c-bc58-11c0993d6662 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:40.135268 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-527710d0-4183-4f7c-bf09-25e21916a943 req-40b50351-c1f0-428c-bc58-11c0993d6662 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:40.164425 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-527710d0-4183-4f7c-bf09-25e21916a943 req-40b50351-c1f0-428c-bc58-11c0993d6662 service nova] Creating event network-vif-deleted:e52c0ed1-6216-4e41-b44c-16e1739167a6 for instance d81ba01e-9ff4-4499-8f31-bc781c290180 on n-h1-master-1 Jul 31 01:15:40.174350 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-527710d0-4183-4f7c-bf09-25e21916a943 req-40b50351-c1f0-428c-bc58-11c0993d6662 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067442 Jul 31 01:15:40.175779 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 985/1992] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:40.181796 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6257d2e3-966d-4dda-a609-b61468dae959 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:40.182652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6257d2e3-966d-4dda-a609-b61468dae959 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:40.189759 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6257d2e3-966d-4dda-a609-b61468dae959 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:40.190608 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6257d2e3-966d-4dda-a609-b61468dae959 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:40.192406 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6257d2e3-966d-4dda-a609-b61468dae959 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:40.192963 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6257d2e3-966d-4dda-a609-b61468dae959 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:40.579223 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6257d2e3-966d-4dda-a609-b61468dae959 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:40.589533 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6257d2e3-966d-4dda-a609-b61468dae959 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:40.591392 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6257d2e3-966d-4dda-a609-b61468dae959 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3657778c56d245c1b1c2081631cd4598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c464605fa24a06a3d4e6107513a823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:40.592946 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6257d2e3-966d-4dda-a609-b61468dae959 tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7" status: 200 len: 1551 microversion: 2.26 time: 0.415848 Jul 31 01:15:40.608334 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 986/1993] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:15:40 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7 => generated 1551 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:15:40.614035 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-55f73bcb-6558-4c95-993a-46c31c159a8d tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:40.614661 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-55f73bcb-6558-4c95-993a-46c31c159a8d tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] [instance: d81ba01e-9ff4-4499-8f31-bc781c290180] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:40.629605 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-55f73bcb-6558-4c95-993a-46c31c159a8d tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:40.630104 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-55f73bcb-6558-4c95-993a-46c31c159a8d tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:40.631530 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-55f73bcb-6558-4c95-993a-46c31c159a8d tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:40.631941 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-55f73bcb-6558-4c95-993a-46c31c159a8d tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:40.652278 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-55f73bcb-6558-4c95-993a-46c31c159a8d tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] HTTP exception thrown: Instance d81ba01e-9ff4-4499-8f31-bc781c290180 could not be found. Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-55f73bcb-6558-4c95-993a-46c31c159a8d tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Request method failure captured: Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180 HTTP/1.1 Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dedR_5kznTMVWebVIu6gDJAsioLb4SVc4a-YnAcqJSKvUnC9A61KGH2QLZd6pJyLPdWrZ9T0OQZgGrSXh16ERIrzGt2EpYZknQaYOiUZTnPa1tgChypVywAaGjDJEqlE6nDIZEvHr0NRDCviPqVnXw_X8Ex8umkgVsTCBOgNB9TmSk Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 1f2913e9df964e9186f05716842e8321 Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-471617812 Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1f2913e9df964e9186f05716842e8321"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1f2913e9df964e9186f05716842e8321"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1f2913e9df964e9186f05716842e8321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1f2913e9df964e9186f05716842e8321", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-471617812 Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 1f2913e9df964e9186f05716842e8321 Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-471617812 Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-InstanceActionsNegativeTestJSON-471617812-project Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f3adb1960d5543bb8073dbe2dddd2c4e Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-471617812-project Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: exception: Instance d81ba01e-9ff4-4499-8f31-bc781c290180 could not be found. Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'd81ba01e-9ff4-4499-8f31-bc781c290180'} Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d81ba01e-9ff4-4499-8f31-bc781c290180 could not be found. Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d81ba01e-9ff4-4499-8f31-bc781c290180 could not be found. Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:40.653970 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:40.659994 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:40.659994 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:40.659994 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:40.659994 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:40.659994 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:40.659994 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:40.659994 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d81ba01e-9ff4-4499-8f31-bc781c290180 could not be found. Jul 31 01:15:40.659994 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:40.659994 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-55f73bcb-6558-4c95-993a-46c31c159a8d tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] Returning 404 to user: Instance d81ba01e-9ff4-4499-8f31-bc781c290180 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:40.659994 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-55f73bcb-6558-4c95-993a-46c31c159a8d tempest-InstanceActionsNegativeTestJSON-471617812 tempest-InstanceActionsNegativeTestJSON-471617812-project] 10.222.0.45 "GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180" status: 404 len: 111 microversion: 2.1 time: 0.046676 Jul 31 01:15:40.661969 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 987/1994] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:40 2022] GET /compute/v2.1/servers/d81ba01e-9ff4-4499-8f31-bc781c290180 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:40.667290 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9eb66dcc-1b05-4d0f-87b8-5576d48d90fe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:40.668045 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9eb66dcc-1b05-4d0f-87b8-5576d48d90fe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:40.675542 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9eb66dcc-1b05-4d0f-87b8-5576d48d90fe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:40.675993 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9eb66dcc-1b05-4d0f-87b8-5576d48d90fe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:40.677203 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9eb66dcc-1b05-4d0f-87b8-5576d48d90fe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:40.677850 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9eb66dcc-1b05-4d0f-87b8-5576d48d90fe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:41.054200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9eb66dcc-1b05-4d0f-87b8-5576d48d90fe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:41.076660 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9eb66dcc-1b05-4d0f-87b8-5576d48d90fe tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 200 len: 1667 microversion: 2.1 time: 0.412787 Jul 31 01:15:41.079471 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 988/1995] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:40 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 1667 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:41.085263 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-c8847085-7039-433e-bd09-61da57d70623 req-62382e3d-571f-4712-89d1-7bdfec709c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fea13f-be07-4445-a8bc-a890b2ff8429", "name": "network-vif-deleted", "tag": "3bc62765-ad76-49a9-a67e-6e53c60ec318"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:41.101132 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c8847085-7039-433e-bd09-61da57d70623 req-62382e3d-571f-4712-89d1-7bdfec709c1e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:41.103120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c8847085-7039-433e-bd09-61da57d70623 req-62382e3d-571f-4712-89d1-7bdfec709c1e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:41.118229 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-6a35098f-a797-4c90-a4ae-206b2240d0a5 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Building network info cache for instance {{(pid=119475) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 31 01:15:41.121738 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-c8847085-7039-433e-bd09-61da57d70623 req-62382e3d-571f-4712-89d1-7bdfec709c1e service nova] Creating event network-vif-deleted:3bc62765-ad76-49a9-a67e-6e53c60ec318 for instance 16fea13f-be07-4445-a8bc-a890b2ff8429 on n-h1-master-1 Jul 31 01:15:41.132517 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-c8847085-7039-433e-bd09-61da57d70623 req-62382e3d-571f-4712-89d1-7bdfec709c1e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050485 Jul 31 01:15:41.133598 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 989/1996] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:41.141350 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9164b182-1a97-4aa9-a8a9-39d5ddeca217 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Action: 'create', calling method: .version_select at 0x7fede4fa2310>, body: {"keypair": {"name": "tempest-keypair-194225778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwvdjB6T9sDA96i8AbhtsirINQbnE2/KJT2uNH/pD9/sKhqj7VVcwfgSmjowb5FUUZY6AT5DppLa+tFlbYqAaiqO8JFlytTU85tlTRmlkDror+/4EHqVVJSJZ18oYs4/w=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:41.167186 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9164b182-1a97-4aa9-a8a9-39d5ddeca217 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Getting quotas for project 276c5f283b1f4c2896b55667156c6f21. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:15:41.173453 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9164b182-1a97-4aa9-a8a9-39d5ddeca217 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Getting quotas for user 5bf6b7d7d5954879be98b36b607daf0d and project 276c5f283b1f4c2896b55667156c6f21. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:15:41.207094 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9164b182-1a97-4aa9-a8a9-39d5ddeca217 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.071536 Jul 31 01:15:41.212242 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 990/1997] 10.222.0.45 () {62 vars in 1200 bytes} [Sun Jul 31 01:15:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 31 01:15:41.448332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-80e3c50c-97a9-4dc9-a14c-ed6f76ff7027 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1081681257", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:41.533763 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-80e3c50c-97a9-4dc9-a14c-ed6f76ff7027 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] validate_networks() for None {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:15:41.937147 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-80e3c50c-97a9-4dc9-a14c-ed6f76ff7027 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:15:41.938122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-80e3c50c-97a9-4dc9-a14c-ed6f76ff7027 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:15:41.938853 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-80e3c50c-97a9-4dc9-a14c-ed6f76ff7027 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:15:41.939533 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-80e3c50c-97a9-4dc9-a14c-ed6f76ff7027 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:15:41.940166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-80e3c50c-97a9-4dc9-a14c-ed6f76ff7027 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:15:41.957279 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80e3c50c-97a9-4dc9-a14c-ed6f76ff7027 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:41.961243 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80e3c50c-97a9-4dc9-a14c-ed6f76ff7027 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:41.962995 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80e3c50c-97a9-4dc9-a14c-ed6f76ff7027 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:41.966814 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80e3c50c-97a9-4dc9-a14c-ed6f76ff7027 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:42.007149 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-80e3c50c-97a9-4dc9-a14c-ed6f76ff7027 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Getting quotas for project 1f193d444cb7454e8181677060a126c5. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:15:42.022457 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-80e3c50c-97a9-4dc9-a14c-ed6f76ff7027 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Getting quotas for user 9fced56492d64f4983157a0e5d7b1121 and project 1f193d444cb7454e8181677060a126c5. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:15:42.053692 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-80e3c50c-97a9-4dc9-a14c-ed6f76ff7027 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:15:42.056533 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-80e3c50c-97a9-4dc9-a14c-ed6f76ff7027 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:15:42.117160 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-80e3c50c-97a9-4dc9-a14c-ed6f76ff7027 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.903152 Jul 31 01:15:42.119797 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 991/1998] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:15:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:15:42.128226 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f5119622-de6d-4020-8a7f-f78e732b5b61 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:42.129126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f5119622-de6d-4020-8a7f-f78e732b5b61 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 16fea13f-be07-4445-a8bc-a890b2ff8429] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:42.140125 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5119622-de6d-4020-8a7f-f78e732b5b61 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:42.140931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5119622-de6d-4020-8a7f-f78e732b5b61 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:42.142503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5119622-de6d-4020-8a7f-f78e732b5b61 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:42.143145 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5119622-de6d-4020-8a7f-f78e732b5b61 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:42.181266 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-f5119622-de6d-4020-8a7f-f78e732b5b61 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] HTTP exception thrown: Instance 16fea13f-be07-4445-a8bc-a890b2ff8429 could not be found. Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f5119622-de6d-4020-8a7f-f78e732b5b61 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Request method failure captured: Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 HTTP/1.1 Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5daZNzbVSRW_MAKMkrOAUUJIeGOi9uDUAoYvS0M7DAhBkdjeL_fmKLhMe2lVjGjEo1zF9tidtGcEORmw2CopMgy4S7BM-2ndIKS-4pmm3qBpWc0rC9OSGiFYwBerHUlvunP3Zg_ptMe0QNZytwKkR_27JMh9lTzzkZBoROoqi3pQMxY Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fb526f587384fdea1a06d8b3b685dcf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesTestJSON-161885913 Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f4352f9b8762490e9187e28e8c9cd58e Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 16fea13f-be07-4445-a8bc-a890b2ff8429 could not be found. Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '16fea13f-be07-4445-a8bc-a890b2ff8429'} Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16fea13f-be07-4445-a8bc-a890b2ff8429 could not be found. Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16fea13f-be07-4445-a8bc-a890b2ff8429 could not be found. Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.185398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:42.190766 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:42.190766 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:42.190766 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:42.190766 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:42.190766 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16fea13f-be07-4445-a8bc-a890b2ff8429 could not be found. Jul 31 01:15:42.190766 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.191661 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f5119622-de6d-4020-8a7f-f78e732b5b61 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Returning 404 to user: Instance 16fea13f-be07-4445-a8bc-a890b2ff8429 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:42.193785 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f5119622-de6d-4020-8a7f-f78e732b5b61 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429" status: 404 len: 111 microversion: 2.1 time: 0.071281 Jul 31 01:15:42.194961 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 992/1999] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:42 2022] GET /compute/v2.1/servers/16fea13f-be07-4445-a8bc-a890b2ff8429 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:42.202224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-33de4c76-ed28-45f0-bdb8-64c590dce40d req-4dfcd7d4-9ec3-46d1-9641-a5902a7c9f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa8017d-089a-4459-8d0d-4f746b868eda", "name": "network-vif-plugged", "status": "completed", "tag": "36fee2cc-f1b4-454c-9903-f979a420d46e"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:42.221732 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-33de4c76-ed28-45f0-bdb8-64c590dce40d req-4dfcd7d4-9ec3-46d1-9641-a5902a7c9f0a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:42.222664 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-33de4c76-ed28-45f0-bdb8-64c590dce40d req-4dfcd7d4-9ec3-46d1-9641-a5902a7c9f0a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:42.237916 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-33de4c76-ed28-45f0-bdb8-64c590dce40d req-4dfcd7d4-9ec3-46d1-9641-a5902a7c9f0a service nova] Creating event network-vif-plugged:36fee2cc-f1b4-454c-9903-f979a420d46e for instance 3fa8017d-089a-4459-8d0d-4f746b868eda on n-h2-master-1 Jul 31 01:15:42.246407 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-33de4c76-ed28-45f0-bdb8-64c590dce40d req-4dfcd7d4-9ec3-46d1-9641-a5902a7c9f0a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049814 Jul 31 01:15:42.247281 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 993/2000] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:42.258242 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4c07c201-a0ca-41d7-b2eb-af8040ba6ef9 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:42.260766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4c07c201-a0ca-41d7-b2eb-af8040ba6ef9 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:42.270442 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c07c201-a0ca-41d7-b2eb-af8040ba6ef9 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:42.271315 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c07c201-a0ca-41d7-b2eb-af8040ba6ef9 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:42.272779 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c07c201-a0ca-41d7-b2eb-af8040ba6ef9 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:42.273414 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c07c201-a0ca-41d7-b2eb-af8040ba6ef9 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:42.683858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-6a35098f-a797-4c90-a4ae-206b2240d0a5 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Updating instance_info_cache with network_info: [{"id": "d19472c9-6b7c-4f7b-a72a-118ac2c23928", "address": "fa:16:3e:3e:21:cf", "network": {"id": "22ab67a7-03cf-45dc-b776-a9640b3e7972", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1239883627-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f130aa9ed7364d0aad29cab48e63f0be", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd19472c9-6b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119475) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 31 01:15:42.729631 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a35098f-a797-4c90-a4ae-206b2240d0a5 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Releasing lock "refresh_cache-9b1a43c9-7310-4068-9b24-7ceb7c935553" {{(pid=119475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 01:15:42.731888 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6a35098f-a797-4c90-a4ae-206b2240d0a5 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "POST /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553/action" status: 202 len: 0 microversion: 2.1 time: 5.707224 Jul 31 01:15:42.733382 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1008/2001] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:15:37 2022] POST /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553/action => generated 0 bytes in 5710 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 31 01:15:42.742305 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4c07c201-a0ca-41d7-b2eb-af8040ba6ef9 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:42.768706 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4c07c201-a0ca-41d7-b2eb-af8040ba6ef9 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda" status: 200 len: 1317 microversion: 2.1 time: 0.517059 Jul 31 01:15:42.771017 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 994/2002] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:42 2022] GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda => generated 1317 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:42.776174 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ffa2429-4ced-40f0-80da-a7796a6cf36e tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:42.776852 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4ffa2429-4ced-40f0-80da-a7796a6cf36e tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] [instance: 88d862c0-3b17-44a3-a405-9c28427a3db7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:42.791501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ffa2429-4ced-40f0-80da-a7796a6cf36e tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:42.792292 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ffa2429-4ced-40f0-80da-a7796a6cf36e tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:42.792864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a2744106-5211-4a8b-b808-47342b84108d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:42.793482 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a2744106-5211-4a8b-b808-47342b84108d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 502a7c35-a8fe-4ace-85d5-bb115f8423fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:42.794194 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ffa2429-4ced-40f0-80da-a7796a6cf36e tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:42.794996 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ffa2429-4ced-40f0-80da-a7796a6cf36e tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:42.814273 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a2744106-5211-4a8b-b808-47342b84108d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:42.815378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a2744106-5211-4a8b-b808-47342b84108d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:42.816373 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a2744106-5211-4a8b-b808-47342b84108d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:42.819241 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a2744106-5211-4a8b-b808-47342b84108d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:42.825449 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-4ffa2429-4ced-40f0-80da-a7796a6cf36e tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] HTTP exception thrown: Instance 88d862c0-3b17-44a3-a405-9c28427a3db7 could not be found. Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ffa2429-4ced-40f0-80da-a7796a6cf36e tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Request method failure captured: Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7 HTTP/1.1 Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5deCLRs9mXQ8my_G1blnERYolVsIUugxfOO_V8uTXDuRegMTxbfzcvhMc4PG-ZpMktjAa64n6IahzAb_ciTg3zM1A11Jb98LZW6CR8EImDW47Cnrw-R7IbVZH5DRfgpIP46Jm6K4jOBn4G-B9d-LYcNApKC98wQmMDDwvshB7h95Y8o Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.26 Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 66c464605fa24a06a3d4e6107513a823 Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerTagsTestJSON-602045312 Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/66c464605fa24a06a3d4e6107513a823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/66c464605fa24a06a3d4e6107513a823"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/66c464605fa24a06a3d4e6107513a823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_66c464605fa24a06a3d4e6107513a823", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerTagsTestJSON-602045312 Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 66c464605fa24a06a3d4e6107513a823 Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerTagsTestJSON-602045312 Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerTagsTestJSON-602045312-project Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 3657778c56d245c1b1c2081631cd4598 Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerTagsTestJSON-602045312-project Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 88d862c0-3b17-44a3-a405-9c28427a3db7 could not be found. Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '88d862c0-3b17-44a3-a405-9c28427a3db7'} Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d862c0-3b17-44a3-a405-9c28427a3db7 could not be found. Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d862c0-3b17-44a3-a405-9c28427a3db7 could not be found. Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:42.827307 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.832558 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:42.832558 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:42.832558 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:42.832558 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:42.832558 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:42.832558 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d862c0-3b17-44a3-a405-9c28427a3db7 could not be found. Jul 31 01:15:42.832558 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.832558 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ffa2429-4ced-40f0-80da-a7796a6cf36e tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] Returning 404 to user: Instance 88d862c0-3b17-44a3-a405-9c28427a3db7 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:42.832558 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4ffa2429-4ced-40f0-80da-a7796a6cf36e tempest-ServerTagsTestJSON-602045312 tempest-ServerTagsTestJSON-602045312-project] 10.222.0.45 "GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7" status: 404 len: 111 microversion: 2.26 time: 0.077000 Jul 31 01:15:42.847265 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1009/2003] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:15:42 2022] GET /compute/v2.1/servers/88d862c0-3b17-44a3-a405-9c28427a3db7 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:15:42.853292 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c25d4d50-1bd5-4885-82da-c16a16ecc202 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:42.854219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c25d4d50-1bd5-4885-82da-c16a16ecc202 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:42.860795 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-a2744106-5211-4a8b-b808-47342b84108d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] HTTP exception thrown: Instance 502a7c35-a8fe-4ace-85d5-bb115f8423fa could not be found. Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a2744106-5211-4a8b-b808-47342b84108d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Request method failure captured: Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa HTTP/1.1 Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXEdSf0Gkqz-Q7EyzIARSzM1tpRTtdOPLVJpa2J_qG7mZevk6GyQhnm9QLedAKtTu6Y06b5WxqinOItA2pGoZRCBBMwYR0jYDk4R4zDfsetamH29xYHuyQ3EGk7WdvpJWGrmcKm3KNA09Pf_mn_e4YVu9YdikywxuH5yA8qcL45MZ0 Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 5d8b0e81765c48039a523271670896d2 Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-LiveMigrationTest-1058922785 Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5d8b0e81765c48039a523271670896d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5d8b0e81765c48039a523271670896d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5d8b0e81765c48039a523271670896d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5d8b0e81765c48039a523271670896d2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-LiveMigrationTest-1058922785 Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 5d8b0e81765c48039a523271670896d2 Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-LiveMigrationTest-1058922785 Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-LiveMigrationTest-1058922785-project Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 457bd8590d5040ef95854808b51c04d3 Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-LiveMigrationTest-1058922785-project Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 502a7c35-a8fe-4ace-85d5-bb115f8423fa could not be found. Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '502a7c35-a8fe-4ace-85d5-bb115f8423fa'} Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 502a7c35-a8fe-4ace-85d5-bb115f8423fa could not be found. Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 502a7c35-a8fe-4ace-85d5-bb115f8423fa could not be found. Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:42.863099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.868481 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:42.868481 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:42.868481 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:42.868481 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:42.868481 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:42.868481 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 502a7c35-a8fe-4ace-85d5-bb115f8423fa could not be found. Jul 31 01:15:42.868481 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.868481 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a2744106-5211-4a8b-b808-47342b84108d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Returning 404 to user: Instance 502a7c35-a8fe-4ace-85d5-bb115f8423fa could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:42.868481 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a2744106-5211-4a8b-b808-47342b84108d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa" status: 404 len: 111 microversion: 2.1 time: 0.090708 Jul 31 01:15:42.870247 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 995/2004] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:42 2022] GET /compute/v2.1/servers/502a7c35-a8fe-4ace-85d5-bb115f8423fa => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:42.884442 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cec45fb9-7af3-4791-850b-8538aea2f401 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedea829d30>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:42.914276 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-cec45fb9-7af3-4791-850b-8538aea2f401 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] HTTP exception thrown: Image not found. Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cec45fb9-7af3-4791-850b-8538aea2f401 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Request method failure captured: Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 HTTP/1.1 Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5daZNzbVSRW_MAKMkrOAUUJIeGOi9uDUAoYvS0M7DAhBkdjeL_fmKLhMe2lVjGjEo1zF9tidtGcEORmw2CopMgy4S7BM-2ndIKS-4pmm3qBpWc0rC9OSGiFYwBerHUlvunP3Zg_ptMe0QNZytwKkR_27JMh9lTzzkZBoROoqi3pQMxY Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fb526f587384fdea1a06d8b3b685dcf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesTestJSON-161885913 Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f4352f9b8762490e9187e28e8c9cd58e Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: exception: Image not found. Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '3f79ab0a-353b-47b7-941f-1fce78686e78'} Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3f79ab0a-353b-47b7-941f-1fce78686e78 to delete Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3f79ab0a-353b-47b7-941f-1fce78686e78 could not be found. Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.916948 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:42.923208 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cec45fb9-7af3-4791-850b-8538aea2f401 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Returning 404 to user: Image not found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:42.927691 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cec45fb9-7af3-4791-850b-8538aea2f401 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "DELETE /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78" status: 404 len: 62 microversion: 2.1 time: 0.049773 Jul 31 01:15:42.940651 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 996/2005] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:42 2022] DELETE /compute/v2.1/images/3f79ab0a-353b-47b7-941f-1fce78686e78 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:15:42.949004 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-deba2530-9d90-44b8-9c40-687a64723e79 req-ce9572a2-00b5-4d07-bd9d-85ad99af52ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502a7c35-a8fe-4ace-85d5-bb115f8423fa", "name": "network-vif-deleted", "tag": "c430395e-d6b3-4f00-927f-f84a47151b4c"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:42.984751 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-deba2530-9d90-44b8-9c40-687a64723e79 req-ce9572a2-00b5-4d07-bd9d-85ad99af52ac service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:42.985208 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-deba2530-9d90-44b8-9c40-687a64723e79 req-ce9572a2-00b5-4d07-bd9d-85ad99af52ac service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:43.007856 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c25d4d50-1bd5-4885-82da-c16a16ecc202 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:43.009526 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-deba2530-9d90-44b8-9c40-687a64723e79 req-ce9572a2-00b5-4d07-bd9d-85ad99af52ac service nova] Creating event network-vif-deleted:c430395e-d6b3-4f00-927f-f84a47151b4c for instance 502a7c35-a8fe-4ace-85d5-bb115f8423fa on n-h2-master-1 Jul 31 01:15:43.021467 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c25d4d50-1bd5-4885-82da-c16a16ecc202 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1219 microversion: 2.1 time: 0.172472 Jul 31 01:15:43.024011 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1010/2006] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:42 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1219 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:43.037258 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-deba2530-9d90-44b8-9c40-687a64723e79 req-ce9572a2-00b5-4d07-bd9d-85ad99af52ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082039 Jul 31 01:15:43.037258 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 997/2007] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:43.042389 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-491dbe4b-2548-41c7-883e-a18573ea4e80 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '.version_select at 0x7fede4f5a1f0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:43.050551 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f987c3de-6db3-4bea-bd80-c458c9f6417b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '.version_select at 0x7fede51d3ca0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:43.087881 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f987c3de-6db3-4bea-bd80-c458c9f6417b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1150729010" status: 202 len: 0 microversion: 2.1 time: 0.045556 Jul 31 01:15:43.088978 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1011/2008] 10.222.0.45 () {58 vars in 1221 bytes} [Sun Jul 31 01:15:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1150729010 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:15:43.096865 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6e93d1a4-adf6-4477-b4db-0a2ef6b9fdbf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:43.097703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6e93d1a4-adf6-4477-b4db-0a2ef6b9fdbf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:43.108091 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e93d1a4-adf6-4477-b4db-0a2ef6b9fdbf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:43.109007 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e93d1a4-adf6-4477-b4db-0a2ef6b9fdbf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:43.110916 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e93d1a4-adf6-4477-b4db-0a2ef6b9fdbf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:43.111673 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e93d1a4-adf6-4477-b4db-0a2ef6b9fdbf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:43.138617 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-6e93d1a4-adf6-4477-b4db-0a2ef6b9fdbf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] HTTP exception thrown: Instance 0b840182-0fef-4cd6-be37-17f8a4f0025d could not be found. Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6e93d1a4-adf6-4477-b4db-0a2ef6b9fdbf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Request method failure captured: Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d HTTP/1.1 Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5daZNzbVSRW_MAKMkrOAUUJIeGOi9uDUAoYvS0M7DAhBkdjeL_fmKLhMe2lVjGjEo1zF9tidtGcEORmw2CopMgy4S7BM-2ndIKS-4pmm3qBpWc0rC9OSGiFYwBerHUlvunP3Zg_ptMe0QNZytwKkR_27JMh9lTzzkZBoROoqi3pQMxY Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fb526f587384fdea1a06d8b3b685dcf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f4352f9b8762490e9187e28e8c9cd58e Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 0b840182-0fef-4cd6-be37-17f8a4f0025d could not be found. Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '0b840182-0fef-4cd6-be37-17f8a4f0025d'} Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b840182-0fef-4cd6-be37-17f8a4f0025d could not be found. Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:43.140959 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b840182-0fef-4cd6-be37-17f8a4f0025d could not be found. Jul 31 01:15:43.145657 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.145657 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.145657 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.145657 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.145657 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:43.145657 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:43.145657 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:43.145657 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:43.145657 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b840182-0fef-4cd6-be37-17f8a4f0025d could not be found. Jul 31 01:15:43.145657 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.148434 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6e93d1a4-adf6-4477-b4db-0a2ef6b9fdbf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Returning 404 to user: Instance 0b840182-0fef-4cd6-be37-17f8a4f0025d could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:43.150296 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6e93d1a4-adf6-4477-b4db-0a2ef6b9fdbf tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d" status: 404 len: 111 microversion: 2.1 time: 0.059225 Jul 31 01:15:43.153795 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1012/2009] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:15:43 2022] DELETE /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:43.164368 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-01433d98-8497-4f55-87a0-35f1bc64b8a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:43.166388 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-01433d98-8497-4f55-87a0-35f1bc64b8a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 0b840182-0fef-4cd6-be37-17f8a4f0025d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:43.174909 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01433d98-8497-4f55-87a0-35f1bc64b8a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:43.175616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01433d98-8497-4f55-87a0-35f1bc64b8a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:43.176634 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01433d98-8497-4f55-87a0-35f1bc64b8a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:43.177255 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01433d98-8497-4f55-87a0-35f1bc64b8a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:43.246340 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-01433d98-8497-4f55-87a0-35f1bc64b8a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] HTTP exception thrown: Instance 0b840182-0fef-4cd6-be37-17f8a4f0025d could not be found. Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-01433d98-8497-4f55-87a0-35f1bc64b8a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Request method failure captured: Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d HTTP/1.1 Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5daZNzbVSRW_MAKMkrOAUUJIeGOi9uDUAoYvS0M7DAhBkdjeL_fmKLhMe2lVjGjEo1zF9tidtGcEORmw2CopMgy4S7BM-2ndIKS-4pmm3qBpWc0rC9OSGiFYwBerHUlvunP3Zg_ptMe0QNZytwKkR_27JMh9lTzzkZBoROoqi3pQMxY Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fb526f587384fdea1a06d8b3b685dcf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f4352f9b8762490e9187e28e8c9cd58e Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 0b840182-0fef-4cd6-be37-17f8a4f0025d could not be found. Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '0b840182-0fef-4cd6-be37-17f8a4f0025d'} Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b840182-0fef-4cd6-be37-17f8a4f0025d could not be found. Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b840182-0fef-4cd6-be37-17f8a4f0025d could not be found. Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.249941 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.255258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:43.255258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:43.255258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:43.255258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:43.255258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b840182-0fef-4cd6-be37-17f8a4f0025d could not be found. Jul 31 01:15:43.255258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.255258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-01433d98-8497-4f55-87a0-35f1bc64b8a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Returning 404 to user: Instance 0b840182-0fef-4cd6-be37-17f8a4f0025d could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:43.255258 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-01433d98-8497-4f55-87a0-35f1bc64b8a3 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d" status: 404 len: 111 microversion: 2.1 time: 0.096431 Jul 31 01:15:43.255258 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1013/2010] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:43 2022] GET /compute/v2.1/servers/0b840182-0fef-4cd6-be37-17f8a4f0025d => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:43.268500 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-43fafae4-9615-4817-8ec4-cb9fb5002532 req-2227198b-11cc-4cf7-b1cc-c7b38c6b76f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d862c0-3b17-44a3-a405-9c28427a3db7", "name": "network-vif-deleted", "tag": "f9cdca3b-8174-4f00-84be-54b07393ab04"}, {"name": "network-changed", "server_uuid": "9b1a43c9-7310-4068-9b24-7ceb7c935553", "tag": "d19472c9-6b7c-4f7b-a72a-118ac2c23928"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:43.287523 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-43fafae4-9615-4817-8ec4-cb9fb5002532 req-2227198b-11cc-4cf7-b1cc-c7b38c6b76f0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:43.287985 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-43fafae4-9615-4817-8ec4-cb9fb5002532 req-2227198b-11cc-4cf7-b1cc-c7b38c6b76f0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:43.304271 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-43fafae4-9615-4817-8ec4-cb9fb5002532 req-2227198b-11cc-4cf7-b1cc-c7b38c6b76f0 service nova] Creating event network-vif-deleted:f9cdca3b-8174-4f00-84be-54b07393ab04 for instance 88d862c0-3b17-44a3-a405-9c28427a3db7 on n-h2-master-1 Jul 31 01:15:43.304788 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-43fafae4-9615-4817-8ec4-cb9fb5002532 req-2227198b-11cc-4cf7-b1cc-c7b38c6b76f0 service nova] Creating event network-changed:d19472c9-6b7c-4f7b-a72a-118ac2c23928 for instance 9b1a43c9-7310-4068-9b24-7ceb7c935553 on n-h2-master-1 Jul 31 01:15:43.312952 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-43fafae4-9615-4817-8ec4-cb9fb5002532 req-2227198b-11cc-4cf7-b1cc-c7b38c6b76f0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058076 Jul 31 01:15:43.314498 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1014/2011] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:43.321892 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7c98e12e-4919-478b-b7d0-2fb02292ee19 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa07790>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:43.370457 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-7c98e12e-4919-478b-b7d0-2fb02292ee19 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] HTTP exception thrown: Image not found. Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7c98e12e-4919-478b-b7d0-2fb02292ee19 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Request method failure captured: Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b HTTP/1.1 Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5daZNzbVSRW_MAKMkrOAUUJIeGOi9uDUAoYvS0M7DAhBkdjeL_fmKLhMe2lVjGjEo1zF9tidtGcEORmw2CopMgy4S7BM-2ndIKS-4pmm3qBpWc0rC9OSGiFYwBerHUlvunP3Zg_ptMe0QNZytwKkR_27JMh9lTzzkZBoROoqi3pQMxY Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fb526f587384fdea1a06d8b3b685dcf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f4352f9b8762490e9187e28e8c9cd58e Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: exception: Image not found. Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '898bf9d3-eb05-4e98-b188-fc613700a38b'} Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 898bf9d3-eb05-4e98-b188-fc613700a38b to delete Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 898bf9d3-eb05-4e98-b188-fc613700a38b could not be found. Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.373165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:15:43.378707 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.381892 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7c98e12e-4919-478b-b7d0-2fb02292ee19 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Returning 404 to user: Image not found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:43.383181 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7c98e12e-4919-478b-b7d0-2fb02292ee19 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "DELETE /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b" status: 404 len: 62 microversion: 2.1 time: 0.067160 Jul 31 01:15:43.386224 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1015/2012] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:43 2022] DELETE /compute/v2.1/images/898bf9d3-eb05-4e98-b188-fc613700a38b => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:15:43.397090 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-059bbe18-a19c-4b30-93f2-4dc0c7406953 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:43.398699 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-059bbe18-a19c-4b30-93f2-4dc0c7406953 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:43.406454 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-059bbe18-a19c-4b30-93f2-4dc0c7406953 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:43.407305 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-059bbe18-a19c-4b30-93f2-4dc0c7406953 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:43.408382 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-059bbe18-a19c-4b30-93f2-4dc0c7406953 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:43.409054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-059bbe18-a19c-4b30-93f2-4dc0c7406953 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:43.428211 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-059bbe18-a19c-4b30-93f2-4dc0c7406953 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] HTTP exception thrown: Instance 37302988-1cb9-4dca-a5a5-93ff2a30316b could not be found. Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-059bbe18-a19c-4b30-93f2-4dc0c7406953 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Request method failure captured: Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b HTTP/1.1 Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5daZNzbVSRW_MAKMkrOAUUJIeGOi9uDUAoYvS0M7DAhBkdjeL_fmKLhMe2lVjGjEo1zF9tidtGcEORmw2CopMgy4S7BM-2ndIKS-4pmm3qBpWc0rC9OSGiFYwBerHUlvunP3Zg_ptMe0QNZytwKkR_27JMh9lTzzkZBoROoqi3pQMxY Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fb526f587384fdea1a06d8b3b685dcf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f4352f9b8762490e9187e28e8c9cd58e Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 37302988-1cb9-4dca-a5a5-93ff2a30316b could not be found. Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '37302988-1cb9-4dca-a5a5-93ff2a30316b'} Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37302988-1cb9-4dca-a5a5-93ff2a30316b could not be found. Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:43.436269 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37302988-1cb9-4dca-a5a5-93ff2a30316b could not be found. Jul 31 01:15:43.440900 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.440900 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.440900 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.440900 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.440900 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:43.440900 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:43.440900 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:43.440900 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:43.440900 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37302988-1cb9-4dca-a5a5-93ff2a30316b could not be found. Jul 31 01:15:43.440900 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.443777 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-059bbe18-a19c-4b30-93f2-4dc0c7406953 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Returning 404 to user: Instance 37302988-1cb9-4dca-a5a5-93ff2a30316b could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:43.445021 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-059bbe18-a19c-4b30-93f2-4dc0c7406953 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "DELETE /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 404 len: 111 microversion: 2.1 time: 0.054844 Jul 31 01:15:43.446806 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1016/2013] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:15:43 2022] DELETE /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:15:43.455554 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1be0bc8b-da2f-4e58-b7b6-a91fd9f76f33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:43.457129 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1be0bc8b-da2f-4e58-b7b6-a91fd9f76f33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 37302988-1cb9-4dca-a5a5-93ff2a30316b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:43.478000 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1be0bc8b-da2f-4e58-b7b6-a91fd9f76f33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:43.478919 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1be0bc8b-da2f-4e58-b7b6-a91fd9f76f33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:43.480034 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1be0bc8b-da2f-4e58-b7b6-a91fd9f76f33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:43.480712 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1be0bc8b-da2f-4e58-b7b6-a91fd9f76f33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:43.501983 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-1be0bc8b-da2f-4e58-b7b6-a91fd9f76f33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] HTTP exception thrown: Instance 37302988-1cb9-4dca-a5a5-93ff2a30316b could not be found. Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1be0bc8b-da2f-4e58-b7b6-a91fd9f76f33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Request method failure captured: Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b HTTP/1.1 Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5daZNzbVSRW_MAKMkrOAUUJIeGOi9uDUAoYvS0M7DAhBkdjeL_fmKLhMe2lVjGjEo1zF9tidtGcEORmw2CopMgy4S7BM-2ndIKS-4pmm3qBpWc0rC9OSGiFYwBerHUlvunP3Zg_ptMe0QNZytwKkR_27JMh9lTzzkZBoROoqi3pQMxY Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fb526f587384fdea1a06d8b3b685dcf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f4352f9b8762490e9187e28e8c9cd58e Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 37302988-1cb9-4dca-a5a5-93ff2a30316b could not be found. Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '37302988-1cb9-4dca-a5a5-93ff2a30316b'} Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37302988-1cb9-4dca-a5a5-93ff2a30316b could not be found. Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37302988-1cb9-4dca-a5a5-93ff2a30316b could not be found. Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.505033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.509771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:43.509771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:43.509771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:43.509771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:43.509771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37302988-1cb9-4dca-a5a5-93ff2a30316b could not be found. Jul 31 01:15:43.509771 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.511880 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1be0bc8b-da2f-4e58-b7b6-a91fd9f76f33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Returning 404 to user: Instance 37302988-1cb9-4dca-a5a5-93ff2a30316b could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:43.513757 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1be0bc8b-da2f-4e58-b7b6-a91fd9f76f33 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b" status: 404 len: 111 microversion: 2.1 time: 0.062606 Jul 31 01:15:43.515785 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1017/2014] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:43 2022] GET /compute/v2.1/servers/37302988-1cb9-4dca-a5a5-93ff2a30316b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:43.528043 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c3e0987c-05df-4745-aab0-6591a76dd495 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '.version_select at 0x7fedeaa69a60>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:43.567647 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-c3e0987c-05df-4745-aab0-6591a76dd495 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] HTTP exception thrown: Image not found. Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c3e0987c-05df-4745-aab0-6591a76dd495 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Request method failure captured: Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 HTTP/1.1 Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5daZNzbVSRW_MAKMkrOAUUJIeGOi9uDUAoYvS0M7DAhBkdjeL_fmKLhMe2lVjGjEo1zF9tidtGcEORmw2CopMgy4S7BM-2ndIKS-4pmm3qBpWc0rC9OSGiFYwBerHUlvunP3Zg_ptMe0QNZytwKkR_27JMh9lTzzkZBoROoqi3pQMxY Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fb526f587384fdea1a06d8b3b685dcf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f4352f9b8762490e9187e28e8c9cd58e Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: exception: Image not found. Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'd8734fe7-3461-4d6c-9dfe-0f873d24c106'} Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d8734fe7-3461-4d6c-9dfe-0f873d24c106 to delete Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d8734fe7-3461-4d6c-9dfe-0f873d24c106 could not be found. Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.571010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.583381 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c3e0987c-05df-4745-aab0-6591a76dd495 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Returning 404 to user: Image not found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:43.587442 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c3e0987c-05df-4745-aab0-6591a76dd495 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "DELETE /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106" status: 404 len: 62 microversion: 2.1 time: 0.062687 Jul 31 01:15:43.587442 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1018/2015] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:43 2022] DELETE /compute/v2.1/images/d8734fe7-3461-4d6c-9dfe-0f873d24c106 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 31 01:15:43.601372 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-528b9c5e-7fa6-4af4-bf92-176b6d4cafd2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:43.603862 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-528b9c5e-7fa6-4af4-bf92-176b6d4cafd2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:43.640469 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-528b9c5e-7fa6-4af4-bf92-176b6d4cafd2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:43.641874 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-528b9c5e-7fa6-4af4-bf92-176b6d4cafd2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:43.643330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-528b9c5e-7fa6-4af4-bf92-176b6d4cafd2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:43.645862 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-528b9c5e-7fa6-4af4-bf92-176b6d4cafd2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:43.687807 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-528b9c5e-7fa6-4af4-bf92-176b6d4cafd2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] HTTP exception thrown: Instance 59f16639-427f-42f0-abe2-19c1106f59e3 could not be found. Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-528b9c5e-7fa6-4af4-bf92-176b6d4cafd2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Request method failure captured: Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 HTTP/1.1 Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5daZNzbVSRW_MAKMkrOAUUJIeGOi9uDUAoYvS0M7DAhBkdjeL_fmKLhMe2lVjGjEo1zF9tidtGcEORmw2CopMgy4S7BM-2ndIKS-4pmm3qBpWc0rC9OSGiFYwBerHUlvunP3Zg_ptMe0QNZytwKkR_27JMh9lTzzkZBoROoqi3pQMxY Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fb526f587384fdea1a06d8b3b685dcf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f4352f9b8762490e9187e28e8c9cd58e Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 59f16639-427f-42f0-abe2-19c1106f59e3 could not be found. Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '59f16639-427f-42f0-abe2-19c1106f59e3'} Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59f16639-427f-42f0-abe2-19c1106f59e3 could not be found. Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:43.690507 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59f16639-427f-42f0-abe2-19c1106f59e3 could not be found. Jul 31 01:15:43.696650 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.696650 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.696650 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.696650 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.696650 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:43.696650 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:43.696650 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:43.696650 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:43.696650 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59f16639-427f-42f0-abe2-19c1106f59e3 could not be found. Jul 31 01:15:43.696650 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.696650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-528b9c5e-7fa6-4af4-bf92-176b6d4cafd2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Returning 404 to user: Instance 59f16639-427f-42f0-abe2-19c1106f59e3 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:43.696650 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-528b9c5e-7fa6-4af4-bf92-176b6d4cafd2 tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "DELETE /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 404 len: 111 microversion: 2.1 time: 0.098803 Jul 31 01:15:43.696650 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1019/2016] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:15:43 2022] DELETE /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:43.703795 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c64caa5a-8a04-45a4-aa54-9abda3460b0c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:43.704941 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c64caa5a-8a04-45a4-aa54-9abda3460b0c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] [instance: 59f16639-427f-42f0-abe2-19c1106f59e3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:43.724302 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c64caa5a-8a04-45a4-aa54-9abda3460b0c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:43.725555 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c64caa5a-8a04-45a4-aa54-9abda3460b0c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:43.726619 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c64caa5a-8a04-45a4-aa54-9abda3460b0c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:43.727916 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c64caa5a-8a04-45a4-aa54-9abda3460b0c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:43.767165 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-c64caa5a-8a04-45a4-aa54-9abda3460b0c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] HTTP exception thrown: Instance 59f16639-427f-42f0-abe2-19c1106f59e3 could not be found. Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c64caa5a-8a04-45a4-aa54-9abda3460b0c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Request method failure captured: Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 HTTP/1.1 Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5daZNzbVSRW_MAKMkrOAUUJIeGOi9uDUAoYvS0M7DAhBkdjeL_fmKLhMe2lVjGjEo1zF9tidtGcEORmw2CopMgy4S7BM-2ndIKS-4pmm3qBpWc0rC9OSGiFYwBerHUlvunP3Zg_ptMe0QNZytwKkR_27JMh9lTzzkZBoROoqi3pQMxY Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3fb526f587384fdea1a06d8b3b685dcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3fb526f587384fdea1a06d8b3b685dcf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 3fb526f587384fdea1a06d8b3b685dcf Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesTestJSON-161885913 Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f4352f9b8762490e9187e28e8c9cd58e Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesTestJSON-161885913-project Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 59f16639-427f-42f0-abe2-19c1106f59e3 could not be found. Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '59f16639-427f-42f0-abe2-19c1106f59e3'} Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59f16639-427f-42f0-abe2-19c1106f59e3 could not be found. Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59f16639-427f-42f0-abe2-19c1106f59e3 could not be found. Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.770171 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:43.776010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:43.776010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:43.776010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:43.776010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:43.776010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59f16639-427f-42f0-abe2-19c1106f59e3 could not be found. Jul 31 01:15:43.776010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:15:43.795867 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c64caa5a-8a04-45a4-aa54-9abda3460b0c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] Returning 404 to user: Instance 59f16639-427f-42f0-abe2-19c1106f59e3 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:43.797518 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c64caa5a-8a04-45a4-aa54-9abda3460b0c tempest-ImagesTestJSON-161885913 tempest-ImagesTestJSON-161885913-project] 10.222.0.45 "GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3" status: 404 len: 111 microversion: 2.1 time: 0.098016 Jul 31 01:15:43.803500 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1020/2017] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:43 2022] GET /compute/v2.1/servers/59f16639-427f-42f0-abe2-19c1106f59e3 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:43.821057 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d57cec91-679b-444d-80d3-8c602e11fabc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:43.822843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d57cec91-679b-444d-80d3-8c602e11fabc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:43.847502 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d57cec91-679b-444d-80d3-8c602e11fabc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:43.848243 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d57cec91-679b-444d-80d3-8c602e11fabc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:43.849303 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d57cec91-679b-444d-80d3-8c602e11fabc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:43.850779 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d57cec91-679b-444d-80d3-8c602e11fabc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:44.493974 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d57cec91-679b-444d-80d3-8c602e11fabc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:44.502099 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d57cec91-679b-444d-80d3-8c602e11fabc tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda" status: 200 len: 1317 microversion: 2.1 time: 0.694120 Jul 31 01:15:44.502686 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1021/2018] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:43 2022] GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda => generated 1317 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:44.508106 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d4614522-1cb4-4902-afed-a613883794e8 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:44.509358 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d4614522-1cb4-4902-afed-a613883794e8 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:44.517446 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4614522-1cb4-4902-afed-a613883794e8 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:44.518947 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4614522-1cb4-4902-afed-a613883794e8 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:44.519941 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4614522-1cb4-4902-afed-a613883794e8 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:44.520417 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4614522-1cb4-4902-afed-a613883794e8 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:45.024909 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d4614522-1cb4-4902-afed-a613883794e8 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:45.033370 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d4614522-1cb4-4902-afed-a613883794e8 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1277 microversion: 2.1 time: 0.529322 Jul 31 01:15:45.034245 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1022/2019] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:44 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1277 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:45.528618 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2e5f6872-7385-485e-8563-30045e4e2a90 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:45.531106 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2e5f6872-7385-485e-8563-30045e4e2a90 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:45.546262 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e5f6872-7385-485e-8563-30045e4e2a90 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:45.548112 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e5f6872-7385-485e-8563-30045e4e2a90 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:45.550506 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e5f6872-7385-485e-8563-30045e4e2a90 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:45.551744 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e5f6872-7385-485e-8563-30045e4e2a90 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:46.074117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2e5f6872-7385-485e-8563-30045e4e2a90 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:46.088028 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2e5f6872-7385-485e-8563-30045e4e2a90 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda" status: 200 len: 1505 microversion: 2.1 time: 0.569657 Jul 31 01:15:46.088965 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1023/2020] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:45 2022] GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda => generated 1505 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:15:46.106127 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ce0f0443-6023-4bbb-aa9f-4f3e64bd2d0c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:46.106650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ce0f0443-6023-4bbb-aa9f-4f3e64bd2d0c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:46.117684 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce0f0443-6023-4bbb-aa9f-4f3e64bd2d0c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:46.118641 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce0f0443-6023-4bbb-aa9f-4f3e64bd2d0c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:46.119454 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce0f0443-6023-4bbb-aa9f-4f3e64bd2d0c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:46.119959 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce0f0443-6023-4bbb-aa9f-4f3e64bd2d0c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:46.206700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ce0f0443-6023-4bbb-aa9f-4f3e64bd2d0c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:15:46.398323 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ce0f0443-6023-4bbb-aa9f-4f3e64bd2d0c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "DELETE /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 204 len: 0 microversion: 2.1 time: 0.308012 Jul 31 01:15:46.400793 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1024/2021] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:15:46 2022] DELETE /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:15:46.411844 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a1dde297-0150-4760-8c03-2b7a18230558 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:46.415442 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a1dde297-0150-4760-8c03-2b7a18230558 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:46.426156 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1dde297-0150-4760-8c03-2b7a18230558 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:46.427031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1dde297-0150-4760-8c03-2b7a18230558 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:46.428299 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1dde297-0150-4760-8c03-2b7a18230558 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:46.429125 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1dde297-0150-4760-8c03-2b7a18230558 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:46.724624 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a1dde297-0150-4760-8c03-2b7a18230558 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:46.733391 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a1dde297-0150-4760-8c03-2b7a18230558 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1277 microversion: 2.1 time: 0.330841 Jul 31 01:15:46.734354 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1025/2022] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:46 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1277 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:46.753937 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ce77030d-3578-4721-873f-0027c3c70480 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:46.754939 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ce77030d-3578-4721-873f-0027c3c70480 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:46.764943 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce77030d-3578-4721-873f-0027c3c70480 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:46.765858 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce77030d-3578-4721-873f-0027c3c70480 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:46.766923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce77030d-3578-4721-873f-0027c3c70480 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:46.767824 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce77030d-3578-4721-873f-0027c3c70480 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:47.030751 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ce77030d-3578-4721-873f-0027c3c70480 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:47.046271 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ce77030d-3578-4721-873f-0027c3c70480 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1484 microversion: 2.1 time: 0.297726 Jul 31 01:15:47.058010 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-491dbe4b-2548-41c7-883e-a18573ea4e80 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/0ff84e57-6cb4-4122-b517-d01d71979dd4" status: 202 len: 0 microversion: 2.1 time: 4.028025 Jul 31 01:15:47.062079 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1026/2023] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:46 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1484 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:47.063019 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 998/2024] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:15:43 2022] DELETE /compute/v2.1/os-floating-ips/0ff84e57-6cb4-4122-b517-d01d71979dd4 => generated 0 bytes in 4034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:15:47.068043 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bc631972-6d35-4223-940a-36acbef426e4 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bc631972-6d35-4223-940a-36acbef426e4 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Request method failure captured: Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553/action HTTP/1.1 Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 34 Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5deCl4ZlFEyAdTg2sbxmSvq4fnDOFPMTJ6vVwSDxMZvTCKTuHmnFSDq3PSTW5MdYOYovAZHymCPCLFHIux9TQ58cOKywQdikdlB61b6S9QW2P59ONV1RcI72itpoP6t_e2bRbY_H4ruv7LgGTxL5h9geLWP9o5xNNuRziRtTrDejUU0 Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: f130aa9ed7364d0aad29cab48e63f0be Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f130aa9ed7364d0aad29cab48e63f0be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f130aa9ed7364d0aad29cab48e63f0be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f130aa9ed7364d0aad29cab48e63f0be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f130aa9ed7364d0aad29cab48e63f0be", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: f130aa9ed7364d0aad29cab48e63f0be Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f4103d2981da44aea1ea8547f225b3b5 Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: {"addFloatingIp": {"address": ""}} Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '9b1a43c9-7310-4068-9b24-7ceb7c935553', 'body': {'addFloatingIp': {'address': ''}}} Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi '' Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:15:47.072772 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:15:47.077735 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:15:47.077735 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 31 01:15:47.077735 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.077735 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:47.077735 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.077735 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:47.077735 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:47.077735 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:47.077735 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:15:47.077735 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:15:47.077735 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 31 01:15:47.077735 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.078607 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4188d608-157b-4a82-b9e0-1a4f0870f96f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-986492920", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ee518728-1cf0-46ae-b0bb-47bce3ace0cb"}, {"port": "9d0de813-2073-4e2a-a486-6e31d72863a5", "tag": "port-1"}, {"port": "125ddd94-e67d-4f25-a9da-1073d0016a4d", "tag": "port-2"}, {"uuid": "cee32c1f-52a3-4c2a-8727-097189acdfaa", "tag": "net-1"}, {"uuid": "cee32c1f-52a3-4c2a-8727-097189acdfaa"}, {"uuid": "4b732533-91fe-432d-a6d2-08df785dbf46", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "4b732533-91fe-432d-a6d2-08df785dbf46", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0ce9a3e0-9c44-4b4c-934d-9e392555b668", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "8b496528-b515-474a-a52e-d861e8b8419d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "72915f39-03f3-49d3-9bad-3e1eac365fe0", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1084409119"}], "key_name": "tempest-keypair-194225778", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:47.080581 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bc631972-6d35-4223-940a-36acbef426e4 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:47.081682 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bc631972-6d35-4223-940a-36acbef426e4 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "POST /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553/action" status: 400 len: 142 microversion: 2.1 time: 0.017453 Jul 31 01:15:47.082470 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 999/2025] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:15:47 2022] POST /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553/action => generated 142 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:15:47.092482 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e147b8ee-3ab9-4c1a-977a-ead2d28a4486 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:47.096140 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e147b8ee-3ab9-4c1a-977a-ead2d28a4486 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:47.103757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e147b8ee-3ab9-4c1a-977a-ead2d28a4486 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:47.104869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e147b8ee-3ab9-4c1a-977a-ead2d28a4486 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:47.106207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e147b8ee-3ab9-4c1a-977a-ead2d28a4486 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:47.106926 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e147b8ee-3ab9-4c1a-977a-ead2d28a4486 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:47.138259 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e147b8ee-3ab9-4c1a-977a-ead2d28a4486 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Acquired lock "refresh_cache-9b1a43c9-7310-4068-9b24-7ceb7c935553" {{(pid=119474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 01:15:47.317217 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-4188d608-157b-4a82-b9e0-1a4f0870f96f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] validate_networks() for [('ee518728-1cf0-46ae-b0bb-47bce3ace0cb', None, None, None, None, None), (None, None, '9d0de813-2073-4e2a-a486-6e31d72863a5', None, None, None), (None, None, '125ddd94-e67d-4f25-a9da-1073d0016a4d', None, None, None), ('cee32c1f-52a3-4c2a-8727-097189acdfaa', None, None, None, None, None), ('cee32c1f-52a3-4c2a-8727-097189acdfaa', None, None, None, None, None), ('4b732533-91fe-432d-a6d2-08df785dbf46', '10.2.2.100', None, None, None, None), ('4b732533-91fe-432d-a6d2-08df785dbf46', '10.2.2.200', None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:15:47.519159 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e147b8ee-3ab9-4c1a-977a-ead2d28a4486 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Releasing lock "refresh_cache-9b1a43c9-7310-4068-9b24-7ceb7c935553" {{(pid=119474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 01:15:47.519831 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-e147b8ee-3ab9-4c1a-977a-ead2d28a4486 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] HTTP exception thrown: floating IP not found Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e147b8ee-3ab9-4c1a-977a-ead2d28a4486 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Request method failure captured: Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553/action HTTP/1.1 Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 41 Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5deCl4ZlFEyAdTg2sbxmSvq4fnDOFPMTJ6vVwSDxMZvTCKTuHmnFSDq3PSTW5MdYOYovAZHymCPCLFHIux9TQ58cOKywQdikdlB61b6S9QW2P59ONV1RcI72itpoP6t_e2bRbY_H4ruv7LgGTxL5h9geLWP9o5xNNuRziRtTrDejUU0 Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: f130aa9ed7364d0aad29cab48e63f0be Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f130aa9ed7364d0aad29cab48e63f0be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f130aa9ed7364d0aad29cab48e63f0be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f130aa9ed7364d0aad29cab48e63f0be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f130aa9ed7364d0aad29cab48e63f0be", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: f130aa9ed7364d0aad29cab48e63f0be Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f4103d2981da44aea1ea8547f225b3b5 Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: exception: floating IP not found Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '9b1a43c9-7310-4068-9b24-7ceb7c935553', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 31 01:15:47.521441 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.528013 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:47.528013 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.528013 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:47.528013 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:47.528013 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:47.528013 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:47.528013 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:47.528013 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 31 01:15:47.528013 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.528013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e147b8ee-3ab9-4c1a-977a-ead2d28a4486 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Returning 404 to user: floating IP not found {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:47.528013 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e147b8ee-3ab9-4c1a-977a-ead2d28a4486 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "POST /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553/action" status: 404 len: 67 microversion: 2.1 time: 0.434435 Jul 31 01:15:47.528013 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1000/2026] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:15:47 2022] POST /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553/action => generated 67 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:15:47.533100 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e54080d8-d59e-4fde-86c5-3ce10c1dcff3 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Action: 'action', calling method: .version_select at 0x7fede83c5430>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:47.745456 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-e54080d8-d59e-4fde-86c5-3ce10c1dcff3 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e54080d8-d59e-4fde-86c5-3ce10c1dcff3 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Request method failure captured: Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553/action HTTP/1.1 Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 44 Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5deCl4ZlFEyAdTg2sbxmSvq4fnDOFPMTJ6vVwSDxMZvTCKTuHmnFSDq3PSTW5MdYOYovAZHymCPCLFHIux9TQ58cOKywQdikdlB61b6S9QW2P59ONV1RcI72itpoP6t_e2bRbY_H4ruv7LgGTxL5h9geLWP9o5xNNuRziRtTrDejUU0 Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: f130aa9ed7364d0aad29cab48e63f0be Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f130aa9ed7364d0aad29cab48e63f0be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f130aa9ed7364d0aad29cab48e63f0be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f130aa9ed7364d0aad29cab48e63f0be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f130aa9ed7364d0aad29cab48e63f0be", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: f130aa9ed7364d0aad29cab48e63f0be Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f4103d2981da44aea1ea8547f225b3b5 Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: exception: Floating IP not found for address 0.0.0.0. Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '9b1a43c9-7310-4068-9b24-7ceb7c935553', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 31 01:15:47.747529 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 31 01:15:47.753452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 31 01:15:47.753452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.753452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:47.753452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.753452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:47.753452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:47.753452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:47.753452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:47.753452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:47.753452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 31 01:15:47.753452 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:47.753452 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e54080d8-d59e-4fde-86c5-3ce10c1dcff3 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:47.753452 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e54080d8-d59e-4fde-86c5-3ce10c1dcff3 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "POST /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553/action" status: 404 len: 88 microversion: 2.1 time: 0.220558 Jul 31 01:15:47.757339 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1001/2027] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:15:47 2022] POST /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553/action => generated 88 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 31 01:15:47.774918 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5b3b4920-12f0-467f-890a-418c1ed3a7f9 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:47.775601 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5b3b4920-12f0-467f-890a-418c1ed3a7f9 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:47.782187 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b3b4920-12f0-467f-890a-418c1ed3a7f9 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:47.786609 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b3b4920-12f0-467f-890a-418c1ed3a7f9 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:47.787924 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b3b4920-12f0-467f-890a-418c1ed3a7f9 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:47.790803 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b3b4920-12f0-467f-890a-418c1ed3a7f9 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:47.823229 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:SELECT=93,nova_cell1:UPDATE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:48.090009 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5b3b4920-12f0-467f-890a-418c1ed3a7f9 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:48.107677 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5b3b4920-12f0-467f-890a-418c1ed3a7f9 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1277 microversion: 2.1 time: 0.349002 Jul 31 01:15:48.108672 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1002/2028] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:47 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1277 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:48.117590 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-54bb2141-b5f4-42c5-b291-06d2eb79fcba tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:48.118115 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-54bb2141-b5f4-42c5-b291-06d2eb79fcba tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:48.120084 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:48.142315 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-54bb2141-b5f4-42c5-b291-06d2eb79fcba tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:48.142777 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-54bb2141-b5f4-42c5-b291-06d2eb79fcba tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:48.143880 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-54bb2141-b5f4-42c5-b291-06d2eb79fcba tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:48.144336 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-54bb2141-b5f4-42c5-b291-06d2eb79fcba tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:48.184539 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-54bb2141-b5f4-42c5-b291-06d2eb79fcba tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:15:48.311163 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-54bb2141-b5f4-42c5-b291-06d2eb79fcba tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553" status: 204 len: 0 microversion: 2.1 time: 0.199818 Jul 31 01:15:48.312813 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1003/2029] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:15:48 2022] DELETE /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:15:48.322908 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cf90510c-ae2d-4e30-a951-d8af501ea83b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:48.324483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cf90510c-ae2d-4e30-a951-d8af501ea83b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:48.332721 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf90510c-ae2d-4e30-a951-d8af501ea83b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:48.333603 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf90510c-ae2d-4e30-a951-d8af501ea83b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:48.334785 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf90510c-ae2d-4e30-a951-d8af501ea83b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:48.335917 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf90510c-ae2d-4e30-a951-d8af501ea83b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:48.745465 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cf90510c-ae2d-4e30-a951-d8af501ea83b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:48.754698 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cf90510c-ae2d-4e30-a951-d8af501ea83b tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 200 len: 1280 microversion: 2.1 time: 0.440031 Jul 31 01:15:48.756100 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1004/2030] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:48 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 1280 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:48.761066 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-81a0222a-9b25-49fd-ab81-718c835cb49a req-d5f54fe9-a176-42f0-a668-cc2e903c7104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aafa66e0-8207-4875-947e-48fe17082af0", "name": "network-vif-deleted", "tag": "81c9c6b7-7555-43c6-a140-9176296ddace"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:48.773450 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-81a0222a-9b25-49fd-ab81-718c835cb49a req-d5f54fe9-a176-42f0-a668-cc2e903c7104 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:48.774394 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-81a0222a-9b25-49fd-ab81-718c835cb49a req-d5f54fe9-a176-42f0-a668-cc2e903c7104 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:48.792643 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-81a0222a-9b25-49fd-ab81-718c835cb49a req-d5f54fe9-a176-42f0-a668-cc2e903c7104 service nova] Creating event network-vif-deleted:81c9c6b7-7555-43c6-a140-9176296ddace for instance aafa66e0-8207-4875-947e-48fe17082af0 on n-h2-master-1 Jul 31 01:15:48.801902 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-81a0222a-9b25-49fd-ab81-718c835cb49a req-d5f54fe9-a176-42f0-a668-cc2e903c7104 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044225 Jul 31 01:15:48.803379 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1005/2031] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:48.810143 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e7456bb8-16f7-4803-8240-122b26e22636 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:48.811462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e7456bb8-16f7-4803-8240-122b26e22636 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:48.818281 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7456bb8-16f7-4803-8240-122b26e22636 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:48.819184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7456bb8-16f7-4803-8240-122b26e22636 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:48.820260 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7456bb8-16f7-4803-8240-122b26e22636 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:48.820975 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7456bb8-16f7-4803-8240-122b26e22636 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:49.378907 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e7456bb8-16f7-4803-8240-122b26e22636 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4103d2981da44aea1ea8547f225b3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f130aa9ed7364d0aad29cab48e63f0be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:49.414399 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e7456bb8-16f7-4803-8240-122b26e22636 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553" status: 200 len: 1542 microversion: 2.1 time: 0.609518 Jul 31 01:15:49.415908 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1006/2032] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:48 2022] GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553 => generated 1542 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:49.420519 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-432427df-3ba8-4dfb-9c47-869bc327ee65 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f2e18c51-7886-4423-9277-5261551fa7c5"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:49.422890 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-432427df-3ba8-4dfb-9c47-869bc327ee65 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:49.450651 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-432427df-3ba8-4dfb-9c47-869bc327ee65 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:49.451221 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-432427df-3ba8-4dfb-9c47-869bc327ee65 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:49.452248 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-432427df-3ba8-4dfb-9c47-869bc327ee65 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:49.452770 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-432427df-3ba8-4dfb-9c47-869bc327ee65 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:49.533635 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-432427df-3ba8-4dfb-9c47-869bc327ee65 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] HTTP exception thrown: Volume 2e65813f-7d06-42fc-ba46-976a4d84fd3e could not be found. Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-432427df-3ba8-4dfb-9c47-869bc327ee65 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] Request method failure captured: Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: request: PUT /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda/os-volume_attachments/2e65813f-7d06-42fc-ba46-976a4d84fd3e HTTP/1.1 Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 74 Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dc4Mrn2OnsLHlFzOw4s7Lb3kD4N1y6SYCTnpNKG2FCUUL3qEdWQVUGu_biWEcDDNJxbLmb8-2OHKPNanBjV6QWGwU-lcT5mBKAPGb4mQP8BemYieNirdKudck0opI6gCJnwTI6rC-IVPep2qx8Zb-Qq0tcxe94zPK9lejR_qJ_jP0g Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 09f165a07e85477897cb0611bee41c4a Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesAdminNegativeTest-146834393 Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/09f165a07e85477897cb0611bee41c4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/09f165a07e85477897cb0611bee41c4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/09f165a07e85477897cb0611bee41c4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_09f165a07e85477897cb0611bee41c4a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesAdminNegativeTest-146834393 Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 09f165a07e85477897cb0611bee41c4a Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-146834393 Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesAdminNegativeTest-146834393-project-admin Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 1e2b7f01bb3d4b8e8466c3f9b993e06f Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesAdminNegativeTest-146834393-project-admin Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: {"volumeAttachment": {"volumeId": "f2e18c51-7886-4423-9277-5261551fa7c5"}} Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: exception: Volume 2e65813f-7d06-42fc-ba46-976a4d84fd3e could not be found. Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: action_args: {'server_id': '3fa8017d-089a-4459-8d0d-4f746b868eda', 'id': '2e65813f-7d06-42fc-ba46-976a4d84fd3e', 'body': {'volumeAttachment': {'volumeId': 'f2e18c51-7886-4423-9277-5261551fa7c5'}}} Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e65813f-7d06-42fc-ba46-976a4d84fd3e could not be found. (HTTP 404) (Request-ID: req-34715531-2f7e-487c-94fc-d593a368035e) Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 01:15:49.548646 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e65813f-7d06-42fc-ba46-976a4d84fd3e could not be found. Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e65813f-7d06-42fc-ba46-976a4d84fd3e could not be found. Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e65813f-7d06-42fc-ba46-976a4d84fd3e could not be found. Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-432427df-3ba8-4dfb-9c47-869bc327ee65 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] Returning 404 to user: Volume 2e65813f-7d06-42fc-ba46-976a4d84fd3e could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:49.553654 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-432427df-3ba8-4dfb-9c47-869bc327ee65 tempest-VolumesAdminNegativeTest-146834393 tempest-VolumesAdminNegativeTest-146834393-project-admin] 10.222.0.45 "PUT /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda/os-volume_attachments/2e65813f-7d06-42fc-ba46-976a4d84fd3e" status: 404 len: 109 microversion: 2.1 time: 0.133595 Jul 31 01:15:49.563565 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1007/2033] 10.222.0.45 () {60 vars in 1433 bytes} [Sun Jul 31 01:15:49 2022] PUT /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda/os-volume_attachments/2e65813f-7d06-42fc-ba46-976a4d84fd3e => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:49.572762 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6282123f-2b5c-4fce-8aca-6f0525cdce02 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:49.573640 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6282123f-2b5c-4fce-8aca-6f0525cdce02 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:49.590612 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6282123f-2b5c-4fce-8aca-6f0525cdce02 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:49.592248 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6282123f-2b5c-4fce-8aca-6f0525cdce02 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:49.593201 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6282123f-2b5c-4fce-8aca-6f0525cdce02 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:49.593594 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6282123f-2b5c-4fce-8aca-6f0525cdce02 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:50.305867 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6282123f-2b5c-4fce-8aca-6f0525cdce02 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:50.313326 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6282123f-2b5c-4fce-8aca-6f0525cdce02 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1319 microversion: 2.1 time: 0.749717 Jul 31 01:15:50.313893 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1008/2034] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:49 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1319 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:50.332320 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0311488b-94b8-407b-903c-20ce84efdb2f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:50.332960 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0311488b-94b8-407b-903c-20ce84efdb2f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: aafa66e0-8207-4875-947e-48fe17082af0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:50.339905 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0311488b-94b8-407b-903c-20ce84efdb2f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:50.340353 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0311488b-94b8-407b-903c-20ce84efdb2f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:50.345340 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0311488b-94b8-407b-903c-20ce84efdb2f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:50.345802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0311488b-94b8-407b-903c-20ce84efdb2f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:50.388267 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-0311488b-94b8-407b-903c-20ce84efdb2f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] HTTP exception thrown: Instance aafa66e0-8207-4875-947e-48fe17082af0 could not be found. Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0311488b-94b8-407b-903c-20ce84efdb2f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Request method failure captured: Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 HTTP/1.1 Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXEdSf0Gkqz-Q7EyzIARSzM1tpRTtdOPLVJpa2J_qG7mZevk6GyQhnm9QLedAKtTu6Y06b5WxqinOItA2pGoZRCBBMwYR0jYDk4R4zDfsetamH29xYHuyQ3EGk7WdvpJWGrmcKm3KNA09Pf_mn_e4YVu9YdikywxuH5yA8qcL45MZ0 Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 5d8b0e81765c48039a523271670896d2 Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-LiveMigrationTest-1058922785 Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5d8b0e81765c48039a523271670896d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5d8b0e81765c48039a523271670896d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5d8b0e81765c48039a523271670896d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5d8b0e81765c48039a523271670896d2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-LiveMigrationTest-1058922785 Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 5d8b0e81765c48039a523271670896d2 Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-LiveMigrationTest-1058922785 Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-LiveMigrationTest-1058922785-project Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 457bd8590d5040ef95854808b51c04d3 Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-LiveMigrationTest-1058922785-project Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: exception: Instance aafa66e0-8207-4875-947e-48fe17082af0 could not be found. Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'aafa66e0-8207-4875-947e-48fe17082af0'} Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aafa66e0-8207-4875-947e-48fe17082af0 could not be found. Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aafa66e0-8207-4875-947e-48fe17082af0 could not be found. Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:50.392775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:50.397305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:50.397305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:50.397305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:50.397305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:50.397305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:50.397305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aafa66e0-8207-4875-947e-48fe17082af0 could not be found. Jul 31 01:15:50.397305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:50.397305 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0311488b-94b8-407b-903c-20ce84efdb2f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Returning 404 to user: Instance aafa66e0-8207-4875-947e-48fe17082af0 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:50.397305 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0311488b-94b8-407b-903c-20ce84efdb2f tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0" status: 404 len: 111 microversion: 2.1 time: 0.068129 Jul 31 01:15:50.400706 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1009/2035] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:50 2022] GET /compute/v2.1/servers/aafa66e0-8207-4875-947e-48fe17082af0 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:50.412232 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b685f744-cc8e-46c1-9110-26efeaa2f246 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:50.415027 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b685f744-cc8e-46c1-9110-26efeaa2f246 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:50.425789 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b685f744-cc8e-46c1-9110-26efeaa2f246 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:50.426640 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b685f744-cc8e-46c1-9110-26efeaa2f246 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:50.427771 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b685f744-cc8e-46c1-9110-26efeaa2f246 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:50.428389 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b685f744-cc8e-46c1-9110-26efeaa2f246 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:50.458627 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b685f744-cc8e-46c1-9110-26efeaa2f246 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:15:50.607144 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b685f744-cc8e-46c1-9110-26efeaa2f246 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "DELETE /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 204 len: 0 microversion: 2.1 time: 0.202766 Jul 31 01:15:50.608349 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1010/2036] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:15:50 2022] DELETE /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:15:50.617099 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9f82070e-a1da-48fd-8294-06ffae4f70a4 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:50.620422 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9f82070e-a1da-48fd-8294-06ffae4f70a4 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:50.629259 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f82070e-a1da-48fd-8294-06ffae4f70a4 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:50.629882 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f82070e-a1da-48fd-8294-06ffae4f70a4 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:50.630868 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f82070e-a1da-48fd-8294-06ffae4f70a4 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:50.631928 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f82070e-a1da-48fd-8294-06ffae4f70a4 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:50.887367 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9f82070e-a1da-48fd-8294-06ffae4f70a4 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4103d2981da44aea1ea8547f225b3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f130aa9ed7364d0aad29cab48e63f0be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:50.898341 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9f82070e-a1da-48fd-8294-06ffae4f70a4 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553" status: 200 len: 1500 microversion: 2.1 time: 0.287903 Jul 31 01:15:50.913023 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1011/2037] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:50 2022] GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553 => generated 1500 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:50.920401 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cd7fe3a7-d582-4824-8ebd-ee6b87abbf4d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:50.921035 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cd7fe3a7-d582-4824-8ebd-ee6b87abbf4d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:50.929207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd7fe3a7-d582-4824-8ebd-ee6b87abbf4d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:50.930605 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd7fe3a7-d582-4824-8ebd-ee6b87abbf4d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:50.931906 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd7fe3a7-d582-4824-8ebd-ee6b87abbf4d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:50.932563 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd7fe3a7-d582-4824-8ebd-ee6b87abbf4d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:51.981560 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:52.043046 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=10 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:52.321684 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cd7fe3a7-d582-4824-8ebd-ee6b87abbf4d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:52.335276 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cd7fe3a7-d582-4824-8ebd-ee6b87abbf4d tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1498 microversion: 2.1 time: 1.420483 Jul 31 01:15:52.338894 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1012/2038] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:50 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1498 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:52.387156 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-fff44df0-3402-46f6-b664-b4af06c7b9ea req-3fbb1d79-b674-4957-958a-d0d4513623d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b1a43c9-7310-4068-9b24-7ceb7c935553", "name": "network-vif-deleted", "tag": "d19472c9-6b7c-4f7b-a72a-118ac2c23928"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:52.397891 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fff44df0-3402-46f6-b664-b4af06c7b9ea req-3fbb1d79-b674-4957-958a-d0d4513623d5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:52.398584 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fff44df0-3402-46f6-b664-b4af06c7b9ea req-3fbb1d79-b674-4957-958a-d0d4513623d5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:52.417464 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-fff44df0-3402-46f6-b664-b4af06c7b9ea req-3fbb1d79-b674-4957-958a-d0d4513623d5 service nova] Creating event network-vif-deleted:d19472c9-6b7c-4f7b-a72a-118ac2c23928 for instance 9b1a43c9-7310-4068-9b24-7ceb7c935553 on n-h2-master-1 Jul 31 01:15:52.422787 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-fff44df0-3402-46f6-b664-b4af06c7b9ea req-3fbb1d79-b674-4957-958a-d0d4513623d5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082308 Jul 31 01:15:52.423695 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1013/2039] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:52.428992 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-91d046e4-89ea-48a9-8ad2-f21988c1d803 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:52.434022 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-91d046e4-89ea-48a9-8ad2-f21988c1d803 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:52.442076 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91d046e4-89ea-48a9-8ad2-f21988c1d803 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:52.443050 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91d046e4-89ea-48a9-8ad2-f21988c1d803 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:52.444032 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91d046e4-89ea-48a9-8ad2-f21988c1d803 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:52.445016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91d046e4-89ea-48a9-8ad2-f21988c1d803 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:52.872625 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-91d046e4-89ea-48a9-8ad2-f21988c1d803 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:52.895692 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-91d046e4-89ea-48a9-8ad2-f21988c1d803 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1319 microversion: 2.1 time: 0.464884 Jul 31 01:15:52.898108 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1014/2040] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:52 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:52.915971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-18386701-30ec-40e9-b23d-0bcf944db6a8 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:52.916935 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-18386701-30ec-40e9-b23d-0bcf944db6a8 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] [instance: 9b1a43c9-7310-4068-9b24-7ceb7c935553] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:52.936407 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18386701-30ec-40e9-b23d-0bcf944db6a8 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:52.937062 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18386701-30ec-40e9-b23d-0bcf944db6a8 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:52.942218 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18386701-30ec-40e9-b23d-0bcf944db6a8 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:52.943100 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18386701-30ec-40e9-b23d-0bcf944db6a8 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:52.982189 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-18386701-30ec-40e9-b23d-0bcf944db6a8 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] HTTP exception thrown: Instance 9b1a43c9-7310-4068-9b24-7ceb7c935553 could not be found. Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-18386701-30ec-40e9-b23d-0bcf944db6a8 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Request method failure captured: Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553 HTTP/1.1 Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5deCl4ZlFEyAdTg2sbxmSvq4fnDOFPMTJ6vVwSDxMZvTCKTuHmnFSDq3PSTW5MdYOYovAZHymCPCLFHIux9TQ58cOKywQdikdlB61b6S9QW2P59ONV1RcI72itpoP6t_e2bRbY_H4ruv7LgGTxL5h9geLWP9o5xNNuRziRtTrDejUU0 Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: f130aa9ed7364d0aad29cab48e63f0be Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f130aa9ed7364d0aad29cab48e63f0be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f130aa9ed7364d0aad29cab48e63f0be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f130aa9ed7364d0aad29cab48e63f0be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f130aa9ed7364d0aad29cab48e63f0be", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: f130aa9ed7364d0aad29cab48e63f0be Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f4103d2981da44aea1ea8547f225b3b5 Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 9b1a43c9-7310-4068-9b24-7ceb7c935553 could not be found. Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '9b1a43c9-7310-4068-9b24-7ceb7c935553'} Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b1a43c9-7310-4068-9b24-7ceb7c935553 could not be found. Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b1a43c9-7310-4068-9b24-7ceb7c935553 could not be found. Jul 31 01:15:52.983636 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:52.993635 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:52.993635 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:52.993635 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:52.993635 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:52.993635 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:52.993635 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:52.993635 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:52.993635 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b1a43c9-7310-4068-9b24-7ceb7c935553 could not be found. Jul 31 01:15:52.993635 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:52.993635 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-18386701-30ec-40e9-b23d-0bcf944db6a8 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] Returning 404 to user: Instance 9b1a43c9-7310-4068-9b24-7ceb7c935553 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:52.993635 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-18386701-30ec-40e9-b23d-0bcf944db6a8 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574 tempest-FloatingIPsAssociationNegativeTestJSON-2097219574-project] 10.222.0.45 "GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553" status: 404 len: 111 microversion: 2.1 time: 0.085699 Jul 31 01:15:52.993635 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1015/2041] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:52 2022] GET /compute/v2.1/servers/9b1a43c9-7310-4068-9b24-7ceb7c935553 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:53.004838 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-35baebe7-16c4-41b2-964e-8abe359dedd6 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:53.005796 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-35baebe7-16c4-41b2-964e-8abe359dedd6 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:53.015178 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35baebe7-16c4-41b2-964e-8abe359dedd6 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:53.018338 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35baebe7-16c4-41b2-964e-8abe359dedd6 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:53.018641 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:53.019746 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35baebe7-16c4-41b2-964e-8abe359dedd6 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:53.023502 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35baebe7-16c4-41b2-964e-8abe359dedd6 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:53.089678 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-35baebe7-16c4-41b2-964e-8abe359dedd6 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:15:53.292999 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-35baebe7-16c4-41b2-964e-8abe359dedd6 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda" status: 204 len: 0 microversion: 2.1 time: 0.305594 Jul 31 01:15:53.293808 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1016/2042] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:15:52 2022] DELETE /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:15:53.305782 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-31375cd9-c332-4f36-9edd-3564cdf65eb0 req-d4a55f37-a28d-40c7-862e-864406d38b2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51fae254-0bd2-4470-a05b-bf0e83d7c3dc", "tag": "916c8310-8e01-40cb-98f9-6d2f0e9823c4"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:53.321318 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-31375cd9-c332-4f36-9edd-3564cdf65eb0 req-d4a55f37-a28d-40c7-862e-864406d38b2c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:53.321796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-31375cd9-c332-4f36-9edd-3564cdf65eb0 req-d4a55f37-a28d-40c7-862e-864406d38b2c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:53.334265 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:15:53.337810 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-31375cd9-c332-4f36-9edd-3564cdf65eb0 req-d4a55f37-a28d-40c7-862e-864406d38b2c service nova] Creating event network-changed:916c8310-8e01-40cb-98f9-6d2f0e9823c4 for instance 51fae254-0bd2-4470-a05b-bf0e83d7c3dc on n-h1-master-1 Jul 31 01:15:53.344727 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-31375cd9-c332-4f36-9edd-3564cdf65eb0 req-d4a55f37-a28d-40c7-862e-864406d38b2c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044976 Jul 31 01:15:53.345929 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1017/2043] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:53.353948 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-66cd81bb-d345-42ee-b370-04a1456257a0 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:53.355023 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-66cd81bb-d345-42ee-b370-04a1456257a0 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:53.364171 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66cd81bb-d345-42ee-b370-04a1456257a0 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:53.364629 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66cd81bb-d345-42ee-b370-04a1456257a0 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:53.365420 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66cd81bb-d345-42ee-b370-04a1456257a0 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:53.365861 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66cd81bb-d345-42ee-b370-04a1456257a0 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:53.780633 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-66cd81bb-d345-42ee-b370-04a1456257a0 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:53.814078 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-66cd81bb-d345-42ee-b370-04a1456257a0 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda" status: 200 len: 1511 microversion: 2.1 time: 0.448040 Jul 31 01:15:53.821826 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1018/2044] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:53 2022] GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda => generated 1511 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:53.869387 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d04eb2d6-8d42-418e-9e45-68a8b56bc4a2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:53.872437 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d04eb2d6-8d42-418e-9e45-68a8b56bc4a2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:53.898709 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d04eb2d6-8d42-418e-9e45-68a8b56bc4a2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:53.899971 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d04eb2d6-8d42-418e-9e45-68a8b56bc4a2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:53.905895 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d04eb2d6-8d42-418e-9e45-68a8b56bc4a2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:53.906358 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d04eb2d6-8d42-418e-9e45-68a8b56bc4a2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:54.026537 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d04eb2d6-8d42-418e-9e45-68a8b56bc4a2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:54.027212 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d04eb2d6-8d42-418e-9e45-68a8b56bc4a2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:54.027371 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-d04eb2d6-8d42-418e-9e45-68a8b56bc4a2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lazy-loading 'fault' on Instance uuid 328017bc-1f5e-4680-9c77-f5eefbce8135 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:15:54.116670 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d04eb2d6-8d42-418e-9e45-68a8b56bc4a2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457bd8590d5040ef95854808b51c04d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8b0e81765c48039a523271670896d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:54.129831 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d04eb2d6-8d42-418e-9e45-68a8b56bc4a2 tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 200 len: 1300 microversion: 2.1 time: 0.305372 Jul 31 01:15:54.140359 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1019/2045] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:53 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 1300 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:54.149636 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-558eed65-b908-4c92-b272-2c7f06f1e206 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:54.150795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-558eed65-b908-4c92-b272-2c7f06f1e206 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:54.162074 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-558eed65-b908-4c92-b272-2c7f06f1e206 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:54.162528 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-558eed65-b908-4c92-b272-2c7f06f1e206 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:54.163500 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-558eed65-b908-4c92-b272-2c7f06f1e206 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:54.163937 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-558eed65-b908-4c92-b272-2c7f06f1e206 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:54.841686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-558eed65-b908-4c92-b272-2c7f06f1e206 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:54.862442 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-558eed65-b908-4c92-b272-2c7f06f1e206 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1319 microversion: 2.1 time: 0.720810 Jul 31 01:15:54.867405 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1020/2046] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:54 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1319 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:54.881077 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-0102c9e8-bf1a-4f7b-8d42-1cc93cc9024a req-f1ca18b1-ce43-4048-b312-40ebe708a265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328017bc-1f5e-4680-9c77-f5eefbce8135", "name": "network-vif-deleted", "tag": "f6d2a872-7a8a-4fce-a428-700f7792e65f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:54.909322 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0102c9e8-bf1a-4f7b-8d42-1cc93cc9024a req-f1ca18b1-ce43-4048-b312-40ebe708a265 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:54.910838 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0102c9e8-bf1a-4f7b-8d42-1cc93cc9024a req-f1ca18b1-ce43-4048-b312-40ebe708a265 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:54.936354 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-0102c9e8-bf1a-4f7b-8d42-1cc93cc9024a req-f1ca18b1-ce43-4048-b312-40ebe708a265 service nova] Creating event network-vif-deleted:f6d2a872-7a8a-4fce-a428-700f7792e65f for instance 328017bc-1f5e-4680-9c77-f5eefbce8135 on n-h1-master-1 Jul 31 01:15:54.953422 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-0102c9e8-bf1a-4f7b-8d42-1cc93cc9024a req-f1ca18b1-ce43-4048-b312-40ebe708a265 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079458 Jul 31 01:15:54.954050 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1021/2047] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:54.978735 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-abbd9f84-0c1f-4905-b68e-4b2f26dc9578 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:54.979926 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-abbd9f84-0c1f-4905-b68e-4b2f26dc9578 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:55.005910 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abbd9f84-0c1f-4905-b68e-4b2f26dc9578 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:55.006755 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abbd9f84-0c1f-4905-b68e-4b2f26dc9578 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:55.008740 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abbd9f84-0c1f-4905-b68e-4b2f26dc9578 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:55.029594 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abbd9f84-0c1f-4905-b68e-4b2f26dc9578 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:55.337906 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-abbd9f84-0c1f-4905-b68e-4b2f26dc9578 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:55.349102 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-abbd9f84-0c1f-4905-b68e-4b2f26dc9578 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda" status: 200 len: 1511 microversion: 2.1 time: 0.393813 Jul 31 01:15:55.349703 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1022/2048] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:54 2022] GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda => generated 1511 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:55.611423 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-61df0cb5-1455-47e0-950a-c620588680a1 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-754122715", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "fc3ec9b4-e7ec-4277-b7db-ec3e277a835b"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:55.678482 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-61df0cb5-1455-47e0-950a-c620588680a1 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] validate_networks() for [('fc3ec9b4-e7ec-4277-b7db-ec3e277a835b', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:15:56.944423 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4188d608-157b-4a82-b9e0-1a4f0870f96f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:15:56.945916 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4188d608-157b-4a82-b9e0-1a4f0870f96f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:15:56.946670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4188d608-157b-4a82-b9e0-1a4f0870f96f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:15:56.947245 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4188d608-157b-4a82-b9e0-1a4f0870f96f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:15:56.947851 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4188d608-157b-4a82-b9e0-1a4f0870f96f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:15:56.978627 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4188d608-157b-4a82-b9e0-1a4f0870f96f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:56.979190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4188d608-157b-4a82-b9e0-1a4f0870f96f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:56.980378 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4188d608-157b-4a82-b9e0-1a4f0870f96f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:56.981105 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4188d608-157b-4a82-b9e0-1a4f0870f96f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:57.006827 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-4188d608-157b-4a82-b9e0-1a4f0870f96f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Getting quotas for project 276c5f283b1f4c2896b55667156c6f21. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:15:57.013748 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-4188d608-157b-4a82-b9e0-1a4f0870f96f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Getting quotas for user 5bf6b7d7d5954879be98b36b607daf0d and project 276c5f283b1f4c2896b55667156c6f21. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:15:57.059179 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-61df0cb5-1455-47e0-950a-c620588680a1 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:15:57.064405 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-61df0cb5-1455-47e0-950a-c620588680a1 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:15:57.065038 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-61df0cb5-1455-47e0-950a-c620588680a1 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:15:57.065534 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-61df0cb5-1455-47e0-950a-c620588680a1 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:15:57.066013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-61df0cb5-1455-47e0-950a-c620588680a1 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:15:57.085462 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61df0cb5-1455-47e0-950a-c620588680a1 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:57.086207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61df0cb5-1455-47e0-950a-c620588680a1 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:57.087226 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61df0cb5-1455-47e0-950a-c620588680a1 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:57.088630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61df0cb5-1455-47e0-950a-c620588680a1 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:57.123399 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-61df0cb5-1455-47e0-950a-c620588680a1 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Getting quotas for project a14ae0c0cc7d4657acb725838ca0325a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:15:57.134881 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-61df0cb5-1455-47e0-950a-c620588680a1 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Getting quotas for user cdce34f77f644220998e5deba40c6421 and project a14ae0c0cc7d4657acb725838ca0325a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:15:57.155312 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-61df0cb5-1455-47e0-950a-c620588680a1 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:15:57.157485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-61df0cb5-1455-47e0-950a-c620588680a1 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:15:57.286570 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-61df0cb5-1455-47e0-950a-c620588680a1 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.935758 Jul 31 01:15:57.291074 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1023/2049] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:15:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:15:57.296134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4188d608-157b-4a82-b9e0-1a4f0870f96f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:15:57.301336 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4188d608-157b-4a82-b9e0-1a4f0870f96f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0ce9a3e0-9c44-4b4c-934d-9e392555b668',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='8b496528-b515-474a-a52e-d861e8b8419d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72915f39-03f3-49d3-9bad-3e1eac365fe0',volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:15:57.305734 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e7e8fe06-d39b-4d1b-bc7c-67c157f41d5c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:57.313442 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e7e8fe06-d39b-4d1b-bc7c-67c157f41d5c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] [instance: 328017bc-1f5e-4680-9c77-f5eefbce8135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:57.334656 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7e8fe06-d39b-4d1b-bc7c-67c157f41d5c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:57.335408 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7e8fe06-d39b-4d1b-bc7c-67c157f41d5c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:57.344802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7e8fe06-d39b-4d1b-bc7c-67c157f41d5c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:57.346225 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7e8fe06-d39b-4d1b-bc7c-67c157f41d5c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:57.372175 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-e7e8fe06-d39b-4d1b-bc7c-67c157f41d5c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] HTTP exception thrown: Instance 328017bc-1f5e-4680-9c77-f5eefbce8135 could not be found. Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e7e8fe06-d39b-4d1b-bc7c-67c157f41d5c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Request method failure captured: Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 HTTP/1.1 Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dXEdSf0Gkqz-Q7EyzIARSzM1tpRTtdOPLVJpa2J_qG7mZevk6GyQhnm9QLedAKtTu6Y06b5WxqinOItA2pGoZRCBBMwYR0jYDk4R4zDfsetamH29xYHuyQ3EGk7WdvpJWGrmcKm3KNA09Pf_mn_e4YVu9YdikywxuH5yA8qcL45MZ0 Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 5d8b0e81765c48039a523271670896d2 Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-LiveMigrationTest-1058922785 Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5d8b0e81765c48039a523271670896d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5d8b0e81765c48039a523271670896d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5d8b0e81765c48039a523271670896d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5d8b0e81765c48039a523271670896d2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-LiveMigrationTest-1058922785 Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 5d8b0e81765c48039a523271670896d2 Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-LiveMigrationTest-1058922785 Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-LiveMigrationTest-1058922785-project Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 457bd8590d5040ef95854808b51c04d3 Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-LiveMigrationTest-1058922785-project Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 328017bc-1f5e-4680-9c77-f5eefbce8135 could not be found. Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '328017bc-1f5e-4680-9c77-f5eefbce8135'} Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328017bc-1f5e-4680-9c77-f5eefbce8135 could not be found. Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328017bc-1f5e-4680-9c77-f5eefbce8135 could not be found. Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:57.374151 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:57.380153 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:57.380153 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:57.380153 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:57.380153 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:57.380153 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:57.380153 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328017bc-1f5e-4680-9c77-f5eefbce8135 could not be found. Jul 31 01:15:57.380153 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:57.385374 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e7e8fe06-d39b-4d1b-bc7c-67c157f41d5c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] Returning 404 to user: Instance 328017bc-1f5e-4680-9c77-f5eefbce8135 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:57.386623 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e7e8fe06-d39b-4d1b-bc7c-67c157f41d5c tempest-LiveMigrationTest-1058922785 tempest-LiveMigrationTest-1058922785-project] 10.222.0.45 "GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135" status: 404 len: 111 microversion: 2.1 time: 0.094401 Jul 31 01:15:57.396340 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1024/2050] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:57 2022] GET /compute/v2.1/servers/328017bc-1f5e-4680-9c77-f5eefbce8135 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:57.402143 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a938537b-72dc-4bf3-8196-0f080e6bcae7 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:57.403083 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a938537b-72dc-4bf3-8196-0f080e6bcae7 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:57.410292 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a938537b-72dc-4bf3-8196-0f080e6bcae7 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:57.412437 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a938537b-72dc-4bf3-8196-0f080e6bcae7 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:57.419072 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a938537b-72dc-4bf3-8196-0f080e6bcae7 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:57.420050 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a938537b-72dc-4bf3-8196-0f080e6bcae7 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:57.943008 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a938537b-72dc-4bf3-8196-0f080e6bcae7 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:57.954066 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a938537b-72dc-4bf3-8196-0f080e6bcae7 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1319 microversion: 2.1 time: 0.556001 Jul 31 01:15:57.954409 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1025/2051] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:57 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1319 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:15:57.963554 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-79e1acd3-fb72-4564-8db6-13f7b4c162fb tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:57.964096 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-79e1acd3-fb72-4564-8db6-13f7b4c162fb tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 3fa8017d-089a-4459-8d0d-4f746b868eda] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:57.977914 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79e1acd3-fb72-4564-8db6-13f7b4c162fb tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:57.978372 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79e1acd3-fb72-4564-8db6-13f7b4c162fb tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:57.979167 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79e1acd3-fb72-4564-8db6-13f7b4c162fb tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:57.979636 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79e1acd3-fb72-4564-8db6-13f7b4c162fb tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:58.033272 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-79e1acd3-fb72-4564-8db6-13f7b4c162fb tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] HTTP exception thrown: Instance 3fa8017d-089a-4459-8d0d-4f746b868eda could not be found. Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-79e1acd3-fb72-4564-8db6-13f7b4c162fb tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Request method failure captured: Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda HTTP/1.1 Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dcYFiMJvfUamP7OU1EExTydP5l2kxHX8Gj0uSPuVxH3lVqZX41QYFW3jpPwayOM93gOaNIe8-4ED4g2HdyckIBM7FPdQP9EGenrJfOhYc0TKEQIPHUCaBMgXw0NkuDnyPqkenn3grHrVGtbmDWm6g2LyBtRwXVrjNzui-2AqXj4c2A Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 47b342e518054a56b42112c5dec71b2f Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesAdminNegativeTest-1012692366 Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/47b342e518054a56b42112c5dec71b2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/47b342e518054a56b42112c5dec71b2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/47b342e518054a56b42112c5dec71b2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_47b342e518054a56b42112c5dec71b2f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesAdminNegativeTest-1012692366 Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 47b342e518054a56b42112c5dec71b2f Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1012692366 Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesAdminNegativeTest-1012692366-project Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 6e5532c17656432182ae9da0d1e2ad67 Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesAdminNegativeTest-1012692366-project Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 3fa8017d-089a-4459-8d0d-4f746b868eda could not be found. Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '3fa8017d-089a-4459-8d0d-4f746b868eda'} Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa8017d-089a-4459-8d0d-4f746b868eda could not be found. Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa8017d-089a-4459-8d0d-4f746b868eda could not be found. Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:15:58.034836 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:58.040751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:15:58.040751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:15:58.040751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:15:58.040751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:15:58.040751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:15:58.040751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa8017d-089a-4459-8d0d-4f746b868eda could not be found. Jul 31 01:15:58.040751 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:15:58.043794 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-79e1acd3-fb72-4564-8db6-13f7b4c162fb tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Returning 404 to user: Instance 3fa8017d-089a-4459-8d0d-4f746b868eda could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:15:58.043794 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-79e1acd3-fb72-4564-8db6-13f7b4c162fb tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda" status: 404 len: 111 microversion: 2.1 time: 0.087658 Jul 31 01:15:58.048590 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1026/2052] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:57 2022] GET /compute/v2.1/servers/3fa8017d-089a-4459-8d0d-4f746b868eda => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:15:58.061055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-9b3e9e13-eee1-48e1-b085-a481c4a308cb req-39d835ae-ad47-4442-9708-81306bc1ddc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa8017d-089a-4459-8d0d-4f746b868eda", "name": "network-vif-deleted", "tag": "36fee2cc-f1b4-454c-9903-f979a420d46e"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:58.089032 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9b3e9e13-eee1-48e1-b085-a481c4a308cb req-39d835ae-ad47-4442-9708-81306bc1ddc7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:58.093586 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9b3e9e13-eee1-48e1-b085-a481c4a308cb req-39d835ae-ad47-4442-9708-81306bc1ddc7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:58.131055 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4188d608-157b-4a82-b9e0-1a4f0870f96f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 11.066101 Jul 31 01:15:58.146600 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1027/2053] 10.222.0.45 () {62 vars in 1189 bytes} [Sun Jul 31 01:15:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 11084 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 01:15:58.150807 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-9b3e9e13-eee1-48e1-b085-a481c4a308cb req-39d835ae-ad47-4442-9708-81306bc1ddc7 service nova] Creating event network-vif-deleted:36fee2cc-f1b4-454c-9903-f979a420d46e for instance 3fa8017d-089a-4459-8d0d-4f746b868eda on n-h2-master-1 Jul 31 01:15:58.165084 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-371b5a6c-b896-4e40-a94f-8b4db875758d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1103108113", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "fc3ec9b4-e7ec-4277-b7db-ec3e277a835b"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:15:58.174961 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-9b3e9e13-eee1-48e1-b085-a481c4a308cb req-39d835ae-ad47-4442-9708-81306bc1ddc7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124331 Jul 31 01:15:58.183718 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1027/2054] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:15:58.205626 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-30a3f0ce-987d-4869-ba27-a6259d0ada03 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:58.207142 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-30a3f0ce-987d-4869-ba27-a6259d0ada03 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:58.317496 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-371b5a6c-b896-4e40-a94f-8b4db875758d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] validate_networks() for [('fc3ec9b4-e7ec-4277-b7db-ec3e277a835b', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:15:58.483963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-30a3f0ce-987d-4869-ba27-a6259d0ada03 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:58.499116 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-30a3f0ce-987d-4869-ba27-a6259d0ada03 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:58.502085 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-30a3f0ce-987d-4869-ba27-a6259d0ada03 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:58.504367 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-30a3f0ce-987d-4869-ba27-a6259d0ada03 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1284 microversion: 2.32 time: 0.319204 Jul 31 01:15:58.509405 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1028/2055] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:15:58 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1284 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:15:58.981038 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-da147328-4faf-4dba-952a-f3bac7902eaa tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:58.981975 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-da147328-4faf-4dba-952a-f3bac7902eaa tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:58.990146 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da147328-4faf-4dba-952a-f3bac7902eaa tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:59.012564 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da147328-4faf-4dba-952a-f3bac7902eaa tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:59.013779 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da147328-4faf-4dba-952a-f3bac7902eaa tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:15:59.014479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da147328-4faf-4dba-952a-f3bac7902eaa tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:15:59.818511 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-da147328-4faf-4dba-952a-f3bac7902eaa tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:15:59.838865 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-da147328-4faf-4dba-952a-f3bac7902eaa tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1319 microversion: 2.1 time: 0.868270 Jul 31 01:15:59.856133 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1029/2056] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:15:58 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1319 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:15:59.874782 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e99276a5-2501-4d59-8056-fde0c9b81409 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:15:59.875436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e99276a5-2501-4d59-8056-fde0c9b81409 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:15:59.982171 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e99276a5-2501-4d59-8056-fde0c9b81409 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:00.006956 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e99276a5-2501-4d59-8056-fde0c9b81409 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:00.009019 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e99276a5-2501-4d59-8056-fde0c9b81409 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:00.010183 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e99276a5-2501-4d59-8056-fde0c9b81409 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1284 microversion: 2.32 time: 0.146553 Jul 31 01:16:00.010751 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1030/2057] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:15:59 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:00.322589 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-371b5a6c-b896-4e40-a94f-8b4db875758d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:16:00.323237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-371b5a6c-b896-4e40-a94f-8b4db875758d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:16:00.323804 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-371b5a6c-b896-4e40-a94f-8b4db875758d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:16:00.324287 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-371b5a6c-b896-4e40-a94f-8b4db875758d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:16:00.324652 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-371b5a6c-b896-4e40-a94f-8b4db875758d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:16:00.353274 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-371b5a6c-b896-4e40-a94f-8b4db875758d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:00.353749 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-371b5a6c-b896-4e40-a94f-8b4db875758d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:00.360088 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-371b5a6c-b896-4e40-a94f-8b4db875758d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:00.361037 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-371b5a6c-b896-4e40-a94f-8b4db875758d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:00.397859 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=94,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:00.426776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-371b5a6c-b896-4e40-a94f-8b4db875758d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Getting quotas for project a14ae0c0cc7d4657acb725838ca0325a. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:16:00.445057 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-371b5a6c-b896-4e40-a94f-8b4db875758d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Getting quotas for user cdce34f77f644220998e5deba40c6421 and project a14ae0c0cc7d4657acb725838ca0325a. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:16:00.450715 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:00.464790 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-371b5a6c-b896-4e40-a94f-8b4db875758d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:16:00.468664 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-371b5a6c-b896-4e40-a94f-8b4db875758d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 2bc94263-b6c3-4954-95b3-345029530b02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:16:00.576750 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-371b5a6c-b896-4e40-a94f-8b4db875758d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.428118 Jul 31 01:16:00.577475 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1028/2058] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:15:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:16:00.852483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-43b4e1e5-7323-4bb2-8de1-a9cc8364f05d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1818759606", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "451", "networks": [{"uuid": "fc3ec9b4-e7ec-4277-b7db-ec3e277a835b"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:00.875535 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9e0f3060-317f-4165-930e-d8db1ccbd149 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:00.877319 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9e0f3060-317f-4165-930e-d8db1ccbd149 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:00.905784 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e0f3060-317f-4165-930e-d8db1ccbd149 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:00.906295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e0f3060-317f-4165-930e-d8db1ccbd149 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:00.935060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e0f3060-317f-4165-930e-d8db1ccbd149 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:00.937793 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e0f3060-317f-4165-930e-d8db1ccbd149 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:01.066876 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-43b4e1e5-7323-4bb2-8de1-a9cc8364f05d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] validate_networks() for [('fc3ec9b4-e7ec-4277-b7db-ec3e277a835b', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:16:01.464180 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9e0f3060-317f-4165-930e-d8db1ccbd149 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:01.477914 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9e0f3060-317f-4165-930e-d8db1ccbd149 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1319 microversion: 2.1 time: 0.612620 Jul 31 01:16:01.480787 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1029/2059] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:00 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1319 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:01.497009 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f9f1671a-20da-4775-90e0-844a45623d49 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:01.502199 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f9f1671a-20da-4775-90e0-844a45623d49 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:01.825085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f9f1671a-20da-4775-90e0-844a45623d49 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:01.839868 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f9f1671a-20da-4775-90e0-844a45623d49 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:01.842394 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f9f1671a-20da-4775-90e0-844a45623d49 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:01.844103 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f9f1671a-20da-4775-90e0-844a45623d49 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1284 microversion: 2.32 time: 0.361865 Jul 31 01:16:01.847648 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1030/2060] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:01 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1284 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:02.270418 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-43b4e1e5-7323-4bb2-8de1-a9cc8364f05d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:16:02.271482 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-43b4e1e5-7323-4bb2-8de1-a9cc8364f05d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:16:02.272275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-43b4e1e5-7323-4bb2-8de1-a9cc8364f05d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:16:02.272911 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-43b4e1e5-7323-4bb2-8de1-a9cc8364f05d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:16:02.274171 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-43b4e1e5-7323-4bb2-8de1-a9cc8364f05d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:16:02.293763 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43b4e1e5-7323-4bb2-8de1-a9cc8364f05d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:02.294452 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43b4e1e5-7323-4bb2-8de1-a9cc8364f05d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:02.295536 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43b4e1e5-7323-4bb2-8de1-a9cc8364f05d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:02.296214 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43b4e1e5-7323-4bb2-8de1-a9cc8364f05d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:02.369759 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-43b4e1e5-7323-4bb2-8de1-a9cc8364f05d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Getting quotas for project a14ae0c0cc7d4657acb725838ca0325a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:16:02.380783 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:02.401269 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-43b4e1e5-7323-4bb2-8de1-a9cc8364f05d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Getting quotas for user cdce34f77f644220998e5deba40c6421 and project a14ae0c0cc7d4657acb725838ca0325a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:16:02.447630 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-43b4e1e5-7323-4bb2-8de1-a9cc8364f05d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:16:02.457809 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-43b4e1e5-7323-4bb2-8de1-a9cc8364f05d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:16:02.500819 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-47368693-f379-40f9-8f3c-a599c529328d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:02.501442 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-47368693-f379-40f9-8f3c-a599c529328d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:02.525638 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47368693-f379-40f9-8f3c-a599c529328d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:02.526311 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47368693-f379-40f9-8f3c-a599c529328d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:02.527387 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47368693-f379-40f9-8f3c-a599c529328d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:02.527918 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47368693-f379-40f9-8f3c-a599c529328d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:02.632738 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-43b4e1e5-7323-4bb2-8de1-a9cc8364f05d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.779035 Jul 31 01:16:02.637200 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1031/2061] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:16:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:16:02.666417 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1a5ab3a9-badb-4590-939e-81a3e3be5d4e tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:02.686036 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1a5ab3a9-badb-4590-939e-81a3e3be5d4e tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:03.228127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1a5ab3a9-badb-4590-939e-81a3e3be5d4e tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:03.236280 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1a5ab3a9-badb-4590-939e-81a3e3be5d4e tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 200 len: 1221 microversion: 2.1 time: 0.594864 Jul 31 01:16:03.236868 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1032/2062] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:02 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 1221 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:03.536508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-47368693-f379-40f9-8f3c-a599c529328d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:03.552620 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-47368693-f379-40f9-8f3c-a599c529328d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1319 microversion: 2.1 time: 1.055621 Jul 31 01:16:03.553243 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1031/2063] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:02 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1319 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:16:03.584824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-a2a21225-795d-43a2-addf-453d8677d15d req-1ec13c44-57f1-4c4f-ae42-8fa7d3459683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fae254-0bd2-4470-a05b-bf0e83d7c3dc", "name": "network-vif-plugged", "status": "completed", "tag": "916c8310-8e01-40cb-98f9-6d2f0e9823c4"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:03.587408 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9be2adbe-1559-4b08-80c6-5fd8e972349b tempest-QuotasTestJSON-2123002736 tempest-QuotasTestJSON-2123002736-project] Calling method '.version_select at 0x7fede4ed23a0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:03.641850 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a2a21225-795d-43a2-addf-453d8677d15d req-1ec13c44-57f1-4c4f-ae42-8fa7d3459683 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:03.642467 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a2a21225-795d-43a2-addf-453d8677d15d req-1ec13c44-57f1-4c4f-ae42-8fa7d3459683 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:03.718664 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-a2a21225-795d-43a2-addf-453d8677d15d req-1ec13c44-57f1-4c4f-ae42-8fa7d3459683 service nova] Creating event network-vif-plugged:916c8310-8e01-40cb-98f9-6d2f0e9823c4 for instance 51fae254-0bd2-4470-a05b-bf0e83d7c3dc on n-h1-master-1 Jul 31 01:16:03.720297 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9be2adbe-1559-4b08-80c6-5fd8e972349b tempest-QuotasTestJSON-2123002736 tempest-QuotasTestJSON-2123002736-project] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/d2ddd0646ff14d96924c2ff3938e401d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.473909 Jul 31 01:16:03.721276 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1033/2064] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 01:16:03 2022] GET /compute/v2.1/os-quota-sets/d2ddd0646ff14d96924c2ff3938e401d/defaults => generated 371 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:03.729268 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0653a4d8-0c20-4fca-9afa-781b690b8a22 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:03.730225 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0653a4d8-0c20-4fca-9afa-781b690b8a22 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:03.740461 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0653a4d8-0c20-4fca-9afa-781b690b8a22 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:03.741212 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0653a4d8-0c20-4fca-9afa-781b690b8a22 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:03.743948 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0653a4d8-0c20-4fca-9afa-781b690b8a22 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:03.744554 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0653a4d8-0c20-4fca-9afa-781b690b8a22 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:03.764318 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-a2a21225-795d-43a2-addf-453d8677d15d req-1ec13c44-57f1-4c4f-ae42-8fa7d3459683 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209735 Jul 31 01:16:03.764984 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1032/2065] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:03.819278 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-adfe71d5-89e0-4978-b3cd-ac64cb69ca9f tempest-QuotasTestJSON-2123002736 tempest-QuotasTestJSON-2123002736-project] Calling method '.version_select at 0x7fede52e4280>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:04.175100 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-adfe71d5-89e0-4978-b3cd-ac64cb69ca9f tempest-QuotasTestJSON-2123002736 tempest-QuotasTestJSON-2123002736-project] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/d2ddd0646ff14d96924c2ff3938e401d" status: 200 len: 371 microversion: 2.1 time: 0.401182 Jul 31 01:16:04.184088 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1033/2066] 10.222.0.45 () {58 vars in 1242 bytes} [Sun Jul 31 01:16:03 2022] GET /compute/v2.1/os-quota-sets/d2ddd0646ff14d96924c2ff3938e401d => generated 371 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:04.203551 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-abcff159-fdfa-41ea-94d3-986fd6edd278 tempest-QuotasTestJSON-2123002736 tempest-QuotasTestJSON-2123002736-project] Calling method '.version_select at 0x7fede5b438b0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:04.366551 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-abcff159-fdfa-41ea-94d3-986fd6edd278 tempest-QuotasTestJSON-2123002736 tempest-QuotasTestJSON-2123002736-project] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/d2ddd0646ff14d96924c2ff3938e401d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.173591 Jul 31 01:16:04.367928 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1034/2067] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 01:16:04 2022] GET /compute/v2.1/os-quota-sets/d2ddd0646ff14d96924c2ff3938e401d/defaults => generated 371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:04.394777 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0653a4d8-0c20-4fca-9afa-781b690b8a22 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:04.395246 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1319b48d-cda3-4749-a23a-2346b2d95c27 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:04.397043 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1319b48d-cda3-4749-a23a-2346b2d95c27 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:04.411691 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1319b48d-cda3-4749-a23a-2346b2d95c27 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:04.413169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1319b48d-cda3-4749-a23a-2346b2d95c27 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:04.419273 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1319b48d-cda3-4749-a23a-2346b2d95c27 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:04.421007 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1319b48d-cda3-4749-a23a-2346b2d95c27 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:04.421347 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0653a4d8-0c20-4fca-9afa-781b690b8a22 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:04.429290 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0653a4d8-0c20-4fca-9afa-781b690b8a22 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:04.431857 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0653a4d8-0c20-4fca-9afa-781b690b8a22 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1592 microversion: 2.32 time: 0.708138 Jul 31 01:16:04.479541 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1034/2068] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:03 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1592 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:04.495568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7ad82497-7211-4af7-9453-54c97bc133aa tempest-QuotasTestJSON-2123002736 tempest-QuotasTestJSON-2123002736-project] Calling method '.version_select at 0x7fede4ed61f0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:05.099746 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7ad82497-7211-4af7-9453-54c97bc133aa tempest-QuotasTestJSON-2123002736 tempest-QuotasTestJSON-2123002736-project] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/d2ddd0646ff14d96924c2ff3938e401d" status: 200 len: 371 microversion: 2.1 time: 0.618968 Jul 31 01:16:05.103459 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1035/2069] 10.222.0.45 () {58 vars in 1242 bytes} [Sun Jul 31 01:16:04 2022] GET /compute/v2.1/os-quota-sets/d2ddd0646ff14d96924c2ff3938e401d => generated 371 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:05.108818 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6de862ed-cca5-4afa-bf5d-e93169e9eea1 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:05.109741 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6de862ed-cca5-4afa-bf5d-e93169e9eea1 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:05.123009 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6de862ed-cca5-4afa-bf5d-e93169e9eea1 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:05.124079 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6de862ed-cca5-4afa-bf5d-e93169e9eea1 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:05.125606 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6de862ed-cca5-4afa-bf5d-e93169e9eea1 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:05.126412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6de862ed-cca5-4afa-bf5d-e93169e9eea1 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:05.558630 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6de862ed-cca5-4afa-bf5d-e93169e9eea1 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:05.576765 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6de862ed-cca5-4afa-bf5d-e93169e9eea1 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1319 microversion: 2.1 time: 0.467772 Jul 31 01:16:05.578214 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1036/2070] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:05 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1319 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:05.609258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-09042cc9-0b95-457a-bba0-f61440dc73f8 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:05.615402 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-09042cc9-0b95-457a-bba0-f61440dc73f8 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:05.647318 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-09042cc9-0b95-457a-bba0-f61440dc73f8 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:05.648472 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-09042cc9-0b95-457a-bba0-f61440dc73f8 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:05.659374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-09042cc9-0b95-457a-bba0-f61440dc73f8 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:05.659851 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-09042cc9-0b95-457a-bba0-f61440dc73f8 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:05.729074 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-09042cc9-0b95-457a-bba0-f61440dc73f8 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:16:05.900662 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-09042cc9-0b95-457a-bba0-f61440dc73f8 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72" status: 204 len: 0 microversion: 2.1 time: 0.320836 Jul 31 01:16:05.901587 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1037/2071] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:16:05 2022] DELETE /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:16:05.910912 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-23c6bbba-b9ae-4957-b405-a33d08270016 tempest-QuotasTestJSON-2123002736 tempest-QuotasTestJSON-2123002736-project] Calling method '.version_select at 0x7fede4eed940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:05.942476 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1319b48d-cda3-4749-a23a-2346b2d95c27 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:05.954704 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1319b48d-cda3-4749-a23a-2346b2d95c27 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 200 len: 1273 microversion: 2.1 time: 1.583759 Jul 31 01:16:05.955306 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1035/2072] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:04 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 1273 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:05.963846 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-393991be-64b2-41ef-9cb9-66ccbe3d8a00 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:05.970123 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-393991be-64b2-41ef-9cb9-66ccbe3d8a00 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:05.989998 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-393991be-64b2-41ef-9cb9-66ccbe3d8a00 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:05.990490 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-393991be-64b2-41ef-9cb9-66ccbe3d8a00 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:05.991559 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-393991be-64b2-41ef-9cb9-66ccbe3d8a00 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:05.992849 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-393991be-64b2-41ef-9cb9-66ccbe3d8a00 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:06.183801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-393991be-64b2-41ef-9cb9-66ccbe3d8a00 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:06.201884 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-393991be-64b2-41ef-9cb9-66ccbe3d8a00 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:06.203636 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-393991be-64b2-41ef-9cb9-66ccbe3d8a00 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:06.205030 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-393991be-64b2-41ef-9cb9-66ccbe3d8a00 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1592 microversion: 2.32 time: 0.245096 Jul 31 01:16:06.205760 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1036/2073] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:05 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1592 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:06.356465 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-23c6bbba-b9ae-4957-b405-a33d08270016 tempest-QuotasTestJSON-2123002736 tempest-QuotasTestJSON-2123002736-project] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/d2ddd0646ff14d96924c2ff3938e401d?user_id=2cdc466b1ce441f58dbaee0868825627" status: 200 len: 371 microversion: 2.1 time: 0.452864 Jul 31 01:16:06.368049 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1038/2074] 10.222.0.45 () {58 vars in 1323 bytes} [Sun Jul 31 01:16:05 2022] GET /compute/v2.1/os-quota-sets/d2ddd0646ff14d96924c2ff3938e401d?user_id=2cdc466b1ce441f58dbaee0868825627 => generated 371 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:06.379670 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3954d9de-aed7-4999-8329-43394de6b8ae tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:06.381318 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3954d9de-aed7-4999-8329-43394de6b8ae tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:06.396565 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3954d9de-aed7-4999-8329-43394de6b8ae tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:06.398884 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3954d9de-aed7-4999-8329-43394de6b8ae tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:06.400074 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3954d9de-aed7-4999-8329-43394de6b8ae tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:06.401860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3954d9de-aed7-4999-8329-43394de6b8ae tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:06.483971 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c03ac29f-58a3-48c5-b24d-375ceb0326c8 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1727594975", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:06.633934 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-c03ac29f-58a3-48c5-b24d-375ceb0326c8 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:16:07.010950 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3954d9de-aed7-4999-8329-43394de6b8ae tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:07.019915 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3954d9de-aed7-4999-8329-43394de6b8ae tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72" status: 200 len: 1680 microversion: 2.1 time: 0.650458 Jul 31 01:16:07.033755 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1039/2075] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:06 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72 => generated 1680 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:07.040149 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fb7af8dc-455c-476b-839b-fa7ca6cf79ff tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:07.041070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fb7af8dc-455c-476b-839b-fa7ca6cf79ff tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:07.047932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb7af8dc-455c-476b-839b-fa7ca6cf79ff tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:07.048616 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb7af8dc-455c-476b-839b-fa7ca6cf79ff tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:07.049585 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb7af8dc-455c-476b-839b-fa7ca6cf79ff tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:07.050171 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb7af8dc-455c-476b-839b-fa7ca6cf79ff tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:07.339109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-c03ac29f-58a3-48c5-b24d-375ceb0326c8 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:16:07.339697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-c03ac29f-58a3-48c5-b24d-375ceb0326c8 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:16:07.341330 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-c03ac29f-58a3-48c5-b24d-375ceb0326c8 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:16:07.341787 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-c03ac29f-58a3-48c5-b24d-375ceb0326c8 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:16:07.342528 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-c03ac29f-58a3-48c5-b24d-375ceb0326c8 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:16:07.365708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c03ac29f-58a3-48c5-b24d-375ceb0326c8 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:07.366315 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c03ac29f-58a3-48c5-b24d-375ceb0326c8 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:07.367814 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c03ac29f-58a3-48c5-b24d-375ceb0326c8 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:07.372211 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c03ac29f-58a3-48c5-b24d-375ceb0326c8 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:07.417544 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-c03ac29f-58a3-48c5-b24d-375ceb0326c8 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Getting quotas for project 2101da474ab040c7a0b921a282f220cf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:16:07.432631 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-c03ac29f-58a3-48c5-b24d-375ceb0326c8 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Getting quotas for user 5cb608462e3a45f69f9056550f16d869 and project 2101da474ab040c7a0b921a282f220cf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:16:07.444254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fb7af8dc-455c-476b-839b-fa7ca6cf79ff tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:07.454582 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fb7af8dc-455c-476b-839b-fa7ca6cf79ff tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1468 microversion: 2.1 time: 0.419308 Jul 31 01:16:07.457263 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1040/2076] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:07 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1468 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:07.463853 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aaddf8ca-e5dd-4975-a7c0-cd7f61e8104b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:07.464477 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aaddf8ca-e5dd-4975-a7c0-cd7f61e8104b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:07.473175 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c03ac29f-58a3-48c5-b24d-375ceb0326c8 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:16:07.473698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aaddf8ca-e5dd-4975-a7c0-cd7f61e8104b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:07.474644 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aaddf8ca-e5dd-4975-a7c0-cd7f61e8104b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:07.475606 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aaddf8ca-e5dd-4975-a7c0-cd7f61e8104b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:07.476855 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aaddf8ca-e5dd-4975-a7c0-cd7f61e8104b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:07.482638 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c03ac29f-58a3-48c5-b24d-375ceb0326c8 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:16:07.626033 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c03ac29f-58a3-48c5-b24d-375ceb0326c8 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.419012 Jul 31 01:16:07.634556 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1037/2077] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:16:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:16:07.642175 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f97251df-c8cd-4a75-b80a-09e44ebfb203 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:07.645509 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f97251df-c8cd-4a75-b80a-09e44ebfb203 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:07.664249 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-aaddf8ca-e5dd-4975-a7c0-cd7f61e8104b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:07.667673 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f97251df-c8cd-4a75-b80a-09e44ebfb203 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:07.670269 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f97251df-c8cd-4a75-b80a-09e44ebfb203 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:07.671672 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f97251df-c8cd-4a75-b80a-09e44ebfb203 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:07.672148 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f97251df-c8cd-4a75-b80a-09e44ebfb203 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:07.691027 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aaddf8ca-e5dd-4975-a7c0-cd7f61e8104b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 200 len: 1279 microversion: 2.1 time: 0.232594 Jul 31 01:16:07.698970 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1041/2078] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:07 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 1279 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:07.957276 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f97251df-c8cd-4a75-b80a-09e44ebfb203 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:07.976147 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f97251df-c8cd-4a75-b80a-09e44ebfb203 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:07.983122 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f97251df-c8cd-4a75-b80a-09e44ebfb203 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:07.986366 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f97251df-c8cd-4a75-b80a-09e44ebfb203 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1592 microversion: 2.32 time: 0.356076 Jul 31 01:16:07.989243 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1038/2079] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:07 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1592 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:08.021801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-aa5ddba8-bd97-4758-882f-a124f7e6325d tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:08.026092 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-aa5ddba8-bd97-4758-882f-a124f7e6325d tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:08.201171 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-aa5ddba8-bd97-4758-882f-a124f7e6325d tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb608462e3a45f69f9056550f16d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2101da474ab040c7a0b921a282f220cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:08.213814 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-aa5ddba8-bd97-4758-882f-a124f7e6325d tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 200 len: 1217 microversion: 2.1 time: 0.207828 Jul 31 01:16:08.220956 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1039/2080] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:07 2022] GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 1217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:08.243312 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-58bab530-d72f-4e41-aeef-50a14c6da3b8 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:08.255601 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-58bab530-d72f-4e41-aeef-50a14c6da3b8 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:08.276144 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58bab530-d72f-4e41-aeef-50a14c6da3b8 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:08.276650 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58bab530-d72f-4e41-aeef-50a14c6da3b8 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:08.284814 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58bab530-d72f-4e41-aeef-50a14c6da3b8 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:08.285294 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58bab530-d72f-4e41-aeef-50a14c6da3b8 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:08.394556 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cadfc216-3273-4ead-ae28-04b4b74a8dfa tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-630331127", "block_migration": true, "disk_over_commit": false}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:08.397574 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cadfc216-3273-4ead-ae28-04b4b74a8dfa tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:08.419834 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cadfc216-3273-4ead-ae28-04b4b74a8dfa tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:08.420839 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cadfc216-3273-4ead-ae28-04b4b74a8dfa tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:08.422509 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cadfc216-3273-4ead-ae28-04b4b74a8dfa tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:08.423879 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cadfc216-3273-4ead-ae28-04b4b74a8dfa tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:08.470758 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:08.484470 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-cadfc216-3273-4ead-ae28-04b4b74a8dfa tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lazy-loading 'flavor' on Instance uuid 51fae254-0bd2-4470-a05b-bf0e83d7c3dc {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:16:08.524043 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cadfc216-3273-4ead-ae28-04b4b74a8dfa tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Going to try to live migrate instance to tempest-host-630331127 {{(pid=119474) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 31 01:16:08.534509 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-cadfc216-3273-4ead-ae28-04b4b74a8dfa tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] HTTP exception thrown: Compute host tempest-host-630331127 could not be found. Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cadfc216-3273-4ead-ae28-04b4b74a8dfa tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Request method failure captured: Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc/action HTTP/1.1 Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 106 Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5de63DzerqiA1fNHcQtwNamley94YV8_b5ngEE6J9Jhn3wtTDyQt91A635Uak6ysnJwEIZg1a2N6_cvnWVaKhaNEqzrKcSG_OlsOBfkTsAXEJyRhZd4_c0PX20pTwqiXENaaFPdNzC2XpwAiWA8d35-7ufa29tGHFQO5SEXY9XtKuRY Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: de1d861fb0d64440b16227ef36cdac6f Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-LiveMigrationNegativeTest-1869567889 Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/de1d861fb0d64440b16227ef36cdac6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/de1d861fb0d64440b16227ef36cdac6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/de1d861fb0d64440b16227ef36cdac6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_de1d861fb0d64440b16227ef36cdac6f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-LiveMigrationNegativeTest-1869567889 Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: de1d861fb0d64440b16227ef36cdac6f Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1869567889 Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-LiveMigrationNegativeTest-1869567889-project-admin Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: e81f89a9ca924c5f895d22c0e85ebe04 Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-LiveMigrationNegativeTest-1869567889-project-admin Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: {"os-migrateLive": {"host": "tempest-host-630331127", "block_migration": true, "disk_over_commit": false}} Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: exception: Compute host tempest-host-630331127 could not be found. Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '51fae254-0bd2-4470-a05b-bf0e83d7c3dc', 'body': {'os-migrateLive': {'host': 'tempest-host-630331127', 'block_migration': True, 'disk_over_commit': False}}} Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5436, in live_migrate Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 31 01:16:08.569864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-630331127 could not be found. Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-630331127 could not be found. Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-630331127 could not be found. Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cadfc216-3273-4ead-ae28-04b4b74a8dfa tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Returning 400 to user: Compute host tempest-host-630331127 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cadfc216-3273-4ead-ae28-04b4b74a8dfa tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc/action" status: 400 len: 99 microversion: 2.1 time: 0.871977 Jul 31 01:16:08.580998 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1042/2081] 10.222.0.45 () {60 vars in 1279 bytes} [Sun Jul 31 01:16:07 2022] POST /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc/action => generated 99 bytes in 873 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:08.588705 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b9c1e280-c98f-4942-865f-76b15eecf258 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:08.589987 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b9c1e280-c98f-4942-865f-76b15eecf258 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:08.607010 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9c1e280-c98f-4942-865f-76b15eecf258 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:08.613816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9c1e280-c98f-4942-865f-76b15eecf258 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:08.615329 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9c1e280-c98f-4942-865f-76b15eecf258 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:08.615459 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9c1e280-c98f-4942-865f-76b15eecf258 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:08.901861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-58bab530-d72f-4e41-aeef-50a14c6da3b8 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:08.921691 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-58bab530-d72f-4e41-aeef-50a14c6da3b8 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72" status: 200 len: 1680 microversion: 2.1 time: 0.699762 Jul 31 01:16:08.922293 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1040/2082] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:08 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72 => generated 1680 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:08.942741 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-24651568-6db1-4dce-833a-8ded898557c6 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:08.943780 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-24651568-6db1-4dce-833a-8ded898557c6 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:08.958386 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24651568-6db1-4dce-833a-8ded898557c6 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:08.962434 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24651568-6db1-4dce-833a-8ded898557c6 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:08.963481 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24651568-6db1-4dce-833a-8ded898557c6 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:08.964083 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24651568-6db1-4dce-833a-8ded898557c6 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:09.233831 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b9c1e280-c98f-4942-865f-76b15eecf258 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:09.274416 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b9c1e280-c98f-4942-865f-76b15eecf258 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1468 microversion: 2.1 time: 0.694756 Jul 31 01:16:09.303961 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1043/2083] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:08 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1468 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:09.356795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-66a0debe-c2f8-4867-b2a0-5e8e92315ba9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:09.358687 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-66a0debe-c2f8-4867-b2a0-5e8e92315ba9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:09.379795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66a0debe-c2f8-4867-b2a0-5e8e92315ba9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:09.383596 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66a0debe-c2f8-4867-b2a0-5e8e92315ba9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:09.385230 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66a0debe-c2f8-4867-b2a0-5e8e92315ba9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:09.385455 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66a0debe-c2f8-4867-b2a0-5e8e92315ba9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:09.387077 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-24651568-6db1-4dce-833a-8ded898557c6 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:09.414952 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-24651568-6db1-4dce-833a-8ded898557c6 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 200 len: 1321 microversion: 2.1 time: 0.469806 Jul 31 01:16:09.415682 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1041/2084] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:08 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 1321 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:09.446184 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1687ae37-5657-44f4-ad2b-ec29f2157d1c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:09.446840 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1687ae37-5657-44f4-ad2b-ec29f2157d1c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:09.483879 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1687ae37-5657-44f4-ad2b-ec29f2157d1c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:09.484472 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1687ae37-5657-44f4-ad2b-ec29f2157d1c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:09.489210 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1687ae37-5657-44f4-ad2b-ec29f2157d1c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:09.491148 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1687ae37-5657-44f4-ad2b-ec29f2157d1c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:09.750054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1687ae37-5657-44f4-ad2b-ec29f2157d1c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb608462e3a45f69f9056550f16d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2101da474ab040c7a0b921a282f220cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:09.766256 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1687ae37-5657-44f4-ad2b-ec29f2157d1c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 200 len: 1269 microversion: 2.1 time: 0.324556 Jul 31 01:16:09.771503 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1042/2085] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:09 2022] GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 1269 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:09.781101 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-27628572-18e4-4d40-b5d2-0e44d722a698 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-422960787", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:09.887206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-27628572-18e4-4d40-b5d2-0e44d722a698 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:16:10.153302 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-66a0debe-c2f8-4867-b2a0-5e8e92315ba9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:10.201620 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-66a0debe-c2f8-4867-b2a0-5e8e92315ba9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:10.213261 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-66a0debe-c2f8-4867-b2a0-5e8e92315ba9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:10.217534 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-66a0debe-c2f8-4867-b2a0-5e8e92315ba9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1660 microversion: 2.32 time: 0.910971 Jul 31 01:16:10.235414 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1044/2086] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:09 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1660 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:10.274192 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3956ed89-68c6-4401-90d1-07d1d824cc48 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:10.277128 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3956ed89-68c6-4401-90d1-07d1d824cc48 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:10.297521 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3956ed89-68c6-4401-90d1-07d1d824cc48 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:10.300082 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3956ed89-68c6-4401-90d1-07d1d824cc48 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:10.301101 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3956ed89-68c6-4401-90d1-07d1d824cc48 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:10.302094 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3956ed89-68c6-4401-90d1-07d1d824cc48 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:11.135837 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3956ed89-68c6-4401-90d1-07d1d824cc48 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:11.146597 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3956ed89-68c6-4401-90d1-07d1d824cc48 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72" status: 200 len: 1680 microversion: 2.1 time: 0.901795 Jul 31 01:16:11.150236 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1045/2087] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:10 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72 => generated 1680 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:11.159382 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e43ad825-30dd-45bd-9637-556cb784f3b9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:11.163082 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e43ad825-30dd-45bd-9637-556cb784f3b9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:11.178638 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e43ad825-30dd-45bd-9637-556cb784f3b9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:11.181389 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e43ad825-30dd-45bd-9637-556cb784f3b9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:11.187771 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e43ad825-30dd-45bd-9637-556cb784f3b9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:11.188460 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e43ad825-30dd-45bd-9637-556cb784f3b9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:11.297382 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-27628572-18e4-4d40-b5d2-0e44d722a698 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:16:11.298678 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-27628572-18e4-4d40-b5d2-0e44d722a698 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:16:11.299404 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-27628572-18e4-4d40-b5d2-0e44d722a698 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:16:11.299975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-27628572-18e4-4d40-b5d2-0e44d722a698 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:16:11.300553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-27628572-18e4-4d40-b5d2-0e44d722a698 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:16:11.317119 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27628572-18e4-4d40-b5d2-0e44d722a698 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:11.318071 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27628572-18e4-4d40-b5d2-0e44d722a698 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:11.321815 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27628572-18e4-4d40-b5d2-0e44d722a698 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:11.322473 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27628572-18e4-4d40-b5d2-0e44d722a698 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:11.372124 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-27628572-18e4-4d40-b5d2-0e44d722a698 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Getting quotas for project 1f193d444cb7454e8181677060a126c5. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:16:11.388291 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-27628572-18e4-4d40-b5d2-0e44d722a698 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Getting quotas for user 9fced56492d64f4983157a0e5d7b1121 and project 1f193d444cb7454e8181677060a126c5. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:16:11.421506 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-27628572-18e4-4d40-b5d2-0e44d722a698 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:16:11.426468 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-27628572-18e4-4d40-b5d2-0e44d722a698 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:16:11.532488 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-27628572-18e4-4d40-b5d2-0e44d722a698 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.759498 Jul 31 01:16:11.537369 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1043/2088] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:16:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:16:11.550605 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a505fa8b-0664-484f-90f2-e725da0a45e9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:11.552843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a505fa8b-0664-484f-90f2-e725da0a45e9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:11.569827 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a505fa8b-0664-484f-90f2-e725da0a45e9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:11.574197 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a505fa8b-0664-484f-90f2-e725da0a45e9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:11.575367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a505fa8b-0664-484f-90f2-e725da0a45e9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:11.575957 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a505fa8b-0664-484f-90f2-e725da0a45e9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:12.043729 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e43ad825-30dd-45bd-9637-556cb784f3b9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:12.050271 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a505fa8b-0664-484f-90f2-e725da0a45e9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb608462e3a45f69f9056550f16d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2101da474ab040c7a0b921a282f220cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:12.055490 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e43ad825-30dd-45bd-9637-556cb784f3b9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 200 len: 1321 microversion: 2.1 time: 0.904063 Jul 31 01:16:12.056948 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1046/2089] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:11 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 1321 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:12.061093 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a505fa8b-0664-484f-90f2-e725da0a45e9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 200 len: 1275 microversion: 2.1 time: 0.520488 Jul 31 01:16:12.068078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a1514907-4891-411e-8776-100355c6418b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede4f68040>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:12.078861 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1044/2090] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:11 2022] GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 1275 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:12.095483 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cb9368b2-1991-44b9-9553-0fb5f61a7f0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:12.096218 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cb9368b2-1991-44b9-9553-0fb5f61a7f0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:12.122763 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb9368b2-1991-44b9-9553-0fb5f61a7f0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:12.131642 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb9368b2-1991-44b9-9553-0fb5f61a7f0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:12.135025 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb9368b2-1991-44b9-9553-0fb5f61a7f0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:12.138270 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb9368b2-1991-44b9-9553-0fb5f61a7f0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:12.330345 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:12.694479 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a1514907-4891-411e-8776-100355c6418b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/afb49c93-59c9-43b4-b788-5493a2c790a3" status: 200 len: 662 microversion: 2.1 time: 0.635186 Jul 31 01:16:12.718006 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1047/2091] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:12 2022] GET /compute/v2.1/images/afb49c93-59c9-43b4-b788-5493a2c790a3 => generated 662 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:12.731805 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5bab0920-f020-424c-8cae-add308dbd038 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:12.732445 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5bab0920-f020-424c-8cae-add308dbd038 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:12.763008 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5bab0920-f020-424c-8cae-add308dbd038 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:12.763627 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5bab0920-f020-424c-8cae-add308dbd038 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:12.767799 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5bab0920-f020-424c-8cae-add308dbd038 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:12.768275 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5bab0920-f020-424c-8cae-add308dbd038 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:12.967927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5bab0920-f020-424c-8cae-add308dbd038 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:12.983142 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5bab0920-f020-424c-8cae-add308dbd038 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1222 microversion: 2.1 time: 0.262920 Jul 31 01:16:12.995883 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1048/2092] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:12 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1222 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:13.001958 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-75dd7b24-d89e-46bb-865e-5e4948feda51 req-456222e3-14c5-481b-bcd8-644822288820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bc94263-b6c3-4954-95b3-345029530b02", "tag": "880daa84-d784-47a1-a8ef-1ddd63cf3602"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:13.029513 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-75dd7b24-d89e-46bb-865e-5e4948feda51 req-456222e3-14c5-481b-bcd8-644822288820 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:13.029977 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-75dd7b24-d89e-46bb-865e-5e4948feda51 req-456222e3-14c5-481b-bcd8-644822288820 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:13.067488 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-75dd7b24-d89e-46bb-865e-5e4948feda51 req-456222e3-14c5-481b-bcd8-644822288820 service nova] Creating event network-changed:880daa84-d784-47a1-a8ef-1ddd63cf3602 for instance 2bc94263-b6c3-4954-95b3-345029530b02 on n-h1-master-1 Jul 31 01:16:13.077471 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-75dd7b24-d89e-46bb-865e-5e4948feda51 req-456222e3-14c5-481b-bcd8-644822288820 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090633 Jul 31 01:16:13.079203 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1049/2093] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:13.091821 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-2542343c-0290-47ba-9962-3b5bc167e061 req-f723b4f9-583d-4b6c-afda-9170c7752b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41f3bd8-298a-48ec-a3da-8e6bc5c459ea", "tag": "ebda67a3-3819-43d1-a74f-77f6d46add98"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:13.105534 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2542343c-0290-47ba-9962-3b5bc167e061 req-f723b4f9-583d-4b6c-afda-9170c7752b4e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:13.105978 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2542343c-0290-47ba-9962-3b5bc167e061 req-f723b4f9-583d-4b6c-afda-9170c7752b4e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:13.119704 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-2542343c-0290-47ba-9962-3b5bc167e061 req-f723b4f9-583d-4b6c-afda-9170c7752b4e service nova] Creating event network-changed:ebda67a3-3819-43d1-a74f-77f6d46add98 for instance f41f3bd8-298a-48ec-a3da-8e6bc5c459ea on n-h2-master-1 Jul 31 01:16:13.133392 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-2542343c-0290-47ba-9962-3b5bc167e061 req-f723b4f9-583d-4b6c-afda-9170c7752b4e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041358 Jul 31 01:16:13.134355 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1050/2094] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:13.140146 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4b7dec91-cd35-416a-9ab7-ea11fe373687 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:13.140860 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4b7dec91-cd35-416a-9ab7-ea11fe373687 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:13.149032 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b7dec91-cd35-416a-9ab7-ea11fe373687 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:13.150282 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b7dec91-cd35-416a-9ab7-ea11fe373687 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:13.151378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b7dec91-cd35-416a-9ab7-ea11fe373687 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:13.151970 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b7dec91-cd35-416a-9ab7-ea11fe373687 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:13.246518 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cb9368b2-1991-44b9-9553-0fb5f61a7f0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:13.269952 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cb9368b2-1991-44b9-9553-0fb5f61a7f0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:13.271839 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cb9368b2-1991-44b9-9553-0fb5f61a7f0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:13.273733 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cb9368b2-1991-44b9-9553-0fb5f61a7f0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1660 microversion: 2.32 time: 1.191672 Jul 31 01:16:13.274513 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1045/2095] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:12 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1660 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:13.281723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b7281fa3-af4e-460a-ab55-2450e50c17bd tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede52c5700>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:13.308508 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4b7dec91-cd35-416a-9ab7-ea11fe373687 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:13.340262 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4b7dec91-cd35-416a-9ab7-ea11fe373687 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72" status: 200 len: 1613 microversion: 2.1 time: 0.200006 Jul 31 01:16:13.344009 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1051/2096] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:13 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72 => generated 1613 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:13.362820 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b7281fa3-af4e-460a-ab55-2450e50c17bd tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/afb49c93-59c9-43b4-b788-5493a2c790a3" status: 200 len: 662 microversion: 2.1 time: 0.076673 Jul 31 01:16:13.364233 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1046/2097] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:13 2022] GET /compute/v2.1/images/afb49c93-59c9-43b4-b788-5493a2c790a3 => generated 662 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:13.373926 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ecab50b2-772d-4910-ba2d-a7f947f5f40d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:13.375812 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ecab50b2-772d-4910-ba2d-a7f947f5f40d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:13.412836 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecab50b2-772d-4910-ba2d-a7f947f5f40d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:13.414049 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecab50b2-772d-4910-ba2d-a7f947f5f40d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:13.415188 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecab50b2-772d-4910-ba2d-a7f947f5f40d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:13.415920 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecab50b2-772d-4910-ba2d-a7f947f5f40d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:13.696310 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-610e1e48-ab9b-442e-8c7e-824471b42e12 tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] Action: 'create', calling method: .version_select at 0x7fede4ed20d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1858740168", "metadata": {"Type": "work"}}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:13.824101 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ecab50b2-772d-4910-ba2d-a7f947f5f40d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:13.832190 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ecab50b2-772d-4910-ba2d-a7f947f5f40d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 200 len: 1321 microversion: 2.1 time: 0.467322 Jul 31 01:16:13.841107 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1047/2098] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:13 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 1321 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:13.849178 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-35ceec0a-0138-4721-8b30-1175ed78ff5e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:13.855811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-35ceec0a-0138-4721-8b30-1175ed78ff5e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:13.877707 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35ceec0a-0138-4721-8b30-1175ed78ff5e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:13.879588 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35ceec0a-0138-4721-8b30-1175ed78ff5e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:13.881199 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35ceec0a-0138-4721-8b30-1175ed78ff5e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:13.883024 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35ceec0a-0138-4721-8b30-1175ed78ff5e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:14.254036 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-35ceec0a-0138-4721-8b30-1175ed78ff5e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb608462e3a45f69f9056550f16d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2101da474ab040c7a0b921a282f220cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:14.273841 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-35ceec0a-0138-4721-8b30-1175ed78ff5e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 200 len: 1317 microversion: 2.1 time: 0.430614 Jul 31 01:16:14.274788 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1048/2099] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:13 2022] GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:14.282522 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-09b3dd30-dd32-4ebe-9b05-80c3f416c3a2 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:14.283263 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-09b3dd30-dd32-4ebe-9b05-80c3f416c3a2 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:14.293442 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09b3dd30-dd32-4ebe-9b05-80c3f416c3a2 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:14.293902 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09b3dd30-dd32-4ebe-9b05-80c3f416c3a2 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:14.294716 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09b3dd30-dd32-4ebe-9b05-80c3f416c3a2 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:14.295158 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09b3dd30-dd32-4ebe-9b05-80c3f416c3a2 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:14.425603 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-610e1e48-ab9b-442e-8c7e-824471b42e12 tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.077696 Jul 31 01:16:14.427145 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1052/2100] 10.222.0.45 () {60 vars in 1156 bytes} [Sun Jul 31 01:16:13 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1082 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 31 01:16:14.432431 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7379de58-07f3-45c7-aa63-034c867f87bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:14.433563 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7379de58-07f3-45c7-aa63-034c867f87bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:14.448977 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7379de58-07f3-45c7-aa63-034c867f87bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:14.454890 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7379de58-07f3-45c7-aa63-034c867f87bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:14.458518 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7379de58-07f3-45c7-aa63-034c867f87bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:14.459310 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7379de58-07f3-45c7-aa63-034c867f87bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:14.531138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-09b3dd30-dd32-4ebe-9b05-80c3f416c3a2 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:14.545523 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-09b3dd30-dd32-4ebe-9b05-80c3f416c3a2 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1276 microversion: 2.1 time: 0.269439 Jul 31 01:16:14.546324 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1049/2101] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:14 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1276 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:14.580074 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-52249cbd-6af7-4d87-a54a-439ec84163b1 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:14.598599 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-52249cbd-6af7-4d87-a54a-439ec84163b1 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:14.603961 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52249cbd-6af7-4d87-a54a-439ec84163b1 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:14.606775 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52249cbd-6af7-4d87-a54a-439ec84163b1 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:14.607818 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52249cbd-6af7-4d87-a54a-439ec84163b1 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:14.611257 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52249cbd-6af7-4d87-a54a-439ec84163b1 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:14.786907 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-52249cbd-6af7-4d87-a54a-439ec84163b1 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5532c17656432182ae9da0d1e2ad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b342e518054a56b42112c5dec71b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:14.797837 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-52249cbd-6af7-4d87-a54a-439ec84163b1 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72" status: 200 len: 1613 microversion: 2.1 time: 0.229146 Jul 31 01:16:14.805144 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1050/2102] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:14 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72 => generated 1613 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:14.827113 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7379de58-07f3-45c7-aa63-034c867f87bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:14.832895 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-679e47a3-ddf7-4ef6-aac7-3d077d468afa tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] Calling method '.version_select at 0x7fedea924160>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:14.851982 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7379de58-07f3-45c7-aa63-034c867f87bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:14.858580 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7379de58-07f3-45c7-aa63-034c867f87bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:14.874640 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7379de58-07f3-45c7-aa63-034c867f87bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1707 microversion: 2.32 time: 0.445517 Jul 31 01:16:14.882764 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1053/2103] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:14 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1707 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:14.922543 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e67c3d54-0d02-4d0a-8391-a299e77983dd tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:14.923631 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e67c3d54-0d02-4d0a-8391-a299e77983dd tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:14.947967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e67c3d54-0d02-4d0a-8391-a299e77983dd tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:14.958038 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e67c3d54-0d02-4d0a-8391-a299e77983dd tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:14.959584 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e67c3d54-0d02-4d0a-8391-a299e77983dd tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:14.960326 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e67c3d54-0d02-4d0a-8391-a299e77983dd tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:15.084976 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-679e47a3-ddf7-4ef6-aac7-3d077d468afa tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/08bf5366-bedf-48d8-aed1-efe4d45bb801" status: 200 len: 353 microversion: 2.1 time: 0.259821 Jul 31 01:16:15.086414 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1051/2104] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:16:14 2022] GET /compute/v2.1/os-volumes/08bf5366-bedf-48d8-aed1-efe4d45bb801 => generated 353 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:15.233864 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-09f0536f-5e2d-4c8c-b342-d557cad325eb req-6bd0324a-a67b-4e12-a414-f875b7ec8e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1062351b-6cff-4363-a029-ddfbb14c6f72", "name": "network-vif-deleted", "tag": "21c27aad-5f1a-4ce4-aa63-e68cdcf475fe"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:15.251856 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-09f0536f-5e2d-4c8c-b342-d557cad325eb req-6bd0324a-a67b-4e12-a414-f875b7ec8e56 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:15.252312 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-09f0536f-5e2d-4c8c-b342-d557cad325eb req-6bd0324a-a67b-4e12-a414-f875b7ec8e56 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:15.280137 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-09f0536f-5e2d-4c8c-b342-d557cad325eb req-6bd0324a-a67b-4e12-a414-f875b7ec8e56 service nova] Creating event network-vif-deleted:21c27aad-5f1a-4ce4-aa63-e68cdcf475fe for instance 1062351b-6cff-4363-a029-ddfbb14c6f72 on n-h2-master-1 Jul 31 01:16:15.296180 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-09f0536f-5e2d-4c8c-b342-d557cad325eb req-6bd0324a-a67b-4e12-a414-f875b7ec8e56 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066973 Jul 31 01:16:15.300346 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1052/2105] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:16:15.318080 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b547d7b7-05aa-4443-a5ca-3ecb5ae02f60 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:15.319044 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b547d7b7-05aa-4443-a5ca-3ecb5ae02f60 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:15.329910 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b547d7b7-05aa-4443-a5ca-3ecb5ae02f60 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:15.335067 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b547d7b7-05aa-4443-a5ca-3ecb5ae02f60 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:15.336944 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b547d7b7-05aa-4443-a5ca-3ecb5ae02f60 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:15.338455 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b547d7b7-05aa-4443-a5ca-3ecb5ae02f60 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:16.248980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e67c3d54-0d02-4d0a-8391-a299e77983dd tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:16.263554 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e67c3d54-0d02-4d0a-8391-a299e77983dd tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 200 len: 1321 microversion: 2.1 time: 1.375149 Jul 31 01:16:16.267357 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1054/2106] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:14 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 1321 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:16.277709 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d366c326-b146-4851-a62e-0629f85df395 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:16.278745 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d366c326-b146-4851-a62e-0629f85df395 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:16.299953 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d366c326-b146-4851-a62e-0629f85df395 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:16.304805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d366c326-b146-4851-a62e-0629f85df395 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:16.307866 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d366c326-b146-4851-a62e-0629f85df395 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:16.308472 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d366c326-b146-4851-a62e-0629f85df395 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:16.360834 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=24 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:16.963985 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d366c326-b146-4851-a62e-0629f85df395 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:16.985416 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b547d7b7-05aa-4443-a5ca-3ecb5ae02f60 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb608462e3a45f69f9056550f16d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2101da474ab040c7a0b921a282f220cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:16.994008 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b547d7b7-05aa-4443-a5ca-3ecb5ae02f60 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 200 len: 1317 microversion: 2.1 time: 1.680760 Jul 31 01:16:16.994611 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1053/2107] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:15 2022] GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 1317 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:16:16.995295 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d366c326-b146-4851-a62e-0629f85df395 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1276 microversion: 2.1 time: 0.726493 Jul 31 01:16:16.996218 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1055/2108] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:16 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1276 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:17.001916 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9a18153f-1464-4c81-bb27-4d225785c897 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:17.002921 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9a18153f-1464-4c81-bb27-4d225785c897 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] [instance: 1062351b-6cff-4363-a029-ddfbb14c6f72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:17.007982 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2a2c6900-01f8-4c05-a8b0-3089a7b68f43 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede51d3670>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:17.017928 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a18153f-1464-4c81-bb27-4d225785c897 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:17.018639 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a18153f-1464-4c81-bb27-4d225785c897 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:17.019744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a18153f-1464-4c81-bb27-4d225785c897 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:17.020469 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a18153f-1464-4c81-bb27-4d225785c897 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:17.071831 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-9a18153f-1464-4c81-bb27-4d225785c897 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] HTTP exception thrown: Instance 1062351b-6cff-4363-a029-ddfbb14c6f72 could not be found. Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9a18153f-1464-4c81-bb27-4d225785c897 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Request method failure captured: Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72 HTTP/1.1 Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dcYFiMJvfUamP7OU1EExTydP5l2kxHX8Gj0uSPuVxH3lVqZX41QYFW3jpPwayOM93gOaNIe8-4ED4g2HdyckIBM7FPdQP9EGenrJfOhYc0TKEQIPHUCaBMgXw0NkuDnyPqkenn3grHrVGtbmDWm6g2LyBtRwXVrjNzui-2AqXj4c2A Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 47b342e518054a56b42112c5dec71b2f Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesAdminNegativeTest-1012692366 Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/47b342e518054a56b42112c5dec71b2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/47b342e518054a56b42112c5dec71b2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/47b342e518054a56b42112c5dec71b2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_47b342e518054a56b42112c5dec71b2f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesAdminNegativeTest-1012692366 Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 47b342e518054a56b42112c5dec71b2f Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1012692366 Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesAdminNegativeTest-1012692366-project Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 6e5532c17656432182ae9da0d1e2ad67 Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesAdminNegativeTest-1012692366-project Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 1062351b-6cff-4363-a029-ddfbb14c6f72 could not be found. Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '1062351b-6cff-4363-a029-ddfbb14c6f72'} Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1062351b-6cff-4363-a029-ddfbb14c6f72 could not be found. Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1062351b-6cff-4363-a029-ddfbb14c6f72 could not be found. Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:16:17.076564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:17.080749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:17.080749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:16:17.080749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:16:17.080749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:16:17.080749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:16:17.080749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1062351b-6cff-4363-a029-ddfbb14c6f72 could not be found. Jul 31 01:16:17.080749 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:17.081188 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2a2c6900-01f8-4c05-a8b0-3089a7b68f43 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/841ea579-f4a4-4d94-a78c-a79ccc8d63e5" status: 200 len: 662 microversion: 2.1 time: 0.081388 Jul 31 01:16:17.081867 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1054/2109] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:16 2022] GET /compute/v2.1/images/841ea579-f4a4-4d94-a78c-a79ccc8d63e5 => generated 662 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:17.082811 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9a18153f-1464-4c81-bb27-4d225785c897 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Returning 404 to user: Instance 1062351b-6cff-4363-a029-ddfbb14c6f72 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:16:17.085347 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9a18153f-1464-4c81-bb27-4d225785c897 tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72" status: 404 len: 111 microversion: 2.1 time: 0.087548 Jul 31 01:16:17.088049 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1056/2110] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:16 2022] GET /compute/v2.1/servers/1062351b-6cff-4363-a029-ddfbb14c6f72 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:16:17.093307 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4691b85f-f31d-4bae-b0bd-1db7cd6e0e0d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:17.094090 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4691b85f-f31d-4bae-b0bd-1db7cd6e0e0d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:17.095702 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7587ce48-7d10-4595-9bcf-fb22de12c993 tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] Calling method '.version_select at 0x7fede4ede820>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:17.129716 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4691b85f-f31d-4bae-b0bd-1db7cd6e0e0d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:17.130287 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4691b85f-f31d-4bae-b0bd-1db7cd6e0e0d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:17.131082 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4691b85f-f31d-4bae-b0bd-1db7cd6e0e0d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:17.131478 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4691b85f-f31d-4bae-b0bd-1db7cd6e0e0d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:17.141016 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:17.178670 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7587ce48-7d10-4595-9bcf-fb22de12c993 tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/08bf5366-bedf-48d8-aed1-efe4d45bb801" status: 200 len: 354 microversion: 2.1 time: 0.088682 Jul 31 01:16:17.180286 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1057/2111] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:16:17 2022] GET /compute/v2.1/os-volumes/08bf5366-bedf-48d8-aed1-efe4d45bb801 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:17.184606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-87d873a3-e605-4ace-bfef-5b8808363bc0 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede4ede940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:17.238234 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-87d873a3-e605-4ace-bfef-5b8808363bc0 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/841ea579-f4a4-4d94-a78c-a79ccc8d63e5" status: 200 len: 662 microversion: 2.1 time: 0.057372 Jul 31 01:16:17.238827 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1058/2112] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:17 2022] GET /compute/v2.1/images/841ea579-f4a4-4d94-a78c-a79ccc8d63e5 => generated 662 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:17.243859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c1d658e9-ff4a-4564-8cc3-69978b11df8c tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] Calling method '.version_select at 0x7fede4ede160>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:17.297332 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c1d658e9-ff4a-4564-8cc3-69978b11df8c tempest-VolumesAdminNegativeTest-1012692366 tempest-VolumesAdminNegativeTest-1012692366-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599966760" status: 202 len: 0 microversion: 2.1 time: 0.057128 Jul 31 01:16:17.301534 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1059/2113] 10.222.0.45 () {58 vars in 1221 bytes} [Sun Jul 31 01:16:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599966760 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:16:17.306711 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ab553e4c-f9e3-4ae4-adda-6191567df9c0 tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] Calling method '.version_select at 0x7fede4e0d820>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:17.409693 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ab553e4c-f9e3-4ae4-adda-6191567df9c0 tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/08bf5366-bedf-48d8-aed1-efe4d45bb801" status: 200 len: 354 microversion: 2.1 time: 0.106788 Jul 31 01:16:17.410983 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1060/2114] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:16:17 2022] GET /compute/v2.1/os-volumes/08bf5366-bedf-48d8-aed1-efe4d45bb801 => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:17.422662 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1339b591-d6a6-4a55-8abf-a920eb70778d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:17.423666 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1339b591-d6a6-4a55-8abf-a920eb70778d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:17.440720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1339b591-d6a6-4a55-8abf-a920eb70778d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:17.441857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1339b591-d6a6-4a55-8abf-a920eb70778d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:17.443972 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1339b591-d6a6-4a55-8abf-a920eb70778d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:17.447869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1339b591-d6a6-4a55-8abf-a920eb70778d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:17.822146 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4691b85f-f31d-4bae-b0bd-1db7cd6e0e0d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:17.843752 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4691b85f-f31d-4bae-b0bd-1db7cd6e0e0d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:17.853649 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4691b85f-f31d-4bae-b0bd-1db7cd6e0e0d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:17.859781 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4691b85f-f31d-4bae-b0bd-1db7cd6e0e0d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1707 microversion: 2.32 time: 0.776782 Jul 31 01:16:17.860443 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1055/2115] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:17 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1707 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:17.874461 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-b1eb9e0a-3910-4e0b-96be-562f6da1120a req-3cfaf5fd-8490-4c0f-923c-36e2147b9dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e902288-e069-4d67-9804-2a58970a96c0", "tag": "7a0675a8-1c66-48f3-aa9c-ba7c125458e4"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:17.904483 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b1eb9e0a-3910-4e0b-96be-562f6da1120a req-3cfaf5fd-8490-4c0f-923c-36e2147b9dee service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:17.905197 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b1eb9e0a-3910-4e0b-96be-562f6da1120a req-3cfaf5fd-8490-4c0f-923c-36e2147b9dee service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:17.936253 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-b1eb9e0a-3910-4e0b-96be-562f6da1120a req-3cfaf5fd-8490-4c0f-923c-36e2147b9dee service nova] Creating event network-changed:7a0675a8-1c66-48f3-aa9c-ba7c125458e4 for instance 4e902288-e069-4d67-9804-2a58970a96c0 on n-h2-master-1 Jul 31 01:16:17.953617 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-b1eb9e0a-3910-4e0b-96be-562f6da1120a req-3cfaf5fd-8490-4c0f-923c-36e2147b9dee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090068 Jul 31 01:16:17.955663 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1056/2116] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:17.970177 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a529d1a8-df2b-488a-afff-c158ca5d2335 tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] Calling method '.version_select at 0x7fede52db790>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:18.153463 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a529d1a8-df2b-488a-afff-c158ca5d2335 tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/08bf5366-bedf-48d8-aed1-efe4d45bb801" status: 202 len: 0 microversion: 2.1 time: 0.196072 Jul 31 01:16:18.154186 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1057/2117] 10.222.0.45 () {58 vars in 1248 bytes} [Sun Jul 31 01:16:17 2022] DELETE /compute/v2.1/os-volumes/08bf5366-bedf-48d8-aed1-efe4d45bb801 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:16:18.159763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3cddecf2-4d74-47a8-ad00-a76012595128 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:18.160524 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3cddecf2-4d74-47a8-ad00-a76012595128 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:18.181703 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3cddecf2-4d74-47a8-ad00-a76012595128 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:18.182526 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3cddecf2-4d74-47a8-ad00-a76012595128 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:18.185413 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3cddecf2-4d74-47a8-ad00-a76012595128 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:18.187839 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3cddecf2-4d74-47a8-ad00-a76012595128 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:18.265173 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1339b591-d6a6-4a55-8abf-a920eb70778d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:18.295111 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1339b591-d6a6-4a55-8abf-a920eb70778d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 200 len: 1321 microversion: 2.1 time: 0.875515 Jul 31 01:16:18.295949 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1061/2118] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:17 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 1321 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:18.332275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2afc2905-f7a7-4c69-85fa-e73cd48ec697 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:18.333950 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2afc2905-f7a7-4c69-85fa-e73cd48ec697 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:18.356180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2afc2905-f7a7-4c69-85fa-e73cd48ec697 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:18.358497 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2afc2905-f7a7-4c69-85fa-e73cd48ec697 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:18.368170 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2afc2905-f7a7-4c69-85fa-e73cd48ec697 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:18.371581 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2afc2905-f7a7-4c69-85fa-e73cd48ec697 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:19.595631 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3cddecf2-4d74-47a8-ad00-a76012595128 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb608462e3a45f69f9056550f16d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2101da474ab040c7a0b921a282f220cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:19.605401 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3cddecf2-4d74-47a8-ad00-a76012595128 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 200 len: 1317 microversion: 2.1 time: 1.450206 Jul 31 01:16:19.615064 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1058/2119] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:18 2022] GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 1317 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:19.635951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-acdb47d6-955c-4407-961d-63e99d1e215b req-906754c8-ea23-44e8-84b0-e9ad5bfcac6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0005650d-9c5d-49ff-bae8-1f9efe4322f5", "tag": "2b6d29d2-1181-470a-9af3-c5ffa1afc021"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:19.661818 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-acdb47d6-955c-4407-961d-63e99d1e215b req-906754c8-ea23-44e8-84b0-e9ad5bfcac6c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:19.667920 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-acdb47d6-955c-4407-961d-63e99d1e215b req-906754c8-ea23-44e8-84b0-e9ad5bfcac6c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:19.695694 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-acdb47d6-955c-4407-961d-63e99d1e215b req-906754c8-ea23-44e8-84b0-e9ad5bfcac6c service nova] Creating event network-changed:2b6d29d2-1181-470a-9af3-c5ffa1afc021 for instance 0005650d-9c5d-49ff-bae8-1f9efe4322f5 on n-h2-master-1 Jul 31 01:16:19.707226 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-acdb47d6-955c-4407-961d-63e99d1e215b req-906754c8-ea23-44e8-84b0-e9ad5bfcac6c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089456 Jul 31 01:16:19.709440 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1059/2120] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:19.722506 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-add32bd6-dcbf-4554-b565-6a18b99c23e2 tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] Calling method '.version_select at 0x7fede52dbd30>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:19.841843 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-add32bd6-dcbf-4554-b565-6a18b99c23e2 tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/08bf5366-bedf-48d8-aed1-efe4d45bb801" status: 200 len: 353 microversion: 2.1 time: 0.130367 Jul 31 01:16:19.842752 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1060/2121] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:16:19 2022] GET /compute/v2.1/os-volumes/08bf5366-bedf-48d8-aed1-efe4d45bb801 => generated 353 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:19.852297 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e047e5d-7845-4e2f-9fca-d2ebda6b9c7c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:19.853353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3e047e5d-7845-4e2f-9fca-d2ebda6b9c7c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:19.861282 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e047e5d-7845-4e2f-9fca-d2ebda6b9c7c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:19.862347 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e047e5d-7845-4e2f-9fca-d2ebda6b9c7c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:19.863498 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e047e5d-7845-4e2f-9fca-d2ebda6b9c7c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:19.864552 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e047e5d-7845-4e2f-9fca-d2ebda6b9c7c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:20.163674 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2afc2905-f7a7-4c69-85fa-e73cd48ec697 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:20.176986 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2afc2905-f7a7-4c69-85fa-e73cd48ec697 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1318 microversion: 2.1 time: 1.874380 Jul 31 01:16:20.176986 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1062/2122] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:18 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1318 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:20.200194 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8cf570e2-6289-421b-a3d6-15304fe496ca tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede4efc430>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:20.270221 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e047e5d-7845-4e2f-9fca-d2ebda6b9c7c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:20.279066 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8cf570e2-6289-421b-a3d6-15304fe496ca tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/c8cb013c-2942-4638-812c-dace061e2684" status: 200 len: 661 microversion: 2.1 time: 0.087118 Jul 31 01:16:20.284287 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1063/2123] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:20 2022] GET /compute/v2.1/images/c8cb013c-2942-4638-812c-dace061e2684 => generated 661 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:20.290811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e047e5d-7845-4e2f-9fca-d2ebda6b9c7c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:20.300980 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e047e5d-7845-4e2f-9fca-d2ebda6b9c7c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:20.301635 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1f7319d4-7479-483d-8bbb-f3b76ae6d163 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:20.302405 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1f7319d4-7479-483d-8bbb-f3b76ae6d163 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:20.303209 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3e047e5d-7845-4e2f-9fca-d2ebda6b9c7c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1707 microversion: 2.32 time: 0.458576 Jul 31 01:16:20.304960 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1061/2124] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:19 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1707 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:20.328924 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f7319d4-7479-483d-8bbb-f3b76ae6d163 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:20.329435 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f7319d4-7479-483d-8bbb-f3b76ae6d163 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:20.332236 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e49f1695-22e9-4c45-a3f7-987ab2116cb8 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede52c58b0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:20.334881 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f7319d4-7479-483d-8bbb-f3b76ae6d163 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:20.336478 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f7319d4-7479-483d-8bbb-f3b76ae6d163 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:20.403200 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e49f1695-22e9-4c45-a3f7-987ab2116cb8 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/c8cb013c-2942-4638-812c-dace061e2684" status: 200 len: 661 microversion: 2.1 time: 0.075717 Jul 31 01:16:20.404262 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1062/2125] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:20 2022] GET /compute/v2.1/images/c8cb013c-2942-4638-812c-dace061e2684 => generated 661 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:20.560622 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-e71a583e-0cac-4441-b07b-e87ea73f00af req-49422076-4e9d-4f70-a3af-2a9af30455bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41f3bd8-298a-48ec-a3da-8e6bc5c459ea", "name": "network-vif-plugged", "status": "completed", "tag": "ebda67a3-3819-43d1-a74f-77f6d46add98"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:20.594862 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e71a583e-0cac-4441-b07b-e87ea73f00af req-49422076-4e9d-4f70-a3af-2a9af30455bf service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:20.595582 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e71a583e-0cac-4441-b07b-e87ea73f00af req-49422076-4e9d-4f70-a3af-2a9af30455bf service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:20.630962 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-e71a583e-0cac-4441-b07b-e87ea73f00af req-49422076-4e9d-4f70-a3af-2a9af30455bf service nova] Creating event network-vif-plugged:ebda67a3-3819-43d1-a74f-77f6d46add98 for instance f41f3bd8-298a-48ec-a3da-8e6bc5c459ea on n-h2-master-1 Jul 31 01:16:20.643389 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-e71a583e-0cac-4441-b07b-e87ea73f00af req-49422076-4e9d-4f70-a3af-2a9af30455bf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085492 Jul 31 01:16:20.645676 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1063/2126] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:16:20.660117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-caa5022b-f31f-486f-9975-8f3c10d6260b tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:20.663130 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-caa5022b-f31f-486f-9975-8f3c10d6260b tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:20.687712 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:20.692229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-caa5022b-f31f-486f-9975-8f3c10d6260b tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:20.695752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-caa5022b-f31f-486f-9975-8f3c10d6260b tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:20.696793 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-caa5022b-f31f-486f-9975-8f3c10d6260b tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:20.700406 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-caa5022b-f31f-486f-9975-8f3c10d6260b tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:21.253922 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-caa5022b-f31f-486f-9975-8f3c10d6260b tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb608462e3a45f69f9056550f16d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2101da474ab040c7a0b921a282f220cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:21.260385 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1f7319d4-7479-483d-8bbb-f3b76ae6d163 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:21.262990 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-caa5022b-f31f-486f-9975-8f3c10d6260b tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 200 len: 1317 microversion: 2.1 time: 0.615458 Jul 31 01:16:21.267939 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1064/2127] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:20 2022] GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 1317 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:21.277750 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7bd43010-6bdd-48ca-aa6d-40d7653a678b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1987335023", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:21.282237 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1f7319d4-7479-483d-8bbb-f3b76ae6d163 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 200 len: 1321 microversion: 2.1 time: 0.996825 Jul 31 01:16:21.283629 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1064/2128] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:20 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 1321 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:21.289110 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-64047cee-3d39-43a7-808b-144e10dd3f4b tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] Calling method '.version_select at 0x7fede4e08b80>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:21.351884 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:21.386088 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-7bd43010-6bdd-48ca-aa6d-40d7653a678b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:16:21.399540 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-64047cee-3d39-43a7-808b-144e10dd3f4b tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/08bf5366-bedf-48d8-aed1-efe4d45bb801" status: 200 len: 353 microversion: 2.1 time: 0.114647 Jul 31 01:16:21.400428 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1065/2129] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:16:21 2022] GET /compute/v2.1/os-volumes/08bf5366-bedf-48d8-aed1-efe4d45bb801 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:21.405089 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-169b4828-f3dd-48fa-878e-9ce14536268c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:21.405889 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-169b4828-f3dd-48fa-878e-9ce14536268c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:21.406448 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=30 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:21.422326 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-169b4828-f3dd-48fa-878e-9ce14536268c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:21.430136 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-169b4828-f3dd-48fa-878e-9ce14536268c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:21.431442 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-169b4828-f3dd-48fa-878e-9ce14536268c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:21.431906 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-169b4828-f3dd-48fa-878e-9ce14536268c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:22.129031 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7bd43010-6bdd-48ca-aa6d-40d7653a678b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:16:22.130325 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7bd43010-6bdd-48ca-aa6d-40d7653a678b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:16:22.130991 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7bd43010-6bdd-48ca-aa6d-40d7653a678b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:16:22.131587 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7bd43010-6bdd-48ca-aa6d-40d7653a678b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:16:22.132203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7bd43010-6bdd-48ca-aa6d-40d7653a678b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:16:22.160839 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-169b4828-f3dd-48fa-878e-9ce14536268c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:22.162563 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7bd43010-6bdd-48ca-aa6d-40d7653a678b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:22.163035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7bd43010-6bdd-48ca-aa6d-40d7653a678b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:22.163984 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7bd43010-6bdd-48ca-aa6d-40d7653a678b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:22.164457 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7bd43010-6bdd-48ca-aa6d-40d7653a678b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:22.172049 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-169b4828-f3dd-48fa-878e-9ce14536268c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1318 microversion: 2.1 time: 0.770371 Jul 31 01:16:22.180720 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1066/2130] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:21 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1318 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:22.186501 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-153d6cdd-674d-4a5a-8b52-5f1edefe4827 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:22.190969 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-153d6cdd-674d-4a5a-8b52-5f1edefe4827 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:22.202897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-153d6cdd-674d-4a5a-8b52-5f1edefe4827 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:22.210922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-153d6cdd-674d-4a5a-8b52-5f1edefe4827 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:22.212133 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-153d6cdd-674d-4a5a-8b52-5f1edefe4827 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:22.212808 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-153d6cdd-674d-4a5a-8b52-5f1edefe4827 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:22.235181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7bd43010-6bdd-48ca-aa6d-40d7653a678b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Getting quotas for project 1144cd95761a4f2d9db48cfe05506abf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:16:22.266589 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7bd43010-6bdd-48ca-aa6d-40d7653a678b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Getting quotas for user aabf32537a9449108581fae373260f1e and project 1144cd95761a4f2d9db48cfe05506abf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:16:22.306360 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7bd43010-6bdd-48ca-aa6d-40d7653a678b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:16:22.316679 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7bd43010-6bdd-48ca-aa6d-40d7653a678b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cf0c39f6-2c6a-4eb3-9176-7d20151b0adb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:16:22.440098 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7bd43010-6bdd-48ca-aa6d-40d7653a678b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170497 Jul 31 01:16:22.441597 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1065/2131] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:16:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:16:22.448130 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-a97a4c7c-2761-41df-bdc7-1a3ada7bd46d req-ba422a95-279a-4d4f-a0ca-878b7d093f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e85908-e4e0-458e-bbfd-f58c0c8adcf5", "tag": "2da650e9-07f6-438f-8236-c614d9bd0271"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:22.491123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a97a4c7c-2761-41df-bdc7-1a3ada7bd46d req-ba422a95-279a-4d4f-a0ca-878b7d093f2e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:22.491859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a97a4c7c-2761-41df-bdc7-1a3ada7bd46d req-ba422a95-279a-4d4f-a0ca-878b7d093f2e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:22.558048 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-a97a4c7c-2761-41df-bdc7-1a3ada7bd46d req-ba422a95-279a-4d4f-a0ca-878b7d093f2e service nova] Creating event network-changed:2da650e9-07f6-438f-8236-c614d9bd0271 for instance 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 on n-h1-master-1 Jul 31 01:16:22.569207 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-a97a4c7c-2761-41df-bdc7-1a3ada7bd46d req-ba422a95-279a-4d4f-a0ca-878b7d093f2e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125730 Jul 31 01:16:22.572260 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1066/2132] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:22.587204 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-46fcfed2-12b4-4be2-a1bd-b22cb05c607c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:22.588048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-46fcfed2-12b4-4be2-a1bd-b22cb05c607c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:22.602006 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46fcfed2-12b4-4be2-a1bd-b22cb05c607c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:22.602846 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46fcfed2-12b4-4be2-a1bd-b22cb05c607c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:22.603905 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46fcfed2-12b4-4be2-a1bd-b22cb05c607c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:22.604504 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46fcfed2-12b4-4be2-a1bd-b22cb05c607c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:23.222881 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-46fcfed2-12b4-4be2-a1bd-b22cb05c607c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb608462e3a45f69f9056550f16d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2101da474ab040c7a0b921a282f220cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:23.238454 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-46fcfed2-12b4-4be2-a1bd-b22cb05c607c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 200 len: 1317 microversion: 2.1 time: 0.661458 Jul 31 01:16:23.239633 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1067/2133] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:22 2022] GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 1317 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:23.249800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0c83ae38-04b3-46d4-963e-2701337d95ad tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:23.252877 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0c83ae38-04b3-46d4-963e-2701337d95ad tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:23.258646 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-153d6cdd-674d-4a5a-8b52-5f1edefe4827 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:23.279113 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-153d6cdd-674d-4a5a-8b52-5f1edefe4827 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:23.285141 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-153d6cdd-674d-4a5a-8b52-5f1edefe4827 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:23.289384 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-153d6cdd-674d-4a5a-8b52-5f1edefe4827 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1754 microversion: 2.32 time: 1.105871 Jul 31 01:16:23.290213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c83ae38-04b3-46d4-963e-2701337d95ad tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:23.291927 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1067/2134] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:22 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1754 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:23.303356 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cdda89d5-df6b-4bc4-a634-c8ddbb6db274 tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] Calling method '.version_select at 0x7fede4fadaf0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:23.314631 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c83ae38-04b3-46d4-963e-2701337d95ad tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:23.315732 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c83ae38-04b3-46d4-963e-2701337d95ad tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:23.316207 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c83ae38-04b3-46d4-963e-2701337d95ad tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:23.384405 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-cdda89d5-df6b-4bc4-a634-c8ddbb6db274 tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] HTTP exception thrown: Volume 08bf5366-bedf-48d8-aed1-efe4d45bb801 could not be found. Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cdda89d5-df6b-4bc4-a634-c8ddbb6db274 tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] Request method failure captured: Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-volumes/08bf5366-bedf-48d8-aed1-efe4d45bb801 HTTP/1.1 Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dfcSprP7HW0r-AW-NseGYLgBMyISQPR-kf_Dt3c2bcnSx3jSRFDnvcEZ6lyh7OFB8368b-kkvAKb54_vepUPmbJUQ99zWuHPYFudp2TbBhCklucnrT2wYAFhPl1v02YmjLckahd-FORblNqEnT9eL5GVaq9IIiMCSlaK-MI8bWaN0g Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6b5e65a681b24176ae9d199c7080e345 Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesGetTestJSON-1016699901 Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b5e65a681b24176ae9d199c7080e345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b5e65a681b24176ae9d199c7080e345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6b5e65a681b24176ae9d199c7080e345"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6b5e65a681b24176ae9d199c7080e345", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesGetTestJSON-1016699901 Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6b5e65a681b24176ae9d199c7080e345 Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesGetTestJSON-1016699901 Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesGetTestJSON-1016699901-project Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 3ca209087b3e487492e8f44c001e1edc Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesGetTestJSON-1016699901-project Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: exception: Volume 08bf5366-bedf-48d8-aed1-efe4d45bb801 could not be found. Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '08bf5366-bedf-48d8-aed1-efe4d45bb801'} Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 08bf5366-bedf-48d8-aed1-efe4d45bb801 could not be found. (HTTP 404) (Request-ID: req-580546d7-7b16-4d00-a6b1-3fff52b7dadc) Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 01:16:23.387459 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 08bf5366-bedf-48d8-aed1-efe4d45bb801 could not be found. Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 08bf5366-bedf-48d8-aed1-efe4d45bb801 could not be found. Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 08bf5366-bedf-48d8-aed1-efe4d45bb801 could not be found. Jul 31 01:16:23.391092 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:23.396084 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cdda89d5-df6b-4bc4-a634-c8ddbb6db274 tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] Returning 404 to user: Volume 08bf5366-bedf-48d8-aed1-efe4d45bb801 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:16:23.396084 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cdda89d5-df6b-4bc4-a634-c8ddbb6db274 tempest-VolumesGetTestJSON-1016699901 tempest-VolumesGetTestJSON-1016699901-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/08bf5366-bedf-48d8-aed1-efe4d45bb801" status: 404 len: 109 microversion: 2.1 time: 0.101520 Jul 31 01:16:23.396084 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1068/2135] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:16:23 2022] GET /compute/v2.1/os-volumes/08bf5366-bedf-48d8-aed1-efe4d45bb801 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:16:23.411623 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b5fdc3c4-96a4-4a25-9be8-c310e2b82450 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1360021364", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:23.530163 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-b5fdc3c4-96a4-4a25-9be8-c310e2b82450 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] validate_networks() for None {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:16:24.323606 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0c83ae38-04b3-46d4-963e-2701337d95ad tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:24.334078 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0c83ae38-04b3-46d4-963e-2701337d95ad tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 200 len: 1321 microversion: 2.1 time: 1.093073 Jul 31 01:16:24.337306 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1068/2136] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:23 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 1321 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:24.350206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-0887f081-7fbc-4a9a-b1f9-3f913ecea714 req-4e78e52c-9fd4-4863-993b-35174fbe2621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bc94263-b6c3-4954-95b3-345029530b02", "name": "network-vif-plugged", "status": "completed", "tag": "880daa84-d784-47a1-a8ef-1ddd63cf3602"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:24.377708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0887f081-7fbc-4a9a-b1f9-3f913ecea714 req-4e78e52c-9fd4-4863-993b-35174fbe2621 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:24.378564 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0887f081-7fbc-4a9a-b1f9-3f913ecea714 req-4e78e52c-9fd4-4863-993b-35174fbe2621 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:24.412624 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-0887f081-7fbc-4a9a-b1f9-3f913ecea714 req-4e78e52c-9fd4-4863-993b-35174fbe2621 service nova] Creating event network-vif-plugged:880daa84-d784-47a1-a8ef-1ddd63cf3602 for instance 2bc94263-b6c3-4954-95b3-345029530b02 on n-h1-master-1 Jul 31 01:16:24.418636 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-0887f081-7fbc-4a9a-b1f9-3f913ecea714 req-4e78e52c-9fd4-4863-993b-35174fbe2621 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079679 Jul 31 01:16:24.425550 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1069/2137] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:24.436457 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-58f46d47-814f-4d0f-8ab5-747d0f9261fe tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:24.441002 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-58f46d47-814f-4d0f-8ab5-747d0f9261fe tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:24.461501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58f46d47-814f-4d0f-8ab5-747d0f9261fe tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:24.461956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58f46d47-814f-4d0f-8ab5-747d0f9261fe tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:24.466971 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58f46d47-814f-4d0f-8ab5-747d0f9261fe tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:24.467800 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58f46d47-814f-4d0f-8ab5-747d0f9261fe tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:24.625421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b5fdc3c4-96a4-4a25-9be8-c310e2b82450 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:16:24.626930 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b5fdc3c4-96a4-4a25-9be8-c310e2b82450 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:16:24.627778 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b5fdc3c4-96a4-4a25-9be8-c310e2b82450 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:16:24.629950 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b5fdc3c4-96a4-4a25-9be8-c310e2b82450 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:16:24.630729 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b5fdc3c4-96a4-4a25-9be8-c310e2b82450 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:16:24.651968 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5fdc3c4-96a4-4a25-9be8-c310e2b82450 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:24.652780 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5fdc3c4-96a4-4a25-9be8-c310e2b82450 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:24.655788 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5fdc3c4-96a4-4a25-9be8-c310e2b82450 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:24.657205 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5fdc3c4-96a4-4a25-9be8-c310e2b82450 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:24.721065 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-b5fdc3c4-96a4-4a25-9be8-c310e2b82450 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Getting quotas for project 1144cd95761a4f2d9db48cfe05506abf. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:16:24.744755 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-b5fdc3c4-96a4-4a25-9be8-c310e2b82450 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Getting quotas for user aabf32537a9449108581fae373260f1e and project 1144cd95761a4f2d9db48cfe05506abf. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:16:24.798700 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b5fdc3c4-96a4-4a25-9be8-c310e2b82450 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:16:24.808920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b5fdc3c4-96a4-4a25-9be8-c310e2b82450 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:16:24.865805 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-58f46d47-814f-4d0f-8ab5-747d0f9261fe tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:24.877998 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-58f46d47-814f-4d0f-8ab5-747d0f9261fe tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1318 microversion: 2.1 time: 0.448999 Jul 31 01:16:24.891904 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1070/2138] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:24 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:24.898175 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f35c467a-3942-4c05-8146-10d6d524796e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:24.899108 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f35c467a-3942-4c05-8146-10d6d524796e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:24.906044 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f35c467a-3942-4c05-8146-10d6d524796e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:24.906783 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f35c467a-3942-4c05-8146-10d6d524796e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:24.907815 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f35c467a-3942-4c05-8146-10d6d524796e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:24.908431 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f35c467a-3942-4c05-8146-10d6d524796e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:24.940379 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b5fdc3c4-96a4-4a25-9be8-c310e2b82450 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.543625 Jul 31 01:16:24.941375 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1069/2139] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:16:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:16:24.952546 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-03bd374e-bd7e-456b-a368-1194dcfdfc72 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:24.975303 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-03bd374e-bd7e-456b-a368-1194dcfdfc72 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:24.977903 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:25.019473 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03bd374e-bd7e-456b-a368-1194dcfdfc72 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:25.020260 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03bd374e-bd7e-456b-a368-1194dcfdfc72 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:25.021257 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03bd374e-bd7e-456b-a368-1194dcfdfc72 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:25.029474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03bd374e-bd7e-456b-a368-1194dcfdfc72 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:25.071709 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:25.418807 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f35c467a-3942-4c05-8146-10d6d524796e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb608462e3a45f69f9056550f16d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2101da474ab040c7a0b921a282f220cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:25.427938 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f35c467a-3942-4c05-8146-10d6d524796e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 200 len: 1317 microversion: 2.1 time: 0.534526 Jul 31 01:16:25.447697 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1071/2140] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:24 2022] GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 1317 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:25.452914 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2459f990-73b9-4b7d-a2f8-35c66159e52c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:25.458702 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2459f990-73b9-4b7d-a2f8-35c66159e52c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:25.598700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2459f990-73b9-4b7d-a2f8-35c66159e52c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:25.606681 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2459f990-73b9-4b7d-a2f8-35c66159e52c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1218 microversion: 2.1 time: 0.157480 Jul 31 01:16:25.611502 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1072/2141] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:25 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:25.624113 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dc39fa40-92aa-45fc-9011-331329e97b99 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:25.624817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dc39fa40-92aa-45fc-9011-331329e97b99 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:25.637513 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc39fa40-92aa-45fc-9011-331329e97b99 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:25.638214 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc39fa40-92aa-45fc-9011-331329e97b99 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:25.639219 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc39fa40-92aa-45fc-9011-331329e97b99 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:25.639872 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc39fa40-92aa-45fc-9011-331329e97b99 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:25.822206 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-03bd374e-bd7e-456b-a368-1194dcfdfc72 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:25.835102 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-03bd374e-bd7e-456b-a368-1194dcfdfc72 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:25.843105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-03bd374e-bd7e-456b-a368-1194dcfdfc72 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:25.845077 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-03bd374e-bd7e-456b-a368-1194dcfdfc72 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1754 microversion: 2.32 time: 0.902631 Jul 31 01:16:25.875945 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1070/2142] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:24 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1754 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:25.901075 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2e2523ff-1314-47e7-8834-c853720aeb0d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:25.902071 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2e2523ff-1314-47e7-8834-c853720aeb0d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:25.917109 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e2523ff-1314-47e7-8834-c853720aeb0d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:25.917921 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e2523ff-1314-47e7-8834-c853720aeb0d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:25.918999 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e2523ff-1314-47e7-8834-c853720aeb0d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:25.919838 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e2523ff-1314-47e7-8834-c853720aeb0d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:26.817111 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dc39fa40-92aa-45fc-9011-331329e97b99 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:26.837785 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dc39fa40-92aa-45fc-9011-331329e97b99 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 200 len: 1321 microversion: 2.1 time: 1.219729 Jul 31 01:16:26.840123 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1073/2143] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:25 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 1321 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:26.851250 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bd4520cc-cff2-4856-a190-1b7980818898 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:26.862529 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bd4520cc-cff2-4856-a190-1b7980818898 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:26.880553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd4520cc-cff2-4856-a190-1b7980818898 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:26.882981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd4520cc-cff2-4856-a190-1b7980818898 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:26.884416 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd4520cc-cff2-4856-a190-1b7980818898 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:26.885068 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd4520cc-cff2-4856-a190-1b7980818898 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:26.945164 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2e2523ff-1314-47e7-8834-c853720aeb0d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:26.966199 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2e2523ff-1314-47e7-8834-c853720aeb0d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1318 microversion: 2.1 time: 1.070074 Jul 31 01:16:26.966852 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1071/2144] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:25 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1318 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:16:26.972397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-c5eada3b-4c68-4dec-9b9f-3cfc7e864838 req-287a19ef-939d-47e6-b572-1f1fbaaedfee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0005650d-9c5d-49ff-bae8-1f9efe4322f5", "name": "network-vif-plugged", "status": "completed", "tag": "2b6d29d2-1181-470a-9af3-c5ffa1afc021"}, {"server_uuid": "4e902288-e069-4d67-9804-2a58970a96c0", "name": "network-vif-plugged", "status": "completed", "tag": "7a0675a8-1c66-48f3-aa9c-ba7c125458e4"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:26.996155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c5eada3b-4c68-4dec-9b9f-3cfc7e864838 req-287a19ef-939d-47e6-b572-1f1fbaaedfee service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:26.997148 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c5eada3b-4c68-4dec-9b9f-3cfc7e864838 req-287a19ef-939d-47e6-b572-1f1fbaaedfee service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:27.012902 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-c5eada3b-4c68-4dec-9b9f-3cfc7e864838 req-287a19ef-939d-47e6-b572-1f1fbaaedfee service nova] Creating event network-vif-plugged:2b6d29d2-1181-470a-9af3-c5ffa1afc021 for instance 0005650d-9c5d-49ff-bae8-1f9efe4322f5 on n-h2-master-1 Jul 31 01:16:27.014451 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-c5eada3b-4c68-4dec-9b9f-3cfc7e864838 req-287a19ef-939d-47e6-b572-1f1fbaaedfee service nova] Creating event network-vif-plugged:7a0675a8-1c66-48f3-aa9c-ba7c125458e4 for instance 4e902288-e069-4d67-9804-2a58970a96c0 on n-h2-master-1 Jul 31 01:16:27.022717 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-c5eada3b-4c68-4dec-9b9f-3cfc7e864838 req-287a19ef-939d-47e6-b572-1f1fbaaedfee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054224 Jul 31 01:16:27.024796 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1072/2145] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:27.032473 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a7242adf-2c6f-4aac-8efe-91bc84842045 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:27.034237 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a7242adf-2c6f-4aac-8efe-91bc84842045 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:27.042298 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7242adf-2c6f-4aac-8efe-91bc84842045 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:27.043161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7242adf-2c6f-4aac-8efe-91bc84842045 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:27.044776 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7242adf-2c6f-4aac-8efe-91bc84842045 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:27.045491 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7242adf-2c6f-4aac-8efe-91bc84842045 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:27.235665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a7242adf-2c6f-4aac-8efe-91bc84842045 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:27.244666 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bd4520cc-cff2-4856-a190-1b7980818898 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb608462e3a45f69f9056550f16d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2101da474ab040c7a0b921a282f220cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:27.245191 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a7242adf-2c6f-4aac-8efe-91bc84842045 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1276 microversion: 2.1 time: 0.218187 Jul 31 01:16:27.258856 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bd4520cc-cff2-4856-a190-1b7980818898 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 200 len: 1317 microversion: 2.1 time: 0.414208 Jul 31 01:16:27.259541 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1074/2146] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:26 2022] GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:27.260293 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1073/2147] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:27 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1276 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:27.270485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7186bb59-9af7-4700-80fe-a9efdb475d55 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:27.271568 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7186bb59-9af7-4700-80fe-a9efdb475d55 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:27.284669 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7186bb59-9af7-4700-80fe-a9efdb475d55 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:27.285411 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7186bb59-9af7-4700-80fe-a9efdb475d55 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:27.286412 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7186bb59-9af7-4700-80fe-a9efdb475d55 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:27.287065 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7186bb59-9af7-4700-80fe-a9efdb475d55 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:27.782130 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7186bb59-9af7-4700-80fe-a9efdb475d55 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:27.838842 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7186bb59-9af7-4700-80fe-a9efdb475d55 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:27.853233 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7186bb59-9af7-4700-80fe-a9efdb475d55 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:27.858307 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7186bb59-9af7-4700-80fe-a9efdb475d55 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1801 microversion: 2.32 time: 0.597100 Jul 31 01:16:27.859303 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ffae170a-b1bd-496f-9a1a-113c6fdfb9d5 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:27.860166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ffae170a-b1bd-496f-9a1a-113c6fdfb9d5 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:27.861167 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1075/2148] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:27 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1801 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:27.900263 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ffae170a-b1bd-496f-9a1a-113c6fdfb9d5 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:27.901280 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ffae170a-b1bd-496f-9a1a-113c6fdfb9d5 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:27.902239 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ffae170a-b1bd-496f-9a1a-113c6fdfb9d5 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:27.902718 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ffae170a-b1bd-496f-9a1a-113c6fdfb9d5 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:27.989177 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-353597d9-6c5b-4411-936e-053addaf96b1 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:27.990132 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-353597d9-6c5b-4411-936e-053addaf96b1 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:28.003884 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-353597d9-6c5b-4411-936e-053addaf96b1 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:28.004818 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-353597d9-6c5b-4411-936e-053addaf96b1 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:28.005886 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-353597d9-6c5b-4411-936e-053addaf96b1 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:28.008141 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-353597d9-6c5b-4411-936e-053addaf96b1 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:29.018452 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ffae170a-b1bd-496f-9a1a-113c6fdfb9d5 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:29.032338 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ffae170a-b1bd-496f-9a1a-113c6fdfb9d5 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 200 len: 1321 microversion: 2.1 time: 1.176970 Jul 31 01:16:29.037877 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1074/2149] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:27 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 1321 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:16:29.064919 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-394ef7d0-10ba-464a-94bc-a426907d9697 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:29.069142 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-394ef7d0-10ba-464a-94bc-a426907d9697 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:29.101506 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-394ef7d0-10ba-464a-94bc-a426907d9697 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:29.101983 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-394ef7d0-10ba-464a-94bc-a426907d9697 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:29.102922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-394ef7d0-10ba-464a-94bc-a426907d9697 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:29.103381 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-394ef7d0-10ba-464a-94bc-a426907d9697 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:29.194256 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-353597d9-6c5b-4411-936e-053addaf96b1 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:29.233666 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-353597d9-6c5b-4411-936e-053addaf96b1 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1318 microversion: 2.1 time: 1.248367 Jul 31 01:16:29.234717 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1076/2150] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:27 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1318 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:16:29.252318 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-942c81c9-cf63-4b06-9ee5-a13f78afc67e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:29.264856 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-942c81c9-cf63-4b06-9ee5-a13f78afc67e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:29.276485 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-942c81c9-cf63-4b06-9ee5-a13f78afc67e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:29.289112 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-942c81c9-cf63-4b06-9ee5-a13f78afc67e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:29.290893 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-942c81c9-cf63-4b06-9ee5-a13f78afc67e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:29.291945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-942c81c9-cf63-4b06-9ee5-a13f78afc67e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:29.429685 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-394ef7d0-10ba-464a-94bc-a426907d9697 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:29.447927 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-394ef7d0-10ba-464a-94bc-a426907d9697 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1276 microversion: 2.1 time: 0.406472 Jul 31 01:16:29.464650 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1075/2151] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:29 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1276 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:29.474989 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b5c98050-d798-4d1e-9c02-f5794f7ff939 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:29.492196 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b5c98050-d798-4d1e-9c02-f5794f7ff939 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:29.514660 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5c98050-d798-4d1e-9c02-f5794f7ff939 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:29.515468 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5c98050-d798-4d1e-9c02-f5794f7ff939 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:29.534354 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5c98050-d798-4d1e-9c02-f5794f7ff939 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:29.543250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5c98050-d798-4d1e-9c02-f5794f7ff939 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:30.085680 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-942c81c9-cf63-4b06-9ee5-a13f78afc67e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb608462e3a45f69f9056550f16d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2101da474ab040c7a0b921a282f220cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:30.104037 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-942c81c9-cf63-4b06-9ee5-a13f78afc67e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 200 len: 1466 microversion: 2.1 time: 0.867584 Jul 31 01:16:30.104643 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1077/2152] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:29 2022] GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 1466 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:30.126298 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7907e0f4-7837-4098-8221-530b67243701 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:30.126939 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7907e0f4-7837-4098-8221-530b67243701 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:30.143608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7907e0f4-7837-4098-8221-530b67243701 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:30.144080 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7907e0f4-7837-4098-8221-530b67243701 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:30.145270 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7907e0f4-7837-4098-8221-530b67243701 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:30.145726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7907e0f4-7837-4098-8221-530b67243701 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:30.184743 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b5c98050-d798-4d1e-9c02-f5794f7ff939 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:30.199317 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b5c98050-d798-4d1e-9c02-f5794f7ff939 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:30.206183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b5c98050-d798-4d1e-9c02-f5794f7ff939 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:30.210640 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b5c98050-d798-4d1e-9c02-f5794f7ff939 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1801 microversion: 2.32 time: 0.743559 Jul 31 01:16:30.215673 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1076/2153] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:29 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1801 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:30.230479 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-abee5815-8412-4681-9e83-235945bc3be6 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1682480199", "metadata": {"image_type": "test"}}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:30.233382 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-abee5815-8412-4681-9e83-235945bc3be6 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:30.267642 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abee5815-8412-4681-9e83-235945bc3be6 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:30.268101 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abee5815-8412-4681-9e83-235945bc3be6 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:30.268916 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abee5815-8412-4681-9e83-235945bc3be6 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:30.281283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abee5815-8412-4681-9e83-235945bc3be6 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:30.403503 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-abee5815-8412-4681-9e83-235945bc3be6 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Getting quotas for project 2101da474ab040c7a0b921a282f220cf. Resources: dict_keys(['metadata_items']) {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:16:30.421807 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-abee5815-8412-4681-9e83-235945bc3be6 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Getting quotas for user 5cb608462e3a45f69f9056550f16d869 and project 2101da474ab040c7a0b921a282f220cf. Resources: dict_keys(['metadata_items']) {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:16:30.801987 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7907e0f4-7837-4098-8221-530b67243701 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:30.812801 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7907e0f4-7837-4098-8221-530b67243701 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 200 len: 1511 microversion: 2.1 time: 0.692213 Jul 31 01:16:30.813820 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1078/2154] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:30 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 1511 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:30.833674 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4e4826bf-da22-4361-ae2d-298d10430437 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:30.834681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4e4826bf-da22-4361-ae2d-298d10430437 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:30.849273 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e4826bf-da22-4361-ae2d-298d10430437 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:30.850097 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e4826bf-da22-4361-ae2d-298d10430437 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:30.851728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e4826bf-da22-4361-ae2d-298d10430437 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:30.852585 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e4826bf-da22-4361-ae2d-298d10430437 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:30.926582 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-abee5815-8412-4681-9e83-235945bc3be6 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "POST /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5/action" status: 202 len: 0 microversion: 2.1 time: 0.706743 Jul 31 01:16:30.928051 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1077/2155] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:16:30 2022] POST /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5/action => generated 0 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 31 01:16:30.941855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0add62fc-33c6-4041-9b9c-996c77d30f10 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:30.948317 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0add62fc-33c6-4041-9b9c-996c77d30f10 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:30.969123 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0add62fc-33c6-4041-9b9c-996c77d30f10 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:30.971221 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0add62fc-33c6-4041-9b9c-996c77d30f10 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:30.973021 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0add62fc-33c6-4041-9b9c-996c77d30f10 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:30.974283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0add62fc-33c6-4041-9b9c-996c77d30f10 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:31.114967 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0add62fc-33c6-4041-9b9c-996c77d30f10 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:31.124231 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0add62fc-33c6-4041-9b9c-996c77d30f10 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1276 microversion: 2.1 time: 0.194582 Jul 31 01:16:31.129153 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1078/2156] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:30 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1276 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:31.152301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-6a5f2606-d692-48b6-80c5-c4dcac6dbff5 req-b3496efe-0d82-4fcf-9764-3bdf5b49bb01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e85908-e4e0-458e-bbfd-f58c0c8adcf5", "name": "network-vif-plugged", "status": "completed", "tag": "2da650e9-07f6-438f-8236-c614d9bd0271"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:31.184192 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-6a5f2606-d692-48b6-80c5-c4dcac6dbff5 req-b3496efe-0d82-4fcf-9764-3bdf5b49bb01 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:31.184650 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-6a5f2606-d692-48b6-80c5-c4dcac6dbff5 req-b3496efe-0d82-4fcf-9764-3bdf5b49bb01 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:31.187802 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4e4826bf-da22-4361-ae2d-298d10430437 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:31.190532 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:31.198965 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4e4826bf-da22-4361-ae2d-298d10430437 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1318 microversion: 2.1 time: 0.383698 Jul 31 01:16:31.214249 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-6a5f2606-d692-48b6-80c5-c4dcac6dbff5 req-b3496efe-0d82-4fcf-9764-3bdf5b49bb01 service nova] Creating event network-vif-plugged:2da650e9-07f6-438f-8236-c614d9bd0271 for instance 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 on n-h1-master-1 Jul 31 01:16:31.215846 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1079/2157] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:30 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:31.223884 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-6a5f2606-d692-48b6-80c5-c4dcac6dbff5 req-b3496efe-0d82-4fcf-9764-3bdf5b49bb01 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092726 Jul 31 01:16:31.224514 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1079/2158] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:31.232708 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3c0cc536-9f1f-49ea-becc-fa89f1c29fb8 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:31.237813 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3c0cc536-9f1f-49ea-becc-fa89f1c29fb8 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:31.240086 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-70a15150-aa78-4b27-bbe1-1e3783faaae6 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede4f600d0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:31.272755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c0cc536-9f1f-49ea-becc-fa89f1c29fb8 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:31.278271 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c0cc536-9f1f-49ea-becc-fa89f1c29fb8 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:31.281897 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c0cc536-9f1f-49ea-becc-fa89f1c29fb8 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:31.282661 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c0cc536-9f1f-49ea-becc-fa89f1c29fb8 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:31.330495 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-70a15150-aa78-4b27-bbe1-1e3783faaae6 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1422 microversion: 2.1 time: 0.104724 Jul 31 01:16:31.346245 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1080/2159] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:31 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1422 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:31.358483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-18919848-2142-46ed-8b4e-4b825c099889 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:31.359243 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-18919848-2142-46ed-8b4e-4b825c099889 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:31.380280 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18919848-2142-46ed-8b4e-4b825c099889 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:31.382268 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18919848-2142-46ed-8b4e-4b825c099889 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:31.385405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18919848-2142-46ed-8b4e-4b825c099889 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:31.386075 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18919848-2142-46ed-8b4e-4b825c099889 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:31.883439 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3c0cc536-9f1f-49ea-becc-fa89f1c29fb8 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:31.892941 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3c0cc536-9f1f-49ea-becc-fa89f1c29fb8 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1510 microversion: 2.1 time: 0.675047 Jul 31 01:16:31.902110 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1080/2160] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:31 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1510 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:31.917773 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-41644c8f-6b4d-4a00-b23d-ce5580d21504 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:31.918797 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-41644c8f-6b4d-4a00-b23d-ce5580d21504 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 2bc94263-b6c3-4954-95b3-345029530b02] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:31.925637 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-41644c8f-6b4d-4a00-b23d-ce5580d21504 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:31.926320 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-41644c8f-6b4d-4a00-b23d-ce5580d21504 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:31.926795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-18919848-2142-46ed-8b4e-4b825c099889 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:31.927510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-41644c8f-6b4d-4a00-b23d-ce5580d21504 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:31.928106 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-41644c8f-6b4d-4a00-b23d-ce5580d21504 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:31.941265 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-18919848-2142-46ed-8b4e-4b825c099889 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:31.952601 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-18919848-2142-46ed-8b4e-4b825c099889 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:31.953857 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-18919848-2142-46ed-8b4e-4b825c099889 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1801 microversion: 2.32 time: 0.605271 Jul 31 01:16:31.964179 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1081/2161] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:31 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1801 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:32.152932 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ff5c0ac6-c443-4989-89ef-d52170f94973 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:32.153605 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ff5c0ac6-c443-4989-89ef-d52170f94973 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:32.171386 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff5c0ac6-c443-4989-89ef-d52170f94973 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:32.173911 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff5c0ac6-c443-4989-89ef-d52170f94973 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:32.177291 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff5c0ac6-c443-4989-89ef-d52170f94973 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:32.181823 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff5c0ac6-c443-4989-89ef-d52170f94973 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:32.198416 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:32.216815 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-41644c8f-6b4d-4a00-b23d-ce5580d21504 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:32.226410 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-41644c8f-6b4d-4a00-b23d-ce5580d21504 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/2bc94263-b6c3-4954-95b3-345029530b02" status: 200 len: 1511 microversion: 2.1 time: 0.313320 Jul 31 01:16:32.244529 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1081/2162] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:31 2022] GET /compute/v2.1/servers/2bc94263-b6c3-4954-95b3-345029530b02 => generated 1511 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:32.258039 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c1c75d65-2209-4b6c-93a5-a2372daa7eb8 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:32.260955 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c1c75d65-2209-4b6c-93a5-a2372daa7eb8 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:32.291990 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1c75d65-2209-4b6c-93a5-a2372daa7eb8 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:32.292546 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1c75d65-2209-4b6c-93a5-a2372daa7eb8 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:32.295077 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1c75d65-2209-4b6c-93a5-a2372daa7eb8 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:32.296873 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1c75d65-2209-4b6c-93a5-a2372daa7eb8 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:32.799664 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ff5c0ac6-c443-4989-89ef-d52170f94973 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:32.821154 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ff5c0ac6-c443-4989-89ef-d52170f94973 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1318 microversion: 2.1 time: 0.665853 Jul 31 01:16:32.835978 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1082/2163] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:32 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1318 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:32.844078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d6ae17a1-a5f3-4356-aec9-1c2152c79dec tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:32.849732 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c1c75d65-2209-4b6c-93a5-a2372daa7eb8 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:32.853716 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d6ae17a1-a5f3-4356-aec9-1c2152c79dec tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:32.855566 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d6ae17a1-a5f3-4356-aec9-1c2152c79dec tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:16:32.878893 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c1c75d65-2209-4b6c-93a5-a2372daa7eb8 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1318 microversion: 2.1 time: 0.641932 Jul 31 01:16:32.882657 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1082/2164] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:32 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1318 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:32.901423 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6ae17a1-a5f3-4356-aec9-1c2152c79dec tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:32.902124 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6ae17a1-a5f3-4356-aec9-1c2152c79dec tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:32.904228 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6ae17a1-a5f3-4356-aec9-1c2152c79dec tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:32.907008 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1f2b754e-5cb1-4931-b444-4f41244e97de tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fedea94faf0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:32.908355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6ae17a1-a5f3-4356-aec9-1c2152c79dec tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:32.994604 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1f2b754e-5cb1-4931-b444-4f41244e97de tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1422 microversion: 2.1 time: 0.100508 Jul 31 01:16:33.016313 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1083/2165] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:32 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1422 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:33.023095 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-95c99548-d26d-4d91-830d-66b7bc7f63bb tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:33.024137 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-95c99548-d26d-4d91-830d-66b7bc7f63bb tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:33.035491 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95c99548-d26d-4d91-830d-66b7bc7f63bb tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:33.036594 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95c99548-d26d-4d91-830d-66b7bc7f63bb tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:33.038485 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95c99548-d26d-4d91-830d-66b7bc7f63bb tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:33.039287 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95c99548-d26d-4d91-830d-66b7bc7f63bb tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:33.079148 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-d6ae17a1-a5f3-4356-aec9-1c2152c79dec tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:16:33.173821 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d6ae17a1-a5f3-4356-aec9-1c2152c79dec tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:33.186097 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6ae17a1-a5f3-4356-aec9-1c2152c79dec tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:33.186829 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6ae17a1-a5f3-4356-aec9-1c2152c79dec tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:33.655908 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-95c99548-d26d-4d91-830d-66b7bc7f63bb tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:33.659311 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d6ae17a1-a5f3-4356-aec9-1c2152c79dec tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.821735 Jul 31 01:16:33.659950 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1083/2166] 10.222.0.45 () {58 vars in 1167 bytes} [Sun Jul 31 01:16:32 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:33.691205 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-95c99548-d26d-4d91-830d-66b7bc7f63bb tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:33.691205 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-95c99548-d26d-4d91-830d-66b7bc7f63bb tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:33.693497 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-95c99548-d26d-4d91-830d-66b7bc7f63bb tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1836 microversion: 2.32 time: 0.673686 Jul 31 01:16:33.693497 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1084/2167] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:33 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1836 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:33.702347 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c785afeb-bf64-4e10-ba54-f7302e2ad4a7 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:33.718084 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c785afeb-bf64-4e10-ba54-f7302e2ad4a7 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:33.723753 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c785afeb-bf64-4e10-ba54-f7302e2ad4a7 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-754122715', 'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:16:33.737403 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c785afeb-bf64-4e10-ba54-f7302e2ad4a7 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:33.743361 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c785afeb-bf64-4e10-ba54-f7302e2ad4a7 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:33.744907 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c785afeb-bf64-4e10-ba54-f7302e2ad4a7 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:33.745565 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c785afeb-bf64-4e10-ba54-f7302e2ad4a7 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:33.958733 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-8683eec3-7048-465a-8437-119c9052674a req-1735188c-4ad3-4c3c-8d3d-664079c31bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf0c39f6-2c6a-4eb3-9176-7d20151b0adb", "tag": "cf150970-8f1a-4d54-b48d-7de2be48f7e1"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:33.972857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8683eec3-7048-465a-8437-119c9052674a req-1735188c-4ad3-4c3c-8d3d-664079c31bf7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:33.978070 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.multi_cell_list [None req-c785afeb-bf64-4e10-ba54-f7302e2ad4a7 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119475) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:16:33.984014 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8683eec3-7048-465a-8437-119c9052674a req-1735188c-4ad3-4c3c-8d3d-664079c31bf7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:34.009311 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-8683eec3-7048-465a-8437-119c9052674a req-1735188c-4ad3-4c3c-8d3d-664079c31bf7 service nova] Creating event network-changed:cf150970-8f1a-4d54-b48d-7de2be48f7e1 for instance cf0c39f6-2c6a-4eb3-9176-7d20151b0adb on n-h2-master-1 Jul 31 01:16:34.017765 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-8683eec3-7048-465a-8437-119c9052674a req-1735188c-4ad3-4c3c-8d3d-664079c31bf7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.356069 Jul 31 01:16:34.020828 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1084/2168] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:34.038877 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c083bdaf-af60-4901-ae5e-231ded567d3b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:34.039971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c083bdaf-af60-4901-ae5e-231ded567d3b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:34.050758 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c083bdaf-af60-4901-ae5e-231ded567d3b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:34.051387 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c083bdaf-af60-4901-ae5e-231ded567d3b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:34.052312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c083bdaf-af60-4901-ae5e-231ded567d3b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:34.059562 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c083bdaf-af60-4901-ae5e-231ded567d3b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:34.128564 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c785afeb-bf64-4e10-ba54-f7302e2ad4a7 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:34.141298 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c785afeb-bf64-4e10-ba54-f7302e2ad4a7 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:34.144655 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c785afeb-bf64-4e10-ba54-f7302e2ad4a7 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:34.448268 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c785afeb-bf64-4e10-ba54-f7302e2ad4a7 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-754122715" status: 200 len: 1513 microversion: 2.1 time: 0.753644 Jul 31 01:16:34.448937 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1085/2169] 10.222.0.45 () {58 vars in 1261 bytes} [Sun Jul 31 01:16:33 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-754122715 => generated 1513 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:34.454098 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f01035aa-45ba-4796-ab5e-173f11282e76 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:34.455143 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f01035aa-45ba-4796-ab5e-173f11282e76 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:34.472730 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c083bdaf-af60-4901-ae5e-231ded567d3b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:34.483324 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c083bdaf-af60-4901-ae5e-231ded567d3b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1318 microversion: 2.1 time: 0.460932 Jul 31 01:16:34.487268 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1085/2170] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:34 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:34.492416 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e72c8bb7-03c8-444b-b7c2-bad44d123a56 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede4edef70>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:34.492761 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f01035aa-45ba-4796-ab5e-173f11282e76 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:34.493740 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f01035aa-45ba-4796-ab5e-173f11282e76 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:34.494775 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f01035aa-45ba-4796-ab5e-173f11282e76 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:34.495455 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f01035aa-45ba-4796-ab5e-173f11282e76 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:34.578522 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e72c8bb7-03c8-444b-b7c2-bad44d123a56 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1422 microversion: 2.1 time: 0.089818 Jul 31 01:16:34.588623 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1086/2171] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:34 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1422 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:34.593931 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3e959525-b5ec-4b78-a0dc-44e1f60ac5ba tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:34.611979 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3e959525-b5ec-4b78-a0dc-44e1f60ac5ba tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:34.613133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3e959525-b5ec-4b78-a0dc-44e1f60ac5ba tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:16:34.621857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e959525-b5ec-4b78-a0dc-44e1f60ac5ba tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:34.622546 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e959525-b5ec-4b78-a0dc-44e1f60ac5ba tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:34.623575 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e959525-b5ec-4b78-a0dc-44e1f60ac5ba tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:34.624208 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e959525-b5ec-4b78-a0dc-44e1f60ac5ba tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:34.984690 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f01035aa-45ba-4796-ab5e-173f11282e76 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:35.000285 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f01035aa-45ba-4796-ab5e-173f11282e76 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1468 microversion: 2.1 time: 0.550128 Jul 31 01:16:35.000903 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1086/2172] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:34 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1468 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:35.012197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-07a5c19a-5dff-4b3a-8fe5-6eb616cb9ad0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:35.012197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-07a5c19a-5dff-4b3a-8fe5-6eb616cb9ad0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:35.014279 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-3e959525-b5ec-4b78-a0dc-44e1f60ac5ba tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:16:35.031457 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07a5c19a-5dff-4b3a-8fe5-6eb616cb9ad0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:35.037525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07a5c19a-5dff-4b3a-8fe5-6eb616cb9ad0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:35.038946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07a5c19a-5dff-4b3a-8fe5-6eb616cb9ad0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:35.039605 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07a5c19a-5dff-4b3a-8fe5-6eb616cb9ad0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:35.156272 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3e959525-b5ec-4b78-a0dc-44e1f60ac5ba tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:35.177940 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e959525-b5ec-4b78-a0dc-44e1f60ac5ba tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:35.178406 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3e959525-b5ec-4b78-a0dc-44e1f60ac5ba tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:35.188858 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:35.341244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-07a5c19a-5dff-4b3a-8fe5-6eb616cb9ad0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:35.372355 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-07a5c19a-5dff-4b3a-8fe5-6eb616cb9ad0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:35.378726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-07a5c19a-5dff-4b3a-8fe5-6eb616cb9ad0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:35.383975 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-07a5c19a-5dff-4b3a-8fe5-6eb616cb9ad0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1836 microversion: 2.32 time: 0.381632 Jul 31 01:16:35.394892 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1087/2173] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:35 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1836 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:35.394892 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ca9c64a2-2528-4ba7-b453-ada4debb580e tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:35.401071 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ca9c64a2-2528-4ba7-b453-ada4debb580e tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:35.419177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca9c64a2-2528-4ba7-b453-ada4debb580e tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:35.419683 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca9c64a2-2528-4ba7-b453-ada4debb580e tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:35.420494 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca9c64a2-2528-4ba7-b453-ada4debb580e tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:35.420940 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca9c64a2-2528-4ba7-b453-ada4debb580e tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:35.461789 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3e959525-b5ec-4b78-a0dc-44e1f60ac5ba tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.871712 Jul 31 01:16:35.462406 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1087/2174] 10.222.0.45 () {58 vars in 1173 bytes} [Sun Jul 31 01:16:34 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:35.497144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b5aca5bd-9106-41dc-b5b4-cd81fd6d6a0f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:35.498112 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-ca9c64a2-2528-4ba7-b453-ada4debb580e tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lazy-loading 'flavor' on Instance uuid 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:16:35.511867 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b5aca5bd-9106-41dc-b5b4-cd81fd6d6a0f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:35.513591 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.compute.servers [None req-b5aca5bd-9106-41dc-b5b4-cd81fd6d6a0f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Removing options 'limit' from query {{(pid=119474) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 31 01:16:35.515770 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b5aca5bd-9106-41dc-b5b4-cd81fd6d6a0f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:16:35.550789 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5aca5bd-9106-41dc-b5b4-cd81fd6d6a0f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:35.551760 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5aca5bd-9106-41dc-b5b4-cd81fd6d6a0f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:35.558994 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5aca5bd-9106-41dc-b5b4-cd81fd6d6a0f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:35.560553 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5aca5bd-9106-41dc-b5b4-cd81fd6d6a0f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:35.696251 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b5aca5bd-9106-41dc-b5b4-cd81fd6d6a0f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:35.724736 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5aca5bd-9106-41dc-b5b4-cd81fd6d6a0f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:35.729011 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5aca5bd-9106-41dc-b5b4-cd81fd6d6a0f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:35.737965 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ca9c64a2-2528-4ba7-b453-ada4debb580e tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5/action" status: 202 len: 0 microversion: 2.1 time: 0.350911 Jul 31 01:16:35.739042 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1088/2175] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:16:35 2022] POST /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:16:35.764119 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f8bfa308-914c-4290-9350-e681d8ff4415 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:35.765932 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f8bfa308-914c-4290-9350-e681d8ff4415 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:35.781306 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8bfa308-914c-4290-9350-e681d8ff4415 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:35.782526 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8bfa308-914c-4290-9350-e681d8ff4415 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:35.784488 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8bfa308-914c-4290-9350-e681d8ff4415 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:35.785291 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8bfa308-914c-4290-9350-e681d8ff4415 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:36.241677 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f8bfa308-914c-4290-9350-e681d8ff4415 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:36.257151 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f8bfa308-914c-4290-9350-e681d8ff4415 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1318 microversion: 2.1 time: 0.509483 Jul 31 01:16:36.259982 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1089/2176] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:35 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:36.266140 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b5aca5bd-9106-41dc-b5b4-cd81fd6d6a0f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.778792 Jul 31 01:16:36.267661 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1088/2177] 10.222.0.45 () {58 vars in 1161 bytes} [Sun Jul 31 01:16:35 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:36.273606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8d64280d-8ce3-4357-aebf-be72d2188910 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:36.275097 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8d64280d-8ce3-4357-aebf-be72d2188910 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:36.296031 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b9a0cf60-f89e-4329-9392-28f27d50f0ac tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede51d3670>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:36.314079 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d64280d-8ce3-4357-aebf-be72d2188910 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:36.314943 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d64280d-8ce3-4357-aebf-be72d2188910 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:36.320182 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d64280d-8ce3-4357-aebf-be72d2188910 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:36.320535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d64280d-8ce3-4357-aebf-be72d2188910 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:36.436037 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b9a0cf60-f89e-4329-9392-28f27d50f0ac tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1422 microversion: 2.1 time: 0.159927 Jul 31 01:16:36.436814 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1090/2178] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:36 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1422 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:36.459810 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-05621d14-e439-4205-a7cc-03424eaca212 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:36.472362 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-05621d14-e439-4205-a7cc-03424eaca212 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:36.473250 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-05621d14-e439-4205-a7cc-03424eaca212 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:16:36.503513 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05621d14-e439-4205-a7cc-03424eaca212 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:36.508479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05621d14-e439-4205-a7cc-03424eaca212 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:36.509443 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05621d14-e439-4205-a7cc-03424eaca212 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:36.512107 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05621d14-e439-4205-a7cc-03424eaca212 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:36.792348 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.multi_cell_list [None req-05621d14-e439-4205-a7cc-03424eaca212 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119475) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:16:36.871849 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-05621d14-e439-4205-a7cc-03424eaca212 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.421522 Jul 31 01:16:36.873305 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1091/2179] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:16:36 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:36.878943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8f46e48b-33fa-4c76-8485-712f4da2806c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:36.879852 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8f46e48b-33fa-4c76-8485-712f4da2806c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:36.888858 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f46e48b-33fa-4c76-8485-712f4da2806c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:36.889508 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f46e48b-33fa-4c76-8485-712f4da2806c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:36.890698 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f46e48b-33fa-4c76-8485-712f4da2806c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:36.891386 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f46e48b-33fa-4c76-8485-712f4da2806c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:37.450942 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8d64280d-8ce3-4357-aebf-be72d2188910 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:37.473410 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8d64280d-8ce3-4357-aebf-be72d2188910 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1476 microversion: 2.1 time: 1.204408 Jul 31 01:16:37.474359 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1089/2180] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:36 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1476 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:37.479330 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-34405ba9-ac4d-4396-a898-a1006ecbcf52 req-21b4d4d8-c41f-44ea-a5d9-6b0c274c9f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0005650d-9c5d-49ff-bae8-1f9efe4322f5", "name": "network-vif-plugged", "status": "completed", "tag": "2b6d29d2-1181-470a-9af3-c5ffa1afc021"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:37.506049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-34405ba9-ac4d-4396-a898-a1006ecbcf52 req-21b4d4d8-c41f-44ea-a5d9-6b0c274c9f80 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:37.507167 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-34405ba9-ac4d-4396-a898-a1006ecbcf52 req-21b4d4d8-c41f-44ea-a5d9-6b0c274c9f80 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:37.548117 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-34405ba9-ac4d-4396-a898-a1006ecbcf52 req-21b4d4d8-c41f-44ea-a5d9-6b0c274c9f80 service nova] Creating event network-vif-plugged:2b6d29d2-1181-470a-9af3-c5ffa1afc021 for instance 0005650d-9c5d-49ff-bae8-1f9efe4322f5 on n-h2-master-1 Jul 31 01:16:37.579084 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-34405ba9-ac4d-4396-a898-a1006ecbcf52 req-21b4d4d8-c41f-44ea-a5d9-6b0c274c9f80 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103370 Jul 31 01:16:37.580754 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8f46e48b-33fa-4c76-8485-712f4da2806c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:37.585127 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1090/2181] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:37.596820 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-98f98b88-0c9d-4fce-a867-602d4bf49b67 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:37.598626 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8f46e48b-33fa-4c76-8485-712f4da2806c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:37.604511 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-98f98b88-0c9d-4fce-a867-602d4bf49b67 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:37.605174 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.compute.servers [None req-98f98b88-0c9d-4fce-a867-602d4bf49b67 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Removing options 'limit' from query {{(pid=119474) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 31 01:16:37.605297 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8f46e48b-33fa-4c76-8485-712f4da2806c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:37.606608 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8f46e48b-33fa-4c76-8485-712f4da2806c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1836 microversion: 2.32 time: 0.731826 Jul 31 01:16:37.607302 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1092/2182] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:36 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1836 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:37.616670 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-98f98b88-0c9d-4fce-a867-602d4bf49b67 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:16:37.617635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-49e2243d-cebd-4871-8d58-06e39dc2ed85 req-44755d45-60d5-4609-9494-a86d70354537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdf56656-f786-439a-8d92-a4365424d0d7", "tag": "f14a9b78-dba4-47d9-b73e-195b70df06a4"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:37.630796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98f98b88-0c9d-4fce-a867-602d4bf49b67 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:37.631258 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98f98b88-0c9d-4fce-a867-602d4bf49b67 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:37.633017 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98f98b88-0c9d-4fce-a867-602d4bf49b67 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:37.633696 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98f98b88-0c9d-4fce-a867-602d4bf49b67 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:37.645431 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-49e2243d-cebd-4871-8d58-06e39dc2ed85 req-44755d45-60d5-4609-9494-a86d70354537 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:37.647897 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-49e2243d-cebd-4871-8d58-06e39dc2ed85 req-44755d45-60d5-4609-9494-a86d70354537 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:37.677311 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-49e2243d-cebd-4871-8d58-06e39dc2ed85 req-44755d45-60d5-4609-9494-a86d70354537 service nova] Creating event network-changed:f14a9b78-dba4-47d9-b73e-195b70df06a4 for instance cdf56656-f786-439a-8d92-a4365424d0d7 on n-h2-master-1 Jul 31 01:16:37.692044 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-49e2243d-cebd-4871-8d58-06e39dc2ed85 req-44755d45-60d5-4609-9494-a86d70354537 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075715 Jul 31 01:16:37.693360 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1093/2183] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:37.708219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e8417243-2910-460f-ae69-e5edb7d07741 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:37.709429 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e8417243-2910-460f-ae69-e5edb7d07741 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:37.724987 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8417243-2910-460f-ae69-e5edb7d07741 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:37.728182 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8417243-2910-460f-ae69-e5edb7d07741 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:37.729722 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8417243-2910-460f-ae69-e5edb7d07741 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:37.732590 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8417243-2910-460f-ae69-e5edb7d07741 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:37.862110 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-98f98b88-0c9d-4fce-a867-602d4bf49b67 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:16:38.030003 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-98f98b88-0c9d-4fce-a867-602d4bf49b67 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.442211 Jul 31 01:16:38.032147 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1091/2184] 10.222.0.45 () {58 vars in 1150 bytes} [Sun Jul 31 01:16:37 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:38.039960 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3724e38c-09bd-4a48-a9f5-7367fab06cbc tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede4f5ae50>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:38.111744 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3724e38c-09bd-4a48-a9f5-7367fab06cbc tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1422 microversion: 2.1 time: 0.077904 Jul 31 01:16:38.122384 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1092/2185] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:38 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:38.150977 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eb07bfbf-0080-4b35-97a3-e471dce2a02d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:38.160686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eb07bfbf-0080-4b35-97a3-e471dce2a02d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:38.161364 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eb07bfbf-0080-4b35-97a3-e471dce2a02d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:16:38.186208 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb07bfbf-0080-4b35-97a3-e471dce2a02d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:38.186662 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb07bfbf-0080-4b35-97a3-e471dce2a02d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:38.187489 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb07bfbf-0080-4b35-97a3-e471dce2a02d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:38.187932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb07bfbf-0080-4b35-97a3-e471dce2a02d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:38.256835 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-eb07bfbf-0080-4b35-97a3-e471dce2a02d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:16:38.377730 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eb07bfbf-0080-4b35-97a3-e471dce2a02d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.242433 Jul 31 01:16:38.378341 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1093/2186] 10.222.0.45 () {58 vars in 1125 bytes} [Sun Jul 31 01:16:38 2022] GET /compute/v2.1/servers => generated 1011 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:38.402000 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0d719000-864c-4174-896d-09e58ed6278d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:38.407111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0d719000-864c-4174-896d-09e58ed6278d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:38.408017 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0d719000-864c-4174-896d-09e58ed6278d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:16:38.421104 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d719000-864c-4174-896d-09e58ed6278d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:38.421949 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d719000-864c-4174-896d-09e58ed6278d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:38.422920 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d719000-864c-4174-896d-09e58ed6278d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:38.423538 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d719000-864c-4174-896d-09e58ed6278d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:38.539782 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-0d719000-864c-4174-896d-09e58ed6278d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:16:38.670027 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0d719000-864c-4174-896d-09e58ed6278d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.273983 Jul 31 01:16:38.683972 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1094/2187] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:16:38 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:38.688910 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7bc30ccd-6555-4c70-93f6-cf9a7aea307e tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:38.697740 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7bc30ccd-6555-4c70-93f6-cf9a7aea307e tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:38.711590 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7bc30ccd-6555-4c70-93f6-cf9a7aea307e tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:38.712991 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7bc30ccd-6555-4c70-93f6-cf9a7aea307e tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:38.713994 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7bc30ccd-6555-4c70-93f6-cf9a7aea307e tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:38.714586 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7bc30ccd-6555-4c70-93f6-cf9a7aea307e tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:39.034468 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e8417243-2910-460f-ae69-e5edb7d07741 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:39.064109 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e8417243-2910-460f-ae69-e5edb7d07741 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1318 microversion: 2.1 time: 1.368328 Jul 31 01:16:39.069699 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1094/2188] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:37 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1318 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:39.090936 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c5bafb39-04b7-4172-98d3-383c3052625d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:39.096887 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c5bafb39-04b7-4172-98d3-383c3052625d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:39.117556 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7bc30ccd-6555-4c70-93f6-cf9a7aea307e tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:39.124751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5bafb39-04b7-4172-98d3-383c3052625d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:39.130523 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7bc30ccd-6555-4c70-93f6-cf9a7aea307e tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1459 microversion: 2.1 time: 0.442218 Jul 31 01:16:39.131375 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1095/2189] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:38 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1459 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:39.132089 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5bafb39-04b7-4172-98d3-383c3052625d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:39.137252 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5bafb39-04b7-4172-98d3-383c3052625d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:39.138786 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5bafb39-04b7-4172-98d3-383c3052625d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:39.158239 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e665ae27-16d6-4169-873a-a544c88640e9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:39.165741 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e665ae27-16d6-4169-873a-a544c88640e9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:39.166194 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.compute.servers [None req-e665ae27-16d6-4169-873a-a544c88640e9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Removing options 'limit' from query {{(pid=119474) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 31 01:16:39.172038 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e665ae27-16d6-4169-873a-a544c88640e9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:16:39.193844 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e665ae27-16d6-4169-873a-a544c88640e9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:39.197431 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e665ae27-16d6-4169-873a-a544c88640e9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:39.201908 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e665ae27-16d6-4169-873a-a544c88640e9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:39.205961 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e665ae27-16d6-4169-873a-a544c88640e9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:39.295786 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e665ae27-16d6-4169-873a-a544c88640e9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.154374 Jul 31 01:16:39.296459 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1096/2190] 10.222.0.45 () {58 vars in 1140 bytes} [Sun Jul 31 01:16:39 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:39.311760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-51015e16-f5c9-4c1b-a1fc-b3a87d16911d tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fedea8d1b80>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:39.440706 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-51015e16-f5c9-4c1b-a1fc-b3a87d16911d tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1422 microversion: 2.1 time: 0.142972 Jul 31 01:16:39.444507 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1097/2191] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:39 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1422 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:39.451650 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a776bc04-eadb-4e12-8d15-f21cb7a07a97 tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:39.460443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a776bc04-eadb-4e12-8d15-f21cb7a07a97 tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:39.485600 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a776bc04-eadb-4e12-8d15-f21cb7a07a97 tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:39.486062 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a776bc04-eadb-4e12-8d15-f21cb7a07a97 tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:39.495434 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a776bc04-eadb-4e12-8d15-f21cb7a07a97 tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:39.499269 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a776bc04-eadb-4e12-8d15-f21cb7a07a97 tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:40.352437 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c5bafb39-04b7-4172-98d3-383c3052625d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:40.362950 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c5bafb39-04b7-4172-98d3-383c3052625d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:40.375679 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c5bafb39-04b7-4172-98d3-383c3052625d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:40.377163 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c5bafb39-04b7-4172-98d3-383c3052625d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1836 microversion: 2.32 time: 1.304689 Jul 31 01:16:40.380450 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1095/2192] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:39 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1836 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:40.389065 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-98726df8-06f5-41ec-bd2c-56a36300f04d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:40.405146 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-98726df8-06f5-41ec-bd2c-56a36300f04d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:40.406422 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-98726df8-06f5-41ec-bd2c-56a36300f04d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-754122715', 'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:16:40.423836 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-98726df8-06f5-41ec-bd2c-56a36300f04d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:40.429987 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-98726df8-06f5-41ec-bd2c-56a36300f04d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:40.433901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-98726df8-06f5-41ec-bd2c-56a36300f04d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:40.434372 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-98726df8-06f5-41ec-bd2c-56a36300f04d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:40.746971 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:40.752015 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.multi_cell_list [None req-98726df8-06f5-41ec-bd2c-56a36300f04d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119475) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:16:40.839646 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-98726df8-06f5-41ec-bd2c-56a36300f04d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-754122715" status: 200 len: 345 microversion: 2.1 time: 0.457814 Jul 31 01:16:40.841598 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1096/2193] 10.222.0.45 () {58 vars in 1240 bytes} [Sun Jul 31 01:16:40 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-754122715 => generated 345 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:40.860236 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-1c11bfa8-498b-4a75-a657-14a2c63ebce7 req-a1451ad7-2192-4a7f-bd7b-a6a810291c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "tag": "993014ab-481c-4599-9cca-e1b1e9595978"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:40.908596 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1c11bfa8-498b-4a75-a657-14a2c63ebce7 req-a1451ad7-2192-4a7f-bd7b-a6a810291c8b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:40.912113 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1c11bfa8-498b-4a75-a657-14a2c63ebce7 req-a1451ad7-2192-4a7f-bd7b-a6a810291c8b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:40.945734 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1c11bfa8-498b-4a75-a657-14a2c63ebce7 req-a1451ad7-2192-4a7f-bd7b-a6a810291c8b service nova] Creating event network-changed:993014ab-481c-4599-9cca-e1b1e9595978 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:16:40.955580 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-1c11bfa8-498b-4a75-a657-14a2c63ebce7 req-a1451ad7-2192-4a7f-bd7b-a6a810291c8b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111792 Jul 31 01:16:40.958114 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1097/2194] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:40.967784 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cfd4ea6c-54e8-46c7-8872-cde7662ffd65 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:40.970274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cfd4ea6c-54e8-46c7-8872-cde7662ffd65 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:40.992324 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfd4ea6c-54e8-46c7-8872-cde7662ffd65 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:40.994888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfd4ea6c-54e8-46c7-8872-cde7662ffd65 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:40.999023 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfd4ea6c-54e8-46c7-8872-cde7662ffd65 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:41.001246 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfd4ea6c-54e8-46c7-8872-cde7662ffd65 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:41.539429 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cfd4ea6c-54e8-46c7-8872-cde7662ffd65 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:41.551770 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cfd4ea6c-54e8-46c7-8872-cde7662ffd65 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1318 microversion: 2.1 time: 0.591753 Jul 31 01:16:41.563403 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1098/2195] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:40 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1318 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:41.563403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-baae2db9-e775-46e0-8300-68f5f5de5cf4 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede7fa9430>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:41.675750 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-baae2db9-e775-46e0-8300-68f5f5de5cf4 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1422 microversion: 2.1 time: 0.119907 Jul 31 01:16:41.677024 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1099/2196] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:41 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1422 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:41.684050 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-64236fae-7edf-4fc6-bc08-e54b7c9026b3 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:41.692164 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64236fae-7edf-4fc6-bc08-e54b7c9026b3 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:41.692857 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64236fae-7edf-4fc6-bc08-e54b7c9026b3 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:41.725085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-64236fae-7edf-4fc6-bc08-e54b7c9026b3 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Going to try to stop instance {{(pid=119475) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 01:16:41.801444 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-64236fae-7edf-4fc6-bc08-e54b7c9026b3 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "POST /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea/action" status: 202 len: 0 microversion: 2.1 time: 0.121743 Jul 31 01:16:41.810680 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1100/2197] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:16:41 2022] POST /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:16:41.827325 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dbbac851-727a-48fd-af5e-222770d05982 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:41.830025 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dbbac851-727a-48fd-af5e-222770d05982 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:41.842694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dbbac851-727a-48fd-af5e-222770d05982 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:41.844475 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dbbac851-727a-48fd-af5e-222770d05982 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:41.846224 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dbbac851-727a-48fd-af5e-222770d05982 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:41.847377 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dbbac851-727a-48fd-af5e-222770d05982 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:41.877174 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a776bc04-eadb-4e12-8d15-f21cb7a07a97 tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1610 microversion: 2.1 time: 2.428579 Jul 31 01:16:41.878728 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1098/2198] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:39 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1610 bytes in 2433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:41.890532 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-10ce377d-5a13-4129-a711-52d78463a7f0 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:41.891388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-10ce377d-5a13-4129-a711-52d78463a7f0 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:41.906098 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10ce377d-5a13-4129-a711-52d78463a7f0 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:41.907569 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10ce377d-5a13-4129-a711-52d78463a7f0 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:41.909634 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10ce377d-5a13-4129-a711-52d78463a7f0 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:41.910285 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10ce377d-5a13-4129-a711-52d78463a7f0 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:42.433975 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-10ce377d-5a13-4129-a711-52d78463a7f0 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:42.442827 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dbbac851-727a-48fd-af5e-222770d05982 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:42.442971 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-10ce377d-5a13-4129-a711-52d78463a7f0 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1520 microversion: 2.1 time: 0.562771 Jul 31 01:16:42.443528 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1099/2199] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:41 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1520 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:42.453625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dbbac851-727a-48fd-af5e-222770d05982 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:42.457400 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b040a8d7-2fe2-46e0-b773-e708dd553d51 tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:42.457953 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dbbac851-727a-48fd-af5e-222770d05982 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:42.460833 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:16:42.460833 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:16:42.463597 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dbbac851-727a-48fd-af5e-222770d05982 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1857 microversion: 2.32 time: 0.650980 Jul 31 01:16:42.469918 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1101/2200] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:41 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1857 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:42.485843 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b040a8d7-2fe2-46e0-b773-e708dd553d51 tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:42.486204 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b040a8d7-2fe2-46e0-b773-e708dd553d51 tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:42.487034 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b040a8d7-2fe2-46e0-b773-e708dd553d51 tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:42.496506 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b040a8d7-2fe2-46e0-b773-e708dd553d51 tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:42.613046 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b040a8d7-2fe2-46e0-b773-e708dd553d51 tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.159700 Jul 31 01:16:42.617751 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0ac5b2ec-6ecc-44f8-870a-427577c2e3b0 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:42.627757 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1100/2201] 10.222.0.45 () {58 vars in 1176 bytes} [Sun Jul 31 01:16:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:42.628042 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0ac5b2ec-6ecc-44f8-870a-427577c2e3b0 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:42.641456 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a5d8b8bc-66f6-472f-af1c-71d0af19a01c tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:42.651287 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a5d8b8bc-66f6-472f-af1c-71d0af19a01c tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:42.661776 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ac5b2ec-6ecc-44f8-870a-427577c2e3b0 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:42.664902 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a5d8b8bc-66f6-472f-af1c-71d0af19a01c tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:42.666055 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a5d8b8bc-66f6-472f-af1c-71d0af19a01c tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:42.666611 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ac5b2ec-6ecc-44f8-870a-427577c2e3b0 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:42.667450 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ac5b2ec-6ecc-44f8-870a-427577c2e3b0 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:42.673603 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ac5b2ec-6ecc-44f8-870a-427577c2e3b0 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:42.673940 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a5d8b8bc-66f6-472f-af1c-71d0af19a01c tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:42.674566 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a5d8b8bc-66f6-472f-af1c-71d0af19a01c tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:42.728184 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-a5d8b8bc-66f6-472f-af1c-71d0af19a01c tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Lazy-loading 'flavor' on Instance uuid 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:16:42.762711 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-a5d8b8bc-66f6-472f-af1c-71d0af19a01c tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 while it is in vm_state suspended Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a5d8b8bc-66f6-472f-af1c-71d0af19a01c tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Request method failure captured: Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5/action HTTP/1.1 Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 97 Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5de63DzerqiA1fNHcQtwNamley94YV8_b5ngEE6J9Jhn3wtTDyQt91A635Uak6ysnJwEIZg1a2N6_cvnWVaKhaNEqzrKcSG_OlsOBfkTsAXEJyRhZd4_c0PX20pTwqiXENaaFPdNzC2XpwAiWA8d35-7ufa29tGHFQO5SEXY9XtKuRY Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: de1d861fb0d64440b16227ef36cdac6f Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-LiveMigrationNegativeTest-1869567889 Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/de1d861fb0d64440b16227ef36cdac6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/de1d861fb0d64440b16227ef36cdac6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/de1d861fb0d64440b16227ef36cdac6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_de1d861fb0d64440b16227ef36cdac6f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-LiveMigrationNegativeTest-1869567889 Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: de1d861fb0d64440b16227ef36cdac6f Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1869567889 Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-LiveMigrationNegativeTest-1869567889-project-admin Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: e81f89a9ca924c5f895d22c0e85ebe04 Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-LiveMigrationNegativeTest-1869567889-project-admin Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: exception: Cannot 'os-migrateLive' instance 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 while it is in vm_state suspended Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '03e85908-e4e0-458e-bbfd-f58c0c8adcf5', 'body': {'os-migrateLive': {'host': 'n-h2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:16:42.772847 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 while it is in vm_state suspended Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 while it is in vm_state suspended Jul 31 01:16:42.776809 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:16:42.779643 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a5d8b8bc-66f6-472f-af1c-71d0af19a01c tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 while it is in vm_state suspended {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:16:42.780847 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a5d8b8bc-66f6-472f-af1c-71d0af19a01c tempest-LiveMigrationNegativeTest-1869567889 tempest-LiveMigrationNegativeTest-1869567889-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5/action" status: 409 len: 155 microversion: 2.1 time: 0.151973 Jul 31 01:16:42.784961 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1101/2202] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:16:42 2022] POST /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5/action => generated 155 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:16:42.790731 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2a838594-21ef-4311-a6d2-e85c0f7be529 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fedea981ee0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:42.879480 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2a838594-21ef-4311-a6d2-e85c0f7be529 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1422 microversion: 2.1 time: 0.093049 Jul 31 01:16:42.880206 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1102/2203] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:42 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:42.894565 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5b5ae471-fa09-493f-9c30-058af1f0da82 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:42.895090 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5b5ae471-fa09-493f-9c30-058af1f0da82 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:42.909737 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b5ae471-fa09-493f-9c30-058af1f0da82 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:42.910482 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b5ae471-fa09-493f-9c30-058af1f0da82 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:42.911548 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b5ae471-fa09-493f-9c30-058af1f0da82 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:42.912328 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b5ae471-fa09-493f-9c30-058af1f0da82 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:42.942349 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5b5ae471-fa09-493f-9c30-058af1f0da82 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:16:43.074344 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5b5ae471-fa09-493f-9c30-058af1f0da82 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "DELETE /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 204 len: 0 microversion: 2.1 time: 0.192592 Jul 31 01:16:43.079494 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1103/2204] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:16:42 2022] DELETE /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:16:43.099332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-3ccfa187-e17b-4559-ad2f-b997250946a0 req-61ef02cf-d0c9-42de-8a71-cf8828796ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf0c39f6-2c6a-4eb3-9176-7d20151b0adb", "name": "network-vif-plugged", "status": "completed", "tag": "cf150970-8f1a-4d54-b48d-7de2be48f7e1"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:43.128491 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3ccfa187-e17b-4559-ad2f-b997250946a0 req-61ef02cf-d0c9-42de-8a71-cf8828796ee5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:43.129241 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3ccfa187-e17b-4559-ad2f-b997250946a0 req-61ef02cf-d0c9-42de-8a71-cf8828796ee5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:43.140664 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0ac5b2ec-6ecc-44f8-870a-427577c2e3b0 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:43.155170 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-3ccfa187-e17b-4559-ad2f-b997250946a0 req-61ef02cf-d0c9-42de-8a71-cf8828796ee5 service nova] Creating event network-vif-plugged:cf150970-8f1a-4d54-b48d-7de2be48f7e1 for instance cf0c39f6-2c6a-4eb3-9176-7d20151b0adb on n-h2-master-1 Jul 31 01:16:43.157470 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0ac5b2ec-6ecc-44f8-870a-427577c2e3b0 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1318 microversion: 2.1 time: 0.567774 Jul 31 01:16:43.158347 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1102/2205] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:42 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:43.174221 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-3ccfa187-e17b-4559-ad2f-b997250946a0 req-61ef02cf-d0c9-42de-8a71-cf8828796ee5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092211 Jul 31 01:16:43.175253 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1104/2206] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:43.182309 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-671cc3f4-351a-4f89-8fd2-c9f042a3a246 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:43.187987 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-671cc3f4-351a-4f89-8fd2-c9f042a3a246 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:43.201667 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-671cc3f4-351a-4f89-8fd2-c9f042a3a246 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:43.202405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-671cc3f4-351a-4f89-8fd2-c9f042a3a246 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:43.211453 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-671cc3f4-351a-4f89-8fd2-c9f042a3a246 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:43.212152 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-671cc3f4-351a-4f89-8fd2-c9f042a3a246 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:43.405060 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-41aa6aea-65a0-438b-9426-47f0b2a93a5f req-723d68b3-138b-429f-b8db-fa6b9a8500b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "tag": "9d0de813-2073-4e2a-a486-6e31d72863a5"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:43.429258 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-41aa6aea-65a0-438b-9426-47f0b2a93a5f req-723d68b3-138b-429f-b8db-fa6b9a8500b4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:43.429996 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-41aa6aea-65a0-438b-9426-47f0b2a93a5f req-723d68b3-138b-429f-b8db-fa6b9a8500b4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:43.455993 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-41aa6aea-65a0-438b-9426-47f0b2a93a5f req-723d68b3-138b-429f-b8db-fa6b9a8500b4 service nova] Creating event network-changed:9d0de813-2073-4e2a-a486-6e31d72863a5 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:16:43.475121 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-41aa6aea-65a0-438b-9426-47f0b2a93a5f req-723d68b3-138b-429f-b8db-fa6b9a8500b4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.314481 Jul 31 01:16:43.476882 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1103/2207] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:43.491849 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e66cd01-0471-42c4-9440-b2c0ab66646c tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:43.494335 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3e66cd01-0471-42c4-9440-b2c0ab66646c tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:43.509349 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e66cd01-0471-42c4-9440-b2c0ab66646c tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:43.512052 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e66cd01-0471-42c4-9440-b2c0ab66646c tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:43.513952 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e66cd01-0471-42c4-9440-b2c0ab66646c tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:43.515100 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e66cd01-0471-42c4-9440-b2c0ab66646c tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:44.126184 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=10 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:44.139829 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-671cc3f4-351a-4f89-8fd2-c9f042a3a246 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:44.152860 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-671cc3f4-351a-4f89-8fd2-c9f042a3a246 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1465 microversion: 2.1 time: 0.973323 Jul 31 01:16:44.156141 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1105/2208] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:43 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1465 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:44.161726 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3ea646f4-eb80-45f7-9fcd-4589b69e5ccf tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:44.168412 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3ea646f4-eb80-45f7-9fcd-4589b69e5ccf tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:44.189113 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ea646f4-eb80-45f7-9fcd-4589b69e5ccf tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:44.189869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ea646f4-eb80-45f7-9fcd-4589b69e5ccf tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:44.193316 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ea646f4-eb80-45f7-9fcd-4589b69e5ccf tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:44.194724 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ea646f4-eb80-45f7-9fcd-4589b69e5ccf tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:44.322197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e66cd01-0471-42c4-9440-b2c0ab66646c tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:44.352225 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3e66cd01-0471-42c4-9440-b2c0ab66646c tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1520 microversion: 2.1 time: 0.873227 Jul 31 01:16:44.374986 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1104/2209] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:43 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1520 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:44.392965 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a71b9ab7-2b03-4992-b6c5-9f323487e38b tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede52db9d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:44.520281 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a71b9ab7-2b03-4992-b6c5-9f323487e38b tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1422 microversion: 2.1 time: 0.138926 Jul 31 01:16:44.521187 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1105/2210] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:44 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1422 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:44.526585 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5c459893-d433-4382-91bb-76ab7d4b8128 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:44.527214 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5c459893-d433-4382-91bb-76ab7d4b8128 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:44.537187 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c459893-d433-4382-91bb-76ab7d4b8128 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:44.538230 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c459893-d433-4382-91bb-76ab7d4b8128 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:44.539061 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c459893-d433-4382-91bb-76ab7d4b8128 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:44.539584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c459893-d433-4382-91bb-76ab7d4b8128 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:45.254038 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3ea646f4-eb80-45f7-9fcd-4589b69e5ccf tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:45.273260 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3ea646f4-eb80-45f7-9fcd-4589b69e5ccf tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:45.275577 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3ea646f4-eb80-45f7-9fcd-4589b69e5ccf tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:45.288210 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3ea646f4-eb80-45f7-9fcd-4589b69e5ccf tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 1.122004 Jul 31 01:16:45.289000 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1106/2211] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:44 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:45.294319 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f5977618-c7d1-43f7-9e02-35fb2c41aa6e tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:45.295264 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f5977618-c7d1-43f7-9e02-35fb2c41aa6e tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:45.311543 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5977618-c7d1-43f7-9e02-35fb2c41aa6e tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:45.312507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5977618-c7d1-43f7-9e02-35fb2c41aa6e tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:45.313585 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5977618-c7d1-43f7-9e02-35fb2c41aa6e tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:45.314239 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5977618-c7d1-43f7-9e02-35fb2c41aa6e tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:45.354412 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:45.374614 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5c459893-d433-4382-91bb-76ab7d4b8128 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:45.385637 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5c459893-d433-4382-91bb-76ab7d4b8128 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1318 microversion: 2.1 time: 0.862959 Jul 31 01:16:45.386838 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1106/2212] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:44 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1318 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:45.402724 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-ddebac00-41b5-439f-a6eb-11777fee2b16 req-5e6bc435-3551-48ba-a732-22b1878d005c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf56656-f786-439a-8d92-a4365424d0d7", "name": "network-vif-plugged", "status": "completed", "tag": "f14a9b78-dba4-47d9-b73e-195b70df06a4"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:45.422274 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ddebac00-41b5-439f-a6eb-11777fee2b16 req-5e6bc435-3551-48ba-a732-22b1878d005c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:45.423123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ddebac00-41b5-439f-a6eb-11777fee2b16 req-5e6bc435-3551-48ba-a732-22b1878d005c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:45.438472 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-ddebac00-41b5-439f-a6eb-11777fee2b16 req-5e6bc435-3551-48ba-a732-22b1878d005c service nova] Creating event network-vif-plugged:f14a9b78-dba4-47d9-b73e-195b70df06a4 for instance cdf56656-f786-439a-8d92-a4365424d0d7 on n-h2-master-1 Jul 31 01:16:45.445695 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-ddebac00-41b5-439f-a6eb-11777fee2b16 req-5e6bc435-3551-48ba-a732-22b1878d005c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057319 Jul 31 01:16:45.447952 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1107/2213] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:45.456678 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c85009e1-30af-469d-992b-30797ba87d5b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:45.458858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c85009e1-30af-469d-992b-30797ba87d5b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:45.466736 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c85009e1-30af-469d-992b-30797ba87d5b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:45.467653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c85009e1-30af-469d-992b-30797ba87d5b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:45.468878 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c85009e1-30af-469d-992b-30797ba87d5b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:45.476239 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c85009e1-30af-469d-992b-30797ba87d5b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:45.671956 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=12 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:47.683881 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f5977618-c7d1-43f7-9e02-35fb2c41aa6e tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:47.692962 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f5977618-c7d1-43f7-9e02-35fb2c41aa6e tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1465 microversion: 2.1 time: 2.402607 Jul 31 01:16:47.696101 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1107/2214] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:45 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1465 bytes in 2406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:47.736502 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e3e9fb88-d725-4ea1-87e4-0c6975f85027 req-4cbf2ccd-c619-478a-859f-08a61ebe815c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "tag": "125ddd94-e67d-4f25-a9da-1073d0016a4d"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:47.775189 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e3e9fb88-d725-4ea1-87e4-0c6975f85027 req-4cbf2ccd-c619-478a-859f-08a61ebe815c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:47.781872 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e3e9fb88-d725-4ea1-87e4-0c6975f85027 req-4cbf2ccd-c619-478a-859f-08a61ebe815c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:47.814184 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e3e9fb88-d725-4ea1-87e4-0c6975f85027 req-4cbf2ccd-c619-478a-859f-08a61ebe815c service nova] Creating event network-changed:125ddd94-e67d-4f25-a9da-1073d0016a4d for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:16:47.820722 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e3e9fb88-d725-4ea1-87e4-0c6975f85027 req-4cbf2ccd-c619-478a-859f-08a61ebe815c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088755 Jul 31 01:16:47.822453 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1108/2215] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:47.830461 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2b81ae03-db32-4b3b-a6ea-5e804e718b8c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fedea8ed550>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:47.925451 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2b81ae03-db32-4b3b-a6ea-5e804e718b8c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1422 microversion: 2.1 time: 0.101124 Jul 31 01:16:47.927455 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1109/2216] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:47 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1422 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:47.945422 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8eb0922a-c453-4398-be8e-51d289670ba7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:47.952172 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8eb0922a-c453-4398-be8e-51d289670ba7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:47.986164 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8eb0922a-c453-4398-be8e-51d289670ba7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:47.988362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8eb0922a-c453-4398-be8e-51d289670ba7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:47.990509 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8eb0922a-c453-4398-be8e-51d289670ba7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:47.994298 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8eb0922a-c453-4398-be8e-51d289670ba7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:48.338175 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c85009e1-30af-469d-992b-30797ba87d5b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:48.369835 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c85009e1-30af-469d-992b-30797ba87d5b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1520 microversion: 2.1 time: 2.919967 Jul 31 01:16:48.373529 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1108/2217] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:45 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1520 bytes in 2925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:48.392202 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d455b902-ba49-4573-8309-4e0ed9c82968 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:48.392925 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d455b902-ba49-4573-8309-4e0ed9c82968 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:48.414960 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:48.419422 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d455b902-ba49-4573-8309-4e0ed9c82968 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:48.420872 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d455b902-ba49-4573-8309-4e0ed9c82968 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:48.425616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d455b902-ba49-4573-8309-4e0ed9c82968 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:48.426283 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d455b902-ba49-4573-8309-4e0ed9c82968 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:49.601658 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8eb0922a-c453-4398-be8e-51d289670ba7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:49.629111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8eb0922a-c453-4398-be8e-51d289670ba7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:49.640097 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8eb0922a-c453-4398-be8e-51d289670ba7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:49.641660 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8eb0922a-c453-4398-be8e-51d289670ba7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 1.707534 Jul 31 01:16:49.642678 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1110/2218] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:47 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:49.648291 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-24939669-79f7-4cd4-b8ba-0cae190f410c req-7d9d598e-8ea2-43e5-9c63-eb3ed97e5d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e85908-e4e0-458e-bbfd-f58c0c8adcf5", "name": "network-vif-unplugged", "status": "completed", "tag": "2da650e9-07f6-438f-8236-c614d9bd0271"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:49.672464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-24939669-79f7-4cd4-b8ba-0cae190f410c req-7d9d598e-8ea2-43e5-9c63-eb3ed97e5d6a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:49.672955 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-24939669-79f7-4cd4-b8ba-0cae190f410c req-7d9d598e-8ea2-43e5-9c63-eb3ed97e5d6a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:49.697518 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-24939669-79f7-4cd4-b8ba-0cae190f410c req-7d9d598e-8ea2-43e5-9c63-eb3ed97e5d6a service nova] Creating event network-vif-unplugged:2da650e9-07f6-438f-8236-c614d9bd0271 for instance 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 on n-h1-master-1 Jul 31 01:16:49.712805 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-24939669-79f7-4cd4-b8ba-0cae190f410c req-7d9d598e-8ea2-43e5-9c63-eb3ed97e5d6a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068491 Jul 31 01:16:49.713467 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1111/2219] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:49.719037 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-25275493-d92b-4a85-a39a-f467c827dc9c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:49.720069 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-25275493-d92b-4a85-a39a-f467c827dc9c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:49.737591 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25275493-d92b-4a85-a39a-f467c827dc9c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:49.738397 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25275493-d92b-4a85-a39a-f467c827dc9c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:49.739384 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25275493-d92b-4a85-a39a-f467c827dc9c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:49.741640 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25275493-d92b-4a85-a39a-f467c827dc9c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:49.823232 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:49.831550 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25275493-d92b-4a85-a39a-f467c827dc9c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:49.832461 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25275493-d92b-4a85-a39a-f467c827dc9c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:49.833361 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-25275493-d92b-4a85-a39a-f467c827dc9c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lazy-loading 'fault' on Instance uuid 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:16:49.953749 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-25275493-d92b-4a85-a39a-f467c827dc9c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:49.964614 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-25275493-d92b-4a85-a39a-f467c827dc9c tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 200 len: 1308 microversion: 2.1 time: 0.249740 Jul 31 01:16:49.970347 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1112/2220] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:49 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 1308 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:49.972628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d455b902-ba49-4573-8309-4e0ed9c82968 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:49.982150 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d455b902-ba49-4573-8309-4e0ed9c82968 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1318 microversion: 2.1 time: 1.604587 Jul 31 01:16:49.989296 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4035fd36-03b2-4c28-a829-5cac581c6433 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fedea944b80>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:49.992679 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1109/2221] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:48 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1318 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:50.019986 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a8b5676b-c338-4d07-97e7-c97ceab8f0d6 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:50.020776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a8b5676b-c338-4d07-97e7-c97ceab8f0d6 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:50.033801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8b5676b-c338-4d07-97e7-c97ceab8f0d6 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:50.037509 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8b5676b-c338-4d07-97e7-c97ceab8f0d6 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:50.039324 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8b5676b-c338-4d07-97e7-c97ceab8f0d6 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:50.041045 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8b5676b-c338-4d07-97e7-c97ceab8f0d6 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:50.114777 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4035fd36-03b2-4c28-a829-5cac581c6433 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1422 microversion: 2.1 time: 0.142914 Jul 31 01:16:50.119548 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1113/2222] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:49 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1422 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:50.132969 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e8adc751-32ea-44d5-ac81-12111eb92ed2 req-75f9383b-e046-483b-9e37-14fbd52f9f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e85908-e4e0-458e-bbfd-f58c0c8adcf5", "name": "network-vif-deleted", "tag": "2da650e9-07f6-438f-8236-c614d9bd0271"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:50.188650 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e8adc751-32ea-44d5-ac81-12111eb92ed2 req-75f9383b-e046-483b-9e37-14fbd52f9f1f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:50.189367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e8adc751-32ea-44d5-ac81-12111eb92ed2 req-75f9383b-e046-483b-9e37-14fbd52f9f1f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:50.214661 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e8adc751-32ea-44d5-ac81-12111eb92ed2 req-75f9383b-e046-483b-9e37-14fbd52f9f1f service nova] Creating event network-vif-deleted:2da650e9-07f6-438f-8236-c614d9bd0271 for instance 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 on n-h1-master-1 Jul 31 01:16:50.231571 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e8adc751-32ea-44d5-ac81-12111eb92ed2 req-75f9383b-e046-483b-9e37-14fbd52f9f1f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109531 Jul 31 01:16:50.232848 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1114/2223] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:50.242085 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-bd2131e2-58ea-412a-b506-6176b149bb7f req-b19b4120-c134-40cf-9825-191aa56db3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "tag": "22b1cf82-6093-47ed-8f73-4e9ef9d96cd1"}, {"name": "network-changed", "server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "tag": "a49bdcce-53dd-4303-86cf-783aea87f084"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:50.259566 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-bd2131e2-58ea-412a-b506-6176b149bb7f req-b19b4120-c134-40cf-9825-191aa56db3e4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:50.260332 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-bd2131e2-58ea-412a-b506-6176b149bb7f req-b19b4120-c134-40cf-9825-191aa56db3e4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:50.280030 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-bd2131e2-58ea-412a-b506-6176b149bb7f req-b19b4120-c134-40cf-9825-191aa56db3e4 service nova] Creating event network-changed:22b1cf82-6093-47ed-8f73-4e9ef9d96cd1 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:16:50.280883 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-bd2131e2-58ea-412a-b506-6176b149bb7f req-b19b4120-c134-40cf-9825-191aa56db3e4 service nova] Creating event network-changed:a49bdcce-53dd-4303-86cf-783aea87f084 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:16:50.288248 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-bd2131e2-58ea-412a-b506-6176b149bb7f req-b19b4120-c134-40cf-9825-191aa56db3e4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053487 Jul 31 01:16:50.289445 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1115/2224] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:50.528107 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:50.547769 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a8b5676b-c338-4d07-97e7-c97ceab8f0d6 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:50.562010 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a8b5676b-c338-4d07-97e7-c97ceab8f0d6 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1520 microversion: 2.1 time: 0.564911 Jul 31 01:16:50.582580 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1110/2225] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:49 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1520 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:50.679398 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c0ac1610-156d-4e16-bc0f-0daa6573db64 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:50.680468 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c0ac1610-156d-4e16-bc0f-0daa6573db64 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:50.707199 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0ac1610-156d-4e16-bc0f-0daa6573db64 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:50.715708 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0ac1610-156d-4e16-bc0f-0daa6573db64 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:50.717252 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0ac1610-156d-4e16-bc0f-0daa6573db64 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:50.717781 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0ac1610-156d-4e16-bc0f-0daa6573db64 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:51.104088 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-87c8187d-29fb-41b2-9103-7dc417f2f3a8 tempest-QuotaClassesAdmin257Test-272671291 tempest-QuotaClassesAdmin257Test-272671291-project-admin] Calling method '.version_select at 0x7fede5659040>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:51.105549 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:16:51.105549 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:16:51.119593 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-87c8187d-29fb-41b2-9103-7dc417f2f3a8 tempest-QuotaClassesAdmin257Test-272671291 tempest-QuotaClassesAdmin257Test-272671291-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.450727 Jul 31 01:16:51.132557 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1111/2226] 10.222.0.45 () {60 vars in 1226 bytes} [Sun Jul 31 01:16:50 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:16:51.144204 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2a2d2e77-e4f4-40f9-b428-404407c25d4d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:51.145079 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2a2d2e77-e4f4-40f9-b428-404407c25d4d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 03e85908-e4e0-458e-bbfd-f58c0c8adcf5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:51.166765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2a2d2e77-e4f4-40f9-b428-404407c25d4d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:51.174930 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2a2d2e77-e4f4-40f9-b428-404407c25d4d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:51.176420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2a2d2e77-e4f4-40f9-b428-404407c25d4d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:51.181513 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2a2d2e77-e4f4-40f9-b428-404407c25d4d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:51.246021 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-2a2d2e77-e4f4-40f9-b428-404407c25d4d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] HTTP exception thrown: Instance 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 could not be found. Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2a2d2e77-e4f4-40f9-b428-404407c25d4d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Request method failure captured: Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 HTTP/1.1 Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5de56tlS_RuJRNdkpPV9b5G2CMe391qrJ8-pALhjQ8DBqpuJeF9j4qS64ml8FALtjBKmI4Mob_NLnVdSiMa9q7CLRT1S59_TbyIyqRNvU_Vica5Nj88IzXiNg62ARZCP_hUooze-Bd16yvTr77zBhuHTZa0r0d59D9L99ezQmkGZYZk Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 1f193d444cb7454e8181677060a126c5 Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-LiveMigrationNegativeTest-1218869871 Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1f193d444cb7454e8181677060a126c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1f193d444cb7454e8181677060a126c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1f193d444cb7454e8181677060a126c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1f193d444cb7454e8181677060a126c5", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-LiveMigrationNegativeTest-1218869871 Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 1f193d444cb7454e8181677060a126c5 Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1218869871 Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-LiveMigrationNegativeTest-1218869871-project Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 9fced56492d64f4983157a0e5d7b1121 Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-LiveMigrationNegativeTest-1218869871-project Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 could not be found. Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '03e85908-e4e0-458e-bbfd-f58c0c8adcf5'} Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 could not be found. Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 could not be found. Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:16:51.249024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:16:51.252566 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:51.252566 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:16:51.252566 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:16:51.252566 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:16:51.252566 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:16:51.252566 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 could not be found. Jul 31 01:16:51.252566 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:16:51.254440 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2a2d2e77-e4f4-40f9-b428-404407c25d4d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Returning 404 to user: Instance 03e85908-e4e0-458e-bbfd-f58c0c8adcf5 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:16:51.255627 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2a2d2e77-e4f4-40f9-b428-404407c25d4d tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5" status: 404 len: 111 microversion: 2.1 time: 0.121320 Jul 31 01:16:51.256487 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1112/2227] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:51 2022] GET /compute/v2.1/servers/03e85908-e4e0-458e-bbfd-f58c0c8adcf5 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:16:51.262290 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f8daacdc-857f-475f-8bf7-6ed293c19763 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:51.263569 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f8daacdc-857f-475f-8bf7-6ed293c19763 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:51.271660 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8daacdc-857f-475f-8bf7-6ed293c19763 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:51.272463 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8daacdc-857f-475f-8bf7-6ed293c19763 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:51.273490 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8daacdc-857f-475f-8bf7-6ed293c19763 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:51.274226 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8daacdc-857f-475f-8bf7-6ed293c19763 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:52.210248 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c0ac1610-156d-4e16-bc0f-0daa6573db64 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:52.262405 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c0ac1610-156d-4e16-bc0f-0daa6573db64 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:52.270279 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c0ac1610-156d-4e16-bc0f-0daa6573db64 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:52.284131 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c0ac1610-156d-4e16-bc0f-0daa6573db64 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 1.606289 Jul 31 01:16:52.289227 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1116/2228] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:50 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:16:52.304737 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8274ccf3-b7af-4ebe-9da9-f5e51b1113fa tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fedea851790>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:52.445641 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8274ccf3-b7af-4ebe-9da9-f5e51b1113fa tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1422 microversion: 2.1 time: 0.153148 Jul 31 01:16:52.446603 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1117/2229] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:52 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1422 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:52.470346 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-137c64b1-f816-4421-a656-3e552644d73d tempest-QuotaClassesAdmin257Test-272671291 tempest-QuotaClassesAdmin257Test-272671291-project-admin] Action: 'update', calling method: .version_select at 0x7fedea959550>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:52.473861 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:16:52.473861 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:16:52.515260 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=18 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:52.517857 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f8daacdc-857f-475f-8bf7-6ed293c19763 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:52.544051 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f8daacdc-857f-475f-8bf7-6ed293c19763 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1468 microversion: 2.1 time: 1.285921 Jul 31 01:16:52.587832 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1113/2230] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:51 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1468 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:52.613333 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dda2d352-5e89-4957-a8dc-7f4a485c9d20 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:52.614446 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dda2d352-5e89-4957-a8dc-7f4a485c9d20 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:52.658223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dda2d352-5e89-4957-a8dc-7f4a485c9d20 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:52.659462 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dda2d352-5e89-4957-a8dc-7f4a485c9d20 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:52.664156 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dda2d352-5e89-4957-a8dc-7f4a485c9d20 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:52.666728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dda2d352-5e89-4957-a8dc-7f4a485c9d20 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:52.746571 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-137c64b1-f816-4421-a656-3e552644d73d tempest-QuotaClassesAdmin257Test-272671291 tempest-QuotaClassesAdmin257Test-272671291-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.280346 Jul 31 01:16:52.747468 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1118/2231] 10.222.0.45 () {62 vars in 1247 bytes} [Sun Jul 31 01:16:52 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:16:52.760861 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-64cc5a7f-2a31-4871-901e-093bec56825b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:52.763637 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-64cc5a7f-2a31-4871-901e-093bec56825b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:52.789110 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-64cc5a7f-2a31-4871-901e-093bec56825b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:52.789571 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-64cc5a7f-2a31-4871-901e-093bec56825b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:52.790384 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-64cc5a7f-2a31-4871-901e-093bec56825b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:52.799447 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-64cc5a7f-2a31-4871-901e-093bec56825b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:52.800588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dda2d352-5e89-4957-a8dc-7f4a485c9d20 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:16:53.011695 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dda2d352-5e89-4957-a8dc-7f4a485c9d20 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "DELETE /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 204 len: 0 microversion: 2.1 time: 0.420717 Jul 31 01:16:53.015325 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1114/2232] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:16:52 2022] DELETE /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:16:53.034028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-ea00db7c-8563-423a-8069-610613cc56df req-e532839a-4103-4a5d-936b-a6a9f890a561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "tag": "de3ca179-e6db-401d-ac3c-cb604c404e59"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:53.052436 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ea00db7c-8563-423a-8069-610613cc56df req-e532839a-4103-4a5d-936b-a6a9f890a561 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:53.054831 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ea00db7c-8563-423a-8069-610613cc56df req-e532839a-4103-4a5d-936b-a6a9f890a561 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:53.076146 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-ea00db7c-8563-423a-8069-610613cc56df req-e532839a-4103-4a5d-936b-a6a9f890a561 service nova] Creating event network-changed:de3ca179-e6db-401d-ac3c-cb604c404e59 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:16:53.093123 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-ea00db7c-8563-423a-8069-610613cc56df req-e532839a-4103-4a5d-936b-a6a9f890a561 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073718 Jul 31 01:16:53.094006 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1115/2233] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:53.116119 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-30407250-6f93-4125-bec0-2b60c91b5130 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:53.116928 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-30407250-6f93-4125-bec0-2b60c91b5130 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cf0c39f6-2c6a-4eb3-9176-7d20151b0adb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:53.124012 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30407250-6f93-4125-bec0-2b60c91b5130 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:53.124407 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30407250-6f93-4125-bec0-2b60c91b5130 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:53.125222 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30407250-6f93-4125-bec0-2b60c91b5130 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:53.125674 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30407250-6f93-4125-bec0-2b60c91b5130 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:53.172942 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:53.633777 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-64cc5a7f-2a31-4871-901e-093bec56825b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:53.645385 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-64cc5a7f-2a31-4871-901e-093bec56825b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1520 microversion: 2.1 time: 0.895612 Jul 31 01:16:53.653048 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1119/2234] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:52 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1520 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:53.658460 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e542920f-4307-4d9a-8b77-53fc344971be tempest-QuotaClassesAdmin257Test-272671291 tempest-QuotaClassesAdmin257Test-272671291-project-admin] Calling method '.version_select at 0x7fedea981820>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:53.663164 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:16:53.663164 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:16:53.697037 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e542920f-4307-4d9a-8b77-53fc344971be tempest-QuotaClassesAdmin257Test-272671291 tempest-QuotaClassesAdmin257Test-272671291-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.042425 Jul 31 01:16:53.704783 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1120/2235] 10.222.0.45 () {60 vars in 1226 bytes} [Sun Jul 31 01:16:53 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:16:53.710072 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-319c3ff0-8d47-41d7-929a-7597f9f1d452 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:53.716908 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-319c3ff0-8d47-41d7-929a-7597f9f1d452 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:53.743284 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-30407250-6f93-4125-bec0-2b60c91b5130 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:53.750618 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-319c3ff0-8d47-41d7-929a-7597f9f1d452 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:53.751280 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-319c3ff0-8d47-41d7-929a-7597f9f1d452 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:53.752393 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-319c3ff0-8d47-41d7-929a-7597f9f1d452 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:53.752930 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-319c3ff0-8d47-41d7-929a-7597f9f1d452 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:53.764673 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-30407250-6f93-4125-bec0-2b60c91b5130 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb" status: 200 len: 1468 microversion: 2.1 time: 0.668586 Jul 31 01:16:53.765671 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1116/2236] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:53 2022] GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb => generated 1468 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:53.780085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-95472932-832d-4c1e-974e-780805c797a5 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:53.792453 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-95472932-832d-4c1e-974e-780805c797a5 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:53.813821 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95472932-832d-4c1e-974e-780805c797a5 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:53.815129 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95472932-832d-4c1e-974e-780805c797a5 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:53.826256 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95472932-832d-4c1e-974e-780805c797a5 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:53.828077 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95472932-832d-4c1e-974e-780805c797a5 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:54.359719 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-95472932-832d-4c1e-974e-780805c797a5 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:54.378090 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-95472932-832d-4c1e-974e-780805c797a5 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:54.379712 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-95472932-832d-4c1e-974e-780805c797a5 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:54.388671 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-95472932-832d-4c1e-974e-780805c797a5 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 0.616019 Jul 31 01:16:54.389327 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1117/2237] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:53 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:54.400679 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3755cac8-2f72-43b0-aa96-5a2b17fd5adf tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede5759310>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:54.424648 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-319c3ff0-8d47-41d7-929a-7597f9f1d452 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:54.436212 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-319c3ff0-8d47-41d7-929a-7597f9f1d452 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1474 microversion: 2.1 time: 0.730063 Jul 31 01:16:54.445149 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1121/2238] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:53 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1474 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:54.457152 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5df045e5-6fe8-44f0-882c-b2a67fb92518 tempest-QuotaClassesAdmin257Test-272671291 tempest-QuotaClassesAdmin257Test-272671291-project-admin] Action: 'update', calling method: .version_select at 0x7fedea871a60>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:54.468134 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:16:54.468134 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:16:54.532040 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3755cac8-2f72-43b0-aa96-5a2b17fd5adf tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1422 microversion: 2.1 time: 0.133705 Jul 31 01:16:54.542240 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1118/2239] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:54 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1422 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:54.565373 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e9d4cd9c-043a-44a0-973d-1c8813b4c914 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-175301820"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:54.578201 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e9d4cd9c-043a-44a0-973d-1c8813b4c914 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cf0c39f6-2c6a-4eb3-9176-7d20151b0adb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:54.598046 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9d4cd9c-043a-44a0-973d-1c8813b4c914 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:54.600456 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9d4cd9c-043a-44a0-973d-1c8813b4c914 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:54.603128 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9d4cd9c-043a-44a0-973d-1c8813b4c914 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:54.603846 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9d4cd9c-043a-44a0-973d-1c8813b4c914 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:54.698562 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5df045e5-6fe8-44f0-882c-b2a67fb92518 tempest-QuotaClassesAdmin257Test-272671291 tempest-QuotaClassesAdmin257Test-272671291-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.252082 Jul 31 01:16:54.700616 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1122/2240] 10.222.0.45 () {62 vars in 1247 bytes} [Sun Jul 31 01:16:54 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:16:54.733515 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2fd8b964-1962-497d-9814-af21f6fc2ffe tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:54.739008 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2fd8b964-1962-497d-9814-af21f6fc2ffe tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:54.793395 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2fd8b964-1962-497d-9814-af21f6fc2ffe tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:54.796209 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2fd8b964-1962-497d-9814-af21f6fc2ffe tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:54.798772 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2fd8b964-1962-497d-9814-af21f6fc2ffe tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:54.804262 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2fd8b964-1962-497d-9814-af21f6fc2ffe tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:55.472643 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e9d4cd9c-043a-44a0-973d-1c8813b4c914 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "POST /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb/action" status: 202 len: 0 microversion: 2.1 time: 0.934679 Jul 31 01:16:55.481593 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1119/2241] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:16:54 2022] POST /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb/action => generated 0 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 31 01:16:55.499156 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-45bbcdf0-4786-423c-bdb1-b6f940076329 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:55.523108 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-45bbcdf0-4786-423c-bdb1-b6f940076329 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:55.554481 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45bbcdf0-4786-423c-bdb1-b6f940076329 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:55.557410 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45bbcdf0-4786-423c-bdb1-b6f940076329 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:55.559986 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2fd8b964-1962-497d-9814-af21f6fc2ffe tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:55.562501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45bbcdf0-4786-423c-bdb1-b6f940076329 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:55.565670 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45bbcdf0-4786-423c-bdb1-b6f940076329 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:55.577852 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2fd8b964-1962-497d-9814-af21f6fc2ffe tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1520 microversion: 2.1 time: 0.866453 Jul 31 01:16:55.582808 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1123/2242] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:54 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1520 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:55.605069 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0da7da93-9565-4fa3-8804-ed24e239b8c5 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:55.608510 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0da7da93-9565-4fa3-8804-ed24e239b8c5 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:55.641385 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0da7da93-9565-4fa3-8804-ed24e239b8c5 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:55.643701 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0da7da93-9565-4fa3-8804-ed24e239b8c5 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:55.649577 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0da7da93-9565-4fa3-8804-ed24e239b8c5 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:55.650510 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0da7da93-9565-4fa3-8804-ed24e239b8c5 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:56.415816 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0da7da93-9565-4fa3-8804-ed24e239b8c5 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:56.428242 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0da7da93-9565-4fa3-8804-ed24e239b8c5 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1474 microversion: 2.1 time: 0.841498 Jul 31 01:16:56.429163 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1124/2243] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:55 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1474 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:56.442340 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-49d4954a-4c2c-476e-b693-f3c219ebd7d6 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedea97c1f0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:56.471785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-45bbcdf0-4786-423c-bdb1-b6f940076329 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:56.490903 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-45bbcdf0-4786-423c-bdb1-b6f940076329 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:56.511225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-45bbcdf0-4786-423c-bdb1-b6f940076329 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:56.525286 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-49d4954a-4c2c-476e-b693-f3c219ebd7d6 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1" status: 200 len: 1454 microversion: 2.1 time: 0.094699 Jul 31 01:16:56.529763 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-45bbcdf0-4786-423c-bdb1-b6f940076329 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 1.045053 Jul 31 01:16:56.530285 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1125/2244] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:56 2022] GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:56.546737 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1120/2245] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:55 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:56.548104 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d70e1083-f32e-4ff4-8aab-945b0aa82c3c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fedea871e50>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:56.585062 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-8ebf329f-d687-4fe8-9466-b50c7e01bf6b req-1d006e94-47e3-4130-a891-8c3fb5251699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "tag": "3b5d94b7-0fe7-467f-9eff-92e830a3cf3d"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:56.614776 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8ebf329f-d687-4fe8-9466-b50c7e01bf6b req-1d006e94-47e3-4130-a891-8c3fb5251699 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:56.615287 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8ebf329f-d687-4fe8-9466-b50c7e01bf6b req-1d006e94-47e3-4130-a891-8c3fb5251699 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:56.656588 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-8ebf329f-d687-4fe8-9466-b50c7e01bf6b req-1d006e94-47e3-4130-a891-8c3fb5251699 service nova] Creating event network-changed:3b5d94b7-0fe7-467f-9eff-92e830a3cf3d for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:16:56.669650 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-8ebf329f-d687-4fe8-9466-b50c7e01bf6b req-1d006e94-47e3-4130-a891-8c3fb5251699 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121431 Jul 31 01:16:56.670286 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1121/2246] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:16:56.681699 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-24f95c71-089e-4046-965e-0aa2ed9dac6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:56.683680 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d70e1083-f32e-4ff4-8aab-945b0aa82c3c tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1422 microversion: 2.1 time: 0.149513 Jul 31 01:16:56.685519 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-24f95c71-089e-4046-965e-0aa2ed9dac6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:56.693465 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1126/2247] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:56 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1422 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:56.708900 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24f95c71-089e-4046-965e-0aa2ed9dac6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:56.711047 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24f95c71-089e-4046-965e-0aa2ed9dac6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:56.714771 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24f95c71-089e-4046-965e-0aa2ed9dac6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:56.715868 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24f95c71-089e-4046-965e-0aa2ed9dac6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:57.192451 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-24f95c71-089e-4046-965e-0aa2ed9dac6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:57.211833 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-24f95c71-089e-4046-965e-0aa2ed9dac6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1520 microversion: 2.1 time: 0.540073 Jul 31 01:16:57.212903 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1122/2248] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:56 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1520 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:57.451244 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f0d5870-70e7-4875-81a2-b4c9d5420479 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:57.452974 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6f0d5870-70e7-4875-81a2-b4c9d5420479 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:57.463263 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f0d5870-70e7-4875-81a2-b4c9d5420479 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:57.463760 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f0d5870-70e7-4875-81a2-b4c9d5420479 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:57.464600 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f0d5870-70e7-4875-81a2-b4c9d5420479 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:57.465050 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f0d5870-70e7-4875-81a2-b4c9d5420479 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:57.534234 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f0d5870-70e7-4875-81a2-b4c9d5420479 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:57.534959 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f0d5870-70e7-4875-81a2-b4c9d5420479 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:57.536209 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-6f0d5870-70e7-4875-81a2-b4c9d5420479 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lazy-loading 'fault' on Instance uuid 51fae254-0bd2-4470-a05b-bf0e83d7c3dc {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:16:57.543944 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-624f017a-9f67-42b3-b709-ada959d0814f tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede55ee700>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:57.635966 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-624f017a-9f67-42b3-b709-ada959d0814f tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1" status: 200 len: 1454 microversion: 2.1 time: 0.095603 Jul 31 01:16:57.637546 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1123/2249] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:57 2022] GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1 => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:16:57.646190 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-19eccc86-b6c6-4f02-89b2-94e998acad62 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:57.647982 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-19eccc86-b6c6-4f02-89b2-94e998acad62 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:57.658080 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19eccc86-b6c6-4f02-89b2-94e998acad62 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:57.658756 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19eccc86-b6c6-4f02-89b2-94e998acad62 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:57.661606 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19eccc86-b6c6-4f02-89b2-94e998acad62 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:57.662871 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19eccc86-b6c6-4f02-89b2-94e998acad62 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:57.761016 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6f0d5870-70e7-4875-81a2-b4c9d5420479 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fced56492d64f4983157a0e5d7b1121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f193d444cb7454e8181677060a126c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:57.809093 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6f0d5870-70e7-4875-81a2-b4c9d5420479 tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 200 len: 1309 microversion: 2.1 time: 0.362725 Jul 31 01:16:57.809989 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1127/2250] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:57 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 1309 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:57.828760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c4aad996-172c-4202-84a0-7b07fc1012b0 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fedea8515e0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:57.901930 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c4aad996-172c-4202-84a0-7b07fc1012b0 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1422 microversion: 2.1 time: 0.086891 Jul 31 01:16:57.902726 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1128/2251] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:57 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1422 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:58.143395 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-19eccc86-b6c6-4f02-89b2-94e998acad62 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:58.157974 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-19eccc86-b6c6-4f02-89b2-94e998acad62 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:58.165903 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-19eccc86-b6c6-4f02-89b2-94e998acad62 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:58.168248 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-19eccc86-b6c6-4f02-89b2-94e998acad62 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 0.528334 Jul 31 01:16:58.184548 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1124/2252] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:57 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:16:58.260530 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8ec77bf7-f731-4b82-8409-bf0de2366702 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:58.261540 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8ec77bf7-f731-4b82-8409-bf0de2366702 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:58.278697 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ec77bf7-f731-4b82-8409-bf0de2366702 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:58.279474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ec77bf7-f731-4b82-8409-bf0de2366702 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:58.288524 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ec77bf7-f731-4b82-8409-bf0de2366702 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:58.293744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ec77bf7-f731-4b82-8409-bf0de2366702 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:58.661669 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a6cbf67e-7225-4feb-a19e-e8dff19d103a tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede55ee670>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:58.754447 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a6cbf67e-7225-4feb-a19e-e8dff19d103a tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1" status: 200 len: 1454 microversion: 2.1 time: 0.096580 Jul 31 01:16:58.755717 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1125/2253] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:58 2022] GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1 => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:58.771940 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-94bfb5ab-cc5a-4eef-beee-82329bc9f510 req-c4c2e06f-6fd5-4ae4-bfaa-d9e459624ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fae254-0bd2-4470-a05b-bf0e83d7c3dc", "name": "network-vif-deleted", "tag": "916c8310-8e01-40cb-98f9-6d2f0e9823c4"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:16:58.795832 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-94bfb5ab-cc5a-4eef-beee-82329bc9f510 req-c4c2e06f-6fd5-4ae4-bfaa-d9e459624ecb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:58.796553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-94bfb5ab-cc5a-4eef-beee-82329bc9f510 req-c4c2e06f-6fd5-4ae4-bfaa-d9e459624ecb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:58.824642 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-94bfb5ab-cc5a-4eef-beee-82329bc9f510 req-c4c2e06f-6fd5-4ae4-bfaa-d9e459624ecb service nova] Creating event network-vif-deleted:916c8310-8e01-40cb-98f9-6d2f0e9823c4 for instance 51fae254-0bd2-4470-a05b-bf0e83d7c3dc on n-h1-master-1 Jul 31 01:16:58.847154 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-94bfb5ab-cc5a-4eef-beee-82329bc9f510 req-c4c2e06f-6fd5-4ae4-bfaa-d9e459624ecb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078355 Jul 31 01:16:58.848809 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1126/2254] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:16:58.871184 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dcf75280-ac11-4045-95a0-84855f0005bd tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:58.872889 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dcf75280-ac11-4045-95a0-84855f0005bd tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] [instance: 51fae254-0bd2-4470-a05b-bf0e83d7c3dc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:58.901180 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dcf75280-ac11-4045-95a0-84855f0005bd tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:58.906610 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dcf75280-ac11-4045-95a0-84855f0005bd tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:58.908394 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dcf75280-ac11-4045-95a0-84855f0005bd tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:58.909291 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dcf75280-ac11-4045-95a0-84855f0005bd tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:58.970691 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-dcf75280-ac11-4045-95a0-84855f0005bd tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] HTTP exception thrown: Instance 51fae254-0bd2-4470-a05b-bf0e83d7c3dc could not be found. Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dcf75280-ac11-4045-95a0-84855f0005bd tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Request method failure captured: Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc HTTP/1.1 Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5de56tlS_RuJRNdkpPV9b5G2CMe391qrJ8-pALhjQ8DBqpuJeF9j4qS64ml8FALtjBKmI4Mob_NLnVdSiMa9q7CLRT1S59_TbyIyqRNvU_Vica5Nj88IzXiNg62ARZCP_hUooze-Bd16yvTr77zBhuHTZa0r0d59D9L99ezQmkGZYZk Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 1f193d444cb7454e8181677060a126c5 Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-LiveMigrationNegativeTest-1218869871 Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1f193d444cb7454e8181677060a126c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1f193d444cb7454e8181677060a126c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1f193d444cb7454e8181677060a126c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1f193d444cb7454e8181677060a126c5", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-LiveMigrationNegativeTest-1218869871 Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 1f193d444cb7454e8181677060a126c5 Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1218869871 Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-LiveMigrationNegativeTest-1218869871-project Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 9fced56492d64f4983157a0e5d7b1121 Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-LiveMigrationNegativeTest-1218869871-project Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 51fae254-0bd2-4470-a05b-bf0e83d7c3dc could not be found. Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '51fae254-0bd2-4470-a05b-bf0e83d7c3dc'} Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51fae254-0bd2-4470-a05b-bf0e83d7c3dc could not be found. Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51fae254-0bd2-4470-a05b-bf0e83d7c3dc could not be found. Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:16:58.974037 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:16:58.978282 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:16:58.978282 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:16:58.978282 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:16:58.978282 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:16:58.978282 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:16:58.978282 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51fae254-0bd2-4470-a05b-bf0e83d7c3dc could not be found. Jul 31 01:16:58.978282 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:16:58.981128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dcf75280-ac11-4045-95a0-84855f0005bd tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] Returning 404 to user: Instance 51fae254-0bd2-4470-a05b-bf0e83d7c3dc could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:16:58.987705 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dcf75280-ac11-4045-95a0-84855f0005bd tempest-LiveMigrationNegativeTest-1218869871 tempest-LiveMigrationNegativeTest-1218869871-project] 10.222.0.45 "GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc" status: 404 len: 111 microversion: 2.1 time: 0.131562 Jul 31 01:16:58.997245 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1127/2255] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:58 2022] GET /compute/v2.1/servers/51fae254-0bd2-4470-a05b-bf0e83d7c3dc => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:16:59.010518 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-413916ed-3ec6-4a77-a68d-5c2c0ab0bc5a tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede57b1670>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:59.127403 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-413916ed-3ec6-4a77-a68d-5c2c0ab0bc5a tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1422 microversion: 2.1 time: 0.130288 Jul 31 01:16:59.127990 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1128/2256] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:58 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1422 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:16:59.195111 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-523a3e01-dfa2-4a35-8117-308f0cd75d01 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:16:59.196276 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-523a3e01-dfa2-4a35-8117-308f0cd75d01 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:16:59.219792 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-523a3e01-dfa2-4a35-8117-308f0cd75d01 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:59.222975 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-523a3e01-dfa2-4a35-8117-308f0cd75d01 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:59.224543 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-523a3e01-dfa2-4a35-8117-308f0cd75d01 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:16:59.226751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-523a3e01-dfa2-4a35-8117-308f0cd75d01 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:16:59.832613 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8ec77bf7-f731-4b82-8409-bf0de2366702 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:16:59.867271 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8ec77bf7-f731-4b82-8409-bf0de2366702 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1520 microversion: 2.1 time: 1.612822 Jul 31 01:16:59.871047 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1129/2257] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:16:58 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1520 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:16:59.895727 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ce1f505a-4342-492d-9850-c1e88a660603 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedea871310>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:00.220233 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ce1f505a-4342-492d-9850-c1e88a660603 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1" status: 200 len: 1454 microversion: 2.1 time: 0.343806 Jul 31 01:17:00.221624 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1130/2258] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:16:59 2022] GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1 => generated 1454 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:00.233419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e26a327c-31b2-4f8b-b1af-d179a4bbb1a9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fedea8514c0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:00.261462 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-523a3e01-dfa2-4a35-8117-308f0cd75d01 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:00.271382 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-523a3e01-dfa2-4a35-8117-308f0cd75d01 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:00.285056 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-523a3e01-dfa2-4a35-8117-308f0cd75d01 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:00.286630 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-523a3e01-dfa2-4a35-8117-308f0cd75d01 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 1.096269 Jul 31 01:17:00.303133 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1129/2259] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:16:59 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:00.910539 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-462dfc1e-9226-4655-93ef-97a5145f881f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:00.911178 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-462dfc1e-9226-4655-93ef-97a5145f881f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:00.925221 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-462dfc1e-9226-4655-93ef-97a5145f881f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:00.936094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-462dfc1e-9226-4655-93ef-97a5145f881f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:00.937553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-462dfc1e-9226-4655-93ef-97a5145f881f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:00.937553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-462dfc1e-9226-4655-93ef-97a5145f881f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:01.119877 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:01.943312 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-462dfc1e-9226-4655-93ef-97a5145f881f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:01.992324 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-462dfc1e-9226-4655-93ef-97a5145f881f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1520 microversion: 2.1 time: 1.079975 Jul 31 01:17:01.996230 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1130/2260] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:00 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1520 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:17:02.739843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-47506d58-2ff0-41a7-8264-05e8e722e7e3 req-c4c0cf79-a842-4e31-97ba-9ec491593b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf0c39f6-2c6a-4eb3-9176-7d20151b0adb", "name": "network-vif-plugged", "status": "completed", "tag": "cf150970-8f1a-4d54-b48d-7de2be48f7e1"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:02.760125 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-47506d58-2ff0-41a7-8264-05e8e722e7e3 req-c4c0cf79-a842-4e31-97ba-9ec491593b20 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:02.762513 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-47506d58-2ff0-41a7-8264-05e8e722e7e3 req-c4c0cf79-a842-4e31-97ba-9ec491593b20 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:02.786104 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-47506d58-2ff0-41a7-8264-05e8e722e7e3 req-c4c0cf79-a842-4e31-97ba-9ec491593b20 service nova] Creating event network-vif-plugged:cf150970-8f1a-4d54-b48d-7de2be48f7e1 for instance cf0c39f6-2c6a-4eb3-9176-7d20151b0adb on n-h2-master-1 Jul 31 01:17:02.801635 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-47506d58-2ff0-41a7-8264-05e8e722e7e3 req-c4c0cf79-a842-4e31-97ba-9ec491593b20 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.799065 Jul 31 01:17:02.805856 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1131/2261] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:02.822874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-84610450-6b8f-494f-9833-c03daa1845a5 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede57b1670>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:02.877756 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e26a327c-31b2-4f8b-b1af-d179a4bbb1a9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1431 microversion: 2.1 time: 2.654042 Jul 31 01:17:02.887103 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1131/2262] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:00 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1431 bytes in 2656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:02.887103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9bfc6813-3dbe-46e8-9a32-5202aa2c1146 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:02.887103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9bfc6813-3dbe-46e8-9a32-5202aa2c1146 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:02.908149 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9bfc6813-3dbe-46e8-9a32-5202aa2c1146 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:02.908601 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9bfc6813-3dbe-46e8-9a32-5202aa2c1146 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:02.909441 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9bfc6813-3dbe-46e8-9a32-5202aa2c1146 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:02.909897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9bfc6813-3dbe-46e8-9a32-5202aa2c1146 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:02.964510 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-84610450-6b8f-494f-9833-c03daa1845a5 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1" status: 200 len: 1454 microversion: 2.1 time: 0.155789 Jul 31 01:17:02.967226 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1132/2263] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:02 2022] GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:02.979237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b6a06694-8400-4c3e-acc9-b61ee7344b4f tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede5632af0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:03.066378 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b6a06694-8400-4c3e-acc9-b61ee7344b4f tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 200 len: 1431 microversion: 2.1 time: 0.095448 Jul 31 01:17:03.095818 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1133/2264] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:02 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 1431 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:03.108703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-77f8c5df-cf0f-44f9-8d18-1cbb9c404795 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:03.113983 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-77f8c5df-cf0f-44f9-8d18-1cbb9c404795 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:03.131531 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77f8c5df-cf0f-44f9-8d18-1cbb9c404795 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:03.134440 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77f8c5df-cf0f-44f9-8d18-1cbb9c404795 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:03.137510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77f8c5df-cf0f-44f9-8d18-1cbb9c404795 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:03.138789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77f8c5df-cf0f-44f9-8d18-1cbb9c404795 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:03.985006 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9bfc6813-3dbe-46e8-9a32-5202aa2c1146 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:04.029588 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9bfc6813-3dbe-46e8-9a32-5202aa2c1146 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:04.032710 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9bfc6813-3dbe-46e8-9a32-5202aa2c1146 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:04.034464 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9bfc6813-3dbe-46e8-9a32-5202aa2c1146 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 1.154557 Jul 31 01:17:04.041450 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1132/2265] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:02 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:04.062160 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-77f8c5df-cf0f-44f9-8d18-1cbb9c404795 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:04.063183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0797b374-4e16-410c-b8ec-43ec82bdb308 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:04.064396 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0797b374-4e16-410c-b8ec-43ec82bdb308 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:04.074717 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-77f8c5df-cf0f-44f9-8d18-1cbb9c404795 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1497 microversion: 2.1 time: 0.975622 Jul 31 01:17:04.075371 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1134/2266] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:03 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1497 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:04.104781 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0797b374-4e16-410c-b8ec-43ec82bdb308 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:04.105948 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0797b374-4e16-410c-b8ec-43ec82bdb308 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:04.107504 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0797b374-4e16-410c-b8ec-43ec82bdb308 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:04.108298 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0797b374-4e16-410c-b8ec-43ec82bdb308 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:04.409410 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-48d5d5e2-de56-4c2b-8099-e023bb9bfe75 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:04.424859 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-48d5d5e2-de56-4c2b-8099-e023bb9bfe75 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.346454 Jul 31 01:17:04.429403 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1135/2267] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:17:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:04.436619 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d0365fb9-37fc-42d5-96fd-7c758f06c477 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede5640670>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:04.505307 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d0365fb9-37fc-42d5-96fd-7c758f06c477 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1" status: 200 len: 1454 microversion: 2.1 time: 0.074464 Jul 31 01:17:04.507101 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1136/2268] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:04 2022] GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1 => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:04.519083 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eea424db-d826-422a-88d5-3676e15970e4 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:04.524353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eea424db-d826-422a-88d5-3676e15970e4 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:04.525251 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eea424db-d826-422a-88d5-3676e15970e4 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:17:04.552228 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eea424db-d826-422a-88d5-3676e15970e4 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:04.552721 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eea424db-d826-422a-88d5-3676e15970e4 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:04.553548 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eea424db-d826-422a-88d5-3676e15970e4 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:04.553994 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eea424db-d826-422a-88d5-3676e15970e4 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:04.652193 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.multi_cell_list [None req-eea424db-d826-422a-88d5-3676e15970e4 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119475) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:17:04.694443 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:04.730673 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eea424db-d826-422a-88d5-3676e15970e4 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.222401 Jul 31 01:17:04.731920 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1137/2269] 10.222.0.45 () {58 vars in 1154 bytes} [Sun Jul 31 01:17:04 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:04.736717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0797b374-4e16-410c-b8ec-43ec82bdb308 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb608462e3a45f69f9056550f16d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2101da474ab040c7a0b921a282f220cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:04.741790 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-87c50cf6-e0a4-4171-b201-d175b44e0a59 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:04.751116 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0797b374-4e16-410c-b8ec-43ec82bdb308 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 200 len: 1466 microversion: 2.1 time: 0.707339 Jul 31 01:17:04.751752 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1133/2270] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:04 2022] GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 1466 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:04.776805 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1066b014-9c63-455c-99f7-f1483dc847fe tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:04.788275 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1066b014-9c63-455c-99f7-f1483dc847fe tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:04.789555 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1066b014-9c63-455c-99f7-f1483dc847fe tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:04.789680 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-87c50cf6-e0a4-4171-b201-d175b44e0a59 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.055557 Jul 31 01:17:04.790201 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1138/2271] 10.222.0.45 () {58 vars in 1125 bytes} [Sun Jul 31 01:17:04 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:04.805794 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3f8278f6-7fff-44a0-8771-cedd0228a398 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede57b1550>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:04.873930 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1066b014-9c63-455c-99f7-f1483dc847fe tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Going to try to start instance {{(pid=119474) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 31 01:17:04.925671 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3f8278f6-7fff-44a0-8771-cedd0228a398 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/0f306572-729b-4b95-a357-79461887e541" status: 200 len: 784 microversion: 2.1 time: 0.133929 Jul 31 01:17:04.926752 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1139/2272] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:04 2022] GET /compute/v2.1/images/0f306572-729b-4b95-a357-79461887e541 => generated 784 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:04.958484 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1066b014-9c63-455c-99f7-f1483dc847fe tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "POST /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea/action" status: 202 len: 0 microversion: 2.1 time: 0.190774 Jul 31 01:17:04.959729 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1134/2273] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:17:04 2022] POST /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:17:04.980969 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-273aaf4d-bf83-46ae-80e4-1da081dc7f23 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:04.992215 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-31459fed-7db7-4489-b0eb-f8bc681d89b4 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:05.000674 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-273aaf4d-bf83-46ae-80e4-1da081dc7f23 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.064893 Jul 31 01:17:05.014177 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1140/2274] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:17:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:05.031779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0995e0da-b20f-48ae-8274-de4e595a1ee3 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:05.032441 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0995e0da-b20f-48ae-8274-de4e595a1ee3 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:05.051945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0995e0da-b20f-48ae-8274-de4e595a1ee3 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:05.052498 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0995e0da-b20f-48ae-8274-de4e595a1ee3 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:05.053347 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-31459fed-7db7-4489-b0eb-f8bc681d89b4 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.089147 Jul 31 01:17:05.054023 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1135/2275] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:17:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:05.056486 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0995e0da-b20f-48ae-8274-de4e595a1ee3 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:05.057564 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0995e0da-b20f-48ae-8274-de4e595a1ee3 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:05.058751 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2386e3a7-ef5c-4ead-b9c8-6fbc75fccf00 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:05.104496 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2386e3a7-ef5c-4ead-b9c8-6fbc75fccf00 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.049356 Jul 31 01:17:05.108850 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1136/2276] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:17:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:05.132368 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f7b60cac-8797-4606-a3ca-d53187f01664 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede557ce50>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:05.829297 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0995e0da-b20f-48ae-8274-de4e595a1ee3 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:05.846940 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0995e0da-b20f-48ae-8274-de4e595a1ee3 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1506 microversion: 2.1 time: 0.831193 Jul 31 01:17:05.847779 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1141/2277] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:05 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1506 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:05.860499 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-069b0442-a5e8-4642-852a-780b2dc30e56 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:05.864295 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-069b0442-a5e8-4642-852a-780b2dc30e56 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:05.886177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-069b0442-a5e8-4642-852a-780b2dc30e56 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:05.886650 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-069b0442-a5e8-4642-852a-780b2dc30e56 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:05.891291 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-069b0442-a5e8-4642-852a-780b2dc30e56 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:05.891899 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-069b0442-a5e8-4642-852a-780b2dc30e56 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:06.528144 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f7b60cac-8797-4606-a3ca-d53187f01664 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "DELETE /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 204 len: 0 microversion: 2.1 time: 1.415635 Jul 31 01:17:06.528725 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1137/2278] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:05 2022] DELETE /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 0 bytes in 1420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:17:06.533891 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-14a84c57-c5a7-426f-a90a-8bc0e20dad5a tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:06.625994 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-14a84c57-c5a7-426f-a90a-8bc0e20dad5a tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.095851 Jul 31 01:17:06.629498 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1138/2279] 10.222.0.45 () {58 vars in 1165 bytes} [Sun Jul 31 01:17:06 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:06.634697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d97c3e10-700d-40ca-86d3-fcc5b63ff3a2 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedeaa913a0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:06.730944 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d97c3e10-700d-40ca-86d3-fcc5b63ff3a2 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1" status: 200 len: 1454 microversion: 2.1 time: 0.100051 Jul 31 01:17:06.733094 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1139/2280] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:06 2022] GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1 => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:06.807615 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-069b0442-a5e8-4642-852a-780b2dc30e56 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:06.833074 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-069b0442-a5e8-4642-852a-780b2dc30e56 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:06.840451 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-069b0442-a5e8-4642-852a-780b2dc30e56 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:06.849522 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-069b0442-a5e8-4642-852a-780b2dc30e56 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 0.999725 Jul 31 01:17:06.852810 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1142/2281] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:05 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:06.908119 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8b98bd05-77ae-4a8b-852d-1e628c144fcd tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede5612160>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:06.964997 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-8b98bd05-77ae-4a8b-852d-1e628c144fcd tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] HTTP exception thrown: Image not found. Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8b98bd05-77ae-4a8b-852d-1e628c144fcd tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Request method failure captured: Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe HTTP/1.1 Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dfV4dSmqv7wfpWNzgtmU0EfF7nr2UxY2t927oUtn5wfdNyGvJfF7pNfaQiCENqwBuqsvDg01l4x46VD1Eu88uexre25eyN7BZrWZrY3Mwz1K93O5CHTaYo_IijkGYix9yXLJ72zsC5fvSrjGcQ2xYjraMJ-kphCrygyVwZq0T6E5Yw Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2101da474ab040c7a0b921a282f220cf Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesOneServerTestJSON-526373175 Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2101da474ab040c7a0b921a282f220cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2101da474ab040c7a0b921a282f220cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2101da474ab040c7a0b921a282f220cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2101da474ab040c7a0b921a282f220cf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesOneServerTestJSON-526373175 Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2101da474ab040c7a0b921a282f220cf Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-526373175 Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesOneServerTestJSON-526373175-project Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 5cb608462e3a45f69f9056550f16d869 Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesOneServerTestJSON-526373175-project Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: exception: Image not found. Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '48835478-388d-4572-9fa7-a1b15a6148fe'} Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 48835478-388d-4572-9fa7-a1b15a6148fe Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 31 01:17:06.972542 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 48835478-388d-4572-9fa7-a1b15a6148fe could not be found. Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:17:06.985165 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:06.998206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8b98bd05-77ae-4a8b-852d-1e628c144fcd tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Returning 404 to user: Image not found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:17:06.998206 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8b98bd05-77ae-4a8b-852d-1e628c144fcd tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 404 len: 62 microversion: 2.1 time: 0.109606 Jul 31 01:17:07.000552 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1143/2282] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:06 2022] GET /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 62 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:17:07.017112 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fe259bf0-195b-4a37-8a4e-c5ad94b1fcd6 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:07.037345 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fe259bf0-195b-4a37-8a4e-c5ad94b1fcd6 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034600 Jul 31 01:17:07.039124 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1144/2283] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:17:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:07.048426 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-42b29807-39b6-424f-84f6-b7fdcc8d1b9c tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:07.049587 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-42b29807-39b6-424f-84f6-b7fdcc8d1b9c tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:07.059979 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42b29807-39b6-424f-84f6-b7fdcc8d1b9c tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:07.061360 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42b29807-39b6-424f-84f6-b7fdcc8d1b9c tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:07.063588 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42b29807-39b6-424f-84f6-b7fdcc8d1b9c tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:07.064708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42b29807-39b6-424f-84f6-b7fdcc8d1b9c tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:07.440578 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-794c81cd-6878-40a3-b281-03c22e679db2 tempest-SecurityGroupsTestAdminJSON-234361446 tempest-SecurityGroupsTestAdminJSON-234361446-project] Action: 'create', calling method: .version_select at 0x7fede4f60ee0>, body: {"security_group": {"name": "tempest-securitygroup-541087686", "description": "tempest-description-1292382950"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:07.636668 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-42b29807-39b6-424f-84f6-b7fdcc8d1b9c tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:07.651571 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-42b29807-39b6-424f-84f6-b7fdcc8d1b9c tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1506 microversion: 2.1 time: 0.604177 Jul 31 01:17:07.660176 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1145/2284] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:07 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1506 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:07.668618 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dc8d6b00-b6eb-4fcc-833f-89e4cb7f75b4 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-525209283"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:07.682211 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dc8d6b00-b6eb-4fcc-833f-89e4cb7f75b4 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:07.692748 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc8d6b00-b6eb-4fcc-833f-89e4cb7f75b4 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:07.693235 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc8d6b00-b6eb-4fcc-833f-89e4cb7f75b4 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:07.697679 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc8d6b00-b6eb-4fcc-833f-89e4cb7f75b4 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:07.699276 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc8d6b00-b6eb-4fcc-833f-89e4cb7f75b4 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:08.070542 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:08.192395 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dc8d6b00-b6eb-4fcc-833f-89e4cb7f75b4 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "POST /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5/action" status: 202 len: 0 microversion: 2.1 time: 0.530817 Jul 31 01:17:08.194589 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1146/2285] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:17:07 2022] POST /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 31 01:17:08.201953 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-fa19263c-90d6-41cb-a1a6-c757a957dd8c req-d2d8d891-4876-4efa-bf14-07a9a9d725be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0005650d-9c5d-49ff-bae8-1f9efe4322f5", "name": "network-vif-unplugged", "status": "completed", "tag": "2b6d29d2-1181-470a-9af3-c5ffa1afc021"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:08.221529 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-fa19263c-90d6-41cb-a1a6-c757a957dd8c req-d2d8d891-4876-4efa-bf14-07a9a9d725be service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:08.222903 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-fa19263c-90d6-41cb-a1a6-c757a957dd8c req-d2d8d891-4876-4efa-bf14-07a9a9d725be service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:08.242230 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-fa19263c-90d6-41cb-a1a6-c757a957dd8c req-d2d8d891-4876-4efa-bf14-07a9a9d725be service nova] Creating event network-vif-unplugged:2b6d29d2-1181-470a-9af3-c5ffa1afc021 for instance 0005650d-9c5d-49ff-bae8-1f9efe4322f5 on n-h2-master-1 Jul 31 01:17:08.248995 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-fa19263c-90d6-41cb-a1a6-c757a957dd8c req-d2d8d891-4876-4efa-bf14-07a9a9d725be service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052257 Jul 31 01:17:08.251101 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1147/2286] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:08.259865 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-45a9dd41-139e-4139-b89c-56242cd05446 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:08.293115 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-45a9dd41-139e-4139-b89c-56242cd05446 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.039464 Jul 31 01:17:08.293739 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1148/2287] 10.222.0.45 () {58 vars in 1169 bytes} [Sun Jul 31 01:17:08 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:08.298729 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-aea18adb-96e1-4046-bb2d-67ea61d88077 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede5612670>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:08.387884 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-aea18adb-96e1-4046-bb2d-67ea61d88077 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1" status: 200 len: 1454 microversion: 2.1 time: 0.092918 Jul 31 01:17:08.401415 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1149/2288] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:08 2022] GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:08.401415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ec012c4b-bc6a-4bec-b76b-c771fadc972e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:08.401415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ec012c4b-bc6a-4bec-b76b-c771fadc972e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:08.406036 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec012c4b-bc6a-4bec-b76b-c771fadc972e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:08.406311 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec012c4b-bc6a-4bec-b76b-c771fadc972e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:08.407087 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec012c4b-bc6a-4bec-b76b-c771fadc972e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:08.407881 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec012c4b-bc6a-4bec-b76b-c771fadc972e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:08.782397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ec012c4b-bc6a-4bec-b76b-c771fadc972e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:08.799249 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ec012c4b-bc6a-4bec-b76b-c771fadc972e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:08.801782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ec012c4b-bc6a-4bec-b76b-c771fadc972e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:08.803220 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ec012c4b-bc6a-4bec-b76b-c771fadc972e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 0.411362 Jul 31 01:17:08.803836 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1150/2289] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:08 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:08.817102 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0a614fe2-5d53-42f1-b4ad-6233dec045ec tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede5612a60>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:08.916570 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0a614fe2-5d53-42f1-b4ad-6233dec045ec tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f" status: 200 len: 1426 microversion: 2.1 time: 0.104809 Jul 31 01:17:08.922812 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1151/2290] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:08 2022] GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f => generated 1426 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:08.930709 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-78cc724f-d113-42d2-82cd-13258dcc40ed tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:08.961859 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-78cc724f-d113-42d2-82cd-13258dcc40ed tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.037527 Jul 31 01:17:08.962372 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1152/2291] 10.222.0.45 () {58 vars in 1161 bytes} [Sun Jul 31 01:17:08 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:09.636670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-50929a1c-a2c1-42e6-8c05-f048d57dda04 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Calling method '.version_select at 0x7fede5a884c0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:09.816735 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-794c81cd-6878-40a3-b281-03c22e679db2 tempest-SecurityGroupsTestAdminJSON-234361446 tempest-SecurityGroupsTestAdminJSON-234361446-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 3.082473 Jul 31 01:17:09.818380 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1140/2292] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:17:06 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 3085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:09.836888 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eb79b10b-3b3a-42a6-86ab-0a3286d557aa tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:09.838070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eb79b10b-3b3a-42a6-86ab-0a3286d557aa tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:09.857115 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb79b10b-3b3a-42a6-86ab-0a3286d557aa tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:09.861139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb79b10b-3b3a-42a6-86ab-0a3286d557aa tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:09.869044 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb79b10b-3b3a-42a6-86ab-0a3286d557aa tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:09.871273 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb79b10b-3b3a-42a6-86ab-0a3286d557aa tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:10.305484 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-50929a1c-a2c1-42e6-8c05-f048d57dda04 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a" status: 200 len: 371 microversion: 2.1 time: 1.341998 Jul 31 01:17:10.306063 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eb79b10b-3b3a-42a6-86ab-0a3286d557aa tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:10.306843 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1153/2293] 10.222.0.45 () {58 vars in 1242 bytes} [Sun Jul 31 01:17:08 2022] GET /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a => generated 371 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:10.312318 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a99f89bc-ce35-4aca-ba77-571dbfc6a1b3 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:10.324533 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a99f89bc-ce35-4aca-ba77-571dbfc6a1b3 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016325 Jul 31 01:17:10.325508 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1154/2294] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:17:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:10.333273 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2e6ec432-dddc-4cbd-9e3b-718074bd1949 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede5612160>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:10.345617 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eb79b10b-3b3a-42a6-86ab-0a3286d557aa tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1510 microversion: 2.1 time: 0.524397 Jul 31 01:17:10.363165 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1141/2295] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:09 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1510 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:10.392026 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21c73a52-9585-480c-b902-2ce1ac0ffb1d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:10.393389 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-21c73a52-9585-480c-b902-2ce1ac0ffb1d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:10.420552 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21c73a52-9585-480c-b902-2ce1ac0ffb1d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:10.421364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21c73a52-9585-480c-b902-2ce1ac0ffb1d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:10.422919 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21c73a52-9585-480c-b902-2ce1ac0ffb1d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:10.424873 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21c73a52-9585-480c-b902-2ce1ac0ffb1d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:10.449624 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:10.464900 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2e6ec432-dddc-4cbd-9e3b-718074bd1949 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1" status: 200 len: 1454 microversion: 2.1 time: 0.137898 Jul 31 01:17:10.465394 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1155/2296] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:10 2022] GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1 => generated 1454 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:10.476614 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eabe3601-b4d0-4556-a291-b1558e5a1980 tempest-SecurityGroupsTestAdminJSON-234361446 tempest-SecurityGroupsTestAdminJSON-234361446-project] Action: 'create', calling method: .version_select at 0x7fede55f8430>, body: {"security_group": {"name": "tempest-securitygroup-34901799", "description": "tempest-description-835619002"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:10.894845 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eabe3601-b4d0-4556-a291-b1558e5a1980 tempest-SecurityGroupsTestAdminJSON-234361446 tempest-SecurityGroupsTestAdminJSON-234361446-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.427621 Jul 31 01:17:10.903896 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1156/2297] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:17:10 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:10.909191 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-90d03f42-5f6f-4a2b-bfab-6b61ebc4d752 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede5632790>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:10.923899 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-21c73a52-9585-480c-b902-2ce1ac0ffb1d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:10.937071 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-21c73a52-9585-480c-b902-2ce1ac0ffb1d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:10.938979 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-21c73a52-9585-480c-b902-2ce1ac0ffb1d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:10.940259 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-21c73a52-9585-480c-b902-2ce1ac0ffb1d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 0.571118 Jul 31 01:17:10.941016 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1142/2298] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:10 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:10.959242 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5dffd185-45f8-4d8c-b417-cc4cbdc4fd05 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Action: 'update', calling method: .version_select at 0x7fedea97c5e0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:11.007108 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-90d03f42-5f6f-4a2b-bfab-6b61ebc4d752 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f" status: 200 len: 1426 microversion: 2.1 time: 0.101959 Jul 31 01:17:11.008317 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1157/2299] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:10 2022] GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f => generated 1426 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:11.013760 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-074712d8-ab75-4fbc-8f4b-b35bc63f9788 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:11.075002 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-074712d8-ab75-4fbc-8f4b-b35bc63f9788 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.065362 Jul 31 01:17:11.076349 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1158/2300] 10.222.0.45 () {58 vars in 1167 bytes} [Sun Jul 31 01:17:11 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:11.093437 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2ecc2047-6fac-44b7-91e9-a9ce2cba8a6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:11.101553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2ecc2047-6fac-44b7-91e9-a9ce2cba8a6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:11.102369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.compute.servers [None req-2ecc2047-6fac-44b7-91e9-a9ce2cba8a6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Removing options 'limit' from query {{(pid=119475) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 31 01:17:11.103452 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2ecc2047-6fac-44b7-91e9-a9ce2cba8a6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:17:11.105550 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ecc2047-6fac-44b7-91e9-a9ce2cba8a6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:11.107023 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ecc2047-6fac-44b7-91e9-a9ce2cba8a6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:11.108216 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ecc2047-6fac-44b7-91e9-a9ce2cba8a6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:11.109024 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ecc2047-6fac-44b7-91e9-a9ce2cba8a6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:11.113855 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2ecc2047-6fac-44b7-91e9-a9ce2cba8a6d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.025758 Jul 31 01:17:11.115531 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1159/2301] 10.222.0.45 () {58 vars in 1140 bytes} [Sun Jul 31 01:17:11 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:17:11.346571 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5dffd185-45f8-4d8c-b417-cc4cbdc4fd05 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:11.348310 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5dffd185-45f8-4d8c-b417-cc4cbdc4fd05 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:11.352059 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5dffd185-45f8-4d8c-b417-cc4cbdc4fd05 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:11.354311 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5dffd185-45f8-4d8c-b417-cc4cbdc4fd05 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:11.433869 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5dffd185-45f8-4d8c-b417-cc4cbdc4fd05 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a" status: 200 len: 328 microversion: 2.1 time: 0.491501 Jul 31 01:17:11.435862 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1143/2302] 10.222.0.45 () {60 vars in 1262 bytes} [Sun Jul 31 01:17:10 2022] PUT /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a => generated 328 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:11.454159 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3873bd04-825a-4591-88ce-777bf4755bc9 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:11.476953 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3873bd04-825a-4591-88ce-777bf4755bc9 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035963 Jul 31 01:17:11.478319 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1144/2303] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:17:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:11.493806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bcd76e66-74bc-45bd-8c2d-6a2c277e4203 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:11.495178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bcd76e66-74bc-45bd-8c2d-6a2c277e4203 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:11.506775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bcd76e66-74bc-45bd-8c2d-6a2c277e4203 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:11.508209 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bcd76e66-74bc-45bd-8c2d-6a2c277e4203 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:11.509856 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bcd76e66-74bc-45bd-8c2d-6a2c277e4203 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:11.510973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bcd76e66-74bc-45bd-8c2d-6a2c277e4203 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:11.591599 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-30c2e785-026c-4e3a-920f-9ecaf9559f5f tempest-SecurityGroupsTestAdminJSON-1871684506 tempest-SecurityGroupsTestAdminJSON-1871684506-project-admin] Action: 'create', calling method: .version_select at 0x7fede5b43940>, body: {"security_group": {"name": "tempest-securitygroup-1417866406", "description": "tempest-description-370258999"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:11.894978 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bcd76e66-74bc-45bd-8c2d-6a2c277e4203 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:11.923885 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bcd76e66-74bc-45bd-8c2d-6a2c277e4203 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1510 microversion: 2.1 time: 0.443241 Jul 31 01:17:11.925017 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1145/2304] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:11 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1510 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:11.944617 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-382bf7a3-097f-4f30-af18-cf32a8688ad9 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede584cf70>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:12.074167 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-382bf7a3-097f-4f30-af18-cf32a8688ad9 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1" status: 200 len: 1454 microversion: 2.1 time: 0.146559 Jul 31 01:17:12.080495 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1146/2305] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:11 2022] GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:12.091729 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c99017fc-5bea-4483-9c0d-46c78698fcdd tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:12.139972 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c99017fc-5bea-4483-9c0d-46c78698fcdd tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.058000 Jul 31 01:17:12.140581 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1147/2306] 10.222.0.45 () {58 vars in 1144 bytes} [Sun Jul 31 01:17:12 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:12.287985 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-30c2e785-026c-4e3a-920f-9ecaf9559f5f tempest-SecurityGroupsTestAdminJSON-1871684506 tempest-SecurityGroupsTestAdminJSON-1871684506-project-admin] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.170547 Jul 31 01:17:12.288688 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1160/2307] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:17:11 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:12.303096 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6aff1bc4-bb4e-4966-bffe-2d76d5cc0a36 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:12.303751 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6aff1bc4-bb4e-4966-bffe-2d76d5cc0a36 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 2bc94263-b6c3-4954-95b3-345029530b02] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:12.315616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6aff1bc4-bb4e-4966-bffe-2d76d5cc0a36 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:12.315616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6aff1bc4-bb4e-4966-bffe-2d76d5cc0a36 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:12.315616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6aff1bc4-bb4e-4966-bffe-2d76d5cc0a36 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:12.315616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6aff1bc4-bb4e-4966-bffe-2d76d5cc0a36 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:12.334902 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1014057250", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:12.449596 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] validate_networks() for None {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:17:12.843765 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6aff1bc4-bb4e-4966-bffe-2d76d5cc0a36 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:12.853236 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6aff1bc4-bb4e-4966-bffe-2d76d5cc0a36 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/2bc94263-b6c3-4954-95b3-345029530b02" status: 200 len: 1511 microversion: 2.1 time: 0.554132 Jul 31 01:17:12.853829 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1161/2308] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:12 2022] GET /compute/v2.1/servers/2bc94263-b6c3-4954-95b3-345029530b02 => generated 1511 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:12.882812 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-58640da3-25c5-42f3-8a66-05afc01fb8f7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:12.883814 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-58640da3-25c5-42f3-8a66-05afc01fb8f7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:12.913888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58640da3-25c5-42f3-8a66-05afc01fb8f7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:12.916425 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58640da3-25c5-42f3-8a66-05afc01fb8f7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:12.921974 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58640da3-25c5-42f3-8a66-05afc01fb8f7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:12.922446 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58640da3-25c5-42f3-8a66-05afc01fb8f7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:13.164057 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:17:13.168113 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:17:13.170429 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:17:13.171219 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:17:13.172092 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:17:13.175840 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=14,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:13.197693 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:13.198848 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:13.201668 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:13.202818 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:13.250250 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Getting quotas for project 383b5e065b9345d1a88c895380b52b7a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:17:13.271223 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Getting quotas for user c6c7f405ccea42b989d85a7c2455241a and project 383b5e065b9345d1a88c895380b52b7a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:17:13.324009 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.utils [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] cores quota exceeded for 383b5e065b9345d1a88c895380b52b7a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119474) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 31 01:17:13.326854 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Request method failure captured: Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 145 Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dgSYQp_vvNezRElgKJ94nu5b1Z3kIDv2N7c5nnYjTwffNnqkos6aYF8stQ0VfwdaEIJVuUMDaKHi5nM7JF_gcYfUgLy2a21gS-FrJkhypAUpjFvQR1zeY-uZm3u2n3jnxtGA6nQZ5vyzJkuPgFcCfdfu6WQpTA5jxU-TIAVVyN_zmw Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 383b5e065b9345d1a88c895380b52b7a Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-QuotasAdminNegativeTest-944703133 Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/383b5e065b9345d1a88c895380b52b7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/383b5e065b9345d1a88c895380b52b7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/383b5e065b9345d1a88c895380b52b7a"}]}, {"type": "tempest-type-637456412", "name": "tempest-service-212884429", "endpoints": [{"region": "tempest-region-1925257104", "publicURL": "https://url-1996201411.com"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "tempest-type-226696235", "name": "tempest-service-1156080264", "endpoints": [{"region": "tempest-region-874058038", "internalURL": "https://url-77151237.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_383b5e065b9345d1a88c895380b52b7a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-QuotasAdminNegativeTest-944703133 Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 383b5e065b9345d1a88c895380b52b7a Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-944703133 Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-QuotasAdminNegativeTest-944703133-project Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: c6c7f405ccea42b989d85a7c2455241a Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-QuotasAdminNegativeTest-944703133-project Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1014057250", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1014057250', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452'}}} Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 31 01:17:13.375559 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6f8ffd0a-b8fe-47ff-bba5-cd37789c7b6d tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.233002 Jul 31 01:17:13.383237 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1148/2309] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:17:12 2022] POST /compute/v2.1/servers => generated 111 bytes in 1235 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:17:13.394998 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-11b631de-6468-4634-9aa9-562cbe9275d1 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede4efc040>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:13.400357 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-58640da3-25c5-42f3-8a66-05afc01fb8f7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:13.411722 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-58640da3-25c5-42f3-8a66-05afc01fb8f7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:13.413775 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-58640da3-25c5-42f3-8a66-05afc01fb8f7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:13.415076 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-58640da3-25c5-42f3-8a66-05afc01fb8f7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 0.553799 Jul 31 01:17:13.428408 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1162/2310] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:12 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:13.445213 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e12d421-c323-4a8b-8074-1ed042fe0ba8 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:13.491748 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1e12d421-c323-4a8b-8074-1ed042fe0ba8 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.060752 Jul 31 01:17:13.499263 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1163/2311] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:17:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:13.513966 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-11b631de-6468-4634-9aa9-562cbe9275d1 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f" status: 200 len: 1426 microversion: 2.1 time: 0.133466 Jul 31 01:17:13.515021 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1149/2312] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:13 2022] GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f => generated 1426 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:13.529138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-63d71be7-61a5-4724-8bb4-aec151029df6 tempest-SecurityGroupsTestAdminJSON-1871684506 tempest-SecurityGroupsTestAdminJSON-1871684506-project-admin] Action: 'create', calling method: .version_select at 0x7fede5632700>, body: {"security_group": {"name": "tempest-securitygroup-519145943", "description": "tempest-description-1588396624"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:13.537483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e831d334-9357-4547-961b-9a7547dd398d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:13.545388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e831d334-9357-4547-961b-9a7547dd398d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:13.571557 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e831d334-9357-4547-961b-9a7547dd398d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:13.572049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e831d334-9357-4547-961b-9a7547dd398d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:13.582784 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e831d334-9357-4547-961b-9a7547dd398d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:13.585322 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e831d334-9357-4547-961b-9a7547dd398d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:14.009114 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-63d71be7-61a5-4724-8bb4-aec151029df6 tempest-SecurityGroupsTestAdminJSON-1871684506 tempest-SecurityGroupsTestAdminJSON-1871684506-project-admin] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.507514 Jul 31 01:17:14.010641 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1164/2313] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:17:13 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:14.035948 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-99a0a354-66fa-461b-8dc3-7b4d8a1741d0 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede5612f70>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:14.085096 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e831d334-9357-4547-961b-9a7547dd398d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:14.100846 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e831d334-9357-4547-961b-9a7547dd398d tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 200 len: 1511 microversion: 2.1 time: 0.580768 Jul 31 01:17:14.102293 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1150/2314] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:13 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 1511 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:14.111126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-217184d2-dadc-4981-b794-3d717bb2a86a tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Action: 'update', calling method: .version_select at 0x7fedea944ca0>, body: {"quota_set": {"cores": 20}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:14.338839 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-99a0a354-66fa-461b-8dc3-7b4d8a1741d0 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1" status: 200 len: 1454 microversion: 2.1 time: 0.323700 Jul 31 01:17:14.339529 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1165/2315] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:14 2022] GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1 => generated 1454 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:14.359093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2e0dbe41-711a-4217-9f92-4054419d8961 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:14.373443 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-217184d2-dadc-4981-b794-3d717bb2a86a tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:14.374728 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-217184d2-dadc-4981-b794-3d717bb2a86a tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:14.376031 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-217184d2-dadc-4981-b794-3d717bb2a86a tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:14.376965 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-217184d2-dadc-4981-b794-3d717bb2a86a tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:14.410356 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2e0dbe41-711a-4217-9f92-4054419d8961 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.065940 Jul 31 01:17:14.415812 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1166/2316] 10.222.0.45 () {58 vars in 1148 bytes} [Sun Jul 31 01:17:14 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:14.433483 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-340d72ce-bd48-4e1d-ab15-41c4761b5f9e tempest-SecurityGroupsTestAdminJSON-1871684506 tempest-SecurityGroupsTestAdminJSON-1871684506-project-admin] Calling method '.version_select at 0x7fede5e7e670>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:14.563974 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-217184d2-dadc-4981-b794-3d717bb2a86a tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a" status: 200 len: 329 microversion: 2.1 time: 0.459519 Jul 31 01:17:14.565437 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1151/2317] 10.222.0.45 () {60 vars in 1262 bytes} [Sun Jul 31 01:17:14 2022] PUT /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a => generated 329 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:14.567725 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:14.573469 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-806db88a-bbfd-44b3-ab75-997adea29117 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:14.612633 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-806db88a-bbfd-44b3-ab75-997adea29117 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:14.613736 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-806db88a-bbfd-44b3-ab75-997adea29117 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'ip': '172.20.0.9', 'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:17:14.988613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-806db88a-bbfd-44b3-ab75-997adea29117 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:14.989081 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-806db88a-bbfd-44b3-ab75-997adea29117 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:14.990805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-806db88a-bbfd-44b3-ab75-997adea29117 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:14.991277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-806db88a-bbfd-44b3-ab75-997adea29117 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:15.209598 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-806db88a-bbfd-44b3-ab75-997adea29117 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:17:15.281842 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-806db88a-bbfd-44b3-ab75-997adea29117 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers?ip=172.20.0.9" status: 200 len: 346 microversion: 2.1 time: 0.714962 Jul 31 01:17:15.283408 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1152/2318] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:17:14 2022] GET /compute/v2.1/servers?ip=172.20.0.9 => generated 346 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:15.289567 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a16f5e1c-feda-427e-bce8-dc23e4f72ee9 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:15.305518 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a16f5e1c-feda-427e-bce8-dc23e4f72ee9 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.020626 Jul 31 01:17:15.315068 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1153/2319] 10.222.0.45 () {58 vars in 1140 bytes} [Sun Jul 31 01:17:15 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:15.321055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f31c440d-d4bd-4a38-b84c-29c934f6f1f1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:15.322044 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f31c440d-d4bd-4a38-b84c-29c934f6f1f1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:15.329843 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f31c440d-d4bd-4a38-b84c-29c934f6f1f1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:15.330812 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f31c440d-d4bd-4a38-b84c-29c934f6f1f1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:15.331952 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f31c440d-d4bd-4a38-b84c-29c934f6f1f1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:15.332635 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f31c440d-d4bd-4a38-b84c-29c934f6f1f1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:16.096257 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f31c440d-d4bd-4a38-b84c-29c934f6f1f1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:16.134515 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f31c440d-d4bd-4a38-b84c-29c934f6f1f1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:16.138014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f31c440d-d4bd-4a38-b84c-29c934f6f1f1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:16.141110 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f31c440d-d4bd-4a38-b84c-29c934f6f1f1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 0.823818 Jul 31 01:17:16.142628 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1154/2320] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:15 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:16.211532 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-82bde00f-116f-4fa9-bc03-b43cfe70c9b6 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fedea8713a0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:18.917845 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-340d72ce-bd48-4e1d-ab15-41c4761b5f9e tempest-SecurityGroupsTestAdminJSON-1871684506 tempest-SecurityGroupsTestAdminJSON-1871684506-project-admin] 10.222.0.45 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8308 microversion: 2.1 time: 4.500247 Jul 31 01:17:18.918610 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1167/2321] 10.222.0.45 () {58 vars in 1191 bytes} [Sun Jul 31 01:17:14 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8308 bytes in 4502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:18.923602 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-530ff8b3-80ec-4847-af22-11f9b87b39f7 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Calling method '.version_select at 0x7fede5a730d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:19.683913 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:19.722822 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-530ff8b3-80ec-4847-af22-11f9b87b39f7 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a" status: 200 len: 371 microversion: 2.1 time: 0.803204 Jul 31 01:17:19.730716 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1168/2322] 10.222.0.45 () {58 vars in 1242 bytes} [Sun Jul 31 01:17:18 2022] GET /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a => generated 371 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:19.736747 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-d92fe599-a86b-483e-a6c4-13820e7dd0ec req-1220c212-69a6-40c9-a179-d20f7d986809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0005650d-9c5d-49ff-bae8-1f9efe4322f5", "name": "network-vif-plugged", "status": "completed", "tag": "2b6d29d2-1181-470a-9af3-c5ffa1afc021"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:19.764310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d92fe599-a86b-483e-a6c4-13820e7dd0ec req-1220c212-69a6-40c9-a179-d20f7d986809 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:19.768844 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d92fe599-a86b-483e-a6c4-13820e7dd0ec req-1220c212-69a6-40c9-a179-d20f7d986809 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:19.798877 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-d92fe599-a86b-483e-a6c4-13820e7dd0ec req-1220c212-69a6-40c9-a179-d20f7d986809 service nova] Creating event network-vif-plugged:2b6d29d2-1181-470a-9af3-c5ffa1afc021 for instance 0005650d-9c5d-49ff-bae8-1f9efe4322f5 on n-h2-master-1 Jul 31 01:17:19.810656 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-d92fe599-a86b-483e-a6c4-13820e7dd0ec req-1220c212-69a6-40c9-a179-d20f7d986809 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078034 Jul 31 01:17:19.814418 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1169/2323] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:19.830464 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-58b97847-3e6b-4795-b19b-1dc20bf6b378 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:19.831624 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-58b97847-3e6b-4795-b19b-1dc20bf6b378 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:19.849683 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58b97847-3e6b-4795-b19b-1dc20bf6b378 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:19.850581 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58b97847-3e6b-4795-b19b-1dc20bf6b378 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:19.855738 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58b97847-3e6b-4795-b19b-1dc20bf6b378 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:19.856976 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58b97847-3e6b-4795-b19b-1dc20bf6b378 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:20.143399 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-58b97847-3e6b-4795-b19b-1dc20bf6b378 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:20.155377 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-58b97847-3e6b-4795-b19b-1dc20bf6b378 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1510 microversion: 2.1 time: 0.339504 Jul 31 01:17:20.156041 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1170/2324] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:19 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1510 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:20.168727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-da453c34-4a45-4016-baa4-96cbd026dcd9 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:20.202613 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-da453c34-4a45-4016-baa4-96cbd026dcd9 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042415 Jul 31 01:17:20.226558 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1171/2325] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:17:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:20.235813 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0d1db1ef-2d67-4771-97f4-ba459140741c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede54c2b80>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:21.257026 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-82bde00f-116f-4fa9-bc03-b43cfe70c9b6 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f" status: 200 len: 1426 microversion: 2.1 time: 5.062306 Jul 31 01:17:21.264991 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0d1db1ef-2d67-4771-97f4-ba459140741c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1" status: 200 len: 1463 microversion: 2.1 time: 1.036216 Jul 31 01:17:21.267269 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1155/2326] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:16 2022] GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f => generated 1426 bytes in 5074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:21.279265 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1172/2327] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:20 2022] GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1 => generated 1463 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:21.299437 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7f9a1065-37fc-44f8-8e7c-0965e81e97c6 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:21.301111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7f9a1065-37fc-44f8-8e7c-0965e81e97c6 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:21.303125 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb952020-826e-4379-8986-17c1c4a4076a tempest-SecurityGroupsTestAdminJSON-234361446 tempest-SecurityGroupsTestAdminJSON-234361446-project] Calling method '.version_select at 0x7fede54c2940>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:21.335808 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f9a1065-37fc-44f8-8e7c-0965e81e97c6 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:21.337066 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f9a1065-37fc-44f8-8e7c-0965e81e97c6 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:21.339150 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f9a1065-37fc-44f8-8e7c-0965e81e97c6 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:21.339962 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f9a1065-37fc-44f8-8e7c-0965e81e97c6 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:21.908969 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fb952020-826e-4379-8986-17c1c4a4076a tempest-SecurityGroupsTestAdminJSON-234361446 tempest-SecurityGroupsTestAdminJSON-234361446-project] 10.222.0.45 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.626966 Jul 31 01:17:21.909764 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1173/2328] 10.222.0.45 () {58 vars in 1191 bytes} [Sun Jul 31 01:17:21 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:21.915048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a3bffa35-0cca-4b8c-81b7-2f6030736269 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Action: 'update', calling method: .version_select at 0x7fede55839d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:21.928401 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7f9a1065-37fc-44f8-8e7c-0965e81e97c6 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:21.942586 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7f9a1065-37fc-44f8-8e7c-0965e81e97c6 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:21.950388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7f9a1065-37fc-44f8-8e7c-0965e81e97c6 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:21.957501 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7f9a1065-37fc-44f8-8e7c-0965e81e97c6 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 0.686329 Jul 31 01:17:21.963235 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1156/2329] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:21 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:21.981664 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-13ec7ad8-40d5-4203-aa82-ca6ada68ef17 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:21.982552 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-13ec7ad8-40d5-4203-aa82-ca6ada68ef17 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 2bc94263-b6c3-4954-95b3-345029530b02] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:22.002744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-13ec7ad8-40d5-4203-aa82-ca6ada68ef17 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:22.005727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-13ec7ad8-40d5-4203-aa82-ca6ada68ef17 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:22.012715 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-13ec7ad8-40d5-4203-aa82-ca6ada68ef17 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:22.013373 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-13ec7ad8-40d5-4203-aa82-ca6ada68ef17 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:22.370244 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3bffa35-0cca-4b8c-81b7-2f6030736269 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:22.371992 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3bffa35-0cca-4b8c-81b7-2f6030736269 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:22.380721 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3bffa35-0cca-4b8c-81b7-2f6030736269 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:22.382321 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3bffa35-0cca-4b8c-81b7-2f6030736269 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:22.409754 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-13ec7ad8-40d5-4203-aa82-ca6ada68ef17 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:22.426038 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-13ec7ad8-40d5-4203-aa82-ca6ada68ef17 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/2bc94263-b6c3-4954-95b3-345029530b02" status: 200 len: 1511 microversion: 2.1 time: 0.460878 Jul 31 01:17:22.443379 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1157/2330] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:21 2022] GET /compute/v2.1/servers/2bc94263-b6c3-4954-95b3-345029530b02 => generated 1511 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:22.451415 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b0e2e36e-be3e-412e-a204-af6c7dc3204d tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:22.528125 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a3bffa35-0cca-4b8c-81b7-2f6030736269 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a" status: 200 len: 328 microversion: 2.1 time: 0.617136 Jul 31 01:17:22.529042 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1174/2331] 10.222.0.45 () {60 vars in 1262 bytes} [Sun Jul 31 01:17:21 2022] PUT /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a => generated 328 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:22.534558 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-919ee1bc-e8fb-4d02-bea7-ae535fa4073d tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede543e040>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:22.560395 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b0e2e36e-be3e-412e-a204-af6c7dc3204d tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.117500 Jul 31 01:17:22.562413 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1158/2332] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:17:22 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:22.572298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9635e52e-bda6-43c1-9073-148d756f0fee tempest-SecurityGroupsTestAdminJSON-1871684506 tempest-SecurityGroupsTestAdminJSON-1871684506-project-admin] Calling method '.version_select at 0x7fede587b4c0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:22.659622 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-919ee1bc-e8fb-4d02-bea7-ae535fa4073d tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1" status: 200 len: 1463 microversion: 2.1 time: 0.129535 Jul 31 01:17:22.660225 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1175/2333] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:22 2022] GET /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1 => generated 1463 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:22.676713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8a967bea-071e-415a-adca-1a8fa90f0c40 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede563bd30>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:22.807287 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8a967bea-071e-415a-adca-1a8fa90f0c40 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f" status: 200 len: 1426 microversion: 2.1 time: 0.134600 Jul 31 01:17:22.809964 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1176/2334] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:22 2022] GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f => generated 1426 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:22.823720 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-78bf6aa4-156b-4bbd-b95a-8bee4a41c06f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:22.832885 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-78bf6aa4-156b-4bbd-b95a-8bee4a41c06f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:22.853700 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-78bf6aa4-156b-4bbd-b95a-8bee4a41c06f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:22.855723 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-78bf6aa4-156b-4bbd-b95a-8bee4a41c06f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:22.858931 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-78bf6aa4-156b-4bbd-b95a-8bee4a41c06f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:22.861564 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-78bf6aa4-156b-4bbd-b95a-8bee4a41c06f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:23.105876 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9635e52e-bda6-43c1-9073-148d756f0fee tempest-SecurityGroupsTestAdminJSON-1871684506 tempest-SecurityGroupsTestAdminJSON-1871684506-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/a37fb15e-0316-414a-973f-ba264587a543" status: 202 len: 0 microversion: 2.1 time: 0.540958 Jul 31 01:17:23.107538 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1159/2335] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:17:22 2022] DELETE /compute/v2.1/os-security-groups/a37fb15e-0316-414a-973f-ba264587a543 => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:17:23.119602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c298b181-ccbf-4450-8f32-0f071f7b1eed tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:23.202172 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c298b181-ccbf-4450-8f32-0f071f7b1eed tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.091628 Jul 31 01:17:23.203252 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1160/2336] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:17:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:23.211024 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6bcce824-8200-44a1-9ce8-87f8adf50052 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:23.211993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6bcce824-8200-44a1-9ce8-87f8adf50052 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cf0c39f6-2c6a-4eb3-9176-7d20151b0adb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:23.232694 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-78bf6aa4-156b-4bbd-b95a-8bee4a41c06f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:23.235408 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6bcce824-8200-44a1-9ce8-87f8adf50052 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:23.235876 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6bcce824-8200-44a1-9ce8-87f8adf50052 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:23.236727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6bcce824-8200-44a1-9ce8-87f8adf50052 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:23.237178 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6bcce824-8200-44a1-9ce8-87f8adf50052 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:23.249901 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-78bf6aa4-156b-4bbd-b95a-8bee4a41c06f tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 200 len: 1511 microversion: 2.1 time: 0.438141 Jul 31 01:17:23.252660 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1177/2337] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:22 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 1511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:23.274680 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-220398730", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:23.374182 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:17:23.631227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6bcce824-8200-44a1-9ce8-87f8adf50052 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:23.643317 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6bcce824-8200-44a1-9ce8-87f8adf50052 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb" status: 200 len: 1468 microversion: 2.1 time: 0.438257 Jul 31 01:17:23.644046 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1161/2338] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:23 2022] GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb => generated 1468 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:23.664450 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-faf4fed8-be2b-4505-8355-6de7f852cd1a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:23.665397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-faf4fed8-be2b-4505-8355-6de7f852cd1a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:23.673293 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-faf4fed8-be2b-4505-8355-6de7f852cd1a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:23.674100 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-faf4fed8-be2b-4505-8355-6de7f852cd1a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:23.675152 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-faf4fed8-be2b-4505-8355-6de7f852cd1a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:23.675830 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-faf4fed8-be2b-4505-8355-6de7f852cd1a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:24.006627 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:17:24.007366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:17:24.008257 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:17:24.008940 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:17:24.009636 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:17:24.037723 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:24.038923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:24.040797 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:24.041820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:24.092478 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Getting quotas for project 383b5e065b9345d1a88c895380b52b7a. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:17:24.103004 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Getting quotas for user c6c7f405ccea42b989d85a7c2455241a and project 383b5e065b9345d1a88c895380b52b7a. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:17:24.137582 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.utils [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] instances quota exceeded for 383b5e065b9345d1a88c895380b52b7a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119475) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 31 01:17:24.139666 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Request method failure captured: Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 144 Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dgSYQp_vvNezRElgKJ94nu5b1Z3kIDv2N7c5nnYjTwffNnqkos6aYF8stQ0VfwdaEIJVuUMDaKHi5nM7JF_gcYfUgLy2a21gS-FrJkhypAUpjFvQR1zeY-uZm3u2n3jnxtGA6nQZ5vyzJkuPgFcCfdfu6WQpTA5jxU-TIAVVyN_zmw Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 383b5e065b9345d1a88c895380b52b7a Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-QuotasAdminNegativeTest-944703133 Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/383b5e065b9345d1a88c895380b52b7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/383b5e065b9345d1a88c895380b52b7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/383b5e065b9345d1a88c895380b52b7a"}]}, {"type": "tempest-type-637456412", "name": "tempest-service-212884429", "endpoints": [{"region": "tempest-region-1925257104", "publicURL": "https://url-1996201411.com"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "tempest-type-226696235", "name": "tempest-service-1156080264", "endpoints": [{"region": "tempest-region-874058038", "internalURL": "https://url-77151237.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_383b5e065b9345d1a88c895380b52b7a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-QuotasAdminNegativeTest-944703133 Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 383b5e065b9345d1a88c895380b52b7a Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-944703133 Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-QuotasAdminNegativeTest-944703133-project Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: c6c7f405ccea42b989d85a7c2455241a Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-QuotasAdminNegativeTest-944703133-project Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-220398730", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-220398730', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452'}}} Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:24.147390 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 31 01:17:24.156357 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:24.168750 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:17:24.170803 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ca005e17-56cd-4dfe-a294-270cdcb6650e tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.908092 Jul 31 01:17:24.178573 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1178/2339] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:17:23 2022] POST /compute/v2.1/servers => generated 119 bytes in 925 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:17:24.190265 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f2810c0d-f4f6-4ac1-b006-bf2d953a8fb5 tempest-SecurityGroupsTestAdminJSON-1871684506 tempest-SecurityGroupsTestAdminJSON-1871684506-project-admin] Calling method '.version_select at 0x7fede5b40e50>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:24.321599 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-faf4fed8-be2b-4505-8355-6de7f852cd1a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:24.334256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-faf4fed8-be2b-4505-8355-6de7f852cd1a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:24.337904 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-faf4fed8-be2b-4505-8355-6de7f852cd1a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:24.340834 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-faf4fed8-be2b-4505-8355-6de7f852cd1a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 0.680123 Jul 31 01:17:24.355658 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1162/2340] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:23 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:24.359581 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ea27c4f1-99ff-4b33-bef8-a136c117a6e1 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:24.381850 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ea27c4f1-99ff-4b33-bef8-a136c117a6e1 tempest-FlavorsV2TestJSON-1841811583 tempest-FlavorsV2TestJSON-1841811583-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033478 Jul 31 01:17:24.386755 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1163/2341] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:17:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:24.400896 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-73ae40d6-fdc3-4277-befc-cee3eb7c6c52 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:24.406289 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-73ae40d6-fdc3-4277-befc-cee3eb7c6c52 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:24.407068 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-73ae40d6-fdc3-4277-befc-cee3eb7c6c52 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:17:24.429197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73ae40d6-fdc3-4277-befc-cee3eb7c6c52 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:24.430278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73ae40d6-fdc3-4277-befc-cee3eb7c6c52 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:24.431983 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73ae40d6-fdc3-4277-befc-cee3eb7c6c52 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:24.436008 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73ae40d6-fdc3-4277-befc-cee3eb7c6c52 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:24.571973 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-73ae40d6-fdc3-4277-befc-cee3eb7c6c52 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:17:24.637979 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=22 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:24.648139 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f2810c0d-f4f6-4ac1-b006-bf2d953a8fb5 tempest-SecurityGroupsTestAdminJSON-1871684506 tempest-SecurityGroupsTestAdminJSON-1871684506-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/99bd022b-12c3-4f7a-a161-7c31025b0e99" status: 202 len: 0 microversion: 2.1 time: 0.467425 Jul 31 01:17:24.649400 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1179/2342] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:17:24 2022] DELETE /compute/v2.1/os-security-groups/99bd022b-12c3-4f7a-a161-7c31025b0e99 => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:17:24.652300 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-73ae40d6-fdc3-4277-befc-cee3eb7c6c52 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:24.659677 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e8ad34c-3ef2-4815-9f51-7b00942e659e tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1600717605"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:24.665136 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1e8ad34c-3ef2-4815-9f51-7b00942e659e tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:24.665479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73ae40d6-fdc3-4277-befc-cee3eb7c6c52 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:24.666105 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73ae40d6-fdc3-4277-befc-cee3eb7c6c52 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:24.706218 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e8ad34c-3ef2-4815-9f51-7b00942e659e tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:24.706750 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e8ad34c-3ef2-4815-9f51-7b00942e659e tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:24.709932 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e8ad34c-3ef2-4815-9f51-7b00942e659e tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:24.710412 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e8ad34c-3ef2-4815-9f51-7b00942e659e tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:25.008108 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-73ae40d6-fdc3-4277-befc-cee3eb7c6c52 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.620072 Jul 31 01:17:25.008996 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1164/2343] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:17:24 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:25.014038 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b896bf04-5758-4df8-8794-4a9fbf31873e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fedea871dc0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:25.150197 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1e8ad34c-3ef2-4815-9f51-7b00942e659e tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "POST /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7/action" status: 202 len: 0 microversion: 2.1 time: 0.496429 Jul 31 01:17:25.153931 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1180/2344] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:17:24 2022] POST /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 31 01:17:25.168294 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-69253a03-7bf1-49a4-b02c-9534ee52764c tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Action: 'update', calling method: .version_select at 0x7fede57af820>, body: {"quota_set": {"instances": 10}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:25.188127 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b896bf04-5758-4df8-8794-4a9fbf31873e tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f" status: 200 len: 1426 microversion: 2.1 time: 0.176891 Jul 31 01:17:25.196948 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1165/2345] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:25 2022] GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f => generated 1426 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:25.210788 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-13f7a620-69b7-4a40-9e6f-4e1887b536b2 tempest-SecurityGroupsTestAdminJSON-234361446 tempest-SecurityGroupsTestAdminJSON-234361446-project] Calling method '.version_select at 0x7fede6025700>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:25.837205 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-13f7a620-69b7-4a40-9e6f-4e1887b536b2 tempest-SecurityGroupsTestAdminJSON-234361446 tempest-SecurityGroupsTestAdminJSON-234361446-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/463b2865-c78c-4168-942d-f58508c5f97d" status: 202 len: 0 microversion: 2.1 time: 0.639002 Jul 31 01:17:25.839014 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1166/2346] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:17:25 2022] DELETE /compute/v2.1/os-security-groups/463b2865-c78c-4168-942d-f58508c5f97d => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:17:25.845614 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-31820e26-5f05-4ac6-ae67-2a2f6143f311 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:25.865796 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-31820e26-5f05-4ac6-ae67-2a2f6143f311 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:25.869707 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-31820e26-5f05-4ac6-ae67-2a2f6143f311 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:17:26.147943 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-31820e26-5f05-4ac6-ae67-2a2f6143f311 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:26.149216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-31820e26-5f05-4ac6-ae67-2a2f6143f311 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:26.150234 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-31820e26-5f05-4ac6-ae67-2a2f6143f311 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:26.151040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-31820e26-5f05-4ac6-ae67-2a2f6143f311 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:26.253097 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-31820e26-5f05-4ac6-ae67-2a2f6143f311 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:17:26.337759 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69253a03-7bf1-49a4-b02c-9534ee52764c tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:26.340339 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69253a03-7bf1-49a4-b02c-9534ee52764c tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:26.343483 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69253a03-7bf1-49a4-b02c-9534ee52764c tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:26.346106 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69253a03-7bf1-49a4-b02c-9534ee52764c tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:26.385312 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-31820e26-5f05-4ac6-ae67-2a2f6143f311 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.543938 Jul 31 01:17:26.394965 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1167/2347] 10.222.0.45 () {58 vars in 1150 bytes} [Sun Jul 31 01:17:25 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:26.398479 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f698790d-d1ab-42a8-afb6-804ddcb4eeec tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede59b7430>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:26.517737 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f698790d-d1ab-42a8-afb6-804ddcb4eeec tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb" status: 200 len: 1455 microversion: 2.1 time: 0.128315 Jul 31 01:17:26.524782 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1168/2348] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:26 2022] GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:26.545361 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7521734d-abc8-46bf-9aa1-9a1e41da8640 req-041d63d8-efff-4b2e-8888-912677425151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf0c39f6-2c6a-4eb3-9176-7d20151b0adb", "name": "network-vif-unplugged", "status": "completed", "tag": "cf150970-8f1a-4d54-b48d-7de2be48f7e1"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:26.571647 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-69253a03-7bf1-49a4-b02c-9534ee52764c tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a" status: 200 len: 329 microversion: 2.1 time: 1.413706 Jul 31 01:17:26.573013 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1181/2349] 10.222.0.45 () {60 vars in 1262 bytes} [Sun Jul 31 01:17:25 2022] PUT /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a => generated 329 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:26.588718 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-20391edf-fe55-4135-aa8f-43931020402d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:26.589610 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-20391edf-fe55-4135-aa8f-43931020402d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:26.603558 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20391edf-fe55-4135-aa8f-43931020402d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:26.604182 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20391edf-fe55-4135-aa8f-43931020402d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:26.605215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20391edf-fe55-4135-aa8f-43931020402d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:26.605751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20391edf-fe55-4135-aa8f-43931020402d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:26.639594 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7521734d-abc8-46bf-9aa1-9a1e41da8640 req-041d63d8-efff-4b2e-8888-912677425151 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:26.648570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7521734d-abc8-46bf-9aa1-9a1e41da8640 req-041d63d8-efff-4b2e-8888-912677425151 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:26.721250 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7521734d-abc8-46bf-9aa1-9a1e41da8640 req-041d63d8-efff-4b2e-8888-912677425151 service nova] Creating event network-vif-unplugged:cf150970-8f1a-4d54-b48d-7de2be48f7e1 for instance cf0c39f6-2c6a-4eb3-9176-7d20151b0adb on n-h2-master-1 Jul 31 01:17:26.746246 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7521734d-abc8-46bf-9aa1-9a1e41da8640 req-041d63d8-efff-4b2e-8888-912677425151 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.218107 Jul 31 01:17:26.753132 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1169/2350] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:26.776420 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-155843dc-99f7-4151-a4f3-3ac52cee4959 tempest-SecurityGroupsTestAdminJSON-234361446 tempest-SecurityGroupsTestAdminJSON-234361446-project] Calling method '.version_select at 0x7fede6136ca0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:27.236650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-20391edf-fe55-4135-aa8f-43931020402d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:27.251065 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-20391edf-fe55-4135-aa8f-43931020402d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:27.252876 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-20391edf-fe55-4135-aa8f-43931020402d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:27.254159 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-20391edf-fe55-4135-aa8f-43931020402d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 0.680505 Jul 31 01:17:27.254741 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1182/2351] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:26 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:27.269679 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-315dc05c-b032-45db-8a6e-b8d3b12760ce tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede5439670>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:27.433471 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-155843dc-99f7-4151-a4f3-3ac52cee4959 tempest-SecurityGroupsTestAdminJSON-234361446 tempest-SecurityGroupsTestAdminJSON-234361446-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/7d1c6fc5-dc61-4f0b-9f32-cd8d7d60634d" status: 202 len: 0 microversion: 2.1 time: 0.678546 Jul 31 01:17:27.444369 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1170/2352] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:17:26 2022] DELETE /compute/v2.1/os-security-groups/7d1c6fc5-dc61-4f0b-9f32-cd8d7d60634d => generated 0 bytes in 690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:17:27.454665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-25c38c96-6756-4ec3-bcf7-0e63466704d9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:27.477208 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-25c38c96-6756-4ec3-bcf7-0e63466704d9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:27.478186 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-315dc05c-b032-45db-8a6e-b8d3b12760ce tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f" status: 200 len: 1426 microversion: 2.1 time: 0.215419 Jul 31 01:17:27.481577 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-25c38c96-6756-4ec3-bcf7-0e63466704d9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:17:27.496153 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25c38c96-6756-4ec3-bcf7-0e63466704d9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:27.496925 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25c38c96-6756-4ec3-bcf7-0e63466704d9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:27.498008 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25c38c96-6756-4ec3-bcf7-0e63466704d9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:27.503421 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1183/2353] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:27 2022] GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f => generated 1426 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:27.511841 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25c38c96-6756-4ec3-bcf7-0e63466704d9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:27.522138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dd558d1c-c81f-4a64-b1a5-a3cda87c13ba tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Calling method '.version_select at 0x7fedeaa090d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:27.656354 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-25c38c96-6756-4ec3-bcf7-0e63466704d9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:17:27.756599 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-25c38c96-6756-4ec3-bcf7-0e63466704d9 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.310642 Jul 31 01:17:27.757608 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1171/2354] 10.222.0.45 () {58 vars in 1212 bytes} [Sun Jul 31 01:17:27 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:27.776076 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8c59ad4f-cb55-4725-b94d-0090e1b9d1a2 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedea97c1f0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:27.845743 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8c59ad4f-cb55-4725-b94d-0090e1b9d1a2 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb" status: 200 len: 1455 microversion: 2.1 time: 0.074558 Jul 31 01:17:27.847110 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1172/2355] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:27 2022] GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:27.854288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7910977b-90b0-45ca-b034-07d1aaf50c14 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:27.862007 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7910977b-90b0-45ca-b034-07d1aaf50c14 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:27.863674 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7910977b-90b0-45ca-b034-07d1aaf50c14 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:17:27.872768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7910977b-90b0-45ca-b034-07d1aaf50c14 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:27.874271 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7910977b-90b0-45ca-b034-07d1aaf50c14 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:27.875665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7910977b-90b0-45ca-b034-07d1aaf50c14 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:27.876400 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7910977b-90b0-45ca-b034-07d1aaf50c14 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:28.121759 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-7910977b-90b0-45ca-b034-07d1aaf50c14 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:17:28.242793 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7910977b-90b0-45ca-b034-07d1aaf50c14 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.393588 Jul 31 01:17:28.256050 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1173/2356] 10.222.0.45 () {58 vars in 1196 bytes} [Sun Jul 31 01:17:27 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:28.264270 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-17f936d7-c7a9-4de4-bab1-9f3495bd034b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:28.282788 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-17f936d7-c7a9-4de4-bab1-9f3495bd034b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:28.282788 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-17f936d7-c7a9-4de4-bab1-9f3495bd034b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'name': '-754122715', 'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:17:28.299473 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17f936d7-c7a9-4de4-bab1-9f3495bd034b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:28.300144 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17f936d7-c7a9-4de4-bab1-9f3495bd034b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:28.306428 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17f936d7-c7a9-4de4-bab1-9f3495bd034b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:28.307190 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17f936d7-c7a9-4de4-bab1-9f3495bd034b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:28.537117 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-17f936d7-c7a9-4de4-bab1-9f3495bd034b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:17:28.679718 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:28.686816 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-17f936d7-c7a9-4de4-bab1-9f3495bd034b tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers?name=-754122715" status: 200 len: 345 microversion: 2.1 time: 0.426665 Jul 31 01:17:28.697861 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1174/2357] 10.222.0.45 () {58 vars in 1156 bytes} [Sun Jul 31 01:17:28 2022] GET /compute/v2.1/servers?name=-754122715 => generated 345 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:17:28.704223 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bd6b5d05-1b3c-45db-85e9-eb6940cebcca tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:28.707238 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bd6b5d05-1b3c-45db-85e9-eb6940cebcca tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:28.742456 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd6b5d05-1b3c-45db-85e9-eb6940cebcca tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:28.744122 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd6b5d05-1b3c-45db-85e9-eb6940cebcca tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:28.746890 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd6b5d05-1b3c-45db-85e9-eb6940cebcca tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:28.753945 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd6b5d05-1b3c-45db-85e9-eb6940cebcca tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:28.798583 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dd558d1c-c81f-4a64-b1a5-a3cda87c13ba tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a" status: 200 len: 371 microversion: 2.1 time: 1.292481 Jul 31 01:17:28.814558 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1184/2358] 10.222.0.45 () {58 vars in 1242 bytes} [Sun Jul 31 01:17:27 2022] GET /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a => generated 371 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:28.835747 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-063af5e3-6af2-49c1-b038-b831e9081f80 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede5c3f0d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:28.979573 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-063af5e3-6af2-49c1-b038-b831e9081f80 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f" status: 200 len: 1426 microversion: 2.1 time: 0.161753 Jul 31 01:17:29.004752 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1185/2359] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:28 2022] GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f => generated 1426 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:29.054930 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-df29a00c-d49b-4ec0-8029-294e6bb78692 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:29.121817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-df29a00c-d49b-4ec0-8029-294e6bb78692 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:29.129299 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-df29a00c-d49b-4ec0-8029-294e6bb78692 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:17:29.152547 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df29a00c-d49b-4ec0-8029-294e6bb78692 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:29.158855 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df29a00c-d49b-4ec0-8029-294e6bb78692 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:29.164420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df29a00c-d49b-4ec0-8029-294e6bb78692 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:29.168249 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df29a00c-d49b-4ec0-8029-294e6bb78692 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:29.405704 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bd6b5d05-1b3c-45db-85e9-eb6940cebcca tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:29.420616 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bd6b5d05-1b3c-45db-85e9-eb6940cebcca tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:29.424207 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bd6b5d05-1b3c-45db-85e9-eb6940cebcca tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:29.425897 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bd6b5d05-1b3c-45db-85e9-eb6940cebcca tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 0.725682 Jul 31 01:17:29.427134 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1175/2360] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:28 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:29.446510 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4b0718d9-252a-43f4-803a-0acef8a02476 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Action: 'update', calling method: .version_select at 0x7fede5b25940>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:29.671708 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.multi_cell_list [None req-df29a00c-d49b-4ec0-8029-294e6bb78692 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119475) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:17:29.821069 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-df29a00c-d49b-4ec0-8029-294e6bb78692 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.811962 Jul 31 01:17:29.829830 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1186/2361] 10.222.0.45 () {58 vars in 1154 bytes} [Sun Jul 31 01:17:29 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:29.857820 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2e459a34-6295-4587-97b5-039c2f4c9338 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedea9b15e0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:30.155441 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2e459a34-6295-4587-97b5-039c2f4c9338 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb" status: 200 len: 1455 microversion: 2.1 time: 0.313209 Jul 31 01:17:30.160156 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1187/2362] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:29 2022] GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb => generated 1455 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:30.182627 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-20e7e62a-fc8f-4d91-930a-8a7761259337 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:30.219645 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-20e7e62a-fc8f-4d91-930a-8a7761259337 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:30.224435 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-20e7e62a-fc8f-4d91-930a-8a7761259337 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-75412271', 'deleted': False, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:17:30.242996 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20e7e62a-fc8f-4d91-930a-8a7761259337 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:30.243523 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20e7e62a-fc8f-4d91-930a-8a7761259337 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:30.244366 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20e7e62a-fc8f-4d91-930a-8a7761259337 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:30.244821 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20e7e62a-fc8f-4d91-930a-8a7761259337 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:30.589483 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b0718d9-252a-43f4-803a-0acef8a02476 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:30.596486 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b0718d9-252a-43f4-803a-0acef8a02476 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:30.604816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b0718d9-252a-43f4-803a-0acef8a02476 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:30.605849 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b0718d9-252a-43f4-803a-0acef8a02476 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:30.611245 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.multi_cell_list [None req-20e7e62a-fc8f-4d91-930a-8a7761259337 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119475) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:17:30.784443 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4b0718d9-252a-43f4-803a-0acef8a02476 tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a" status: 200 len: 325 microversion: 2.1 time: 1.355396 Jul 31 01:17:30.814491 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1176/2363] 10.222.0.45 () {60 vars in 1262 bytes} [Sun Jul 31 01:17:29 2022] PUT /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a => generated 325 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:30.829339 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cd5cf039-46fd-4b26-8da8-39d1486f89f1 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede59a7820>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:30.888370 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-20e7e62a-fc8f-4d91-930a-8a7761259337 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-75412271" status: 200 len: 345 microversion: 2.1 time: 0.720859 Jul 31 01:17:30.909095 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1188/2364] 10.222.0.45 () {58 vars in 1226 bytes} [Sun Jul 31 01:17:30 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-75412271 => generated 345 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:30.931494 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b900cc39-0ae1-4613-b55a-9f7cd527bbf0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:30.945253 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b900cc39-0ae1-4613-b55a-9f7cd527bbf0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:30.964200 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b900cc39-0ae1-4613-b55a-9f7cd527bbf0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:30.970624 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b900cc39-0ae1-4613-b55a-9f7cd527bbf0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:30.977727 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b900cc39-0ae1-4613-b55a-9f7cd527bbf0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:30.980559 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b900cc39-0ae1-4613-b55a-9f7cd527bbf0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:31.489059 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b900cc39-0ae1-4613-b55a-9f7cd527bbf0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:31.526780 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b900cc39-0ae1-4613-b55a-9f7cd527bbf0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:31.530061 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b900cc39-0ae1-4613-b55a-9f7cd527bbf0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:31.542877 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b900cc39-0ae1-4613-b55a-9f7cd527bbf0 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 0.619537 Jul 31 01:17:31.544612 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1189/2365] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:30 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:31.571314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b9b74160-b2d9-4ee1-9680-ce0c9bfe00f0 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:31.583234 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b9b74160-b2d9-4ee1-9680-ce0c9bfe00f0 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:31.617387 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9b74160-b2d9-4ee1-9680-ce0c9bfe00f0 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:31.620522 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9b74160-b2d9-4ee1-9680-ce0c9bfe00f0 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:31.633595 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9b74160-b2d9-4ee1-9680-ce0c9bfe00f0 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:31.634692 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9b74160-b2d9-4ee1-9680-ce0c9bfe00f0 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:31.792041 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b9b74160-b2d9-4ee1-9680-ce0c9bfe00f0 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:17:31.960840 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:32.099772 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b9b74160-b2d9-4ee1-9680-ce0c9bfe00f0 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 204 len: 0 microversion: 2.1 time: 0.553098 Jul 31 01:17:32.100433 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1190/2366] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:17:31 2022] DELETE /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:17:32.115783 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b01a2210-2f24-48c9-8e30-5c34a659ca4c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede5632790>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:36.352193 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cd5cf039-46fd-4b26-8da8-39d1486f89f1 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f" status: 200 len: 1435 microversion: 2.1 time: 5.536049 Jul 31 01:17:36.354278 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1177/2367] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:30 2022] GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f => generated 1435 bytes in 5539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:36.368414 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-739673731", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:36.372031 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b01a2210-2f24-48c9-8e30-5c34a659ca4c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb" status: 200 len: 1455 microversion: 2.1 time: 4.268367 Jul 31 01:17:36.381224 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1191/2368] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:32 2022] GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb => generated 1455 bytes in 4280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:36.401064 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb850ac4-7958-480c-b028-c30d6e368943 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:36.402110 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fb850ac4-7958-480c-b028-c30d6e368943 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:36.410806 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb850ac4-7958-480c-b028-c30d6e368943 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:36.412181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb850ac4-7958-480c-b028-c30d6e368943 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:36.414102 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb850ac4-7958-480c-b028-c30d6e368943 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:36.414727 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb850ac4-7958-480c-b028-c30d6e368943 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:36.473224 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb850ac4-7958-480c-b028-c30d6e368943 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:36.475814 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb850ac4-7958-480c-b028-c30d6e368943 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:36.479108 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-fb850ac4-7958-480c-b028-c30d6e368943 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lazy-loading 'fault' on Instance uuid 4e902288-e069-4d67-9804-2a58970a96c0 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:17:36.565382 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fb850ac4-7958-480c-b028-c30d6e368943 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:36.586657 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fb850ac4-7958-480c-b028-c30d6e368943 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 200 len: 1311 microversion: 2.1 time: 0.192295 Jul 31 01:17:36.589476 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1192/2369] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:36 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 1311 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:36.599764 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ac58466f-2f1a-4834-8cfc-dbc78c17e84c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:36.601173 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ac58466f-2f1a-4834-8cfc-dbc78c17e84c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:36.608614 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac58466f-2f1a-4834-8cfc-dbc78c17e84c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:36.609610 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac58466f-2f1a-4834-8cfc-dbc78c17e84c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:36.611559 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac58466f-2f1a-4834-8cfc-dbc78c17e84c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:36.612246 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac58466f-2f1a-4834-8cfc-dbc78c17e84c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:36.613668 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] validate_networks() for None {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:17:37.120364 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ac58466f-2f1a-4834-8cfc-dbc78c17e84c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:37.132234 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ac58466f-2f1a-4834-8cfc-dbc78c17e84c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:37.143900 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ac58466f-2f1a-4834-8cfc-dbc78c17e84c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:37.147449 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ac58466f-2f1a-4834-8cfc-dbc78c17e84c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 0.553447 Jul 31 01:17:37.149745 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1193/2370] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:36 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:37.163705 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-0de950ab-0609-42bb-b4b8-78696bfe9124 req-a5f29548-cee1-44b5-afdf-9f75215240e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-plugged", "status": "completed", "tag": "9d0de813-2073-4e2a-a486-6e31d72863a5"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:37.187445 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0de950ab-0609-42bb-b4b8-78696bfe9124 req-a5f29548-cee1-44b5-afdf-9f75215240e6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:37.195668 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0de950ab-0609-42bb-b4b8-78696bfe9124 req-a5f29548-cee1-44b5-afdf-9f75215240e6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:37.218748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:17:37.219584 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:17:37.220390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:17:37.221036 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:17:37.222373 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:17:37.226440 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-0de950ab-0609-42bb-b4b8-78696bfe9124 req-a5f29548-cee1-44b5-afdf-9f75215240e6 service nova] Creating event network-vif-plugged:9d0de813-2073-4e2a-a486-6e31d72863a5 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:17:37.236683 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:37.238356 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:37.239679 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-0de950ab-0609-42bb-b4b8-78696bfe9124 req-a5f29548-cee1-44b5-afdf-9f75215240e6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086237 Jul 31 01:17:37.241990 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:37.243097 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:37.243221 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1194/2371] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:37.248684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-0d4a9cee-bce3-442a-94ae-f6a4ea30919f req-497e5cd8-2be2-4c29-bf69-743334a34976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e902288-e069-4d67-9804-2a58970a96c0", "name": "network-vif-deleted", "tag": "7a0675a8-1c66-48f3-aa9c-ba7c125458e4"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:37.253965 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=21 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:37.274990 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Getting quotas for project 383b5e065b9345d1a88c895380b52b7a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:17:37.279763 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0d4a9cee-bce3-442a-94ae-f6a4ea30919f req-497e5cd8-2be2-4c29-bf69-743334a34976 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:37.279763 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0d4a9cee-bce3-442a-94ae-f6a4ea30919f req-497e5cd8-2be2-4c29-bf69-743334a34976 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:37.288563 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Getting quotas for user c6c7f405ccea42b989d85a7c2455241a and project 383b5e065b9345d1a88c895380b52b7a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:17:37.306637 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.utils [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] ram quota exceeded for 383b5e065b9345d1a88c895380b52b7a, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119474) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 31 01:17:37.308317 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Request method failure captured: Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 144 Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dgSYQp_vvNezRElgKJ94nu5b1Z3kIDv2N7c5nnYjTwffNnqkos6aYF8stQ0VfwdaEIJVuUMDaKHi5nM7JF_gcYfUgLy2a21gS-FrJkhypAUpjFvQR1zeY-uZm3u2n3jnxtGA6nQZ5vyzJkuPgFcCfdfu6WQpTA5jxU-TIAVVyN_zmw Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 383b5e065b9345d1a88c895380b52b7a Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-QuotasAdminNegativeTest-944703133 Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/383b5e065b9345d1a88c895380b52b7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/383b5e065b9345d1a88c895380b52b7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/383b5e065b9345d1a88c895380b52b7a"}]}, {"type": "tempest-type-637456412", "name": "tempest-service-212884429", "endpoints": [{"region": "tempest-region-1925257104", "publicURL": "https://url-1996201411.com"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "tempest-type-226696235", "name": "tempest-service-1156080264", "endpoints": [{"region": "tempest-region-874058038", "internalURL": "https://url-77151237.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_383b5e065b9345d1a88c895380b52b7a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-QuotasAdminNegativeTest-944703133 Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 383b5e065b9345d1a88c895380b52b7a Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-944703133 Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-QuotasAdminNegativeTest-944703133-project Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: c6c7f405ccea42b989d85a7c2455241a Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-QuotasAdminNegativeTest-944703133-project Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-739673731", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-739673731', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452'}}} Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 31 01:17:37.311500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 31 01:17:37.315073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:37.322854 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-0d4a9cee-bce3-442a-94ae-f6a4ea30919f req-497e5cd8-2be2-4c29-bf69-743334a34976 service nova] Creating event network-vif-deleted:7a0675a8-1c66-48f3-aa9c-ba7c125458e4 for instance 4e902288-e069-4d67-9804-2a58970a96c0 on n-h2-master-1 Jul 31 01:17:37.324906 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:17:37.326143 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7f739bf1-6a9d-4215-8eae-c3a0ea9ad8df tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.970811 Jul 31 01:17:37.326852 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-0d4a9cee-bce3-442a-94ae-f6a4ea30919f req-497e5cd8-2be2-4c29-bf69-743334a34976 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082203 Jul 31 01:17:37.327491 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1195/2372] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:37.333348 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1178/2373] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:17:36 2022] POST /compute/v2.1/servers => generated 110 bytes in 978 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:17:37.340389 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b0c08b7f-05fa-42d6-a99e-4b4985f6332a tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede58b43a0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:37.462030 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b0c08b7f-05fa-42d6-a99e-4b4985f6332a tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f" status: 200 len: 1435 microversion: 2.1 time: 0.126571 Jul 31 01:17:37.463230 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1179/2374] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:37 2022] GET /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f => generated 1435 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:37.469111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a3149ecd-0804-413b-8d0e-b2e0355241fb tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Action: 'update', calling method: .version_select at 0x7fede58b4af0>, body: {"quota_set": {"ram": 51200}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:37.727032 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e45008cf-e7ce-4b83-b1c8-4bac11b6a2ec tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2054546948", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:37.821007 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-e45008cf-e7ce-4b83-b1c8-4bac11b6a2ec tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:17:38.091294 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3149ecd-0804-413b-8d0e-b2e0355241fb tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:38.093778 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3149ecd-0804-413b-8d0e-b2e0355241fb tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:38.099705 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3149ecd-0804-413b-8d0e-b2e0355241fb tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:38.100733 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3149ecd-0804-413b-8d0e-b2e0355241fb tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:38.292710 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:38.348592 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a3149ecd-0804-413b-8d0e-b2e0355241fb tempest-QuotasAdminNegativeTest-378830890 tempest-QuotasAdminNegativeTest-378830890-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a" status: 200 len: 329 microversion: 2.1 time: 0.883931 Jul 31 01:17:38.352544 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1180/2375] 10.222.0.45 () {60 vars in 1262 bytes} [Sun Jul 31 01:17:37 2022] PUT /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a => generated 329 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:38.366751 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-e45008cf-e7ce-4b83-b1c8-4bac11b6a2ec tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:17:38.367205 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-e45008cf-e7ce-4b83-b1c8-4bac11b6a2ec tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:17:38.367742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-e45008cf-e7ce-4b83-b1c8-4bac11b6a2ec tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:17:38.368222 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-e45008cf-e7ce-4b83-b1c8-4bac11b6a2ec tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:17:38.368650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-e45008cf-e7ce-4b83-b1c8-4bac11b6a2ec tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:17:38.371890 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-96a20fcc-eea3-48da-81bf-d78ff811d670 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedea981d30>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:38.385070 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=29 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:38.396420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e45008cf-e7ce-4b83-b1c8-4bac11b6a2ec tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:38.397111 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e45008cf-e7ce-4b83-b1c8-4bac11b6a2ec tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:38.398098 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e45008cf-e7ce-4b83-b1c8-4bac11b6a2ec tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:38.398725 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e45008cf-e7ce-4b83-b1c8-4bac11b6a2ec tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:38.436753 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-e45008cf-e7ce-4b83-b1c8-4bac11b6a2ec tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Getting quotas for project 43c36901e18a4507ae8a90557eb9abc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:17:38.445622 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-e45008cf-e7ce-4b83-b1c8-4bac11b6a2ec tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Getting quotas for user 4157eca4624c444bb8b88bdb958dd8dc and project 43c36901e18a4507ae8a90557eb9abc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:17:38.462383 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e45008cf-e7ce-4b83-b1c8-4bac11b6a2ec tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:17:38.464961 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e45008cf-e7ce-4b83-b1c8-4bac11b6a2ec tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:17:38.470161 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-96a20fcc-eea3-48da-81bf-d78ff811d670 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb" status: 200 len: 1455 microversion: 2.1 time: 0.113012 Jul 31 01:17:38.484693 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1181/2376] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:38 2022] GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:38.493414 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-309bd0d4-f75c-4b2e-bb00-18e51b4a23b5 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:38.495368 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-309bd0d4-f75c-4b2e-bb00-18e51b4a23b5 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:38.509597 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-309bd0d4-f75c-4b2e-bb00-18e51b4a23b5 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:38.510383 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-309bd0d4-f75c-4b2e-bb00-18e51b4a23b5 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:38.511723 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-309bd0d4-f75c-4b2e-bb00-18e51b4a23b5 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:38.512899 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-309bd0d4-f75c-4b2e-bb00-18e51b4a23b5 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:38.529101 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:38.565415 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e45008cf-e7ce-4b83-b1c8-4bac11b6a2ec tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.229515 Jul 31 01:17:38.577877 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1196/2377] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:17:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:17:38.589930 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6b6dd088-d363-47be-aa16-ef3f70e85532 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:38.607886 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6b6dd088-d363-47be-aa16-ef3f70e85532 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 4e902288-e069-4d67-9804-2a58970a96c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:38.662426 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b6dd088-d363-47be-aa16-ef3f70e85532 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:38.663061 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b6dd088-d363-47be-aa16-ef3f70e85532 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:38.672484 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b6dd088-d363-47be-aa16-ef3f70e85532 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:38.674584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b6dd088-d363-47be-aa16-ef3f70e85532 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:38.749331 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-6b6dd088-d363-47be-aa16-ef3f70e85532 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] HTTP exception thrown: Instance 4e902288-e069-4d67-9804-2a58970a96c0 could not be found. Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6b6dd088-d363-47be-aa16-ef3f70e85532 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Request method failure captured: Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 HTTP/1.1 Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dfKFOVp5TofmrO6CXNVhnRKGtQ-0xDO2sBSXr8w9ILqhzWEnu6H2iaCDY5li3X7n0axWXg4vWDd4IDQeJgP0AWN4kubfY9Or0gzrazacaSYIEJIBra41XpjbV7885ypwuFGn1I2YB4P2EE1EwqZabFajpCglCuQdc1Ggzywv9i3ghQ Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a14ae0c0cc7d4657acb725838ca0325a Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ListServerFiltersTestJSON-1159454571 Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a14ae0c0cc7d4657acb725838ca0325a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a14ae0c0cc7d4657acb725838ca0325a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a14ae0c0cc7d4657acb725838ca0325a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a14ae0c0cc7d4657acb725838ca0325a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ListServerFiltersTestJSON-1159454571 Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a14ae0c0cc7d4657acb725838ca0325a Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1159454571 Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ListServerFiltersTestJSON-1159454571-project Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: cdce34f77f644220998e5deba40c6421 Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ListServerFiltersTestJSON-1159454571-project Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 4e902288-e069-4d67-9804-2a58970a96c0 could not be found. Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '4e902288-e069-4d67-9804-2a58970a96c0'} Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e902288-e069-4d67-9804-2a58970a96c0 could not be found. Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e902288-e069-4d67-9804-2a58970a96c0 could not be found. Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:38.765408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:38.769755 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:38.769755 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:38.769755 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:38.769755 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:17:38.769755 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:17:38.769755 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e902288-e069-4d67-9804-2a58970a96c0 could not be found. Jul 31 01:17:38.769755 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:38.769755 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6b6dd088-d363-47be-aa16-ef3f70e85532 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Returning 404 to user: Instance 4e902288-e069-4d67-9804-2a58970a96c0 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:17:38.769755 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6b6dd088-d363-47be-aa16-ef3f70e85532 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0" status: 404 len: 111 microversion: 2.1 time: 0.187536 Jul 31 01:17:38.774978 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1197/2378] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:38 2022] GET /compute/v2.1/servers/4e902288-e069-4d67-9804-2a58970a96c0 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:17:38.787993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-db072ecb-9cf1-4fba-bfdf-b4f91faa70dc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:38.802309 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-db072ecb-9cf1-4fba-bfdf-b4f91faa70dc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:38.833584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db072ecb-9cf1-4fba-bfdf-b4f91faa70dc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:38.839294 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db072ecb-9cf1-4fba-bfdf-b4f91faa70dc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:38.842713 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db072ecb-9cf1-4fba-bfdf-b4f91faa70dc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:38.848916 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db072ecb-9cf1-4fba-bfdf-b4f91faa70dc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:39.050216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-309bd0d4-f75c-4b2e-bb00-18e51b4a23b5 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb608462e3a45f69f9056550f16d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2101da474ab040c7a0b921a282f220cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:39.063693 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-309bd0d4-f75c-4b2e-bb00-18e51b4a23b5 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 200 len: 1466 microversion: 2.1 time: 0.576573 Jul 31 01:17:39.064456 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1182/2379] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:38 2022] GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 1466 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:39.073863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5873fe23-e10a-4618-9994-ed9172d87744 tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Action: 'update', calling method: .version_select at 0x7fede5c2bca0>, body: {"quota_set": {"ram": 0}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:39.089631 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5873fe23-e10a-4618-9994-ed9172d87744 tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'c6c7f405ccea42b989d85a7c2455241a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383b5e065b9345d1a88c895380b52b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5873fe23-e10a-4618-9994-ed9172d87744 tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Request method failure captured: Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: request: PUT /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a HTTP/1.1 Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 25 Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dgSYQp_vvNezRElgKJ94nu5b1Z3kIDv2N7c5nnYjTwffNnqkos6aYF8stQ0VfwdaEIJVuUMDaKHi5nM7JF_gcYfUgLy2a21gS-FrJkhypAUpjFvQR1zeY-uZm3u2n3jnxtGA6nQZ5vyzJkuPgFcCfdfu6WQpTA5jxU-TIAVVyN_zmw Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 383b5e065b9345d1a88c895380b52b7a Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-QuotasAdminNegativeTest-944703133 Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/383b5e065b9345d1a88c895380b52b7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/383b5e065b9345d1a88c895380b52b7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/383b5e065b9345d1a88c895380b52b7a"}]}, {"type": "tempest-type-637456412", "name": "tempest-service-212884429", "endpoints": [{"region": "tempest-region-1925257104", "publicURL": "https://url-1996201411.com"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "tempest-type-226696235", "name": "tempest-service-1156080264", "endpoints": [{"region": "tempest-region-874058038", "internalURL": "https://url-77151237.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_383b5e065b9345d1a88c895380b52b7a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-QuotasAdminNegativeTest-944703133 Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 383b5e065b9345d1a88c895380b52b7a Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-944703133 Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-QuotasAdminNegativeTest-944703133-project Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: c6c7f405ccea42b989d85a7c2455241a Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-QuotasAdminNegativeTest-944703133-project Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: {"quota_set": {"ram": 0}} Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '383b5e065b9345d1a88c895380b52b7a', 'body': {'quota_set': {'ram': 0}}} Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:17:39.099954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 31 01:17:39.105704 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:39.109457 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5873fe23-e10a-4618-9994-ed9172d87744 tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:17:39.110709 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5873fe23-e10a-4618-9994-ed9172d87744 tempest-QuotasAdminNegativeTest-944703133 tempest-QuotasAdminNegativeTest-944703133-project] 10.222.0.45 "PUT /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a" status: 403 len: 116 microversion: 2.1 time: 0.044078 Jul 31 01:17:39.112097 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1183/2380] 10.222.0.45 () {60 vars in 1262 bytes} [Sun Jul 31 01:17:39 2022] PUT /compute/v2.1/os-quota-sets/383b5e065b9345d1a88c895380b52b7a => generated 116 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:17:39.136589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1121bdf5-e6a4-423a-8a6b-0fba9196a942 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:39.143297 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1121bdf5-e6a4-423a-8a6b-0fba9196a942 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 2bc94263-b6c3-4954-95b3-345029530b02] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:39.207662 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1121bdf5-e6a4-423a-8a6b-0fba9196a942 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:39.210723 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1121bdf5-e6a4-423a-8a6b-0fba9196a942 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:39.212688 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1121bdf5-e6a4-423a-8a6b-0fba9196a942 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:39.213700 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1121bdf5-e6a4-423a-8a6b-0fba9196a942 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:39.285219 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1121bdf5-e6a4-423a-8a6b-0fba9196a942 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 2bc94263-b6c3-4954-95b3-345029530b02] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:17:39.555451 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1121bdf5-e6a4-423a-8a6b-0fba9196a942 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2bc94263-b6c3-4954-95b3-345029530b02" status: 204 len: 0 microversion: 2.1 time: 0.434143 Jul 31 01:17:39.556765 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1184/2381] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:17:39 2022] DELETE /compute/v2.1/servers/2bc94263-b6c3-4954-95b3-345029530b02 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:17:39.588874 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-da43419a-1c73-4521-a858-7de3d45db8d6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-32496287", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:39.648204 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-db072ecb-9cf1-4fba-bfdf-b4f91faa70dc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:39.718558 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-db072ecb-9cf1-4fba-bfdf-b4f91faa70dc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:39.754278 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-db072ecb-9cf1-4fba-bfdf-b4f91faa70dc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:39.769466 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-db072ecb-9cf1-4fba-bfdf-b4f91faa70dc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 0.985329 Jul 31 01:17:39.780728 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1198/2382] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:38 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:39.820842 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4bc56617-7311-4ec2-8cf3-a7d9d6eec839 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fedea9b15e0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:42.069854 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4bc56617-7311-4ec2-8cf3-a7d9d6eec839 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "DELETE /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f" status: 204 len: 0 microversion: 2.1 time: 2.254391 Jul 31 01:17:42.071282 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1199/2383] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:39 2022] DELETE /compute/v2.1/images/53b175fc-4c09-4559-9b95-1f4ff6cba20f => generated 0 bytes in 2278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:17:42.084789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-55b3fddf-4603-4dc5-9a6d-aad2548170cb req-963519e6-ca22-480b-9597-1f3c173706d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf56656-f786-439a-8d92-a4365424d0d7", "name": "network-vif-plugged", "status": "completed", "tag": "f14a9b78-dba4-47d9-b73e-195b70df06a4"}, {"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-plugged", "status": "completed", "tag": "a49bdcce-53dd-4303-86cf-783aea87f084"}, {"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-plugged", "status": "completed", "tag": "125ddd94-e67d-4f25-a9da-1073d0016a4d"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:42.099805 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-da43419a-1c73-4521-a858-7de3d45db8d6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] validate_networks() for None {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:17:42.121654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-55b3fddf-4603-4dc5-9a6d-aad2548170cb req-963519e6-ca22-480b-9597-1f3c173706d0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:42.122624 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-55b3fddf-4603-4dc5-9a6d-aad2548170cb req-963519e6-ca22-480b-9597-1f3c173706d0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:42.165690 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-55b3fddf-4603-4dc5-9a6d-aad2548170cb req-963519e6-ca22-480b-9597-1f3c173706d0 service nova] Creating event network-vif-plugged:f14a9b78-dba4-47d9-b73e-195b70df06a4 for instance cdf56656-f786-439a-8d92-a4365424d0d7 on n-h2-master-1 Jul 31 01:17:42.175468 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-55b3fddf-4603-4dc5-9a6d-aad2548170cb req-963519e6-ca22-480b-9597-1f3c173706d0 service nova] Creating event network-vif-plugged:a49bdcce-53dd-4303-86cf-783aea87f084 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:17:42.178752 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-55b3fddf-4603-4dc5-9a6d-aad2548170cb req-963519e6-ca22-480b-9597-1f3c173706d0 service nova] Creating event network-vif-plugged:125ddd94-e67d-4f25-a9da-1073d0016a4d for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:17:42.216492 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-55b3fddf-4603-4dc5-9a6d-aad2548170cb req-963519e6-ca22-480b-9597-1f3c173706d0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.142888 Jul 31 01:17:42.219126 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1200/2384] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:42.241758 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-089842a9-90b0-4512-8248-8f64fb9bebd2 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedea9b1b80>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:42.391976 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-089842a9-90b0-4512-8248-8f64fb9bebd2 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb" status: 200 len: 1455 microversion: 2.1 time: 0.168734 Jul 31 01:17:42.392398 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1201/2385] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:42 2022] GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb => generated 1455 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:42.410684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d22e5b91-0c1b-463a-8ff8-4a2ae6286a47 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:42.412884 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d22e5b91-0c1b-463a-8ff8-4a2ae6286a47 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 2bc94263-b6c3-4954-95b3-345029530b02] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:42.445195 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d22e5b91-0c1b-463a-8ff8-4a2ae6286a47 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:42.450828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d22e5b91-0c1b-463a-8ff8-4a2ae6286a47 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:42.454180 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d22e5b91-0c1b-463a-8ff8-4a2ae6286a47 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:42.454888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d22e5b91-0c1b-463a-8ff8-4a2ae6286a47 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:43.902204 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d22e5b91-0c1b-463a-8ff8-4a2ae6286a47 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:43.910462 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d22e5b91-0c1b-463a-8ff8-4a2ae6286a47 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/2bc94263-b6c3-4954-95b3-345029530b02" status: 200 len: 1517 microversion: 2.1 time: 1.516747 Jul 31 01:17:43.923264 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1202/2386] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:42 2022] GET /compute/v2.1/servers/2bc94263-b6c3-4954-95b3-345029530b02 => generated 1517 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:43.947037 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7c73d22a-aecd-4148-abe0-480fea245bf7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:43.953150 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7c73d22a-aecd-4148-abe0-480fea245bf7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:43.970617 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c73d22a-aecd-4148-abe0-480fea245bf7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:43.971890 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c73d22a-aecd-4148-abe0-480fea245bf7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:43.973503 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c73d22a-aecd-4148-abe0-480fea245bf7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:43.976217 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c73d22a-aecd-4148-abe0-480fea245bf7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:44.019419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-da43419a-1c73-4521-a858-7de3d45db8d6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:17:44.020473 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-da43419a-1c73-4521-a858-7de3d45db8d6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:17:44.021678 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-da43419a-1c73-4521-a858-7de3d45db8d6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:17:44.022259 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-da43419a-1c73-4521-a858-7de3d45db8d6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:17:44.023072 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-da43419a-1c73-4521-a858-7de3d45db8d6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:17:44.056637 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da43419a-1c73-4521-a858-7de3d45db8d6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:44.069524 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da43419a-1c73-4521-a858-7de3d45db8d6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:44.070979 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da43419a-1c73-4521-a858-7de3d45db8d6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:44.074988 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da43419a-1c73-4521-a858-7de3d45db8d6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:44.151864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-da43419a-1c73-4521-a858-7de3d45db8d6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Getting quotas for project 43c36901e18a4507ae8a90557eb9abc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:17:44.165319 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-da43419a-1c73-4521-a858-7de3d45db8d6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Getting quotas for user 4157eca4624c444bb8b88bdb958dd8dc and project 43c36901e18a4507ae8a90557eb9abc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:17:44.189859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-da43419a-1c73-4521-a858-7de3d45db8d6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:17:44.194296 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-da43419a-1c73-4521-a858-7de3d45db8d6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:17:44.285329 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-da43419a-1c73-4521-a858-7de3d45db8d6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.724233 Jul 31 01:17:44.287313 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1185/2387] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:17:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 4730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:17:44.302628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-da73e42a-d0d6-44c0-b0c6-25f4c2638fbb tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '.version_select at 0x7fede55d8430>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:44.408228 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-da73e42a-d0d6-44c0-b0c6-25f4c2638fbb tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] HTTP exception thrown: Image not found. Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-da73e42a-d0d6-44c0-b0c6-25f4c2638fbb tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Request method failure captured: Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe HTTP/1.1 Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dfV4dSmqv7wfpWNzgtmU0EfF7nr2UxY2t927oUtn5wfdNyGvJfF7pNfaQiCENqwBuqsvDg01l4x46VD1Eu88uexre25eyN7BZrWZrY3Mwz1K93O5CHTaYo_IijkGYix9yXLJ72zsC5fvSrjGcQ2xYjraMJ-kphCrygyVwZq0T6E5Yw Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2101da474ab040c7a0b921a282f220cf Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesOneServerTestJSON-526373175 Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2101da474ab040c7a0b921a282f220cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2101da474ab040c7a0b921a282f220cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2101da474ab040c7a0b921a282f220cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2101da474ab040c7a0b921a282f220cf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesOneServerTestJSON-526373175 Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2101da474ab040c7a0b921a282f220cf Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-526373175 Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesOneServerTestJSON-526373175-project Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 5cb608462e3a45f69f9056550f16d869 Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesOneServerTestJSON-526373175-project Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: exception: Image not found. Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '48835478-388d-4572-9fa7-a1b15a6148fe'} Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 48835478-388d-4572-9fa7-a1b15a6148fe to delete Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 48835478-388d-4572-9fa7-a1b15a6148fe could not be found. Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:44.411909 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:17:44.417057 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:17:44.420309 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-da73e42a-d0d6-44c0-b0c6-25f4c2638fbb tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Returning 404 to user: Image not found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:17:44.421439 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-da73e42a-d0d6-44c0-b0c6-25f4c2638fbb tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "DELETE /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe" status: 404 len: 62 microversion: 2.1 time: 0.131883 Jul 31 01:17:44.422166 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1186/2388] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:44 2022] DELETE /compute/v2.1/images/48835478-388d-4572-9fa7-a1b15a6148fe => generated 62 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:17:44.429343 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5a6d88e6-e1fc-4e9d-aa80-f577193aa10a tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede5994430>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:44.592386 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5a6d88e6-e1fc-4e9d-aa80-f577193aa10a tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb" status: 200 len: 1455 microversion: 2.1 time: 0.168828 Jul 31 01:17:44.593076 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1187/2389] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:44 2022] GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb => generated 1455 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:44.616503 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-15f96902-7c18-40f5-9a13-28aae80712bd req-8eaebf06-d7fa-47de-ac9a-8801a9b3abe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bc94263-b6c3-4954-95b3-345029530b02", "name": "network-vif-deleted", "tag": "880daa84-d784-47a1-a8ef-1ddd63cf3602"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:44.653605 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-15f96902-7c18-40f5-9a13-28aae80712bd req-8eaebf06-d7fa-47de-ac9a-8801a9b3abe9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:44.657707 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-15f96902-7c18-40f5-9a13-28aae80712bd req-8eaebf06-d7fa-47de-ac9a-8801a9b3abe9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:44.712001 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-15f96902-7c18-40f5-9a13-28aae80712bd req-8eaebf06-d7fa-47de-ac9a-8801a9b3abe9 service nova] Creating event network-vif-deleted:880daa84-d784-47a1-a8ef-1ddd63cf3602 for instance 2bc94263-b6c3-4954-95b3-345029530b02 on n-h1-master-1 Jul 31 01:17:44.746834 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-15f96902-7c18-40f5-9a13-28aae80712bd req-8eaebf06-d7fa-47de-ac9a-8801a9b3abe9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146214 Jul 31 01:17:44.748761 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1188/2390] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:44.784806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fcd3dd3c-403f-4409-beb3-8bdddabd67c0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:44.785560 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fcd3dd3c-403f-4409-beb3-8bdddabd67c0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:45.190817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fcd3dd3c-403f-4409-beb3-8bdddabd67c0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:45.203360 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fcd3dd3c-403f-4409-beb3-8bdddabd67c0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 200 len: 1212 microversion: 2.1 time: 0.446922 Jul 31 01:17:45.210407 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1189/2391] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:44 2022] GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 1212 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:45.242641 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-020346dc-9ebb-4d6e-87ad-d560c9ffcb26 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:45.243249 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-020346dc-9ebb-4d6e-87ad-d560c9ffcb26 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:45.263445 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-020346dc-9ebb-4d6e-87ad-d560c9ffcb26 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:45.274200 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-020346dc-9ebb-4d6e-87ad-d560c9ffcb26 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:45.278091 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-020346dc-9ebb-4d6e-87ad-d560c9ffcb26 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:45.278768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-020346dc-9ebb-4d6e-87ad-d560c9ffcb26 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:45.345639 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7c73d22a-aecd-4148-abe0-480fea245bf7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:45.373703 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-020346dc-9ebb-4d6e-87ad-d560c9ffcb26 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:17:45.374630 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7c73d22a-aecd-4148-abe0-480fea245bf7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:45.385760 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7c73d22a-aecd-4148-abe0-480fea245bf7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:45.388636 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7c73d22a-aecd-4148-abe0-480fea245bf7 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 1.463919 Jul 31 01:17:45.395325 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1203/2392] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:43 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:45.403703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-81df88b2-9dca-4cf9-9bf9-deb526fe3619 req-df546bb1-5709-471d-8ba3-ca3658f383db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0005650d-9c5d-49ff-bae8-1f9efe4322f5", "name": "network-vif-unplugged", "status": "completed", "tag": "2b6d29d2-1181-470a-9af3-c5ffa1afc021"}, {"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-plugged", "status": "completed", "tag": "3b5d94b7-0fe7-467f-9eff-92e830a3cf3d"}, {"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-plugged", "status": "completed", "tag": "22b1cf82-6093-47ed-8f73-4e9ef9d96cd1"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:45.458861 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-81df88b2-9dca-4cf9-9bf9-deb526fe3619 req-df546bb1-5709-471d-8ba3-ca3658f383db service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:45.469752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-81df88b2-9dca-4cf9-9bf9-deb526fe3619 req-df546bb1-5709-471d-8ba3-ca3658f383db service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:45.544313 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-81df88b2-9dca-4cf9-9bf9-deb526fe3619 req-df546bb1-5709-471d-8ba3-ca3658f383db service nova] Creating event network-vif-unplugged:2b6d29d2-1181-470a-9af3-c5ffa1afc021 for instance 0005650d-9c5d-49ff-bae8-1f9efe4322f5 on n-h2-master-1 Jul 31 01:17:45.545375 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-81df88b2-9dca-4cf9-9bf9-deb526fe3619 req-df546bb1-5709-471d-8ba3-ca3658f383db service nova] Creating event network-vif-plugged:3b5d94b7-0fe7-467f-9eff-92e830a3cf3d for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:17:45.548728 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-81df88b2-9dca-4cf9-9bf9-deb526fe3619 req-df546bb1-5709-471d-8ba3-ca3658f383db service nova] Creating event network-vif-plugged:22b1cf82-6093-47ed-8f73-4e9ef9d96cd1 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:17:45.585792 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-81df88b2-9dca-4cf9-9bf9-deb526fe3619 req-df546bb1-5709-471d-8ba3-ca3658f383db service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.182511 Jul 31 01:17:45.587029 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1204/2393] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:45.603374 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-043d3a33-e115-4954-a915-299f02eece31 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:45.606332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-043d3a33-e115-4954-a915-299f02eece31 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: 2bc94263-b6c3-4954-95b3-345029530b02] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:45.628298 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-043d3a33-e115-4954-a915-299f02eece31 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:45.631690 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-043d3a33-e115-4954-a915-299f02eece31 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:45.634456 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-043d3a33-e115-4954-a915-299f02eece31 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:45.636029 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-043d3a33-e115-4954-a915-299f02eece31 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:45.640141 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-020346dc-9ebb-4d6e-87ad-d560c9ffcb26 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 204 len: 0 microversion: 2.1 time: 0.402374 Jul 31 01:17:45.645709 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1190/2394] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:17:45 2022] DELETE /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:17:45.681137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-40571424-b431-4406-878d-8644f37aa139 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede59a7dc0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:45.685737 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-043d3a33-e115-4954-a915-299f02eece31 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] HTTP exception thrown: Instance 2bc94263-b6c3-4954-95b3-345029530b02 could not be found. Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-043d3a33-e115-4954-a915-299f02eece31 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Request method failure captured: Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/2bc94263-b6c3-4954-95b3-345029530b02 HTTP/1.1 Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dfKFOVp5TofmrO6CXNVhnRKGtQ-0xDO2sBSXr8w9ILqhzWEnu6H2iaCDY5li3X7n0axWXg4vWDd4IDQeJgP0AWN4kubfY9Or0gzrazacaSYIEJIBra41XpjbV7885ypwuFGn1I2YB4P2EE1EwqZabFajpCglCuQdc1Ggzywv9i3ghQ Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a14ae0c0cc7d4657acb725838ca0325a Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ListServerFiltersTestJSON-1159454571 Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a14ae0c0cc7d4657acb725838ca0325a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a14ae0c0cc7d4657acb725838ca0325a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a14ae0c0cc7d4657acb725838ca0325a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a14ae0c0cc7d4657acb725838ca0325a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ListServerFiltersTestJSON-1159454571 Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a14ae0c0cc7d4657acb725838ca0325a Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1159454571 Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ListServerFiltersTestJSON-1159454571-project Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: cdce34f77f644220998e5deba40c6421 Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ListServerFiltersTestJSON-1159454571-project Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 2bc94263-b6c3-4954-95b3-345029530b02 could not be found. Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '2bc94263-b6c3-4954-95b3-345029530b02'} Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bc94263-b6c3-4954-95b3-345029530b02 could not be found. Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bc94263-b6c3-4954-95b3-345029530b02 could not be found. Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:45.690713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:45.695361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:45.695361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:45.695361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:45.695361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:17:45.695361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:17:45.695361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bc94263-b6c3-4954-95b3-345029530b02 could not be found. Jul 31 01:17:45.695361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:45.701215 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-043d3a33-e115-4954-a915-299f02eece31 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Returning 404 to user: Instance 2bc94263-b6c3-4954-95b3-345029530b02 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:17:45.701215 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-043d3a33-e115-4954-a915-299f02eece31 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/2bc94263-b6c3-4954-95b3-345029530b02" status: 404 len: 111 microversion: 2.1 time: 0.108984 Jul 31 01:17:45.702182 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1205/2395] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:45 2022] GET /compute/v2.1/servers/2bc94263-b6c3-4954-95b3-345029530b02 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:17:45.718297 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-60afaf18-2997-4027-b135-84be9ef8beb9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:45.721716 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-60afaf18-2997-4027-b135-84be9ef8beb9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:45.741923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-60afaf18-2997-4027-b135-84be9ef8beb9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:45.744124 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-60afaf18-2997-4027-b135-84be9ef8beb9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:45.745207 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-60afaf18-2997-4027-b135-84be9ef8beb9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:45.747397 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-60afaf18-2997-4027-b135-84be9ef8beb9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:45.845906 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-40571424-b431-4406-878d-8644f37aa139 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb" status: 200 len: 1455 microversion: 2.1 time: 0.195375 Jul 31 01:17:45.855453 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1191/2396] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:45 2022] GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb => generated 1455 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:45.868692 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2d97a8f7-2230-411d-b8d7-f3fc58a0e0af tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:45.869396 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2d97a8f7-2230-411d-b8d7-f3fc58a0e0af tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:45.900593 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d97a8f7-2230-411d-b8d7-f3fc58a0e0af tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:45.901350 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d97a8f7-2230-411d-b8d7-f3fc58a0e0af tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:45.902706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d97a8f7-2230-411d-b8d7-f3fc58a0e0af tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:45.929114 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d97a8f7-2230-411d-b8d7-f3fc58a0e0af tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:46.095654 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2d97a8f7-2230-411d-b8d7-f3fc58a0e0af tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:17:46.409043 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2d97a8f7-2230-411d-b8d7-f3fc58a0e0af tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 204 len: 0 microversion: 2.1 time: 0.547777 Jul 31 01:17:46.409043 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1192/2397] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:17:45 2022] DELETE /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 0 bytes in 549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:17:46.421940 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0a81d09f-8048-49e7-b072-52af05f4a0ef tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:46.448182 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0a81d09f-8048-49e7-b072-52af05f4a0ef tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:46.485233 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a81d09f-8048-49e7-b072-52af05f4a0ef tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:46.485696 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a81d09f-8048-49e7-b072-52af05f4a0ef tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:46.498796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a81d09f-8048-49e7-b072-52af05f4a0ef tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:46.499263 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a81d09f-8048-49e7-b072-52af05f4a0ef tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:46.556608 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-60afaf18-2997-4027-b135-84be9ef8beb9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb608462e3a45f69f9056550f16d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2101da474ab040c7a0b921a282f220cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:46.574213 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-60afaf18-2997-4027-b135-84be9ef8beb9 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 200 len: 1472 microversion: 2.1 time: 0.864298 Jul 31 01:17:46.575179 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1206/2398] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:45 2022] GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 1472 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:46.596064 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-31a9d093-b1ad-4c28-8b03-d1e9d8f67557 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:46.605843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-31a9d093-b1ad-4c28-8b03-d1e9d8f67557 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:46.638790 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31a9d093-b1ad-4c28-8b03-d1e9d8f67557 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:46.639266 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31a9d093-b1ad-4c28-8b03-d1e9d8f67557 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:46.640170 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31a9d093-b1ad-4c28-8b03-d1e9d8f67557 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:46.651958 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31a9d093-b1ad-4c28-8b03-d1e9d8f67557 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:46.804815 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0a81d09f-8048-49e7-b072-52af05f4a0ef tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:46.837945 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0a81d09f-8048-49e7-b072-52af05f4a0ef tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 200 len: 1264 microversion: 2.1 time: 0.430984 Jul 31 01:17:46.843805 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1193/2399] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:46 2022] GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 1264 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:46.860274 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-92707cda-ad4f-4459-9aa0-1e1229470a9c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:46.861427 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-92707cda-ad4f-4459-9aa0-1e1229470a9c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:46.923217 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92707cda-ad4f-4459-9aa0-1e1229470a9c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:46.923835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92707cda-ad4f-4459-9aa0-1e1229470a9c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:46.930862 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92707cda-ad4f-4459-9aa0-1e1229470a9c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:46.935919 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92707cda-ad4f-4459-9aa0-1e1229470a9c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:48.123068 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-31a9d093-b1ad-4c28-8b03-d1e9d8f67557 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:48.149405 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-31a9d093-b1ad-4c28-8b03-d1e9d8f67557 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1516 microversion: 2.1 time: 1.568164 Jul 31 01:17:48.150420 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1207/2400] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:46 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1516 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:48.170199 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e9d1c017-efea-4a14-a79d-7cb1127d7457 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede5a884c0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:48.305612 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e9d1c017-efea-4a14-a79d-7cb1127d7457 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb" status: 200 len: 1455 microversion: 2.1 time: 0.153116 Jul 31 01:17:48.311780 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1208/2401] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:48 2022] GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:48.328070 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e71103a5-a798-4330-b3c0-b5025bf6ab50 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:48.332847 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e71103a5-a798-4330-b3c0-b5025bf6ab50 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:48.358351 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e71103a5-a798-4330-b3c0-b5025bf6ab50 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:48.372631 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e71103a5-a798-4330-b3c0-b5025bf6ab50 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:48.374537 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e71103a5-a798-4330-b3c0-b5025bf6ab50 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:48.375701 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e71103a5-a798-4330-b3c0-b5025bf6ab50 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:48.449690 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=12 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:48.470769 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-92707cda-ad4f-4459-9aa0-1e1229470a9c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:48.480880 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=5 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:48.531620 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-92707cda-ad4f-4459-9aa0-1e1229470a9c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:48.540248 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-92707cda-ad4f-4459-9aa0-1e1229470a9c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:48.554593 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-92707cda-ad4f-4459-9aa0-1e1229470a9c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 1.708523 Jul 31 01:17:48.561464 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1194/2402] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:46 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:49.394665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ad2264da-59d3-4848-96d3-d21530b14a91 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] Action: 'create', calling method: .version_select at 0x7fede588f9d0>, body: {"pool": null} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:49.725258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e71103a5-a798-4330-b3c0-b5025bf6ab50 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb608462e3a45f69f9056550f16d869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2101da474ab040c7a0b921a282f220cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:49.738082 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e71103a5-a798-4330-b3c0-b5025bf6ab50 tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 200 len: 1472 microversion: 2.1 time: 1.424445 Jul 31 01:17:49.753768 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1209/2403] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:48 2022] GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 1472 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:49.760661 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-9cd30625-9511-4ee8-902a-cadc6bbe6c72 req-04514f67-3184-419a-8ba3-448fb918ad7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-plugged", "status": "completed", "tag": "de3ca179-e6db-401d-ac3c-cb604c404e59"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:49.773635 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9cd30625-9511-4ee8-902a-cadc6bbe6c72 req-04514f67-3184-419a-8ba3-448fb918ad7e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:49.774347 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9cd30625-9511-4ee8-902a-cadc6bbe6c72 req-04514f67-3184-419a-8ba3-448fb918ad7e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:49.790239 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-9cd30625-9511-4ee8-902a-cadc6bbe6c72 req-04514f67-3184-419a-8ba3-448fb918ad7e service nova] Creating event network-vif-plugged:de3ca179-e6db-401d-ac3c-cb604c404e59 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:17:49.797732 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-9cd30625-9511-4ee8-902a-cadc6bbe6c72 req-04514f67-3184-419a-8ba3-448fb918ad7e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041724 Jul 31 01:17:49.798840 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1210/2404] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:49.806239 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b08d3157-d2a2-434e-a14a-26ad40de2e15 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:49.807393 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b08d3157-d2a2-434e-a14a-26ad40de2e15 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:49.816307 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b08d3157-d2a2-434e-a14a-26ad40de2e15 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:49.817719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b08d3157-d2a2-434e-a14a-26ad40de2e15 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:49.819096 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b08d3157-d2a2-434e-a14a-26ad40de2e15 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:49.819833 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b08d3157-d2a2-434e-a14a-26ad40de2e15 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:50.153094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b08d3157-d2a2-434e-a14a-26ad40de2e15 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:50.167662 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b08d3157-d2a2-434e-a14a-26ad40de2e15 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 200 len: 1270 microversion: 2.1 time: 0.367182 Jul 31 01:17:50.175284 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1211/2405] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:49 2022] GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 1270 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:50.208270 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e4c932b1-9ede-43c5-81b7-af9ca99e9a72 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:50.211218 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e4c932b1-9ede-43c5-81b7-af9ca99e9a72 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:50.267453 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4c932b1-9ede-43c5-81b7-af9ca99e9a72 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:50.278430 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4c932b1-9ede-43c5-81b7-af9ca99e9a72 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:50.279966 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4c932b1-9ede-43c5-81b7-af9ca99e9a72 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:50.280709 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4c932b1-9ede-43c5-81b7-af9ca99e9a72 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:50.945000 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e4c932b1-9ede-43c5-81b7-af9ca99e9a72 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdce34f77f644220998e5deba40c6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14ae0c0cc7d4657acb725838ca0325a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:50.959701 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e4c932b1-9ede-43c5-81b7-af9ca99e9a72 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 200 len: 1516 microversion: 2.1 time: 0.777203 Jul 31 01:17:50.968234 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1212/2406] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:50 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 1516 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:50.984641 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-69791f24-1b77-4199-8727-1e37d9b360bd tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedea9b19d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:51.212304 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-69791f24-1b77-4199-8727-1e37d9b360bd tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb" status: 200 len: 1455 microversion: 2.1 time: 0.241764 Jul 31 01:17:51.228663 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1213/2407] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:50 2022] GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb => generated 1455 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:51.249888 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5d601a65-cc29-4657-8add-b51276a604ef tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:51.251515 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5d601a65-cc29-4657-8add-b51276a604ef tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:51.270846 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d601a65-cc29-4657-8add-b51276a604ef tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:51.272210 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d601a65-cc29-4657-8add-b51276a604ef tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:51.277027 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d601a65-cc29-4657-8add-b51276a604ef tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:51.277843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d601a65-cc29-4657-8add-b51276a604ef tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:52.413785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5d601a65-cc29-4657-8add-b51276a604ef tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:52.445927 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5d601a65-cc29-4657-8add-b51276a604ef tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:52.460631 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5d601a65-cc29-4657-8add-b51276a604ef tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:52.465303 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5d601a65-cc29-4657-8add-b51276a604ef tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 1.230880 Jul 31 01:17:52.466739 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1214/2408] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:51 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:52.794683 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7ae6f3cf-b6a1-43ca-a3e2-57e35da71207 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1739423625", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:52.986970 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-7ae6f3cf-b6a1-43ca-a3e2-57e35da71207 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:17:53.461779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7ae6f3cf-b6a1-43ca-a3e2-57e35da71207 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:17:53.470759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7ae6f3cf-b6a1-43ca-a3e2-57e35da71207 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:17:53.471986 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7ae6f3cf-b6a1-43ca-a3e2-57e35da71207 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:17:53.472906 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7ae6f3cf-b6a1-43ca-a3e2-57e35da71207 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:17:53.474274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7ae6f3cf-b6a1-43ca-a3e2-57e35da71207 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:17:53.501479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ae6f3cf-b6a1-43ca-a3e2-57e35da71207 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:53.505166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ae6f3cf-b6a1-43ca-a3e2-57e35da71207 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:53.506810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ae6f3cf-b6a1-43ca-a3e2-57e35da71207 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:53.507996 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ae6f3cf-b6a1-43ca-a3e2-57e35da71207 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:53.545350 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7ae6f3cf-b6a1-43ca-a3e2-57e35da71207 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Getting quotas for project 64cd99ab55534716b181e34f17442c7f. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:17:53.555200 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7ae6f3cf-b6a1-43ca-a3e2-57e35da71207 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Getting quotas for user ab2074f35abf4032ab99ec20f3afc57e and project 64cd99ab55534716b181e34f17442c7f. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:17:53.581654 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7ae6f3cf-b6a1-43ca-a3e2-57e35da71207 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:17:53.584357 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7ae6f3cf-b6a1-43ca-a3e2-57e35da71207 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:17:53.680097 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7ae6f3cf-b6a1-43ca-a3e2-57e35da71207 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.209970 Jul 31 01:17:53.689273 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1215/2409] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:17:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:17:53.711592 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ae4172ed-169f-44f7-b396-1cf3a22c0fcc tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:53.712998 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ae4172ed-169f-44f7-b396-1cf3a22c0fcc tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] [instance: 0005650d-9c5d-49ff-bae8-1f9efe4322f5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:53.746810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae4172ed-169f-44f7-b396-1cf3a22c0fcc tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:53.752174 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae4172ed-169f-44f7-b396-1cf3a22c0fcc tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:53.761178 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae4172ed-169f-44f7-b396-1cf3a22c0fcc tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:53.766777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae4172ed-169f-44f7-b396-1cf3a22c0fcc tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:53.819443 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-ae4172ed-169f-44f7-b396-1cf3a22c0fcc tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] HTTP exception thrown: Instance 0005650d-9c5d-49ff-bae8-1f9efe4322f5 could not be found. Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ae4172ed-169f-44f7-b396-1cf3a22c0fcc tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Request method failure captured: Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 HTTP/1.1 Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dfV4dSmqv7wfpWNzgtmU0EfF7nr2UxY2t927oUtn5wfdNyGvJfF7pNfaQiCENqwBuqsvDg01l4x46VD1Eu88uexre25eyN7BZrWZrY3Mwz1K93O5CHTaYo_IijkGYix9yXLJ72zsC5fvSrjGcQ2xYjraMJ-kphCrygyVwZq0T6E5Yw Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2101da474ab040c7a0b921a282f220cf Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesOneServerTestJSON-526373175 Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2101da474ab040c7a0b921a282f220cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2101da474ab040c7a0b921a282f220cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2101da474ab040c7a0b921a282f220cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2101da474ab040c7a0b921a282f220cf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesOneServerTestJSON-526373175 Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2101da474ab040c7a0b921a282f220cf Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-526373175 Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesOneServerTestJSON-526373175-project Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 5cb608462e3a45f69f9056550f16d869 Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesOneServerTestJSON-526373175-project Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 0005650d-9c5d-49ff-bae8-1f9efe4322f5 could not be found. Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '0005650d-9c5d-49ff-bae8-1f9efe4322f5'} Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0005650d-9c5d-49ff-bae8-1f9efe4322f5 could not be found. Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0005650d-9c5d-49ff-bae8-1f9efe4322f5 could not be found. Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:53.822716 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:53.838286 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:53.838286 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:53.838286 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:53.838286 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:17:53.838286 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:17:53.838286 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0005650d-9c5d-49ff-bae8-1f9efe4322f5 could not be found. Jul 31 01:17:53.838286 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:53.838286 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ae4172ed-169f-44f7-b396-1cf3a22c0fcc tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] Returning 404 to user: Instance 0005650d-9c5d-49ff-bae8-1f9efe4322f5 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:17:53.838286 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ae4172ed-169f-44f7-b396-1cf3a22c0fcc tempest-ImagesOneServerTestJSON-526373175 tempest-ImagesOneServerTestJSON-526373175-project] 10.222.0.45 "GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5" status: 404 len: 111 microversion: 2.1 time: 0.134202 Jul 31 01:17:53.838286 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1216/2410] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:53 2022] GET /compute/v2.1/servers/0005650d-9c5d-49ff-bae8-1f9efe4322f5 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:17:53.853464 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-b68aa1b1-397c-4b04-9dba-71610412d25a req-3ad21467-a519-44ac-b81f-a7e14dd90fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41f3bd8-298a-48ec-a3da-8e6bc5c459ea", "name": "network-vif-deleted", "tag": "ebda67a3-3819-43d1-a74f-77f6d46add98"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:53.903958 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b68aa1b1-397c-4b04-9dba-71610412d25a req-3ad21467-a519-44ac-b81f-a7e14dd90fa0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:53.907720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b68aa1b1-397c-4b04-9dba-71610412d25a req-3ad21467-a519-44ac-b81f-a7e14dd90fa0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:53.970779 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-b68aa1b1-397c-4b04-9dba-71610412d25a req-3ad21467-a519-44ac-b81f-a7e14dd90fa0 service nova] Creating event network-vif-deleted:ebda67a3-3819-43d1-a74f-77f6d46add98 for instance f41f3bd8-298a-48ec-a3da-8e6bc5c459ea on n-h2-master-1 Jul 31 01:17:54.012670 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-b68aa1b1-397c-4b04-9dba-71610412d25a req-3ad21467-a519-44ac-b81f-a7e14dd90fa0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169248 Jul 31 01:17:54.030107 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1217/2411] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:54.047047 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-859f936b-9bc1-4876-a5e5-c0254e2a3127 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:54.048970 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-859f936b-9bc1-4876-a5e5-c0254e2a3127 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:54.063574 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-859f936b-9bc1-4876-a5e5-c0254e2a3127 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:54.064683 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-859f936b-9bc1-4876-a5e5-c0254e2a3127 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:54.068848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-859f936b-9bc1-4876-a5e5-c0254e2a3127 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:54.070213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-859f936b-9bc1-4876-a5e5-c0254e2a3127 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:54.122627 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=5 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:55.159842 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-859f936b-9bc1-4876-a5e5-c0254e2a3127 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:55.163872 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:55.173402 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-859f936b-9bc1-4876-a5e5-c0254e2a3127 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 200 len: 1312 microversion: 2.1 time: 1.138632 Jul 31 01:17:55.180120 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1218/2412] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:54 2022] GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 1312 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:55.196587 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-8b019fc9-6f60-42c8-82f8-041a1410fd74 req-e431f751-936d-4a9c-bb68-f3f6c59f6322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f931f935-17a4-41ac-ac71-4ee21771219d", "tag": "5ecc4d11-f7de-41b8-bd4a-7e73d5c197fb"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:55.197080 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=32 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:55.240638 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8b019fc9-6f60-42c8-82f8-041a1410fd74 req-e431f751-936d-4a9c-bb68-f3f6c59f6322 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:55.243086 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8b019fc9-6f60-42c8-82f8-041a1410fd74 req-e431f751-936d-4a9c-bb68-f3f6c59f6322 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:55.271151 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-8b019fc9-6f60-42c8-82f8-041a1410fd74 req-e431f751-936d-4a9c-bb68-f3f6c59f6322 service nova] Creating event network-changed:5ecc4d11-f7de-41b8-bd4a-7e73d5c197fb for instance f931f935-17a4-41ac-ac71-4ee21771219d on n-h2-master-1 Jul 31 01:17:55.307891 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-8b019fc9-6f60-42c8-82f8-041a1410fd74 req-e431f751-936d-4a9c-bb68-f3f6c59f6322 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126148 Jul 31 01:17:55.312160 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1219/2413] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:55.338216 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-86b8183c-1b8b-4573-9342-114abd4abcc8 req-8abe27e2-a457-408b-afec-d68491956eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-plugged", "status": "completed", "tag": "993014ab-481c-4599-9cca-e1b1e9595978"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:55.376149 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-86b8183c-1b8b-4573-9342-114abd4abcc8 req-8abe27e2-a457-408b-afec-d68491956eb9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:55.376657 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-86b8183c-1b8b-4573-9342-114abd4abcc8 req-8abe27e2-a457-408b-afec-d68491956eb9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:55.423747 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-86b8183c-1b8b-4573-9342-114abd4abcc8 req-8abe27e2-a457-408b-afec-d68491956eb9 service nova] Creating event network-vif-plugged:993014ab-481c-4599-9cca-e1b1e9595978 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:17:55.461818 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-86b8183c-1b8b-4573-9342-114abd4abcc8 req-8abe27e2-a457-408b-afec-d68491956eb9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148028 Jul 31 01:17:55.468214 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1220/2414] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:55.487817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4162a548-2694-4936-9e1c-2174fc176854 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:55.488628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4162a548-2694-4936-9e1c-2174fc176854 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] [instance: f41f3bd8-298a-48ec-a3da-8e6bc5c459ea] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:55.529439 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4162a548-2694-4936-9e1c-2174fc176854 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:55.530175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4162a548-2694-4936-9e1c-2174fc176854 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:55.535942 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4162a548-2694-4936-9e1c-2174fc176854 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:55.537077 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4162a548-2694-4936-9e1c-2174fc176854 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:55.595560 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-4162a548-2694-4936-9e1c-2174fc176854 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] HTTP exception thrown: Instance f41f3bd8-298a-48ec-a3da-8e6bc5c459ea could not be found. Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4162a548-2694-4936-9e1c-2174fc176854 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Request method failure captured: Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea HTTP/1.1 Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dfKFOVp5TofmrO6CXNVhnRKGtQ-0xDO2sBSXr8w9ILqhzWEnu6H2iaCDY5li3X7n0axWXg4vWDd4IDQeJgP0AWN4kubfY9Or0gzrazacaSYIEJIBra41XpjbV7885ypwuFGn1I2YB4P2EE1EwqZabFajpCglCuQdc1Ggzywv9i3ghQ Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a14ae0c0cc7d4657acb725838ca0325a Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ListServerFiltersTestJSON-1159454571 Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a14ae0c0cc7d4657acb725838ca0325a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a14ae0c0cc7d4657acb725838ca0325a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a14ae0c0cc7d4657acb725838ca0325a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a14ae0c0cc7d4657acb725838ca0325a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ListServerFiltersTestJSON-1159454571 Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a14ae0c0cc7d4657acb725838ca0325a Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1159454571 Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ListServerFiltersTestJSON-1159454571-project Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: cdce34f77f644220998e5deba40c6421 Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ListServerFiltersTestJSON-1159454571-project Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: exception: Instance f41f3bd8-298a-48ec-a3da-8e6bc5c459ea could not be found. Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'f41f3bd8-298a-48ec-a3da-8e6bc5c459ea'} Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f41f3bd8-298a-48ec-a3da-8e6bc5c459ea could not be found. Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f41f3bd8-298a-48ec-a3da-8e6bc5c459ea could not be found. Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:55.608946 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:55.615035 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:55.615035 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:55.615035 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:55.615035 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:17:55.615035 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:17:55.615035 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f41f3bd8-298a-48ec-a3da-8e6bc5c459ea could not be found. Jul 31 01:17:55.615035 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:55.621331 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4162a548-2694-4936-9e1c-2174fc176854 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] Returning 404 to user: Instance f41f3bd8-298a-48ec-a3da-8e6bc5c459ea could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:17:55.622624 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4162a548-2694-4936-9e1c-2174fc176854 tempest-ListServerFiltersTestJSON-1159454571 tempest-ListServerFiltersTestJSON-1159454571-project] 10.222.0.45 "GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea" status: 404 len: 111 microversion: 2.1 time: 0.152853 Jul 31 01:17:55.624530 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1221/2415] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:55 2022] GET /compute/v2.1/servers/f41f3bd8-298a-48ec-a3da-8e6bc5c459ea => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:17:55.644318 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cd02cce2-81e6-4ab2-b17a-80536223ea69 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede491f9d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:55.784060 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cd02cce2-81e6-4ab2-b17a-80536223ea69 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb" status: 200 len: 1455 microversion: 2.1 time: 0.158215 Jul 31 01:17:55.785401 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1222/2416] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:55 2022] GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:55.802438 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-91283277-e184-42e8-9580-18bf53a1bda2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:55.803654 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-91283277-e184-42e8-9580-18bf53a1bda2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:55.826097 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-91283277-e184-42e8-9580-18bf53a1bda2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:55.830705 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-91283277-e184-42e8-9580-18bf53a1bda2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:55.834690 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-91283277-e184-42e8-9580-18bf53a1bda2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:55.835358 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-91283277-e184-42e8-9580-18bf53a1bda2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:56.889487 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:57.390513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-91283277-e184-42e8-9580-18bf53a1bda2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:57.420207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-91283277-e184-42e8-9580-18bf53a1bda2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:57.422117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-91283277-e184-42e8-9580-18bf53a1bda2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:57.423517 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-91283277-e184-42e8-9580-18bf53a1bda2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1878 microversion: 2.32 time: 1.636132 Jul 31 01:17:57.424207 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1223/2417] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:55 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1878 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:57.444823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9194d7b2-96b9-48e6-a545-1404b312e893 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:57.445906 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9194d7b2-96b9-48e6-a545-1404b312e893 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:57.455136 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ad2264da-59d3-4848-96d3-d21530b14a91 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 8.891627 Jul 31 01:17:57.480233 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9194d7b2-96b9-48e6-a545-1404b312e893 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:57.487102 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9194d7b2-96b9-48e6-a545-1404b312e893 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:57.489605 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9194d7b2-96b9-48e6-a545-1404b312e893 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:57.491966 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1195/2418] 10.222.0.45 () {60 vars in 1170 bytes} [Sun Jul 31 01:17:48 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 8929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:57.495328 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9194d7b2-96b9-48e6-a545-1404b312e893 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:57.504268 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-13634630-51d6-4e19-a389-bc089292b068 req-22cb396a-f505-482d-a012-2a905e9b3c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0005650d-9c5d-49ff-bae8-1f9efe4322f5", "name": "network-vif-deleted", "tag": "2b6d29d2-1181-470a-9af3-c5ffa1afc021"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:57.633138 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-13634630-51d6-4e19-a389-bc089292b068 req-22cb396a-f505-482d-a012-2a905e9b3c63 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:57.633843 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-13634630-51d6-4e19-a389-bc089292b068 req-22cb396a-f505-482d-a012-2a905e9b3c63 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:57.682435 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-13634630-51d6-4e19-a389-bc089292b068 req-22cb396a-f505-482d-a012-2a905e9b3c63 service nova] Creating event network-vif-deleted:2b6d29d2-1181-470a-9af3-c5ffa1afc021 for instance 0005650d-9c5d-49ff-bae8-1f9efe4322f5 on n-h2-master-1 Jul 31 01:17:57.706356 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-13634630-51d6-4e19-a389-bc089292b068 req-22cb396a-f505-482d-a012-2a905e9b3c63 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212404 Jul 31 01:17:57.707016 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1196/2419] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:57.751037 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-88ac65c8-bc04-4fde-9843-35d8aa8ac449 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:57.754274 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-88ac65c8-bc04-4fde-9843-35d8aa8ac449 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:57.785898 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88ac65c8-bc04-4fde-9843-35d8aa8ac449 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:57.791176 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88ac65c8-bc04-4fde-9843-35d8aa8ac449 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:57.795076 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88ac65c8-bc04-4fde-9843-35d8aa8ac449 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:57.795681 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88ac65c8-bc04-4fde-9843-35d8aa8ac449 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:57.892894 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9194d7b2-96b9-48e6-a545-1404b312e893 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2074f35abf4032ab99ec20f3afc57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cd99ab55534716b181e34f17442c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:57.916165 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9194d7b2-96b9-48e6-a545-1404b312e893 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 200 len: 1272 microversion: 2.1 time: 0.482822 Jul 31 01:17:57.916926 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1224/2420] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:57 2022] GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 1272 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:57.922063 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0fd35829-a64f-48df-9f58-a895e56c290e tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede55f8310>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:57.992894 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0fd35829-a64f-48df-9f58-a895e56c290e tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb" status: 200 len: 1455 microversion: 2.1 time: 0.074620 Jul 31 01:17:57.993632 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1225/2421] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:57 2022] GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:58.310874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5f575182-9393-4597-8a02-c57701e3fb20 tempest-ListImageFiltersNegativeTestJSON-1300603100 tempest-ListImageFiltersNegativeTestJSON-1300603100-project] Calling method '.version_select at 0x7fede48e30d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:58.354942 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-5f575182-9393-4597-8a02-c57701e3fb20 tempest-ListImageFiltersNegativeTestJSON-1300603100 tempest-ListImageFiltersNegativeTestJSON-1300603100-project] HTTP exception thrown: Image not found. Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5f575182-9393-4597-8a02-c57701e3fb20 tempest-ListImageFiltersNegativeTestJSON-1300603100 tempest-ListImageFiltersNegativeTestJSON-1300603100-project] Request method failure captured: Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/images/1307b3aa-528d-4603-9dc4-2cd774a93f2e HTTP/1.1 Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dhFgkOajf8Pa6V4ur0f-CfRs5f6apnIeuq8KZmMw3LT1DGQvdxTSqUogh5q8hTb2gVJHLCcCdVX2DAHMwVvqhX4i1YxMJdhWfp_hgMOJKzURfNX8wbgDBpM_zHE72WrCUCbWQhpaUeAQ3N8RCy3q0PEpW_P_8dYhU2xk0uzFVS2mLg Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 3e7e9d88aaa74d868ce1c5e74089d3de Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1300603100 Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3e7e9d88aaa74d868ce1c5e74089d3de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3e7e9d88aaa74d868ce1c5e74089d3de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3e7e9d88aaa74d868ce1c5e74089d3de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3e7e9d88aaa74d868ce1c5e74089d3de", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1300603100 Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 3e7e9d88aaa74d868ce1c5e74089d3de Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1300603100 Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ListImageFiltersNegativeTestJSON-1300603100-project Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 112019d3d5ec4ab88739a111b67f286d Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1300603100-project Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: exception: Image not found. Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '1307b3aa-528d-4603-9dc4-2cd774a93f2e'} Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1307b3aa-528d-4603-9dc4-2cd774a93f2e Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 31 01:17:58.357692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1307b3aa-528d-4603-9dc4-2cd774a93f2e could not be found. Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:17:58.362382 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:17:58.368476 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5f575182-9393-4597-8a02-c57701e3fb20 tempest-ListImageFiltersNegativeTestJSON-1300603100 tempest-ListImageFiltersNegativeTestJSON-1300603100-project] Returning 404 to user: Image not found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:17:58.371383 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5f575182-9393-4597-8a02-c57701e3fb20 tempest-ListImageFiltersNegativeTestJSON-1300603100 tempest-ListImageFiltersNegativeTestJSON-1300603100-project] 10.222.0.45 "GET /compute/v2.1/images/1307b3aa-528d-4603-9dc4-2cd774a93f2e" status: 404 len: 62 microversion: 2.1 time: 0.375911 Jul 31 01:17:58.381397 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1226/2422] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:57 2022] GET /compute/v2.1/images/1307b3aa-528d-4603-9dc4-2cd774a93f2e => generated 62 bytes in 381 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:17:58.392535 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-679aef7f-1b0a-428e-bdc0-4f15b73869f3 req-d869dcb7-b412-47e3-a8b3-739fabba72ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c2fb1f-e2af-4b6e-a479-11c2fe101899", "tag": "c97f7a0b-c24e-4337-82f2-431b50cd2106"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:58.422946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-679aef7f-1b0a-428e-bdc0-4f15b73869f3 req-d869dcb7-b412-47e3-a8b3-739fabba72ba service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:58.424898 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-679aef7f-1b0a-428e-bdc0-4f15b73869f3 req-d869dcb7-b412-47e3-a8b3-739fabba72ba service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:58.455610 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-679aef7f-1b0a-428e-bdc0-4f15b73869f3 req-d869dcb7-b412-47e3-a8b3-739fabba72ba service nova] Creating event network-changed:c97f7a0b-c24e-4337-82f2-431b50cd2106 for instance 95c2fb1f-e2af-4b6e-a479-11c2fe101899 on n-h1-master-1 Jul 31 01:17:58.471803 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-679aef7f-1b0a-428e-bdc0-4f15b73869f3 req-d869dcb7-b412-47e3-a8b3-739fabba72ba service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088864 Jul 31 01:17:58.478090 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1227/2423] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:58.494853 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cf2902d9-e729-49ad-9c6e-3338a276f791 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] Calling method '.version_select at 0x7fedea94a310>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:58.638219 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-88ac65c8-bc04-4fde-9843-35d8aa8ac449 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:58.655013 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-88ac65c8-bc04-4fde-9843-35d8aa8ac449 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 200 len: 1312 microversion: 2.1 time: 0.946368 Jul 31 01:17:58.676104 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1197/2424] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:57 2022] GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 1312 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:58.693902 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e7b7c7db-4e56-4e0e-80d0-31001a671e52 req-26be9c2b-b1cd-4373-8fb8-b0bd7091fc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f931f935-17a4-41ac-ac71-4ee21771219d", "name": "network-vif-plugged", "status": "completed", "tag": "5ecc4d11-f7de-41b8-bd4a-7e73d5c197fb"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:17:58.703990 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e7b7c7db-4e56-4e0e-80d0-31001a671e52 req-26be9c2b-b1cd-4373-8fb8-b0bd7091fc07 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:58.715359 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e7b7c7db-4e56-4e0e-80d0-31001a671e52 req-26be9c2b-b1cd-4373-8fb8-b0bd7091fc07 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:58.751479 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e7b7c7db-4e56-4e0e-80d0-31001a671e52 req-26be9c2b-b1cd-4373-8fb8-b0bd7091fc07 service nova] Creating event network-vif-plugged:5ecc4d11-f7de-41b8-bd4a-7e73d5c197fb for instance f931f935-17a4-41ac-ac71-4ee21771219d on n-h2-master-1 Jul 31 01:17:58.761360 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e7b7c7db-4e56-4e0e-80d0-31001a671e52 req-26be9c2b-b1cd-4373-8fb8-b0bd7091fc07 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083848 Jul 31 01:17:58.767734 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1198/2425] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:58.774188 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cab889fb-d3ae-4896-8c79-789b96824644 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:58.802634 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cab889fb-d3ae-4896-8c79-789b96824644 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:58.828360 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cab889fb-d3ae-4896-8c79-789b96824644 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:58.829289 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cab889fb-d3ae-4896-8c79-789b96824644 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:58.830343 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cab889fb-d3ae-4896-8c79-789b96824644 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:58.832943 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cab889fb-d3ae-4896-8c79-789b96824644 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:58.873377 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:17:59.325741 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cf2902d9-e729-49ad-9c6e-3338a276f791 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ips/e08ee5ba-36fc-406c-a1ee-f7bb614ffbba" status: 200 len: 141 microversion: 2.1 time: 0.845325 Jul 31 01:17:59.327271 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1228/2426] 10.222.0.45 () {58 vars in 1260 bytes} [Sun Jul 31 01:17:58 2022] GET /compute/v2.1/os-floating-ips/e08ee5ba-36fc-406c-a1ee-f7bb614ffbba => generated 141 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:17:59.356836 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3091b461-d370-4b3f-9e6d-c72db00ae96c tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:59.358431 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3091b461-d370-4b3f-9e6d-c72db00ae96c tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:59.383666 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3091b461-d370-4b3f-9e6d-c72db00ae96c tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:59.384625 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3091b461-d370-4b3f-9e6d-c72db00ae96c tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:59.385645 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3091b461-d370-4b3f-9e6d-c72db00ae96c tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:59.386591 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3091b461-d370-4b3f-9e6d-c72db00ae96c tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:59.388830 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cab889fb-d3ae-4896-8c79-789b96824644 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:59.415201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cab889fb-d3ae-4896-8c79-789b96824644 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:59.417528 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cab889fb-d3ae-4896-8c79-789b96824644 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:59.418863 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cab889fb-d3ae-4896-8c79-789b96824644 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 2829 microversion: 2.32 time: 0.649514 Jul 31 01:17:59.419919 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1199/2427] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:17:58 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 2829 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:17:59.427078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8e88b5f2-0ff5-435b-b1e7-ea47c822b35c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede56624c0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:59.487331 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8e88b5f2-0ff5-435b-b1e7-ea47c822b35c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb" status: 200 len: 1464 microversion: 2.1 time: 0.064909 Jul 31 01:17:59.489310 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1200/2428] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:17:59 2022] GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb => generated 1464 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:59.499435 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c586ad2c-0567-4d58-bcfb-ce4071370fb6 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] Calling method '.version_select at 0x7fede5647dc0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:59.595672 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3091b461-d370-4b3f-9e6d-c72db00ae96c tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2074f35abf4032ab99ec20f3afc57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cd99ab55534716b181e34f17442c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:17:59.605384 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3091b461-d370-4b3f-9e6d-c72db00ae96c tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 200 len: 1272 microversion: 2.1 time: 0.276358 Jul 31 01:17:59.606169 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1229/2429] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:17:59 2022] GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:17:59.612124 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c8e29a48-e6bf-4b28-a397-98c2086b227e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:17:59.613034 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c8e29a48-e6bf-4b28-a397-98c2086b227e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:17:59.620770 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8e29a48-e6bf-4b28-a397-98c2086b227e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:59.621333 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8e29a48-e6bf-4b28-a397-98c2086b227e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:17:59.622257 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8e29a48-e6bf-4b28-a397-98c2086b227e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:17:59.622785 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8e29a48-e6bf-4b28-a397-98c2086b227e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:00.185735 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c8e29a48-e6bf-4b28-a397-98c2086b227e tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.577713 Jul 31 01:18:00.186335 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1230/2430] 10.222.0.45 () {60 vars in 1316 bytes} [Sun Jul 31 01:17:59 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb/os-interface => generated 1829 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:18:00.190934 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-82b101c4-cbf8-4cc0-a643-9b062a5b1bd3 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedea94ae50>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:00.274359 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-82b101c4-cbf8-4cc0-a643-9b062a5b1bd3 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb" status: 200 len: 1464 microversion: 2.1 time: 0.086968 Jul 31 01:18:00.279942 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1231/2431] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:00 2022] GET /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb => generated 1464 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:00.292350 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e1ad6ef-4f6b-4b85-b07c-89d0b11facc7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:00.292992 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1e1ad6ef-4f6b-4b85-b07c-89d0b11facc7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:00.310199 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e1ad6ef-4f6b-4b85-b07c-89d0b11facc7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:00.310668 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e1ad6ef-4f6b-4b85-b07c-89d0b11facc7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:00.311536 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e1ad6ef-4f6b-4b85-b07c-89d0b11facc7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:00.311981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e1ad6ef-4f6b-4b85-b07c-89d0b11facc7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:00.412489 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c586ad2c-0567-4d58-bcfb-ce4071370fb6 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.921306 Jul 31 01:18:00.413422 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1201/2432] 10.222.0.45 () {58 vars in 1149 bytes} [Sun Jul 31 01:17:59 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:00.418203 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-58d8ccbe-aec3-4356-941a-ed00d3a20bac tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:00.418825 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-58d8ccbe-aec3-4356-941a-ed00d3a20bac tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:00.433849 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58d8ccbe-aec3-4356-941a-ed00d3a20bac tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:00.434309 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58d8ccbe-aec3-4356-941a-ed00d3a20bac tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:00.435114 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58d8ccbe-aec3-4356-941a-ed00d3a20bac tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:00.442854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58d8ccbe-aec3-4356-941a-ed00d3a20bac tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:00.821320 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1e1ad6ef-4f6b-4b85-b07c-89d0b11facc7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:00.833998 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1e1ad6ef-4f6b-4b85-b07c-89d0b11facc7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 200 len: 1312 microversion: 2.1 time: 0.552768 Jul 31 01:18:00.835868 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1232/2433] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:00 2022] GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 1312 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:00.841860 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-25d1186a-593a-4ed3-bcf6-07adf9476d64 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] Calling method '.version_select at 0x7fede54394c0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:01.052633 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-58d8ccbe-aec3-4356-941a-ed00d3a20bac tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:01.072915 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-58d8ccbe-aec3-4356-941a-ed00d3a20bac tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1468 microversion: 2.1 time: 0.657878 Jul 31 01:18:01.075656 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1202/2434] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:00 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1468 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:01.096339 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5f8d8239-fa57-4164-95f3-b79bd952942b tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:01.098640 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5f8d8239-fa57-4164-95f3-b79bd952942b tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:01.112735 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f8d8239-fa57-4164-95f3-b79bd952942b tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:01.114066 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f8d8239-fa57-4164-95f3-b79bd952942b tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:01.116467 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f8d8239-fa57-4164-95f3-b79bd952942b tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:01.117499 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f8d8239-fa57-4164-95f3-b79bd952942b tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:01.382916 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5f8d8239-fa57-4164-95f3-b79bd952942b tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2074f35abf4032ab99ec20f3afc57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cd99ab55534716b181e34f17442c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:01.409173 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5f8d8239-fa57-4164-95f3-b79bd952942b tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 200 len: 1272 microversion: 2.1 time: 0.331125 Jul 31 01:18:01.416152 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1203/2435] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:01 2022] GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 1272 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:01.428160 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0d042117-4198-4188-9723-daca24b19a22 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-704790786"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:01.450172 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0d042117-4198-4188-9723-daca24b19a22 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cf0c39f6-2c6a-4eb3-9176-7d20151b0adb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:01.460198 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d042117-4198-4188-9723-daca24b19a22 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:01.462934 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d042117-4198-4188-9723-daca24b19a22 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:01.464333 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d042117-4198-4188-9723-daca24b19a22 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:01.465098 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d042117-4198-4188-9723-daca24b19a22 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:01.934018 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0d042117-4198-4188-9723-daca24b19a22 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "POST /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb/action" status: 202 len: 0 microversion: 2.1 time: 0.512507 Jul 31 01:18:01.940678 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1204/2436] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:18:01 2022] POST /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 31 01:18:01.951106 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b3bfc5de-8b39-4ec4-b0f1-ac57225aa070 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:01.952666 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b3bfc5de-8b39-4ec4-b0f1-ac57225aa070 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:01.967784 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3bfc5de-8b39-4ec4-b0f1-ac57225aa070 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:01.968557 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3bfc5de-8b39-4ec4-b0f1-ac57225aa070 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:01.970421 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3bfc5de-8b39-4ec4-b0f1-ac57225aa070 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:01.971520 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3bfc5de-8b39-4ec4-b0f1-ac57225aa070 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:02.486706 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b3bfc5de-8b39-4ec4-b0f1-ac57225aa070 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:02.504958 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b3bfc5de-8b39-4ec4-b0f1-ac57225aa070 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 200 len: 1312 microversion: 2.1 time: 0.567603 Jul 31 01:18:02.506290 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1205/2437] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:01 2022] GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 1312 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:02.511204 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-67d08aa4-1b4f-4bff-882f-6d0ad5a30a8f tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede588f700>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:02.612755 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-67d08aa4-1b4f-4bff-882f-6d0ad5a30a8f tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.105282 Jul 31 01:18:02.614487 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1206/2438] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:02 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:02.632826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-189f79c5-7067-43b2-94b3-51657889f143 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:02.634354 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-189f79c5-7067-43b2-94b3-51657889f143 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:02.642478 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-189f79c5-7067-43b2-94b3-51657889f143 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:02.643413 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-189f79c5-7067-43b2-94b3-51657889f143 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:02.644589 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-189f79c5-7067-43b2-94b3-51657889f143 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:02.645901 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-189f79c5-7067-43b2-94b3-51657889f143 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:03.170729 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-25d1186a-593a-4ed3-bcf6-07adf9476d64 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/e08ee5ba-36fc-406c-a1ee-f7bb614ffbba" status: 202 len: 0 microversion: 2.1 time: 2.333391 Jul 31 01:18:03.171306 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1233/2439] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:18:00 2022] DELETE /compute/v2.1/os-floating-ips/e08ee5ba-36fc-406c-a1ee-f7bb614ffbba => generated 0 bytes in 2335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:18:03.176188 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-391cbf00-2742-4933-8598-a2394b53ef25 req-715ecb5f-a1d6-435a-b02f-e866e9a11821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "tag": "993014ab-481c-4599-9cca-e1b1e9595978"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:03.186483 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-391cbf00-2742-4933-8598-a2394b53ef25 req-715ecb5f-a1d6-435a-b02f-e866e9a11821 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:03.187275 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-391cbf00-2742-4933-8598-a2394b53ef25 req-715ecb5f-a1d6-435a-b02f-e866e9a11821 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:03.201472 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-391cbf00-2742-4933-8598-a2394b53ef25 req-715ecb5f-a1d6-435a-b02f-e866e9a11821 service nova] Creating event network-changed:993014ab-481c-4599-9cca-e1b1e9595978 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:18:03.208626 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-391cbf00-2742-4933-8598-a2394b53ef25 req-715ecb5f-a1d6-435a-b02f-e866e9a11821 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036079 Jul 31 01:18:03.209472 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1234/2440] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:03.215785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b74dd165-a263-4e40-a182-dee8dc60ebe8 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] Action: 'create', calling method: .version_select at 0x7fedea9b10d0>, body: {"pool": null} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:03.233955 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-189f79c5-7067-43b2-94b3-51657889f143 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2074f35abf4032ab99ec20f3afc57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cd99ab55534716b181e34f17442c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:03.245494 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-189f79c5-7067-43b2-94b3-51657889f143 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 200 len: 1314 microversion: 2.1 time: 0.619261 Jul 31 01:18:03.246795 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1207/2441] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:02 2022] GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:03.520462 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:03.550448 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5719a8b4-91e0-4b12-a13e-69b0d233f6a1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:03.552245 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5719a8b4-91e0-4b12-a13e-69b0d233f6a1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:03.563580 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5719a8b4-91e0-4b12-a13e-69b0d233f6a1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:03.569698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5719a8b4-91e0-4b12-a13e-69b0d233f6a1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:03.571041 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5719a8b4-91e0-4b12-a13e-69b0d233f6a1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:03.571941 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5719a8b4-91e0-4b12-a13e-69b0d233f6a1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:03.574899 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:04.228196 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5719a8b4-91e0-4b12-a13e-69b0d233f6a1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:04.254757 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5719a8b4-91e0-4b12-a13e-69b0d233f6a1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 200 len: 1312 microversion: 2.1 time: 0.709210 Jul 31 01:18:04.276485 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1208/2442] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:03 2022] GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 1312 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:18:04.284034 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a392902d-a012-43d8-bb89-477860640532 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedea9cc550>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:04.348336 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a392902d-a012-43d8-bb89-477860640532 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.070248 Jul 31 01:18:04.354104 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1209/2443] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:04 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:04.370281 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f0569cd7-580d-4ce1-9258-bdcfc34d12b1 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:04.370925 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f0569cd7-580d-4ce1-9258-bdcfc34d12b1 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:04.391308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f0569cd7-580d-4ce1-9258-bdcfc34d12b1 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:04.391852 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f0569cd7-580d-4ce1-9258-bdcfc34d12b1 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:04.393711 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f0569cd7-580d-4ce1-9258-bdcfc34d12b1 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:04.394239 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f0569cd7-580d-4ce1-9258-bdcfc34d12b1 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:04.954826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f0569cd7-580d-4ce1-9258-bdcfc34d12b1 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2074f35abf4032ab99ec20f3afc57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cd99ab55534716b181e34f17442c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:04.971231 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f0569cd7-580d-4ce1-9258-bdcfc34d12b1 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 200 len: 1314 microversion: 2.1 time: 0.614466 Jul 31 01:18:04.974727 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1210/2444] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:04 2022] GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:05.017489 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-91431c08-d6f1-41a2-be63-e780180cf2cf req-0384bf94-cdc1-4952-8e24-bc9a5d682aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9d7608-d9aa-462b-bba2-d6653bdb63c1", "tag": "c0ceb8b9-8f50-4801-922c-f49ef93054f6"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:05.028876 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-91431c08-d6f1-41a2-be63-e780180cf2cf req-0384bf94-cdc1-4952-8e24-bc9a5d682aa6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:05.029630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-91431c08-d6f1-41a2-be63-e780180cf2cf req-0384bf94-cdc1-4952-8e24-bc9a5d682aa6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:05.045914 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-91431c08-d6f1-41a2-be63-e780180cf2cf req-0384bf94-cdc1-4952-8e24-bc9a5d682aa6 service nova] Creating event network-changed:c0ceb8b9-8f50-4801-922c-f49ef93054f6 for instance ce9d7608-d9aa-462b-bba2-d6653bdb63c1 on n-h2-master-1 Jul 31 01:18:05.051845 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-91431c08-d6f1-41a2-be63-e780180cf2cf req-0384bf94-cdc1-4952-8e24-bc9a5d682aa6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037897 Jul 31 01:18:05.053142 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1211/2445] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:18:05.286855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8d4dba62-4859-454a-b87f-90f4ad3c1b49 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:05.287866 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8d4dba62-4859-454a-b87f-90f4ad3c1b49 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:05.295407 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d4dba62-4859-454a-b87f-90f4ad3c1b49 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:05.296207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d4dba62-4859-454a-b87f-90f4ad3c1b49 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:05.297272 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d4dba62-4859-454a-b87f-90f4ad3c1b49 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:05.297958 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d4dba62-4859-454a-b87f-90f4ad3c1b49 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:05.951086 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8d4dba62-4859-454a-b87f-90f4ad3c1b49 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:05.959596 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8d4dba62-4859-454a-b87f-90f4ad3c1b49 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 200 len: 1312 microversion: 2.1 time: 0.684422 Jul 31 01:18:05.961276 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1212/2446] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:05 2022] GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 1312 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:05.966953 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d7ec9628-667f-4358-bb70-27bd78e46b60 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede56628b0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:06.048209 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d7ec9628-667f-4358-bb70-27bd78e46b60 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.085537 Jul 31 01:18:06.049190 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1213/2447] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:05 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:06.059589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-dd277d79-429d-4740-b9d7-bf0805b53acf req-ab77ddf3-2f30-4a1e-ac63-255660f3dc08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf56656-f786-439a-8d92-a4365424d0d7", "name": "network-vif-unplugged", "status": "completed", "tag": "f14a9b78-dba4-47d9-b73e-195b70df06a4"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:06.105588 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-dd277d79-429d-4740-b9d7-bf0805b53acf req-ab77ddf3-2f30-4a1e-ac63-255660f3dc08 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:06.106310 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-dd277d79-429d-4740-b9d7-bf0805b53acf req-ab77ddf3-2f30-4a1e-ac63-255660f3dc08 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:06.124888 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-dd277d79-429d-4740-b9d7-bf0805b53acf req-ab77ddf3-2f30-4a1e-ac63-255660f3dc08 service nova] Creating event network-vif-unplugged:f14a9b78-dba4-47d9-b73e-195b70df06a4 for instance cdf56656-f786-439a-8d92-a4365424d0d7 on n-h2-master-1 Jul 31 01:18:06.136645 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-dd277d79-429d-4740-b9d7-bf0805b53acf req-ab77ddf3-2f30-4a1e-ac63-255660f3dc08 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085565 Jul 31 01:18:06.138594 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1214/2448] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:06.151296 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fd027ab4-5975-44d5-a225-19d57c9f8a2f tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:06.153651 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fd027ab4-5975-44d5-a225-19d57c9f8a2f tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:06.163548 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd027ab4-5975-44d5-a225-19d57c9f8a2f tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:06.165216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd027ab4-5975-44d5-a225-19d57c9f8a2f tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:06.166969 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd027ab4-5975-44d5-a225-19d57c9f8a2f tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:06.168561 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd027ab4-5975-44d5-a225-19d57c9f8a2f tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:08.046923 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fd027ab4-5975-44d5-a225-19d57c9f8a2f tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2074f35abf4032ab99ec20f3afc57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cd99ab55534716b181e34f17442c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:08.056145 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fd027ab4-5975-44d5-a225-19d57c9f8a2f tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 200 len: 1314 microversion: 2.1 time: 1.915861 Jul 31 01:18:08.068321 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1215/2449] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:06 2022] GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 1314 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:08.084705 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a6542a47-b1f9-4e35-a081-8cb51d21088c tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:08.088978 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a6542a47-b1f9-4e35-a081-8cb51d21088c tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:08.106894 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a6542a47-b1f9-4e35-a081-8cb51d21088c tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:08.107382 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a6542a47-b1f9-4e35-a081-8cb51d21088c tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:08.108189 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a6542a47-b1f9-4e35-a081-8cb51d21088c tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:08.108640 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a6542a47-b1f9-4e35-a081-8cb51d21088c tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:08.919093 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a6542a47-b1f9-4e35-a081-8cb51d21088c tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:08.934064 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a6542a47-b1f9-4e35-a081-8cb51d21088c tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 200 len: 1312 microversion: 2.1 time: 0.865505 Jul 31 01:18:08.936758 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1216/2450] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:08 2022] GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 1312 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:08.951194 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7235176d-bf27-4a16-8cb6-2e796a887d5b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedea8715e0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:09.052176 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7235176d-bf27-4a16-8cb6-2e796a887d5b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.113399 Jul 31 01:18:09.052867 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1217/2451] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:08 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:09.063558 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-27649a3e-9f16-4ae1-82c7-8f3c6dc4acde req-78a0a5d9-fee6-4543-b2ec-26c6a87b3c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c2fb1f-e2af-4b6e-a479-11c2fe101899", "name": "network-vif-plugged", "status": "completed", "tag": "c97f7a0b-c24e-4337-82f2-431b50cd2106"}, {"server_uuid": "cf0c39f6-2c6a-4eb3-9176-7d20151b0adb", "name": "network-vif-plugged", "status": "completed", "tag": "cf150970-8f1a-4d54-b48d-7de2be48f7e1"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:09.098540 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-27649a3e-9f16-4ae1-82c7-8f3c6dc4acde req-78a0a5d9-fee6-4543-b2ec-26c6a87b3c76 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:09.099464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-27649a3e-9f16-4ae1-82c7-8f3c6dc4acde req-78a0a5d9-fee6-4543-b2ec-26c6a87b3c76 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:09.120450 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-27649a3e-9f16-4ae1-82c7-8f3c6dc4acde req-78a0a5d9-fee6-4543-b2ec-26c6a87b3c76 service nova] Creating event network-vif-plugged:c97f7a0b-c24e-4337-82f2-431b50cd2106 for instance 95c2fb1f-e2af-4b6e-a479-11c2fe101899 on n-h1-master-1 Jul 31 01:18:09.121939 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-27649a3e-9f16-4ae1-82c7-8f3c6dc4acde req-78a0a5d9-fee6-4543-b2ec-26c6a87b3c76 service nova] Creating event network-vif-plugged:cf150970-8f1a-4d54-b48d-7de2be48f7e1 for instance cf0c39f6-2c6a-4eb3-9176-7d20151b0adb on n-h2-master-1 Jul 31 01:18:09.145821 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-27649a3e-9f16-4ae1-82c7-8f3c6dc4acde req-78a0a5d9-fee6-4543-b2ec-26c6a87b3c76 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091013 Jul 31 01:18:09.163056 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1218/2452] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:09.179115 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fef2edbb-891e-44c6-881b-a448e1a9532e tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:09.189181 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fef2edbb-891e-44c6-881b-a448e1a9532e tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:09.237720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fef2edbb-891e-44c6-881b-a448e1a9532e tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:09.239479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fef2edbb-891e-44c6-881b-a448e1a9532e tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:09.246629 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fef2edbb-891e-44c6-881b-a448e1a9532e tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:09.252162 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fef2edbb-891e-44c6-881b-a448e1a9532e tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:10.681018 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b74dd165-a263-4e40-a182-dee8dc60ebe8 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.470097 Jul 31 01:18:10.688442 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1235/2453] 10.222.0.45 () {60 vars in 1170 bytes} [Sun Jul 31 01:18:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:10.694261 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6277aaa1-64de-40d1-a711-720e54c036f6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:10.695023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6277aaa1-64de-40d1-a711-720e54c036f6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:10.711059 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=68 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:10.714857 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6277aaa1-64de-40d1-a711-720e54c036f6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:10.715325 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6277aaa1-64de-40d1-a711-720e54c036f6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:10.716181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6277aaa1-64de-40d1-a711-720e54c036f6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:10.721067 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fef2edbb-891e-44c6-881b-a448e1a9532e tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2074f35abf4032ab99ec20f3afc57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cd99ab55534716b181e34f17442c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:10.733495 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fef2edbb-891e-44c6-881b-a448e1a9532e tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 200 len: 1314 microversion: 2.1 time: 1.565759 Jul 31 01:18:10.736644 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6277aaa1-64de-40d1-a711-720e54c036f6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:10.747064 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1219/2454] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:09 2022] GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 1314 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:10.752974 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-de855cec-8a69-42d1-8249-5374a0dd9aed tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede5662310>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:10.829806 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-de855cec-8a69-42d1-8249-5374a0dd9aed tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.080902 Jul 31 01:18:10.830853 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1220/2455] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:10 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:10.850267 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ccab7a32-1d6e-408a-99b1-d14de6f998c2 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] Calling method '.version_select at 0x7fede58e9790>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:12.078228 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6277aaa1-64de-40d1-a711-720e54c036f6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:12.121902 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6277aaa1-64de-40d1-a711-720e54c036f6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 200 len: 1312 microversion: 2.1 time: 1.431798 Jul 31 01:18:12.125426 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1236/2456] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:10 2022] GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 1312 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:12.137811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-50ed74e7-8b89-493f-8892-903fb5c44eed tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:12.139495 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-50ed74e7-8b89-493f-8892-903fb5c44eed tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:12.151221 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-50ed74e7-8b89-493f-8892-903fb5c44eed tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:12.152662 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-50ed74e7-8b89-493f-8892-903fb5c44eed tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:12.154387 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-50ed74e7-8b89-493f-8892-903fb5c44eed tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:12.155040 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-50ed74e7-8b89-493f-8892-903fb5c44eed tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:12.660632 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-50ed74e7-8b89-493f-8892-903fb5c44eed tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2074f35abf4032ab99ec20f3afc57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cd99ab55534716b181e34f17442c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:12.680164 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-50ed74e7-8b89-493f-8892-903fb5c44eed tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 200 len: 1314 microversion: 2.1 time: 0.552639 Jul 31 01:18:12.702009 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1237/2457] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:12 2022] GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:12.726222 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c4f3b6f0-536c-49ed-aa71-3981032ed55c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedeaa171f0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:12.814099 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c4f3b6f0-536c-49ed-aa71-3981032ed55c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.123482 Jul 31 01:18:12.814965 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1238/2458] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:12 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:13.157235 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-51946878-9f78-4243-999e-9dd27cd6a80c tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:13.157910 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-51946878-9f78-4243-999e-9dd27cd6a80c tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:13.169447 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51946878-9f78-4243-999e-9dd27cd6a80c tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:13.169908 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51946878-9f78-4243-999e-9dd27cd6a80c tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:13.170701 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51946878-9f78-4243-999e-9dd27cd6a80c tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:13.171148 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51946878-9f78-4243-999e-9dd27cd6a80c tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:13.902637 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-51946878-9f78-4243-999e-9dd27cd6a80c tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:13.914097 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-51946878-9f78-4243-999e-9dd27cd6a80c tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 200 len: 1462 microversion: 2.1 time: 0.761312 Jul 31 01:18:13.947194 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1239/2459] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:13 2022] GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 1462 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:18:13.982982 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-867d54c5-4390-44c8-8824-8172ea5389f2 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:13.983652 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-867d54c5-4390-44c8-8824-8172ea5389f2 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:13.995972 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-867d54c5-4390-44c8-8824-8172ea5389f2 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:13.999173 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-867d54c5-4390-44c8-8824-8172ea5389f2 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:14.004091 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-867d54c5-4390-44c8-8824-8172ea5389f2 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:14.004863 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-867d54c5-4390-44c8-8824-8172ea5389f2 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:14.015187 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ccab7a32-1d6e-408a-99b1-d14de6f998c2 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/2135a312-1ec9-43a2-b9b6-463f4e23489b" status: 202 len: 0 microversion: 2.1 time: 3.178636 Jul 31 01:18:14.020784 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1221/2460] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:18:10 2022] DELETE /compute/v2.1/os-floating-ips/2135a312-1ec9-43a2-b9b6-463f4e23489b => generated 0 bytes in 3184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:18:14.025078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-162e1630-ee10-4c26-b728-05de036fee74 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede58b44c0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:14.150910 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-162e1630-ee10-4c26-b728-05de036fee74 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.134001 Jul 31 01:18:14.152226 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1222/2461] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:14 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:14.157850 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-300be511-cd20-45cd-8847-785ca811e679 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:14.158859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-300be511-cd20-45cd-8847-785ca811e679 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:14.166527 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-300be511-cd20-45cd-8847-785ca811e679 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:14.167278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-300be511-cd20-45cd-8847-785ca811e679 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:14.168801 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-300be511-cd20-45cd-8847-785ca811e679 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:14.170862 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-300be511-cd20-45cd-8847-785ca811e679 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:14.564617 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-867d54c5-4390-44c8-8824-8172ea5389f2 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2074f35abf4032ab99ec20f3afc57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cd99ab55534716b181e34f17442c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:14.575639 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-867d54c5-4390-44c8-8824-8172ea5389f2 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 200 len: 1314 microversion: 2.1 time: 0.626727 Jul 31 01:18:14.581396 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1240/2462] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:13 2022] GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:14.588542 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7111213d-3a64-41ca-a5ca-eb329aa64411 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] Calling method '.version_select at 0x7fede491f940>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:14.845403 n-d-master-1 devstack@n-api.service[119475]: DEBUG neutronclient.v2_0.client [None req-7111213d-3a64-41ca-a5ca-eb329aa64411 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2135a312-1ec9-43a2-b9b6-463f4e23489b could not be found", "detail": ""}} {{(pid=119475) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:18:14.846719 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-7111213d-3a64-41ca-a5ca-eb329aa64411 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] HTTP exception thrown: Floating IP not found for ID 2135a312-1ec9-43a2-b9b6-463f4e23489b Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7111213d-3a64-41ca-a5ca-eb329aa64411 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] Request method failure captured: Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-floating-ips/2135a312-1ec9-43a2-b9b6-463f4e23489b HTTP/1.1 Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dg7-RzwkNSe6QD2rFpZjfj_oRnxneoxCSyZ-7KO70qXXYGMztiDZI3QJYOAsw7tFGrWzsrzagJtxt6z0Zf515dYEbaOFiSvFh7jI2b1KbqC3VL04GsRShyVsRRTCZKLKEJ3HJzz5Pmi3l-BUX-WveGG4mWquYxFbXIyJoUKLsIPcNo Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 7adafabe634f4d7eb99110978752f011 Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-FloatingIPsTestJSON-337110484 Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7adafabe634f4d7eb99110978752f011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7adafabe634f4d7eb99110978752f011"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7adafabe634f4d7eb99110978752f011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7adafabe634f4d7eb99110978752f011", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-FloatingIPsTestJSON-337110484 Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 7adafabe634f4d7eb99110978752f011 Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-FloatingIPsTestJSON-337110484 Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-FloatingIPsTestJSON-337110484-project Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 7ae97500a4e44e0194b2b32e70313806 Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-FloatingIPsTestJSON-337110484-project Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: exception: Floating IP not found for ID 2135a312-1ec9-43a2-b9b6-463f4e23489b Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '2135a312-1ec9-43a2-b9b6-463f4e23489b'} Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2135a312-1ec9-43a2-b9b6-463f4e23489b could not be found Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03a7b7e5-1f4b-4301-ada2-d00b2a18f38a'] Jul 31 01:18:14.864808 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2135a312-1ec9-43a2-b9b6-463f4e23489b. Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2135a312-1ec9-43a2-b9b6-463f4e23489b Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2135a312-1ec9-43a2-b9b6-463f4e23489b Jul 31 01:18:14.869997 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:14.873460 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7111213d-3a64-41ca-a5ca-eb329aa64411 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] Returning 404 to user: Floating IP not found for ID 2135a312-1ec9-43a2-b9b6-463f4e23489b {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:18:14.874655 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7111213d-3a64-41ca-a5ca-eb329aa64411 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ips/2135a312-1ec9-43a2-b9b6-463f4e23489b" status: 404 len: 111 microversion: 2.1 time: 0.291637 Jul 31 01:18:14.875599 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1241/2463] 10.222.0.45 () {58 vars in 1260 bytes} [Sun Jul 31 01:18:14 2022] GET /compute/v2.1/os-floating-ips/2135a312-1ec9-43a2-b9b6-463f4e23489b => generated 111 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:18:14.888815 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7d09d694-62ff-4581-bf67-67a53a1111d8 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] Calling method '.version_select at 0x7fede55f88b0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:15.523180 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-300be511-cd20-45cd-8847-785ca811e679 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:15.535674 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-300be511-cd20-45cd-8847-785ca811e679 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1464 microversion: 2.1 time: 1.382095 Jul 31 01:18:15.536526 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1223/2464] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:14 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1464 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:15.557050 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bfdbd590-0338-45b5-9a79-97d96751ad7e tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede58d7c10>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:15.582942 n-d-master-1 devstack@n-api.service[119475]: DEBUG neutronclient.v2_0.client [None req-7d09d694-62ff-4581-bf67-67a53a1111d8 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2135a312-1ec9-43a2-b9b6-463f4e23489b could not be found", "detail": ""}} {{(pid=119475) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:18:15.584913 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-7d09d694-62ff-4581-bf67-67a53a1111d8 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] HTTP exception thrown: Floating IP not found for ID 2135a312-1ec9-43a2-b9b6-463f4e23489b Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7d09d694-62ff-4581-bf67-67a53a1111d8 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] Request method failure captured: Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/os-floating-ips/2135a312-1ec9-43a2-b9b6-463f4e23489b HTTP/1.1 Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dg7-RzwkNSe6QD2rFpZjfj_oRnxneoxCSyZ-7KO70qXXYGMztiDZI3QJYOAsw7tFGrWzsrzagJtxt6z0Zf515dYEbaOFiSvFh7jI2b1KbqC3VL04GsRShyVsRRTCZKLKEJ3HJzz5Pmi3l-BUX-WveGG4mWquYxFbXIyJoUKLsIPcNo Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 7adafabe634f4d7eb99110978752f011 Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-FloatingIPsTestJSON-337110484 Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7adafabe634f4d7eb99110978752f011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7adafabe634f4d7eb99110978752f011"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7adafabe634f4d7eb99110978752f011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7adafabe634f4d7eb99110978752f011", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-FloatingIPsTestJSON-337110484 Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 7adafabe634f4d7eb99110978752f011 Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-FloatingIPsTestJSON-337110484 Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-FloatingIPsTestJSON-337110484-project Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 7ae97500a4e44e0194b2b32e70313806 Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-FloatingIPsTestJSON-337110484-project Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: exception: Floating IP not found for ID 2135a312-1ec9-43a2-b9b6-463f4e23489b Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '2135a312-1ec9-43a2-b9b6-463f4e23489b'} Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2135a312-1ec9-43a2-b9b6-463f4e23489b could not be found Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-204de4ef-a186-4251-a0b4-a259cc7db76b'] Jul 31 01:18:15.586724 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2135a312-1ec9-43a2-b9b6-463f4e23489b. Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2135a312-1ec9-43a2-b9b6-463f4e23489b Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2135a312-1ec9-43a2-b9b6-463f4e23489b Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7d09d694-62ff-4581-bf67-67a53a1111d8 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] Returning 404 to user: Floating IP not found for ID 2135a312-1ec9-43a2-b9b6-463f4e23489b {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7d09d694-62ff-4581-bf67-67a53a1111d8 tempest-FloatingIPsTestJSON-337110484 tempest-FloatingIPsTestJSON-337110484-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/2135a312-1ec9-43a2-b9b6-463f4e23489b" status: 404 len: 111 microversion: 2.1 time: 0.708623 Jul 31 01:18:15.595097 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1242/2465] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:18:14 2022] DELETE /compute/v2.1/os-floating-ips/2135a312-1ec9-43a2-b9b6-463f4e23489b => generated 111 bytes in 710 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:18:15.631491 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fe5140bd-5aca-4b70-b49c-026bc3767c8c tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:15.640295 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fe5140bd-5aca-4b70-b49c-026bc3767c8c tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:15.651916 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe5140bd-5aca-4b70-b49c-026bc3767c8c tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:15.659143 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe5140bd-5aca-4b70-b49c-026bc3767c8c tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:15.660425 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe5140bd-5aca-4b70-b49c-026bc3767c8c tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:15.662766 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe5140bd-5aca-4b70-b49c-026bc3767c8c tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:15.695181 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bfdbd590-0338-45b5-9a79-97d96751ad7e tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.157357 Jul 31 01:18:15.715845 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1224/2466] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:15 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:15.841172 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c328a7bc-c376-449d-9664-49bba008727d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-361585877", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f931f935-17a4-41ac-ac71-4ee21771219d"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:16.025628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-c328a7bc-c376-449d-9664-49bba008727d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] validate_networks() for None {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:18:16.701759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fe5140bd-5aca-4b70-b49c-026bc3767c8c tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2074f35abf4032ab99ec20f3afc57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cd99ab55534716b181e34f17442c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:16.722413 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fe5140bd-5aca-4b70-b49c-026bc3767c8c tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 200 len: 1314 microversion: 2.1 time: 1.121671 Jul 31 01:18:16.727937 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1243/2467] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:15 2022] GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 1314 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:16.744540 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-48dcfe55-251b-4b3c-8734-d689bd7e5565 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedea9b1d30>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:16.862497 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-48dcfe55-251b-4b3c-8734-d689bd7e5565 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.133195 Jul 31 01:18:16.863710 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1244/2468] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:16 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:17.002081 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-1e4768b6-2f95-4b52-8b22-8fdfb78d0b2b req-41c45e31-1f7a-4a45-bc48-817a45b63985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9d7608-d9aa-462b-bba2-d6653bdb63c1", "name": "network-vif-plugged", "status": "completed", "tag": "c0ceb8b9-8f50-4801-922c-f49ef93054f6"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:17.020433 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1e4768b6-2f95-4b52-8b22-8fdfb78d0b2b req-41c45e31-1f7a-4a45-bc48-817a45b63985 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:17.021151 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1e4768b6-2f95-4b52-8b22-8fdfb78d0b2b req-41c45e31-1f7a-4a45-bc48-817a45b63985 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:17.040048 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1e4768b6-2f95-4b52-8b22-8fdfb78d0b2b req-41c45e31-1f7a-4a45-bc48-817a45b63985 service nova] Creating event network-vif-plugged:c0ceb8b9-8f50-4801-922c-f49ef93054f6 for instance ce9d7608-d9aa-462b-bba2-d6653bdb63c1 on n-h2-master-1 Jul 31 01:18:17.049548 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-1e4768b6-2f95-4b52-8b22-8fdfb78d0b2b req-41c45e31-1f7a-4a45-bc48-817a45b63985 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051166 Jul 31 01:18:17.050972 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1245/2469] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:17.979164 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-c328a7bc-c376-449d-9664-49bba008727d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:18:17.979796 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-c328a7bc-c376-449d-9664-49bba008727d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:18:17.980225 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-c328a7bc-c376-449d-9664-49bba008727d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:18:17.980705 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-c328a7bc-c376-449d-9664-49bba008727d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:18:17.981461 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-c328a7bc-c376-449d-9664-49bba008727d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:18:18.024308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c328a7bc-c376-449d-9664-49bba008727d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:18.026926 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c328a7bc-c376-449d-9664-49bba008727d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:18.035826 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c328a7bc-c376-449d-9664-49bba008727d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:18.036420 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c328a7bc-c376-449d-9664-49bba008727d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:18.158714 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-c328a7bc-c376-449d-9664-49bba008727d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Getting quotas for project 43c36901e18a4507ae8a90557eb9abc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:18:18.195053 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-c328a7bc-c376-449d-9664-49bba008727d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Getting quotas for user 4157eca4624c444bb8b88bdb958dd8dc and project 43c36901e18a4507ae8a90557eb9abc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:18:18.270621 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c328a7bc-c376-449d-9664-49bba008727d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:18:18.291822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c328a7bc-c376-449d-9664-49bba008727d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:18:18.319022 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1488176364", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "21da8480-a842-4066-86d3-fc2fbeb2ee2c"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:18.453461 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c328a7bc-c376-449d-9664-49bba008727d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.619098 Jul 31 01:18:18.455992 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1225/2470] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:18:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:18:18.465587 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-68e4aec8-8a9b-4afb-a7b1-e3fd8c68097a tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:18.466203 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-68e4aec8-8a9b-4afb-a7b1-e3fd8c68097a tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:18.489961 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68e4aec8-8a9b-4afb-a7b1-e3fd8c68097a tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:18.489961 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68e4aec8-8a9b-4afb-a7b1-e3fd8c68097a tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:18.490689 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68e4aec8-8a9b-4afb-a7b1-e3fd8c68097a tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:18.491295 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68e4aec8-8a9b-4afb-a7b1-e3fd8c68097a tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:19.187443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-68e4aec8-8a9b-4afb-a7b1-e3fd8c68097a tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2074f35abf4032ab99ec20f3afc57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cd99ab55534716b181e34f17442c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:19.201061 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-68e4aec8-8a9b-4afb-a7b1-e3fd8c68097a tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 200 len: 1314 microversion: 2.1 time: 0.743234 Jul 31 01:18:19.224444 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1226/2471] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:18 2022] GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 1314 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:19.245491 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0c1acacb-7872-4df1-b48b-687609798706 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede561aca0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:19.678585 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] validate_networks() for [('21da8480-a842-4066-86d3-fc2fbeb2ee2c', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:18:19.947642 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0c1acacb-7872-4df1-b48b-687609798706 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.721033 Jul 31 01:18:19.979615 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1227/2472] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:19 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:19.988330 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-78cc6be6-9805-4249-9958-600b7d3d49b8 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:19.989081 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-78cc6be6-9805-4249-9958-600b7d3d49b8 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:20.018588 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78cc6be6-9805-4249-9958-600b7d3d49b8 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:20.019656 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78cc6be6-9805-4249-9958-600b7d3d49b8 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:20.021324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78cc6be6-9805-4249-9958-600b7d3d49b8 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:20.021853 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78cc6be6-9805-4249-9958-600b7d3d49b8 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:20.057293 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:20.418293 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-78cc6be6-9805-4249-9958-600b7d3d49b8 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:20.432465 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-78cc6be6-9805-4249-9958-600b7d3d49b8 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1265 microversion: 2.1 time: 0.451425 Jul 31 01:18:20.439914 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1228/2473] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:19 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1265 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:20.467889 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-278cf8e1-04fc-4944-831c-f52141f3e137 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:20.477996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-278cf8e1-04fc-4944-831c-f52141f3e137 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:20.526241 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-278cf8e1-04fc-4944-831c-f52141f3e137 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:20.527120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-278cf8e1-04fc-4944-831c-f52141f3e137 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:20.528252 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-278cf8e1-04fc-4944-831c-f52141f3e137 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:20.528882 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-278cf8e1-04fc-4944-831c-f52141f3e137 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:21.511690 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-278cf8e1-04fc-4944-831c-f52141f3e137 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2074f35abf4032ab99ec20f3afc57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cd99ab55534716b181e34f17442c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:21.532723 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-278cf8e1-04fc-4944-831c-f52141f3e137 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 200 len: 1464 microversion: 2.1 time: 1.088861 Jul 31 01:18:21.538449 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1229/2474] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:20 2022] GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 1464 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:21.571279 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-75aab20e-222f-473c-838f-d73da1ad3584 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedeaa5c940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:21.715228 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-75aab20e-222f-473c-838f-d73da1ad3584 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.173071 Jul 31 01:18:21.730293 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1230/2475] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:21 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:21.736159 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-37321b3b-3502-4cc9-bbcb-68a8ac83adcf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:21.736807 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-37321b3b-3502-4cc9-bbcb-68a8ac83adcf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:21.762639 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37321b3b-3502-4cc9-bbcb-68a8ac83adcf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:21.763103 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37321b3b-3502-4cc9-bbcb-68a8ac83adcf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:21.764197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37321b3b-3502-4cc9-bbcb-68a8ac83adcf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:21.764821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37321b3b-3502-4cc9-bbcb-68a8ac83adcf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:22.355771 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-37321b3b-3502-4cc9-bbcb-68a8ac83adcf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:22.370605 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-37321b3b-3502-4cc9-bbcb-68a8ac83adcf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1271 microversion: 2.1 time: 0.638434 Jul 31 01:18:22.371278 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1231/2476] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:21 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1271 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:23.027669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d8b50d23-5dc3-4dfb-8d79-faa6a46987ce tempest-TenantUsagesTestJSON-364710384 tempest-TenantUsagesTestJSON-364710384-project-admin] Calling method '.version_select at 0x7fede588f0d0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:23.052851 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8b50d23-5dc3-4dfb-8d79-faa6a46987ce tempest-TenantUsagesTestJSON-364710384 tempest-TenantUsagesTestJSON-364710384-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:23.056095 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8b50d23-5dc3-4dfb-8d79-faa6a46987ce tempest-TenantUsagesTestJSON-364710384 tempest-TenantUsagesTestJSON-364710384-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:23.096986 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8b50d23-5dc3-4dfb-8d79-faa6a46987ce tempest-TenantUsagesTestJSON-364710384 tempest-TenantUsagesTestJSON-364710384-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:23.098025 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8b50d23-5dc3-4dfb-8d79-faa6a46987ce tempest-TenantUsagesTestJSON-364710384 tempest-TenantUsagesTestJSON-364710384-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:23.130578 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d8b50d23-5dc3-4dfb-8d79-faa6a46987ce tempest-TenantUsagesTestJSON-364710384 tempest-TenantUsagesTestJSON-364710384-project-admin] 10.222.0.45 "GET /compute/v2.1/os-simple-tenant-usage/64cd99ab55534716b181e34f17442c7f?start=2022-07-30T01%3A18%3A21.550770&end=2022-08-01T01%3A18%3A21.550770" status: 200 len: 694 microversion: 2.1 time: 0.749951 Jul 31 01:18:23.142025 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1232/2477] 10.222.0.45 () {58 vars in 1412 bytes} [Sun Jul 31 01:18:22 2022] GET /compute/v2.1/os-simple-tenant-usage/64cd99ab55534716b181e34f17442c7f?start=2022-07-30T01%3A18%3A21.550770&end=2022-08-01T01%3A18%3A21.550770 => generated 694 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:23.152537 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5202f1e7-7fef-4369-804c-7c56a15d306f tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede5b60a60>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:23.234169 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5202f1e7-7fef-4369-804c-7c56a15d306f tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.090915 Jul 31 01:18:23.246495 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1233/2478] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:23 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:23.254687 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f7a488df-799d-4713-9f38-b7bc4e73aa47 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '.version_select at 0x7fede588f700>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:23.266141 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:18:23.268338 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:18:23.269048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:18:23.270596 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:18:23.272587 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:18:23.302968 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7a488df-799d-4713-9f38-b7bc4e73aa47 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:23.304883 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:23.306447 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:23.307038 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7a488df-799d-4713-9f38-b7bc4e73aa47 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:23.313767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:23.316818 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:23.339897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7a488df-799d-4713-9f38-b7bc4e73aa47 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:23.345323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7a488df-799d-4713-9f38-b7bc4e73aa47 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:23.380372 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f7a488df-799d-4713-9f38-b7bc4e73aa47 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/os-simple-tenant-usage/64cd99ab55534716b181e34f17442c7f?start=2022-07-30T01%3A18%3A21.550770&end=2022-08-01T01%3A18%3A21.550770" status: 200 len: 694 microversion: 2.1 time: 0.131516 Jul 31 01:18:23.387787 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Getting quotas for project 44209ac9bb8d45afa6803de51652c614. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:18:23.403786 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1234/2479] 10.222.0.45 () {58 vars in 1412 bytes} [Sun Jul 31 01:18:23 2022] GET /compute/v2.1/os-simple-tenant-usage/64cd99ab55534716b181e34f17442c7f?start=2022-07-30T01%3A18%3A21.550770&end=2022-08-01T01%3A18%3A21.550770 => generated 694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:23.410984 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Getting quotas for user 0149114cdb8e493c946447fc26acbce2 and project 44209ac9bb8d45afa6803de51652c614. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:18:23.418513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6378efd7-0c48-41e8-a880-4b67e82c0652 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:23.424689 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6378efd7-0c48-41e8-a880-4b67e82c0652 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:23.441923 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6378efd7-0c48-41e8-a880-4b67e82c0652 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:23.444533 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6378efd7-0c48-41e8-a880-4b67e82c0652 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:23.445841 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6378efd7-0c48-41e8-a880-4b67e82c0652 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:23.446219 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6378efd7-0c48-41e8-a880-4b67e82c0652 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:23.459993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Going to run 2 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:18:23.478010 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: f43b4b8e-a135-4dbd-886f-8b8a7c396bd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:18:23.584653 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=f43b4b8e-a135-4dbd-886f-8b8a7c396bd1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:18:23.782981 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3847c3a7-0cf6-4b92-800e-a64d455990e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.185953 Jul 31 01:18:23.792746 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1246/2480] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:18:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 6197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:18:23.822932 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7dd5229c-6232-4612-866f-c8f3c567ea6f tempest-TenantUsagesTestJSON-364710384 tempest-TenantUsagesTestJSON-364710384-project-admin] Calling method '.version_select at 0x7fede4896e50>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:23.862447 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7dd5229c-6232-4612-866f-c8f3c567ea6f tempest-TenantUsagesTestJSON-364710384 tempest-TenantUsagesTestJSON-364710384-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:23.864553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7dd5229c-6232-4612-866f-c8f3c567ea6f tempest-TenantUsagesTestJSON-364710384 tempest-TenantUsagesTestJSON-364710384-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:23.906146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7dd5229c-6232-4612-866f-c8f3c567ea6f tempest-TenantUsagesTestJSON-364710384 tempest-TenantUsagesTestJSON-364710384-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:23.907822 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7dd5229c-6232-4612-866f-c8f3c567ea6f tempest-TenantUsagesTestJSON-364710384 tempest-TenantUsagesTestJSON-364710384-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:24.152070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6378efd7-0c48-41e8-a880-4b67e82c0652 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:24.170868 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6378efd7-0c48-41e8-a880-4b67e82c0652 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1271 microversion: 2.1 time: 0.761444 Jul 31 01:18:24.183430 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1235/2481] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:23 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1271 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:24.183430 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-02bfb909-ef19-47f6-a383-b24aa061698f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:24.188808 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-02bfb909-ef19-47f6-a383-b24aa061698f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:24.189034 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-02bfb909-ef19-47f6-a383-b24aa061698f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Searching by: {'deleted': False, 'project_id': '44209ac9bb8d45afa6803de51652c614'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:18:24.220045 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02bfb909-ef19-47f6-a383-b24aa061698f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:24.220970 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02bfb909-ef19-47f6-a383-b24aa061698f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:24.222843 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02bfb909-ef19-47f6-a383-b24aa061698f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:24.223783 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02bfb909-ef19-47f6-a383-b24aa061698f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:24.266600 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-02bfb909-ef19-47f6-a383-b24aa061698f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.092118 Jul 31 01:18:24.272345 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1236/2482] 10.222.0.45 () {58 vars in 1125 bytes} [Sun Jul 31 01:18:24 2022] GET /compute/v2.1/servers => generated 677 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:24.298802 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-df978f63-8922-41da-abf9-892a54e28b81 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede55d8310>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:24.322656 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7dd5229c-6232-4612-866f-c8f3c567ea6f tempest-TenantUsagesTestJSON-364710384 tempest-TenantUsagesTestJSON-364710384-project-admin] 10.222.0.45 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-30T01%3A18%3A21.550770&end=2022-08-01T01%3A18%3A21.550770&detailed=1" status: 200 len: 30824 microversion: 2.1 time: 0.519684 Jul 31 01:18:24.323371 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1247/2483] 10.222.0.45 () {58 vars in 1335 bytes} [Sun Jul 31 01:18:23 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-30T01%3A18%3A21.550770&end=2022-08-01T01%3A18%3A21.550770&detailed=1 => generated 30824 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:18:24.339488 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f6ce98e4-95c4-4050-b7cd-1e51facb9fed tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:24.340140 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f6ce98e4-95c4-4050-b7cd-1e51facb9fed tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:24.359545 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-df978f63-8922-41da-abf9-892a54e28b81 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.080846 Jul 31 01:18:24.367794 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1237/2484] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:24 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:24.389025 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8deadb3e-82f0-4a41-9251-086f3aefef76 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:24.391533 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8deadb3e-82f0-4a41-9251-086f3aefef76 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:24.414486 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8deadb3e-82f0-4a41-9251-086f3aefef76 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:24.414956 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8deadb3e-82f0-4a41-9251-086f3aefef76 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:24.415805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8deadb3e-82f0-4a41-9251-086f3aefef76 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:24.416318 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8deadb3e-82f0-4a41-9251-086f3aefef76 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:24.495763 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8deadb3e-82f0-4a41-9251-086f3aefef76 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:18:24.676686 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8deadb3e-82f0-4a41-9251-086f3aefef76 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 204 len: 0 microversion: 2.1 time: 0.294833 Jul 31 01:18:24.683683 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1238/2485] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:18:24 2022] DELETE /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:18:24.701013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-44df6963-d924-46ce-a4b8-2a30a9a8122b tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:24.717435 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-44df6963-d924-46ce-a4b8-2a30a9a8122b tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:24.728520 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44df6963-d924-46ce-a4b8-2a30a9a8122b tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:24.731916 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44df6963-d924-46ce-a4b8-2a30a9a8122b tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:24.735420 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44df6963-d924-46ce-a4b8-2a30a9a8122b tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:24.739240 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44df6963-d924-46ce-a4b8-2a30a9a8122b tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:24.865746 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f6ce98e4-95c4-4050-b7cd-1e51facb9fed tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:24.877660 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f6ce98e4-95c4-4050-b7cd-1e51facb9fed tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 200 len: 1220 microversion: 2.1 time: 0.553071 Jul 31 01:18:24.878799 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1248/2486] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:24 2022] GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 1220 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:25.211366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c7944c3c-17c3-47b7-b65c-9eca107f5435 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:25.211366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c7944c3c-17c3-47b7-b65c-9eca107f5435 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:25.224235 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7944c3c-17c3-47b7-b65c-9eca107f5435 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:25.224993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7944c3c-17c3-47b7-b65c-9eca107f5435 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:25.226026 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7944c3c-17c3-47b7-b65c-9eca107f5435 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:25.228216 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7944c3c-17c3-47b7-b65c-9eca107f5435 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:25.234797 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=76 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:26.009629 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c7944c3c-17c3-47b7-b65c-9eca107f5435 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:26.022182 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c7944c3c-17c3-47b7-b65c-9eca107f5435 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1271 microversion: 2.1 time: 0.824029 Jul 31 01:18:26.028951 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1249/2487] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:25 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1271 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:18:26.042736 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ac1efc09-2343-4da1-b6e7-8d2a70b328ed tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede48965e0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:26.156091 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ac1efc09-2343-4da1-b6e7-8d2a70b328ed tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.124684 Jul 31 01:18:26.165105 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1250/2488] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:26 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:26.181680 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f983637f-bcad-4f0c-b949-d363cf7812de tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:26.182847 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f983637f-bcad-4f0c-b949-d363cf7812de tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:26.188642 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-44df6963-d924-46ce-a4b8-2a30a9a8122b tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2074f35abf4032ab99ec20f3afc57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cd99ab55534716b181e34f17442c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:26.202615 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-44df6963-d924-46ce-a4b8-2a30a9a8122b tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 200 len: 1470 microversion: 2.1 time: 1.504820 Jul 31 01:18:26.208337 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1239/2489] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:24 2022] GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 1470 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:26.229758 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f983637f-bcad-4f0c-b949-d363cf7812de tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:26.230239 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f983637f-bcad-4f0c-b949-d363cf7812de tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:26.231179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f983637f-bcad-4f0c-b949-d363cf7812de tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:26.231780 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f983637f-bcad-4f0c-b949-d363cf7812de tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:26.745508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f983637f-bcad-4f0c-b949-d363cf7812de tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:26.793711 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f983637f-bcad-4f0c-b949-d363cf7812de tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 200 len: 1216 microversion: 2.1 time: 0.623218 Jul 31 01:18:26.811374 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1251/2490] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:26 2022] GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 1216 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:27.056304 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fcfde2da-ddc7-44da-b34c-17d54fa45680 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:27.057447 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fcfde2da-ddc7-44da-b34c-17d54fa45680 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:27.072305 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:27.074806 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcfde2da-ddc7-44da-b34c-17d54fa45680 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:27.076551 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcfde2da-ddc7-44da-b34c-17d54fa45680 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:27.077671 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcfde2da-ddc7-44da-b34c-17d54fa45680 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:27.080238 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcfde2da-ddc7-44da-b34c-17d54fa45680 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:27.200103 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-da88e2b9-feeb-4a99-b3d9-bfb8864016b2 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedea9b1dc0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:27.309769 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-da88e2b9-feeb-4a99-b3d9-bfb8864016b2 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.121930 Jul 31 01:18:27.316772 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1252/2491] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:27 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:27.335573 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3ae7d5d7-c980-4049-a9f9-ed41c991a206 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:27.352625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3ae7d5d7-c980-4049-a9f9-ed41c991a206 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:27.402663 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ae7d5d7-c980-4049-a9f9-ed41c991a206 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:27.403526 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ae7d5d7-c980-4049-a9f9-ed41c991a206 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:27.405233 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ae7d5d7-c980-4049-a9f9-ed41c991a206 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:27.410273 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ae7d5d7-c980-4049-a9f9-ed41c991a206 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:28.233009 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:28.337580 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fcfde2da-ddc7-44da-b34c-17d54fa45680 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:28.363753 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fcfde2da-ddc7-44da-b34c-17d54fa45680 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1313 microversion: 2.1 time: 1.297676 Jul 31 01:18:28.366716 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1240/2492] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:27 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1313 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:28.381795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-447ac493-711b-4af7-886f-c0b53f510117 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:28.382805 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-447ac493-711b-4af7-886f-c0b53f510117 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:28.398412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-447ac493-711b-4af7-886f-c0b53f510117 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:28.400776 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-447ac493-711b-4af7-886f-c0b53f510117 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:28.402270 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-447ac493-711b-4af7-886f-c0b53f510117 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:28.405691 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-447ac493-711b-4af7-886f-c0b53f510117 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:28.438889 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3ae7d5d7-c980-4049-a9f9-ed41c991a206 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2074f35abf4032ab99ec20f3afc57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cd99ab55534716b181e34f17442c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:28.453036 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3ae7d5d7-c980-4049-a9f9-ed41c991a206 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 200 len: 1470 microversion: 2.1 time: 1.134451 Jul 31 01:18:28.460331 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1253/2493] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:27 2022] GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 1470 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:28.700858 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-447ac493-711b-4af7-886f-c0b53f510117 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:28.718884 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-447ac493-711b-4af7-886f-c0b53f510117 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 200 len: 1278 microversion: 2.1 time: 0.350620 Jul 31 01:18:28.721280 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1241/2494] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:28 2022] GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 1278 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:28.735255 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7fd2397f-79ce-445b-82f9-2df706fc744d tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede55a69d0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:28.896843 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7fd2397f-79ce-445b-82f9-2df706fc744d tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.172048 Jul 31 01:18:28.897495 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1242/2495] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:28 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:29.282709 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-069e607e-e9b2-4ec6-85f3-94ba2ccf4c62 req-ad060acf-69a9-48ee-a374-b599fe988e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9d7608-d9aa-462b-bba2-d6653bdb63c1", "name": "network-vif-deleted", "tag": "c0ceb8b9-8f50-4801-922c-f49ef93054f6"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:29.341305 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-069e607e-e9b2-4ec6-85f3-94ba2ccf4c62 req-ad060acf-69a9-48ee-a374-b599fe988e46 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:29.344064 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-069e607e-e9b2-4ec6-85f3-94ba2ccf4c62 req-ad060acf-69a9-48ee-a374-b599fe988e46 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:29.356262 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-db9b9000-adb6-49f6-a407-9b16e267b10b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'create', calling method: .version_select at 0x7fede55f8550>, body: {"keypair": {"name": "tempest-keypair-1644209376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIk1tTr44HbzguXGaekXigHVL5gOw8kn7Q45G7XYNTl2oAvmYgf+1SC1Y0v/sxsRkUAM8rTFWC5f2tQSMO6Uxw9xaEYZl1lbGVKiOu6MruTdNWX5XWPWYYmpqPzy2Z5IUw=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:29.389726 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-069e607e-e9b2-4ec6-85f3-94ba2ccf4c62 req-ad060acf-69a9-48ee-a374-b599fe988e46 service nova] Creating event network-vif-deleted:c0ceb8b9-8f50-4801-922c-f49ef93054f6 for instance ce9d7608-d9aa-462b-bba2-d6653bdb63c1 on n-h2-master-1 Jul 31 01:18:29.403288 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-069e607e-e9b2-4ec6-85f3-94ba2ccf4c62 req-ad060acf-69a9-48ee-a374-b599fe988e46 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128628 Jul 31 01:18:29.404776 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1243/2496] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:29.415946 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-08c87cdb-ec44-4502-b163-918bc65b0f98 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:29.417419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-08c87cdb-ec44-4502-b163-918bc65b0f98 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:29.435764 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08c87cdb-ec44-4502-b163-918bc65b0f98 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:29.438010 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08c87cdb-ec44-4502-b163-918bc65b0f98 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:29.441728 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08c87cdb-ec44-4502-b163-918bc65b0f98 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:29.445442 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08c87cdb-ec44-4502-b163-918bc65b0f98 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:29.461872 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-db9b9000-adb6-49f6-a407-9b16e267b10b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Getting quotas for project da596310058e4248bf33465f387956f2. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:18:29.499163 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-db9b9000-adb6-49f6-a407-9b16e267b10b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Getting quotas for user 36a36dbb4f6c40a7bb69c8c3f747aaed and project da596310058e4248bf33465f387956f2. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:18:29.603210 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-db9b9000-adb6-49f6-a407-9b16e267b10b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.140810 Jul 31 01:18:29.613316 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1254/2497] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:18:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:29.660117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-38e49550-6143-4637-b22c-6abb0c09a460 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:29.668014 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-38e49550-6143-4637-b22c-6abb0c09a460 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:29.710176 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38e49550-6143-4637-b22c-6abb0c09a460 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:29.712018 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38e49550-6143-4637-b22c-6abb0c09a460 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:29.717709 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38e49550-6143-4637-b22c-6abb0c09a460 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:29.720810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38e49550-6143-4637-b22c-6abb0c09a460 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:29.878068 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38e49550-6143-4637-b22c-6abb0c09a460 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:29.881598 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38e49550-6143-4637-b22c-6abb0c09a460 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:29.882971 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-38e49550-6143-4637-b22c-6abb0c09a460 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lazy-loading 'fault' on Instance uuid ce9d7608-d9aa-462b-bba2-d6653bdb63c1 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:18:30.429839 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-38e49550-6143-4637-b22c-6abb0c09a460 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2074f35abf4032ab99ec20f3afc57e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64cd99ab55534716b181e34f17442c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:30.444799 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-38e49550-6143-4637-b22c-6abb0c09a460 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 200 len: 1304 microversion: 2.1 time: 0.829026 Jul 31 01:18:30.447782 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1255/2498] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:29 2022] GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 1304 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:30.462330 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fff1fd48-6c38-4e97-857b-acee6a7a2c63 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:30.467109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fff1fd48-6c38-4e97-857b-acee6a7a2c63 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:30.483283 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fff1fd48-6c38-4e97-857b-acee6a7a2c63 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:30.484708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fff1fd48-6c38-4e97-857b-acee6a7a2c63 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:30.486361 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fff1fd48-6c38-4e97-857b-acee6a7a2c63 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:30.489035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fff1fd48-6c38-4e97-857b-acee6a7a2c63 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:30.753519 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fff1fd48-6c38-4e97-857b-acee6a7a2c63 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:30.766297 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-08c87cdb-ec44-4502-b163-918bc65b0f98 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:30.779084 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-08c87cdb-ec44-4502-b163-918bc65b0f98 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1313 microversion: 2.1 time: 1.372464 Jul 31 01:18:30.781754 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1244/2499] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:29 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1313 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:30.793807 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-698de9d3-d58f-4bd8-9010-5f84ad90ae04 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedeaa530d0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:30.804572 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fff1fd48-6c38-4e97-857b-acee6a7a2c63 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 200 len: 1278 microversion: 2.1 time: 0.342863 Jul 31 01:18:30.805797 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1256/2500] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:30 2022] GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 1278 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:30.873700 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-698de9d3-d58f-4bd8-9010-5f84ad90ae04 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.090576 Jul 31 01:18:30.880967 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1245/2501] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:30 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:31.471329 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6bebf37c-5437-4b0d-9808-91236f5d7b82 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:31.472408 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6bebf37c-5437-4b0d-9808-91236f5d7b82 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] [instance: ce9d7608-d9aa-462b-bba2-d6653bdb63c1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:31.493383 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6bebf37c-5437-4b0d-9808-91236f5d7b82 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:31.494167 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6bebf37c-5437-4b0d-9808-91236f5d7b82 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:31.496547 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6bebf37c-5437-4b0d-9808-91236f5d7b82 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:31.499288 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6bebf37c-5437-4b0d-9808-91236f5d7b82 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:31.544249 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-6bebf37c-5437-4b0d-9808-91236f5d7b82 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] HTTP exception thrown: Instance ce9d7608-d9aa-462b-bba2-d6653bdb63c1 could not be found. Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6bebf37c-5437-4b0d-9808-91236f5d7b82 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Request method failure captured: Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 HTTP/1.1 Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dg7K1u-HAsqHvWgymGmuFJfKOSpDdzGcouvnLzvkQh_0Xb7C82PKhj6fZ978M2Mp5F4u8E8OommyS302ZEPYffFcxFYaYEtwQU9jhmwfXHul39YzuxFPo-_ZIy6UG2aBNaluhBW-QkqR6v5KrphOxO0J8jSWuXTxzUlUGdPhiwbOgo Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 64cd99ab55534716b181e34f17442c7f Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TenantUsagesTestJSON-1332495451 Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/64cd99ab55534716b181e34f17442c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/64cd99ab55534716b181e34f17442c7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/64cd99ab55534716b181e34f17442c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_64cd99ab55534716b181e34f17442c7f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TenantUsagesTestJSON-1332495451 Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 64cd99ab55534716b181e34f17442c7f Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1332495451 Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TenantUsagesTestJSON-1332495451-project Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: ab2074f35abf4032ab99ec20f3afc57e Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TenantUsagesTestJSON-1332495451-project Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: exception: Instance ce9d7608-d9aa-462b-bba2-d6653bdb63c1 could not be found. Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'ce9d7608-d9aa-462b-bba2-d6653bdb63c1'} Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9d7608-d9aa-462b-bba2-d6653bdb63c1 could not be found. Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9d7608-d9aa-462b-bba2-d6653bdb63c1 could not be found. Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:31.549349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:31.559112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:31.559112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:31.559112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:31.559112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:18:31.559112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:18:31.559112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9d7608-d9aa-462b-bba2-d6653bdb63c1 could not be found. Jul 31 01:18:31.559112 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:31.561706 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6bebf37c-5437-4b0d-9808-91236f5d7b82 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] Returning 404 to user: Instance ce9d7608-d9aa-462b-bba2-d6653bdb63c1 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:18:31.562877 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6bebf37c-5437-4b0d-9808-91236f5d7b82 tempest-TenantUsagesTestJSON-1332495451 tempest-TenantUsagesTestJSON-1332495451-project] 10.222.0.45 "GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1" status: 404 len: 111 microversion: 2.1 time: 0.097261 Jul 31 01:18:31.564970 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1257/2502] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:31 2022] GET /compute/v2.1/servers/ce9d7608-d9aa-462b-bba2-d6653bdb63c1 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:18:31.804922 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0473364d-83ce-44c8-a3fe-f821f1e8acce tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:31.806141 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0473364d-83ce-44c8-a3fe-f821f1e8acce tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:31.825915 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0473364d-83ce-44c8-a3fe-f821f1e8acce tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:31.826659 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0473364d-83ce-44c8-a3fe-f821f1e8acce tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:31.827898 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0473364d-83ce-44c8-a3fe-f821f1e8acce tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:31.828699 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0473364d-83ce-44c8-a3fe-f821f1e8acce tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:31.830544 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e27e1c66-439f-42e6-8002-e97e8e3037e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:31.832680 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e27e1c66-439f-42e6-8002-e97e8e3037e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:31.855689 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e27e1c66-439f-42e6-8002-e97e8e3037e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:31.856478 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e27e1c66-439f-42e6-8002-e97e8e3037e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:31.857584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e27e1c66-439f-42e6-8002-e97e8e3037e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:31.858275 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e27e1c66-439f-42e6-8002-e97e8e3037e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:32.200826 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e27e1c66-439f-42e6-8002-e97e8e3037e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:32.212545 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e27e1c66-439f-42e6-8002-e97e8e3037e8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 200 len: 1278 microversion: 2.1 time: 0.388842 Jul 31 01:18:32.217256 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1258/2503] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:31 2022] GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 1278 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:32.241975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-48cf8fdc-d533-4c67-bd26-2294392a7ce2 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedea9b1550>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:32.414991 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-48cf8fdc-d533-4c67-bd26-2294392a7ce2 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.187035 Jul 31 01:18:32.419289 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1259/2504] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:32 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:32.934727 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0473364d-83ce-44c8-a3fe-f821f1e8acce tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:32.949758 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0473364d-83ce-44c8-a3fe-f821f1e8acce tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1313 microversion: 2.1 time: 1.150951 Jul 31 01:18:32.951664 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1246/2505] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:31 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1313 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:33.241750 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-23517daa-862e-4177-a5da-3b4357d3ff01 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:33.242375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-23517daa-862e-4177-a5da-3b4357d3ff01 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:33.258595 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23517daa-862e-4177-a5da-3b4357d3ff01 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:33.259509 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23517daa-862e-4177-a5da-3b4357d3ff01 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:33.260797 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23517daa-862e-4177-a5da-3b4357d3ff01 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:33.261485 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23517daa-862e-4177-a5da-3b4357d3ff01 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:33.444907 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8f00680b-96f4-4586-a0e7-dc71342af19d tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede588f0d0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:33.543137 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8f00680b-96f4-4586-a0e7-dc71342af19d tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.103025 Jul 31 01:18:33.571885 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1247/2506] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:33 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:18:33.905641 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:33.981384 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ddd54549-44e0-41c6-8bc8-a1bc85219a7b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:33.983108 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ddd54549-44e0-41c6-8bc8-a1bc85219a7b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:34.000451 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddd54549-44e0-41c6-8bc8-a1bc85219a7b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:34.000926 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddd54549-44e0-41c6-8bc8-a1bc85219a7b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:34.008690 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddd54549-44e0-41c6-8bc8-a1bc85219a7b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:34.011019 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddd54549-44e0-41c6-8bc8-a1bc85219a7b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:34.249640 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=8 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:34.624074 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-23517daa-862e-4177-a5da-3b4357d3ff01 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:34.654018 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-23517daa-862e-4177-a5da-3b4357d3ff01 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 200 len: 1320 microversion: 2.1 time: 1.417578 Jul 31 01:18:34.657481 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1260/2507] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:33 2022] GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 1320 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:34.673981 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-52c93fdf-0389-44ee-9181-dcd48af62c5b req-39d83843-9d47-44c5-a22a-0094db4c1266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe0ea96-0654-4e48-a079-d876355232c8", "tag": "beb3a534-9a39-4c7d-bff6-542253cd9b59"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:34.695476 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-52c93fdf-0389-44ee-9181-dcd48af62c5b req-39d83843-9d47-44c5-a22a-0094db4c1266 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:34.696292 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-52c93fdf-0389-44ee-9181-dcd48af62c5b req-39d83843-9d47-44c5-a22a-0094db4c1266 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:34.716378 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-52c93fdf-0389-44ee-9181-dcd48af62c5b req-39d83843-9d47-44c5-a22a-0094db4c1266 service nova] Creating event network-changed:beb3a534-9a39-4c7d-bff6-542253cd9b59 for instance fbe0ea96-0654-4e48-a079-d876355232c8 on n-h2-master-1 Jul 31 01:18:34.729023 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-52c93fdf-0389-44ee-9181-dcd48af62c5b req-39d83843-9d47-44c5-a22a-0094db4c1266 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068227 Jul 31 01:18:34.731557 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1261/2508] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:34.742149 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a8542158-ec39-44b7-ad07-9f9afdb48f4d tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede48a4280>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:34.851866 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a8542158-ec39-44b7-ad07-9f9afdb48f4d tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1454 microversion: 2.1 time: 0.117345 Jul 31 01:18:34.855077 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1262/2509] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:34 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:34.870966 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-5880d8c2-818f-4506-9b90-e885786e8214 req-e4b6d8fa-b323-4757-a129-ab1f18d37806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f43b4b8e-a135-4dbd-886f-8b8a7c396bd1", "tag": "ce126f1b-8ca9-4952-b9c7-e8bcfc30dc81"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:34.877978 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ddd54549-44e0-41c6-8bc8-a1bc85219a7b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:34.898546 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5880d8c2-818f-4506-9b90-e885786e8214 req-e4b6d8fa-b323-4757-a129-ab1f18d37806 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:34.898847 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ddd54549-44e0-41c6-8bc8-a1bc85219a7b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1313 microversion: 2.1 time: 0.923591 Jul 31 01:18:34.899936 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1248/2510] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:33 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1313 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:18:34.917688 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5880d8c2-818f-4506-9b90-e885786e8214 req-e4b6d8fa-b323-4757-a129-ab1f18d37806 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:35.049091 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-5880d8c2-818f-4506-9b90-e885786e8214 req-e4b6d8fa-b323-4757-a129-ab1f18d37806 service nova] Creating event network-changed:ce126f1b-8ca9-4952-b9c7-e8bcfc30dc81 for instance f43b4b8e-a135-4dbd-886f-8b8a7c396bd1 on n-h1-master-1 Jul 31 01:18:35.063583 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-5880d8c2-818f-4506-9b90-e885786e8214 req-e4b6d8fa-b323-4757-a129-ab1f18d37806 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205611 Jul 31 01:18:35.067990 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1263/2511] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:35.681176 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-80a919ca-8fd7-4230-b7fc-a3dc22b51177 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:35.682208 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-80a919ca-8fd7-4230-b7fc-a3dc22b51177 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:35.717663 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80a919ca-8fd7-4230-b7fc-a3dc22b51177 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:35.720694 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80a919ca-8fd7-4230-b7fc-a3dc22b51177 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:35.725057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80a919ca-8fd7-4230-b7fc-a3dc22b51177 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:35.728677 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80a919ca-8fd7-4230-b7fc-a3dc22b51177 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:35.884497 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a62cb470-2289-4a1b-baa1-71ad515e3f8f tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede53e7670>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:35.960082 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a62cb470-2289-4a1b-baa1-71ad515e3f8f tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1463 microversion: 2.1 time: 0.092850 Jul 31 01:18:35.962201 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1264/2512] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:35 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1463 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:35.967296 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6866d2fe-9d70-4c87-99fb-9c2319943075 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:35.968170 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6866d2fe-9d70-4c87-99fb-9c2319943075 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:35.984321 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6866d2fe-9d70-4c87-99fb-9c2319943075 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:35.984773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6866d2fe-9d70-4c87-99fb-9c2319943075 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:35.985619 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6866d2fe-9d70-4c87-99fb-9c2319943075 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:35.986317 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6866d2fe-9d70-4c87-99fb-9c2319943075 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:36.223592 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-80a919ca-8fd7-4230-b7fc-a3dc22b51177 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:36.235640 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-80a919ca-8fd7-4230-b7fc-a3dc22b51177 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 200 len: 1320 microversion: 2.1 time: 0.561191 Jul 31 01:18:36.245149 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1249/2513] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:35 2022] GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 1320 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:18:36.257632 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b112628d-9195-421d-b5cc-86067470151a tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedeaa40940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:36.329320 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b112628d-9195-421d-b5cc-86067470151a tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 200 len: 1463 microversion: 2.1 time: 0.082075 Jul 31 01:18:36.330770 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1250/2514] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:36 2022] GET /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 1463 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:36.377511 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6866d2fe-9d70-4c87-99fb-9c2319943075 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:36.385155 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-88072273-bb4c-40a9-ac90-98471662bfba tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:36.389009 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-88072273-bb4c-40a9-ac90-98471662bfba tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cf0c39f6-2c6a-4eb3-9176-7d20151b0adb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:36.395281 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6866d2fe-9d70-4c87-99fb-9c2319943075 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1313 microversion: 2.1 time: 0.431895 Jul 31 01:18:36.399704 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1265/2515] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:35 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:36.400169 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88072273-bb4c-40a9-ac90-98471662bfba tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:36.400734 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88072273-bb4c-40a9-ac90-98471662bfba tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:36.401992 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88072273-bb4c-40a9-ac90-98471662bfba tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:36.402566 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88072273-bb4c-40a9-ac90-98471662bfba tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:36.701174 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-88072273-bb4c-40a9-ac90-98471662bfba tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:36.713673 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-88072273-bb4c-40a9-ac90-98471662bfba tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb" status: 200 len: 1481 microversion: 2.1 time: 0.347657 Jul 31 01:18:36.714351 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1251/2516] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:36 2022] GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb => generated 1481 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:37.122726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-90a1b082-5994-42ba-8938-6a02703e8a44 req-6c1ab41f-26df-4002-b6fc-3765faf3e541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "619b940f-1846-459d-9b47-8d2ee3c907c0", "tag": "34f13022-c348-4ce3-a22a-3feadeaea7d2"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:37.159863 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-90a1b082-5994-42ba-8938-6a02703e8a44 req-6c1ab41f-26df-4002-b6fc-3765faf3e541 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:37.164659 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-90a1b082-5994-42ba-8938-6a02703e8a44 req-6c1ab41f-26df-4002-b6fc-3765faf3e541 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:37.224316 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-90a1b082-5994-42ba-8938-6a02703e8a44 req-6c1ab41f-26df-4002-b6fc-3765faf3e541 service nova] Creating event network-changed:34f13022-c348-4ce3-a22a-3feadeaea7d2 for instance 619b940f-1846-459d-9b47-8d2ee3c907c0 on n-h2-master-1 Jul 31 01:18:37.232671 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-90a1b082-5994-42ba-8938-6a02703e8a44 req-6c1ab41f-26df-4002-b6fc-3765faf3e541 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115105 Jul 31 01:18:37.234219 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1266/2517] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:18:37.263707 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-405df011-ab31-4e22-84eb-822811130a12 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:37.265257 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-405df011-ab31-4e22-84eb-822811130a12 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:37.277807 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-405df011-ab31-4e22-84eb-822811130a12 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:37.278905 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-405df011-ab31-4e22-84eb-822811130a12 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:37.280603 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-405df011-ab31-4e22-84eb-822811130a12 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:37.281616 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-405df011-ab31-4e22-84eb-822811130a12 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:37.427780 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d556fe73-82f2-4d1e-8544-95120d4b9a60 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:37.428593 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d556fe73-82f2-4d1e-8544-95120d4b9a60 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:37.436013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d556fe73-82f2-4d1e-8544-95120d4b9a60 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:37.436926 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d556fe73-82f2-4d1e-8544-95120d4b9a60 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:37.438177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d556fe73-82f2-4d1e-8544-95120d4b9a60 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:37.438772 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d556fe73-82f2-4d1e-8544-95120d4b9a60 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:37.740531 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-405df011-ab31-4e22-84eb-822811130a12 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:37.763736 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-405df011-ab31-4e22-84eb-822811130a12 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 200 len: 1320 microversion: 2.1 time: 0.500103 Jul 31 01:18:37.764440 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1252/2518] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:37 2022] GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 1320 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:37.770149 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f7a0c1f9-74b4-4f2c-89da-e1a7931ff7ea tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:37.776396 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f7a0c1f9-74b4-4f2c-89da-e1a7931ff7ea tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cf0c39f6-2c6a-4eb3-9176-7d20151b0adb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:37.791695 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7a0c1f9-74b4-4f2c-89da-e1a7931ff7ea tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:37.792434 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7a0c1f9-74b4-4f2c-89da-e1a7931ff7ea tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:37.793746 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7a0c1f9-74b4-4f2c-89da-e1a7931ff7ea tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:37.794191 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7a0c1f9-74b4-4f2c-89da-e1a7931ff7ea tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:37.830274 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:37.996670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d556fe73-82f2-4d1e-8544-95120d4b9a60 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:38.026296 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d556fe73-82f2-4d1e-8544-95120d4b9a60 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1313 microversion: 2.1 time: 0.610382 Jul 31 01:18:38.028376 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1267/2519] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:37 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1313 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:38.283797 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7685216f-8417-4fb8-b07c-9b16ffaf85a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1528914317", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97fe48eb-b52c-4abc-b249-8d6775315204"}], "security_groups": [{"name": "tempest-securitygroup--312053178"}], "key_name": "tempest-keypair-1644209376", "user_data": "}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:38.312227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f7a0c1f9-74b4-4f2c-89da-e1a7931ff7ea tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:38.325699 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f7a0c1f9-74b4-4f2c-89da-e1a7931ff7ea tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb" status: 200 len: 1468 microversion: 2.1 time: 0.558594 Jul 31 01:18:38.327977 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1253/2520] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:37 2022] GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb => generated 1468 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:38.358639 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a1070670-5116-48e8-8ece-8b8f4e834292 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedeaa9f700>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:38.552773 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a1070670-5116-48e8-8ece-8b8f4e834292 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images?changes-since=2022-07-31T01%3A16%3A17Z" status: 200 len: 1901 microversion: 2.1 time: 0.199904 Jul 31 01:18:38.567648 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1254/2521] 10.222.0.45 () {58 vars in 1199 bytes} [Sun Jul 31 01:18:38 2022] GET /compute/v2.1/images?changes-since=2022-07-31T01%3A16%3A17Z => generated 1901 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:38.582240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0cf2267d-f0d3-4795-b0c9-37f48f9a666f tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede560a790>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:38.587527 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-7685216f-8417-4fb8-b07c-9b16ffaf85a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] validate_networks() for [('97fe48eb-b52c-4abc-b249-8d6775315204', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:18:38.746530 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0cf2267d-f0d3-4795-b0c9-37f48f9a666f tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1072334628" status: 200 len: 485 microversion: 2.1 time: 0.173039 Jul 31 01:18:38.747786 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1255/2522] 10.222.0.45 () {58 vars in 1231 bytes} [Sun Jul 31 01:18:38 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1072334628 => generated 485 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:38.768534 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6ac1382f-6f17-4dd2-8c02-922cc2da1600 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede57bd820>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:39.000161 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6ac1382f-6f17-4dd2-8c02-922cc2da1600 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images?server=cf0c39f6-2c6a-4eb3-9176-7d20151b0adb" status: 200 len: 956 microversion: 2.1 time: 0.241897 Jul 31 01:18:39.001180 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1256/2523] 10.222.0.45 () {58 vars in 1209 bytes} [Sun Jul 31 01:18:38 2022] GET /compute/v2.1/images?server=cf0c39f6-2c6a-4eb3-9176-7d20151b0adb => generated 956 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:39.009348 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-46d6dd73-d37c-4331-b825-e76089fbb284 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:39.010322 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-46d6dd73-d37c-4331-b825-e76089fbb284 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:39.023053 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46d6dd73-d37c-4331-b825-e76089fbb284 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:39.023947 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46d6dd73-d37c-4331-b825-e76089fbb284 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:39.025800 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46d6dd73-d37c-4331-b825-e76089fbb284 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:39.027962 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46d6dd73-d37c-4331-b825-e76089fbb284 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:39.530274 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=12 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:40.110816 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-46d6dd73-d37c-4331-b825-e76089fbb284 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:40.125158 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-46d6dd73-d37c-4331-b825-e76089fbb284 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 200 len: 1320 microversion: 2.1 time: 1.120551 Jul 31 01:18:40.125814 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1257/2524] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:39 2022] GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 1320 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:40.149469 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f33f4d7b-8a1e-4bbd-bf60-e578add8d3cc tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedeaa61c10>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:40.268028 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f33f4d7b-8a1e-4bbd-bf60-e578add8d3cc tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.45%2Fcompute%2Fv2.1%2Fservers%2Fcdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 485 microversion: 2.1 time: 0.140926 Jul 31 01:18:40.269191 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1258/2525] 10.222.0.45 () {58 vars in 1317 bytes} [Sun Jul 31 01:18:40 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.45%2Fcompute%2Fv2.1%2Fservers%2Fcdf56656-f786-439a-8d92-a4365424d0d7 => generated 485 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:40.281127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5b04c332-bd31-4ca3-b204-71191a7d50fc tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:40.282174 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5b04c332-bd31-4ca3-b204-71191a7d50fc tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:40.297446 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b04c332-bd31-4ca3-b204-71191a7d50fc tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:40.298127 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b04c332-bd31-4ca3-b204-71191a7d50fc tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:40.300247 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b04c332-bd31-4ca3-b204-71191a7d50fc tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:40.300726 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b04c332-bd31-4ca3-b204-71191a7d50fc tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:40.582853 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7685216f-8417-4fb8-b07c-9b16ffaf85a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:18:40.583309 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7685216f-8417-4fb8-b07c-9b16ffaf85a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:18:40.583789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7685216f-8417-4fb8-b07c-9b16ffaf85a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:18:40.584202 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7685216f-8417-4fb8-b07c-9b16ffaf85a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:18:40.585457 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7685216f-8417-4fb8-b07c-9b16ffaf85a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:18:40.617045 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7685216f-8417-4fb8-b07c-9b16ffaf85a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:40.617502 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7685216f-8417-4fb8-b07c-9b16ffaf85a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:40.618365 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7685216f-8417-4fb8-b07c-9b16ffaf85a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:40.618809 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7685216f-8417-4fb8-b07c-9b16ffaf85a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:40.708171 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7685216f-8417-4fb8-b07c-9b16ffaf85a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Getting quotas for project da596310058e4248bf33465f387956f2. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:18:40.715688 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7685216f-8417-4fb8-b07c-9b16ffaf85a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Getting quotas for user 36a36dbb4f6c40a7bb69c8c3f747aaed and project da596310058e4248bf33465f387956f2. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:18:40.763378 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5b04c332-bd31-4ca3-b204-71191a7d50fc tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:40.767830 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7685216f-8417-4fb8-b07c-9b16ffaf85a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:18:40.772015 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5b04c332-bd31-4ca3-b204-71191a7d50fc tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1313 microversion: 2.1 time: 0.501734 Jul 31 01:18:40.776441 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1259/2526] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:40 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:40.777458 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7685216f-8417-4fb8-b07c-9b16ffaf85a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:18:40.786201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-6c0fccad-0ef9-4567-972f-ed0fe352826e req-e0f938e5-a54a-490b-a72d-24a7919490f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf0c39f6-2c6a-4eb3-9176-7d20151b0adb", "name": "network-vif-unplugged", "status": "completed", "tag": "cf150970-8f1a-4d54-b48d-7de2be48f7e1"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:40.805287 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-6c0fccad-0ef9-4567-972f-ed0fe352826e req-e0f938e5-a54a-490b-a72d-24a7919490f3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:40.805735 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-6c0fccad-0ef9-4567-972f-ed0fe352826e req-e0f938e5-a54a-490b-a72d-24a7919490f3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:40.835908 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-6c0fccad-0ef9-4567-972f-ed0fe352826e req-e0f938e5-a54a-490b-a72d-24a7919490f3 service nova] Creating event network-vif-unplugged:cf150970-8f1a-4d54-b48d-7de2be48f7e1 for instance cf0c39f6-2c6a-4eb3-9176-7d20151b0adb on n-h2-master-1 Jul 31 01:18:40.845813 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-6c0fccad-0ef9-4567-972f-ed0fe352826e req-e0f938e5-a54a-490b-a72d-24a7919490f3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067809 Jul 31 01:18:40.848910 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:40.850535 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1260/2527] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:40.864724 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-58b02ac3-4980-40d3-ba11-0fc98d53ccbc tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedeaa53940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:40.970901 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-58b02ac3-4980-40d3-ba11-0fc98d53ccbc tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.45%2Fcompute%2Fservers%2Fcdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 485 microversion: 2.1 time: 0.118040 Jul 31 01:18:40.971550 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1261/2528] 10.222.0.45 () {58 vars in 1303 bytes} [Sun Jul 31 01:18:40 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.45%2Fcompute%2Fservers%2Fcdf56656-f786-439a-8d92-a4365424d0d7 => generated 485 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:40.984614 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7685216f-8417-4fb8-b07c-9b16ffaf85a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.711539 Jul 31 01:18:40.990660 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1268/2529] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:18:38 2022] POST /compute/v2.1/servers => generated 408 bytes in 2721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 01:18:41.010961 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cfdeb851-2da2-4a31-aa0a-f69d475524be tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede56628b0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:41.025317 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1fbbab4c-d282-4993-a72d-b7f4dfdebb69 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:41.035457 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1fbbab4c-d282-4993-a72d-b7f4dfdebb69 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:41.246305 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1fbbab4c-d282-4993-a72d-b7f4dfdebb69 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:41.259399 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1fbbab4c-d282-4993-a72d-b7f4dfdebb69 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1239 microversion: 2.1 time: 0.261243 Jul 31 01:18:41.260644 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1269/2530] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:40 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1239 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:41.263155 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cfdeb851-2da2-4a31-aa0a-f69d475524be tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.278280 Jul 31 01:18:41.263754 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1262/2531] 10.222.0.45 () {58 vars in 1149 bytes} [Sun Jul 31 01:18:40 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:41.296980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-53ccf43b-f8e7-4ce6-83ca-ec23b041f108 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:41.303451 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-53ccf43b-f8e7-4ce6-83ca-ec23b041f108 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:41.318327 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53ccf43b-f8e7-4ce6-83ca-ec23b041f108 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:41.318789 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53ccf43b-f8e7-4ce6-83ca-ec23b041f108 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:41.321697 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53ccf43b-f8e7-4ce6-83ca-ec23b041f108 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:41.322067 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53ccf43b-f8e7-4ce6-83ca-ec23b041f108 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:41.587190 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7b3bc94c-eaf3-4e07-88c2-94f8dfbb6e57 tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] 10.222.0.45 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.325019 Jul 31 01:18:41.588208 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1270/2532] 10.222.0.45 () {58 vars in 1128 bytes} [Sun Jul 31 01:18:41 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 31 01:18:41.601834 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-02108398-d434-4599-9f1e-b617c94498df tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede55f88b0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:41.650557 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-53ccf43b-f8e7-4ce6-83ca-ec23b041f108 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:41.659269 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-53ccf43b-f8e7-4ce6-83ca-ec23b041f108 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 200 len: 1320 microversion: 2.1 time: 0.375137 Jul 31 01:18:41.664889 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1263/2533] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:41 2022] GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 1320 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:41.674943 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e1e66df8-4c5c-4937-aa7a-08066204e734 tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] Calling method '.version_select at 0x7fede557bb80>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:41.714674 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-e1e66df8-4c5c-4937-aa7a-08066204e734 tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] HTTP exception thrown: Image not found. Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e1e66df8-4c5c-4937-aa7a-08066204e734 tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] Request method failure captured: Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dhwL_qjHXvV6X9ZVf2x87I7QJo0LBLWxK7cNfcMPq_tyK8ZXXF0a2N0MAYzn_D75nrbxbOiaJeNagRSlEBuyR7yNHTCmG26XIkXpkNgf04r4_z92ydImOt2zFOCcESNwn8yL-mAHYwb0KBqCmgTYBZLhtecNLVl52PgUbjRpcvPklM Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: ab085866abfa46d294ba0351d8e9cea2 Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-232819410 Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab085866abfa46d294ba0351d8e9cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab085866abfa46d294ba0351d8e9cea2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ab085866abfa46d294ba0351d8e9cea2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ab085866abfa46d294ba0351d8e9cea2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-232819410 Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: ab085866abfa46d294ba0351d8e9cea2 Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-232819410 Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesDeleteNegativeTestJSON-232819410-project Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: df3489c80c0d451ebc26362c7cc34de6 Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-232819410-project Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: exception: Image not found. Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '-1'} Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.717019 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e1e66df8-4c5c-4937-aa7a-08066204e734 tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] Returning 404 to user: Image not found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e1e66df8-4c5c-4937-aa7a-08066204e734 tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] 10.222.0.45 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.048404 Jul 31 01:18:41.724099 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1264/2534] 10.222.0.45 () {58 vars in 1134 bytes} [Sun Jul 31 01:18:41 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:18:41.732522 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6e5e7bdc-d164-4168-95e0-409aa69a6655 tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] Calling method '.version_select at 0x7fedeaa531f0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:41.770512 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-02108398-d434-4599-9f1e-b617c94498df tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.181087 Jul 31 01:18:41.771612 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1271/2535] 10.222.0.45 () {58 vars in 1149 bytes} [Sun Jul 31 01:18:41 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:41.785437 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-6e5e7bdc-d164-4168-95e0-409aa69a6655 tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] HTTP exception thrown: Image not found. Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6e5e7bdc-d164-4168-95e0-409aa69a6655 tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] Request method failure captured: Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/images/968d6ffe-c8d2-4d20-8c9c-3903c3c060ej HTTP/1.1 Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dhwL_qjHXvV6X9ZVf2x87I7QJo0LBLWxK7cNfcMPq_tyK8ZXXF0a2N0MAYzn_D75nrbxbOiaJeNagRSlEBuyR7yNHTCmG26XIkXpkNgf04r4_z92ydImOt2zFOCcESNwn8yL-mAHYwb0KBqCmgTYBZLhtecNLVl52PgUbjRpcvPklM Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: ab085866abfa46d294ba0351d8e9cea2 Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-232819410 Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab085866abfa46d294ba0351d8e9cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab085866abfa46d294ba0351d8e9cea2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ab085866abfa46d294ba0351d8e9cea2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ab085866abfa46d294ba0351d8e9cea2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-232819410 Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: ab085866abfa46d294ba0351d8e9cea2 Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-232819410 Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesDeleteNegativeTestJSON-232819410-project Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: df3489c80c0d451ebc26362c7cc34de6 Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-232819410-project Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: exception: Image not found. Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '968d6ffe-c8d2-4d20-8c9c-3903c3c060ej'} Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 968d6ffe-c8d2-4d20-8c9c-3903c3c060ej to delete Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 968d6ffe-c8d2-4d20-8c9c-3903c3c060ej could not be found. Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:41.787758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:18:41.793516 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.796707 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed1c5292-4427-4fc1-b892-3f0e22bd29f5 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedeaa231f0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:41.798633 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6e5e7bdc-d164-4168-95e0-409aa69a6655 tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] Returning 404 to user: Image not found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:18:41.799862 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6e5e7bdc-d164-4168-95e0-409aa69a6655 tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] 10.222.0.45 "DELETE /compute/v2.1/images/968d6ffe-c8d2-4d20-8c9c-3903c3c060ej" status: 404 len: 62 microversion: 2.1 time: 0.072315 Jul 31 01:18:41.800952 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1265/2536] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:41 2022] DELETE /compute/v2.1/images/968d6ffe-c8d2-4d20-8c9c-3903c3c060ej => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 31 01:18:41.810967 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7141b04f-a258-405a-8d00-a570eac40164 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:41.811993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7141b04f-a258-405a-8d00-a570eac40164 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:41.819474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7141b04f-a258-405a-8d00-a570eac40164 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:41.820262 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7141b04f-a258-405a-8d00-a570eac40164 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:41.821334 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7141b04f-a258-405a-8d00-a570eac40164 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:41.822053 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7141b04f-a258-405a-8d00-a570eac40164 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:41.922349 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ed1c5292-4427-4fc1-b892-3f0e22bd29f5 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.140635 Jul 31 01:18:41.923657 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1272/2537] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:18:41 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:41.928666 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7370cdf9-0f54-4817-aaaf-902154a4d55c tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] Calling method '.version_select at 0x7fede48e3160>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:41.946536 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-7370cdf9-0f54-4817-aaaf-902154a4d55c tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] HTTP exception thrown: Image not found. Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7370cdf9-0f54-4817-aaaf-902154a4d55c tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] Request method failure captured: Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/images/13aa28b7-3712-4b27-85d4-2cb7461cc0e91 HTTP/1.1 Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dhwL_qjHXvV6X9ZVf2x87I7QJo0LBLWxK7cNfcMPq_tyK8ZXXF0a2N0MAYzn_D75nrbxbOiaJeNagRSlEBuyR7yNHTCmG26XIkXpkNgf04r4_z92ydImOt2zFOCcESNwn8yL-mAHYwb0KBqCmgTYBZLhtecNLVl52PgUbjRpcvPklM Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: ab085866abfa46d294ba0351d8e9cea2 Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-232819410 Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab085866abfa46d294ba0351d8e9cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab085866abfa46d294ba0351d8e9cea2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ab085866abfa46d294ba0351d8e9cea2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ab085866abfa46d294ba0351d8e9cea2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-232819410 Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: ab085866abfa46d294ba0351d8e9cea2 Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-232819410 Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesDeleteNegativeTestJSON-232819410-project Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: df3489c80c0d451ebc26362c7cc34de6 Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-232819410-project Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: exception: Image not found. Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '13aa28b7-3712-4b27-85d4-2cb7461cc0e91'} Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 13aa28b7-3712-4b27-85d4-2cb7461cc0e91 to delete Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 13aa28b7-3712-4b27-85d4-2cb7461cc0e91 could not be found. Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:41.948737 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:18:41.952994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:41.955268 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7370cdf9-0f54-4817-aaaf-902154a4d55c tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] Returning 404 to user: Image not found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:18:41.956932 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7370cdf9-0f54-4817-aaaf-902154a4d55c tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] 10.222.0.45 "DELETE /compute/v2.1/images/13aa28b7-3712-4b27-85d4-2cb7461cc0e91" status: 404 len: 62 microversion: 2.1 time: 0.031569 Jul 31 01:18:41.958089 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1273/2538] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:18:41 2022] DELETE /compute/v2.1/images/13aa28b7-3712-4b27-85d4-2cb7461cc0e91 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:18:41.964743 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-978565db-5ece-4128-9232-d5892a313e0c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede485aca0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:42.082102 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-978565db-5ece-4128-9232-d5892a313e0c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/detail?changes-since=2022-07-31T01%3A16%3A09Z" status: 200 len: 6333 microversion: 2.1 time: 0.122679 Jul 31 01:18:42.093338 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1274/2539] 10.222.0.45 () {58 vars in 1220 bytes} [Sun Jul 31 01:18:41 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-31T01%3A16%3A09Z => generated 6333 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:42.104648 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-28e773b0-6a3c-41e9-b3c9-894728ade29e tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] Calling method '.version_select at 0x7fedeaa23b80>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:42.137752 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-28e773b0-6a3c-41e9-b3c9-894728ade29e tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] HTTP exception thrown: Image not found. Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-28e773b0-6a3c-41e9-b3c9-894728ade29e tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] Request method failure captured: Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/images/tempest-invalid-1208732531 HTTP/1.1 Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dhwL_qjHXvV6X9ZVf2x87I7QJo0LBLWxK7cNfcMPq_tyK8ZXXF0a2N0MAYzn_D75nrbxbOiaJeNagRSlEBuyR7yNHTCmG26XIkXpkNgf04r4_z92ydImOt2zFOCcESNwn8yL-mAHYwb0KBqCmgTYBZLhtecNLVl52PgUbjRpcvPklM Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: ab085866abfa46d294ba0351d8e9cea2 Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-232819410 Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab085866abfa46d294ba0351d8e9cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab085866abfa46d294ba0351d8e9cea2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ab085866abfa46d294ba0351d8e9cea2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ab085866abfa46d294ba0351d8e9cea2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-232819410 Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: ab085866abfa46d294ba0351d8e9cea2 Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-232819410 Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesDeleteNegativeTestJSON-232819410-project Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: df3489c80c0d451ebc26362c7cc34de6 Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-232819410-project Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: exception: Image not found. Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'tempest-invalid-1208732531'} Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1208732531 to delete Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1208732531 could not be found. Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:42.141340 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:18:42.147305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:42.155219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-28e773b0-6a3c-41e9-b3c9-894728ade29e tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] Returning 404 to user: Image not found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:18:42.156323 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-28e773b0-6a3c-41e9-b3c9-894728ade29e tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] 10.222.0.45 "DELETE /compute/v2.1/images/tempest-invalid-1208732531" status: 404 len: 62 microversion: 2.1 time: 0.061666 Jul 31 01:18:42.157049 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1275/2540] 10.222.0.45 () {58 vars in 1206 bytes} [Sun Jul 31 01:18:42 2022] DELETE /compute/v2.1/images/tempest-invalid-1208732531 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:18:42.170447 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c7fe981f-8d81-4c5b-9056-86db00b5cdda tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede485a790>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:42.258177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7141b04f-a258-405a-8d00-a570eac40164 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:42.266660 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7141b04f-a258-405a-8d00-a570eac40164 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1313 microversion: 2.1 time: 0.464383 Jul 31 01:18:42.270510 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1266/2541] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:41 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:42.284702 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-72f1d42d-b32e-497f-a103-f800fc517027 tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] Calling method '.version_select at 0x7fede565ab80>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:42.323391 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-72f1d42d-b32e-497f-a103-f800fc517027 tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] HTTP exception thrown: Image not found. Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-72f1d42d-b32e-497f-a103-f800fc517027 tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] Request method failure captured: Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/images/a1cf095c-2d98-482f-842c-3a6eac972067 HTTP/1.1 Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dhwL_qjHXvV6X9ZVf2x87I7QJo0LBLWxK7cNfcMPq_tyK8ZXXF0a2N0MAYzn_D75nrbxbOiaJeNagRSlEBuyR7yNHTCmG26XIkXpkNgf04r4_z92ydImOt2zFOCcESNwn8yL-mAHYwb0KBqCmgTYBZLhtecNLVl52PgUbjRpcvPklM Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: ab085866abfa46d294ba0351d8e9cea2 Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-232819410 Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab085866abfa46d294ba0351d8e9cea2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab085866abfa46d294ba0351d8e9cea2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ab085866abfa46d294ba0351d8e9cea2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ab085866abfa46d294ba0351d8e9cea2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-232819410 Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: ab085866abfa46d294ba0351d8e9cea2 Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-232819410 Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesDeleteNegativeTestJSON-232819410-project Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: df3489c80c0d451ebc26362c7cc34de6 Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-232819410-project Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: exception: Image not found. Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'a1cf095c-2d98-482f-842c-3a6eac972067'} Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a1cf095c-2d98-482f-842c-3a6eac972067 to delete Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a1cf095c-2d98-482f-842c-3a6eac972067 could not be found. Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:42.333400 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-72f1d42d-b32e-497f-a103-f800fc517027 tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] Returning 404 to user: Image not found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-72f1d42d-b32e-497f-a103-f800fc517027 tempest-ImagesDeleteNegativeTestJSON-232819410 tempest-ImagesDeleteNegativeTestJSON-232819410-project] 10.222.0.45 "DELETE /compute/v2.1/images/a1cf095c-2d98-482f-842c-3a6eac972067" status: 404 len: 62 microversion: 2.1 time: 0.063393 Jul 31 01:18:42.340193 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1267/2542] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:42 2022] DELETE /compute/v2.1/images/a1cf095c-2d98-482f-842c-3a6eac972067 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:18:42.345503 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f13ef917-485d-45c9-a3ca-18fda7f1f777 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:42.346169 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f13ef917-485d-45c9-a3ca-18fda7f1f777 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:42.354112 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c7fe981f-8d81-4c5b-9056-86db00b5cdda tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1072334628" status: 200 len: 665 microversion: 2.1 time: 0.195848 Jul 31 01:18:42.355171 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1276/2543] 10.222.0.45 () {58 vars in 1252 bytes} [Sun Jul 31 01:18:42 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1072334628 => generated 665 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:42.363930 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f13ef917-485d-45c9-a3ca-18fda7f1f777 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:42.364801 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f13ef917-485d-45c9-a3ca-18fda7f1f777 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:42.365844 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f13ef917-485d-45c9-a3ca-18fda7f1f777 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:42.370958 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e16f425a-d81b-4280-aed4-dc845e50ce7d tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede485a940>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:42.388672 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f13ef917-485d-45c9-a3ca-18fda7f1f777 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:42.458735 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e16f425a-d81b-4280-aed4-dc845e50ce7d tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.45%2Fcompute%2Fv2.1%2Fservers%2Fcdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1467 microversion: 2.1 time: 0.089771 Jul 31 01:18:42.459765 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1277/2544] 10.222.0.45 () {58 vars in 1338 bytes} [Sun Jul 31 01:18:42 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.45%2Fcompute%2Fv2.1%2Fservers%2Fcdf56656-f786-439a-8d92-a4365424d0d7 => generated 1467 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:42.478418 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c7e7ba16-95c3-44b1-9ae2-56d7f6fe8221 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede485af70>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:42.554717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f13ef917-485d-45c9-a3ca-18fda7f1f777 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:42.571258 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f13ef917-485d-45c9-a3ca-18fda7f1f777 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1291 microversion: 2.1 time: 0.234396 Jul 31 01:18:42.574856 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1268/2545] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:42 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1291 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:42.592385 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c7e7ba16-95c3-44b1-9ae2-56d7f6fe8221 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.45%2Fcompute%2Fservers%2Fcdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1467 microversion: 2.1 time: 0.120759 Jul 31 01:18:42.594870 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1278/2546] 10.222.0.45 () {58 vars in 1324 bytes} [Sun Jul 31 01:18:42 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.45%2Fcompute%2Fservers%2Fcdf56656-f786-439a-8d92-a4365424d0d7 => generated 1467 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:42.613211 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-363433a3-bbb1-4d20-8f16-0bb9fc83298b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede58ec280>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:42.688060 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c92ff684-6c51-453e-a3d6-51e3c59e47e0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:42.688820 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c92ff684-6c51-453e-a3d6-51e3c59e47e0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:42.707266 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c92ff684-6c51-453e-a3d6-51e3c59e47e0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:42.708002 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c92ff684-6c51-453e-a3d6-51e3c59e47e0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:42.713611 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c92ff684-6c51-453e-a3d6-51e3c59e47e0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:42.720728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c92ff684-6c51-453e-a3d6-51e3c59e47e0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:42.921035 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-363433a3-bbb1-4d20-8f16-0bb9fc83298b tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.310989 Jul 31 01:18:42.923881 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1269/2547] 10.222.0.45 () {58 vars in 1170 bytes} [Sun Jul 31 01:18:42 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:42.962594 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-befa7119-ae03-48b3-8479-1dde6b8b9d2e tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedea981e50>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:43.088206 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-befa7119-ae03-48b3-8479-1dde6b8b9d2e tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.139719 Jul 31 01:18:43.101888 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1270/2548] 10.222.0.45 () {58 vars in 1170 bytes} [Sun Jul 31 01:18:42 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:43.108826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e74ef2f5-3a39-45de-88ba-04f6f5f147e9 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedea9cc040>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:43.167314 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e74ef2f5-3a39-45de-88ba-04f6f5f147e9 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/0f306572-729b-4b95-a357-79461887e541" status: 200 len: 784 microversion: 2.1 time: 0.063947 Jul 31 01:18:43.168171 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1271/2549] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:43 2022] GET /compute/v2.1/images/0f306572-729b-4b95-a357-79461887e541 => generated 784 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:43.188905 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-29701434-1bac-4c20-b42b-f92e9b963d97 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fedeaa53f70>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:43.348232 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-29701434-1bac-4c20-b42b-f92e9b963d97 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.166620 Jul 31 01:18:43.349147 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1272/2550] 10.222.0.45 () {58 vars in 1158 bytes} [Sun Jul 31 01:18:43 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:43.370478 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-18b2b609-5c49-4db0-8030-a23a1ca89cbd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:43.371266 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-18b2b609-5c49-4db0-8030-a23a1ca89cbd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:43.379990 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18b2b609-5c49-4db0-8030-a23a1ca89cbd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:43.380890 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18b2b609-5c49-4db0-8030-a23a1ca89cbd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:43.381905 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18b2b609-5c49-4db0-8030-a23a1ca89cbd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:43.382540 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18b2b609-5c49-4db0-8030-a23a1ca89cbd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:43.476417 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c92ff684-6c51-453e-a3d6-51e3c59e47e0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:43.494318 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c92ff684-6c51-453e-a3d6-51e3c59e47e0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 200 len: 1320 microversion: 2.1 time: 0.810477 Jul 31 01:18:43.495454 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1279/2551] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:42 2022] GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 1320 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:43.501551 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cac2b494-d1bf-464d-ad8f-633200ac4501 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede486f430>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:43.788379 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-18b2b609-5c49-4db0-8030-a23a1ca89cbd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:43.801443 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-18b2b609-5c49-4db0-8030-a23a1ca89cbd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1313 microversion: 2.1 time: 0.451058 Jul 31 01:18:43.804208 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1273/2552] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:43 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:43.836331 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-05ed0f8b-75c3-43e7-ac5c-270db913d375 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:43.837342 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-05ed0f8b-75c3-43e7-ac5c-270db913d375 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:43.867046 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-05ed0f8b-75c3-43e7-ac5c-270db913d375 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:43.867546 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-05ed0f8b-75c3-43e7-ac5c-270db913d375 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:43.868444 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-05ed0f8b-75c3-43e7-ac5c-270db913d375 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:43.879963 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-05ed0f8b-75c3-43e7-ac5c-270db913d375 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:44.048210 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-05ed0f8b-75c3-43e7-ac5c-270db913d375 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:44.061589 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-05ed0f8b-75c3-43e7-ac5c-270db913d375 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1297 microversion: 2.1 time: 0.256087 Jul 31 01:18:44.062249 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1274/2553] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:43 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1297 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:44.467260 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cac2b494-d1bf-464d-ad8f-633200ac4501 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "DELETE /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e" status: 204 len: 0 microversion: 2.1 time: 0.970190 Jul 31 01:18:44.468050 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1280/2554] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:43 2022] DELETE /compute/v2.1/images/ac7c2f36-e598-4a55-aeeb-d2fff8e88c9e => generated 0 bytes in 972 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:18:44.478154 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1789cbce-91f1-4b57-b632-238aa64be9f3 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede58b4700>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:44.520076 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b8b2ed5e-47f8-43ec-9752-9264acd08a07 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:44.520727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b8b2ed5e-47f8-43ec-9752-9264acd08a07 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:44.536391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b8b2ed5e-47f8-43ec-9752-9264acd08a07 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:44.537198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b8b2ed5e-47f8-43ec-9752-9264acd08a07 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:44.541247 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b8b2ed5e-47f8-43ec-9752-9264acd08a07 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:44.541825 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b8b2ed5e-47f8-43ec-9752-9264acd08a07 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:45.387015 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1789cbce-91f1-4b57-b632-238aa64be9f3 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "DELETE /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb" status: 204 len: 0 microversion: 2.1 time: 0.913096 Jul 31 01:18:45.387655 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1275/2555] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:44 2022] DELETE /compute/v2.1/images/b51ebd05-3a55-4ce8-883b-1190684aecbb => generated 0 bytes in 915 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:18:45.397224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cedc3774-2370-4b91-9412-982f3d966138 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:45.398327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cedc3774-2370-4b91-9412-982f3d966138 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:45.429463 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cedc3774-2370-4b91-9412-982f3d966138 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:45.430708 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cedc3774-2370-4b91-9412-982f3d966138 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:45.434042 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cedc3774-2370-4b91-9412-982f3d966138 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:45.434715 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cedc3774-2370-4b91-9412-982f3d966138 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:45.972532 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b8b2ed5e-47f8-43ec-9752-9264acd08a07 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:45.984033 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b8b2ed5e-47f8-43ec-9752-9264acd08a07 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 200 len: 1320 microversion: 2.1 time: 1.469337 Jul 31 01:18:45.984654 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1281/2556] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:44 2022] GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 1320 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:45.989966 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0b1a4fc8-c16d-405c-9203-1cf9bf8c904e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:45.997223 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0b1a4fc8-c16d-405c-9203-1cf9bf8c904e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:46.019608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b1a4fc8-c16d-405c-9203-1cf9bf8c904e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:46.020166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b1a4fc8-c16d-405c-9203-1cf9bf8c904e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:46.020901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b1a4fc8-c16d-405c-9203-1cf9bf8c904e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:46.021354 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b1a4fc8-c16d-405c-9203-1cf9bf8c904e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:46.196013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cedc3774-2370-4b91-9412-982f3d966138 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:46.208317 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cedc3774-2370-4b91-9412-982f3d966138 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1313 microversion: 2.1 time: 0.813381 Jul 31 01:18:46.222439 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1276/2557] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:45 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1313 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:46.239151 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-36d8ddf7-3561-4e8f-8a44-a0263499280f req-1905b33e-ca59-482c-98a4-5fb7083c5d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe0ea96-0654-4e48-a079-d876355232c8", "name": "network-vif-plugged", "status": "completed", "tag": "beb3a534-9a39-4c7d-bff6-542253cd9b59"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:46.268355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-36d8ddf7-3561-4e8f-8a44-a0263499280f req-1905b33e-ca59-482c-98a4-5fb7083c5d70 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:46.269980 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-36d8ddf7-3561-4e8f-8a44-a0263499280f req-1905b33e-ca59-482c-98a4-5fb7083c5d70 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:46.285947 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0b1a4fc8-c16d-405c-9203-1cf9bf8c904e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:46.310248 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0b1a4fc8-c16d-405c-9203-1cf9bf8c904e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1297 microversion: 2.1 time: 0.324161 Jul 31 01:18:46.333340 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1282/2558] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:45 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1297 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:46.348671 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-36d8ddf7-3561-4e8f-8a44-a0263499280f req-1905b33e-ca59-482c-98a4-5fb7083c5d70 service nova] Creating event network-vif-plugged:beb3a534-9a39-4c7d-bff6-542253cd9b59 for instance fbe0ea96-0654-4e48-a079-d876355232c8 on n-h2-master-1 Jul 31 01:18:46.357203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-03c8cd97-0844-4353-9e18-9801a2be52f0 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede4896c10>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:46.377195 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-36d8ddf7-3561-4e8f-8a44-a0263499280f req-1905b33e-ca59-482c-98a4-5fb7083c5d70 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150325 Jul 31 01:18:46.382722 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1277/2559] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:46.842398 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9245d031-225c-4c81-9fff-6e1a62d9b8d8 tempest-AbsoluteLimitsNegativeTestJSON-1605905224 tempest-AbsoluteLimitsNegativeTestJSON-1605905224-project] Calling method '.version_select at 0x7fede5662e50>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:46.880557 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9245d031-225c-4c81-9fff-6e1a62d9b8d8 tempest-AbsoluteLimitsNegativeTestJSON-1605905224 tempest-AbsoluteLimitsNegativeTestJSON-1605905224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:46.882116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9245d031-225c-4c81-9fff-6e1a62d9b8d8 tempest-AbsoluteLimitsNegativeTestJSON-1605905224 tempest-AbsoluteLimitsNegativeTestJSON-1605905224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:46.885165 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9245d031-225c-4c81-9fff-6e1a62d9b8d8 tempest-AbsoluteLimitsNegativeTestJSON-1605905224 tempest-AbsoluteLimitsNegativeTestJSON-1605905224-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:46.887123 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9245d031-225c-4c81-9fff-6e1a62d9b8d8 tempest-AbsoluteLimitsNegativeTestJSON-1605905224 tempest-AbsoluteLimitsNegativeTestJSON-1605905224-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:46.947011 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9245d031-225c-4c81-9fff-6e1a62d9b8d8 tempest-AbsoluteLimitsNegativeTestJSON-1605905224 tempest-AbsoluteLimitsNegativeTestJSON-1605905224-project] 10.222.0.45 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.361073 Jul 31 01:18:46.948520 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1278/2560] 10.222.0.45 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:46 2022] GET /compute/v2.1/limits => generated 511 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:18:47.011214 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63c23ed6-b8c2-41fe-9319-9db27a866058 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:47.014594 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-63c23ed6-b8c2-41fe-9319-9db27a866058 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:47.029357 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63c23ed6-b8c2-41fe-9319-9db27a866058 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:47.031126 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63c23ed6-b8c2-41fe-9319-9db27a866058 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:47.032902 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63c23ed6-b8c2-41fe-9319-9db27a866058 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:47.033984 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63c23ed6-b8c2-41fe-9319-9db27a866058 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:47.524749 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-03c8cd97-0844-4353-9e18-9801a2be52f0 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "DELETE /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1" status: 204 len: 0 microversion: 2.1 time: 1.190165 Jul 31 01:18:47.525462 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1283/2561] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:46 2022] DELETE /compute/v2.1/images/e1fc2fed-9798-4c90-bae1-0087c13a78a1 => generated 0 bytes in 1192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:18:47.534319 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b53cb898-f53c-437f-8d04-abe917328dc3 tempest-AbsoluteLimitsNegativeTestJSON-1605905224 tempest-AbsoluteLimitsNegativeTestJSON-1605905224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-702385966", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:47.643915 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-b53cb898-f53c-437f-8d04-abe917328dc3 tempest-AbsoluteLimitsNegativeTestJSON-1605905224 tempest-AbsoluteLimitsNegativeTestJSON-1605905224-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:18:47.869480 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-63c23ed6-b8c2-41fe-9319-9db27a866058 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:47.880799 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-63c23ed6-b8c2-41fe-9319-9db27a866058 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 200 len: 1320 microversion: 2.1 time: 0.877635 Jul 31 01:18:47.881971 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1279/2562] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:47 2022] GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 1320 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:18:47.915961 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-87a91a93-c121-4875-95e5-361e117f42a1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:47.917895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-87a91a93-c121-4875-95e5-361e117f42a1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:47.940105 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87a91a93-c121-4875-95e5-361e117f42a1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:47.941460 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87a91a93-c121-4875-95e5-361e117f42a1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:47.944103 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87a91a93-c121-4875-95e5-361e117f42a1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:47.946606 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87a91a93-c121-4875-95e5-361e117f42a1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:48.437685 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-b53cb898-f53c-437f-8d04-abe917328dc3 tempest-AbsoluteLimitsNegativeTestJSON-1605905224 tempest-AbsoluteLimitsNegativeTestJSON-1605905224-project] Getting quotas for project d6fcd25845d74ad19e43b89a4c653a0a. Resources: dict_keys(['metadata_items']) {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:18:48.445403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-b53cb898-f53c-437f-8d04-abe917328dc3 tempest-AbsoluteLimitsNegativeTestJSON-1605905224 tempest-AbsoluteLimitsNegativeTestJSON-1605905224-project] Getting quotas for user 368a60cd502a44b3a08e5a950d39e6ee and project d6fcd25845d74ad19e43b89a4c653a0a. Resources: dict_keys(['metadata_items']) {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:18:48.463352 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-b53cb898-f53c-437f-8d04-abe917328dc3 tempest-AbsoluteLimitsNegativeTestJSON-1605905224 tempest-AbsoluteLimitsNegativeTestJSON-1605905224-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b53cb898-f53c-437f-8d04-abe917328dc3 tempest-AbsoluteLimitsNegativeTestJSON-1605905224 tempest-AbsoluteLimitsNegativeTestJSON-1605905224-project] Request method failure captured: Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 1751 Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dh2QdbWBTtokg-4yYR1V1KoZhQ0CuKuiqHEJnnm6Wn0odcYHi-gHuUvaJZVXRUzYK4zT0-wmosG0zT33sIqB3roA7Q_eTqWF3_ZjVglYSU8jZbhirEj-nd4QTqonjyD7NXKpKUlygVU0fcIY83moeBL5Fr049KfQdNWsHzCYcn9PEQ Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: d6fcd25845d74ad19e43b89a4c653a0a Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1605905224 Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d6fcd25845d74ad19e43b89a4c653a0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d6fcd25845d74ad19e43b89a4c653a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d6fcd25845d74ad19e43b89a4c653a0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d6fcd25845d74ad19e43b89a4c653a0a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1605905224 Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: d6fcd25845d74ad19e43b89a4c653a0a Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1605905224 Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1605905224-project Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 368a60cd502a44b3a08e5a950d39e6ee Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1605905224-project Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-702385966", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:18:48.466270 n-d-master-1 devstack@n-api.service[119475]: exception: Maximum number of metadata items exceeds 128 Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-702385966', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 464, in _check_metadata_properties_quota Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1004, in _checks_for_create_and_rebuild Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 471, in _check_metadata_properties_quota Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:18:48.468842 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:18:48.471779 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:18:48.471779 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 31 01:18:48.471779 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 31 01:18:48.471779 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 31 01:18:48.471779 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 31 01:18:48.471779 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:48.471779 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:48.471779 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:48.471779 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:48.471779 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:48.471779 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:48.471779 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:18:48.471779 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:18:48.471779 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 31 01:18:48.471779 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:18:48.475087 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b53cb898-f53c-437f-8d04-abe917328dc3 tempest-AbsoluteLimitsNegativeTestJSON-1605905224 tempest-AbsoluteLimitsNegativeTestJSON-1605905224-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:18:48.476691 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b53cb898-f53c-437f-8d04-abe917328dc3 tempest-AbsoluteLimitsNegativeTestJSON-1605905224 tempest-AbsoluteLimitsNegativeTestJSON-1605905224-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.949884 Jul 31 01:18:48.477871 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1284/2563] 10.222.0.45 () {60 vars in 1148 bytes} [Sun Jul 31 01:18:47 2022] POST /compute/v2.1/servers => generated 87 bytes in 952 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:18:48.490445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d711a9ba-357c-4b15-8055-394a4d640fe5 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:48.491670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d711a9ba-357c-4b15-8055-394a4d640fe5 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:48.501106 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d711a9ba-357c-4b15-8055-394a4d640fe5 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:48.502006 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d711a9ba-357c-4b15-8055-394a4d640fe5 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:48.503883 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d711a9ba-357c-4b15-8055-394a4d640fe5 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:48.504807 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d711a9ba-357c-4b15-8055-394a4d640fe5 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:48.678778 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-87a91a93-c121-4875-95e5-361e117f42a1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:48.698288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-87a91a93-c121-4875-95e5-361e117f42a1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:48.706692 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-87a91a93-c121-4875-95e5-361e117f42a1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:48.715877 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-87a91a93-c121-4875-95e5-361e117f42a1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 2947 microversion: 2.32 time: 0.831759 Jul 31 01:18:48.719941 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1280/2564] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:18:47 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 2947 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:18:48.736612 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a55c0a09-c24a-4793-8903-481ec91e5404 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:48.738061 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a55c0a09-c24a-4793-8903-481ec91e5404 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:48.759279 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a55c0a09-c24a-4793-8903-481ec91e5404 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:48.760725 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a55c0a09-c24a-4793-8903-481ec91e5404 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:48.762965 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a55c0a09-c24a-4793-8903-481ec91e5404 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:48.763914 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a55c0a09-c24a-4793-8903-481ec91e5404 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:48.990338 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d711a9ba-357c-4b15-8055-394a4d640fe5 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:49.003656 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d711a9ba-357c-4b15-8055-394a4d640fe5 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1462 microversion: 2.1 time: 0.523703 Jul 31 01:18:49.031194 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1285/2565] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:48 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1462 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:49.040854 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ef6c652a-b0fa-43f5-aa9e-80baa80f7896 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:49.040854 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ef6c652a-b0fa-43f5-aa9e-80baa80f7896 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:49.053871 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef6c652a-b0fa-43f5-aa9e-80baa80f7896 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:49.054330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef6c652a-b0fa-43f5-aa9e-80baa80f7896 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:49.055122 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef6c652a-b0fa-43f5-aa9e-80baa80f7896 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:49.056217 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef6c652a-b0fa-43f5-aa9e-80baa80f7896 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:49.115429 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ef6c652a-b0fa-43f5-aa9e-80baa80f7896 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:18:49.195171 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:49.242052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a55c0a09-c24a-4793-8903-481ec91e5404 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:49.254412 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a55c0a09-c24a-4793-8903-481ec91e5404 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1364 microversion: 2.1 time: 0.531830 Jul 31 01:18:49.256983 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1281/2566] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:48 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1364 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:49.267965 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-3d247d5e-3f80-45c3-9c15-0f7c396b0f2a req-2af25d83-6c74-4e8b-a40b-c72791ee4254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43b4b8e-a135-4dbd-886f-8b8a7c396bd1", "name": "network-vif-plugged", "status": "completed", "tag": "ce126f1b-8ca9-4952-b9c7-e8bcfc30dc81"}, {"server_uuid": "619b940f-1846-459d-9b47-8d2ee3c907c0", "name": "network-vif-plugged", "status": "completed", "tag": "34f13022-c348-4ce3-a22a-3feadeaea7d2"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:49.285503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3d247d5e-3f80-45c3-9c15-0f7c396b0f2a req-2af25d83-6c74-4e8b-a40b-c72791ee4254 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:49.286750 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3d247d5e-3f80-45c3-9c15-0f7c396b0f2a req-2af25d83-6c74-4e8b-a40b-c72791ee4254 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:49.298019 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ef6c652a-b0fa-43f5-aa9e-80baa80f7896 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 204 len: 0 microversion: 2.1 time: 0.263977 Jul 31 01:18:49.299183 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1286/2567] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:18:49 2022] DELETE /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:18:49.306722 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-3d247d5e-3f80-45c3-9c15-0f7c396b0f2a req-2af25d83-6c74-4e8b-a40b-c72791ee4254 service nova] Creating event network-vif-plugged:ce126f1b-8ca9-4952-b9c7-e8bcfc30dc81 for instance f43b4b8e-a135-4dbd-886f-8b8a7c396bd1 on n-h1-master-1 Jul 31 01:18:49.307288 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a421b074-38d0-4d3e-9b8a-c17ee31f3d83 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:49.307983 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-3d247d5e-3f80-45c3-9c15-0f7c396b0f2a req-2af25d83-6c74-4e8b-a40b-c72791ee4254 service nova] Creating event network-vif-plugged:34f13022-c348-4ce3-a22a-3feadeaea7d2 for instance 619b940f-1846-459d-9b47-8d2ee3c907c0 on n-h2-master-1 Jul 31 01:18:49.315994 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a421b074-38d0-4d3e-9b8a-c17ee31f3d83 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:49.322204 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-3d247d5e-3f80-45c3-9c15-0f7c396b0f2a req-2af25d83-6c74-4e8b-a40b-c72791ee4254 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063228 Jul 31 01:18:49.327287 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a421b074-38d0-4d3e-9b8a-c17ee31f3d83 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:49.327891 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a421b074-38d0-4d3e-9b8a-c17ee31f3d83 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:49.329074 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1282/2568] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:49.338759 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9d089354-40a1-43aa-bec1-a68b415415bc tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:49.340024 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9d089354-40a1-43aa-bec1-a68b415415bc tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:49.340340 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a421b074-38d0-4d3e-9b8a-c17ee31f3d83 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:49.343128 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a421b074-38d0-4d3e-9b8a-c17ee31f3d83 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:49.360273 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d089354-40a1-43aa-bec1-a68b415415bc tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:49.369391 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d089354-40a1-43aa-bec1-a68b415415bc tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:49.370539 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d089354-40a1-43aa-bec1-a68b415415bc tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:49.371180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d089354-40a1-43aa-bec1-a68b415415bc tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:50.014479 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a421b074-38d0-4d3e-9b8a-c17ee31f3d83 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.713068 Jul 31 01:18:50.015282 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1287/2569] 10.222.0.45 () {60 vars in 1316 bytes} [Sun Jul 31 01:18:49 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb/os-interface => generated 1829 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:18:50.249216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9d089354-40a1-43aa-bec1-a68b415415bc tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:50.263880 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9d089354-40a1-43aa-bec1-a68b415415bc tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 200 len: 1320 microversion: 2.1 time: 0.930579 Jul 31 01:18:50.265575 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1283/2570] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:49 2022] GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 1320 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:50.280157 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6c25f35a-47fc-4ab4-95fb-c69e51becf55 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:50.284433 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6c25f35a-47fc-4ab4-95fb-c69e51becf55 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:50.294251 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e33b8d35-4d97-4ff0-8366-cb24b3f53b2a tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:50.302264 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e33b8d35-4d97-4ff0-8366-cb24b3f53b2a tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Searching by: {'deleted': False, 'project_id': '23be6457c94249f6813fbacb138900ab'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:18:50.305954 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c25f35a-47fc-4ab4-95fb-c69e51becf55 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:50.306855 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c25f35a-47fc-4ab4-95fb-c69e51becf55 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:50.310440 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c25f35a-47fc-4ab4-95fb-c69e51becf55 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:50.312177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c25f35a-47fc-4ab4-95fb-c69e51becf55 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:50.317104 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e33b8d35-4d97-4ff0-8366-cb24b3f53b2a tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:50.320290 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e33b8d35-4d97-4ff0-8366-cb24b3f53b2a tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:50.321344 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e33b8d35-4d97-4ff0-8366-cb24b3f53b2a tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:50.324093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e33b8d35-4d97-4ff0-8366-cb24b3f53b2a tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:50.362991 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e33b8d35-4d97-4ff0-8366-cb24b3f53b2a tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.345711 Jul 31 01:18:50.364411 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1288/2571] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:18:50 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:18:50.370702 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-29aacf9c-7e54-4489-8ab6-8dfb564a4646 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:50.371915 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-29aacf9c-7e54-4489-8ab6-8dfb564a4646 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:50.388326 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29aacf9c-7e54-4489-8ab6-8dfb564a4646 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:50.389495 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29aacf9c-7e54-4489-8ab6-8dfb564a4646 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:50.390756 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29aacf9c-7e54-4489-8ab6-8dfb564a4646 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:50.391552 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29aacf9c-7e54-4489-8ab6-8dfb564a4646 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:50.986813 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6c25f35a-47fc-4ab4-95fb-c69e51becf55 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:51.003499 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6c25f35a-47fc-4ab4-95fb-c69e51becf55 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1474 microversion: 2.1 time: 0.731145 Jul 31 01:18:51.006147 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1284/2572] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:50 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1474 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:51.041444 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b23d9be4-b3d1-4b65-85b4-047c1ad2e208 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:51.050367 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b23d9be4-b3d1-4b65-85b4-047c1ad2e208 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Searching by: {'deleted': False} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:18:51.057364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b23d9be4-b3d1-4b65-85b4-047c1ad2e208 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:51.057830 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b23d9be4-b3d1-4b65-85b4-047c1ad2e208 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:51.058637 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b23d9be4-b3d1-4b65-85b4-047c1ad2e208 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:51.059084 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b23d9be4-b3d1-4b65-85b4-047c1ad2e208 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:51.081056 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-29aacf9c-7e54-4489-8ab6-8dfb564a4646 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:51.107707 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-29aacf9c-7e54-4489-8ab6-8dfb564a4646 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1364 microversion: 2.1 time: 0.741219 Jul 31 01:18:51.109189 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1289/2573] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:50 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1364 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:51.118329 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f9d61acc-b8ae-40ce-9abd-49bb2f810a53 req-3ea6baf1-d178-47ee-8ce2-50722128a979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7f0abec-dd05-4dff-8f15-b56464346b06", "tag": "02e5aa3d-f780-459d-9466-4437ed729ddc"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:51.149686 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f9d61acc-b8ae-40ce-9abd-49bb2f810a53 req-3ea6baf1-d178-47ee-8ce2-50722128a979 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:51.150808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f9d61acc-b8ae-40ce-9abd-49bb2f810a53 req-3ea6baf1-d178-47ee-8ce2-50722128a979 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:51.191265 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f9d61acc-b8ae-40ce-9abd-49bb2f810a53 req-3ea6baf1-d178-47ee-8ce2-50722128a979 service nova] Creating event network-changed:02e5aa3d-f780-459d-9466-4437ed729ddc for instance e7f0abec-dd05-4dff-8f15-b56464346b06 on n-h2-master-1 Jul 31 01:18:51.200875 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f9d61acc-b8ae-40ce-9abd-49bb2f810a53 req-3ea6baf1-d178-47ee-8ce2-50722128a979 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085843 Jul 31 01:18:51.201752 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1290/2574] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:51.264112 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-b23d9be4-b3d1-4b65-85b4-047c1ad2e208 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:18:51.297332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-75d1d994-2186-4d0a-9d4f-b1a6a9b07c33 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:51.298451 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-75d1d994-2186-4d0a-9d4f-b1a6a9b07c33 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:51.318909 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75d1d994-2186-4d0a-9d4f-b1a6a9b07c33 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:51.319419 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75d1d994-2186-4d0a-9d4f-b1a6a9b07c33 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:51.320238 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75d1d994-2186-4d0a-9d4f-b1a6a9b07c33 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:51.320689 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75d1d994-2186-4d0a-9d4f-b1a6a9b07c33 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:51.431062 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b23d9be4-b3d1-4b65-85b4-047c1ad2e208 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:51.431962 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b23d9be4-b3d1-4b65-85b4-047c1ad2e208 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:51.434926 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:52.051032 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-75d1d994-2186-4d0a-9d4f-b1a6a9b07c33 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:52.067442 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-75d1d994-2186-4d0a-9d4f-b1a6a9b07c33 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 200 len: 1320 microversion: 2.1 time: 0.779656 Jul 31 01:18:52.079923 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1291/2575] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:51 2022] GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 1320 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:52.090045 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f05a5d27-8ab5-4a39-a4a6-09fe688869ec tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:52.090733 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f05a5d27-8ab5-4a39-a4a6-09fe688869ec tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:52.112371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f05a5d27-8ab5-4a39-a4a6-09fe688869ec tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:52.112838 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f05a5d27-8ab5-4a39-a4a6-09fe688869ec tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:52.113727 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f05a5d27-8ab5-4a39-a4a6-09fe688869ec tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:52.114352 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f05a5d27-8ab5-4a39-a4a6-09fe688869ec tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:53.005324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f05a5d27-8ab5-4a39-a4a6-09fe688869ec tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:53.017932 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f05a5d27-8ab5-4a39-a4a6-09fe688869ec tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1474 microversion: 2.1 time: 0.936847 Jul 31 01:18:53.018823 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1292/2576] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:52 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1474 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:53.032497 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b57476dc-5770-450a-93a7-86eab83b28e1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:53.033613 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b57476dc-5770-450a-93a7-86eab83b28e1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:53.087522 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b57476dc-5770-450a-93a7-86eab83b28e1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:53.088982 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b57476dc-5770-450a-93a7-86eab83b28e1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:53.090980 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b57476dc-5770-450a-93a7-86eab83b28e1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:53.092389 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b57476dc-5770-450a-93a7-86eab83b28e1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:53.144887 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b23d9be4-b3d1-4b65-85b4-047c1ad2e208 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 15604 microversion: 2.1 time: 2.110201 Jul 31 01:18:53.165806 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1285/2577] 10.222.0.45 () {58 vars in 1171 bytes} [Sun Jul 31 01:18:51 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 15604 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:18:53.171255 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-688c8348-3500-403f-810d-21c519b2020e tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:53.184733 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-688c8348-3500-403f-810d-21c519b2020e tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:53.202283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-688c8348-3500-403f-810d-21c519b2020e tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:53.202952 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-688c8348-3500-403f-810d-21c519b2020e tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:53.204128 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-688c8348-3500-403f-810d-21c519b2020e tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:53.205243 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-688c8348-3500-403f-810d-21c519b2020e tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:53.608496 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b57476dc-5770-450a-93a7-86eab83b28e1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:53.621895 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b57476dc-5770-450a-93a7-86eab83b28e1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1364 microversion: 2.1 time: 0.598962 Jul 31 01:18:53.622522 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1293/2578] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:53 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1364 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:53.627457 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5ebb1f25-9166-4151-a8cd-64e0a7062020 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:53.633841 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5ebb1f25-9166-4151-a8cd-64e0a7062020 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Searching by: {'deleted': False, 'project_id': '23be6457c94249f6813fbacb138900ab'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:18:53.639924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5ebb1f25-9166-4151-a8cd-64e0a7062020 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:53.640675 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5ebb1f25-9166-4151-a8cd-64e0a7062020 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:53.641706 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5ebb1f25-9166-4151-a8cd-64e0a7062020 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:53.642335 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5ebb1f25-9166-4151-a8cd-64e0a7062020 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:53.659122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-688c8348-3500-403f-810d-21c519b2020e tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:53.673037 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-688c8348-3500-403f-810d-21c519b2020e tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 200 len: 1508 microversion: 2.1 time: 0.501195 Jul 31 01:18:53.674228 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1286/2579] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:53 2022] GET /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 1508 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:53.681059 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-d4dcb551-2a8e-4417-b2b2-f00f4b87ad46 req-334a06c9-bfab-40b2-88ee-5eb785ed78f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf56656-f786-439a-8d92-a4365424d0d7", "name": "network-vif-deleted", "tag": "f14a9b78-dba4-47d9-b73e-195b70df06a4"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:53.694519 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d4dcb551-2a8e-4417-b2b2-f00f4b87ad46 req-334a06c9-bfab-40b2-88ee-5eb785ed78f0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:53.695248 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d4dcb551-2a8e-4417-b2b2-f00f4b87ad46 req-334a06c9-bfab-40b2-88ee-5eb785ed78f0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:53.711230 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-d4dcb551-2a8e-4417-b2b2-f00f4b87ad46 req-334a06c9-bfab-40b2-88ee-5eb785ed78f0 service nova] Creating event network-vif-deleted:f14a9b78-dba4-47d9-b73e-195b70df06a4 for instance cdf56656-f786-439a-8d92-a4365424d0d7 on n-h2-master-1 Jul 31 01:18:53.712568 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5ebb1f25-9166-4151-a8cd-64e0a7062020 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/detail?tenant_id=43c36901e18a4507ae8a90557eb9abc9" status: 200 len: 15 microversion: 2.1 time: 0.088933 Jul 31 01:18:53.715252 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1294/2580] 10.222.0.45 () {58 vars in 1231 bytes} [Sun Jul 31 01:18:53 2022] GET /compute/v2.1/servers/detail?tenant_id=43c36901e18a4507ae8a90557eb9abc9 => generated 15 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:18:53.721023 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-d4dcb551-2a8e-4417-b2b2-f00f4b87ad46 req-334a06c9-bfab-40b2-88ee-5eb785ed78f0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043120 Jul 31 01:18:53.724852 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1287/2581] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:53.727879 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1ec024d3-7e0b-41e5-af76-ff31e32f89fc tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:53.728992 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1ec024d3-7e0b-41e5-af76-ff31e32f89fc tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: f43b4b8e-a135-4dbd-886f-8b8a7c396bd1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:53.740526 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cad92776-2a2e-4274-b7e5-3327a29443db tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:53.742614 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1ec024d3-7e0b-41e5-af76-ff31e32f89fc tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:53.743504 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1ec024d3-7e0b-41e5-af76-ff31e32f89fc tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:53.744730 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1ec024d3-7e0b-41e5-af76-ff31e32f89fc tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:53.745575 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1ec024d3-7e0b-41e5-af76-ff31e32f89fc tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:53.747386 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cad92776-2a2e-4274-b7e5-3327a29443db tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Searching by: {'tenant_id': '43c36901e18a4507ae8a90557eb9abc9', 'deleted': False} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:18:53.755888 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cad92776-2a2e-4274-b7e5-3327a29443db tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:53.756364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cad92776-2a2e-4274-b7e5-3327a29443db tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:53.757272 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cad92776-2a2e-4274-b7e5-3327a29443db tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:53.757720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cad92776-2a2e-4274-b7e5-3327a29443db tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:53.807941 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-cad92776-2a2e-4274-b7e5-3327a29443db tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:18:53.883601 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cad92776-2a2e-4274-b7e5-3327a29443db tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:53.884303 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cad92776-2a2e-4274-b7e5-3327a29443db tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.059045 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1ec024d3-7e0b-41e5-af76-ff31e32f89fc tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:54.067580 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1ec024d3-7e0b-41e5-af76-ff31e32f89fc tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/f43b4b8e-a135-4dbd-886f-8b8a7c396bd1" status: 200 len: 1507 microversion: 2.1 time: 0.349169 Jul 31 01:18:54.068181 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1295/2582] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:53 2022] GET /compute/v2.1/servers/f43b4b8e-a135-4dbd-886f-8b8a7c396bd1 => generated 1507 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:54.073555 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6ddb41cf-3adc-4840-ac78-b9de52d20287 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:54.074185 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6ddb41cf-3adc-4840-ac78-b9de52d20287 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:54.082058 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6ddb41cf-3adc-4840-ac78-b9de52d20287 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.082980 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6ddb41cf-3adc-4840-ac78-b9de52d20287 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.083832 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6ddb41cf-3adc-4840-ac78-b9de52d20287 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.084282 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6ddb41cf-3adc-4840-ac78-b9de52d20287 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.122962 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6ddb41cf-3adc-4840-ac78-b9de52d20287 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.123746 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6ddb41cf-3adc-4840-ac78-b9de52d20287 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.124045 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-6ddb41cf-3adc-4840-ac78-b9de52d20287 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lazy-loading 'fault' on Instance uuid cdf56656-f786-439a-8d92-a4365424d0d7 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:18:54.187907 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cad92776-2a2e-4274-b7e5-3327a29443db tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=43c36901e18a4507ae8a90557eb9abc9" status: 200 len: 4824 microversion: 2.1 time: 0.456600 Jul 31 01:18:54.191927 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1288/2583] 10.222.0.45 () {58 vars in 1257 bytes} [Sun Jul 31 01:18:53 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=43c36901e18a4507ae8a90557eb9abc9 => generated 4824 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:54.196991 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1d30e31c-fa88-494a-ab7f-821a20ec8515 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:54.197620 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1d30e31c-fa88-494a-ab7f-821a20ec8515 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: f43b4b8e-a135-4dbd-886f-8b8a7c396bd1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:54.215007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d30e31c-fa88-494a-ab7f-821a20ec8515 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.215772 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6ddb41cf-3adc-4840-ac78-b9de52d20287 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:54.216077 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d30e31c-fa88-494a-ab7f-821a20ec8515 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.217048 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d30e31c-fa88-494a-ab7f-821a20ec8515 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.217679 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d30e31c-fa88-494a-ab7f-821a20ec8515 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.226953 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6ddb41cf-3adc-4840-ac78-b9de52d20287 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 200 len: 1308 microversion: 2.1 time: 0.157258 Jul 31 01:18:54.228164 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1296/2584] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:54 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:54.234039 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-da21f9c3-d4d9-454c-9b19-d63099fb080f tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:54.243927 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-da21f9c3-d4d9-454c-9b19-d63099fb080f tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Searching by: {'tenant_id': '23be6457c94249f6813fbacb138900ab', 'deleted': False} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:18:54.252196 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da21f9c3-d4d9-454c-9b19-d63099fb080f tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.252996 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da21f9c3-d4d9-454c-9b19-d63099fb080f tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.254232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da21f9c3-d4d9-454c-9b19-d63099fb080f tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.255575 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da21f9c3-d4d9-454c-9b19-d63099fb080f tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.260548 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1d30e31c-fa88-494a-ab7f-821a20ec8515 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: f43b4b8e-a135-4dbd-886f-8b8a7c396bd1] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:18:54.292998 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-da21f9c3-d4d9-454c-9b19-d63099fb080f tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=23be6457c94249f6813fbacb138900ab" status: 200 len: 15 microversion: 2.1 time: 0.062866 Jul 31 01:18:54.304933 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1297/2585] 10.222.0.45 () {58 vars in 1257 bytes} [Sun Jul 31 01:18:54 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=23be6457c94249f6813fbacb138900ab => generated 15 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:18:54.317119 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-134da100-2996-471e-bbce-f3b4eb283431 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:54.327954 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-134da100-2996-471e-bbce-f3b4eb283431 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.015061 Jul 31 01:18:54.328497 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1298/2586] 10.222.0.45 () {58 vars in 1189 bytes} [Sun Jul 31 01:18:54 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:18:54.354263 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a179c6ca-6517-415c-a24b-4ecf952f8128 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:54.356515 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a179c6ca-6517-415c-a24b-4ecf952f8128 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:54.370347 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a179c6ca-6517-415c-a24b-4ecf952f8128 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.374525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a179c6ca-6517-415c-a24b-4ecf952f8128 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.377480 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a179c6ca-6517-415c-a24b-4ecf952f8128 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.378066 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a179c6ca-6517-415c-a24b-4ecf952f8128 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.378629 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1d30e31c-fa88-494a-ab7f-821a20ec8515 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f43b4b8e-a135-4dbd-886f-8b8a7c396bd1" status: 204 len: 0 microversion: 2.1 time: 0.185308 Jul 31 01:18:54.379320 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1289/2587] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:18:54 2022] DELETE /compute/v2.1/servers/f43b4b8e-a135-4dbd-886f-8b8a7c396bd1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:18:54.389368 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-33153939-e9b7-4344-befc-d957df58e5ce tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:54.389951 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-33153939-e9b7-4344-befc-d957df58e5ce tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:54.399386 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33153939-e9b7-4344-befc-d957df58e5ce tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.402964 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33153939-e9b7-4344-befc-d957df58e5ce tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.404412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33153939-e9b7-4344-befc-d957df58e5ce tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.405379 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33153939-e9b7-4344-befc-d957df58e5ce tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.433908 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-33153939-e9b7-4344-befc-d957df58e5ce tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 619b940f-1846-459d-9b47-8d2ee3c907c0] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:18:54.491226 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a179c6ca-6517-415c-a24b-4ecf952f8128 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d/action" status: 202 len: 0 microversion: 2.1 time: 0.141840 Jul 31 01:18:54.493248 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1299/2588] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:18:54 2022] POST /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:18:54.504615 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-799e1ce8-41f4-4f7b-a2a2-5aa205adbbdd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:54.527387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-799e1ce8-41f4-4f7b-a2a2-5aa205adbbdd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:54.528966 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-799e1ce8-41f4-4f7b-a2a2-5aa205adbbdd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '43c36901e18a4507ae8a90557eb9abc9'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:18:54.538237 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-799e1ce8-41f4-4f7b-a2a2-5aa205adbbdd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.538989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-799e1ce8-41f4-4f7b-a2a2-5aa205adbbdd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.540256 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-799e1ce8-41f4-4f7b-a2a2-5aa205adbbdd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.540859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-799e1ce8-41f4-4f7b-a2a2-5aa205adbbdd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.591241 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-33153939-e9b7-4344-befc-d957df58e5ce tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "DELETE /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0" status: 204 len: 0 microversion: 2.1 time: 0.207050 Jul 31 01:18:54.602847 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1290/2589] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:18:54 2022] DELETE /compute/v2.1/servers/619b940f-1846-459d-9b47-8d2ee3c907c0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:18:54.621060 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.multi_cell_list [None req-799e1ce8-41f4-4f7b-a2a2-5aa205adbbdd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119475) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:18:54.644615 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0557a8bb-3f2f-4c36-9533-3301f2cdc9cf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:54.645589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0557a8bb-3f2f-4c36-9533-3301f2cdc9cf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:54.656859 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0557a8bb-3f2f-4c36-9533-3301f2cdc9cf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.660111 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0557a8bb-3f2f-4c36-9533-3301f2cdc9cf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.661554 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0557a8bb-3f2f-4c36-9533-3301f2cdc9cf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.662808 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0557a8bb-3f2f-4c36-9533-3301f2cdc9cf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.664991 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-799e1ce8-41f4-4f7b-a2a2-5aa205adbbdd tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.166540 Jul 31 01:18:54.666108 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1300/2590] 10.222.0.45 () {58 vars in 1150 bytes} [Sun Jul 31 01:18:54 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:54.679427 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-193ad238-f1f6-43b4-af73-1747552cf125 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:54.681910 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-193ad238-f1f6-43b4-af73-1747552cf125 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:54.690504 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-193ad238-f1f6-43b4-af73-1747552cf125 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.691216 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-193ad238-f1f6-43b4-af73-1747552cf125 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.693297 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-193ad238-f1f6-43b4-af73-1747552cf125 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:54.693936 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-193ad238-f1f6-43b4-af73-1747552cf125 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:54.823298 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-193ad238-f1f6-43b4-af73-1747552cf125 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d/action" status: 202 len: 0 microversion: 2.1 time: 0.149224 Jul 31 01:18:54.825776 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1301/2591] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:18:54 2022] POST /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:18:54.832335 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1095762476", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "21da8480-a842-4066-86d3-fc2fbeb2ee2c"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:54.901432 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] validate_networks() for [('21da8480-a842-4066-86d3-fc2fbeb2ee2c', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:18:55.367589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0557a8bb-3f2f-4c36-9533-3301f2cdc9cf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:55.378874 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0557a8bb-3f2f-4c36-9533-3301f2cdc9cf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1364 microversion: 2.1 time: 0.738217 Jul 31 01:18:55.391821 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1291/2592] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:54 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1364 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:18:55.397825 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ab9c300-b02d-44e4-a81a-730997d88c98 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:55.399065 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0ab9c300-b02d-44e4-a81a-730997d88c98 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:55.406162 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ab9c300-b02d-44e4-a81a-730997d88c98 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:55.407090 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ab9c300-b02d-44e4-a81a-730997d88c98 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:55.408165 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ab9c300-b02d-44e4-a81a-730997d88c98 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:55.408674 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ab9c300-b02d-44e4-a81a-730997d88c98 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:55.832869 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0ab9c300-b02d-44e4-a81a-730997d88c98 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1615 microversion: 2.1 time: 0.438918 Jul 31 01:18:55.847563 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1292/2593] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:55 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1615 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:55.856902 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4c429fe4-fbd8-458c-bc1c-76eadf11cb13 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:55.857676 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4c429fe4-fbd8-458c-bc1c-76eadf11cb13 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cdf56656-f786-439a-8d92-a4365424d0d7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:55.865590 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c429fe4-fbd8-458c-bc1c-76eadf11cb13 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:55.866363 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c429fe4-fbd8-458c-bc1c-76eadf11cb13 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:55.867395 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c429fe4-fbd8-458c-bc1c-76eadf11cb13 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:55.868124 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c429fe4-fbd8-458c-bc1c-76eadf11cb13 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:55.893899 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-4c429fe4-fbd8-458c-bc1c-76eadf11cb13 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] HTTP exception thrown: Instance cdf56656-f786-439a-8d92-a4365424d0d7 could not be found. Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4c429fe4-fbd8-458c-bc1c-76eadf11cb13 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Request method failure captured: Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 HTTP/1.1 Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dfYPyxmvlSowH_3BtU4gguiciH9Nl5y9UyxQs7MlUf4O7ZJ3Njim7hT9ZyPZaQ7BzqTkx_Ej5U4EeCmkh8D4KteV0EG4Ycd9QRlzkHuW1lfqyYSWBfEtWKICwrn6uABK6XZdjhmGDTLTV1CEVj8mOSZ6vx_yLNWV6Yqrgvr9WY3iKw Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 1144cd95761a4f2d9db48cfe05506abf Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ListImageFiltersTestJSON-2065633259 Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1144cd95761a4f2d9db48cfe05506abf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1144cd95761a4f2d9db48cfe05506abf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1144cd95761a4f2d9db48cfe05506abf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1144cd95761a4f2d9db48cfe05506abf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ListImageFiltersTestJSON-2065633259 Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 1144cd95761a4f2d9db48cfe05506abf Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2065633259 Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ListImageFiltersTestJSON-2065633259-project Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: aabf32537a9449108581fae373260f1e Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ListImageFiltersTestJSON-2065633259-project Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: exception: Instance cdf56656-f786-439a-8d92-a4365424d0d7 could not be found. Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'cdf56656-f786-439a-8d92-a4365424d0d7'} Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf56656-f786-439a-8d92-a4365424d0d7 could not be found. Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf56656-f786-439a-8d92-a4365424d0d7 could not be found. Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:18:55.897393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:55.903753 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:18:55.903753 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:18:55.903753 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:18:55.903753 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:18:55.903753 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:18:55.903753 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf56656-f786-439a-8d92-a4365424d0d7 could not be found. Jul 31 01:18:55.903753 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:18:55.905679 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4c429fe4-fbd8-458c-bc1c-76eadf11cb13 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Returning 404 to user: Instance cdf56656-f786-439a-8d92-a4365424d0d7 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:18:55.906909 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4c429fe4-fbd8-458c-bc1c-76eadf11cb13 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7" status: 404 len: 111 microversion: 2.1 time: 0.057956 Jul 31 01:18:55.912363 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1293/2594] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:55 2022] GET /compute/v2.1/servers/cdf56656-f786-439a-8d92-a4365424d0d7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:18:55.919667 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1cb845a8-9d77-4749-aa10-4f0ec764263f tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:55.921839 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1cb845a8-9d77-4749-aa10-4f0ec764263f tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:55.931218 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cb845a8-9d77-4749-aa10-4f0ec764263f tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:55.932109 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cb845a8-9d77-4749-aa10-4f0ec764263f tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:55.933940 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cb845a8-9d77-4749-aa10-4f0ec764263f tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:55.934749 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cb845a8-9d77-4749-aa10-4f0ec764263f tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:56.391693 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:18:56.392220 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:18:56.393037 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:18:56.394093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:18:56.394889 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:18:56.416556 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:56.417185 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:56.418156 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:56.419784 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:56.459704 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Getting quotas for project 44209ac9bb8d45afa6803de51652c614. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:18:56.468528 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Getting quotas for user 0149114cdb8e493c946447fc26acbce2 and project 44209ac9bb8d45afa6803de51652c614. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:18:56.483455 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1cb845a8-9d77-4749-aa10-4f0ec764263f tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1615 microversion: 2.1 time: 0.569510 Jul 31 01:18:56.489448 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1294/2595] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:55 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1615 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:56.500553 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-83f65e69-a45f-458d-89f8-f229f3faa2f1 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:56.503879 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-83f65e69-a45f-458d-89f8-f229f3faa2f1 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cf0c39f6-2c6a-4eb3-9176-7d20151b0adb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:56.519240 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Going to run 2 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:18:56.523668 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83f65e69-a45f-458d-89f8-f229f3faa2f1 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:56.524443 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83f65e69-a45f-458d-89f8-f229f3faa2f1 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:56.525849 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 15155950-e1cc-4745-b8ef-266093e7a6fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:18:56.527588 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83f65e69-a45f-458d-89f8-f229f3faa2f1 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:56.528853 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83f65e69-a45f-458d-89f8-f229f3faa2f1 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:56.626564 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-83f65e69-a45f-458d-89f8-f229f3faa2f1 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cf0c39f6-2c6a-4eb3-9176-7d20151b0adb] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:18:56.635178 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=15155950-e1cc-4745-b8ef-266093e7a6fa,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:18:56.774693 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4e3d66fa-fe47-4dab-967e-d4a77acfa398 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.947666 Jul 31 01:18:56.777109 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1302/2596] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:18:54 2022] POST /compute/v2.1/servers => generated 32 bytes in 1951 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 31 01:18:56.784676 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f99dccaf-3b42-49e3-b512-527720ce4507 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:56.817985 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f99dccaf-3b42-49e3-b512-527720ce4507 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:56.823065 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:56.834971 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f99dccaf-3b42-49e3-b512-527720ce4507 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:56.837798 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f99dccaf-3b42-49e3-b512-527720ce4507 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:56.839362 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f99dccaf-3b42-49e3-b512-527720ce4507 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:56.840076 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f99dccaf-3b42-49e3-b512-527720ce4507 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:56.845847 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-83f65e69-a45f-458d-89f8-f229f3faa2f1 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb" status: 204 len: 0 microversion: 2.1 time: 0.354568 Jul 31 01:18:56.850852 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1295/2597] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:18:56 2022] DELETE /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:18:56.857500 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9947b89a-61b8-4754-9872-543d7f13ef37 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:56.867537 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9947b89a-61b8-4754-9872-543d7f13ef37 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Searching by: {'host': 'n-h2-master-1', 'deleted': False} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:18:56.888642 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9947b89a-61b8-4754-9872-543d7f13ef37 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:56.889310 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9947b89a-61b8-4754-9872-543d7f13ef37 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:56.891289 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9947b89a-61b8-4754-9872-543d7f13ef37 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:56.892314 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9947b89a-61b8-4754-9872-543d7f13ef37 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:57.065307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-9947b89a-61b8-4754-9872-543d7f13ef37 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:18:57.171702 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9947b89a-61b8-4754-9872-543d7f13ef37 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "GET /compute/v2.1/servers?host=n-h2-master-1&all_tenants=1" status: 200 len: 1653 microversion: 2.1 time: 0.318876 Jul 31 01:18:57.184143 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1296/2598] 10.222.0.45 () {58 vars in 1190 bytes} [Sun Jul 31 01:18:56 2022] GET /compute/v2.1/servers?host=n-h2-master-1&all_tenants=1 => generated 1653 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:57.184372 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f99dccaf-3b42-49e3-b512-527720ce4507 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:57.187823 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:57.190007 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6516088b-6f26-4a5a-8b52-1aa9f61e95db tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:57.191112 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f99dccaf-3b42-49e3-b512-527720ce4507 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1364 microversion: 2.1 time: 0.410378 Jul 31 01:18:57.197014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6516088b-6f26-4a5a-8b52-1aa9f61e95db tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:57.197898 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6516088b-6f26-4a5a-8b52-1aa9f61e95db tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Searching by: {'deleted': False, 'project_id': '44209ac9bb8d45afa6803de51652c614'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:18:57.204354 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1303/2599] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:56 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1364 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:57.211328 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-821d1929-1fdb-4305-9f9f-d19f0b1c5f56 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:57.212180 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-821d1929-1fdb-4305-9f9f-d19f0b1c5f56 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cf0c39f6-2c6a-4eb3-9176-7d20151b0adb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:57.219947 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-821d1929-1fdb-4305-9f9f-d19f0b1c5f56 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:57.232132 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-821d1929-1fdb-4305-9f9f-d19f0b1c5f56 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:57.233408 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-821d1929-1fdb-4305-9f9f-d19f0b1c5f56 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:57.234098 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-821d1929-1fdb-4305-9f9f-d19f0b1c5f56 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:57.275963 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6516088b-6f26-4a5a-8b52-1aa9f61e95db tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:57.276585 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6516088b-6f26-4a5a-8b52-1aa9f61e95db tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:57.277961 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6516088b-6f26-4a5a-8b52-1aa9f61e95db tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:57.279544 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6516088b-6f26-4a5a-8b52-1aa9f61e95db tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:57.339472 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-6516088b-6f26-4a5a-8b52-1aa9f61e95db tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:18:57.487885 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:57.494240 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6516088b-6f26-4a5a-8b52-1aa9f61e95db tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.320747 Jul 31 01:18:57.503001 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1297/2600] 10.222.0.45 () {58 vars in 1125 bytes} [Sun Jul 31 01:18:57 2022] GET /compute/v2.1/servers => generated 1337 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:57.503001 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c96cef7d-7daf-4bbd-b100-75f3a25fb698 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:57.543275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c96cef7d-7daf-4bbd-b100-75f3a25fb698 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:18:57.623891 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c96cef7d-7daf-4bbd-b100-75f3a25fb698 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:57.625147 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c96cef7d-7daf-4bbd-b100-75f3a25fb698 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:57.627439 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c96cef7d-7daf-4bbd-b100-75f3a25fb698 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:57.628560 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c96cef7d-7daf-4bbd-b100-75f3a25fb698 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:57.836034 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-821d1929-1fdb-4305-9f9f-d19f0b1c5f56 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:57.854957 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-821d1929-1fdb-4305-9f9f-d19f0b1c5f56 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb" status: 200 len: 1474 microversion: 2.1 time: 0.649253 Jul 31 01:18:57.855730 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1304/2601] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:57 2022] GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb => generated 1474 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:57.870612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a3e372ea-c75e-4b24-a303-717e35308325 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:57.871688 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a3e372ea-c75e-4b24-a303-717e35308325 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:57.985936 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a3e372ea-c75e-4b24-a303-717e35308325 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:58.000294 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a3e372ea-c75e-4b24-a303-717e35308325 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346" status: 200 len: 1218 microversion: 2.1 time: 0.143250 Jul 31 01:18:58.001095 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1305/2602] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:57 2022] GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:58.022186 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-42cf011d-6e86-4f7e-ac17-78dc1d1502e2 req-bd3d47fa-234b-475c-8a51-5826d2a7ea48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619b940f-1846-459d-9b47-8d2ee3c907c0", "name": "network-vif-deleted", "tag": "34f13022-c348-4ce3-a22a-3feadeaea7d2"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:58.053707 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-42cf011d-6e86-4f7e-ac17-78dc1d1502e2 req-bd3d47fa-234b-475c-8a51-5826d2a7ea48 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:58.055511 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-42cf011d-6e86-4f7e-ac17-78dc1d1502e2 req-bd3d47fa-234b-475c-8a51-5826d2a7ea48 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:58.083835 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-42cf011d-6e86-4f7e-ac17-78dc1d1502e2 req-bd3d47fa-234b-475c-8a51-5826d2a7ea48 service nova] Creating event network-vif-deleted:34f13022-c348-4ce3-a22a-3feadeaea7d2 for instance 619b940f-1846-459d-9b47-8d2ee3c907c0 on n-h2-master-1 Jul 31 01:18:58.093279 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-42cf011d-6e86-4f7e-ac17-78dc1d1502e2 req-bd3d47fa-234b-475c-8a51-5826d2a7ea48 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075417 Jul 31 01:18:58.097748 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1306/2603] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:58.107890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-d1a77ced-b676-431d-99bb-1f59d9898170 req-dbd37a6c-94cd-4864-95c1-41ad692cd649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43b4b8e-a135-4dbd-886f-8b8a7c396bd1", "name": "network-vif-deleted", "tag": "ce126f1b-8ca9-4952-b9c7-e8bcfc30dc81"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:58.138728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d1a77ced-b676-431d-99bb-1f59d9898170 req-dbd37a6c-94cd-4864-95c1-41ad692cd649 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:58.144209 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d1a77ced-b676-431d-99bb-1f59d9898170 req-dbd37a6c-94cd-4864-95c1-41ad692cd649 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:58.170469 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-d1a77ced-b676-431d-99bb-1f59d9898170 req-dbd37a6c-94cd-4864-95c1-41ad692cd649 service nova] Creating event network-vif-deleted:ce126f1b-8ca9-4952-b9c7-e8bcfc30dc81 for instance f43b4b8e-a135-4dbd-886f-8b8a7c396bd1 on n-h1-master-1 Jul 31 01:18:58.185471 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-d1a77ced-b676-431d-99bb-1f59d9898170 req-dbd37a6c-94cd-4864-95c1-41ad692cd649 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085931 Jul 31 01:18:58.186601 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1307/2604] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:18:58.217372 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b50f3001-6c20-470e-90fd-43f6a381935f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:58.218270 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b50f3001-6c20-470e-90fd-43f6a381935f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:58.221434 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:58.239020 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b50f3001-6c20-470e-90fd-43f6a381935f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:58.239975 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b50f3001-6c20-470e-90fd-43f6a381935f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:58.241116 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b50f3001-6c20-470e-90fd-43f6a381935f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:58.252189 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b50f3001-6c20-470e-90fd-43f6a381935f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:58.345559 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c96cef7d-7daf-4bbd-b100-75f3a25fb698 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.848077 Jul 31 01:18:58.353904 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1298/2605] 10.222.0.45 () {58 vars in 1196 bytes} [Sun Jul 31 01:18:57 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:18:58.365563 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-16096755-a28e-402f-a120-1d12bdfdb734 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:58.369447 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-16096755-a28e-402f-a120-1d12bdfdb734 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:58.386091 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16096755-a28e-402f-a120-1d12bdfdb734 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:58.386698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16096755-a28e-402f-a120-1d12bdfdb734 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:58.388733 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16096755-a28e-402f-a120-1d12bdfdb734 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:58.389181 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16096755-a28e-402f-a120-1d12bdfdb734 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:58.601504 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b50f3001-6c20-470e-90fd-43f6a381935f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:58.615268 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b50f3001-6c20-470e-90fd-43f6a381935f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1364 microversion: 2.1 time: 0.402236 Jul 31 01:18:58.630461 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-16096755-a28e-402f-a120-1d12bdfdb734 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d/action" status: 202 len: 0 microversion: 2.1 time: 0.269770 Jul 31 01:18:58.631445 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1308/2606] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:58 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1364 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:18:58.631915 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1299/2607] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:18:58 2022] POST /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:18:58.648360 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0f306572-729b-4b95-a357-79461887e541"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:18:58.658141 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:58.682906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:58.685929 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:58.699169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:58.700215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:58.860268 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:18:58.861587 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:18:58.863060 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:18:58.863754 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:18:58.864653 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:18:58.878726 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f3452ded-53e4-4607-90b4-43f70ebe3e49 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:58.879013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f3452ded-53e4-4607-90b4-43f70ebe3e49 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cf0c39f6-2c6a-4eb3-9176-7d20151b0adb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:58.900938 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3452ded-53e4-4607-90b4-43f70ebe3e49 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:58.901757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3452ded-53e4-4607-90b4-43f70ebe3e49 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:58.912481 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3452ded-53e4-4607-90b4-43f70ebe3e49 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:58.912952 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3452ded-53e4-4607-90b4-43f70ebe3e49 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:59.013615 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:59.044976 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:59.045746 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:59.047037 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:59.047961 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:59.089271 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-42652704-17a1-47e3-9ea3-76212bce1137 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "POST /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d/action" status: 202 len: 1068 microversion: 2.1 time: 0.450089 Jul 31 01:18:59.090674 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1309/2608] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:18:58 2022] POST /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d/action => generated 1068 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 31 01:18:59.104508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f1b31210-f66d-4bcc-a636-959f32b514b0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:59.105702 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f1b31210-f66d-4bcc-a636-959f32b514b0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:59.114816 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1b31210-f66d-4bcc-a636-959f32b514b0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:59.115867 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1b31210-f66d-4bcc-a636-959f32b514b0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:59.117178 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1b31210-f66d-4bcc-a636-959f32b514b0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:59.118216 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1b31210-f66d-4bcc-a636-959f32b514b0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:59.246691 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f1b31210-f66d-4bcc-a636-959f32b514b0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:59.275317 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f1b31210-f66d-4bcc-a636-959f32b514b0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346" status: 200 len: 1214 microversion: 2.1 time: 0.182717 Jul 31 01:18:59.276337 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1310/2609] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:59 2022] GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:59.283570 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8927688b-1af0-44bb-ab02-ab498e5006d3 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:59.285034 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8927688b-1af0-44bb-ab02-ab498e5006d3 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:59.292970 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8927688b-1af0-44bb-ab02-ab498e5006d3 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:59.294035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8927688b-1af0-44bb-ab02-ab498e5006d3 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:59.295756 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8927688b-1af0-44bb-ab02-ab498e5006d3 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:59.296493 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8927688b-1af0-44bb-ab02-ab498e5006d3 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:59.518037 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f3452ded-53e4-4607-90b4-43f70ebe3e49 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:59.532718 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f3452ded-53e4-4607-90b4-43f70ebe3e49 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb" status: 200 len: 1474 microversion: 2.1 time: 0.660226 Jul 31 01:18:59.533582 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1300/2610] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:58 2022] GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb => generated 1474 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:18:59.637699 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3b060097-8f6f-4ad9-a440-7df12bdc267a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:18:59.638976 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3b060097-8f6f-4ad9-a440-7df12bdc267a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:18:59.647143 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b060097-8f6f-4ad9-a440-7df12bdc267a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:59.652592 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b060097-8f6f-4ad9-a440-7df12bdc267a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:59.653715 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b060097-8f6f-4ad9-a440-7df12bdc267a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:18:59.654345 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b060097-8f6f-4ad9-a440-7df12bdc267a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:18:59.943837 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8927688b-1af0-44bb-ab02-ab498e5006d3 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:18:59.952329 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8927688b-1af0-44bb-ab02-ab498e5006d3 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1472 microversion: 2.1 time: 0.674609 Jul 31 01:18:59.960244 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1311/2611] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:59 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1472 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:00.120592 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b060097-8f6f-4ad9-a440-7df12bdc267a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:00.142152 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3b060097-8f6f-4ad9-a440-7df12bdc267a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1364 microversion: 2.1 time: 0.508876 Jul 31 01:19:00.159631 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1301/2612] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:18:59 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1364 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:00.296896 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7ebd73fa-231e-48b3-a188-5472d212554f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:00.297668 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7ebd73fa-231e-48b3-a188-5472d212554f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:00.309119 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ebd73fa-231e-48b3-a188-5472d212554f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:00.313169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ebd73fa-231e-48b3-a188-5472d212554f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:00.314384 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ebd73fa-231e-48b3-a188-5472d212554f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:00.315957 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ebd73fa-231e-48b3-a188-5472d212554f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:00.505048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7ebd73fa-231e-48b3-a188-5472d212554f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:00.514759 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7ebd73fa-231e-48b3-a188-5472d212554f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346" status: 200 len: 1288 microversion: 2.1 time: 0.222230 Jul 31 01:19:00.515663 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1312/2613] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:00 2022] GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 => generated 1288 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:00.562051 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d77b4f3f-1e84-49a9-bfd0-4f014aaeeb0c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:00.562953 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d77b4f3f-1e84-49a9-bfd0-4f014aaeeb0c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cf0c39f6-2c6a-4eb3-9176-7d20151b0adb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:00.578757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d77b4f3f-1e84-49a9-bfd0-4f014aaeeb0c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:00.581453 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d77b4f3f-1e84-49a9-bfd0-4f014aaeeb0c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:00.582531 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d77b4f3f-1e84-49a9-bfd0-4f014aaeeb0c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:00.582982 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d77b4f3f-1e84-49a9-bfd0-4f014aaeeb0c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:00.983433 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b7666488-b6f5-43c2-b55a-9ff256ea4d49 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:00.984792 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b7666488-b6f5-43c2-b55a-9ff256ea4d49 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:00.993276 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7666488-b6f5-43c2-b55a-9ff256ea4d49 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:00.994211 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7666488-b6f5-43c2-b55a-9ff256ea4d49 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:00.995381 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7666488-b6f5-43c2-b55a-9ff256ea4d49 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:00.996122 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7666488-b6f5-43c2-b55a-9ff256ea4d49 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:01.850981 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d77b4f3f-1e84-49a9-bfd0-4f014aaeeb0c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aabf32537a9449108581fae373260f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144cd95761a4f2d9db48cfe05506abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:01.862573 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d77b4f3f-1e84-49a9-bfd0-4f014aaeeb0c tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb" status: 200 len: 1474 microversion: 2.1 time: 1.308772 Jul 31 01:19:01.871265 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1302/2614] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:00 2022] GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb => generated 1474 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:01.876331 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1f26de88-cd7e-4241-a582-2a0dc2f88c0d req-85bbb97b-e6b1-4015-83f6-986c55416c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f0abec-dd05-4dff-8f15-b56464346b06", "name": "network-vif-plugged", "status": "completed", "tag": "02e5aa3d-f780-459d-9466-4437ed729ddc"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:01.901469 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1f26de88-cd7e-4241-a582-2a0dc2f88c0d req-85bbb97b-e6b1-4015-83f6-986c55416c66 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:01.901916 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1f26de88-cd7e-4241-a582-2a0dc2f88c0d req-85bbb97b-e6b1-4015-83f6-986c55416c66 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:01.944609 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1f26de88-cd7e-4241-a582-2a0dc2f88c0d req-85bbb97b-e6b1-4015-83f6-986c55416c66 service nova] Creating event network-vif-plugged:02e5aa3d-f780-459d-9466-4437ed729ddc for instance e7f0abec-dd05-4dff-8f15-b56464346b06 on n-h2-master-1 Jul 31 01:19:01.952263 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1f26de88-cd7e-4241-a582-2a0dc2f88c0d req-85bbb97b-e6b1-4015-83f6-986c55416c66 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079398 Jul 31 01:19:01.956289 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1303/2615] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:01.963569 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b9f3e821-24d4-4ea6-8dc5-d79ba52977a0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:01.971266 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b9f3e821-24d4-4ea6-8dc5-d79ba52977a0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:01.983504 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9f3e821-24d4-4ea6-8dc5-d79ba52977a0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:01.984186 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9f3e821-24d4-4ea6-8dc5-d79ba52977a0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:01.985160 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9f3e821-24d4-4ea6-8dc5-d79ba52977a0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:01.986359 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9f3e821-24d4-4ea6-8dc5-d79ba52977a0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:02.015720 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b7666488-b6f5-43c2-b55a-9ff256ea4d49 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:02.025473 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b7666488-b6f5-43c2-b55a-9ff256ea4d49 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1472 microversion: 2.1 time: 1.047497 Jul 31 01:19:02.030127 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1313/2616] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:00 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1472 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:02.037889 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8caefb32-659a-4067-8904-b9aff2d3c3c7 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:02.052446 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8caefb32-659a-4067-8904-b9aff2d3c3c7 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:02.063425 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8caefb32-659a-4067-8904-b9aff2d3c3c7 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:02.063974 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8caefb32-659a-4067-8904-b9aff2d3c3c7 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:02.072120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8caefb32-659a-4067-8904-b9aff2d3c3c7 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:02.072577 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8caefb32-659a-4067-8904-b9aff2d3c3c7 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:02.313761 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8caefb32-659a-4067-8904-b9aff2d3c3c7 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:02.329910 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8caefb32-659a-4067-8904-b9aff2d3c3c7 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346" status: 200 len: 1276 microversion: 2.1 time: 0.298430 Jul 31 01:19:02.338307 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1314/2617] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:02 2022] GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 => generated 1276 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:02.343661 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-7ae0659a-a592-4a8c-968e-6018ffa14c34 req-6f81482e-8142-4b93-91d0-84c457cf09fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf0c39f6-2c6a-4eb3-9176-7d20151b0adb", "name": "network-vif-deleted", "tag": "cf150970-8f1a-4d54-b48d-7de2be48f7e1"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:02.374072 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7ae0659a-a592-4a8c-968e-6018ffa14c34 req-6f81482e-8142-4b93-91d0-84c457cf09fe service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:02.382330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7ae0659a-a592-4a8c-968e-6018ffa14c34 req-6f81482e-8142-4b93-91d0-84c457cf09fe service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:02.412758 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-7ae0659a-a592-4a8c-968e-6018ffa14c34 req-6f81482e-8142-4b93-91d0-84c457cf09fe service nova] Creating event network-vif-deleted:cf150970-8f1a-4d54-b48d-7de2be48f7e1 for instance cf0c39f6-2c6a-4eb3-9176-7d20151b0adb on n-h2-master-1 Jul 31 01:19:02.423747 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-7ae0659a-a592-4a8c-968e-6018ffa14c34 req-6f81482e-8142-4b93-91d0-84c457cf09fe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083807 Jul 31 01:19:02.432437 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1315/2618] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:02.888311 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed4e8445-f03c-48cd-b39f-48d6fee01cb5 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:02.893362 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ed4e8445-f03c-48cd-b39f-48d6fee01cb5 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] [instance: cf0c39f6-2c6a-4eb3-9176-7d20151b0adb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:02.929732 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed4e8445-f03c-48cd-b39f-48d6fee01cb5 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:02.930218 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed4e8445-f03c-48cd-b39f-48d6fee01cb5 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:02.931318 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed4e8445-f03c-48cd-b39f-48d6fee01cb5 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:02.931490 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed4e8445-f03c-48cd-b39f-48d6fee01cb5 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:02.989426 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-ed4e8445-f03c-48cd-b39f-48d6fee01cb5 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] HTTP exception thrown: Instance cf0c39f6-2c6a-4eb3-9176-7d20151b0adb could not be found. Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed4e8445-f03c-48cd-b39f-48d6fee01cb5 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Request method failure captured: Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb HTTP/1.1 Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dfYPyxmvlSowH_3BtU4gguiciH9Nl5y9UyxQs7MlUf4O7ZJ3Njim7hT9ZyPZaQ7BzqTkx_Ej5U4EeCmkh8D4KteV0EG4Ycd9QRlzkHuW1lfqyYSWBfEtWKICwrn6uABK6XZdjhmGDTLTV1CEVj8mOSZ6vx_yLNWV6Yqrgvr9WY3iKw Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 1144cd95761a4f2d9db48cfe05506abf Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ListImageFiltersTestJSON-2065633259 Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1144cd95761a4f2d9db48cfe05506abf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1144cd95761a4f2d9db48cfe05506abf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1144cd95761a4f2d9db48cfe05506abf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1144cd95761a4f2d9db48cfe05506abf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ListImageFiltersTestJSON-2065633259 Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 1144cd95761a4f2d9db48cfe05506abf Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2065633259 Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ListImageFiltersTestJSON-2065633259-project Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: aabf32537a9449108581fae373260f1e Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ListImageFiltersTestJSON-2065633259-project Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: exception: Instance cf0c39f6-2c6a-4eb3-9176-7d20151b0adb could not be found. Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'cf0c39f6-2c6a-4eb3-9176-7d20151b0adb'} Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf0c39f6-2c6a-4eb3-9176-7d20151b0adb could not be found. Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf0c39f6-2c6a-4eb3-9176-7d20151b0adb could not be found. Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:02.991676 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:02.998104 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:02.998104 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:02.998104 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:02.998104 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:19:02.998104 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:19:02.998104 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf0c39f6-2c6a-4eb3-9176-7d20151b0adb could not be found. Jul 31 01:19:02.998104 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:03.002549 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed4e8445-f03c-48cd-b39f-48d6fee01cb5 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Returning 404 to user: Instance cf0c39f6-2c6a-4eb3-9176-7d20151b0adb could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:19:03.002549 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ed4e8445-f03c-48cd-b39f-48d6fee01cb5 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb" status: 404 len: 111 microversion: 2.1 time: 0.119075 Jul 31 01:19:03.008324 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1316/2619] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:02 2022] GET /compute/v2.1/servers/cf0c39f6-2c6a-4eb3-9176-7d20151b0adb => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:19:03.018814 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cfd00e64-2fe7-49e7-9d80-9e5bb5517495 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede482ce50>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:03.849191 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b9f3e821-24d4-4ea6-8dc5-d79ba52977a0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:03.866200 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:03.873238 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b9f3e821-24d4-4ea6-8dc5-d79ba52977a0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1364 microversion: 2.1 time: 1.915389 Jul 31 01:19:03.874144 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1304/2620] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:01 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1364 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:03.896906 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-abf301ac-136b-48ab-8819-3d6183cc0264 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:03.897651 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-abf301ac-136b-48ab-8819-3d6183cc0264 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:03.918461 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abf301ac-136b-48ab-8819-3d6183cc0264 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:03.920073 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abf301ac-136b-48ab-8819-3d6183cc0264 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:03.923747 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abf301ac-136b-48ab-8819-3d6183cc0264 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:03.925516 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abf301ac-136b-48ab-8819-3d6183cc0264 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:04.101693 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cfd00e64-2fe7-49e7-9d80-9e5bb5517495 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "DELETE /compute/v2.1/images/c8cb013c-2942-4638-812c-dace061e2684" status: 204 len: 0 microversion: 2.1 time: 1.091952 Jul 31 01:19:04.103114 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1317/2621] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:03 2022] DELETE /compute/v2.1/images/c8cb013c-2942-4638-812c-dace061e2684 => generated 0 bytes in 1094 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:19:04.133061 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9e352427-4e18-4f9c-a8a8-de7e9f6c4443 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:04.138468 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9e352427-4e18-4f9c-a8a8-de7e9f6c4443 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:04.161770 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e352427-4e18-4f9c-a8a8-de7e9f6c4443 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:04.162759 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e352427-4e18-4f9c-a8a8-de7e9f6c4443 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:04.164249 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e352427-4e18-4f9c-a8a8-de7e9f6c4443 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:04.165298 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e352427-4e18-4f9c-a8a8-de7e9f6c4443 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:04.839640 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9e352427-4e18-4f9c-a8a8-de7e9f6c4443 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:04.862647 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9e352427-4e18-4f9c-a8a8-de7e9f6c4443 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346" status: 200 len: 1276 microversion: 2.1 time: 0.755718 Jul 31 01:19:04.864286 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1318/2622] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:04 2022] GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 => generated 1276 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:04.883518 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-65ca15de-c427-4b3e-afd8-8254aea9f982 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede482c5e0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:05.342034 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-65ca15de-c427-4b3e-afd8-8254aea9f982 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "DELETE /compute/v2.1/images/841ea579-f4a4-4d94-a78c-a79ccc8d63e5" status: 204 len: 0 microversion: 2.1 time: 0.474198 Jul 31 01:19:05.347297 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1319/2623] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:04 2022] DELETE /compute/v2.1/images/841ea579-f4a4-4d94-a78c-a79ccc8d63e5 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:19:05.353172 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a3c3c570-0d1e-4744-9324-28c61689d7cc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:05.354110 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a3c3c570-0d1e-4744-9324-28c61689d7cc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:05.365101 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3c3c570-0d1e-4744-9324-28c61689d7cc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:05.366153 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3c3c570-0d1e-4744-9324-28c61689d7cc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:05.367202 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3c3c570-0d1e-4744-9324-28c61689d7cc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:05.368017 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3c3c570-0d1e-4744-9324-28c61689d7cc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:05.459817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-abf301ac-136b-48ab-8819-3d6183cc0264 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:05.469892 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-abf301ac-136b-48ab-8819-3d6183cc0264 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1472 microversion: 2.1 time: 1.586001 Jul 31 01:19:05.479410 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1305/2624] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:03 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1472 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:05.493166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c40aeb0d-33c7-47f1-9def-d862a31c50a2 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] Calling method '.version_select at 0x7fede565aca0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:05.863444 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c40aeb0d-33c7-47f1-9def-d862a31c50a2 tempest-ListImageFiltersTestJSON-2065633259 tempest-ListImageFiltersTestJSON-2065633259-project] 10.222.0.45 "DELETE /compute/v2.1/images/afb49c93-59c9-43b4-b788-5493a2c790a3" status: 204 len: 0 microversion: 2.1 time: 0.382226 Jul 31 01:19:05.864033 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1306/2625] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:05 2022] DELETE /compute/v2.1/images/afb49c93-59c9-43b4-b788-5493a2c790a3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:19:05.884821 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-77336455-32fb-424e-a3ce-dfd3d5ef9884 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:05.885447 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-77336455-32fb-424e-a3ce-dfd3d5ef9884 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:05.898679 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-77336455-32fb-424e-a3ce-dfd3d5ef9884 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:05.899142 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-77336455-32fb-424e-a3ce-dfd3d5ef9884 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:05.899987 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-77336455-32fb-424e-a3ce-dfd3d5ef9884 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:05.901201 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-77336455-32fb-424e-a3ce-dfd3d5ef9884 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:06.445985 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=12 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:06.552404 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-77336455-32fb-424e-a3ce-dfd3d5ef9884 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:06.562722 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-77336455-32fb-424e-a3ce-dfd3d5ef9884 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346" status: 200 len: 1318 microversion: 2.1 time: 0.681748 Jul 31 01:19:06.572707 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1307/2626] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:05 2022] GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 => generated 1318 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:06.588428 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-5ae9d86b-b10a-4e19-9dde-6cd3940af157 req-e87c9dc3-5b14-466d-9844-ea1d2211c9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15155950-e1cc-4745-b8ef-266093e7a6fa", "tag": "4a038e08-ee1c-4b47-beb3-700d261847cb"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:06.607447 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-5ae9d86b-b10a-4e19-9dde-6cd3940af157 req-e87c9dc3-5b14-466d-9844-ea1d2211c9a6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:06.611151 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-5ae9d86b-b10a-4e19-9dde-6cd3940af157 req-e87c9dc3-5b14-466d-9844-ea1d2211c9a6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:06.638178 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-5ae9d86b-b10a-4e19-9dde-6cd3940af157 req-e87c9dc3-5b14-466d-9844-ea1d2211c9a6 service nova] Creating event network-changed:4a038e08-ee1c-4b47-beb3-700d261847cb for instance 15155950-e1cc-4745-b8ef-266093e7a6fa on n-h1-master-1 Jul 31 01:19:06.650801 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-5ae9d86b-b10a-4e19-9dde-6cd3940af157 req-e87c9dc3-5b14-466d-9844-ea1d2211c9a6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076400 Jul 31 01:19:06.652929 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1308/2627] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:06.658403 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95085fc1-6ba8-4047-b9b7-f942baa7f91b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:06.668084 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-95085fc1-6ba8-4047-b9b7-f942baa7f91b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:06.684681 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95085fc1-6ba8-4047-b9b7-f942baa7f91b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:06.685161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95085fc1-6ba8-4047-b9b7-f942baa7f91b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:06.685979 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95085fc1-6ba8-4047-b9b7-f942baa7f91b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:06.691319 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95085fc1-6ba8-4047-b9b7-f942baa7f91b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:06.735117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a3c3c570-0d1e-4744-9324-28c61689d7cc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:06.747148 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a3c3c570-0d1e-4744-9324-28c61689d7cc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1552 microversion: 2.1 time: 1.398321 Jul 31 01:19:06.748271 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1320/2628] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:05 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1552 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:06.769524 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3991672b-2275-4d75-832a-545450a54cf9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:06.770356 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3991672b-2275-4d75-832a-545450a54cf9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:06.781517 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3991672b-2275-4d75-832a-545450a54cf9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:06.781993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3991672b-2275-4d75-832a-545450a54cf9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:06.782840 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3991672b-2275-4d75-832a-545450a54cf9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:06.783256 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3991672b-2275-4d75-832a-545450a54cf9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:07.134042 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3991672b-2275-4d75-832a-545450a54cf9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.368108 Jul 31 01:19:07.145039 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1321/2629] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:19:06 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/os-interface => generated 285 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:07.353804 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-95085fc1-6ba8-4047-b9b7-f942baa7f91b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:07.365473 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-95085fc1-6ba8-4047-b9b7-f942baa7f91b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1472 microversion: 2.1 time: 0.711200 Jul 31 01:19:07.366091 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1309/2630] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:06 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1472 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:07.588268 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3255c9a5-abca-4970-a91a-5070ce40f4c3 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:07.589679 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3255c9a5-abca-4970-a91a-5070ce40f4c3 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:07.597556 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3255c9a5-abca-4970-a91a-5070ce40f4c3 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:07.598156 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3255c9a5-abca-4970-a91a-5070ce40f4c3 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:07.599207 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3255c9a5-abca-4970-a91a-5070ce40f4c3 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:07.599931 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3255c9a5-abca-4970-a91a-5070ce40f4c3 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:07.993705 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=20 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:08.390077 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cb621196-6fc3-4b98-acd2-df975b7dc530 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:08.391495 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cb621196-6fc3-4b98-acd2-df975b7dc530 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:08.401278 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=12 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:08.410630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb621196-6fc3-4b98-acd2-df975b7dc530 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:08.416535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb621196-6fc3-4b98-acd2-df975b7dc530 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:08.417715 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb621196-6fc3-4b98-acd2-df975b7dc530 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:08.418404 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb621196-6fc3-4b98-acd2-df975b7dc530 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:08.978558 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3255c9a5-abca-4970-a91a-5070ce40f4c3 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:08.991571 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3255c9a5-abca-4970-a91a-5070ce40f4c3 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346" status: 200 len: 1318 microversion: 2.1 time: 1.408359 Jul 31 01:19:09.000764 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1322/2631] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:07 2022] GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 => generated 1318 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:09.021721 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-3d05f3fd-c556-4879-bf88-1fbf2690610d req-32b8d48a-be7f-4aae-9cc8-e1b90e3cbbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b1dac5-1cf2-48e9-b801-96f2b39d8346", "tag": "e5a9e900-5875-4d34-961e-0503dea72d2f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:09.063854 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3d05f3fd-c556-4879-bf88-1fbf2690610d req-32b8d48a-be7f-4aae-9cc8-e1b90e3cbbe8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:09.068426 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3d05f3fd-c556-4879-bf88-1fbf2690610d req-32b8d48a-be7f-4aae-9cc8-e1b90e3cbbe8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:09.115975 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-3d05f3fd-c556-4879-bf88-1fbf2690610d req-32b8d48a-be7f-4aae-9cc8-e1b90e3cbbe8 service nova] Creating event network-changed:e5a9e900-5875-4d34-961e-0503dea72d2f for instance 41b1dac5-1cf2-48e9-b801-96f2b39d8346 on n-h2-master-1 Jul 31 01:19:09.131024 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-3d05f3fd-c556-4879-bf88-1fbf2690610d req-32b8d48a-be7f-4aae-9cc8-e1b90e3cbbe8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124143 Jul 31 01:19:09.135753 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1323/2632] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:09.369422 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cb621196-6fc3-4b98-acd2-df975b7dc530 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:09.407963 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cb621196-6fc3-4b98-acd2-df975b7dc530 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1472 microversion: 2.1 time: 1.023217 Jul 31 01:19:09.413513 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1310/2633] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:08 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1472 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:10.023074 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7fea378d-fcbf-400b-9841-9daf38ad386a tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:10.023900 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7fea378d-fcbf-400b-9841-9daf38ad386a tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:10.038880 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fea378d-fcbf-400b-9841-9daf38ad386a tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:10.042599 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fea378d-fcbf-400b-9841-9daf38ad386a tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:10.044174 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fea378d-fcbf-400b-9841-9daf38ad386a tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:10.047140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fea378d-fcbf-400b-9841-9daf38ad386a tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:10.439031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b4c494a1-fac7-466c-9950-428bc5f782d4 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:10.441114 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b4c494a1-fac7-466c-9950-428bc5f782d4 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:10.456981 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4c494a1-fac7-466c-9950-428bc5f782d4 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:10.457591 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4c494a1-fac7-466c-9950-428bc5f782d4 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:10.458683 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4c494a1-fac7-466c-9950-428bc5f782d4 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:10.459471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4c494a1-fac7-466c-9950-428bc5f782d4 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:10.766048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7fea378d-fcbf-400b-9841-9daf38ad386a tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:10.786442 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7fea378d-fcbf-400b-9841-9daf38ad386a tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346" status: 200 len: 1318 microversion: 2.1 time: 0.768627 Jul 31 01:19:10.787684 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1324/2634] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:10 2022] GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 => generated 1318 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:11.050924 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b4c494a1-fac7-466c-9950-428bc5f782d4 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:11.059195 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b4c494a1-fac7-466c-9950-428bc5f782d4 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1472 microversion: 2.1 time: 0.626394 Jul 31 01:19:11.059845 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1311/2635] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:10 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1472 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:11.835640 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-85f2b64d-ee3f-4e83-9703-fb786173ade8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:11.843965 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-85f2b64d-ee3f-4e83-9703-fb786173ade8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:11.861173 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-85f2b64d-ee3f-4e83-9703-fb786173ade8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:11.863158 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-85f2b64d-ee3f-4e83-9703-fb786173ade8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:11.867174 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-85f2b64d-ee3f-4e83-9703-fb786173ade8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:11.868450 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-85f2b64d-ee3f-4e83-9703-fb786173ade8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:11.878755 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:12.088511 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-11fd3256-80f7-4689-bdc4-430405464110 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:12.089807 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-11fd3256-80f7-4689-bdc4-430405464110 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:12.111599 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-11fd3256-80f7-4689-bdc4-430405464110 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:12.120305 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-11fd3256-80f7-4689-bdc4-430405464110 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:12.121643 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-11fd3256-80f7-4689-bdc4-430405464110 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:12.122404 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-11fd3256-80f7-4689-bdc4-430405464110 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:12.900055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-11fd3256-80f7-4689-bdc4-430405464110 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:12.908640 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-11fd3256-80f7-4689-bdc4-430405464110 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1472 microversion: 2.1 time: 0.825100 Jul 31 01:19:12.912733 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1312/2636] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:12 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1472 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:12.926935 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-8bb4c42f-c1c3-4cba-8c4e-eb01fe17e7ba req-c670df60-44b4-4de4-89b8-494f6355d26a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7f0abec-dd05-4dff-8f15-b56464346b06", "tag": "02e5aa3d-f780-459d-9466-4437ed729ddc"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:12.948360 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8bb4c42f-c1c3-4cba-8c4e-eb01fe17e7ba req-c670df60-44b4-4de4-89b8-494f6355d26a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:12.948806 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8bb4c42f-c1c3-4cba-8c4e-eb01fe17e7ba req-c670df60-44b4-4de4-89b8-494f6355d26a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:12.975728 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-8bb4c42f-c1c3-4cba-8c4e-eb01fe17e7ba req-c670df60-44b4-4de4-89b8-494f6355d26a service nova] Creating event network-changed:02e5aa3d-f780-459d-9466-4437ed729ddc for instance e7f0abec-dd05-4dff-8f15-b56464346b06 on n-h2-master-1 Jul 31 01:19:12.980716 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-85f2b64d-ee3f-4e83-9703-fb786173ade8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:12.993297 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-8bb4c42f-c1c3-4cba-8c4e-eb01fe17e7ba req-c670df60-44b4-4de4-89b8-494f6355d26a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079145 Jul 31 01:19:12.993919 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1313/2637] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:13.006882 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-85f2b64d-ee3f-4e83-9703-fb786173ade8 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346" status: 200 len: 1318 microversion: 2.1 time: 1.181985 Jul 31 01:19:13.026102 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1325/2638] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:11 2022] GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 => generated 1318 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:13.206280 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e012172f-3944-4ea0-9931-7899935867b9 req-c3f4a3c7-28e9-4c86-b5a3-87fc0f379f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15155950-e1cc-4745-b8ef-266093e7a6fa", "name": "network-vif-plugged", "status": "completed", "tag": "4a038e08-ee1c-4b47-beb3-700d261847cb"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:13.237056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e012172f-3944-4ea0-9931-7899935867b9 req-c3f4a3c7-28e9-4c86-b5a3-87fc0f379f6b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:13.241078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e012172f-3944-4ea0-9931-7899935867b9 req-c3f4a3c7-28e9-4c86-b5a3-87fc0f379f6b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:13.276667 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e012172f-3944-4ea0-9931-7899935867b9 req-c3f4a3c7-28e9-4c86-b5a3-87fc0f379f6b service nova] Creating event network-vif-plugged:4a038e08-ee1c-4b47-beb3-700d261847cb for instance 15155950-e1cc-4745-b8ef-266093e7a6fa on n-h1-master-1 Jul 31 01:19:13.290238 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e012172f-3944-4ea0-9931-7899935867b9 req-c3f4a3c7-28e9-4c86-b5a3-87fc0f379f6b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093027 Jul 31 01:19:13.294030 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1314/2639] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:13.943281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f2cc5690-5579-4a73-ae15-38c8c544d859 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:13.948860 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f2cc5690-5579-4a73-ae15-38c8c544d859 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:13.968018 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2cc5690-5579-4a73-ae15-38c8c544d859 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:13.968564 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2cc5690-5579-4a73-ae15-38c8c544d859 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:13.969932 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2cc5690-5579-4a73-ae15-38c8c544d859 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:13.970376 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2cc5690-5579-4a73-ae15-38c8c544d859 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:14.045978 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8cf284d2-f70a-420e-97cb-22817047b065 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:14.046782 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8cf284d2-f70a-420e-97cb-22817047b065 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:14.059775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cf284d2-f70a-420e-97cb-22817047b065 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:14.060600 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cf284d2-f70a-420e-97cb-22817047b065 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:14.070471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cf284d2-f70a-420e-97cb-22817047b065 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:14.071906 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cf284d2-f70a-420e-97cb-22817047b065 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:15.163729 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f2cc5690-5579-4a73-ae15-38c8c544d859 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:15.171722 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f2cc5690-5579-4a73-ae15-38c8c544d859 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1472 microversion: 2.1 time: 1.244412 Jul 31 01:19:15.191776 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1326/2640] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:13 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1472 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:15.300413 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8cf284d2-f70a-420e-97cb-22817047b065 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:15.316599 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8cf284d2-f70a-420e-97cb-22817047b065 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346" status: 200 len: 1318 microversion: 2.1 time: 1.285861 Jul 31 01:19:15.317570 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1315/2641] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:14 2022] GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 => generated 1318 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:15.566983 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f01d7a3a-5f53-4f7a-8344-6f5824346a2a tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Action: 'create', calling method: .version_select at 0x7fede488b670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1491127174", "description": "tempest-description-1288700079"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:16.203014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a4e1ccd1-e28e-4113-a1ec-7085e6fb0062 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:16.204299 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a4e1ccd1-e28e-4113-a1ec-7085e6fb0062 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:16.230899 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a4e1ccd1-e28e-4113-a1ec-7085e6fb0062 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:16.231634 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a4e1ccd1-e28e-4113-a1ec-7085e6fb0062 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:16.240019 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a4e1ccd1-e28e-4113-a1ec-7085e6fb0062 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:16.240539 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a4e1ccd1-e28e-4113-a1ec-7085e6fb0062 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:16.950093 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f01d7a3a-5f53-4f7a-8344-6f5824346a2a tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.756993 Jul 31 01:19:16.951754 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1327/2642] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:19:15 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:16.974837 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b930579f-417c-4291-b36a-9e2e8ae5ec3b tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:16.978115 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b930579f-417c-4291-b36a-9e2e8ae5ec3b tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:17.017589 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b930579f-417c-4291-b36a-9e2e8ae5ec3b tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:17.018849 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b930579f-417c-4291-b36a-9e2e8ae5ec3b tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:17.020447 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b930579f-417c-4291-b36a-9e2e8ae5ec3b tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:17.021283 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b930579f-417c-4291-b36a-9e2e8ae5ec3b tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:17.687879 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a4e1ccd1-e28e-4113-a1ec-7085e6fb0062 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:17.702249 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:17.716190 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a4e1ccd1-e28e-4113-a1ec-7085e6fb0062 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1472 microversion: 2.1 time: 1.520244 Jul 31 01:19:17.716816 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1316/2643] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:16 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1472 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:17.722359 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-290deca8-05be-459c-8f66-133b031bb259 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Action: 'create', calling method: .version_select at 0x7fedea9f71f0>, body: {"security_group_rule": {"parent_group_id": "0ea06c39-57c0-43f1-b241-148b71197dfa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:17.888442 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b930579f-417c-4291-b36a-9e2e8ae5ec3b tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:17.917611 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b930579f-417c-4291-b36a-9e2e8ae5ec3b tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346" status: 200 len: 1318 microversion: 2.1 time: 0.960961 Jul 31 01:19:17.919796 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1328/2644] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:16 2022] GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 => generated 1318 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:17.933057 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-1bd991da-d77c-4851-a498-45f26ae2496e req-5e558f72-7cbc-4786-8f63-4e9076544d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b1dac5-1cf2-48e9-b801-96f2b39d8346", "name": "network-vif-plugged", "status": "completed", "tag": "e5a9e900-5875-4d34-961e-0503dea72d2f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:17.957744 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1bd991da-d77c-4851-a498-45f26ae2496e req-5e558f72-7cbc-4786-8f63-4e9076544d02 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:17.962630 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1bd991da-d77c-4851-a498-45f26ae2496e req-5e558f72-7cbc-4786-8f63-4e9076544d02 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:18.004828 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1bd991da-d77c-4851-a498-45f26ae2496e req-5e558f72-7cbc-4786-8f63-4e9076544d02 service nova] Creating event network-vif-plugged:e5a9e900-5875-4d34-961e-0503dea72d2f for instance 41b1dac5-1cf2-48e9-b801-96f2b39d8346 on n-h2-master-1 Jul 31 01:19:18.022203 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-1bd991da-d77c-4851-a498-45f26ae2496e req-5e558f72-7cbc-4786-8f63-4e9076544d02 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100873 Jul 31 01:19:18.024986 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1329/2645] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:18.748052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7f9161e9-0ca6-486b-bdc1-67d77ae3f94d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:18.751512 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7f9161e9-0ca6-486b-bdc1-67d77ae3f94d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:18.790866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f9161e9-0ca6-486b-bdc1-67d77ae3f94d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:18.791901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f9161e9-0ca6-486b-bdc1-67d77ae3f94d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:18.793139 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f9161e9-0ca6-486b-bdc1-67d77ae3f94d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:18.794627 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f9161e9-0ca6-486b-bdc1-67d77ae3f94d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:18.978376 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 01:19:18.978981 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 01:19:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-group-rules (ip 10.222.0.45) !!! Jul 31 01:19:20.209257 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-290deca8-05be-459c-8f66-133b031bb259 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.491128 Jul 31 01:19:20.216319 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1317/2646] 10.222.0.45 () {60 vars in 1195 bytes} [Sun Jul 31 01:19:17 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:20.216659 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fdbdf31e-a41d-4ac6-a867-19c184fb212d tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:20.217297 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fdbdf31e-a41d-4ac6-a867-19c184fb212d tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:20.242165 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdbdf31e-a41d-4ac6-a867-19c184fb212d tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:20.242635 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdbdf31e-a41d-4ac6-a867-19c184fb212d tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:20.243466 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdbdf31e-a41d-4ac6-a867-19c184fb212d tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:20.243913 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdbdf31e-a41d-4ac6-a867-19c184fb212d tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:20.663870 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7f9161e9-0ca6-486b-bdc1-67d77ae3f94d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:20.694840 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7f9161e9-0ca6-486b-bdc1-67d77ae3f94d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1472 microversion: 2.1 time: 1.958108 Jul 31 01:19:20.716167 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1330/2647] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:18 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1472 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:20.733042 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-21424d3c-83da-45c6-870c-93f8efe2dd48 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Action: 'create', calling method: .version_select at 0x7fede483d4c0>, body: {"security_group_rule": {"parent_group_id": "0ea06c39-57c0-43f1-b241-148b71197dfa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:21.001467 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fdbdf31e-a41d-4ac6-a867-19c184fb212d tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:21.010001 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fdbdf31e-a41d-4ac6-a867-19c184fb212d tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346" status: 200 len: 1318 microversion: 2.1 time: 0.797056 Jul 31 01:19:21.028051 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1318/2648] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:20 2022] GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 => generated 1318 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:21.034296 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-21424d3c-83da-45c6-870c-93f8efe2dd48 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] HTTP exception thrown: This rule already exists in group 0ea06c39-57c0-43f1-b241-148b71197dfa Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-21424d3c-83da-45c6-870c-93f8efe2dd48 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Request method failure captured: Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 138 Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5diSh2JJgxOPRGJ9wZvFb7vwDRvdd0E5gttpLj96oT6MN2dmJ5LbVotKSP20LletX3vptZFiX1D_j3X6TJDcyDAMGnPBK1nXS3NXdif7y1bNYH1R70LejgzSJSoqC5WH0IJkTwCwBHs9v_ALWXVPLnBXqHkmfXxs1Bq8EiR5Z9HO4Bs Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: bb2b89c41673431398f204fe56b43905 Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb2b89c41673431398f204fe56b43905"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb2b89c41673431398f204fe56b43905"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb2b89c41673431398f204fe56b43905"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb2b89c41673431398f204fe56b43905", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: bb2b89c41673431398f204fe56b43905 Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 09e740a43a08454294946de0a5536f7a Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: {"security_group_rule": {"parent_group_id": "0ea06c39-57c0-43f1-b241-148b71197dfa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: exception: This rule already exists in group 0ea06c39-57c0-43f1-b241-148b71197dfa Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0ea06c39-57c0-43f1-b241-148b71197dfa', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 0ea06c39-57c0-43f1-b241-148b71197dfa Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 0ea06c39-57c0-43f1-b241-148b71197dfa Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:21.036306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:21.039994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:19:21.039994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:19:21.039994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 0ea06c39-57c0-43f1-b241-148b71197dfa Jul 31 01:19:21.039994 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:21.039994 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-21424d3c-83da-45c6-870c-93f8efe2dd48 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Returning 400 to user: This rule already exists in group 0ea06c39-57c0-43f1-b241-148b71197dfa {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:19:21.039994 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-21424d3c-83da-45c6-870c-93f8efe2dd48 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.319373 Jul 31 01:19:21.039994 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1331/2649] 10.222.0.45 () {60 vars in 1195 bytes} [Sun Jul 31 01:19:20 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 323 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:19:21.048159 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bee6e8ca-19e2-4669-b57b-1459c705fee4 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Calling method '.version_select at 0x7fedea9f7940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:21.730173 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6da582e1-841d-49ca-9e84-0c27ac2c41c3 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:21.730884 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6da582e1-841d-49ca-9e84-0c27ac2c41c3 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:21.790315 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6da582e1-841d-49ca-9e84-0c27ac2c41c3 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:21.791255 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6da582e1-841d-49ca-9e84-0c27ac2c41c3 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:21.796008 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6da582e1-841d-49ca-9e84-0c27ac2c41c3 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:21.798543 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6da582e1-841d-49ca-9e84-0c27ac2c41c3 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:21.815425 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bee6e8ca-19e2-4669-b57b-1459c705fee4 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-group-rules/61de4592-0abe-41e0-ad4d-20bd704ed2b7" status: 202 len: 0 microversion: 2.1 time: 0.770507 Jul 31 01:19:21.816377 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1319/2650] 10.222.0.45 () {58 vars in 1287 bytes} [Sun Jul 31 01:19:21 2022] DELETE /compute/v2.1/os-security-group-rules/61de4592-0abe-41e0-ad4d-20bd704ed2b7 => generated 0 bytes in 773 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:19:21.826084 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ebda6edc-36a2-4b44-84e7-e049d6857741 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Action: 'create', calling method: .version_select at 0x7fedea9f7700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1658947188", "description": "tempest-description-2063770627"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:22.866153 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6da582e1-841d-49ca-9e84-0c27ac2c41c3 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:22.893787 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6da582e1-841d-49ca-9e84-0c27ac2c41c3 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1472 microversion: 2.1 time: 1.175135 Jul 31 01:19:22.895841 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1332/2651] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:21 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1472 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:22.916196 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d73303ac-84cd-42c3-87fd-7f8b45a91929 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:22.917248 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d73303ac-84cd-42c3-87fd-7f8b45a91929 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:22.937726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d73303ac-84cd-42c3-87fd-7f8b45a91929 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:22.938533 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d73303ac-84cd-42c3-87fd-7f8b45a91929 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:22.941681 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d73303ac-84cd-42c3-87fd-7f8b45a91929 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:22.942629 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d73303ac-84cd-42c3-87fd-7f8b45a91929 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:22.991390 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ebda6edc-36a2-4b44-84e7-e049d6857741 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.169202 Jul 31 01:19:22.992706 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1320/2652] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:19:21 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:19:23.009660 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0bd7e315-12e8-4247-a168-3b59145c7606 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Action: 'create', calling method: .version_select at 0x7fede5f16670>, body: {"security_group_rule": {"parent_group_id": "cf2664ee-cad1-46e2-9627-3b89b0cde0dd", "ip_protocol": "tcp", "from_port": 1600519082, "to_port": 22}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:23.316373 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-0bd7e315-12e8-4247-a168-3b59145c7606 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] HTTP exception thrown: Invalid port range 1600519082:22. Former value cannot be greater than the later Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0bd7e315-12e8-4247-a168-3b59145c7606 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Request method failure captured: Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 146 Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5diSh2JJgxOPRGJ9wZvFb7vwDRvdd0E5gttpLj96oT6MN2dmJ5LbVotKSP20LletX3vptZFiX1D_j3X6TJDcyDAMGnPBK1nXS3NXdif7y1bNYH1R70LejgzSJSoqC5WH0IJkTwCwBHs9v_ALWXVPLnBXqHkmfXxs1Bq8EiR5Z9HO4Bs Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: bb2b89c41673431398f204fe56b43905 Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb2b89c41673431398f204fe56b43905"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb2b89c41673431398f204fe56b43905"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb2b89c41673431398f204fe56b43905"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb2b89c41673431398f204fe56b43905", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: bb2b89c41673431398f204fe56b43905 Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 09e740a43a08454294946de0a5536f7a Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: {"security_group_rule": {"parent_group_id": "cf2664ee-cad1-46e2-9627-3b89b0cde0dd", "ip_protocol": "tcp", "from_port": 1600519082, "to_port": 22}} Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid port range 1600519082:22. Former value cannot be greater than the later Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cf2664ee-cad1-46e2-9627-3b89b0cde0dd', 'ip_protocol': 'tcp', 'from_port': 1600519082, 'to_port': 22}}} Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1600519082:22. Former value cannot be greater than the later Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1600519082:22. Former value cannot be greater than the later Jul 31 01:19:23.318469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:23.322467 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:23.322467 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:23.322467 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:23.322467 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:23.322467 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:23.322467 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:19:23.322467 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:19:23.322467 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1600519082:22. Former value cannot be greater than the later Jul 31 01:19:23.322467 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:23.324814 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0bd7e315-12e8-4247-a168-3b59145c7606 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Returning 400 to user: Invalid port range 1600519082:22. Former value cannot be greater than the later {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:19:23.325968 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0bd7e315-12e8-4247-a168-3b59145c7606 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.320288 Jul 31 01:19:23.326774 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1321/2653] 10.222.0.45 () {60 vars in 1195 bytes} [Sun Jul 31 01:19:23 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 322 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:19:23.422198 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d73303ac-84cd-42c3-87fd-7f8b45a91929 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:23.444133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2d4204bb-fb55-40a7-9d10-337100b446a9 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-992519529", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "11f04f30-fb24-47ce-b222-88fb5fe4a2ee"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:23.457625 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d73303ac-84cd-42c3-87fd-7f8b45a91929 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346" status: 200 len: 1506 microversion: 2.1 time: 0.553355 Jul 31 01:19:23.468324 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1333/2654] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:22 2022] GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:23.483764 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4d63d330-b01c-45aa-b4bc-4230a96378d1 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Action: 'create', calling method: .version_select at 0x7fede482ce50>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-693936246", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:23.493075 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-4d63d330-b01c-45aa-b4bc-4230a96378d1 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] HTTP exception thrown: Security group id should be uuid Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4d63d330-b01c-45aa-b4bc-4230a96378d1 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Request method failure captured: Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 130 Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5diSh2JJgxOPRGJ9wZvFb7vwDRvdd0E5gttpLj96oT6MN2dmJ5LbVotKSP20LletX3vptZFiX1D_j3X6TJDcyDAMGnPBK1nXS3NXdif7y1bNYH1R70LejgzSJSoqC5WH0IJkTwCwBHs9v_ALWXVPLnBXqHkmfXxs1Bq8EiR5Z9HO4Bs Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: bb2b89c41673431398f204fe56b43905 Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb2b89c41673431398f204fe56b43905"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb2b89c41673431398f204fe56b43905"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb2b89c41673431398f204fe56b43905"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb2b89c41673431398f204fe56b43905", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: bb2b89c41673431398f204fe56b43905 Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 09e740a43a08454294946de0a5536f7a Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-693936246", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: exception: Security group id should be uuid Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-693936246', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:19:23.494710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:19:23.499889 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 31 01:19:23.499889 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:23.499889 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4d63d330-b01c-45aa-b4bc-4230a96378d1 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Returning 400 to user: Security group id should be uuid {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:19:23.503587 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4d63d330-b01c-45aa-b4bc-4230a96378d1 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.040689 Jul 31 01:19:23.508288 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1334/2655] 10.222.0.45 () {60 vars in 1195 bytes} [Sun Jul 31 01:19:23 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:23.519171 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7179a480-83ec-46f2-8913-69d63d55cabf tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:23.524698 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7179a480-83ec-46f2-8913-69d63d55cabf tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 15155950-e1cc-4745-b8ef-266093e7a6fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:23.540164 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7179a480-83ec-46f2-8913-69d63d55cabf tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:23.540769 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7179a480-83ec-46f2-8913-69d63d55cabf tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:23.541629 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7179a480-83ec-46f2-8913-69d63d55cabf tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:23.542072 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7179a480-83ec-46f2-8913-69d63d55cabf tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:23.581793 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-2d4204bb-fb55-40a7-9d10-337100b446a9 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] validate_networks() for [('11f04f30-fb24-47ce-b222-88fb5fe4a2ee', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:19:23.886146 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7179a480-83ec-46f2-8913-69d63d55cabf tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:23.899279 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7179a480-83ec-46f2-8913-69d63d55cabf tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/15155950-e1cc-4745-b8ef-266093e7a6fa" status: 200 len: 1506 microversion: 2.1 time: 0.389805 Jul 31 01:19:23.902578 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1335/2656] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:23 2022] GET /compute/v2.1/servers/15155950-e1cc-4745-b8ef-266093e7a6fa => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:23.916945 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb276a00-c154-4fd3-93e0-29dd6647a4d5 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Action: 'create', calling method: .version_select at 0x7fede482cca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-92693905", "description": "tempest-description-1787197633"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:24.324895 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fb276a00-c154-4fd3-93e0-29dd6647a4d5 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.411713 Jul 31 01:19:24.325506 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1336/2657] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:19:23 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:24.337284 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-df68a24d-beb7-49a3-87f8-46a0fa889731 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:24.338019 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-df68a24d-beb7-49a3-87f8-46a0fa889731 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:24.349863 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df68a24d-beb7-49a3-87f8-46a0fa889731 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:24.353974 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df68a24d-beb7-49a3-87f8-46a0fa889731 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:24.355052 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df68a24d-beb7-49a3-87f8-46a0fa889731 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:24.356304 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df68a24d-beb7-49a3-87f8-46a0fa889731 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:24.708200 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-df68a24d-beb7-49a3-87f8-46a0fa889731 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:24.721492 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-df68a24d-beb7-49a3-87f8-46a0fa889731 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1472 microversion: 2.1 time: 0.394355 Jul 31 01:19:24.723280 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1337/2658] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:24 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1472 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:24.736950 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8625f806-1afa-4072-9999-478668d2cc8f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:24.737878 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8625f806-1afa-4072-9999-478668d2cc8f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 15155950-e1cc-4745-b8ef-266093e7a6fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:24.753313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8625f806-1afa-4072-9999-478668d2cc8f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:24.757156 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8625f806-1afa-4072-9999-478668d2cc8f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:24.758204 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8625f806-1afa-4072-9999-478668d2cc8f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:24.761503 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8625f806-1afa-4072-9999-478668d2cc8f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:24.779746 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-2d4204bb-fb55-40a7-9d10-337100b446a9 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:19:24.780770 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-2d4204bb-fb55-40a7-9d10-337100b446a9 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:19:24.781485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-2d4204bb-fb55-40a7-9d10-337100b446a9 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:19:24.782111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-2d4204bb-fb55-40a7-9d10-337100b446a9 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:19:24.782750 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-2d4204bb-fb55-40a7-9d10-337100b446a9 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:19:24.805958 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d4204bb-fb55-40a7-9d10-337100b446a9 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:24.806480 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d4204bb-fb55-40a7-9d10-337100b446a9 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:24.807780 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d4204bb-fb55-40a7-9d10-337100b446a9 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:24.808394 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d4204bb-fb55-40a7-9d10-337100b446a9 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:24.808790 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8625f806-1afa-4072-9999-478668d2cc8f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 15155950-e1cc-4745-b8ef-266093e7a6fa] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:19:24.858259 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-2d4204bb-fb55-40a7-9d10-337100b446a9 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Getting quotas for project 5473e5d0400e44bbaaf59a2c86a14f8a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:19:24.879264 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-2d4204bb-fb55-40a7-9d10-337100b446a9 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Getting quotas for user 440b48b4049a4a1ea3bfb6cdd372b205 and project 5473e5d0400e44bbaaf59a2c86a14f8a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:19:24.920482 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2d4204bb-fb55-40a7-9d10-337100b446a9 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:19:24.923038 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2d4204bb-fb55-40a7-9d10-337100b446a9 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:19:25.003049 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8625f806-1afa-4072-9999-478668d2cc8f tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "DELETE /compute/v2.1/servers/15155950-e1cc-4745-b8ef-266093e7a6fa" status: 204 len: 0 microversion: 2.1 time: 0.277628 Jul 31 01:19:25.009473 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1338/2659] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:19:24 2022] DELETE /compute/v2.1/servers/15155950-e1cc-4745-b8ef-266093e7a6fa => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:19:25.017553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-75421276-6376-4c1f-8efa-2db0d18c4980 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Action: 'create', calling method: .version_select at 0x7fede4832ca0>, body: {"security_group_rule": {"parent_group_id": "c7bd976e-8d9a-4fad-bf7c-7c6e851052bc", "ip_protocol": "tempest-999-1046936991", "from_port": 22, "to_port": 22}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:25.036150 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2d4204bb-fb55-40a7-9d10-337100b446a9 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.707721 Jul 31 01:19:25.036766 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1322/2660] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:19:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:19:25.047853 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9f1d2b71-990a-4d24-8888-6ed7941076f0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:25.048366 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9f1d2b71-990a-4d24-8888-6ed7941076f0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:25.063861 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f1d2b71-990a-4d24-8888-6ed7941076f0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:25.067153 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f1d2b71-990a-4d24-8888-6ed7941076f0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:25.068039 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f1d2b71-990a-4d24-8888-6ed7941076f0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:25.073066 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f1d2b71-990a-4d24-8888-6ed7941076f0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:25.153483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9f1d2b71-990a-4d24-8888-6ed7941076f0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:19:25.190565 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-75421276-6376-4c1f-8efa-2db0d18c4980 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] HTTP exception thrown: Invalid IP protocol tempest-999-1046936991. Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-75421276-6376-4c1f-8efa-2db0d18c4980 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Request method failure captured: Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 157 Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5diSh2JJgxOPRGJ9wZvFb7vwDRvdd0E5gttpLj96oT6MN2dmJ5LbVotKSP20LletX3vptZFiX1D_j3X6TJDcyDAMGnPBK1nXS3NXdif7y1bNYH1R70LejgzSJSoqC5WH0IJkTwCwBHs9v_ALWXVPLnBXqHkmfXxs1Bq8EiR5Z9HO4Bs Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: bb2b89c41673431398f204fe56b43905 Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb2b89c41673431398f204fe56b43905"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb2b89c41673431398f204fe56b43905"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb2b89c41673431398f204fe56b43905"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb2b89c41673431398f204fe56b43905", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: bb2b89c41673431398f204fe56b43905 Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 09e740a43a08454294946de0a5536f7a Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: {"security_group_rule": {"parent_group_id": "c7bd976e-8d9a-4fad-bf7c-7c6e851052bc", "ip_protocol": "tempest-999-1046936991", "from_port": 22, "to_port": 22}} Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid IP protocol tempest-999-1046936991. Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c7bd976e-8d9a-4fad-bf7c-7c6e851052bc', 'ip_protocol': 'tempest-999-1046936991', 'from_port': 22, 'to_port': 22}}} Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1046936991. Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1046936991. Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:25.192629 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:25.197316 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:25.197316 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:25.197316 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:25.197316 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:25.197316 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:19:25.197316 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:19:25.197316 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1046936991. Jul 31 01:19:25.197316 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:25.199894 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-75421276-6376-4c1f-8efa-2db0d18c4980 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Returning 400 to user: Invalid IP protocol tempest-999-1046936991. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:19:25.201625 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-75421276-6376-4c1f-8efa-2db0d18c4980 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.190474 Jul 31 01:19:25.202933 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1339/2661] 10.222.0.45 () {60 vars in 1195 bytes} [Sun Jul 31 01:19:25 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:25.215172 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-93b197bf-d7bd-4264-aea5-92111657d653 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:25.227128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-93b197bf-d7bd-4264-aea5-92111657d653 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:25.363228 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-93b197bf-d7bd-4264-aea5-92111657d653 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:25.372485 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-93b197bf-d7bd-4264-aea5-92111657d653 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1217 microversion: 2.1 time: 0.166993 Jul 31 01:19:25.376594 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1340/2662] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:25 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:25.390802 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-633bb6e8-25d1-43c1-a104-76bf5742c756 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Action: 'create', calling method: .version_select at 0x7fede4837700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-13003549", "description": "tempest-description-479193447"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:25.391204 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9f1d2b71-990a-4d24-8888-6ed7941076f0 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "DELETE /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346" status: 204 len: 0 microversion: 2.1 time: 0.353154 Jul 31 01:19:25.393143 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1323/2663] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:19:25 2022] DELETE /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:19:25.404444 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c9fb80e2-c5a4-4932-b750-ec048d328678 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:25.405167 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c9fb80e2-c5a4-4932-b750-ec048d328678 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 15155950-e1cc-4745-b8ef-266093e7a6fa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:25.432577 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c9fb80e2-c5a4-4932-b750-ec048d328678 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:25.434262 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c9fb80e2-c5a4-4932-b750-ec048d328678 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:25.435220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c9fb80e2-c5a4-4932-b750-ec048d328678 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:25.435700 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c9fb80e2-c5a4-4932-b750-ec048d328678 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:26.074313 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c9fb80e2-c5a4-4932-b750-ec048d328678 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:26.095228 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c9fb80e2-c5a4-4932-b750-ec048d328678 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/15155950-e1cc-4745-b8ef-266093e7a6fa" status: 200 len: 1512 microversion: 2.1 time: 0.696019 Jul 31 01:19:26.108316 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1324/2664] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:25 2022] GET /compute/v2.1/servers/15155950-e1cc-4745-b8ef-266093e7a6fa => generated 1512 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:26.119071 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-633bb6e8-25d1-43c1-a104-76bf5742c756 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.739337 Jul 31 01:19:26.125330 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1341/2665] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:19:25 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:26.136815 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-723809fa-ed60-41cf-970b-e80c73c77815 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Action: 'create', calling method: .version_select at 0x7fede482cca0>, body: {"security_group_rule": {"parent_group_id": "fc905cd9-b10f-46e6-8f4c-9c60219c5120", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:26.165143 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ee03f5b8-218f-4421-8144-19e3a3636085 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:26.177560 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ee03f5b8-218f-4421-8144-19e3a3636085 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:26.289815 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee03f5b8-218f-4421-8144-19e3a3636085 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:26.290879 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee03f5b8-218f-4421-8144-19e3a3636085 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:26.290996 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-723809fa-ed60-41cf-970b-e80c73c77815 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 31 01:19:26.292083 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee03f5b8-218f-4421-8144-19e3a3636085 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-723809fa-ed60-41cf-970b-e80c73c77815 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Request method failure captured: Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 138 Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5diSh2JJgxOPRGJ9wZvFb7vwDRvdd0E5gttpLj96oT6MN2dmJ5LbVotKSP20LletX3vptZFiX1D_j3X6TJDcyDAMGnPBK1nXS3NXdif7y1bNYH1R70LejgzSJSoqC5WH0IJkTwCwBHs9v_ALWXVPLnBXqHkmfXxs1Bq8EiR5Z9HO4Bs Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: bb2b89c41673431398f204fe56b43905 Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb2b89c41673431398f204fe56b43905"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb2b89c41673431398f204fe56b43905"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb2b89c41673431398f204fe56b43905"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb2b89c41673431398f204fe56b43905", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: bb2b89c41673431398f204fe56b43905 Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 09e740a43a08454294946de0a5536f7a Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: {"security_group_rule": {"parent_group_id": "fc905cd9-b10f-46e6-8f4c-9c60219c5120", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fc905cd9-b10f-46e6-8f4c-9c60219c5120', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 31 01:19:26.292528 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:26.296304 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:26.296304 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:26.296304 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:26.296304 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:26.296304 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:26.296304 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:19:26.296304 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:19:26.296304 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 31 01:19:26.296304 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:26.296304 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-723809fa-ed60-41cf-970b-e80c73c77815 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:19:26.296304 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-723809fa-ed60-41cf-970b-e80c73c77815 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.162463 Jul 31 01:19:26.300444 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1342/2666] 10.222.0.45 () {60 vars in 1195 bytes} [Sun Jul 31 01:19:26 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:19:26.304095 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee03f5b8-218f-4421-8144-19e3a3636085 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:26.308581 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3cbd437a-4d12-44fb-a3a0-2fd274b3f923 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Action: 'create', calling method: .version_select at 0x7fede483d430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-119419668", "description": "tempest-description-1676770318"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:27.078834 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ee03f5b8-218f-4421-8144-19e3a3636085 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:27.111325 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ee03f5b8-218f-4421-8144-19e3a3636085 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1472 microversion: 2.1 time: 1.000926 Jul 31 01:19:27.124961 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1325/2667] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:26 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1472 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:27.134762 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4df1a22d-7acb-43cf-96ae-0edd31d1e2d5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:27.140051 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4df1a22d-7acb-43cf-96ae-0edd31d1e2d5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:27.144048 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:27.158521 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4df1a22d-7acb-43cf-96ae-0edd31d1e2d5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:27.160433 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4df1a22d-7acb-43cf-96ae-0edd31d1e2d5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:27.161843 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4df1a22d-7acb-43cf-96ae-0edd31d1e2d5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:27.164106 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4df1a22d-7acb-43cf-96ae-0edd31d1e2d5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:27.249239 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3cbd437a-4d12-44fb-a3a0-2fd274b3f923 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.947417 Jul 31 01:19:27.258345 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1343/2668] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:19:26 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:27.264137 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a5a8af6-adf3-419c-9222-d2d903d1d845 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:27.264782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9a5a8af6-adf3-419c-9222-d2d903d1d845 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 15155950-e1cc-4745-b8ef-266093e7a6fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:27.287058 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a5a8af6-adf3-419c-9222-d2d903d1d845 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:27.287577 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a5a8af6-adf3-419c-9222-d2d903d1d845 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:27.293163 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a5a8af6-adf3-419c-9222-d2d903d1d845 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:27.301285 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a5a8af6-adf3-419c-9222-d2d903d1d845 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:27.636305 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4df1a22d-7acb-43cf-96ae-0edd31d1e2d5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:27.648502 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4df1a22d-7acb-43cf-96ae-0edd31d1e2d5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1269 microversion: 2.1 time: 0.521677 Jul 31 01:19:27.649099 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1326/2669] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:27 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1269 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:27.653881 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3da6271f-4de1-4688-a033-26b5dcab0ed3 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Action: 'create', calling method: .version_select at 0x7fede5f16670>, body: {"security_group_rule": {"parent_group_id": "76c49f97-38a5-4317-ba99-1f2e62cfb9d5", "ip_protocol": "tcp", "from_port": 22, "to_port": 1903624356}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:28.110465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9a5a8af6-adf3-419c-9222-d2d903d1d845 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:28.128473 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9a5a8af6-adf3-419c-9222-d2d903d1d845 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/15155950-e1cc-4745-b8ef-266093e7a6fa" status: 200 len: 1512 microversion: 2.1 time: 0.868393 Jul 31 01:19:28.144532 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-3da6271f-4de1-4688-a033-26b5dcab0ed3 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] HTTP exception thrown: Invalid port range 22:1903624356. Valid TCP ports should be between 1-65535 Jul 31 01:19:28.145936 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1344/2670] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:27 2022] GET /compute/v2.1/servers/15155950-e1cc-4745-b8ef-266093e7a6fa => generated 1512 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3da6271f-4de1-4688-a033-26b5dcab0ed3 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Request method failure captured: Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 146 Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5diSh2JJgxOPRGJ9wZvFb7vwDRvdd0E5gttpLj96oT6MN2dmJ5LbVotKSP20LletX3vptZFiX1D_j3X6TJDcyDAMGnPBK1nXS3NXdif7y1bNYH1R70LejgzSJSoqC5WH0IJkTwCwBHs9v_ALWXVPLnBXqHkmfXxs1Bq8EiR5Z9HO4Bs Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: bb2b89c41673431398f204fe56b43905 Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb2b89c41673431398f204fe56b43905"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb2b89c41673431398f204fe56b43905"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb2b89c41673431398f204fe56b43905"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb2b89c41673431398f204fe56b43905", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: bb2b89c41673431398f204fe56b43905 Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 09e740a43a08454294946de0a5536f7a Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: {"security_group_rule": {"parent_group_id": "76c49f97-38a5-4317-ba99-1f2e62cfb9d5", "ip_protocol": "tcp", "from_port": 22, "to_port": 1903624356}} Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid port range 22:1903624356. Valid TCP ports should be between 1-65535 Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'security_group_rule': {'parent_group_id': '76c49f97-38a5-4317-ba99-1f2e62cfb9d5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1903624356}}} Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1903624356. Valid TCP ports should be between 1-65535 Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1903624356. Valid TCP ports should be between 1-65535 Jul 31 01:19:28.147044 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.150908 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:28.150908 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.150908 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:28.150908 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:28.150908 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:28.150908 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:19:28.150908 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:19:28.150908 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1903624356. Valid TCP ports should be between 1-65535 Jul 31 01:19:28.150908 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.152997 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3da6271f-4de1-4688-a033-26b5dcab0ed3 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Returning 400 to user: Invalid port range 22:1903624356. Valid TCP ports should be between 1-65535 {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:19:28.154069 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3da6271f-4de1-4688-a033-26b5dcab0ed3 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.503830 Jul 31 01:19:28.159611 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1327/2671] 10.222.0.45 () {60 vars in 1195 bytes} [Sun Jul 31 01:19:27 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 510 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:19:28.169533 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f536bcef-061a-4730-87d3-1a9971fd9575 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:28.171568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-35808214-5b7d-444d-829f-5f05ecae7bb3 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Action: 'create', calling method: .version_select at 0x7fede55d80d0>, body: {"security_group_rule": {"parent_group_id": "91504770-e512-42e5-ab8e-6d686d60f372", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:28.172406 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f536bcef-061a-4730-87d3-1a9971fd9575 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:28.193184 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f536bcef-061a-4730-87d3-1a9971fd9575 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:28.198787 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f536bcef-061a-4730-87d3-1a9971fd9575 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:28.201452 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f536bcef-061a-4730-87d3-1a9971fd9575 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:28.206634 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f536bcef-061a-4730-87d3-1a9971fd9575 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:28.592335 n-d-master-1 devstack@n-api.service[119474]: DEBUG neutronclient.v2_0.client [None req-35808214-5b7d-444d-829f-5f05ecae7bb3 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 91504770-e512-42e5-ab8e-6d686d60f372 does not exist", "detail": ""}} {{(pid=119474) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:19:28.593130 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.security_group_api [None req-35808214-5b7d-444d-829f-5f05ecae7bb3 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Neutron security group 91504770-e512-42e5-ab8e-6d686d60f372 not found {{(pid=119474) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 31 01:19:28.593727 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-35808214-5b7d-444d-829f-5f05ecae7bb3 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] HTTP exception thrown: Security group 91504770-e512-42e5-ab8e-6d686d60f372 does not exist Jul 31 01:19:28.593727 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-57270906-0881-4996-8f2a-069c74c8dade'] Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-35808214-5b7d-444d-829f-5f05ecae7bb3 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Request method failure captured: Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 138 Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5diSh2JJgxOPRGJ9wZvFb7vwDRvdd0E5gttpLj96oT6MN2dmJ5LbVotKSP20LletX3vptZFiX1D_j3X6TJDcyDAMGnPBK1nXS3NXdif7y1bNYH1R70LejgzSJSoqC5WH0IJkTwCwBHs9v_ALWXVPLnBXqHkmfXxs1Bq8EiR5Z9HO4Bs Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: bb2b89c41673431398f204fe56b43905 Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb2b89c41673431398f204fe56b43905"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb2b89c41673431398f204fe56b43905"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb2b89c41673431398f204fe56b43905"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb2b89c41673431398f204fe56b43905", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: bb2b89c41673431398f204fe56b43905 Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 09e740a43a08454294946de0a5536f7a Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: {"security_group_rule": {"parent_group_id": "91504770-e512-42e5-ab8e-6d686d60f372", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: exception: Security group 91504770-e512-42e5-ab8e-6d686d60f372 does not exist Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-57270906-0881-4996-8f2a-069c74c8dade'] Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'security_group_rule': {'parent_group_id': '91504770-e512-42e5-ab8e-6d686d60f372', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:19:28.596641 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 91504770-e512-42e5-ab8e-6d686d60f372 does not exist Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57270906-0881-4996-8f2a-069c74c8dade'] Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 91504770-e512-42e5-ab8e-6d686d60f372 does not exist Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57270906-0881-4996-8f2a-069c74c8dade'] Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 91504770-e512-42e5-ab8e-6d686d60f372 does not exist Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57270906-0881-4996-8f2a-069c74c8dade'] Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 91504770-e512-42e5-ab8e-6d686d60f372 does not exist Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57270906-0881-4996-8f2a-069c74c8dade'] Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-35808214-5b7d-444d-829f-5f05ecae7bb3 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Returning 404 to user: Security group 91504770-e512-42e5-ab8e-6d686d60f372 does not exist Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-57270906-0881-4996-8f2a-069c74c8dade'] {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-35808214-5b7d-444d-829f-5f05ecae7bb3 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.437329 Jul 31 01:19:28.608566 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1328/2672] 10.222.0.45 () {60 vars in 1195 bytes} [Sun Jul 31 01:19:28 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:19:28.619253 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-277b30c6-0941-48ea-97b7-0b8d4d58cd70 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Calling method '.version_select at 0x7fedeaa09b80>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:28.774697 n-d-master-1 devstack@n-api.service[119474]: DEBUG neutronclient.v2_0.client [None req-277b30c6-0941-48ea-97b7-0b8d4d58cd70 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 2299e31a-95d2-45c5-a009-75c09e4278d3 does not exist", "detail": ""}} {{(pid=119474) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:19:28.775612 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.security_group_api [None req-277b30c6-0941-48ea-97b7-0b8d4d58cd70 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Neutron security group rule 2299e31a-95d2-45c5-a009-75c09e4278d3 not found {{(pid=119474) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 31 01:19:28.776380 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-277b30c6-0941-48ea-97b7-0b8d4d58cd70 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] HTTP exception thrown: Security group rule 2299e31a-95d2-45c5-a009-75c09e4278d3 does not exist Jul 31 01:19:28.776380 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-d660cf1d-7bd4-4447-a778-d08a3df58ab9'] Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-277b30c6-0941-48ea-97b7-0b8d4d58cd70 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Request method failure captured: Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/os-security-group-rules/2299e31a-95d2-45c5-a009-75c09e4278d3 HTTP/1.1 Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5diSh2JJgxOPRGJ9wZvFb7vwDRvdd0E5gttpLj96oT6MN2dmJ5LbVotKSP20LletX3vptZFiX1D_j3X6TJDcyDAMGnPBK1nXS3NXdif7y1bNYH1R70LejgzSJSoqC5WH0IJkTwCwBHs9v_ALWXVPLnBXqHkmfXxs1Bq8EiR5Z9HO4Bs Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: bb2b89c41673431398f204fe56b43905 Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb2b89c41673431398f204fe56b43905"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/bb2b89c41673431398f204fe56b43905"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/bb2b89c41673431398f204fe56b43905"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_bb2b89c41673431398f204fe56b43905", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: bb2b89c41673431398f204fe56b43905 Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330 Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 09e740a43a08454294946de0a5536f7a Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: exception: Security group rule 2299e31a-95d2-45c5-a009-75c09e4278d3 does not exist Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-d660cf1d-7bd4-4447-a778-d08a3df58ab9'] Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '2299e31a-95d2-45c5-a009-75c09e4278d3'} Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:19:28.779301 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 2299e31a-95d2-45c5-a009-75c09e4278d3 does not exist Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d660cf1d-7bd4-4447-a778-d08a3df58ab9'] Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 2299e31a-95d2-45c5-a009-75c09e4278d3 does not exist Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d660cf1d-7bd4-4447-a778-d08a3df58ab9'] Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 2299e31a-95d2-45c5-a009-75c09e4278d3 does not exist Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d660cf1d-7bd4-4447-a778-d08a3df58ab9'] Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 2299e31a-95d2-45c5-a009-75c09e4278d3 does not exist Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d660cf1d-7bd4-4447-a778-d08a3df58ab9'] Jul 31 01:19:28.784411 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:28.795792 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-277b30c6-0941-48ea-97b7-0b8d4d58cd70 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Returning 404 to user: Security group rule 2299e31a-95d2-45c5-a009-75c09e4278d3 does not exist Jul 31 01:19:28.795792 n-d-master-1 devstack@n-api.service[119474]: Neutron server returns request_ids: ['req-d660cf1d-7bd4-4447-a778-d08a3df58ab9'] {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:19:28.797028 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-277b30c6-0941-48ea-97b7-0b8d4d58cd70 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-group-rules/2299e31a-95d2-45c5-a009-75c09e4278d3" status: 404 len: 199 microversion: 2.1 time: 0.190431 Jul 31 01:19:28.803940 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1329/2673] 10.222.0.45 () {58 vars in 1287 bytes} [Sun Jul 31 01:19:28 2022] DELETE /compute/v2.1/os-security-group-rules/2299e31a-95d2-45c5-a009-75c09e4278d3 => generated 199 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:19:28.814070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cda051dd-2022-42b6-bb07-c94afb53ad8c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:28.816066 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cda051dd-2022-42b6-bb07-c94afb53ad8c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:28.833511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cda051dd-2022-42b6-bb07-c94afb53ad8c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:28.834504 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cda051dd-2022-42b6-bb07-c94afb53ad8c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:28.836110 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cda051dd-2022-42b6-bb07-c94afb53ad8c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:28.840002 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cda051dd-2022-42b6-bb07-c94afb53ad8c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:29.030350 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cda051dd-2022-42b6-bb07-c94afb53ad8c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:29.039888 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cda051dd-2022-42b6-bb07-c94afb53ad8c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1275 microversion: 2.1 time: 0.234113 Jul 31 01:19:29.047511 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1330/2674] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:28 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1275 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:29.065849 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ebb258ec-7106-4f03-93fc-7cbced4eceab tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Calling method '.version_select at 0x7fede565adc0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:29.118251 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f536bcef-061a-4730-87d3-1a9971fd9575 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:29.132736 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f536bcef-061a-4730-87d3-1a9971fd9575 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1490 microversion: 2.1 time: 0.976829 Jul 31 01:19:29.136379 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1345/2675] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:28 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1490 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:29.148619 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f1c32ac4-5619-4cbc-bb25-b7c6e7b6aeb5 req-c749079c-0806-4bb3-86b0-7d2f00128a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15155950-e1cc-4745-b8ef-266093e7a6fa", "name": "network-vif-deleted", "tag": "4a038e08-ee1c-4b47-beb3-700d261847cb"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:29.178294 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:29.191850 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f1c32ac4-5619-4cbc-bb25-b7c6e7b6aeb5 req-c749079c-0806-4bb3-86b0-7d2f00128a76 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:29.193331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f1c32ac4-5619-4cbc-bb25-b7c6e7b6aeb5 req-c749079c-0806-4bb3-86b0-7d2f00128a76 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:29.222484 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f1c32ac4-5619-4cbc-bb25-b7c6e7b6aeb5 req-c749079c-0806-4bb3-86b0-7d2f00128a76 service nova] Creating event network-vif-deleted:4a038e08-ee1c-4b47-beb3-700d261847cb for instance 15155950-e1cc-4745-b8ef-266093e7a6fa on n-h1-master-1 Jul 31 01:19:29.240340 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f1c32ac4-5619-4cbc-bb25-b7c6e7b6aeb5 req-c749079c-0806-4bb3-86b0-7d2f00128a76 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102225 Jul 31 01:19:29.243994 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1346/2676] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:29.265158 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc3afd0b-9de2-42f5-8dc9-754c661a4e23 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:29.268325 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc3afd0b-9de2-42f5-8dc9-754c661a4e23 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 15155950-e1cc-4745-b8ef-266093e7a6fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:29.292853 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc3afd0b-9de2-42f5-8dc9-754c661a4e23 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:29.293777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc3afd0b-9de2-42f5-8dc9-754c661a4e23 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:29.294820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc3afd0b-9de2-42f5-8dc9-754c661a4e23 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:29.295552 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc3afd0b-9de2-42f5-8dc9-754c661a4e23 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:29.366734 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc3afd0b-9de2-42f5-8dc9-754c661a4e23 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:29.367694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc3afd0b-9de2-42f5-8dc9-754c661a4e23 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:29.368522 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-fc3afd0b-9de2-42f5-8dc9-754c661a4e23 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lazy-loading 'fault' on Instance uuid 15155950-e1cc-4745-b8ef-266093e7a6fa {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:19:29.503480 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fc3afd0b-9de2-42f5-8dc9-754c661a4e23 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:29.543637 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc3afd0b-9de2-42f5-8dc9-754c661a4e23 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/15155950-e1cc-4745-b8ef-266093e7a6fa" status: 200 len: 1308 microversion: 2.1 time: 0.298060 Jul 31 01:19:29.551076 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1347/2677] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:29 2022] GET /compute/v2.1/servers/15155950-e1cc-4745-b8ef-266093e7a6fa => generated 1308 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:30.074329 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-44cd0b5e-3321-41e2-bfe7-55bfc131b7eb tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:30.075157 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-44cd0b5e-3321-41e2-bfe7-55bfc131b7eb tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:30.089264 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44cd0b5e-3321-41e2-bfe7-55bfc131b7eb tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:30.090023 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44cd0b5e-3321-41e2-bfe7-55bfc131b7eb tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:30.092136 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44cd0b5e-3321-41e2-bfe7-55bfc131b7eb tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:30.093476 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44cd0b5e-3321-41e2-bfe7-55bfc131b7eb tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:31.278144 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ebb258ec-7106-4f03-93fc-7cbced4eceab tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/76c49f97-38a5-4317-ba99-1f2e62cfb9d5" status: 202 len: 0 microversion: 2.1 time: 2.229208 Jul 31 01:19:31.282388 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1331/2678] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:19:29 2022] DELETE /compute/v2.1/os-security-groups/76c49f97-38a5-4317-ba99-1f2e62cfb9d5 => generated 0 bytes in 2234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:19:31.291365 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ce56ba58-35f6-41ba-b535-979fd5e983ee tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:31.292537 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ce56ba58-35f6-41ba-b535-979fd5e983ee tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:31.308947 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce56ba58-35f6-41ba-b535-979fd5e983ee tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:31.310055 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce56ba58-35f6-41ba-b535-979fd5e983ee tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:31.315326 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce56ba58-35f6-41ba-b535-979fd5e983ee tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:31.316202 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce56ba58-35f6-41ba-b535-979fd5e983ee tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:31.523546 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-44cd0b5e-3321-41e2-bfe7-55bfc131b7eb tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:31.540723 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-44cd0b5e-3321-41e2-bfe7-55bfc131b7eb tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1317 microversion: 2.1 time: 1.472599 Jul 31 01:19:31.574649 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1348/2679] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:30 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1317 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:31.600335 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5aee2254-ba6b-4019-b538-f431a992b558 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:31.601774 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5aee2254-ba6b-4019-b538-f431a992b558 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 15155950-e1cc-4745-b8ef-266093e7a6fa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:31.630980 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5aee2254-ba6b-4019-b538-f431a992b558 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:31.631765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5aee2254-ba6b-4019-b538-f431a992b558 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:31.632566 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5aee2254-ba6b-4019-b538-f431a992b558 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:31.633003 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5aee2254-ba6b-4019-b538-f431a992b558 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:31.688353 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-5aee2254-ba6b-4019-b538-f431a992b558 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] HTTP exception thrown: Instance 15155950-e1cc-4745-b8ef-266093e7a6fa could not be found. Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5aee2254-ba6b-4019-b538-f431a992b558 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Request method failure captured: Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/15155950-e1cc-4745-b8ef-266093e7a6fa HTTP/1.1 Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dhZ5jhNh1z7vA0cg3H0WA-LPvutnLYe5gliJ4Eg0xvvIXFMEMK-0GBY96z6BZRF6iJxybucetky_z2qoMrd-NxIS3E5JyqUKDqIfMpVMSsOnepK6t0H_4jCjDGCG4Mjcny61EWfdcw5r69WyHMmyPWCbN_UJoHM7n4nDp2Ns04Mybs Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 44209ac9bb8d45afa6803de51652c614 Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-MultipleCreateTestJSON-682036235 Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/44209ac9bb8d45afa6803de51652c614"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/44209ac9bb8d45afa6803de51652c614"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/44209ac9bb8d45afa6803de51652c614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_44209ac9bb8d45afa6803de51652c614", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-MultipleCreateTestJSON-682036235 Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 44209ac9bb8d45afa6803de51652c614 Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-MultipleCreateTestJSON-682036235 Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-MultipleCreateTestJSON-682036235-project Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 0149114cdb8e493c946447fc26acbce2 Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-MultipleCreateTestJSON-682036235-project Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 15155950-e1cc-4745-b8ef-266093e7a6fa could not be found. Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '15155950-e1cc-4745-b8ef-266093e7a6fa'} Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15155950-e1cc-4745-b8ef-266093e7a6fa could not be found. Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15155950-e1cc-4745-b8ef-266093e7a6fa could not be found. Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:31.698352 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:31.702982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:31.702982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:31.702982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:31.702982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:19:31.702982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:19:31.702982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15155950-e1cc-4745-b8ef-266093e7a6fa could not be found. Jul 31 01:19:31.702982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:31.702982 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5aee2254-ba6b-4019-b538-f431a992b558 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Returning 404 to user: Instance 15155950-e1cc-4745-b8ef-266093e7a6fa could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:19:31.707720 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5aee2254-ba6b-4019-b538-f431a992b558 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/15155950-e1cc-4745-b8ef-266093e7a6fa" status: 404 len: 111 microversion: 2.1 time: 0.127554 Jul 31 01:19:31.708487 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1349/2680] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:31 2022] GET /compute/v2.1/servers/15155950-e1cc-4745-b8ef-266093e7a6fa => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:19:31.722488 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-29ec37fb-a81a-43b2-aaf6-33c0f5810003 req-9624690b-da87-48e8-a3d8-1731415ad054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f931f935-17a4-41ac-ac71-4ee21771219d", "name": "network-vif-unplugged", "status": "completed", "tag": "5ecc4d11-f7de-41b8-bd4a-7e73d5c197fb"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:31.750545 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-29ec37fb-a81a-43b2-aaf6-33c0f5810003 req-9624690b-da87-48e8-a3d8-1731415ad054 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:31.751010 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-29ec37fb-a81a-43b2-aaf6-33c0f5810003 req-9624690b-da87-48e8-a3d8-1731415ad054 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:31.783127 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-29ec37fb-a81a-43b2-aaf6-33c0f5810003 req-9624690b-da87-48e8-a3d8-1731415ad054 service nova] Creating event network-vif-unplugged:5ecc4d11-f7de-41b8-bd4a-7e73d5c197fb for instance f931f935-17a4-41ac-ac71-4ee21771219d on n-h2-master-1 Jul 31 01:19:31.798296 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-29ec37fb-a81a-43b2-aaf6-33c0f5810003 req-9624690b-da87-48e8-a3d8-1731415ad054 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085852 Jul 31 01:19:31.803617 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1350/2681] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:31.818945 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-128cd209-ffcf-47ad-ae81-e7c6be9df416 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Calling method '.version_select at 0x7fede4880790>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:32.025582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ce56ba58-35f6-41ba-b535-979fd5e983ee tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:32.037308 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ce56ba58-35f6-41ba-b535-979fd5e983ee tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1478 microversion: 2.1 time: 0.752429 Jul 31 01:19:32.039822 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1332/2682] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:31 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1478 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:32.051831 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a6be9d60-3e1e-46d2-b937-da1e1b3f04df tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:32.054192 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a6be9d60-3e1e-46d2-b937-da1e1b3f04df tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:32.070414 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a6be9d60-3e1e-46d2-b937-da1e1b3f04df tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:32.070873 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a6be9d60-3e1e-46d2-b937-da1e1b3f04df tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:32.071694 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a6be9d60-3e1e-46d2-b937-da1e1b3f04df tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:32.072985 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a6be9d60-3e1e-46d2-b937-da1e1b3f04df tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:32.163878 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a6be9d60-3e1e-46d2-b937-da1e1b3f04df tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:32.164349 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a6be9d60-3e1e-46d2-b937-da1e1b3f04df tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:32.168192 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-a6be9d60-3e1e-46d2-b937-da1e1b3f04df tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lazy-loading 'fault' on Instance uuid 41b1dac5-1cf2-48e9-b801-96f2b39d8346 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:19:32.277440 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a6be9d60-3e1e-46d2-b937-da1e1b3f04df tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0149114cdb8e493c946447fc26acbce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44209ac9bb8d45afa6803de51652c614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:32.303526 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a6be9d60-3e1e-46d2-b937-da1e1b3f04df tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346" status: 200 len: 1308 microversion: 2.1 time: 0.260303 Jul 31 01:19:32.307477 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1333/2683] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:32 2022] GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 => generated 1308 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:32.322097 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-cf16d5dd-3a5b-4dd1-9ef3-1dce30eee9d8 req-ce64804c-2e27-4e83-ade6-2d5fe8f39f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b1dac5-1cf2-48e9-b801-96f2b39d8346", "name": "network-vif-deleted", "tag": "e5a9e900-5875-4d34-961e-0503dea72d2f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:32.341697 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-cf16d5dd-3a5b-4dd1-9ef3-1dce30eee9d8 req-ce64804c-2e27-4e83-ade6-2d5fe8f39f3e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:32.342154 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-cf16d5dd-3a5b-4dd1-9ef3-1dce30eee9d8 req-ce64804c-2e27-4e83-ade6-2d5fe8f39f3e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:32.365265 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-cf16d5dd-3a5b-4dd1-9ef3-1dce30eee9d8 req-ce64804c-2e27-4e83-ade6-2d5fe8f39f3e service nova] Creating event network-vif-deleted:e5a9e900-5875-4d34-961e-0503dea72d2f for instance 41b1dac5-1cf2-48e9-b801-96f2b39d8346 on n-h2-master-1 Jul 31 01:19:32.370870 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-cf16d5dd-3a5b-4dd1-9ef3-1dce30eee9d8 req-ce64804c-2e27-4e83-ade6-2d5fe8f39f3e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062138 Jul 31 01:19:32.372159 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1334/2684] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:32.378692 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-f482d056-508c-4ff2-97d3-e9525695379d req-3675f0ea-a25d-426e-ad67-6f0f44f5fe9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "643b9642-846d-41a9-886f-d9b173367085", "tag": "f063d071-4d08-4af3-aad9-ba5f92e981e7"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:32.393213 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f482d056-508c-4ff2-97d3-e9525695379d req-3675f0ea-a25d-426e-ad67-6f0f44f5fe9f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:32.394197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f482d056-508c-4ff2-97d3-e9525695379d req-3675f0ea-a25d-426e-ad67-6f0f44f5fe9f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:32.410837 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-f482d056-508c-4ff2-97d3-e9525695379d req-3675f0ea-a25d-426e-ad67-6f0f44f5fe9f service nova] Creating event network-changed:f063d071-4d08-4af3-aad9-ba5f92e981e7 for instance 643b9642-846d-41a9-886f-d9b173367085 on n-h1-master-1 Jul 31 01:19:32.418003 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-f482d056-508c-4ff2-97d3-e9525695379d req-3675f0ea-a25d-426e-ad67-6f0f44f5fe9f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043679 Jul 31 01:19:32.419251 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1335/2685] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:32.466939 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-128cd209-ffcf-47ad-ae81-e7c6be9df416 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/fc905cd9-b10f-46e6-8f4c-9c60219c5120" status: 202 len: 0 microversion: 2.1 time: 0.657116 Jul 31 01:19:32.467906 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1351/2686] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:19:31 2022] DELETE /compute/v2.1/os-security-groups/fc905cd9-b10f-46e6-8f4c-9c60219c5120 => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:19:32.478119 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bde857bc-47e3-479f-8532-5940bb9e8f51 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Calling method '.version_select at 0x7fede5662310>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:32.567189 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e89843b-765c-461e-974f-f6a38f945ef3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:32.567947 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3e89843b-765c-461e-974f-f6a38f945ef3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:32.590676 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e89843b-765c-461e-974f-f6a38f945ef3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:32.591148 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e89843b-765c-461e-974f-f6a38f945ef3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:32.595054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e89843b-765c-461e-974f-f6a38f945ef3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:32.596305 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e89843b-765c-461e-974f-f6a38f945ef3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:32.631949 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:32.918954 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e89843b-765c-461e-974f-f6a38f945ef3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:32.932098 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3e89843b-765c-461e-974f-f6a38f945ef3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1317 microversion: 2.1 time: 0.368939 Jul 31 01:19:32.945363 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1352/2687] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:32 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:33.063503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3d5cf07c-d96b-4489-8356-bb524326cf32 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:33.064922 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3d5cf07c-d96b-4489-8356-bb524326cf32 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:33.084289 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d5cf07c-d96b-4489-8356-bb524326cf32 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:33.086043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d5cf07c-d96b-4489-8356-bb524326cf32 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:33.090834 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d5cf07c-d96b-4489-8356-bb524326cf32 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:33.091479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d5cf07c-d96b-4489-8356-bb524326cf32 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:33.144458 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bde857bc-47e3-479f-8532-5940bb9e8f51 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/c7bd976e-8d9a-4fad-bf7c-7c6e851052bc" status: 202 len: 0 microversion: 2.1 time: 0.671227 Jul 31 01:19:33.146039 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1336/2688] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:19:32 2022] DELETE /compute/v2.1/os-security-groups/c7bd976e-8d9a-4fad-bf7c-7c6e851052bc => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:19:33.154578 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c493c72f-c174-449e-a8e2-407a55e49651 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Calling method '.version_select at 0x7fede5f16af0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:33.419975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3d5cf07c-d96b-4489-8356-bb524326cf32 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:33.444413 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3d5cf07c-d96b-4489-8356-bb524326cf32 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1478 microversion: 2.1 time: 0.384838 Jul 31 01:19:33.447641 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1353/2689] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:33 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1478 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:33.459302 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b5f36cc0-eb69-48ba-a392-53b67f789f14 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:33.462022 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b5f36cc0-eb69-48ba-a392-53b67f789f14 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] [instance: 41b1dac5-1cf2-48e9-b801-96f2b39d8346] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:33.473139 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5f36cc0-eb69-48ba-a392-53b67f789f14 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:33.473788 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5f36cc0-eb69-48ba-a392-53b67f789f14 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:33.474745 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5f36cc0-eb69-48ba-a392-53b67f789f14 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:33.475619 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5f36cc0-eb69-48ba-a392-53b67f789f14 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:33.493826 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-b5f36cc0-eb69-48ba-a392-53b67f789f14 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] HTTP exception thrown: Instance 41b1dac5-1cf2-48e9-b801-96f2b39d8346 could not be found. Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b5f36cc0-eb69-48ba-a392-53b67f789f14 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Request method failure captured: Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 HTTP/1.1 Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dhZ5jhNh1z7vA0cg3H0WA-LPvutnLYe5gliJ4Eg0xvvIXFMEMK-0GBY96z6BZRF6iJxybucetky_z2qoMrd-NxIS3E5JyqUKDqIfMpVMSsOnepK6t0H_4jCjDGCG4Mjcny61EWfdcw5r69WyHMmyPWCbN_UJoHM7n4nDp2Ns04Mybs Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 44209ac9bb8d45afa6803de51652c614 Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-MultipleCreateTestJSON-682036235 Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/44209ac9bb8d45afa6803de51652c614"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/44209ac9bb8d45afa6803de51652c614"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/44209ac9bb8d45afa6803de51652c614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_44209ac9bb8d45afa6803de51652c614", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-MultipleCreateTestJSON-682036235 Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 44209ac9bb8d45afa6803de51652c614 Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-MultipleCreateTestJSON-682036235 Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-MultipleCreateTestJSON-682036235-project Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 0149114cdb8e493c946447fc26acbce2 Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-MultipleCreateTestJSON-682036235-project Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 41b1dac5-1cf2-48e9-b801-96f2b39d8346 could not be found. Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '41b1dac5-1cf2-48e9-b801-96f2b39d8346'} Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41b1dac5-1cf2-48e9-b801-96f2b39d8346 could not be found. Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41b1dac5-1cf2-48e9-b801-96f2b39d8346 could not be found. Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:33.497028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:33.503853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:33.503853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:33.503853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:33.503853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:19:33.503853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:19:33.503853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41b1dac5-1cf2-48e9-b801-96f2b39d8346 could not be found. Jul 31 01:19:33.503853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:33.508441 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b5f36cc0-eb69-48ba-a392-53b67f789f14 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] Returning 404 to user: Instance 41b1dac5-1cf2-48e9-b801-96f2b39d8346 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:19:33.509662 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b5f36cc0-eb69-48ba-a392-53b67f789f14 tempest-MultipleCreateTestJSON-682036235 tempest-MultipleCreateTestJSON-682036235-project] 10.222.0.45 "GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346" status: 404 len: 111 microversion: 2.1 time: 0.060671 Jul 31 01:19:33.511525 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1354/2690] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:33 2022] GET /compute/v2.1/servers/41b1dac5-1cf2-48e9-b801-96f2b39d8346 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:19:33.654407 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c493c72f-c174-449e-a8e2-407a55e49651 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/cf2664ee-cad1-46e2-9627-3b89b0cde0dd" status: 202 len: 0 microversion: 2.1 time: 0.504218 Jul 31 01:19:33.656095 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1337/2691] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:19:33 2022] DELETE /compute/v2.1/os-security-groups/cf2664ee-cad1-46e2-9627-3b89b0cde0dd => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 01:19:33.665169 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-57487226-0f94-4bcd-874d-b77e7311fc29 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] Calling method '.version_select at 0x7fede483d0d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:33.954479 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-49b1093d-a13b-4625-bf43-a242e9818f14 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:33.955982 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-49b1093d-a13b-4625-bf43-a242e9818f14 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:33.967548 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49b1093d-a13b-4625-bf43-a242e9818f14 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:33.971277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49b1093d-a13b-4625-bf43-a242e9818f14 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:33.972369 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49b1093d-a13b-4625-bf43-a242e9818f14 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:33.974578 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49b1093d-a13b-4625-bf43-a242e9818f14 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:34.052994 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-57487226-0f94-4bcd-874d-b77e7311fc29 tempest-SecurityGroupRulesNegativeTestJSON-1883892330 tempest-SecurityGroupRulesNegativeTestJSON-1883892330-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/0ea06c39-57c0-43f1-b241-148b71197dfa" status: 202 len: 0 microversion: 2.1 time: 0.392252 Jul 31 01:19:34.055124 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1355/2692] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:19:33 2022] DELETE /compute/v2.1/os-security-groups/0ea06c39-57c0-43f1-b241-148b71197dfa => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:19:34.401563 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-49b1093d-a13b-4625-bf43-a242e9818f14 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:34.419200 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-49b1093d-a13b-4625-bf43-a242e9818f14 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1317 microversion: 2.1 time: 0.468726 Jul 31 01:19:34.423277 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1338/2693] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:33 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:34.470263 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6eae22f1-1930-436f-b40d-16fbe0103faf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:34.471594 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6eae22f1-1930-436f-b40d-16fbe0103faf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:34.487500 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6eae22f1-1930-436f-b40d-16fbe0103faf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:34.491143 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6eae22f1-1930-436f-b40d-16fbe0103faf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:34.492268 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6eae22f1-1930-436f-b40d-16fbe0103faf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:34.493163 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6eae22f1-1930-436f-b40d-16fbe0103faf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:34.771416 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6eae22f1-1930-436f-b40d-16fbe0103faf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:34.796503 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6eae22f1-1930-436f-b40d-16fbe0103faf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1478 microversion: 2.1 time: 0.331192 Jul 31 01:19:34.821273 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1356/2694] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:34 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1478 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:35.226610 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-739c7714-f0a1-44d6-9008-4b58a406cd63 req-e9a6f397-8817-4600-862c-569fed73062a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f931f935-17a4-41ac-ac71-4ee21771219d", "name": "network-vif-plugged", "status": "completed", "tag": "5ecc4d11-f7de-41b8-bd4a-7e73d5c197fb"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:35.246457 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:35.247198 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:35.257595 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-739c7714-f0a1-44d6-9008-4b58a406cd63 req-e9a6f397-8817-4600-862c-569fed73062a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:35.258063 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-739c7714-f0a1-44d6-9008-4b58a406cd63 req-e9a6f397-8817-4600-862c-569fed73062a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:35.277434 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-739c7714-f0a1-44d6-9008-4b58a406cd63 req-e9a6f397-8817-4600-862c-569fed73062a service nova] Creating event network-vif-plugged:5ecc4d11-f7de-41b8-bd4a-7e73d5c197fb for instance f931f935-17a4-41ac-ac71-4ee21771219d on n-h2-master-1 Jul 31 01:19:35.287770 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-739c7714-f0a1-44d6-9008-4b58a406cd63 req-e9a6f397-8817-4600-862c-569fed73062a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065468 Jul 31 01:19:35.288719 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1339/2695] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:35.459593 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7b271d5a-f6e6-450e-bd1e-ee7dbf6bf75d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:35.460621 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7b271d5a-f6e6-450e-bd1e-ee7dbf6bf75d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:35.467686 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:35.471551 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b271d5a-f6e6-450e-bd1e-ee7dbf6bf75d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:35.472619 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b271d5a-f6e6-450e-bd1e-ee7dbf6bf75d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:35.473902 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b271d5a-f6e6-450e-bd1e-ee7dbf6bf75d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:35.474791 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b271d5a-f6e6-450e-bd1e-ee7dbf6bf75d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:35.836906 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e4de91b3-9175-4e7e-a11e-c07e3b3e43e9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:35.839577 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e4de91b3-9175-4e7e-a11e-c07e3b3e43e9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:35.849270 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4de91b3-9175-4e7e-a11e-c07e3b3e43e9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:35.851702 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4de91b3-9175-4e7e-a11e-c07e3b3e43e9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:35.852855 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4de91b3-9175-4e7e-a11e-c07e3b3e43e9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:35.853561 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4de91b3-9175-4e7e-a11e-c07e3b3e43e9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:36.038994 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7b271d5a-f6e6-450e-bd1e-ee7dbf6bf75d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:36.056572 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7b271d5a-f6e6-450e-bd1e-ee7dbf6bf75d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1317 microversion: 2.1 time: 0.601633 Jul 31 01:19:36.085677 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1357/2696] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:35 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:36.216053 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e4de91b3-9175-4e7e-a11e-c07e3b3e43e9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:36.229699 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e4de91b3-9175-4e7e-a11e-c07e3b3e43e9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1478 microversion: 2.1 time: 0.405285 Jul 31 01:19:36.244555 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1340/2697] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:35 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1478 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:37.085370 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ee148779-7bde-43ad-98a9-8d51d51e66b0 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:37.086196 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ee148779-7bde-43ad-98a9-8d51d51e66b0 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:37.106641 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee148779-7bde-43ad-98a9-8d51d51e66b0 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:37.107492 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee148779-7bde-43ad-98a9-8d51d51e66b0 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:37.116459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee148779-7bde-43ad-98a9-8d51d51e66b0 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:37.118297 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee148779-7bde-43ad-98a9-8d51d51e66b0 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:37.257071 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b722a2f8-e966-4b3d-8cf4-5ad5d0b5f12b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:37.258763 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b722a2f8-e966-4b3d-8cf4-5ad5d0b5f12b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:37.290777 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b722a2f8-e966-4b3d-8cf4-5ad5d0b5f12b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:37.301301 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b722a2f8-e966-4b3d-8cf4-5ad5d0b5f12b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:37.305166 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b722a2f8-e966-4b3d-8cf4-5ad5d0b5f12b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:37.311067 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b722a2f8-e966-4b3d-8cf4-5ad5d0b5f12b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:37.870805 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ee148779-7bde-43ad-98a9-8d51d51e66b0 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:37.879545 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ee148779-7bde-43ad-98a9-8d51d51e66b0 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1317 microversion: 2.1 time: 0.799121 Jul 31 01:19:37.892093 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1358/2698] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:37 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1317 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:37.905945 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f1314538-244a-49a4-b525-4fbfad1dcd20 req-345b2393-1187-47bd-9ba7-b273af8d4273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "643b9642-846d-41a9-886f-d9b173367085", "name": "network-vif-plugged", "status": "completed", "tag": "f063d071-4d08-4af3-aad9-ba5f92e981e7"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:37.953554 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f1314538-244a-49a4-b525-4fbfad1dcd20 req-345b2393-1187-47bd-9ba7-b273af8d4273 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:37.961795 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f1314538-244a-49a4-b525-4fbfad1dcd20 req-345b2393-1187-47bd-9ba7-b273af8d4273 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:38.001246 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f1314538-244a-49a4-b525-4fbfad1dcd20 req-345b2393-1187-47bd-9ba7-b273af8d4273 service nova] Creating event network-vif-plugged:f063d071-4d08-4af3-aad9-ba5f92e981e7 for instance 643b9642-846d-41a9-886f-d9b173367085 on n-h1-master-1 Jul 31 01:19:38.019171 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f1314538-244a-49a4-b525-4fbfad1dcd20 req-345b2393-1187-47bd-9ba7-b273af8d4273 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124964 Jul 31 01:19:38.019892 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1359/2699] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:38.053524 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b722a2f8-e966-4b3d-8cf4-5ad5d0b5f12b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:38.080696 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b722a2f8-e966-4b3d-8cf4-5ad5d0b5f12b tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1464 microversion: 2.1 time: 0.824492 Jul 31 01:19:38.086547 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1341/2700] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:37 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1464 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:38.110581 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-053c29d5-b315-41e0-8788-2f27ee750c6d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:38.112393 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-053c29d5-b315-41e0-8788-2f27ee750c6d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:38.135495 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-053c29d5-b315-41e0-8788-2f27ee750c6d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:38.136763 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-053c29d5-b315-41e0-8788-2f27ee750c6d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:38.137778 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-053c29d5-b315-41e0-8788-2f27ee750c6d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:38.138241 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-053c29d5-b315-41e0-8788-2f27ee750c6d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:38.474724 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-053c29d5-b315-41e0-8788-2f27ee750c6d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:38.494727 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-053c29d5-b315-41e0-8788-2f27ee750c6d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1464 microversion: 2.1 time: 0.388415 Jul 31 01:19:38.495422 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1360/2701] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:38 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1464 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:38.525630 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0f306572-729b-4b95-a357-79461887e541"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:38.529924 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:38.545674 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:38.547362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:38.550642 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:38.553154 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:38.730966 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:19:38.732278 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:19:38.733237 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:19:38.733932 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:19:38.734558 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:19:38.820143 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:38.863391 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:38.873219 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:38.873928 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:38.874876 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:38.875705 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:38.901172 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-47df292a-9941-4561-8feb-b29e2eadef4f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:38.901929 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-47df292a-9941-4561-8feb-b29e2eadef4f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:38.921254 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47df292a-9941-4561-8feb-b29e2eadef4f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:38.923771 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-099b5a1f-d0fe-4b00-9ece-d889208588e2 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "POST /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d/action" status: 202 len: 1068 microversion: 2.1 time: 0.402594 Jul 31 01:19:38.925472 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1342/2702] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:19:38 2022] POST /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d/action => generated 1068 bytes in 405 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 31 01:19:38.925633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47df292a-9941-4561-8feb-b29e2eadef4f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:38.927114 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47df292a-9941-4561-8feb-b29e2eadef4f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:38.937646 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47df292a-9941-4561-8feb-b29e2eadef4f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:38.965253 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0b1befb2-a587-46ee-90b3-86d009b7af47 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:38.968648 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0b1befb2-a587-46ee-90b3-86d009b7af47 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:38.992091 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b1befb2-a587-46ee-90b3-86d009b7af47 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:38.994588 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b1befb2-a587-46ee-90b3-86d009b7af47 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:38.995660 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b1befb2-a587-46ee-90b3-86d009b7af47 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:38.996164 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b1befb2-a587-46ee-90b3-86d009b7af47 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:39.943834 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-47df292a-9941-4561-8feb-b29e2eadef4f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:39.958921 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-47df292a-9941-4561-8feb-b29e2eadef4f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1317 microversion: 2.1 time: 1.062416 Jul 31 01:19:39.972183 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1361/2703] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:38 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1317 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:40.005946 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0b1befb2-a587-46ee-90b3-86d009b7af47 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:40.013819 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0b1befb2-a587-46ee-90b3-86d009b7af47 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 1.068275 Jul 31 01:19:40.031877 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1343/2704] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:38 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:40.980082 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-46f024d0-cd4d-45d2-b767-9b8d5af16302 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:40.980724 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-46f024d0-cd4d-45d2-b767-9b8d5af16302 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:40.991108 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46f024d0-cd4d-45d2-b767-9b8d5af16302 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:40.991861 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46f024d0-cd4d-45d2-b767-9b8d5af16302 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:40.992833 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46f024d0-cd4d-45d2-b767-9b8d5af16302 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:40.993447 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46f024d0-cd4d-45d2-b767-9b8d5af16302 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:41.036188 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-22e37b9c-346a-42e4-8169-4b0f95c14434 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:41.037460 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-22e37b9c-346a-42e4-8169-4b0f95c14434 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:41.045213 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22e37b9c-346a-42e4-8169-4b0f95c14434 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:41.046463 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22e37b9c-346a-42e4-8169-4b0f95c14434 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:41.047478 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22e37b9c-346a-42e4-8169-4b0f95c14434 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:41.048110 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22e37b9c-346a-42e4-8169-4b0f95c14434 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:41.580104 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-22e37b9c-346a-42e4-8169-4b0f95c14434 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:41.589491 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-22e37b9c-346a-42e4-8169-4b0f95c14434 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 0.557632 Jul 31 01:19:41.600970 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-46f024d0-cd4d-45d2-b767-9b8d5af16302 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:41.601099 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1344/2705] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:41 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:41.606756 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-46f024d0-cd4d-45d2-b767-9b8d5af16302 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1506 microversion: 2.1 time: 0.630536 Jul 31 01:19:41.636266 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1362/2706] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:40 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1506 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:41.637815 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4fbe47b2-cf2e-44e1-9964-5183f1fe7130 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:41.638459 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4fbe47b2-cf2e-44e1-9964-5183f1fe7130 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:41.659038 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4fbe47b2-cf2e-44e1-9964-5183f1fe7130 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:41.659626 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4fbe47b2-cf2e-44e1-9964-5183f1fe7130 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:41.660471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4fbe47b2-cf2e-44e1-9964-5183f1fe7130 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:41.660925 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4fbe47b2-cf2e-44e1-9964-5183f1fe7130 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:42.344407 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4fbe47b2-cf2e-44e1-9964-5183f1fe7130 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:42.357359 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4fbe47b2-cf2e-44e1-9964-5183f1fe7130 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1506 microversion: 2.1 time: 0.725381 Jul 31 01:19:42.359529 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1345/2707] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:41 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1506 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:42.383399 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0f306572-729b-4b95-a357-79461887e541", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:42.395561 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:42.412737 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:42.413542 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:42.414870 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:42.415526 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:42.613742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95450c72-73a7-4fce-9914-5c7ce36dd4ed tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:42.614373 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-95450c72-73a7-4fce-9914-5c7ce36dd4ed tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:42.634869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95450c72-73a7-4fce-9914-5c7ce36dd4ed tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:42.635323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95450c72-73a7-4fce-9914-5c7ce36dd4ed tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:42.655870 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95450c72-73a7-4fce-9914-5c7ce36dd4ed tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:42.658307 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95450c72-73a7-4fce-9914-5c7ce36dd4ed tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:42.665314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:19:42.669547 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:19:42.671301 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:19:42.671821 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:19:42.674403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:19:42.818677 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:42.827039 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:42.828112 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:42.829334 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:42.830777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:42.893765 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "POST /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085/action" status: 202 len: 1108 microversion: 2.1 time: 0.517595 Jul 31 01:19:42.910803 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1363/2708] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:19:42 2022] POST /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085/action => generated 1108 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 31 01:19:42.914713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:42.917592 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bedf042b-9661-4cc3-95ed-9cdf5bb28995 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005075 Jul 31 01:19:42.926182 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1364/2709] 10.222.0.45 () {56 vars in 886 bytes} [Sun Jul 31 01:19:42 2022] GET /compute/ => generated 377 bytes in 14 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 31 01:19:42.965904 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c812995a-70c3-4d1b-b354-0df073564304 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:42.967914 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c812995a-70c3-4d1b-b354-0df073564304 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:42.982316 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c812995a-70c3-4d1b-b354-0df073564304 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:42.983261 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c812995a-70c3-4d1b-b354-0df073564304 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:42.984585 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c812995a-70c3-4d1b-b354-0df073564304 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:42.985271 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c812995a-70c3-4d1b-b354-0df073564304 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:43.140739 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-95450c72-73a7-4fce-9914-5c7ce36dd4ed tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:43.159112 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-95450c72-73a7-4fce-9914-5c7ce36dd4ed tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 0.544427 Jul 31 01:19:43.175854 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1346/2710] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:42 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:43.177696 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95450c72-73a7-4fce-9914-5c7ce36dd4ed tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:43.178961 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-95450c72-73a7-4fce-9914-5c7ce36dd4ed tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001939 Jul 31 01:19:43.185401 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1347/2711] 10.222.0.45 () {54 vars in 1035 bytes} [Sun Jul 31 01:19:43 2022] GET /compute/v2/ => generated 379 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 31 01:19:43.187141 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95450c72-73a7-4fce-9914-5c7ce36dd4ed tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:43.192251 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-95450c72-73a7-4fce-9914-5c7ce36dd4ed tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001611 Jul 31 01:19:43.193564 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1348/2712] 10.222.0.45 () {54 vars in 1041 bytes} [Sun Jul 31 01:19:43 2022] GET /compute/v2.1/ => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:43.206363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95450c72-73a7-4fce-9914-5c7ce36dd4ed tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:43.207376 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-95450c72-73a7-4fce-9914-5c7ce36dd4ed tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001327 Jul 31 01:19:43.216181 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1349/2713] 10.222.0.45 () {56 vars in 886 bytes} [Sun Jul 31 01:19:43 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 31 01:19:43.331494 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c812995a-70c3-4d1b-b354-0df073564304 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:43.345713 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c812995a-70c3-4d1b-b354-0df073564304 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1513 microversion: 2.1 time: 0.416733 Jul 31 01:19:43.346700 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1365/2714] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:42 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1513 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:44.177474 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cce0bcd6-b7bc-4747-9fb7-e77228f52c40 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:44.178105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cce0bcd6-b7bc-4747-9fb7-e77228f52c40 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:44.195765 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cce0bcd6-b7bc-4747-9fb7-e77228f52c40 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:44.196323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cce0bcd6-b7bc-4747-9fb7-e77228f52c40 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:44.197209 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cce0bcd6-b7bc-4747-9fb7-e77228f52c40 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:44.197617 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cce0bcd6-b7bc-4747-9fb7-e77228f52c40 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:44.367028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fe827e56-4bc2-4a69-8316-cbf5f29b1b20 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:44.368053 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fe827e56-4bc2-4a69-8316-cbf5f29b1b20 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:44.396749 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe827e56-4bc2-4a69-8316-cbf5f29b1b20 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:44.397350 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe827e56-4bc2-4a69-8316-cbf5f29b1b20 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:44.400922 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe827e56-4bc2-4a69-8316-cbf5f29b1b20 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:44.402798 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe827e56-4bc2-4a69-8316-cbf5f29b1b20 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:44.560760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cce0bcd6-b7bc-4747-9fb7-e77228f52c40 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:44.573393 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cce0bcd6-b7bc-4747-9fb7-e77228f52c40 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 0.400016 Jul 31 01:19:44.591903 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1350/2715] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:44 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:44.725935 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fe827e56-4bc2-4a69-8316-cbf5f29b1b20 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:44.738255 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fe827e56-4bc2-4a69-8316-cbf5f29b1b20 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1513 microversion: 2.1 time: 0.375373 Jul 31 01:19:44.753058 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1366/2716] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:44 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1513 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:45.597567 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1077e3ad-8836-4628-aefc-61367139ad7f tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:45.598275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1077e3ad-8836-4628-aefc-61367139ad7f tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:45.622116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1077e3ad-8836-4628-aefc-61367139ad7f tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:45.623586 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1077e3ad-8836-4628-aefc-61367139ad7f tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:45.628273 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1077e3ad-8836-4628-aefc-61367139ad7f tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:45.628983 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1077e3ad-8836-4628-aefc-61367139ad7f tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:45.773377 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4c543bc2-a509-49f1-8e61-1e3fee461be3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:45.774545 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4c543bc2-a509-49f1-8e61-1e3fee461be3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:45.782843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c543bc2-a509-49f1-8e61-1e3fee461be3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:45.783600 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c543bc2-a509-49f1-8e61-1e3fee461be3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:45.784664 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c543bc2-a509-49f1-8e61-1e3fee461be3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:45.785287 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c543bc2-a509-49f1-8e61-1e3fee461be3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:45.935666 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1077e3ad-8836-4628-aefc-61367139ad7f tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:45.950706 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1077e3ad-8836-4628-aefc-61367139ad7f tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 0.356697 Jul 31 01:19:45.951546 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1351/2717] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:45 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:46.060989 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4c543bc2-a509-49f1-8e61-1e3fee461be3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:46.071366 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4c543bc2-a509-49f1-8e61-1e3fee461be3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1513 microversion: 2.1 time: 0.313798 Jul 31 01:19:46.087980 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1367/2718] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:45 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1513 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:46.348652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4830b5fa-33c3-43d4-9314-e20c20515c55 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:46.350259 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4830b5fa-33c3-43d4-9314-e20c20515c55 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:46.366176 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4830b5fa-33c3-43d4-9314-e20c20515c55 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:46.366176 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4830b5fa-33c3-43d4-9314-e20c20515c55 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:46.366176 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4830b5fa-33c3-43d4-9314-e20c20515c55 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:46.366176 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4830b5fa-33c3-43d4-9314-e20c20515c55 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:46.635186 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4830b5fa-33c3-43d4-9314-e20c20515c55 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:46.650728 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4830b5fa-33c3-43d4-9314-e20c20515c55 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.306799 Jul 31 01:19:46.653197 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1352/2719] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:46 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:46.679227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-86bf8036-85c7-4ca6-a605-4d844c247f6e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:46.680496 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-86bf8036-85c7-4ca6-a605-4d844c247f6e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:46.691719 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86bf8036-85c7-4ca6-a605-4d844c247f6e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:46.692453 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86bf8036-85c7-4ca6-a605-4d844c247f6e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:46.694932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86bf8036-85c7-4ca6-a605-4d844c247f6e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:46.695665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86bf8036-85c7-4ca6-a605-4d844c247f6e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:46.744312 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-47b9ab89-ee79-46b0-b0f3-c9ce0bccb891 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-293124414", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:46.748037 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-47b9ab89-ee79-46b0-b0f3-c9ce0bccb891 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] HTTP exception thrown: min_count must be <= max_count Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-47b9ab89-ee79-46b0-b0f3-c9ce0bccb891 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] Request method failure captured: Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 183 Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5diySBeX-UQ1AgCqdd3sU8S5sSqwntDMbCX9TUX2JqIqaCBwNhCAthNpJkmcToegxBXmfyxVdQDbblL_RrhaO15its4qcOZOPRKrfa1vXv6FbvCuCXaGXwijqLlxSTQRBiRvRjJF_FmcyDXxQDKfP_dVnnaINuDEK6UhOohmiqaLOtU Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 6dd659e4d68d4bb58d292339e10d8ef2 Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-126799789 Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6dd659e4d68d4bb58d292339e10d8ef2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6dd659e4d68d4bb58d292339e10d8ef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6dd659e4d68d4bb58d292339e10d8ef2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6dd659e4d68d4bb58d292339e10d8ef2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-126799789 Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 6dd659e4d68d4bb58d292339e10d8ef2 Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-126799789 Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-MultipleCreateNegativeTestJSON-126799789-project Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: afd8149e77cc4297b05e955f04757125 Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-126799789-project Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-293124414", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: exception: min_count must be <= max_count Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-293124414', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 31 01:19:46.749772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.757661 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-47b9ab89-ee79-46b0-b0f3-c9ce0bccb891 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] Returning 400 to user: min_count must be <= max_count {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:19:46.761758 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-47b9ab89-ee79-46b0-b0f3-c9ce0bccb891 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.380212 Jul 31 01:19:46.762517 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1368/2720] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:19:46 2022] POST /compute/v2.1/servers => generated 74 bytes in 382 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:46.839120 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4dd0a420-d8a0-45f4-a980-c3c89ebe21f7 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1051117217", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "max_count": 0}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4dd0a420-d8a0-45f4-a980-c3c89ebe21f7 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] Request method failure captured: Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 168 Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5diySBeX-UQ1AgCqdd3sU8S5sSqwntDMbCX9TUX2JqIqaCBwNhCAthNpJkmcToegxBXmfyxVdQDbblL_RrhaO15its4qcOZOPRKrfa1vXv6FbvCuCXaGXwijqLlxSTQRBiRvRjJF_FmcyDXxQDKfP_dVnnaINuDEK6UhOohmiqaLOtU Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 6dd659e4d68d4bb58d292339e10d8ef2 Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-126799789 Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6dd659e4d68d4bb58d292339e10d8ef2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6dd659e4d68d4bb58d292339e10d8ef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6dd659e4d68d4bb58d292339e10d8ef2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6dd659e4d68d4bb58d292339e10d8ef2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-126799789 Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 6dd659e4d68d4bb58d292339e10d8ef2 Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-126799789 Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-MultipleCreateNegativeTestJSON-126799789-project Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: afd8149e77cc4297b05e955f04757125 Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-126799789-project Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1051117217", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "max_count": 0}} Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1051117217', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'max_count': 0}}} Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 0 Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:19:46.843485 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4dd0a420-d8a0-45f4-a980-c3c89ebe21f7 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:19:46.853235 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4dd0a420-d8a0-45f4-a980-c3c89ebe21f7 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.012545 Jul 31 01:19:46.868947 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1369/2721] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:19:46 2022] POST /compute/v2.1/servers => generated 130 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:19:46.905040 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc279ee7-bf65-4a2b-92f7-025a1fec51b3 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-853496361", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "max_count": 2.5}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc279ee7-bf65-4a2b-92f7-025a1fec51b3 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] Request method failure captured: Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 169 Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5diySBeX-UQ1AgCqdd3sU8S5sSqwntDMbCX9TUX2JqIqaCBwNhCAthNpJkmcToegxBXmfyxVdQDbblL_RrhaO15its4qcOZOPRKrfa1vXv6FbvCuCXaGXwijqLlxSTQRBiRvRjJF_FmcyDXxQDKfP_dVnnaINuDEK6UhOohmiqaLOtU Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 6dd659e4d68d4bb58d292339e10d8ef2 Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-126799789 Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6dd659e4d68d4bb58d292339e10d8ef2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6dd659e4d68d4bb58d292339e10d8ef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6dd659e4d68d4bb58d292339e10d8ef2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6dd659e4d68d4bb58d292339e10d8ef2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-126799789 Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 6dd659e4d68d4bb58d292339e10d8ef2 Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-126799789 Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-MultipleCreateNegativeTestJSON-126799789-project Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: afd8149e77cc4297b05e955f04757125 Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-126799789-project Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-853496361", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "max_count": 2.5}} Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-853496361', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'max_count': 2.5}}} Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 2.5 Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:19:46.910041 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc279ee7-bf65-4a2b-92f7-025a1fec51b3 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:19:46.914575 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc279ee7-bf65-4a2b-92f7-025a1fec51b3 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.012369 Jul 31 01:19:46.926663 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1370/2722] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:19:46 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:19:46.979386 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f1df2632-00b1-42f6-ad4c-5e9223e98ea8 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:46.980429 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f1df2632-00b1-42f6-ad4c-5e9223e98ea8 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:47.005956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1df2632-00b1-42f6-ad4c-5e9223e98ea8 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:47.007826 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1df2632-00b1-42f6-ad4c-5e9223e98ea8 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:47.010914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-86bf8036-85c7-4ca6-a605-4d844c247f6e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:47.013181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1df2632-00b1-42f6-ad4c-5e9223e98ea8 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:47.013693 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1df2632-00b1-42f6-ad4c-5e9223e98ea8 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:47.022305 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-86bf8036-85c7-4ca6-a605-4d844c247f6e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.346598 Jul 31 01:19:47.023513 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1353/2723] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:46 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:47.041566 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1e7721a3-f2b2-41ab-9e0e-fc7082ba1110 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1558270345", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "min_count": 0}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1e7721a3-f2b2-41ab-9e0e-fc7082ba1110 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] Request method failure captured: Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 168 Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5diySBeX-UQ1AgCqdd3sU8S5sSqwntDMbCX9TUX2JqIqaCBwNhCAthNpJkmcToegxBXmfyxVdQDbblL_RrhaO15its4qcOZOPRKrfa1vXv6FbvCuCXaGXwijqLlxSTQRBiRvRjJF_FmcyDXxQDKfP_dVnnaINuDEK6UhOohmiqaLOtU Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6dd659e4d68d4bb58d292339e10d8ef2 Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-126799789 Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6dd659e4d68d4bb58d292339e10d8ef2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6dd659e4d68d4bb58d292339e10d8ef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6dd659e4d68d4bb58d292339e10d8ef2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6dd659e4d68d4bb58d292339e10d8ef2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-126799789 Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6dd659e4d68d4bb58d292339e10d8ef2 Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-126799789 Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-MultipleCreateNegativeTestJSON-126799789-project Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: afd8149e77cc4297b05e955f04757125 Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-126799789-project Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1558270345", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "min_count": 0}} Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1558270345', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'min_count': 0}}} Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 0 Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:19:47.047711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:19:47.051657 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:19:47.051657 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:19:47.051657 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:19:47.051657 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:19:47.051657 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 31 01:19:47.051657 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:47.051657 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:47.051657 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:47.051657 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:47.051657 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:47.051657 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:47.051657 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:19:47.051657 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:19:47.051657 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 31 01:19:47.051657 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:19:47.054584 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1e7721a3-f2b2-41ab-9e0e-fc7082ba1110 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:19:47.055707 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1e7721a3-f2b2-41ab-9e0e-fc7082ba1110 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.030922 Jul 31 01:19:47.056975 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1354/2724] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:19:47 2022] POST /compute/v2.1/servers => generated 130 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:19:47.062484 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-85e2a5ce-fd6e-4215-a74d-c6ae2b470ea0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:47.064419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-85e2a5ce-fd6e-4215-a74d-c6ae2b470ea0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:47.084435 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85e2a5ce-fd6e-4215-a74d-c6ae2b470ea0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:47.088948 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85e2a5ce-fd6e-4215-a74d-c6ae2b470ea0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:47.092910 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85e2a5ce-fd6e-4215-a74d-c6ae2b470ea0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:47.096745 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85e2a5ce-fd6e-4215-a74d-c6ae2b470ea0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:47.454962 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-85e2a5ce-fd6e-4215-a74d-c6ae2b470ea0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:47.463501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f1df2632-00b1-42f6-ad4c-5e9223e98ea8 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:47.464062 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-85e2a5ce-fd6e-4215-a74d-c6ae2b470ea0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.405736 Jul 31 01:19:47.474237 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f1df2632-00b1-42f6-ad4c-5e9223e98ea8 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 0.503542 Jul 31 01:19:47.475132 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1355/2725] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:47 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:47.486821 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1371/2726] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:46 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:47.491909 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-505512f0-f146-420e-8c85-2781c2e880bd tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:47.492545 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-505512f0-f146-420e-8c85-2781c2e880bd tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:47.497185 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-88c8b575-ea6d-44b6-ab33-aae18f29c5a5 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-481845232", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "min_count": 2.5}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-88c8b575-ea6d-44b6-ab33-aae18f29c5a5 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] Request method failure captured: Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 169 Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5diySBeX-UQ1AgCqdd3sU8S5sSqwntDMbCX9TUX2JqIqaCBwNhCAthNpJkmcToegxBXmfyxVdQDbblL_RrhaO15its4qcOZOPRKrfa1vXv6FbvCuCXaGXwijqLlxSTQRBiRvRjJF_FmcyDXxQDKfP_dVnnaINuDEK6UhOohmiqaLOtU Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 6dd659e4d68d4bb58d292339e10d8ef2 Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-126799789 Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6dd659e4d68d4bb58d292339e10d8ef2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6dd659e4d68d4bb58d292339e10d8ef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6dd659e4d68d4bb58d292339e10d8ef2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6dd659e4d68d4bb58d292339e10d8ef2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-126799789 Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 6dd659e4d68d4bb58d292339e10d8ef2 Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-126799789 Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-MultipleCreateNegativeTestJSON-126799789-project Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: afd8149e77cc4297b05e955f04757125 Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-126799789-project Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-481845232", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "min_count": 2.5}} Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-481845232', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'min_count': 2.5}}} Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 2.5 Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:19:47.502321 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:19:47.506943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:19:47.506943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:19:47.506943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:19:47.506943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:19:47.506943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 31 01:19:47.506943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:47.506943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:19:47.506943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:47.506943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:19:47.506943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:19:47.506943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:19:47.506943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:19:47.506943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:19:47.506943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 31 01:19:47.506943 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:19:47.508003 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-88c8b575-ea6d-44b6-ab33-aae18f29c5a5 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:19:47.509001 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-88c8b575-ea6d-44b6-ab33-aae18f29c5a5 tempest-MultipleCreateNegativeTestJSON-126799789 tempest-MultipleCreateNegativeTestJSON-126799789-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020939 Jul 31 01:19:47.510010 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1372/2727] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:19:47 2022] POST /compute/v2.1/servers => generated 139 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:19:47.515013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b92c3655-197a-4615-a0ff-5fd491886071 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-815896455"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:47.520761 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b92c3655-197a-4615-a0ff-5fd491886071 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:47.521667 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-505512f0-f146-420e-8c85-2781c2e880bd tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:47.522126 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-505512f0-f146-420e-8c85-2781c2e880bd tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:47.522930 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-505512f0-f146-420e-8c85-2781c2e880bd tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:47.523472 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-505512f0-f146-420e-8c85-2781c2e880bd tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:47.536775 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b92c3655-197a-4615-a0ff-5fd491886071 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:47.537345 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b92c3655-197a-4615-a0ff-5fd491886071 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:47.544422 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b92c3655-197a-4615-a0ff-5fd491886071 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:47.546244 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b92c3655-197a-4615-a0ff-5fd491886071 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:47.950250 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:48.050905 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b92c3655-197a-4615-a0ff-5fd491886071 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 202 len: 0 microversion: 2.1 time: 0.538173 Jul 31 01:19:48.053866 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1373/2728] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:19:47 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 31 01:19:48.502090 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb5349a6-23ac-44d0-b975-b428e5777eae tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:48.503225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fb5349a6-23ac-44d0-b975-b428e5777eae tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:48.518728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb5349a6-23ac-44d0-b975-b428e5777eae tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:48.519698 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb5349a6-23ac-44d0-b975-b428e5777eae tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:48.521002 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb5349a6-23ac-44d0-b975-b428e5777eae tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:48.521677 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb5349a6-23ac-44d0-b975-b428e5777eae tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:48.572005 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-505512f0-f146-420e-8c85-2781c2e880bd tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:48.588131 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-505512f0-f146-420e-8c85-2781c2e880bd tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1513 microversion: 2.1 time: 1.109349 Jul 31 01:19:48.591382 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1356/2729] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:47 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1513 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:48.821480 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fb5349a6-23ac-44d0-b975-b428e5777eae tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:48.832337 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fb5349a6-23ac-44d0-b975-b428e5777eae tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 0.335537 Jul 31 01:19:48.848882 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1374/2730] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:48 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:49.616258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-93ff86fb-b7e0-400c-a8cb-3ebfe452a88e tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] Calling method '.version_select at 0x7fedea91e790>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:49.618127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2e8dcae7-2e95-447e-89a4-bbfce79755a7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:49.622796 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2e8dcae7-2e95-447e-89a4-bbfce79755a7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:49.641235 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e8dcae7-2e95-447e-89a4-bbfce79755a7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:49.642508 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e8dcae7-2e95-447e-89a4-bbfce79755a7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:49.643539 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e8dcae7-2e95-447e-89a4-bbfce79755a7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:49.650571 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e8dcae7-2e95-447e-89a4-bbfce79755a7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:49.720275 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-93ff86fb-b7e0-400c-a8cb-3ebfe452a88e tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8c846437-5f55-4bf0-b635-b2f8bbc6cd82" status: 200 len: 350 microversion: 2.1 time: 0.107564 Jul 31 01:19:49.722305 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1375/2731] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:19:49 2022] GET /compute/v2.1/os-volumes/8c846437-5f55-4bf0-b635-b2f8bbc6cd82 => generated 350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:19:49.858347 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-122c9ca4-5e99-441f-81df-f98a85842410 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:49.859168 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-122c9ca4-5e99-441f-81df-f98a85842410 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:49.871921 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-122c9ca4-5e99-441f-81df-f98a85842410 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:49.874359 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-122c9ca4-5e99-441f-81df-f98a85842410 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:49.880070 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-122c9ca4-5e99-441f-81df-f98a85842410 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:49.880790 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-122c9ca4-5e99-441f-81df-f98a85842410 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:49.930305 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2e8dcae7-2e95-447e-89a4-bbfce79755a7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:49.941596 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2e8dcae7-2e95-447e-89a4-bbfce79755a7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1513 microversion: 2.1 time: 0.333384 Jul 31 01:19:49.943242 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1357/2732] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:49 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1513 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:50.131032 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-122c9ca4-5e99-441f-81df-f98a85842410 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:50.141823 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-122c9ca4-5e99-441f-81df-f98a85842410 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 0.287674 Jul 31 01:19:50.156036 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1376/2733] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:49 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:50.822196 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a55c15d5-c53b-45ba-b95f-1a46280a15ff tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1707992687", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": "none"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:50.902571 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a55c15d5-c53b-45ba-b95f-1a46280a15ff tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:19:50.903465 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a55c15d5-c53b-45ba-b95f-1a46280a15ff tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:19:50.904253 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a55c15d5-c53b-45ba-b95f-1a46280a15ff tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:19:50.904814 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a55c15d5-c53b-45ba-b95f-1a46280a15ff tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:19:50.905389 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a55c15d5-c53b-45ba-b95f-1a46280a15ff tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:19:50.916549 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a55c15d5-c53b-45ba-b95f-1a46280a15ff tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:50.917813 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a55c15d5-c53b-45ba-b95f-1a46280a15ff tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:50.918777 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a55c15d5-c53b-45ba-b95f-1a46280a15ff tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:50.919413 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a55c15d5-c53b-45ba-b95f-1a46280a15ff tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:50.950738 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-a55c15d5-c53b-45ba-b95f-1a46280a15ff tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Getting quotas for project 9b448e6c52e546778622d6eaee947164. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:19:50.959989 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-a55c15d5-c53b-45ba-b95f-1a46280a15ff tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Getting quotas for user a9779d23976745ccb0fa40c26678de44 and project 9b448e6c52e546778622d6eaee947164. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:19:50.968464 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5cba0c59-f174-4129-b911-382d039a5792 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:50.969109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5cba0c59-f174-4129-b911-382d039a5792 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:50.980511 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a55c15d5-c53b-45ba-b95f-1a46280a15ff tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:19:50.980755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5cba0c59-f174-4129-b911-382d039a5792 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:50.983555 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a55c15d5-c53b-45ba-b95f-1a46280a15ff tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] [instance: 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:19:50.990660 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5cba0c59-f174-4129-b911-382d039a5792 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:50.994035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5cba0c59-f174-4129-b911-382d039a5792 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:50.994498 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5cba0c59-f174-4129-b911-382d039a5792 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:51.062532 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a55c15d5-c53b-45ba-b95f-1a46280a15ff tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.418059 Jul 31 01:19:51.064729 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1358/2734] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:19:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 01:19:51.082493 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dcd81fe8-638a-46e3-8918-6406dc5b84b9 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:51.084122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dcd81fe8-638a-46e3-8918-6406dc5b84b9 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] [instance: 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:51.276286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dcd81fe8-638a-46e3-8918-6406dc5b84b9 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:51.314960 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dcd81fe8-638a-46e3-8918-6406dc5b84b9 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:51.334884 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dcd81fe8-638a-46e3-8918-6406dc5b84b9 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:51.340600 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dcd81fe8-638a-46e3-8918-6406dc5b84b9 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] 10.222.0.45 "GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135" status: 200 len: 1281 microversion: 2.47 time: 0.266501 Jul 31 01:19:51.342336 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1359/2735] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:19:51 2022] GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135 => generated 1281 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:19:51.367384 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-72ce6762-0d77-43af-9ed6-a8f35f1116bf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:51.369654 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-72ce6762-0d77-43af-9ed6-a8f35f1116bf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:51.418150 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72ce6762-0d77-43af-9ed6-a8f35f1116bf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:51.420283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72ce6762-0d77-43af-9ed6-a8f35f1116bf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:51.425552 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72ce6762-0d77-43af-9ed6-a8f35f1116bf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:51.429077 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72ce6762-0d77-43af-9ed6-a8f35f1116bf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:51.593485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5cba0c59-f174-4129-b911-382d039a5792 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:51.613247 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5cba0c59-f174-4129-b911-382d039a5792 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1513 microversion: 2.1 time: 0.648007 Jul 31 01:19:51.614699 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1377/2736] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:50 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1513 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:51.897133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-72ce6762-0d77-43af-9ed6-a8f35f1116bf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:51.907218 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-72ce6762-0d77-43af-9ed6-a8f35f1116bf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 0.562634 Jul 31 01:19:51.908381 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1360/2737] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:51 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:52.368026 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f610628f-5159-45fa-a055-1d1eecd72124 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:52.368658 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f610628f-5159-45fa-a055-1d1eecd72124 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] [instance: 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:52.380668 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f610628f-5159-45fa-a055-1d1eecd72124 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:52.381132 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f610628f-5159-45fa-a055-1d1eecd72124 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:52.381936 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f610628f-5159-45fa-a055-1d1eecd72124 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:52.382376 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f610628f-5159-45fa-a055-1d1eecd72124 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:52.639503 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8150c3cb-3a78-4c8f-a5ce-d824d74dbf0f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:52.640146 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8150c3cb-3a78-4c8f-a5ce-d824d74dbf0f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:52.662380 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f610628f-5159-45fa-a055-1d1eecd72124 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:52.679652 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8150c3cb-3a78-4c8f-a5ce-d824d74dbf0f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:52.680131 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8150c3cb-3a78-4c8f-a5ce-d824d74dbf0f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:52.683824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f610628f-5159-45fa-a055-1d1eecd72124 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:52.687641 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f610628f-5159-45fa-a055-1d1eecd72124 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:52.709630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8150c3cb-3a78-4c8f-a5ce-d824d74dbf0f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:52.711582 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8150c3cb-3a78-4c8f-a5ce-d824d74dbf0f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:52.712934 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f610628f-5159-45fa-a055-1d1eecd72124 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] 10.222.0.45 "GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135" status: 200 len: 1277 microversion: 2.47 time: 0.334041 Jul 31 01:19:52.725686 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1378/2738] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:19:52 2022] GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135 => generated 1277 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:19:52.771990 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8ac77034-9e42-434a-9678-798539a27ac2 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] Calling method '.version_select at 0x7fede4832dc0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:52.885828 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8ac77034-9e42-434a-9678-798539a27ac2 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/3b5213b3-7128-412d-9025-356fb4537777" status: 200 len: 351 microversion: 2.1 time: 0.157868 Jul 31 01:19:52.886625 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1379/2739] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:19:52 2022] GET /compute/v2.1/os-volumes/3b5213b3-7128-412d-9025-356fb4537777 => generated 351 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:52.951651 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ff8769bb-9dd0-43cf-b8da-3c2d967f4372 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:52.954304 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ff8769bb-9dd0-43cf-b8da-3c2d967f4372 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:52.967781 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff8769bb-9dd0-43cf-b8da-3c2d967f4372 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:52.968829 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff8769bb-9dd0-43cf-b8da-3c2d967f4372 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:52.970599 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff8769bb-9dd0-43cf-b8da-3c2d967f4372 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:52.972175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff8769bb-9dd0-43cf-b8da-3c2d967f4372 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:53.456849 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8150c3cb-3a78-4c8f-a5ce-d824d74dbf0f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:53.465262 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8150c3cb-3a78-4c8f-a5ce-d824d74dbf0f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1513 microversion: 2.1 time: 0.830422 Jul 31 01:19:53.471724 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1361/2740] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:52 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1513 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:53.495608 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ff8769bb-9dd0-43cf-b8da-3c2d967f4372 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:53.512859 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ff8769bb-9dd0-43cf-b8da-3c2d967f4372 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 0.567046 Jul 31 01:19:53.535176 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1380/2741] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:52 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:53.761013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9701a9ac-62bc-4650-8cf4-e1f20b1102b1 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:53.761912 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9701a9ac-62bc-4650-8cf4-e1f20b1102b1 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] [instance: 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:53.796173 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9701a9ac-62bc-4650-8cf4-e1f20b1102b1 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:53.853004 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9701a9ac-62bc-4650-8cf4-e1f20b1102b1 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:53.853930 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9701a9ac-62bc-4650-8cf4-e1f20b1102b1 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:53.854883 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9701a9ac-62bc-4650-8cf4-e1f20b1102b1 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:54.237515 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9701a9ac-62bc-4650-8cf4-e1f20b1102b1 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:54.239806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9701a9ac-62bc-4650-8cf4-e1f20b1102b1 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:54.245663 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9701a9ac-62bc-4650-8cf4-e1f20b1102b1 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:54.247090 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9701a9ac-62bc-4650-8cf4-e1f20b1102b1 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] 10.222.0.45 "GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135" status: 200 len: 1339 microversion: 2.47 time: 0.490870 Jul 31 01:19:54.252090 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1362/2742] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:19:53 2022] GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135 => generated 1339 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:19:54.490216 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-edabbe9e-0a42-4ddf-a46f-3cc2e825b1e5 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Action: 'create', calling method: .version_select at 0x7fede48320d0>, body: {"keypair": {"name": "tempest-keypair-1230189843", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtQBXxBKkPY0GRHflkvDGu0tKcr/5KIHZcj9nKnACPjmW9aYweF3cAX9SjatlTRwgP9XbTEuPuKIcj5V8u/8Ho3F0bMPyNMXvUUXu4n1SqGP7QSl+cBloUwC1wxGCqWeg=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:54.503572 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a067e9c7-c2a1-412b-b69c-9b6e8342ff7c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:54.505287 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a067e9c7-c2a1-412b-b69c-9b6e8342ff7c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:54.512547 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a067e9c7-c2a1-412b-b69c-9b6e8342ff7c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:54.513383 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a067e9c7-c2a1-412b-b69c-9b6e8342ff7c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:54.514535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a067e9c7-c2a1-412b-b69c-9b6e8342ff7c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:54.515211 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a067e9c7-c2a1-412b-b69c-9b6e8342ff7c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:54.546865 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-edabbe9e-0a42-4ddf-a46f-3cc2e825b1e5 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Getting quotas for project 5bed329cedce4da7a08600d0586d25a8. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:19:54.570317 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-edabbe9e-0a42-4ddf-a46f-3cc2e825b1e5 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Getting quotas for user fc397063f50746daa3dba6975d872941 and project 5bed329cedce4da7a08600d0586d25a8. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:19:54.629498 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-edabbe9e-0a42-4ddf-a46f-3cc2e825b1e5 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.431408 Jul 31 01:19:54.638001 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1381/2743] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:19:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:54.644059 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4849779f-1da4-435c-a748-820833dfcfc5 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:54.645411 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4849779f-1da4-435c-a748-820833dfcfc5 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:54.665861 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4849779f-1da4-435c-a748-820833dfcfc5 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:54.666929 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4849779f-1da4-435c-a748-820833dfcfc5 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:54.668665 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4849779f-1da4-435c-a748-820833dfcfc5 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:54.669460 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4849779f-1da4-435c-a748-820833dfcfc5 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:55.062506 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a067e9c7-c2a1-412b-b69c-9b6e8342ff7c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:55.072507 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a067e9c7-c2a1-412b-b69c-9b6e8342ff7c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1513 microversion: 2.1 time: 0.577497 Jul 31 01:19:55.074087 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1363/2744] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:54 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1513 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:55.214583 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4849779f-1da4-435c-a748-820833dfcfc5 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:55.240257 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4849779f-1da4-435c-a748-820833dfcfc5 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 0.600695 Jul 31 01:19:55.260469 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1382/2745] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:54 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:55.291916 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4cf4e29b-8b35-4d88-8196-4742c942ff78 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:55.296920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4cf4e29b-8b35-4d88-8196-4742c942ff78 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] [instance: 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:55.327936 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4cf4e29b-8b35-4d88-8196-4742c942ff78 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:55.331986 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4cf4e29b-8b35-4d88-8196-4742c942ff78 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:55.333967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4cf4e29b-8b35-4d88-8196-4742c942ff78 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:55.337333 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4cf4e29b-8b35-4d88-8196-4742c942ff78 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:55.409843 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:55.481107 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4cf4e29b-8b35-4d88-8196-4742c942ff78 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:55.500375 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4cf4e29b-8b35-4d88-8196-4742c942ff78 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:55.504850 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4cf4e29b-8b35-4d88-8196-4742c942ff78 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:55.512159 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4cf4e29b-8b35-4d88-8196-4742c942ff78 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] 10.222.0.45 "GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135" status: 200 len: 1339 microversion: 2.47 time: 0.230239 Jul 31 01:19:55.513048 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1364/2746] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:19:55 2022] GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135 => generated 1339 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:19:55.537910 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-744198ff-d769-479c-b89e-9dd9291ad435 req-0dc45da4-40a3-44b6-ba78-37f2aa0e9f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f0abec-dd05-4dff-8f15-b56464346b06", "name": "network-vif-plugged", "status": "completed", "tag": "02e5aa3d-f780-459d-9466-4437ed729ddc"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:55.620777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-744198ff-d769-479c-b89e-9dd9291ad435 req-0dc45da4-40a3-44b6-ba78-37f2aa0e9f10 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:55.622054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-744198ff-d769-479c-b89e-9dd9291ad435 req-0dc45da4-40a3-44b6-ba78-37f2aa0e9f10 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:55.651099 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-744198ff-d769-479c-b89e-9dd9291ad435 req-0dc45da4-40a3-44b6-ba78-37f2aa0e9f10 service nova] Creating event network-vif-plugged:02e5aa3d-f780-459d-9466-4437ed729ddc for instance e7f0abec-dd05-4dff-8f15-b56464346b06 on n-h2-master-1 Jul 31 01:19:55.659964 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-744198ff-d769-479c-b89e-9dd9291ad435 req-0dc45da4-40a3-44b6-ba78-37f2aa0e9f10 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140017 Jul 31 01:19:55.661154 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1383/2747] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:55.846807 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5113d2bd-69a4-46b6-9bb9-80225725af5e tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] Calling method '.version_select at 0x7fede59943a0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:55.956254 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5113d2bd-69a4-46b6-9bb9-80225725af5e tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/c7965262-6d8b-44f0-9069-9f1c77761a36" status: 200 len: 350 microversion: 2.1 time: 0.112407 Jul 31 01:19:55.956940 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1365/2748] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:19:55 2022] GET /compute/v2.1/os-volumes/c7965262-6d8b-44f0-9069-9f1c77761a36 => generated 350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:55.981386 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fab82860-fcc5-4e00-93a7-8c37109c2638 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] Calling method '.version_select at 0x7fede55839d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:56.113147 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9cfe96e7-5aa6-4973-b394-42cb03c3a218 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:56.116840 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9cfe96e7-5aa6-4973-b394-42cb03c3a218 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:56.134491 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cfe96e7-5aa6-4973-b394-42cb03c3a218 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:56.139509 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cfe96e7-5aa6-4973-b394-42cb03c3a218 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:56.141562 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cfe96e7-5aa6-4973-b394-42cb03c3a218 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:56.142045 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cfe96e7-5aa6-4973-b394-42cb03c3a218 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:56.256225 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fab82860-fcc5-4e00-93a7-8c37109c2638 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.276236 Jul 31 01:19:56.260926 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1384/2749] 10.222.0.45 () {58 vars in 1134 bytes} [Sun Jul 31 01:19:55 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:56.276830 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-28ee0ff5-4294-4770-991c-53d1f15a1e5f tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:56.281825 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-28ee0ff5-4294-4770-991c-53d1f15a1e5f tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:56.304454 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28ee0ff5-4294-4770-991c-53d1f15a1e5f tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:56.304928 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28ee0ff5-4294-4770-991c-53d1f15a1e5f tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:56.309699 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28ee0ff5-4294-4770-991c-53d1f15a1e5f tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:56.310527 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28ee0ff5-4294-4770-991c-53d1f15a1e5f tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:56.647792 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-28ee0ff5-4294-4770-991c-53d1f15a1e5f tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:56.658287 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9cfe96e7-5aa6-4973-b394-42cb03c3a218 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:56.677539 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9cfe96e7-5aa6-4973-b394-42cb03c3a218 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1513 microversion: 2.1 time: 0.571168 Jul 31 01:19:56.678841 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1366/2750] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:56 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1513 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:56.688249 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-07238c8c-b10b-49d0-a53d-9a7b9f4a6d82 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] Calling method '.version_select at 0x7fede59943a0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:56.717285 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-28ee0ff5-4294-4770-991c-53d1f15a1e5f tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 0.452136 Jul 31 01:19:56.718336 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1385/2751] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:56 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:56.724148 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a00653fb-dd0b-4b4d-bb36-f67f92a17b87 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:56.725023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a00653fb-dd0b-4b4d-bb36-f67f92a17b87 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] [instance: 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:56.733441 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a00653fb-dd0b-4b4d-bb36-f67f92a17b87 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:56.735577 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a00653fb-dd0b-4b4d-bb36-f67f92a17b87 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:56.736967 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a00653fb-dd0b-4b4d-bb36-f67f92a17b87 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:56.745120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a00653fb-dd0b-4b4d-bb36-f67f92a17b87 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:56.868538 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-07238c8c-b10b-49d0-a53d-9a7b9f4a6d82 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.185411 Jul 31 01:19:56.869126 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1367/2752] 10.222.0.45 () {58 vars in 1149 bytes} [Sun Jul 31 01:19:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:56.890980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-66311423-c580-434a-9500-a094ca901626 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] Calling method '.version_select at 0x7fede59a7550>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:56.895100 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a00653fb-dd0b-4b4d-bb36-f67f92a17b87 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:56.913855 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a00653fb-dd0b-4b4d-bb36-f67f92a17b87 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:56.927721 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a00653fb-dd0b-4b4d-bb36-f67f92a17b87 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:56.929767 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a00653fb-dd0b-4b4d-bb36-f67f92a17b87 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] 10.222.0.45 "GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135" status: 200 len: 1360 microversion: 2.47 time: 0.210387 Jul 31 01:19:56.931296 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1386/2753] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:19:56 2022] GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135 => generated 1360 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:19:56.978811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-88ddbf2a-4a34-473a-8494-63180cbd7562 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1442608042"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:56.997410 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-88ddbf2a-4a34-473a-8494-63180cbd7562 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] [instance: 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:57.014328 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88ddbf2a-4a34-473a-8494-63180cbd7562 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:57.017730 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88ddbf2a-4a34-473a-8494-63180cbd7562 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:57.018963 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88ddbf2a-4a34-473a-8494-63180cbd7562 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:57.019686 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88ddbf2a-4a34-473a-8494-63180cbd7562 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:57.149390 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-66311423-c580-434a-9500-a094ca901626 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.270199 Jul 31 01:19:57.149977 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1368/2754] 10.222.0.45 () {58 vars in 1134 bytes} [Sun Jul 31 01:19:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:57.166275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f04292d0-6fbb-4354-9b8d-6e49340f9892 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] Calling method '.version_select at 0x7fede7fe18b0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:57.300705 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f04292d0-6fbb-4354-9b8d-6e49340f9892 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.138238 Jul 31 01:19:57.301316 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1369/2755] 10.222.0.45 () {58 vars in 1167 bytes} [Sun Jul 31 01:19:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:57.316464 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f714f2f2-26be-4607-8ad2-7ee0fab12212 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] Calling method '.version_select at 0x7fede5986310>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:57.441773 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f714f2f2-26be-4607-8ad2-7ee0fab12212 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.129936 Jul 31 01:19:57.452029 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1370/2756] 10.222.0.45 () {58 vars in 1170 bytes} [Sun Jul 31 01:19:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:57.458591 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bb996c6d-40d8-436d-9fb9-7c0caa6ea4b6 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] Calling method '.version_select at 0x7fede557b040>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:57.576102 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-88ddbf2a-4a34-473a-8494-63180cbd7562 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] 10.222.0.45 "POST /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135/action" status: 202 len: 52 microversion: 2.47 time: 0.604775 Jul 31 01:19:57.576779 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1387/2757] 10.222.0.45 () {62 vars in 1319 bytes} [Sun Jul 31 01:19:56 2022] POST /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135/action => generated 52 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 31 01:19:57.599889 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1d3dd286-84e8-478c-b410-7de4bec4b484 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:57.601491 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1d3dd286-84e8-478c-b410-7de4bec4b484 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] [instance: 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:57.612276 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d3dd286-84e8-478c-b410-7de4bec4b484 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:57.615381 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bb996c6d-40d8-436d-9fb9-7c0caa6ea4b6 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.161480 Jul 31 01:19:57.616224 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d3dd286-84e8-478c-b410-7de4bec4b484 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:57.616432 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1371/2758] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:19:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:57.617092 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d3dd286-84e8-478c-b410-7de4bec4b484 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:57.617556 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d3dd286-84e8-478c-b410-7de4bec4b484 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:57.631108 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ae01e49a-cfb9-402e-84c6-4f80d32460a3 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] Calling method '.version_select at 0x7fede55a6f70>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:57.674119 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1d3dd286-84e8-478c-b410-7de4bec4b484 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] [instance: 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:19:57.756320 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ae01e49a-cfb9-402e-84c6-4f80d32460a3 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.130292 Jul 31 01:19:57.759503 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1372/2759] 10.222.0.45 () {58 vars in 1188 bytes} [Sun Jul 31 01:19:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:19:57.771065 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7a742a7c-5ae5-4814-b478-c6f641e76392 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:57.772096 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7a742a7c-5ae5-4814-b478-c6f641e76392 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:57.779499 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:57.797635 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a742a7c-5ae5-4814-b478-c6f641e76392 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:57.798597 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a742a7c-5ae5-4814-b478-c6f641e76392 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:57.800007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a742a7c-5ae5-4814-b478-c6f641e76392 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:57.800471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a742a7c-5ae5-4814-b478-c6f641e76392 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:57.909361 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1d3dd286-84e8-478c-b410-7de4bec4b484 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135" status: 204 len: 0 microversion: 2.47 time: 0.323119 Jul 31 01:19:57.910550 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1388/2760] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:19:57 2022] DELETE /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:19:57.929405 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7f5f09c7-ed53-48a4-ae6c-19879b022717 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:57.937085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7f5f09c7-ed53-48a4-ae6c-19879b022717 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:57.951545 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f5f09c7-ed53-48a4-ae6c-19879b022717 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:57.952720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f5f09c7-ed53-48a4-ae6c-19879b022717 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:57.986575 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f5f09c7-ed53-48a4-ae6c-19879b022717 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:57.988541 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f5f09c7-ed53-48a4-ae6c-19879b022717 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:58.237212 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7a742a7c-5ae5-4814-b478-c6f641e76392 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:58.261910 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7a742a7c-5ae5-4814-b478-c6f641e76392 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1513 microversion: 2.1 time: 0.499992 Jul 31 01:19:58.263011 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1373/2761] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:57 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1513 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:58.275430 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aec4303a-f020-4468-bf24-9cd9945e6232 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] Calling method '.version_select at 0x7fede59a7940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:58.419670 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aec4303a-f020-4468-bf24-9cd9945e6232 tempest-VolumesTestJSON-409762772 tempest-VolumesTestJSON-409762772-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.150203 Jul 31 01:19:58.420534 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1374/2762] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:19:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:58.429142 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8dda3fa1-632e-4d68-8866-ac7db326c47d tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:58.432846 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8dda3fa1-632e-4d68-8866-ac7db326c47d tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] [instance: 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:58.450471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8dda3fa1-632e-4d68-8866-ac7db326c47d tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:58.454781 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8dda3fa1-632e-4d68-8866-ac7db326c47d tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:58.455769 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8dda3fa1-632e-4d68-8866-ac7db326c47d tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:58.456419 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8dda3fa1-632e-4d68-8866-ac7db326c47d tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:58.505859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7f5f09c7-ed53-48a4-ae6c-19879b022717 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:58.521006 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7f5f09c7-ed53-48a4-ae6c-19879b022717 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 0.602865 Jul 31 01:19:58.521691 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1389/2763] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:57 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:19:58.660863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8dda3fa1-632e-4d68-8866-ac7db326c47d tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:58.711891 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8dda3fa1-632e-4d68-8866-ac7db326c47d tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:58.713580 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8dda3fa1-632e-4d68-8866-ac7db326c47d tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:58.732210 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8dda3fa1-632e-4d68-8866-ac7db326c47d tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] 10.222.0.45 "GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135" status: 200 len: 1366 microversion: 2.47 time: 0.308881 Jul 31 01:19:58.737445 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1375/2764] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:19:58 2022] GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:19:59.113329 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-71831b14-6fb9-4459-b98a-d161f276841a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-132224045", "imageRef": "439d4400-c3a8-41a3-b323-14e36c7d1b48", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "85e20fcb-6197-4f6c-8d27-264a808ce283"}], "security_groups": [{"name": "tempest-securitygroup--1305366891"}], "key_name": "tempest-keypair-1230189843", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:19:59.290333 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4867a7c2-0550-460d-883e-bee30caa5bb8 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:59.291691 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4867a7c2-0550-460d-883e-bee30caa5bb8 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:59.310777 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4867a7c2-0550-460d-883e-bee30caa5bb8 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:59.314261 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4867a7c2-0550-460d-883e-bee30caa5bb8 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:59.322473 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4867a7c2-0550-460d-883e-bee30caa5bb8 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:59.323268 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4867a7c2-0550-460d-883e-bee30caa5bb8 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:59.481123 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-71831b14-6fb9-4459-b98a-d161f276841a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] validate_networks() for [('85e20fcb-6197-4f6c-8d27-264a808ce283', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:19:59.948282 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4867a7c2-0550-460d-883e-bee30caa5bb8 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:19:59.961124 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4867a7c2-0550-460d-883e-bee30caa5bb8 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1513 microversion: 2.1 time: 0.679810 Jul 31 01:19:59.962425 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1376/2765] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:59 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1513 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:19:59.967716 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-efe56d0f-1d33-4bed-aa6f-6544986eb6f0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:19:59.968710 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-efe56d0f-1d33-4bed-aa6f-6544986eb6f0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:19:59.976377 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efe56d0f-1d33-4bed-aa6f-6544986eb6f0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:59.977182 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efe56d0f-1d33-4bed-aa6f-6544986eb6f0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:59.978228 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efe56d0f-1d33-4bed-aa6f-6544986eb6f0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:19:59.978888 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efe56d0f-1d33-4bed-aa6f-6544986eb6f0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:19:59.998728 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:00.933892 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:00.943439 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-efe56d0f-1d33-4bed-aa6f-6544986eb6f0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:00.959159 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-71831b14-6fb9-4459-b98a-d161f276841a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:20:00.960160 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-71831b14-6fb9-4459-b98a-d161f276841a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:20:00.960824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-71831b14-6fb9-4459-b98a-d161f276841a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:20:00.961254 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-71831b14-6fb9-4459-b98a-d161f276841a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:20:00.961854 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-71831b14-6fb9-4459-b98a-d161f276841a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:20:00.975693 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71831b14-6fb9-4459-b98a-d161f276841a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:00.977093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71831b14-6fb9-4459-b98a-d161f276841a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:00.978189 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71831b14-6fb9-4459-b98a-d161f276841a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:00.978830 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71831b14-6fb9-4459-b98a-d161f276841a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:00.983260 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-efe56d0f-1d33-4bed-aa6f-6544986eb6f0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 1.018785 Jul 31 01:20:00.988021 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1377/2766] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:19:59 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:01.003287 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-71831b14-6fb9-4459-b98a-d161f276841a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Getting quotas for project 5bed329cedce4da7a08600d0586d25a8. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:20:01.018187 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c5a2f398-e8d5-48b7-babc-b108b4605a86 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:01.020724 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c5a2f398-e8d5-48b7-babc-b108b4605a86 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] [instance: 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:01.039079 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-71831b14-6fb9-4459-b98a-d161f276841a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Getting quotas for user fc397063f50746daa3dba6975d872941 and project 5bed329cedce4da7a08600d0586d25a8. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:20:01.053566 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5a2f398-e8d5-48b7-babc-b108b4605a86 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:01.056320 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5a2f398-e8d5-48b7-babc-b108b4605a86 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:01.057377 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5a2f398-e8d5-48b7-babc-b108b4605a86 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:01.065583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5a2f398-e8d5-48b7-babc-b108b4605a86 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:01.069024 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-71831b14-6fb9-4459-b98a-d161f276841a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:20:01.073996 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-71831b14-6fb9-4459-b98a-d161f276841a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='439d4400-c3a8-41a3-b323-14e36c7d1b48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:20:01.193194 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c5a2f398-e8d5-48b7-babc-b108b4605a86 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:01.203454 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-71831b14-6fb9-4459-b98a-d161f276841a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.096091 Jul 31 01:20:01.204995 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1390/2767] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:19:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 2098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:20:01.214351 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c5a2f398-e8d5-48b7-babc-b108b4605a86 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:01.215096 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2eec98fb-4e53-4895-a791-35ec5f7fb0d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:01.218729 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2eec98fb-4e53-4895-a791-35ec5f7fb0d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:01.219950 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c5a2f398-e8d5-48b7-babc-b108b4605a86 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9779d23976745ccb0fa40c26678de44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b448e6c52e546778622d6eaee947164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:01.224982 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c5a2f398-e8d5-48b7-babc-b108b4605a86 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] 10.222.0.45 "GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135" status: 200 len: 1366 microversion: 2.47 time: 0.229689 Jul 31 01:20:01.225681 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1378/2768] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:20:00 2022] GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:20:01.238031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2eec98fb-4e53-4895-a791-35ec5f7fb0d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:01.246883 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2eec98fb-4e53-4895-a791-35ec5f7fb0d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:01.250734 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3345433a-5f91-4a15-907a-3e73645f29df tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:01.251958 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3345433a-5f91-4a15-907a-3e73645f29df tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:01.252779 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2eec98fb-4e53-4895-a791-35ec5f7fb0d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:01.253257 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2eec98fb-4e53-4895-a791-35ec5f7fb0d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:01.333649 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=8 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:01.453366 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3345433a-5f91-4a15-907a-3e73645f29df tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:01.462326 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3345433a-5f91-4a15-907a-3e73645f29df tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1245 microversion: 2.1 time: 0.235341 Jul 31 01:20:01.471306 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1379/2769] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:01 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1245 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:01.556453 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2eec98fb-4e53-4895-a791-35ec5f7fb0d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:01.566281 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2eec98fb-4e53-4895-a791-35ec5f7fb0d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1513 microversion: 2.1 time: 0.360017 Jul 31 01:20:01.567264 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1391/2770] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:01 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1513 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:02.009370 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1c38c78f-0ef6-4c7a-b876-8156de50cbbb tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:02.010170 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1c38c78f-0ef6-4c7a-b876-8156de50cbbb tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:02.026576 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c38c78f-0ef6-4c7a-b876-8156de50cbbb tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:02.028257 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c38c78f-0ef6-4c7a-b876-8156de50cbbb tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:02.029890 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c38c78f-0ef6-4c7a-b876-8156de50cbbb tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:02.030984 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c38c78f-0ef6-4c7a-b876-8156de50cbbb tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:02.262273 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6aa797f1-ca59-4785-abe4-7e0e85978e07 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:02.263925 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6aa797f1-ca59-4785-abe4-7e0e85978e07 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] [instance: 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:02.279645 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6aa797f1-ca59-4785-abe4-7e0e85978e07 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:02.281292 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6aa797f1-ca59-4785-abe4-7e0e85978e07 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:02.286633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6aa797f1-ca59-4785-abe4-7e0e85978e07 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:02.287197 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6aa797f1-ca59-4785-abe4-7e0e85978e07 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:02.296677 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:02.325618 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-6aa797f1-ca59-4785-abe4-7e0e85978e07 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] HTTP exception thrown: Instance 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135 could not be found. Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6aa797f1-ca59-4785-abe4-7e0e85978e07 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Request method failure captured: Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135 HTTP/1.1 Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5di2uC833qG0kyXhFA8cG-UKuO1Jj4VBiKdoMZHf6_3D01Az8RKQhB6HLeIDmxd-qKlY8owsj7hYEPFpkRk9o-q91iCnrBbeOkWpXy2lPszdFF1qE8ImkrSXDDmsk8Ll8g_P2x-KEu-CyN1sDv1ps4OU-L3XXSb8dDN1Vylim5u_TQw Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.47 Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 9b448e6c52e546778622d6eaee947164 Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersAaction247Test-392669924 Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9b448e6c52e546778622d6eaee947164"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9b448e6c52e546778622d6eaee947164"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9b448e6c52e546778622d6eaee947164"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9b448e6c52e546778622d6eaee947164", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersAaction247Test-392669924 Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 9b448e6c52e546778622d6eaee947164 Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersAaction247Test-392669924 Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersAaction247Test-392669924-project Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: a9779d23976745ccb0fa40c26678de44 Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersAaction247Test-392669924-project Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135 could not be found. Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135'} Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135 could not be found. Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135 could not be found. Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:20:02.333330 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:02.338362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:02.338362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:20:02.338362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:20:02.338362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:20:02.338362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:20:02.338362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135 could not be found. Jul 31 01:20:02.338362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:02.340277 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6aa797f1-ca59-4785-abe4-7e0e85978e07 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] Returning 404 to user: Instance 9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:20:02.342538 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6aa797f1-ca59-4785-abe4-7e0e85978e07 tempest-ServersAaction247Test-392669924 tempest-ServersAaction247Test-392669924-project] 10.222.0.45 "GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135" status: 404 len: 111 microversion: 2.47 time: 0.088166 Jul 31 01:20:02.346767 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1392/2771] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:20:02 2022] GET /compute/v2.1/servers/9a6c79cc-5ff0-4235-b06d-3d8b7d4e6135 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 31 01:20:02.382555 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1c38c78f-0ef6-4c7a-b876-8156de50cbbb tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:02.396044 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1c38c78f-0ef6-4c7a-b876-8156de50cbbb tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 0.391063 Jul 31 01:20:02.397888 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1380/2772] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:02 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:02.501118 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4eccd9e6-68ec-4509-9ce9-858d7a2fad01 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:02.503995 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4eccd9e6-68ec-4509-9ce9-858d7a2fad01 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:02.539977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4eccd9e6-68ec-4509-9ce9-858d7a2fad01 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:02.540491 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4eccd9e6-68ec-4509-9ce9-858d7a2fad01 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:02.541337 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4eccd9e6-68ec-4509-9ce9-858d7a2fad01 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:02.542282 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4eccd9e6-68ec-4509-9ce9-858d7a2fad01 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:02.598940 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-acc4842a-79e6-459e-991c-4aba54634ecc tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:02.599974 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-acc4842a-79e6-459e-991c-4aba54634ecc tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:02.642225 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-acc4842a-79e6-459e-991c-4aba54634ecc tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:02.642225 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-acc4842a-79e6-459e-991c-4aba54634ecc tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:02.643172 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-acc4842a-79e6-459e-991c-4aba54634ecc tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:02.643761 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-acc4842a-79e6-459e-991c-4aba54634ecc tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:02.708202 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4eccd9e6-68ec-4509-9ce9-858d7a2fad01 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:02.727966 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4eccd9e6-68ec-4509-9ce9-858d7a2fad01 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1249 microversion: 2.1 time: 0.235016 Jul 31 01:20:02.744054 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1393/2773] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:02 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1249 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:20:02.901432 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-acc4842a-79e6-459e-991c-4aba54634ecc tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:02.923750 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-acc4842a-79e6-459e-991c-4aba54634ecc tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1513 microversion: 2.1 time: 0.336498 Jul 31 01:20:02.928403 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1381/2774] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:02 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1513 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:03.420708 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4c21d2af-f644-4b00-80c4-08b41b1ba4f6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:03.422255 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4c21d2af-f644-4b00-80c4-08b41b1ba4f6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:03.448516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c21d2af-f644-4b00-80c4-08b41b1ba4f6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:03.451189 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c21d2af-f644-4b00-80c4-08b41b1ba4f6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:03.452251 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c21d2af-f644-4b00-80c4-08b41b1ba4f6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:03.454550 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c21d2af-f644-4b00-80c4-08b41b1ba4f6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:03.757876 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-deab6892-117f-43c7-b5b1-bf24b3ede945 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:03.758475 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-deab6892-117f-43c7-b5b1-bf24b3ede945 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:03.792573 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-deab6892-117f-43c7-b5b1-bf24b3ede945 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:03.793048 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-deab6892-117f-43c7-b5b1-bf24b3ede945 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:03.796712 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-deab6892-117f-43c7-b5b1-bf24b3ede945 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:03.797287 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-deab6892-117f-43c7-b5b1-bf24b3ede945 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:04.074451 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-deab6892-117f-43c7-b5b1-bf24b3ede945 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:04.088780 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-deab6892-117f-43c7-b5b1-bf24b3ede945 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1315 microversion: 2.1 time: 0.333447 Jul 31 01:20:04.092410 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1382/2775] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:03 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:04.108808 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6dfa2d64-77cf-4b99-976e-690f9f44d47f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:04.117202 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6dfa2d64-77cf-4b99-976e-690f9f44d47f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:04.156460 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6dfa2d64-77cf-4b99-976e-690f9f44d47f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:04.160584 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6dfa2d64-77cf-4b99-976e-690f9f44d47f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:04.167946 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6dfa2d64-77cf-4b99-976e-690f9f44d47f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:04.168690 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6dfa2d64-77cf-4b99-976e-690f9f44d47f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:04.325671 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4c21d2af-f644-4b00-80c4-08b41b1ba4f6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:04.341965 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4c21d2af-f644-4b00-80c4-08b41b1ba4f6 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 0.921741 Jul 31 01:20:04.342565 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1394/2776] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:03 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:04.791358 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6dfa2d64-77cf-4b99-976e-690f9f44d47f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:04.807272 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6dfa2d64-77cf-4b99-976e-690f9f44d47f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1513 microversion: 2.1 time: 0.712201 Jul 31 01:20:04.808891 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1383/2777] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:04 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1513 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:05.118848 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5dc03d1d-bae1-4aef-8613-d165c19f7e8c tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:05.120160 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5dc03d1d-bae1-4aef-8613-d165c19f7e8c tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:05.154625 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5dc03d1d-bae1-4aef-8613-d165c19f7e8c tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:05.155106 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5dc03d1d-bae1-4aef-8613-d165c19f7e8c tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:05.155978 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5dc03d1d-bae1-4aef-8613-d165c19f7e8c tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:05.170172 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5dc03d1d-bae1-4aef-8613-d165c19f7e8c tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:05.369511 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8d332ca7-0284-4022-b493-13e2ab435b76 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:05.370783 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8d332ca7-0284-4022-b493-13e2ab435b76 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:05.396694 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d332ca7-0284-4022-b493-13e2ab435b76 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:05.397308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d332ca7-0284-4022-b493-13e2ab435b76 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:05.398224 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d332ca7-0284-4022-b493-13e2ab435b76 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:05.402008 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d332ca7-0284-4022-b493-13e2ab435b76 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:05.519964 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5dc03d1d-bae1-4aef-8613-d165c19f7e8c tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:05.552891 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5dc03d1d-bae1-4aef-8613-d165c19f7e8c tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1303 microversion: 2.1 time: 0.438796 Jul 31 01:20:05.556307 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1395/2778] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:05 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1303 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:05.832012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a685074a-f68a-4f25-aabf-d7baf4b81944 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:05.833211 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a685074a-f68a-4f25-aabf-d7baf4b81944 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:05.848983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a685074a-f68a-4f25-aabf-d7baf4b81944 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:05.856689 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a685074a-f68a-4f25-aabf-d7baf4b81944 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:05.862101 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a685074a-f68a-4f25-aabf-d7baf4b81944 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:05.868167 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a685074a-f68a-4f25-aabf-d7baf4b81944 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:06.810622 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a685074a-f68a-4f25-aabf-d7baf4b81944 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:06.834647 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a685074a-f68a-4f25-aabf-d7baf4b81944 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1513 microversion: 2.1 time: 1.007585 Jul 31 01:20:06.855381 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1396/2779] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:05 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1513 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:06.861050 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-17a5d1b0-69f5-4184-ab3a-7135a6c513de tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:06.869592 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-17a5d1b0-69f5-4184-ab3a-7135a6c513de tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:06.904426 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17a5d1b0-69f5-4184-ab3a-7135a6c513de tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:06.904901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17a5d1b0-69f5-4184-ab3a-7135a6c513de tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:06.909884 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17a5d1b0-69f5-4184-ab3a-7135a6c513de tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:06.910828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17a5d1b0-69f5-4184-ab3a-7135a6c513de tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:06.917772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8d332ca7-0284-4022-b493-13e2ab435b76 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:06.941033 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8d332ca7-0284-4022-b493-13e2ab435b76 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1473 microversion: 2.1 time: 1.576061 Jul 31 01:20:06.956231 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1384/2780] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:05 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1473 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:20:07.215585 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-17a5d1b0-69f5-4184-ab3a-7135a6c513de tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:07.261893 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-17a5d1b0-69f5-4184-ab3a-7135a6c513de tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1303 microversion: 2.1 time: 0.409502 Jul 31 01:20:07.263055 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1397/2781] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:06 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1303 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:07.868098 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-842f23d7-d7d6-4b07-9312-224ea617b3bb tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:07.869044 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-842f23d7-d7d6-4b07-9312-224ea617b3bb tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:07.904824 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-842f23d7-d7d6-4b07-9312-224ea617b3bb tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:07.905568 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-842f23d7-d7d6-4b07-9312-224ea617b3bb tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:07.906619 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-842f23d7-d7d6-4b07-9312-224ea617b3bb tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:07.908040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-842f23d7-d7d6-4b07-9312-224ea617b3bb tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:07.965703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5ef0845d-a4ac-49c2-9c50-402be99cd266 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:07.966360 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5ef0845d-a4ac-49c2-9c50-402be99cd266 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:07.983885 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5ef0845d-a4ac-49c2-9c50-402be99cd266 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:07.986347 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5ef0845d-a4ac-49c2-9c50-402be99cd266 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:07.987694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5ef0845d-a4ac-49c2-9c50-402be99cd266 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:07.989016 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5ef0845d-a4ac-49c2-9c50-402be99cd266 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:09.136617 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-842f23d7-d7d6-4b07-9312-224ea617b3bb tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:09.162831 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-842f23d7-d7d6-4b07-9312-224ea617b3bb tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1513 microversion: 2.1 time: 1.298189 Jul 31 01:20:09.164598 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1385/2782] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:07 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1513 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:20:09.181200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d19e9f3f-eb45-4712-a5d2-e3ede7151022 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:09.184570 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d19e9f3f-eb45-4712-a5d2-e3ede7151022 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:09.209013 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d19e9f3f-eb45-4712-a5d2-e3ede7151022 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:09.212568 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d19e9f3f-eb45-4712-a5d2-e3ede7151022 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:09.216440 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d19e9f3f-eb45-4712-a5d2-e3ede7151022 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:09.217307 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d19e9f3f-eb45-4712-a5d2-e3ede7151022 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:09.338681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5ef0845d-a4ac-49c2-9c50-402be99cd266 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:09.353951 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5ef0845d-a4ac-49c2-9c50-402be99cd266 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1479 microversion: 2.1 time: 1.394260 Jul 31 01:20:09.356173 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1398/2783] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:07 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1479 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:20:09.368135 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-11302013-46a5-474d-8589-88f5495ac168 req-53a09e97-ff56-4fd4-a052-2e24fe5b2583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f931f935-17a4-41ac-ac71-4ee21771219d", "name": "network-vif-unplugged", "status": "completed", "tag": "5ecc4d11-f7de-41b8-bd4a-7e73d5c197fb"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:09.402121 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-11302013-46a5-474d-8589-88f5495ac168 req-53a09e97-ff56-4fd4-a052-2e24fe5b2583 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:09.403668 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-11302013-46a5-474d-8589-88f5495ac168 req-53a09e97-ff56-4fd4-a052-2e24fe5b2583 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:09.438574 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-11302013-46a5-474d-8589-88f5495ac168 req-53a09e97-ff56-4fd4-a052-2e24fe5b2583 service nova] Creating event network-vif-unplugged:5ecc4d11-f7de-41b8-bd4a-7e73d5c197fb for instance f931f935-17a4-41ac-ac71-4ee21771219d on n-h2-master-1 Jul 31 01:20:09.449736 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-11302013-46a5-474d-8589-88f5495ac168 req-53a09e97-ff56-4fd4-a052-2e24fe5b2583 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089997 Jul 31 01:20:09.454243 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1399/2784] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:09.802706 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-b2d1770e-3af2-42ae-a6ba-5fdddf71de79 req-85b438d7-f6d5-4c78-b7c0-f97baed69b01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f6be904-5471-4ad5-bd1d-dc6802808c37", "tag": "62897edb-69e4-46f0-8193-e27cfe7ff775"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:09.843939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b2d1770e-3af2-42ae-a6ba-5fdddf71de79 req-85b438d7-f6d5-4c78-b7c0-f97baed69b01 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:09.852213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b2d1770e-3af2-42ae-a6ba-5fdddf71de79 req-85b438d7-f6d5-4c78-b7c0-f97baed69b01 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:09.931861 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-b2d1770e-3af2-42ae-a6ba-5fdddf71de79 req-85b438d7-f6d5-4c78-b7c0-f97baed69b01 service nova] Creating event network-changed:62897edb-69e4-46f0-8193-e27cfe7ff775 for instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 on n-h1-master-1 Jul 31 01:20:09.955324 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-b2d1770e-3af2-42ae-a6ba-5fdddf71de79 req-85b438d7-f6d5-4c78-b7c0-f97baed69b01 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155256 Jul 31 01:20:09.956216 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1400/2785] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:20:10.052847 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d19e9f3f-eb45-4712-a5d2-e3ede7151022 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:10.065390 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d19e9f3f-eb45-4712-a5d2-e3ede7151022 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1371 microversion: 2.1 time: 0.898083 Jul 31 01:20:10.066533 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1386/2786] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:09 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1371 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:10.194517 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc6efcec-cfd3-4ae4-b437-9687330cb4e1 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:10.195725 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc6efcec-cfd3-4ae4-b437-9687330cb4e1 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:10.223714 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc6efcec-cfd3-4ae4-b437-9687330cb4e1 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:10.226798 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc6efcec-cfd3-4ae4-b437-9687330cb4e1 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:10.228062 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc6efcec-cfd3-4ae4-b437-9687330cb4e1 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:10.244475 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc6efcec-cfd3-4ae4-b437-9687330cb4e1 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:10.383386 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-347d5bb0-2401-479b-b0b9-d5a4da99bec0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:10.384831 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-347d5bb0-2401-479b-b0b9-d5a4da99bec0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:10.412177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-347d5bb0-2401-479b-b0b9-d5a4da99bec0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:10.413083 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-347d5bb0-2401-479b-b0b9-d5a4da99bec0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:10.414211 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-347d5bb0-2401-479b-b0b9-d5a4da99bec0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:10.414920 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-347d5bb0-2401-479b-b0b9-d5a4da99bec0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:10.940127 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fc6efcec-cfd3-4ae4-b437-9687330cb4e1 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:11.004105 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc6efcec-cfd3-4ae4-b437-9687330cb4e1 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1531 microversion: 2.1 time: 0.815006 Jul 31 01:20:11.008435 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1401/2787] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:10 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1531 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:20:11.116297 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5569d5e0-845f-4c02-a281-69f4812b576a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:11.124610 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5569d5e0-845f-4c02-a281-69f4812b576a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:11.152507 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:11.162320 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=10 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:11.164335 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5569d5e0-845f-4c02-a281-69f4812b576a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:11.168248 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5569d5e0-845f-4c02-a281-69f4812b576a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:11.181901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5569d5e0-845f-4c02-a281-69f4812b576a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:11.193858 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5569d5e0-845f-4c02-a281-69f4812b576a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:11.357431 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-347d5bb0-2401-479b-b0b9-d5a4da99bec0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:11.374891 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-347d5bb0-2401-479b-b0b9-d5a4da99bec0 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1479 microversion: 2.1 time: 0.995433 Jul 31 01:20:11.388535 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1387/2788] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:10 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1479 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:12.008068 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5569d5e0-845f-4c02-a281-69f4812b576a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:12.031626 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bd7a464c-62c0-4cd9-87e8-7e6f12926797 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:12.032738 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bd7a464c-62c0-4cd9-87e8-7e6f12926797 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:12.035042 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:12.042922 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5569d5e0-845f-4c02-a281-69f4812b576a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1371 microversion: 2.1 time: 0.933830 Jul 31 01:20:12.047200 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1402/2789] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:11 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1371 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:12.054790 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd7a464c-62c0-4cd9-87e8-7e6f12926797 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:12.059118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd7a464c-62c0-4cd9-87e8-7e6f12926797 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:12.061621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd7a464c-62c0-4cd9-87e8-7e6f12926797 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:12.065789 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd7a464c-62c0-4cd9-87e8-7e6f12926797 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:12.404048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-daf78b67-6e11-40cd-8d0a-462798309e17 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:12.405305 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-daf78b67-6e11-40cd-8d0a-462798309e17 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:12.416210 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daf78b67-6e11-40cd-8d0a-462798309e17 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:12.424710 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daf78b67-6e11-40cd-8d0a-462798309e17 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:12.430260 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daf78b67-6e11-40cd-8d0a-462798309e17 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:12.433967 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daf78b67-6e11-40cd-8d0a-462798309e17 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:12.862144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bd7a464c-62c0-4cd9-87e8-7e6f12926797 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:12.871602 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bd7a464c-62c0-4cd9-87e8-7e6f12926797 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1519 microversion: 2.1 time: 0.845088 Jul 31 01:20:12.884405 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1388/2790] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:12 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1519 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:13.082548 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-86424ef6-40ea-4994-a99d-60f74fa93715 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:13.083621 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-86424ef6-40ea-4994-a99d-60f74fa93715 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:13.100374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86424ef6-40ea-4994-a99d-60f74fa93715 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:13.116403 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86424ef6-40ea-4994-a99d-60f74fa93715 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:13.117435 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86424ef6-40ea-4994-a99d-60f74fa93715 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:13.117950 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86424ef6-40ea-4994-a99d-60f74fa93715 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:13.313552 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-daf78b67-6e11-40cd-8d0a-462798309e17 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:13.329352 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-daf78b67-6e11-40cd-8d0a-462798309e17 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1479 microversion: 2.1 time: 0.929698 Jul 31 01:20:13.331144 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1403/2791] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:12 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1479 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:20:13.523812 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-86424ef6-40ea-4994-a99d-60f74fa93715 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:13.532979 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-86424ef6-40ea-4994-a99d-60f74fa93715 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1371 microversion: 2.1 time: 0.454010 Jul 31 01:20:13.547749 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1389/2792] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:13 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1371 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:20:13.917493 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-97c3b688-7c88-4a6c-babf-265c8144a1b5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:13.924316 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-97c3b688-7c88-4a6c-babf-265c8144a1b5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:13.981213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97c3b688-7c88-4a6c-babf-265c8144a1b5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:13.989783 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97c3b688-7c88-4a6c-babf-265c8144a1b5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:13.990676 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97c3b688-7c88-4a6c-babf-265c8144a1b5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:13.996708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97c3b688-7c88-4a6c-babf-265c8144a1b5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:14.361387 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dedd7e8f-0d4c-470b-843e-f7672ec585df tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:14.362019 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dedd7e8f-0d4c-470b-843e-f7672ec585df tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:14.379660 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dedd7e8f-0d4c-470b-843e-f7672ec585df tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:14.380144 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dedd7e8f-0d4c-470b-843e-f7672ec585df tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:14.385550 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dedd7e8f-0d4c-470b-843e-f7672ec585df tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:14.387493 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dedd7e8f-0d4c-470b-843e-f7672ec585df tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:14.452955 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:15.202631 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dedd7e8f-0d4c-470b-843e-f7672ec585df tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:15.214128 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dedd7e8f-0d4c-470b-843e-f7672ec585df tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1479 microversion: 2.1 time: 0.856935 Jul 31 01:20:15.218262 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1390/2793] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:14 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1479 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:15.235808 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7853a790-ce2c-419a-b942-098dc4ebc05c req-47013567-c562-4bcb-b3a2-de9c9cc87175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "643b9642-846d-41a9-886f-d9b173367085", "name": "network-vif-unplugged", "status": "completed", "tag": "f063d071-4d08-4af3-aad9-ba5f92e981e7"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:15.258286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7853a790-ce2c-419a-b942-098dc4ebc05c req-47013567-c562-4bcb-b3a2-de9c9cc87175 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:15.258450 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-97c3b688-7c88-4a6c-babf-265c8144a1b5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:15.261450 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7853a790-ce2c-419a-b942-098dc4ebc05c req-47013567-c562-4bcb-b3a2-de9c9cc87175 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:15.271519 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-97c3b688-7c88-4a6c-babf-265c8144a1b5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1519 microversion: 2.1 time: 1.362081 Jul 31 01:20:15.272490 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1404/2794] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:13 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1519 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:15.285498 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-212577cf-9c38-4203-b215-c1faf66241f9 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:15.286813 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-212577cf-9c38-4203-b215-c1faf66241f9 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:15.296002 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7853a790-ce2c-419a-b942-098dc4ebc05c req-47013567-c562-4bcb-b3a2-de9c9cc87175 service nova] Creating event network-vif-unplugged:f063d071-4d08-4af3-aad9-ba5f92e981e7 for instance 643b9642-846d-41a9-886f-d9b173367085 on n-h1-master-1 Jul 31 01:20:15.304979 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-212577cf-9c38-4203-b215-c1faf66241f9 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:15.305397 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7853a790-ce2c-419a-b942-098dc4ebc05c req-47013567-c562-4bcb-b3a2-de9c9cc87175 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081650 Jul 31 01:20:15.305894 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-212577cf-9c38-4203-b215-c1faf66241f9 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:15.306514 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1391/2795] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:15.309146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-212577cf-9c38-4203-b215-c1faf66241f9 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:15.310835 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-212577cf-9c38-4203-b215-c1faf66241f9 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:16.253441 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ba63dbcd-efe5-4f02-b4e7-8143dc335c8e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:16.254319 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ba63dbcd-efe5-4f02-b4e7-8143dc335c8e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:16.257231 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-212577cf-9c38-4203-b215-c1faf66241f9 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:16.274031 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-212577cf-9c38-4203-b215-c1faf66241f9 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1371 microversion: 2.1 time: 0.996397 Jul 31 01:20:16.276910 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba63dbcd-efe5-4f02-b4e7-8143dc335c8e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:16.288124 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba63dbcd-efe5-4f02-b4e7-8143dc335c8e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:16.292383 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1405/2796] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:15 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1371 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:16.295838 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba63dbcd-efe5-4f02-b4e7-8143dc335c8e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:16.296629 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba63dbcd-efe5-4f02-b4e7-8143dc335c8e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:16.312041 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f2c7289b-1e33-4dde-9a2b-2245dbdbafa0 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:16.312952 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f2c7289b-1e33-4dde-9a2b-2245dbdbafa0 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:16.340267 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2c7289b-1e33-4dde-9a2b-2245dbdbafa0 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:16.341021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2c7289b-1e33-4dde-9a2b-2245dbdbafa0 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:16.342655 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2c7289b-1e33-4dde-9a2b-2245dbdbafa0 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:16.345038 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2c7289b-1e33-4dde-9a2b-2245dbdbafa0 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:17.216382 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f2c7289b-1e33-4dde-9a2b-2245dbdbafa0 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:17.234031 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f2c7289b-1e33-4dde-9a2b-2245dbdbafa0 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1519 microversion: 2.1 time: 0.938213 Jul 31 01:20:17.236487 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1406/2797] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:16 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1519 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:17.300691 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-87f6b056-c84b-4517-bfc8-af3122e8de1b tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:17.302460 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-87f6b056-c84b-4517-bfc8-af3122e8de1b tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:17.335421 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-87f6b056-c84b-4517-bfc8-af3122e8de1b tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:17.337929 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-87f6b056-c84b-4517-bfc8-af3122e8de1b tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:17.340469 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-87f6b056-c84b-4517-bfc8-af3122e8de1b tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:17.341274 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-87f6b056-c84b-4517-bfc8-af3122e8de1b tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:17.370523 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ba63dbcd-efe5-4f02-b4e7-8143dc335c8e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:17.390867 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ba63dbcd-efe5-4f02-b4e7-8143dc335c8e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1479 microversion: 2.1 time: 1.141429 Jul 31 01:20:17.408505 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1392/2798] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:16 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1479 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:17.514089 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e9f43e4a-3ede-49cd-8f43-9f85eb5aa433 req-94f52f9c-ee90-4c68-8645-11fa26840ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f931f935-17a4-41ac-ac71-4ee21771219d", "name": "network-vif-plugged", "status": "completed", "tag": "5ecc4d11-f7de-41b8-bd4a-7e73d5c197fb"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:17.543583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e9f43e4a-3ede-49cd-8f43-9f85eb5aa433 req-94f52f9c-ee90-4c68-8645-11fa26840ecd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:17.549601 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e9f43e4a-3ede-49cd-8f43-9f85eb5aa433 req-94f52f9c-ee90-4c68-8645-11fa26840ecd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:17.620308 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e9f43e4a-3ede-49cd-8f43-9f85eb5aa433 req-94f52f9c-ee90-4c68-8645-11fa26840ecd service nova] Creating event network-vif-plugged:5ecc4d11-f7de-41b8-bd4a-7e73d5c197fb for instance f931f935-17a4-41ac-ac71-4ee21771219d on n-h2-master-1 Jul 31 01:20:17.665884 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e9f43e4a-3ede-49cd-8f43-9f85eb5aa433 req-94f52f9c-ee90-4c68-8645-11fa26840ecd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152574 Jul 31 01:20:17.669245 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1393/2799] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:18.045126 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-87f6b056-c84b-4517-bfc8-af3122e8de1b tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:18.060178 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-87f6b056-c84b-4517-bfc8-af3122e8de1b tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1371 microversion: 2.1 time: 0.766145 Jul 31 01:20:18.071015 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1407/2800] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:17 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1371 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:18.249031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-580b8491-627f-43b2-b4d1-0953280e4988 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:18.250676 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-580b8491-627f-43b2-b4d1-0953280e4988 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:18.258824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a529e1ae-7dca-4526-abb5-145a985f2c6e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:18.259743 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a529e1ae-7dca-4526-abb5-145a985f2c6e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:18.277114 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a529e1ae-7dca-4526-abb5-145a985f2c6e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:18.288259 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a529e1ae-7dca-4526-abb5-145a985f2c6e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:18.289830 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a529e1ae-7dca-4526-abb5-145a985f2c6e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:18.296329 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a529e1ae-7dca-4526-abb5-145a985f2c6e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:18.299371 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-580b8491-627f-43b2-b4d1-0953280e4988 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:18.304090 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-580b8491-627f-43b2-b4d1-0953280e4988 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:18.310756 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-580b8491-627f-43b2-b4d1-0953280e4988 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:18.311861 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-580b8491-627f-43b2-b4d1-0953280e4988 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:19.030973 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-580b8491-627f-43b2-b4d1-0953280e4988 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:19.049054 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-580b8491-627f-43b2-b4d1-0953280e4988 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1683 microversion: 2.1 time: 0.803772 Jul 31 01:20:19.050107 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1394/2801] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:18 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1683 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:19.078088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-351a6839-9918-4be9-9d20-85355cf098e7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:19.086581 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a529e1ae-7dca-4526-abb5-145a985f2c6e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:19.087502 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-351a6839-9918-4be9-9d20-85355cf098e7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:19.104937 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-351a6839-9918-4be9-9d20-85355cf098e7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:19.105219 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a529e1ae-7dca-4526-abb5-145a985f2c6e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1519 microversion: 2.1 time: 0.850194 Jul 31 01:20:19.105722 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-351a6839-9918-4be9-9d20-85355cf098e7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:19.108269 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-351a6839-9918-4be9-9d20-85355cf098e7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:19.109119 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1408/2802] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:18 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1519 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:19.109570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-351a6839-9918-4be9-9d20-85355cf098e7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:19.124894 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1f390259-a937-437c-ab0b-840bb9f74473 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:19.127848 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1f390259-a937-437c-ab0b-840bb9f74473 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:19.161551 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f390259-a937-437c-ab0b-840bb9f74473 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:19.162238 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f390259-a937-437c-ab0b-840bb9f74473 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:19.163095 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f390259-a937-437c-ab0b-840bb9f74473 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:19.163575 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f390259-a937-437c-ab0b-840bb9f74473 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:19.721384 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-351a6839-9918-4be9-9d20-85355cf098e7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:19.750176 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-351a6839-9918-4be9-9d20-85355cf098e7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1479 microversion: 2.1 time: 0.697435 Jul 31 01:20:19.764440 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1395/2803] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:19 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1479 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:19.769819 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-d9877d42-39db-4225-a35f-b56159162e6c req-c5653c02-3da9-42b3-8227-2ff67e19082d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "643b9642-846d-41a9-886f-d9b173367085", "name": "network-vif-plugged", "status": "completed", "tag": "f063d071-4d08-4af3-aad9-ba5f92e981e7"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:19.817392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d9877d42-39db-4225-a35f-b56159162e6c req-c5653c02-3da9-42b3-8227-2ff67e19082d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:19.817849 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d9877d42-39db-4225-a35f-b56159162e6c req-c5653c02-3da9-42b3-8227-2ff67e19082d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:19.856572 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-d9877d42-39db-4225-a35f-b56159162e6c req-c5653c02-3da9-42b3-8227-2ff67e19082d service nova] Creating event network-vif-plugged:f063d071-4d08-4af3-aad9-ba5f92e981e7 for instance 643b9642-846d-41a9-886f-d9b173367085 on n-h1-master-1 Jul 31 01:20:19.863291 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1f390259-a937-437c-ab0b-840bb9f74473 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:19.873052 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-d9877d42-39db-4225-a35f-b56159162e6c req-c5653c02-3da9-42b3-8227-2ff67e19082d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105265 Jul 31 01:20:19.876537 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1396/2804] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:19.882151 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1f390259-a937-437c-ab0b-840bb9f74473 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1371 microversion: 2.1 time: 0.763933 Jul 31 01:20:19.895890 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1409/2805] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:19 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1371 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:20.080657 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9759d916-5d28-4d6b-914a-fc07ae6deaa7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:20.081416 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9759d916-5d28-4d6b-914a-fc07ae6deaa7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:20.102677 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9759d916-5d28-4d6b-914a-fc07ae6deaa7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:20.103930 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9759d916-5d28-4d6b-914a-fc07ae6deaa7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:20.104788 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9759d916-5d28-4d6b-914a-fc07ae6deaa7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:20.105294 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9759d916-5d28-4d6b-914a-fc07ae6deaa7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:20.138950 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7ee3e650-ebde-4fb7-a0a2-a23018b2550d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:20.140220 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7ee3e650-ebde-4fb7-a0a2-a23018b2550d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:20.149452 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ee3e650-ebde-4fb7-a0a2-a23018b2550d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:20.158317 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ee3e650-ebde-4fb7-a0a2-a23018b2550d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:20.159586 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ee3e650-ebde-4fb7-a0a2-a23018b2550d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:20.160202 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ee3e650-ebde-4fb7-a0a2-a23018b2550d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:20.820675 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9759d916-5d28-4d6b-914a-fc07ae6deaa7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:20.831649 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9759d916-5d28-4d6b-914a-fc07ae6deaa7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.753678 Jul 31 01:20:20.832359 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1397/2806] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:20 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:20.854553 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5ffdb228-25c2-4af7-a683-643683adab0e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:20.855700 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5ffdb228-25c2-4af7-a683-643683adab0e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:20.867094 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ffdb228-25c2-4af7-a683-643683adab0e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:20.881947 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7ee3e650-ebde-4fb7-a0a2-a23018b2550d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:20.884694 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:20.894407 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ffdb228-25c2-4af7-a683-643683adab0e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:20.895535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ffdb228-25c2-4af7-a683-643683adab0e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:20.896620 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ffdb228-25c2-4af7-a683-643683adab0e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:20.900080 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7ee3e650-ebde-4fb7-a0a2-a23018b2550d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1519 microversion: 2.1 time: 0.763314 Jul 31 01:20:20.909913 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1410/2807] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:20 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1519 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:20.933180 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-da6c1a71-1705-4c9f-8b46-668a5c0a79bc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-669423590"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:20.936390 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-da6c1a71-1705-4c9f-8b46-668a5c0a79bc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:20.943521 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da6c1a71-1705-4c9f-8b46-668a5c0a79bc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:20.944346 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da6c1a71-1705-4c9f-8b46-668a5c0a79bc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:20.945323 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da6c1a71-1705-4c9f-8b46-668a5c0a79bc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:20.946129 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da6c1a71-1705-4c9f-8b46-668a5c0a79bc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:21.268136 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5ffdb228-25c2-4af7-a683-643683adab0e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:21.300163 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5ffdb228-25c2-4af7-a683-643683adab0e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1464 microversion: 2.1 time: 0.454289 Jul 31 01:20:21.303940 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1398/2808] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:20 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1464 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:21.312494 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ac89d877-676f-42ff-8099-fb604049ba8b tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:21.329776 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ac89d877-676f-42ff-8099-fb604049ba8b tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:21.343266 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac89d877-676f-42ff-8099-fb604049ba8b tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:21.343854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac89d877-676f-42ff-8099-fb604049ba8b tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:21.345657 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac89d877-676f-42ff-8099-fb604049ba8b tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:21.346310 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac89d877-676f-42ff-8099-fb604049ba8b tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:21.383687 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-da6c1a71-1705-4c9f-8b46-668a5c0a79bc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 202 len: 0 microversion: 2.1 time: 0.470387 Jul 31 01:20:21.392420 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1411/2809] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:20:20 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 31 01:20:21.410722 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-37c1adc0-170c-4639-8b16-dfd449630090 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:21.415221 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-37c1adc0-170c-4639-8b16-dfd449630090 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:21.453030 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37c1adc0-170c-4639-8b16-dfd449630090 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:21.456760 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37c1adc0-170c-4639-8b16-dfd449630090 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:21.457795 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37c1adc0-170c-4639-8b16-dfd449630090 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:21.461764 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37c1adc0-170c-4639-8b16-dfd449630090 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:21.747635 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-37c1adc0-170c-4639-8b16-dfd449630090 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d/action" status: 202 len: 0 microversion: 2.1 time: 0.352238 Jul 31 01:20:21.756017 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1412/2810] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:20:21 2022] POST /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:20:21.764850 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-74187cd2-79bc-4ab0-9074-d6d22b402b63 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:21.765495 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-74187cd2-79bc-4ab0-9074-d6d22b402b63 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:21.771256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ac89d877-676f-42ff-8099-fb604049ba8b tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:21.784537 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ac89d877-676f-42ff-8099-fb604049ba8b tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1371 microversion: 2.1 time: 0.479032 Jul 31 01:20:21.798434 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1399/2811] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:21 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1371 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:21.820590 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74187cd2-79bc-4ab0-9074-d6d22b402b63 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:21.821064 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74187cd2-79bc-4ab0-9074-d6d22b402b63 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:21.822244 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74187cd2-79bc-4ab0-9074-d6d22b402b63 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:21.822369 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74187cd2-79bc-4ab0-9074-d6d22b402b63 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:21.929959 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9cce94b1-ad71-45ad-80b3-733c0517f0e3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:21.930995 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9cce94b1-ad71-45ad-80b3-733c0517f0e3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:21.940888 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cce94b1-ad71-45ad-80b3-733c0517f0e3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:21.941813 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cce94b1-ad71-45ad-80b3-733c0517f0e3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:21.943433 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cce94b1-ad71-45ad-80b3-733c0517f0e3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:21.944161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cce94b1-ad71-45ad-80b3-733c0517f0e3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:21.990243 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74187cd2-79bc-4ab0-9074-d6d22b402b63 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:21.990713 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74187cd2-79bc-4ab0-9074-d6d22b402b63 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:21.991183 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-74187cd2-79bc-4ab0-9074-d6d22b402b63 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lazy-loading 'fault' on Instance uuid f931f935-17a4-41ac-ac71-4ee21771219d {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:20:22.202959 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9cce94b1-ad71-45ad-80b3-733c0517f0e3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:22.232484 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9cce94b1-ad71-45ad-80b3-733c0517f0e3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1519 microversion: 2.1 time: 0.309944 Jul 31 01:20:22.240341 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1400/2812] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:21 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1519 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:20:22.274002 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1c744a1c-9a71-4fb9-ac4a-06402e988e0a req-2fed051f-81b7-43b7-b615-43d819bbcb57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f0abec-dd05-4dff-8f15-b56464346b06", "name": "network-vif-unplugged", "status": "completed", "tag": "02e5aa3d-f780-459d-9466-4437ed729ddc"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:22.281035 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-74187cd2-79bc-4ab0-9074-d6d22b402b63 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1598 microversion: 2.1 time: 0.522337 Jul 31 01:20:22.282431 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1413/2813] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:21 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1598 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:22.308212 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-231ee922-fac5-49bc-95c7-75ec9c28e9e1 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:22.314036 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-231ee922-fac5-49bc-95c7-75ec9c28e9e1 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:22.322105 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-231ee922-fac5-49bc-95c7-75ec9c28e9e1 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:22.323268 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-231ee922-fac5-49bc-95c7-75ec9c28e9e1 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:22.324417 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-231ee922-fac5-49bc-95c7-75ec9c28e9e1 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:22.325107 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-231ee922-fac5-49bc-95c7-75ec9c28e9e1 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:22.328411 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1c744a1c-9a71-4fb9-ac4a-06402e988e0a req-2fed051f-81b7-43b7-b615-43d819bbcb57 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:22.329535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1c744a1c-9a71-4fb9-ac4a-06402e988e0a req-2fed051f-81b7-43b7-b615-43d819bbcb57 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:22.408521 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1c744a1c-9a71-4fb9-ac4a-06402e988e0a req-2fed051f-81b7-43b7-b615-43d819bbcb57 service nova] Creating event network-vif-unplugged:02e5aa3d-f780-459d-9466-4437ed729ddc for instance e7f0abec-dd05-4dff-8f15-b56464346b06 on n-h2-master-1 Jul 31 01:20:22.420237 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1c744a1c-9a71-4fb9-ac4a-06402e988e0a req-2fed051f-81b7-43b7-b615-43d819bbcb57 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.174865 Jul 31 01:20:22.421699 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1401/2814] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:22.477565 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-231ee922-fac5-49bc-95c7-75ec9c28e9e1 tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d/action" status: 202 len: 0 microversion: 2.1 time: 0.174006 Jul 31 01:20:22.488432 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6e2ce6b4-34f6-495a-ad99-eb018eeef13a tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:22.489297 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6e2ce6b4-34f6-495a-ad99-eb018eeef13a tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:22.497275 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1414/2815] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:20:22 2022] POST /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:20:22.510526 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e2ce6b4-34f6-495a-ad99-eb018eeef13a tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:22.512359 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e2ce6b4-34f6-495a-ad99-eb018eeef13a tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:22.513479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e2ce6b4-34f6-495a-ad99-eb018eeef13a tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:22.518322 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e2ce6b4-34f6-495a-ad99-eb018eeef13a tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:22.810737 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c7fcfbea-8496-40c8-b43d-66a46bff2e0d tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:22.811504 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c7fcfbea-8496-40c8-b43d-66a46bff2e0d tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:22.847354 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6e2ce6b4-34f6-495a-ad99-eb018eeef13a tempest-ServersAdminTestJSON-834562648 tempest-ServersAdminTestJSON-834562648-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1615 microversion: 2.1 time: 0.364243 Jul 31 01:20:22.852413 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1402/2816] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:22 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1615 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:22.874271 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7fcfbea-8496-40c8-b43d-66a46bff2e0d tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:22.877577 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c79ca2d5-136b-4d5a-8001-0495195b8268 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:22.877746 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7fcfbea-8496-40c8-b43d-66a46bff2e0d tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:22.878672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c79ca2d5-136b-4d5a-8001-0495195b8268 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:22.887190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7fcfbea-8496-40c8-b43d-66a46bff2e0d tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:22.893564 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7fcfbea-8496-40c8-b43d-66a46bff2e0d tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:22.902419 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c79ca2d5-136b-4d5a-8001-0495195b8268 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:22.905904 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c79ca2d5-136b-4d5a-8001-0495195b8268 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:22.910340 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c79ca2d5-136b-4d5a-8001-0495195b8268 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:22.913366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c79ca2d5-136b-4d5a-8001-0495195b8268 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:23.034199 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c79ca2d5-136b-4d5a-8001-0495195b8268 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:20:23.246666 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c79ca2d5-136b-4d5a-8001-0495195b8268 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 204 len: 0 microversion: 2.1 time: 0.376640 Jul 31 01:20:23.248095 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1403/2817] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:20:22 2022] DELETE /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:20:23.267890 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-674d38c3-5888-4700-a168-452c9b49662d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:23.269028 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-674d38c3-5888-4700-a168-452c9b49662d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:23.289343 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-674d38c3-5888-4700-a168-452c9b49662d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:23.294631 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-674d38c3-5888-4700-a168-452c9b49662d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:23.295887 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-674d38c3-5888-4700-a168-452c9b49662d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:23.300586 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-674d38c3-5888-4700-a168-452c9b49662d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:23.394594 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c7fcfbea-8496-40c8-b43d-66a46bff2e0d tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:23.416589 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c7fcfbea-8496-40c8-b43d-66a46bff2e0d tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1371 microversion: 2.1 time: 0.610686 Jul 31 01:20:23.431464 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1415/2818] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:22 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1371 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:20:23.446175 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-232afa67-312f-417e-95ce-1578813d4999 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:23.446974 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-232afa67-312f-417e-95ce-1578813d4999 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:23.477374 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-232afa67-312f-417e-95ce-1578813d4999 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:23.483379 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-232afa67-312f-417e-95ce-1578813d4999 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:23.486119 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-232afa67-312f-417e-95ce-1578813d4999 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:23.487659 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-232afa67-312f-417e-95ce-1578813d4999 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:24.118425 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-674d38c3-5888-4700-a168-452c9b49662d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:24.142233 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-674d38c3-5888-4700-a168-452c9b49662d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1468 microversion: 2.1 time: 0.889328 Jul 31 01:20:24.159973 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1404/2819] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:23 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1468 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:24.222533 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-232afa67-312f-417e-95ce-1578813d4999 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:24.237379 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-232afa67-312f-417e-95ce-1578813d4999 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1504 microversion: 2.1 time: 0.812842 Jul 31 01:20:24.254222 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1416/2820] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:23 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1504 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:24.265271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7aae5d81-6bb2-496d-83d3-ca5bfeea7381 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:24.266144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7aae5d81-6bb2-496d-83d3-ca5bfeea7381 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:24.275560 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7aae5d81-6bb2-496d-83d3-ca5bfeea7381 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:24.276245 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7aae5d81-6bb2-496d-83d3-ca5bfeea7381 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:24.277650 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7aae5d81-6bb2-496d-83d3-ca5bfeea7381 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:24.280665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7aae5d81-6bb2-496d-83d3-ca5bfeea7381 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:24.453811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9aca2c77-1ea4-4fa0-9fbc-7e75b4a4e94c tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:24.457924 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9aca2c77-1ea4-4fa0-9fbc-7e75b4a4e94c tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:24.513578 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9aca2c77-1ea4-4fa0-9fbc-7e75b4a4e94c tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:24.514140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9aca2c77-1ea4-4fa0-9fbc-7e75b4a4e94c tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:24.524429 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9aca2c77-1ea4-4fa0-9fbc-7e75b4a4e94c tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:24.526524 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9aca2c77-1ea4-4fa0-9fbc-7e75b4a4e94c tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:24.844070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7aae5d81-6bb2-496d-83d3-ca5bfeea7381 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:24.863197 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7aae5d81-6bb2-496d-83d3-ca5bfeea7381 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 200 len: 1504 microversion: 2.1 time: 0.604521 Jul 31 01:20:24.867541 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1405/2821] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:24 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 1504 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:24.892063 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-35abce23-90e3-4862-a736-23e139a8d82c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:24.892882 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-35abce23-90e3-4862-a736-23e139a8d82c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:24.902804 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35abce23-90e3-4862-a736-23e139a8d82c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:24.904613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35abce23-90e3-4862-a736-23e139a8d82c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:24.905728 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35abce23-90e3-4862-a736-23e139a8d82c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:24.906713 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35abce23-90e3-4862-a736-23e139a8d82c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:24.972899 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-35abce23-90e3-4862-a736-23e139a8d82c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:20:25.096729 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:25.252245 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-35abce23-90e3-4862-a736-23e139a8d82c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "DELETE /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 204 len: 0 microversion: 2.1 time: 0.364101 Jul 31 01:20:25.254595 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1406/2822] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:20:24 2022] DELETE /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:20:25.261169 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fe01a282-4237-4232-b924-f7c0b8f2567e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:25.262288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fe01a282-4237-4232-b924-f7c0b8f2567e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:25.270865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe01a282-4237-4232-b924-f7c0b8f2567e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:25.271622 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe01a282-4237-4232-b924-f7c0b8f2567e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:25.273401 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe01a282-4237-4232-b924-f7c0b8f2567e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:25.274155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe01a282-4237-4232-b924-f7c0b8f2567e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:25.578050 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9aca2c77-1ea4-4fa0-9fbc-7e75b4a4e94c tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:25.597182 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9aca2c77-1ea4-4fa0-9fbc-7e75b4a4e94c tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1371 microversion: 2.1 time: 1.153746 Jul 31 01:20:25.598134 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1417/2823] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:24 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1371 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:25.604738 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-06b8d908-3e21-46b9-a378-42dc7341fb56 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1616773415", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "11f04f30-fb24-47ce-b222-88fb5fe4a2ee"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:25.719742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-06b8d908-3e21-46b9-a378-42dc7341fb56 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] validate_networks() for [('11f04f30-fb24-47ce-b222-88fb5fe4a2ee', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:20:25.874704 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fe01a282-4237-4232-b924-f7c0b8f2567e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:25.887263 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fe01a282-4237-4232-b924-f7c0b8f2567e tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 200 len: 1468 microversion: 2.1 time: 0.629760 Jul 31 01:20:25.888769 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1407/2824] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:25 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 1468 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:26.330736 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-65f9f32e-8ebd-45df-b632-7e0fd87f0e75 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1174379583", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "50f1d2fc-29a0-4237-9bf0-2a3accf7d63c"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:26.455539 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-65f9f32e-8ebd-45df-b632-7e0fd87f0e75 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] validate_networks() for [('50f1d2fc-29a0-4237-9bf0-2a3accf7d63c', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:20:26.778993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-06b8d908-3e21-46b9-a378-42dc7341fb56 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:20:26.786022 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-06b8d908-3e21-46b9-a378-42dc7341fb56 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:20:26.787095 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-06b8d908-3e21-46b9-a378-42dc7341fb56 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:20:26.788174 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-06b8d908-3e21-46b9-a378-42dc7341fb56 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:20:26.788709 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-06b8d908-3e21-46b9-a378-42dc7341fb56 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:20:26.805676 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06b8d908-3e21-46b9-a378-42dc7341fb56 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:26.806461 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06b8d908-3e21-46b9-a378-42dc7341fb56 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:26.807550 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06b8d908-3e21-46b9-a378-42dc7341fb56 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:26.808115 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06b8d908-3e21-46b9-a378-42dc7341fb56 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:26.877832 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-06b8d908-3e21-46b9-a378-42dc7341fb56 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Getting quotas for project 5473e5d0400e44bbaaf59a2c86a14f8a. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:20:26.895357 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-06b8d908-3e21-46b9-a378-42dc7341fb56 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Getting quotas for user 440b48b4049a4a1ea3bfb6cdd372b205 and project 5473e5d0400e44bbaaf59a2c86a14f8a. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:20:26.923380 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-06b8d908-3e21-46b9-a378-42dc7341fb56 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:20:26.928765 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-06b8d908-3e21-46b9-a378-42dc7341fb56 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:20:27.129239 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-06b8d908-3e21-46b9-a378-42dc7341fb56 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.523422 Jul 31 01:20:27.138918 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1418/2825] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:20:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:20:27.181671 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-407027d0-e5ed-4cad-9be0-5b5ded39f08a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:27.188922 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-407027d0-e5ed-4cad-9be0-5b5ded39f08a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:27.228606 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-407027d0-e5ed-4cad-9be0-5b5ded39f08a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:27.229291 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-407027d0-e5ed-4cad-9be0-5b5ded39f08a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:27.249140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-407027d0-e5ed-4cad-9be0-5b5ded39f08a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:27.249670 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-407027d0-e5ed-4cad-9be0-5b5ded39f08a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:28.539297 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-407027d0-e5ed-4cad-9be0-5b5ded39f08a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:28.548028 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-407027d0-e5ed-4cad-9be0-5b5ded39f08a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1371 microversion: 2.1 time: 1.400217 Jul 31 01:20:28.548629 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1419/2826] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:27 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1371 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:28.567833 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6da7690b-dab1-4eea-9fa1-65ef51f03181 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:28.568471 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6da7690b-dab1-4eea-9fa1-65ef51f03181 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: fbe0ea96-0654-4e48-a079-d876355232c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:28.588959 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6da7690b-dab1-4eea-9fa1-65ef51f03181 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:28.594085 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6da7690b-dab1-4eea-9fa1-65ef51f03181 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:28.595970 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6da7690b-dab1-4eea-9fa1-65ef51f03181 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:28.596636 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6da7690b-dab1-4eea-9fa1-65ef51f03181 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:28.619100 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-65f9f32e-8ebd-45df-b632-7e0fd87f0e75 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:20:28.620084 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-65f9f32e-8ebd-45df-b632-7e0fd87f0e75 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:20:28.620894 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-65f9f32e-8ebd-45df-b632-7e0fd87f0e75 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:20:28.621900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-65f9f32e-8ebd-45df-b632-7e0fd87f0e75 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:20:28.622512 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-65f9f32e-8ebd-45df-b632-7e0fd87f0e75 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:20:28.626428 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:28.646721 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-65f9f32e-8ebd-45df-b632-7e0fd87f0e75 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:28.648409 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-65f9f32e-8ebd-45df-b632-7e0fd87f0e75 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:28.655794 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-65f9f32e-8ebd-45df-b632-7e0fd87f0e75 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:28.656399 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-6da7690b-dab1-4eea-9fa1-65ef51f03181 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] HTTP exception thrown: Instance fbe0ea96-0654-4e48-a079-d876355232c8 could not be found. Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6da7690b-dab1-4eea-9fa1-65ef51f03181 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Request method failure captured: Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 HTTP/1.1 Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dguPNepptukr8H-ji6fsrHXxlejjxXer1JyubCqhAhkoiBpNguA0R_E3XoPxWV4q0PuRAzi2jU_vz2uJXvXClFImKpp5rfGz0RYEwvL-5qPKuxEHNLfvn32JzJRx33-AmS2jzMNT_SkXTAKqpE_zVST5WzuvTnSe8eLsc89apZZsQc Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 43c36901e18a4507ae8a90557eb9abc9 Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersAdminTestJSON-1847417388 Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/43c36901e18a4507ae8a90557eb9abc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/43c36901e18a4507ae8a90557eb9abc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/43c36901e18a4507ae8a90557eb9abc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_43c36901e18a4507ae8a90557eb9abc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersAdminTestJSON-1847417388 Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 43c36901e18a4507ae8a90557eb9abc9 Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersAdminTestJSON-1847417388 Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersAdminTestJSON-1847417388-project Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 4157eca4624c444bb8b88bdb958dd8dc Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersAdminTestJSON-1847417388-project Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: exception: Instance fbe0ea96-0654-4e48-a079-d876355232c8 could not be found. Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'fbe0ea96-0654-4e48-a079-d876355232c8'} Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbe0ea96-0654-4e48-a079-d876355232c8 could not be found. Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbe0ea96-0654-4e48-a079-d876355232c8 could not be found. Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:20:28.658806 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:28.665556 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:28.665556 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:20:28.665556 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:20:28.665556 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:20:28.665556 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:20:28.665556 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbe0ea96-0654-4e48-a079-d876355232c8 could not be found. Jul 31 01:20:28.665556 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:28.666904 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-65f9f32e-8ebd-45df-b632-7e0fd87f0e75 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:28.667050 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6da7690b-dab1-4eea-9fa1-65ef51f03181 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Returning 404 to user: Instance fbe0ea96-0654-4e48-a079-d876355232c8 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:20:28.667050 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6da7690b-dab1-4eea-9fa1-65ef51f03181 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8" status: 404 len: 111 microversion: 2.1 time: 0.110855 Jul 31 01:20:28.673181 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1420/2827] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:28 2022] GET /compute/v2.1/servers/fbe0ea96-0654-4e48-a079-d876355232c8 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:20:28.678772 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-b4fdee1f-8d7c-403a-b09d-3a22eedb1dcf req-f18ee38c-d07e-40a3-8178-dc4257cdfbc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe0ea96-0654-4e48-a079-d876355232c8", "name": "network-vif-deleted", "tag": "beb3a534-9a39-4c7d-bff6-542253cd9b59"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:28.707641 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b4fdee1f-8d7c-403a-b09d-3a22eedb1dcf req-f18ee38c-d07e-40a3-8178-dc4257cdfbc2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:28.708108 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b4fdee1f-8d7c-403a-b09d-3a22eedb1dcf req-f18ee38c-d07e-40a3-8178-dc4257cdfbc2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:28.713059 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-65f9f32e-8ebd-45df-b632-7e0fd87f0e75 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Getting quotas for project 8fa7743dce0f4d989a5fe94cf332a4ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:20:28.737219 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-65f9f32e-8ebd-45df-b632-7e0fd87f0e75 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Getting quotas for user c8472c850b5f4254b04d6fc49401cd08 and project 8fa7743dce0f4d989a5fe94cf332a4ba. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:20:28.745124 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-b4fdee1f-8d7c-403a-b09d-3a22eedb1dcf req-f18ee38c-d07e-40a3-8178-dc4257cdfbc2 service nova] Creating event network-vif-deleted:beb3a534-9a39-4c7d-bff6-542253cd9b59 for instance fbe0ea96-0654-4e48-a079-d876355232c8 on n-h2-master-1 Jul 31 01:20:28.771816 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-b4fdee1f-8d7c-403a-b09d-3a22eedb1dcf req-f18ee38c-d07e-40a3-8178-dc4257cdfbc2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093115 Jul 31 01:20:28.772473 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1421/2828] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:28.779400 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-65f9f32e-8ebd-45df-b632-7e0fd87f0e75 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:20:28.789895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-65f9f32e-8ebd-45df-b632-7e0fd87f0e75 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:20:28.798465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-656a663a-ff39-4ea3-97bb-d5dddc814b8b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:28.802552 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-656a663a-ff39-4ea3-97bb-d5dddc814b8b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:28.820140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-656a663a-ff39-4ea3-97bb-d5dddc814b8b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:28.820870 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-656a663a-ff39-4ea3-97bb-d5dddc814b8b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:28.824263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-656a663a-ff39-4ea3-97bb-d5dddc814b8b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:28.825214 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-656a663a-ff39-4ea3-97bb-d5dddc814b8b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:28.898211 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-65f9f32e-8ebd-45df-b632-7e0fd87f0e75 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.992915 Jul 31 01:20:28.902293 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1408/2829] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:20:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:20:28.918065 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1a96b09e-bbaf-4738-b2e8-f6f7429fb883 req-8335df00-423c-40c5-96a9-9575610693a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f0abec-dd05-4dff-8f15-b56464346b06", "name": "network-vif-plugged", "status": "completed", "tag": "02e5aa3d-f780-459d-9466-4437ed729ddc"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:28.946641 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1a96b09e-bbaf-4738-b2e8-f6f7429fb883 req-8335df00-423c-40c5-96a9-9575610693a9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:28.947719 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1a96b09e-bbaf-4738-b2e8-f6f7429fb883 req-8335df00-423c-40c5-96a9-9575610693a9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:28.990090 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1a96b09e-bbaf-4738-b2e8-f6f7429fb883 req-8335df00-423c-40c5-96a9-9575610693a9 service nova] Creating event network-vif-plugged:02e5aa3d-f780-459d-9466-4437ed729ddc for instance e7f0abec-dd05-4dff-8f15-b56464346b06 on n-h2-master-1 Jul 31 01:20:29.002718 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1a96b09e-bbaf-4738-b2e8-f6f7429fb883 req-8335df00-423c-40c5-96a9-9575610693a9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097814 Jul 31 01:20:29.009667 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1409/2830] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:29.023697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-656a663a-ff39-4ea3-97bb-d5dddc814b8b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:29.023967 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6976898d-3f52-4f63-a401-e71918744a28 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:29.024704 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6976898d-3f52-4f63-a401-e71918744a28 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:29.040280 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-656a663a-ff39-4ea3-97bb-d5dddc814b8b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1270 microversion: 2.1 time: 0.264237 Jul 31 01:20:29.045847 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6976898d-3f52-4f63-a401-e71918744a28 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:29.046917 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1422/2831] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:28 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1270 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:29.049341 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6976898d-3f52-4f63-a401-e71918744a28 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:29.050481 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6976898d-3f52-4f63-a401-e71918744a28 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:29.053729 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6976898d-3f52-4f63-a401-e71918744a28 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:29.061617 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4403140c-2676-4b15-b26f-70450384032f tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:29.070332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4403140c-2676-4b15-b26f-70450384032f tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:29.114886 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6976898d-3f52-4f63-a401-e71918744a28 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:20:29.275587 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4403140c-2676-4b15-b26f-70450384032f tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8472c850b5f4254b04d6fc49401cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7743dce0f4d989a5fe94cf332a4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:29.283956 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4403140c-2676-4b15-b26f-70450384032f tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 200 len: 1217 microversion: 2.1 time: 0.234895 Jul 31 01:20:29.305725 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1423/2832] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:29 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 1217 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:29.314522 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6976898d-3f52-4f63-a401-e71918744a28 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "DELETE /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 204 len: 0 microversion: 2.1 time: 0.301436 Jul 31 01:20:29.315072 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1410/2833] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:20:29 2022] DELETE /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:20:29.329218 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3b702d0c-f6f4-43d5-aaec-2f79a8f8676d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:29.329658 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3b702d0c-f6f4-43d5-aaec-2f79a8f8676d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:29.350225 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:29.366782 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b702d0c-f6f4-43d5-aaec-2f79a8f8676d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:29.391923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b702d0c-f6f4-43d5-aaec-2f79a8f8676d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:29.393300 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b702d0c-f6f4-43d5-aaec-2f79a8f8676d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:29.394073 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b702d0c-f6f4-43d5-aaec-2f79a8f8676d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:29.570418 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-27bbed6e-37c4-4200-aef9-8fa2af4a8170 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:29.572122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-27bbed6e-37c4-4200-aef9-8fa2af4a8170 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:29.590829 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-27bbed6e-37c4-4200-aef9-8fa2af4a8170 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:29.591893 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-27bbed6e-37c4-4200-aef9-8fa2af4a8170 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:29.592974 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-27bbed6e-37c4-4200-aef9-8fa2af4a8170 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:29.595864 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-27bbed6e-37c4-4200-aef9-8fa2af4a8170 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:30.586663 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3b702d0c-f6f4-43d5-aaec-2f79a8f8676d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:30.608945 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3b702d0c-f6f4-43d5-aaec-2f79a8f8676d tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 200 len: 1468 microversion: 2.1 time: 1.289363 Jul 31 01:20:30.628068 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1424/2834] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:29 2022] GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 1468 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:30.661943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-44fb0595-8e8f-4787-b71b-524cce3f6113 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:30.670172 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-44fb0595-8e8f-4787-b71b-524cce3f6113 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:30.697488 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44fb0595-8e8f-4787-b71b-524cce3f6113 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:30.698294 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44fb0595-8e8f-4787-b71b-524cce3f6113 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:30.699421 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44fb0595-8e8f-4787-b71b-524cce3f6113 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:30.701223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44fb0595-8e8f-4787-b71b-524cce3f6113 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:30.885654 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-27bbed6e-37c4-4200-aef9-8fa2af4a8170 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:30.916189 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-27bbed6e-37c4-4200-aef9-8fa2af4a8170 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1371 microversion: 2.1 time: 1.350128 Jul 31 01:20:30.937444 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1411/2835] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:29 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1371 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:30.953358 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0974e97b-e77b-4ff5-a5fd-20b44e6b501a tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:30.960071 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0974e97b-e77b-4ff5-a5fd-20b44e6b501a tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:30.988850 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0974e97b-e77b-4ff5-a5fd-20b44e6b501a tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:30.989305 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0974e97b-e77b-4ff5-a5fd-20b44e6b501a tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:30.990183 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0974e97b-e77b-4ff5-a5fd-20b44e6b501a tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:30.990555 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0974e97b-e77b-4ff5-a5fd-20b44e6b501a tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:31.112508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-44fb0595-8e8f-4787-b71b-524cce3f6113 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:31.115536 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:31.188860 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-44fb0595-8e8f-4787-b71b-524cce3f6113 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1276 microversion: 2.1 time: 0.544029 Jul 31 01:20:31.193999 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1425/2836] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:30 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1276 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:31.230042 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-0d5c0a4c-ec93-4ca9-8be2-19ecbbf87650 req-5c3da346-fe72-4c28-a0e7-8a7b119d6e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "643b9642-846d-41a9-886f-d9b173367085", "name": "network-vif-deleted", "tag": "f063d071-4d08-4af3-aad9-ba5f92e981e7"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:31.296552 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0d5c0a4c-ec93-4ca9-8be2-19ecbbf87650 req-5c3da346-fe72-4c28-a0e7-8a7b119d6e73 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:31.301732 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0d5c0a4c-ec93-4ca9-8be2-19ecbbf87650 req-5c3da346-fe72-4c28-a0e7-8a7b119d6e73 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:31.345539 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-0d5c0a4c-ec93-4ca9-8be2-19ecbbf87650 req-5c3da346-fe72-4c28-a0e7-8a7b119d6e73 service nova] Creating event network-vif-deleted:f063d071-4d08-4af3-aad9-ba5f92e981e7 for instance 643b9642-846d-41a9-886f-d9b173367085 on n-h1-master-1 Jul 31 01:20:31.360821 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-0d5c0a4c-ec93-4ca9-8be2-19ecbbf87650 req-5c3da346-fe72-4c28-a0e7-8a7b119d6e73 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160634 Jul 31 01:20:31.364458 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1426/2837] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:31.608113 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0974e97b-e77b-4ff5-a5fd-20b44e6b501a tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8472c850b5f4254b04d6fc49401cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7743dce0f4d989a5fe94cf332a4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:31.622832 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0974e97b-e77b-4ff5-a5fd-20b44e6b501a tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 200 len: 1269 microversion: 2.1 time: 0.679471 Jul 31 01:20:31.628123 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1412/2838] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:30 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 1269 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:31.658593 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3869cfed-b15b-4bf6-a214-fbe9eccf36a7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:31.659451 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3869cfed-b15b-4bf6-a214-fbe9eccf36a7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:31.697360 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3869cfed-b15b-4bf6-a214-fbe9eccf36a7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:31.699809 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3869cfed-b15b-4bf6-a214-fbe9eccf36a7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:31.702993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3869cfed-b15b-4bf6-a214-fbe9eccf36a7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:31.705371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3869cfed-b15b-4bf6-a214-fbe9eccf36a7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:31.948547 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-57730248-66d9-4dd0-a754-174163214d88 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:31.949299 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-57730248-66d9-4dd0-a754-174163214d88 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:31.962155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57730248-66d9-4dd0-a754-174163214d88 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:31.962620 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57730248-66d9-4dd0-a754-174163214d88 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:31.963482 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57730248-66d9-4dd0-a754-174163214d88 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:31.968642 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57730248-66d9-4dd0-a754-174163214d88 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:32.831321 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-57730248-66d9-4dd0-a754-174163214d88 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:32.852661 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-57730248-66d9-4dd0-a754-174163214d88 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1371 microversion: 2.1 time: 0.909227 Jul 31 01:20:32.864056 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1413/2839] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:31 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1371 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:32.879973 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3869cfed-b15b-4bf6-a214-fbe9eccf36a7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:32.882255 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ac72ad3b-8db4-42ee-899c-a58801dd3b8c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:32.887139 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ac72ad3b-8db4-42ee-899c-a58801dd3b8c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:32.892865 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3869cfed-b15b-4bf6-a214-fbe9eccf36a7 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 200 len: 1468 microversion: 2.1 time: 1.244921 Jul 31 01:20:32.898387 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1427/2840] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:31 2022] GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 1468 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:32.913328 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-6b3f1ee1-5976-42ce-8e09-b674015ed8cd req-44b7d1f1-6260-480c-8060-25d1239b6148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c2fb1f-e2af-4b6e-a479-11c2fe101899", "name": "network-vif-unplugged", "status": "completed", "tag": "c97f7a0b-c24e-4337-82f2-431b50cd2106"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:32.921185 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac72ad3b-8db4-42ee-899c-a58801dd3b8c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:32.921656 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac72ad3b-8db4-42ee-899c-a58801dd3b8c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:32.924901 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac72ad3b-8db4-42ee-899c-a58801dd3b8c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:32.925397 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac72ad3b-8db4-42ee-899c-a58801dd3b8c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:32.936234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6b3f1ee1-5976-42ce-8e09-b674015ed8cd req-44b7d1f1-6260-480c-8060-25d1239b6148 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:32.937032 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6b3f1ee1-5976-42ce-8e09-b674015ed8cd req-44b7d1f1-6260-480c-8060-25d1239b6148 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:32.962229 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-6b3f1ee1-5976-42ce-8e09-b674015ed8cd req-44b7d1f1-6260-480c-8060-25d1239b6148 service nova] Creating event network-vif-unplugged:c97f7a0b-c24e-4337-82f2-431b50cd2106 for instance 95c2fb1f-e2af-4b6e-a479-11c2fe101899 on n-h1-master-1 Jul 31 01:20:32.976901 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-6b3f1ee1-5976-42ce-8e09-b674015ed8cd req-44b7d1f1-6260-480c-8060-25d1239b6148 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076866 Jul 31 01:20:32.981926 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1428/2841] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:32.993893 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cb48afcc-5961-4def-b763-2751a6a35ffb tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:32.996255 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cb48afcc-5961-4def-b763-2751a6a35ffb tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:33.011106 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb48afcc-5961-4def-b763-2751a6a35ffb tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:33.017210 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb48afcc-5961-4def-b763-2751a6a35ffb tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:33.019779 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb48afcc-5961-4def-b763-2751a6a35ffb tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:33.021654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb48afcc-5961-4def-b763-2751a6a35ffb tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:33.373440 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cb48afcc-5961-4def-b763-2751a6a35ffb tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8472c850b5f4254b04d6fc49401cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7743dce0f4d989a5fe94cf332a4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:33.383957 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cb48afcc-5961-4def-b763-2751a6a35ffb tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 200 len: 1275 microversion: 2.1 time: 0.400462 Jul 31 01:20:33.394027 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1429/2842] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:32 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 1275 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:33.445998 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ac72ad3b-8db4-42ee-899c-a58801dd3b8c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:33.459424 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ac72ad3b-8db4-42ee-899c-a58801dd3b8c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1276 microversion: 2.1 time: 0.587450 Jul 31 01:20:33.462322 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1414/2843] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:32 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1276 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:33.762085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-bce411e3-08d8-4358-9f9a-2b7dc48250f7 req-d55f4d14-3e44-432c-bb49-4a878654f1fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c2fb1f-e2af-4b6e-a479-11c2fe101899", "name": "network-vif-deleted", "tag": "c97f7a0b-c24e-4337-82f2-431b50cd2106"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:33.816102 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-bce411e3-08d8-4358-9f9a-2b7dc48250f7 req-d55f4d14-3e44-432c-bb49-4a878654f1fa service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:33.827676 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-bce411e3-08d8-4358-9f9a-2b7dc48250f7 req-d55f4d14-3e44-432c-bb49-4a878654f1fa service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:33.881192 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-44fed8c3-e277-46b1-8daf-665ce2ae346e tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:33.882090 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-44fed8c3-e277-46b1-8daf-665ce2ae346e tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:33.892344 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-bce411e3-08d8-4358-9f9a-2b7dc48250f7 req-d55f4d14-3e44-432c-bb49-4a878654f1fa service nova] Creating event network-vif-deleted:c97f7a0b-c24e-4337-82f2-431b50cd2106 for instance 95c2fb1f-e2af-4b6e-a479-11c2fe101899 on n-h1-master-1 Jul 31 01:20:33.903200 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44fed8c3-e277-46b1-8daf-665ce2ae346e tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:33.912689 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-bce411e3-08d8-4358-9f9a-2b7dc48250f7 req-d55f4d14-3e44-432c-bb49-4a878654f1fa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153621 Jul 31 01:20:33.915326 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44fed8c3-e277-46b1-8daf-665ce2ae346e tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:33.920496 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1430/2844] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:33.930178 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44fed8c3-e277-46b1-8daf-665ce2ae346e tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:33.930654 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44fed8c3-e277-46b1-8daf-665ce2ae346e tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:33.946098 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-64ffa447-fa5d-4772-91dd-74ff711533f1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:33.947273 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-64ffa447-fa5d-4772-91dd-74ff711533f1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:33.976094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64ffa447-fa5d-4772-91dd-74ff711533f1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:33.976978 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64ffa447-fa5d-4772-91dd-74ff711533f1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:33.979424 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64ffa447-fa5d-4772-91dd-74ff711533f1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:34.041340 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64ffa447-fa5d-4772-91dd-74ff711533f1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.060s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:34.183308 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64ffa447-fa5d-4772-91dd-74ff711533f1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:34.184265 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64ffa447-fa5d-4772-91dd-74ff711533f1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:34.184953 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-64ffa447-fa5d-4772-91dd-74ff711533f1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lazy-loading 'fault' on Instance uuid 95c2fb1f-e2af-4b6e-a479-11c2fe101899 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:20:34.665619 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-64ffa447-fa5d-4772-91dd-74ff711533f1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:34.676335 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-64ffa447-fa5d-4772-91dd-74ff711533f1 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 200 len: 1302 microversion: 2.1 time: 0.754427 Jul 31 01:20:34.688583 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1431/2845] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:33 2022] GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 1302 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:34.724508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dc564719-f1ce-4442-a730-e07086f1ef55 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:34.725138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dc564719-f1ce-4442-a730-e07086f1ef55 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:34.760436 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc564719-f1ce-4442-a730-e07086f1ef55 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:34.769098 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc564719-f1ce-4442-a730-e07086f1ef55 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:34.769543 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc564719-f1ce-4442-a730-e07086f1ef55 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:34.770021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc564719-f1ce-4442-a730-e07086f1ef55 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:34.944338 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-44fed8c3-e277-46b1-8daf-665ce2ae346e tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:34.964963 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-44fed8c3-e277-46b1-8daf-665ce2ae346e tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1371 microversion: 2.1 time: 1.083746 Jul 31 01:20:34.982813 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1415/2846] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:33 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1371 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:34.996240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2ba3a8cb-ff8e-47c1-9afe-c9045fb96b4f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:34.997011 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2ba3a8cb-ff8e-47c1-9afe-c9045fb96b4f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:35.018510 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2ba3a8cb-ff8e-47c1-9afe-c9045fb96b4f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:35.019142 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2ba3a8cb-ff8e-47c1-9afe-c9045fb96b4f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:35.020146 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2ba3a8cb-ff8e-47c1-9afe-c9045fb96b4f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:35.021128 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2ba3a8cb-ff8e-47c1-9afe-c9045fb96b4f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:35.559485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2ba3a8cb-ff8e-47c1-9afe-c9045fb96b4f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:35.571375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dc564719-f1ce-4442-a730-e07086f1ef55 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8472c850b5f4254b04d6fc49401cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7743dce0f4d989a5fe94cf332a4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:35.588115 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2ba3a8cb-ff8e-47c1-9afe-c9045fb96b4f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1318 microversion: 2.1 time: 0.601848 Jul 31 01:20:35.590307 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dc564719-f1ce-4442-a730-e07086f1ef55 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 200 len: 1317 microversion: 2.1 time: 0.899505 Jul 31 01:20:35.603683 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1416/2848] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:34 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:35.607963 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1432/2847] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:34 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 1317 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:35.612378 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-681f460f-d875-4e96-931d-b624f5bf2c6e req-8a69a1ff-87e2-4d32-bbda-079fb69b6e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f6be904-5471-4ad5-bd1d-dc6802808c37", "name": "network-vif-plugged", "status": "completed", "tag": "62897edb-69e4-46f0-8193-e27cfe7ff775"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:35.622667 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-681f460f-d875-4e96-931d-b624f5bf2c6e req-8a69a1ff-87e2-4d32-bbda-079fb69b6e2e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:35.623195 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-681f460f-d875-4e96-931d-b624f5bf2c6e req-8a69a1ff-87e2-4d32-bbda-079fb69b6e2e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:35.636234 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-681f460f-d875-4e96-931d-b624f5bf2c6e req-8a69a1ff-87e2-4d32-bbda-079fb69b6e2e service nova] Creating event network-vif-plugged:62897edb-69e4-46f0-8193-e27cfe7ff775 for instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 on n-h1-master-1 Jul 31 01:20:35.641854 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-681f460f-d875-4e96-931d-b624f5bf2c6e req-8a69a1ff-87e2-4d32-bbda-079fb69b6e2e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036245 Jul 31 01:20:35.642831 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1417/2849] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:35.713983 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-52e23fe0-c09a-45f0-bd04-410ac13de564 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:35.714852 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-52e23fe0-c09a-45f0-bd04-410ac13de564 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: 95c2fb1f-e2af-4b6e-a479-11c2fe101899] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:35.733767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52e23fe0-c09a-45f0-bd04-410ac13de564 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:35.734238 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52e23fe0-c09a-45f0-bd04-410ac13de564 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:35.742270 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52e23fe0-c09a-45f0-bd04-410ac13de564 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:35.742754 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52e23fe0-c09a-45f0-bd04-410ac13de564 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:35.797382 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-52e23fe0-c09a-45f0-bd04-410ac13de564 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] HTTP exception thrown: Instance 95c2fb1f-e2af-4b6e-a479-11c2fe101899 could not be found. Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-52e23fe0-c09a-45f0-bd04-410ac13de564 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Request method failure captured: Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 HTTP/1.1 Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dguPNepptukr8H-ji6fsrHXxlejjxXer1JyubCqhAhkoiBpNguA0R_E3XoPxWV4q0PuRAzi2jU_vz2uJXvXClFImKpp5rfGz0RYEwvL-5qPKuxEHNLfvn32JzJRx33-AmS2jzMNT_SkXTAKqpE_zVST5WzuvTnSe8eLsc89apZZsQc Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 43c36901e18a4507ae8a90557eb9abc9 Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersAdminTestJSON-1847417388 Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/43c36901e18a4507ae8a90557eb9abc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/43c36901e18a4507ae8a90557eb9abc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/43c36901e18a4507ae8a90557eb9abc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_43c36901e18a4507ae8a90557eb9abc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersAdminTestJSON-1847417388 Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 43c36901e18a4507ae8a90557eb9abc9 Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersAdminTestJSON-1847417388 Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersAdminTestJSON-1847417388-project Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 4157eca4624c444bb8b88bdb958dd8dc Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersAdminTestJSON-1847417388-project Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 95c2fb1f-e2af-4b6e-a479-11c2fe101899 could not be found. Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '95c2fb1f-e2af-4b6e-a479-11c2fe101899'} Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c2fb1f-e2af-4b6e-a479-11c2fe101899 could not be found. Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c2fb1f-e2af-4b6e-a479-11c2fe101899 could not be found. Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:20:35.807948 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:35.811846 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:35.811846 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:20:35.811846 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:20:35.811846 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:20:35.811846 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:20:35.811846 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c2fb1f-e2af-4b6e-a479-11c2fe101899 could not be found. Jul 31 01:20:35.811846 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:35.815821 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-52e23fe0-c09a-45f0-bd04-410ac13de564 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Returning 404 to user: Instance 95c2fb1f-e2af-4b6e-a479-11c2fe101899 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:20:35.817737 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-52e23fe0-c09a-45f0-bd04-410ac13de564 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899" status: 404 len: 111 microversion: 2.1 time: 0.118614 Jul 31 01:20:35.831656 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1433/2850] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:35 2022] GET /compute/v2.1/servers/95c2fb1f-e2af-4b6e-a479-11c2fe101899 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:20:35.841623 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-75715248-0b3e-4771-afe4-a1700be7e56a tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:35.842318 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-75715248-0b3e-4771-afe4-a1700be7e56a tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:35.856921 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75715248-0b3e-4771-afe4-a1700be7e56a tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:35.859268 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75715248-0b3e-4771-afe4-a1700be7e56a tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:35.860613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75715248-0b3e-4771-afe4-a1700be7e56a tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:35.863055 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75715248-0b3e-4771-afe4-a1700be7e56a tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:35.927591 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-75715248-0b3e-4771-afe4-a1700be7e56a tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:20:35.993317 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2ce3fbe6-ca15-439f-9bb5-7032c9c51752 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:35.994225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2ce3fbe6-ca15-439f-9bb5-7032c9c51752 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:36.028633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ce3fbe6-ca15-439f-9bb5-7032c9c51752 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:36.029439 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ce3fbe6-ca15-439f-9bb5-7032c9c51752 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:36.055147 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ce3fbe6-ca15-439f-9bb5-7032c9c51752 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:36.060307 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ce3fbe6-ca15-439f-9bb5-7032c9c51752 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:36.145705 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-75715248-0b3e-4771-afe4-a1700be7e56a tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 204 len: 0 microversion: 2.1 time: 0.309071 Jul 31 01:20:36.146949 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1418/2851] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:20:35 2022] DELETE /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:20:36.161398 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-66c634de-4e37-41f0-89ab-584effd9adcf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:36.164499 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-66c634de-4e37-41f0-89ab-584effd9adcf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:36.175788 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66c634de-4e37-41f0-89ab-584effd9adcf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:36.176590 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66c634de-4e37-41f0-89ab-584effd9adcf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:36.177806 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66c634de-4e37-41f0-89ab-584effd9adcf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:36.178967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66c634de-4e37-41f0-89ab-584effd9adcf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:36.835601 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:37.162374 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2ce3fbe6-ca15-439f-9bb5-7032c9c51752 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:37.172145 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2ce3fbe6-ca15-439f-9bb5-7032c9c51752 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1371 microversion: 2.1 time: 1.182739 Jul 31 01:20:37.177124 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1434/2852] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:35 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1371 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:37.186093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-08e69376-3bff-49cc-8309-1b2d4387833a req-bb9c8c76-486f-4eb0-b344-b4649388ff54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc96be05-825f-41e5-83f0-09fdc15ed529", "tag": "5717f3f9-5b67-4c5a-a4cb-5e728071b0a5"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:37.192764 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-66c634de-4e37-41f0-89ab-584effd9adcf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:37.215811 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-66c634de-4e37-41f0-89ab-584effd9adcf tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1470 microversion: 2.1 time: 1.058686 Jul 31 01:20:37.220617 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1419/2853] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:36 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1470 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:37.224676 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-08e69376-3bff-49cc-8309-1b2d4387833a req-bb9c8c76-486f-4eb0-b344-b4649388ff54 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:37.225058 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-08e69376-3bff-49cc-8309-1b2d4387833a req-bb9c8c76-486f-4eb0-b344-b4649388ff54 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:37.248165 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c239df3e-fcac-4063-8dcd-8e3416622929 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:37.256311 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c239df3e-fcac-4063-8dcd-8e3416622929 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:37.284814 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-08e69376-3bff-49cc-8309-1b2d4387833a req-bb9c8c76-486f-4eb0-b344-b4649388ff54 service nova] Creating event network-changed:5717f3f9-5b67-4c5a-a4cb-5e728071b0a5 for instance dc96be05-825f-41e5-83f0-09fdc15ed529 on n-h2-master-1 Jul 31 01:20:37.300660 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c239df3e-fcac-4063-8dcd-8e3416622929 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:37.305617 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c239df3e-fcac-4063-8dcd-8e3416622929 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:37.314347 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c239df3e-fcac-4063-8dcd-8e3416622929 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:37.315325 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c239df3e-fcac-4063-8dcd-8e3416622929 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:37.316650 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-08e69376-3bff-49cc-8309-1b2d4387833a req-bb9c8c76-486f-4eb0-b344-b4649388ff54 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136314 Jul 31 01:20:37.317617 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1435/2854] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:37.328904 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-687735ee-554d-400e-b148-28dc05264b79 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:37.337163 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-687735ee-554d-400e-b148-28dc05264b79 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:37.379830 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-687735ee-554d-400e-b148-28dc05264b79 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:37.381438 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-687735ee-554d-400e-b148-28dc05264b79 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:37.385442 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-687735ee-554d-400e-b148-28dc05264b79 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:37.387984 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-687735ee-554d-400e-b148-28dc05264b79 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:37.956358 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c239df3e-fcac-4063-8dcd-8e3416622929 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8472c850b5f4254b04d6fc49401cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7743dce0f4d989a5fe94cf332a4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:37.970428 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c239df3e-fcac-4063-8dcd-8e3416622929 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 200 len: 1317 microversion: 2.1 time: 0.747960 Jul 31 01:20:37.971177 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1420/2855] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:37 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 1317 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:37.980721 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-d34a4513-0351-4210-ad09-eed1c160930b req-ada84184-72d8-4dd8-ab99-b2a73fe0dc48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae5b84e-919e-4ad7-8348-9d4326695306", "tag": "e639f0c2-df6c-4867-a6d5-a8e4da2fee54"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:38.005792 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d34a4513-0351-4210-ad09-eed1c160930b req-ada84184-72d8-4dd8-ab99-b2a73fe0dc48 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:38.006243 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d34a4513-0351-4210-ad09-eed1c160930b req-ada84184-72d8-4dd8-ab99-b2a73fe0dc48 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:38.034543 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-d34a4513-0351-4210-ad09-eed1c160930b req-ada84184-72d8-4dd8-ab99-b2a73fe0dc48 service nova] Creating event network-changed:e639f0c2-df6c-4867-a6d5-a8e4da2fee54 for instance 3ae5b84e-919e-4ad7-8348-9d4326695306 on n-h2-master-1 Jul 31 01:20:38.040909 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-d34a4513-0351-4210-ad09-eed1c160930b req-ada84184-72d8-4dd8-ab99-b2a73fe0dc48 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068261 Jul 31 01:20:38.042039 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1421/2856] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:38.195859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bad7ba18-e346-4ead-a8d5-810e60db3473 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:38.196910 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bad7ba18-e346-4ead-a8d5-810e60db3473 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:38.212794 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bad7ba18-e346-4ead-a8d5-810e60db3473 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:38.213264 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bad7ba18-e346-4ead-a8d5-810e60db3473 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:38.214204 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bad7ba18-e346-4ead-a8d5-810e60db3473 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:38.214652 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bad7ba18-e346-4ead-a8d5-810e60db3473 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:38.241324 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:38.296588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-687735ee-554d-400e-b148-28dc05264b79 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:38.307324 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-687735ee-554d-400e-b148-28dc05264b79 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1318 microversion: 2.1 time: 0.988318 Jul 31 01:20:38.308688 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1436/2857] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:37 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1318 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:38.327254 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5092525c-876f-46eb-90a6-b8f4f4666674 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:38.328072 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5092525c-876f-46eb-90a6-b8f4f4666674 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:38.361401 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5092525c-876f-46eb-90a6-b8f4f4666674 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:38.368204 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5092525c-876f-46eb-90a6-b8f4f4666674 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:38.376899 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5092525c-876f-46eb-90a6-b8f4f4666674 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:38.377709 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5092525c-876f-46eb-90a6-b8f4f4666674 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:38.672587 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:38.757554 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:38.992312 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bad7ba18-e346-4ead-a8d5-810e60db3473 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:39.025996 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bad7ba18-e346-4ead-a8d5-810e60db3473 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1557 microversion: 2.1 time: 0.835394 Jul 31 01:20:39.039471 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1422/2858] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:38 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1557 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:39.039471 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c11de7a4-df0c-4762-a1e7-82abf0bcc735 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:39.039471 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c11de7a4-df0c-4762-a1e7-82abf0bcc735 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:39.050816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c11de7a4-df0c-4762-a1e7-82abf0bcc735 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:39.051278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c11de7a4-df0c-4762-a1e7-82abf0bcc735 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:39.052172 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c11de7a4-df0c-4762-a1e7-82abf0bcc735 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:39.052612 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c11de7a4-df0c-4762-a1e7-82abf0bcc735 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:39.280160 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:39.637452 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5092525c-876f-46eb-90a6-b8f4f4666674 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:39.647568 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5092525c-876f-46eb-90a6-b8f4f4666674 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1470 microversion: 2.1 time: 1.333013 Jul 31 01:20:39.667440 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1437/2859] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:38 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1470 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:39.674401 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0f7d19aa-2d32-4ee5-a1d7-8986b4a80064 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:39.681624 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0f7d19aa-2d32-4ee5-a1d7-8986b4a80064 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:39.692914 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f7d19aa-2d32-4ee5-a1d7-8986b4a80064 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:39.698317 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f7d19aa-2d32-4ee5-a1d7-8986b4a80064 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:39.699611 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f7d19aa-2d32-4ee5-a1d7-8986b4a80064 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:39.700295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f7d19aa-2d32-4ee5-a1d7-8986b4a80064 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:40.073022 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0f7d19aa-2d32-4ee5-a1d7-8986b4a80064 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.403694 Jul 31 01:20:40.074094 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1438/2860] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:20:39 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37/os-interface => generated 285 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:40.079617 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c77f9861-c741-4b17-80b9-a0dc7e0e5dbf tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:40.080407 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c77f9861-c741-4b17-80b9-a0dc7e0e5dbf tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:40.100879 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c77f9861-c741-4b17-80b9-a0dc7e0e5dbf tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:40.101748 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c77f9861-c741-4b17-80b9-a0dc7e0e5dbf tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:40.102816 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c77f9861-c741-4b17-80b9-a0dc7e0e5dbf tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:40.103539 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c77f9861-c741-4b17-80b9-a0dc7e0e5dbf tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:40.121793 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c11de7a4-df0c-4762-a1e7-82abf0bcc735 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8472c850b5f4254b04d6fc49401cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7743dce0f4d989a5fe94cf332a4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:40.139393 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c11de7a4-df0c-4762-a1e7-82abf0bcc735 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 200 len: 1317 microversion: 2.1 time: 1.110091 Jul 31 01:20:40.143052 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1423/2861] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:39 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 1317 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:40.150543 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-2f6809e5-5721-4e83-8484-732c813da699 req-052a0e72-3115-44a4-86c8-83bb8e98bef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f931f935-17a4-41ac-ac71-4ee21771219d", "name": "network-vif-deleted", "tag": "5ecc4d11-f7de-41b8-bd4a-7e73d5c197fb"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:40.181672 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2f6809e5-5721-4e83-8484-732c813da699 req-052a0e72-3115-44a4-86c8-83bb8e98bef8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:40.183060 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2f6809e5-5721-4e83-8484-732c813da699 req-052a0e72-3115-44a4-86c8-83bb8e98bef8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:40.200811 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-2f6809e5-5721-4e83-8484-732c813da699 req-052a0e72-3115-44a4-86c8-83bb8e98bef8 service nova] Creating event network-vif-deleted:5ecc4d11-f7de-41b8-bd4a-7e73d5c197fb for instance f931f935-17a4-41ac-ac71-4ee21771219d on n-h2-master-1 Jul 31 01:20:40.207507 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-2f6809e5-5721-4e83-8484-732c813da699 req-052a0e72-3115-44a4-86c8-83bb8e98bef8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062603 Jul 31 01:20:40.208828 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1424/2862] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:40.677370 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5f8f5074-c0cc-47c1-a6a4-d8ad6ea06ce9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:40.678634 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5f8f5074-c0cc-47c1-a6a4-d8ad6ea06ce9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:40.713734 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f8f5074-c0cc-47c1-a6a4-d8ad6ea06ce9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:40.725805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f8f5074-c0cc-47c1-a6a4-d8ad6ea06ce9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:40.736240 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f8f5074-c0cc-47c1-a6a4-d8ad6ea06ce9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:40.747512 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f8f5074-c0cc-47c1-a6a4-d8ad6ea06ce9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:40.808787 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c77f9861-c741-4b17-80b9-a0dc7e0e5dbf tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:40.843669 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c77f9861-c741-4b17-80b9-a0dc7e0e5dbf tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1318 microversion: 2.1 time: 0.765728 Jul 31 01:20:40.847930 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f8f5074-c0cc-47c1-a6a4-d8ad6ea06ce9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:40.848623 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f8f5074-c0cc-47c1-a6a4-d8ad6ea06ce9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:40.849240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-5f8f5074-c0cc-47c1-a6a4-d8ad6ea06ce9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lazy-loading 'fault' on Instance uuid f931f935-17a4-41ac-ac71-4ee21771219d {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:20:40.860050 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1439/2863] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:40 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1318 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:40.963474 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5f8f5074-c0cc-47c1-a6a4-d8ad6ea06ce9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157eca4624c444bb8b88bdb958dd8dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c36901e18a4507ae8a90557eb9abc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:40.988162 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5f8f5074-c0cc-47c1-a6a4-d8ad6ea06ce9 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 200 len: 1304 microversion: 2.1 time: 0.312670 Jul 31 01:20:40.989126 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1425/2864] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:40 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 1304 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:20:41.166939 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-732cbb30-f029-4f5f-b8cb-7b074addc7c1 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:41.167915 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-732cbb30-f029-4f5f-b8cb-7b074addc7c1 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:41.197914 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-732cbb30-f029-4f5f-b8cb-7b074addc7c1 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:41.197914 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-732cbb30-f029-4f5f-b8cb-7b074addc7c1 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:41.200965 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-732cbb30-f029-4f5f-b8cb-7b074addc7c1 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:41.204958 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-732cbb30-f029-4f5f-b8cb-7b074addc7c1 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:41.642909 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-732cbb30-f029-4f5f-b8cb-7b074addc7c1 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8472c850b5f4254b04d6fc49401cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7743dce0f4d989a5fe94cf332a4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:41.672772 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-732cbb30-f029-4f5f-b8cb-7b074addc7c1 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 200 len: 1317 microversion: 2.1 time: 0.512582 Jul 31 01:20:41.673667 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1440/2865] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:41 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:41.865318 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d211a1f4-762f-45af-a06f-34aa3f4b026e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:41.867513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d211a1f4-762f-45af-a06f-34aa3f4b026e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:41.892702 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d211a1f4-762f-45af-a06f-34aa3f4b026e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:41.893957 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d211a1f4-762f-45af-a06f-34aa3f4b026e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:41.896070 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d211a1f4-762f-45af-a06f-34aa3f4b026e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:41.900124 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d211a1f4-762f-45af-a06f-34aa3f4b026e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:42.009762 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2e2cb5e8-f519-4e23-9c67-936dce976503 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:42.010776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2e2cb5e8-f519-4e23-9c67-936dce976503 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] [instance: f931f935-17a4-41ac-ac71-4ee21771219d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:42.022731 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e2cb5e8-f519-4e23-9c67-936dce976503 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:42.023597 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e2cb5e8-f519-4e23-9c67-936dce976503 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:42.027383 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e2cb5e8-f519-4e23-9c67-936dce976503 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:42.028310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e2cb5e8-f519-4e23-9c67-936dce976503 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:42.069514 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-2e2cb5e8-f519-4e23-9c67-936dce976503 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] HTTP exception thrown: Instance f931f935-17a4-41ac-ac71-4ee21771219d could not be found. Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2e2cb5e8-f519-4e23-9c67-936dce976503 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Request method failure captured: Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d HTTP/1.1 Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dguPNepptukr8H-ji6fsrHXxlejjxXer1JyubCqhAhkoiBpNguA0R_E3XoPxWV4q0PuRAzi2jU_vz2uJXvXClFImKpp5rfGz0RYEwvL-5qPKuxEHNLfvn32JzJRx33-AmS2jzMNT_SkXTAKqpE_zVST5WzuvTnSe8eLsc89apZZsQc Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 43c36901e18a4507ae8a90557eb9abc9 Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersAdminTestJSON-1847417388 Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/43c36901e18a4507ae8a90557eb9abc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/43c36901e18a4507ae8a90557eb9abc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/43c36901e18a4507ae8a90557eb9abc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_43c36901e18a4507ae8a90557eb9abc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersAdminTestJSON-1847417388 Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 43c36901e18a4507ae8a90557eb9abc9 Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersAdminTestJSON-1847417388 Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersAdminTestJSON-1847417388-project Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 4157eca4624c444bb8b88bdb958dd8dc Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersAdminTestJSON-1847417388-project Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: exception: Instance f931f935-17a4-41ac-ac71-4ee21771219d could not be found. Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'f931f935-17a4-41ac-ac71-4ee21771219d'} Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f931f935-17a4-41ac-ac71-4ee21771219d could not be found. Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f931f935-17a4-41ac-ac71-4ee21771219d could not be found. Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:20:42.071874 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:42.076033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:42.076033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:20:42.076033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:20:42.076033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:20:42.076033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:20:42.076033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f931f935-17a4-41ac-ac71-4ee21771219d could not be found. Jul 31 01:20:42.076033 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:42.080023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2e2cb5e8-f519-4e23-9c67-936dce976503 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] Returning 404 to user: Instance f931f935-17a4-41ac-ac71-4ee21771219d could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:20:42.083221 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2e2cb5e8-f519-4e23-9c67-936dce976503 tempest-ServersAdminTestJSON-1847417388 tempest-ServersAdminTestJSON-1847417388-project] 10.222.0.45 "GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d" status: 404 len: 111 microversion: 2.1 time: 0.075635 Jul 31 01:20:42.090006 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1441/2866] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:42 2022] GET /compute/v2.1/servers/f931f935-17a4-41ac-ac71-4ee21771219d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:20:42.466616 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d211a1f4-762f-45af-a06f-34aa3f4b026e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:42.476190 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d211a1f4-762f-45af-a06f-34aa3f4b026e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1318 microversion: 2.1 time: 0.614818 Jul 31 01:20:42.477036 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1426/2867] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:41 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1318 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:42.702295 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed012a5f-1cf1-4e1a-b59b-0b753db0aef3 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:42.703266 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ed012a5f-1cf1-4e1a-b59b-0b753db0aef3 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:42.710289 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed012a5f-1cf1-4e1a-b59b-0b753db0aef3 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:42.711390 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed012a5f-1cf1-4e1a-b59b-0b753db0aef3 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:42.712367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed012a5f-1cf1-4e1a-b59b-0b753db0aef3 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:42.712983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed012a5f-1cf1-4e1a-b59b-0b753db0aef3 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:43.503972 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4fb719c5-ec01-4953-8028-975d3231b17c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:43.504617 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4fb719c5-ec01-4953-8028-975d3231b17c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:43.530373 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4fb719c5-ec01-4953-8028-975d3231b17c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:43.532403 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4fb719c5-ec01-4953-8028-975d3231b17c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:43.534149 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4fb719c5-ec01-4953-8028-975d3231b17c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:43.536360 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4fb719c5-ec01-4953-8028-975d3231b17c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:43.847937 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ed012a5f-1cf1-4e1a-b59b-0b753db0aef3 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8472c850b5f4254b04d6fc49401cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7743dce0f4d989a5fe94cf332a4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:43.864264 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ed012a5f-1cf1-4e1a-b59b-0b753db0aef3 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 200 len: 1317 microversion: 2.1 time: 1.165816 Jul 31 01:20:43.875586 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1442/2868] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:42 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 1317 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:44.064570 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4fb719c5-ec01-4953-8028-975d3231b17c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:44.079158 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4fb719c5-ec01-4953-8028-975d3231b17c tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1318 microversion: 2.1 time: 0.584090 Jul 31 01:20:44.084603 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1427/2869] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:43 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1318 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:44.901012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-27149e1b-b02c-4ffa-bd39-b163e0d675b0 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:44.902418 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-27149e1b-b02c-4ffa-bd39-b163e0d675b0 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:44.911752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27149e1b-b02c-4ffa-bd39-b163e0d675b0 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:44.912580 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27149e1b-b02c-4ffa-bd39-b163e0d675b0 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:44.913652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27149e1b-b02c-4ffa-bd39-b163e0d675b0 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:44.914373 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27149e1b-b02c-4ffa-bd39-b163e0d675b0 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:45.108412 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-856dbb8c-f9d2-42ba-ba40-1404132ec883 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:45.109155 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-856dbb8c-f9d2-42ba-ba40-1404132ec883 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:45.120807 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-856dbb8c-f9d2-42ba-ba40-1404132ec883 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:45.121264 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-856dbb8c-f9d2-42ba-ba40-1404132ec883 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:45.124621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-856dbb8c-f9d2-42ba-ba40-1404132ec883 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:45.127486 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-856dbb8c-f9d2-42ba-ba40-1404132ec883 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:45.512686 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-27149e1b-b02c-4ffa-bd39-b163e0d675b0 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8472c850b5f4254b04d6fc49401cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7743dce0f4d989a5fe94cf332a4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:45.528128 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-27149e1b-b02c-4ffa-bd39-b163e0d675b0 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 200 len: 1317 microversion: 2.1 time: 0.633730 Jul 31 01:20:45.530013 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1443/2870] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:44 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 1317 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:45.542280 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-43b3478e-5530-499d-a3f7-7b250771ffbe req-23f12c23-93ec-4dd8-88c2-e785977c7879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f6be904-5471-4ad5-bd1d-dc6802808c37", "tag": "62897edb-69e4-46f0-8193-e27cfe7ff775"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:45.574927 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-43b3478e-5530-499d-a3f7-7b250771ffbe req-23f12c23-93ec-4dd8-88c2-e785977c7879 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:45.575739 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-43b3478e-5530-499d-a3f7-7b250771ffbe req-23f12c23-93ec-4dd8-88c2-e785977c7879 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:45.620002 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-43b3478e-5530-499d-a3f7-7b250771ffbe req-23f12c23-93ec-4dd8-88c2-e785977c7879 service nova] Creating event network-changed:62897edb-69e4-46f0-8193-e27cfe7ff775 for instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 on n-h1-master-1 Jul 31 01:20:45.635547 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-43b3478e-5530-499d-a3f7-7b250771ffbe req-23f12c23-93ec-4dd8-88c2-e785977c7879 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103879 Jul 31 01:20:45.638615 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1444/2871] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:46.327416 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-856dbb8c-f9d2-42ba-ba40-1404132ec883 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:46.341052 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-856dbb8c-f9d2-42ba-ba40-1404132ec883 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1318 microversion: 2.1 time: 1.238743 Jul 31 01:20:46.358026 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1428/2872] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:45 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1318 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:46.551380 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-049f0dff-58b0-4133-a353-8dd1881b0c8b tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:46.552246 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-049f0dff-58b0-4133-a353-8dd1881b0c8b tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:46.582870 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-049f0dff-58b0-4133-a353-8dd1881b0c8b tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:46.585641 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-049f0dff-58b0-4133-a353-8dd1881b0c8b tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:46.587983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-049f0dff-58b0-4133-a353-8dd1881b0c8b tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:46.591106 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-049f0dff-58b0-4133-a353-8dd1881b0c8b tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:47.300375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-049f0dff-58b0-4133-a353-8dd1881b0c8b tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8472c850b5f4254b04d6fc49401cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7743dce0f4d989a5fe94cf332a4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:47.317860 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-049f0dff-58b0-4133-a353-8dd1881b0c8b tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 200 len: 1317 microversion: 2.1 time: 0.770301 Jul 31 01:20:47.320420 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1445/2873] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:46 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 1317 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:47.369630 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b205b719-649d-490c-a912-b390a5d24310 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:47.370744 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b205b719-649d-490c-a912-b390a5d24310 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:47.390492 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b205b719-649d-490c-a912-b390a5d24310 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:47.396786 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b205b719-649d-490c-a912-b390a5d24310 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:47.405084 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b205b719-649d-490c-a912-b390a5d24310 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:47.408252 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b205b719-649d-490c-a912-b390a5d24310 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:47.826212 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b205b719-649d-490c-a912-b390a5d24310 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:47.849432 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b205b719-649d-490c-a912-b390a5d24310 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1318 microversion: 2.1 time: 0.480496 Jul 31 01:20:47.853197 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1429/2874] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:47 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:48.347679 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-be22b67c-adca-4885-9fd5-fd156db75473 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:48.348420 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-be22b67c-adca-4885-9fd5-fd156db75473 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:48.381398 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be22b67c-adca-4885-9fd5-fd156db75473 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:48.386320 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be22b67c-adca-4885-9fd5-fd156db75473 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:48.389423 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be22b67c-adca-4885-9fd5-fd156db75473 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:48.392156 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be22b67c-adca-4885-9fd5-fd156db75473 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:48.496507 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb4afbc5-aa1f-4972-b0ef-6016a44f6c16 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:48.508556 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:20:48.508556 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:20:48.517387 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb4afbc5-aa1f-4972-b0ef-6016a44f6c16 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:48.517847 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb4afbc5-aa1f-4972-b0ef-6016a44f6c16 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:48.529668 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb4afbc5-aa1f-4972-b0ef-6016a44f6c16 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:48.530566 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb4afbc5-aa1f-4972-b0ef-6016a44f6c16 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:48.648904 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fb4afbc5-aa1f-4972-b0ef-6016a44f6c16 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.421958 Jul 31 01:20:48.662930 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1446/2875] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:20:48 2022] GET /compute/v2.1/os-services => generated 944 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:48.669944 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-38ee1911-6a71-49f1-b403-384d5fde0b10 req-45aca5ac-eec5-42af-a0f6-a4c21737c21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc96be05-825f-41e5-83f0-09fdc15ed529", "name": "network-vif-plugged", "status": "completed", "tag": "5717f3f9-5b67-4c5a-a4cb-5e728071b0a5"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:48.691412 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-38ee1911-6a71-49f1-b403-384d5fde0b10 req-45aca5ac-eec5-42af-a0f6-a4c21737c21b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:48.692154 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-38ee1911-6a71-49f1-b403-384d5fde0b10 req-45aca5ac-eec5-42af-a0f6-a4c21737c21b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:48.716330 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-38ee1911-6a71-49f1-b403-384d5fde0b10 req-45aca5ac-eec5-42af-a0f6-a4c21737c21b service nova] Creating event network-vif-plugged:5717f3f9-5b67-4c5a-a4cb-5e728071b0a5 for instance dc96be05-825f-41e5-83f0-09fdc15ed529 on n-h2-master-1 Jul 31 01:20:48.725383 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-38ee1911-6a71-49f1-b403-384d5fde0b10 req-45aca5ac-eec5-42af-a0f6-a4c21737c21b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060903 Jul 31 01:20:48.727260 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1447/2876] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:48.732664 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-567f2730-1f2e-48f8-aaee-e8810996ee56 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:48.736535 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:20:48.736535 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:20:48.738287 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-567f2730-1f2e-48f8-aaee-e8810996ee56 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:48.738940 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-567f2730-1f2e-48f8-aaee-e8810996ee56 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:48.739968 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-567f2730-1f2e-48f8-aaee-e8810996ee56 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:48.740601 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-567f2730-1f2e-48f8-aaee-e8810996ee56 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:48.779225 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-567f2730-1f2e-48f8-aaee-e8810996ee56 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?host=n-d-master-1" status: 200 len: 578 microversion: 2.1 time: 0.050457 Jul 31 01:20:48.780370 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1448/2877] 10.222.0.45 () {58 vars in 1172 bytes} [Sun Jul 31 01:20:48 2022] GET /compute/v2.1/os-services?host=n-d-master-1 => generated 578 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:48.793160 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5f76a6c9-c0e3-4fd8-b50c-56164fbd8a63 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:48.802457 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:20:48.802457 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:20:48.808126 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5f76a6c9-c0e3-4fd8-b50c-56164fbd8a63 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:48.811718 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5f76a6c9-c0e3-4fd8-b50c-56164fbd8a63 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:48.812828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5f76a6c9-c0e3-4fd8-b50c-56164fbd8a63 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:48.813352 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5f76a6c9-c0e3-4fd8-b50c-56164fbd8a63 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:48.844178 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:48.876604 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5f76a6c9-c0e3-4fd8-b50c-56164fbd8a63 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.087291 Jul 31 01:20:48.884979 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1449/2878] 10.222.0.45 () {58 vars in 1176 bytes} [Sun Jul 31 01:20:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:48.893729 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-22a71d9f-c936-4625-b2e6-cc4e6fcc7363 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:48.894759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-22a71d9f-c936-4625-b2e6-cc4e6fcc7363 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:48.901786 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22a71d9f-c936-4625-b2e6-cc4e6fcc7363 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:48.902762 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22a71d9f-c936-4625-b2e6-cc4e6fcc7363 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:48.903843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22a71d9f-c936-4625-b2e6-cc4e6fcc7363 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:48.904526 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22a71d9f-c936-4625-b2e6-cc4e6fcc7363 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:49.127840 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-be22b67c-adca-4885-9fd5-fd156db75473 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8472c850b5f4254b04d6fc49401cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7743dce0f4d989a5fe94cf332a4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:49.144999 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-be22b67c-adca-4885-9fd5-fd156db75473 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 200 len: 1317 microversion: 2.1 time: 0.806081 Jul 31 01:20:49.147502 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1430/2879] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:48 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 1317 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:49.161304 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e8fd278b-ad78-430a-9881-80539b61a723 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:49.167574 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:20:49.167574 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:20:49.173639 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8fd278b-ad78-430a-9881-80539b61a723 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:49.176541 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8fd278b-ad78-430a-9881-80539b61a723 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:49.179145 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8fd278b-ad78-430a-9881-80539b61a723 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:49.180906 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8fd278b-ad78-430a-9881-80539b61a723 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:49.251039 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e8fd278b-ad78-430a-9881-80539b61a723 tempest-ServicesAdminTestJSON-863759585 tempest-ServicesAdminTestJSON-863759585-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.096863 Jul 31 01:20:49.271969 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1431/2880] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:20:49 2022] GET /compute/v2.1/os-services => generated 944 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:49.280399 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-22a71d9f-c936-4625-b2e6-cc4e6fcc7363 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:49.295620 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-22a71d9f-c936-4625-b2e6-cc4e6fcc7363 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1318 microversion: 2.1 time: 0.405366 Jul 31 01:20:49.297942 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1450/2881] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:48 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:50.174127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e3134cd9-eeee-4403-96b3-531e7f75f487 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:50.176029 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e3134cd9-eeee-4403-96b3-531e7f75f487 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:50.200881 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3134cd9-eeee-4403-96b3-531e7f75f487 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:50.202006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3134cd9-eeee-4403-96b3-531e7f75f487 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:50.209243 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3134cd9-eeee-4403-96b3-531e7f75f487 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:50.210741 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3134cd9-eeee-4403-96b3-531e7f75f487 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:50.324014 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cda63674-18f3-42b2-bc0b-5c26850fafe1 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:50.324653 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cda63674-18f3-42b2-bc0b-5c26850fafe1 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:50.359388 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cda63674-18f3-42b2-bc0b-5c26850fafe1 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:50.383606 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cda63674-18f3-42b2-bc0b-5c26850fafe1 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:50.390037 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cda63674-18f3-42b2-bc0b-5c26850fafe1 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:50.390037 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cda63674-18f3-42b2-bc0b-5c26850fafe1 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:50.547594 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e3134cd9-eeee-4403-96b3-531e7f75f487 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8472c850b5f4254b04d6fc49401cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7743dce0f4d989a5fe94cf332a4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:50.563948 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e3134cd9-eeee-4403-96b3-531e7f75f487 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 200 len: 1317 microversion: 2.1 time: 0.394558 Jul 31 01:20:50.565673 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1432/2882] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:50 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:50.773951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cda63674-18f3-42b2-bc0b-5c26850fafe1 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:50.782289 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cda63674-18f3-42b2-bc0b-5c26850fafe1 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1318 microversion: 2.1 time: 0.464010 Jul 31 01:20:50.795720 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1451/2883] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:50 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:20:50.810054 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-42008ce5-67ca-497a-a58d-b7176515264d req-9c8e8bcb-df2e-445d-a18c-044b61c1e156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae5b84e-919e-4ad7-8348-9d4326695306", "name": "network-vif-plugged", "status": "completed", "tag": "e639f0c2-df6c-4867-a6d5-a8e4da2fee54"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:50.835922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-42008ce5-67ca-497a-a58d-b7176515264d req-9c8e8bcb-df2e-445d-a18c-044b61c1e156 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:50.837127 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-42008ce5-67ca-497a-a58d-b7176515264d req-9c8e8bcb-df2e-445d-a18c-044b61c1e156 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:50.851276 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-42008ce5-67ca-497a-a58d-b7176515264d req-9c8e8bcb-df2e-445d-a18c-044b61c1e156 service nova] Creating event network-vif-plugged:e639f0c2-df6c-4867-a6d5-a8e4da2fee54 for instance 3ae5b84e-919e-4ad7-8348-9d4326695306 on n-h2-master-1 Jul 31 01:20:50.858327 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-42008ce5-67ca-497a-a58d-b7176515264d req-9c8e8bcb-df2e-445d-a18c-044b61c1e156 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051309 Jul 31 01:20:50.860225 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1433/2884] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:51.585024 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5674996f-2681-4774-8114-6d608b22b883 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:51.586616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5674996f-2681-4774-8114-6d608b22b883 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:51.604098 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5674996f-2681-4774-8114-6d608b22b883 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:51.604790 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5674996f-2681-4774-8114-6d608b22b883 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:51.605702 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5674996f-2681-4774-8114-6d608b22b883 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:51.606250 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5674996f-2681-4774-8114-6d608b22b883 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:51.810728 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63f30e06-bf06-48aa-8f65-a56a105f67b7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:51.811705 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-63f30e06-bf06-48aa-8f65-a56a105f67b7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:51.831775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63f30e06-bf06-48aa-8f65-a56a105f67b7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:51.832245 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63f30e06-bf06-48aa-8f65-a56a105f67b7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:51.833049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63f30e06-bf06-48aa-8f65-a56a105f67b7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:51.833498 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63f30e06-bf06-48aa-8f65-a56a105f67b7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:51.987792 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5674996f-2681-4774-8114-6d608b22b883 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8472c850b5f4254b04d6fc49401cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7743dce0f4d989a5fe94cf332a4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:52.004261 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5674996f-2681-4774-8114-6d608b22b883 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 200 len: 1505 microversion: 2.1 time: 0.422994 Jul 31 01:20:52.006035 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1452/2885] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:51 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 1505 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:52.031522 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f8945f6b-80d1-4537-a0a7-1e5622047591 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:52.032217 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f8945f6b-80d1-4537-a0a7-1e5622047591 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:52.058743 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8945f6b-80d1-4537-a0a7-1e5622047591 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:52.060676 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8945f6b-80d1-4537-a0a7-1e5622047591 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:52.063314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8945f6b-80d1-4537-a0a7-1e5622047591 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:52.065492 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8945f6b-80d1-4537-a0a7-1e5622047591 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:52.142362 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f8945f6b-80d1-4537-a0a7-1e5622047591 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529/ips" status: 200 len: 108 microversion: 2.1 time: 0.116859 Jul 31 01:20:52.155025 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1453/2886] 10.222.0.45 () {58 vars in 1248 bytes} [Sun Jul 31 01:20:52 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529/ips => generated 108 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:52.167225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-988db603-5537-423d-9cd4-6ec95b64f5db tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:52.168953 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-988db603-5537-423d-9cd4-6ec95b64f5db tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:52.177244 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-988db603-5537-423d-9cd4-6ec95b64f5db tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:52.178108 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-988db603-5537-423d-9cd4-6ec95b64f5db tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:52.179175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-988db603-5537-423d-9cd4-6ec95b64f5db tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:52.179871 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-988db603-5537-423d-9cd4-6ec95b64f5db tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:52.220957 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-988db603-5537-423d-9cd4-6ec95b64f5db tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529/ips" status: 200 len: 108 microversion: 2.1 time: 0.063576 Jul 31 01:20:52.222013 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1454/2887] 10.222.0.45 () {58 vars in 1248 bytes} [Sun Jul 31 01:20:52 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529/ips => generated 108 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:52.253292 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e617b25-232a-4b93-a7f9-d350868cfb00 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:52.254300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1e617b25-232a-4b93-a7f9-d350868cfb00 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:52.284181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e617b25-232a-4b93-a7f9-d350868cfb00 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:52.285019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e617b25-232a-4b93-a7f9-d350868cfb00 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:52.286462 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e617b25-232a-4b93-a7f9-d350868cfb00 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:52.288884 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e617b25-232a-4b93-a7f9-d350868cfb00 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:52.351135 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1e617b25-232a-4b93-a7f9-d350868cfb00 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529/ips/tempest-ServerAddressesTestJSON-187813450-network" status: 200 len: 93 microversion: 2.1 time: 0.109675 Jul 31 01:20:52.365496 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1455/2888] 10.222.0.45 () {58 vars in 1398 bytes} [Sun Jul 31 01:20:52 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529/ips/tempest-ServerAddressesTestJSON-187813450-network => generated 93 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:20:52.372127 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e8958d13-5fd9-448c-8a80-5833fda89d81 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:52.377237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e8958d13-5fd9-448c-8a80-5833fda89d81 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:52.401918 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8958d13-5fd9-448c-8a80-5833fda89d81 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:52.404912 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8958d13-5fd9-448c-8a80-5833fda89d81 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:52.409307 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8958d13-5fd9-448c-8a80-5833fda89d81 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:52.410226 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8958d13-5fd9-448c-8a80-5833fda89d81 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:52.495960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e8958d13-5fd9-448c-8a80-5833fda89d81 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:20:52.754325 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e8958d13-5fd9-448c-8a80-5833fda89d81 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "DELETE /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 204 len: 0 microversion: 2.1 time: 0.387029 Jul 31 01:20:52.758632 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1456/2889] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:20:52 2022] DELETE /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:20:52.773006 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9d4f824f-7572-4537-b9c4-0ba742ab83f2 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:52.773740 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9d4f824f-7572-4537-b9c4-0ba742ab83f2 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:52.794089 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d4f824f-7572-4537-b9c4-0ba742ab83f2 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:52.794613 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d4f824f-7572-4537-b9c4-0ba742ab83f2 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:52.795754 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d4f824f-7572-4537-b9c4-0ba742ab83f2 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:52.796059 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d4f824f-7572-4537-b9c4-0ba742ab83f2 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:52.855117 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-63f30e06-bf06-48aa-8f65-a56a105f67b7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:52.869558 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-63f30e06-bf06-48aa-8f65-a56a105f67b7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1318 microversion: 2.1 time: 1.062809 Jul 31 01:20:52.870353 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1434/2890] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:51 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1318 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:53.025723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9d4f824f-7572-4537-b9c4-0ba742ab83f2 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8472c850b5f4254b04d6fc49401cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7743dce0f4d989a5fe94cf332a4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:53.038921 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9d4f824f-7572-4537-b9c4-0ba742ab83f2 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 200 len: 1511 microversion: 2.1 time: 0.278889 Jul 31 01:20:53.039552 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1457/2891] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:52 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 1511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:53.894278 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b6e03c7b-ba4c-4468-aca7-49a3f8582c2a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:53.894278 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b6e03c7b-ba4c-4468-aca7-49a3f8582c2a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:53.903330 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6e03c7b-ba4c-4468-aca7-49a3f8582c2a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:53.904837 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6e03c7b-ba4c-4468-aca7-49a3f8582c2a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:53.907286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6e03c7b-ba4c-4468-aca7-49a3f8582c2a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:53.910036 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6e03c7b-ba4c-4468-aca7-49a3f8582c2a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:54.066953 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9c4944fe-42cc-4f52-8a35-a2c302ec4e91 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:54.069366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9c4944fe-42cc-4f52-8a35-a2c302ec4e91 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:54.090327 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c4944fe-42cc-4f52-8a35-a2c302ec4e91 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:54.091051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c4944fe-42cc-4f52-8a35-a2c302ec4e91 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:54.092345 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c4944fe-42cc-4f52-8a35-a2c302ec4e91 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:54.099240 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c4944fe-42cc-4f52-8a35-a2c302ec4e91 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:54.190547 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b6e03c7b-ba4c-4468-aca7-49a3f8582c2a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:54.206591 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b6e03c7b-ba4c-4468-aca7-49a3f8582c2a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1508 microversion: 2.1 time: 0.319225 Jul 31 01:20:54.231039 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1435/2892] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:53 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1508 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:54.256404 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0a2b5a22-f6c8-4a2e-a4c2-6d5281cde928 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:54.258130 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0a2b5a22-f6c8-4a2e-a4c2-6d5281cde928 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:54.277193 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a2b5a22-f6c8-4a2e-a4c2-6d5281cde928 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:54.280064 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a2b5a22-f6c8-4a2e-a4c2-6d5281cde928 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:54.288883 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a2b5a22-f6c8-4a2e-a4c2-6d5281cde928 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:54.289377 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a2b5a22-f6c8-4a2e-a4c2-6d5281cde928 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:54.706843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9c4944fe-42cc-4f52-8a35-a2c302ec4e91 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8472c850b5f4254b04d6fc49401cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7743dce0f4d989a5fe94cf332a4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:54.718687 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9c4944fe-42cc-4f52-8a35-a2c302ec4e91 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 200 len: 1511 microversion: 2.1 time: 0.654484 Jul 31 01:20:54.720433 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1458/2893] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:54 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 1511 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:54.750773 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0a2b5a22-f6c8-4a2e-a4c2-6d5281cde928 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:54.758746 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0a2b5a22-f6c8-4a2e-a4c2-6d5281cde928 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1508 microversion: 2.1 time: 0.526185 Jul 31 01:20:54.766289 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1436/2894] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:54 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1508 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:54.781302 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5fdbf5a5-a2f1-48da-879d-428c3bc44b16 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:54.784726 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5fdbf5a5-a2f1-48da-879d-428c3bc44b16 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:54.793680 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5fdbf5a5-a2f1-48da-879d-428c3bc44b16 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:54.794244 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5fdbf5a5-a2f1-48da-879d-428c3bc44b16 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:54.795233 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5fdbf5a5-a2f1-48da-879d-428c3bc44b16 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:54.795785 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5fdbf5a5-a2f1-48da-879d-428c3bc44b16 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:54.917003 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5fdbf5a5-a2f1-48da-879d-428c3bc44b16 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "PUT /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1080 microversion: 2.1 time: 0.139452 Jul 31 01:20:54.931509 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1437/2895] 10.222.0.45 () {60 vars in 1256 bytes} [Sun Jul 31 01:20:54 2022] PUT /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1080 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:20:54.940779 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3492164a-642e-48a0-b434-5690568093a7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:54.946127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3492164a-642e-48a0-b434-5690568093a7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:54.966845 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3492164a-642e-48a0-b434-5690568093a7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:54.967315 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3492164a-642e-48a0-b434-5690568093a7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:54.968802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3492164a-642e-48a0-b434-5690568093a7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:54.969230 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3492164a-642e-48a0-b434-5690568093a7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:55.339982 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9ca595de-1f6a-4bd4-b252-a8aacf2a9f9b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:55.340823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9ca595de-1f6a-4bd4-b252-a8aacf2a9f9b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:55.354298 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9ca595de-1f6a-4bd4-b252-a8aacf2a9f9b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:55.354644 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9ca595de-1f6a-4bd4-b252-a8aacf2a9f9b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:55.357054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9ca595de-1f6a-4bd4-b252-a8aacf2a9f9b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:55.362527 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9ca595de-1f6a-4bd4-b252-a8aacf2a9f9b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:55.396189 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3492164a-642e-48a0-b434-5690568093a7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:55.402765 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9ca595de-1f6a-4bd4-b252-a8aacf2a9f9b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:20:55.424058 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3492164a-642e-48a0-b434-5690568093a7 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1506 microversion: 2.1 time: 0.489980 Jul 31 01:20:55.440270 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1438/2896] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:54 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:55.446896 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b98c1ab8-53ed-464f-a481-a43ec45c159a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:55.447934 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b98c1ab8-53ed-464f-a481-a43ec45c159a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:55.455121 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b98c1ab8-53ed-464f-a481-a43ec45c159a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:55.455896 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b98c1ab8-53ed-464f-a481-a43ec45c159a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:55.457550 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b98c1ab8-53ed-464f-a481-a43ec45c159a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:55.458303 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b98c1ab8-53ed-464f-a481-a43ec45c159a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:55.596085 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9ca595de-1f6a-4bd4-b252-a8aacf2a9f9b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 204 len: 0 microversion: 2.32 time: 0.873353 Jul 31 01:20:55.598741 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1459/2897] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:20:54 2022] DELETE /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 0 bytes in 877 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:20:55.618052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-288c3c81-b478-47bd-87e9-f8c90588f46d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:55.620976 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-288c3c81-b478-47bd-87e9-f8c90588f46d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:55.643231 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-288c3c81-b478-47bd-87e9-f8c90588f46d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:55.650347 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-288c3c81-b478-47bd-87e9-f8c90588f46d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:55.651523 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-288c3c81-b478-47bd-87e9-f8c90588f46d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:55.652143 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-288c3c81-b478-47bd-87e9-f8c90588f46d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:56.301151 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b98c1ab8-53ed-464f-a481-a43ec45c159a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:56.305427 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:56.317615 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b98c1ab8-53ed-464f-a481-a43ec45c159a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1506 microversion: 2.1 time: 0.875825 Jul 31 01:20:56.331812 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1439/2898] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:55 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1506 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:20:56.341009 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cbc87ea0-86c5-4b54-912b-4248f515714b tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:56.344349 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cbc87ea0-86c5-4b54-912b-4248f515714b tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:56.360251 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbc87ea0-86c5-4b54-912b-4248f515714b tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:56.361538 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbc87ea0-86c5-4b54-912b-4248f515714b tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:56.362776 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbc87ea0-86c5-4b54-912b-4248f515714b tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:56.364235 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbc87ea0-86c5-4b54-912b-4248f515714b tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:56.497069 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-288c3c81-b478-47bd-87e9-f8c90588f46d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:56.510331 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-288c3c81-b478-47bd-87e9-f8c90588f46d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:56.513862 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-288c3c81-b478-47bd-87e9-f8c90588f46d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:56.515780 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-288c3c81-b478-47bd-87e9-f8c90588f46d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 2953 microversion: 2.32 time: 0.909740 Jul 31 01:20:56.516590 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1460/2899] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:20:55 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 2953 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:20:56.525144 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-317a3881-91c0-485c-98bb-be939140c0d8 req-fa5484a4-d551-4f31-a57f-1fb0862640df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc96be05-825f-41e5-83f0-09fdc15ed529", "name": "network-vif-deleted", "tag": "5717f3f9-5b67-4c5a-a4cb-5e728071b0a5"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:56.536946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-317a3881-91c0-485c-98bb-be939140c0d8 req-fa5484a4-d551-4f31-a57f-1fb0862640df service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:56.537662 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-317a3881-91c0-485c-98bb-be939140c0d8 req-fa5484a4-d551-4f31-a57f-1fb0862640df service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:56.544774 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cbc87ea0-86c5-4b54-912b-4248f515714b tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8472c850b5f4254b04d6fc49401cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa7743dce0f4d989a5fe94cf332a4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:56.564756 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-317a3881-91c0-485c-98bb-be939140c0d8 req-fa5484a4-d551-4f31-a57f-1fb0862640df service nova] Creating event network-vif-deleted:5717f3f9-5b67-4c5a-a4cb-5e728071b0a5 for instance dc96be05-825f-41e5-83f0-09fdc15ed529 on n-h2-master-1 Jul 31 01:20:56.575488 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-317a3881-91c0-485c-98bb-be939140c0d8 req-fa5484a4-d551-4f31-a57f-1fb0862640df service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055160 Jul 31 01:20:56.576391 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1461/2900] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:56.580135 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cbc87ea0-86c5-4b54-912b-4248f515714b tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 200 len: 1469 microversion: 2.1 time: 0.247116 Jul 31 01:20:56.587720 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1440/2901] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:56 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 1469 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:56.603835 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0f306572-729b-4b95-a357-79461887e541", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:56.608514 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:56.617988 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:56.619573 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:56.621161 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:56.621900 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:56.628359 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8dd006d4-f7c5-4cbf-83c9-9a6fed7425a1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:56.628846 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8dd006d4-f7c5-4cbf-83c9-9a6fed7425a1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:56.638093 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8dd006d4-f7c5-4cbf-83c9-9a6fed7425a1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:56.639856 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8dd006d4-f7c5-4cbf-83c9-9a6fed7425a1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:56.657646 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8dd006d4-f7c5-4cbf-83c9-9a6fed7425a1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:56.662904 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8dd006d4-f7c5-4cbf-83c9-9a6fed7425a1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:56.828907 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:20:56.829399 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:20:56.829887 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:20:56.830305 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:20:56.830722 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:20:56.954201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8dd006d4-f7c5-4cbf-83c9-9a6fed7425a1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:56.966361 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8dd006d4-f7c5-4cbf-83c9-9a6fed7425a1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.343311 Jul 31 01:20:56.983955 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1441/2902] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:56 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:56.999111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8fdf41fb-85f2-4412-9712-95b3bbc49bd2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-2102754816"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:57.006521 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8fdf41fb-85f2-4412-9712-95b3bbc49bd2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:57.008910 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:57.017382 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fdf41fb-85f2-4412-9712-95b3bbc49bd2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:57.019297 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fdf41fb-85f2-4412-9712-95b3bbc49bd2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:57.020745 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:57.024092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fdf41fb-85f2-4412-9712-95b3bbc49bd2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:57.025142 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:57.026701 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:57.028103 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fdf41fb-85f2-4412-9712-95b3bbc49bd2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:57.030330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:57.030860 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:57.127332 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:57.146119 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f3414dd6-b7e8-4e34-bfbb-dc30ec28112f tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "POST /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306/action" status: 202 len: 1112 microversion: 2.1 time: 0.565313 Jul 31 01:20:57.147412 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1462/2903] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:20:56 2022] POST /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306/action => generated 1112 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 31 01:20:57.181607 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0260f9b9-77f8-4e4f-893b-2183615d8b6e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:57.183708 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0260f9b9-77f8-4e4f-893b-2183615d8b6e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:57.195977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0260f9b9-77f8-4e4f-893b-2183615d8b6e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:57.201133 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0260f9b9-77f8-4e4f-893b-2183615d8b6e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:57.207938 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0260f9b9-77f8-4e4f-893b-2183615d8b6e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:57.212420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0260f9b9-77f8-4e4f-893b-2183615d8b6e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:57.434577 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8fdf41fb-85f2-4412-9712-95b3bbc49bd2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 202 len: 0 microversion: 2.1 time: 0.442189 Jul 31 01:20:57.436438 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1442/2904] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:20:56 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 31 01:20:57.515319 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0260f9b9-77f8-4e4f-893b-2183615d8b6e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:57.529070 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0260f9b9-77f8-4e4f-893b-2183615d8b6e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1517 microversion: 2.1 time: 0.364385 Jul 31 01:20:57.530685 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1463/2905] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:57 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1517 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:20:57.538386 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3503681-0f0f-4fd6-be3a-f85eb011f44d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:57.539380 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3503681-0f0f-4fd6-be3a-f85eb011f44d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:57.554482 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3503681-0f0f-4fd6-be3a-f85eb011f44d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:57.556054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3503681-0f0f-4fd6-be3a-f85eb011f44d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:57.557156 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3503681-0f0f-4fd6-be3a-f85eb011f44d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:57.557835 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3503681-0f0f-4fd6-be3a-f85eb011f44d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:57.800157 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-957ea075-9617-4944-8fa1-f985017710ba tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:57.803396 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:20:57.803396 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:20:57.805514 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-957ea075-9617-4944-8fa1-f985017710ba tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:57.806401 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-957ea075-9617-4944-8fa1-f985017710ba tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:57.807842 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-957ea075-9617-4944-8fa1-f985017710ba tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:57.808793 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-957ea075-9617-4944-8fa1-f985017710ba tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:57.832732 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:57.840052 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-957ea075-9617-4944-8fa1-f985017710ba tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.400767 Jul 31 01:20:57.841010 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1443/2906] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:20:57 2022] GET /compute/v2.1/os-services => generated 944 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:57.851543 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-59af3264-ca59-49aa-b94b-596879329c45 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:57.853173 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-59af3264-ca59-49aa-b94b-596879329c45 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:57.864107 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59af3264-ca59-49aa-b94b-596879329c45 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:57.864630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59af3264-ca59-49aa-b94b-596879329c45 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:57.865416 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59af3264-ca59-49aa-b94b-596879329c45 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:57.865914 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59af3264-ca59-49aa-b94b-596879329c45 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:58.078521 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3503681-0f0f-4fd6-be3a-f85eb011f44d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:58.096160 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3503681-0f0f-4fd6-be3a-f85eb011f44d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1680 microversion: 2.1 time: 0.563894 Jul 31 01:20:58.098851 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1464/2907] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:57 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1680 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:58.106623 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c0cc4277-0feb-4da5-8182-ffbe1817d050 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:58.107434 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c0cc4277-0feb-4da5-8182-ffbe1817d050 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] [instance: dc96be05-825f-41e5-83f0-09fdc15ed529] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:58.124105 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0cc4277-0feb-4da5-8182-ffbe1817d050 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:58.129295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0cc4277-0feb-4da5-8182-ffbe1817d050 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:58.131013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0cc4277-0feb-4da5-8182-ffbe1817d050 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:58.131526 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0cc4277-0feb-4da5-8182-ffbe1817d050 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:58.150007 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-59af3264-ca59-49aa-b94b-596879329c45 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:58.161136 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-c0cc4277-0feb-4da5-8182-ffbe1817d050 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] HTTP exception thrown: Instance dc96be05-825f-41e5-83f0-09fdc15ed529 could not be found. Jul 31 01:20:58.162148 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-59af3264-ca59-49aa-b94b-596879329c45 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c0cc4277-0feb-4da5-8182-ffbe1817d050 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Request method failure captured: Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 HTTP/1.1 Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5djZAP4AzfnnMEFa-AgtsHBIB8DVaekBA1PG7GoSpHFzRrI47uqcwAX8Kll23LDPTmY4oiO8zVDJOP-cvU9Bj1VcLCyX0ztjEFPLFzrQKzy7cNzHSdFW1to5KaJFR1r2Zm8C4-YQC_2HGYf4tsAjcFAi2w08KMAcKoicr-1q1UAn6Ew Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 8fa7743dce0f4d989a5fe94cf332a4ba Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerAddressesTestJSON-1034867113 Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8fa7743dce0f4d989a5fe94cf332a4ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8fa7743dce0f4d989a5fe94cf332a4ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8fa7743dce0f4d989a5fe94cf332a4ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8fa7743dce0f4d989a5fe94cf332a4ba", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerAddressesTestJSON-1034867113 Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 8fa7743dce0f4d989a5fe94cf332a4ba Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1034867113 Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerAddressesTestJSON-1034867113-project Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: c8472c850b5f4254b04d6fc49401cd08 Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerAddressesTestJSON-1034867113-project Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: exception: Instance dc96be05-825f-41e5-83f0-09fdc15ed529 could not be found. Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'dc96be05-825f-41e5-83f0-09fdc15ed529'} Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc96be05-825f-41e5-83f0-09fdc15ed529 could not be found. Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc96be05-825f-41e5-83f0-09fdc15ed529 could not be found. Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:20:58.163258 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:58.167754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:58.167754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:20:58.167754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:20:58.167754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:20:58.167754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:20:58.167754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc96be05-825f-41e5-83f0-09fdc15ed529 could not be found. Jul 31 01:20:58.167754 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:58.168221 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-59af3264-ca59-49aa-b94b-596879329c45 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:58.168221 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-59af3264-ca59-49aa-b94b-596879329c45 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 2953 microversion: 2.32 time: 0.320643 Jul 31 01:20:58.168221 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1444/2908] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:20:57 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 2953 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:20:58.169375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c0cc4277-0feb-4da5-8182-ffbe1817d050 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] Returning 404 to user: Instance dc96be05-825f-41e5-83f0-09fdc15ed529 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:20:58.170399 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c0cc4277-0feb-4da5-8182-ffbe1817d050 tempest-ServerAddressesTestJSON-1034867113 tempest-ServerAddressesTestJSON-1034867113-project] 10.222.0.45 "GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529" status: 404 len: 111 microversion: 2.1 time: 0.068102 Jul 31 01:20:58.171030 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-cc12cb1c-1b92-4609-a618-9c22e9b03ebc req-25fbefa1-9672-4925-9487-7def56668bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f0abec-dd05-4dff-8f15-b56464346b06", "name": "network-vif-unplugged", "status": "completed", "tag": "02e5aa3d-f780-459d-9466-4437ed729ddc"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:20:58.175677 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1465/2909] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:58 2022] GET /compute/v2.1/servers/dc96be05-825f-41e5-83f0-09fdc15ed529 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:20:58.180616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-538f1acc-1223-4f75-96ee-c8f30d3d1c09 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:58.183579 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:20:58.183579 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:20:58.185108 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-538f1acc-1223-4f75-96ee-c8f30d3d1c09 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:58.185745 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-538f1acc-1223-4f75-96ee-c8f30d3d1c09 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:58.186791 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-538f1acc-1223-4f75-96ee-c8f30d3d1c09 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:58.187560 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-538f1acc-1223-4f75-96ee-c8f30d3d1c09 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:58.204981 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-cc12cb1c-1b92-4609-a618-9c22e9b03ebc req-25fbefa1-9672-4925-9487-7def56668bd5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:58.209569 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-cc12cb1c-1b92-4609-a618-9c22e9b03ebc req-25fbefa1-9672-4925-9487-7def56668bd5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:58.219111 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-538f1acc-1223-4f75-96ee-c8f30d3d1c09 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.041582 Jul 31 01:20:58.220897 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1466/2910] 10.222.0.45 () {58 vars in 1170 bytes} [Sun Jul 31 01:20:58 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:58.233639 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7d486dd-d6e2-4f86-a93a-a241899a025b tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:58.238424 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:20:58.238424 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:20:58.240900 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7d486dd-d6e2-4f86-a93a-a241899a025b tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:58.241561 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7d486dd-d6e2-4f86-a93a-a241899a025b tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:58.242555 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7d486dd-d6e2-4f86-a93a-a241899a025b tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:58.243190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7d486dd-d6e2-4f86-a93a-a241899a025b tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:58.253316 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-cc12cb1c-1b92-4609-a618-9c22e9b03ebc req-25fbefa1-9672-4925-9487-7def56668bd5 service nova] Creating event network-vif-unplugged:02e5aa3d-f780-459d-9466-4437ed729ddc for instance e7f0abec-dd05-4dff-8f15-b56464346b06 on n-h2-master-1 Jul 31 01:20:58.265547 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-cc12cb1c-1b92-4609-a618-9c22e9b03ebc req-25fbefa1-9672-4925-9487-7def56668bd5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097656 Jul 31 01:20:58.267322 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1445/2911] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:58.278314 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a7d486dd-d6e2-4f86-a93a-a241899a025b tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.048558 Jul 31 01:20:58.279274 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1467/2912] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:20:58 2022] GET /compute/v2.1/os-services => generated 944 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:20:58.294565 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f87ce624-76af-448c-b5db-52ae917d63c1 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:58.299019 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:20:58.299019 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:20:58.300922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f87ce624-76af-448c-b5db-52ae917d63c1 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:58.302084 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f87ce624-76af-448c-b5db-52ae917d63c1 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:58.303374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f87ce624-76af-448c-b5db-52ae917d63c1 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:58.304005 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f87ce624-76af-448c-b5db-52ae917d63c1 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:58.337949 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f87ce624-76af-448c-b5db-52ae917d63c1 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.049303 Jul 31 01:20:58.339770 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1446/2913] 10.222.0.45 () {58 vars in 1194 bytes} [Sun Jul 31 01:20:58 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:20:58.352454 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2b8545c5-69e3-4fdb-9005-896c96229a32 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:58.355984 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:20:58.355984 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:20:58.357886 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b8545c5-69e3-4fdb-9005-896c96229a32 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:58.358631 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b8545c5-69e3-4fdb-9005-896c96229a32 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:58.360334 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b8545c5-69e3-4fdb-9005-896c96229a32 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:58.361204 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b8545c5-69e3-4fdb-9005-896c96229a32 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:58.400742 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2b8545c5-69e3-4fdb-9005-896c96229a32 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.051337 Jul 31 01:20:58.401549 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1468/2914] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:20:58 2022] GET /compute/v2.1/os-services => generated 944 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:20:58.415182 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6294452b-8616-4df9-ae49-138d7320c0f8 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:58.418463 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:20:58.418463 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:20:58.419784 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6294452b-8616-4df9-ae49-138d7320c0f8 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:58.420310 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6294452b-8616-4df9-ae49-138d7320c0f8 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:58.425246 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6294452b-8616-4df9-ae49-138d7320c0f8 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:58.426222 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6294452b-8616-4df9-ae49-138d7320c0f8 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:58.470367 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6294452b-8616-4df9-ae49-138d7320c0f8 tempest-ServicesAdminNegativeTestJSON-1052985479 tempest-ServicesAdminNegativeTestJSON-1052985479-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.059001 Jul 31 01:20:58.472921 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1447/2915] 10.222.0.45 () {58 vars in 1198 bytes} [Sun Jul 31 01:20:58 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:20:58.552921 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5b36fd31-71d4-4cfc-a57f-5d6f81631282 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:58.556443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5b36fd31-71d4-4cfc-a57f-5d6f81631282 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:58.565835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b36fd31-71d4-4cfc-a57f-5d6f81631282 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:58.566242 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b36fd31-71d4-4cfc-a57f-5d6f81631282 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:58.571582 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b36fd31-71d4-4cfc-a57f-5d6f81631282 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:58.572263 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b36fd31-71d4-4cfc-a57f-5d6f81631282 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:58.834660 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e9850e0-0028-44e2-8139-a42ef7921051 tempest-ServicesAdminNegativeTestJSON-865547948 tempest-ServicesAdminNegativeTestJSON-865547948-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:58.838248 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:20:58.838248 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:20:58.839962 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e9850e0-0028-44e2-8139-a42ef7921051 tempest-ServicesAdminNegativeTestJSON-865547948 tempest-ServicesAdminNegativeTestJSON-865547948-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4a3600aef1224db594fb05c882585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20277ff315b406cac50926fde86e8db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e9850e0-0028-44e2-8139-a42ef7921051 tempest-ServicesAdminNegativeTestJSON-865547948 tempest-ServicesAdminNegativeTestJSON-865547948-project] Request method failure captured: Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dj3EwmACBwme2ecBZAehag1G0rFJ3YuNrgBmKKEJAyQvLBOvdOqY8jcDpn59buYCH6NpiXDs2ew7lF8c8CsszHsJd-XFPw02Q9HVYqHijn25PgABP-7QSK1K-YITyrn028OX4j1aqiEAgEOOIprZWgBw6VksjMcOHwBAMbxTnMZLjA Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: c20277ff315b406cac50926fde86e8db Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-865547948 Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c20277ff315b406cac50926fde86e8db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c20277ff315b406cac50926fde86e8db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c20277ff315b406cac50926fde86e8db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c20277ff315b406cac50926fde86e8db", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-865547948 Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: c20277ff315b406cac50926fde86e8db Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-865547948 Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServicesAdminNegativeTestJSON-865547948-project Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 4a3600aef1224db594fb05c882585024 Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-865547948-project Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: action_args: {} Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 31 01:20:58.853173 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:58.857919 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:20:58.857919 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:58.857919 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:20:58.857919 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:20:58.857919 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:20:58.857919 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:20:58.857919 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:20:58.857919 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 31 01:20:58.857919 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:20:58.857919 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e9850e0-0028-44e2-8139-a42ef7921051 tempest-ServicesAdminNegativeTestJSON-865547948 tempest-ServicesAdminNegativeTestJSON-865547948-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:20:58.859724 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3e9850e0-0028-44e2-8139-a42ef7921051 tempest-ServicesAdminNegativeTestJSON-865547948 tempest-ServicesAdminNegativeTestJSON-865547948-project] 10.222.0.45 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.373084 Jul 31 01:20:58.860684 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1469/2916] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:20:58 2022] GET /compute/v2.1/os-services => generated 112 bytes in 377 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:20:59.122766 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4c064952-27a1-4d3e-ae29-5dcdac6f984f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:59.123898 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4c064952-27a1-4d3e-ae29-5dcdac6f984f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:59.134586 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c064952-27a1-4d3e-ae29-5dcdac6f984f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:59.135368 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c064952-27a1-4d3e-ae29-5dcdac6f984f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:59.136500 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c064952-27a1-4d3e-ae29-5dcdac6f984f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:59.137116 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c064952-27a1-4d3e-ae29-5dcdac6f984f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:59.240680 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5b36fd31-71d4-4cfc-a57f-5d6f81631282 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:20:59.253590 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5b36fd31-71d4-4cfc-a57f-5d6f81631282 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1517 microversion: 2.1 time: 0.704654 Jul 31 01:20:59.255252 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1448/2917] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:58 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1517 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:20:59.283502 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8cda0fc1-1316-4c6c-bca1-500149b07d8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:20:59.284198 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8cda0fc1-1316-4c6c-bca1-500149b07d8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:20:59.301637 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cda0fc1-1316-4c6c-bca1-500149b07d8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:59.302110 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cda0fc1-1316-4c6c-bca1-500149b07d8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:20:59.302914 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cda0fc1-1316-4c6c-bca1-500149b07d8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:20:59.303963 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cda0fc1-1316-4c6c-bca1-500149b07d8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:00.425757 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8cda0fc1-1316-4c6c-bca1-500149b07d8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:00.449211 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8cda0fc1-1316-4c6c-bca1-500149b07d8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:00.451359 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8cda0fc1-1316-4c6c-bca1-500149b07d8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:00.452715 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8cda0fc1-1316-4c6c-bca1-500149b07d8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 2953 microversion: 2.32 time: 1.181442 Jul 31 01:21:00.454686 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1449/2918] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:20:59 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 2953 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:00.460238 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ee306a4d-78dd-45e0-9de6-a4bff8692067 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:00.461080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ee306a4d-78dd-45e0-9de6-a4bff8692067 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:00.476258 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee306a4d-78dd-45e0-9de6-a4bff8692067 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:00.477621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee306a4d-78dd-45e0-9de6-a4bff8692067 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:00.478706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee306a4d-78dd-45e0-9de6-a4bff8692067 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:00.479370 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee306a4d-78dd-45e0-9de6-a4bff8692067 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:00.568008 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4c064952-27a1-4d3e-ae29-5dcdac6f984f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:00.587039 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4c064952-27a1-4d3e-ae29-5dcdac6f984f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1688 microversion: 2.1 time: 1.468176 Jul 31 01:21:00.588428 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1470/2919] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:20:59 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1688 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:21:01.222681 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ee306a4d-78dd-45e0-9de6-a4bff8692067 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:01.236449 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ee306a4d-78dd-45e0-9de6-a4bff8692067 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1517 microversion: 2.1 time: 0.779698 Jul 31 01:21:01.249849 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1450/2920] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:00 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1517 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:01.481888 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7564c56f-bef7-4a98-9d70-51a3fb2821b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:01.482576 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7564c56f-bef7-4a98-9d70-51a3fb2821b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:01.497556 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7564c56f-bef7-4a98-9d70-51a3fb2821b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:01.498024 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7564c56f-bef7-4a98-9d70-51a3fb2821b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:01.498850 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7564c56f-bef7-4a98-9d70-51a3fb2821b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:01.503590 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7564c56f-bef7-4a98-9d70-51a3fb2821b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:01.610173 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4dec4b61-0a31-42f5-af5c-e6e16ad33d1d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:01.611298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4dec4b61-0a31-42f5-af5c-e6e16ad33d1d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:01.624709 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4dec4b61-0a31-42f5-af5c-e6e16ad33d1d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:01.626146 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4dec4b61-0a31-42f5-af5c-e6e16ad33d1d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:01.628867 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4dec4b61-0a31-42f5-af5c-e6e16ad33d1d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:01.630794 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4dec4b61-0a31-42f5-af5c-e6e16ad33d1d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:02.411704 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4dec4b61-0a31-42f5-af5c-e6e16ad33d1d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:02.420343 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4dec4b61-0a31-42f5-af5c-e6e16ad33d1d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1688 microversion: 2.1 time: 0.814685 Jul 31 01:21:02.423602 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1451/2921] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:01 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1688 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:21:02.428614 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-3741fa55-c5eb-42ac-9525-ae15d7bd7e91 req-d183d96e-7506-4c5b-b83c-75c97d0c2cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f0abec-dd05-4dff-8f15-b56464346b06", "name": "network-vif-plugged", "status": "completed", "tag": "02e5aa3d-f780-459d-9466-4437ed729ddc"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:02.458014 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3741fa55-c5eb-42ac-9525-ae15d7bd7e91 req-d183d96e-7506-4c5b-b83c-75c97d0c2cb6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:02.458888 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3741fa55-c5eb-42ac-9525-ae15d7bd7e91 req-d183d96e-7506-4c5b-b83c-75c97d0c2cb6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:02.504457 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-3741fa55-c5eb-42ac-9525-ae15d7bd7e91 req-d183d96e-7506-4c5b-b83c-75c97d0c2cb6 service nova] Creating event network-vif-plugged:02e5aa3d-f780-459d-9466-4437ed729ddc for instance e7f0abec-dd05-4dff-8f15-b56464346b06 on n-h2-master-1 Jul 31 01:21:02.518630 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-3741fa55-c5eb-42ac-9525-ae15d7bd7e91 req-d183d96e-7506-4c5b-b83c-75c97d0c2cb6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092939 Jul 31 01:21:02.526429 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1452/2922] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:21:02.536963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-89141644-8279-426c-9a1b-6b85b0b0c292 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:02.537672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-89141644-8279-426c-9a1b-6b85b0b0c292 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:02.582827 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-89141644-8279-426c-9a1b-6b85b0b0c292 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:02.583364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-89141644-8279-426c-9a1b-6b85b0b0c292 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:02.584349 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-89141644-8279-426c-9a1b-6b85b0b0c292 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:02.587841 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-89141644-8279-426c-9a1b-6b85b0b0c292 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:02.982031 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7564c56f-bef7-4a98-9d70-51a3fb2821b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:03.008513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7564c56f-bef7-4a98-9d70-51a3fb2821b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:03.011866 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7564c56f-bef7-4a98-9d70-51a3fb2821b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:03.016798 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7564c56f-bef7-4a98-9d70-51a3fb2821b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 2953 microversion: 2.32 time: 1.538939 Jul 31 01:21:03.021996 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1471/2923] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:01 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 2953 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:03.161981 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-89141644-8279-426c-9a1b-6b85b0b0c292 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:03.182952 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-89141644-8279-426c-9a1b-6b85b0b0c292 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1517 microversion: 2.1 time: 0.653555 Jul 31 01:21:03.186548 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1453/2924] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:02 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1517 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:03.461190 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-48566b37-d9ba-4426-b547-4b07a6e65faf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:03.462528 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-48566b37-d9ba-4426-b547-4b07a6e65faf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:03.474210 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48566b37-d9ba-4426-b547-4b07a6e65faf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:03.480078 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48566b37-d9ba-4426-b547-4b07a6e65faf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:03.482168 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48566b37-d9ba-4426-b547-4b07a6e65faf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:03.485401 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48566b37-d9ba-4426-b547-4b07a6e65faf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:04.132233 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-48566b37-d9ba-4426-b547-4b07a6e65faf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:04.142212 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-48566b37-d9ba-4426-b547-4b07a6e65faf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1683 microversion: 2.1 time: 0.686872 Jul 31 01:21:04.149924 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1472/2925] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:03 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1683 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:04.172779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6a12a1b7-dedc-4a4f-ad7d-84e2d629a0ff tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:04.179737 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6a12a1b7-dedc-4a4f-ad7d-84e2d629a0ff tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:04.209921 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a12a1b7-dedc-4a4f-ad7d-84e2d629a0ff tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:04.211968 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a12a1b7-dedc-4a4f-ad7d-84e2d629a0ff tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:04.220702 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a12a1b7-dedc-4a4f-ad7d-84e2d629a0ff tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:04.221215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a12a1b7-dedc-4a4f-ad7d-84e2d629a0ff tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:04.493336 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bd2b9101-39bb-4c1f-bb8c-aacb3dde2078 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Action: 'update', calling method: .version_select at 0x7fede4f5ae50>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:04.497042 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:21:04.497042 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:21:04.499026 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd2b9101-39bb-4c1f-bb8c-aacb3dde2078 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:04.499808 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd2b9101-39bb-4c1f-bb8c-aacb3dde2078 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:04.518304 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd2b9101-39bb-4c1f-bb8c-aacb3dde2078 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:04.518864 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd2b9101-39bb-4c1f-bb8c-aacb3dde2078 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:04.538034 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-bd2b9101-39bb-4c1f-bb8c-aacb3dde2078 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] HTTP exception thrown: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bd2b9101-39bb-4c1f-bb8c-aacb3dde2078 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Request method failure captured: Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: request: PUT /compute/v2.1/os-services/a0c7dee7-22b3-435c-a823-9f36b4d1156d HTTP/1.1 Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 56 Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dj_6YWyLm9J6qh7kYsDg3IRbAUkh56nUddh1f3oUbNdnu2VOnyKZjr-CAqhAEx6H1xedulexpDNS3ruBCmf8Tgr7t4BsjXcYfAuRqnjCwroFMPOa9DVuTmfzb9hYYi-Cj1tOd4VJGxnwJVmjUxmasEe3e1XZ5v-1fhsQsl87WfPjc0 Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-Openstack-Nova-Api-Version: 2.53 Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 4009ff62527341eabe6db084daf73cc9 Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1774735443 Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4009ff62527341eabe6db084daf73cc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4009ff62527341eabe6db084daf73cc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4009ff62527341eabe6db084daf73cc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4009ff62527341eabe6db084daf73cc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1774735443 Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 4009ff62527341eabe6db084daf73cc9 Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1774735443 Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 2f96e1b9254847fcb7327e3d4f379db9 Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: exception: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'a0c7dee7-22b3-435c-a823-9f36b4d1156d', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:21:04.540328 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:21:04.545198 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 31 01:21:04.545198 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:21:04.545198 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. Jul 31 01:21:04.545198 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:04.545198 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:21:04.545198 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:04.545198 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:04.545198 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:21:04.545198 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:21:04.545198 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:21:04.545198 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:21:04.545198 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. Jul 31 01:21:04.545198 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:04.545198 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bd2b9101-39bb-4c1f-bb8c-aacb3dde2078 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Returning 404 to user: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:21:04.548225 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bd2b9101-39bb-4c1f-bb8c-aacb3dde2078 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-services/a0c7dee7-22b3-435c-a823-9f36b4d1156d" status: 404 len: 110 microversion: 2.53 time: 0.755157 Jul 31 01:21:04.553103 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1454/2926] 10.222.0.45 () {62 vars in 1309 bytes} [Sun Jul 31 01:21:03 2022] PUT /compute/v2.1/os-services/a0c7dee7-22b3-435c-a823-9f36b4d1156d => generated 110 bytes in 761 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 31 01:21:04.561759 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c5a0a31a-ec74-4dc2-b99a-458717571485 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:04.562710 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c5a0a31a-ec74-4dc2-b99a-458717571485 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:04.579313 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5a0a31a-ec74-4dc2-b99a-458717571485 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:04.579869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5a0a31a-ec74-4dc2-b99a-458717571485 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:04.581925 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5a0a31a-ec74-4dc2-b99a-458717571485 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:04.583620 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5a0a31a-ec74-4dc2-b99a-458717571485 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.071596 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6a12a1b7-dedc-4a4f-ad7d-84e2d629a0ff tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:05.102836 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6a12a1b7-dedc-4a4f-ad7d-84e2d629a0ff tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:05.109166 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6a12a1b7-dedc-4a4f-ad7d-84e2d629a0ff tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:05.113594 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6a12a1b7-dedc-4a4f-ad7d-84e2d629a0ff tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 2932 microversion: 2.32 time: 0.956346 Jul 31 01:21:05.133835 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1473/2927] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:04 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 2932 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:05.144399 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-38e2e9f4-31e6-439e-b1ad-69622f4683f9 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Action: 'update', calling method: .version_select at 0x7fede5d30820>, body: {"status": "disabled"} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:05.162024 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:21:05.162024 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:21:05.170672 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38e2e9f4-31e6-439e-b1ad-69622f4683f9 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.174049 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38e2e9f4-31e6-439e-b1ad-69622f4683f9 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.204354 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38e2e9f4-31e6-439e-b1ad-69622f4683f9 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.205901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38e2e9f4-31e6-439e-b1ad-69622f4683f9 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.228373 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-38e2e9f4-31e6-439e-b1ad-69622f4683f9 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] HTTP exception thrown: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-38e2e9f4-31e6-439e-b1ad-69622f4683f9 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Request method failure captured: Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: request: PUT /compute/v2.1/os-services/a0c7dee7-22b3-435c-a823-9f36b4d1156d HTTP/1.1 Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 22 Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dj_6YWyLm9J6qh7kYsDg3IRbAUkh56nUddh1f3oUbNdnu2VOnyKZjr-CAqhAEx6H1xedulexpDNS3ruBCmf8Tgr7t4BsjXcYfAuRqnjCwroFMPOa9DVuTmfzb9hYYi-Cj1tOd4VJGxnwJVmjUxmasEe3e1XZ5v-1fhsQsl87WfPjc0 Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.53 Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 4009ff62527341eabe6db084daf73cc9 Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1774735443 Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4009ff62527341eabe6db084daf73cc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4009ff62527341eabe6db084daf73cc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4009ff62527341eabe6db084daf73cc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4009ff62527341eabe6db084daf73cc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1774735443 Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 4009ff62527341eabe6db084daf73cc9 Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1774735443 Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 2f96e1b9254847fcb7327e3d4f379db9 Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: {"status": "disabled"} Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: exception: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'a0c7dee7-22b3-435c-a823-9f36b4d1156d', 'body': {'status': 'disabled'}} Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:21:05.231963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:21:05.237476 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 31 01:21:05.237476 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:21:05.237476 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. Jul 31 01:21:05.237476 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:05.237476 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:21:05.237476 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:05.237476 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:05.237476 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:21:05.237476 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:21:05.237476 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:21:05.237476 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:21:05.237476 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. Jul 31 01:21:05.237476 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:05.237476 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-38e2e9f4-31e6-439e-b1ad-69622f4683f9 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Returning 404 to user: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:21:05.237476 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-38e2e9f4-31e6-439e-b1ad-69622f4683f9 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-services/a0c7dee7-22b3-435c-a823-9f36b4d1156d" status: 404 len: 110 microversion: 2.53 time: 0.097752 Jul 31 01:21:05.239012 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1474/2928] 10.222.0.45 () {62 vars in 1309 bytes} [Sun Jul 31 01:21:05 2022] PUT /compute/v2.1/os-services/a0c7dee7-22b3-435c-a823-9f36b4d1156d => generated 110 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:21:05.248886 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-17a7603f-ced0-4f6c-abfb-42a78e28877f req-67120d92-ebfa-4fe1-892c-e8ce20a0c2cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-unplugged", "status": "completed", "tag": "a49bdcce-53dd-4303-86cf-783aea87f084"}, {"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-unplugged", "status": "completed", "tag": "125ddd94-e67d-4f25-a9da-1073d0016a4d"}, {"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-unplugged", "status": "completed", "tag": "993014ab-481c-4599-9cca-e1b1e9595978"}, {"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-unplugged", "status": "completed", "tag": "3b5d94b7-0fe7-467f-9eff-92e830a3cf3d"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:05.276866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-17a7603f-ced0-4f6c-abfb-42a78e28877f req-67120d92-ebfa-4fe1-892c-e8ce20a0c2cd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.277501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-17a7603f-ced0-4f6c-abfb-42a78e28877f req-67120d92-ebfa-4fe1-892c-e8ce20a0c2cd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.296260 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c5a0a31a-ec74-4dc2-b99a-458717571485 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:05.307541 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-17a7603f-ced0-4f6c-abfb-42a78e28877f req-67120d92-ebfa-4fe1-892c-e8ce20a0c2cd service nova] Creating event network-vif-unplugged:a49bdcce-53dd-4303-86cf-783aea87f084 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:21:05.309504 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-17a7603f-ced0-4f6c-abfb-42a78e28877f req-67120d92-ebfa-4fe1-892c-e8ce20a0c2cd service nova] Creating event network-vif-unplugged:125ddd94-e67d-4f25-a9da-1073d0016a4d for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:21:05.310223 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-17a7603f-ced0-4f6c-abfb-42a78e28877f req-67120d92-ebfa-4fe1-892c-e8ce20a0c2cd service nova] Creating event network-vif-unplugged:993014ab-481c-4599-9cca-e1b1e9595978 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:21:05.312737 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-17a7603f-ced0-4f6c-abfb-42a78e28877f req-67120d92-ebfa-4fe1-892c-e8ce20a0c2cd service nova] Creating event network-vif-unplugged:3b5d94b7-0fe7-467f-9eff-92e830a3cf3d for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:21:05.316661 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c5a0a31a-ec74-4dc2-b99a-458717571485 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1517 microversion: 2.1 time: 0.762082 Jul 31 01:21:05.319836 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1455/2929] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:04 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1517 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:05.328198 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f7ec692c-fed6-46b1-a195-cecdb6fbcb6c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:05.330760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f7ec692c-fed6-46b1-a195-cecdb6fbcb6c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:05.334424 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-17a7603f-ced0-4f6c-abfb-42a78e28877f req-67120d92-ebfa-4fe1-892c-e8ce20a0c2cd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.091271 Jul 31 01:21:05.335206 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1475/2930] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:21:05.351289 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-da76bf57-285a-45ff-8fbf-ae86544f30ca tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Action: 'update', calling method: .version_select at 0x7fede5d30f70>, body: {"status": "enabled"} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:05.354488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7ec692c-fed6-46b1-a195-cecdb6fbcb6c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.358106 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7ec692c-fed6-46b1-a195-cecdb6fbcb6c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.359078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7ec692c-fed6-46b1-a195-cecdb6fbcb6c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.359576 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7ec692c-fed6-46b1-a195-cecdb6fbcb6c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.360894 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:21:05.360894 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:21:05.366262 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da76bf57-285a-45ff-8fbf-ae86544f30ca tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.367904 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da76bf57-285a-45ff-8fbf-ae86544f30ca tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.383141 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da76bf57-285a-45ff-8fbf-ae86544f30ca tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.383963 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da76bf57-285a-45ff-8fbf-ae86544f30ca tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.397993 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-da76bf57-285a-45ff-8fbf-ae86544f30ca tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] HTTP exception thrown: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-da76bf57-285a-45ff-8fbf-ae86544f30ca tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Request method failure captured: Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: request: PUT /compute/v2.1/os-services/a0c7dee7-22b3-435c-a823-9f36b4d1156d HTTP/1.1 Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 21 Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dj_6YWyLm9J6qh7kYsDg3IRbAUkh56nUddh1f3oUbNdnu2VOnyKZjr-CAqhAEx6H1xedulexpDNS3ruBCmf8Tgr7t4BsjXcYfAuRqnjCwroFMPOa9DVuTmfzb9hYYi-Cj1tOd4VJGxnwJVmjUxmasEe3e1XZ5v-1fhsQsl87WfPjc0 Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.53 Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 4009ff62527341eabe6db084daf73cc9 Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1774735443 Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4009ff62527341eabe6db084daf73cc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4009ff62527341eabe6db084daf73cc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4009ff62527341eabe6db084daf73cc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4009ff62527341eabe6db084daf73cc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1774735443 Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 4009ff62527341eabe6db084daf73cc9 Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1774735443 Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 2f96e1b9254847fcb7327e3d4f379db9 Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: {"status": "enabled"} Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: exception: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'a0c7dee7-22b3-435c-a823-9f36b4d1156d', 'body': {'status': 'enabled'}} Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:21:05.404197 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:21:05.410422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 31 01:21:05.410422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:21:05.410422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. Jul 31 01:21:05.410422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:05.410422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:21:05.410422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:05.410422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:05.410422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:21:05.410422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:21:05.410422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:21:05.410422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:21:05.410422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. Jul 31 01:21:05.410422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:05.416566 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-da76bf57-285a-45ff-8fbf-ae86544f30ca tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Returning 404 to user: Service a0c7dee7-22b3-435c-a823-9f36b4d1156d could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:21:05.417663 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-da76bf57-285a-45ff-8fbf-ae86544f30ca tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-services/a0c7dee7-22b3-435c-a823-9f36b4d1156d" status: 404 len: 110 microversion: 2.53 time: 0.078173 Jul 31 01:21:05.423430 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1476/2931] 10.222.0.45 () {62 vars in 1309 bytes} [Sun Jul 31 01:21:05 2022] PUT /compute/v2.1/os-services/a0c7dee7-22b3-435c-a823-9f36b4d1156d => generated 110 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:21:05.434349 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ca6b44cd-6aba-435f-9e93-0810df4d9762 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:05.437647 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:21:05.437647 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:21:05.449808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca6b44cd-6aba-435f-9e93-0810df4d9762 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.450525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca6b44cd-6aba-435f-9e93-0810df4d9762 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.451944 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca6b44cd-6aba-435f-9e93-0810df4d9762 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.453127 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca6b44cd-6aba-435f-9e93-0810df4d9762 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.520651 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ca6b44cd-6aba-435f-9e93-0810df4d9762 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.091467 Jul 31 01:21:05.530549 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1477/2932] 10.222.0.45 () {60 vars in 1178 bytes} [Sun Jul 31 01:21:05 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:05.543513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f7dd82c7-5acb-416d-ac4d-e7c2c1ff1f0f tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:05.551129 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:21:05.551129 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:21:05.554851 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7dd82c7-5acb-416d-ac4d-e7c2c1ff1f0f tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.555585 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7dd82c7-5acb-416d-ac4d-e7c2c1ff1f0f tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.557608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7dd82c7-5acb-416d-ac4d-e7c2c1ff1f0f tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.559529 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7dd82c7-5acb-416d-ac4d-e7c2c1ff1f0f tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.635176 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f7dd82c7-5acb-416d-ac4d-e7c2c1ff1f0f tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.100700 Jul 31 01:21:05.648001 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1478/2933] 10.222.0.45 () {60 vars in 1211 bytes} [Sun Jul 31 01:21:05 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:05.660032 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-97386574-cc69-4091-a7db-d658138ed69b tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:05.665743 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:21:05.665743 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:21:05.669168 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97386574-cc69-4091-a7db-d658138ed69b tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.669611 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97386574-cc69-4091-a7db-d658138ed69b tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.670457 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97386574-cc69-4091-a7db-d658138ed69b tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.673857 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97386574-cc69-4091-a7db-d658138ed69b tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.740239 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-97386574-cc69-4091-a7db-d658138ed69b tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.090920 Jul 31 01:21:05.762381 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1479/2934] 10.222.0.45 () {60 vars in 1178 bytes} [Sun Jul 31 01:21:05 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:05.780325 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-57c70b87-75f0-4bb5-a228-cdf0ddce7cd5 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:05.785259 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:21:05.785259 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:21:05.787234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-57c70b87-75f0-4bb5-a228-cdf0ddce7cd5 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.787821 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-57c70b87-75f0-4bb5-a228-cdf0ddce7cd5 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.788984 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-57c70b87-75f0-4bb5-a228-cdf0ddce7cd5 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.789752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-57c70b87-75f0-4bb5-a228-cdf0ddce7cd5 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.838364 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-57c70b87-75f0-4bb5-a228-cdf0ddce7cd5 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.074240 Jul 31 01:21:05.839714 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1480/2935] 10.222.0.45 () {60 vars in 1235 bytes} [Sun Jul 31 01:21:05 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:05.861776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5b4979d7-dbf7-466b-9f7b-2ee896289d80 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:05.865656 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:21:05.865656 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:21:05.868819 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b4979d7-dbf7-466b-9f7b-2ee896289d80 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.870279 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b4979d7-dbf7-466b-9f7b-2ee896289d80 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.871766 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b4979d7-dbf7-466b-9f7b-2ee896289d80 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.872619 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b4979d7-dbf7-466b-9f7b-2ee896289d80 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.923477 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5b4979d7-dbf7-466b-9f7b-2ee896289d80 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.068905 Jul 31 01:21:05.930190 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1481/2936] 10.222.0.45 () {60 vars in 1178 bytes} [Sun Jul 31 01:21:05 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:05.950946 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a4ba4856-f5e0-4ef3-ab8b-cd576e3c9c10 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:05.961338 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:21:05.961338 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:21:05.971804 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a4ba4856-f5e0-4ef3-ab8b-cd576e3c9c10 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.973511 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a4ba4856-f5e0-4ef3-ab8b-cd576e3c9c10 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:05.978189 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a4ba4856-f5e0-4ef3-ab8b-cd576e3c9c10 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:05.980481 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a4ba4856-f5e0-4ef3-ab8b-cd576e3c9c10 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:06.064609 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a4ba4856-f5e0-4ef3-ab8b-cd576e3c9c10 tempest-ServicesAdminNegativeV253TestJSON-1774735443 tempest-ServicesAdminNegativeV253TestJSON-1774735443-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.124713 Jul 31 01:21:06.069564 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1482/2937] 10.222.0.45 () {60 vars in 1239 bytes} [Sun Jul 31 01:21:05 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:06.332579 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-481579a5-396a-4277-a435-84d4bcf1393e tempest-ServicesAdminNegativeV253TestJSON-1033154741 tempest-ServicesAdminNegativeV253TestJSON-1033154741-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:06.337225 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:21:06.337225 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:21:06.345553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-481579a5-396a-4277-a435-84d4bcf1393e tempest-ServicesAdminNegativeV253TestJSON-1033154741 tempest-ServicesAdminNegativeV253TestJSON-1033154741-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'd00bf7f0d33940f5845d49ccdfb2a571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d120d9df0e84ffa88768ff52dd63ec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-481579a5-396a-4277-a435-84d4bcf1393e tempest-ServicesAdminNegativeV253TestJSON-1033154741 tempest-ServicesAdminNegativeV253TestJSON-1033154741-project] Request method failure captured: Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dj9sDaDiyw4q_OddohUZUASPCBnQGdgn3VsOxmXsob8VbXBQelmM-MunJndn07uHqThxxfkruhPh-KM1X8SmMadG1dCTTffo5XD7l3XF2TvLg1AFjOnpUuGSnzArvJJSt0N_G_m7Cs1EH2StjuUmAp_uYphPwfVXAmR77MIZX0M7xI Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.53 Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 0d120d9df0e84ffa88768ff52dd63ec4 Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1033154741 Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d120d9df0e84ffa88768ff52dd63ec4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d120d9df0e84ffa88768ff52dd63ec4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0d120d9df0e84ffa88768ff52dd63ec4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0d120d9df0e84ffa88768ff52dd63ec4", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1033154741 Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 0d120d9df0e84ffa88768ff52dd63ec4 Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1033154741 Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1033154741-project Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: d00bf7f0d33940f5845d49ccdfb2a571 Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1033154741-project Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: action_args: {} Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise self.value Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 31 01:21:06.351168 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:06.355964 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:21:06.355964 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:06.355964 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:06.355964 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:21:06.355964 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:21:06.355964 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 31 01:21:06.355964 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 31 01:21:06.355964 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 31 01:21:06.355964 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:21:06.358502 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-481579a5-396a-4277-a435-84d4bcf1393e tempest-ServicesAdminNegativeV253TestJSON-1033154741 tempest-ServicesAdminNegativeV253TestJSON-1033154741-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:21:06.361281 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-481579a5-396a-4277-a435-84d4bcf1393e tempest-ServicesAdminNegativeV253TestJSON-1033154741 tempest-ServicesAdminNegativeV253TestJSON-1033154741-project] 10.222.0.45 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.283833 Jul 31 01:21:06.376444 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1483/2938] 10.222.0.45 () {60 vars in 1178 bytes} [Sun Jul 31 01:21:06 2022] GET /compute/v2.1/os-services => generated 112 bytes in 297 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Jul 31 01:21:06.398021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8791f6f9-9218-486b-930b-9b40f98d183c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:06.403023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8791f6f9-9218-486b-930b-9b40f98d183c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:06.437919 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8791f6f9-9218-486b-930b-9b40f98d183c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:06.438442 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8791f6f9-9218-486b-930b-9b40f98d183c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:06.439444 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8791f6f9-9218-486b-930b-9b40f98d183c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:06.439914 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8791f6f9-9218-486b-930b-9b40f98d183c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:07.349309 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f7ec692c-fed6-46b1-a195-cecdb6fbcb6c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:07.372033 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f7ec692c-fed6-46b1-a195-cecdb6fbcb6c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1683 microversion: 2.1 time: 2.046087 Jul 31 01:21:07.377359 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1456/2939] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:05 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1683 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:07.411026 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8828796c-1f6c-48e1-8a54-3d5f759c59ae tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:07.412887 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8828796c-1f6c-48e1-8a54-3d5f759c59ae tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:07.447069 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8828796c-1f6c-48e1-8a54-3d5f759c59ae tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:07.448252 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8828796c-1f6c-48e1-8a54-3d5f759c59ae tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:07.454717 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8828796c-1f6c-48e1-8a54-3d5f759c59ae tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:07.455414 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8828796c-1f6c-48e1-8a54-3d5f759c59ae tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:09.194826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8828796c-1f6c-48e1-8a54-3d5f759c59ae tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:09.223504 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8828796c-1f6c-48e1-8a54-3d5f759c59ae tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1517 microversion: 2.1 time: 1.839215 Jul 31 01:21:09.223998 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1457/2940] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:07 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1517 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:09.226852 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8791f6f9-9218-486b-930b-9b40f98d183c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:09.244246 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8791f6f9-9218-486b-930b-9b40f98d183c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:09.254590 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8791f6f9-9218-486b-930b-9b40f98d183c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:09.257315 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8791f6f9-9218-486b-930b-9b40f98d183c tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 2911 microversion: 2.32 time: 2.873913 Jul 31 01:21:09.263975 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1484/2941] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:06 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 2911 bytes in 2886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:09.266294 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-552bf443-bb98-4513-9269-99875f4e760a req-eaafc4c4-0047-435a-ad23-c6737cb7c7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-unplugged", "status": "completed", "tag": "de3ca179-e6db-401d-ac3c-cb604c404e59"}, {"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-unplugged", "status": "completed", "tag": "22b1cf82-6093-47ed-8f73-4e9ef9d96cd1"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:09.278184 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dac82f4f-21f0-42c4-82b0-7fb9a590a530 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:09.286484 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dac82f4f-21f0-42c4-82b0-7fb9a590a530 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:09.308169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dac82f4f-21f0-42c4-82b0-7fb9a590a530 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:09.308969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dac82f4f-21f0-42c4-82b0-7fb9a590a530 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:09.310364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dac82f4f-21f0-42c4-82b0-7fb9a590a530 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:09.311167 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dac82f4f-21f0-42c4-82b0-7fb9a590a530 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:09.313496 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-552bf443-bb98-4513-9269-99875f4e760a req-eaafc4c4-0047-435a-ad23-c6737cb7c7fb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:09.315894 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-552bf443-bb98-4513-9269-99875f4e760a req-eaafc4c4-0047-435a-ad23-c6737cb7c7fb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:09.364183 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-552bf443-bb98-4513-9269-99875f4e760a req-eaafc4c4-0047-435a-ad23-c6737cb7c7fb service nova] Creating event network-vif-unplugged:de3ca179-e6db-401d-ac3c-cb604c404e59 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:21:09.365116 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-552bf443-bb98-4513-9269-99875f4e760a req-eaafc4c4-0047-435a-ad23-c6737cb7c7fb service nova] Creating event network-vif-unplugged:22b1cf82-6093-47ed-8f73-4e9ef9d96cd1 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:21:09.380828 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-552bf443-bb98-4513-9269-99875f4e760a req-eaafc4c4-0047-435a-ad23-c6737cb7c7fb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.135398 Jul 31 01:21:09.382180 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1458/2942] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:21:10.263381 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d6bd3f6f-3513-478b-be7c-0ebcd84bccc3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:10.290057 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d6bd3f6f-3513-478b-be7c-0ebcd84bccc3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:10.314179 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6bd3f6f-3513-478b-be7c-0ebcd84bccc3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:10.316354 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6bd3f6f-3513-478b-be7c-0ebcd84bccc3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:10.318522 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6bd3f6f-3513-478b-be7c-0ebcd84bccc3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:10.320537 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6bd3f6f-3513-478b-be7c-0ebcd84bccc3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:11.123592 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dac82f4f-21f0-42c4-82b0-7fb9a590a530 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:11.140759 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dac82f4f-21f0-42c4-82b0-7fb9a590a530 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1683 microversion: 2.1 time: 1.874906 Jul 31 01:21:11.141583 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1485/2943] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:09 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1683 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:11.148448 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-def61989-8210-4066-978d-c63089b2c165 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:11.148779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-def61989-8210-4066-978d-c63089b2c165 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:11.178620 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-def61989-8210-4066-978d-c63089b2c165 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:11.179097 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-def61989-8210-4066-978d-c63089b2c165 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:11.179950 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-def61989-8210-4066-978d-c63089b2c165 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:11.180408 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-def61989-8210-4066-978d-c63089b2c165 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:12.790302 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d6bd3f6f-3513-478b-be7c-0ebcd84bccc3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:12.794192 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:12.813032 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d6bd3f6f-3513-478b-be7c-0ebcd84bccc3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1517 microversion: 2.1 time: 2.566249 Jul 31 01:21:12.816742 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1459/2944] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:10 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1517 bytes in 2571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:12.850692 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dba06b2a-6ff7-4cdf-b7e5-82391868bb5c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:12.869494 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dba06b2a-6ff7-4cdf-b7e5-82391868bb5c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:12.896909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dba06b2a-6ff7-4cdf-b7e5-82391868bb5c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:12.900776 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dba06b2a-6ff7-4cdf-b7e5-82391868bb5c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:12.901890 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dba06b2a-6ff7-4cdf-b7e5-82391868bb5c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:12.904654 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dba06b2a-6ff7-4cdf-b7e5-82391868bb5c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:13.019719 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-def61989-8210-4066-978d-c63089b2c165 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:13.036567 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-def61989-8210-4066-978d-c63089b2c165 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:13.038459 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-def61989-8210-4066-978d-c63089b2c165 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:13.053942 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-def61989-8210-4066-978d-c63089b2c165 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 2864 microversion: 2.32 time: 1.911390 Jul 31 01:21:13.055848 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1486/2945] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:11 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 2864 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:13.623951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-18f70a20-cce7-450c-9d43-1081697ce746 req-5913b087-9815-4dfc-9447-7a63a6bc4ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-deleted", "tag": "993014ab-481c-4599-9cca-e1b1e9595978"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:13.656625 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-18f70a20-cce7-450c-9d43-1081697ce746 req-5913b087-9815-4dfc-9447-7a63a6bc4ef1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:13.657083 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-18f70a20-cce7-450c-9d43-1081697ce746 req-5913b087-9815-4dfc-9447-7a63a6bc4ef1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:13.708264 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-18f70a20-cce7-450c-9d43-1081697ce746 req-5913b087-9815-4dfc-9447-7a63a6bc4ef1 service nova] Creating event network-vif-deleted:993014ab-481c-4599-9cca-e1b1e9595978 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:21:13.739035 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-18f70a20-cce7-450c-9d43-1081697ce746 req-5913b087-9815-4dfc-9447-7a63a6bc4ef1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110798 Jul 31 01:21:13.742306 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1487/2946] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:21:13.851168 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b37415a3-127b-4d42-b2b6-558c5e349abd tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:13.852205 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b37415a3-127b-4d42-b2b6-558c5e349abd tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:13.895583 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b37415a3-127b-4d42-b2b6-558c5e349abd tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:13.903720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b37415a3-127b-4d42-b2b6-558c5e349abd tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:13.910881 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b37415a3-127b-4d42-b2b6-558c5e349abd tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:13.912330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b37415a3-127b-4d42-b2b6-558c5e349abd tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:14.518403 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=10 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:15.323666 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dba06b2a-6ff7-4cdf-b7e5-82391868bb5c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:15.335378 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dba06b2a-6ff7-4cdf-b7e5-82391868bb5c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1683 microversion: 2.1 time: 2.516554 Jul 31 01:21:15.341480 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1460/2947] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:12 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1683 bytes in 2522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:15.360876 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-df9b3e76-c7f0-4a32-8ac7-cc2ef4802477 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:15.361609 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-df9b3e76-c7f0-4a32-8ac7-cc2ef4802477 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:15.383803 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df9b3e76-c7f0-4a32-8ac7-cc2ef4802477 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:15.384539 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df9b3e76-c7f0-4a32-8ac7-cc2ef4802477 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:15.387527 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df9b3e76-c7f0-4a32-8ac7-cc2ef4802477 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:15.388025 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df9b3e76-c7f0-4a32-8ac7-cc2ef4802477 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:15.390546 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b37415a3-127b-4d42-b2b6-558c5e349abd tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:15.404281 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b37415a3-127b-4d42-b2b6-558c5e349abd tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1517 microversion: 2.1 time: 1.565501 Jul 31 01:21:15.437682 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1488/2948] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:13 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1517 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:21:15.449327 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-142db53f-9df4-4dbc-b278-b67fc044c957 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "834838a3-5c18-43eb-98dd-c49acd27ba15"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:15.452783 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-142db53f-9df4-4dbc-b278-b67fc044c957 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:15.474061 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-142db53f-9df4-4dbc-b278-b67fc044c957 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:15.475877 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-142db53f-9df4-4dbc-b278-b67fc044c957 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:15.477242 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-142db53f-9df4-4dbc-b278-b67fc044c957 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:15.479179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-142db53f-9df4-4dbc-b278-b67fc044c957 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:16.009355 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=28 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:16.136623 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:16.193357 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-142db53f-9df4-4dbc-b278-b67fc044c957 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "POST /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752025 Jul 31 01:21:16.195879 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1489/2949] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:21:15 2022] POST /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:21:16.368572 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-187a8da2-3ee7-403f-b15b-3ca653bc8a1f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:16.369322 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-187a8da2-3ee7-403f-b15b-3ca653bc8a1f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:16.390683 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-187a8da2-3ee7-403f-b15b-3ca653bc8a1f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:16.391299 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-187a8da2-3ee7-403f-b15b-3ca653bc8a1f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:16.394450 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-187a8da2-3ee7-403f-b15b-3ca653bc8a1f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:16.395783 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-187a8da2-3ee7-403f-b15b-3ca653bc8a1f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:16.741684 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-df9b3e76-c7f0-4a32-8ac7-cc2ef4802477 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:16.760900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-df9b3e76-c7f0-4a32-8ac7-cc2ef4802477 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:16.764455 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-df9b3e76-c7f0-4a32-8ac7-cc2ef4802477 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:16.769131 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-df9b3e76-c7f0-4a32-8ac7-cc2ef4802477 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 2578 microversion: 2.32 time: 1.426486 Jul 31 01:21:16.771867 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1461/2950] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:15 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 2578 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:16.790369 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-995072ed-1411-4ff5-9538-3a9910d09a74 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:16.791628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-995072ed-1411-4ff5-9538-3a9910d09a74 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:16.810154 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-995072ed-1411-4ff5-9538-3a9910d09a74 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:16.815779 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-995072ed-1411-4ff5-9538-3a9910d09a74 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:16.817116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-995072ed-1411-4ff5-9538-3a9910d09a74 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:16.817961 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-995072ed-1411-4ff5-9538-3a9910d09a74 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:17.325405 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-187a8da2-3ee7-403f-b15b-3ca653bc8a1f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:17.346930 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-187a8da2-3ee7-403f-b15b-3ca653bc8a1f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1683 microversion: 2.1 time: 0.987990 Jul 31 01:21:17.353755 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1490/2951] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:16 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1683 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:21:17.370651 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-126b1bbe-74ed-4ec8-a5e3-c0992e27f331 req-8389d4a7-2215-4e87-9c30-c1e6387cd68f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-deleted", "tag": "a49bdcce-53dd-4303-86cf-783aea87f084"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:17.408076 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-126b1bbe-74ed-4ec8-a5e3-c0992e27f331 req-8389d4a7-2215-4e87-9c30-c1e6387cd68f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:17.414994 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-126b1bbe-74ed-4ec8-a5e3-c0992e27f331 req-8389d4a7-2215-4e87-9c30-c1e6387cd68f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:17.476355 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-126b1bbe-74ed-4ec8-a5e3-c0992e27f331 req-8389d4a7-2215-4e87-9c30-c1e6387cd68f service nova] Creating event network-vif-deleted:a49bdcce-53dd-4303-86cf-783aea87f084 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:21:17.497635 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-126b1bbe-74ed-4ec8-a5e3-c0992e27f331 req-8389d4a7-2215-4e87-9c30-c1e6387cd68f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137895 Jul 31 01:21:17.500437 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1491/2952] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:21:17.800594 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6c358441-57ec-49a9-a556-5cc78d2b888a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:17.801735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6c358441-57ec-49a9-a556-5cc78d2b888a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:17.830463 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c358441-57ec-49a9-a556-5cc78d2b888a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:17.833147 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c358441-57ec-49a9-a556-5cc78d2b888a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:17.837648 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c358441-57ec-49a9-a556-5cc78d2b888a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:17.839431 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c358441-57ec-49a9-a556-5cc78d2b888a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:18.172417 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-995072ed-1411-4ff5-9538-3a9910d09a74 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:18.187237 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-995072ed-1411-4ff5-9538-3a9910d09a74 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1517 microversion: 2.1 time: 1.413403 Jul 31 01:21:18.191882 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1462/2953] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:16 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1517 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:18.378707 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6c4704d3-158d-4565-925f-72ebf7173ac4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:18.380118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6c4704d3-158d-4565-925f-72ebf7173ac4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:18.412521 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c4704d3-158d-4565-925f-72ebf7173ac4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:18.413084 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c4704d3-158d-4565-925f-72ebf7173ac4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:18.416798 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c4704d3-158d-4565-925f-72ebf7173ac4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:18.417281 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c4704d3-158d-4565-925f-72ebf7173ac4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:19.388066 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6c358441-57ec-49a9-a556-5cc78d2b888a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:19.412207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6c358441-57ec-49a9-a556-5cc78d2b888a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:19.420492 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6c358441-57ec-49a9-a556-5cc78d2b888a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:19.424675 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6c358441-57ec-49a9-a556-5cc78d2b888a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 2419 microversion: 2.32 time: 1.628157 Jul 31 01:21:19.440714 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1492/2954] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:17 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 2419 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:19.472879 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2c251b37-5e9d-44f5-834f-8b4653de3076 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:19.474374 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2c251b37-5e9d-44f5-834f-8b4653de3076 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:19.499694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c251b37-5e9d-44f5-834f-8b4653de3076 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:19.500472 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c251b37-5e9d-44f5-834f-8b4653de3076 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:19.505412 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c251b37-5e9d-44f5-834f-8b4653de3076 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:19.506973 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c251b37-5e9d-44f5-834f-8b4653de3076 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:20.263838 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6c4704d3-158d-4565-925f-72ebf7173ac4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:20.272453 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6c4704d3-158d-4565-925f-72ebf7173ac4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1683 microversion: 2.1 time: 1.900661 Jul 31 01:21:20.273341 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1463/2955] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:18 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1683 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:20.280560 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-36d55175-aebe-41c8-8fe3-920c17f6a50c req-f8a5de29-341a-437f-bbe0-91b187659682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-deleted", "tag": "22b1cf82-6093-47ed-8f73-4e9ef9d96cd1"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:20.309391 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-36d55175-aebe-41c8-8fe3-920c17f6a50c req-f8a5de29-341a-437f-bbe0-91b187659682 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:20.310175 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-36d55175-aebe-41c8-8fe3-920c17f6a50c req-f8a5de29-341a-437f-bbe0-91b187659682 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:20.343592 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-36d55175-aebe-41c8-8fe3-920c17f6a50c req-f8a5de29-341a-437f-bbe0-91b187659682 service nova] Creating event network-vif-deleted:22b1cf82-6093-47ed-8f73-4e9ef9d96cd1 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:21:20.355304 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-36d55175-aebe-41c8-8fe3-920c17f6a50c req-f8a5de29-341a-437f-bbe0-91b187659682 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080460 Jul 31 01:21:20.359214 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1464/2956] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:21:20.403896 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2c251b37-5e9d-44f5-834f-8b4653de3076 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:20.419651 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2c251b37-5e9d-44f5-834f-8b4653de3076 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1517 microversion: 2.1 time: 0.975601 Jul 31 01:21:20.426091 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1493/2957] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:19 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1517 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:20.455874 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e47bf22f-a4a9-4da0-8eb4-51b6552dfc8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:20.457039 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e47bf22f-a4a9-4da0-8eb4-51b6552dfc8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:20.471058 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e47bf22f-a4a9-4da0-8eb4-51b6552dfc8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:20.473238 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e47bf22f-a4a9-4da0-8eb4-51b6552dfc8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:20.476300 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e47bf22f-a4a9-4da0-8eb4-51b6552dfc8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:20.477099 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e47bf22f-a4a9-4da0-8eb4-51b6552dfc8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:21.075200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e47bf22f-a4a9-4da0-8eb4-51b6552dfc8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:21.113572 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e47bf22f-a4a9-4da0-8eb4-51b6552dfc8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:21.123960 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e47bf22f-a4a9-4da0-8eb4-51b6552dfc8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:21.132492 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e47bf22f-a4a9-4da0-8eb4-51b6552dfc8b tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 2258 microversion: 2.32 time: 0.682136 Jul 31 01:21:21.146991 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1465/2958] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:20 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 2258 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:21.294096 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-83e05194-048b-4d0a-9442-dcbf544192d0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:21.294736 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-83e05194-048b-4d0a-9442-dcbf544192d0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:21.312955 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83e05194-048b-4d0a-9442-dcbf544192d0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:21.331695 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83e05194-048b-4d0a-9442-dcbf544192d0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:21.344642 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83e05194-048b-4d0a-9442-dcbf544192d0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:21.345117 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83e05194-048b-4d0a-9442-dcbf544192d0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:21.455781 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-75fe7c1d-d4e5-43bf-a66a-e18fe56f2f9a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:21.469273 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-75fe7c1d-d4e5-43bf-a66a-e18fe56f2f9a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:21.500813 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75fe7c1d-d4e5-43bf-a66a-e18fe56f2f9a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:21.501378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75fe7c1d-d4e5-43bf-a66a-e18fe56f2f9a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:21.516447 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75fe7c1d-d4e5-43bf-a66a-e18fe56f2f9a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:21.516899 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75fe7c1d-d4e5-43bf-a66a-e18fe56f2f9a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:23.175015 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-83e05194-048b-4d0a-9442-dcbf544192d0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:23.188853 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-83e05194-048b-4d0a-9442-dcbf544192d0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1683 microversion: 2.1 time: 1.898599 Jul 31 01:21:23.196926 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1494/2959] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:21 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1683 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:23.216932 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a88cf8bf-289b-49e1-8ad8-dcf55dec86e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:23.218755 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a88cf8bf-289b-49e1-8ad8-dcf55dec86e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:23.246278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a88cf8bf-289b-49e1-8ad8-dcf55dec86e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:23.247462 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a88cf8bf-289b-49e1-8ad8-dcf55dec86e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:23.249226 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a88cf8bf-289b-49e1-8ad8-dcf55dec86e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:23.253379 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a88cf8bf-289b-49e1-8ad8-dcf55dec86e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:24.313366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a88cf8bf-289b-49e1-8ad8-dcf55dec86e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:24.333892 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-75fe7c1d-d4e5-43bf-a66a-e18fe56f2f9a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:24.352703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a88cf8bf-289b-49e1-8ad8-dcf55dec86e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:24.353451 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-75fe7c1d-d4e5-43bf-a66a-e18fe56f2f9a tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1517 microversion: 2.1 time: 2.898579 Jul 31 01:21:24.354453 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1466/2960] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:21 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1517 bytes in 2911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:24.362419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-ffbe4550-56e2-4d1b-b4ae-c2ad65f28e3d req-944138cb-b5a2-4ddb-9841-2db9f070caba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-deleted", "tag": "de3ca179-e6db-401d-ac3c-cb604c404e59"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:24.366459 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a88cf8bf-289b-49e1-8ad8-dcf55dec86e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:24.375284 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a88cf8bf-289b-49e1-8ad8-dcf55dec86e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 2211 microversion: 2.32 time: 1.166983 Jul 31 01:21:24.383455 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1495/2961] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:23 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 2211 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:24.425124 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c8207ad1-c50e-4a58-bbd0-5a23dc67b895 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:24.426734 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c8207ad1-c50e-4a58-bbd0-5a23dc67b895 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:24.445741 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8207ad1-c50e-4a58-bbd0-5a23dc67b895 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:24.447105 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8207ad1-c50e-4a58-bbd0-5a23dc67b895 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:24.447970 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-ffbe4550-56e2-4d1b-b4ae-c2ad65f28e3d req-944138cb-b5a2-4ddb-9841-2db9f070caba service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:24.448432 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-ffbe4550-56e2-4d1b-b4ae-c2ad65f28e3d req-944138cb-b5a2-4ddb-9841-2db9f070caba service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:24.450735 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8207ad1-c50e-4a58-bbd0-5a23dc67b895 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:24.452151 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8207ad1-c50e-4a58-bbd0-5a23dc67b895 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:24.544873 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-ffbe4550-56e2-4d1b-b4ae-c2ad65f28e3d req-944138cb-b5a2-4ddb-9841-2db9f070caba service nova] Creating event network-vif-deleted:de3ca179-e6db-401d-ac3c-cb604c404e59 for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:21:24.588506 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-ffbe4550-56e2-4d1b-b4ae-c2ad65f28e3d req-944138cb-b5a2-4ddb-9841-2db9f070caba service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219978 Jul 31 01:21:24.591385 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1467/2962] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:21:25.279302 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c8207ad1-c50e-4a58-bbd0-5a23dc67b895 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:25.328409 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c8207ad1-c50e-4a58-bbd0-5a23dc67b895 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1683 microversion: 2.1 time: 0.934078 Jul 31 01:21:25.340866 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1496/2963] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:24 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1683 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:25.396181 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0c191369-5d63-4853-ae5b-1eff57451476 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:25.396897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0c191369-5d63-4853-ae5b-1eff57451476 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:25.416300 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0c191369-5d63-4853-ae5b-1eff57451476 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:25.424378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0c191369-5d63-4853-ae5b-1eff57451476 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:25.427072 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0c191369-5d63-4853-ae5b-1eff57451476 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:25.428682 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0c191369-5d63-4853-ae5b-1eff57451476 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:25.431181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-44a939cd-3e8d-4f78-8666-ba4e4e4119b1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:25.441789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-44a939cd-3e8d-4f78-8666-ba4e4e4119b1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:25.482962 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44a939cd-3e8d-4f78-8666-ba4e4e4119b1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:25.488316 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44a939cd-3e8d-4f78-8666-ba4e4e4119b1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:25.505051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44a939cd-3e8d-4f78-8666-ba4e4e4119b1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:25.509628 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44a939cd-3e8d-4f78-8666-ba4e4e4119b1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:26.658061 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-44a939cd-3e8d-4f78-8666-ba4e4e4119b1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:26.677294 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-44a939cd-3e8d-4f78-8666-ba4e4e4119b1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:26.679021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-44a939cd-3e8d-4f78-8666-ba4e4e4119b1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:26.684924 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-44a939cd-3e8d-4f78-8666-ba4e4e4119b1 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 2029 microversion: 2.32 time: 1.261960 Jul 31 01:21:26.699373 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1497/2964] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:25 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 2029 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:26.699373 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-426bbc3c-d5dd-47f4-ac7a-7aee527627cb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:26.699373 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-426bbc3c-d5dd-47f4-ac7a-7aee527627cb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:26.716903 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-426bbc3c-d5dd-47f4-ac7a-7aee527627cb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:26.717515 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-426bbc3c-d5dd-47f4-ac7a-7aee527627cb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:26.718979 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-426bbc3c-d5dd-47f4-ac7a-7aee527627cb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:26.721218 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-426bbc3c-d5dd-47f4-ac7a-7aee527627cb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:27.211742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0c191369-5d63-4853-ae5b-1eff57451476 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:27.234986 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0c191369-5d63-4853-ae5b-1eff57451476 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1523 microversion: 2.1 time: 1.843106 Jul 31 01:21:27.250092 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1468/2965] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:25 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1523 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:21:27.266223 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7f9a6b3c-5122-4006-a016-5dae41e67642 req-577a6eea-876e-43c0-93e4-1f3e70ced878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad9ccd1-b86c-4c3e-9530-59120ba09cdb", "name": "network-vif-deleted", "tag": "3b5d94b7-0fe7-467f-9eff-92e830a3cf3d"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:27.312067 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7f9a6b3c-5122-4006-a016-5dae41e67642 req-577a6eea-876e-43c0-93e4-1f3e70ced878 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:27.312989 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7f9a6b3c-5122-4006-a016-5dae41e67642 req-577a6eea-876e-43c0-93e4-1f3e70ced878 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:27.354323 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7f9a6b3c-5122-4006-a016-5dae41e67642 req-577a6eea-876e-43c0-93e4-1f3e70ced878 service nova] Creating event network-vif-deleted:3b5d94b7-0fe7-467f-9eff-92e830a3cf3d for instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb on n-h1-master-1 Jul 31 01:21:27.365575 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7f9a6b3c-5122-4006-a016-5dae41e67642 req-577a6eea-876e-43c0-93e4-1f3e70ced878 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114042 Jul 31 01:21:27.379142 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1469/2966] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:21:27.719739 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cd063f9b-90f3-4168-865e-a8d370526b37 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:27.721369 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cd063f9b-90f3-4168-865e-a8d370526b37 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:27.752989 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd063f9b-90f3-4168-865e-a8d370526b37 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:27.753750 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd063f9b-90f3-4168-865e-a8d370526b37 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:27.757873 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd063f9b-90f3-4168-865e-a8d370526b37 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:27.758835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd063f9b-90f3-4168-865e-a8d370526b37 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:28.168428 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cd063f9b-90f3-4168-865e-a8d370526b37 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:28.186287 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cd063f9b-90f3-4168-865e-a8d370526b37 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:28.199436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cd063f9b-90f3-4168-865e-a8d370526b37 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:28.200720 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cd063f9b-90f3-4168-865e-a8d370526b37 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.490750 Jul 31 01:21:28.211739 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1470/2967] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:27 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:28.271443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1c5b818e-acc9-41c6-9eca-cd2bee0bd3ee tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:28.272119 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1c5b818e-acc9-41c6-9eca-cd2bee0bd3ee tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:28.274402 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=58 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:28.293783 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c5b818e-acc9-41c6-9eca-cd2bee0bd3ee tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:28.294295 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c5b818e-acc9-41c6-9eca-cd2bee0bd3ee tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:28.294503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-426bbc3c-d5dd-47f4-ac7a-7aee527627cb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:28.295194 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c5b818e-acc9-41c6-9eca-cd2bee0bd3ee tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:28.295845 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c5b818e-acc9-41c6-9eca-cd2bee0bd3ee tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:28.310673 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-426bbc3c-d5dd-47f4-ac7a-7aee527627cb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1683 microversion: 2.1 time: 1.618687 Jul 31 01:21:28.312227 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1498/2968] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:26 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1683 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:28.805714 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1c5b818e-acc9-41c6-9eca-cd2bee0bd3ee tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:28.826149 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1c5b818e-acc9-41c6-9eca-cd2bee0bd3ee tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1523 microversion: 2.1 time: 0.559093 Jul 31 01:21:28.828251 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1471/2969] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:28 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1523 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:21:29.240419 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6ab0a52e-8e0a-4de8-bc29-6a6a4deddc8a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:29.241632 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6ab0a52e-8e0a-4de8-bc29-6a6a4deddc8a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:29.273595 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=84 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:29.289519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6ab0a52e-8e0a-4de8-bc29-6a6a4deddc8a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:29.294100 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6ab0a52e-8e0a-4de8-bc29-6a6a4deddc8a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:29.299754 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6ab0a52e-8e0a-4de8-bc29-6a6a4deddc8a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:29.306356 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6ab0a52e-8e0a-4de8-bc29-6a6a4deddc8a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:29.338820 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eea105f9-36d1-42a9-819a-aeb82effdf8c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:29.339484 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eea105f9-36d1-42a9-819a-aeb82effdf8c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:29.366967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eea105f9-36d1-42a9-819a-aeb82effdf8c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:29.367691 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eea105f9-36d1-42a9-819a-aeb82effdf8c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:29.368558 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eea105f9-36d1-42a9-819a-aeb82effdf8c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:29.369009 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eea105f9-36d1-42a9-819a-aeb82effdf8c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:29.762346 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6ab0a52e-8e0a-4de8-bc29-6a6a4deddc8a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:29.778796 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6ab0a52e-8e0a-4de8-bc29-6a6a4deddc8a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:29.780564 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6ab0a52e-8e0a-4de8-bc29-6a6a4deddc8a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:29.787986 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6ab0a52e-8e0a-4de8-bc29-6a6a4deddc8a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.560802 Jul 31 01:21:29.789862 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1499/2970] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:29 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:29.850564 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bcbcae47-3de5-47e7-9b39-bb0d8890bc3b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:29.851611 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bcbcae47-3de5-47e7-9b39-bb0d8890bc3b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:29.866345 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcbcae47-3de5-47e7-9b39-bb0d8890bc3b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:29.867180 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcbcae47-3de5-47e7-9b39-bb0d8890bc3b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:29.869552 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcbcae47-3de5-47e7-9b39-bb0d8890bc3b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:29.873754 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcbcae47-3de5-47e7-9b39-bb0d8890bc3b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:30.082142 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eea105f9-36d1-42a9-819a-aeb82effdf8c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:30.099829 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eea105f9-36d1-42a9-819a-aeb82effdf8c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1683 microversion: 2.1 time: 0.763213 Jul 31 01:21:30.120354 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1472/2971] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:29 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1683 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:21:30.672652 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bcbcae47-3de5-47e7-9b39-bb0d8890bc3b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:30.702883 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bcbcae47-3de5-47e7-9b39-bb0d8890bc3b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1523 microversion: 2.1 time: 0.856962 Jul 31 01:21:30.707765 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1500/2972] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:29 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1523 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:21:30.818928 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fbc44434-da06-49be-b12d-f57adef1c3dd tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:30.819653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fbc44434-da06-49be-b12d-f57adef1c3dd tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:30.862932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbc44434-da06-49be-b12d-f57adef1c3dd tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:30.864661 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbc44434-da06-49be-b12d-f57adef1c3dd tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:30.868087 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbc44434-da06-49be-b12d-f57adef1c3dd tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:30.874004 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbc44434-da06-49be-b12d-f57adef1c3dd tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:31.133640 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0695962a-13ee-4406-9884-3c9325714edf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:31.134395 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0695962a-13ee-4406-9884-3c9325714edf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:31.146561 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0695962a-13ee-4406-9884-3c9325714edf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:31.157331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0695962a-13ee-4406-9884-3c9325714edf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:31.158607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0695962a-13ee-4406-9884-3c9325714edf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:31.164809 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0695962a-13ee-4406-9884-3c9325714edf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:31.203139 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fbc44434-da06-49be-b12d-f57adef1c3dd tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:31.228592 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fbc44434-da06-49be-b12d-f57adef1c3dd tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:31.231384 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fbc44434-da06-49be-b12d-f57adef1c3dd tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:31.236837 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fbc44434-da06-49be-b12d-f57adef1c3dd tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.426178 Jul 31 01:21:31.247309 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1473/2973] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:30 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:31.539652 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0695962a-13ee-4406-9884-3c9325714edf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:31.572787 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0695962a-13ee-4406-9884-3c9325714edf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1683 microversion: 2.1 time: 0.433502 Jul 31 01:21:31.576588 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1501/2974] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:31 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1683 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:21:31.732240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-be65504b-d96e-4065-be9c-02ab0d6f0a64 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:31.735584 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-be65504b-d96e-4065-be9c-02ab0d6f0a64 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:31.752000 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be65504b-d96e-4065-be9c-02ab0d6f0a64 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:31.753735 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be65504b-d96e-4065-be9c-02ab0d6f0a64 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:31.758989 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be65504b-d96e-4065-be9c-02ab0d6f0a64 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:31.762200 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be65504b-d96e-4065-be9c-02ab0d6f0a64 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:32.269456 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a07665de-14f8-4f12-8d66-630ef222301f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:32.270270 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a07665de-14f8-4f12-8d66-630ef222301f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:32.286603 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a07665de-14f8-4f12-8d66-630ef222301f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:32.289242 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a07665de-14f8-4f12-8d66-630ef222301f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:32.293807 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a07665de-14f8-4f12-8d66-630ef222301f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:32.295903 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a07665de-14f8-4f12-8d66-630ef222301f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:32.330780 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-be65504b-d96e-4065-be9c-02ab0d6f0a64 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:32.362148 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-be65504b-d96e-4065-be9c-02ab0d6f0a64 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1523 microversion: 2.1 time: 0.629080 Jul 31 01:21:32.381086 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1474/2975] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:31 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1523 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:32.551730 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a07665de-14f8-4f12-8d66-630ef222301f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:32.578827 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a07665de-14f8-4f12-8d66-630ef222301f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:32.580573 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a07665de-14f8-4f12-8d66-630ef222301f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:32.598787 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a07665de-14f8-4f12-8d66-630ef222301f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.317434 Jul 31 01:21:32.607525 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4a35ed21-8368-47cd-b0b0-250da600ff8f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:32.608185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4a35ed21-8368-47cd-b0b0-250da600ff8f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:32.625859 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1502/2976] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:32 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:32.628129 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a35ed21-8368-47cd-b0b0-250da600ff8f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:32.628727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a35ed21-8368-47cd-b0b0-250da600ff8f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:32.629586 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a35ed21-8368-47cd-b0b0-250da600ff8f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:32.630039 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a35ed21-8368-47cd-b0b0-250da600ff8f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:32.685758 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-e754c311-2bda-49b0-a203-70c9bb53023b req-d89af9be-6dd2-4d9b-9320-75c468a36bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae5b84e-919e-4ad7-8348-9d4326695306", "name": "network-vif-plugged", "status": "completed", "tag": "e639f0c2-df6c-4867-a6d5-a8e4da2fee54"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:32.741116 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e754c311-2bda-49b0-a203-70c9bb53023b req-d89af9be-6dd2-4d9b-9320-75c468a36bfd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:32.741603 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e754c311-2bda-49b0-a203-70c9bb53023b req-d89af9be-6dd2-4d9b-9320-75c468a36bfd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:32.826100 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-e754c311-2bda-49b0-a203-70c9bb53023b req-d89af9be-6dd2-4d9b-9320-75c468a36bfd service nova] Creating event network-vif-plugged:e639f0c2-df6c-4867-a6d5-a8e4da2fee54 for instance 3ae5b84e-919e-4ad7-8348-9d4326695306 on n-h2-master-1 Jul 31 01:21:32.876349 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-e754c311-2bda-49b0-a203-70c9bb53023b req-d89af9be-6dd2-4d9b-9320-75c468a36bfd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190120 Jul 31 01:21:32.881054 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1503/2977] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:21:33.188907 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4a35ed21-8368-47cd-b0b0-250da600ff8f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:33.239176 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4a35ed21-8368-47cd-b0b0-250da600ff8f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1683 microversion: 2.1 time: 0.637000 Jul 31 01:21:33.246852 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1475/2978] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:32 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1683 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:33.420342 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4506efd4-c6aa-46f3-a43b-360add76dae3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:33.445622 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4506efd4-c6aa-46f3-a43b-360add76dae3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:33.473480 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4506efd4-c6aa-46f3-a43b-360add76dae3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:33.476826 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4506efd4-c6aa-46f3-a43b-360add76dae3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:33.478033 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4506efd4-c6aa-46f3-a43b-360add76dae3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:33.478645 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4506efd4-c6aa-46f3-a43b-360add76dae3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:33.622079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e4ab5357-1950-4096-ad58-43fbbcc22e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:33.622705 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e4ab5357-1950-4096-ad58-43fbbcc22e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:33.635239 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4ab5357-1950-4096-ad58-43fbbcc22e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:33.635718 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4ab5357-1950-4096-ad58-43fbbcc22e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:33.636501 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4ab5357-1950-4096-ad58-43fbbcc22e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:33.636939 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4ab5357-1950-4096-ad58-43fbbcc22e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:33.814611 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e4ab5357-1950-4096-ad58-43fbbcc22e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:33.833033 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e4ab5357-1950-4096-ad58-43fbbcc22e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:33.834890 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e4ab5357-1950-4096-ad58-43fbbcc22e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:33.837256 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e4ab5357-1950-4096-ad58-43fbbcc22e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.219126 Jul 31 01:21:33.840768 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1476/2979] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:33 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:21:33.910260 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4506efd4-c6aa-46f3-a43b-360add76dae3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:33.918835 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4506efd4-c6aa-46f3-a43b-360add76dae3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1523 microversion: 2.1 time: 0.536500 Jul 31 01:21:33.921800 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1504/2980] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:33 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1523 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:21:34.273011 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21d4b530-ee24-433a-a767-03adc54e90b4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:34.273828 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-21d4b530-ee24-433a-a767-03adc54e90b4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:34.282475 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21d4b530-ee24-433a-a767-03adc54e90b4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:34.282934 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21d4b530-ee24-433a-a767-03adc54e90b4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:34.283979 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21d4b530-ee24-433a-a767-03adc54e90b4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:34.284423 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21d4b530-ee24-433a-a767-03adc54e90b4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:34.560207 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-21d4b530-ee24-433a-a767-03adc54e90b4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:34.575502 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-21d4b530-ee24-433a-a767-03adc54e90b4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1683 microversion: 2.1 time: 0.306643 Jul 31 01:21:34.576380 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1477/2981] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:34 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1683 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:34.867553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-926875ba-32ff-4dd8-b8f0-31eb2cd4c4b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:34.868183 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-926875ba-32ff-4dd8-b8f0-31eb2cd4c4b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:34.899070 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-926875ba-32ff-4dd8-b8f0-31eb2cd4c4b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:34.904751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-926875ba-32ff-4dd8-b8f0-31eb2cd4c4b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:34.909395 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-926875ba-32ff-4dd8-b8f0-31eb2cd4c4b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:34.911051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-926875ba-32ff-4dd8-b8f0-31eb2cd4c4b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:34.940967 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aaad9d0e-6b96-4803-8c71-b10ee6af0f57 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:34.942409 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aaad9d0e-6b96-4803-8c71-b10ee6af0f57 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:34.958024 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aaad9d0e-6b96-4803-8c71-b10ee6af0f57 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:34.964973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aaad9d0e-6b96-4803-8c71-b10ee6af0f57 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:34.970862 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aaad9d0e-6b96-4803-8c71-b10ee6af0f57 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:34.988166 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aaad9d0e-6b96-4803-8c71-b10ee6af0f57 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:35.066652 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:35.380459 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-926875ba-32ff-4dd8-b8f0-31eb2cd4c4b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:35.404748 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-926875ba-32ff-4dd8-b8f0-31eb2cd4c4b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:35.409013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-926875ba-32ff-4dd8-b8f0-31eb2cd4c4b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:35.417107 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-926875ba-32ff-4dd8-b8f0-31eb2cd4c4b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.552652 Jul 31 01:21:35.421544 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1505/2982] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:34 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:35.466203 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-aaad9d0e-6b96-4803-8c71-b10ee6af0f57 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:35.487516 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aaad9d0e-6b96-4803-8c71-b10ee6af0f57 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1508 microversion: 2.1 time: 0.551688 Jul 31 01:21:35.491570 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1478/2983] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:34 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1508 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:35.514952 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-87458684-8fd9-46b4-92ff-e2c72f990286 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:35.515645 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-87458684-8fd9-46b4-92ff-e2c72f990286 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:35.531983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-87458684-8fd9-46b4-92ff-e2c72f990286 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:35.532516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-87458684-8fd9-46b4-92ff-e2c72f990286 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:35.533381 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-87458684-8fd9-46b4-92ff-e2c72f990286 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:35.539475 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-87458684-8fd9-46b4-92ff-e2c72f990286 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:35.598796 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ec71d80a-89e3-4bf7-83dc-b2622f0129e0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:35.599571 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ec71d80a-89e3-4bf7-83dc-b2622f0129e0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:35.628023 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec71d80a-89e3-4bf7-83dc-b2622f0129e0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:35.633797 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec71d80a-89e3-4bf7-83dc-b2622f0129e0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:35.649804 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec71d80a-89e3-4bf7-83dc-b2622f0129e0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:35.650310 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec71d80a-89e3-4bf7-83dc-b2622f0129e0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:36.013748 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-87458684-8fd9-46b4-92ff-e2c72f990286 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:36.033091 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-87458684-8fd9-46b4-92ff-e2c72f990286 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 200 len: 1508 microversion: 2.1 time: 0.522140 Jul 31 01:21:36.035318 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1506/2984] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:35 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 1508 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:36.072495 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-37f4cbd8-91bc-497d-8d5d-a7d4499893d5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:36.080228 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-37f4cbd8-91bc-497d-8d5d-a7d4499893d5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:36.130288 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37f4cbd8-91bc-497d-8d5d-a7d4499893d5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:36.132740 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37f4cbd8-91bc-497d-8d5d-a7d4499893d5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:36.133747 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37f4cbd8-91bc-497d-8d5d-a7d4499893d5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:36.139690 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37f4cbd8-91bc-497d-8d5d-a7d4499893d5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:36.186084 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ec71d80a-89e3-4bf7-83dc-b2622f0129e0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:36.208559 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ec71d80a-89e3-4bf7-83dc-b2622f0129e0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.606058 Jul 31 01:21:36.210714 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1479/2985] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:35 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:36.225323 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:36.243071 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-37f4cbd8-91bc-497d-8d5d-a7d4499893d5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:21:36.447110 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5eba121a-8701-4651-9dd2-0b6d21691c47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:36.448740 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5eba121a-8701-4651-9dd2-0b6d21691c47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:36.457313 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5eba121a-8701-4651-9dd2-0b6d21691c47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:36.458328 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5eba121a-8701-4651-9dd2-0b6d21691c47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:36.460256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5eba121a-8701-4651-9dd2-0b6d21691c47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:36.461387 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5eba121a-8701-4651-9dd2-0b6d21691c47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:36.522427 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-37f4cbd8-91bc-497d-8d5d-a7d4499893d5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 204 len: 0 microversion: 2.1 time: 0.462500 Jul 31 01:21:36.526318 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1507/2986] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:21:36 2022] DELETE /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:21:36.534376 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-461787cc-4d71-4d9b-aa9d-bf9dd653cc31 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:36.535138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-461787cc-4d71-4d9b-aa9d-bf9dd653cc31 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:36.552828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-461787cc-4d71-4d9b-aa9d-bf9dd653cc31 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:36.553333 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-461787cc-4d71-4d9b-aa9d-bf9dd653cc31 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:36.554168 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-461787cc-4d71-4d9b-aa9d-bf9dd653cc31 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:36.554514 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-461787cc-4d71-4d9b-aa9d-bf9dd653cc31 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:36.657007 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5eba121a-8701-4651-9dd2-0b6d21691c47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:36.684980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5eba121a-8701-4651-9dd2-0b6d21691c47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:36.688178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5eba121a-8701-4651-9dd2-0b6d21691c47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:36.690255 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5eba121a-8701-4651-9dd2-0b6d21691c47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.248621 Jul 31 01:21:36.693858 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1480/2987] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:36 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:21:36.835827 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6d82c32a-e027-4010-8c21-40a5ca1fef32 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1046196720", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "11f04f30-fb24-47ce-b222-88fb5fe4a2ee"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:36.934271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-6d82c32a-e027-4010-8c21-40a5ca1fef32 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] validate_networks() for [('11f04f30-fb24-47ce-b222-88fb5fe4a2ee', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:21:37.047538 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-461787cc-4d71-4d9b-aa9d-bf9dd653cc31 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:37.062324 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-461787cc-4d71-4d9b-aa9d-bf9dd653cc31 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.536896 Jul 31 01:21:37.066557 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1508/2988] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:36 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:37.708885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-6d82c32a-e027-4010-8c21-40a5ca1fef32 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:21:37.709589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-6d82c32a-e027-4010-8c21-40a5ca1fef32 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:21:37.710103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-6d82c32a-e027-4010-8c21-40a5ca1fef32 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:21:37.710601 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-6d82c32a-e027-4010-8c21-40a5ca1fef32 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:21:37.713673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-6d82c32a-e027-4010-8c21-40a5ca1fef32 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:21:37.714347 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-879b0940-0e7a-4fb1-88d5-29f24f17ef47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:37.715169 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-879b0940-0e7a-4fb1-88d5-29f24f17ef47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:37.729377 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-879b0940-0e7a-4fb1-88d5-29f24f17ef47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:37.729865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-879b0940-0e7a-4fb1-88d5-29f24f17ef47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:37.730543 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-879b0940-0e7a-4fb1-88d5-29f24f17ef47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:37.731177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-879b0940-0e7a-4fb1-88d5-29f24f17ef47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:37.732762 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d82c32a-e027-4010-8c21-40a5ca1fef32 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:37.733629 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d82c32a-e027-4010-8c21-40a5ca1fef32 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:37.734511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d82c32a-e027-4010-8c21-40a5ca1fef32 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:37.735283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d82c32a-e027-4010-8c21-40a5ca1fef32 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:37.768103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-6d82c32a-e027-4010-8c21-40a5ca1fef32 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Getting quotas for project 5473e5d0400e44bbaaf59a2c86a14f8a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:21:37.776488 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-6d82c32a-e027-4010-8c21-40a5ca1fef32 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Getting quotas for user 440b48b4049a4a1ea3bfb6cdd372b205 and project 5473e5d0400e44bbaaf59a2c86a14f8a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:21:37.798796 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6d82c32a-e027-4010-8c21-40a5ca1fef32 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:21:37.819627 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6d82c32a-e027-4010-8c21-40a5ca1fef32 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:21:37.993100 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6d82c32a-e027-4010-8c21-40a5ca1fef32 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.162318 Jul 31 01:21:38.000509 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1481/2989] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:21:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:21:38.017861 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4043514a-6140-4875-a5a5-76a23b34a70e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:38.024526 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4043514a-6140-4875-a5a5-76a23b34a70e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:38.113126 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-879b0940-0e7a-4fb1-88d5-29f24f17ef47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:38.139159 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-879b0940-0e7a-4fb1-88d5-29f24f17ef47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:38.141856 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-879b0940-0e7a-4fb1-88d5-29f24f17ef47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:38.158992 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-879b0940-0e7a-4fb1-88d5-29f24f17ef47 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.444094 Jul 31 01:21:38.163017 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1509/2990] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:37 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:38.262203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-831a5044-32ea-4a71-87c3-3f4751e2b138 req-cab4370c-9e26-47ad-a313-167bf11dd58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f0abec-dd05-4dff-8f15-b56464346b06", "name": "network-vif-unplugged", "status": "completed", "tag": "02e5aa3d-f780-459d-9466-4437ed729ddc"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:38.305034 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-831a5044-32ea-4a71-87c3-3f4751e2b138 req-cab4370c-9e26-47ad-a313-167bf11dd58f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:38.305498 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-831a5044-32ea-4a71-87c3-3f4751e2b138 req-cab4370c-9e26-47ad-a313-167bf11dd58f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:38.338213 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-831a5044-32ea-4a71-87c3-3f4751e2b138 req-cab4370c-9e26-47ad-a313-167bf11dd58f service nova] Creating event network-vif-unplugged:02e5aa3d-f780-459d-9466-4437ed729ddc for instance e7f0abec-dd05-4dff-8f15-b56464346b06 on n-h2-master-1 Jul 31 01:21:38.347801 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-831a5044-32ea-4a71-87c3-3f4751e2b138 req-cab4370c-9e26-47ad-a313-167bf11dd58f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090846 Jul 31 01:21:38.350143 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1510/2991] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:21:38.363613 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3c842b5a-143e-4086-bd66-2e0d5b98f431 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:38.367269 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3c842b5a-143e-4086-bd66-2e0d5b98f431 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:38.384190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c842b5a-143e-4086-bd66-2e0d5b98f431 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:38.384661 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c842b5a-143e-4086-bd66-2e0d5b98f431 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:38.399054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c842b5a-143e-4086-bd66-2e0d5b98f431 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:38.403813 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c842b5a-143e-4086-bd66-2e0d5b98f431 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:38.424137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4043514a-6140-4875-a5a5-76a23b34a70e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:38.435012 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4043514a-6140-4875-a5a5-76a23b34a70e tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1218 microversion: 2.1 time: 0.429556 Jul 31 01:21:38.438389 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1482/2992] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:38 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1218 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:38.499089 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3c842b5a-143e-4086-bd66-2e0d5b98f431 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147622 Jul 31 01:21:38.500407 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1511/2993] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:21:38 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:21:38.514840 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-229d1f51-3b79-4261-8f59-618d39e2dc8f tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:38.516234 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-229d1f51-3b79-4261-8f59-618d39e2dc8f tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:38.525630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-229d1f51-3b79-4261-8f59-618d39e2dc8f tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:38.526480 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-229d1f51-3b79-4261-8f59-618d39e2dc8f tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:38.527658 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-229d1f51-3b79-4261-8f59-618d39e2dc8f tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:38.528314 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-229d1f51-3b79-4261-8f59-618d39e2dc8f tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:38.716705 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-229d1f51-3b79-4261-8f59-618d39e2dc8f tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lazy-loading 'services' on Instance uuid 5f6be904-5471-4ad5-bd1d-dc6802808c37 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:21:38.942222 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-229d1f51-3b79-4261-8f59-618d39e2dc8f tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37/os-volume_attachments/834838a3-5c18-43eb-98dd-c49acd27ba15" status: 202 len: 0 microversion: 2.1 time: 0.413114 Jul 31 01:21:38.947892 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1483/2994] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 01:21:38 2022] DELETE /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37/os-volume_attachments/834838a3-5c18-43eb-98dd-c49acd27ba15 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:21:39.195528 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-14a16207-0a33-4240-8668-d914a93a4ba8 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:39.196731 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-14a16207-0a33-4240-8668-d914a93a4ba8 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:39.221173 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14a16207-0a33-4240-8668-d914a93a4ba8 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:39.224274 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14a16207-0a33-4240-8668-d914a93a4ba8 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:39.225802 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14a16207-0a33-4240-8668-d914a93a4ba8 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:39.229798 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14a16207-0a33-4240-8668-d914a93a4ba8 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:39.467181 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eb057907-1c2e-4605-9971-e77d72e6f902 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:39.469026 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eb057907-1c2e-4605-9971-e77d72e6f902 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:39.499261 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-14a16207-0a33-4240-8668-d914a93a4ba8 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:39.537190 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-14a16207-0a33-4240-8668-d914a93a4ba8 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:39.544798 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-14a16207-0a33-4240-8668-d914a93a4ba8 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:39.559161 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-14a16207-0a33-4240-8668-d914a93a4ba8 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.370060 Jul 31 01:21:39.588410 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1512/2995] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:39 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:39.810204 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eb057907-1c2e-4605-9971-e77d72e6f902 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:39.824689 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eb057907-1c2e-4605-9971-e77d72e6f902 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1218 microversion: 2.1 time: 0.362135 Jul 31 01:21:39.826093 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1484/2996] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:39 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1218 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:40.190837 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-b93853b1-90d7-4ec0-bfef-f2f5df1eb1a5 req-aa77814b-c9ba-4f07-b897-204e815a0152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae5b84e-919e-4ad7-8348-9d4326695306", "name": "network-vif-deleted", "tag": "e639f0c2-df6c-4867-a6d5-a8e4da2fee54"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:40.210022 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b93853b1-90d7-4ec0-bfef-f2f5df1eb1a5 req-aa77814b-c9ba-4f07-b897-204e815a0152 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:40.210670 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b93853b1-90d7-4ec0-bfef-f2f5df1eb1a5 req-aa77814b-c9ba-4f07-b897-204e815a0152 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:40.238183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ba7cafd8-001d-484b-a580-42f5fcf86d47 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:40.238869 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ba7cafd8-001d-484b-a580-42f5fcf86d47 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:40.249900 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-b93853b1-90d7-4ec0-bfef-f2f5df1eb1a5 req-aa77814b-c9ba-4f07-b897-204e815a0152 service nova] Creating event network-vif-deleted:e639f0c2-df6c-4867-a6d5-a8e4da2fee54 for instance 3ae5b84e-919e-4ad7-8348-9d4326695306 on n-h2-master-1 Jul 31 01:21:40.260132 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-b93853b1-90d7-4ec0-bfef-f2f5df1eb1a5 req-aa77814b-c9ba-4f07-b897-204e815a0152 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.421640 Jul 31 01:21:40.260386 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba7cafd8-001d-484b-a580-42f5fcf86d47 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:40.261509 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba7cafd8-001d-484b-a580-42f5fcf86d47 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:40.262802 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1513/2997] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:21:40.265438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba7cafd8-001d-484b-a580-42f5fcf86d47 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:40.267199 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba7cafd8-001d-484b-a580-42f5fcf86d47 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:40.543955 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ba7cafd8-001d-484b-a580-42f5fcf86d47 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:40.569164 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ba7cafd8-001d-484b-a580-42f5fcf86d47 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.341524 Jul 31 01:21:40.582807 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1485/2998] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:40 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:21:40.594501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-aef918e9-660e-4ef1-a809-ebb939c99a81 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:40.595243 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-aef918e9-660e-4ef1-a809-ebb939c99a81 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:40.604782 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4b640319-928e-4433-a837-23d6fc661542 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:40.605745 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4b640319-928e-4433-a837-23d6fc661542 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:40.623310 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b640319-928e-4433-a837-23d6fc661542 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:40.625269 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b640319-928e-4433-a837-23d6fc661542 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:40.626255 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b640319-928e-4433-a837-23d6fc661542 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:40.626895 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b640319-928e-4433-a837-23d6fc661542 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:40.628147 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aef918e9-660e-4ef1-a809-ebb939c99a81 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:40.632937 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aef918e9-660e-4ef1-a809-ebb939c99a81 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:40.633923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aef918e9-660e-4ef1-a809-ebb939c99a81 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:40.634392 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aef918e9-660e-4ef1-a809-ebb939c99a81 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:40.978140 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4b640319-928e-4433-a837-23d6fc661542 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:41.016449 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4b640319-928e-4433-a837-23d6fc661542 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:41.020982 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4b640319-928e-4433-a837-23d6fc661542 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:41.022258 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4b640319-928e-4433-a837-23d6fc661542 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.423738 Jul 31 01:21:41.022839 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1486/2999] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:40 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:41.053522 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0e6352b0-6b3a-423a-80c9-55eedee3f77b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:41.054330 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0e6352b0-6b3a-423a-80c9-55eedee3f77b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:41.071907 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e6352b0-6b3a-423a-80c9-55eedee3f77b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:41.072378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e6352b0-6b3a-423a-80c9-55eedee3f77b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:41.073181 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e6352b0-6b3a-423a-80c9-55eedee3f77b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:41.073838 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e6352b0-6b3a-423a-80c9-55eedee3f77b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:41.181771 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-aef918e9-660e-4ef1-a809-ebb939c99a81 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:41.193897 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-aef918e9-660e-4ef1-a809-ebb939c99a81 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.603775 Jul 31 01:21:41.208522 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1514/3000] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:40 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:41.229219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-65d0c431-1d82-4e00-aeb4-a7650e653eb3 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:41.229907 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-65d0c431-1d82-4e00-aeb4-a7650e653eb3 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:41.247408 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65d0c431-1d82-4e00-aeb4-a7650e653eb3 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:41.249863 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65d0c431-1d82-4e00-aeb4-a7650e653eb3 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:41.250776 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65d0c431-1d82-4e00-aeb4-a7650e653eb3 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:41.251240 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65d0c431-1d82-4e00-aeb4-a7650e653eb3 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:41.257401 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e6352b0-6b3a-423a-80c9-55eedee3f77b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:41.274196 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0e6352b0-6b3a-423a-80c9-55eedee3f77b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1288 microversion: 2.1 time: 0.234699 Jul 31 01:21:41.287373 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1487/3001] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:41 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1288 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:41.720916 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-65d0c431-1d82-4e00-aeb4-a7650e653eb3 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:41.747945 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-65d0c431-1d82-4e00-aeb4-a7650e653eb3 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.531144 Jul 31 01:21:41.752338 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1515/3002] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:41 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:41.774600 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-afd0e372-4a00-4958-a289-7a23ac685b8b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:41.777052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-afd0e372-4a00-4958-a289-7a23ac685b8b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:41.818392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-afd0e372-4a00-4958-a289-7a23ac685b8b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:41.818867 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-afd0e372-4a00-4958-a289-7a23ac685b8b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:41.819706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-afd0e372-4a00-4958-a289-7a23ac685b8b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:41.820155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-afd0e372-4a00-4958-a289-7a23ac685b8b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:42.010236 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-afd0e372-4a00-4958-a289-7a23ac685b8b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 202 len: 0 microversion: 2.1 time: 0.238348 Jul 31 01:21:42.012485 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1488/3003] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:21:41 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:21:42.020842 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cdb247fa-64f7-41d7-92d3-80277034f3b3 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:42.022856 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cdb247fa-64f7-41d7-92d3-80277034f3b3 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:42.039488 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdb247fa-64f7-41d7-92d3-80277034f3b3 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:42.039968 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdb247fa-64f7-41d7-92d3-80277034f3b3 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:42.042314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdb247fa-64f7-41d7-92d3-80277034f3b3 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:42.042314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdb247fa-64f7-41d7-92d3-80277034f3b3 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:42.050695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6c67e4cd-2919-46d0-aae7-afc00d030950 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:42.051879 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6c67e4cd-2919-46d0-aae7-afc00d030950 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:42.099402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c67e4cd-2919-46d0-aae7-afc00d030950 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:42.100615 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c67e4cd-2919-46d0-aae7-afc00d030950 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:42.103101 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c67e4cd-2919-46d0-aae7-afc00d030950 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:42.105681 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c67e4cd-2919-46d0-aae7-afc00d030950 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:43.388258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6c67e4cd-2919-46d0-aae7-afc00d030950 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:43.407025 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6c67e4cd-2919-46d0-aae7-afc00d030950 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:43.418431 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6c67e4cd-2919-46d0-aae7-afc00d030950 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:43.423591 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6c67e4cd-2919-46d0-aae7-afc00d030950 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 1.378207 Jul 31 01:21:43.425320 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1489/3004] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:42 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:43.457237 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a8690af2-b73a-4992-aa7c-63664dbfd6c4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:43.457886 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a8690af2-b73a-4992-aa7c-63664dbfd6c4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:43.480871 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8690af2-b73a-4992-aa7c-63664dbfd6c4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:43.481594 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8690af2-b73a-4992-aa7c-63664dbfd6c4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:43.484559 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8690af2-b73a-4992-aa7c-63664dbfd6c4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:43.485233 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8690af2-b73a-4992-aa7c-63664dbfd6c4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:44.346272 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cdb247fa-64f7-41d7-92d3-80277034f3b3 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:44.360489 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cdb247fa-64f7-41d7-92d3-80277034f3b3 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1672 microversion: 2.1 time: 2.338891 Jul 31 01:21:44.361690 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1516/3005] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:42 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1672 bytes in 2345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:44.741605 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c1b3f152-bac1-4f12-9aec-e22c4fcbf92d tempest-FloatingIPsNegativeTestJSON-746471456 tempest-FloatingIPsNegativeTestJSON-746471456-project] Calling method '.version_select at 0x7fede52a7a60>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:44.968073 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c1b3f152-bac1-4f12-9aec-e22c4fcbf92d tempest-FloatingIPsNegativeTestJSON-746471456 tempest-FloatingIPsNegativeTestJSON-746471456-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.594833 Jul 31 01:21:44.968073 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1517/3006] 10.222.0.45 () {58 vars in 1149 bytes} [Sun Jul 31 01:21:44 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:21:44.977321 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e48f938e-7300-4f7e-a9e2-18798fa1e5f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:44.978489 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e48f938e-7300-4f7e-a9e2-18798fa1e5f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:44.986341 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e48f938e-7300-4f7e-a9e2-18798fa1e5f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:44.990312 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e48f938e-7300-4f7e-a9e2-18798fa1e5f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:44.995764 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e48f938e-7300-4f7e-a9e2-18798fa1e5f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:44.996776 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e48f938e-7300-4f7e-a9e2-18798fa1e5f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:45.002381 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a8690af2-b73a-4992-aa7c-63664dbfd6c4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:45.013620 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a8690af2-b73a-4992-aa7c-63664dbfd6c4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1318 microversion: 2.1 time: 1.568538 Jul 31 01:21:45.014754 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1490/3007] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:43 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1318 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:45.042465 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dd8a6cd1-d15b-4905-a95c-b6e329c62343 tempest-FloatingIPsNegativeTestJSON-746471456 tempest-FloatingIPsNegativeTestJSON-746471456-project] Action: 'create', calling method: .version_select at 0x7fedea871c10>, body: {"pool": "non_exist_pool"} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:45.298793 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-dd8a6cd1-d15b-4905-a95c-b6e329c62343 tempest-FloatingIPsNegativeTestJSON-746471456 tempest-FloatingIPsNegativeTestJSON-746471456-project] HTTP exception thrown: Floating IP pool not found. Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dd8a6cd1-d15b-4905-a95c-b6e329c62343 tempest-FloatingIPsNegativeTestJSON-746471456 tempest-FloatingIPsNegativeTestJSON-746471456-project] Request method failure captured: Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 26 Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dkn4lRYmTijDVezM08DxC_mDQ00hF0mjuVuy3ORtKb4NNsCVjsqyZPZr5ZbCtuAzb6EdRmOehwpxz1dIIOEpR8QKCOzFX_VOcPSRY8PS51Qz8GkLKmo3GvKrDQ6YAvHvX0eh_r2FpaskGwvbTnQwnymQI7laaLLYlUXGkOc-i5SFPU Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 9abfdd4e8e894e1badd7416f3328bf5f Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-746471456 Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9abfdd4e8e894e1badd7416f3328bf5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9abfdd4e8e894e1badd7416f3328bf5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9abfdd4e8e894e1badd7416f3328bf5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9abfdd4e8e894e1badd7416f3328bf5f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-746471456 Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 9abfdd4e8e894e1badd7416f3328bf5f Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-746471456 Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-FloatingIPsNegativeTestJSON-746471456-project Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 4c9f465c9692450b840b013e05823182 Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-746471456-project Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: {"pool": "non_exist_pool"} Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: exception: Floating IP pool not found. Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:21:45.300484 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:21:45.305314 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 31 01:21:45.305314 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:45.305314 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dd8a6cd1-d15b-4905-a95c-b6e329c62343 tempest-FloatingIPsNegativeTestJSON-746471456 tempest-FloatingIPsNegativeTestJSON-746471456-project] Returning 404 to user: Floating IP pool not found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:21:45.305314 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dd8a6cd1-d15b-4905-a95c-b6e329c62343 tempest-FloatingIPsNegativeTestJSON-746471456 tempest-FloatingIPsNegativeTestJSON-746471456-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.286221 Jul 31 01:21:45.305314 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1491/3008] 10.222.0.45 () {60 vars in 1170 bytes} [Sun Jul 31 01:21:45 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 287 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:21:45.316474 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-de3292bf-12b5-426b-bc23-e461a696ab5d tempest-FloatingIPsNegativeTestJSON-746471456 tempest-FloatingIPsNegativeTestJSON-746471456-project] Calling method '.version_select at 0x7fede4f605e0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:45.325703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e48f938e-7300-4f7e-a9e2-18798fa1e5f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:45.337122 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e48f938e-7300-4f7e-a9e2-18798fa1e5f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:45.349021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e48f938e-7300-4f7e-a9e2-18798fa1e5f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:45.350332 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e48f938e-7300-4f7e-a9e2-18798fa1e5f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.384552 Jul 31 01:21:45.363383 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1518/3009] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:44 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:45.382347 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1a5d3384-e1e0-42a7-afce-ad01355b69d9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:45.382900 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1a5d3384-e1e0-42a7-afce-ad01355b69d9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:45.401005 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a5d3384-e1e0-42a7-afce-ad01355b69d9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:45.401447 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a5d3384-e1e0-42a7-afce-ad01355b69d9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:45.402270 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a5d3384-e1e0-42a7-afce-ad01355b69d9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:45.402728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a5d3384-e1e0-42a7-afce-ad01355b69d9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:45.651789 n-d-master-1 devstack@n-api.service[119474]: DEBUG neutronclient.v2_0.client [None req-de3292bf-12b5-426b-bc23-e461a696ab5d tempest-FloatingIPsNegativeTestJSON-746471456 tempest-FloatingIPsNegativeTestJSON-746471456-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7f639821-f57e-4448-8e87-1ae8ba56cc87 could not be found", "detail": ""}} {{(pid=119474) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 31 01:21:45.652494 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-de3292bf-12b5-426b-bc23-e461a696ab5d tempest-FloatingIPsNegativeTestJSON-746471456 tempest-FloatingIPsNegativeTestJSON-746471456-project] HTTP exception thrown: Floating IP not found for ID 7f639821-f57e-4448-8e87-1ae8ba56cc87 Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-de3292bf-12b5-426b-bc23-e461a696ab5d tempest-FloatingIPsNegativeTestJSON-746471456 tempest-FloatingIPsNegativeTestJSON-746471456-project] Request method failure captured: Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/os-floating-ips/7f639821-f57e-4448-8e87-1ae8ba56cc87 HTTP/1.1 Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dkn4lRYmTijDVezM08DxC_mDQ00hF0mjuVuy3ORtKb4NNsCVjsqyZPZr5ZbCtuAzb6EdRmOehwpxz1dIIOEpR8QKCOzFX_VOcPSRY8PS51Qz8GkLKmo3GvKrDQ6YAvHvX0eh_r2FpaskGwvbTnQwnymQI7laaLLYlUXGkOc-i5SFPU Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 9abfdd4e8e894e1badd7416f3328bf5f Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-746471456 Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9abfdd4e8e894e1badd7416f3328bf5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9abfdd4e8e894e1badd7416f3328bf5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9abfdd4e8e894e1badd7416f3328bf5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9abfdd4e8e894e1badd7416f3328bf5f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-746471456 Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 9abfdd4e8e894e1badd7416f3328bf5f Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-746471456 Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-FloatingIPsNegativeTestJSON-746471456-project Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 4c9f465c9692450b840b013e05823182 Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-746471456-project Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: exception: Floating IP not found for ID 7f639821-f57e-4448-8e87-1ae8ba56cc87 Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '7f639821-f57e-4448-8e87-1ae8ba56cc87'} Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7f639821-f57e-4448-8e87-1ae8ba56cc87 could not be found Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b14d7a7c-f3f9-4d3a-822b-37c722c5c6e8'] Jul 31 01:21:45.654324 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7f639821-f57e-4448-8e87-1ae8ba56cc87. Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7f639821-f57e-4448-8e87-1ae8ba56cc87 Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7f639821-f57e-4448-8e87-1ae8ba56cc87 Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-de3292bf-12b5-426b-bc23-e461a696ab5d tempest-FloatingIPsNegativeTestJSON-746471456 tempest-FloatingIPsNegativeTestJSON-746471456-project] Returning 404 to user: Floating IP not found for ID 7f639821-f57e-4448-8e87-1ae8ba56cc87 {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-de3292bf-12b5-426b-bc23-e461a696ab5d tempest-FloatingIPsNegativeTestJSON-746471456 tempest-FloatingIPsNegativeTestJSON-746471456-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/7f639821-f57e-4448-8e87-1ae8ba56cc87" status: 404 len: 111 microversion: 2.1 time: 0.343535 Jul 31 01:21:45.662789 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1492/3010] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:21:45 2022] DELETE /compute/v2.1/os-floating-ips/7f639821-f57e-4448-8e87-1ae8ba56cc87 => generated 111 bytes in 345 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:21:46.040727 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-46615fc2-f1e7-4d1c-9601-c4aa92410db5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:46.042332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-46615fc2-f1e7-4d1c-9601-c4aa92410db5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:46.056206 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46615fc2-f1e7-4d1c-9601-c4aa92410db5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:46.057150 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46615fc2-f1e7-4d1c-9601-c4aa92410db5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:46.058294 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46615fc2-f1e7-4d1c-9601-c4aa92410db5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:46.060738 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46615fc2-f1e7-4d1c-9601-c4aa92410db5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:46.178619 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1a5d3384-e1e0-42a7-afce-ad01355b69d9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:46.193518 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1a5d3384-e1e0-42a7-afce-ad01355b69d9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1672 microversion: 2.1 time: 0.815255 Jul 31 01:21:46.194839 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1519/3011] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:45 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1672 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:21:46.378242 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7070bbc4-861e-4269-9194-aa4c401850b9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:46.379998 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7070bbc4-861e-4269-9194-aa4c401850b9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:46.410558 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7070bbc4-861e-4269-9194-aa4c401850b9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:46.412925 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7070bbc4-861e-4269-9194-aa4c401850b9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:46.418052 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7070bbc4-861e-4269-9194-aa4c401850b9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:46.418933 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7070bbc4-861e-4269-9194-aa4c401850b9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:46.539137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-46615fc2-f1e7-4d1c-9601-c4aa92410db5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:46.549646 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-46615fc2-f1e7-4d1c-9601-c4aa92410db5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1318 microversion: 2.1 time: 0.514204 Jul 31 01:21:46.551668 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1493/3012] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:46 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:46.972246 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7070bbc4-861e-4269-9194-aa4c401850b9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:47.016143 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7070bbc4-861e-4269-9194-aa4c401850b9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:47.017890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7070bbc4-861e-4269-9194-aa4c401850b9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:47.019192 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7070bbc4-861e-4269-9194-aa4c401850b9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.645079 Jul 31 01:21:47.028212 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1520/3013] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:46 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:21:47.222413 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9ba81c7f-337e-4d35-a6a8-d5af4ad1c658 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:47.223185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9ba81c7f-337e-4d35-a6a8-d5af4ad1c658 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:47.250604 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ba81c7f-337e-4d35-a6a8-d5af4ad1c658 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:47.258916 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ba81c7f-337e-4d35-a6a8-d5af4ad1c658 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:47.264731 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ba81c7f-337e-4d35-a6a8-d5af4ad1c658 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:47.265197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ba81c7f-337e-4d35-a6a8-d5af4ad1c658 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:47.573225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2a7601ca-65c7-44c0-b94b-8b22dd45b185 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:47.573861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2a7601ca-65c7-44c0-b94b-8b22dd45b185 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:47.584993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2a7601ca-65c7-44c0-b94b-8b22dd45b185 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:47.591427 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2a7601ca-65c7-44c0-b94b-8b22dd45b185 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:47.592630 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2a7601ca-65c7-44c0-b94b-8b22dd45b185 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:47.600175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2a7601ca-65c7-44c0-b94b-8b22dd45b185 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:47.754933 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:49.424774 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9ba81c7f-337e-4d35-a6a8-d5af4ad1c658 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:49.429673 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2a7601ca-65c7-44c0-b94b-8b22dd45b185 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:49.485848 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2a7601ca-65c7-44c0-b94b-8b22dd45b185 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1318 microversion: 2.1 time: 1.909096 Jul 31 01:21:49.487895 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9ba81c7f-337e-4d35-a6a8-d5af4ad1c658 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1672 microversion: 2.1 time: 2.268737 Jul 31 01:21:49.489135 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1521/3014] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:47 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1318 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:49.493163 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1494/3015] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:47 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1672 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:49.506942 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-88004828-5a94-45fc-a9b8-1cfc6c92982d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:49.508711 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-88004828-5a94-45fc-a9b8-1cfc6c92982d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:49.539780 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88004828-5a94-45fc-a9b8-1cfc6c92982d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:49.542149 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88004828-5a94-45fc-a9b8-1cfc6c92982d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:49.545995 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88004828-5a94-45fc-a9b8-1cfc6c92982d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:49.547927 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88004828-5a94-45fc-a9b8-1cfc6c92982d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:49.880733 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-88004828-5a94-45fc-a9b8-1cfc6c92982d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:49.911993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-88004828-5a94-45fc-a9b8-1cfc6c92982d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:49.924478 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-88004828-5a94-45fc-a9b8-1cfc6c92982d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:49.930120 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-88004828-5a94-45fc-a9b8-1cfc6c92982d tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.435527 Jul 31 01:21:49.932480 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1522/3016] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:49 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:50.514766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9151899a-5e32-44ad-b389-39040be620ee tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:50.515431 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9151899a-5e32-44ad-b389-39040be620ee tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:50.530171 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6dd14233-7646-4dc3-9f23-f17e25ca5355 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:50.530820 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6dd14233-7646-4dc3-9f23-f17e25ca5355 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:50.549166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6dd14233-7646-4dc3-9f23-f17e25ca5355 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:50.549639 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6dd14233-7646-4dc3-9f23-f17e25ca5355 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:50.550448 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6dd14233-7646-4dc3-9f23-f17e25ca5355 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:50.550903 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6dd14233-7646-4dc3-9f23-f17e25ca5355 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:50.553964 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=10 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:50.557816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9151899a-5e32-44ad-b389-39040be620ee tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:50.558218 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9151899a-5e32-44ad-b389-39040be620ee tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:50.559199 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9151899a-5e32-44ad-b389-39040be620ee tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:50.560241 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9151899a-5e32-44ad-b389-39040be620ee tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:51.653558 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9151899a-5e32-44ad-b389-39040be620ee tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:51.665216 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9151899a-5e32-44ad-b389-39040be620ee tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 1.153350 Jul 31 01:21:51.666107 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1495/3017] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:50 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:51.674377 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9a56bac8-705d-4ade-ab33-343e57d3d9f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:51.687240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9a56bac8-705d-4ade-ab33-343e57d3d9f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:51.703085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6dd14233-7646-4dc3-9f23-f17e25ca5355 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:51.706594 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a56bac8-705d-4ade-ab33-343e57d3d9f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:51.710666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a56bac8-705d-4ade-ab33-343e57d3d9f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:51.714028 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6dd14233-7646-4dc3-9f23-f17e25ca5355 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1318 microversion: 2.1 time: 1.193660 Jul 31 01:21:51.714471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a56bac8-705d-4ade-ab33-343e57d3d9f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:51.728206 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1523/3018] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:50 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1318 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:51.729072 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a56bac8-705d-4ade-ab33-343e57d3d9f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:51.749785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8bca627f-3d26-409c-a254-6077ada638d6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:51.779090 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8bca627f-3d26-409c-a254-6077ada638d6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:51.813422 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8bca627f-3d26-409c-a254-6077ada638d6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:51.816989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8bca627f-3d26-409c-a254-6077ada638d6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:51.819980 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8bca627f-3d26-409c-a254-6077ada638d6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:51.820455 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8bca627f-3d26-409c-a254-6077ada638d6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:51.974549 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8bca627f-3d26-409c-a254-6077ada638d6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 200 len: 322 microversion: 2.1 time: 0.246839 Jul 31 01:21:51.976262 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1524/3019] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:21:51 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:21:52.017357 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-814b8ff0-5e0d-434b-ade2-3c694d7a5d43 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:52.021661 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-814b8ff0-5e0d-434b-ade2-3c694d7a5d43 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:52.055696 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-814b8ff0-5e0d-434b-ade2-3c694d7a5d43 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:52.058244 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-814b8ff0-5e0d-434b-ade2-3c694d7a5d43 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:52.061599 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-814b8ff0-5e0d-434b-ade2-3c694d7a5d43 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:52.068279 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-814b8ff0-5e0d-434b-ade2-3c694d7a5d43 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:52.079489 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:52.276361 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9a56bac8-705d-4ade-ab33-343e57d3d9f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:52.297590 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9a56bac8-705d-4ade-ab33-343e57d3d9f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:52.315940 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9a56bac8-705d-4ade-ab33-343e57d3d9f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:52.321083 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9a56bac8-705d-4ade-ab33-343e57d3d9f4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.649137 Jul 31 01:21:52.326530 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1496/3020] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:51 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:52.362872 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-80d9b5c1-ca49-4cd1-bdd0-014cd4317787 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:52.367050 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-80d9b5c1-ca49-4cd1-bdd0-014cd4317787 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:52.390684 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80d9b5c1-ca49-4cd1-bdd0-014cd4317787 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:52.399412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80d9b5c1-ca49-4cd1-bdd0-014cd4317787 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:52.400787 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80d9b5c1-ca49-4cd1-bdd0-014cd4317787 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:52.401891 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80d9b5c1-ca49-4cd1-bdd0-014cd4317787 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:52.546312 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-80d9b5c1-ca49-4cd1-bdd0-014cd4317787 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.208907 Jul 31 01:21:52.547375 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1497/3021] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:21:52 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37/os-volume_attachments => generated 25 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:21:52.610347 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-2ab95f03-ff31-4f13-97aa-e550ef99bafb req-bc3c5b06-e6e1-4719-8efb-c5fdcf0bbe37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef", "tag": "ae1cb343-a9a3-40ae-b39e-13af344f6e1f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:52.634645 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2ab95f03-ff31-4f13-97aa-e550ef99bafb req-bc3c5b06-e6e1-4719-8efb-c5fdcf0bbe37 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:52.644227 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2ab95f03-ff31-4f13-97aa-e550ef99bafb req-bc3c5b06-e6e1-4719-8efb-c5fdcf0bbe37 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:52.649627 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:52.695114 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-2ab95f03-ff31-4f13-97aa-e550ef99bafb req-bc3c5b06-e6e1-4719-8efb-c5fdcf0bbe37 service nova] Creating event network-changed:ae1cb343-a9a3-40ae-b39e-13af344f6e1f for instance 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef on n-h1-master-1 Jul 31 01:21:52.707488 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-2ab95f03-ff31-4f13-97aa-e550ef99bafb req-bc3c5b06-e6e1-4719-8efb-c5fdcf0bbe37 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101521 Jul 31 01:21:52.709032 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1498/3022] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:21:52.720357 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fbe04be6-ddc4-48fe-8fbf-5d17d28c5a31 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:52.728662 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fbe04be6-ddc4-48fe-8fbf-5d17d28c5a31 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:52.759367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbe04be6-ddc4-48fe-8fbf-5d17d28c5a31 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:52.761625 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbe04be6-ddc4-48fe-8fbf-5d17d28c5a31 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:52.762696 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbe04be6-ddc4-48fe-8fbf-5d17d28c5a31 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:52.763867 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbe04be6-ddc4-48fe-8fbf-5d17d28c5a31 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:52.859881 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fbe04be6-ddc4-48fe-8fbf-5d17d28c5a31 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.148307 Jul 31 01:21:52.866776 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1499/3023] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:21:52 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:21:52.878097 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-41d9d90f-356e-4de2-9c21-df0ebd128772 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:52.879839 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-814b8ff0-5e0d-434b-ade2-3c694d7a5d43 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:52.880366 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-41d9d90f-356e-4de2-9c21-df0ebd128772 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:52.896484 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-814b8ff0-5e0d-434b-ade2-3c694d7a5d43 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.914726 Jul 31 01:21:52.896832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41d9d90f-356e-4de2-9c21-df0ebd128772 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:52.898501 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41d9d90f-356e-4de2-9c21-df0ebd128772 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:52.899629 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41d9d90f-356e-4de2-9c21-df0ebd128772 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:52.902759 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41d9d90f-356e-4de2-9c21-df0ebd128772 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:52.911489 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1525/3024] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:51 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:52.926839 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d9324213-c39d-4f1c-ab93-2737e390aa5d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:52.935635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d9324213-c39d-4f1c-ab93-2737e390aa5d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:52.946197 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9324213-c39d-4f1c-ab93-2737e390aa5d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:52.946668 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9324213-c39d-4f1c-ab93-2737e390aa5d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:52.947509 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9324213-c39d-4f1c-ab93-2737e390aa5d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:52.948046 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9324213-c39d-4f1c-ab93-2737e390aa5d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:53.796038 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-41d9d90f-356e-4de2-9c21-df0ebd128772 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:53.812497 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-41d9d90f-356e-4de2-9c21-df0ebd128772 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1318 microversion: 2.1 time: 0.948203 Jul 31 01:21:53.813386 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1500/3025] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:52 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1318 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:53.818337 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1bffc098-1ee9-4595-8b40-a320a263c7d6 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:53.819914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1bffc098-1ee9-4595-8b40-a320a263c7d6 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:53.837583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1bffc098-1ee9-4595-8b40-a320a263c7d6 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:53.839194 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1bffc098-1ee9-4595-8b40-a320a263c7d6 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:53.840470 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1bffc098-1ee9-4595-8b40-a320a263c7d6 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:53.841267 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1bffc098-1ee9-4595-8b40-a320a263c7d6 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:53.863467 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d9324213-c39d-4f1c-ab93-2737e390aa5d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:53.876480 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d9324213-c39d-4f1c-ab93-2737e390aa5d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.953769 Jul 31 01:21:53.877102 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1526/3026] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:52 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:21:53.881957 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f8c31aad-ed97-43a0-b8c7-f9423ce36404 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:53.888762 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f8c31aad-ed97-43a0-b8c7-f9423ce36404 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:53.892402 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1bffc098-1ee9-4595-8b40-a320a263c7d6 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:21:53.907192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8c31aad-ed97-43a0-b8c7-f9423ce36404 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:53.907960 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8c31aad-ed97-43a0-b8c7-f9423ce36404 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:53.908915 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8c31aad-ed97-43a0-b8c7-f9423ce36404 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:53.909505 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8c31aad-ed97-43a0-b8c7-f9423ce36404 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:54.053486 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1bffc098-1ee9-4595-8b40-a320a263c7d6 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 204 len: 0 microversion: 2.1 time: 0.238563 Jul 31 01:21:54.057077 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1501/3027] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:21:53 2022] DELETE /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:21:54.068497 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-99970427-b82b-4d76-8d4f-6b4ed8cb3d0b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:54.070192 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-99970427-b82b-4d76-8d4f-6b4ed8cb3d0b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:54.077162 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99970427-b82b-4d76-8d4f-6b4ed8cb3d0b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:54.077953 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99970427-b82b-4d76-8d4f-6b4ed8cb3d0b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:54.079152 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99970427-b82b-4d76-8d4f-6b4ed8cb3d0b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:54.080093 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99970427-b82b-4d76-8d4f-6b4ed8cb3d0b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:54.150513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f8c31aad-ed97-43a0-b8c7-f9423ce36404 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:54.174647 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f8c31aad-ed97-43a0-b8c7-f9423ce36404 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:54.176644 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f8c31aad-ed97-43a0-b8c7-f9423ce36404 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:54.177896 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f8c31aad-ed97-43a0-b8c7-f9423ce36404 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.299687 Jul 31 01:21:54.178455 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1527/3028] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:53 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:54.187400 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d16812c3-065c-4d42-9f3d-9fb2ab583f28 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:54.188338 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d16812c3-065c-4d42-9f3d-9fb2ab583f28 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:54.195740 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d16812c3-065c-4d42-9f3d-9fb2ab583f28 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:54.196427 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d16812c3-065c-4d42-9f3d-9fb2ab583f28 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:54.197392 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d16812c3-065c-4d42-9f3d-9fb2ab583f28 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:54.198072 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d16812c3-065c-4d42-9f3d-9fb2ab583f28 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:55.202951 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-99970427-b82b-4d76-8d4f-6b4ed8cb3d0b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:55.216123 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-99970427-b82b-4d76-8d4f-6b4ed8cb3d0b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 1.155132 Jul 31 01:21:55.225096 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1502/3029] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:54 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:55.241008 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-89ed55eb-4a0d-44e4-8b99-dd1a03071450 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:55.241388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-89ed55eb-4a0d-44e4-8b99-dd1a03071450 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:55.271828 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-89ed55eb-4a0d-44e4-8b99-dd1a03071450 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:55.274997 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-89ed55eb-4a0d-44e4-8b99-dd1a03071450 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:55.275911 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-89ed55eb-4a0d-44e4-8b99-dd1a03071450 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:55.277234 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-89ed55eb-4a0d-44e4-8b99-dd1a03071450 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:55.648650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d16812c3-065c-4d42-9f3d-9fb2ab583f28 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:55.671254 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d16812c3-065c-4d42-9f3d-9fb2ab583f28 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1681 microversion: 2.1 time: 1.489091 Jul 31 01:21:55.699189 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1528/3030] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:54 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1681 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:55.723793 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-df31ee93-8ed5-4bf8-98cf-b17f1f7d8f70 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:55.724928 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-df31ee93-8ed5-4bf8-98cf-b17f1f7d8f70 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:55.780224 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df31ee93-8ed5-4bf8-98cf-b17f1f7d8f70 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:55.797826 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df31ee93-8ed5-4bf8-98cf-b17f1f7d8f70 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:55.810247 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df31ee93-8ed5-4bf8-98cf-b17f1f7d8f70 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:55.810718 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df31ee93-8ed5-4bf8-98cf-b17f1f7d8f70 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:56.005391 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-89ed55eb-4a0d-44e4-8b99-dd1a03071450 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:56.023002 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-89ed55eb-4a0d-44e4-8b99-dd1a03071450 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1318 microversion: 2.1 time: 0.792669 Jul 31 01:21:56.043543 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1503/3031] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:55 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1318 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:56.049851 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-93cd2de6-a05d-4f7c-bee8-ced90259cfe9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:56.057126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-93cd2de6-a05d-4f7c-bee8-ced90259cfe9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:56.084585 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93cd2de6-a05d-4f7c-bee8-ced90259cfe9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:56.086506 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93cd2de6-a05d-4f7c-bee8-ced90259cfe9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:56.093242 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-df31ee93-8ed5-4bf8-98cf-b17f1f7d8f70 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:56.095809 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93cd2de6-a05d-4f7c-bee8-ced90259cfe9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:56.096523 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93cd2de6-a05d-4f7c-bee8-ced90259cfe9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:56.103693 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-df31ee93-8ed5-4bf8-98cf-b17f1f7d8f70 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:56.112683 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-df31ee93-8ed5-4bf8-98cf-b17f1f7d8f70 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:56.120410 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-df31ee93-8ed5-4bf8-98cf-b17f1f7d8f70 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.417260 Jul 31 01:21:56.124465 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1529/3032] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:21:55 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:21:56.448812 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-93cd2de6-a05d-4f7c-bee8-ced90259cfe9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:56.461989 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-93cd2de6-a05d-4f7c-bee8-ced90259cfe9 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.418116 Jul 31 01:21:56.464831 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1504/3033] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:56 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:21:56.722681 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d6fd66c7-03b0-43b1-8d6c-759d06d419eb tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:56.723304 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d6fd66c7-03b0-43b1-8d6c-759d06d419eb tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:56.740921 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6fd66c7-03b0-43b1-8d6c-759d06d419eb tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:56.742527 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6fd66c7-03b0-43b1-8d6c-759d06d419eb tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:56.744763 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6fd66c7-03b0-43b1-8d6c-759d06d419eb tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:56.749632 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6fd66c7-03b0-43b1-8d6c-759d06d419eb tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:56.891519 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0eda8c56-606b-4787-a5ca-11a3564b2f7b tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-933017187", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "75211626-e5b7-4b2a-9395-3d8265878040"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:57.032880 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-0eda8c56-606b-4787-a5ca-11a3564b2f7b tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] validate_networks() for [('75211626-e5b7-4b2a-9395-3d8265878040', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:21:57.456797 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d6fd66c7-03b0-43b1-8d6c-759d06d419eb tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:21:57.485414 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d6fd66c7-03b0-43b1-8d6c-759d06d419eb tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1681 microversion: 2.1 time: 0.768267 Jul 31 01:21:57.489370 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1505/3034] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:56 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1681 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:21:57.503766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a040ad0e-1c88-4906-907c-0b459221ef4f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-914681055", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "97fe48eb-b52c-4abc-b249-8d6775315204"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:21:57.637602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-a040ad0e-1c88-4906-907c-0b459221ef4f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] validate_networks() for [('97fe48eb-b52c-4abc-b249-8d6775315204', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:21:59.132333 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a040ad0e-1c88-4906-907c-0b459221ef4f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:21:59.132964 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a040ad0e-1c88-4906-907c-0b459221ef4f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:21:59.133256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a040ad0e-1c88-4906-907c-0b459221ef4f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:21:59.133914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a040ad0e-1c88-4906-907c-0b459221ef4f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:21:59.134031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a040ad0e-1c88-4906-907c-0b459221ef4f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:21:59.138841 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:59.170431 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a040ad0e-1c88-4906-907c-0b459221ef4f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:59.171312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a040ad0e-1c88-4906-907c-0b459221ef4f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:59.172434 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a040ad0e-1c88-4906-907c-0b459221ef4f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:59.174775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a040ad0e-1c88-4906-907c-0b459221ef4f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:59.234166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-a040ad0e-1c88-4906-907c-0b459221ef4f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Getting quotas for project da596310058e4248bf33465f387956f2. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:21:59.255265 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-a040ad0e-1c88-4906-907c-0b459221ef4f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Getting quotas for user 36a36dbb4f6c40a7bb69c8c3f747aaed and project da596310058e4248bf33465f387956f2. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:21:59.289957 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a040ad0e-1c88-4906-907c-0b459221ef4f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:21:59.297273 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a040ad0e-1c88-4906-907c-0b459221ef4f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:21:59.414195 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a040ad0e-1c88-4906-907c-0b459221ef4f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.919580 Jul 31 01:21:59.417003 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1506/3035] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:21:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:21:59.431594 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4d1d73f4-7948-4e5a-b735-e5de8d48a94b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:21:59.432826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4d1d73f4-7948-4e5a-b735-e5de8d48a94b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:21:59.445464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d1d73f4-7948-4e5a-b735-e5de8d48a94b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:59.447997 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d1d73f4-7948-4e5a-b735-e5de8d48a94b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:21:59.454889 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d1d73f4-7948-4e5a-b735-e5de8d48a94b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:21:59.455786 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d1d73f4-7948-4e5a-b735-e5de8d48a94b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:00.896736 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-0eda8c56-606b-4787-a5ca-11a3564b2f7b tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:22:00.897294 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-0eda8c56-606b-4787-a5ca-11a3564b2f7b tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:22:00.897646 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-0eda8c56-606b-4787-a5ca-11a3564b2f7b tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:22:00.899467 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-0eda8c56-606b-4787-a5ca-11a3564b2f7b tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:22:00.899467 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-0eda8c56-606b-4787-a5ca-11a3564b2f7b tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:22:00.902696 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:00.913961 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0eda8c56-606b-4787-a5ca-11a3564b2f7b tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:00.914432 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0eda8c56-606b-4787-a5ca-11a3564b2f7b tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:00.915265 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0eda8c56-606b-4787-a5ca-11a3564b2f7b tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:00.920805 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0eda8c56-606b-4787-a5ca-11a3564b2f7b tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:00.967447 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-0eda8c56-606b-4787-a5ca-11a3564b2f7b tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Getting quotas for project 03b61b61373141c2a210b47eb51c3f85. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:22:00.979424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-0eda8c56-606b-4787-a5ca-11a3564b2f7b tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Getting quotas for user 47229f06a62d4846bf643fc036230ccf and project 03b61b61373141c2a210b47eb51c3f85. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:22:01.015518 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0eda8c56-606b-4787-a5ca-11a3564b2f7b tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:22:01.018362 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0eda8c56-606b-4787-a5ca-11a3564b2f7b tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:22:01.201922 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0eda8c56-606b-4787-a5ca-11a3564b2f7b tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.857640 Jul 31 01:22:01.210944 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1530/3036] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:21:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 4878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:22:01.213556 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fdd892f5-7b54-4667-a63e-2f962f198a1f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:01.224843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fdd892f5-7b54-4667-a63e-2f962f198a1f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:01.272372 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fdd892f5-7b54-4667-a63e-2f962f198a1f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:01.272844 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fdd892f5-7b54-4667-a63e-2f962f198a1f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:01.274927 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fdd892f5-7b54-4667-a63e-2f962f198a1f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:01.279969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fdd892f5-7b54-4667-a63e-2f962f198a1f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:01.746345 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4d1d73f4-7948-4e5a-b735-e5de8d48a94b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:01.767430 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4d1d73f4-7948-4e5a-b735-e5de8d48a94b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1318 microversion: 2.1 time: 2.342658 Jul 31 01:22:01.787914 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1507/3037] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:21:59 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1318 bytes in 2370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:01.799176 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c6192d3a-8b16-4942-b7f0-49a262a4afe3 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:01.812762 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c6192d3a-8b16-4942-b7f0-49a262a4afe3 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:01.844244 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6192d3a-8b16-4942-b7f0-49a262a4afe3 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:01.846955 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6192d3a-8b16-4942-b7f0-49a262a4afe3 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:01.847864 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6192d3a-8b16-4942-b7f0-49a262a4afe3 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:01.851550 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6192d3a-8b16-4942-b7f0-49a262a4afe3 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:02.016260 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fdd892f5-7b54-4667-a63e-2f962f198a1f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:02.030750 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fdd892f5-7b54-4667-a63e-2f962f198a1f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:02.033495 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fdd892f5-7b54-4667-a63e-2f962f198a1f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:02.035863 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fdd892f5-7b54-4667-a63e-2f962f198a1f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.827837 Jul 31 01:22:02.055786 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1531/3038] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:22:01 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:22:02.071300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2d5edf2d-4219-4f40-bb45-5ba6ef9d20fb req-e94b3bb9-0507-4d00-ad63-29f6c29f0f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f6be904-5471-4ad5-bd1d-dc6802808c37", "name": "network-vif-unplugged", "status": "completed", "tag": "62897edb-69e4-46f0-8193-e27cfe7ff775"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:02.090885 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2d5edf2d-4219-4f40-bb45-5ba6ef9d20fb req-e94b3bb9-0507-4d00-ad63-29f6c29f0f8f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:02.096868 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2d5edf2d-4219-4f40-bb45-5ba6ef9d20fb req-e94b3bb9-0507-4d00-ad63-29f6c29f0f8f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:02.128433 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c6192d3a-8b16-4942-b7f0-49a262a4afe3 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:02.150421 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c6192d3a-8b16-4942-b7f0-49a262a4afe3 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1613 microversion: 2.1 time: 0.360111 Jul 31 01:22:02.154405 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1508/3039] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:01 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1613 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:02.160103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-028049fb-55a3-444d-a6c4-b59af93a020f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:02.162705 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-028049fb-55a3-444d-a6c4-b59af93a020f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:02.168066 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2d5edf2d-4219-4f40-bb45-5ba6ef9d20fb req-e94b3bb9-0507-4d00-ad63-29f6c29f0f8f service nova] Creating event network-vif-unplugged:62897edb-69e4-46f0-8193-e27cfe7ff775 for instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 on n-h1-master-1 Jul 31 01:22:02.172492 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-028049fb-55a3-444d-a6c4-b59af93a020f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:02.173242 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-028049fb-55a3-444d-a6c4-b59af93a020f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:02.175296 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-028049fb-55a3-444d-a6c4-b59af93a020f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:02.176114 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-028049fb-55a3-444d-a6c4-b59af93a020f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:02.184942 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2d5edf2d-4219-4f40-bb45-5ba6ef9d20fb req-e94b3bb9-0507-4d00-ad63-29f6c29f0f8f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127330 Jul 31 01:22:02.192871 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1532/3040] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:22:02.208740 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1aeda5a5-4a7f-4a6c-b7d3-1fdc5f142327 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:02.209655 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1aeda5a5-4a7f-4a6c-b7d3-1fdc5f142327 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:02.326724 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1aeda5a5-4a7f-4a6c-b7d3-1fdc5f142327 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47229f06a62d4846bf643fc036230ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b61b61373141c2a210b47eb51c3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:02.333956 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1aeda5a5-4a7f-4a6c-b7d3-1fdc5f142327 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a" status: 200 len: 1223 microversion: 2.1 time: 0.139280 Jul 31 01:22:02.348067 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1533/3041] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:02 2022] GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a => generated 1223 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:02.385457 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-028049fb-55a3-444d-a6c4-b59af93a020f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:02.397953 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-028049fb-55a3-444d-a6c4-b59af93a020f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1272 microversion: 2.1 time: 0.242114 Jul 31 01:22:02.398566 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1509/3042] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:02 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:02.793403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-14245e37-b3aa-48e7-ba83-79f9ba4a0eb4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:02.794396 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-14245e37-b3aa-48e7-ba83-79f9ba4a0eb4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:02.812391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14245e37-b3aa-48e7-ba83-79f9ba4a0eb4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:02.813190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14245e37-b3aa-48e7-ba83-79f9ba4a0eb4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:02.814266 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14245e37-b3aa-48e7-ba83-79f9ba4a0eb4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:02.816382 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14245e37-b3aa-48e7-ba83-79f9ba4a0eb4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:03.065164 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c0e026d3-4ac9-4929-bc63-4f1e8f92576f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:03.069272 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c0e026d3-4ac9-4929-bc63-4f1e8f92576f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:03.097871 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0e026d3-4ac9-4929-bc63-4f1e8f92576f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:03.101247 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0e026d3-4ac9-4929-bc63-4f1e8f92576f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:03.108454 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0e026d3-4ac9-4929-bc63-4f1e8f92576f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:03.114069 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0e026d3-4ac9-4929-bc63-4f1e8f92576f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:03.411727 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c0e026d3-4ac9-4929-bc63-4f1e8f92576f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:03.433525 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c0e026d3-4ac9-4929-bc63-4f1e8f92576f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:03.436444 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c0e026d3-4ac9-4929-bc63-4f1e8f92576f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:03.449691 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c0e026d3-4ac9-4929-bc63-4f1e8f92576f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.380908 Jul 31 01:22:03.451084 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1510/3043] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:22:03 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:22:03.457792 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9fca0bdc-b1f9-428f-9222-ef15a887049d tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:03.458695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9fca0bdc-b1f9-428f-9222-ef15a887049d tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:03.468581 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9fca0bdc-b1f9-428f-9222-ef15a887049d tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:03.470151 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9fca0bdc-b1f9-428f-9222-ef15a887049d tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:03.471369 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9fca0bdc-b1f9-428f-9222-ef15a887049d tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:03.473422 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9fca0bdc-b1f9-428f-9222-ef15a887049d tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:03.762451 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9fca0bdc-b1f9-428f-9222-ef15a887049d tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc397063f50746daa3dba6975d872941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bed329cedce4da7a08600d0586d25a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:03.778337 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9fca0bdc-b1f9-428f-9222-ef15a887049d tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 200 len: 1326 microversion: 2.1 time: 0.325320 Jul 31 01:22:03.783052 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1511/3044] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:03 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 1326 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:03.788902 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-ccab8526-07eb-416d-bd3a-c2f0e3ddc854 req-1549eacc-8c1d-4d66-a54b-9278d42e222f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f6be904-5471-4ad5-bd1d-dc6802808c37", "name": "network-vif-deleted", "tag": "62897edb-69e4-46f0-8193-e27cfe7ff775"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:03.818901 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-ccab8526-07eb-416d-bd3a-c2f0e3ddc854 req-1549eacc-8c1d-4d66-a54b-9278d42e222f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:03.822580 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-ccab8526-07eb-416d-bd3a-c2f0e3ddc854 req-1549eacc-8c1d-4d66-a54b-9278d42e222f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:03.853447 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-ccab8526-07eb-416d-bd3a-c2f0e3ddc854 req-1549eacc-8c1d-4d66-a54b-9278d42e222f service nova] Creating event network-vif-deleted:62897edb-69e4-46f0-8193-e27cfe7ff775 for instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 on n-h1-master-1 Jul 31 01:22:03.861670 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-ccab8526-07eb-416d-bd3a-c2f0e3ddc854 req-1549eacc-8c1d-4d66-a54b-9278d42e222f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076640 Jul 31 01:22:03.865670 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1512/3045] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:22:03.876352 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d1082fb6-f331-420f-a18f-1df73b07ec31 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:03.878301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d1082fb6-f331-420f-a18f-1df73b07ec31 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:03.899449 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d1082fb6-f331-420f-a18f-1df73b07ec31 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:03.899909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d1082fb6-f331-420f-a18f-1df73b07ec31 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:03.900757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d1082fb6-f331-420f-a18f-1df73b07ec31 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:03.901135 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d1082fb6-f331-420f-a18f-1df73b07ec31 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:03.938081 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-14245e37-b3aa-48e7-ba83-79f9ba4a0eb4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:03.965309 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-14245e37-b3aa-48e7-ba83-79f9ba4a0eb4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1318 microversion: 2.1 time: 1.172443 Jul 31 01:22:03.967918 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1534/3046] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:02 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1318 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:22:03.979641 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ca92dec5-9197-40ff-9cd5-6ae6d24c3fe2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:03.983321 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ca92dec5-9197-40ff-9cd5-6ae6d24c3fe2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:04.002302 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca92dec5-9197-40ff-9cd5-6ae6d24c3fe2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:04.002972 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca92dec5-9197-40ff-9cd5-6ae6d24c3fe2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:04.006471 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca92dec5-9197-40ff-9cd5-6ae6d24c3fe2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:04.008019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca92dec5-9197-40ff-9cd5-6ae6d24c3fe2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:04.116271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d1082fb6-f331-420f-a18f-1df73b07ec31 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47229f06a62d4846bf643fc036230ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b61b61373141c2a210b47eb51c3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:04.129914 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d1082fb6-f331-420f-a18f-1df73b07ec31 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a" status: 200 len: 1293 microversion: 2.1 time: 0.262546 Jul 31 01:22:04.132074 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1513/3047] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:03 2022] GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a => generated 1293 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:04.228227 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ca92dec5-9197-40ff-9cd5-6ae6d24c3fe2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:04.254378 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ca92dec5-9197-40ff-9cd5-6ae6d24c3fe2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1272 microversion: 2.1 time: 0.284811 Jul 31 01:22:04.256380 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1535/3048] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:03 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1272 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:04.485493 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1964bcc5-9f23-4003-b753-495c512840b3 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:04.486672 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1964bcc5-9f23-4003-b753-495c512840b3 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:04.523007 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1964bcc5-9f23-4003-b753-495c512840b3 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:04.523877 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1964bcc5-9f23-4003-b753-495c512840b3 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:04.527307 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1964bcc5-9f23-4003-b753-495c512840b3 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:04.533965 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1964bcc5-9f23-4003-b753-495c512840b3 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:04.777980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e819e126-f113-4470-b131-a439aa1a064a req-8c09ae9f-6cf3-495a-867d-4267adb26a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef", "name": "network-vif-plugged", "status": "completed", "tag": "ae1cb343-a9a3-40ae-b39e-13af344f6e1f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:04.800414 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e819e126-f113-4470-b131-a439aa1a064a req-8c09ae9f-6cf3-495a-867d-4267adb26a8c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:04.803699 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e819e126-f113-4470-b131-a439aa1a064a req-8c09ae9f-6cf3-495a-867d-4267adb26a8c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:04.838056 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e819e126-f113-4470-b131-a439aa1a064a req-8c09ae9f-6cf3-495a-867d-4267adb26a8c service nova] Creating event network-vif-plugged:ae1cb343-a9a3-40ae-b39e-13af344f6e1f for instance 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef on n-h1-master-1 Jul 31 01:22:04.851865 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e819e126-f113-4470-b131-a439aa1a064a req-8c09ae9f-6cf3-495a-867d-4267adb26a8c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.555977 Jul 31 01:22:04.853694 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1514/3049] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:22:04.871665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-382c03d9-eccd-4417-86fa-626e4ff85af2 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:04.872581 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-382c03d9-eccd-4417-86fa-626e4ff85af2 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:04.904842 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-382c03d9-eccd-4417-86fa-626e4ff85af2 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:04.907135 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-382c03d9-eccd-4417-86fa-626e4ff85af2 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:04.909293 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-382c03d9-eccd-4417-86fa-626e4ff85af2 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:04.910727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-382c03d9-eccd-4417-86fa-626e4ff85af2 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:04.953996 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-382c03d9-eccd-4417-86fa-626e4ff85af2 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] HTTP exception thrown: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-382c03d9-eccd-4417-86fa-626e4ff85af2 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Request method failure captured: Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 HTTP/1.1 Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5diA_n7tCK2R8ZpiHypzD4N4Yfd4U-Em8v3IOlER45FgT3kjR8i2tSMkPkDFJDH9Ta-AeCVkhXaKo5s16QIQMU_J2ojh7zRaPSWI281T_JOfDBcZYhCWaowgmcY-LOfD2CIPVVQnnqGaDtiys2Rq5naY2bALPhBuZewvA8CZ0NRSz4Q Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 5bed329cedce4da7a08600d0586d25a8 Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1913698188 Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5bed329cedce4da7a08600d0586d25a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5bed329cedce4da7a08600d0586d25a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5bed329cedce4da7a08600d0586d25a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5bed329cedce4da7a08600d0586d25a8", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1913698188 Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 5bed329cedce4da7a08600d0586d25a8 Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1913698188 Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AttachSCSIVolumeTestJSON-1913698188-project Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: fc397063f50746daa3dba6975d872941 Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1913698188-project Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '5f6be904-5471-4ad5-bd1d-dc6802808c37'} Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:04.956157 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:04.960564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:04.960564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:04.960564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:04.960564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:22:04.960564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:22:04.960564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. Jul 31 01:22:04.960564 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:04.963267 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-382c03d9-eccd-4417-86fa-626e4ff85af2 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Returning 404 to user: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:04.964488 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-382c03d9-eccd-4417-86fa-626e4ff85af2 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 404 len: 111 microversion: 2.1 time: 0.108106 Jul 31 01:22:04.965351 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1515/3050] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:04 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:22:04.975984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6af969f5-d909-498e-b80f-cb624d2a9496 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '.version_select at 0x7fede4fadb80>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:05.038727 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6af969f5-d909-498e-b80f-cb624d2a9496 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230189843" status: 202 len: 0 microversion: 2.1 time: 0.067703 Jul 31 01:22:05.042920 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1516/3051] 10.222.0.45 () {58 vars in 1221 bytes} [Sun Jul 31 01:22:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230189843 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:22:05.054672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2e9ecc2d-6d0d-4425-9a96-34a337af33a5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:05.056685 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2e9ecc2d-6d0d-4425-9a96-34a337af33a5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:05.082292 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e9ecc2d-6d0d-4425-9a96-34a337af33a5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:05.083501 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e9ecc2d-6d0d-4425-9a96-34a337af33a5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:05.086093 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e9ecc2d-6d0d-4425-9a96-34a337af33a5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:05.091028 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e9ecc2d-6d0d-4425-9a96-34a337af33a5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:05.147767 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:05.426922 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1964bcc5-9f23-4003-b753-495c512840b3 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:05.440089 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1964bcc5-9f23-4003-b753-495c512840b3 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:05.441682 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1964bcc5-9f23-4003-b753-495c512840b3 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:05.443005 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1964bcc5-9f23-4003-b753-495c512840b3 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.967125 Jul 31 01:22:05.453391 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1536/3052] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:22:04 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:22:05.466702 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-138ad1a6-e956-4500-8dfe-da748134e391 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:05.476073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-138ad1a6-e956-4500-8dfe-da748134e391 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:05.493945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-138ad1a6-e956-4500-8dfe-da748134e391 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:05.503658 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-138ad1a6-e956-4500-8dfe-da748134e391 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:05.505186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-138ad1a6-e956-4500-8dfe-da748134e391 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:05.506364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-138ad1a6-e956-4500-8dfe-da748134e391 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:06.680251 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-138ad1a6-e956-4500-8dfe-da748134e391 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47229f06a62d4846bf643fc036230ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b61b61373141c2a210b47eb51c3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:06.691756 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-138ad1a6-e956-4500-8dfe-da748134e391 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a" status: 200 len: 1323 microversion: 2.1 time: 1.235431 Jul 31 01:22:06.692566 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1537/3053] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:05 2022] GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a => generated 1323 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:06.707868 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7ff26409-bffa-4ada-b99e-0a94e0c4ba5d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:06.714157 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7ff26409-bffa-4ada-b99e-0a94e0c4ba5d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:06.744967 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ff26409-bffa-4ada-b99e-0a94e0c4ba5d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:06.749820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ff26409-bffa-4ada-b99e-0a94e0c4ba5d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:06.750836 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ff26409-bffa-4ada-b99e-0a94e0c4ba5d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:06.755436 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ff26409-bffa-4ada-b99e-0a94e0c4ba5d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:06.927669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2e9ecc2d-6d0d-4425-9a96-34a337af33a5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:06.956353 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2e9ecc2d-6d0d-4425-9a96-34a337af33a5 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1318 microversion: 2.1 time: 1.911271 Jul 31 01:22:06.957631 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1517/3054] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:05 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1318 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:06.967814 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-853a114c-d2b8-4fc7-b6db-f378424fed8f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:06.972164 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-853a114c-d2b8-4fc7-b6db-f378424fed8f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:06.993431 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-853a114c-d2b8-4fc7-b6db-f378424fed8f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:06.995786 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-853a114c-d2b8-4fc7-b6db-f378424fed8f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:07.003053 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-853a114c-d2b8-4fc7-b6db-f378424fed8f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:07.008146 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-853a114c-d2b8-4fc7-b6db-f378424fed8f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:07.181688 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-853a114c-d2b8-4fc7-b6db-f378424fed8f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:07.195742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-853a114c-d2b8-4fc7-b6db-f378424fed8f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:07.198871 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-853a114c-d2b8-4fc7-b6db-f378424fed8f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:07.202755 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-853a114c-d2b8-4fc7-b6db-f378424fed8f tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.239682 Jul 31 01:22:07.208454 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1518/3055] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:22:06 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:22:07.713041 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-469786d9-689e-4d7e-a548-36044a0d7503 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:07.713658 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-469786d9-689e-4d7e-a548-36044a0d7503 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:07.727465 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-469786d9-689e-4d7e-a548-36044a0d7503 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:07.728254 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-469786d9-689e-4d7e-a548-36044a0d7503 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:07.729220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-469786d9-689e-4d7e-a548-36044a0d7503 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:07.729827 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-469786d9-689e-4d7e-a548-36044a0d7503 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:08.082172 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7ff26409-bffa-4ada-b99e-0a94e0c4ba5d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:08.090541 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7ff26409-bffa-4ada-b99e-0a94e0c4ba5d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1314 microversion: 2.1 time: 1.396119 Jul 31 01:22:08.091403 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1538/3056] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:06 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1314 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:08.100349 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-24d7e721-88d7-4768-85bf-377ae5e49ace tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:08.106638 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-24d7e721-88d7-4768-85bf-377ae5e49ace tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:08.122302 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24d7e721-88d7-4768-85bf-377ae5e49ace tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:08.123141 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24d7e721-88d7-4768-85bf-377ae5e49ace tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:08.126621 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24d7e721-88d7-4768-85bf-377ae5e49ace tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:08.127298 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24d7e721-88d7-4768-85bf-377ae5e49ace tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:08.479877 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-469786d9-689e-4d7e-a548-36044a0d7503 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47229f06a62d4846bf643fc036230ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b61b61373141c2a210b47eb51c3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:08.497886 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-469786d9-689e-4d7e-a548-36044a0d7503 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a" status: 200 len: 1323 microversion: 2.1 time: 0.788584 Jul 31 01:22:08.504113 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1519/3057] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:07 2022] GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a => generated 1323 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:08.891646 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-c1aab467-0999-49ff-aee7-ae6c46c04f51 req-826db4e5-410e-4575-9ef3-65b57b0da0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c84a95-1628-4a2b-a63b-56f72c5ab07a", "tag": "da765c45-020f-40dd-a568-8a89aee07903"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:08.913894 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c1aab467-0999-49ff-aee7-ae6c46c04f51 req-826db4e5-410e-4575-9ef3-65b57b0da0f2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:08.920526 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c1aab467-0999-49ff-aee7-ae6c46c04f51 req-826db4e5-410e-4575-9ef3-65b57b0da0f2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:08.944805 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-c1aab467-0999-49ff-aee7-ae6c46c04f51 req-826db4e5-410e-4575-9ef3-65b57b0da0f2 service nova] Creating event network-changed:da765c45-020f-40dd-a568-8a89aee07903 for instance 31c84a95-1628-4a2b-a63b-56f72c5ab07a on n-h2-master-1 Jul 31 01:22:08.967564 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-c1aab467-0999-49ff-aee7-ae6c46c04f51 req-826db4e5-410e-4575-9ef3-65b57b0da0f2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.455478 Jul 31 01:22:08.968535 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1520/3058] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:22:08.989660 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0e7e3491-adf5-4402-8c79-90645bb424e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:08.990958 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0e7e3491-adf5-4402-8c79-90645bb424e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:09.006488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e7e3491-adf5-4402-8c79-90645bb424e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:09.008144 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e7e3491-adf5-4402-8c79-90645bb424e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:09.016958 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e7e3491-adf5-4402-8c79-90645bb424e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:09.017671 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e7e3491-adf5-4402-8c79-90645bb424e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:09.202972 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:09.275818 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:09.390958 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e7e3491-adf5-4402-8c79-90645bb424e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:09.404916 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e7e3491-adf5-4402-8c79-90645bb424e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:09.406457 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e7e3491-adf5-4402-8c79-90645bb424e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:09.419457 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0e7e3491-adf5-4402-8c79-90645bb424e9 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.434447 Jul 31 01:22:09.422116 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1521/3059] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:22:08 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:22:09.443294 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0f699e73-f2a0-4f41-9d0f-60bc1e657079 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:09.454451 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0f699e73-f2a0-4f41-9d0f-60bc1e657079 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:09.470450 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f699e73-f2a0-4f41-9d0f-60bc1e657079 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:09.471560 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f699e73-f2a0-4f41-9d0f-60bc1e657079 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:09.476351 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f699e73-f2a0-4f41-9d0f-60bc1e657079 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:09.477041 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f699e73-f2a0-4f41-9d0f-60bc1e657079 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:09.890170 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-24d7e721-88d7-4768-85bf-377ae5e49ace tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:09.901716 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-24d7e721-88d7-4768-85bf-377ae5e49ace tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1507 microversion: 2.1 time: 1.807755 Jul 31 01:22:09.904896 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1539/3060] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:08 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1507 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:09.920465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-141f0951-d7f2-4c85-8214-3e373d49f17c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:09.921286 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-141f0951-d7f2-4c85-8214-3e373d49f17c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:09.932043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-141f0951-d7f2-4c85-8214-3e373d49f17c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:09.940404 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-141f0951-d7f2-4c85-8214-3e373d49f17c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:09.942330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-141f0951-d7f2-4c85-8214-3e373d49f17c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:09.953541 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-141f0951-d7f2-4c85-8214-3e373d49f17c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:10.282166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0f699e73-f2a0-4f41-9d0f-60bc1e657079 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:10.297250 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0f699e73-f2a0-4f41-9d0f-60bc1e657079 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1314 microversion: 2.1 time: 0.870935 Jul 31 01:22:10.297909 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1522/3061] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:09 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1314 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:10.307128 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b2fd8290-6aa7-4ce4-b932-1fc477b2ec11 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:10.318678 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b2fd8290-6aa7-4ce4-b932-1fc477b2ec11 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:10.331952 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2fd8290-6aa7-4ce4-b932-1fc477b2ec11 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:10.332539 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2fd8290-6aa7-4ce4-b932-1fc477b2ec11 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:10.336702 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2fd8290-6aa7-4ce4-b932-1fc477b2ec11 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:10.337766 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2fd8290-6aa7-4ce4-b932-1fc477b2ec11 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:10.656245 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-141f0951-d7f2-4c85-8214-3e373d49f17c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47229f06a62d4846bf643fc036230ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b61b61373141c2a210b47eb51c3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:10.669464 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-141f0951-d7f2-4c85-8214-3e373d49f17c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a" status: 200 len: 1323 microversion: 2.1 time: 0.762592 Jul 31 01:22:10.684021 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1540/3062] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:09 2022] GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a => generated 1323 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:10.689830 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-906ef43a-ad65-4f41-a1b2-33ed9e52c1bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:10.690484 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-906ef43a-ad65-4f41-a1b2-33ed9e52c1bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:10.713054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-906ef43a-ad65-4f41-a1b2-33ed9e52c1bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:10.713814 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-906ef43a-ad65-4f41-a1b2-33ed9e52c1bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:10.715500 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-906ef43a-ad65-4f41-a1b2-33ed9e52c1bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:10.716215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-906ef43a-ad65-4f41-a1b2-33ed9e52c1bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:10.942499 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:10.962882 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-906ef43a-ad65-4f41-a1b2-33ed9e52c1bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:10.976392 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-906ef43a-ad65-4f41-a1b2-33ed9e52c1bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:10.981225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-906ef43a-ad65-4f41-a1b2-33ed9e52c1bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bf6b7d7d5954879be98b36b607daf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276c5f283b1f4c2896b55667156c6f21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:10.983103 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-906ef43a-ad65-4f41-a1b2-33ed9e52c1bc tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 200 len: 1603 microversion: 2.32 time: 0.297409 Jul 31 01:22:10.999594 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1541/3063] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:22:10 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 1603 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:22:11.064048 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b2fd8290-6aa7-4ce4-b932-1fc477b2ec11 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:11.072608 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b2fd8290-6aa7-4ce4-b932-1fc477b2ec11 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1507 microversion: 2.1 time: 0.772036 Jul 31 01:22:11.084145 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1523/3064] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:10 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1507 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:11.108772 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e743870a-7939-4459-b53c-7c25d8bf1b44 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:11.111672 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e743870a-7939-4459-b53c-7c25d8bf1b44 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:11.123235 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e743870a-7939-4459-b53c-7c25d8bf1b44 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:11.123728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e743870a-7939-4459-b53c-7c25d8bf1b44 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:11.124530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e743870a-7939-4459-b53c-7c25d8bf1b44 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:11.124974 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e743870a-7939-4459-b53c-7c25d8bf1b44 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:11.321731 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-abbc1533-f7e6-462b-9612-3f3f056de130 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:11.323427 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-abbc1533-f7e6-462b-9612-3f3f056de130 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:11.342499 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abbc1533-f7e6-462b-9612-3f3f056de130 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:11.343284 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abbc1533-f7e6-462b-9612-3f3f056de130 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:11.344311 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abbc1533-f7e6-462b-9612-3f3f056de130 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:11.344943 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abbc1533-f7e6-462b-9612-3f3f056de130 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:11.363993 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e743870a-7939-4459-b53c-7c25d8bf1b44 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "PUT /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1079 microversion: 2.1 time: 0.259360 Jul 31 01:22:11.372789 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1542/3065] 10.222.0.45 () {60 vars in 1256 bytes} [Sun Jul 31 01:22:11 2022] PUT /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1079 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:11.408491 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a8416895-29f6-4e23-8c52-bb2632431b43 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:11.423822 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a8416895-29f6-4e23-8c52-bb2632431b43 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:11.444208 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8416895-29f6-4e23-8c52-bb2632431b43 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:11.446620 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8416895-29f6-4e23-8c52-bb2632431b43 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:11.447834 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8416895-29f6-4e23-8c52-bb2632431b43 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:11.462723 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8416895-29f6-4e23-8c52-bb2632431b43 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:11.502715 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:11.859994 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-abbc1533-f7e6-462b-9612-3f3f056de130 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:11.868720 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-abbc1533-f7e6-462b-9612-3f3f056de130 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1314 microversion: 2.1 time: 0.551287 Jul 31 01:22:11.885159 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1524/3066] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:11 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:11.897222 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-581ca962-d2a8-46cd-b329-7827afa04020 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:11.900013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-581ca962-d2a8-46cd-b329-7827afa04020 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:11.916897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-581ca962-d2a8-46cd-b329-7827afa04020 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:11.917515 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-581ca962-d2a8-46cd-b329-7827afa04020 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:11.918411 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-581ca962-d2a8-46cd-b329-7827afa04020 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:11.918956 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-581ca962-d2a8-46cd-b329-7827afa04020 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:12.333703 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:12.487459 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a8416895-29f6-4e23-8c52-bb2632431b43 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:12.502882 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a8416895-29f6-4e23-8c52-bb2632431b43 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1505 microversion: 2.1 time: 1.116679 Jul 31 01:22:12.503858 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1543/3067] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:11 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1505 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:22:12.519652 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0a516de9-ae73-459c-88cf-75ec37ed20b2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:12.520291 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0a516de9-ae73-459c-88cf-75ec37ed20b2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:12.537132 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a516de9-ae73-459c-88cf-75ec37ed20b2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:12.537596 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a516de9-ae73-459c-88cf-75ec37ed20b2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:12.538413 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a516de9-ae73-459c-88cf-75ec37ed20b2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:12.538845 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a516de9-ae73-459c-88cf-75ec37ed20b2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:12.568193 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-0a516de9-ae73-459c-88cf-75ec37ed20b2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] HTTP exception thrown: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0a516de9-ae73-459c-88cf-75ec37ed20b2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Request method failure captured: Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb HTTP/1.1 Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5ddzzEp9sT_2kGAaW-hFypPilocfSUFN2vAvRBgLUoR-sStDgr8iS7L8egTdXdKKEacudRhTtjd0mnd9h7P3a7iCb7KfUEvXheYUOlyBC5yoxdH6OZJ7r-9mlJDahS3Ig8QTDFTG8ZdwDNk8gbg8gRvJK06sSeEegM27g1jZkpVieJ8 Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.32 Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 276c5f283b1f4c2896b55667156c6f21 Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TaggedBootDevicesTest-1129120023 Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/276c5f283b1f4c2896b55667156c6f21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/276c5f283b1f4c2896b55667156c6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/276c5f283b1f4c2896b55667156c6f21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "tempest-type-1863551521", "name": "tempest-service-300100163", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_276c5f283b1f4c2896b55667156c6f21", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TaggedBootDevicesTest-1129120023 Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 276c5f283b1f4c2896b55667156c6f21 Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1129120023 Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TaggedBootDevicesTest-1129120023-project Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 5bf6b7d7d5954879be98b36b607daf0d Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TaggedBootDevicesTest-1129120023-project Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: exception: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'bad9ccd1-b86c-4c3e-9530-59120ba09cdb'} Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. Jul 31 01:22:12.569920 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:12.573883 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:12.573883 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:12.573883 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:12.573883 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:12.573883 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:12.573883 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:22:12.573883 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:22:12.573883 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. Jul 31 01:22:12.573883 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:12.573883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0a516de9-ae73-459c-88cf-75ec37ed20b2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Returning 404 to user: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:12.573883 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0a516de9-ae73-459c-88cf-75ec37ed20b2 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 404 len: 111 microversion: 2.32 time: 0.066464 Jul 31 01:22:12.578728 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1544/3068] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:22:12 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:22:12.586108 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-60ff5288-af12-4e28-ba1d-578921e19b44 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:12.586747 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-60ff5288-af12-4e28-ba1d-578921e19b44 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:12.605359 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-60ff5288-af12-4e28-ba1d-578921e19b44 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:12.605826 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-60ff5288-af12-4e28-ba1d-578921e19b44 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:12.606636 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-60ff5288-af12-4e28-ba1d-578921e19b44 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:12.607084 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-60ff5288-af12-4e28-ba1d-578921e19b44 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:12.724990 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-581ca962-d2a8-46cd-b329-7827afa04020 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47229f06a62d4846bf643fc036230ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b61b61373141c2a210b47eb51c3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:12.744433 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-581ca962-d2a8-46cd-b329-7827afa04020 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a" status: 200 len: 1323 microversion: 2.1 time: 0.851059 Jul 31 01:22:12.745697 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1525/3069] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:11 2022] GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a => generated 1323 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:12.757731 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c8055b38-694c-4192-9845-bf585ac3f3b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '.version_select at 0x7fedea8fcb80>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:12.821942 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c8055b38-694c-4192-9845-bf585ac3f3b4 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-194225778" status: 204 len: 0 microversion: 2.32 time: 0.066963 Jul 31 01:22:12.822965 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1526/3070] 10.222.0.45 () {60 vars in 1259 bytes} [Sun Jul 31 01:22:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-194225778 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:22:12.847841 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-0a30dcc8-53f4-4327-9599-f4478077badc req-e5f277cf-fdfd-43be-99be-c9a1db88f66b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6d1238-b717-4469-b7dc-d49276871d99", "tag": "f10cad9b-64dd-4555-8d3b-b1279fecd75b"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:12.907171 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0a30dcc8-53f4-4327-9599-f4478077badc req-e5f277cf-fdfd-43be-99be-c9a1db88f66b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:12.908057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0a30dcc8-53f4-4327-9599-f4478077badc req-e5f277cf-fdfd-43be-99be-c9a1db88f66b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:12.941573 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-0a30dcc8-53f4-4327-9599-f4478077badc req-e5f277cf-fdfd-43be-99be-c9a1db88f66b service nova] Creating event network-changed:f10cad9b-64dd-4555-8d3b-b1279fecd75b for instance 1e6d1238-b717-4469-b7dc-d49276871d99 on n-h2-master-1 Jul 31 01:22:12.958471 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-0a30dcc8-53f4-4327-9599-f4478077badc req-e5f277cf-fdfd-43be-99be-c9a1db88f66b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133505 Jul 31 01:22:12.960512 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1527/3071] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:22:12.971080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b2bb1763-d23d-4e25-ac7b-5d7e1172022f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:12.972086 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b2bb1763-d23d-4e25-ac7b-5d7e1172022f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:12.979906 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2bb1763-d23d-4e25-ac7b-5d7e1172022f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:12.980675 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2bb1763-d23d-4e25-ac7b-5d7e1172022f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:12.981965 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2bb1763-d23d-4e25-ac7b-5d7e1172022f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:12.982470 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2bb1763-d23d-4e25-ac7b-5d7e1172022f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:13.072071 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-60ff5288-af12-4e28-ba1d-578921e19b44 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:13.081909 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-60ff5288-af12-4e28-ba1d-578921e19b44 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1505 microversion: 2.1 time: 0.504656 Jul 31 01:22:13.092828 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1545/3072] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:12 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:13.113165 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-91960815-9162-4ab3-aedd-644ab3b5c446 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:13.116018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-91960815-9162-4ab3-aedd-644ab3b5c446 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:13.137059 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-91960815-9162-4ab3-aedd-644ab3b5c446 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:13.137525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-91960815-9162-4ab3-aedd-644ab3b5c446 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:13.138325 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-91960815-9162-4ab3-aedd-644ab3b5c446 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:13.139332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-91960815-9162-4ab3-aedd-644ab3b5c446 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:13.330465 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-91960815-9162-4ab3-aedd-644ab3b5c446 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "PUT /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1081 microversion: 2.1 time: 0.221435 Jul 31 01:22:13.331641 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1546/3073] 10.222.0.45 () {60 vars in 1256 bytes} [Sun Jul 31 01:22:13 2022] PUT /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1081 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:22:13.349920 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c48ccc63-a333-4ade-bb14-095084fb7332 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:13.351146 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c48ccc63-a333-4ade-bb14-095084fb7332 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:13.365115 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c48ccc63-a333-4ade-bb14-095084fb7332 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:13.375939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c48ccc63-a333-4ade-bb14-095084fb7332 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:13.377138 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c48ccc63-a333-4ade-bb14-095084fb7332 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:13.377923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c48ccc63-a333-4ade-bb14-095084fb7332 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:13.568587 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b2bb1763-d23d-4e25-ac7b-5d7e1172022f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:13.578910 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b2bb1763-d23d-4e25-ac7b-5d7e1172022f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1314 microversion: 2.1 time: 0.616393 Jul 31 01:22:13.586025 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1528/3074] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:12 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:13.765787 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ed7ad827-7959-4423-a5e9-f394191e9c1c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:13.768198 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ed7ad827-7959-4423-a5e9-f394191e9c1c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:13.792740 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed7ad827-7959-4423-a5e9-f394191e9c1c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:13.793926 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed7ad827-7959-4423-a5e9-f394191e9c1c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:13.796060 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed7ad827-7959-4423-a5e9-f394191e9c1c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:13.797835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed7ad827-7959-4423-a5e9-f394191e9c1c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:14.062940 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c48ccc63-a333-4ade-bb14-095084fb7332 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:14.072198 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c48ccc63-a333-4ade-bb14-095084fb7332 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1507 microversion: 2.1 time: 0.727787 Jul 31 01:22:14.073646 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1547/3075] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:13 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1507 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:22:14.096680 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9eab5534-0993-486a-85c6-6436a42484a4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:14.097551 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9eab5534-0993-486a-85c6-6436a42484a4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:14.115391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9eab5534-0993-486a-85c6-6436a42484a4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:14.116954 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9eab5534-0993-486a-85c6-6436a42484a4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:14.117901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9eab5534-0993-486a-85c6-6436a42484a4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:14.118597 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9eab5534-0993-486a-85c6-6436a42484a4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:14.957307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ed7ad827-7959-4423-a5e9-f394191e9c1c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47229f06a62d4846bf643fc036230ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b61b61373141c2a210b47eb51c3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:14.976643 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ed7ad827-7959-4423-a5e9-f394191e9c1c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a" status: 200 len: 1323 microversion: 2.1 time: 1.214266 Jul 31 01:22:14.978486 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1529/3076] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:13 2022] GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a => generated 1323 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:14.985369 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-72c68afe-54b5-4b42-9670-38acfdb74910 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:14.986099 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-72c68afe-54b5-4b42-9670-38acfdb74910 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:14.993173 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72c68afe-54b5-4b42-9670-38acfdb74910 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:14.993638 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72c68afe-54b5-4b42-9670-38acfdb74910 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:14.994794 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72c68afe-54b5-4b42-9670-38acfdb74910 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:14.995404 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72c68afe-54b5-4b42-9670-38acfdb74910 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:15.027408 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9eab5534-0993-486a-85c6-6436a42484a4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:15.037303 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9eab5534-0993-486a-85c6-6436a42484a4 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1507 microversion: 2.1 time: 0.947859 Jul 31 01:22:15.037931 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1548/3077] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:14 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1507 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:15.061936 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bb76f91d-a9f8-4d89-b202-077810dfb031 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:15.062887 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bb76f91d-a9f8-4d89-b202-077810dfb031 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:15.072229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bb76f91d-a9f8-4d89-b202-077810dfb031 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:15.073028 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bb76f91d-a9f8-4d89-b202-077810dfb031 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:15.074026 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bb76f91d-a9f8-4d89-b202-077810dfb031 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:15.074905 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bb76f91d-a9f8-4d89-b202-077810dfb031 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:15.114180 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bb76f91d-a9f8-4d89-b202-077810dfb031 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:22:15.237647 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bb76f91d-a9f8-4d89-b202-077810dfb031 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 204 len: 0 microversion: 2.1 time: 0.182355 Jul 31 01:22:15.239091 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1549/3078] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:22:15 2022] DELETE /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:22:15.268925 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d3e69d99-f8a5-49f2-9f0b-0473fbe5c52d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:15.272054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d3e69d99-f8a5-49f2-9f0b-0473fbe5c52d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:15.280906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3e69d99-f8a5-49f2-9f0b-0473fbe5c52d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:15.281476 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3e69d99-f8a5-49f2-9f0b-0473fbe5c52d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:15.282479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3e69d99-f8a5-49f2-9f0b-0473fbe5c52d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:15.282994 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3e69d99-f8a5-49f2-9f0b-0473fbe5c52d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:15.344396 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d3e69d99-f8a5-49f2-9f0b-0473fbe5c52d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:22:15.453881 n-d-master-1 devstack@n-api.service[119475]: INFO nova.compute.api [None req-d3e69d99-f8a5-49f2-9f0b-0473fbe5c52d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Instance is already in deleting state, ignoring this request Jul 31 01:22:15.454357 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d3e69d99-f8a5-49f2-9f0b-0473fbe5c52d tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 204 len: 0 microversion: 2.1 time: 0.198931 Jul 31 01:22:15.455728 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1550/3079] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:22:15 2022] DELETE /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:22:15.463588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0b47bb23-2f42-425b-8e36-a5155723b540 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:15.464522 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0b47bb23-2f42-425b-8e36-a5155723b540 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:15.477940 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b47bb23-2f42-425b-8e36-a5155723b540 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:15.478727 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b47bb23-2f42-425b-8e36-a5155723b540 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:15.481322 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b47bb23-2f42-425b-8e36-a5155723b540 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:15.483409 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-72c68afe-54b5-4b42-9670-38acfdb74910 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:15.483680 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b47bb23-2f42-425b-8e36-a5155723b540 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:15.499022 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-72c68afe-54b5-4b42-9670-38acfdb74910 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1314 microversion: 2.1 time: 0.519009 Jul 31 01:22:15.499817 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1530/3080] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:14 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:15.972264 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0b47bb23-2f42-425b-8e36-a5155723b540 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:15.984338 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0b47bb23-2f42-425b-8e36-a5155723b540 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1513 microversion: 2.1 time: 0.524358 Jul 31 01:22:16.002494 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-45ed943f-5136-4296-97e4-6edf7a58b854 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:16.003103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-45ed943f-5136-4296-97e4-6edf7a58b854 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:16.010807 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1551/3081] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:15 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1513 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:16.016291 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-45ed943f-5136-4296-97e4-6edf7a58b854 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:16.017020 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-45ed943f-5136-4296-97e4-6edf7a58b854 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:16.019505 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-45ed943f-5136-4296-97e4-6edf7a58b854 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:16.021292 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-45ed943f-5136-4296-97e4-6edf7a58b854 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:16.324946 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e04d899-7ec0-4e10-b9d7-28a38860613a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:16.325500 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1e04d899-7ec0-4e10-b9d7-28a38860613a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:16.337192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e04d899-7ec0-4e10-b9d7-28a38860613a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:16.337742 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e04d899-7ec0-4e10-b9d7-28a38860613a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:16.338604 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e04d899-7ec0-4e10-b9d7-28a38860613a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:16.344519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e04d899-7ec0-4e10-b9d7-28a38860613a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:16.379144 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-1e04d899-7ec0-4e10-b9d7-28a38860613a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] HTTP exception thrown: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e04d899-7ec0-4e10-b9d7-28a38860613a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Request method failure captured: Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 HTTP/1.1 Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5diA_n7tCK2R8ZpiHypzD4N4Yfd4U-Em8v3IOlER45FgT3kjR8i2tSMkPkDFJDH9Ta-AeCVkhXaKo5s16QIQMU_J2ojh7zRaPSWI281T_JOfDBcZYhCWaowgmcY-LOfD2CIPVVQnnqGaDtiys2Rq5naY2bALPhBuZewvA8CZ0NRSz4Q Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 5bed329cedce4da7a08600d0586d25a8 Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1913698188 Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5bed329cedce4da7a08600d0586d25a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5bed329cedce4da7a08600d0586d25a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5bed329cedce4da7a08600d0586d25a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5bed329cedce4da7a08600d0586d25a8", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1913698188 Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 5bed329cedce4da7a08600d0586d25a8 Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1913698188 Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AttachSCSIVolumeTestJSON-1913698188-project Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: fc397063f50746daa3dba6975d872941 Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1913698188-project Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '5f6be904-5471-4ad5-bd1d-dc6802808c37'} Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:22:16.384694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:22:16.391787 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. Jul 31 01:22:16.391787 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:16.391787 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:16.391787 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:16.391787 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:16.391787 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:16.391787 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:16.391787 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:22:16.391787 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:22:16.391787 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. Jul 31 01:22:16.391787 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:16.391787 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e04d899-7ec0-4e10-b9d7-28a38860613a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Returning 404 to user: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:16.391787 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1e04d899-7ec0-4e10-b9d7-28a38860613a tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 404 len: 111 microversion: 2.1 time: 0.070883 Jul 31 01:22:16.391787 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1552/3082] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:22:16 2022] DELETE /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:22:16.403377 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ec7bf4ff-8968-4af1-bd1a-06d12066b8c8 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:16.404024 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ec7bf4ff-8968-4af1-bd1a-06d12066b8c8 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] [instance: 5f6be904-5471-4ad5-bd1d-dc6802808c37] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:16.419229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec7bf4ff-8968-4af1-bd1a-06d12066b8c8 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:16.421242 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec7bf4ff-8968-4af1-bd1a-06d12066b8c8 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:16.422077 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec7bf4ff-8968-4af1-bd1a-06d12066b8c8 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:16.425713 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec7bf4ff-8968-4af1-bd1a-06d12066b8c8 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:16.451687 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-ec7bf4ff-8968-4af1-bd1a-06d12066b8c8 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] HTTP exception thrown: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ec7bf4ff-8968-4af1-bd1a-06d12066b8c8 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Request method failure captured: Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 HTTP/1.1 Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5diA_n7tCK2R8ZpiHypzD4N4Yfd4U-Em8v3IOlER45FgT3kjR8i2tSMkPkDFJDH9Ta-AeCVkhXaKo5s16QIQMU_J2ojh7zRaPSWI281T_JOfDBcZYhCWaowgmcY-LOfD2CIPVVQnnqGaDtiys2Rq5naY2bALPhBuZewvA8CZ0NRSz4Q Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 5bed329cedce4da7a08600d0586d25a8 Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1913698188 Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5bed329cedce4da7a08600d0586d25a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5bed329cedce4da7a08600d0586d25a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5bed329cedce4da7a08600d0586d25a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5bed329cedce4da7a08600d0586d25a8", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1913698188 Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 5bed329cedce4da7a08600d0586d25a8 Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1913698188 Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AttachSCSIVolumeTestJSON-1913698188-project Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: fc397063f50746daa3dba6975d872941 Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1913698188-project Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '5f6be904-5471-4ad5-bd1d-dc6802808c37'} Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:16.463031 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:16.467221 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:16.467221 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:16.467221 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:16.467221 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:22:16.467221 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:22:16.467221 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. Jul 31 01:22:16.467221 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:16.467221 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ec7bf4ff-8968-4af1-bd1a-06d12066b8c8 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] Returning 404 to user: Instance 5f6be904-5471-4ad5-bd1d-dc6802808c37 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:16.470620 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ec7bf4ff-8968-4af1-bd1a-06d12066b8c8 tempest-AttachSCSIVolumeTestJSON-1913698188 tempest-AttachSCSIVolumeTestJSON-1913698188-project] 10.222.0.45 "GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37" status: 404 len: 111 microversion: 2.1 time: 0.070850 Jul 31 01:22:16.471873 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1553/3083] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:16 2022] GET /compute/v2.1/servers/5f6be904-5471-4ad5-bd1d-dc6802808c37 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:22:16.521960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5146e808-6e00-4134-9881-3652c650e290 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:16.522572 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5146e808-6e00-4134-9881-3652c650e290 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:16.531543 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5146e808-6e00-4134-9881-3652c650e290 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:16.532000 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5146e808-6e00-4134-9881-3652c650e290 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:16.532785 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5146e808-6e00-4134-9881-3652c650e290 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:16.533227 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5146e808-6e00-4134-9881-3652c650e290 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:16.650390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-45ed943f-5136-4296-97e4-6edf7a58b854 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47229f06a62d4846bf643fc036230ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b61b61373141c2a210b47eb51c3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:16.665414 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-45ed943f-5136-4296-97e4-6edf7a58b854 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a" status: 200 len: 1323 microversion: 2.1 time: 0.666674 Jul 31 01:22:16.667414 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1531/3084] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:15 2022] GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a => generated 1323 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:17.005332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-52b9e419-a2fa-49d1-81ae-067169602392 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:17.006046 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-52b9e419-a2fa-49d1-81ae-067169602392 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:17.014219 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52b9e419-a2fa-49d1-81ae-067169602392 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:17.014764 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52b9e419-a2fa-49d1-81ae-067169602392 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:17.016245 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52b9e419-a2fa-49d1-81ae-067169602392 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:17.016897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52b9e419-a2fa-49d1-81ae-067169602392 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:18.094808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5146e808-6e00-4134-9881-3652c650e290 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:18.107002 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5146e808-6e00-4134-9881-3652c650e290 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1314 microversion: 2.1 time: 1.591105 Jul 31 01:22:18.108497 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1554/3085] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:16 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1314 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:22:18.119565 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-113316ba-10e8-468d-bc7b-a171693ad315 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:18.121313 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-113316ba-10e8-468d-bc7b-a171693ad315 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:18.135956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-113316ba-10e8-468d-bc7b-a171693ad315 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:18.139748 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-113316ba-10e8-468d-bc7b-a171693ad315 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:18.140880 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-113316ba-10e8-468d-bc7b-a171693ad315 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:18.141344 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-113316ba-10e8-468d-bc7b-a171693ad315 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:18.418491 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-52b9e419-a2fa-49d1-81ae-067169602392 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:18.445062 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-52b9e419-a2fa-49d1-81ae-067169602392 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1513 microversion: 2.1 time: 1.442271 Jul 31 01:22:18.461725 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1532/3086] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:16 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1513 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:18.513278 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-6dc600a5-a38c-46e4-9530-a849d977a517 req-dc60577c-c782-427b-a7ec-ff3b8073af72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c84a95-1628-4a2b-a63b-56f72c5ab07a", "name": "network-vif-plugged", "status": "completed", "tag": "da765c45-020f-40dd-a568-8a89aee07903"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:18.547834 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-6dc600a5-a38c-46e4-9530-a849d977a517 req-dc60577c-c782-427b-a7ec-ff3b8073af72 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:18.548252 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-6dc600a5-a38c-46e4-9530-a849d977a517 req-dc60577c-c782-427b-a7ec-ff3b8073af72 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:18.582911 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-6dc600a5-a38c-46e4-9530-a849d977a517 req-dc60577c-c782-427b-a7ec-ff3b8073af72 service nova] Creating event network-vif-plugged:da765c45-020f-40dd-a568-8a89aee07903 for instance 31c84a95-1628-4a2b-a63b-56f72c5ab07a on n-h2-master-1 Jul 31 01:22:18.603188 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-6dc600a5-a38c-46e4-9530-a849d977a517 req-dc60577c-c782-427b-a7ec-ff3b8073af72 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095383 Jul 31 01:22:18.604173 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1533/3087] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:22:18.943912 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-113316ba-10e8-468d-bc7b-a171693ad315 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47229f06a62d4846bf643fc036230ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b61b61373141c2a210b47eb51c3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:18.954129 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-113316ba-10e8-468d-bc7b-a171693ad315 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a" status: 200 len: 1323 microversion: 2.1 time: 0.842267 Jul 31 01:22:18.955615 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1555/3088] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:18 2022] GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a => generated 1323 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:19.130629 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b81fbd36-586b-49f7-a1fd-57b48bbf1eac tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:19.131620 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b81fbd36-586b-49f7-a1fd-57b48bbf1eac tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:19.146798 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b81fbd36-586b-49f7-a1fd-57b48bbf1eac tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:19.147483 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b81fbd36-586b-49f7-a1fd-57b48bbf1eac tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:19.151403 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b81fbd36-586b-49f7-a1fd-57b48bbf1eac tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:19.152077 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b81fbd36-586b-49f7-a1fd-57b48bbf1eac tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:19.473594 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb422fff-a185-4fd8-b01c-a6c51e617577 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:19.474227 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fb422fff-a185-4fd8-b01c-a6c51e617577 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:19.488185 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb422fff-a185-4fd8-b01c-a6c51e617577 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:19.489938 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb422fff-a185-4fd8-b01c-a6c51e617577 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:19.493838 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb422fff-a185-4fd8-b01c-a6c51e617577 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:19.495510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb422fff-a185-4fd8-b01c-a6c51e617577 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:19.698474 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fb422fff-a185-4fd8-b01c-a6c51e617577 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440b48b4049a4a1ea3bfb6cdd372b205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5473e5d0400e44bbaaf59a2c86a14f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:19.713097 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fb422fff-a185-4fd8-b01c-a6c51e617577 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 200 len: 1471 microversion: 2.1 time: 0.243565 Jul 31 01:22:19.717967 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1556/3089] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:19 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 1471 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:22:19.727536 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b81fbd36-586b-49f7-a1fd-57b48bbf1eac tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:19.751122 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b81fbd36-586b-49f7-a1fd-57b48bbf1eac tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1314 microversion: 2.1 time: 0.614129 Jul 31 01:22:19.752885 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1534/3090] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:19 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1314 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:19.962336 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-6678a1f0-b332-4dd9-9cd2-fa396aa7bca6 req-92d1a8cc-4a54-4eae-9824-0333b4f22a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef", "name": "network-vif-deleted", "tag": "ae1cb343-a9a3-40ae-b39e-13af344f6e1f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:19.978680 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6678a1f0-b332-4dd9-9cd2-fa396aa7bca6 req-92d1a8cc-4a54-4eae-9824-0333b4f22a26 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:19.980593 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-33cdc1a4-a0c6-414b-8fc9-e2e8a896790f tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:19.980753 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6678a1f0-b332-4dd9-9cd2-fa396aa7bca6 req-92d1a8cc-4a54-4eae-9824-0333b4f22a26 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:19.981568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-33cdc1a4-a0c6-414b-8fc9-e2e8a896790f tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:19.997520 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33cdc1a4-a0c6-414b-8fc9-e2e8a896790f tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:19.998387 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33cdc1a4-a0c6-414b-8fc9-e2e8a896790f tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:20.002106 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33cdc1a4-a0c6-414b-8fc9-e2e8a896790f tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:20.004062 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33cdc1a4-a0c6-414b-8fc9-e2e8a896790f tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:20.011582 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-6678a1f0-b332-4dd9-9cd2-fa396aa7bca6 req-92d1a8cc-4a54-4eae-9824-0333b4f22a26 service nova] Creating event network-vif-deleted:ae1cb343-a9a3-40ae-b39e-13af344f6e1f for instance 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef on n-h1-master-1 Jul 31 01:22:20.025932 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-6678a1f0-b332-4dd9-9cd2-fa396aa7bca6 req-92d1a8cc-4a54-4eae-9824-0333b4f22a26 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069795 Jul 31 01:22:20.027682 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1557/3091] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:22:20.522271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-33cdc1a4-a0c6-414b-8fc9-e2e8a896790f tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47229f06a62d4846bf643fc036230ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b61b61373141c2a210b47eb51c3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:20.537949 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-33cdc1a4-a0c6-414b-8fc9-e2e8a896790f tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a" status: 200 len: 1323 microversion: 2.1 time: 0.563421 Jul 31 01:22:20.554436 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1535/3092] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:19 2022] GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a => generated 1323 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:20.738965 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4c2f35ec-a98c-4281-9447-f2a5db451a4b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:20.740942 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4c2f35ec-a98c-4281-9447-f2a5db451a4b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:20.756228 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c2f35ec-a98c-4281-9447-f2a5db451a4b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:20.757914 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c2f35ec-a98c-4281-9447-f2a5db451a4b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:20.762206 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c2f35ec-a98c-4281-9447-f2a5db451a4b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:20.762854 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c2f35ec-a98c-4281-9447-f2a5db451a4b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:20.774506 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c6ac2022-31e8-4ea7-a93d-89c62d9fbf87 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:20.775829 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c6ac2022-31e8-4ea7-a93d-89c62d9fbf87 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:20.789448 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6ac2022-31e8-4ea7-a93d-89c62d9fbf87 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:20.793412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6ac2022-31e8-4ea7-a93d-89c62d9fbf87 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:20.796554 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6ac2022-31e8-4ea7-a93d-89c62d9fbf87 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:20.819135 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-4c2f35ec-a98c-4281-9447-f2a5db451a4b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] HTTP exception thrown: Instance 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef could not be found. Jul 31 01:22:20.820056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c6ac2022-31e8-4ea7-a93d-89c62d9fbf87 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4c2f35ec-a98c-4281-9447-f2a5db451a4b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Request method failure captured: Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef HTTP/1.1 Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5diapgleaePFpS3jQHfHX7VXE9G2oDO2DX9Q8jy91qrrBzXs8a43oeOzpkL4Fq5h6WHfi6uz3KGwXqlgi3tevAgYuWLcC0BAAz2L9w2p94kAL5wOUGzVDjYO_SZLdpxU0Wdcku10HWsV6pKJyKTHzXmiYJ5_lP2m7uiZO_5M6OBU6Eo Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 5473e5d0400e44bbaaf59a2c86a14f8a Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerDiskConfigTestJSON-851629466 Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5473e5d0400e44bbaaf59a2c86a14f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5473e5d0400e44bbaaf59a2c86a14f8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5473e5d0400e44bbaaf59a2c86a14f8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5473e5d0400e44bbaaf59a2c86a14f8a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerDiskConfigTestJSON-851629466 Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 5473e5d0400e44bbaaf59a2c86a14f8a Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-851629466 Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerDiskConfigTestJSON-851629466-project Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 440b48b4049a4a1ea3bfb6cdd372b205 Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerDiskConfigTestJSON-851629466-project Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef could not be found. Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef'} Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef could not be found. Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef could not be found. Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:20.851793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:20.856499 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:20.856499 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:20.856499 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:20.856499 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:22:20.856499 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:22:20.856499 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef could not be found. Jul 31 01:22:20.856499 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:20.858095 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4c2f35ec-a98c-4281-9447-f2a5db451a4b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Returning 404 to user: Instance 9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:20.859642 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4c2f35ec-a98c-4281-9447-f2a5db451a4b tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef" status: 404 len: 111 microversion: 2.1 time: 0.124658 Jul 31 01:22:20.863758 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1558/3093] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:20 2022] GET /compute/v2.1/servers/9c9abff7-78d4-4a0e-82ca-6c2c3246e6ef => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:22:20.890249 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bb4cdfcf-730f-46a4-a534-eac668272582 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:20.890249 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bb4cdfcf-730f-46a4-a534-eac668272582 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:20.919122 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bb4cdfcf-730f-46a4-a534-eac668272582 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:20.919594 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bb4cdfcf-730f-46a4-a534-eac668272582 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:20.920547 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bb4cdfcf-730f-46a4-a534-eac668272582 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:20.921072 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bb4cdfcf-730f-46a4-a534-eac668272582 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:20.983555 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-bb4cdfcf-730f-46a4-a534-eac668272582 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] HTTP exception thrown: Instance 3ae5b84e-919e-4ad7-8348-9d4326695306 could not be found. Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bb4cdfcf-730f-46a4-a534-eac668272582 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Request method failure captured: Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 HTTP/1.1 Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5diapgleaePFpS3jQHfHX7VXE9G2oDO2DX9Q8jy91qrrBzXs8a43oeOzpkL4Fq5h6WHfi6uz3KGwXqlgi3tevAgYuWLcC0BAAz2L9w2p94kAL5wOUGzVDjYO_SZLdpxU0Wdcku10HWsV6pKJyKTHzXmiYJ5_lP2m7uiZO_5M6OBU6Eo Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 5473e5d0400e44bbaaf59a2c86a14f8a Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerDiskConfigTestJSON-851629466 Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5473e5d0400e44bbaaf59a2c86a14f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5473e5d0400e44bbaaf59a2c86a14f8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5473e5d0400e44bbaaf59a2c86a14f8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5473e5d0400e44bbaaf59a2c86a14f8a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerDiskConfigTestJSON-851629466 Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 5473e5d0400e44bbaaf59a2c86a14f8a Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-851629466 Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerDiskConfigTestJSON-851629466-project Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 440b48b4049a4a1ea3bfb6cdd372b205 Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerDiskConfigTestJSON-851629466-project Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 3ae5b84e-919e-4ad7-8348-9d4326695306 could not be found. Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '3ae5b84e-919e-4ad7-8348-9d4326695306'} Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ae5b84e-919e-4ad7-8348-9d4326695306 could not be found. Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:22:20.989279 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:22:20.993302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ae5b84e-919e-4ad7-8348-9d4326695306 could not be found. Jul 31 01:22:20.993302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:20.993302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:20.993302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:20.993302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:20.993302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:20.993302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:20.993302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:22:20.993302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:22:20.993302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ae5b84e-919e-4ad7-8348-9d4326695306 could not be found. Jul 31 01:22:20.993302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:20.995675 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bb4cdfcf-730f-46a4-a534-eac668272582 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Returning 404 to user: Instance 3ae5b84e-919e-4ad7-8348-9d4326695306 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:20.996742 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bb4cdfcf-730f-46a4-a534-eac668272582 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 404 len: 111 microversion: 2.1 time: 0.117241 Jul 31 01:22:21.001376 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1559/3094] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:22:20 2022] DELETE /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:22:21.009291 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2d2b490d-af39-4956-87d0-c247f9d1aa27 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:21.010150 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2d2b490d-af39-4956-87d0-c247f9d1aa27 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 3ae5b84e-919e-4ad7-8348-9d4326695306] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:21.017536 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d2b490d-af39-4956-87d0-c247f9d1aa27 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:21.018260 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d2b490d-af39-4956-87d0-c247f9d1aa27 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:21.019503 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d2b490d-af39-4956-87d0-c247f9d1aa27 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:21.019952 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d2b490d-af39-4956-87d0-c247f9d1aa27 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:21.041849 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-2d2b490d-af39-4956-87d0-c247f9d1aa27 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] HTTP exception thrown: Instance 3ae5b84e-919e-4ad7-8348-9d4326695306 could not be found. Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2d2b490d-af39-4956-87d0-c247f9d1aa27 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Request method failure captured: Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 HTTP/1.1 Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5diapgleaePFpS3jQHfHX7VXE9G2oDO2DX9Q8jy91qrrBzXs8a43oeOzpkL4Fq5h6WHfi6uz3KGwXqlgi3tevAgYuWLcC0BAAz2L9w2p94kAL5wOUGzVDjYO_SZLdpxU0Wdcku10HWsV6pKJyKTHzXmiYJ5_lP2m7uiZO_5M6OBU6Eo Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 5473e5d0400e44bbaaf59a2c86a14f8a Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerDiskConfigTestJSON-851629466 Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5473e5d0400e44bbaaf59a2c86a14f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5473e5d0400e44bbaaf59a2c86a14f8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5473e5d0400e44bbaaf59a2c86a14f8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5473e5d0400e44bbaaf59a2c86a14f8a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerDiskConfigTestJSON-851629466 Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 5473e5d0400e44bbaaf59a2c86a14f8a Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-851629466 Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerDiskConfigTestJSON-851629466-project Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 440b48b4049a4a1ea3bfb6cdd372b205 Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerDiskConfigTestJSON-851629466-project Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 3ae5b84e-919e-4ad7-8348-9d4326695306 could not be found. Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '3ae5b84e-919e-4ad7-8348-9d4326695306'} Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ae5b84e-919e-4ad7-8348-9d4326695306 could not be found. Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ae5b84e-919e-4ad7-8348-9d4326695306 could not be found. Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:21.047850 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:21.052541 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:21.052541 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:21.052541 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:21.052541 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:22:21.052541 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:22:21.052541 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ae5b84e-919e-4ad7-8348-9d4326695306 could not be found. Jul 31 01:22:21.052541 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:21.054002 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2d2b490d-af39-4956-87d0-c247f9d1aa27 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Returning 404 to user: Instance 3ae5b84e-919e-4ad7-8348-9d4326695306 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:21.055145 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2d2b490d-af39-4956-87d0-c247f9d1aa27 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306" status: 404 len: 111 microversion: 2.1 time: 0.052474 Jul 31 01:22:21.059405 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1560/3095] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:21 2022] GET /compute/v2.1/servers/3ae5b84e-919e-4ad7-8348-9d4326695306 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:22:21.065226 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-75a83d1e-3f64-4103-ba09-249247f522d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:21.074149 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-75a83d1e-3f64-4103-ba09-249247f522d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:21.081179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75a83d1e-3f64-4103-ba09-249247f522d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:21.081909 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75a83d1e-3f64-4103-ba09-249247f522d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:21.082885 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75a83d1e-3f64-4103-ba09-249247f522d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:21.083706 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75a83d1e-3f64-4103-ba09-249247f522d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:21.100532 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:21.102441 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-75a83d1e-3f64-4103-ba09-249247f522d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] HTTP exception thrown: Instance 643b9642-846d-41a9-886f-d9b173367085 could not be found. Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-75a83d1e-3f64-4103-ba09-249247f522d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Request method failure captured: Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 HTTP/1.1 Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5diapgleaePFpS3jQHfHX7VXE9G2oDO2DX9Q8jy91qrrBzXs8a43oeOzpkL4Fq5h6WHfi6uz3KGwXqlgi3tevAgYuWLcC0BAAz2L9w2p94kAL5wOUGzVDjYO_SZLdpxU0Wdcku10HWsV6pKJyKTHzXmiYJ5_lP2m7uiZO_5M6OBU6Eo Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 5473e5d0400e44bbaaf59a2c86a14f8a Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerDiskConfigTestJSON-851629466 Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5473e5d0400e44bbaaf59a2c86a14f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5473e5d0400e44bbaaf59a2c86a14f8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5473e5d0400e44bbaaf59a2c86a14f8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5473e5d0400e44bbaaf59a2c86a14f8a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerDiskConfigTestJSON-851629466 Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 5473e5d0400e44bbaaf59a2c86a14f8a Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-851629466 Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerDiskConfigTestJSON-851629466-project Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 440b48b4049a4a1ea3bfb6cdd372b205 Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerDiskConfigTestJSON-851629466-project Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 643b9642-846d-41a9-886f-d9b173367085 could not be found. Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '643b9642-846d-41a9-886f-d9b173367085'} Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 643b9642-846d-41a9-886f-d9b173367085 could not be found. Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:22:21.104394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:22:21.109416 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 643b9642-846d-41a9-886f-d9b173367085 could not be found. Jul 31 01:22:21.109416 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:21.109416 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:21.109416 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:21.109416 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:21.109416 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:21.109416 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:21.109416 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:22:21.109416 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:22:21.109416 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 643b9642-846d-41a9-886f-d9b173367085 could not be found. Jul 31 01:22:21.109416 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:21.112092 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-75a83d1e-3f64-4103-ba09-249247f522d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Returning 404 to user: Instance 643b9642-846d-41a9-886f-d9b173367085 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:21.113060 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-75a83d1e-3f64-4103-ba09-249247f522d3 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "DELETE /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 404 len: 111 microversion: 2.1 time: 0.052366 Jul 31 01:22:21.125761 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1561/3096] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:22:21 2022] DELETE /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:22:21.131798 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0e6b2e48-8400-484f-bf51-0009eeac3989 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:21.132672 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0e6b2e48-8400-484f-bf51-0009eeac3989 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] [instance: 643b9642-846d-41a9-886f-d9b173367085] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:21.139901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e6b2e48-8400-484f-bf51-0009eeac3989 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:21.140608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e6b2e48-8400-484f-bf51-0009eeac3989 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:21.141592 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e6b2e48-8400-484f-bf51-0009eeac3989 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:21.142229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e6b2e48-8400-484f-bf51-0009eeac3989 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:21.167764 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-0e6b2e48-8400-484f-bf51-0009eeac3989 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] HTTP exception thrown: Instance 643b9642-846d-41a9-886f-d9b173367085 could not be found. Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0e6b2e48-8400-484f-bf51-0009eeac3989 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Request method failure captured: Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 HTTP/1.1 Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5diapgleaePFpS3jQHfHX7VXE9G2oDO2DX9Q8jy91qrrBzXs8a43oeOzpkL4Fq5h6WHfi6uz3KGwXqlgi3tevAgYuWLcC0BAAz2L9w2p94kAL5wOUGzVDjYO_SZLdpxU0Wdcku10HWsV6pKJyKTHzXmiYJ5_lP2m7uiZO_5M6OBU6Eo Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 5473e5d0400e44bbaaf59a2c86a14f8a Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerDiskConfigTestJSON-851629466 Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5473e5d0400e44bbaaf59a2c86a14f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5473e5d0400e44bbaaf59a2c86a14f8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5473e5d0400e44bbaaf59a2c86a14f8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5473e5d0400e44bbaaf59a2c86a14f8a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerDiskConfigTestJSON-851629466 Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 5473e5d0400e44bbaaf59a2c86a14f8a Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-851629466 Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerDiskConfigTestJSON-851629466-project Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 440b48b4049a4a1ea3bfb6cdd372b205 Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerDiskConfigTestJSON-851629466-project Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 643b9642-846d-41a9-886f-d9b173367085 could not be found. Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '643b9642-846d-41a9-886f-d9b173367085'} Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 643b9642-846d-41a9-886f-d9b173367085 could not be found. Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 643b9642-846d-41a9-886f-d9b173367085 could not be found. Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:21.172857 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:21.177531 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:21.177531 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:21.177531 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:21.177531 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:22:21.177531 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:22:21.177531 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 643b9642-846d-41a9-886f-d9b173367085 could not be found. Jul 31 01:22:21.177531 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:21.178179 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0e6b2e48-8400-484f-bf51-0009eeac3989 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] Returning 404 to user: Instance 643b9642-846d-41a9-886f-d9b173367085 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:21.181395 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0e6b2e48-8400-484f-bf51-0009eeac3989 tempest-ServerDiskConfigTestJSON-851629466 tempest-ServerDiskConfigTestJSON-851629466-project] 10.222.0.45 "GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085" status: 404 len: 111 microversion: 2.1 time: 0.054085 Jul 31 01:22:21.182705 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1562/3097] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:21 2022] GET /compute/v2.1/servers/643b9642-846d-41a9-886f-d9b173367085 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:22:21.273960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-5619e98b-470a-4c38-a1c1-7adc0d83d8b2 req-c4e769c8-7480-4ff2-99a5-e4618f676218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6d1238-b717-4469-b7dc-d49276871d99", "name": "network-vif-plugged", "status": "completed", "tag": "f10cad9b-64dd-4555-8d3b-b1279fecd75b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:21.298672 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5619e98b-470a-4c38-a1c1-7adc0d83d8b2 req-c4e769c8-7480-4ff2-99a5-e4618f676218 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:21.302192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5619e98b-470a-4c38-a1c1-7adc0d83d8b2 req-c4e769c8-7480-4ff2-99a5-e4618f676218 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:21.340074 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-5619e98b-470a-4c38-a1c1-7adc0d83d8b2 req-c4e769c8-7480-4ff2-99a5-e4618f676218 service nova] Creating event network-vif-plugged:f10cad9b-64dd-4555-8d3b-b1279fecd75b for instance 1e6d1238-b717-4469-b7dc-d49276871d99 on n-h2-master-1 Jul 31 01:22:21.370411 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-5619e98b-470a-4c38-a1c1-7adc0d83d8b2 req-c4e769c8-7480-4ff2-99a5-e4618f676218 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106931 Jul 31 01:22:21.376829 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1563/3098] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:22:21.583736 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0b175362-ce19-44dd-b0e2-ef6b0d206c2d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:21.586540 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0b175362-ce19-44dd-b0e2-ef6b0d206c2d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:21.601600 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b175362-ce19-44dd-b0e2-ef6b0d206c2d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:21.602324 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b175362-ce19-44dd-b0e2-ef6b0d206c2d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:21.603433 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b175362-ce19-44dd-b0e2-ef6b0d206c2d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:21.604098 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b175362-ce19-44dd-b0e2-ef6b0d206c2d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:22.657060 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c6ac2022-31e8-4ea7-a93d-89c62d9fbf87 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:22.666442 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c6ac2022-31e8-4ea7-a93d-89c62d9fbf87 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1314 microversion: 2.1 time: 1.896197 Jul 31 01:22:22.670918 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1536/3099] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:20 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1314 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:22.926529 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0b175362-ce19-44dd-b0e2-ef6b0d206c2d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47229f06a62d4846bf643fc036230ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b61b61373141c2a210b47eb51c3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:22.938951 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0b175362-ce19-44dd-b0e2-ef6b0d206c2d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a" status: 200 len: 1519 microversion: 2.1 time: 1.377935 Jul 31 01:22:22.956759 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1564/3100] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:21 2022] GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a => generated 1519 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:23.154936 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ec231181-e132-41d2-bd0f-f22412ec9178 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-904145421", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "75211626-e5b7-4b2a-9395-3d8265878040"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ec231181-e132-41d2-bd0f-f22412ec9178 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Request method failure captured: Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 242 Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dkzH55DFUnvLMBGOfCuxi-q8oZLaG74NIhfiPkgxJJiDvQcmW56gVs-lrCw6dyC6HS6zCBVOnAnL9U0QJ08cR1fWAvSUvHChbv0C6IYxaAiIvKlnEyBXcG5MBtggeODjjcc4Vc3YcaWvBiflqNTEBSQGyeHphplMM70eLAnuqxr1PM Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 03b61b61373141c2a210b47eb51c3f85 Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_03b61b61373141c2a210b47eb51c3f85", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 03b61b61373141c2a210b47eb51c3f85 Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerMetadataNegativeTestJSON-1316963015-project Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 47229f06a62d4846bf643fc036230ccf Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1316963015-project Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-904145421", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "75211626-e5b7-4b2a-9395-3d8265878040"}]}} Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-904145421', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '75211626-e5b7-4b2a-9395-3d8265878040'}]}}} Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:22:23.159604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ec231181-e132-41d2-bd0f-f22412ec9178 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:23.165216 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ec231181-e132-41d2-bd0f-f22412ec9178 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.010786 Jul 31 01:22:23.172843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b388f0d8-bc0e-48dc-9efd-ccae02983d01 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:23.173357 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b388f0d8-bc0e-48dc-9efd-ccae02983d01 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: cd6a4289-e963-4962-878a-ef9dff5210c9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:23.182569 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1537/3101] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:22:23 2022] POST /compute/v2.1/servers => generated 175 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:22:23.184006 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-b388f0d8-bc0e-48dc-9efd-ccae02983d01 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] HTTP exception thrown: Instance cd6a4289-e963-4962-878a-ef9dff5210c9 could not be found. Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b388f0d8-bc0e-48dc-9efd-ccae02983d01 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Request method failure captured: Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/cd6a4289-e963-4962-878a-ef9dff5210c9/metadata HTTP/1.1 Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dkzH55DFUnvLMBGOfCuxi-q8oZLaG74NIhfiPkgxJJiDvQcmW56gVs-lrCw6dyC6HS6zCBVOnAnL9U0QJ08cR1fWAvSUvHChbv0C6IYxaAiIvKlnEyBXcG5MBtggeODjjcc4Vc3YcaWvBiflqNTEBSQGyeHphplMM70eLAnuqxr1PM Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 03b61b61373141c2a210b47eb51c3f85 Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_03b61b61373141c2a210b47eb51c3f85", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 03b61b61373141c2a210b47eb51c3f85 Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerMetadataNegativeTestJSON-1316963015-project Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 47229f06a62d4846bf643fc036230ccf Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1316963015-project Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: exception: Instance cd6a4289-e963-4962-878a-ef9dff5210c9 could not be found. Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: action_args: {'server_id': 'cd6a4289-e963-4962-878a-ef9dff5210c9'} Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd6a4289-e963-4962-878a-ef9dff5210c9 could not be found. Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd6a4289-e963-4962-878a-ef9dff5210c9 could not be found. Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:23.198341 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:23.203028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:22:23.203028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:22:23.203028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd6a4289-e963-4962-878a-ef9dff5210c9 could not be found. Jul 31 01:22:23.203028 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.205993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b388f0d8-bc0e-48dc-9efd-ccae02983d01 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Returning 404 to user: Instance cd6a4289-e963-4962-878a-ef9dff5210c9 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:23.206966 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b388f0d8-bc0e-48dc-9efd-ccae02983d01 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "GET /compute/v2.1/servers/cd6a4289-e963-4962-878a-ef9dff5210c9/metadata" status: 404 len: 111 microversion: 2.1 time: 0.037909 Jul 31 01:22:23.208783 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1565/3102] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:22:23 2022] GET /compute/v2.1/servers/cd6a4289-e963-4962-878a-ef9dff5210c9/metadata => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:22:23.269953 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0c20c681-114a-4b70-93b1-0f324ff9bc90 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-661430411", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "75211626-e5b7-4b2a-9395-3d8265878040"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0c20c681-114a-4b70-93b1-0f324ff9bc90 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Request method failure captured: Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 498 Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dkzH55DFUnvLMBGOfCuxi-q8oZLaG74NIhfiPkgxJJiDvQcmW56gVs-lrCw6dyC6HS6zCBVOnAnL9U0QJ08cR1fWAvSUvHChbv0C6IYxaAiIvKlnEyBXcG5MBtggeODjjcc4Vc3YcaWvBiflqNTEBSQGyeHphplMM70eLAnuqxr1PM Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 03b61b61373141c2a210b47eb51c3f85 Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_03b61b61373141c2a210b47eb51c3f85", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 03b61b61373141c2a210b47eb51c3f85 Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerMetadataNegativeTestJSON-1316963015-project Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 47229f06a62d4846bf643fc036230ccf Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1316963015-project Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-661430411", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "75211626-e5b7-4b2a-9395-3d8265878040"}]}} Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-661430411', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '75211626-e5b7-4b2a-9395-3d8265878040'}]}}} Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 31 01:22:23.276274 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0c20c681-114a-4b70-93b1-0f324ff9bc90 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:23.280240 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0c20c681-114a-4b70-93b1-0f324ff9bc90 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.014024 Jul 31 01:22:23.289376 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1538/3103] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:22:23 2022] POST /compute/v2.1/servers => generated 687 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:22:23.494659 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7714d989-2820-4bfc-a5f2-76b6aac8756c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1479464958", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "75211626-e5b7-4b2a-9395-3d8265878040"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7714d989-2820-4bfc-a5f2-76b6aac8756c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Request method failure captured: Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 500 Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dkzH55DFUnvLMBGOfCuxi-q8oZLaG74NIhfiPkgxJJiDvQcmW56gVs-lrCw6dyC6HS6zCBVOnAnL9U0QJ08cR1fWAvSUvHChbv0C6IYxaAiIvKlnEyBXcG5MBtggeODjjcc4Vc3YcaWvBiflqNTEBSQGyeHphplMM70eLAnuqxr1PM Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 03b61b61373141c2a210b47eb51c3f85 Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_03b61b61373141c2a210b47eb51c3f85", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 03b61b61373141c2a210b47eb51c3f85 Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerMetadataNegativeTestJSON-1316963015-project Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 47229f06a62d4846bf643fc036230ccf Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1316963015-project Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1479464958", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "75211626-e5b7-4b2a-9395-3d8265878040"}]}} Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1479464958', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '75211626-e5b7-4b2a-9395-3d8265878040'}]}}} Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 31 01:22:23.499118 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.502332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7714d989-2820-4bfc-a5f2-76b6aac8756c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:23.509302 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7714d989-2820-4bfc-a5f2-76b6aac8756c tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.015412 Jul 31 01:22:23.515034 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1566/3104] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:22:23 2022] POST /compute/v2.1/servers => generated 689 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:22:23.692222 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3549fdbb-e44d-4dcc-b3ad-23a965c62b25 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:23.692897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3549fdbb-e44d-4dcc-b3ad-23a965c62b25 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:23.707070 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3549fdbb-e44d-4dcc-b3ad-23a965c62b25 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:23.713156 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3549fdbb-e44d-4dcc-b3ad-23a965c62b25 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:23.714309 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3549fdbb-e44d-4dcc-b3ad-23a965c62b25 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:23.715052 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3549fdbb-e44d-4dcc-b3ad-23a965c62b25 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:23.766103 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:23.818943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1b614a70-5a82-4988-8b2f-dbccb038092d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1759187041", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "75211626-e5b7-4b2a-9395-3d8265878040"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1b614a70-5a82-4988-8b2f-dbccb038092d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Request method failure captured: Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 754 Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dkzH55DFUnvLMBGOfCuxi-q8oZLaG74NIhfiPkgxJJiDvQcmW56gVs-lrCw6dyC6HS6zCBVOnAnL9U0QJ08cR1fWAvSUvHChbv0C6IYxaAiIvKlnEyBXcG5MBtggeODjjcc4Vc3YcaWvBiflqNTEBSQGyeHphplMM70eLAnuqxr1PM Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 03b61b61373141c2a210b47eb51c3f85 Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_03b61b61373141c2a210b47eb51c3f85", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 03b61b61373141c2a210b47eb51c3f85 Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerMetadataNegativeTestJSON-1316963015-project Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 47229f06a62d4846bf643fc036230ccf Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1316963015-project Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1759187041", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "75211626-e5b7-4b2a-9395-3d8265878040"}]}} Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1759187041', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '75211626-e5b7-4b2a-9395-3d8265878040'}]}}} Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:22:23.823841 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:22:23.827042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:22:23.829568 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.829568 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.829568 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1b614a70-5a82-4988-8b2f-dbccb038092d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:23.829568 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1b614a70-5a82-4988-8b2f-dbccb038092d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.016890 Jul 31 01:22:23.836403 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1567/3105] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:22:23 2022] POST /compute/v2.1/servers => generated 1197 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Jul 31 01:22:23.915364 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7942c25e-d61c-4b55-9460-1a2ec9d8ac0a tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1304812495", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "75211626-e5b7-4b2a-9395-3d8265878040"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7942c25e-d61c-4b55-9460-1a2ec9d8ac0a tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Request method failure captured: Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 1266 Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dkzH55DFUnvLMBGOfCuxi-q8oZLaG74NIhfiPkgxJJiDvQcmW56gVs-lrCw6dyC6HS6zCBVOnAnL9U0QJ08cR1fWAvSUvHChbv0C6IYxaAiIvKlnEyBXcG5MBtggeODjjcc4Vc3YcaWvBiflqNTEBSQGyeHphplMM70eLAnuqxr1PM Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 03b61b61373141c2a210b47eb51c3f85 Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_03b61b61373141c2a210b47eb51c3f85", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 03b61b61373141c2a210b47eb51c3f85 Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerMetadataNegativeTestJSON-1316963015-project Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 47229f06a62d4846bf643fc036230ccf Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1316963015-project Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1304812495", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "75211626-e5b7-4b2a-9395-3d8265878040"}]}} Jul 31 01:22:23.924025 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1304812495', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '75211626-e5b7-4b2a-9395-3d8265878040'}]}}} Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.927184 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:22:23.928581 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:22:23.930688 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:22:23.930688 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.930688 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7942c25e-d61c-4b55-9460-1a2ec9d8ac0a tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:23.932426 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7942c25e-d61c-4b55-9460-1a2ec9d8ac0a tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.019936 Jul 31 01:22:23.933591 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1568/3106] 10.222.0.45 () {60 vars in 1148 bytes} [Sun Jul 31 01:22:23 2022] POST /compute/v2.1/servers => generated 2221 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 31 01:22:23.962467 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-52eac821-122a-4d95-aaf0-f24218bd43e6 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:23.963100 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-52eac821-122a-4d95-aaf0-f24218bd43e6 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 28228a01-283c-4ebf-80f9-104f6a9a1e6f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:23.976376 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-52eac821-122a-4d95-aaf0-f24218bd43e6 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] HTTP exception thrown: Instance 28228a01-283c-4ebf-80f9-104f6a9a1e6f could not be found. Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-52eac821-122a-4d95-aaf0-f24218bd43e6 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Request method failure captured: Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/28228a01-283c-4ebf-80f9-104f6a9a1e6f/metadata/test2 HTTP/1.1 Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dkzH55DFUnvLMBGOfCuxi-q8oZLaG74NIhfiPkgxJJiDvQcmW56gVs-lrCw6dyC6HS6zCBVOnAnL9U0QJ08cR1fWAvSUvHChbv0C6IYxaAiIvKlnEyBXcG5MBtggeODjjcc4Vc3YcaWvBiflqNTEBSQGyeHphplMM70eLAnuqxr1PM Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 03b61b61373141c2a210b47eb51c3f85 Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_03b61b61373141c2a210b47eb51c3f85", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 03b61b61373141c2a210b47eb51c3f85 Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerMetadataNegativeTestJSON-1316963015-project Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 47229f06a62d4846bf643fc036230ccf Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1316963015-project Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 28228a01-283c-4ebf-80f9-104f6a9a1e6f could not be found. Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: action_args: {'server_id': '28228a01-283c-4ebf-80f9-104f6a9a1e6f', 'id': 'test2'} Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28228a01-283c-4ebf-80f9-104f6a9a1e6f could not be found. Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28228a01-283c-4ebf-80f9-104f6a9a1e6f could not be found. Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:23.984490 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:24.000244 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:22:24.000244 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:22:24.000244 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28228a01-283c-4ebf-80f9-104f6a9a1e6f could not be found. Jul 31 01:22:24.000244 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:24.000244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-52eac821-122a-4d95-aaf0-f24218bd43e6 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Returning 404 to user: Instance 28228a01-283c-4ebf-80f9-104f6a9a1e6f could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:24.000244 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-52eac821-122a-4d95-aaf0-f24218bd43e6 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "GET /compute/v2.1/servers/28228a01-283c-4ebf-80f9-104f6a9a1e6f/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.042094 Jul 31 01:22:24.000244 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1569/3107] 10.222.0.45 () {58 vars in 1281 bytes} [Sun Jul 31 01:22:23 2022] GET /compute/v2.1/servers/28228a01-283c-4ebf-80f9-104f6a9a1e6f/metadata/test2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:22:24.004776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1890035f-2984-43bb-b891-0a533871a4cb tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:24.005290 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1890035f-2984-43bb-b891-0a533871a4cb tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:24.013543 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1890035f-2984-43bb-b891-0a533871a4cb tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:24.013906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1890035f-2984-43bb-b891-0a533871a4cb tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:24.014705 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1890035f-2984-43bb-b891-0a533871a4cb tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:24.015153 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1890035f-2984-43bb-b891-0a533871a4cb tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:24.087747 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1890035f-2984-43bb-b891-0a533871a4cb tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:22:24.199637 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3549fdbb-e44d-4dcc-b3ad-23a965c62b25 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:24.208536 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3549fdbb-e44d-4dcc-b3ad-23a965c62b25 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1502 microversion: 2.1 time: 0.521711 Jul 31 01:22:24.214531 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1539/3108] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:23 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1502 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:24.237294 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cc018b27-5195-4359-9ad2-3bb6747a1b52 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:24.253150 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cc018b27-5195-4359-9ad2-3bb6747a1b52 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:24.255117 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cc018b27-5195-4359-9ad2-3bb6747a1b52 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:24.267580 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:24.284702 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1890035f-2984-43bb-b891-0a533871a4cb tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "DELETE /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a" status: 204 len: 0 microversion: 2.1 time: 0.283585 Jul 31 01:22:24.287383 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1570/3109] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:22:23 2022] DELETE /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:22:24.289922 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cc018b27-5195-4359-9ad2-3bb6747a1b52 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Going to try to stop instance {{(pid=119474) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 01:22:24.304099 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d8838854-1b59-4240-9e02-83a0f1e7ca47 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:24.304934 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d8838854-1b59-4240-9e02-83a0f1e7ca47 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:24.319460 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8838854-1b59-4240-9e02-83a0f1e7ca47 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:24.321093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8838854-1b59-4240-9e02-83a0f1e7ca47 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:24.323843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8838854-1b59-4240-9e02-83a0f1e7ca47 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:24.324847 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8838854-1b59-4240-9e02-83a0f1e7ca47 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:24.353122 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cc018b27-5195-4359-9ad2-3bb6747a1b52 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99/action" status: 202 len: 0 microversion: 2.1 time: 0.120478 Jul 31 01:22:24.359722 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1540/3110] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:22:24 2022] POST /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 01:22:24.367840 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fb607a3e-3af1-48c1-93a2-5b96dfc83ff7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:24.371242 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fb607a3e-3af1-48c1-93a2-5b96dfc83ff7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:24.386337 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb607a3e-3af1-48c1-93a2-5b96dfc83ff7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:24.396672 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb607a3e-3af1-48c1-93a2-5b96dfc83ff7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:24.397616 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb607a3e-3af1-48c1-93a2-5b96dfc83ff7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:24.398072 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb607a3e-3af1-48c1-93a2-5b96dfc83ff7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:25.113918 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d8838854-1b59-4240-9e02-83a0f1e7ca47 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47229f06a62d4846bf643fc036230ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b61b61373141c2a210b47eb51c3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:25.124172 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d8838854-1b59-4240-9e02-83a0f1e7ca47 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a" status: 200 len: 1525 microversion: 2.1 time: 0.831912 Jul 31 01:22:25.125582 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1571/3111] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:24 2022] GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a => generated 1525 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:25.131375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-64a42838-c380-456c-9e1e-3ddc472c2e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:25.132234 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-64a42838-c380-456c-9e1e-3ddc472c2e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:25.141537 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64a42838-c380-456c-9e1e-3ddc472c2e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:25.142438 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64a42838-c380-456c-9e1e-3ddc472c2e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:25.143555 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64a42838-c380-456c-9e1e-3ddc472c2e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:25.144272 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64a42838-c380-456c-9e1e-3ddc472c2e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:25.162979 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-64a42838-c380-456c-9e1e-3ddc472c2e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] HTTP exception thrown: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-64a42838-c380-456c-9e1e-3ddc472c2e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Request method failure captured: Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb HTTP/1.1 Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5ddzzEp9sT_2kGAaW-hFypPilocfSUFN2vAvRBgLUoR-sStDgr8iS7L8egTdXdKKEacudRhTtjd0mnd9h7P3a7iCb7KfUEvXheYUOlyBC5yoxdH6OZJ7r-9mlJDahS3Ig8QTDFTG8ZdwDNk8gbg8gRvJK06sSeEegM27g1jZkpVieJ8 Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.32 Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 276c5f283b1f4c2896b55667156c6f21 Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TaggedBootDevicesTest-1129120023 Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/276c5f283b1f4c2896b55667156c6f21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/276c5f283b1f4c2896b55667156c6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/276c5f283b1f4c2896b55667156c6f21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "tempest-type-1863551521", "name": "tempest-service-300100163", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_276c5f283b1f4c2896b55667156c6f21", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TaggedBootDevicesTest-1129120023 Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 276c5f283b1f4c2896b55667156c6f21 Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1129120023 Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TaggedBootDevicesTest-1129120023-project Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 5bf6b7d7d5954879be98b36b607daf0d Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TaggedBootDevicesTest-1129120023-project Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: exception: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'bad9ccd1-b86c-4c3e-9530-59120ba09cdb'} Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:22:25.166039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:22:25.172636 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:22:25.172636 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. Jul 31 01:22:25.172636 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:25.172636 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:25.172636 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:25.172636 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:25.172636 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:25.172636 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:25.172636 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:22:25.172636 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:22:25.172636 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. Jul 31 01:22:25.172636 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:25.174960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-64a42838-c380-456c-9e1e-3ddc472c2e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Returning 404 to user: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:25.176259 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-64a42838-c380-456c-9e1e-3ddc472c2e0a tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 404 len: 111 microversion: 2.32 time: 0.049331 Jul 31 01:22:25.177247 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1572/3112] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:22:25 2022] DELETE /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:22:25.188777 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b0eb888c-6d9b-4caf-9d3c-141d9cd96348 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:25.189779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b0eb888c-6d9b-4caf-9d3c-141d9cd96348 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] [instance: bad9ccd1-b86c-4c3e-9530-59120ba09cdb] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:25.196943 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0eb888c-6d9b-4caf-9d3c-141d9cd96348 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:25.197684 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0eb888c-6d9b-4caf-9d3c-141d9cd96348 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:25.198824 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0eb888c-6d9b-4caf-9d3c-141d9cd96348 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:25.199499 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0eb888c-6d9b-4caf-9d3c-141d9cd96348 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:25.218220 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-b0eb888c-6d9b-4caf-9d3c-141d9cd96348 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] HTTP exception thrown: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b0eb888c-6d9b-4caf-9d3c-141d9cd96348 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Request method failure captured: Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb HTTP/1.1 Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5ddzzEp9sT_2kGAaW-hFypPilocfSUFN2vAvRBgLUoR-sStDgr8iS7L8egTdXdKKEacudRhTtjd0mnd9h7P3a7iCb7KfUEvXheYUOlyBC5yoxdH6OZJ7r-9mlJDahS3Ig8QTDFTG8ZdwDNk8gbg8gRvJK06sSeEegM27g1jZkpVieJ8 Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.32 Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 276c5f283b1f4c2896b55667156c6f21 Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TaggedBootDevicesTest-1129120023 Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/276c5f283b1f4c2896b55667156c6f21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/276c5f283b1f4c2896b55667156c6f21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/276c5f283b1f4c2896b55667156c6f21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "tempest-type-1863551521", "name": "tempest-service-300100163", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_276c5f283b1f4c2896b55667156c6f21", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TaggedBootDevicesTest-1129120023 Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 276c5f283b1f4c2896b55667156c6f21 Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1129120023 Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TaggedBootDevicesTest-1129120023-project Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 5bf6b7d7d5954879be98b36b607daf0d Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TaggedBootDevicesTest-1129120023-project Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: exception: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'bad9ccd1-b86c-4c3e-9530-59120ba09cdb'} Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. Jul 31 01:22:25.220198 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:25.224924 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:25.224924 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:25.224924 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:25.224924 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:25.224924 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:25.224924 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:22:25.224924 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:22:25.224924 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. Jul 31 01:22:25.224924 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:25.226573 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b0eb888c-6d9b-4caf-9d3c-141d9cd96348 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] Returning 404 to user: Instance bad9ccd1-b86c-4c3e-9530-59120ba09cdb could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:25.227802 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b0eb888c-6d9b-4caf-9d3c-141d9cd96348 tempest-TaggedBootDevicesTest-1129120023 tempest-TaggedBootDevicesTest-1129120023-project] 10.222.0.45 "GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb" status: 404 len: 111 microversion: 2.32 time: 0.043202 Jul 31 01:22:25.232687 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1573/3113] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:22:25 2022] GET /compute/v2.1/servers/bad9ccd1-b86c-4c3e-9530-59120ba09cdb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:22:25.241924 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fb607a3e-3af1-48c1-93a2-5b96dfc83ff7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:25.262641 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fb607a3e-3af1-48c1-93a2-5b96dfc83ff7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1512 microversion: 2.1 time: 0.898932 Jul 31 01:22:25.264046 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1541/3114] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:24 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1512 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:26.152854 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8ca066ab-e6a6-4f2a-9e45-cb3e12cb3a7d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:26.159140 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8ca066ab-e6a6-4f2a-9e45-cb3e12cb3a7d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:26.181006 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9b87fcb5-f891-416b-857b-2c4b88ce18a6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2034853549", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "8b91968f-c568-4ed4-aa48-c01a381493ce"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:26.203035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ca066ab-e6a6-4f2a-9e45-cb3e12cb3a7d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:26.210067 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ca066ab-e6a6-4f2a-9e45-cb3e12cb3a7d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:26.218405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ca066ab-e6a6-4f2a-9e45-cb3e12cb3a7d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:26.221063 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ca066ab-e6a6-4f2a-9e45-cb3e12cb3a7d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:26.348550 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-9b87fcb5-f891-416b-857b-2c4b88ce18a6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] validate_networks() for [('8b91968f-c568-4ed4-aa48-c01a381493ce', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:22:28.013806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8ca066ab-e6a6-4f2a-9e45-cb3e12cb3a7d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47229f06a62d4846bf643fc036230ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b61b61373141c2a210b47eb51c3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:28.023275 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8ca066ab-e6a6-4f2a-9e45-cb3e12cb3a7d tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a" status: 200 len: 1525 microversion: 2.1 time: 1.877059 Jul 31 01:22:28.030374 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1542/3115] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:26 2022] GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a => generated 1525 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:28.049522 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-93238e8b-5bbe-4b68-afb6-a783f1342597 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:28.050811 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-93238e8b-5bbe-4b68-afb6-a783f1342597 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:28.073833 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93238e8b-5bbe-4b68-afb6-a783f1342597 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:28.074323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93238e8b-5bbe-4b68-afb6-a783f1342597 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:28.075161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93238e8b-5bbe-4b68-afb6-a783f1342597 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:28.075687 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93238e8b-5bbe-4b68-afb6-a783f1342597 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:28.637508 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-93238e8b-5bbe-4b68-afb6-a783f1342597 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:28.647675 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-93238e8b-5bbe-4b68-afb6-a783f1342597 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1512 microversion: 2.1 time: 0.611458 Jul 31 01:22:28.648916 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1543/3116] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:28 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1512 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:28.655417 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-34697285-033c-4e89-97c7-f10ddddf0167 req-b9487300-4130-49da-ba1a-adfa9629b751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c84a95-1628-4a2b-a63b-56f72c5ab07a", "name": "network-vif-deleted", "tag": "da765c45-020f-40dd-a568-8a89aee07903"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:28.670231 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-34697285-033c-4e89-97c7-f10ddddf0167 req-b9487300-4130-49da-ba1a-adfa9629b751 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:28.671977 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-34697285-033c-4e89-97c7-f10ddddf0167 req-b9487300-4130-49da-ba1a-adfa9629b751 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:28.689565 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-34697285-033c-4e89-97c7-f10ddddf0167 req-b9487300-4130-49da-ba1a-adfa9629b751 service nova] Creating event network-vif-deleted:da765c45-020f-40dd-a568-8a89aee07903 for instance 31c84a95-1628-4a2b-a63b-56f72c5ab07a on n-h2-master-1 Jul 31 01:22:28.698515 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-34697285-033c-4e89-97c7-f10ddddf0167 req-b9487300-4130-49da-ba1a-adfa9629b751 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047646 Jul 31 01:22:28.700336 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1544/3117] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:22:28.772828 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9b87fcb5-f891-416b-857b-2c4b88ce18a6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:22:28.773787 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9b87fcb5-f891-416b-857b-2c4b88ce18a6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:22:28.774434 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9b87fcb5-f891-416b-857b-2c4b88ce18a6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:22:28.774846 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9b87fcb5-f891-416b-857b-2c4b88ce18a6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:22:28.775471 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9b87fcb5-f891-416b-857b-2c4b88ce18a6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:22:28.786382 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9b87fcb5-f891-416b-857b-2c4b88ce18a6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:28.787555 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9b87fcb5-f891-416b-857b-2c4b88ce18a6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:28.788622 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9b87fcb5-f891-416b-857b-2c4b88ce18a6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:28.789242 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9b87fcb5-f891-416b-857b-2c4b88ce18a6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:28.832031 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-9b87fcb5-f891-416b-857b-2c4b88ce18a6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Getting quotas for project 92857051a9cd4da89f95ecc871ad3f6d. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:22:28.864207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-9b87fcb5-f891-416b-857b-2c4b88ce18a6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Getting quotas for user 8634c5dfc8d14138a4107a129d68e178 and project 92857051a9cd4da89f95ecc871ad3f6d. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:22:28.906503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9b87fcb5-f891-416b-857b-2c4b88ce18a6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:22:28.912991 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9b87fcb5-f891-416b-857b-2c4b88ce18a6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:22:28.995144 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9b87fcb5-f891-416b-857b-2c4b88ce18a6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.137473 Jul 31 01:22:28.998969 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1574/3118] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:22:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:22:29.012074 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f9857d6d-1f39-4369-b113-e1b0e38f01f4 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:29.012930 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f9857d6d-1f39-4369-b113-e1b0e38f01f4 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:29.050907 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a30e7246-c57b-4179-b5c3-8f9501e0a2a9 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:29.052052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a30e7246-c57b-4179-b5c3-8f9501e0a2a9 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] [instance: 31c84a95-1628-4a2b-a63b-56f72c5ab07a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:29.063654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a30e7246-c57b-4179-b5c3-8f9501e0a2a9 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:29.067169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a30e7246-c57b-4179-b5c3-8f9501e0a2a9 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:29.069049 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a30e7246-c57b-4179-b5c3-8f9501e0a2a9 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:29.070488 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a30e7246-c57b-4179-b5c3-8f9501e0a2a9 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:29.138159 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-a30e7246-c57b-4179-b5c3-8f9501e0a2a9 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] HTTP exception thrown: Instance 31c84a95-1628-4a2b-a63b-56f72c5ab07a could not be found. Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a30e7246-c57b-4179-b5c3-8f9501e0a2a9 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Request method failure captured: Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a HTTP/1.1 Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dkzH55DFUnvLMBGOfCuxi-q8oZLaG74NIhfiPkgxJJiDvQcmW56gVs-lrCw6dyC6HS6zCBVOnAnL9U0QJ08cR1fWAvSUvHChbv0C6IYxaAiIvKlnEyBXcG5MBtggeODjjcc4Vc3YcaWvBiflqNTEBSQGyeHphplMM70eLAnuqxr1PM Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 03b61b61373141c2a210b47eb51c3f85 Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/03b61b61373141c2a210b47eb51c3f85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_03b61b61373141c2a210b47eb51c3f85", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 03b61b61373141c2a210b47eb51c3f85 Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1316963015 Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerMetadataNegativeTestJSON-1316963015-project Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 47229f06a62d4846bf643fc036230ccf Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1316963015-project Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 31c84a95-1628-4a2b-a63b-56f72c5ab07a could not be found. Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '31c84a95-1628-4a2b-a63b-56f72c5ab07a'} Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c84a95-1628-4a2b-a63b-56f72c5ab07a could not be found. Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c84a95-1628-4a2b-a63b-56f72c5ab07a could not be found. Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:29.139825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:22:29.144438 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:29.144438 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:22:29.144438 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:22:29.144438 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:22:29.144438 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:22:29.144438 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:22:29.144438 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c84a95-1628-4a2b-a63b-56f72c5ab07a could not be found. Jul 31 01:22:29.144438 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:22:29.150869 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a30e7246-c57b-4179-b5c3-8f9501e0a2a9 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] Returning 404 to user: Instance 31c84a95-1628-4a2b-a63b-56f72c5ab07a could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:22:29.151800 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a30e7246-c57b-4179-b5c3-8f9501e0a2a9 tempest-ServerMetadataNegativeTestJSON-1316963015 tempest-ServerMetadataNegativeTestJSON-1316963015-project] 10.222.0.45 "GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a" status: 404 len: 111 microversion: 2.1 time: 0.104805 Jul 31 01:22:29.156774 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f9857d6d-1f39-4369-b113-e1b0e38f01f4 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:29.158488 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1575/3119] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:29 2022] GET /compute/v2.1/servers/31c84a95-1628-4a2b-a63b-56f72c5ab07a => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:22:29.167143 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f9857d6d-1f39-4369-b113-e1b0e38f01f4 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1216 microversion: 2.1 time: 0.160439 Jul 31 01:22:29.170549 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1545/3120] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:29 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1216 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:22:29.670274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ec17233a-f82e-4e4b-a008-80ece2e46b67 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:29.671168 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ec17233a-f82e-4e4b-a008-80ece2e46b67 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:29.681989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec17233a-f82e-4e4b-a008-80ece2e46b67 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:29.682787 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec17233a-f82e-4e4b-a008-80ece2e46b67 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:29.684244 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec17233a-f82e-4e4b-a008-80ece2e46b67 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:29.684815 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec17233a-f82e-4e4b-a008-80ece2e46b67 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:30.193748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f512464b-673d-4d34-ac66-18fa39230cd9 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:30.194364 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f512464b-673d-4d34-ac66-18fa39230cd9 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:30.204628 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:30.217674 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f512464b-673d-4d34-ac66-18fa39230cd9 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:30.219155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f512464b-673d-4d34-ac66-18fa39230cd9 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:30.225290 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f512464b-673d-4d34-ac66-18fa39230cd9 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:30.227636 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f512464b-673d-4d34-ac66-18fa39230cd9 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:30.730205 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f512464b-673d-4d34-ac66-18fa39230cd9 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:30.744557 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f512464b-673d-4d34-ac66-18fa39230cd9 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1220 microversion: 2.1 time: 0.554631 Jul 31 01:22:30.745243 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1546/3121] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:30 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1220 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:30.770581 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ec17233a-f82e-4e4b-a008-80ece2e46b67 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:30.779643 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ec17233a-f82e-4e4b-a008-80ece2e46b67 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1512 microversion: 2.1 time: 1.112823 Jul 31 01:22:30.780910 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1576/3122] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:29 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1512 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:31.767772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-38ad497b-81ea-4b94-ba27-0adae0c0e9b0 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:31.768979 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-38ad497b-81ea-4b94-ba27-0adae0c0e9b0 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:31.786719 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-38ad497b-81ea-4b94-ba27-0adae0c0e9b0 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:31.787558 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-38ad497b-81ea-4b94-ba27-0adae0c0e9b0 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:31.791990 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-38ad497b-81ea-4b94-ba27-0adae0c0e9b0 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:31.792747 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-38ad497b-81ea-4b94-ba27-0adae0c0e9b0 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:31.800302 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bce35cd3-5841-4fde-a076-effb7363002a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:31.801601 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bce35cd3-5841-4fde-a076-effb7363002a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:31.810779 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bce35cd3-5841-4fde-a076-effb7363002a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:31.811622 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bce35cd3-5841-4fde-a076-effb7363002a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:31.812731 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bce35cd3-5841-4fde-a076-effb7363002a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:31.813396 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bce35cd3-5841-4fde-a076-effb7363002a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:32.356214 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-38ad497b-81ea-4b94-ba27-0adae0c0e9b0 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:32.383867 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-38ad497b-81ea-4b94-ba27-0adae0c0e9b0 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1274 microversion: 2.1 time: 0.620940 Jul 31 01:22:32.386639 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1547/3123] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:31 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1274 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:33.410235 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a43030bf-9244-4de0-961f-fc07cc2ce631 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:33.411036 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a43030bf-9244-4de0-961f-fc07cc2ce631 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:33.439573 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a43030bf-9244-4de0-961f-fc07cc2ce631 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:33.440595 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a43030bf-9244-4de0-961f-fc07cc2ce631 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:33.443703 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a43030bf-9244-4de0-961f-fc07cc2ce631 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:33.444390 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a43030bf-9244-4de0-961f-fc07cc2ce631 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:34.378954 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bce35cd3-5841-4fde-a076-effb7363002a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:34.386954 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bce35cd3-5841-4fde-a076-effb7363002a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1512 microversion: 2.1 time: 2.591034 Jul 31 01:22:34.387576 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1577/3124] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:31 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1512 bytes in 2592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:34.448383 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a43030bf-9244-4de0-961f-fc07cc2ce631 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:34.464881 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a43030bf-9244-4de0-961f-fc07cc2ce631 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1274 microversion: 2.1 time: 1.057220 Jul 31 01:22:34.465726 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1548/3125] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:33 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1274 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:35.410612 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3b247be6-c641-4eae-a882-552bbfab2e84 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:35.411397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3b247be6-c641-4eae-a882-552bbfab2e84 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:35.427313 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b247be6-c641-4eae-a882-552bbfab2e84 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:35.427941 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b247be6-c641-4eae-a882-552bbfab2e84 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:35.428770 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b247be6-c641-4eae-a882-552bbfab2e84 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:35.429250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b247be6-c641-4eae-a882-552bbfab2e84 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:35.470209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a86acb9c-0358-48d7-af2e-e6273f9123c9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-245840985 tempest-PortsAdminExtendedAttrsIpV6TestJSON-245840985-project-admin] Calling method '.version_select at 0x7fedeaa5af70>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:35.471643 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:22:35.471643 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:22:35.472840 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a86acb9c-0358-48d7-af2e-e6273f9123c9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-245840985 tempest-PortsAdminExtendedAttrsIpV6TestJSON-245840985-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:35.473317 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a86acb9c-0358-48d7-af2e-e6273f9123c9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-245840985 tempest-PortsAdminExtendedAttrsIpV6TestJSON-245840985-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:35.522848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a86acb9c-0358-48d7-af2e-e6273f9123c9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-245840985 tempest-PortsAdminExtendedAttrsIpV6TestJSON-245840985-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:35.523316 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a86acb9c-0358-48d7-af2e-e6273f9123c9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-245840985 tempest-PortsAdminExtendedAttrsIpV6TestJSON-245840985-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:35.568861 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a86acb9c-0358-48d7-af2e-e6273f9123c9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-245840985 tempest-PortsAdminExtendedAttrsIpV6TestJSON-245840985-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:35.569487 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a86acb9c-0358-48d7-af2e-e6273f9123c9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-245840985 tempest-PortsAdminExtendedAttrsIpV6TestJSON-245840985-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:35.578884 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a86acb9c-0358-48d7-af2e-e6273f9123c9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-245840985 tempest-PortsAdminExtendedAttrsIpV6TestJSON-245840985-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.358230 Jul 31 01:22:35.579557 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1578/3126] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:22:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:22:35.585724 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-aa2fe323-3ede-4fbe-8f74-9e298b7fff93 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:35.600353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-aa2fe323-3ede-4fbe-8f74-9e298b7fff93 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:35.620866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aa2fe323-3ede-4fbe-8f74-9e298b7fff93 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:35.623804 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aa2fe323-3ede-4fbe-8f74-9e298b7fff93 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:35.624862 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aa2fe323-3ede-4fbe-8f74-9e298b7fff93 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:35.625502 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aa2fe323-3ede-4fbe-8f74-9e298b7fff93 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:35.901471 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-aa2fe323-3ede-4fbe-8f74-9e298b7fff93 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:35.936277 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-aa2fe323-3ede-4fbe-8f74-9e298b7fff93 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1274 microversion: 2.1 time: 0.355385 Jul 31 01:22:35.938731 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1579/3127] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:35 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1274 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:36.364051 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b247be6-c641-4eae-a882-552bbfab2e84 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:36.383317 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3b247be6-c641-4eae-a882-552bbfab2e84 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1512 microversion: 2.1 time: 0.976840 Jul 31 01:22:36.384313 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1549/3128] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:35 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1512 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:22:36.962543 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a0387d7-74ac-485a-b622-b2cf8f69a5f6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:36.969202 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9a0387d7-74ac-485a-b622-b2cf8f69a5f6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:36.984103 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a0387d7-74ac-485a-b622-b2cf8f69a5f6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:36.985556 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a0387d7-74ac-485a-b622-b2cf8f69a5f6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:36.987812 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a0387d7-74ac-485a-b622-b2cf8f69a5f6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:36.992412 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a0387d7-74ac-485a-b622-b2cf8f69a5f6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:37.411197 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-93e08d1d-2e56-481f-8268-a63f72dd7cfe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:37.412019 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-93e08d1d-2e56-481f-8268-a63f72dd7cfe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:37.426687 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93e08d1d-2e56-481f-8268-a63f72dd7cfe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:37.427267 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93e08d1d-2e56-481f-8268-a63f72dd7cfe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:37.428211 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93e08d1d-2e56-481f-8268-a63f72dd7cfe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:37.429753 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93e08d1d-2e56-481f-8268-a63f72dd7cfe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:38.448990 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-93e08d1d-2e56-481f-8268-a63f72dd7cfe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:38.459269 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-93e08d1d-2e56-481f-8268-a63f72dd7cfe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1512 microversion: 2.1 time: 1.051299 Jul 31 01:22:38.475471 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1550/3129] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:37 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1512 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:38.804748 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:38.896764 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:38.964791 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9a0387d7-74ac-485a-b622-b2cf8f69a5f6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:38.979856 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9a0387d7-74ac-485a-b622-b2cf8f69a5f6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1316 microversion: 2.1 time: 2.021188 Jul 31 01:22:38.983384 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1580/3130] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:36 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1316 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:39.190683 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 01:22:39.190862 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 01:22:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 01:22:39.481825 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-462f8770-67ff-447a-b8ae-4c140bc46a8c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:39.482973 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-462f8770-67ff-447a-b8ae-4c140bc46a8c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:39.491816 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:39.498368 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-462f8770-67ff-447a-b8ae-4c140bc46a8c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:39.498980 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-462f8770-67ff-447a-b8ae-4c140bc46a8c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:39.499842 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-462f8770-67ff-447a-b8ae-4c140bc46a8c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:39.509305 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-462f8770-67ff-447a-b8ae-4c140bc46a8c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:40.006028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-414b98da-7af3-4ee4-83a8-7fc161bf773f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:40.007638 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-414b98da-7af3-4ee4-83a8-7fc161bf773f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:40.016879 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-414b98da-7af3-4ee4-83a8-7fc161bf773f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:40.017632 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-414b98da-7af3-4ee4-83a8-7fc161bf773f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:40.018859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-414b98da-7af3-4ee4-83a8-7fc161bf773f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:40.019549 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-414b98da-7af3-4ee4-83a8-7fc161bf773f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:40.308968 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-462f8770-67ff-447a-b8ae-4c140bc46a8c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:40.327582 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-462f8770-67ff-447a-b8ae-4c140bc46a8c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1512 microversion: 2.1 time: 0.849524 Jul 31 01:22:40.328688 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1551/3131] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:39 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1512 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:40.725275 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-414b98da-7af3-4ee4-83a8-7fc161bf773f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:40.740517 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-414b98da-7af3-4ee4-83a8-7fc161bf773f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1316 microversion: 2.1 time: 0.738104 Jul 31 01:22:40.741787 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1581/3132] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:40 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1316 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:22:40.926856 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-b29e95c6-1063-47fe-9606-61f607545289 req-eccbacbc-7a14-4800-9793-530148cacb4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a960a5aa-d631-4018-b2a2-c7e453fe341f", "tag": "4360dd0b-f437-42de-a9a3-02fda4423657"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:40.956444 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b29e95c6-1063-47fe-9606-61f607545289 req-eccbacbc-7a14-4800-9793-530148cacb4e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:40.957866 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b29e95c6-1063-47fe-9606-61f607545289 req-eccbacbc-7a14-4800-9793-530148cacb4e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:40.977479 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-b29e95c6-1063-47fe-9606-61f607545289 req-eccbacbc-7a14-4800-9793-530148cacb4e service nova] Creating event network-changed:4360dd0b-f437-42de-a9a3-02fda4423657 for instance a960a5aa-d631-4018-b2a2-c7e453fe341f on n-h1-master-1 Jul 31 01:22:40.990836 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-b29e95c6-1063-47fe-9606-61f607545289 req-eccbacbc-7a14-4800-9793-530148cacb4e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068121 Jul 31 01:22:40.991482 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1552/3133] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:22:41.349704 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ec1ec068-05fe-4baa-94c8-43f43a96704a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:41.350344 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ec1ec068-05fe-4baa-94c8-43f43a96704a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:41.367135 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec1ec068-05fe-4baa-94c8-43f43a96704a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:41.367634 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec1ec068-05fe-4baa-94c8-43f43a96704a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:41.368445 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec1ec068-05fe-4baa-94c8-43f43a96704a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:41.373810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec1ec068-05fe-4baa-94c8-43f43a96704a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:41.767380 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fb9d7069-cee2-46bf-a4cb-ff5f1b6a9e26 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:41.768834 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fb9d7069-cee2-46bf-a4cb-ff5f1b6a9e26 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:41.792018 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb9d7069-cee2-46bf-a4cb-ff5f1b6a9e26 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:41.795364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb9d7069-cee2-46bf-a4cb-ff5f1b6a9e26 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:41.796504 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb9d7069-cee2-46bf-a4cb-ff5f1b6a9e26 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:41.799355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb9d7069-cee2-46bf-a4cb-ff5f1b6a9e26 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:42.987026 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ec1ec068-05fe-4baa-94c8-43f43a96704a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:43.003653 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ec1ec068-05fe-4baa-94c8-43f43a96704a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1512 microversion: 2.1 time: 1.654637 Jul 31 01:22:43.006839 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1582/3134] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:41 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1512 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:43.202394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fb9d7069-cee2-46bf-a4cb-ff5f1b6a9e26 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:43.211435 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fb9d7069-cee2-46bf-a4cb-ff5f1b6a9e26 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1316 microversion: 2.1 time: 1.452188 Jul 31 01:22:43.212040 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1553/3135] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:41 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1316 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:44.032245 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5dac7baa-a9b9-4859-8dc9-f02fe3eb1aeb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:44.041912 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5dac7baa-a9b9-4859-8dc9-f02fe3eb1aeb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:44.066389 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5dac7baa-a9b9-4859-8dc9-f02fe3eb1aeb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:44.073815 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5dac7baa-a9b9-4859-8dc9-f02fe3eb1aeb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:44.074959 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5dac7baa-a9b9-4859-8dc9-f02fe3eb1aeb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:44.078702 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5dac7baa-a9b9-4859-8dc9-f02fe3eb1aeb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:44.234189 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8088cab5-ee78-4a8f-9c15-ef719d2eea5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:44.234822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8088cab5-ee78-4a8f-9c15-ef719d2eea5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:44.254222 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8088cab5-ee78-4a8f-9c15-ef719d2eea5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:44.254964 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8088cab5-ee78-4a8f-9c15-ef719d2eea5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:44.255978 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8088cab5-ee78-4a8f-9c15-ef719d2eea5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:44.256581 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8088cab5-ee78-4a8f-9c15-ef719d2eea5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:44.711483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8088cab5-ee78-4a8f-9c15-ef719d2eea5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:44.725186 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8088cab5-ee78-4a8f-9c15-ef719d2eea5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1316 microversion: 2.1 time: 0.496500 Jul 31 01:22:44.725797 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1554/3136] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:44 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1316 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:44.729166 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5dac7baa-a9b9-4859-8dc9-f02fe3eb1aeb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:44.742712 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5dac7baa-a9b9-4859-8dc9-f02fe3eb1aeb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1512 microversion: 2.1 time: 0.716453 Jul 31 01:22:44.743555 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1583/3137] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:44 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1512 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:45.751160 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-20fae493-9a96-4e3b-a5f1-fc613a21c7cf tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:45.751824 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-20fae493-9a96-4e3b-a5f1-fc613a21c7cf tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:45.765043 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c3778b74-de4e-44ec-92d6-db684a77b9b4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:45.765671 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c3778b74-de4e-44ec-92d6-db684a77b9b4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:45.766714 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-20fae493-9a96-4e3b-a5f1-fc613a21c7cf tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:45.767245 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-20fae493-9a96-4e3b-a5f1-fc613a21c7cf tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:45.774153 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-20fae493-9a96-4e3b-a5f1-fc613a21c7cf tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:45.774782 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-20fae493-9a96-4e3b-a5f1-fc613a21c7cf tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:45.777318 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3778b74-de4e-44ec-92d6-db684a77b9b4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:45.790137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3778b74-de4e-44ec-92d6-db684a77b9b4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:45.791279 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3778b74-de4e-44ec-92d6-db684a77b9b4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:45.791926 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3778b74-de4e-44ec-92d6-db684a77b9b4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:46.309341 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c3778b74-de4e-44ec-92d6-db684a77b9b4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:46.322403 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c3778b74-de4e-44ec-92d6-db684a77b9b4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1512 microversion: 2.1 time: 0.561742 Jul 31 01:22:46.323022 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1584/3138] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:45 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1512 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:46.347518 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-20fae493-9a96-4e3b-a5f1-fc613a21c7cf tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:46.358328 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-20fae493-9a96-4e3b-a5f1-fc613a21c7cf tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1316 microversion: 2.1 time: 0.609027 Jul 31 01:22:46.358876 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1555/3139] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:45 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1316 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:47.349416 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-70c68827-3fab-444e-9b3b-fb898499b010 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:47.351314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-70c68827-3fab-444e-9b3b-fb898499b010 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:47.365167 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-70c68827-3fab-444e-9b3b-fb898499b010 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:47.367971 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-70c68827-3fab-444e-9b3b-fb898499b010 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:47.369810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-70c68827-3fab-444e-9b3b-fb898499b010 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:47.370546 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-70c68827-3fab-444e-9b3b-fb898499b010 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:47.381583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ca273baa-a56d-4804-ad97-1aa3f93688cf tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:47.382384 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ca273baa-a56d-4804-ad97-1aa3f93688cf tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:47.400759 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca273baa-a56d-4804-ad97-1aa3f93688cf tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:47.404644 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca273baa-a56d-4804-ad97-1aa3f93688cf tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:47.405824 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca273baa-a56d-4804-ad97-1aa3f93688cf tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:47.409293 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca273baa-a56d-4804-ad97-1aa3f93688cf tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:48.101800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ca273baa-a56d-4804-ad97-1aa3f93688cf tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:48.105998 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-70c68827-3fab-444e-9b3b-fb898499b010 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:48.108467 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:48.112325 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ca273baa-a56d-4804-ad97-1aa3f93688cf tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1316 microversion: 2.1 time: 0.737339 Jul 31 01:22:48.113741 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1556/3140] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:47 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1316 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:48.130005 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-70c68827-3fab-444e-9b3b-fb898499b010 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1512 microversion: 2.1 time: 0.786564 Jul 31 01:22:48.144144 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1585/3141] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:47 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1512 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:49.134846 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cf7fb5e7-72dc-4c4b-b3a5-b447c56decdd tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:49.135407 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cf7fb5e7-72dc-4c4b-b3a5-b447c56decdd tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:49.145547 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf7fb5e7-72dc-4c4b-b3a5-b447c56decdd tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:49.153361 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-71a43e52-ab3d-44f1-8912-2c1d297e5c79 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:49.155147 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-71a43e52-ab3d-44f1-8912-2c1d297e5c79 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:49.159876 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf7fb5e7-72dc-4c4b-b3a5-b447c56decdd tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:49.161062 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf7fb5e7-72dc-4c4b-b3a5-b447c56decdd tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:49.162720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf7fb5e7-72dc-4c4b-b3a5-b447c56decdd tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:49.165356 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71a43e52-ab3d-44f1-8912-2c1d297e5c79 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:49.168866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71a43e52-ab3d-44f1-8912-2c1d297e5c79 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:49.169963 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71a43e52-ab3d-44f1-8912-2c1d297e5c79 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:49.171890 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71a43e52-ab3d-44f1-8912-2c1d297e5c79 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:49.220695 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:50.100727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-71a43e52-ab3d-44f1-8912-2c1d297e5c79 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:50.114446 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-71a43e52-ab3d-44f1-8912-2c1d297e5c79 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1512 microversion: 2.1 time: 0.965458 Jul 31 01:22:50.130872 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1586/3142] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:49 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1512 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:50.143946 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-328d3915-a168-47e1-92a9-cf49b0be215f req-9543b2d9-d1ee-4a18-86b5-f70401b02fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a960a5aa-d631-4018-b2a2-c7e453fe341f", "name": "network-vif-plugged", "status": "completed", "tag": "4360dd0b-f437-42de-a9a3-02fda4423657"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:50.155837 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cf7fb5e7-72dc-4c4b-b3a5-b447c56decdd tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:50.170363 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cf7fb5e7-72dc-4c4b-b3a5-b447c56decdd tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1316 microversion: 2.1 time: 1.034965 Jul 31 01:22:50.173014 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1557/3143] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:49 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1316 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:50.178345 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-328d3915-a168-47e1-92a9-cf49b0be215f req-9543b2d9-d1ee-4a18-86b5-f70401b02fae service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:50.179528 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-328d3915-a168-47e1-92a9-cf49b0be215f req-9543b2d9-d1ee-4a18-86b5-f70401b02fae service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:50.211494 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-328d3915-a168-47e1-92a9-cf49b0be215f req-9543b2d9-d1ee-4a18-86b5-f70401b02fae service nova] Creating event network-vif-plugged:4360dd0b-f437-42de-a9a3-02fda4423657 for instance a960a5aa-d631-4018-b2a2-c7e453fe341f on n-h1-master-1 Jul 31 01:22:50.223772 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-328d3915-a168-47e1-92a9-cf49b0be215f req-9543b2d9-d1ee-4a18-86b5-f70401b02fae service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084501 Jul 31 01:22:50.228094 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1587/3144] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:22:51.138547 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9ac74cf3-dd02-4f8e-b490-ff24b8563c7a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:51.139444 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9ac74cf3-dd02-4f8e-b490-ff24b8563c7a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:51.160322 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ac74cf3-dd02-4f8e-b490-ff24b8563c7a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:51.160922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ac74cf3-dd02-4f8e-b490-ff24b8563c7a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:51.161587 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ac74cf3-dd02-4f8e-b490-ff24b8563c7a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:51.162035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ac74cf3-dd02-4f8e-b490-ff24b8563c7a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:51.196426 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-519717ef-2f47-42f3-aff7-3961fd234119 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:51.197269 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-519717ef-2f47-42f3-aff7-3961fd234119 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:51.230129 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-519717ef-2f47-42f3-aff7-3961fd234119 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:51.234360 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-519717ef-2f47-42f3-aff7-3961fd234119 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:51.235410 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-519717ef-2f47-42f3-aff7-3961fd234119 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:51.235878 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-519717ef-2f47-42f3-aff7-3961fd234119 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:52.343081 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9ac74cf3-dd02-4f8e-b490-ff24b8563c7a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:52.361033 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9ac74cf3-dd02-4f8e-b490-ff24b8563c7a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1489 microversion: 2.1 time: 1.227807 Jul 31 01:22:52.362253 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1558/3145] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:51 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1489 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:52.385599 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-00850836-46d9-45fa-9044-2d1e78b86dd8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:52.389878 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-00850836-46d9-45fa-9044-2d1e78b86dd8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:52.397055 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-519717ef-2f47-42f3-aff7-3961fd234119 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:52.414649 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-519717ef-2f47-42f3-aff7-3961fd234119 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1316 microversion: 2.1 time: 1.217617 Jul 31 01:22:52.420270 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1588/3146] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:51 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1316 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:52.421134 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-00850836-46d9-45fa-9044-2d1e78b86dd8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:52.421769 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-00850836-46d9-45fa-9044-2d1e78b86dd8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:52.425539 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-00850836-46d9-45fa-9044-2d1e78b86dd8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:52.426160 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-00850836-46d9-45fa-9044-2d1e78b86dd8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:52.502177 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-00850836-46d9-45fa-9044-2d1e78b86dd8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 200 len: 155 microversion: 2.1 time: 0.118966 Jul 31 01:22:52.509385 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1559/3147] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:22:52 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 155 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:22:52.520348 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6440acbb-b6d6-4c5f-acaa-d5b71b9b80d5 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:52.522461 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6440acbb-b6d6-4c5f-acaa-d5b71b9b80d5 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:52.540733 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6440acbb-b6d6-4c5f-acaa-d5b71b9b80d5 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:52.542833 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6440acbb-b6d6-4c5f-acaa-d5b71b9b80d5 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:52.546983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6440acbb-b6d6-4c5f-acaa-d5b71b9b80d5 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:52.550377 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6440acbb-b6d6-4c5f-acaa-d5b71b9b80d5 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:53.157973 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6440acbb-b6d6-4c5f-acaa-d5b71b9b80d5 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:53.175459 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6440acbb-b6d6-4c5f-acaa-d5b71b9b80d5 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.661324 Jul 31 01:22:53.176717 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1589/3148] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:52 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:53.203900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4ee726b6-ddd9-4cb7-a74b-6c11b37e4642 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:53.205539 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4ee726b6-ddd9-4cb7-a74b-6c11b37e4642 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:53.218410 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ee726b6-ddd9-4cb7-a74b-6c11b37e4642 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:53.219260 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ee726b6-ddd9-4cb7-a74b-6c11b37e4642 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:53.220846 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ee726b6-ddd9-4cb7-a74b-6c11b37e4642 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:53.222312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ee726b6-ddd9-4cb7-a74b-6c11b37e4642 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:53.450625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5ea870e8-1bf8-4cd4-bae0-877211f4ddd6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:53.451979 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5ea870e8-1bf8-4cd4-bae0-877211f4ddd6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:53.467292 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5ea870e8-1bf8-4cd4-bae0-877211f4ddd6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:53.468410 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5ea870e8-1bf8-4cd4-bae0-877211f4ddd6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:53.470150 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5ea870e8-1bf8-4cd4-bae0-877211f4ddd6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:53.473449 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5ea870e8-1bf8-4cd4-bae0-877211f4ddd6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:53.892494 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4ee726b6-ddd9-4cb7-a74b-6c11b37e4642 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:53.914517 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4ee726b6-ddd9-4cb7-a74b-6c11b37e4642 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.714774 Jul 31 01:22:53.918404 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1560/3149] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:53 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:53.941802 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c2501db4-ac35-496c-8335-e194919b3d50 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:53.942996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c2501db4-ac35-496c-8335-e194919b3d50 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:53.954646 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c2501db4-ac35-496c-8335-e194919b3d50 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:53.955520 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c2501db4-ac35-496c-8335-e194919b3d50 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:53.956582 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c2501db4-ac35-496c-8335-e194919b3d50 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:53.961249 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c2501db4-ac35-496c-8335-e194919b3d50 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:54.084657 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5ea870e8-1bf8-4cd4-bae0-877211f4ddd6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:54.102341 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5ea870e8-1bf8-4cd4-bae0-877211f4ddd6 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1505 microversion: 2.1 time: 0.654748 Jul 31 01:22:54.107486 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1590/3150] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:53 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1505 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:54.125308 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-da91a48c-1c51-4bd6-b24b-076338c64983 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:54.125841 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-da91a48c-1c51-4bd6-b24b-076338c64983 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:54.133140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da91a48c-1c51-4bd6-b24b-076338c64983 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:54.133605 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da91a48c-1c51-4bd6-b24b-076338c64983 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:54.134408 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da91a48c-1c51-4bd6-b24b-076338c64983 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:54.135102 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da91a48c-1c51-4bd6-b24b-076338c64983 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:54.201244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-da91a48c-1c51-4bd6-b24b-076338c64983 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:22:54.357951 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:54.386791 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-da91a48c-1c51-4bd6-b24b-076338c64983 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 204 len: 0 microversion: 2.1 time: 0.265699 Jul 31 01:22:54.388691 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1591/3151] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:22:54 2022] DELETE /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:22:54.404241 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0cfd0ca4-c4d7-4300-8144-b4b51ccdb5ac tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:54.405403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0cfd0ca4-c4d7-4300-8144-b4b51ccdb5ac tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:54.421988 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0cfd0ca4-c4d7-4300-8144-b4b51ccdb5ac tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:54.422819 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0cfd0ca4-c4d7-4300-8144-b4b51ccdb5ac tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:54.423918 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0cfd0ca4-c4d7-4300-8144-b4b51ccdb5ac tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:54.427393 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0cfd0ca4-c4d7-4300-8144-b4b51ccdb5ac tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:54.440397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c2501db4-ac35-496c-8335-e194919b3d50 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:54.453558 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c2501db4-ac35-496c-8335-e194919b3d50 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.515337 Jul 31 01:22:54.471449 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1561/3152] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:53 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:54.489545 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e92fc543-5c2e-49fa-94fb-3f3fd39b3a27 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:54.502391 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e92fc543-5c2e-49fa-94fb-3f3fd39b3a27 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:54.532518 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e92fc543-5c2e-49fa-94fb-3f3fd39b3a27 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:54.535177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e92fc543-5c2e-49fa-94fb-3f3fd39b3a27 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:54.541454 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e92fc543-5c2e-49fa-94fb-3f3fd39b3a27 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:54.543818 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e92fc543-5c2e-49fa-94fb-3f3fd39b3a27 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:55.136109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0cfd0ca4-c4d7-4300-8144-b4b51ccdb5ac tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:55.151114 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0cfd0ca4-c4d7-4300-8144-b4b51ccdb5ac tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1511 microversion: 2.1 time: 0.757093 Jul 31 01:22:55.152012 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1592/3153] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:54 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1511 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:55.251779 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e92fc543-5c2e-49fa-94fb-3f3fd39b3a27 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:55.262475 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e92fc543-5c2e-49fa-94fb-3f3fd39b3a27 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.786523 Jul 31 01:22:55.267945 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1562/3154] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:54 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:22:55.540852 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f84dcea9-c758-4cee-8962-655dbce1993d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-996620604", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "97fe48eb-b52c-4abc-b249-8d6775315204"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:55.667079 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-f84dcea9-c758-4cee-8962-655dbce1993d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] validate_networks() for [('97fe48eb-b52c-4abc-b249-8d6775315204', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:22:56.188178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8466a46b-4040-4a62-9238-1ef9687e087e tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:56.189553 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8466a46b-4040-4a62-9238-1ef9687e087e tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:56.212201 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8466a46b-4040-4a62-9238-1ef9687e087e tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:56.213404 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8466a46b-4040-4a62-9238-1ef9687e087e tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:56.215569 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8466a46b-4040-4a62-9238-1ef9687e087e tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:56.217197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8466a46b-4040-4a62-9238-1ef9687e087e tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:57.185467 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8466a46b-4040-4a62-9238-1ef9687e087e tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:57.197032 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8466a46b-4040-4a62-9238-1ef9687e087e tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1511 microversion: 2.1 time: 1.025847 Jul 31 01:22:57.212201 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1563/3155] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:56 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1511 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:22:58.172796 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-26d0d0a6-dac4-4b7a-88bf-1eeab8624ed3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1421572229", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:22:58.273843 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-26d0d0a6-dac4-4b7a-88bf-1eeab8624ed3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] validate_networks() for [('7b031005-156d-4980-9df3-ab75fe4f1154', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:22:58.739964 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f84dcea9-c758-4cee-8962-655dbce1993d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:22:58.742762 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f84dcea9-c758-4cee-8962-655dbce1993d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:22:58.743492 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f84dcea9-c758-4cee-8962-655dbce1993d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:22:58.744091 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f84dcea9-c758-4cee-8962-655dbce1993d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:22:58.744704 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f84dcea9-c758-4cee-8962-655dbce1993d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:22:58.766950 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f84dcea9-c758-4cee-8962-655dbce1993d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:58.777209 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f84dcea9-c758-4cee-8962-655dbce1993d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:58.778461 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f84dcea9-c758-4cee-8962-655dbce1993d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:58.779085 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f84dcea9-c758-4cee-8962-655dbce1993d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:58.814700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-f84dcea9-c758-4cee-8962-655dbce1993d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Getting quotas for project da596310058e4248bf33465f387956f2. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:22:58.821005 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-f84dcea9-c758-4cee-8962-655dbce1993d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Getting quotas for user 36a36dbb4f6c40a7bb69c8c3f747aaed and project da596310058e4248bf33465f387956f2. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:22:58.835324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f84dcea9-c758-4cee-8962-655dbce1993d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:22:58.838280 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f84dcea9-c758-4cee-8962-655dbce1993d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:22:58.961710 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f84dcea9-c758-4cee-8962-655dbce1993d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.425932 Jul 31 01:22:58.964673 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1593/3156] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:22:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:22:58.977440 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7872d73a-d932-40db-b394-33a8ef059fff tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:58.980465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7872d73a-d932-40db-b394-33a8ef059fff tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:58.998808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7872d73a-d932-40db-b394-33a8ef059fff tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:58.999563 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7872d73a-d932-40db-b394-33a8ef059fff tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:59.002374 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7872d73a-d932-40db-b394-33a8ef059fff tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:22:59.002944 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7872d73a-d932-40db-b394-33a8ef059fff tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:22:59.425936 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7872d73a-d932-40db-b394-33a8ef059fff tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:59.463826 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7872d73a-d932-40db-b394-33a8ef059fff tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1469 microversion: 2.1 time: 0.495392 Jul 31 01:22:59.483383 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1594/3157] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:58 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1469 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:59.492333 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-12037e0e-d9fe-46d3-9416-b6bf044c5145 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:22:59.492888 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-12037e0e-d9fe-46d3-9416-b6bf044c5145 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:22:59.892782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-12037e0e-d9fe-46d3-9416-b6bf044c5145 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:22:59.913404 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-12037e0e-d9fe-46d3-9416-b6bf044c5145 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 200 len: 1214 microversion: 2.1 time: 0.416689 Jul 31 01:22:59.921005 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1595/3158] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:22:59 2022] GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 1214 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:22:59.939584 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-367730e1-0be2-4487-8a45-f680551eab21 req-090669da-8af4-477a-8938-36965eb349a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a960a5aa-d631-4018-b2a2-c7e453fe341f", "name": "network-vif-deleted", "tag": "4360dd0b-f437-42de-a9a3-02fda4423657"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:00.006017 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-367730e1-0be2-4487-8a45-f680551eab21 req-090669da-8af4-477a-8938-36965eb349a0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:00.006485 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-367730e1-0be2-4487-8a45-f680551eab21 req-090669da-8af4-477a-8938-36965eb349a0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:00.032793 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-367730e1-0be2-4487-8a45-f680551eab21 req-090669da-8af4-477a-8938-36965eb349a0 service nova] Creating event network-vif-deleted:4360dd0b-f437-42de-a9a3-02fda4423657 for instance a960a5aa-d631-4018-b2a2-c7e453fe341f on n-h1-master-1 Jul 31 01:23:00.049622 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-367730e1-0be2-4487-8a45-f680551eab21 req-090669da-8af4-477a-8938-36965eb349a0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124687 Jul 31 01:23:00.052175 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1596/3159] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:23:00.487364 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eb5fd1b2-bed9-46f3-804c-b3f49087c292 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:00.488157 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eb5fd1b2-bed9-46f3-804c-b3f49087c292 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:00.505109 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb5fd1b2-bed9-46f3-804c-b3f49087c292 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:00.506215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb5fd1b2-bed9-46f3-804c-b3f49087c292 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:00.507144 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb5fd1b2-bed9-46f3-804c-b3f49087c292 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:00.507759 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb5fd1b2-bed9-46f3-804c-b3f49087c292 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:00.627531 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb5fd1b2-bed9-46f3-804c-b3f49087c292 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:00.629740 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb5fd1b2-bed9-46f3-804c-b3f49087c292 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:00.630393 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-eb5fd1b2-bed9-46f3-804c-b3f49087c292 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lazy-loading 'fault' on Instance uuid a960a5aa-d631-4018-b2a2-c7e453fe341f {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:23:01.806178 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eb5fd1b2-bed9-46f3-804c-b3f49087c292 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8634c5dfc8d14138a4107a129d68e178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92857051a9cd4da89f95ecc871ad3f6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:01.815546 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eb5fd1b2-bed9-46f3-804c-b3f49087c292 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 200 len: 1306 microversion: 2.1 time: 1.333483 Jul 31 01:23:01.819761 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1597/3160] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:00 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 1306 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:01.835499 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3711f57b-85bb-4a60-8a85-fecf33eaf30e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:01.836375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3711f57b-85bb-4a60-8a85-fecf33eaf30e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:01.847882 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3711f57b-85bb-4a60-8a85-fecf33eaf30e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:01.848540 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3711f57b-85bb-4a60-8a85-fecf33eaf30e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:01.853692 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3711f57b-85bb-4a60-8a85-fecf33eaf30e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:01.854215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3711f57b-85bb-4a60-8a85-fecf33eaf30e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:02.087852 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3711f57b-85bb-4a60-8a85-fecf33eaf30e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:02.096748 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3711f57b-85bb-4a60-8a85-fecf33eaf30e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 200 len: 1272 microversion: 2.1 time: 0.275353 Jul 31 01:23:02.103975 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1598/3161] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:01 2022] GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 1272 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:02.118115 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-26d0d0a6-dac4-4b7a-88bf-1eeab8624ed3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:23:02.119240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-26d0d0a6-dac4-4b7a-88bf-1eeab8624ed3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:23:02.119967 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-26d0d0a6-dac4-4b7a-88bf-1eeab8624ed3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:23:02.120597 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-26d0d0a6-dac4-4b7a-88bf-1eeab8624ed3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:23:02.121254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-26d0d0a6-dac4-4b7a-88bf-1eeab8624ed3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:23:02.123800 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=38 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:02.138152 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26d0d0a6-dac4-4b7a-88bf-1eeab8624ed3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:02.141735 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26d0d0a6-dac4-4b7a-88bf-1eeab8624ed3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:02.142972 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26d0d0a6-dac4-4b7a-88bf-1eeab8624ed3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:02.143676 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26d0d0a6-dac4-4b7a-88bf-1eeab8624ed3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:02.184004 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-26d0d0a6-dac4-4b7a-88bf-1eeab8624ed3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Getting quotas for project af1bdeca391f47f3bde21459bf893f89. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:23:02.198183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-26d0d0a6-dac4-4b7a-88bf-1eeab8624ed3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Getting quotas for user 87e482f360af4e56a325960d834fb9f8 and project af1bdeca391f47f3bde21459bf893f89. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:23:02.239717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-26d0d0a6-dac4-4b7a-88bf-1eeab8624ed3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:23:02.242410 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-26d0d0a6-dac4-4b7a-88bf-1eeab8624ed3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:23:02.337684 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-26d0d0a6-dac4-4b7a-88bf-1eeab8624ed3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.388692 Jul 31 01:23:02.342293 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1564/3162] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:22:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 4394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:23:02.352627 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-da86184a-e3ad-42a2-bc62-10f96517497d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:02.354073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-da86184a-e3ad-42a2-bc62-10f96517497d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:02.577633 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-da86184a-e3ad-42a2-bc62-10f96517497d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:02.587724 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-da86184a-e3ad-42a2-bc62-10f96517497d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1222 microversion: 2.1 time: 0.237584 Jul 31 01:23:02.589744 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1599/3163] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:02 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1222 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:02.759827 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-941ea0bc-bf1b-4643-8e2d-5072c7c4e8ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-74935754", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:02.848109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bd84360e-51ce-47b7-8598-5685340a01b3 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:02.848881 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bd84360e-51ce-47b7-8598-5685340a01b3 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:02.868132 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd84360e-51ce-47b7-8598-5685340a01b3 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:02.869711 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd84360e-51ce-47b7-8598-5685340a01b3 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:02.870728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd84360e-51ce-47b7-8598-5685340a01b3 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:02.872642 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd84360e-51ce-47b7-8598-5685340a01b3 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:02.919760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-941ea0bc-bf1b-4643-8e2d-5072c7c4e8ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] validate_networks() for [('7b031005-156d-4980-9df3-ab75fe4f1154', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:23:02.939896 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-bd84360e-51ce-47b7-8598-5685340a01b3 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] HTTP exception thrown: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bd84360e-51ce-47b7-8598-5685340a01b3 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Request method failure captured: Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f HTTP/1.1 Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dlRsyP3Ljt0VLJ_UrhH10-Zk-5qXdFacuYajX3uhgr3WC9ik4RByEnW5eRKOiupCU0I5uDmo7KTtG2vo7Cj1JFjxyMEl7Sk9F8GYsBoP6EgU8_BdRoCeSJiBHWJ9SZ_gms1g5M0yOMf8rHeJTPC2PXDnmVJK-R93zSet_d2cuQHF9o Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 92857051a9cd4da89f95ecc871ad3f6d Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92857051a9cd4da89f95ecc871ad3f6d", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 92857051a9cd4da89f95ecc871ad3f6d Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesNegativeTestJSON-1191343095-project Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 8634c5dfc8d14138a4107a129d68e178 Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesNegativeTestJSON-1191343095-project Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: exception: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'a960a5aa-d631-4018-b2a2-c7e453fe341f'} Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:23:02.946123 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:02.963070 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:02.963070 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:23:02.963070 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:23:02.963070 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:23:02.963070 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:23:02.963070 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:02.963070 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:02.963070 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bd84360e-51ce-47b7-8598-5685340a01b3 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Returning 404 to user: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:23:02.963070 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bd84360e-51ce-47b7-8598-5685340a01b3 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 404 len: 111 microversion: 2.1 time: 0.116745 Jul 31 01:23:02.963070 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1600/3164] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:02 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:23:02.988457 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7e76b863-57b3-4328-a972-a163c4e5ce5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2136251449", "metadata": {"image_type": "test"}}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:03.001443 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7e76b863-57b3-4328-a972-a163c4e5ce5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:03.026479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e76b863-57b3-4328-a972-a163c4e5ce5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:03.027271 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e76b863-57b3-4328-a972-a163c4e5ce5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:03.029286 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e76b863-57b3-4328-a972-a163c4e5ce5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:03.030090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e76b863-57b3-4328-a972-a163c4e5ce5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:03.129507 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-7e76b863-57b3-4328-a972-a163c4e5ce5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] HTTP exception thrown: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7e76b863-57b3-4328-a972-a163c4e5ce5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Request method failure captured: Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f/action HTTP/1.1 Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 112 Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dlRsyP3Ljt0VLJ_UrhH10-Zk-5qXdFacuYajX3uhgr3WC9ik4RByEnW5eRKOiupCU0I5uDmo7KTtG2vo7Cj1JFjxyMEl7Sk9F8GYsBoP6EgU8_BdRoCeSJiBHWJ9SZ_gms1g5M0yOMf8rHeJTPC2PXDnmVJK-R93zSet_d2cuQHF9o Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 92857051a9cd4da89f95ecc871ad3f6d Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92857051a9cd4da89f95ecc871ad3f6d", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 92857051a9cd4da89f95ecc871ad3f6d Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesNegativeTestJSON-1191343095-project Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 8634c5dfc8d14138a4107a129d68e178 Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesNegativeTestJSON-1191343095-project Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2136251449", "metadata": {"image_type": "test"}}} Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: exception: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'a960a5aa-d631-4018-b2a2-c7e453fe341f', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2136251449', 'metadata': {'image_type': 'test'}}}} Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 31 01:23:03.140039 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:23:03.147982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:23:03.147982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:23:03.147982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:23:03.147982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:03.147982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.147982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:23:03.147982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.147982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.147982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:23:03.147982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:23:03.147982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:23:03.147982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:23:03.147982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:03.147982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.147982 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7e76b863-57b3-4328-a972-a163c4e5ce5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Returning 404 to user: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:23:03.147982 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7e76b863-57b3-4328-a972-a163c4e5ce5f tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "POST /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f/action" status: 404 len: 111 microversion: 2.1 time: 0.176638 Jul 31 01:23:03.150255 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1601/3165] 10.222.0.45 () {60 vars in 1279 bytes} [Sun Jul 31 01:23:02 2022] POST /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f/action => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:23:03.170667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e1dbbd64-5452-45ca-a4d3-88818db9b74a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:03.172386 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e1dbbd64-5452-45ca-a4d3-88818db9b74a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:03.198949 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1dbbd64-5452-45ca-a4d3-88818db9b74a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:03.201977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1dbbd64-5452-45ca-a4d3-88818db9b74a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:03.206510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1dbbd64-5452-45ca-a4d3-88818db9b74a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:03.208425 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1dbbd64-5452-45ca-a4d3-88818db9b74a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:03.542226 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e1dbbd64-5452-45ca-a4d3-88818db9b74a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:03.569279 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e1dbbd64-5452-45ca-a4d3-88818db9b74a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 200 len: 1272 microversion: 2.1 time: 0.408822 Jul 31 01:23:03.571572 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1602/3166] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:03 2022] GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 1272 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:03.578951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-49f949f5-987f-4448-8ec2-323badeb18e3 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-105886425", "metadata": {"image_type": "test"}}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:03.581580 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-49f949f5-987f-4448-8ec2-323badeb18e3 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Failed to fetch instance by id tempest-invalid-255442605 {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2928}} Jul 31 01:23:03.582115 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-49f949f5-987f-4448-8ec2-323badeb18e3 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] HTTP exception thrown: Instance tempest-invalid-255442605 could not be found. Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-49f949f5-987f-4448-8ec2-323badeb18e3 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Request method failure captured: Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/tempest-invalid-255442605/action HTTP/1.1 Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 111 Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dlRsyP3Ljt0VLJ_UrhH10-Zk-5qXdFacuYajX3uhgr3WC9ik4RByEnW5eRKOiupCU0I5uDmo7KTtG2vo7Cj1JFjxyMEl7Sk9F8GYsBoP6EgU8_BdRoCeSJiBHWJ9SZ_gms1g5M0yOMf8rHeJTPC2PXDnmVJK-R93zSet_d2cuQHF9o Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 92857051a9cd4da89f95ecc871ad3f6d Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92857051a9cd4da89f95ecc871ad3f6d", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 92857051a9cd4da89f95ecc871ad3f6d Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesNegativeTestJSON-1191343095-project Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 8634c5dfc8d14138a4107a129d68e178 Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesNegativeTestJSON-1191343095-project Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-105886425", "metadata": {"image_type": "test"}}} Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: exception: Instance tempest-invalid-255442605 could not be found. Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'tempest-invalid-255442605', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-105886425', 'metadata': {'image_type': 'test'}}}} Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-255442605 could not be found. Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:23:03.584391 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-255442605 could not be found. Jul 31 01:23:03.599362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.599362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:23:03.599362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.599362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.599362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:23:03.599362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:23:03.599362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:23:03.599362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:23:03.599362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-255442605 could not be found. Jul 31 01:23:03.599362 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.599362 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-49f949f5-987f-4448-8ec2-323badeb18e3 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Returning 404 to user: Instance tempest-invalid-255442605 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:23:03.599362 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-49f949f5-987f-4448-8ec2-323badeb18e3 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "POST /compute/v2.1/servers/tempest-invalid-255442605/action" status: 404 len: 100 microversion: 2.1 time: 0.012959 Jul 31 01:23:03.599362 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1603/3167] 10.222.0.45 () {60 vars in 1246 bytes} [Sun Jul 31 01:23:03 2022] POST /compute/v2.1/servers/tempest-invalid-255442605/action => generated 100 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:23:03.602019 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5ec77d62-f971-428d-9147-94b9e9202866 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-843336408"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:03.604667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5ec77d62-f971-428d-9147-94b9e9202866 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2928}} Jul 31 01:23:03.605616 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-5ec77d62-f971-428d-9147-94b9e9202866 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5ec77d62-f971-428d-9147-94b9e9202866 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Request method failure captured: Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 56 Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dlRsyP3Ljt0VLJ_UrhH10-Zk-5qXdFacuYajX3uhgr3WC9ik4RByEnW5eRKOiupCU0I5uDmo7KTtG2vo7Cj1JFjxyMEl7Sk9F8GYsBoP6EgU8_BdRoCeSJiBHWJ9SZ_gms1g5M0yOMf8rHeJTPC2PXDnmVJK-R93zSet_d2cuQHF9o Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 92857051a9cd4da89f95ecc871ad3f6d Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92857051a9cd4da89f95ecc871ad3f6d", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 92857051a9cd4da89f95ecc871ad3f6d Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesNegativeTestJSON-1191343095-project Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 8634c5dfc8d14138a4107a129d68e178 Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesNegativeTestJSON-1191343095-project Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: {"createImage": {"name": "tempest-test-snap-843336408"}} Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-843336408'}}} Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 31 01:23:03.608343 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.612535 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:23:03.612535 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.612535 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.612535 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:23:03.612535 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:23:03.612535 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:23:03.612535 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:23:03.612535 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 31 01:23:03.612535 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.614460 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5ec77d62-f971-428d-9147-94b9e9202866 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:23:03.616033 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5ec77d62-f971-428d-9147-94b9e9202866 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.023871 Jul 31 01:23:03.616725 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1604/3168] 10.222.0.45 () {60 vars in 1275 bytes} [Sun Jul 31 01:23:03 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:23:03.632314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f20d6358-76b5-4f6b-9623-b0299bdfaa89 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1192048103"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:03.634678 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f20d6358-76b5-4f6b-9623-b0299bdfaa89 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2928}} Jul 31 01:23:03.635200 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-f20d6358-76b5-4f6b-9623-b0299bdfaa89 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f20d6358-76b5-4f6b-9623-b0299bdfaa89 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Request method failure captured: Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 57 Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dlRsyP3Ljt0VLJ_UrhH10-Zk-5qXdFacuYajX3uhgr3WC9ik4RByEnW5eRKOiupCU0I5uDmo7KTtG2vo7Cj1JFjxyMEl7Sk9F8GYsBoP6EgU8_BdRoCeSJiBHWJ9SZ_gms1g5M0yOMf8rHeJTPC2PXDnmVJK-R93zSet_d2cuQHF9o Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 92857051a9cd4da89f95ecc871ad3f6d Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92857051a9cd4da89f95ecc871ad3f6d", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 92857051a9cd4da89f95ecc871ad3f6d Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesNegativeTestJSON-1191343095-project Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 8634c5dfc8d14138a4107a129d68e178 Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesNegativeTestJSON-1191343095-project Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: {"createImage": {"name": "tempest-test-snap-1192048103"}} Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1192048103'}}} Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 31 01:23:03.636783 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.646347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:23:03.646347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.646347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.646347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:23:03.646347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:23:03.646347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:23:03.646347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:23:03.646347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 31 01:23:03.646347 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.646347 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f20d6358-76b5-4f6b-9623-b0299bdfaa89 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:23:03.646347 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f20d6358-76b5-4f6b-9623-b0299bdfaa89 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.015968 Jul 31 01:23:03.646347 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1605/3169] 10.222.0.45 () {60 vars in 1281 bytes} [Sun Jul 31 01:23:03 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:23:03.654877 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ae53e8f-11d3-44de-a95e-dffb1dbb873d tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:03.655968 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4ae53e8f-11d3-44de-a95e-dffb1dbb873d tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:03.667700 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ae53e8f-11d3-44de-a95e-dffb1dbb873d tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:03.668738 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ae53e8f-11d3-44de-a95e-dffb1dbb873d tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:03.669771 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ae53e8f-11d3-44de-a95e-dffb1dbb873d tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:03.670261 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ae53e8f-11d3-44de-a95e-dffb1dbb873d tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:03.704796 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-4ae53e8f-11d3-44de-a95e-dffb1dbb873d tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] HTTP exception thrown: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ae53e8f-11d3-44de-a95e-dffb1dbb873d tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Request method failure captured: Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f HTTP/1.1 Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dlRsyP3Ljt0VLJ_UrhH10-Zk-5qXdFacuYajX3uhgr3WC9ik4RByEnW5eRKOiupCU0I5uDmo7KTtG2vo7Cj1JFjxyMEl7Sk9F8GYsBoP6EgU8_BdRoCeSJiBHWJ9SZ_gms1g5M0yOMf8rHeJTPC2PXDnmVJK-R93zSet_d2cuQHF9o Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 92857051a9cd4da89f95ecc871ad3f6d Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92857051a9cd4da89f95ecc871ad3f6d", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 92857051a9cd4da89f95ecc871ad3f6d Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesNegativeTestJSON-1191343095-project Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 8634c5dfc8d14138a4107a129d68e178 Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesNegativeTestJSON-1191343095-project Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: exception: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'a960a5aa-d631-4018-b2a2-c7e453fe341f'} Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:23:03.707226 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:23:03.712058 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:03.712058 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.712058 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:23:03.712058 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.712058 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.712058 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:23:03.712058 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:23:03.712058 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:23:03.712058 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:23:03.712058 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:03.712058 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.712058 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ae53e8f-11d3-44de-a95e-dffb1dbb873d tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Returning 404 to user: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:23:03.712058 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4ae53e8f-11d3-44de-a95e-dffb1dbb873d tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 404 len: 111 microversion: 2.1 time: 0.060787 Jul 31 01:23:03.712058 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1606/3170] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:23:03 2022] DELETE /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:23:03.734840 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-147bec11-d351-4df3-ab09-cf2d0a3041a1 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:03.735818 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-147bec11-d351-4df3-ab09-cf2d0a3041a1 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] [instance: a960a5aa-d631-4018-b2a2-c7e453fe341f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:03.745607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-147bec11-d351-4df3-ab09-cf2d0a3041a1 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:03.746429 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-147bec11-d351-4df3-ab09-cf2d0a3041a1 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:03.749332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-147bec11-d351-4df3-ab09-cf2d0a3041a1 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:03.750161 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-147bec11-d351-4df3-ab09-cf2d0a3041a1 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:03.777768 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-147bec11-d351-4df3-ab09-cf2d0a3041a1 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] HTTP exception thrown: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-147bec11-d351-4df3-ab09-cf2d0a3041a1 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Request method failure captured: Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f HTTP/1.1 Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dlRsyP3Ljt0VLJ_UrhH10-Zk-5qXdFacuYajX3uhgr3WC9ik4RByEnW5eRKOiupCU0I5uDmo7KTtG2vo7Cj1JFjxyMEl7Sk9F8GYsBoP6EgU8_BdRoCeSJiBHWJ9SZ_gms1g5M0yOMf8rHeJTPC2PXDnmVJK-R93zSet_d2cuQHF9o Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 92857051a9cd4da89f95ecc871ad3f6d Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/92857051a9cd4da89f95ecc871ad3f6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_92857051a9cd4da89f95ecc871ad3f6d", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 92857051a9cd4da89f95ecc871ad3f6d Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1191343095 Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesNegativeTestJSON-1191343095-project Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 8634c5dfc8d14138a4107a129d68e178 Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesNegativeTestJSON-1191343095-project Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: exception: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'a960a5aa-d631-4018-b2a2-c7e453fe341f'} Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:23:03.780475 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.785300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:03.785300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:23:03.785300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:23:03.785300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:23:03.785300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:23:03.785300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. Jul 31 01:23:03.785300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:23:03.787442 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-147bec11-d351-4df3-ab09-cf2d0a3041a1 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] Returning 404 to user: Instance a960a5aa-d631-4018-b2a2-c7e453fe341f could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:23:03.789314 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-147bec11-d351-4df3-ab09-cf2d0a3041a1 tempest-ImagesNegativeTestJSON-1191343095 tempest-ImagesNegativeTestJSON-1191343095-project] 10.222.0.45 "GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f" status: 404 len: 111 microversion: 2.1 time: 0.073176 Jul 31 01:23:03.791060 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1607/3171] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:03 2022] GET /compute/v2.1/servers/a960a5aa-d631-4018-b2a2-c7e453fe341f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:23:04.594395 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-22e339a3-a5a6-4b58-aaa1-71a215ceb06a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:04.595036 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-22e339a3-a5a6-4b58-aaa1-71a215ceb06a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:04.605403 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22e339a3-a5a6-4b58-aaa1-71a215ceb06a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:04.609293 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22e339a3-a5a6-4b58-aaa1-71a215ceb06a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:04.623622 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22e339a3-a5a6-4b58-aaa1-71a215ceb06a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:04.624637 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22e339a3-a5a6-4b58-aaa1-71a215ceb06a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:04.891476 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-22e339a3-a5a6-4b58-aaa1-71a215ceb06a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:04.902948 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-22e339a3-a5a6-4b58-aaa1-71a215ceb06a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 200 len: 1272 microversion: 2.1 time: 0.314590 Jul 31 01:23:04.907941 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1608/3172] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:04 2022] GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 1272 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:05.648700 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-941ea0bc-bf1b-4643-8e2d-5072c7c4e8ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:23:05.649435 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-941ea0bc-bf1b-4643-8e2d-5072c7c4e8ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:23:05.649917 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-941ea0bc-bf1b-4643-8e2d-5072c7c4e8ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:23:05.650336 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-941ea0bc-bf1b-4643-8e2d-5072c7c4e8ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:23:05.650747 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-941ea0bc-bf1b-4643-8e2d-5072c7c4e8ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:23:05.672798 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-941ea0bc-bf1b-4643-8e2d-5072c7c4e8ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:05.673260 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-941ea0bc-bf1b-4643-8e2d-5072c7c4e8ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:05.674071 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-941ea0bc-bf1b-4643-8e2d-5072c7c4e8ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:05.674514 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-941ea0bc-bf1b-4643-8e2d-5072c7c4e8ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:05.724589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-941ea0bc-bf1b-4643-8e2d-5072c7c4e8ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Getting quotas for project af1bdeca391f47f3bde21459bf893f89. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:23:05.733685 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-941ea0bc-bf1b-4643-8e2d-5072c7c4e8ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Getting quotas for user 87e482f360af4e56a325960d834fb9f8 and project af1bdeca391f47f3bde21459bf893f89. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:23:05.764462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-941ea0bc-bf1b-4643-8e2d-5072c7c4e8ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:23:05.766603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-941ea0bc-bf1b-4643-8e2d-5072c7c4e8ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:23:05.882360 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-941ea0bc-bf1b-4643-8e2d-5072c7c4e8ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.131846 Jul 31 01:23:05.887753 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1565/3173] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:23:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 3138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:23:05.902618 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-68e5c66f-80e5-4c01-b49a-2c64146e9b73 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:05.904527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-68e5c66f-80e5-4c01-b49a-2c64146e9b73 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:06.145211 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f6bf08e2-cf72-48f4-916b-10ee37f9cb1e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1194242790", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:06.284464 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-f6bf08e2-cf72-48f4-916b-10ee37f9cb1e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] validate_networks() for [('4d404412-2eb0-46dc-81fa-b0022c4749f4', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:23:06.898652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-68e5c66f-80e5-4c01-b49a-2c64146e9b73 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:06.914431 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-68e5c66f-80e5-4c01-b49a-2c64146e9b73 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1220 microversion: 2.1 time: 1.016492 Jul 31 01:23:06.918461 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1566/3174] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:05 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1220 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:06.940535 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5fdde6c1-474e-4d33-9d53-a17592f3220c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:06.942247 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5fdde6c1-474e-4d33-9d53-a17592f3220c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:06.964251 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5fdde6c1-474e-4d33-9d53-a17592f3220c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:06.964997 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5fdde6c1-474e-4d33-9d53-a17592f3220c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:06.966110 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5fdde6c1-474e-4d33-9d53-a17592f3220c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:06.966722 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5fdde6c1-474e-4d33-9d53-a17592f3220c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:07.984055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5fdde6c1-474e-4d33-9d53-a17592f3220c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:08.019895 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5fdde6c1-474e-4d33-9d53-a17592f3220c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 200 len: 1314 microversion: 2.1 time: 1.097852 Jul 31 01:23:08.035668 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1567/3175] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:06 2022] GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 1314 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:08.040774 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a70b8737-09be-41f7-ad0f-35ebcdc2f854 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:08.041401 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a70b8737-09be-41f7-ad0f-35ebcdc2f854 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:08.048151 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a70b8737-09be-41f7-ad0f-35ebcdc2f854 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:08.048616 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a70b8737-09be-41f7-ad0f-35ebcdc2f854 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:08.049583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a70b8737-09be-41f7-ad0f-35ebcdc2f854 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:08.050035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a70b8737-09be-41f7-ad0f-35ebcdc2f854 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:08.348080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a70b8737-09be-41f7-ad0f-35ebcdc2f854 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:08.356969 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a70b8737-09be-41f7-ad0f-35ebcdc2f854 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1278 microversion: 2.1 time: 0.319261 Jul 31 01:23:08.369007 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1568/3176] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:08 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1278 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:08.804817 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:09.043539 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b9e7ff77-734b-4c71-aea2-d5cf8a796c19 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:09.044920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b9e7ff77-734b-4c71-aea2-d5cf8a796c19 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:09.055955 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9e7ff77-734b-4c71-aea2-d5cf8a796c19 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:09.057025 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9e7ff77-734b-4c71-aea2-d5cf8a796c19 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:09.058037 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9e7ff77-734b-4c71-aea2-d5cf8a796c19 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:09.058711 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9e7ff77-734b-4c71-aea2-d5cf8a796c19 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:09.294993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f6bf08e2-cf72-48f4-916b-10ee37f9cb1e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:23:09.297305 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f6bf08e2-cf72-48f4-916b-10ee37f9cb1e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:23:09.298111 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f6bf08e2-cf72-48f4-916b-10ee37f9cb1e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:23:09.299610 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f6bf08e2-cf72-48f4-916b-10ee37f9cb1e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:23:09.300397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f6bf08e2-cf72-48f4-916b-10ee37f9cb1e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:23:09.318956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6bf08e2-cf72-48f4-916b-10ee37f9cb1e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:09.320173 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6bf08e2-cf72-48f4-916b-10ee37f9cb1e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:09.321308 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6bf08e2-cf72-48f4-916b-10ee37f9cb1e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:09.321987 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6bf08e2-cf72-48f4-916b-10ee37f9cb1e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:09.361008 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-f6bf08e2-cf72-48f4-916b-10ee37f9cb1e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Getting quotas for project e67e378ff39c450b9fb120ccb870a002. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:23:09.375646 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-f6bf08e2-cf72-48f4-916b-10ee37f9cb1e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Getting quotas for user 7cf700eaa42443f6a6bd64f51ab7f8dd and project e67e378ff39c450b9fb120ccb870a002. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:23:09.414887 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f6bf08e2-cf72-48f4-916b-10ee37f9cb1e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:23:09.418415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f6bf08e2-cf72-48f4-916b-10ee37f9cb1e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:23:09.490647 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f6bf08e2-cf72-48f4-916b-10ee37f9cb1e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.726767 Jul 31 01:23:09.492216 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1609/3177] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:23:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 3729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:23:09.501117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0c1e3a28-49d0-4558-8797-4acaf69e8566 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:09.502259 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0c1e3a28-49d0-4558-8797-4acaf69e8566 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:09.510914 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c1e3a28-49d0-4558-8797-4acaf69e8566 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:09.511817 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c1e3a28-49d0-4558-8797-4acaf69e8566 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:09.513584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c1e3a28-49d0-4558-8797-4acaf69e8566 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:09.514552 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c1e3a28-49d0-4558-8797-4acaf69e8566 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:09.902831 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0c1e3a28-49d0-4558-8797-4acaf69e8566 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:09.912845 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:09.921682 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0c1e3a28-49d0-4558-8797-4acaf69e8566 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1278 microversion: 2.1 time: 0.426026 Jul 31 01:23:09.922997 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1610/3178] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:09 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1278 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:09.955517 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-82f4dd92-8a93-449a-8dd0-c22d294af09c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:09.956842 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-82f4dd92-8a93-449a-8dd0-c22d294af09c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:10.177811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-82f4dd92-8a93-449a-8dd0-c22d294af09c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:10.218231 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-82f4dd92-8a93-449a-8dd0-c22d294af09c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1214 microversion: 2.1 time: 0.271947 Jul 31 01:23:10.220891 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1611/3179] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:09 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1214 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:10.238832 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b9e7ff77-734b-4c71-aea2-d5cf8a796c19 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:10.254331 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b9e7ff77-734b-4c71-aea2-d5cf8a796c19 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 200 len: 1314 microversion: 2.1 time: 1.215791 Jul 31 01:23:10.254926 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1569/3180] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:09 2022] GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 1314 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:10.955662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b0fc6d26-5d17-4f9d-b254-ef1ea0a3c2ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:10.957355 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b0fc6d26-5d17-4f9d-b254-ef1ea0a3c2ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:11.015008 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0fc6d26-5d17-4f9d-b254-ef1ea0a3c2ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:11.019981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0fc6d26-5d17-4f9d-b254-ef1ea0a3c2ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:11.024720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0fc6d26-5d17-4f9d-b254-ef1ea0a3c2ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:11.028466 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0fc6d26-5d17-4f9d-b254-ef1ea0a3c2ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:11.247645 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-575f7b78-a398-4bda-8ca8-0aa922e73ebb tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:11.249027 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-575f7b78-a398-4bda-8ca8-0aa922e73ebb tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:11.267501 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-575f7b78-a398-4bda-8ca8-0aa922e73ebb tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:11.269367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-575f7b78-a398-4bda-8ca8-0aa922e73ebb tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:11.274653 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-575f7b78-a398-4bda-8ca8-0aa922e73ebb tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:11.275468 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-575f7b78-a398-4bda-8ca8-0aa922e73ebb tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:11.355659 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b0fc6d26-5d17-4f9d-b254-ef1ea0a3c2ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:11.369164 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b0fc6d26-5d17-4f9d-b254-ef1ea0a3c2ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1278 microversion: 2.1 time: 0.421082 Jul 31 01:23:11.371397 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1612/3181] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:10 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1278 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:11.384759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3af78d5f-fcfb-489c-a9b8-75f65d09fa35 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:11.385799 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3af78d5f-fcfb-489c-a9b8-75f65d09fa35 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:11.412012 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3af78d5f-fcfb-489c-a9b8-75f65d09fa35 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:11.412573 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3af78d5f-fcfb-489c-a9b8-75f65d09fa35 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:11.413491 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3af78d5f-fcfb-489c-a9b8-75f65d09fa35 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:11.414095 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3af78d5f-fcfb-489c-a9b8-75f65d09fa35 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:11.593881 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-575f7b78-a398-4bda-8ca8-0aa922e73ebb tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:11.602471 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-575f7b78-a398-4bda-8ca8-0aa922e73ebb tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1274 microversion: 2.1 time: 0.363348 Jul 31 01:23:11.608200 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1570/3182] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:11 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1274 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:11.628583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-de8f38df-67fa-4c8e-8ef8-b288ac3c7b7d req-ed415549-4398-4a35-bd5c-ad3ddc4d7855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8667f0e5-8943-46fb-94fb-ca6bb4dfce3b", "tag": "30b19f8b-7004-4e0e-8ab1-3a71b9e8ba6d"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:11.639319 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-de8f38df-67fa-4c8e-8ef8-b288ac3c7b7d req-ed415549-4398-4a35-bd5c-ad3ddc4d7855 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:11.640191 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-de8f38df-67fa-4c8e-8ef8-b288ac3c7b7d req-ed415549-4398-4a35-bd5c-ad3ddc4d7855 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:11.651741 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-de8f38df-67fa-4c8e-8ef8-b288ac3c7b7d req-ed415549-4398-4a35-bd5c-ad3ddc4d7855 service nova] Creating event network-changed:30b19f8b-7004-4e0e-8ab1-3a71b9e8ba6d for instance 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b on n-h1-master-1 Jul 31 01:23:11.657659 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-de8f38df-67fa-4c8e-8ef8-b288ac3c7b7d req-ed415549-4398-4a35-bd5c-ad3ddc4d7855 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035757 Jul 31 01:23:11.660260 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1571/3183] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:23:12.227176 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3af78d5f-fcfb-489c-a9b8-75f65d09fa35 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:12.242431 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3af78d5f-fcfb-489c-a9b8-75f65d09fa35 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 200 len: 1314 microversion: 2.1 time: 0.869230 Jul 31 01:23:12.245155 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1613/3184] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:11 2022] GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:12.394130 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-924cf047-99c4-4ff2-bade-ebbb25e03f1f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:12.395561 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-924cf047-99c4-4ff2-bade-ebbb25e03f1f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:12.411317 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-924cf047-99c4-4ff2-bade-ebbb25e03f1f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:12.412110 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-924cf047-99c4-4ff2-bade-ebbb25e03f1f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:12.413196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-924cf047-99c4-4ff2-bade-ebbb25e03f1f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:12.414180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-924cf047-99c4-4ff2-bade-ebbb25e03f1f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:12.526014 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-1716fc2e-a49c-47c0-8899-9eb0465632c0 req-6561b7b5-3e33-464c-8bd0-7c46b51de4fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8da54db7-290e-4d68-bf4c-4c6f49984fef", "tag": "1b85d67d-d978-4b7d-b30d-7cc0e62e0604"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:12.576491 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1716fc2e-a49c-47c0-8899-9eb0465632c0 req-6561b7b5-3e33-464c-8bd0-7c46b51de4fd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:12.577159 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1716fc2e-a49c-47c0-8899-9eb0465632c0 req-6561b7b5-3e33-464c-8bd0-7c46b51de4fd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:12.628779 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1716fc2e-a49c-47c0-8899-9eb0465632c0 req-6561b7b5-3e33-464c-8bd0-7c46b51de4fd service nova] Creating event network-changed:1b85d67d-d978-4b7d-b30d-7cc0e62e0604 for instance 8da54db7-290e-4d68-bf4c-4c6f49984fef on n-h1-master-1 Jul 31 01:23:12.641331 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-1716fc2e-a49c-47c0-8899-9eb0465632c0 req-6561b7b5-3e33-464c-8bd0-7c46b51de4fd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114073 Jul 31 01:23:12.642080 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1614/3185] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:23:12.659197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3bc1ca71-3c35-423b-b13e-cd16d441c035 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:12.660165 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3bc1ca71-3c35-423b-b13e-cd16d441c035 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:12.682976 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bc1ca71-3c35-423b-b13e-cd16d441c035 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:12.688157 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bc1ca71-3c35-423b-b13e-cd16d441c035 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:12.689456 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bc1ca71-3c35-423b-b13e-cd16d441c035 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:12.692217 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bc1ca71-3c35-423b-b13e-cd16d441c035 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:13.257323 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3bc1ca71-3c35-423b-b13e-cd16d441c035 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:13.284464 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3bc1ca71-3c35-423b-b13e-cd16d441c035 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1272 microversion: 2.1 time: 0.623814 Jul 31 01:23:13.285814 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1615/3186] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:12 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1272 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:13.291239 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8161b8fd-fd2e-4fa2-8296-bebc8d8b839c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:13.303062 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8161b8fd-fd2e-4fa2-8296-bebc8d8b839c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:13.320992 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8161b8fd-fd2e-4fa2-8296-bebc8d8b839c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:13.332175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8161b8fd-fd2e-4fa2-8296-bebc8d8b839c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:13.333329 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8161b8fd-fd2e-4fa2-8296-bebc8d8b839c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:13.333944 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8161b8fd-fd2e-4fa2-8296-bebc8d8b839c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:14.122508 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-924cf047-99c4-4ff2-bade-ebbb25e03f1f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:14.136433 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-924cf047-99c4-4ff2-bade-ebbb25e03f1f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1320 microversion: 2.1 time: 1.747644 Jul 31 01:23:14.143160 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1572/3187] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:12 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1320 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:23:14.308924 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7fbec632-0f2d-4f61-8c41-23fba93682a8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:14.309738 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7fbec632-0f2d-4f61-8c41-23fba93682a8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:14.335140 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fbec632-0f2d-4f61-8c41-23fba93682a8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:14.339735 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fbec632-0f2d-4f61-8c41-23fba93682a8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:14.341356 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fbec632-0f2d-4f61-8c41-23fba93682a8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:14.343925 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fbec632-0f2d-4f61-8c41-23fba93682a8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:14.487044 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8161b8fd-fd2e-4fa2-8296-bebc8d8b839c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:14.511567 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8161b8fd-fd2e-4fa2-8296-bebc8d8b839c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 200 len: 1314 microversion: 2.1 time: 1.216775 Jul 31 01:23:14.514521 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1616/3188] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:13 2022] GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 1314 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:14.789422 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7fbec632-0f2d-4f61-8c41-23fba93682a8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:14.804555 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7fbec632-0f2d-4f61-8c41-23fba93682a8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1272 microversion: 2.1 time: 0.499793 Jul 31 01:23:14.813785 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1573/3189] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:14 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1272 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:15.165556 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-50e1034d-4d11-4309-a452-7ec08d3719e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:15.166246 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-50e1034d-4d11-4309-a452-7ec08d3719e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:15.185946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-50e1034d-4d11-4309-a452-7ec08d3719e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:15.204263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-50e1034d-4d11-4309-a452-7ec08d3719e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:15.207215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-50e1034d-4d11-4309-a452-7ec08d3719e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:15.209615 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-50e1034d-4d11-4309-a452-7ec08d3719e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:15.535865 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-03641d76-be1a-4c68-8659-924ff2fdc905 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:15.541716 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-03641d76-be1a-4c68-8659-924ff2fdc905 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:15.550033 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03641d76-be1a-4c68-8659-924ff2fdc905 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:15.550491 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03641d76-be1a-4c68-8659-924ff2fdc905 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:15.551279 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03641d76-be1a-4c68-8659-924ff2fdc905 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:15.559840 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03641d76-be1a-4c68-8659-924ff2fdc905 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:15.700167 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:16.069450 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-03641d76-be1a-4c68-8659-924ff2fdc905 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:16.078862 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-03641d76-be1a-4c68-8659-924ff2fdc905 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 200 len: 1314 microversion: 2.1 time: 0.546962 Jul 31 01:23:16.083701 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1574/3190] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:15 2022] GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:23:16.088911 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d30041f6-74ef-4369-ae56-c0441751c1ff tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:16.089915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d30041f6-74ef-4369-ae56-c0441751c1ff tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:16.098131 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d30041f6-74ef-4369-ae56-c0441751c1ff tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:16.099431 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d30041f6-74ef-4369-ae56-c0441751c1ff tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:16.100511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d30041f6-74ef-4369-ae56-c0441751c1ff tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:16.101229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d30041f6-74ef-4369-ae56-c0441751c1ff tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:16.300141 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-50e1034d-4d11-4309-a452-7ec08d3719e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:16.312693 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-50e1034d-4d11-4309-a452-7ec08d3719e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1320 microversion: 2.1 time: 1.152461 Jul 31 01:23:16.315526 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1617/3191] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:15 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1320 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:16.678046 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d30041f6-74ef-4369-ae56-c0441751c1ff tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:16.713519 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d30041f6-74ef-4369-ae56-c0441751c1ff tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1314 microversion: 2.1 time: 0.627872 Jul 31 01:23:16.717552 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1575/3192] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:16 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:17.195582 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5471989a-55d7-4993-9e76-94ae51db6e22 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:17.198125 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5471989a-55d7-4993-9e76-94ae51db6e22 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:17.206470 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5471989a-55d7-4993-9e76-94ae51db6e22 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:17.207892 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5471989a-55d7-4993-9e76-94ae51db6e22 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:17.209022 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5471989a-55d7-4993-9e76-94ae51db6e22 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:17.209740 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5471989a-55d7-4993-9e76-94ae51db6e22 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:17.338576 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e7cfafbf-a8ad-4960-8c74-48c1cc8e72a7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:17.339734 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e7cfafbf-a8ad-4960-8c74-48c1cc8e72a7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:17.343260 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=14 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:17.359670 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7cfafbf-a8ad-4960-8c74-48c1cc8e72a7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:17.361953 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7cfafbf-a8ad-4960-8c74-48c1cc8e72a7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:17.364493 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7cfafbf-a8ad-4960-8c74-48c1cc8e72a7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:17.365648 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7cfafbf-a8ad-4960-8c74-48c1cc8e72a7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:18.027248 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5471989a-55d7-4993-9e76-94ae51db6e22 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:18.038672 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5471989a-55d7-4993-9e76-94ae51db6e22 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 200 len: 1314 microversion: 2.1 time: 0.846901 Jul 31 01:23:18.040162 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1618/3193] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:17 2022] GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 1314 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:18.058317 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6f35d469-d3cf-4cb4-a417-f7ebeb614ec8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:18.059445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6f35d469-d3cf-4cb4-a417-f7ebeb614ec8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:18.069952 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6f35d469-d3cf-4cb4-a417-f7ebeb614ec8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:18.070568 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6f35d469-d3cf-4cb4-a417-f7ebeb614ec8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:18.072140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6f35d469-d3cf-4cb4-a417-f7ebeb614ec8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:18.072875 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6f35d469-d3cf-4cb4-a417-f7ebeb614ec8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:18.577652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e7cfafbf-a8ad-4960-8c74-48c1cc8e72a7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:18.587080 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e7cfafbf-a8ad-4960-8c74-48c1cc8e72a7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1320 microversion: 2.1 time: 1.253146 Jul 31 01:23:18.588281 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1576/3194] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:17 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1320 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:23:18.593607 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-2bcf91f8-c0d9-4779-827c-32436325a928 req-b8e6283d-8804-46e1-b2c3-c53f496fa9cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7733cd2-57de-4174-878c-f68b917b991c", "tag": "70710cea-27b7-4189-8439-7f0de6882981"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:18.604571 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2bcf91f8-c0d9-4779-827c-32436325a928 req-b8e6283d-8804-46e1-b2c3-c53f496fa9cb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:18.605388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2bcf91f8-c0d9-4779-827c-32436325a928 req-b8e6283d-8804-46e1-b2c3-c53f496fa9cb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:18.623567 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:18.627551 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-2bcf91f8-c0d9-4779-827c-32436325a928 req-b8e6283d-8804-46e1-b2c3-c53f496fa9cb service nova] Creating event network-changed:70710cea-27b7-4189-8439-7f0de6882981 for instance c7733cd2-57de-4174-878c-f68b917b991c on n-h2-master-1 Jul 31 01:23:18.639451 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-2bcf91f8-c0d9-4779-827c-32436325a928 req-b8e6283d-8804-46e1-b2c3-c53f496fa9cb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047509 Jul 31 01:23:18.640971 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1577/3195] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:23:18.868755 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6f35d469-d3cf-4cb4-a417-f7ebeb614ec8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:18.900214 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6f35d469-d3cf-4cb4-a417-f7ebeb614ec8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1314 microversion: 2.1 time: 0.858057 Jul 31 01:23:18.901894 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1619/3196] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:18 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1314 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:19.065797 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c282b374-2046-4c4e-8fc2-4accab1d6609 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:19.066535 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c282b374-2046-4c4e-8fc2-4accab1d6609 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:19.081490 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c282b374-2046-4c4e-8fc2-4accab1d6609 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:19.082177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c282b374-2046-4c4e-8fc2-4accab1d6609 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:19.083171 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c282b374-2046-4c4e-8fc2-4accab1d6609 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:19.083639 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c282b374-2046-4c4e-8fc2-4accab1d6609 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:19.448513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-4f24f706-b203-469b-a625-b36042c3b45d req-8b23e550-2816-4391-8afb-7a27294938f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8667f0e5-8943-46fb-94fb-ca6bb4dfce3b", "name": "network-vif-plugged", "status": "completed", "tag": "30b19f8b-7004-4e0e-8ab1-3a71b9e8ba6d"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:19.455648 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:19.477149 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4f24f706-b203-469b-a625-b36042c3b45d req-8b23e550-2816-4391-8afb-7a27294938f5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:19.478132 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4f24f706-b203-469b-a625-b36042c3b45d req-8b23e550-2816-4391-8afb-7a27294938f5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:19.506488 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-4f24f706-b203-469b-a625-b36042c3b45d req-8b23e550-2816-4391-8afb-7a27294938f5 service nova] Creating event network-vif-plugged:30b19f8b-7004-4e0e-8ab1-3a71b9e8ba6d for instance 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b on n-h1-master-1 Jul 31 01:23:19.519618 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-4f24f706-b203-469b-a625-b36042c3b45d req-8b23e550-2816-4391-8afb-7a27294938f5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074361 Jul 31 01:23:19.520725 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1620/3197] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:23:19.612818 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1b371e29-48b0-4136-b8e8-aa1be22d4991 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:19.613664 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1b371e29-48b0-4136-b8e8-aa1be22d4991 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:19.621212 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b371e29-48b0-4136-b8e8-aa1be22d4991 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:19.622063 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b371e29-48b0-4136-b8e8-aa1be22d4991 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:19.623100 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b371e29-48b0-4136-b8e8-aa1be22d4991 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:19.623862 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b371e29-48b0-4136-b8e8-aa1be22d4991 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:20.195547 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=18 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:20.694176 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c282b374-2046-4c4e-8fc2-4accab1d6609 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:20.716096 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c282b374-2046-4c4e-8fc2-4accab1d6609 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 200 len: 1314 microversion: 2.1 time: 1.643728 Jul 31 01:23:20.717071 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1578/3198] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:19 2022] GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 1314 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:20.722422 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ec795f73-d0de-4ddf-8a6e-375d22f89452 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:20.723301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ec795f73-d0de-4ddf-8a6e-375d22f89452 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:20.729841 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec795f73-d0de-4ddf-8a6e-375d22f89452 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:20.738355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec795f73-d0de-4ddf-8a6e-375d22f89452 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:20.739590 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec795f73-d0de-4ddf-8a6e-375d22f89452 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:20.740199 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec795f73-d0de-4ddf-8a6e-375d22f89452 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:20.804642 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1b371e29-48b0-4136-b8e8-aa1be22d4991 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:20.869461 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1b371e29-48b0-4136-b8e8-aa1be22d4991 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1320 microversion: 2.1 time: 1.263464 Jul 31 01:23:20.871991 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1621/3199] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:19 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1320 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:20.887313 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-01ffc100-3a79-4274-a56e-0f4c87a4614f req-597f1541-fc14-45f8-8c50-82dfa01c9702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc6d88e0-7229-441a-9ea6-79179f9c9531", "tag": "7727b825-f9ff-406c-9b91-708d69a2d9f7"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:20.942102 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-01ffc100-3a79-4274-a56e-0f4c87a4614f req-597f1541-fc14-45f8-8c50-82dfa01c9702 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:20.942865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-01ffc100-3a79-4274-a56e-0f4c87a4614f req-597f1541-fc14-45f8-8c50-82dfa01c9702 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:20.988719 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-01ffc100-3a79-4274-a56e-0f4c87a4614f req-597f1541-fc14-45f8-8c50-82dfa01c9702 service nova] Creating event network-changed:7727b825-f9ff-406c-9b91-708d69a2d9f7 for instance cc6d88e0-7229-441a-9ea6-79179f9c9531 on n-h2-master-1 Jul 31 01:23:20.997329 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-01ffc100-3a79-4274-a56e-0f4c87a4614f req-597f1541-fc14-45f8-8c50-82dfa01c9702 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122723 Jul 31 01:23:20.999732 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1622/3200] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:23:21.306862 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ec795f73-d0de-4ddf-8a6e-375d22f89452 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:21.316012 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ec795f73-d0de-4ddf-8a6e-375d22f89452 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1314 microversion: 2.1 time: 0.597549 Jul 31 01:23:21.341244 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1579/3201] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:20 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:21.640319 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-53f61c3f-4b14-49ee-9fc6-690e1ac9df10 req-791356d9-b39f-4dff-adae-26df54b96546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da54db7-290e-4d68-bf4c-4c6f49984fef", "name": "network-vif-plugged", "status": "completed", "tag": "1b85d67d-d978-4b7d-b30d-7cc0e62e0604"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:21.665031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-53f61c3f-4b14-49ee-9fc6-690e1ac9df10 req-791356d9-b39f-4dff-adae-26df54b96546 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:21.668084 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-53f61c3f-4b14-49ee-9fc6-690e1ac9df10 req-791356d9-b39f-4dff-adae-26df54b96546 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:21.707149 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-53f61c3f-4b14-49ee-9fc6-690e1ac9df10 req-791356d9-b39f-4dff-adae-26df54b96546 service nova] Creating event network-vif-plugged:1b85d67d-d978-4b7d-b30d-7cc0e62e0604 for instance 8da54db7-290e-4d68-bf4c-4c6f49984fef on n-h1-master-1 Jul 31 01:23:21.723042 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-53f61c3f-4b14-49ee-9fc6-690e1ac9df10 req-791356d9-b39f-4dff-adae-26df54b96546 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087340 Jul 31 01:23:21.725635 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1623/3202] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:23:21.738336 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0d140f3d-3bb8-4dff-aad2-57987a23810e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:21.740288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0d140f3d-3bb8-4dff-aad2-57987a23810e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:21.754064 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d140f3d-3bb8-4dff-aad2-57987a23810e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:21.755596 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d140f3d-3bb8-4dff-aad2-57987a23810e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:21.757822 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d140f3d-3bb8-4dff-aad2-57987a23810e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:21.759299 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d140f3d-3bb8-4dff-aad2-57987a23810e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:21.897525 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3ea6cfb9-fbfb-4756-bf0b-1ff740cee7b1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:21.899637 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3ea6cfb9-fbfb-4756-bf0b-1ff740cee7b1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:21.910111 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:21.923686 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ea6cfb9-fbfb-4756-bf0b-1ff740cee7b1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:21.924641 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ea6cfb9-fbfb-4756-bf0b-1ff740cee7b1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:21.930464 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ea6cfb9-fbfb-4756-bf0b-1ff740cee7b1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:21.932075 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ea6cfb9-fbfb-4756-bf0b-1ff740cee7b1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:22.493298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0d140f3d-3bb8-4dff-aad2-57987a23810e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:22.521166 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0d140f3d-3bb8-4dff-aad2-57987a23810e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 200 len: 1502 microversion: 2.1 time: 0.784899 Jul 31 01:23:22.523714 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1580/3203] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:21 2022] GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 1502 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:22.532740 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1eee39db-12d8-45a5-8455-888cfe47ee4c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:22.533369 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1eee39db-12d8-45a5-8455-888cfe47ee4c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:22.571895 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1eee39db-12d8-45a5-8455-888cfe47ee4c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:22.572371 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1eee39db-12d8-45a5-8455-888cfe47ee4c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:22.573185 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1eee39db-12d8-45a5-8455-888cfe47ee4c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:22.579196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1eee39db-12d8-45a5-8455-888cfe47ee4c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:22.786978 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3ea6cfb9-fbfb-4756-bf0b-1ff740cee7b1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:22.809195 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3ea6cfb9-fbfb-4756-bf0b-1ff740cee7b1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1320 microversion: 2.1 time: 0.910865 Jul 31 01:23:22.834223 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1624/3204] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:21 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1320 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:22.839809 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-580504be-4836-43af-b183-4ac2d77d1f98 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:22.843917 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-580504be-4836-43af-b183-4ac2d77d1f98 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:22.853736 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-580504be-4836-43af-b183-4ac2d77d1f98 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:22.854594 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-580504be-4836-43af-b183-4ac2d77d1f98 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:22.855847 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-580504be-4836-43af-b183-4ac2d77d1f98 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:22.856550 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-580504be-4836-43af-b183-4ac2d77d1f98 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:23.061235 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-580504be-4836-43af-b183-4ac2d77d1f98 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action" status: 200 len: 14 microversion: 2.1 time: 0.222688 Jul 31 01:23:23.068655 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1625/3205] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:22 2022] POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action => generated 14 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:23:23.492520 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1eee39db-12d8-45a5-8455-888cfe47ee4c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:23.521384 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1eee39db-12d8-45a5-8455-888cfe47ee4c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1314 microversion: 2.1 time: 0.991525 Jul 31 01:23:23.522263 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1581/3206] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:22 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1314 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:23.839981 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f96b6f0c-26ad-4ea1-9331-e75b7020ea28 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:23.841693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f96b6f0c-26ad-4ea1-9331-e75b7020ea28 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:23.866110 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f96b6f0c-26ad-4ea1-9331-e75b7020ea28 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:23.869990 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f96b6f0c-26ad-4ea1-9331-e75b7020ea28 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:23.876079 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f96b6f0c-26ad-4ea1-9331-e75b7020ea28 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:23.877164 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f96b6f0c-26ad-4ea1-9331-e75b7020ea28 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:24.176876 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a8014fc0-c50f-4a7b-98c5-8fbad94ac287 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1076983791", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "02e0c218-00bf-47b5-abe5-e48ac4dced0a"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:24.245125 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-a8014fc0-c50f-4a7b-98c5-8fbad94ac287 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] validate_networks() for [('02e0c218-00bf-47b5-abe5-e48ac4dced0a', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:23:25.061595 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f96b6f0c-26ad-4ea1-9331-e75b7020ea28 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:25.072171 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f96b6f0c-26ad-4ea1-9331-e75b7020ea28 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1320 microversion: 2.1 time: 1.237511 Jul 31 01:23:25.072921 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1582/3207] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:23 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1320 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:25.092135 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-063318fc-2976-44a4-b905-88ea62a2b065 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:25.098698 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-063318fc-2976-44a4-b905-88ea62a2b065 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:25.118614 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-063318fc-2976-44a4-b905-88ea62a2b065 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:25.118983 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-063318fc-2976-44a4-b905-88ea62a2b065 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:25.122361 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-063318fc-2976-44a4-b905-88ea62a2b065 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:25.125068 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-063318fc-2976-44a4-b905-88ea62a2b065 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:25.256544 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-063318fc-2976-44a4-b905-88ea62a2b065 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action" status: 200 len: 14 microversion: 2.1 time: 0.174145 Jul 31 01:23:25.262003 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1583/3208] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:25 2022] POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:23:25.278480 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-531b92da-80f6-4893-bf71-72a069ce7637 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:25.279110 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-531b92da-80f6-4893-bf71-72a069ce7637 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:25.293864 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-531b92da-80f6-4893-bf71-72a069ce7637 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:25.294317 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-531b92da-80f6-4893-bf71-72a069ce7637 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:25.295107 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-531b92da-80f6-4893-bf71-72a069ce7637 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:25.295579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-531b92da-80f6-4893-bf71-72a069ce7637 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:25.568675 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-531b92da-80f6-4893-bf71-72a069ce7637 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:25.578199 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-531b92da-80f6-4893-bf71-72a069ce7637 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1314 microversion: 2.1 time: 0.312077 Jul 31 01:23:25.582276 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1584/3209] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:25 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:26.100972 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9abdd798-deaf-47de-b3da-5e96593ba0e6 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:26.101628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9abdd798-deaf-47de-b3da-5e96593ba0e6 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:26.117763 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9abdd798-deaf-47de-b3da-5e96593ba0e6 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:26.120662 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9abdd798-deaf-47de-b3da-5e96593ba0e6 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:26.123613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9abdd798-deaf-47de-b3da-5e96593ba0e6 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:26.124274 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9abdd798-deaf-47de-b3da-5e96593ba0e6 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:26.206126 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-a8014fc0-c50f-4a7b-98c5-8fbad94ac287 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:23:26.206625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-a8014fc0-c50f-4a7b-98c5-8fbad94ac287 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:23:26.207437 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-a8014fc0-c50f-4a7b-98c5-8fbad94ac287 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:23:26.208041 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-a8014fc0-c50f-4a7b-98c5-8fbad94ac287 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:23:26.208564 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-a8014fc0-c50f-4a7b-98c5-8fbad94ac287 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:23:26.226523 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8014fc0-c50f-4a7b-98c5-8fbad94ac287 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:26.227193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8014fc0-c50f-4a7b-98c5-8fbad94ac287 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:26.228538 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8014fc0-c50f-4a7b-98c5-8fbad94ac287 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:26.229198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8014fc0-c50f-4a7b-98c5-8fbad94ac287 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:26.276405 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-a8014fc0-c50f-4a7b-98c5-8fbad94ac287 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Getting quotas for project 9d6baeb89380488c9ef70003b86c5815. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:23:26.288324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-a8014fc0-c50f-4a7b-98c5-8fbad94ac287 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Getting quotas for user 46a58b52653f40e696d7d0a09d7e48e7 and project 9d6baeb89380488c9ef70003b86c5815. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:23:26.305941 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a8014fc0-c50f-4a7b-98c5-8fbad94ac287 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:23:26.310665 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a8014fc0-c50f-4a7b-98c5-8fbad94ac287 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:23:26.396214 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a8014fc0-c50f-4a7b-98c5-8fbad94ac287 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.655681 Jul 31 01:23:26.397236 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1626/3210] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:23:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:23:26.412595 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-28394e2b-d058-48d5-a0e8-ccbe27ce18d2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:26.427656 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-28394e2b-d058-48d5-a0e8-ccbe27ce18d2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:26.460868 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28394e2b-d058-48d5-a0e8-ccbe27ce18d2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:26.461956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28394e2b-d058-48d5-a0e8-ccbe27ce18d2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:26.465054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28394e2b-d058-48d5-a0e8-ccbe27ce18d2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:26.466135 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28394e2b-d058-48d5-a0e8-ccbe27ce18d2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:26.530514 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9abdd798-deaf-47de-b3da-5e96593ba0e6 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:26.542116 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9abdd798-deaf-47de-b3da-5e96593ba0e6 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1320 microversion: 2.1 time: 0.445403 Jul 31 01:23:26.542657 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1585/3211] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:26 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1320 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:26.570754 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-94eb0041-d973-4fc6-bebc-4aed063b01de tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:26.576649 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-28394e2b-d058-48d5-a0e8-ccbe27ce18d2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action" status: 200 len: 14 microversion: 2.1 time: 0.175749 Jul 31 01:23:26.577349 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-94eb0041-d973-4fc6-bebc-4aed063b01de tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:26.577754 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1627/3212] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:26 2022] POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:23:26.604905 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f5025138-3939-4851-ae76-919e7eba1f66 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:26.606115 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f5025138-3939-4851-ae76-919e7eba1f66 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:26.617269 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5025138-3939-4851-ae76-919e7eba1f66 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:26.620233 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5025138-3939-4851-ae76-919e7eba1f66 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:26.624982 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5025138-3939-4851-ae76-919e7eba1f66 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:26.625672 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5025138-3939-4851-ae76-919e7eba1f66 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:26.822898 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-94eb0041-d973-4fc6-bebc-4aed063b01de tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:26.830742 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-94eb0041-d973-4fc6-bebc-4aed063b01de tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 200 len: 1224 microversion: 2.1 time: 0.273755 Jul 31 01:23:26.832849 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1586/3213] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:26 2022] GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 1224 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:27.350816 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f5025138-3939-4851-ae76-919e7eba1f66 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:27.386099 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f5025138-3939-4851-ae76-919e7eba1f66 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1314 microversion: 2.1 time: 0.786315 Jul 31 01:23:27.387652 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1628/3214] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:26 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:27.568706 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-abf9c6b5-7aad-4bdd-8860-31ab0d3622e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:27.569423 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-abf9c6b5-7aad-4bdd-8860-31ab0d3622e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:27.589285 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2d0994d7-2f36-4bba-b726-b6832a6ebb38 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:27.592602 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2d0994d7-2f36-4bba-b726-b6832a6ebb38 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:27.592969 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abf9c6b5-7aad-4bdd-8860-31ab0d3622e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:27.593436 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abf9c6b5-7aad-4bdd-8860-31ab0d3622e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:27.594223 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abf9c6b5-7aad-4bdd-8860-31ab0d3622e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:27.594667 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abf9c6b5-7aad-4bdd-8860-31ab0d3622e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:27.610830 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d0994d7-2f36-4bba-b726-b6832a6ebb38 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:27.611290 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d0994d7-2f36-4bba-b726-b6832a6ebb38 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:27.631822 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d0994d7-2f36-4bba-b726-b6832a6ebb38 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:27.633131 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d0994d7-2f36-4bba-b726-b6832a6ebb38 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:27.725781 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2d0994d7-2f36-4bba-b726-b6832a6ebb38 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action" status: 200 len: 14 microversion: 2.1 time: 0.140675 Jul 31 01:23:27.729383 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1629/3215] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:27 2022] POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 31 01:23:27.856201 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-89ba9e1d-522d-4c65-82d9-ef4e92d0d089 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:27.857205 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-89ba9e1d-522d-4c65-82d9-ef4e92d0d089 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:27.877098 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89ba9e1d-522d-4c65-82d9-ef4e92d0d089 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:27.877899 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89ba9e1d-522d-4c65-82d9-ef4e92d0d089 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:27.878881 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89ba9e1d-522d-4c65-82d9-ef4e92d0d089 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:27.879681 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89ba9e1d-522d-4c65-82d9-ef4e92d0d089 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:28.232596 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-89ba9e1d-522d-4c65-82d9-ef4e92d0d089 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:28.242000 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-89ba9e1d-522d-4c65-82d9-ef4e92d0d089 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 200 len: 1276 microversion: 2.1 time: 0.392416 Jul 31 01:23:28.256369 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1630/3216] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:27 2022] GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 1276 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:23:28.411930 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6298f713-8435-47bf-9490-dcb2ba6b71d8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:28.412938 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6298f713-8435-47bf-9490-dcb2ba6b71d8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:28.428428 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6298f713-8435-47bf-9490-dcb2ba6b71d8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:28.429365 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6298f713-8435-47bf-9490-dcb2ba6b71d8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:28.431028 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6298f713-8435-47bf-9490-dcb2ba6b71d8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:28.432594 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6298f713-8435-47bf-9490-dcb2ba6b71d8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:28.570237 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-abf9c6b5-7aad-4bdd-8860-31ab0d3622e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:28.589950 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-abf9c6b5-7aad-4bdd-8860-31ab0d3622e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1320 microversion: 2.1 time: 1.023364 Jul 31 01:23:28.593995 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1587/3217] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:27 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1320 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:28.743110 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bbdae9db-a3b1-44c4-8c64-0e04202482fd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:28.747177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bbdae9db-a3b1-44c4-8c64-0e04202482fd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:28.759392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bbdae9db-a3b1-44c4-8c64-0e04202482fd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:28.761092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bbdae9db-a3b1-44c4-8c64-0e04202482fd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:28.766404 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bbdae9db-a3b1-44c4-8c64-0e04202482fd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:28.767255 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bbdae9db-a3b1-44c4-8c64-0e04202482fd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:28.893350 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bbdae9db-a3b1-44c4-8c64-0e04202482fd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action" status: 200 len: 14 microversion: 2.1 time: 0.157915 Jul 31 01:23:28.894930 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1588/3218] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:28 2022] POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:23:29.004725 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6298f713-8435-47bf-9490-dcb2ba6b71d8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:29.012778 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6298f713-8435-47bf-9490-dcb2ba6b71d8 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1314 microversion: 2.1 time: 0.605496 Jul 31 01:23:29.013379 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1631/3219] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:28 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:23:29.127363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7e95751e-dcbb-4b1c-9f8b-251d8d69e325 req-80e48e29-a17b-48b2-ae26-adbffca20964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7733cd2-57de-4174-878c-f68b917b991c", "name": "network-vif-plugged", "status": "completed", "tag": "70710cea-27b7-4189-8439-7f0de6882981"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:29.163688 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7e95751e-dcbb-4b1c-9f8b-251d8d69e325 req-80e48e29-a17b-48b2-ae26-adbffca20964 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:29.164543 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7e95751e-dcbb-4b1c-9f8b-251d8d69e325 req-80e48e29-a17b-48b2-ae26-adbffca20964 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:29.183513 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7e95751e-dcbb-4b1c-9f8b-251d8d69e325 req-80e48e29-a17b-48b2-ae26-adbffca20964 service nova] Creating event network-vif-plugged:70710cea-27b7-4189-8439-7f0de6882981 for instance c7733cd2-57de-4174-878c-f68b917b991c on n-h2-master-1 Jul 31 01:23:29.188984 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7e95751e-dcbb-4b1c-9f8b-251d8d69e325 req-80e48e29-a17b-48b2-ae26-adbffca20964 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066374 Jul 31 01:23:29.190055 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1589/3220] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:23:29.278826 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-74ada176-580c-4295-9b71-f4afd8c4b300 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:29.279698 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-74ada176-580c-4295-9b71-f4afd8c4b300 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:29.321832 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74ada176-580c-4295-9b71-f4afd8c4b300 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:29.328909 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74ada176-580c-4295-9b71-f4afd8c4b300 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:29.335041 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74ada176-580c-4295-9b71-f4afd8c4b300 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:29.336682 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74ada176-580c-4295-9b71-f4afd8c4b300 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:29.500982 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-74ada176-580c-4295-9b71-f4afd8c4b300 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:29.508775 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:29.521016 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-74ada176-580c-4295-9b71-f4afd8c4b300 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 200 len: 1282 microversion: 2.1 time: 0.246277 Jul 31 01:23:29.536849 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1632/3221] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:29 2022] GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 1282 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:29.615711 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-08d1ebc6-276f-4bc9-b0b2-8f3caab8fbbd tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:29.616410 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-08d1ebc6-276f-4bc9-b0b2-8f3caab8fbbd tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:29.630680 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08d1ebc6-276f-4bc9-b0b2-8f3caab8fbbd tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:29.631143 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08d1ebc6-276f-4bc9-b0b2-8f3caab8fbbd tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:29.632115 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08d1ebc6-276f-4bc9-b0b2-8f3caab8fbbd tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:29.632559 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08d1ebc6-276f-4bc9-b0b2-8f3caab8fbbd tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:30.342589 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-523979d0-79ad-46cc-b8cd-e203a54da844 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:30.346308 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-523979d0-79ad-46cc-b8cd-e203a54da844 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:30.375660 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-523979d0-79ad-46cc-b8cd-e203a54da844 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:30.376430 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-523979d0-79ad-46cc-b8cd-e203a54da844 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:30.379450 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-523979d0-79ad-46cc-b8cd-e203a54da844 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:30.382165 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-523979d0-79ad-46cc-b8cd-e203a54da844 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:30.417740 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-08d1ebc6-276f-4bc9-b0b2-8f3caab8fbbd tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:30.436107 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-08d1ebc6-276f-4bc9-b0b2-8f3caab8fbbd tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1320 microversion: 2.1 time: 0.824455 Jul 31 01:23:30.459236 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1590/3222] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:29 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1320 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:30.463620 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a87f8045-646a-45d8-a874-3bf1ca3f176b tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:30.466198 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a87f8045-646a-45d8-a874-3bf1ca3f176b tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:30.499778 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a87f8045-646a-45d8-a874-3bf1ca3f176b tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:30.504646 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-523979d0-79ad-46cc-b8cd-e203a54da844 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action" status: 200 len: 14 microversion: 2.1 time: 0.600600 Jul 31 01:23:30.505718 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a87f8045-646a-45d8-a874-3bf1ca3f176b tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:30.506731 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a87f8045-646a-45d8-a874-3bf1ca3f176b tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:30.507244 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a87f8045-646a-45d8-a874-3bf1ca3f176b tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:30.508179 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1633/3223] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:29 2022] POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action => generated 14 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:23:30.563873 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5886aea8-fa44-4fc0-963e-38623df4eba0 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:30.564800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5886aea8-fa44-4fc0-963e-38623df4eba0 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:30.580208 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5886aea8-fa44-4fc0-963e-38623df4eba0 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:30.583931 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5886aea8-fa44-4fc0-963e-38623df4eba0 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:30.585211 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5886aea8-fa44-4fc0-963e-38623df4eba0 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:30.591639 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5886aea8-fa44-4fc0-963e-38623df4eba0 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:30.787685 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5886aea8-fa44-4fc0-963e-38623df4eba0 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:30.856228 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5886aea8-fa44-4fc0-963e-38623df4eba0 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 200 len: 1282 microversion: 2.1 time: 0.297225 Jul 31 01:23:30.857296 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1634/3224] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:30 2022] GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 1282 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:31.128021 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a87f8045-646a-45d8-a874-3bf1ca3f176b tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:31.143527 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a87f8045-646a-45d8-a874-3bf1ca3f176b tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1314 microversion: 2.1 time: 0.692153 Jul 31 01:23:31.144467 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1591/3225] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:30 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1314 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:31.280434 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-3b2a98e7-7873-49f1-a7e5-bee56eea4963 req-e75ad333-320d-4f04-a971-24d4a630ccb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6d88e0-7229-441a-9ea6-79179f9c9531", "name": "network-vif-plugged", "status": "completed", "tag": "7727b825-f9ff-406c-9b91-708d69a2d9f7"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:31.303658 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3b2a98e7-7873-49f1-a7e5-bee56eea4963 req-e75ad333-320d-4f04-a971-24d4a630ccb1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:31.304153 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3b2a98e7-7873-49f1-a7e5-bee56eea4963 req-e75ad333-320d-4f04-a971-24d4a630ccb1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:31.328898 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-3b2a98e7-7873-49f1-a7e5-bee56eea4963 req-e75ad333-320d-4f04-a971-24d4a630ccb1 service nova] Creating event network-vif-plugged:7727b825-f9ff-406c-9b91-708d69a2d9f7 for instance cc6d88e0-7229-441a-9ea6-79179f9c9531 on n-h2-master-1 Jul 31 01:23:31.333956 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-3b2a98e7-7873-49f1-a7e5-bee56eea4963 req-e75ad333-320d-4f04-a971-24d4a630ccb1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058008 Jul 31 01:23:31.334917 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1635/3226] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:23:31.466252 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-04f2f1b5-763c-4739-848a-1e9fcd8cca49 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:31.466872 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-04f2f1b5-763c-4739-848a-1e9fcd8cca49 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:31.475242 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-04f2f1b5-763c-4739-848a-1e9fcd8cca49 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:31.479263 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-04f2f1b5-763c-4739-848a-1e9fcd8cca49 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:31.480198 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-04f2f1b5-763c-4739-848a-1e9fcd8cca49 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:31.480679 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-04f2f1b5-763c-4739-848a-1e9fcd8cca49 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:31.520158 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-04594e96-8fb5-46f5-830a-49df378c153f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:31.523699 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-04594e96-8fb5-46f5-830a-49df378c153f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:31.540865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04594e96-8fb5-46f5-830a-49df378c153f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:31.541691 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04594e96-8fb5-46f5-830a-49df378c153f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:31.547728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04594e96-8fb5-46f5-830a-49df378c153f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:31.548983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04594e96-8fb5-46f5-830a-49df378c153f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:31.658310 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-04594e96-8fb5-46f5-830a-49df378c153f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action" status: 200 len: 14 microversion: 2.1 time: 0.141453 Jul 31 01:23:31.662347 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1636/3227] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:31 2022] POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:23:31.880185 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-27f2b115-ba5a-48c0-8b62-510cc2ea979d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:31.881206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-27f2b115-ba5a-48c0-8b62-510cc2ea979d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:31.893013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27f2b115-ba5a-48c0-8b62-510cc2ea979d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:31.893855 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27f2b115-ba5a-48c0-8b62-510cc2ea979d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:31.894908 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27f2b115-ba5a-48c0-8b62-510cc2ea979d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:31.895633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27f2b115-ba5a-48c0-8b62-510cc2ea979d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:33.307166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-04f2f1b5-763c-4739-848a-1e9fcd8cca49 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:33.323795 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-04f2f1b5-763c-4739-848a-1e9fcd8cca49 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1515 microversion: 2.1 time: 1.861291 Jul 31 01:23:33.341960 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1592/3228] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:31 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1515 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:33.352537 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-78dcd499-8394-4705-acef-e8d45ad26a53 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:33.355706 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-78dcd499-8394-4705-acef-e8d45ad26a53 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:33.363591 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:33.366131 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78dcd499-8394-4705-acef-e8d45ad26a53 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:33.367092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78dcd499-8394-4705-acef-e8d45ad26a53 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:33.368551 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78dcd499-8394-4705-acef-e8d45ad26a53 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:33.369627 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78dcd499-8394-4705-acef-e8d45ad26a53 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:33.589703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-27f2b115-ba5a-48c0-8b62-510cc2ea979d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:33.599495 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-27f2b115-ba5a-48c0-8b62-510cc2ea979d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 200 len: 1324 microversion: 2.1 time: 1.724110 Jul 31 01:23:33.613397 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1637/3229] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:31 2022] GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 1324 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:33.620610 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-52f77901-0fb7-44e1-aeb5-bf6617a63b9b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:33.624580 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-52f77901-0fb7-44e1-aeb5-bf6617a63b9b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:33.633226 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52f77901-0fb7-44e1-aeb5-bf6617a63b9b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:33.634242 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52f77901-0fb7-44e1-aeb5-bf6617a63b9b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:33.636046 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52f77901-0fb7-44e1-aeb5-bf6617a63b9b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:33.638058 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52f77901-0fb7-44e1-aeb5-bf6617a63b9b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:33.724192 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-52f77901-0fb7-44e1-aeb5-bf6617a63b9b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action" status: 200 len: 14 microversion: 2.1 time: 0.108521 Jul 31 01:23:33.724857 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1638/3230] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:33 2022] POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:23:34.122300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6e85c1b7-1b5e-4812-ad81-370756544539 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1930882706", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "804c34c8-0d77-4b28-a565-52f45793e06f"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:34.223320 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-6e85c1b7-1b5e-4812-ad81-370756544539 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] validate_networks() for [('804c34c8-0d77-4b28-a565-52f45793e06f', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:23:34.257226 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-78dcd499-8394-4705-acef-e8d45ad26a53 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:34.290658 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-78dcd499-8394-4705-acef-e8d45ad26a53 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1500 microversion: 2.1 time: 0.945852 Jul 31 01:23:34.300876 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1593/3231] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:33 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1500 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:34.320598 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-52a79f09-071c-4368-9f0b-11c15db26982 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:34.324805 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-52a79f09-071c-4368-9f0b-11c15db26982 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:34.333909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52a79f09-071c-4368-9f0b-11c15db26982 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:34.335493 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52a79f09-071c-4368-9f0b-11c15db26982 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:34.336884 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52a79f09-071c-4368-9f0b-11c15db26982 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:34.337376 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52a79f09-071c-4368-9f0b-11c15db26982 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:34.383156 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-52a79f09-071c-4368-9f0b-11c15db26982 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lazy-loading 'flavor' on Instance uuid c7733cd2-57de-4174-878c-f68b917b991c {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:23:34.554962 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:34.583713 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-52a79f09-071c-4368-9f0b-11c15db26982 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c/action" status: 200 len: 32 microversion: 2.1 time: 0.280903 Jul 31 01:23:34.584796 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1594/3232] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:34 2022] POST /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c/action => generated 32 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:23:34.651105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b0c62105-1df1-4a2d-845b-170b75dc0634 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:34.664553 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b0c62105-1df1-4a2d-845b-170b75dc0634 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:34.675106 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0c62105-1df1-4a2d-845b-170b75dc0634 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:34.676260 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0c62105-1df1-4a2d-845b-170b75dc0634 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:34.677333 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0c62105-1df1-4a2d-845b-170b75dc0634 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:34.678139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0c62105-1df1-4a2d-845b-170b75dc0634 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:34.727799 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-b0c62105-1df1-4a2d-845b-170b75dc0634 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lazy-loading 'flavor' on Instance uuid cc6d88e0-7229-441a-9ea6-79179f9c9531 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:23:34.925842 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b0c62105-1df1-4a2d-845b-170b75dc0634 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "POST /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531/action" status: 200 len: 32 microversion: 2.1 time: 0.338233 Jul 31 01:23:34.926526 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1595/3233] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:34 2022] POST /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531/action => generated 32 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:23:34.965313 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1f2f9e91-062e-4590-b5a6-9ef45505fea1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:34.967282 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1f2f9e91-062e-4590-b5a6-9ef45505fea1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:34.983089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f2f9e91-062e-4590-b5a6-9ef45505fea1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:34.989490 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f2f9e91-062e-4590-b5a6-9ef45505fea1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:34.990579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f2f9e91-062e-4590-b5a6-9ef45505fea1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:34.991122 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f2f9e91-062e-4590-b5a6-9ef45505fea1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:35.610518 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1f2f9e91-062e-4590-b5a6-9ef45505fea1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:35.622760 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1f2f9e91-062e-4590-b5a6-9ef45505fea1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.673371 Jul 31 01:23:35.624019 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1596/3234] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:34 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:35.629006 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3bbf1202-6eb4-4a07-b8ab-ca09db2d8e21 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:35.629735 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3bbf1202-6eb4-4a07-b8ab-ca09db2d8e21 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:35.636511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3bbf1202-6eb4-4a07-b8ab-ca09db2d8e21 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:35.637902 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3bbf1202-6eb4-4a07-b8ab-ca09db2d8e21 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:35.638783 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3bbf1202-6eb4-4a07-b8ab-ca09db2d8e21 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:35.639364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3bbf1202-6eb4-4a07-b8ab-ca09db2d8e21 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:36.021192 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-6e85c1b7-1b5e-4812-ad81-370756544539 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:23:36.021711 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-6e85c1b7-1b5e-4812-ad81-370756544539 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:23:36.022095 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-6e85c1b7-1b5e-4812-ad81-370756544539 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:23:36.022513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-6e85c1b7-1b5e-4812-ad81-370756544539 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:23:36.023169 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-6e85c1b7-1b5e-4812-ad81-370756544539 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:23:36.038951 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e85c1b7-1b5e-4812-ad81-370756544539 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:36.039906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e85c1b7-1b5e-4812-ad81-370756544539 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:36.041611 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e85c1b7-1b5e-4812-ad81-370756544539 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:36.042689 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e85c1b7-1b5e-4812-ad81-370756544539 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:36.076578 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-6e85c1b7-1b5e-4812-ad81-370756544539 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Getting quotas for project 819969e4931a47988c057e1cda311f94. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:23:36.077679 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3bbf1202-6eb4-4a07-b8ab-ca09db2d8e21 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:36.085914 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-6e85c1b7-1b5e-4812-ad81-370756544539 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Getting quotas for user cfe557fe9f8240b2962f4c3cf66ddb03 and project 819969e4931a47988c057e1cda311f94. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:23:36.086143 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3bbf1202-6eb4-4a07-b8ab-ca09db2d8e21 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 200 len: 1324 microversion: 2.1 time: 0.460927 Jul 31 01:23:36.092497 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1597/3235] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:35 2022] GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 1324 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:36.115294 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b56bfe37-f05e-4ed1-a2cf-670d6e528845 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:36.121766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b56bfe37-f05e-4ed1-a2cf-670d6e528845 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:36.127585 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6e85c1b7-1b5e-4812-ad81-370756544539 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:23:36.132719 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b56bfe37-f05e-4ed1-a2cf-670d6e528845 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:36.135598 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6e85c1b7-1b5e-4812-ad81-370756544539 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:23:36.136325 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b56bfe37-f05e-4ed1-a2cf-670d6e528845 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:36.137886 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b56bfe37-f05e-4ed1-a2cf-670d6e528845 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:36.138513 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b56bfe37-f05e-4ed1-a2cf-670d6e528845 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:36.223290 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6e85c1b7-1b5e-4812-ad81-370756544539 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.496933 Jul 31 01:23:36.229898 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1639/3236] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:23:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2504 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 01:23:36.233460 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b56bfe37-f05e-4ed1-a2cf-670d6e528845 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action" status: 200 len: 16393 microversion: 2.1 time: 0.139049 Jul 31 01:23:36.237436 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1598/3237] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:36 2022] POST /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b/action => generated 16393 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:23:36.243957 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-579f1b85-21e0-4ea6-a751-d6176289e26c req-ac221fc7-7c3f-4a68-bf46-f1f89047b2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e94ea78-2ac3-4192-aa5c-165b70d7b083", "tag": "da0517f6-7df8-42a4-8ee4-a90c7b34261b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:36.268180 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f3eb7051-2c61-444a-b4b3-fe7954fa3960 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:36.271502 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f3eb7051-2c61-444a-b4b3-fe7954fa3960 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:36.279460 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-579f1b85-21e0-4ea6-a751-d6176289e26c req-ac221fc7-7c3f-4a68-bf46-f1f89047b2dc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:36.283357 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-579f1b85-21e0-4ea6-a751-d6176289e26c req-ac221fc7-7c3f-4a68-bf46-f1f89047b2dc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:36.287965 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3eb7051-2c61-444a-b4b3-fe7954fa3960 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:36.288438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3eb7051-2c61-444a-b4b3-fe7954fa3960 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:36.289655 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3eb7051-2c61-444a-b4b3-fe7954fa3960 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:36.289655 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3eb7051-2c61-444a-b4b3-fe7954fa3960 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:36.318123 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-579f1b85-21e0-4ea6-a751-d6176289e26c req-ac221fc7-7c3f-4a68-bf46-f1f89047b2dc service nova] Creating event network-changed:da0517f6-7df8-42a4-8ee4-a90c7b34261b for instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083 on n-h1-master-1 Jul 31 01:23:36.329972 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-579f1b85-21e0-4ea6-a751-d6176289e26c req-ac221fc7-7c3f-4a68-bf46-f1f89047b2dc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090707 Jul 31 01:23:36.330933 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1640/3238] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:23:36.336134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-854b2561-b6a9-4e3f-a3e8-d9417f226e6c tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:36.336782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-854b2561-b6a9-4e3f-a3e8-d9417f226e6c tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:36.487382 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-854b2561-b6a9-4e3f-a3e8-d9417f226e6c tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:36.502135 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-854b2561-b6a9-4e3f-a3e8-d9417f226e6c tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:36.516916 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-854b2561-b6a9-4e3f-a3e8-d9417f226e6c tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:36.522728 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-854b2561-b6a9-4e3f-a3e8-d9417f226e6c tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 200 len: 1259 microversion: 2.21 time: 0.186270 Jul 31 01:23:36.525688 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1641/3239] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:23:36 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:23:36.539548 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-004d5b0a-5991-4819-b094-aef899e92a29 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:36.542450 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-004d5b0a-5991-4819-b094-aef899e92a29 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:36.562565 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-004d5b0a-5991-4819-b094-aef899e92a29 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:36.563918 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-004d5b0a-5991-4819-b094-aef899e92a29 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:36.566508 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-004d5b0a-5991-4819-b094-aef899e92a29 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:36.567893 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-004d5b0a-5991-4819-b094-aef899e92a29 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:36.832146 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f3eb7051-2c61-444a-b4b3-fe7954fa3960 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:36.839194 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:36.856247 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f3eb7051-2c61-444a-b4b3-fe7954fa3960 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 0.614267 Jul 31 01:23:36.860819 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1599/3240] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:36 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:36.886471 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-201be312-0004-419f-8219-03b72eb1d3d9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:36.889319 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-201be312-0004-419f-8219-03b72eb1d3d9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:36.913627 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-201be312-0004-419f-8219-03b72eb1d3d9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:36.917183 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-201be312-0004-419f-8219-03b72eb1d3d9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:36.922772 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-201be312-0004-419f-8219-03b72eb1d3d9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:36.928770 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-201be312-0004-419f-8219-03b72eb1d3d9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:37.870795 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-004d5b0a-5991-4819-b094-aef899e92a29 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:37.886754 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-004d5b0a-5991-4819-b094-aef899e92a29 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 1.356912 Jul 31 01:23:37.898504 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1642/3241] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:36 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:37.914850 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8a143dc8-10c6-465f-8484-e3663cc7339f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:37.915926 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8a143dc8-10c6-465f-8484-e3663cc7339f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:37.923933 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a143dc8-10c6-465f-8484-e3663cc7339f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:37.924428 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a143dc8-10c6-465f-8484-e3663cc7339f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:37.925273 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a143dc8-10c6-465f-8484-e3663cc7339f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:37.927862 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a143dc8-10c6-465f-8484-e3663cc7339f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:38.162717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-201be312-0004-419f-8219-03b72eb1d3d9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:38.188463 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-201be312-0004-419f-8219-03b72eb1d3d9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 1.311074 Jul 31 01:23:38.191024 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1600/3242] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:36 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:38.213438 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ee2d7fd9-f778-4e7c-a852-edeec1e9b603 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:38.217757 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ee2d7fd9-f778-4e7c-a852-edeec1e9b603 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:38.234794 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee2d7fd9-f778-4e7c-a852-edeec1e9b603 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:38.237771 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee2d7fd9-f778-4e7c-a852-edeec1e9b603 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:38.238882 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee2d7fd9-f778-4e7c-a852-edeec1e9b603 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:38.239598 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee2d7fd9-f778-4e7c-a852-edeec1e9b603 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:38.403867 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ee2d7fd9-f778-4e7c-a852-edeec1e9b603 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:38.424839 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ee2d7fd9-f778-4e7c-a852-edeec1e9b603 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:38.427000 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ee2d7fd9-f778-4e7c-a852-edeec1e9b603 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:38.428766 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ee2d7fd9-f778-4e7c-a852-edeec1e9b603 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 200 len: 1319 microversion: 2.21 time: 0.236404 Jul 31 01:23:38.430022 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1601/3243] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:23:38 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:23:38.436356 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-71172329-1709-41d5-9e1c-bbcde2a5e5c1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:38.448358 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-71172329-1709-41d5-9e1c-bbcde2a5e5c1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:38.455646 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-71172329-1709-41d5-9e1c-bbcde2a5e5c1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:38.456509 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-71172329-1709-41d5-9e1c-bbcde2a5e5c1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:38.457519 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-71172329-1709-41d5-9e1c-bbcde2a5e5c1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:38.457963 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-71172329-1709-41d5-9e1c-bbcde2a5e5c1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:38.680911 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8a143dc8-10c6-465f-8484-e3663cc7339f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:38.692328 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8a143dc8-10c6-465f-8484-e3663cc7339f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 200 len: 1324 microversion: 2.1 time: 0.791904 Jul 31 01:23:38.692996 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1643/3244] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:37 2022] GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 1324 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:38.698809 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-88a68964-b9e3-4dfd-b27a-5d609d45f763 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:38.716454 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-88a68964-b9e3-4dfd-b27a-5d609d45f763 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:38.724360 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88a68964-b9e3-4dfd-b27a-5d609d45f763 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:38.724836 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88a68964-b9e3-4dfd-b27a-5d609d45f763 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:38.725634 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88a68964-b9e3-4dfd-b27a-5d609d45f763 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:38.726081 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88a68964-b9e3-4dfd-b27a-5d609d45f763 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:38.977942 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-71172329-1709-41d5-9e1c-bbcde2a5e5c1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:38.994427 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-71172329-1709-41d5-9e1c-bbcde2a5e5c1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 0.562933 Jul 31 01:23:38.996034 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1602/3245] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:38 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:39.124852 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-88a68964-b9e3-4dfd-b27a-5d609d45f763 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:39.139381 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-88a68964-b9e3-4dfd-b27a-5d609d45f763 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.444693 Jul 31 01:23:39.154073 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1644/3246] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:38 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:39.174239 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3825893f-e2a9-4c54-95cd-3c77d5801d2e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:39.175726 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3825893f-e2a9-4c54-95cd-3c77d5801d2e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:39.191517 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3825893f-e2a9-4c54-95cd-3c77d5801d2e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:39.192338 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3825893f-e2a9-4c54-95cd-3c77d5801d2e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:39.193808 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3825893f-e2a9-4c54-95cd-3c77d5801d2e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:39.194887 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3825893f-e2a9-4c54-95cd-3c77d5801d2e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:39.232854 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4933fb33-7713-4f80-b43e-043d7933f1ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:39.233496 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4933fb33-7713-4f80-b43e-043d7933f1ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:39.263851 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4933fb33-7713-4f80-b43e-043d7933f1ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:39.269035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4933fb33-7713-4f80-b43e-043d7933f1ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:39.270041 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4933fb33-7713-4f80-b43e-043d7933f1ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:39.270505 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4933fb33-7713-4f80-b43e-043d7933f1ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:39.798919 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3825893f-e2a9-4c54-95cd-3c77d5801d2e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:39.808184 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3825893f-e2a9-4c54-95cd-3c77d5801d2e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.649546 Jul 31 01:23:39.810550 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1603/3247] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:39 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:39.826508 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a9bcbfaf-f259-4800-a7ed-3185768bb017 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:39.827852 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a9bcbfaf-f259-4800-a7ed-3185768bb017 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:39.830650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4933fb33-7713-4f80-b43e-043d7933f1ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:39.840027 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a9bcbfaf-f259-4800-a7ed-3185768bb017 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:39.842630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a9bcbfaf-f259-4800-a7ed-3185768bb017 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:39.843795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a9bcbfaf-f259-4800-a7ed-3185768bb017 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:39.847200 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a9bcbfaf-f259-4800-a7ed-3185768bb017 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:39.848286 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4933fb33-7713-4f80-b43e-043d7933f1ea tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.628010 Jul 31 01:23:39.849214 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1645/3248] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:39 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:39.859915 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c892d877-348c-4b20-b251-4977f6de85bd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:39.860601 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c892d877-348c-4b20-b251-4977f6de85bd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:39.882825 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c892d877-348c-4b20-b251-4977f6de85bd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:39.883443 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c892d877-348c-4b20-b251-4977f6de85bd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:39.884274 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c892d877-348c-4b20-b251-4977f6de85bd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:39.884725 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c892d877-348c-4b20-b251-4977f6de85bd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:40.065861 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a9bcbfaf-f259-4800-a7ed-3185768bb017 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:40.080094 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a9bcbfaf-f259-4800-a7ed-3185768bb017 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:40.081748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a9bcbfaf-f259-4800-a7ed-3185768bb017 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:40.085057 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a9bcbfaf-f259-4800-a7ed-3185768bb017 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 200 len: 1317 microversion: 2.21 time: 0.270532 Jul 31 01:23:40.092054 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1604/3249] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:23:39 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:23:40.097841 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f0a33a0c-6b3c-47c0-b109-00c0f314e61d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:40.108867 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f0a33a0c-6b3c-47c0-b109-00c0f314e61d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:40.115448 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f0a33a0c-6b3c-47c0-b109-00c0f314e61d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:40.116176 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f0a33a0c-6b3c-47c0-b109-00c0f314e61d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:40.117238 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f0a33a0c-6b3c-47c0-b109-00c0f314e61d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:40.122553 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f0a33a0c-6b3c-47c0-b109-00c0f314e61d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:40.156215 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c892d877-348c-4b20-b251-4977f6de85bd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:40.172417 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c892d877-348c-4b20-b251-4977f6de85bd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 200 len: 1324 microversion: 2.1 time: 0.322103 Jul 31 01:23:40.173724 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1646/3250] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:39 2022] GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 1324 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:40.178473 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a9ee359-976f-43ba-b6a0-08d92281a71d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:40.179279 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9a9ee359-976f-43ba-b6a0-08d92281a71d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:40.192967 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a9ee359-976f-43ba-b6a0-08d92281a71d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:40.198509 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a9ee359-976f-43ba-b6a0-08d92281a71d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:40.199611 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a9ee359-976f-43ba-b6a0-08d92281a71d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:40.200070 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a9ee359-976f-43ba-b6a0-08d92281a71d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:40.447998 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f0a33a0c-6b3c-47c0-b109-00c0f314e61d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:40.483721 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f0a33a0c-6b3c-47c0-b109-00c0f314e61d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.390170 Jul 31 01:23:40.485794 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1605/3251] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:40 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:40.510276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-61e26ca2-ae0e-441c-b8b0-80b0ed48648d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:40.510276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-61e26ca2-ae0e-441c-b8b0-80b0ed48648d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:40.515728 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61e26ca2-ae0e-441c-b8b0-80b0ed48648d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:40.516588 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61e26ca2-ae0e-441c-b8b0-80b0ed48648d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:40.517839 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61e26ca2-ae0e-441c-b8b0-80b0ed48648d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:40.518579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61e26ca2-ae0e-441c-b8b0-80b0ed48648d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:40.532384 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9a9ee359-976f-43ba-b6a0-08d92281a71d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:40.541846 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9a9ee359-976f-43ba-b6a0-08d92281a71d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 0.366857 Jul 31 01:23:40.548300 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1647/3252] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:40 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:40.595099 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-61e26ca2-ae0e-441c-b8b0-80b0ed48648d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Locking {{(pid=119474) lock /opt/stack/nova/nova/compute/api.py:4781}} Jul 31 01:23:40.703747 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-61e26ca2-ae0e-441c-b8b0-80b0ed48648d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 202 len: 0 microversion: 2.1 time: 0.199656 Jul 31 01:23:40.708821 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1606/3253] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:40 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:23:40.713775 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7e08d129-cbde-44e4-b255-38538f00fc6d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:40.714663 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7e08d129-cbde-44e4-b255-38538f00fc6d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:40.724757 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e08d129-cbde-44e4-b255-38538f00fc6d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:40.736237 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e08d129-cbde-44e4-b255-38538f00fc6d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:40.737114 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e08d129-cbde-44e4-b255-38538f00fc6d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:40.738257 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e08d129-cbde-44e4-b255-38538f00fc6d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:40.873606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0dc90041-95e6-4f7d-963c-780c32a41523 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:40.874693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0dc90041-95e6-4f7d-963c-780c32a41523 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:40.890135 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0dc90041-95e6-4f7d-963c-780c32a41523 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:40.891445 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0dc90041-95e6-4f7d-963c-780c32a41523 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:40.894124 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0dc90041-95e6-4f7d-963c-780c32a41523 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:40.895095 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0dc90041-95e6-4f7d-963c-780c32a41523 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:40.948534 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:41.318501 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0dc90041-95e6-4f7d-963c-780c32a41523 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:41.327317 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0dc90041-95e6-4f7d-963c-780c32a41523 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.461070 Jul 31 01:23:41.327931 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1607/3254] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:40 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:41.348909 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a7047559-c386-4684-9268-732bc264165e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:41.349538 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a7047559-c386-4684-9268-732bc264165e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:41.367130 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7047559-c386-4684-9268-732bc264165e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:41.377655 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7e08d129-cbde-44e4-b255-38538f00fc6d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:41.379807 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7047559-c386-4684-9268-732bc264165e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:41.380767 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7047559-c386-4684-9268-732bc264165e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:41.381225 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7047559-c386-4684-9268-732bc264165e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:41.389157 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7e08d129-cbde-44e4-b255-38538f00fc6d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.676283 Jul 31 01:23:41.389797 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1648/3255] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:40 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:23:41.396194 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8f06fe8f-ad09-488e-a643-a7bb25e6794d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:41.402238 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8f06fe8f-ad09-488e-a643-a7bb25e6794d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:41.425060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f06fe8f-ad09-488e-a643-a7bb25e6794d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:41.425916 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f06fe8f-ad09-488e-a643-a7bb25e6794d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:41.428886 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f06fe8f-ad09-488e-a643-a7bb25e6794d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:41.430643 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f06fe8f-ad09-488e-a643-a7bb25e6794d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:41.919235 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a7047559-c386-4684-9268-732bc264165e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:41.935449 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a7047559-c386-4684-9268-732bc264165e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:41.937479 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a7047559-c386-4684-9268-732bc264165e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:41.939181 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a7047559-c386-4684-9268-732bc264165e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 200 len: 1359 microversion: 2.21 time: 0.594456 Jul 31 01:23:41.948268 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1608/3256] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:23:41 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 1359 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:23:41.959213 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5db3e78d-b243-48d9-b042-47820776cf98 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:41.983239 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5db3e78d-b243-48d9-b042-47820776cf98 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:41.984466 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5db3e78d-b243-48d9-b042-47820776cf98 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:41.992335 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8f06fe8f-ad09-488e-a643-a7bb25e6794d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:42.002741 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8f06fe8f-ad09-488e-a643-a7bb25e6794d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 200 len: 1324 microversion: 2.1 time: 0.610181 Jul 31 01:23:42.003485 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1649/3257] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:41 2022] GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 1324 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:42.008721 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-e63c0f7a-28d5-48e8-b1ef-b8ed5891a4de req-b4b77a7b-b2d6-47d7-8631-8eb445c4a5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e94ea78-2ac3-4192-aa5c-165b70d7b083", "name": "network-vif-plugged", "status": "completed", "tag": "da0517f6-7df8-42a4-8ee4-a90c7b34261b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:42.025399 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-5db3e78d-b243-48d9-b042-47820776cf98 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] HTTP exception thrown: Instance e7f0abec-dd05-4dff-8f15-b56464346b06 is locked Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5db3e78d-b243-48d9-b042-47820776cf98 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Request method failure captured: Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action HTTP/1.1 Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 15 Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dhkaGQR0CXWpGPAG4YiZIdd83eiYcwnrL_vFJ3yaYlDHK66u6nP96xvpo7ut6hmJeUxvAmVeOuG6fHMb0MynOrnbx53tSX29FKCgbTIvynvxRGnCTvg3yHoj2O8OMB7aoPhOzqFGyp1k3ddC6-5iirQ3GPjkps3ibXZR3HrXQFzSHc Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: da596310058e4248bf33465f387956f2 Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da596310058e4248bf33465f387956f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da596310058e4248bf33465f387956f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/da596310058e4248bf33465f387956f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_da596310058e4248bf33465f387956f2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: da596310058e4248bf33465f387956f2 Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerActionsTestJSON-1719297789-project Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 36a36dbb4f6c40a7bb69c8c3f747aaed Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerActionsTestJSON-1719297789-project Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: {"os-stop": {}} Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: exception: Instance e7f0abec-dd05-4dff-8f15-b56464346b06 is locked Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'e7f0abec-dd05-4dff-8f15-b56464346b06', 'body': {'os-stop': {}}} Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance e7f0abec-dd05-4dff-8f15-b56464346b06 is locked Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance e7f0abec-dd05-4dff-8f15-b56464346b06 is locked Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7f0abec-dd05-4dff-8f15-b56464346b06 is locked Jul 31 01:23:42.028029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:23:42.039298 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e63c0f7a-28d5-48e8-b1ef-b8ed5891a4de req-b4b77a7b-b2d6-47d7-8631-8eb445c4a5d1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:42.040427 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5db3e78d-b243-48d9-b042-47820776cf98 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Returning 409 to user: Instance e7f0abec-dd05-4dff-8f15-b56464346b06 is locked {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:23:42.041405 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5db3e78d-b243-48d9-b042-47820776cf98 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 409 len: 107 microversion: 2.1 time: 0.091785 Jul 31 01:23:42.045644 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1609/3258] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:41 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 107 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:23:42.045878 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e63c0f7a-28d5-48e8-b1ef-b8ed5891a4de req-b4b77a7b-b2d6-47d7-8631-8eb445c4a5d1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:42.073986 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f1f5e5ab-771b-4309-ba21-f807c6b32f8d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:42.075218 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f1f5e5ab-771b-4309-ba21-f807c6b32f8d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:42.080193 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-e63c0f7a-28d5-48e8-b1ef-b8ed5891a4de req-b4b77a7b-b2d6-47d7-8631-8eb445c4a5d1 service nova] Creating event network-vif-plugged:da0517f6-7df8-42a4-8ee4-a90c7b34261b for instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083 on n-h1-master-1 Jul 31 01:23:42.089462 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-e63c0f7a-28d5-48e8-b1ef-b8ed5891a4de req-b4b77a7b-b2d6-47d7-8631-8eb445c4a5d1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083835 Jul 31 01:23:42.092198 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1f5e5ab-771b-4309-ba21-f807c6b32f8d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:42.093243 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1f5e5ab-771b-4309-ba21-f807c6b32f8d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:42.099660 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1f5e5ab-771b-4309-ba21-f807c6b32f8d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:42.100348 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1650/3259] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:23:42.100473 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1f5e5ab-771b-4309-ba21-f807c6b32f8d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:42.106814 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-711fcf6f-70cf-4b0c-b41c-f0fc0b4605f8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:42.108624 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-711fcf6f-70cf-4b0c-b41c-f0fc0b4605f8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:42.116476 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-711fcf6f-70cf-4b0c-b41c-f0fc0b4605f8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:42.117432 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-711fcf6f-70cf-4b0c-b41c-f0fc0b4605f8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:42.118679 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-711fcf6f-70cf-4b0c-b41c-f0fc0b4605f8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:42.119970 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-711fcf6f-70cf-4b0c-b41c-f0fc0b4605f8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:42.187461 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-711fcf6f-70cf-4b0c-b41c-f0fc0b4605f8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Unlocking {{(pid=119475) unlock /opt/stack/nova/nova/compute/api.py:4810}} Jul 31 01:23:42.272082 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:42.279403 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-711fcf6f-70cf-4b0c-b41c-f0fc0b4605f8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 202 len: 0 microversion: 2.1 time: 0.177262 Jul 31 01:23:42.280993 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1651/3260] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:42 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:23:42.291444 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-374d83b0-2ed2-4d5f-8ced-ee973d4c16c1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:42.303025 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-374d83b0-2ed2-4d5f-8ced-ee973d4c16c1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:42.304648 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-374d83b0-2ed2-4d5f-8ced-ee973d4c16c1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:42.359567 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-374d83b0-2ed2-4d5f-8ced-ee973d4c16c1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Going to try to stop instance {{(pid=119475) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 01:23:42.427873 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-374d83b0-2ed2-4d5f-8ced-ee973d4c16c1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 202 len: 0 microversion: 2.1 time: 0.141423 Jul 31 01:23:42.430111 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1652/3261] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:42 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 01:23:42.465989 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b868475f-45cb-4a04-9824-735e7815b79b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:42.467091 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b868475f-45cb-4a04-9824-735e7815b79b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:42.494097 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b868475f-45cb-4a04-9824-735e7815b79b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:42.497916 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b868475f-45cb-4a04-9824-735e7815b79b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:42.500332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b868475f-45cb-4a04-9824-735e7815b79b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:42.501140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b868475f-45cb-4a04-9824-735e7815b79b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:43.200168 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f1f5e5ab-771b-4309-ba21-f807c6b32f8d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:43.209080 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f1f5e5ab-771b-4309-ba21-f807c6b32f8d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 1.166020 Jul 31 01:23:43.220478 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1610/3262] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:42 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:43.226591 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-69e48b42-2dd5-4da2-ae01-d11fce1dd343 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:43.227522 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-69e48b42-2dd5-4da2-ae01-d11fce1dd343 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:43.239840 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69e48b42-2dd5-4da2-ae01-d11fce1dd343 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:43.240748 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69e48b42-2dd5-4da2-ae01-d11fce1dd343 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:43.241917 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69e48b42-2dd5-4da2-ae01-d11fce1dd343 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:43.245670 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-69e48b42-2dd5-4da2-ae01-d11fce1dd343 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:43.259742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b868475f-45cb-4a04-9824-735e7815b79b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:43.271817 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b868475f-45cb-4a04-9824-735e7815b79b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.839926 Jul 31 01:23:43.272684 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1653/3263] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:42 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:43.291556 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2ff0031e-6ee8-40a8-a4ac-216c343a8a9a req-d9eb221c-814c-451b-b253-6ff5eb3645c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc", "tag": "c984b49e-330a-4948-9217-e662ab215f37"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:43.313367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2ff0031e-6ee8-40a8-a4ac-216c343a8a9a req-d9eb221c-814c-451b-b253-6ff5eb3645c7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:43.313642 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2ff0031e-6ee8-40a8-a4ac-216c343a8a9a req-d9eb221c-814c-451b-b253-6ff5eb3645c7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:43.341790 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2ff0031e-6ee8-40a8-a4ac-216c343a8a9a req-d9eb221c-814c-451b-b253-6ff5eb3645c7 service nova] Creating event network-changed:c984b49e-330a-4948-9217-e662ab215f37 for instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc on n-h2-master-1 Jul 31 01:23:43.359916 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2ff0031e-6ee8-40a8-a4ac-216c343a8a9a req-d9eb221c-814c-451b-b253-6ff5eb3645c7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085738 Jul 31 01:23:43.360843 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1654/3264] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:23:43.366088 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-067fd488-0034-4a88-acc1-fe1e208322f4 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:43.366750 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-067fd488-0034-4a88-acc1-fe1e208322f4 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:43.386464 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-067fd488-0034-4a88-acc1-fe1e208322f4 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:43.386464 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-067fd488-0034-4a88-acc1-fe1e208322f4 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:43.387028 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-067fd488-0034-4a88-acc1-fe1e208322f4 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:43.387559 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-067fd488-0034-4a88-acc1-fe1e208322f4 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:43.607905 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-69e48b42-2dd5-4da2-ae01-d11fce1dd343 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:43.618316 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-69e48b42-2dd5-4da2-ae01-d11fce1dd343 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1680 microversion: 2.1 time: 0.396422 Jul 31 01:23:43.618903 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1611/3265] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:43 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1680 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:43.626146 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-256ccd54-eeaa-48c0-89b1-ba1026c3b38a tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:43.626780 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-256ccd54-eeaa-48c0-89b1-ba1026c3b38a tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:43.637744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-256ccd54-eeaa-48c0-89b1-ba1026c3b38a tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:43.638610 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-256ccd54-eeaa-48c0-89b1-ba1026c3b38a tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:43.640387 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-256ccd54-eeaa-48c0-89b1-ba1026c3b38a tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:43.641050 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-256ccd54-eeaa-48c0-89b1-ba1026c3b38a tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:43.906108 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-256ccd54-eeaa-48c0-89b1-ba1026c3b38a tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:43.920836 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-256ccd54-eeaa-48c0-89b1-ba1026c3b38a tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 200 len: 1324 microversion: 2.1 time: 0.300139 Jul 31 01:23:43.945439 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1612/3266] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:43 2022] GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 1324 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:43.980327 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-067fd488-0034-4a88-acc1-fe1e208322f4 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:43.994662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-067fd488-0034-4a88-acc1-fe1e208322f4 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:44.006248 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-067fd488-0034-4a88-acc1-fe1e208322f4 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:44.009306 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-067fd488-0034-4a88-acc1-fe1e208322f4 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 200 len: 1359 microversion: 2.21 time: 0.647267 Jul 31 01:23:44.013067 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1655/3267] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:23:43 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 1359 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:23:44.244012 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7e066e90-e45d-46a9-a6eb-172622e0f024 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:44.244804 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7e066e90-e45d-46a9-a6eb-172622e0f024 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:44.259523 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e066e90-e45d-46a9-a6eb-172622e0f024 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:44.274577 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e066e90-e45d-46a9-a6eb-172622e0f024 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:44.275459 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e066e90-e45d-46a9-a6eb-172622e0f024 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:44.275909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e066e90-e45d-46a9-a6eb-172622e0f024 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:44.293624 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-548d3eca-04e9-4571-99b6-4b291274f4df tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:44.294989 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-548d3eca-04e9-4571-99b6-4b291274f4df tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:44.304678 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-548d3eca-04e9-4571-99b6-4b291274f4df tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:44.305480 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-548d3eca-04e9-4571-99b6-4b291274f4df tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:44.306628 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-548d3eca-04e9-4571-99b6-4b291274f4df tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:44.308007 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-548d3eca-04e9-4571-99b6-4b291274f4df tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:44.628883 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7e066e90-e45d-46a9-a6eb-172622e0f024 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:44.636052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-548d3eca-04e9-4571-99b6-4b291274f4df tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:44.674217 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-548d3eca-04e9-4571-99b6-4b291274f4df tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.384744 Jul 31 01:23:44.679316 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7e066e90-e45d-46a9-a6eb-172622e0f024 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 0.441244 Jul 31 01:23:44.683647 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1656/3268] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:44 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:44.701978 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4cf5de33-97f2-4a65-b301-015154c40d28 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:44.702941 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4cf5de33-97f2-4a65-b301-015154c40d28 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:44.711779 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4cf5de33-97f2-4a65-b301-015154c40d28 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:44.712511 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4cf5de33-97f2-4a65-b301-015154c40d28 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:44.713803 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4cf5de33-97f2-4a65-b301-015154c40d28 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:44.714466 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4cf5de33-97f2-4a65-b301-015154c40d28 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:44.716028 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1613/3269] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:44 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:44.944756 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d0e40f7d-c79f-4e97-92f5-ae4ac66a8e76 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:44.945373 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d0e40f7d-c79f-4e97-92f5-ae4ac66a8e76 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:44.958361 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0e40f7d-c79f-4e97-92f5-ae4ac66a8e76 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:44.958792 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0e40f7d-c79f-4e97-92f5-ae4ac66a8e76 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:44.959623 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0e40f7d-c79f-4e97-92f5-ae4ac66a8e76 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:44.960058 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0e40f7d-c79f-4e97-92f5-ae4ac66a8e76 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:45.075168 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4cf5de33-97f2-4a65-b301-015154c40d28 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:45.083444 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4cf5de33-97f2-4a65-b301-015154c40d28 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1680 microversion: 2.1 time: 0.385203 Jul 31 01:23:45.084045 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1657/3270] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:44 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1680 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:45.103046 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3d28a984-df90-472d-a0c8-d8a8cb72f739 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:45.103699 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3d28a984-df90-472d-a0c8-d8a8cb72f739 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:45.111652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d28a984-df90-472d-a0c8-d8a8cb72f739 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:45.112986 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d28a984-df90-472d-a0c8-d8a8cb72f739 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:45.114096 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d28a984-df90-472d-a0c8-d8a8cb72f739 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:45.114786 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d28a984-df90-472d-a0c8-d8a8cb72f739 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:45.588105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d0e40f7d-c79f-4e97-92f5-ae4ac66a8e76 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:45.600169 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d0e40f7d-c79f-4e97-92f5-ae4ac66a8e76 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 200 len: 1520 microversion: 2.1 time: 0.659125 Jul 31 01:23:45.604852 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1614/3271] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:44 2022] GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 1520 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:23:45.628914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-68586640-67cb-47df-99fd-856c62402f10 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Action: 'create', calling method: .version_select at 0x7fede455bc10>, body: {"pool": null} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:45.722485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3d28a984-df90-472d-a0c8-d8a8cb72f739 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:45.740415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3d28a984-df90-472d-a0c8-d8a8cb72f739 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:45.747189 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3d28a984-df90-472d-a0c8-d8a8cb72f739 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:45.749607 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3d28a984-df90-472d-a0c8-d8a8cb72f739 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 200 len: 1359 microversion: 2.21 time: 0.650340 Jul 31 01:23:45.752519 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1658/3272] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:23:45 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 1359 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:23:45.769796 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-27b4840f-fe1f-4fd6-8288-891b9edda248 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:45.772167 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-27b4840f-fe1f-4fd6-8288-891b9edda248 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:45.774648 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:45.792797 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27b4840f-fe1f-4fd6-8288-891b9edda248 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:45.794075 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27b4840f-fe1f-4fd6-8288-891b9edda248 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:45.795100 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27b4840f-fe1f-4fd6-8288-891b9edda248 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:45.795860 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27b4840f-fe1f-4fd6-8288-891b9edda248 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:46.062126 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:46.302940 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-27b4840f-fe1f-4fd6-8288-891b9edda248 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:46.312325 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-27b4840f-fe1f-4fd6-8288-891b9edda248 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.558679 Jul 31 01:23:46.324608 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1659/3273] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:45 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:46.330276 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-aca7b5d0-161a-4a6d-a547-2d8d65fa7fb1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:46.331186 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-aca7b5d0-161a-4a6d-a547-2d8d65fa7fb1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:46.341687 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aca7b5d0-161a-4a6d-a547-2d8d65fa7fb1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:46.344236 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aca7b5d0-161a-4a6d-a547-2d8d65fa7fb1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:46.352250 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aca7b5d0-161a-4a6d-a547-2d8d65fa7fb1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:46.353127 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aca7b5d0-161a-4a6d-a547-2d8d65fa7fb1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:46.496545 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=14 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:46.684135 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-aca7b5d0-161a-4a6d-a547-2d8d65fa7fb1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:46.701735 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-aca7b5d0-161a-4a6d-a547-2d8d65fa7fb1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 0.371319 Jul 31 01:23:46.702910 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1660/3274] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:46 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:46.728971 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-293a53bc-3d07-487f-8497-e19a3d4c254e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:46.729609 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-293a53bc-3d07-487f-8497-e19a3d4c254e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:46.744780 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-293a53bc-3d07-487f-8497-e19a3d4c254e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:46.747315 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-293a53bc-3d07-487f-8497-e19a3d4c254e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:46.749384 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-293a53bc-3d07-487f-8497-e19a3d4c254e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:46.751972 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-293a53bc-3d07-487f-8497-e19a3d4c254e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:47.111675 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-293a53bc-3d07-487f-8497-e19a3d4c254e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:47.119406 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-293a53bc-3d07-487f-8497-e19a3d4c254e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1680 microversion: 2.1 time: 0.407502 Jul 31 01:23:47.121944 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1661/3275] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:46 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1680 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:47.229265 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a81ec8e0-d7b3-43c5-ae45-4d568d8df9b4 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Action: 'create', calling method: .version_select at 0x7fedea94f8b0>, body: {"keypair": {"name": "tempest-keypair-1379601569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQ1oQ7RcAmzQaKzH7q8yvDCInyPerDxwe6aiidLe5KOQqV7Su8Jof+FR5WDiGsToAgk7YWnGBk4lp8hWF3pucTRVaS4jkQ+Ah/ZibGO0J7xon1JaY4H3mjobKyOXzuJAQ=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:47.248512 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-a81ec8e0-d7b3-43c5-ae45-4d568d8df9b4 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Getting quotas for project 3c66667f28da48db95c5fa73292a2537. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:23:47.253914 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-a81ec8e0-d7b3-43c5-ae45-4d568d8df9b4 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Getting quotas for user 6134662798544bffbb92ba1f4e890b81 and project 3c66667f28da48db95c5fa73292a2537. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:23:47.303230 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a81ec8e0-d7b3-43c5-ae45-4d568d8df9b4 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177531 Jul 31 01:23:47.305543 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1662/3276] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:23:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:23:47.316570 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4b3f585a-7a5b-4f97-b991-d839bed63b5b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:47.317209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4b3f585a-7a5b-4f97-b991-d839bed63b5b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:47.337679 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b3f585a-7a5b-4f97-b991-d839bed63b5b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:47.340253 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b3f585a-7a5b-4f97-b991-d839bed63b5b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:47.340253 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b3f585a-7a5b-4f97-b991-d839bed63b5b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:47.340479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b3f585a-7a5b-4f97-b991-d839bed63b5b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:47.755775 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4b3f585a-7a5b-4f97-b991-d839bed63b5b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:47.778866 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4b3f585a-7a5b-4f97-b991-d839bed63b5b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:47.782196 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4b3f585a-7a5b-4f97-b991-d839bed63b5b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:47.786277 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4b3f585a-7a5b-4f97-b991-d839bed63b5b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 200 len: 1359 microversion: 2.21 time: 0.479357 Jul 31 01:23:47.788702 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1663/3277] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:23:47 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 1359 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:23:47.814107 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-da634df5-8da7-49de-9608-aa02c5889da2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:47.814889 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-da634df5-8da7-49de-9608-aa02c5889da2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:47.825268 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da634df5-8da7-49de-9608-aa02c5889da2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:47.826254 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da634df5-8da7-49de-9608-aa02c5889da2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:47.827288 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da634df5-8da7-49de-9608-aa02c5889da2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:47.828023 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da634df5-8da7-49de-9608-aa02c5889da2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:48.099552 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-da634df5-8da7-49de-9608-aa02c5889da2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:48.116076 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-da634df5-8da7-49de-9608-aa02c5889da2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.325140 Jul 31 01:23:48.117161 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1664/3278] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:47 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:48.122244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5a00f4e5-8f20-441f-bf08-415114450c37 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:48.122870 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5a00f4e5-8f20-441f-bf08-415114450c37 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:48.139791 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a00f4e5-8f20-441f-bf08-415114450c37 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:48.141186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a00f4e5-8f20-441f-bf08-415114450c37 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:48.144004 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a00f4e5-8f20-441f-bf08-415114450c37 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:48.146457 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a00f4e5-8f20-441f-bf08-415114450c37 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:48.564164 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5a00f4e5-8f20-441f-bf08-415114450c37 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:48.579047 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5a00f4e5-8f20-441f-bf08-415114450c37 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 0.460933 Jul 31 01:23:48.580170 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1665/3279] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:48 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:48.584395 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bedcaa55-26c0-4286-b38a-e5883e70e950 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:48.585029 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bedcaa55-26c0-4286-b38a-e5883e70e950 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:48.603636 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bedcaa55-26c0-4286-b38a-e5883e70e950 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:48.604541 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bedcaa55-26c0-4286-b38a-e5883e70e950 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:48.607476 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bedcaa55-26c0-4286-b38a-e5883e70e950 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:48.608870 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bedcaa55-26c0-4286-b38a-e5883e70e950 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:48.708876 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-68586640-67cb-47df-99fd-856c62402f10 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.084870 Jul 31 01:23:48.710863 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1615/3280] 10.222.0.45 () {60 vars in 1170 bytes} [Sun Jul 31 01:23:45 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:23:48.812499 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-17b3c8c5-d9f5-4c36-8ee3-dc8dbefc306e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:48.813412 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-17b3c8c5-d9f5-4c36-8ee3-dc8dbefc306e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:48.820649 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17b3c8c5-d9f5-4c36-8ee3-dc8dbefc306e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:48.821407 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17b3c8c5-d9f5-4c36-8ee3-dc8dbefc306e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:48.822472 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17b3c8c5-d9f5-4c36-8ee3-dc8dbefc306e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:48.823086 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17b3c8c5-d9f5-4c36-8ee3-dc8dbefc306e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:49.360777 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bedcaa55-26c0-4286-b38a-e5883e70e950 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:49.371592 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bedcaa55-26c0-4286-b38a-e5883e70e950 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1680 microversion: 2.1 time: 0.790707 Jul 31 01:23:49.372184 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1666/3281] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:48 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1680 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:49.381105 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9d7cbe89-b9c7-45a5-a91c-6c0cbc6d64cd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-912304020", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "02e0c218-00bf-47b5-abe5-e48ac4dced0a"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:49.501570 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-17b3c8c5-d9f5-4c36-8ee3-dc8dbefc306e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:49.514457 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-17b3c8c5-d9f5-4c36-8ee3-dc8dbefc306e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:49.515134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-9d7cbe89-b9c7-45a5-a91c-6c0cbc6d64cd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] validate_networks() for [('02e0c218-00bf-47b5-abe5-e48ac4dced0a', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:23:49.519687 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-17b3c8c5-d9f5-4c36-8ee3-dc8dbefc306e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:49.521360 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-17b3c8c5-d9f5-4c36-8ee3-dc8dbefc306e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 200 len: 1359 microversion: 2.21 time: 0.715072 Jul 31 01:23:49.527012 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1616/3282] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:23:48 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 1359 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:23:49.537081 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-31a59b43-7d9f-4c83-b8e8-71889d9100a2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:49.540078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-31a59b43-7d9f-4c83-b8e8-71889d9100a2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:49.554196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-31a59b43-7d9f-4c83-b8e8-71889d9100a2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:49.556973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-31a59b43-7d9f-4c83-b8e8-71889d9100a2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:49.560308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-31a59b43-7d9f-4c83-b8e8-71889d9100a2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:49.563007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-31a59b43-7d9f-4c83-b8e8-71889d9100a2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:49.997926 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-31a59b43-7d9f-4c83-b8e8-71889d9100a2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:50.008641 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-31a59b43-7d9f-4c83-b8e8-71889d9100a2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.478599 Jul 31 01:23:50.024901 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1617/3283] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:49 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:50.033653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-99733ccf-dbc5-4001-952b-9d65d0116136 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:50.034721 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-99733ccf-dbc5-4001-952b-9d65d0116136 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:50.044675 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99733ccf-dbc5-4001-952b-9d65d0116136 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:50.046382 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99733ccf-dbc5-4001-952b-9d65d0116136 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:50.047572 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99733ccf-dbc5-4001-952b-9d65d0116136 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:50.048206 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99733ccf-dbc5-4001-952b-9d65d0116136 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:50.599278 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9d7cbe89-b9c7-45a5-a91c-6c0cbc6d64cd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:23:50.600533 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-99733ccf-dbc5-4001-952b-9d65d0116136 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:50.600888 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9d7cbe89-b9c7-45a5-a91c-6c0cbc6d64cd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:23:50.601869 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9d7cbe89-b9c7-45a5-a91c-6c0cbc6d64cd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:23:50.603061 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9d7cbe89-b9c7-45a5-a91c-6c0cbc6d64cd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:23:50.604651 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9d7cbe89-b9c7-45a5-a91c-6c0cbc6d64cd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:23:50.620060 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-99733ccf-dbc5-4001-952b-9d65d0116136 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 0.592388 Jul 31 01:23:50.638761 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d7cbe89-b9c7-45a5-a91c-6c0cbc6d64cd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:50.639220 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d7cbe89-b9c7-45a5-a91c-6c0cbc6d64cd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:50.641455 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1618/3284] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:50 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:50.647581 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d7cbe89-b9c7-45a5-a91c-6c0cbc6d64cd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:50.648685 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ae4af33b-57c0-4f39-a53a-f5a202916443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:50.649283 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d7cbe89-b9c7-45a5-a91c-6c0cbc6d64cd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:50.652366 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ae4af33b-57c0-4f39-a53a-f5a202916443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:50.688408 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae4af33b-57c0-4f39-a53a-f5a202916443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:50.695051 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae4af33b-57c0-4f39-a53a-f5a202916443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:50.698740 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae4af33b-57c0-4f39-a53a-f5a202916443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:50.700858 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae4af33b-57c0-4f39-a53a-f5a202916443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:50.751049 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-9d7cbe89-b9c7-45a5-a91c-6c0cbc6d64cd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Getting quotas for project 9d6baeb89380488c9ef70003b86c5815. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:23:50.780214 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-9d7cbe89-b9c7-45a5-a91c-6c0cbc6d64cd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Getting quotas for user 46a58b52653f40e696d7d0a09d7e48e7 and project 9d6baeb89380488c9ef70003b86c5815. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:23:50.822686 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9d7cbe89-b9c7-45a5-a91c-6c0cbc6d64cd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:23:50.827389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9d7cbe89-b9c7-45a5-a91c-6c0cbc6d64cd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:23:50.909031 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9d7cbe89-b9c7-45a5-a91c-6c0cbc6d64cd tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.532488 Jul 31 01:23:50.910362 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1667/3285] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:23:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:23:50.920856 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3b89029-a910-4530-b4d0-64f22e4b47b5 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:50.922497 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3b89029-a910-4530-b4d0-64f22e4b47b5 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:50.934023 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3b89029-a910-4530-b4d0-64f22e4b47b5 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:50.935689 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3b89029-a910-4530-b4d0-64f22e4b47b5 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:50.937293 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3b89029-a910-4530-b4d0-64f22e4b47b5 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:50.938354 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3b89029-a910-4530-b4d0-64f22e4b47b5 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:51.186181 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ae4af33b-57c0-4f39-a53a-f5a202916443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:51.196837 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ae4af33b-57c0-4f39-a53a-f5a202916443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1680 microversion: 2.1 time: 0.554143 Jul 31 01:23:51.197452 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1619/3286] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:50 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1680 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:51.205247 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-47f05374-3e01-4620-87ef-ddb01bb33bb2 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:51.205883 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-47f05374-3e01-4620-87ef-ddb01bb33bb2 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:51.452938 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-47f05374-3e01-4620-87ef-ddb01bb33bb2 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:51.462286 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-47f05374-3e01-4620-87ef-ddb01bb33bb2 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318" status: 200 len: 1223 microversion: 2.1 time: 0.260570 Jul 31 01:23:51.465658 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1620/3287] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:51 2022] GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318 => generated 1223 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:51.473547 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0b47bd2a-f7ec-4bf3-b600-5cf4e28dfcfd tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:51.474599 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0b47bd2a-f7ec-4bf3-b600-5cf4e28dfcfd tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:51.486112 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b47bd2a-f7ec-4bf3-b600-5cf4e28dfcfd tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:51.487351 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b47bd2a-f7ec-4bf3-b600-5cf4e28dfcfd tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:51.488886 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b47bd2a-f7ec-4bf3-b600-5cf4e28dfcfd tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:51.489582 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b47bd2a-f7ec-4bf3-b600-5cf4e28dfcfd tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:51.530990 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3b89029-a910-4530-b4d0-64f22e4b47b5 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:51.542004 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3b89029-a910-4530-b4d0-64f22e4b47b5 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:51.545504 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3b89029-a910-4530-b4d0-64f22e4b47b5 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:51.547957 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3b89029-a910-4530-b4d0-64f22e4b47b5 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 200 len: 1359 microversion: 2.21 time: 0.636291 Jul 31 01:23:51.549091 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1668/3288] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:23:50 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 1359 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:23:51.581560 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-d90a7ba1-24b2-49c4-8bb4-5dca9c389752 req-3472bb6f-9424-4571-8250-30fdc70707c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc", "name": "network-vif-plugged", "status": "completed", "tag": "c984b49e-330a-4948-9217-e662ab215f37"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:51.600057 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d90a7ba1-24b2-49c4-8bb4-5dca9c389752 req-3472bb6f-9424-4571-8250-30fdc70707c6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:51.601312 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d90a7ba1-24b2-49c4-8bb4-5dca9c389752 req-3472bb6f-9424-4571-8250-30fdc70707c6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:51.636930 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-d90a7ba1-24b2-49c4-8bb4-5dca9c389752 req-3472bb6f-9424-4571-8250-30fdc70707c6 service nova] Creating event network-vif-plugged:c984b49e-330a-4948-9217-e662ab215f37 for instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc on n-h2-master-1 Jul 31 01:23:51.650265 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-d90a7ba1-24b2-49c4-8bb4-5dca9c389752 req-3472bb6f-9424-4571-8250-30fdc70707c6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099667 Jul 31 01:23:51.660179 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1669/3289] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:23:51.673548 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-27c5544b-6983-451b-ba3e-d46750b19f95 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "c09fa550-f8f6-414b-8764-b0891b72ce64"}], "security_groups": [{"name": "tempest-securitygroup--1648413173"}], "key_name": "tempest-keypair-1379601569", "user_data": "}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:51.866527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0b47bd2a-f7ec-4bf3-b600-5cf4e28dfcfd tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:51.881123 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0b47bd2a-f7ec-4bf3-b600-5cf4e28dfcfd tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.413732 Jul 31 01:23:51.882165 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1621/3290] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:51 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:51.896413 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-06da1995-a85f-4763-aa64-0c2752373fea tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:51.897069 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-06da1995-a85f-4763-aa64-0c2752373fea tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:51.905333 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06da1995-a85f-4763-aa64-0c2752373fea tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:51.906057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06da1995-a85f-4763-aa64-0c2752373fea tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:51.907049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06da1995-a85f-4763-aa64-0c2752373fea tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:51.907929 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06da1995-a85f-4763-aa64-0c2752373fea tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:51.912356 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-27c5544b-6983-451b-ba3e-d46750b19f95 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] validate_networks() for [('c09fa550-f8f6-414b-8764-b0891b72ce64', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:23:52.343388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-06da1995-a85f-4763-aa64-0c2752373fea tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:52.355090 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-06da1995-a85f-4763-aa64-0c2752373fea tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 0.470851 Jul 31 01:23:52.355740 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1622/3291] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:51 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:52.366132 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-89d78f1c-8603-4cc0-b1a7-c5e05f4c453c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:52.367256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-89d78f1c-8603-4cc0-b1a7-c5e05f4c453c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:52.376245 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-89d78f1c-8603-4cc0-b1a7-c5e05f4c453c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:52.376713 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-89d78f1c-8603-4cc0-b1a7-c5e05f4c453c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:52.377510 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-89d78f1c-8603-4cc0-b1a7-c5e05f4c453c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:52.378258 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-89d78f1c-8603-4cc0-b1a7-c5e05f4c453c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:52.793747 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-89d78f1c-8603-4cc0-b1a7-c5e05f4c453c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:52.816893 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-89d78f1c-8603-4cc0-b1a7-c5e05f4c453c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1680 microversion: 2.1 time: 0.453201 Jul 31 01:23:52.817639 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1623/3292] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:52 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1680 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:52.831043 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-978574a9-cf8e-4aef-85b1-03172dd0f664 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:52.834845 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-978574a9-cf8e-4aef-85b1-03172dd0f664 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:52.854280 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-978574a9-cf8e-4aef-85b1-03172dd0f664 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:52.856155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-978574a9-cf8e-4aef-85b1-03172dd0f664 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:52.857177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-978574a9-cf8e-4aef-85b1-03172dd0f664 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:52.857840 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-978574a9-cf8e-4aef-85b1-03172dd0f664 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:53.014216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-978574a9-cf8e-4aef-85b1-03172dd0f664 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:53.032153 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-27c5544b-6983-451b-ba3e-d46750b19f95 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:23:53.033159 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-27c5544b-6983-451b-ba3e-d46750b19f95 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:23:53.033645 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-27c5544b-6983-451b-ba3e-d46750b19f95 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:23:53.034238 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-27c5544b-6983-451b-ba3e-d46750b19f95 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:23:53.034671 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-27c5544b-6983-451b-ba3e-d46750b19f95 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:23:53.035143 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-978574a9-cf8e-4aef-85b1-03172dd0f664 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318" status: 200 len: 1293 microversion: 2.1 time: 0.214291 Jul 31 01:23:53.035773 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1624/3293] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:52 2022] GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318 => generated 1293 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:53.050806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63a1be2a-d0c8-475b-bbfb-2ae95c4619db tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:53.054417 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27c5544b-6983-451b-ba3e-d46750b19f95 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:53.055123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27c5544b-6983-451b-ba3e-d46750b19f95 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:53.056229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27c5544b-6983-451b-ba3e-d46750b19f95 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:53.056870 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27c5544b-6983-451b-ba3e-d46750b19f95 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:53.057303 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-63a1be2a-d0c8-475b-bbfb-2ae95c4619db tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:53.066778 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63a1be2a-d0c8-475b-bbfb-2ae95c4619db tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:53.067691 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63a1be2a-d0c8-475b-bbfb-2ae95c4619db tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:53.069332 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63a1be2a-d0c8-475b-bbfb-2ae95c4619db tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:53.070054 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63a1be2a-d0c8-475b-bbfb-2ae95c4619db tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:53.076708 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:53.101130 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-27c5544b-6983-451b-ba3e-d46750b19f95 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Getting quotas for project 3c66667f28da48db95c5fa73292a2537. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:23:53.117233 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-27c5544b-6983-451b-ba3e-d46750b19f95 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Getting quotas for user 6134662798544bffbb92ba1f4e890b81 and project 3c66667f28da48db95c5fa73292a2537. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:23:53.154256 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-27c5544b-6983-451b-ba3e-d46750b19f95 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:23:53.156761 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-27c5544b-6983-451b-ba3e-d46750b19f95 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:23:53.227219 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-27c5544b-6983-451b-ba3e-d46750b19f95 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.565304 Jul 31 01:23:53.228531 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1670/3294] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:23:51 2022] POST /compute/v2.1/servers => generated 409 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:23:53.235380 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-806e6f9f-a771-42de-a4f1-7f2689613815 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:53.236496 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-806e6f9f-a771-42de-a4f1-7f2689613815 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:53.246320 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-806e6f9f-a771-42de-a4f1-7f2689613815 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:53.247190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-806e6f9f-a771-42de-a4f1-7f2689613815 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:53.248311 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-806e6f9f-a771-42de-a4f1-7f2689613815 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:53.248997 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-806e6f9f-a771-42de-a4f1-7f2689613815 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:53.542653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-63a1be2a-d0c8-475b-bbfb-2ae95c4619db tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:53.569091 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-63a1be2a-d0c8-475b-bbfb-2ae95c4619db tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:53.571604 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-63a1be2a-d0c8-475b-bbfb-2ae95c4619db tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:53.572790 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-63a1be2a-d0c8-475b-bbfb-2ae95c4619db tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 200 len: 1359 microversion: 2.21 time: 0.534823 Jul 31 01:23:53.574856 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1625/3295] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:23:53 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 1359 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:23:53.580847 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8233406c-5814-437b-b8e7-36ae26a4a920 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:53.581468 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8233406c-5814-437b-b8e7-36ae26a4a920 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:53.720131 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8233406c-5814-437b-b8e7-36ae26a4a920 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134662798544bffbb92ba1f4e890b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66667f28da48db95c5fa73292a2537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:53.730837 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8233406c-5814-437b-b8e7-36ae26a4a920 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1" status: 200 len: 1226 microversion: 2.1 time: 0.154581 Jul 31 01:23:53.731613 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1626/3296] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:53 2022] GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 => generated 1226 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:53.737738 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-72f82c30-ba45-4b95-8465-663e5d9fe153 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:53.742077 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-72f82c30-ba45-4b95-8465-663e5d9fe153 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:53.751398 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72f82c30-ba45-4b95-8465-663e5d9fe153 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:53.754788 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72f82c30-ba45-4b95-8465-663e5d9fe153 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:53.757481 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72f82c30-ba45-4b95-8465-663e5d9fe153 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:53.759157 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72f82c30-ba45-4b95-8465-663e5d9fe153 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:53.786702 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:53.792857 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-806e6f9f-a771-42de-a4f1-7f2689613815 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:53.807906 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-806e6f9f-a771-42de-a4f1-7f2689613815 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.577842 Jul 31 01:23:53.819767 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1671/3297] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:53 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:53.844480 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1c1cfd1a-0402-4b9b-860f-0c3cf95005a6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:53.845117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1c1cfd1a-0402-4b9b-860f-0c3cf95005a6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:53.854863 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c1cfd1a-0402-4b9b-860f-0c3cf95005a6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:53.856376 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c1cfd1a-0402-4b9b-860f-0c3cf95005a6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:53.857892 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c1cfd1a-0402-4b9b-860f-0c3cf95005a6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:53.858613 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c1cfd1a-0402-4b9b-860f-0c3cf95005a6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:54.135374 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-72f82c30-ba45-4b95-8465-663e5d9fe153 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:54.150882 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-72f82c30-ba45-4b95-8465-663e5d9fe153 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 0.416441 Jul 31 01:23:54.152757 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1627/3298] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:53 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:54.162298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-60c9e79c-9b5e-475d-8ba3-8c9c734ee80c tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:54.163183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-60c9e79c-9b5e-475d-8ba3-8c9c734ee80c tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:54.170416 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60c9e79c-9b5e-475d-8ba3-8c9c734ee80c tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:54.170898 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60c9e79c-9b5e-475d-8ba3-8c9c734ee80c tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:54.171795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60c9e79c-9b5e-475d-8ba3-8c9c734ee80c tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:54.183064 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60c9e79c-9b5e-475d-8ba3-8c9c734ee80c tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:54.214937 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1c1cfd1a-0402-4b9b-860f-0c3cf95005a6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:54.244885 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1c1cfd1a-0402-4b9b-860f-0c3cf95005a6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1657 microversion: 2.1 time: 0.405257 Jul 31 01:23:54.247498 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1672/3299] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:53 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1657 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:54.267462 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-695ad228-1c8a-457f-84f9-637ed53a2677 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:54.286367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-695ad228-1c8a-457f-84f9-637ed53a2677 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:54.294623 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-695ad228-1c8a-457f-84f9-637ed53a2677 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:54.327437 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-695ad228-1c8a-457f-84f9-637ed53a2677 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Going to try to start instance {{(pid=119475) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 31 01:23:54.357083 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-60c9e79c-9b5e-475d-8ba3-8c9c734ee80c tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:54.365671 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-60c9e79c-9b5e-475d-8ba3-8c9c734ee80c tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318" status: 200 len: 1281 microversion: 2.1 time: 0.209782 Jul 31 01:23:54.368956 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1628/3300] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:54 2022] GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318 => generated 1281 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:54.435030 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-695ad228-1c8a-457f-84f9-637ed53a2677 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 202 len: 0 microversion: 2.1 time: 0.170059 Jul 31 01:23:54.437890 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1673/3301] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:54 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 01:23:54.445652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3b4fab7e-489b-485d-a05d-0040d8c98000 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:54.446929 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3b4fab7e-489b-485d-a05d-0040d8c98000 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:54.462130 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b4fab7e-489b-485d-a05d-0040d8c98000 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:54.462595 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b4fab7e-489b-485d-a05d-0040d8c98000 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:54.463457 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b4fab7e-489b-485d-a05d-0040d8c98000 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:54.467673 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b4fab7e-489b-485d-a05d-0040d8c98000 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:54.599596 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f4f7959b-7f27-4eac-8b1b-8a3af817a182 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:54.600927 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f4f7959b-7f27-4eac-8b1b-8a3af817a182 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:54.636439 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f4f7959b-7f27-4eac-8b1b-8a3af817a182 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:54.638744 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f4f7959b-7f27-4eac-8b1b-8a3af817a182 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:54.639648 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f4f7959b-7f27-4eac-8b1b-8a3af817a182 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:54.640148 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f4f7959b-7f27-4eac-8b1b-8a3af817a182 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:55.179237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f4f7959b-7f27-4eac-8b1b-8a3af817a182 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:55.190650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f4f7959b-7f27-4eac-8b1b-8a3af817a182 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:55.193535 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f4f7959b-7f27-4eac-8b1b-8a3af817a182 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:55.194759 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f4f7959b-7f27-4eac-8b1b-8a3af817a182 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 200 len: 1552 microversion: 2.21 time: 0.600780 Jul 31 01:23:55.195678 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1674/3302] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:23:54 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 1552 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:23:55.201609 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-041c73b7-ce10-436e-8157-881ee4da45f3 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:55.202479 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-041c73b7-ce10-436e-8157-881ee4da45f3 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:55.211618 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b4fab7e-489b-485d-a05d-0040d8c98000 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:55.224840 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3b4fab7e-489b-485d-a05d-0040d8c98000 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1666 microversion: 2.1 time: 0.782222 Jul 31 01:23:55.226454 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1629/3303] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:54 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1666 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:55.240286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a991e665-45c8-4482-b393-f910fb5d5522 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:55.244977 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a991e665-45c8-4482-b393-f910fb5d5522 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:55.249242 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-041c73b7-ce10-436e-8157-881ee4da45f3 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:55.255074 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-041c73b7-ce10-436e-8157-881ee4da45f3 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:55.263841 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a991e665-45c8-4482-b393-f910fb5d5522 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:55.264671 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-041c73b7-ce10-436e-8157-881ee4da45f3 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:55.265396 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a991e665-45c8-4482-b393-f910fb5d5522 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:55.266759 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-041c73b7-ce10-436e-8157-881ee4da45f3 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:55.267288 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a991e665-45c8-4482-b393-f910fb5d5522 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:55.269579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a991e665-45c8-4482-b393-f910fb5d5522 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:55.535825 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-041c73b7-ce10-436e-8157-881ee4da45f3 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134662798544bffbb92ba1f4e890b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66667f28da48db95c5fa73292a2537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:55.547176 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-041c73b7-ce10-436e-8157-881ee4da45f3 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1" status: 200 len: 1284 microversion: 2.1 time: 0.350304 Jul 31 01:23:55.548339 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1675/3304] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:55 2022] GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 => generated 1284 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:55.554156 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2e87cc09-d352-4cd8-b77a-4b7b6d62969f tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:55.557444 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2e87cc09-d352-4cd8-b77a-4b7b6d62969f tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:55.570163 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e87cc09-d352-4cd8-b77a-4b7b6d62969f tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:55.571369 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e87cc09-d352-4cd8-b77a-4b7b6d62969f tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:55.572562 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e87cc09-d352-4cd8-b77a-4b7b6d62969f tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:55.573260 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e87cc09-d352-4cd8-b77a-4b7b6d62969f tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:55.777943 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a991e665-45c8-4482-b393-f910fb5d5522 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:55.790055 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a991e665-45c8-4482-b393-f910fb5d5522 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.559757 Jul 31 01:23:55.791190 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1630/3305] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:55 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:55.798549 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f46319c5-2747-47cf-b9f6-6f1dec8520b3 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:55.800071 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f46319c5-2747-47cf-b9f6-6f1dec8520b3 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:55.814893 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f46319c5-2747-47cf-b9f6-6f1dec8520b3 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:55.818601 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f46319c5-2747-47cf-b9f6-6f1dec8520b3 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:55.820730 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f46319c5-2747-47cf-b9f6-6f1dec8520b3 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:55.822577 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f46319c5-2747-47cf-b9f6-6f1dec8520b3 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:55.883006 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f46319c5-2747-47cf-b9f6-6f1dec8520b3 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:23:55.890954 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2e87cc09-d352-4cd8-b77a-4b7b6d62969f tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:55.899249 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2e87cc09-d352-4cd8-b77a-4b7b6d62969f tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 0.349568 Jul 31 01:23:55.903705 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1676/3306] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:55 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:55.908680 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2bb2b719-a14c-4489-9844-a5a8918b708f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:55.920792 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2bb2b719-a14c-4489-9844-a5a8918b708f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:55.928507 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bb2b719-a14c-4489-9844-a5a8918b708f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:55.929449 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bb2b719-a14c-4489-9844-a5a8918b708f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:55.930979 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bb2b719-a14c-4489-9844-a5a8918b708f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:55.932613 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bb2b719-a14c-4489-9844-a5a8918b708f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:56.040992 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f46319c5-2747-47cf-b9f6-6f1dec8520b3 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 204 len: 0 microversion: 2.21 time: 0.248202 Jul 31 01:23:56.046326 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1631/3307] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:23:55 2022] DELETE /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:23:56.055917 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3f6f4ab6-00ce-420f-9b33-fc6e02ca181e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:56.061023 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3f6f4ab6-00ce-420f-9b33-fc6e02ca181e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:56.072716 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f6f4ab6-00ce-420f-9b33-fc6e02ca181e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:56.074951 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f6f4ab6-00ce-420f-9b33-fc6e02ca181e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:56.076254 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f6f4ab6-00ce-420f-9b33-fc6e02ca181e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:56.080610 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f6f4ab6-00ce-420f-9b33-fc6e02ca181e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:56.334897 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2bb2b719-a14c-4489-9844-a5a8918b708f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:56.343177 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2bb2b719-a14c-4489-9844-a5a8918b708f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318" status: 200 len: 1323 microversion: 2.1 time: 0.438122 Jul 31 01:23:56.343804 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1677/3308] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:55 2022] GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318 => generated 1323 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:56.359408 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-533ba478-4814-4d35-a398-70158097738b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:56.360306 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-533ba478-4814-4d35-a398-70158097738b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:56.366982 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-533ba478-4814-4d35-a398-70158097738b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:56.368263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-533ba478-4814-4d35-a398-70158097738b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:56.368797 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-533ba478-4814-4d35-a398-70158097738b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:56.369527 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-533ba478-4814-4d35-a398-70158097738b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:57.015551 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3f6f4ab6-00ce-420f-9b33-fc6e02ca181e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:57.032729 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3f6f4ab6-00ce-420f-9b33-fc6e02ca181e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:57.034837 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3f6f4ab6-00ce-420f-9b33-fc6e02ca181e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:57.036439 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3f6f4ab6-00ce-420f-9b33-fc6e02ca181e tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 200 len: 1558 microversion: 2.21 time: 0.987967 Jul 31 01:23:57.037013 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1632/3309] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:23:56 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 1558 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:23:57.041833 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6727da22-24a1-4449-a346-1e6956fecafa tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:57.043810 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6727da22-24a1-4449-a346-1e6956fecafa tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:57.050734 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6727da22-24a1-4449-a346-1e6956fecafa tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:57.051314 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6727da22-24a1-4449-a346-1e6956fecafa tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:57.051968 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6727da22-24a1-4449-a346-1e6956fecafa tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:57.052405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6727da22-24a1-4449-a346-1e6956fecafa tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:57.241112 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-533ba478-4814-4d35-a398-70158097738b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:57.249402 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-533ba478-4814-4d35-a398-70158097738b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1666 microversion: 2.1 time: 0.900847 Jul 31 01:23:57.264320 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1678/3310] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:56 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1666 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:57.270135 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-003062af-bb58-4a2d-8df9-0ff72f4a0f8b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:57.271035 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-003062af-bb58-4a2d-8df9-0ff72f4a0f8b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:57.289969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-003062af-bb58-4a2d-8df9-0ff72f4a0f8b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:57.290440 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-003062af-bb58-4a2d-8df9-0ff72f4a0f8b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:57.291611 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-003062af-bb58-4a2d-8df9-0ff72f4a0f8b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:57.291754 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-003062af-bb58-4a2d-8df9-0ff72f4a0f8b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:57.490788 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6727da22-24a1-4449-a346-1e6956fecafa tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134662798544bffbb92ba1f4e890b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66667f28da48db95c5fa73292a2537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:57.498777 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6727da22-24a1-4449-a346-1e6956fecafa tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1" status: 200 len: 1352 microversion: 2.1 time: 0.460515 Jul 31 01:23:57.511813 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1633/3311] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:57 2022] GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 => generated 1352 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:57.518399 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6ca2d9b0-e4ed-4e15-8041-8965a499ff75 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:57.519461 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6ca2d9b0-e4ed-4e15-8041-8965a499ff75 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:57.526844 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6ca2d9b0-e4ed-4e15-8041-8965a499ff75 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:57.528436 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6ca2d9b0-e4ed-4e15-8041-8965a499ff75 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:57.529507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6ca2d9b0-e4ed-4e15-8041-8965a499ff75 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:57.530250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6ca2d9b0-e4ed-4e15-8041-8965a499ff75 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:57.809203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-003062af-bb58-4a2d-8df9-0ff72f4a0f8b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:57.819879 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-003062af-bb58-4a2d-8df9-0ff72f4a0f8b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.554028 Jul 31 01:23:57.821068 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1679/3312] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:57 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:57.826579 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fa50d600-b072-4dca-99db-f155e54cc811 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:57.827467 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fa50d600-b072-4dca-99db-f155e54cc811 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:57.833825 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fa50d600-b072-4dca-99db-f155e54cc811 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:57.834517 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fa50d600-b072-4dca-99db-f155e54cc811 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:57.835573 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fa50d600-b072-4dca-99db-f155e54cc811 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:57.836218 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fa50d600-b072-4dca-99db-f155e54cc811 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:58.006388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6ca2d9b0-e4ed-4e15-8041-8965a499ff75 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:58.024942 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6ca2d9b0-e4ed-4e15-8041-8965a499ff75 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 0.511126 Jul 31 01:23:58.025786 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1634/3313] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:57 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:58.049252 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-0679d273-f28f-4cb9-be36-49711271dc99 req-bd3cf8e3-90f2-4067-b3a9-455f37c199fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b03ee7-a722-4b4c-a4f0-af7da2265318", "tag": "2863df11-0199-454e-97de-0d7aefc5ae04"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:58.084851 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0679d273-f28f-4cb9-be36-49711271dc99 req-bd3cf8e3-90f2-4067-b3a9-455f37c199fc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:58.085219 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0679d273-f28f-4cb9-be36-49711271dc99 req-bd3cf8e3-90f2-4067-b3a9-455f37c199fc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:58.108799 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-0679d273-f28f-4cb9-be36-49711271dc99 req-bd3cf8e3-90f2-4067-b3a9-455f37c199fc service nova] Creating event network-changed:2863df11-0199-454e-97de-0d7aefc5ae04 for instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 on n-h1-master-1 Jul 31 01:23:58.114312 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-0679d273-f28f-4cb9-be36-49711271dc99 req-bd3cf8e3-90f2-4067-b3a9-455f37c199fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069638 Jul 31 01:23:58.115682 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1635/3314] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:23:58.125118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-49008d48-d716-450a-b4c0-0ca6646c40ba tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:58.126187 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-49008d48-d716-450a-b4c0-0ca6646c40ba tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:58.134344 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49008d48-d716-450a-b4c0-0ca6646c40ba tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:58.135128 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49008d48-d716-450a-b4c0-0ca6646c40ba tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:58.136307 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49008d48-d716-450a-b4c0-0ca6646c40ba tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:58.137940 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49008d48-d716-450a-b4c0-0ca6646c40ba tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:58.303617 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fa50d600-b072-4dca-99db-f155e54cc811 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:58.319680 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fa50d600-b072-4dca-99db-f155e54cc811 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318" status: 200 len: 1323 microversion: 2.1 time: 0.496606 Jul 31 01:23:58.331748 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1680/3315] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:57 2022] GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318 => generated 1323 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:58.339443 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-46a9417e-bac0-4203-b076-b10d27322836 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:58.345267 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-46a9417e-bac0-4203-b076-b10d27322836 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:58.353442 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46a9417e-bac0-4203-b076-b10d27322836 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:58.354189 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46a9417e-bac0-4203-b076-b10d27322836 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:58.355186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46a9417e-bac0-4203-b076-b10d27322836 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:58.355869 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-46a9417e-bac0-4203-b076-b10d27322836 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:58.717031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-49008d48-d716-450a-b4c0-0ca6646c40ba tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:58.726267 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-49008d48-d716-450a-b4c0-0ca6646c40ba tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:58.727834 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-49008d48-d716-450a-b4c0-0ca6646c40ba tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:58.729056 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-49008d48-d716-450a-b4c0-0ca6646c40ba tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 200 len: 1558 microversion: 2.21 time: 0.612007 Jul 31 01:23:58.745110 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1636/3316] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:23:58 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 1558 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:23:58.764485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6e908692-bfa9-4cb5-b757-5d5e21d6c9a3 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:58.768683 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6e908692-bfa9-4cb5-b757-5d5e21d6c9a3 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:58.777646 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-46a9417e-bac0-4203-b076-b10d27322836 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:58.793690 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-46a9417e-bac0-4203-b076-b10d27322836 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.463971 Jul 31 01:23:58.800323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e908692-bfa9-4cb5-b757-5d5e21d6c9a3 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:58.800782 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e908692-bfa9-4cb5-b757-5d5e21d6c9a3 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:58.801630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e908692-bfa9-4cb5-b757-5d5e21d6c9a3 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:58.802131 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e908692-bfa9-4cb5-b757-5d5e21d6c9a3 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:58.807830 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1681/3317] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:58 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:58.829206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b3a693d0-91e1-4dc6-abbc-03fef9612a40 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:58.830657 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b3a693d0-91e1-4dc6-abbc-03fef9612a40 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:58.838486 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3a693d0-91e1-4dc6-abbc-03fef9612a40 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:58.838969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3a693d0-91e1-4dc6-abbc-03fef9612a40 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:58.844725 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3a693d0-91e1-4dc6-abbc-03fef9612a40 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:58.845179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3a693d0-91e1-4dc6-abbc-03fef9612a40 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:59.101138 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6e908692-bfa9-4cb5-b757-5d5e21d6c9a3 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134662798544bffbb92ba1f4e890b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66667f28da48db95c5fa73292a2537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:59.113503 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6e908692-bfa9-4cb5-b757-5d5e21d6c9a3 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1" status: 200 len: 1352 microversion: 2.1 time: 0.366971 Jul 31 01:23:59.129236 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1637/3318] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:58 2022] GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 => generated 1352 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:59.140045 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-385e0cac-84f8-4f8c-b855-db988ece9c1a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:59.141173 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-385e0cac-84f8-4f8c-b855-db988ece9c1a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:59.148495 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-385e0cac-84f8-4f8c-b855-db988ece9c1a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:59.149973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-385e0cac-84f8-4f8c-b855-db988ece9c1a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:59.151059 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-385e0cac-84f8-4f8c-b855-db988ece9c1a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:59.151809 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-385e0cac-84f8-4f8c-b855-db988ece9c1a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:59.190807 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b3a693d0-91e1-4dc6-abbc-03fef9612a40 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:59.199237 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b3a693d0-91e1-4dc6-abbc-03fef9612a40 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.373792 Jul 31 01:23:59.200178 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1682/3319] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:58 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:23:59.205227 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4270ebb2-2cc9-4024-aefb-776af1fe0483 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:59.205838 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4270ebb2-2cc9-4024-aefb-776af1fe0483 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:59.212786 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4270ebb2-2cc9-4024-aefb-776af1fe0483 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:59.214318 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4270ebb2-2cc9-4024-aefb-776af1fe0483 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:59.215889 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4270ebb2-2cc9-4024-aefb-776af1fe0483 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:59.216342 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4270ebb2-2cc9-4024-aefb-776af1fe0483 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:59.382998 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-385e0cac-84f8-4f8c-b855-db988ece9c1a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:59.406998 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-385e0cac-84f8-4f8c-b855-db988ece9c1a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.274536 Jul 31 01:23:59.409977 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1638/3320] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:59 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:59.415301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c54fdc72-2e13-4852-86b5-54eba8e4c6d2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:59.416165 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c54fdc72-2e13-4852-86b5-54eba8e4c6d2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:59.418479 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:59.419926 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4270ebb2-2cc9-4024-aefb-776af1fe0483 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:59.426542 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c54fdc72-2e13-4852-86b5-54eba8e4c6d2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:59.427223 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c54fdc72-2e13-4852-86b5-54eba8e4c6d2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:59.428257 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c54fdc72-2e13-4852-86b5-54eba8e4c6d2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:59.428698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c54fdc72-2e13-4852-86b5-54eba8e4c6d2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:59.432804 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4270ebb2-2cc9-4024-aefb-776af1fe0483 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 0.230626 Jul 31 01:23:59.433596 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1683/3321] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:59 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:59.456108 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-91191568-6a85-4fd6-a65a-6bbf3b3a0bc2 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:59.462836 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-91191568-6a85-4fd6-a65a-6bbf3b3a0bc2 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:59.480839 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-91191568-6a85-4fd6-a65a-6bbf3b3a0bc2 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:59.481308 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-91191568-6a85-4fd6-a65a-6bbf3b3a0bc2 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:59.482918 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-91191568-6a85-4fd6-a65a-6bbf3b3a0bc2 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:59.483857 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-91191568-6a85-4fd6-a65a-6bbf3b3a0bc2 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:59.521232 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c54fdc72-2e13-4852-86b5-54eba8e4c6d2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Unlocking {{(pid=119474) unlock /opt/stack/nova/nova/compute/api.py:4810}} Jul 31 01:23:59.615392 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c54fdc72-2e13-4852-86b5-54eba8e4c6d2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 202 len: 0 microversion: 2.1 time: 0.203913 Jul 31 01:23:59.622982 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1639/3322] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:23:59 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:23:59.627527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-98f17083-8a72-4292-8fb2-3747483fcdcf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:59.628289 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-98f17083-8a72-4292-8fb2-3747483fcdcf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:59.635940 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98f17083-8a72-4292-8fb2-3747483fcdcf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:59.636402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98f17083-8a72-4292-8fb2-3747483fcdcf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:59.638156 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98f17083-8a72-4292-8fb2-3747483fcdcf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:59.638398 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98f17083-8a72-4292-8fb2-3747483fcdcf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:59.672286 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:59.704797 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-91191568-6a85-4fd6-a65a-6bbf3b3a0bc2 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:59.714814 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-91191568-6a85-4fd6-a65a-6bbf3b3a0bc2 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318" status: 200 len: 1323 microversion: 2.1 time: 0.279747 Jul 31 01:23:59.715942 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1684/3323] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:59 2022] GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318 => generated 1323 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:59.754006 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-5938ff1e-cc4e-4743-9324-2dc3f9fae1e7 req-dbd448b2-1b8e-4341-aeb4-04e9f5e1938d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1", "tag": "807c4baf-3ac4-4e79-9bd8-75e2c62bfec9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:23:59.787098 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5938ff1e-cc4e-4743-9324-2dc3f9fae1e7 req-dbd448b2-1b8e-4341-aeb4-04e9f5e1938d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:59.788058 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5938ff1e-cc4e-4743-9324-2dc3f9fae1e7 req-dbd448b2-1b8e-4341-aeb4-04e9f5e1938d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:59.812918 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-5938ff1e-cc4e-4743-9324-2dc3f9fae1e7 req-dbd448b2-1b8e-4341-aeb4-04e9f5e1938d service nova] Creating event network-changed:807c4baf-3ac4-4e79-9bd8-75e2c62bfec9 for instance 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 on n-h2-master-1 Jul 31 01:23:59.821744 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-5938ff1e-cc4e-4743-9324-2dc3f9fae1e7 req-dbd448b2-1b8e-4341-aeb4-04e9f5e1938d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076792 Jul 31 01:23:59.823832 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1685/3324] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:23:59.833509 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bce09aad-9a7b-4ac6-8239-0c2669a93d07 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:59.840003 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bce09aad-9a7b-4ac6-8239-0c2669a93d07 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:59.869700 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bce09aad-9a7b-4ac6-8239-0c2669a93d07 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:59.870500 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bce09aad-9a7b-4ac6-8239-0c2669a93d07 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:59.874995 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bce09aad-9a7b-4ac6-8239-0c2669a93d07 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:59.875558 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bce09aad-9a7b-4ac6-8239-0c2669a93d07 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:59.928229 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-98f17083-8a72-4292-8fb2-3747483fcdcf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:23:59.944449 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-98f17083-8a72-4292-8fb2-3747483fcdcf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.318089 Jul 31 01:23:59.945204 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1640/3325] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:59 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:23:59.970158 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-72a1740e-d008-4902-8c05-a0fa5ecfc9f1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:23:59.970942 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-72a1740e-d008-4902-8c05-a0fa5ecfc9f1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:23:59.984974 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72a1740e-d008-4902-8c05-a0fa5ecfc9f1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:59.986624 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72a1740e-d008-4902-8c05-a0fa5ecfc9f1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:23:59.990278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72a1740e-d008-4902-8c05-a0fa5ecfc9f1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:23:59.992367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72a1740e-d008-4902-8c05-a0fa5ecfc9f1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:00.078700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bce09aad-9a7b-4ac6-8239-0c2669a93d07 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:00.098691 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bce09aad-9a7b-4ac6-8239-0c2669a93d07 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:00.100445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bce09aad-9a7b-4ac6-8239-0c2669a93d07 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfe557fe9f8240b2962f4c3cf66ddb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819969e4931a47988c057e1cda311f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:00.101658 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bce09aad-9a7b-4ac6-8239-0c2669a93d07 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 200 len: 1344 microversion: 2.21 time: 0.275019 Jul 31 01:24:00.117482 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1686/3326] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:23:59 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 1344 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:24:00.143871 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-35d2151b-ecc0-47f4-9b8d-c8a1034e89a1 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:00.145156 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-35d2151b-ecc0-47f4-9b8d-c8a1034e89a1 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:00.153589 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35d2151b-ecc0-47f4-9b8d-c8a1034e89a1 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:00.153801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35d2151b-ecc0-47f4-9b8d-c8a1034e89a1 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:00.154606 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35d2151b-ecc0-47f4-9b8d-c8a1034e89a1 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:00.155230 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35d2151b-ecc0-47f4-9b8d-c8a1034e89a1 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:00.161224 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:00.488798 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-72a1740e-d008-4902-8c05-a0fa5ecfc9f1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:00.524247 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-72a1740e-d008-4902-8c05-a0fa5ecfc9f1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.559045 Jul 31 01:24:00.525521 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1641/3327] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:23:59 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:00.532111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0131328a-5604-49b6-a157-b67028e06e14 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:00.533164 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0131328a-5604-49b6-a157-b67028e06e14 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:00.553335 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0131328a-5604-49b6-a157-b67028e06e14 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:00.554100 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0131328a-5604-49b6-a157-b67028e06e14 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:00.555093 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0131328a-5604-49b6-a157-b67028e06e14 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:00.555777 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0131328a-5604-49b6-a157-b67028e06e14 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:00.592091 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-35d2151b-ecc0-47f4-9b8d-c8a1034e89a1 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134662798544bffbb92ba1f4e890b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66667f28da48db95c5fa73292a2537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:00.609385 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-35d2151b-ecc0-47f4-9b8d-c8a1034e89a1 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1" status: 200 len: 1352 microversion: 2.1 time: 0.471524 Jul 31 01:24:00.613313 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1687/3328] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:00 2022] GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 => generated 1352 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:00.625937 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-64636bb8-2103-442a-9cd9-898572a86899 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:00.628793 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-64636bb8-2103-442a-9cd9-898572a86899 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:00.660352 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64636bb8-2103-442a-9cd9-898572a86899 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:00.665204 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64636bb8-2103-442a-9cd9-898572a86899 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:00.671255 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64636bb8-2103-442a-9cd9-898572a86899 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:00.673193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64636bb8-2103-442a-9cd9-898572a86899 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:01.161994 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0131328a-5604-49b6-a157-b67028e06e14 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:01.176313 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0131328a-5604-49b6-a157-b67028e06e14 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.649127 Jul 31 01:24:01.177735 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1642/3329] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:00 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:01.185979 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-91776097-4ece-4196-a114-b64eed41affb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:01.186961 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-91776097-4ece-4196-a114-b64eed41affb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:01.196439 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91776097-4ece-4196-a114-b64eed41affb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:01.197323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91776097-4ece-4196-a114-b64eed41affb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:01.198388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91776097-4ece-4196-a114-b64eed41affb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:01.199886 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91776097-4ece-4196-a114-b64eed41affb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:01.222641 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-64636bb8-2103-442a-9cd9-898572a86899 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:01.236587 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-64636bb8-2103-442a-9cd9-898572a86899 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 0.620948 Jul 31 01:24:01.239746 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1688/3330] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:00 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:01.250779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1ad9e875-6910-4a7c-b078-c128db5a5fa3 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:01.252262 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1ad9e875-6910-4a7c-b078-c128db5a5fa3 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:01.273516 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:01.281089 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1ad9e875-6910-4a7c-b078-c128db5a5fa3 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:01.282232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1ad9e875-6910-4a7c-b078-c128db5a5fa3 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:01.282957 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1ad9e875-6910-4a7c-b078-c128db5a5fa3 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:01.283874 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1ad9e875-6910-4a7c-b078-c128db5a5fa3 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:01.648416 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-91776097-4ece-4196-a114-b64eed41affb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:01.681542 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-91776097-4ece-4196-a114-b64eed41affb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.502365 Jul 31 01:24:01.705611 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1643/3331] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:01 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:01.718181 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-664e1160-bc11-48bc-aa20-5feffda4d268 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:01.719303 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-664e1160-bc11-48bc-aa20-5feffda4d268 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:01.722214 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1ad9e875-6910-4a7c-b078-c128db5a5fa3 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:01.727632 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-664e1160-bc11-48bc-aa20-5feffda4d268 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:01.728439 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-664e1160-bc11-48bc-aa20-5feffda4d268 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:01.729714 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-664e1160-bc11-48bc-aa20-5feffda4d268 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:01.730488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-664e1160-bc11-48bc-aa20-5feffda4d268 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:01.741866 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1ad9e875-6910-4a7c-b078-c128db5a5fa3 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318" status: 200 len: 1323 microversion: 2.1 time: 0.500589 Jul 31 01:24:01.742489 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1689/3332] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:01 2022] GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318 => generated 1323 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:01.751564 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-664e1160-bc11-48bc-aa20-5feffda4d268 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] HTTP exception thrown: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. Jul 31 01:24:01.753798 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6277630a-0307-40a8-bc5a-2012e06131b7 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-664e1160-bc11-48bc-aa20-5feffda4d268 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Request method failure captured: Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc HTTP/1.1 Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dmUuw3VDQUZ0feAibqbyc1DuIpGxeuWFLp66EweT52aNsKbv4gPfO9FAMxtdFtjS71IjDgDnqJ5LApbK75-E0z4n_Y1Q1S2PVqGePD5Ray9gcdtXFbcVQSB1uGyzQXXvnxduMB36Q5AIK4JGKJYPuUZM4xvmQIsEZV4eEI4yLx270I Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-Openstack-Nova-Api-Version: 2.21 Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 819969e4931a47988c057e1cda311f94 Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-InstanceActionsV221TestJSON-661662051 Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/819969e4931a47988c057e1cda311f94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/819969e4931a47988c057e1cda311f94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/819969e4931a47988c057e1cda311f94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_819969e4931a47988c057e1cda311f94", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-InstanceActionsV221TestJSON-661662051 Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 819969e4931a47988c057e1cda311f94 Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-661662051 Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-InstanceActionsV221TestJSON-661662051-project Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: cfe557fe9f8240b2962f4c3cf66ddb03 Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-InstanceActionsV221TestJSON-661662051-project Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc'} Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:01.754377 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:01.759162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:01.759162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:01.759162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:01.759162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:01.759162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:01.759162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:01.759162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. Jul 31 01:24:01.759162 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:01.759749 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6277630a-0307-40a8-bc5a-2012e06131b7 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:01.761079 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6277630a-0307-40a8-bc5a-2012e06131b7 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:01.762195 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6277630a-0307-40a8-bc5a-2012e06131b7 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:01.762419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-664e1160-bc11-48bc-aa20-5feffda4d268 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Returning 404 to user: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:01.763002 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6277630a-0307-40a8-bc5a-2012e06131b7 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:01.763252 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-664e1160-bc11-48bc-aa20-5feffda4d268 tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 404 len: 111 microversion: 2.21 time: 0.055795 Jul 31 01:24:01.763865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6277630a-0307-40a8-bc5a-2012e06131b7 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:01.767674 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1644/3333] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:24:01 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:24:01.773436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-163d183b-e5ad-4b0a-b03a-d6dae6b8b1ce tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:01.774190 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-163d183b-e5ad-4b0a-b03a-d6dae6b8b1ce tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:01.781539 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-163d183b-e5ad-4b0a-b03a-d6dae6b8b1ce tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:01.781999 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-163d183b-e5ad-4b0a-b03a-d6dae6b8b1ce tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:01.782804 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-163d183b-e5ad-4b0a-b03a-d6dae6b8b1ce tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:01.783246 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-163d183b-e5ad-4b0a-b03a-d6dae6b8b1ce tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:01.887510 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-163d183b-e5ad-4b0a-b03a-d6dae6b8b1ce tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 202 len: 0 microversion: 2.1 time: 0.115046 Jul 31 01:24:01.891872 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1645/3334] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:24:01 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:24:01.900714 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-343e0027-060e-4759-aa11-fe6bd9691fcc tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '.version_select at 0x7fede55d8160>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:01.901389 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-343e0027-060e-4759-aa11-fe6bd9691fcc tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:01.920674 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-343e0027-060e-4759-aa11-fe6bd9691fcc tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:01.921163 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-343e0027-060e-4759-aa11-fe6bd9691fcc tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:01.922058 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-343e0027-060e-4759-aa11-fe6bd9691fcc tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:01.922475 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-343e0027-060e-4759-aa11-fe6bd9691fcc tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:02.029117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6277630a-0307-40a8-bc5a-2012e06131b7 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134662798544bffbb92ba1f4e890b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66667f28da48db95c5fa73292a2537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:02.037692 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-343e0027-060e-4759-aa11-fe6bd9691fcc tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.138357 Jul 31 01:24:02.039276 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1646/3335] 10.222.0.45 () {60 vars in 1337 bytes} [Sun Jul 31 01:24:01 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc/os-instance-actions => generated 611 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:24:02.042484 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6277630a-0307-40a8-bc5a-2012e06131b7 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1" status: 200 len: 1352 microversion: 2.1 time: 0.293801 Jul 31 01:24:02.055369 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1690/3336] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:01 2022] GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 => generated 1352 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:02.055369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8e62a4d4-c476-456c-8b46-ede63090800b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:02.055369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8e62a4d4-c476-456c-8b46-ede63090800b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:02.060984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-142b124b-c5a9-44b5-ad89-a48b6921e3f1 req-35ef767d-81de-4c2b-8531-bf801bd320c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc", "name": "network-vif-deleted", "tag": "c984b49e-330a-4948-9217-e662ab215f37"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:02.072942 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e62a4d4-c476-456c-8b46-ede63090800b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:02.073403 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e62a4d4-c476-456c-8b46-ede63090800b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:02.074778 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e62a4d4-c476-456c-8b46-ede63090800b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:02.075228 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e62a4d4-c476-456c-8b46-ede63090800b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:02.082879 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-142b124b-c5a9-44b5-ad89-a48b6921e3f1 req-35ef767d-81de-4c2b-8531-bf801bd320c2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:02.083954 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-142b124b-c5a9-44b5-ad89-a48b6921e3f1 req-35ef767d-81de-4c2b-8531-bf801bd320c2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:02.141257 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-142b124b-c5a9-44b5-ad89-a48b6921e3f1 req-35ef767d-81de-4c2b-8531-bf801bd320c2 service nova] Creating event network-vif-deleted:c984b49e-330a-4948-9217-e662ab215f37 for instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc on n-h2-master-1 Jul 31 01:24:02.154999 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-142b124b-c5a9-44b5-ad89-a48b6921e3f1 req-35ef767d-81de-4c2b-8531-bf801bd320c2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113604 Jul 31 01:24:02.156382 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1647/3337] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:02.163987 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-66a3e184-9cf9-4dd5-b3ee-7dd04aa8c0ab tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:02.165089 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-66a3e184-9cf9-4dd5-b3ee-7dd04aa8c0ab tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:02.174385 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66a3e184-9cf9-4dd5-b3ee-7dd04aa8c0ab tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:02.175748 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66a3e184-9cf9-4dd5-b3ee-7dd04aa8c0ab tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:02.176937 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66a3e184-9cf9-4dd5-b3ee-7dd04aa8c0ab tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:02.177623 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66a3e184-9cf9-4dd5-b3ee-7dd04aa8c0ab tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:02.203926 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-66a3e184-9cf9-4dd5-b3ee-7dd04aa8c0ab tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] HTTP exception thrown: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-66a3e184-9cf9-4dd5-b3ee-7dd04aa8c0ab tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Request method failure captured: Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc HTTP/1.1 Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dmUuw3VDQUZ0feAibqbyc1DuIpGxeuWFLp66EweT52aNsKbv4gPfO9FAMxtdFtjS71IjDgDnqJ5LApbK75-E0z4n_Y1Q1S2PVqGePD5Ray9gcdtXFbcVQSB1uGyzQXXvnxduMB36Q5AIK4JGKJYPuUZM4xvmQIsEZV4eEI4yLx270I Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-Openstack-Nova-Api-Version: 2.21 Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 819969e4931a47988c057e1cda311f94 Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-InstanceActionsV221TestJSON-661662051 Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/819969e4931a47988c057e1cda311f94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/819969e4931a47988c057e1cda311f94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/819969e4931a47988c057e1cda311f94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_819969e4931a47988c057e1cda311f94", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-InstanceActionsV221TestJSON-661662051 Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 819969e4931a47988c057e1cda311f94 Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-661662051 Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-InstanceActionsV221TestJSON-661662051-project Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: cfe557fe9f8240b2962f4c3cf66ddb03 Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-InstanceActionsV221TestJSON-661662051-project Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc'} Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:24:02.205802 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:24:02.213285 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. Jul 31 01:24:02.213285 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:02.213285 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:02.213285 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:02.213285 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:02.213285 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:02.213285 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:02.213285 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:02.213285 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:02.213285 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. Jul 31 01:24:02.213285 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:02.213285 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-66a3e184-9cf9-4dd5-b3ee-7dd04aa8c0ab tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Returning 404 to user: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:02.213285 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-66a3e184-9cf9-4dd5-b3ee-7dd04aa8c0ab tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 404 len: 111 microversion: 2.21 time: 0.049043 Jul 31 01:24:02.223325 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1648/3338] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:24:02 2022] DELETE /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:24:02.256870 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-904d482f-28b7-47a5-9b56-bee1d5e9f522 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:02.257593 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-904d482f-28b7-47a5-9b56-bee1d5e9f522 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:02.274847 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-904d482f-28b7-47a5-9b56-bee1d5e9f522 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:02.275302 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-904d482f-28b7-47a5-9b56-bee1d5e9f522 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:02.277400 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-904d482f-28b7-47a5-9b56-bee1d5e9f522 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:02.277848 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-904d482f-28b7-47a5-9b56-bee1d5e9f522 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:02.488170 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8e62a4d4-c476-456c-8b46-ede63090800b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:02.518247 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8e62a4d4-c476-456c-8b46-ede63090800b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1675 microversion: 2.1 time: 0.473595 Jul 31 01:24:02.519604 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1691/3339] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:02 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1675 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:02.524648 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e9358c0e-d1d0-4501-9a4b-37547022024b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:02.525616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e9358c0e-d1d0-4501-9a4b-37547022024b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] [instance: 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:02.539917 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9358c0e-d1d0-4501-9a4b-37547022024b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:02.543774 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9358c0e-d1d0-4501-9a4b-37547022024b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:02.544919 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9358c0e-d1d0-4501-9a4b-37547022024b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:02.547198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9358c0e-d1d0-4501-9a4b-37547022024b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:02.567044 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-904d482f-28b7-47a5-9b56-bee1d5e9f522 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:02.577491 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-904d482f-28b7-47a5-9b56-bee1d5e9f522 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.351783 Jul 31 01:24:02.590772 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1649/3340] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:02 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:02.592678 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4709f998-e5be-4a98-adbd-94062958fe5c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:02.592828 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-e9358c0e-d1d0-4501-9a4b-37547022024b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] HTTP exception thrown: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. Jul 31 01:24:02.593348 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4709f998-e5be-4a98-adbd-94062958fe5c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e9358c0e-d1d0-4501-9a4b-37547022024b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Request method failure captured: Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc HTTP/1.1 Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dmUuw3VDQUZ0feAibqbyc1DuIpGxeuWFLp66EweT52aNsKbv4gPfO9FAMxtdFtjS71IjDgDnqJ5LApbK75-E0z4n_Y1Q1S2PVqGePD5Ray9gcdtXFbcVQSB1uGyzQXXvnxduMB36Q5AIK4JGKJYPuUZM4xvmQIsEZV4eEI4yLx270I Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.21 Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 819969e4931a47988c057e1cda311f94 Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-InstanceActionsV221TestJSON-661662051 Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/819969e4931a47988c057e1cda311f94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/819969e4931a47988c057e1cda311f94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/819969e4931a47988c057e1cda311f94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_819969e4931a47988c057e1cda311f94", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-InstanceActionsV221TestJSON-661662051 Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 819969e4931a47988c057e1cda311f94 Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-661662051 Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-InstanceActionsV221TestJSON-661662051-project Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: cfe557fe9f8240b2962f4c3cf66ddb03 Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-InstanceActionsV221TestJSON-661662051-project Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc'} Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:02.594387 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:02.599405 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:02.599405 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:02.599405 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:02.599405 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:02.599405 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:02.599405 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:02.599405 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. Jul 31 01:24:02.599405 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:02.599405 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e9358c0e-d1d0-4501-9a4b-37547022024b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] Returning 404 to user: Instance 0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:02.599405 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e9358c0e-d1d0-4501-9a4b-37547022024b tempest-InstanceActionsV221TestJSON-661662051 tempest-InstanceActionsV221TestJSON-661662051-project] 10.222.0.45 "GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc" status: 404 len: 111 microversion: 2.21 time: 0.075087 Jul 31 01:24:02.599405 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1692/3341] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:24:02 2022] GET /compute/v2.1/servers/0c8d1b37-6782-4bf6-83ee-43b0dc06dfcc => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:24:02.606640 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4709f998-e5be-4a98-adbd-94062958fe5c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:02.607377 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4709f998-e5be-4a98-adbd-94062958fe5c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:02.608736 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4709f998-e5be-4a98-adbd-94062958fe5c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:02.610966 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4709f998-e5be-4a98-adbd-94062958fe5c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:02.763629 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6be3140c-31d9-4a75-a348-12f759959dae tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:02.764259 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6be3140c-31d9-4a75-a348-12f759959dae tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:02.775842 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6be3140c-31d9-4a75-a348-12f759959dae tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:02.776296 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6be3140c-31d9-4a75-a348-12f759959dae tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:02.778262 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6be3140c-31d9-4a75-a348-12f759959dae tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:02.778709 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6be3140c-31d9-4a75-a348-12f759959dae tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:02.875089 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4709f998-e5be-4a98-adbd-94062958fe5c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:02.883359 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4709f998-e5be-4a98-adbd-94062958fe5c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 0.297573 Jul 31 01:24:02.900665 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1650/3342] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:02 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:03.052281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6be3140c-31d9-4a75-a348-12f759959dae tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:03.062867 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6be3140c-31d9-4a75-a348-12f759959dae tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318" status: 200 len: 1323 microversion: 2.1 time: 0.303008 Jul 31 01:24:03.063966 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1693/3343] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:02 2022] GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318 => generated 1323 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:03.065254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c8dc57da-a521-45fd-9c7c-408ef0110165 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:03.066815 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c8dc57da-a521-45fd-9c7c-408ef0110165 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:03.081458 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c8dc57da-a521-45fd-9c7c-408ef0110165 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:03.081915 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c8dc57da-a521-45fd-9c7c-408ef0110165 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:03.082695 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c8dc57da-a521-45fd-9c7c-408ef0110165 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:03.083131 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c8dc57da-a521-45fd-9c7c-408ef0110165 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:03.295461 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c8dc57da-a521-45fd-9c7c-408ef0110165 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134662798544bffbb92ba1f4e890b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66667f28da48db95c5fa73292a2537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:03.308788 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c8dc57da-a521-45fd-9c7c-408ef0110165 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1" status: 200 len: 1352 microversion: 2.1 time: 0.247525 Jul 31 01:24:03.309926 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1651/3344] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:03 2022] GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 => generated 1352 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:03.543021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-63a13708-dc94-4fe7-8a65-31d53a10adeb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:03.544407 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-63a13708-dc94-4fe7-8a65-31d53a10adeb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:03.546716 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:03.547422 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=16 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:03.565711 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-63a13708-dc94-4fe7-8a65-31d53a10adeb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:03.566510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-63a13708-dc94-4fe7-8a65-31d53a10adeb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:03.567538 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-63a13708-dc94-4fe7-8a65-31d53a10adeb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:03.568384 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-63a13708-dc94-4fe7-8a65-31d53a10adeb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:03.598377 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c5be02ce-4464-4857-894b-1842ce5300b3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:03.599489 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c5be02ce-4464-4857-894b-1842ce5300b3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:03.613865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5be02ce-4464-4857-894b-1842ce5300b3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:03.614312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5be02ce-4464-4857-894b-1842ce5300b3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:03.615097 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5be02ce-4464-4857-894b-1842ce5300b3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:03.615628 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5be02ce-4464-4857-894b-1842ce5300b3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:03.729498 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:03.846092 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c5be02ce-4464-4857-894b-1842ce5300b3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:03.857006 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c5be02ce-4464-4857-894b-1842ce5300b3 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.262747 Jul 31 01:24:03.859770 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-63a13708-dc94-4fe7-8a65-31d53a10adeb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:03.870333 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-63a13708-dc94-4fe7-8a65-31d53a10adeb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1655 microversion: 2.1 time: 0.331348 Jul 31 01:24:03.871654 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1652/3345] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:03 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:03.872575 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1694/3346] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:03 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1655 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:03.876441 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-0bc49f8c-8cb2-4f5e-87f5-82e5fa39653e req-917005cb-179a-4856-bf5e-109f2e8e8a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b03ee7-a722-4b4c-a4f0-af7da2265318", "name": "network-vif-plugged", "status": "completed", "tag": "2863df11-0199-454e-97de-0d7aefc5ae04"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:03.892841 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0bc49f8c-8cb2-4f5e-87f5-82e5fa39653e req-917005cb-179a-4856-bf5e-109f2e8e8a28 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:03.893302 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0bc49f8c-8cb2-4f5e-87f5-82e5fa39653e req-917005cb-179a-4856-bf5e-109f2e8e8a28 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:03.894281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-301ae841-57c6-4851-a4e8-7c644c8b55b7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:03.896380 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-301ae841-57c6-4851-a4e8-7c644c8b55b7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:03.907398 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-301ae841-57c6-4851-a4e8-7c644c8b55b7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:03.908273 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-301ae841-57c6-4851-a4e8-7c644c8b55b7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:03.909319 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-301ae841-57c6-4851-a4e8-7c644c8b55b7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:03.910250 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-301ae841-57c6-4851-a4e8-7c644c8b55b7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:03.918477 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-0bc49f8c-8cb2-4f5e-87f5-82e5fa39653e req-917005cb-179a-4856-bf5e-109f2e8e8a28 service nova] Creating event network-vif-plugged:2863df11-0199-454e-97de-0d7aefc5ae04 for instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 on n-h1-master-1 Jul 31 01:24:03.924285 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-0bc49f8c-8cb2-4f5e-87f5-82e5fa39653e req-917005cb-179a-4856-bf5e-109f2e8e8a28 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051283 Jul 31 01:24:03.925260 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1653/3347] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:03.930609 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6a797ea1-8b68-4c16-b3d6-738272e514c6 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:03.931370 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6a797ea1-8b68-4c16-b3d6-738272e514c6 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:03.939543 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a797ea1-8b68-4c16-b3d6-738272e514c6 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:03.940091 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a797ea1-8b68-4c16-b3d6-738272e514c6 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:03.940870 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a797ea1-8b68-4c16-b3d6-738272e514c6 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:03.941509 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a797ea1-8b68-4c16-b3d6-738272e514c6 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:04.052067 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-301ae841-57c6-4851-a4e8-7c644c8b55b7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 202 len: 0 microversion: 2.1 time: 0.157963 Jul 31 01:24:04.053554 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1695/3348] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:24:03 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:24:04.082215 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eb6d0644-0c3a-45e3-90d1-634a01800037 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:04.084315 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eb6d0644-0c3a-45e3-90d1-634a01800037 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:04.101238 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb6d0644-0c3a-45e3-90d1-634a01800037 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:04.103111 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb6d0644-0c3a-45e3-90d1-634a01800037 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:04.104289 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb6d0644-0c3a-45e3-90d1-634a01800037 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:04.104991 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb6d0644-0c3a-45e3-90d1-634a01800037 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:04.197731 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6a797ea1-8b68-4c16-b3d6-738272e514c6 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:04.205853 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6a797ea1-8b68-4c16-b3d6-738272e514c6 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 0.279312 Jul 31 01:24:04.206483 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1654/3349] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:03 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:04.212022 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3d2c94d8-db30-4797-b7ef-b55775298e1e tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:04.213577 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3d2c94d8-db30-4797-b7ef-b55775298e1e tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:04.220535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d2c94d8-db30-4797-b7ef-b55775298e1e tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:04.221267 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d2c94d8-db30-4797-b7ef-b55775298e1e tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:04.222341 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d2c94d8-db30-4797-b7ef-b55775298e1e tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:04.222777 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d2c94d8-db30-4797-b7ef-b55775298e1e tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:04.271681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eb6d0644-0c3a-45e3-90d1-634a01800037 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:04.282562 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eb6d0644-0c3a-45e3-90d1-634a01800037 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1662 microversion: 2.1 time: 0.216220 Jul 31 01:24:04.284137 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1696/3350] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:04 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1662 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:04.331006 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-877e5f4d-7cb8-4133-a196-3f3962716284 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:04.332088 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-877e5f4d-7cb8-4133-a196-3f3962716284 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:04.345609 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-877e5f4d-7cb8-4133-a196-3f3962716284 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:04.350042 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-877e5f4d-7cb8-4133-a196-3f3962716284 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:04.352840 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-877e5f4d-7cb8-4133-a196-3f3962716284 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:04.354367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-877e5f4d-7cb8-4133-a196-3f3962716284 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:04.574513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3d2c94d8-db30-4797-b7ef-b55775298e1e tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:04.584333 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3d2c94d8-db30-4797-b7ef-b55775298e1e tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318" status: 200 len: 1323 microversion: 2.1 time: 0.376271 Jul 31 01:24:04.585362 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1655/3351] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:04 2022] GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318 => generated 1323 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:04.626427 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-877e5f4d-7cb8-4133-a196-3f3962716284 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134662798544bffbb92ba1f4e890b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66667f28da48db95c5fa73292a2537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:04.635890 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-877e5f4d-7cb8-4133-a196-3f3962716284 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1" status: 200 len: 1352 microversion: 2.1 time: 0.309635 Jul 31 01:24:04.647362 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1697/3352] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:04 2022] GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 => generated 1352 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:04.878106 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-42f17c1d-0146-47ad-a8c9-32018cee695f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:04.879301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-42f17c1d-0146-47ad-a8c9-32018cee695f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:04.888735 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42f17c1d-0146-47ad-a8c9-32018cee695f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:04.890426 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42f17c1d-0146-47ad-a8c9-32018cee695f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:04.891946 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42f17c1d-0146-47ad-a8c9-32018cee695f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:04.892669 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42f17c1d-0146-47ad-a8c9-32018cee695f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:05.122737 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-42f17c1d-0146-47ad-a8c9-32018cee695f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:05.132441 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-42f17c1d-0146-47ad-a8c9-32018cee695f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.257083 Jul 31 01:24:05.137323 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1656/3353] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:04 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:05.228424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3ac6447f-efb5-4bd2-8c5c-92b946e85def tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:05.228973 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3ac6447f-efb5-4bd2-8c5c-92b946e85def tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:05.242743 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ac6447f-efb5-4bd2-8c5c-92b946e85def tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:05.243180 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ac6447f-efb5-4bd2-8c5c-92b946e85def tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:05.248019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ac6447f-efb5-4bd2-8c5c-92b946e85def tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:05.248968 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ac6447f-efb5-4bd2-8c5c-92b946e85def tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:05.314236 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-739f8054-ba59-4bee-821a-85e75f3eaa53 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:05.315057 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-739f8054-ba59-4bee-821a-85e75f3eaa53 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:05.324887 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-739f8054-ba59-4bee-821a-85e75f3eaa53 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:05.325717 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-739f8054-ba59-4bee-821a-85e75f3eaa53 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:05.327735 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-739f8054-ba59-4bee-821a-85e75f3eaa53 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:05.328388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-739f8054-ba59-4bee-821a-85e75f3eaa53 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:05.469723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3ac6447f-efb5-4bd2-8c5c-92b946e85def tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:05.483424 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3ac6447f-efb5-4bd2-8c5c-92b946e85def tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1506 microversion: 2.1 time: 0.259013 Jul 31 01:24:05.486091 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1698/3354] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:05 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:05.539230 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-739f8054-ba59-4bee-821a-85e75f3eaa53 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:05.552839 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-739f8054-ba59-4bee-821a-85e75f3eaa53 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.243337 Jul 31 01:24:05.553947 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1657/3355] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:05 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:05.580362 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7b4aecba-9cf3-4bca-a19e-74f1748b4d3b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:05.588401 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7b4aecba-9cf3-4bca-a19e-74f1748b4d3b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:05.603652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b4aecba-9cf3-4bca-a19e-74f1748b4d3b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:05.604289 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b4aecba-9cf3-4bca-a19e-74f1748b4d3b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:05.606343 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-de73a854-f13b-4a6d-9481-03a3022cff41 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:05.606520 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b4aecba-9cf3-4bca-a19e-74f1748b4d3b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:05.607003 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b4aecba-9cf3-4bca-a19e-74f1748b4d3b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:05.607248 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-de73a854-f13b-4a6d-9481-03a3022cff41 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:05.615522 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-de73a854-f13b-4a6d-9481-03a3022cff41 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:05.615874 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-de73a854-f13b-4a6d-9481-03a3022cff41 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:05.616664 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-de73a854-f13b-4a6d-9481-03a3022cff41 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:05.620028 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-de73a854-f13b-4a6d-9481-03a3022cff41 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:06.015130 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7b4aecba-9cf3-4bca-a19e-74f1748b4d3b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:06.022208 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-de73a854-f13b-4a6d-9481-03a3022cff41 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:06.023276 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7b4aecba-9cf3-4bca-a19e-74f1748b4d3b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.447520 Jul 31 01:24:06.034984 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1699/3356] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:05 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:06.043495 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:06.043495 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-de73a854-f13b-4a6d-9481-03a3022cff41 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318" status: 200 len: 1323 microversion: 2.1 time: 0.439029 Jul 31 01:24:06.049604 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e180d894-e23e-4ea1-96a4-7dde67c65be4 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:06.050276 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e180d894-e23e-4ea1-96a4-7dde67c65be4 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:06.055497 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1658/3357] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:05 2022] GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318 => generated 1323 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:06.063725 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e180d894-e23e-4ea1-96a4-7dde67c65be4 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:06.065992 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e180d894-e23e-4ea1-96a4-7dde67c65be4 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:06.067136 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e180d894-e23e-4ea1-96a4-7dde67c65be4 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:06.068192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e180d894-e23e-4ea1-96a4-7dde67c65be4 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:06.076369 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-246e38e3-a75b-4f1d-ac09-099e2727eaa7 req-04f84aca-69f1-4ad6-a9b1-c7007d1b6161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1", "name": "network-vif-plugged", "status": "completed", "tag": "807c4baf-3ac4-4e79-9bd8-75e2c62bfec9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:06.089771 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-246e38e3-a75b-4f1d-ac09-099e2727eaa7 req-04f84aca-69f1-4ad6-a9b1-c7007d1b6161 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:06.090231 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-246e38e3-a75b-4f1d-ac09-099e2727eaa7 req-04f84aca-69f1-4ad6-a9b1-c7007d1b6161 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:06.110491 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-246e38e3-a75b-4f1d-ac09-099e2727eaa7 req-04f84aca-69f1-4ad6-a9b1-c7007d1b6161 service nova] Creating event network-vif-plugged:807c4baf-3ac4-4e79-9bd8-75e2c62bfec9 for instance 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 on n-h2-master-1 Jul 31 01:24:06.117802 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-246e38e3-a75b-4f1d-ac09-099e2727eaa7 req-04f84aca-69f1-4ad6-a9b1-c7007d1b6161 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060922 Jul 31 01:24:06.119094 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1659/3358] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:06.127851 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0767231d-bc6f-44a2-8fc0-a23d9e199a05 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:06.129740 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0767231d-bc6f-44a2-8fc0-a23d9e199a05 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:06.140248 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0767231d-bc6f-44a2-8fc0-a23d9e199a05 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:06.141010 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0767231d-bc6f-44a2-8fc0-a23d9e199a05 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:06.142673 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0767231d-bc6f-44a2-8fc0-a23d9e199a05 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:06.143389 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0767231d-bc6f-44a2-8fc0-a23d9e199a05 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:06.345347 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e180d894-e23e-4ea1-96a4-7dde67c65be4 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134662798544bffbb92ba1f4e890b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66667f28da48db95c5fa73292a2537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:06.354763 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e180d894-e23e-4ea1-96a4-7dde67c65be4 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1" status: 200 len: 1352 microversion: 2.1 time: 0.318002 Jul 31 01:24:06.355786 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1700/3359] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:06 2022] GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 => generated 1352 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:06.361993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ab707495-e648-4e25-89db-bf3f447b2060 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:06.362700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ab707495-e648-4e25-89db-bf3f447b2060 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:06.383374 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab707495-e648-4e25-89db-bf3f447b2060 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:06.385216 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab707495-e648-4e25-89db-bf3f447b2060 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:06.386391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab707495-e648-4e25-89db-bf3f447b2060 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:06.389520 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab707495-e648-4e25-89db-bf3f447b2060 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:06.420979 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0767231d-bc6f-44a2-8fc0-a23d9e199a05 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:06.436388 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0767231d-bc6f-44a2-8fc0-a23d9e199a05 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.311215 Jul 31 01:24:06.455924 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1660/3360] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:06 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:06.467351 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-356db6ee-a8cc-408b-9214-270233e8ba81 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:06.467983 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-356db6ee-a8cc-408b-9214-270233e8ba81 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:06.475398 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-356db6ee-a8cc-408b-9214-270233e8ba81 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:06.475860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-356db6ee-a8cc-408b-9214-270233e8ba81 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:06.476666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-356db6ee-a8cc-408b-9214-270233e8ba81 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:06.477108 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-356db6ee-a8cc-408b-9214-270233e8ba81 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:06.741501 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-356db6ee-a8cc-408b-9214-270233e8ba81 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:06.751931 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-356db6ee-a8cc-408b-9214-270233e8ba81 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.287635 Jul 31 01:24:06.767563 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1661/3361] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:06 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:06.773356 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-829e3a9e-5977-4e88-bdd9-9c077e553e42 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:06.773994 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-829e3a9e-5977-4e88-bdd9-9c077e553e42 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:06.780967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-829e3a9e-5977-4e88-bdd9-9c077e553e42 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:06.781422 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-829e3a9e-5977-4e88-bdd9-9c077e553e42 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:06.782215 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-829e3a9e-5977-4e88-bdd9-9c077e553e42 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:06.782661 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-829e3a9e-5977-4e88-bdd9-9c077e553e42 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:06.877442 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ab707495-e648-4e25-89db-bf3f447b2060 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:06.894966 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ab707495-e648-4e25-89db-bf3f447b2060 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.537936 Jul 31 01:24:06.909973 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1701/3362] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:06 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:06.915293 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-04e58e88-fdd5-4709-b9f9-2619e7a6ec9c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:06.916186 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-04e58e88-fdd5-4709-b9f9-2619e7a6ec9c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:06.923975 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04e58e88-fdd5-4709-b9f9-2619e7a6ec9c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:06.924757 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04e58e88-fdd5-4709-b9f9-2619e7a6ec9c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:06.925750 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04e58e88-fdd5-4709-b9f9-2619e7a6ec9c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:06.926369 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04e58e88-fdd5-4709-b9f9-2619e7a6ec9c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:07.690187 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-829e3a9e-5977-4e88-bdd9-9c077e553e42 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:07.705266 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-829e3a9e-5977-4e88-bdd9-9c077e553e42 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1486 microversion: 2.1 time: 0.935667 Jul 31 01:24:07.722952 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1662/3363] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:06 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1486 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:07.738860 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d8c7f414-593b-420d-bb96-d33fb68f870d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:07.739875 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d8c7f414-593b-420d-bb96-d33fb68f870d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:07.749647 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8c7f414-593b-420d-bb96-d33fb68f870d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:07.751466 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8c7f414-593b-420d-bb96-d33fb68f870d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:07.752558 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8c7f414-593b-420d-bb96-d33fb68f870d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:07.753947 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8c7f414-593b-420d-bb96-d33fb68f870d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:07.981613 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-04e58e88-fdd5-4709-b9f9-2619e7a6ec9c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:07.995604 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-04e58e88-fdd5-4709-b9f9-2619e7a6ec9c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 1.083492 Jul 31 01:24:07.998122 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1702/3364] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:06 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:08.006321 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-36f3fdd0-a901-434e-95d1-3fca7eb79ffc tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:08.007218 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-36f3fdd0-a901-434e-95d1-3fca7eb79ffc tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:08.015372 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36f3fdd0-a901-434e-95d1-3fca7eb79ffc tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:08.015746 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36f3fdd0-a901-434e-95d1-3fca7eb79ffc tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:08.016750 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36f3fdd0-a901-434e-95d1-3fca7eb79ffc tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:08.017205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36f3fdd0-a901-434e-95d1-3fca7eb79ffc tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:08.036454 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:08.161921 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d8c7f414-593b-420d-bb96-d33fb68f870d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:08.169642 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d8c7f414-593b-420d-bb96-d33fb68f870d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318" status: 200 len: 1518 microversion: 2.1 time: 0.445161 Jul 31 01:24:08.171005 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1663/3365] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:07 2022] GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318 => generated 1518 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:08.176288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4d1440f5-d726-4a71-82a0-56dfb4204d22 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-503200755", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:08.237315 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-4d1440f5-d726-4a71-82a0-56dfb4204d22 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] validate_networks() for [('4d404412-2eb0-46dc-81fa-b0022c4749f4', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:24:08.371946 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-36f3fdd0-a901-434e-95d1-3fca7eb79ffc tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134662798544bffbb92ba1f4e890b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66667f28da48db95c5fa73292a2537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:08.382296 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-36f3fdd0-a901-434e-95d1-3fca7eb79ffc tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1" status: 200 len: 1541 microversion: 2.1 time: 0.382082 Jul 31 01:24:08.384266 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1703/3366] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:07 2022] GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 => generated 1541 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:08.390999 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5e12b2dd-f919-49d4-8f7e-cbe49224b8fc tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:08.391749 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5e12b2dd-f919-49d4-8f7e-cbe49224b8fc tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:08.401054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e12b2dd-f919-49d4-8f7e-cbe49224b8fc tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:08.401851 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e12b2dd-f919-49d4-8f7e-cbe49224b8fc tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:08.402871 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e12b2dd-f919-49d4-8f7e-cbe49224b8fc tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:08.403575 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e12b2dd-f919-49d4-8f7e-cbe49224b8fc tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:08.737844 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5e12b2dd-f919-49d4-8f7e-cbe49224b8fc tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:08.766692 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5e12b2dd-f919-49d4-8f7e-cbe49224b8fc tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.378729 Jul 31 01:24:08.771773 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1704/3367] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:08 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:08.786222 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-92b2e89f-8bf2-40ff-bb9f-117d48ff2786 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:08.789403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-92b2e89f-8bf2-40ff-bb9f-117d48ff2786 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:08.806060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92b2e89f-8bf2-40ff-bb9f-117d48ff2786 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:08.807871 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92b2e89f-8bf2-40ff-bb9f-117d48ff2786 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:08.809827 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92b2e89f-8bf2-40ff-bb9f-117d48ff2786 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:08.810650 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92b2e89f-8bf2-40ff-bb9f-117d48ff2786 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:09.289846 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-92b2e89f-8bf2-40ff-bb9f-117d48ff2786 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:09.300318 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-92b2e89f-8bf2-40ff-bb9f-117d48ff2786 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.527085 Jul 31 01:24:09.306565 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1705/3368] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:08 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:09.328201 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b9e75da3-a103-4291-89bb-108188d8c539 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.162"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:09.331265 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b9e75da3-a103-4291-89bb-108188d8c539 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:09.338483 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9e75da3-a103-4291-89bb-108188d8c539 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:09.339225 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9e75da3-a103-4291-89bb-108188d8c539 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:09.340373 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9e75da3-a103-4291-89bb-108188d8c539 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:09.341088 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9e75da3-a103-4291-89bb-108188d8c539 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:09.375514 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9e75da3-a103-4291-89bb-108188d8c539 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Acquired lock "refresh_cache-0e94ea78-2ac3-4192-aa5c-165b70d7b083" {{(pid=119475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 01:24:09.415915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-4d1440f5-d726-4a71-82a0-56dfb4204d22 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:24:09.418991 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-4d1440f5-d726-4a71-82a0-56dfb4204d22 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:24:09.419817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-4d1440f5-d726-4a71-82a0-56dfb4204d22 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:24:09.420547 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-4d1440f5-d726-4a71-82a0-56dfb4204d22 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:24:09.421276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-4d1440f5-d726-4a71-82a0-56dfb4204d22 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:24:09.445636 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d1440f5-d726-4a71-82a0-56dfb4204d22 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:09.447621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d1440f5-d726-4a71-82a0-56dfb4204d22 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:09.451108 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d1440f5-d726-4a71-82a0-56dfb4204d22 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:09.452142 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d1440f5-d726-4a71-82a0-56dfb4204d22 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:09.494921 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-4d1440f5-d726-4a71-82a0-56dfb4204d22 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Getting quotas for project e67e378ff39c450b9fb120ccb870a002. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:24:09.504152 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-4d1440f5-d726-4a71-82a0-56dfb4204d22 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Getting quotas for user 7cf700eaa42443f6a6bd64f51ab7f8dd and project e67e378ff39c450b9fb120ccb870a002. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:24:09.527971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4d1440f5-d726-4a71-82a0-56dfb4204d22 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:24:09.531304 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4d1440f5-d726-4a71-82a0-56dfb4204d22 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:24:09.611254 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4d1440f5-d726-4a71-82a0-56dfb4204d22 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.438801 Jul 31 01:24:09.612374 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1664/3369] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:24:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:24:09.620749 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e6d2695c-6729-4d75-b816-410f06bea719 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:09.621613 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e6d2695c-6729-4d75-b816-410f06bea719 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:09.633276 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6d2695c-6729-4d75-b816-410f06bea719 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:09.634096 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6d2695c-6729-4d75-b816-410f06bea719 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:09.653012 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6d2695c-6729-4d75-b816-410f06bea719 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:09.654333 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6d2695c-6729-4d75-b816-410f06bea719 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:10.016817 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e6d2695c-6729-4d75-b816-410f06bea719 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.402956 Jul 31 01:24:10.017422 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1665/3370] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:24:09 2022] GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1/os-interface => generated 284 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:10.022232 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8ebbe74f-d8a5-4f98-8c86-7de88b5d57a2 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:10.023119 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8ebbe74f-d8a5-4f98-8c86-7de88b5d57a2 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:10.340734 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8ebbe74f-d8a5-4f98-8c86-7de88b5d57a2 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:10.348564 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8ebbe74f-d8a5-4f98-8c86-7de88b5d57a2 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1213 microversion: 2.1 time: 0.329882 Jul 31 01:24:10.360301 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1666/3371] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:10 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1213 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:10.365200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a0f402a0-d083-45c6-9389-6edf0ea5b04f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:10.366113 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a0f402a0-d083-45c6-9389-6edf0ea5b04f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:10.375168 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0f402a0-d083-45c6-9389-6edf0ea5b04f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:10.380141 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0f402a0-d083-45c6-9389-6edf0ea5b04f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:10.381015 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0f402a0-d083-45c6-9389-6edf0ea5b04f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:10.381463 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0f402a0-d083-45c6-9389-6edf0ea5b04f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:11.067262 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a0f402a0-d083-45c6-9389-6edf0ea5b04f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:11.092501 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a0f402a0-d083-45c6-9389-6edf0ea5b04f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1521 microversion: 2.1 time: 0.716139 Jul 31 01:24:11.093689 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1667/3372] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:10 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1521 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:11.380817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-14e7bd7f-2a7a-4431-978a-c03512d2e42c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:11.381704 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-14e7bd7f-2a7a-4431-978a-c03512d2e42c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:11.393771 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-14e7bd7f-2a7a-4431-978a-c03512d2e42c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:11.403377 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-14e7bd7f-2a7a-4431-978a-c03512d2e42c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:11.405277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-14e7bd7f-2a7a-4431-978a-c03512d2e42c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:11.406915 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-14e7bd7f-2a7a-4431-978a-c03512d2e42c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:11.656024 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-14e7bd7f-2a7a-4431-978a-c03512d2e42c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:11.667164 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-14e7bd7f-2a7a-4431-978a-c03512d2e42c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1283 microversion: 2.1 time: 0.290617 Jul 31 01:24:11.673719 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1668/3373] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:11 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1283 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:12.116507 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-12f467d8-92e7-456a-8238-ccede1855ab1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:12.117115 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-12f467d8-92e7-456a-8238-ccede1855ab1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:12.129394 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12f467d8-92e7-456a-8238-ccede1855ab1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:12.130052 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12f467d8-92e7-456a-8238-ccede1855ab1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:12.131384 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12f467d8-92e7-456a-8238-ccede1855ab1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:12.135519 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12f467d8-92e7-456a-8238-ccede1855ab1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:12.756000 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-12f467d8-92e7-456a-8238-ccede1855ab1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:12.769540 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-12f467d8-92e7-456a-8238-ccede1855ab1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1501 microversion: 2.1 time: 0.656430 Jul 31 01:24:12.774259 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1669/3374] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:12 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1501 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:12.780154 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d4f4bf07-5e11-46f0-8829-db925a78f363 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:12.781161 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d4f4bf07-5e11-46f0-8829-db925a78f363 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:12.788832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d4f4bf07-5e11-46f0-8829-db925a78f363 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:12.789652 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d4f4bf07-5e11-46f0-8829-db925a78f363 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:12.790865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d4f4bf07-5e11-46f0-8829-db925a78f363 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:12.791558 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d4f4bf07-5e11-46f0-8829-db925a78f363 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:12.987007 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d4f4bf07-5e11-46f0-8829-db925a78f363 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:12.998179 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d4f4bf07-5e11-46f0-8829-db925a78f363 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1271 microversion: 2.1 time: 0.222347 Jul 31 01:24:12.999050 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1670/3375] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:12 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:13.019105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-30185869-6278-4c52-875c-1e221212a993 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:13.019767 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-30185869-6278-4c52-875c-1e221212a993 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:13.027495 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30185869-6278-4c52-875c-1e221212a993 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:13.028263 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30185869-6278-4c52-875c-1e221212a993 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:13.029344 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30185869-6278-4c52-875c-1e221212a993 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:13.029784 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30185869-6278-4c52-875c-1e221212a993 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:13.554406 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-30185869-6278-4c52-875c-1e221212a993 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:13.577619 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-30185869-6278-4c52-875c-1e221212a993 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1517 microversion: 2.1 time: 0.564378 Jul 31 01:24:13.579476 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1671/3376] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:12 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1517 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:13.591146 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e5079123-b481-4b27-8c0f-0593699f3dbd req-18d34c75-60cb-4cae-a244-aa041da3280f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1", "tag": "807c4baf-3ac4-4e79-9bd8-75e2c62bfec9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:13.613821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e5079123-b481-4b27-8c0f-0593699f3dbd req-18d34c75-60cb-4cae-a244-aa041da3280f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:13.615763 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e5079123-b481-4b27-8c0f-0593699f3dbd req-18d34c75-60cb-4cae-a244-aa041da3280f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:13.646311 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e5079123-b481-4b27-8c0f-0593699f3dbd req-18d34c75-60cb-4cae-a244-aa041da3280f service nova] Creating event network-changed:807c4baf-3ac4-4e79-9bd8-75e2c62bfec9 for instance 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 on n-h2-master-1 Jul 31 01:24:13.660453 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e5079123-b481-4b27-8c0f-0593699f3dbd req-18d34c75-60cb-4cae-a244-aa041da3280f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078721 Jul 31 01:24:13.661068 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1672/3377] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:13.684777 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-85a16d35-57ec-4ee8-8530-a2836bcd966e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:13.687881 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-85a16d35-57ec-4ee8-8530-a2836bcd966e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8a635dc3-65f1-472c-b0d2-7434bb2be647] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:13.704732 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-85a16d35-57ec-4ee8-8530-a2836bcd966e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] HTTP exception thrown: Instance 8a635dc3-65f1-472c-b0d2-7434bb2be647 could not be found. Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-85a16d35-57ec-4ee8-8530-a2836bcd966e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Request method failure captured: Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/8a635dc3-65f1-472c-b0d2-7434bb2be647/action HTTP/1.1 Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 14 Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dlxeTMDBunLit2vGiPrRDr1dvwQZdXub1419SqSyDOiGVHpAG6yJGGezx9r9jLdyswls0cvvjHa7zsCjK7Ca5A4yF2d26H1NpXXYaK068O8-NSelNX8BnsHr9p-9TQJIL4Ay7u6mf8S-XLTaElYJgrWyL6gNGdxZnY_92dE9hLD6X8 Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_af1bdeca391f47f3bde21459bf893f89", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 87e482f360af4e56a325960d834fb9f8 Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: {"rescue": {}} Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 8a635dc3-65f1-472c-b0d2-7434bb2be647 could not be found. Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '8a635dc3-65f1-472c-b0d2-7434bb2be647', 'body': {'rescue': {}}} Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a635dc3-65f1-472c-b0d2-7434bb2be647 could not be found. Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a635dc3-65f1-472c-b0d2-7434bb2be647 could not be found. Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:13.716233 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:13.721393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:13.721393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:13.721393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:13.721393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:13.721393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a635dc3-65f1-472c-b0d2-7434bb2be647 could not be found. Jul 31 01:24:13.721393 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:13.721393 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-85a16d35-57ec-4ee8-8530-a2836bcd966e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Returning 404 to user: Instance 8a635dc3-65f1-472c-b0d2-7434bb2be647 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:13.721393 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-85a16d35-57ec-4ee8-8530-a2836bcd966e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/servers/8a635dc3-65f1-472c-b0d2-7434bb2be647/action" status: 404 len: 111 microversion: 2.1 time: 0.052123 Jul 31 01:24:13.726114 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1673/3378] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:24:13 2022] POST /compute/v2.1/servers/8a635dc3-65f1-472c-b0d2-7434bb2be647/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:24:13.731462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-708bf3d9-93b0-44a3-bf09-02942b656add tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:13.731887 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-708bf3d9-93b0-44a3-bf09-02942b656add tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:13.749405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-708bf3d9-93b0-44a3-bf09-02942b656add tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:13.756756 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-708bf3d9-93b0-44a3-bf09-02942b656add tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:13.758148 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-708bf3d9-93b0-44a3-bf09-02942b656add tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:13.758705 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-708bf3d9-93b0-44a3-bf09-02942b656add tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:13.786334 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-b9e75da3-a103-4291-89bb-108188d8c539 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Building network info cache for instance {{(pid=119475) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 31 01:24:13.948552 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-708bf3d9-93b0-44a3-bf09-02942b656add tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef/action" status: 202 len: 0 microversion: 2.1 time: 0.221007 Jul 31 01:24:13.950098 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1674/3379] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:24:13 2022] POST /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:24:13.969373 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-858cf919-071a-402a-9bcf-6219f619cb34 req-adb30747-8006-4002-a388-c9fc4b4a25b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e94ea78-2ac3-4192-aa5c-165b70d7b083", "tag": "da0517f6-7df8-42a4-8ee4-a90c7b34261b"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:13.986385 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-858cf919-071a-402a-9bcf-6219f619cb34 req-adb30747-8006-4002-a388-c9fc4b4a25b3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:14.000177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-858cf919-071a-402a-9bcf-6219f619cb34 req-adb30747-8006-4002-a388-c9fc4b4a25b3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:14.013509 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-858cf919-071a-402a-9bcf-6219f619cb34 req-adb30747-8006-4002-a388-c9fc4b4a25b3 service nova] Creating event network-changed:da0517f6-7df8-42a4-8ee4-a90c7b34261b for instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083 on n-h1-master-1 Jul 31 01:24:14.025020 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-858cf919-071a-402a-9bcf-6219f619cb34 req-adb30747-8006-4002-a388-c9fc4b4a25b3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073152 Jul 31 01:24:14.034639 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1675/3380] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:14.041003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7e4d16fa-9210-4e59-a760-96b5323a7830 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:14.041935 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7e4d16fa-9210-4e59-a760-96b5323a7830 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:14.058601 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e4d16fa-9210-4e59-a760-96b5323a7830 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:14.059366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e4d16fa-9210-4e59-a760-96b5323a7830 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:14.060358 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e4d16fa-9210-4e59-a760-96b5323a7830 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:14.060967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e4d16fa-9210-4e59-a760-96b5323a7830 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:15.064943 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7e4d16fa-9210-4e59-a760-96b5323a7830 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:15.076329 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7e4d16fa-9210-4e59-a760-96b5323a7830 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1522 microversion: 2.1 time: 1.040020 Jul 31 01:24:15.085342 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1676/3381] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:14 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1522 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:15.091621 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d16541e5-30ae-4548-862e-b50c941071c2 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:15.105803 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d16541e5-30ae-4548-862e-b50c941071c2 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:15.116706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d16541e5-30ae-4548-862e-b50c941071c2 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:15.121768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d16541e5-30ae-4548-862e-b50c941071c2 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:15.123111 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d16541e5-30ae-4548-862e-b50c941071c2 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:15.123761 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d16541e5-30ae-4548-862e-b50c941071c2 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:15.715742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d16541e5-30ae-4548-862e-b50c941071c2 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:15.729101 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d16541e5-30ae-4548-862e-b50c941071c2 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1313 microversion: 2.1 time: 0.641811 Jul 31 01:24:15.736288 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1677/3382] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:15 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1313 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:16.111465 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2940a8bd-d1da-4fb0-a76a-237c258e9093 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:16.112100 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2940a8bd-d1da-4fb0-a76a-237c258e9093 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:16.127533 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2940a8bd-d1da-4fb0-a76a-237c258e9093 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:16.128522 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2940a8bd-d1da-4fb0-a76a-237c258e9093 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:16.129863 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2940a8bd-d1da-4fb0-a76a-237c258e9093 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:16.130517 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2940a8bd-d1da-4fb0-a76a-237c258e9093 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:16.813368 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-b9e75da3-a103-4291-89bb-108188d8c539 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Updating instance_info_cache with network_info: [{"id": "da0517f6-7df8-42a4-8ee4-a90c7b34261b", "address": "fa:16:3e:fe:f7:e4", "network": {"id": "02e0c218-00bf-47b5-abe5-e48ac4dced0a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-439471096-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9d6baeb89380488c9ef70003b86c5815", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapda0517f6-7d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119475) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 31 01:24:16.844362 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9e75da3-a103-4291-89bb-108188d8c539 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Releasing lock "refresh_cache-0e94ea78-2ac3-4192-aa5c-165b70d7b083" {{(pid=119475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 01:24:16.868447 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b9e75da3-a103-4291-89bb-108188d8c539 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "POST /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083/action" status: 202 len: 0 microversion: 2.1 time: 7.527851 Jul 31 01:24:16.872703 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1706/3383] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:24:09 2022] POST /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083/action => generated 0 bytes in 7565 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 31 01:24:16.878626 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-04472297-80eb-4208-bb7c-7e0e684e4c40 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:16.879809 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-04472297-80eb-4208-bb7c-7e0e684e4c40 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:16.889543 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04472297-80eb-4208-bb7c-7e0e684e4c40 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:16.890399 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04472297-80eb-4208-bb7c-7e0e684e4c40 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:16.891911 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04472297-80eb-4208-bb7c-7e0e684e4c40 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:16.892656 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04472297-80eb-4208-bb7c-7e0e684e4c40 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:16.919691 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2940a8bd-d1da-4fb0-a76a-237c258e9093 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:16.929232 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2940a8bd-d1da-4fb0-a76a-237c258e9093 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1502 microversion: 2.1 time: 0.821993 Jul 31 01:24:16.931647 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1678/3384] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:16 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1502 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:16.939017 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-83fd0a70-b9f3-43b3-8c50-ad3b40fbcba7 req-2c4ead84-2157-485c-9ab8-a279ea28a2da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3718ee1b-5f4c-4eff-963f-7cfa870c1121", "tag": "71702003-7704-491a-a12c-4c1b90917e4f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:16.965990 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-83fd0a70-b9f3-43b3-8c50-ad3b40fbcba7 req-2c4ead84-2157-485c-9ab8-a279ea28a2da service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:16.966703 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-83fd0a70-b9f3-43b3-8c50-ad3b40fbcba7 req-2c4ead84-2157-485c-9ab8-a279ea28a2da service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:16.985961 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-83fd0a70-b9f3-43b3-8c50-ad3b40fbcba7 req-2c4ead84-2157-485c-9ab8-a279ea28a2da service nova] Creating event network-changed:71702003-7704-491a-a12c-4c1b90917e4f for instance 3718ee1b-5f4c-4eff-963f-7cfa870c1121 on n-h1-master-1 Jul 31 01:24:16.992441 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-83fd0a70-b9f3-43b3-8c50-ad3b40fbcba7 req-2c4ead84-2157-485c-9ab8-a279ea28a2da service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058919 Jul 31 01:24:16.997739 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1679/3385] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:17.004004 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-af13b7a0-7913-4945-8a7c-be84cc550772 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.162"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:17.007476 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-af13b7a0-7913-4945-8a7c-be84cc550772 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:17.015200 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-af13b7a0-7913-4945-8a7c-be84cc550772 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:17.016331 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-af13b7a0-7913-4945-8a7c-be84cc550772 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:17.018506 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-af13b7a0-7913-4945-8a7c-be84cc550772 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:17.019222 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-af13b7a0-7913-4945-8a7c-be84cc550772 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:17.037842 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:17.065184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-af13b7a0-7913-4945-8a7c-be84cc550772 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Acquired lock "refresh_cache-35b03ee7-a722-4b4c-a4f0-af7da2265318" {{(pid=119474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 01:24:17.266385 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-04472297-80eb-4208-bb7c-7e0e684e4c40 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:17.281933 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-04472297-80eb-4208-bb7c-7e0e684e4c40 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1313 microversion: 2.1 time: 0.408178 Jul 31 01:24:17.296443 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1707/3386] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:16 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:17.302670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e211b8cc-3bc0-49ff-b1d5-1c03363ad936 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:17.305813 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e211b8cc-3bc0-49ff-b1d5-1c03363ad936 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:17.313610 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e211b8cc-3bc0-49ff-b1d5-1c03363ad936 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:17.314514 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e211b8cc-3bc0-49ff-b1d5-1c03363ad936 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:17.315578 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e211b8cc-3bc0-49ff-b1d5-1c03363ad936 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:17.316227 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e211b8cc-3bc0-49ff-b1d5-1c03363ad936 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:17.358356 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-e211b8cc-3bc0-49ff-b1d5-1c03363ad936 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lazy-loading 'flavor' on Instance uuid 8da54db7-290e-4d68-bf4c-4c6f49984fef {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:24:17.383609 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-e211b8cc-3bc0-49ff-b1d5-1c03363ad936 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] HTTP exception thrown: Cannot 'rescue' instance 8da54db7-290e-4d68-bf4c-4c6f49984fef while it is in vm_state paused Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e211b8cc-3bc0-49ff-b1d5-1c03363ad936 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Request method failure captured: Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef/action HTTP/1.1 Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 14 Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dlxeTMDBunLit2vGiPrRDr1dvwQZdXub1419SqSyDOiGVHpAG6yJGGezx9r9jLdyswls0cvvjHa7zsCjK7Ca5A4yF2d26H1NpXXYaK068O8-NSelNX8BnsHr9p-9TQJIL4Ay7u6mf8S-XLTaElYJgrWyL6gNGdxZnY_92dE9hLD6X8 Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_af1bdeca391f47f3bde21459bf893f89", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 87e482f360af4e56a325960d834fb9f8 Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: {"rescue": {}} Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: exception: Cannot 'rescue' instance 8da54db7-290e-4d68-bf4c-4c6f49984fef while it is in vm_state paused Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '8da54db7-290e-4d68-bf4c-4c6f49984fef', 'body': {'rescue': {}}} Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8da54db7-290e-4d68-bf4c-4c6f49984fef in vm_state paused. Cannot rescue while the instance is in this state. Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 8da54db7-290e-4d68-bf4c-4c6f49984fef while it is in vm_state paused Jul 31 01:24:17.386205 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:17.391492 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:17.391492 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:17.391492 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:17.391492 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:17.391492 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:17.391492 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:17.391492 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:17.391492 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 8da54db7-290e-4d68-bf4c-4c6f49984fef while it is in vm_state paused Jul 31 01:24:17.391492 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:17.391492 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e211b8cc-3bc0-49ff-b1d5-1c03363ad936 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Returning 409 to user: Cannot 'rescue' instance 8da54db7-290e-4d68-bf4c-4c6f49984fef while it is in vm_state paused {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:17.391492 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e211b8cc-3bc0-49ff-b1d5-1c03363ad936 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef/action" status: 409 len: 144 microversion: 2.1 time: 0.091753 Jul 31 01:24:17.397273 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1708/3387] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:24:17 2022] POST /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef/action => generated 144 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:24:17.412092 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d386b0ec-81fd-4f71-80d2-148a324aa3a5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:17.415799 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d386b0ec-81fd-4f71-80d2-148a324aa3a5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:17.427094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d386b0ec-81fd-4f71-80d2-148a324aa3a5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:17.427682 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d386b0ec-81fd-4f71-80d2-148a324aa3a5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:17.428575 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d386b0ec-81fd-4f71-80d2-148a324aa3a5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:17.429429 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d386b0ec-81fd-4f71-80d2-148a324aa3a5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:17.513522 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d386b0ec-81fd-4f71-80d2-148a324aa3a5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef/action" status: 202 len: 0 microversion: 2.1 time: 0.114633 Jul 31 01:24:17.514634 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1709/3388] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:24:17 2022] POST /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:24:17.530398 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-40b16d05-bc7f-4e19-8e12-b2e98b6b7eb9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:17.532154 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-40b16d05-bc7f-4e19-8e12-b2e98b6b7eb9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:17.541059 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40b16d05-bc7f-4e19-8e12-b2e98b6b7eb9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:17.542122 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40b16d05-bc7f-4e19-8e12-b2e98b6b7eb9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:17.543797 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40b16d05-bc7f-4e19-8e12-b2e98b6b7eb9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:17.544571 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40b16d05-bc7f-4e19-8e12-b2e98b6b7eb9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:18.124052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-40b16d05-bc7f-4e19-8e12-b2e98b6b7eb9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:18.132310 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-40b16d05-bc7f-4e19-8e12-b2e98b6b7eb9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1509 microversion: 2.1 time: 0.611384 Jul 31 01:24:18.147029 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1710/3389] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:17 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1509 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:18.311012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-baadb252-1318-444f-a20d-b004e112ad13 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:18.312312 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-baadb252-1318-444f-a20d-b004e112ad13 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:18.323109 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-baadb252-1318-444f-a20d-b004e112ad13 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:18.324131 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-baadb252-1318-444f-a20d-b004e112ad13 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:18.324942 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-baadb252-1318-444f-a20d-b004e112ad13 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:18.325388 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-baadb252-1318-444f-a20d-b004e112ad13 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:18.888244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-baadb252-1318-444f-a20d-b004e112ad13 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:18.896908 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-baadb252-1318-444f-a20d-b004e112ad13 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1313 microversion: 2.1 time: 0.589953 Jul 31 01:24:18.898198 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1711/3390] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:18 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:18.994269 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 01:24:18.995192 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 01:24:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318/action (ip 10.222.0.45) !!! Jul 31 01:24:19.185374 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ccf079c7-5b97-41d3-8aa6-79b6cfd39861 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:19.187224 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ccf079c7-5b97-41d3-8aa6-79b6cfd39861 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:19.203916 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ccf079c7-5b97-41d3-8aa6-79b6cfd39861 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:19.257076 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ccf079c7-5b97-41d3-8aa6-79b6cfd39861 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:19.264711 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ccf079c7-5b97-41d3-8aa6-79b6cfd39861 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:19.267715 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ccf079c7-5b97-41d3-8aa6-79b6cfd39861 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:19.467793 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:19.702272 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ccf079c7-5b97-41d3-8aa6-79b6cfd39861 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:19.716356 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ccf079c7-5b97-41d3-8aa6-79b6cfd39861 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1517 microversion: 2.1 time: 0.557204 Jul 31 01:24:19.717389 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1712/3391] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:19 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1517 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:19.919418 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-62d71484-b775-472c-b9a4-3d9cb9ae4102 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:19.920044 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-62d71484-b775-472c-b9a4-3d9cb9ae4102 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:19.932513 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-62d71484-b775-472c-b9a4-3d9cb9ae4102 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:19.934006 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-62d71484-b775-472c-b9a4-3d9cb9ae4102 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:19.937879 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-62d71484-b775-472c-b9a4-3d9cb9ae4102 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:19.938746 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-62d71484-b775-472c-b9a4-3d9cb9ae4102 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:20.345913 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=8 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:20.399496 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-62d71484-b775-472c-b9a4-3d9cb9ae4102 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:20.408938 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-62d71484-b775-472c-b9a4-3d9cb9ae4102 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1313 microversion: 2.1 time: 0.494832 Jul 31 01:24:20.423919 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1713/3392] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:19 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:21.449846 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c6ad09bb-d1d3-4072-9a77-6a9b26c2459d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:21.450328 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c6ad09bb-d1d3-4072-9a77-6a9b26c2459d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:21.492751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6ad09bb-d1d3-4072-9a77-6a9b26c2459d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:21.495920 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6ad09bb-d1d3-4072-9a77-6a9b26c2459d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:21.502764 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6ad09bb-d1d3-4072-9a77-6a9b26c2459d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:21.504629 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6ad09bb-d1d3-4072-9a77-6a9b26c2459d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:22.291578 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c6ad09bb-d1d3-4072-9a77-6a9b26c2459d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:22.302951 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c6ad09bb-d1d3-4072-9a77-6a9b26c2459d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1313 microversion: 2.1 time: 0.859876 Jul 31 01:24:22.306166 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1714/3393] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:21 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1313 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:22.346685 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2866e4fd-a2ab-43f7-8a4c-879d924aa817 req-9e45fb12-ef60-4a43-927a-07d926fac0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e94ea78-2ac3-4192-aa5c-165b70d7b083", "tag": "da0517f6-7df8-42a4-8ee4-a90c7b34261b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:22.368954 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2866e4fd-a2ab-43f7-8a4c-879d924aa817 req-9e45fb12-ef60-4a43-927a-07d926fac0e8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:22.372695 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2866e4fd-a2ab-43f7-8a4c-879d924aa817 req-9e45fb12-ef60-4a43-927a-07d926fac0e8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:22.402701 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2866e4fd-a2ab-43f7-8a4c-879d924aa817 req-9e45fb12-ef60-4a43-927a-07d926fac0e8 service nova] Creating event network-changed:da0517f6-7df8-42a4-8ee4-a90c7b34261b for instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083 on n-h1-master-1 Jul 31 01:24:22.415163 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2866e4fd-a2ab-43f7-8a4c-879d924aa817 req-9e45fb12-ef60-4a43-927a-07d926fac0e8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073711 Jul 31 01:24:22.433856 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1715/3394] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:24:22.581942 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2c6be97b-28ef-4251-a0a6-86f531a47d71 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:22.589893 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2c6be97b-28ef-4251-a0a6-86f531a47d71 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:22.603950 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c6be97b-28ef-4251-a0a6-86f531a47d71 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:22.605304 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c6be97b-28ef-4251-a0a6-86f531a47d71 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:22.606545 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c6be97b-28ef-4251-a0a6-86f531a47d71 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:22.607175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c6be97b-28ef-4251-a0a6-86f531a47d71 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:22.675704 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-2c6be97b-28ef-4251-a0a6-86f531a47d71 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lazy-loading 'flavor' on Instance uuid 8da54db7-290e-4d68-bf4c-4c6f49984fef {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:24:22.796999 n-d-master-1 devstack@n-api.service[119474]: INFO nova.network.neutron [None req-af13b7a0-7913-4945-8a7c-be84cc550772 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] re-assign floating IP 172.35.6.162 from instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083 Jul 31 01:24:22.893201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-af13b7a0-7913-4945-8a7c-be84cc550772 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Building network info cache for instance {{(pid=119474) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 31 01:24:22.894749 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2c6be97b-28ef-4251-a0a6-86f531a47d71 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef/action" status: 200 len: 32 microversion: 2.1 time: 0.342408 Jul 31 01:24:22.899394 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1716/3395] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:24:22 2022] POST /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef/action => generated 32 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:24:22.922044 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-28beedf9-ecf5-4e6b-a70a-18c4a7ae80e4 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:22.922764 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-28beedf9-ecf5-4e6b-a70a-18c4a7ae80e4 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:22.942729 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28beedf9-ecf5-4e6b-a70a-18c4a7ae80e4 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:22.943202 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28beedf9-ecf5-4e6b-a70a-18c4a7ae80e4 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:22.945751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28beedf9-ecf5-4e6b-a70a-18c4a7ae80e4 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:22.946208 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28beedf9-ecf5-4e6b-a70a-18c4a7ae80e4 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:22.963996 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:23.504021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-28beedf9-ecf5-4e6b-a70a-18c4a7ae80e4 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:23.527897 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-28beedf9-ecf5-4e6b-a70a-18c4a7ae80e4 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.614912 Jul 31 01:24:23.545274 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1717/3396] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:22 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:23.567636 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f0a4af93-9b7d-4aa9-b761-cbb92dd3accd tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:23.567636 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f0a4af93-9b7d-4aa9-b761-cbb92dd3accd tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:23.589053 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0a4af93-9b7d-4aa9-b761-cbb92dd3accd tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:23.590389 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0a4af93-9b7d-4aa9-b761-cbb92dd3accd tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:23.594427 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0a4af93-9b7d-4aa9-b761-cbb92dd3accd tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:23.595491 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0a4af93-9b7d-4aa9-b761-cbb92dd3accd tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:24.050489 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f0a4af93-9b7d-4aa9-b761-cbb92dd3accd tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:24.061551 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f0a4af93-9b7d-4aa9-b761-cbb92dd3accd tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1313 microversion: 2.1 time: 0.514688 Jul 31 01:24:24.077047 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1718/3397] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:23 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:24.478931 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2b7f1597-65a2-4f10-b01d-81470636514b req-7b7bf354-1fdb-4720-a598-f23f65ec4c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b03ee7-a722-4b4c-a4f0-af7da2265318", "tag": "2863df11-0199-454e-97de-0d7aefc5ae04"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:24.502507 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2b7f1597-65a2-4f10-b01d-81470636514b req-7b7bf354-1fdb-4720-a598-f23f65ec4c1b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:24.502956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2b7f1597-65a2-4f10-b01d-81470636514b req-7b7bf354-1fdb-4720-a598-f23f65ec4c1b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:24.520761 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2b7f1597-65a2-4f10-b01d-81470636514b req-7b7bf354-1fdb-4720-a598-f23f65ec4c1b service nova] Creating event network-changed:2863df11-0199-454e-97de-0d7aefc5ae04 for instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 on n-h1-master-1 Jul 31 01:24:24.537528 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2b7f1597-65a2-4f10-b01d-81470636514b req-7b7bf354-1fdb-4720-a598-f23f65ec4c1b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063092 Jul 31 01:24:24.538832 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1719/3398] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:24:24.550568 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-776d2161-d8ba-478e-b25b-52218917b8e0 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:24.551690 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-776d2161-d8ba-478e-b25b-52218917b8e0 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:24.575151 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-776d2161-d8ba-478e-b25b-52218917b8e0 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:24.576109 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-776d2161-d8ba-478e-b25b-52218917b8e0 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:24.577194 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-776d2161-d8ba-478e-b25b-52218917b8e0 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:24.578113 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-776d2161-d8ba-478e-b25b-52218917b8e0 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:24.794468 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-af13b7a0-7913-4945-8a7c-be84cc550772 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Updating instance_info_cache with network_info: [{"id": "da0517f6-7df8-42a4-8ee4-a90c7b34261b", "address": "fa:16:3e:fe:f7:e4", "network": {"id": "02e0c218-00bf-47b5-abe5-e48ac4dced0a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-439471096-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9d6baeb89380488c9ef70003b86c5815", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapda0517f6-7d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119474) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 31 01:24:24.815201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-af13b7a0-7913-4945-8a7c-be84cc550772 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Building network info cache for instance {{(pid=119474) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 31 01:24:25.369253 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-776d2161-d8ba-478e-b25b-52218917b8e0 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:25.381513 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-776d2161-d8ba-478e-b25b-52218917b8e0 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.832276 Jul 31 01:24:25.383567 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1720/3399] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:24 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:25.389155 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a49dcc36-67f8-4d3d-a1a1-118414094a31 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:25.390945 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a49dcc36-67f8-4d3d-a1a1-118414094a31 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:25.424362 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a49dcc36-67f8-4d3d-a1a1-118414094a31 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:25.425006 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a49dcc36-67f8-4d3d-a1a1-118414094a31 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:25.425954 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a49dcc36-67f8-4d3d-a1a1-118414094a31 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:25.426505 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a49dcc36-67f8-4d3d-a1a1-118414094a31 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:26.038747 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a49dcc36-67f8-4d3d-a1a1-118414094a31 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:26.051405 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a49dcc36-67f8-4d3d-a1a1-118414094a31 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1313 microversion: 2.1 time: 0.666531 Jul 31 01:24:26.075623 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1721/3400] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:25 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1313 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:26.088768 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f3eb31b0-9460-4da7-8ef9-bde188ea6729 req-2afda741-2317-4875-be93-bfeb7ae9d227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3718ee1b-5f4c-4eff-963f-7cfa870c1121", "name": "network-vif-plugged", "status": "completed", "tag": "71702003-7704-491a-a12c-4c1b90917e4f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:26.113522 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f3eb31b0-9460-4da7-8ef9-bde188ea6729 req-2afda741-2317-4875-be93-bfeb7ae9d227 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:26.115120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f3eb31b0-9460-4da7-8ef9-bde188ea6729 req-2afda741-2317-4875-be93-bfeb7ae9d227 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:26.139911 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f3eb31b0-9460-4da7-8ef9-bde188ea6729 req-2afda741-2317-4875-be93-bfeb7ae9d227 service nova] Creating event network-vif-plugged:71702003-7704-491a-a12c-4c1b90917e4f for instance 3718ee1b-5f4c-4eff-963f-7cfa870c1121 on n-h1-master-1 Jul 31 01:24:26.146786 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f3eb31b0-9460-4da7-8ef9-bde188ea6729 req-2afda741-2317-4875-be93-bfeb7ae9d227 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068047 Jul 31 01:24:26.153490 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1722/3401] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:26.405563 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8af8a3b7-d988-4c4f-93fe-0599f1328d67 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:26.406991 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8af8a3b7-d988-4c4f-93fe-0599f1328d67 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:26.417397 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8af8a3b7-d988-4c4f-93fe-0599f1328d67 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:26.417874 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8af8a3b7-d988-4c4f-93fe-0599f1328d67 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:26.418672 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8af8a3b7-d988-4c4f-93fe-0599f1328d67 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:26.419119 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8af8a3b7-d988-4c4f-93fe-0599f1328d67 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:26.998822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-af13b7a0-7913-4945-8a7c-be84cc550772 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Updating instance_info_cache with network_info: [{"id": "2863df11-0199-454e-97de-0d7aefc5ae04", "address": "fa:16:3e:9d:44:3e", "network": {"id": "02e0c218-00bf-47b5-abe5-e48ac4dced0a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-439471096-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9d6baeb89380488c9ef70003b86c5815", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2863df11-01", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119474) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 31 01:24:27.008766 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-af13b7a0-7913-4945-8a7c-be84cc550772 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Releasing lock "refresh_cache-35b03ee7-a722-4b4c-a4f0-af7da2265318" {{(pid=119474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 01:24:27.009904 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-af13b7a0-7913-4945-8a7c-be84cc550772 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "POST /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318/action" status: 202 len: 0 microversion: 2.1 time: 10.010405 Jul 31 01:24:27.022926 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1680/3402] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:24:16 2022] POST /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318/action => generated 0 bytes in 10024 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 31 01:24:27.038065 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:27.178439 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8af8a3b7-d988-4c4f-93fe-0599f1328d67 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:27.190981 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8af8a3b7-d988-4c4f-93fe-0599f1328d67 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.790926 Jul 31 01:24:27.192028 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1723/3403] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:26 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:27.198478 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ad2e8d93-c000-4af5-ba65-d2db92c03f8d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.162"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:27.235044 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fe2324a0-d968-4fef-b081-24604d580b8a tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Action: 'create', calling method: .version_select at 0x7fede445ec10>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1745622719", "policies": ["affinity"]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:27.254384 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-fe2324a0-d968-4fef-b081-24604d580b8a tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:24:27.260271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-fe2324a0-d968-4fef-b081-24604d580b8a tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for user 81b070b0ba7349038f808de839eca450 and project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:24:27.317910 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-fe2324a0-d968-4fef-b081-24604d580b8a tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:24:27.324014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-fe2324a0-d968-4fef-b081-24604d580b8a tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for user 81b070b0ba7349038f808de839eca450 and project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:24:27.356830 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fe2324a0-d968-4fef-b081-24604d580b8a tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.327417 Jul 31 01:24:27.358722 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1681/3404] 10.222.0.45 () {60 vars in 1174 bytes} [Sun Jul 31 01:24:27 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:27.371615 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-766caf4b-f652-4c5a-b674-28794a8ed001 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:27.373017 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-766caf4b-f652-4c5a-b674-28794a8ed001 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:27.382350 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-766caf4b-f652-4c5a-b674-28794a8ed001 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:27.383003 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-766caf4b-f652-4c5a-b674-28794a8ed001 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:27.384013 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-766caf4b-f652-4c5a-b674-28794a8ed001 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:27.384629 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-766caf4b-f652-4c5a-b674-28794a8ed001 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:27.412753 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ad2e8d93-c000-4af5-ba65-d2db92c03f8d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:27.420601 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad2e8d93-c000-4af5-ba65-d2db92c03f8d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:27.421383 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad2e8d93-c000-4af5-ba65-d2db92c03f8d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:27.424977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad2e8d93-c000-4af5-ba65-d2db92c03f8d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:27.425575 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad2e8d93-c000-4af5-ba65-d2db92c03f8d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:27.760383 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-766caf4b-f652-4c5a-b674-28794a8ed001 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:27.768536 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-766caf4b-f652-4c5a-b674-28794a8ed001 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1313 microversion: 2.1 time: 0.408650 Jul 31 01:24:27.769683 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1682/3405] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:27 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:27.774443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-74e52375-0136-48b0-bfeb-1069c6ae96bd tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Action: 'create', calling method: .version_select at 0x7fede445e0d0>, body: {"server_group": {"name": "tempest-server-group-753129004", "policies": ["affinity"]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:27.792523 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-74e52375-0136-48b0-bfeb-1069c6ae96bd tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:24:27.798686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-74e52375-0136-48b0-bfeb-1069c6ae96bd tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for user 81b070b0ba7349038f808de839eca450 and project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:24:27.853232 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-74e52375-0136-48b0-bfeb-1069c6ae96bd tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:24:27.860717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-74e52375-0136-48b0-bfeb-1069c6ae96bd tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for user 81b070b0ba7349038f808de839eca450 and project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:24:27.876412 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-74e52375-0136-48b0-bfeb-1069c6ae96bd tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.105461 Jul 31 01:24:27.882122 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1683/3406] 10.222.0.45 () {60 vars in 1173 bytes} [Sun Jul 31 01:24:27 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:27.887859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-da31c171-91e1-43c5-a064-02f38f45f933 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Action: 'create', calling method: .version_select at 0x7fede449d790>, body: {"server_group": {"name": "tempest-server-group-753129004", "policies": ["affinity"]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:27.908631 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-da31c171-91e1-43c5-a064-02f38f45f933 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:24:27.914585 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-da31c171-91e1-43c5-a064-02f38f45f933 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for user 81b070b0ba7349038f808de839eca450 and project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:24:27.991263 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-ad2e8d93-c000-4af5-ba65-d2db92c03f8d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] HTTP exception thrown: Floating IP 172.35.6.162 is not associated with instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083. Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ad2e8d93-c000-4af5-ba65-d2db92c03f8d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Request method failure captured: Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083/action HTTP/1.1 Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 49 Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dmL5eUWSDT_M26c56oWS00BkDdrJ_z7Ku045FmSMVe4jLtYjk5TLCJIbzLbFAy8OMBrx2T5TrY1Duz4tR1Wz4XLXFQnVkTYI2V3XKZ9BGnzwGk2pXwMy2DEs6r6uNreUFkkWdFqLwD4RqQfJ9i1FuDzlpiUPHywDHN1TzRaXsFa_6s Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 9d6baeb89380488c9ef70003b86c5815 Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1957096628 Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9d6baeb89380488c9ef70003b86c5815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9d6baeb89380488c9ef70003b86c5815"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9d6baeb89380488c9ef70003b86c5815"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9d6baeb89380488c9ef70003b86c5815", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1957096628 Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 9d6baeb89380488c9ef70003b86c5815 Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1957096628 Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-FloatingIPsAssociationTestJSON-1957096628-project Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 46a58b52653f40e696d7d0a09d7e48e7 Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1957096628-project Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: {"removeFloatingIp": {"address": "172.35.6.162"}} Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: exception: Floating IP 172.35.6.162 is not associated with instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083. Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '0e94ea78-2ac3-4192-aa5c-165b70d7b083', 'body': {'removeFloatingIp': {'address': '172.35.6.162'}}} Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.6.162 is not associated with instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083. Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.6.162 is not associated with instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083. Jul 31 01:24:27.993805 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:27.999071 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ad2e8d93-c000-4af5-ba65-d2db92c03f8d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Returning 409 to user: Floating IP 172.35.6.162 is not associated with instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:27.999071 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ad2e8d93-c000-4af5-ba65-d2db92c03f8d tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "POST /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083/action" status: 409 len: 146 microversion: 2.1 time: 0.801526 Jul 31 01:24:27.999071 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1724/3407] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:24:27 2022] POST /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083/action => generated 146 bytes in 803 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:24:27.999378 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-da31c171-91e1-43c5-a064-02f38f45f933 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:24:28.005286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-da31c171-91e1-43c5-a064-02f38f45f933 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for user 81b070b0ba7349038f808de839eca450 and project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:24:28.008934 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bcf24268-8cea-4f57-8520-83e70d31ef70 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.162"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:28.022273 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-da31c171-91e1-43c5-a064-02f38f45f933 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.138592 Jul 31 01:24:28.023214 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1684/3408] 10.222.0.45 () {60 vars in 1173 bytes} [Sun Jul 31 01:24:27 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:28.034911 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f93b4c61-8c1c-45ec-ab4d-6c141958af23 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:28.074507 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f93b4c61-8c1c-45ec-ab4d-6c141958af23 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/a743d025-649a-4b1b-8f24-e6380f5dd54d" status: 204 len: 0 microversion: 2.1 time: 0.043925 Jul 31 01:24:28.075705 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1685/3409] 10.222.0.45 () {58 vars in 1266 bytes} [Sun Jul 31 01:24:28 2022] DELETE /compute/v2.1/os-server-groups/a743d025-649a-4b1b-8f24-e6380f5dd54d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:24:28.083952 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fb935146-245b-47cb-8368-6c8624b1353e tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:28.104612 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fb935146-245b-47cb-8368-6c8624b1353e tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.025042 Jul 31 01:24:28.105851 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1686/3410] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:24:28 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:28.117804 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8cc17329-4b3e-4e71-b50a-d12d806d4f48 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:28.141682 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:28.152378 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8cc17329-4b3e-4e71-b50a-d12d806d4f48 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/c47f3d33-55d2-4fed-90cc-acd2f924a9f7" status: 204 len: 0 microversion: 2.1 time: 0.039519 Jul 31 01:24:28.153830 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1687/3411] 10.222.0.45 () {58 vars in 1266 bytes} [Sun Jul 31 01:24:28 2022] DELETE /compute/v2.1/os-server-groups/c47f3d33-55d2-4fed-90cc-acd2f924a9f7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:24:28.163865 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-81e3f136-22c8-45f7-ac79-d6454ebbed2f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:28.177213 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-81e3f136-22c8-45f7-ac79-d6454ebbed2f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.018293 Jul 31 01:24:28.179002 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1688/3412] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:24:28 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:28.193198 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fbd21773-4e7f-4ca0-b645-99f6b992dda8 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Action: 'create', calling method: .version_select at 0x7fede449d430>, body: {"server_group": {"name": "tempest-server-group-897368069", "policies": ["affinity"]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:28.226794 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-fbd21773-4e7f-4ca0-b645-99f6b992dda8 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:24:28.240286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-fbd21773-4e7f-4ca0-b645-99f6b992dda8 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for user 81b070b0ba7349038f808de839eca450 and project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:24:28.312070 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bcf24268-8cea-4f57-8520-83e70d31ef70 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:28.334134 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcf24268-8cea-4f57-8520-83e70d31ef70 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:28.336838 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcf24268-8cea-4f57-8520-83e70d31ef70 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:28.353071 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcf24268-8cea-4f57-8520-83e70d31ef70 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:28.356257 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcf24268-8cea-4f57-8520-83e70d31ef70 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:28.360590 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-fbd21773-4e7f-4ca0-b645-99f6b992dda8 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:24:28.378827 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-fbd21773-4e7f-4ca0-b645-99f6b992dda8 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for user 81b070b0ba7349038f808de839eca450 and project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:24:28.412146 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fbd21773-4e7f-4ca0-b645-99f6b992dda8 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.223398 Jul 31 01:24:28.413295 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1689/3413] 10.222.0.45 () {60 vars in 1173 bytes} [Sun Jul 31 01:24:28 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:24:28.437463 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ce3b9bb0-a3e1-4a43-a595-17160c04f0af tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:28.439311 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ce3b9bb0-a3e1-4a43-a595-17160c04f0af tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:28.452566 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce3b9bb0-a3e1-4a43-a595-17160c04f0af tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:28.453246 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce3b9bb0-a3e1-4a43-a595-17160c04f0af tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:28.454158 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce3b9bb0-a3e1-4a43-a595-17160c04f0af tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:28.454710 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce3b9bb0-a3e1-4a43-a595-17160c04f0af tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:28.795682 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ce3b9bb0-a3e1-4a43-a595-17160c04f0af tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:28.809854 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ce3b9bb0-a3e1-4a43-a595-17160c04f0af tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.395297 Jul 31 01:24:28.811591 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1690/3414] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:28 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:28.840673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-490bf2b9-228a-4616-8cdb-7b669c8657b7 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:28.907790 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-490bf2b9-228a-4616-8cdb-7b669c8657b7 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/9f8d4bf9-848d-4213-8453-cc414d5d243b" status: 204 len: 0 microversion: 2.1 time: 0.095166 Jul 31 01:24:28.910173 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1691/3415] 10.222.0.45 () {58 vars in 1266 bytes} [Sun Jul 31 01:24:28 2022] DELETE /compute/v2.1/os-server-groups/9f8d4bf9-848d-4213-8453-cc414d5d243b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:24:28.929178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d13cc965-c112-4889-9ee5-19108aa3be85 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:28.929997 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d13cc965-c112-4889-9ee5-19108aa3be85 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:28.950960 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d13cc965-c112-4889-9ee5-19108aa3be85 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:28.951460 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d13cc965-c112-4889-9ee5-19108aa3be85 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:28.952294 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d13cc965-c112-4889-9ee5-19108aa3be85 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:28.955647 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d13cc965-c112-4889-9ee5-19108aa3be85 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:29.000737 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcf24268-8cea-4f57-8520-83e70d31ef70 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Acquired lock "refresh_cache-35b03ee7-a722-4b4c-a4f0-af7da2265318" {{(pid=119475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 01:24:29.408101 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d13cc965-c112-4889-9ee5-19108aa3be85 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:29.427461 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d13cc965-c112-4889-9ee5-19108aa3be85 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1498 microversion: 2.1 time: 0.515063 Jul 31 01:24:29.429593 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1692/3416] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:28 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1498 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:29.446328 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-40450a4a-6167-4f25-aabf-bc1917870226 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:29.469626 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-40450a4a-6167-4f25-aabf-bc1917870226 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.038251 Jul 31 01:24:29.475436 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1693/3417] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:24:29 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:29.490449 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f9e0382-e085-4ac6-96b2-a97470d3179e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:29.494924 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6f9e0382-e085-4ac6-96b2-a97470d3179e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:29.527840 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f9e0382-e085-4ac6-96b2-a97470d3179e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:29.544161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f9e0382-e085-4ac6-96b2-a97470d3179e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:29.546767 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f9e0382-e085-4ac6-96b2-a97470d3179e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:29.548971 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f9e0382-e085-4ac6-96b2-a97470d3179e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:29.603921 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-6f9e0382-e085-4ac6-96b2-a97470d3179e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lazy-loading 'flavor' on Instance uuid 3718ee1b-5f4c-4eff-963f-7cfa870c1121 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:24:29.787443 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6f9e0382-e085-4ac6-96b2-a97470d3179e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "POST /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121/action" status: 200 len: 32 microversion: 2.1 time: 0.286448 Jul 31 01:24:29.790344 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1694/3418] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:24:29 2022] POST /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121/action => generated 32 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:24:29.802213 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7a598bba-2a23-447a-a1ac-fc3edd9891e2 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Action: 'create', calling method: .version_select at 0x7fede459bc10>, body: {"server_group": {"name": "tempest-server-group-1416081902", "policies": ["anti-affinity"]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:29.853508 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-7a598bba-2a23-447a-a1ac-fc3edd9891e2 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:24:29.869098 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-7a598bba-2a23-447a-a1ac-fc3edd9891e2 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for user 81b070b0ba7349038f808de839eca450 and project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:24:29.965360 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-7a598bba-2a23-447a-a1ac-fc3edd9891e2 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:24:29.982310 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-7a598bba-2a23-447a-a1ac-fc3edd9891e2 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for user 81b070b0ba7349038f808de839eca450 and project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_groups'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:24:29.999421 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7a598bba-2a23-447a-a1ac-fc3edd9891e2 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.202771 Jul 31 01:24:29.999998 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1695/3419] 10.222.0.45 () {60 vars in 1173 bytes} [Sun Jul 31 01:24:29 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:30.004865 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d15121ce-7871-4e0e-8a62-50fa34eab457 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:30.007295 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d15121ce-7871-4e0e-8a62-50fa34eab457 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:30.013922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d15121ce-7871-4e0e-8a62-50fa34eab457 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:30.015531 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d15121ce-7871-4e0e-8a62-50fa34eab457 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:30.016944 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d15121ce-7871-4e0e-8a62-50fa34eab457 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:30.017736 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d15121ce-7871-4e0e-8a62-50fa34eab457 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:30.777376 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d15121ce-7871-4e0e-8a62-50fa34eab457 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:30.794884 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d15121ce-7871-4e0e-8a62-50fa34eab457 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.793779 Jul 31 01:24:30.807384 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1696/3420] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:29 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:30.814489 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eacb54ae-9f06-43be-b816-da24916d2335 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:30.815673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eacb54ae-9f06-43be-b816-da24916d2335 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:30.830781 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eacb54ae-9f06-43be-b816-da24916d2335 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:30.833743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eacb54ae-9f06-43be-b816-da24916d2335 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:30.834848 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eacb54ae-9f06-43be-b816-da24916d2335 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:30.836027 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eacb54ae-9f06-43be-b816-da24916d2335 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:31.423859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eacb54ae-9f06-43be-b816-da24916d2335 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:31.435298 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eacb54ae-9f06-43be-b816-da24916d2335 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.632343 Jul 31 01:24:31.449860 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1697/3421] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:30 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:31.458541 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ce9c32bd-6a5e-4ba0-a2b5-2ac4323faf54 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:31.489252 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ce9c32bd-6a5e-4ba0-a2b5-2ac4323faf54 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/f7338b65-d9d8-4070-84fb-27c9ce05dd9e" status: 204 len: 0 microversion: 2.1 time: 0.037838 Jul 31 01:24:31.490007 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1698/3422] 10.222.0.45 () {58 vars in 1266 bytes} [Sun Jul 31 01:24:31 2022] DELETE /compute/v2.1/os-server-groups/f7338b65-d9d8-4070-84fb-27c9ce05dd9e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:24:31.498363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8263c9b7-23ac-48aa-bb94-71ea0ec25903 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:31.510429 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8263c9b7-23ac-48aa-bb94-71ea0ec25903 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.015849 Jul 31 01:24:31.532265 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1699/3423] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:24:31 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:24:31.587867 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1003193087", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "71b135d0-67a8-4712-a44c-6fc6521eb4c1"}]}, "os:scheduler_hints": {"group": "b1a91bb3-115e-4eb9-80e7-0761abf20084"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:31.653294 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] validate_networks() for [('71b135d0-67a8-4712-a44c-6fc6521eb4c1', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:24:31.794588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-bcf24268-8cea-4f57-8520-83e70d31ef70 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Building network info cache for instance {{(pid=119475) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 31 01:24:32.707735 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:24:32.708335 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:24:32.709051 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:24:32.709570 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:24:32.710198 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:24:32.728604 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:32.731055 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:32.733185 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:32.734547 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:32.765923 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:24:32.776138 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for user 81b070b0ba7349038f808de839eca450 and project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:24:32.792864 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:32.801491 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:24:32.801992 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:24:32.878627 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:24:32.885283 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for user 81b070b0ba7349038f808de839eca450 and project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:24:32.980677 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:24:32.983883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-bcf24268-8cea-4f57-8520-83e70d31ef70 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Updating instance_info_cache with network_info: [{"id": "2863df11-0199-454e-97de-0d7aefc5ae04", "address": "fa:16:3e:9d:44:3e", "network": {"id": "02e0c218-00bf-47b5-abe5-e48ac4dced0a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-439471096-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9d6baeb89380488c9ef70003b86c5815", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2863df11-01", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119475) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 31 01:24:32.991018 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Getting quotas for user 81b070b0ba7349038f808de839eca450 and project c1254dde3a2f46328c18a7fec70d4d91. Resources: {'server_group_members'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:24:33.003866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcf24268-8cea-4f57-8520-83e70d31ef70 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Releasing lock "refresh_cache-35b03ee7-a722-4b4c-a4f0-af7da2265318" {{(pid=119475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 01:24:33.006565 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bcf24268-8cea-4f57-8520-83e70d31ef70 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "POST /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318/action" status: 202 len: 0 microversion: 2.1 time: 5.004112 Jul 31 01:24:33.008432 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1725/3424] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:24:28 2022] POST /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318/action => generated 0 bytes in 5007 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 31 01:24:33.017588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-c1dcd8d7-dc6d-46aa-bba4-d87f132e84c1 req-d2adcf41-6d68-4ebb-b93e-72a1bd58de8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b03ee7-a722-4b4c-a4f0-af7da2265318", "tag": "2863df11-0199-454e-97de-0d7aefc5ae04"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:33.031254 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=74 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:33.035525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c1dcd8d7-dc6d-46aa-bba4-d87f132e84c1 req-d2adcf41-6d68-4ebb-b93e-72a1bd58de8a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:33.036366 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c1dcd8d7-dc6d-46aa-bba4-d87f132e84c1 req-d2adcf41-6d68-4ebb-b93e-72a1bd58de8a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:33.044034 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-39b7f6c0-da16-4d12-8005-3bf03240536f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.459532 Jul 31 01:24:33.056553 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1700/3425] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:24:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 01:24:33.064013 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-c1dcd8d7-dc6d-46aa-bba4-d87f132e84c1 req-d2adcf41-6d68-4ebb-b93e-72a1bd58de8a service nova] Creating event network-changed:2863df11-0199-454e-97de-0d7aefc5ae04 for instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 on n-h1-master-1 Jul 31 01:24:33.066688 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ff220311-0c7d-44a0-b45c-3b90363dcc5c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:33.067441 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ff220311-0c7d-44a0-b45c-3b90363dcc5c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:33.071482 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-c1dcd8d7-dc6d-46aa-bba4-d87f132e84c1 req-d2adcf41-6d68-4ebb-b93e-72a1bd58de8a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061390 Jul 31 01:24:33.073044 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1726/3426] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:33.081782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-96e586ca-0479-4407-be0d-825cfd3539a8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:33.082906 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-96e586ca-0479-4407-be0d-825cfd3539a8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:33.090405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff220311-0c7d-44a0-b45c-3b90363dcc5c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:33.090862 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff220311-0c7d-44a0-b45c-3b90363dcc5c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:33.091760 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff220311-0c7d-44a0-b45c-3b90363dcc5c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:33.092375 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff220311-0c7d-44a0-b45c-3b90363dcc5c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:33.092525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96e586ca-0479-4407-be0d-825cfd3539a8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:33.093265 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96e586ca-0479-4407-be0d-825cfd3539a8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:33.095147 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96e586ca-0479-4407-be0d-825cfd3539a8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:33.096083 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96e586ca-0479-4407-be0d-825cfd3539a8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:33.584020 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-96e586ca-0479-4407-be0d-825cfd3539a8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:33.597877 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-96e586ca-0479-4407-be0d-825cfd3539a8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.522282 Jul 31 01:24:33.617894 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ff220311-0c7d-44a0-b45c-3b90363dcc5c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:33.629414 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1727/3427] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:33 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:33.637163 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ff220311-0c7d-44a0-b45c-3b90363dcc5c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.580600 Jul 31 01:24:33.638416 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1701/3428] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:33 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:33.641874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0b734fe2-fba2-464f-acee-022c5590da16 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:33.642394 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0b734fe2-fba2-464f-acee-022c5590da16 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:33.650940 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-39da3eb7-9edd-4de3-b5a8-4d8d31307f65 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:33.652741 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-39da3eb7-9edd-4de3-b5a8-4d8d31307f65 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:33.659688 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b734fe2-fba2-464f-acee-022c5590da16 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:33.665670 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b734fe2-fba2-464f-acee-022c5590da16 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:33.666936 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b734fe2-fba2-464f-acee-022c5590da16 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:33.668265 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b734fe2-fba2-464f-acee-022c5590da16 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:33.717296 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0b734fe2-fba2-464f-acee-022c5590da16 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:24:33.811603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-39da3eb7-9edd-4de3-b5a8-4d8d31307f65 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b070b0ba7349038f808de839eca450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1254dde3a2f46328c18a7fec70d4d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:33.820441 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-39da3eb7-9edd-4de3-b5a8-4d8d31307f65 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59" status: 200 len: 1213 microversion: 2.1 time: 0.181483 Jul 31 01:24:33.824570 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1702/3429] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:33 2022] GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 => generated 1213 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:33.899641 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0b734fe2-fba2-464f-acee-022c5590da16 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "DELETE /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318" status: 204 len: 0 microversion: 2.1 time: 0.266776 Jul 31 01:24:33.901571 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1728/3430] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:24:33 2022] DELETE /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:24:33.916683 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-475f804d-6114-4500-ac18-0244c16e62de tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.162"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:33.921930 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-475f804d-6114-4500-ac18-0244c16e62de tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:33.936414 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-475f804d-6114-4500-ac18-0244c16e62de tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:33.941731 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-475f804d-6114-4500-ac18-0244c16e62de tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:33.945672 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-475f804d-6114-4500-ac18-0244c16e62de tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:33.946541 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-475f804d-6114-4500-ac18-0244c16e62de tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:34.022075 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-475f804d-6114-4500-ac18-0244c16e62de tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Acquired lock "refresh_cache-0e94ea78-2ac3-4192-aa5c-165b70d7b083" {{(pid=119474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 01:24:34.627291 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-12854fda-a0a4-4af8-bef2-69b3d5e951ac tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:34.628936 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-12854fda-a0a4-4af8-bef2-69b3d5e951ac tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:34.640713 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12854fda-a0a4-4af8-bef2-69b3d5e951ac tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:34.642265 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12854fda-a0a4-4af8-bef2-69b3d5e951ac tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:34.644358 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12854fda-a0a4-4af8-bef2-69b3d5e951ac tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:34.645020 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12854fda-a0a4-4af8-bef2-69b3d5e951ac tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:35.505803 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-12854fda-a0a4-4af8-bef2-69b3d5e951ac tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:35.518014 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-12854fda-a0a4-4af8-bef2-69b3d5e951ac tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.899818 Jul 31 01:24:35.518618 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1729/3431] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:34 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:35.536465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-437fee2d-a2ff-4bec-98b7-34f1b53ac6e6 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:35.537492 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-437fee2d-a2ff-4bec-98b7-34f1b53ac6e6 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:35.544158 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-437fee2d-a2ff-4bec-98b7-34f1b53ac6e6 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:35.545112 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-437fee2d-a2ff-4bec-98b7-34f1b53ac6e6 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:35.546499 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-437fee2d-a2ff-4bec-98b7-34f1b53ac6e6 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:35.547905 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-437fee2d-a2ff-4bec-98b7-34f1b53ac6e6 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:36.050049 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-437fee2d-a2ff-4bec-98b7-34f1b53ac6e6 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:36.066948 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-437fee2d-a2ff-4bec-98b7-34f1b53ac6e6 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.546531 Jul 31 01:24:36.068242 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1730/3432] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:35 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:36.086615 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8ee1b22f-9887-43eb-8935-b01e772a97fd tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:36.088386 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8ee1b22f-9887-43eb-8935-b01e772a97fd tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:36.100124 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ee1b22f-9887-43eb-8935-b01e772a97fd tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:36.101416 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ee1b22f-9887-43eb-8935-b01e772a97fd tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:36.103206 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ee1b22f-9887-43eb-8935-b01e772a97fd tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:36.104198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ee1b22f-9887-43eb-8935-b01e772a97fd tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:36.270074 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8ee1b22f-9887-43eb-8935-b01e772a97fd tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b070b0ba7349038f808de839eca450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1254dde3a2f46328c18a7fec70d4d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:36.285207 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8ee1b22f-9887-43eb-8935-b01e772a97fd tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59" status: 200 len: 1265 microversion: 2.1 time: 0.214112 Jul 31 01:24:36.285842 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1731/3433] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:36 2022] GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:36.405759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-fbcc80f0-5605-4891-a302-b739d587bcbb req-71354cc4-6c29-4079-9089-b1fa31c45e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b03ee7-a722-4b4c-a4f0-af7da2265318", "name": "network-vif-deleted", "tag": "2863df11-0199-454e-97de-0d7aefc5ae04"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:36.430773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-fbcc80f0-5605-4891-a302-b739d587bcbb req-71354cc4-6c29-4079-9089-b1fa31c45e0d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:36.431913 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-fbcc80f0-5605-4891-a302-b739d587bcbb req-71354cc4-6c29-4079-9089-b1fa31c45e0d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:36.464328 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-fbcc80f0-5605-4891-a302-b739d587bcbb req-71354cc4-6c29-4079-9089-b1fa31c45e0d service nova] Creating event network-vif-deleted:2863df11-0199-454e-97de-0d7aefc5ae04 for instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 on n-h1-master-1 Jul 31 01:24:36.469622 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-fbcc80f0-5605-4891-a302-b739d587bcbb req-71354cc4-6c29-4079-9089-b1fa31c45e0d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068174 Jul 31 01:24:36.470793 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1732/3434] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:24:36.541150 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-29aceafe-80f0-4f8a-9f61-25f6dad8613f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:36.542348 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-29aceafe-80f0-4f8a-9f61-25f6dad8613f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:36.553657 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29aceafe-80f0-4f8a-9f61-25f6dad8613f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:36.554128 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29aceafe-80f0-4f8a-9f61-25f6dad8613f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:36.554981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29aceafe-80f0-4f8a-9f61-25f6dad8613f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:36.563327 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29aceafe-80f0-4f8a-9f61-25f6dad8613f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:36.966877 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-29aceafe-80f0-4f8a-9f61-25f6dad8613f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:36.976404 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-29aceafe-80f0-4f8a-9f61-25f6dad8613f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.439815 Jul 31 01:24:36.980188 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1733/3435] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:36 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:37.039135 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-475f804d-6114-4500-ac18-0244c16e62de tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Building network info cache for instance {{(pid=119474) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 31 01:24:37.066481 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-63066a9b-bed4-426d-9140-357fb1b3fc78 req-4b73e9f3-5bfd-4f6b-adfd-85e0f93ed69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e94ea78-2ac3-4192-aa5c-165b70d7b083", "tag": "da0517f6-7df8-42a4-8ee4-a90c7b34261b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:37.084626 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-63066a9b-bed4-426d-9140-357fb1b3fc78 req-4b73e9f3-5bfd-4f6b-adfd-85e0f93ed69c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:37.085336 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-63066a9b-bed4-426d-9140-357fb1b3fc78 req-4b73e9f3-5bfd-4f6b-adfd-85e0f93ed69c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:37.101628 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:37.110482 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-63066a9b-bed4-426d-9140-357fb1b3fc78 req-4b73e9f3-5bfd-4f6b-adfd-85e0f93ed69c service nova] Creating event network-changed:da0517f6-7df8-42a4-8ee4-a90c7b34261b for instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083 on n-h1-master-1 Jul 31 01:24:37.116364 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-63066a9b-bed4-426d-9140-357fb1b3fc78 req-4b73e9f3-5bfd-4f6b-adfd-85e0f93ed69c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054682 Jul 31 01:24:37.117742 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1734/3436] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:37.125030 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8a854d44-b7b3-4527-b16c-2d3855ddd933 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:37.126706 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8a854d44-b7b3-4527-b16c-2d3855ddd933 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:37.135554 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a854d44-b7b3-4527-b16c-2d3855ddd933 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:37.136520 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a854d44-b7b3-4527-b16c-2d3855ddd933 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:37.137852 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a854d44-b7b3-4527-b16c-2d3855ddd933 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:37.138789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a854d44-b7b3-4527-b16c-2d3855ddd933 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:37.620409 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8a854d44-b7b3-4527-b16c-2d3855ddd933 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:37.629196 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8a854d44-b7b3-4527-b16c-2d3855ddd933 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.510015 Jul 31 01:24:37.630426 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1735/3437] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:37 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:37.635444 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-42c28f25-4bb1-4c92-8407-e256e4ddf6b5 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:37.636880 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-42c28f25-4bb1-4c92-8407-e256e4ddf6b5 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:37.643486 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42c28f25-4bb1-4c92-8407-e256e4ddf6b5 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:37.644328 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42c28f25-4bb1-4c92-8407-e256e4ddf6b5 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:37.645429 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42c28f25-4bb1-4c92-8407-e256e4ddf6b5 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:37.646056 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42c28f25-4bb1-4c92-8407-e256e4ddf6b5 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:37.805129 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-42c28f25-4bb1-4c92-8407-e256e4ddf6b5 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b070b0ba7349038f808de839eca450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1254dde3a2f46328c18a7fec70d4d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:37.821598 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-42c28f25-4bb1-4c92-8407-e256e4ddf6b5 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59" status: 200 len: 1271 microversion: 2.1 time: 0.189731 Jul 31 01:24:37.824341 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1736/3438] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:37 2022] GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 => generated 1271 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:38.003727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7a2f2a28-0402-482a-9f62-6622afead980 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:38.004497 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7a2f2a28-0402-482a-9f62-6622afead980 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:38.011768 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a2f2a28-0402-482a-9f62-6622afead980 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:38.013385 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a2f2a28-0402-482a-9f62-6622afead980 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:38.014575 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a2f2a28-0402-482a-9f62-6622afead980 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:38.015203 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a2f2a28-0402-482a-9f62-6622afead980 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:38.375980 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7a2f2a28-0402-482a-9f62-6622afead980 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:38.383622 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7a2f2a28-0402-482a-9f62-6622afead980 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.389119 Jul 31 01:24:38.398166 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1737/3439] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:37 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:38.432462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-475f804d-6114-4500-ac18-0244c16e62de tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Updating instance_info_cache with network_info: [{"id": "da0517f6-7df8-42a4-8ee4-a90c7b34261b", "address": "fa:16:3e:fe:f7:e4", "network": {"id": "02e0c218-00bf-47b5-abe5-e48ac4dced0a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-439471096-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9d6baeb89380488c9ef70003b86c5815", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapda0517f6-7d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119474) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 31 01:24:38.458305 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-475f804d-6114-4500-ac18-0244c16e62de tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Releasing lock "refresh_cache-0e94ea78-2ac3-4192-aa5c-165b70d7b083" {{(pid=119474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 01:24:38.460614 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-475f804d-6114-4500-ac18-0244c16e62de tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "POST /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083/action" status: 202 len: 0 microversion: 2.1 time: 4.552857 Jul 31 01:24:38.461942 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1703/3440] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:24:33 2022] POST /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083/action => generated 0 bytes in 4555 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 31 01:24:38.470401 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4d669852-2a29-405f-adae-36c9b89cefcf tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '.version_select at 0x7fede46eae50>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:38.652729 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b8bb474e-33a5-415e-86e8-b4017db26d52 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:38.653472 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b8bb474e-33a5-415e-86e8-b4017db26d52 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:38.667865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b8bb474e-33a5-415e-86e8-b4017db26d52 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:38.668788 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b8bb474e-33a5-415e-86e8-b4017db26d52 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:38.670397 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b8bb474e-33a5-415e-86e8-b4017db26d52 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:38.671133 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b8bb474e-33a5-415e-86e8-b4017db26d52 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:39.086295 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4d669852-2a29-405f-adae-36c9b89cefcf tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ips/ac8af163-6ac8-4c64-9c95-b76dfbfe96c0" status: 200 len: 185 microversion: 2.1 time: 0.620101 Jul 31 01:24:39.086921 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1738/3441] 10.222.0.45 () {58 vars in 1260 bytes} [Sun Jul 31 01:24:38 2022] GET /compute/v2.1/os-floating-ips/ac8af163-6ac8-4c64-9c95-b76dfbfe96c0 => generated 185 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:39.098321 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fff48df8-37ce-44ff-b607-bbb01bf61ff0 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:39.099192 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fff48df8-37ce-44ff-b607-bbb01bf61ff0 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:39.110198 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b8bb474e-33a5-415e-86e8-b4017db26d52 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:39.112824 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fff48df8-37ce-44ff-b607-bbb01bf61ff0 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:39.114666 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fff48df8-37ce-44ff-b607-bbb01bf61ff0 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:39.116093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fff48df8-37ce-44ff-b607-bbb01bf61ff0 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:39.117992 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fff48df8-37ce-44ff-b607-bbb01bf61ff0 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:39.119393 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b8bb474e-33a5-415e-86e8-b4017db26d52 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.471918 Jul 31 01:24:39.119990 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1704/3442] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:38 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:39.130571 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-daad2bce-09d8-4868-8896-0384ad422384 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.162"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:40.117446 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-daad2bce-09d8-4868-8896-0384ad422384 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:40.128031 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fff48df8-37ce-44ff-b607-bbb01bf61ff0 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b070b0ba7349038f808de839eca450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1254dde3a2f46328c18a7fec70d4d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:40.139172 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-daad2bce-09d8-4868-8896-0384ad422384 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:40.142296 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-daad2bce-09d8-4868-8896-0384ad422384 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:40.143380 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-daad2bce-09d8-4868-8896-0384ad422384 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:40.144964 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fff48df8-37ce-44ff-b607-bbb01bf61ff0 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59" status: 200 len: 1313 microversion: 2.1 time: 1.056866 Jul 31 01:24:40.145842 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-daad2bce-09d8-4868-8896-0384ad422384 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:40.147456 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1739/3443] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:39 2022] GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 => generated 1313 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:40.160931 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7dba95b5-3d29-4bd1-b011-b971b2125161 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:40.163697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7dba95b5-3d29-4bd1-b011-b971b2125161 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:40.183848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7dba95b5-3d29-4bd1-b011-b971b2125161 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:40.186188 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7dba95b5-3d29-4bd1-b011-b971b2125161 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:40.190418 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7dba95b5-3d29-4bd1-b011-b971b2125161 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:40.191024 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7dba95b5-3d29-4bd1-b011-b971b2125161 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:40.561082 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7dba95b5-3d29-4bd1-b011-b971b2125161 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:40.571930 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7dba95b5-3d29-4bd1-b011-b971b2125161 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.419004 Jul 31 01:24:40.587157 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1740/3444] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:40 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:40.595644 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-950115c2-9549-4af5-8a46-2175ea9963de req-b0aabe21-a8e6-4299-b8bc-5c0e2afe1b42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce71e2b-332a-4865-99ba-80dccb338e59", "tag": "641d2620-1b72-424a-95f6-218a2c4723ce"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:40.609347 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-daad2bce-09d8-4868-8896-0384ad422384 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Acquired lock "refresh_cache-0e94ea78-2ac3-4192-aa5c-165b70d7b083" {{(pid=119474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 01:24:40.625200 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-950115c2-9549-4af5-8a46-2175ea9963de req-b0aabe21-a8e6-4299-b8bc-5c0e2afe1b42 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:40.625200 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-950115c2-9549-4af5-8a46-2175ea9963de req-b0aabe21-a8e6-4299-b8bc-5c0e2afe1b42 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:40.646005 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-950115c2-9549-4af5-8a46-2175ea9963de req-b0aabe21-a8e6-4299-b8bc-5c0e2afe1b42 service nova] Creating event network-changed:641d2620-1b72-424a-95f6-218a2c4723ce for instance bce71e2b-332a-4865-99ba-80dccb338e59 on n-h1-master-1 Jul 31 01:24:40.652887 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-950115c2-9549-4af5-8a46-2175ea9963de req-b0aabe21-a8e6-4299-b8bc-5c0e2afe1b42 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064215 Jul 31 01:24:40.653794 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1741/3445] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:40.668229 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6dee79f6-fc80-4ff1-a428-b9fca73312f3 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:40.668948 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6dee79f6-fc80-4ff1-a428-b9fca73312f3 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:40.679496 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6dee79f6-fc80-4ff1-a428-b9fca73312f3 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:40.679956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6dee79f6-fc80-4ff1-a428-b9fca73312f3 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:40.683009 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6dee79f6-fc80-4ff1-a428-b9fca73312f3 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:40.683493 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6dee79f6-fc80-4ff1-a428-b9fca73312f3 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:40.996895 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6dee79f6-fc80-4ff1-a428-b9fca73312f3 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:41.030415 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6dee79f6-fc80-4ff1-a428-b9fca73312f3 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.374963 Jul 31 01:24:41.030983 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1742/3446] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:40 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:41.041017 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c4530fbb-8eaf-440d-836d-ea0498e92911 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:41.052182 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c4530fbb-8eaf-440d-836d-ea0498e92911 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:41.076087 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c4530fbb-8eaf-440d-836d-ea0498e92911 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:41.076766 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c4530fbb-8eaf-440d-836d-ea0498e92911 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:41.077769 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c4530fbb-8eaf-440d-836d-ea0498e92911 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:41.078424 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c4530fbb-8eaf-440d-836d-ea0498e92911 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:41.192689 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c4530fbb-8eaf-440d-836d-ea0498e92911 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 202 len: 0 microversion: 2.1 time: 0.155262 Jul 31 01:24:41.194514 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1743/3447] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:24:41 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:24:41.200910 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9f7fa8d0-d4ea-4e1f-8679-73b6a136e225 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:41.202101 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9f7fa8d0-d4ea-4e1f-8679-73b6a136e225 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:41.209671 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9f7fa8d0-d4ea-4e1f-8679-73b6a136e225 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:41.210593 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9f7fa8d0-d4ea-4e1f-8679-73b6a136e225 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:41.211729 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9f7fa8d0-d4ea-4e1f-8679-73b6a136e225 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:41.212462 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9f7fa8d0-d4ea-4e1f-8679-73b6a136e225 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:41.582674 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9f7fa8d0-d4ea-4e1f-8679-73b6a136e225 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b070b0ba7349038f808de839eca450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1254dde3a2f46328c18a7fec70d4d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:41.600354 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9f7fa8d0-d4ea-4e1f-8679-73b6a136e225 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59" status: 200 len: 1313 microversion: 2.1 time: 0.404115 Jul 31 01:24:41.601629 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1744/3448] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:41 2022] GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:41.608269 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-af0fd3ea-f180-4fa6-b33f-5cd394728019 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:41.609171 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-af0fd3ea-f180-4fa6-b33f-5cd394728019 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:41.626646 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af0fd3ea-f180-4fa6-b33f-5cd394728019 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:41.627522 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af0fd3ea-f180-4fa6-b33f-5cd394728019 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:41.628615 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af0fd3ea-f180-4fa6-b33f-5cd394728019 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:41.629548 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af0fd3ea-f180-4fa6-b33f-5cd394728019 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:41.916261 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-af0fd3ea-f180-4fa6-b33f-5cd394728019 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:41.927283 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-af0fd3ea-f180-4fa6-b33f-5cd394728019 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1672 microversion: 2.1 time: 0.323977 Jul 31 01:24:41.930608 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1745/3449] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:41 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1672 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:41.951230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ff0710f3-d889-4beb-9761-f217d3daabe9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:41.952029 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ff0710f3-d889-4beb-9761-f217d3daabe9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:41.968787 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff0710f3-d889-4beb-9761-f217d3daabe9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:41.969345 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff0710f3-d889-4beb-9761-f217d3daabe9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:41.970392 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff0710f3-d889-4beb-9761-f217d3daabe9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:41.970998 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff0710f3-d889-4beb-9761-f217d3daabe9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:42.000382 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-daad2bce-09d8-4868-8896-0384ad422384 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Building network info cache for instance {{(pid=119474) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 31 01:24:42.235560 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ff0710f3-d889-4beb-9761-f217d3daabe9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:42.252974 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ff0710f3-d889-4beb-9761-f217d3daabe9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.320632 Jul 31 01:24:42.254690 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1746/3450] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:41 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:42.260594 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-11a16b0c-8ca3-419a-b4c5-804a8b01a140 req-280d93e6-12eb-4433-8340-1dc6e03765b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e94ea78-2ac3-4192-aa5c-165b70d7b083", "tag": "da0517f6-7df8-42a4-8ee4-a90c7b34261b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:42.281631 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-11a16b0c-8ca3-419a-b4c5-804a8b01a140 req-280d93e6-12eb-4433-8340-1dc6e03765b3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:42.283133 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-11a16b0c-8ca3-419a-b4c5-804a8b01a140 req-280d93e6-12eb-4433-8340-1dc6e03765b3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:42.298435 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-11a16b0c-8ca3-419a-b4c5-804a8b01a140 req-280d93e6-12eb-4433-8340-1dc6e03765b3 service nova] Creating event network-changed:da0517f6-7df8-42a4-8ee4-a90c7b34261b for instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083 on n-h1-master-1 Jul 31 01:24:42.306121 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-11a16b0c-8ca3-419a-b4c5-804a8b01a140 req-280d93e6-12eb-4433-8340-1dc6e03765b3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049189 Jul 31 01:24:42.308746 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1747/3451] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:42.325403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6b864cf6-721d-4800-9fdb-8a7e33b5d848 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:42.328138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6b864cf6-721d-4800-9fdb-8a7e33b5d848 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:42.371993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b864cf6-721d-4800-9fdb-8a7e33b5d848 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:42.371993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b864cf6-721d-4800-9fdb-8a7e33b5d848 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:42.371993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b864cf6-721d-4800-9fdb-8a7e33b5d848 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:42.371993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b864cf6-721d-4800-9fdb-8a7e33b5d848 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:42.755245 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:43.158733 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6b864cf6-721d-4800-9fdb-8a7e33b5d848 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:43.170314 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6b864cf6-721d-4800-9fdb-8a7e33b5d848 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.858106 Jul 31 01:24:43.171502 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1748/3452] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:42 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:43.178451 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f7dd15bd-dc33-46db-b131-986a2df0aba8 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:43.179779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f7dd15bd-dc33-46db-b131-986a2df0aba8 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:43.192563 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7dd15bd-dc33-46db-b131-986a2df0aba8 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:43.193143 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7dd15bd-dc33-46db-b131-986a2df0aba8 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:43.194932 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7dd15bd-dc33-46db-b131-986a2df0aba8 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:43.196130 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7dd15bd-dc33-46db-b131-986a2df0aba8 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:43.715047 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f7dd15bd-dc33-46db-b131-986a2df0aba8 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b070b0ba7349038f808de839eca450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1254dde3a2f46328c18a7fec70d4d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:43.737067 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f7dd15bd-dc33-46db-b131-986a2df0aba8 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59" status: 200 len: 1313 microversion: 2.1 time: 0.562513 Jul 31 01:24:43.738644 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1749/3453] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:43 2022] GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:43.763510 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7fc570c9-f723-48ee-93b2-45859ba1224f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:43.770969 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7fc570c9-f723-48ee-93b2-45859ba1224f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:43.782591 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fc570c9-f723-48ee-93b2-45859ba1224f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:43.783576 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fc570c9-f723-48ee-93b2-45859ba1224f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:43.787149 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fc570c9-f723-48ee-93b2-45859ba1224f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:43.789669 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fc570c9-f723-48ee-93b2-45859ba1224f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:43.816377 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=56 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:44.009213 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-daad2bce-09d8-4868-8896-0384ad422384 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Updating instance_info_cache with network_info: [{"id": "da0517f6-7df8-42a4-8ee4-a90c7b34261b", "address": "fa:16:3e:fe:f7:e4", "network": {"id": "02e0c218-00bf-47b5-abe5-e48ac4dced0a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-439471096-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9d6baeb89380488c9ef70003b86c5815", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapda0517f6-7d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119474) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 31 01:24:44.017993 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=4,nova_cell1:RELEASE=4,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:44.032841 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-daad2bce-09d8-4868-8896-0384ad422384 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Releasing lock "refresh_cache-0e94ea78-2ac3-4192-aa5c-165b70d7b083" {{(pid=119474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 01:24:44.033951 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-daad2bce-09d8-4868-8896-0384ad422384 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "POST /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083/action" status: 202 len: 0 microversion: 2.1 time: 4.911840 Jul 31 01:24:44.034849 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1705/3454] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:24:39 2022] POST /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083/action => generated 0 bytes in 4913 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 31 01:24:44.045265 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-139dee66-c93d-44a5-a214-1a3129452a4f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:44.045933 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-139dee66-c93d-44a5-a214-1a3129452a4f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:44.066658 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-139dee66-c93d-44a5-a214-1a3129452a4f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:44.071712 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-139dee66-c93d-44a5-a214-1a3129452a4f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:44.074938 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-139dee66-c93d-44a5-a214-1a3129452a4f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:44.076376 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-139dee66-c93d-44a5-a214-1a3129452a4f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:44.688540 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7fc570c9-f723-48ee-93b2-45859ba1224f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:44.700922 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7fc570c9-f723-48ee-93b2-45859ba1224f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1677 microversion: 2.1 time: 0.960785 Jul 31 01:24:44.701815 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1750/3455] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:43 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1677 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:44.707045 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f92dadfc-b826-43af-8f67-1412d6ebe6f4 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:44.707800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f92dadfc-b826-43af-8f67-1412d6ebe6f4 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:44.714864 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f92dadfc-b826-43af-8f67-1412d6ebe6f4 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:44.715591 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f92dadfc-b826-43af-8f67-1412d6ebe6f4 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:44.724782 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f92dadfc-b826-43af-8f67-1412d6ebe6f4 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:44.725401 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f92dadfc-b826-43af-8f67-1412d6ebe6f4 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:44.727266 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-139dee66-c93d-44a5-a214-1a3129452a4f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:44.735007 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-139dee66-c93d-44a5-a214-1a3129452a4f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.699349 Jul 31 01:24:44.735851 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1706/3456] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:44 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:44.740104 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b3198ed0-4b67-408d-b0dd-cbf9e53276c0 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:44.740714 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b3198ed0-4b67-408d-b0dd-cbf9e53276c0 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:44.741040 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-f92dadfc-b826-43af-8f67-1412d6ebe6f4 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] HTTP exception thrown: Instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 could not be found. Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f92dadfc-b826-43af-8f67-1412d6ebe6f4 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Request method failure captured: Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318 HTTP/1.1 Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dmL5eUWSDT_M26c56oWS00BkDdrJ_z7Ku045FmSMVe4jLtYjk5TLCJIbzLbFAy8OMBrx2T5TrY1Duz4tR1Wz4XLXFQnVkTYI2V3XKZ9BGnzwGk2pXwMy2DEs6r6uNreUFkkWdFqLwD4RqQfJ9i1FuDzlpiUPHywDHN1TzRaXsFa_6s Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 9d6baeb89380488c9ef70003b86c5815 Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1957096628 Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9d6baeb89380488c9ef70003b86c5815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9d6baeb89380488c9ef70003b86c5815"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9d6baeb89380488c9ef70003b86c5815"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9d6baeb89380488c9ef70003b86c5815", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1957096628 Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 9d6baeb89380488c9ef70003b86c5815 Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1957096628 Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-FloatingIPsAssociationTestJSON-1957096628-project Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 46a58b52653f40e696d7d0a09d7e48e7 Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1957096628-project Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 could not be found. Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '35b03ee7-a722-4b4c-a4f0-af7da2265318'} Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 could not be found. Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:24:44.742708 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:24:44.749049 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 could not be found. Jul 31 01:24:44.749049 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:44.749049 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:44.749049 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:44.749049 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:44.749049 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:44.749049 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:44.749049 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:44.749049 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:44.749049 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 could not be found. Jul 31 01:24:44.749049 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:44.749049 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f92dadfc-b826-43af-8f67-1412d6ebe6f4 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Returning 404 to user: Instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:44.749049 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f92dadfc-b826-43af-8f67-1412d6ebe6f4 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "DELETE /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318" status: 404 len: 111 microversion: 2.1 time: 0.041047 Jul 31 01:24:44.751610 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3198ed0-4b67-408d-b0dd-cbf9e53276c0 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:44.752099 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3198ed0-4b67-408d-b0dd-cbf9e53276c0 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:44.753090 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3198ed0-4b67-408d-b0dd-cbf9e53276c0 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:44.753535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3198ed0-4b67-408d-b0dd-cbf9e53276c0 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:44.759511 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1751/3457] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:24:44 2022] DELETE /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:24:44.770473 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3167b3a0-b85c-40e7-9101-6d163cd3d75f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:44.772302 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3167b3a0-b85c-40e7-9101-6d163cd3d75f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 35b03ee7-a722-4b4c-a4f0-af7da2265318] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:44.778958 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3167b3a0-b85c-40e7-9101-6d163cd3d75f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:44.779716 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3167b3a0-b85c-40e7-9101-6d163cd3d75f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:44.781002 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3167b3a0-b85c-40e7-9101-6d163cd3d75f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:44.781704 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3167b3a0-b85c-40e7-9101-6d163cd3d75f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:44.800501 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-3167b3a0-b85c-40e7-9101-6d163cd3d75f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] HTTP exception thrown: Instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 could not be found. Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3167b3a0-b85c-40e7-9101-6d163cd3d75f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Request method failure captured: Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318 HTTP/1.1 Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dmL5eUWSDT_M26c56oWS00BkDdrJ_z7Ku045FmSMVe4jLtYjk5TLCJIbzLbFAy8OMBrx2T5TrY1Duz4tR1Wz4XLXFQnVkTYI2V3XKZ9BGnzwGk2pXwMy2DEs6r6uNreUFkkWdFqLwD4RqQfJ9i1FuDzlpiUPHywDHN1TzRaXsFa_6s Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 9d6baeb89380488c9ef70003b86c5815 Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1957096628 Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9d6baeb89380488c9ef70003b86c5815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9d6baeb89380488c9ef70003b86c5815"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9d6baeb89380488c9ef70003b86c5815"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9d6baeb89380488c9ef70003b86c5815", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1957096628 Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 9d6baeb89380488c9ef70003b86c5815 Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1957096628 Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-FloatingIPsAssociationTestJSON-1957096628-project Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 46a58b52653f40e696d7d0a09d7e48e7 Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1957096628-project Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 could not be found. Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '35b03ee7-a722-4b4c-a4f0-af7da2265318'} Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 could not be found. Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 could not be found. Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:44.803214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:44.809143 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:44.809143 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:44.809143 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:44.809143 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:44.809143 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:44.809143 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:44.809143 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 could not be found. Jul 31 01:24:44.809143 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:44.809143 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3167b3a0-b85c-40e7-9101-6d163cd3d75f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Returning 404 to user: Instance 35b03ee7-a722-4b4c-a4f0-af7da2265318 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:44.809143 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3167b3a0-b85c-40e7-9101-6d163cd3d75f tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318" status: 404 len: 111 microversion: 2.1 time: 0.044187 Jul 31 01:24:44.809143 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1752/3458] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:44 2022] GET /compute/v2.1/servers/35b03ee7-a722-4b4c-a4f0-af7da2265318 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:24:44.813837 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0600ebfd-2bf3-46c8-9a6f-c3bf20f610b6 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:44.814459 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0600ebfd-2bf3-46c8-9a6f-c3bf20f610b6 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:44.820969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0600ebfd-2bf3-46c8-9a6f-c3bf20f610b6 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:44.821426 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0600ebfd-2bf3-46c8-9a6f-c3bf20f610b6 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:44.822203 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0600ebfd-2bf3-46c8-9a6f-c3bf20f610b6 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:44.822648 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0600ebfd-2bf3-46c8-9a6f-c3bf20f610b6 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:44.964316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b3198ed0-4b67-408d-b0dd-cbf9e53276c0 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:44.973782 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b3198ed0-4b67-408d-b0dd-cbf9e53276c0 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.237093 Jul 31 01:24:44.974804 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1707/3459] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:44 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:44.980621 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1c8927fc-cc36-4369-8523-bea5bcbe4744 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '.version_select at 0x7fede44fe310>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:45.045883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0600ebfd-2bf3-46c8-9a6f-c3bf20f610b6 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b070b0ba7349038f808de839eca450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1254dde3a2f46328c18a7fec70d4d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:45.054386 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0600ebfd-2bf3-46c8-9a6f-c3bf20f610b6 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59" status: 200 len: 1313 microversion: 2.1 time: 0.243999 Jul 31 01:24:45.054870 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1753/3460] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:44 2022] GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:45.519553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-0ef2b272-503b-4547-a0af-3d0374287cc0 req-77e80844-7cdc-4879-b4f7-ede33f2af9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce71e2b-332a-4865-99ba-80dccb338e59", "name": "network-vif-plugged", "status": "completed", "tag": "641d2620-1b72-424a-95f6-218a2c4723ce"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:45.548442 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0ef2b272-503b-4547-a0af-3d0374287cc0 req-77e80844-7cdc-4879-b4f7-ede33f2af9d9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:45.551001 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0ef2b272-503b-4547-a0af-3d0374287cc0 req-77e80844-7cdc-4879-b4f7-ede33f2af9d9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:45.598261 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:45.608846 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-0ef2b272-503b-4547-a0af-3d0374287cc0 req-77e80844-7cdc-4879-b4f7-ede33f2af9d9 service nova] Creating event network-vif-plugged:641d2620-1b72-424a-95f6-218a2c4723ce for instance bce71e2b-332a-4865-99ba-80dccb338e59 on n-h1-master-1 Jul 31 01:24:45.622381 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-0ef2b272-503b-4547-a0af-3d0374287cc0 req-77e80844-7cdc-4879-b4f7-ede33f2af9d9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107455 Jul 31 01:24:45.624030 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1754/3461] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:45.727230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-47e3f468-658c-451e-8c5a-42a8b09718fe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:45.727957 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-47e3f468-658c-451e-8c5a-42a8b09718fe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:45.744863 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47e3f468-658c-451e-8c5a-42a8b09718fe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:45.745742 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47e3f468-658c-451e-8c5a-42a8b09718fe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:45.746743 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47e3f468-658c-451e-8c5a-42a8b09718fe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:45.747370 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47e3f468-658c-451e-8c5a-42a8b09718fe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:46.092084 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-47e3f468-658c-451e-8c5a-42a8b09718fe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:46.102636 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-47e3f468-658c-451e-8c5a-42a8b09718fe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.381023 Jul 31 01:24:46.104494 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1755/3462] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:45 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:46.110098 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-31493900-170f-4c4c-992b-861f65c9be8b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:46.111043 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-31493900-170f-4c4c-992b-861f65c9be8b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:46.118161 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31493900-170f-4c4c-992b-861f65c9be8b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:46.118750 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31493900-170f-4c4c-992b-861f65c9be8b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:46.119671 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31493900-170f-4c4c-992b-861f65c9be8b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:46.120863 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31493900-170f-4c4c-992b-861f65c9be8b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:46.402389 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1c8927fc-cc36-4369-8523-bea5bcbe4744 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/ac8af163-6ac8-4c64-9c95-b76dfbfe96c0" status: 202 len: 0 microversion: 2.1 time: 1.426167 Jul 31 01:24:46.410410 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1708/3463] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:24:44 2022] DELETE /compute/v2.1/os-floating-ips/ac8af163-6ac8-4c64-9c95-b76dfbfe96c0 => generated 0 bytes in 1435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:24:46.411525 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-31493900-170f-4c4c-992b-861f65c9be8b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:46.416583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-304b812a-9edb-4563-88b4-1d0a34b19406 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:46.417528 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-304b812a-9edb-4563-88b4-1d0a34b19406 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:46.427893 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-31493900-170f-4c4c-992b-861f65c9be8b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.321525 Jul 31 01:24:46.442993 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-304b812a-9edb-4563-88b4-1d0a34b19406 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:46.444311 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-304b812a-9edb-4563-88b4-1d0a34b19406 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:46.447227 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-304b812a-9edb-4563-88b4-1d0a34b19406 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:46.450930 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-304b812a-9edb-4563-88b4-1d0a34b19406 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:46.463238 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1756/3464] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:46 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:46.468398 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-96265add-29f1-4494-a969-f3d31fc9cf51 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:46.469030 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-96265add-29f1-4494-a969-f3d31fc9cf51 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:46.487768 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96265add-29f1-4494-a969-f3d31fc9cf51 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:46.488609 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96265add-29f1-4494-a969-f3d31fc9cf51 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:46.489647 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96265add-29f1-4494-a969-f3d31fc9cf51 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:46.496343 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96265add-29f1-4494-a969-f3d31fc9cf51 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:46.752896 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-96265add-29f1-4494-a969-f3d31fc9cf51 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b070b0ba7349038f808de839eca450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1254dde3a2f46328c18a7fec70d4d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:46.758731 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-304b812a-9edb-4563-88b4-1d0a34b19406 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:46.770107 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-304b812a-9edb-4563-88b4-1d0a34b19406 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.358266 Jul 31 01:24:46.774633 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-96265add-29f1-4494-a969-f3d31fc9cf51 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59" status: 200 len: 1313 microversion: 2.1 time: 0.310061 Jul 31 01:24:46.775531 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1709/3465] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:46 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:46.780609 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1757/3466] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:46 2022] GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:46.785021 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5ec75acb-ff1a-42e9-8d70-760771ea316b tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:46.788023 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5ec75acb-ff1a-42e9-8d70-760771ea316b tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:46.802252 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ec75acb-ff1a-42e9-8d70-760771ea316b tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:46.802729 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ec75acb-ff1a-42e9-8d70-760771ea316b tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:46.803546 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ec75acb-ff1a-42e9-8d70-760771ea316b tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:46.803995 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ec75acb-ff1a-42e9-8d70-760771ea316b tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:46.834157 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5ec75acb-ff1a-42e9-8d70-760771ea316b tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:24:46.925853 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5ec75acb-ff1a-42e9-8d70-760771ea316b tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 204 len: 0 microversion: 2.1 time: 0.148289 Jul 31 01:24:46.926600 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1710/3467] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:24:46 2022] DELETE /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:24:46.937292 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-730b29c5-9cdf-40b5-a13a-c8e109ae004e tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:46.938134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-730b29c5-9cdf-40b5-a13a-c8e109ae004e tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:46.949086 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-730b29c5-9cdf-40b5-a13a-c8e109ae004e tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:46.950259 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-730b29c5-9cdf-40b5-a13a-c8e109ae004e tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:46.958179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-730b29c5-9cdf-40b5-a13a-c8e109ae004e tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:46.958828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-730b29c5-9cdf-40b5-a13a-c8e109ae004e tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:47.193930 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-730b29c5-9cdf-40b5-a13a-c8e109ae004e tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:47.204238 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-730b29c5-9cdf-40b5-a13a-c8e109ae004e tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 200 len: 1526 microversion: 2.1 time: 0.271091 Jul 31 01:24:47.205571 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1758/3468] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:46 2022] GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 1526 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:47.471705 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8b61c88b-6105-484b-b572-7e309f840ea4 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:47.473377 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8b61c88b-6105-484b-b572-7e309f840ea4 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:47.481187 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b61c88b-6105-484b-b572-7e309f840ea4 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:47.481630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b61c88b-6105-484b-b572-7e309f840ea4 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:47.482466 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b61c88b-6105-484b-b572-7e309f840ea4 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:47.483105 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b61c88b-6105-484b-b572-7e309f840ea4 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:47.737087 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8b61c88b-6105-484b-b572-7e309f840ea4 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:47.748805 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8b61c88b-6105-484b-b572-7e309f840ea4 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.279319 Jul 31 01:24:47.758499 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1711/3469] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:47 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:47.803937 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f4e96366-e445-4e4a-99dc-1d239b2b1f44 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:47.806170 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f4e96366-e445-4e4a-99dc-1d239b2b1f44 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:47.817940 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f4e96366-e445-4e4a-99dc-1d239b2b1f44 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:47.819033 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f4e96366-e445-4e4a-99dc-1d239b2b1f44 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:47.820690 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f4e96366-e445-4e4a-99dc-1d239b2b1f44 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:47.821720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f4e96366-e445-4e4a-99dc-1d239b2b1f44 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:47.829256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5bb4322f-2307-494d-84c9-e2c0020132ab tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:47.834864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5bb4322f-2307-494d-84c9-e2c0020132ab tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:47.853178 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5bb4322f-2307-494d-84c9-e2c0020132ab tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:47.854050 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5bb4322f-2307-494d-84c9-e2c0020132ab tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:47.855133 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5bb4322f-2307-494d-84c9-e2c0020132ab tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:47.855887 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5bb4322f-2307-494d-84c9-e2c0020132ab tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:48.485703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f4e96366-e445-4e4a-99dc-1d239b2b1f44 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:48.494635 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f4e96366-e445-4e4a-99dc-1d239b2b1f44 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.701154 Jul 31 01:24:48.497557 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1759/3470] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:47 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:48.505021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bc0a5e73-b222-4e48-b7de-eef31b499647 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:48.509102 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5bb4322f-2307-494d-84c9-e2c0020132ab tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b070b0ba7349038f808de839eca450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1254dde3a2f46328c18a7fec70d4d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:48.512615 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bc0a5e73-b222-4e48-b7de-eef31b499647 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:48.527881 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5bb4322f-2307-494d-84c9-e2c0020132ab tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59" status: 200 len: 1498 microversion: 2.1 time: 0.727928 Jul 31 01:24:48.530381 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc0a5e73-b222-4e48-b7de-eef31b499647 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:48.532078 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc0a5e73-b222-4e48-b7de-eef31b499647 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:48.532867 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1712/3471] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:47 2022] GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 => generated 1498 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:48.533633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc0a5e73-b222-4e48-b7de-eef31b499647 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:48.534322 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc0a5e73-b222-4e48-b7de-eef31b499647 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:48.557669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ba5fac34-48df-4ad4-b5f0-45b004bd712d tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:48.604089 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.compute.server_groups [None req-ba5fac34-48df-4ad4-b5f0-45b004bd712d tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Querying cell b79bbab3-22fe-4aca-b591-999750c84479(cell1) for 1 instances {{(pid=119474) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 31 01:24:48.608792 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba5fac34-48df-4ad4-b5f0-45b004bd712d tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:48.609589 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba5fac34-48df-4ad4-b5f0-45b004bd712d tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:48.641414 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ba5fac34-48df-4ad4-b5f0-45b004bd712d tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups/b1a91bb3-115e-4eb9-80e7-0761abf20084" status: 200 len: 222 microversion: 2.1 time: 0.092135 Jul 31 01:24:48.648502 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1713/3472] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:24:48 2022] GET /compute/v2.1/os-server-groups/b1a91bb3-115e-4eb9-80e7-0761abf20084 => generated 222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:48.656880 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9ef8d715-c807-4c78-abc5-22adf7ca13a6 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:48.657935 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9ef8d715-c807-4c78-abc5-22adf7ca13a6 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:48.666349 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ef8d715-c807-4c78-abc5-22adf7ca13a6 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:48.667162 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ef8d715-c807-4c78-abc5-22adf7ca13a6 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:48.668701 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ef8d715-c807-4c78-abc5-22adf7ca13a6 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:48.670061 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ef8d715-c807-4c78-abc5-22adf7ca13a6 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:48.700930 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9ef8d715-c807-4c78-abc5-22adf7ca13a6 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:24:48.806006 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9ef8d715-c807-4c78-abc5-22adf7ca13a6 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59" status: 204 len: 0 microversion: 2.1 time: 0.154670 Jul 31 01:24:48.811504 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1714/3473] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:24:48 2022] DELETE /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:24:48.818800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-049fe7cb-abf8-4785-9477-fdd2696df0f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:48.819884 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-049fe7cb-abf8-4785-9477-fdd2696df0f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:48.831544 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-049fe7cb-abf8-4785-9477-fdd2696df0f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:48.832504 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-049fe7cb-abf8-4785-9477-fdd2696df0f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:48.833782 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-049fe7cb-abf8-4785-9477-fdd2696df0f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:48.834216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-049fe7cb-abf8-4785-9477-fdd2696df0f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:49.085540 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bc0a5e73-b222-4e48-b7de-eef31b499647 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:49.105673 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bc0a5e73-b222-4e48-b7de-eef31b499647 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 200 len: 1526 microversion: 2.1 time: 0.604615 Jul 31 01:24:49.106374 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1760/3474] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:48 2022] GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 1526 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:49.124843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b3aa82ac-1b41-4ff1-a56f-d049aa701760 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:49.125069 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-049fe7cb-abf8-4785-9477-fdd2696df0f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:49.125900 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b3aa82ac-1b41-4ff1-a56f-d049aa701760 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:49.132006 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3aa82ac-1b41-4ff1-a56f-d049aa701760 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:49.132468 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3aa82ac-1b41-4ff1-a56f-d049aa701760 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:49.133010 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-049fe7cb-abf8-4785-9477-fdd2696df0f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.319155 Jul 31 01:24:49.133243 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3aa82ac-1b41-4ff1-a56f-d049aa701760 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:49.133808 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1715/3475] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:48 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:49.133933 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3aa82ac-1b41-4ff1-a56f-d049aa701760 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:49.302217 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b3aa82ac-1b41-4ff1-a56f-d049aa701760 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b070b0ba7349038f808de839eca450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1254dde3a2f46328c18a7fec70d4d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:49.312864 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b3aa82ac-1b41-4ff1-a56f-d049aa701760 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59" status: 200 len: 1504 microversion: 2.1 time: 0.191584 Jul 31 01:24:49.313520 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1761/3476] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:49 2022] GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:49.519518 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-be843b36-f9aa-4249-87ca-fa43544339a1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:49.520198 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-be843b36-f9aa-4249-87ca-fa43544339a1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:49.527005 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be843b36-f9aa-4249-87ca-fa43544339a1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:49.527488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be843b36-f9aa-4249-87ca-fa43544339a1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:49.528250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be843b36-f9aa-4249-87ca-fa43544339a1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:49.528684 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be843b36-f9aa-4249-87ca-fa43544339a1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:49.684393 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-be843b36-f9aa-4249-87ca-fa43544339a1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:49.698992 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-be843b36-f9aa-4249-87ca-fa43544339a1 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.182678 Jul 31 01:24:49.699754 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1716/3477] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:49 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:50.130484 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cfe00f51-fe4a-44f0-bc65-de6479c8dbfb tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:50.131554 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cfe00f51-fe4a-44f0-bc65-de6479c8dbfb tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:50.139415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfe00f51-fe4a-44f0-bc65-de6479c8dbfb tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:50.139885 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfe00f51-fe4a-44f0-bc65-de6479c8dbfb tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:50.140681 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfe00f51-fe4a-44f0-bc65-de6479c8dbfb tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:50.141130 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfe00f51-fe4a-44f0-bc65-de6479c8dbfb tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:50.162825 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-202e4843-5d0e-4037-8c8d-cb5a37d12493 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:50.163191 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-202e4843-5d0e-4037-8c8d-cb5a37d12493 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:50.173384 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-202e4843-5d0e-4037-8c8d-cb5a37d12493 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:50.173849 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-202e4843-5d0e-4037-8c8d-cb5a37d12493 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:50.174993 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-202e4843-5d0e-4037-8c8d-cb5a37d12493 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:50.175129 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-202e4843-5d0e-4037-8c8d-cb5a37d12493 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:50.543021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cfe00f51-fe4a-44f0-bc65-de6479c8dbfb tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:50.572300 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-202e4843-5d0e-4037-8c8d-cb5a37d12493 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:50.590156 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-202e4843-5d0e-4037-8c8d-cb5a37d12493 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.431300 Jul 31 01:24:50.590648 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cfe00f51-fe4a-44f0-bc65-de6479c8dbfb tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 200 len: 1526 microversion: 2.1 time: 0.463632 Jul 31 01:24:50.598923 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1762/3478] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:50 2022] GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 1526 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:50.599708 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1717/3479] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:50 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:50.611054 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-081c9576-57b4-4084-ae98-a8f45a1a2744 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:50.612036 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-80da7cb2-a7b8-4264-ada0-936b770c9b2b tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:50.612830 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-80da7cb2-a7b8-4264-ada0-936b770c9b2b tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:50.614560 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-081c9576-57b4-4084-ae98-a8f45a1a2744 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:50.631653 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-081c9576-57b4-4084-ae98-a8f45a1a2744 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:50.632376 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-081c9576-57b4-4084-ae98-a8f45a1a2744 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:50.633612 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-081c9576-57b4-4084-ae98-a8f45a1a2744 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:50.634249 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-081c9576-57b4-4084-ae98-a8f45a1a2744 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:50.634640 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80da7cb2-a7b8-4264-ada0-936b770c9b2b tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:50.638315 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80da7cb2-a7b8-4264-ada0-936b770c9b2b tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:50.641347 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80da7cb2-a7b8-4264-ada0-936b770c9b2b tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:50.644301 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80da7cb2-a7b8-4264-ada0-936b770c9b2b tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:50.723453 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-80da7cb2-a7b8-4264-ada0-936b770c9b2b tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:24:50.895614 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-80da7cb2-a7b8-4264-ada0-936b770c9b2b tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "DELETE /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1" status: 204 len: 0 microversion: 2.1 time: 0.300027 Jul 31 01:24:50.901648 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1763/3480] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:24:50 2022] DELETE /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:24:50.913667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-782f163c-5dcd-4f5d-bf25-074338bac9b5 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:50.914429 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-782f163c-5dcd-4f5d-bf25-074338bac9b5 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:50.930154 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-782f163c-5dcd-4f5d-bf25-074338bac9b5 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:50.931893 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-782f163c-5dcd-4f5d-bf25-074338bac9b5 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:50.932907 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-782f163c-5dcd-4f5d-bf25-074338bac9b5 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:50.933351 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-782f163c-5dcd-4f5d-bf25-074338bac9b5 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:51.102882 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-081c9576-57b4-4084-ae98-a8f45a1a2744 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b070b0ba7349038f808de839eca450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1254dde3a2f46328c18a7fec70d4d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:51.113079 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-081c9576-57b4-4084-ae98-a8f45a1a2744 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59" status: 200 len: 1504 microversion: 2.1 time: 0.512055 Jul 31 01:24:51.116118 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1718/3481] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:50 2022] GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 => generated 1504 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:51.138933 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0fa96072-2b03-4c8b-91bd-e1ff1bbfb92e tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:51.141090 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0fa96072-2b03-4c8b-91bd-e1ff1bbfb92e tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:51.165208 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0fa96072-2b03-4c8b-91bd-e1ff1bbfb92e tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:51.166196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0fa96072-2b03-4c8b-91bd-e1ff1bbfb92e tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:51.167196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0fa96072-2b03-4c8b-91bd-e1ff1bbfb92e tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:51.167850 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0fa96072-2b03-4c8b-91bd-e1ff1bbfb92e tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:51.390726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-782f163c-5dcd-4f5d-bf25-074338bac9b5 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:51.413493 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-782f163c-5dcd-4f5d-bf25-074338bac9b5 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.509722 Jul 31 01:24:51.427547 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1764/3482] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:50 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:51.444154 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-204d85d0-e712-4a4d-a445-85ad33f0ae8f req-f2c4fe14-3a1a-40ee-ba67-a63fab2ef777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e94ea78-2ac3-4192-aa5c-165b70d7b083", "name": "network-vif-deleted", "tag": "da0517f6-7df8-42a4-8ee4-a90c7b34261b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:51.469598 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-204d85d0-e712-4a4d-a445-85ad33f0ae8f req-f2c4fe14-3a1a-40ee-ba67-a63fab2ef777 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:51.470060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-204d85d0-e712-4a4d-a445-85ad33f0ae8f req-f2c4fe14-3a1a-40ee-ba67-a63fab2ef777 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:51.499896 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-204d85d0-e712-4a4d-a445-85ad33f0ae8f req-f2c4fe14-3a1a-40ee-ba67-a63fab2ef777 service nova] Creating event network-vif-deleted:da0517f6-7df8-42a4-8ee4-a90c7b34261b for instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083 on n-h1-master-1 Jul 31 01:24:51.503074 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0fa96072-2b03-4c8b-91bd-e1ff1bbfb92e tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134662798544bffbb92ba1f4e890b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66667f28da48db95c5fa73292a2537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:51.513242 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-204d85d0-e712-4a4d-a445-85ad33f0ae8f req-f2c4fe14-3a1a-40ee-ba67-a63fab2ef777 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084071 Jul 31 01:24:51.513509 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0fa96072-2b03-4c8b-91bd-e1ff1bbfb92e tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1" status: 200 len: 1666 microversion: 2.1 time: 0.394689 Jul 31 01:24:51.513870 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1765/3483] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:51.517021 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1719/3484] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:51 2022] GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 => generated 1666 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:51.626993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-99289aab-ab60-4459-b7c2-32f2410c4194 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:51.627502 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d5181665-8607-4cb4-aa39-fc9ed0d5c72d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:51.628124 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d5181665-8607-4cb4-aa39-fc9ed0d5c72d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:51.629077 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-99289aab-ab60-4459-b7c2-32f2410c4194 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:51.637956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99289aab-ab60-4459-b7c2-32f2410c4194 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:51.639003 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99289aab-ab60-4459-b7c2-32f2410c4194 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:51.639930 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5181665-8607-4cb4-aa39-fc9ed0d5c72d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:51.640844 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5181665-8607-4cb4-aa39-fc9ed0d5c72d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:51.641119 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99289aab-ab60-4459-b7c2-32f2410c4194 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:51.641246 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5181665-8607-4cb4-aa39-fc9ed0d5c72d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:51.641583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5181665-8607-4cb4-aa39-fc9ed0d5c72d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:51.642330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99289aab-ab60-4459-b7c2-32f2410c4194 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:51.676136 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:51.699647 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99289aab-ab60-4459-b7c2-32f2410c4194 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:51.700537 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99289aab-ab60-4459-b7c2-32f2410c4194 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:51.701177 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-99289aab-ab60-4459-b7c2-32f2410c4194 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lazy-loading 'fault' on Instance uuid 0e94ea78-2ac3-4192-aa5c-165b70d7b083 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:24:51.789131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-99289aab-ab60-4459-b7c2-32f2410c4194 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a58b52653f40e696d7d0a09d7e48e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d6baeb89380488c9ef70003b86c5815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:51.808362 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-99289aab-ab60-4459-b7c2-32f2410c4194 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 200 len: 1314 microversion: 2.1 time: 0.185230 Jul 31 01:24:51.809288 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1766/3485] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:51 2022] GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:51.882270 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-13d30d18-ee88-463a-913c-4dd59cfb938b req-05297a97-5563-441c-b8bf-a49becb3f605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce71e2b-332a-4865-99ba-80dccb338e59", "name": "network-vif-deleted", "tag": "641d2620-1b72-424a-95f6-218a2c4723ce"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:51.900293 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-13d30d18-ee88-463a-913c-4dd59cfb938b req-05297a97-5563-441c-b8bf-a49becb3f605 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:51.903783 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-13d30d18-ee88-463a-913c-4dd59cfb938b req-05297a97-5563-441c-b8bf-a49becb3f605 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:51.934659 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-13d30d18-ee88-463a-913c-4dd59cfb938b req-05297a97-5563-441c-b8bf-a49becb3f605 service nova] Creating event network-vif-deleted:641d2620-1b72-424a-95f6-218a2c4723ce for instance bce71e2b-332a-4865-99ba-80dccb338e59 on n-h1-master-1 Jul 31 01:24:51.950883 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d5181665-8607-4cb4-aa39-fc9ed0d5c72d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:51.956413 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-13d30d18-ee88-463a-913c-4dd59cfb938b req-05297a97-5563-441c-b8bf-a49becb3f605 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078662 Jul 31 01:24:51.961191 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d5181665-8607-4cb4-aa39-fc9ed0d5c72d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.337815 Jul 31 01:24:51.964437 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1767/3487] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:51.964639 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1720/3487] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:51 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:52.141916 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9adfae82-6dc2-49b4-a29b-a31413dc6c1f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:52.142736 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9adfae82-6dc2-49b4-a29b-a31413dc6c1f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:52.150225 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9adfae82-6dc2-49b4-a29b-a31413dc6c1f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:52.150754 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9adfae82-6dc2-49b4-a29b-a31413dc6c1f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:52.152574 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9adfae82-6dc2-49b4-a29b-a31413dc6c1f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:52.152703 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9adfae82-6dc2-49b4-a29b-a31413dc6c1f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:52.185662 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9adfae82-6dc2-49b4-a29b-a31413dc6c1f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:52.186458 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9adfae82-6dc2-49b4-a29b-a31413dc6c1f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:52.187888 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-9adfae82-6dc2-49b4-a29b-a31413dc6c1f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lazy-loading 'fault' on Instance uuid bce71e2b-332a-4865-99ba-80dccb338e59 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:24:52.234703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9adfae82-6dc2-49b4-a29b-a31413dc6c1f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b070b0ba7349038f808de839eca450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1254dde3a2f46328c18a7fec70d4d91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:52.242853 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9adfae82-6dc2-49b4-a29b-a31413dc6c1f tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59" status: 200 len: 1303 microversion: 2.1 time: 0.106476 Jul 31 01:24:52.243787 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1768/3488] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:52 2022] GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:52.445208 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fac8078d-288e-41b6-8112-37965059ba58 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:52.446741 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fac8078d-288e-41b6-8112-37965059ba58 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:52.453758 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fac8078d-288e-41b6-8112-37965059ba58 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:52.454309 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fac8078d-288e-41b6-8112-37965059ba58 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:52.455177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fac8078d-288e-41b6-8112-37965059ba58 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:52.456263 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fac8078d-288e-41b6-8112-37965059ba58 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:52.541442 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-34614aa9-73bf-4927-b9a8-2a75f4a7c63b tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:52.543794 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-34614aa9-73bf-4927-b9a8-2a75f4a7c63b tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:52.567267 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:52.569507 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34614aa9-73bf-4927-b9a8-2a75f4a7c63b tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:52.570051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34614aa9-73bf-4927-b9a8-2a75f4a7c63b tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:52.570931 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34614aa9-73bf-4927-b9a8-2a75f4a7c63b tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:52.571486 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34614aa9-73bf-4927-b9a8-2a75f4a7c63b tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:52.663832 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fac8078d-288e-41b6-8112-37965059ba58 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:52.671978 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fac8078d-288e-41b6-8112-37965059ba58 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.231340 Jul 31 01:24:52.672560 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1721/3489] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:52 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:52.731476 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-34614aa9-73bf-4927-b9a8-2a75f4a7c63b tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134662798544bffbb92ba1f4e890b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66667f28da48db95c5fa73292a2537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:52.739612 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-34614aa9-73bf-4927-b9a8-2a75f4a7c63b tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1" status: 200 len: 1666 microversion: 2.1 time: 0.203746 Jul 31 01:24:52.740319 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1769/3490] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:52 2022] GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 => generated 1666 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:52.834512 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21207526-7907-4009-9b3b-069040a91886 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:52.835253 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-21207526-7907-4009-9b3b-069040a91886 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] [instance: 0e94ea78-2ac3-4192-aa5c-165b70d7b083] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:52.842259 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21207526-7907-4009-9b3b-069040a91886 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:52.843228 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21207526-7907-4009-9b3b-069040a91886 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:52.844171 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21207526-7907-4009-9b3b-069040a91886 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:52.844715 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21207526-7907-4009-9b3b-069040a91886 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:52.859138 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-21207526-7907-4009-9b3b-069040a91886 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] HTTP exception thrown: Instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083 could not be found. Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21207526-7907-4009-9b3b-069040a91886 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Request method failure captured: Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 HTTP/1.1 Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dmL5eUWSDT_M26c56oWS00BkDdrJ_z7Ku045FmSMVe4jLtYjk5TLCJIbzLbFAy8OMBrx2T5TrY1Duz4tR1Wz4XLXFQnVkTYI2V3XKZ9BGnzwGk2pXwMy2DEs6r6uNreUFkkWdFqLwD4RqQfJ9i1FuDzlpiUPHywDHN1TzRaXsFa_6s Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 9d6baeb89380488c9ef70003b86c5815 Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1957096628 Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9d6baeb89380488c9ef70003b86c5815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9d6baeb89380488c9ef70003b86c5815"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9d6baeb89380488c9ef70003b86c5815"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9d6baeb89380488c9ef70003b86c5815", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1957096628 Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 9d6baeb89380488c9ef70003b86c5815 Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1957096628 Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-FloatingIPsAssociationTestJSON-1957096628-project Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 46a58b52653f40e696d7d0a09d7e48e7 Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1957096628-project Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083 could not be found. Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '0e94ea78-2ac3-4192-aa5c-165b70d7b083'} Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083 could not be found. Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083 could not be found. Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:52.860944 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:52.866318 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:52.866318 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:52.866318 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:52.866318 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:52.866318 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:52.866318 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:52.866318 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083 could not be found. Jul 31 01:24:52.866318 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:52.866318 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21207526-7907-4009-9b3b-069040a91886 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] Returning 404 to user: Instance 0e94ea78-2ac3-4192-aa5c-165b70d7b083 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:52.866318 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-21207526-7907-4009-9b3b-069040a91886 tempest-FloatingIPsAssociationTestJSON-1957096628 tempest-FloatingIPsAssociationTestJSON-1957096628-project] 10.222.0.45 "GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083" status: 404 len: 111 microversion: 2.1 time: 0.032074 Jul 31 01:24:52.866318 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1722/3491] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:52 2022] GET /compute/v2.1/servers/0e94ea78-2ac3-4192-aa5c-165b70d7b083 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:24:52.989199 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9def2df0-bfe4-445a-9562-194b748af44a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:52.990109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9def2df0-bfe4-445a-9562-194b748af44a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:52.997334 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9def2df0-bfe4-445a-9562-194b748af44a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:52.997877 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9def2df0-bfe4-445a-9562-194b748af44a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:52.998760 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9def2df0-bfe4-445a-9562-194b748af44a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:52.999402 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9def2df0-bfe4-445a-9562-194b748af44a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:53.019763 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:53.222800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9def2df0-bfe4-445a-9562-194b748af44a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:53.231641 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9def2df0-bfe4-445a-9562-194b748af44a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.246548 Jul 31 01:24:53.246894 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1770/3492] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:52 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:53.270043 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8395be07-220b-4a46-a97c-047824e52fce tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:53.270702 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8395be07-220b-4a46-a97c-047824e52fce tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:53.283508 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8395be07-220b-4a46-a97c-047824e52fce tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:53.284490 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8395be07-220b-4a46-a97c-047824e52fce tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:53.285439 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8395be07-220b-4a46-a97c-047824e52fce tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:53.286013 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8395be07-220b-4a46-a97c-047824e52fce tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:53.313098 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-8395be07-220b-4a46-a97c-047824e52fce tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] HTTP exception thrown: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8395be07-220b-4a46-a97c-047824e52fce tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Request method failure captured: Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 HTTP/1.1 Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dnKjkNINUy-g7brYn0wBwx6abZCwAv8iuSEuJjz3Kkjnhlwszvr1vfQaWutF_vIVDPjmlEo_dzaFv9M8lfGV4PrYOHw3c0kkYbLBBCmxJCnucTqEha3dIVp3rnkZMlVchM_dfYDj3QEQw53S9ut8e4FteIGuGbADfCozvKfNqvtbaM Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: c1254dde3a2f46328c18a7fec70d4d91 Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c1254dde3a2f46328c18a7fec70d4d91", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: c1254dde3a2f46328c18a7fec70d4d91 Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerGroupTestJSON-1603439194-project Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 81b070b0ba7349038f808de839eca450 Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerGroupTestJSON-1603439194-project Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: exception: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'bce71e2b-332a-4865-99ba-80dccb338e59'} Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:53.314801 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.325035 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.325035 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:53.325035 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:53.325035 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:53.325035 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:53.325035 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. Jul 31 01:24:53.325035 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.325035 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8395be07-220b-4a46-a97c-047824e52fce tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Returning 404 to user: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:53.325035 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8395be07-220b-4a46-a97c-047824e52fce tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59" status: 404 len: 111 microversion: 2.1 time: 0.052811 Jul 31 01:24:53.325035 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1723/3493] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:53 2022] GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:24:53.331681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-400d52b8-9340-4e5b-a032-e859dee2e481 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:53.356989 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.compute.server_groups [None req-400d52b8-9340-4e5b-a032-e859dee2e481 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Querying cell b79bbab3-22fe-4aca-b591-999750c84479(cell1) for 1 instances {{(pid=119475) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 31 01:24:53.359389 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-400d52b8-9340-4e5b-a032-e859dee2e481 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:53.360144 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-400d52b8-9340-4e5b-a032-e859dee2e481 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:53.372597 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-400d52b8-9340-4e5b-a032-e859dee2e481 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.044869 Jul 31 01:24:53.380761 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1771/3494] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:24:53 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:53.388737 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c53f9372-85d9-4de6-91e4-8ba3f7aa3e9d tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:53.421710 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.compute.server_groups [None req-c53f9372-85d9-4de6-91e4-8ba3f7aa3e9d tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Querying cell b79bbab3-22fe-4aca-b591-999750c84479(cell1) for 1 instances {{(pid=119474) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 31 01:24:53.425040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c53f9372-85d9-4de6-91e4-8ba3f7aa3e9d tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:53.427439 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c53f9372-85d9-4de6-91e4-8ba3f7aa3e9d tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:53.449332 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c53f9372-85d9-4de6-91e4-8ba3f7aa3e9d tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups/b1a91bb3-115e-4eb9-80e7-0761abf20084" status: 200 len: 184 microversion: 2.1 time: 0.067606 Jul 31 01:24:53.450733 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1724/3495] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:24:53 2022] GET /compute/v2.1/os-server-groups/b1a91bb3-115e-4eb9-80e7-0761abf20084 => generated 184 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:53.462142 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c2d5855a-4107-456e-be3d-5c083063d7b2 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:53.462893 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c2d5855a-4107-456e-be3d-5c083063d7b2 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:53.473605 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2d5855a-4107-456e-be3d-5c083063d7b2 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:53.477464 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2d5855a-4107-456e-be3d-5c083063d7b2 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:53.478458 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2d5855a-4107-456e-be3d-5c083063d7b2 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:53.478990 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2d5855a-4107-456e-be3d-5c083063d7b2 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:53.515562 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-c2d5855a-4107-456e-be3d-5c083063d7b2 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] HTTP exception thrown: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c2d5855a-4107-456e-be3d-5c083063d7b2 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Request method failure captured: Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 HTTP/1.1 Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dnKjkNINUy-g7brYn0wBwx6abZCwAv8iuSEuJjz3Kkjnhlwszvr1vfQaWutF_vIVDPjmlEo_dzaFv9M8lfGV4PrYOHw3c0kkYbLBBCmxJCnucTqEha3dIVp3rnkZMlVchM_dfYDj3QEQw53S9ut8e4FteIGuGbADfCozvKfNqvtbaM Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: c1254dde3a2f46328c18a7fec70d4d91 Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c1254dde3a2f46328c18a7fec70d4d91", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: c1254dde3a2f46328c18a7fec70d4d91 Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerGroupTestJSON-1603439194-project Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 81b070b0ba7349038f808de839eca450 Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerGroupTestJSON-1603439194-project Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: exception: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'bce71e2b-332a-4865-99ba-80dccb338e59'} Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:24:53.517791 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:24:53.522181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. Jul 31 01:24:53.522181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.522181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:53.522181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.522181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.522181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:53.522181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:53.522181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:53.522181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:53.522181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. Jul 31 01:24:53.522181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.522181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c2d5855a-4107-456e-be3d-5c083063d7b2 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Returning 404 to user: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:53.525261 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c2d5855a-4107-456e-be3d-5c083063d7b2 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59" status: 404 len: 111 microversion: 2.1 time: 0.061123 Jul 31 01:24:53.526060 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1772/3496] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:24:53 2022] DELETE /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:24:53.534787 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8eb1bf5f-f9de-4ee5-bf80-68f0e46bf4be tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:53.535438 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8eb1bf5f-f9de-4ee5-bf80-68f0e46bf4be tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] [instance: bce71e2b-332a-4865-99ba-80dccb338e59] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:53.545765 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8eb1bf5f-f9de-4ee5-bf80-68f0e46bf4be tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:53.546234 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8eb1bf5f-f9de-4ee5-bf80-68f0e46bf4be tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:53.553582 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8eb1bf5f-f9de-4ee5-bf80-68f0e46bf4be tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:53.554072 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8eb1bf5f-f9de-4ee5-bf80-68f0e46bf4be tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:53.600784 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-8eb1bf5f-f9de-4ee5-bf80-68f0e46bf4be tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] HTTP exception thrown: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8eb1bf5f-f9de-4ee5-bf80-68f0e46bf4be tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Request method failure captured: Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 HTTP/1.1 Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dnKjkNINUy-g7brYn0wBwx6abZCwAv8iuSEuJjz3Kkjnhlwszvr1vfQaWutF_vIVDPjmlEo_dzaFv9M8lfGV4PrYOHw3c0kkYbLBBCmxJCnucTqEha3dIVp3rnkZMlVchM_dfYDj3QEQw53S9ut8e4FteIGuGbADfCozvKfNqvtbaM Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: c1254dde3a2f46328c18a7fec70d4d91 Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c1254dde3a2f46328c18a7fec70d4d91", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: c1254dde3a2f46328c18a7fec70d4d91 Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerGroupTestJSON-1603439194-project Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 81b070b0ba7349038f808de839eca450 Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerGroupTestJSON-1603439194-project Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: exception: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'bce71e2b-332a-4865-99ba-80dccb338e59'} Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:53.602250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.610453 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.610453 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:53.610453 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:53.610453 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:53.610453 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:53.610453 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. Jul 31 01:24:53.610453 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.610453 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8eb1bf5f-f9de-4ee5-bf80-68f0e46bf4be tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Returning 404 to user: Instance bce71e2b-332a-4865-99ba-80dccb338e59 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:53.610453 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8eb1bf5f-f9de-4ee5-bf80-68f0e46bf4be tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59" status: 404 len: 111 microversion: 2.1 time: 0.075519 Jul 31 01:24:53.610453 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1725/3497] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:53 2022] GET /compute/v2.1/servers/bce71e2b-332a-4865-99ba-80dccb338e59 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:24:53.620704 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ecef39f7-1b03-465f-9867-91f5237f0970 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:53.635990 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-ecef39f7-1b03-465f-9867-91f5237f0970 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] HTTP exception thrown: Instance group f7338b65-d9d8-4070-84fb-27c9ce05dd9e could not be found. Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ecef39f7-1b03-465f-9867-91f5237f0970 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Request method failure captured: Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/os-server-groups/f7338b65-d9d8-4070-84fb-27c9ce05dd9e HTTP/1.1 Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dnKjkNINUy-g7brYn0wBwx6abZCwAv8iuSEuJjz3Kkjnhlwszvr1vfQaWutF_vIVDPjmlEo_dzaFv9M8lfGV4PrYOHw3c0kkYbLBBCmxJCnucTqEha3dIVp3rnkZMlVchM_dfYDj3QEQw53S9ut8e4FteIGuGbADfCozvKfNqvtbaM Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: c1254dde3a2f46328c18a7fec70d4d91 Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c1254dde3a2f46328c18a7fec70d4d91", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: c1254dde3a2f46328c18a7fec70d4d91 Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerGroupTestJSON-1603439194-project Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 81b070b0ba7349038f808de839eca450 Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerGroupTestJSON-1603439194-project Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: exception: Instance group f7338b65-d9d8-4070-84fb-27c9ce05dd9e could not be found. Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'f7338b65-d9d8-4070-84fb-27c9ce05dd9e'} Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f7338b65-d9d8-4070-84fb-27c9ce05dd9e could not be found. Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f7338b65-d9d8-4070-84fb-27c9ce05dd9e could not be found. Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.645089 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.650232 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:53.650232 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:53.650232 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:53.650232 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:53.650232 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f7338b65-d9d8-4070-84fb-27c9ce05dd9e could not be found. Jul 31 01:24:53.650232 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.652415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ecef39f7-1b03-465f-9867-91f5237f0970 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Returning 404 to user: Instance group f7338b65-d9d8-4070-84fb-27c9ce05dd9e could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:53.653597 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ecef39f7-1b03-465f-9867-91f5237f0970 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/f7338b65-d9d8-4070-84fb-27c9ce05dd9e" status: 404 len: 117 microversion: 2.1 time: 0.039323 Jul 31 01:24:53.654825 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1773/3498] 10.222.0.45 () {58 vars in 1266 bytes} [Sun Jul 31 01:24:53 2022] DELETE /compute/v2.1/os-server-groups/f7338b65-d9d8-4070-84fb-27c9ce05dd9e => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:24:53.663795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a1b13d10-916f-4f2a-899a-2634c141abee tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:53.672683 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-a1b13d10-916f-4f2a-899a-2634c141abee tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] HTTP exception thrown: Instance group 9f8d4bf9-848d-4213-8453-cc414d5d243b could not be found. Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a1b13d10-916f-4f2a-899a-2634c141abee tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Request method failure captured: Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/os-server-groups/9f8d4bf9-848d-4213-8453-cc414d5d243b HTTP/1.1 Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dnKjkNINUy-g7brYn0wBwx6abZCwAv8iuSEuJjz3Kkjnhlwszvr1vfQaWutF_vIVDPjmlEo_dzaFv9M8lfGV4PrYOHw3c0kkYbLBBCmxJCnucTqEha3dIVp3rnkZMlVchM_dfYDj3QEQw53S9ut8e4FteIGuGbADfCozvKfNqvtbaM Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: c1254dde3a2f46328c18a7fec70d4d91 Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c1254dde3a2f46328c18a7fec70d4d91", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: c1254dde3a2f46328c18a7fec70d4d91 Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerGroupTestJSON-1603439194-project Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 81b070b0ba7349038f808de839eca450 Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerGroupTestJSON-1603439194-project Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: exception: Instance group 9f8d4bf9-848d-4213-8453-cc414d5d243b could not be found. Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '9f8d4bf9-848d-4213-8453-cc414d5d243b'} Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9f8d4bf9-848d-4213-8453-cc414d5d243b could not be found. Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9f8d4bf9-848d-4213-8453-cc414d5d243b could not be found. Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.675098 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.680404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:53.680404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:53.680404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:53.680404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:53.680404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9f8d4bf9-848d-4213-8453-cc414d5d243b could not be found. Jul 31 01:24:53.680404 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.680404 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a1b13d10-916f-4f2a-899a-2634c141abee tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Returning 404 to user: Instance group 9f8d4bf9-848d-4213-8453-cc414d5d243b could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:53.680404 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a1b13d10-916f-4f2a-899a-2634c141abee tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/9f8d4bf9-848d-4213-8453-cc414d5d243b" status: 404 len: 117 microversion: 2.1 time: 0.017848 Jul 31 01:24:53.680404 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1726/3499] 10.222.0.45 () {58 vars in 1266 bytes} [Sun Jul 31 01:24:53 2022] DELETE /compute/v2.1/os-server-groups/9f8d4bf9-848d-4213-8453-cc414d5d243b => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:24:53.688015 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f1068d7c-d976-461b-8fc6-18f914f46c58 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:53.695784 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-44279fa8-aa96-4b22-89f9-817992405ca0 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:53.696780 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-44279fa8-aa96-4b22-89f9-817992405ca0 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:53.700846 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-f1068d7c-d976-461b-8fc6-18f914f46c58 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] HTTP exception thrown: Instance group c47f3d33-55d2-4fed-90cc-acd2f924a9f7 could not be found. Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f1068d7c-d976-461b-8fc6-18f914f46c58 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Request method failure captured: Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/os-server-groups/c47f3d33-55d2-4fed-90cc-acd2f924a9f7 HTTP/1.1 Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dnKjkNINUy-g7brYn0wBwx6abZCwAv8iuSEuJjz3Kkjnhlwszvr1vfQaWutF_vIVDPjmlEo_dzaFv9M8lfGV4PrYOHw3c0kkYbLBBCmxJCnucTqEha3dIVp3rnkZMlVchM_dfYDj3QEQw53S9ut8e4FteIGuGbADfCozvKfNqvtbaM Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: c1254dde3a2f46328c18a7fec70d4d91 Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c1254dde3a2f46328c18a7fec70d4d91", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: c1254dde3a2f46328c18a7fec70d4d91 Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerGroupTestJSON-1603439194-project Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 81b070b0ba7349038f808de839eca450 Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerGroupTestJSON-1603439194-project Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: exception: Instance group c47f3d33-55d2-4fed-90cc-acd2f924a9f7 could not be found. Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'c47f3d33-55d2-4fed-90cc-acd2f924a9f7'} Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c47f3d33-55d2-4fed-90cc-acd2f924a9f7 could not be found. Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c47f3d33-55d2-4fed-90cc-acd2f924a9f7 could not be found. Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.706467 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.711577 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:53.711577 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:53.711577 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:53.711577 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:53.711577 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c47f3d33-55d2-4fed-90cc-acd2f924a9f7 could not be found. Jul 31 01:24:53.711577 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.712092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44279fa8-aa96-4b22-89f9-817992405ca0 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:53.712092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44279fa8-aa96-4b22-89f9-817992405ca0 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:53.712092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44279fa8-aa96-4b22-89f9-817992405ca0 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:53.712092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44279fa8-aa96-4b22-89f9-817992405ca0 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:53.714808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f1068d7c-d976-461b-8fc6-18f914f46c58 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Returning 404 to user: Instance group c47f3d33-55d2-4fed-90cc-acd2f924a9f7 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:53.718114 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f1068d7c-d976-461b-8fc6-18f914f46c58 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/c47f3d33-55d2-4fed-90cc-acd2f924a9f7" status: 404 len: 117 microversion: 2.1 time: 0.035635 Jul 31 01:24:53.720797 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1774/3500] 10.222.0.45 () {58 vars in 1266 bytes} [Sun Jul 31 01:24:53 2022] DELETE /compute/v2.1/os-server-groups/c47f3d33-55d2-4fed-90cc-acd2f924a9f7 => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:24:53.733810 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7d7368fd-ca40-48a0-9e80-e089f256a6bf tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:53.757285 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-7d7368fd-ca40-48a0-9e80-e089f256a6bf tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] HTTP exception thrown: Instance group a743d025-649a-4b1b-8f24-e6380f5dd54d could not be found. Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7d7368fd-ca40-48a0-9e80-e089f256a6bf tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Request method failure captured: Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/os-server-groups/a743d025-649a-4b1b-8f24-e6380f5dd54d HTTP/1.1 Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dnKjkNINUy-g7brYn0wBwx6abZCwAv8iuSEuJjz3Kkjnhlwszvr1vfQaWutF_vIVDPjmlEo_dzaFv9M8lfGV4PrYOHw3c0kkYbLBBCmxJCnucTqEha3dIVp3rnkZMlVchM_dfYDj3QEQw53S9ut8e4FteIGuGbADfCozvKfNqvtbaM Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: c1254dde3a2f46328c18a7fec70d4d91 Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c1254dde3a2f46328c18a7fec70d4d91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c1254dde3a2f46328c18a7fec70d4d91", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: c1254dde3a2f46328c18a7fec70d4d91 Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerGroupTestJSON-1603439194 Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerGroupTestJSON-1603439194-project Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 81b070b0ba7349038f808de839eca450 Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerGroupTestJSON-1603439194-project Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: exception: Instance group a743d025-649a-4b1b-8f24-e6380f5dd54d could not be found. Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'a743d025-649a-4b1b-8f24-e6380f5dd54d'} Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a743d025-649a-4b1b-8f24-e6380f5dd54d could not be found. Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a743d025-649a-4b1b-8f24-e6380f5dd54d could not be found. Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.761092 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:53.766414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:53.766414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:53.766414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:53.766414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:53.766414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a743d025-649a-4b1b-8f24-e6380f5dd54d could not be found. Jul 31 01:24:53.766414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:53.769879 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7d7368fd-ca40-48a0-9e80-e089f256a6bf tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Returning 404 to user: Instance group a743d025-649a-4b1b-8f24-e6380f5dd54d could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:53.771710 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7d7368fd-ca40-48a0-9e80-e089f256a6bf tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/a743d025-649a-4b1b-8f24-e6380f5dd54d" status: 404 len: 117 microversion: 2.1 time: 0.045937 Jul 31 01:24:53.777615 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1775/3501] 10.222.0.45 () {58 vars in 1266 bytes} [Sun Jul 31 01:24:53 2022] DELETE /compute/v2.1/os-server-groups/a743d025-649a-4b1b-8f24-e6380f5dd54d => generated 117 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:24:53.786177 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-10f2d52c-e95c-4f28-b62a-735e757d2e61 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:53.787794 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-10f2d52c-e95c-4f28-b62a-735e757d2e61 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:53.803573 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10f2d52c-e95c-4f28-b62a-735e757d2e61 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:53.804799 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10f2d52c-e95c-4f28-b62a-735e757d2e61 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:53.806238 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10f2d52c-e95c-4f28-b62a-735e757d2e61 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:53.806932 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10f2d52c-e95c-4f28-b62a-735e757d2e61 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:54.206432 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-10f2d52c-e95c-4f28-b62a-735e757d2e61 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134662798544bffbb92ba1f4e890b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66667f28da48db95c5fa73292a2537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:54.224987 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-10f2d52c-e95c-4f28-b62a-735e757d2e61 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1" status: 200 len: 1598 microversion: 2.1 time: 0.445389 Jul 31 01:24:54.225903 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1776/3502] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:53 2022] GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 => generated 1598 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:54.243178 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b7c5fb20-c8d3-46af-88fa-1891a91a9283 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:54.291759 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b7c5fb20-c8d3-46af-88fa-1891a91a9283 tempest-ServerGroupTestJSON-1603439194 tempest-ServerGroupTestJSON-1603439194-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/b1a91bb3-115e-4eb9-80e7-0761abf20084" status: 204 len: 0 microversion: 2.1 time: 0.064684 Jul 31 01:24:54.292471 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1777/3503] 10.222.0.45 () {58 vars in 1266 bytes} [Sun Jul 31 01:24:54 2022] DELETE /compute/v2.1/os-server-groups/b1a91bb3-115e-4eb9-80e7-0761abf20084 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:24:54.299069 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6d34ff84-f8fd-4c4d-a17c-6eb803792fac tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:54.301792 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6d34ff84-f8fd-4c4d-a17c-6eb803792fac tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:54.315029 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d34ff84-f8fd-4c4d-a17c-6eb803792fac tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:54.319928 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d34ff84-f8fd-4c4d-a17c-6eb803792fac tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:54.320941 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d34ff84-f8fd-4c4d-a17c-6eb803792fac tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:54.321499 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d34ff84-f8fd-4c4d-a17c-6eb803792fac tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:55.005442 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-44279fa8-aa96-4b22-89f9-817992405ca0 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:55.020021 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-44279fa8-aa96-4b22-89f9-817992405ca0 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 1.329475 Jul 31 01:24:55.028401 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1727/3504] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:53 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:55.033369 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-a908ed20-149c-4023-909c-84dc6bf04c76 req-b9045898-4e00-4435-8cb5-b2f851c9aac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1", "name": "network-vif-deleted", "tag": "807c4baf-3ac4-4e79-9bd8-75e2c62bfec9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:24:55.047450 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:55.059085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a908ed20-149c-4023-909c-84dc6bf04c76 req-b9045898-4e00-4435-8cb5-b2f851c9aac1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:55.064455 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a908ed20-149c-4023-909c-84dc6bf04c76 req-b9045898-4e00-4435-8cb5-b2f851c9aac1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:55.083530 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-a908ed20-149c-4023-909c-84dc6bf04c76 req-b9045898-4e00-4435-8cb5-b2f851c9aac1 service nova] Creating event network-vif-deleted:807c4baf-3ac4-4e79-9bd8-75e2c62bfec9 for instance 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 on n-h2-master-1 Jul 31 01:24:55.098078 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-a908ed20-149c-4023-909c-84dc6bf04c76 req-b9045898-4e00-4435-8cb5-b2f851c9aac1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067879 Jul 31 01:24:55.098983 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1728/3505] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:24:55.247416 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e31f6f53-21eb-4ecd-a985-a980e7432e7a tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:55.248131 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e31f6f53-21eb-4ecd-a985-a980e7432e7a tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:55.258821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e31f6f53-21eb-4ecd-a985-a980e7432e7a tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:55.264986 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e31f6f53-21eb-4ecd-a985-a980e7432e7a tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:55.266187 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e31f6f53-21eb-4ecd-a985-a980e7432e7a tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:55.266902 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e31f6f53-21eb-4ecd-a985-a980e7432e7a tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:55.392875 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e31f6f53-21eb-4ecd-a985-a980e7432e7a tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:55.393330 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e31f6f53-21eb-4ecd-a985-a980e7432e7a tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:55.394204 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-e31f6f53-21eb-4ecd-a985-a980e7432e7a tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lazy-loading 'fault' on Instance uuid 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:24:55.475960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6d34ff84-f8fd-4c4d-a17c-6eb803792fac tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:55.487300 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6d34ff84-f8fd-4c4d-a17c-6eb803792fac tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 1.193471 Jul 31 01:24:55.488434 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1778/3506] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:54 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:55.602692 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e31f6f53-21eb-4ecd-a985-a980e7432e7a tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134662798544bffbb92ba1f4e890b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c66667f28da48db95c5fa73292a2537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:55.613542 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e31f6f53-21eb-4ecd-a985-a980e7432e7a tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1" status: 200 len: 1316 microversion: 2.1 time: 0.371072 Jul 31 01:24:55.633540 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1729/3507] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:55 2022] GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:24:56.050217 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-94010cf3-fce1-4956-9ac0-ed94703b6481 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:56.051897 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-94010cf3-fce1-4956-9ac0-ed94703b6481 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:56.068951 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-94010cf3-fce1-4956-9ac0-ed94703b6481 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:56.069719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-94010cf3-fce1-4956-9ac0-ed94703b6481 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:56.070774 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-94010cf3-fce1-4956-9ac0-ed94703b6481 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:56.071439 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-94010cf3-fce1-4956-9ac0-ed94703b6481 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:56.459923 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-94010cf3-fce1-4956-9ac0-ed94703b6481 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:56.481428 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-94010cf3-fce1-4956-9ac0-ed94703b6481 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.436329 Jul 31 01:24:56.487903 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1779/3508] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:56 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:56.509876 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-40d09dea-4e40-4efa-83e9-17ccf68d77f2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:56.511463 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-40d09dea-4e40-4efa-83e9-17ccf68d77f2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:56.545328 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-40d09dea-4e40-4efa-83e9-17ccf68d77f2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:56.545802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-40d09dea-4e40-4efa-83e9-17ccf68d77f2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:56.546613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-40d09dea-4e40-4efa-83e9-17ccf68d77f2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:56.547048 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-40d09dea-4e40-4efa-83e9-17ccf68d77f2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:56.636347 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bbb72963-4d82-4664-bfe3-5f9dc6d26f06 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:56.636987 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bbb72963-4d82-4664-bfe3-5f9dc6d26f06 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] [instance: 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:56.656939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bbb72963-4d82-4664-bfe3-5f9dc6d26f06 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:56.657572 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bbb72963-4d82-4664-bfe3-5f9dc6d26f06 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:56.661337 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bbb72963-4d82-4664-bfe3-5f9dc6d26f06 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:56.661669 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bbb72963-4d82-4664-bfe3-5f9dc6d26f06 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:56.702114 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-bbb72963-4d82-4664-bfe3-5f9dc6d26f06 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] HTTP exception thrown: Instance 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 could not be found. Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bbb72963-4d82-4664-bfe3-5f9dc6d26f06 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Request method failure captured: Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 HTTP/1.1 Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dmiqAOlDqJIx_9fo0QyVfT_E_9s9X3m1y2ID6ZuVxwAQKaffgTaMAlDGmoyCvn9FdRipzI4MAAhjPHHCzZxAdTHN07YduLQBPcl06udmCWBvHLzfi-Rl_5NuoWenHDYL_vpfF1UL5Mi84moze8XapcTAWxBxF0noHOXNrx9k2vHuRY Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 3c66667f28da48db95c5fa73292a2537 Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestFqdnHostnames-779865645 Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c66667f28da48db95c5fa73292a2537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3c66667f28da48db95c5fa73292a2537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3c66667f28da48db95c5fa73292a2537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3c66667f28da48db95c5fa73292a2537", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestFqdnHostnames-779865645 Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 3c66667f28da48db95c5fa73292a2537 Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-779865645 Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestFqdnHostnames-779865645-project Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 6134662798544bffbb92ba1f4e890b81 Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestFqdnHostnames-779865645-project Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 could not be found. Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1'} Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 could not be found. Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 could not be found. Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:24:56.703317 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:56.708499 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:24:56.708499 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:24:56.708499 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:24:56.708499 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:24:56.708499 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:24:56.708499 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 could not be found. Jul 31 01:24:56.708499 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:24:56.708499 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bbb72963-4d82-4664-bfe3-5f9dc6d26f06 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Returning 404 to user: Instance 56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:24:56.709177 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bbb72963-4d82-4664-bfe3-5f9dc6d26f06 tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1" status: 404 len: 111 microversion: 2.1 time: 0.077417 Jul 31 01:24:56.715696 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1780/3509] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:56 2022] GET /compute/v2.1/servers/56015b9d-42af-4c9d-b2b1-8e2ca7e5fde1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:24:56.740867 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5c803bc5-b57b-4a19-9637-7fb5bb9fdbfe tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] Calling method '.version_select at 0x7fede46e3790>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:56.789101 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5c803bc5-b57b-4a19-9637-7fb5bb9fdbfe tempest-ServersTestFqdnHostnames-779865645 tempest-ServersTestFqdnHostnames-779865645-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1379601569" status: 202 len: 0 microversion: 2.1 time: 0.072140 Jul 31 01:24:56.793253 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1781/3510] 10.222.0.45 () {58 vars in 1221 bytes} [Sun Jul 31 01:24:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1379601569 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:24:57.248604 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-40d09dea-4e40-4efa-83e9-17ccf68d77f2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:57.260912 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-40d09dea-4e40-4efa-83e9-17ccf68d77f2 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.754745 Jul 31 01:24:57.275463 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1730/3511] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:56 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:57.514286 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ce7200d2-ba9b-4b2f-8c19-41026c79e92f tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:57.516053 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ce7200d2-ba9b-4b2f-8c19-41026c79e92f tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:57.539773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce7200d2-ba9b-4b2f-8c19-41026c79e92f tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:57.540771 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce7200d2-ba9b-4b2f-8c19-41026c79e92f tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:57.544528 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce7200d2-ba9b-4b2f-8c19-41026c79e92f tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:57.545576 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce7200d2-ba9b-4b2f-8c19-41026c79e92f tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:58.130252 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ce7200d2-ba9b-4b2f-8c19-41026c79e92f tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:58.145715 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ce7200d2-ba9b-4b2f-8c19-41026c79e92f tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.634484 Jul 31 01:24:58.161082 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1782/3512] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:57 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:58.282254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f9bd0511-2959-406b-b1e2-4b02e6f88dad tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:58.282956 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f9bd0511-2959-406b-b1e2-4b02e6f88dad tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:58.296639 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9bd0511-2959-406b-b1e2-4b02e6f88dad tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:58.297236 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9bd0511-2959-406b-b1e2-4b02e6f88dad tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:58.298629 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9bd0511-2959-406b-b1e2-4b02e6f88dad tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:58.299360 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9bd0511-2959-406b-b1e2-4b02e6f88dad tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:59.112479 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f9bd0511-2959-406b-b1e2-4b02e6f88dad tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:24:59.127288 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f9bd0511-2959-406b-b1e2-4b02e6f88dad tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.848902 Jul 31 01:24:59.128723 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1731/3513] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:58 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:24:59.183256 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-94976266-7443-4f78-95c6-23071cc9efcf tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:24:59.186283 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-94976266-7443-4f78-95c6-23071cc9efcf tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:24:59.198955 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-94976266-7443-4f78-95c6-23071cc9efcf tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:59.200340 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-94976266-7443-4f78-95c6-23071cc9efcf tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:24:59.202133 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-94976266-7443-4f78-95c6-23071cc9efcf tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:24:59.207910 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-94976266-7443-4f78-95c6-23071cc9efcf tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:00.028654 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-94976266-7443-4f78-95c6-23071cc9efcf tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:00.055009 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-94976266-7443-4f78-95c6-23071cc9efcf tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.885727 Jul 31 01:25:00.070663 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1783/3514] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:24:59 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:00.149062 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d96d9cc8-c1f5-4bfe-be21-7d82b2e2202b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:00.149843 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d96d9cc8-c1f5-4bfe-be21-7d82b2e2202b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:00.157278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d96d9cc8-c1f5-4bfe-be21-7d82b2e2202b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:00.157862 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d96d9cc8-c1f5-4bfe-be21-7d82b2e2202b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:00.158910 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d96d9cc8-c1f5-4bfe-be21-7d82b2e2202b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:00.159570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d96d9cc8-c1f5-4bfe-be21-7d82b2e2202b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:00.737937 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d96d9cc8-c1f5-4bfe-be21-7d82b2e2202b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:00.748478 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d96d9cc8-c1f5-4bfe-be21-7d82b2e2202b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1503 microversion: 2.1 time: 0.603490 Jul 31 01:25:00.766962 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1732/3515] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:00 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1503 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:00.773497 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6c05e805-5097-4730-a8e4-fc6580a0b392 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13dba9f8-37bb-42ba-beed-fa3423158a01"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:00.780132 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6c05e805-5097-4730-a8e4-fc6580a0b392 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:00.796816 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c05e805-5097-4730-a8e4-fc6580a0b392 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:00.796816 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c05e805-5097-4730-a8e4-fc6580a0b392 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:00.797889 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c05e805-5097-4730-a8e4-fc6580a0b392 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:00.798344 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c05e805-5097-4730-a8e4-fc6580a0b392 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:00.849943 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-6c05e805-5097-4730-a8e4-fc6580a0b392 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] HTTP exception thrown: Cannot 'attach_volume' instance 8da54db7-290e-4d68-bf4c-4c6f49984fef while it is in vm_state rescued Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6c05e805-5097-4730-a8e4-fc6580a0b392 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Request method failure captured: Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef/os-volume_attachments HTTP/1.1 Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 74 Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dlxeTMDBunLit2vGiPrRDr1dvwQZdXub1419SqSyDOiGVHpAG6yJGGezx9r9jLdyswls0cvvjHa7zsCjK7Ca5A4yF2d26H1NpXXYaK068O8-NSelNX8BnsHr9p-9TQJIL4Ay7u6mf8S-XLTaElYJgrWyL6gNGdxZnY_92dE9hLD6X8 Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_af1bdeca391f47f3bde21459bf893f89", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 87e482f360af4e56a325960d834fb9f8 Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: {"volumeAttachment": {"volumeId": "13dba9f8-37bb-42ba-beed-fa3423158a01"}} Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: exception: Cannot 'attach_volume' instance 8da54db7-290e-4d68-bf4c-4c6f49984fef while it is in vm_state rescued Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: action_args: {'server_id': '8da54db7-290e-4d68-bf4c-4c6f49984fef', 'body': {'volumeAttachment': {'volumeId': '13dba9f8-37bb-42ba-beed-fa3423158a01'}}} Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8da54db7-290e-4d68-bf4c-4c6f49984fef in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 31 01:25:00.851604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 01:25:00.856984 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 01:25:00.856984 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 01:25:00.856984 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8da54db7-290e-4d68-bf4c-4c6f49984fef while it is in vm_state rescued Jul 31 01:25:00.856984 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:00.856984 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:00.856984 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:00.856984 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:00.856984 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:25:00.856984 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:25:00.856984 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:25:00.856984 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:25:00.856984 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8da54db7-290e-4d68-bf4c-4c6f49984fef while it is in vm_state rescued Jul 31 01:25:00.856984 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:00.868022 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6c05e805-5097-4730-a8e4-fc6580a0b392 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Returning 409 to user: Cannot 'attach_volume' instance 8da54db7-290e-4d68-bf4c-4c6f49984fef while it is in vm_state rescued {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:25:00.869196 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6c05e805-5097-4730-a8e4-fc6580a0b392 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.099854 Jul 31 01:25:00.870021 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1784/3516] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:25:00 2022] POST /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef/os-volume_attachments => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:25:00.878872 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fa95374b-453f-478b-a87f-c85e328ebbc6 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:00.880352 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fa95374b-453f-478b-a87f-c85e328ebbc6 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:00.889495 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa95374b-453f-478b-a87f-c85e328ebbc6 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:00.892587 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa95374b-453f-478b-a87f-c85e328ebbc6 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:00.893540 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa95374b-453f-478b-a87f-c85e328ebbc6 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:00.894122 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa95374b-453f-478b-a87f-c85e328ebbc6 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:01.025630 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fa95374b-453f-478b-a87f-c85e328ebbc6 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef/action" status: 202 len: 0 microversion: 2.1 time: 0.150632 Jul 31 01:25:01.028375 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1733/3517] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:25:00 2022] POST /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:25:01.036565 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3b7fe0bd-9779-418b-81da-283e76c6dcae tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:01.037200 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3b7fe0bd-9779-418b-81da-283e76c6dcae tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:01.051194 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b7fe0bd-9779-418b-81da-283e76c6dcae tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:01.052001 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b7fe0bd-9779-418b-81da-283e76c6dcae tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:01.053118 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b7fe0bd-9779-418b-81da-283e76c6dcae tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:01.057148 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b7fe0bd-9779-418b-81da-283e76c6dcae tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:01.077737 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b657fb10-e9f4-45fd-8968-d2663e63d392 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:01.078768 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b657fb10-e9f4-45fd-8968-d2663e63d392 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:01.094047 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b657fb10-e9f4-45fd-8968-d2663e63d392 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:01.100080 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b657fb10-e9f4-45fd-8968-d2663e63d392 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:01.112534 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b657fb10-e9f4-45fd-8968-d2663e63d392 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:01.112994 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b657fb10-e9f4-45fd-8968-d2663e63d392 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:01.616472 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3b7fe0bd-9779-418b-81da-283e76c6dcae tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:01.649027 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3b7fe0bd-9779-418b-81da-283e76c6dcae tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1511 microversion: 2.1 time: 0.616189 Jul 31 01:25:01.652278 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1785/3518] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:01 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1511 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:01.698444 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b657fb10-e9f4-45fd-8968-d2663e63d392 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:01.708387 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b657fb10-e9f4-45fd-8968-d2663e63d392 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1484 microversion: 2.1 time: 0.635319 Jul 31 01:25:01.708987 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1734/3519] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:01 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1484 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:01.731524 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c277e33d-49e1-4820-ba18-3b72f09b40aa tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:01.732327 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c277e33d-49e1-4820-ba18-3b72f09b40aa tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:01.746796 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c277e33d-49e1-4820-ba18-3b72f09b40aa tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:01.747587 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c277e33d-49e1-4820-ba18-3b72f09b40aa tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:01.748589 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c277e33d-49e1-4820-ba18-3b72f09b40aa tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:01.749470 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c277e33d-49e1-4820-ba18-3b72f09b40aa tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:01.939240 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c277e33d-49e1-4820-ba18-3b72f09b40aa tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "POST /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121/action" status: 202 len: 0 microversion: 2.1 time: 0.207026 Jul 31 01:25:01.949578 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1786/3520] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:25:01 2022] POST /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:25:01.955904 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-73f53419-a26d-49da-88b4-d10cfd0a2482 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:01.956531 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-73f53419-a26d-49da-88b4-d10cfd0a2482 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:01.981193 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73f53419-a26d-49da-88b4-d10cfd0a2482 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:01.985957 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73f53419-a26d-49da-88b4-d10cfd0a2482 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:01.988120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73f53419-a26d-49da-88b4-d10cfd0a2482 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:01.988788 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73f53419-a26d-49da-88b4-d10cfd0a2482 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:02.503226 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-73f53419-a26d-49da-88b4-d10cfd0a2482 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:02.519533 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-73f53419-a26d-49da-88b4-d10cfd0a2482 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1492 microversion: 2.1 time: 0.568879 Jul 31 01:25:02.523059 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1735/3521] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:01 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1492 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:25:02.695906 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-62181e4d-31bf-4426-b4ff-9fcbae0ea817 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:02.696781 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-62181e4d-31bf-4426-b4ff-9fcbae0ea817 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:02.710664 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-62181e4d-31bf-4426-b4ff-9fcbae0ea817 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:02.711140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-62181e4d-31bf-4426-b4ff-9fcbae0ea817 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:02.711989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-62181e4d-31bf-4426-b4ff-9fcbae0ea817 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:02.712430 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-62181e4d-31bf-4426-b4ff-9fcbae0ea817 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:03.389507 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-62181e4d-31bf-4426-b4ff-9fcbae0ea817 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:03.404963 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-62181e4d-31bf-4426-b4ff-9fcbae0ea817 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1511 microversion: 2.1 time: 0.733030 Jul 31 01:25:03.406213 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1787/3522] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:02 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1511 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:03.571922 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-79d79a36-a926-432e-8491-896e8c4ef06a tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:03.575050 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-79d79a36-a926-432e-8491-896e8c4ef06a tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:03.593755 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79d79a36-a926-432e-8491-896e8c4ef06a tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:03.594491 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79d79a36-a926-432e-8491-896e8c4ef06a tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:03.595660 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79d79a36-a926-432e-8491-896e8c4ef06a tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:03.596277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79d79a36-a926-432e-8491-896e8c4ef06a tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:04.011541 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-79d79a36-a926-432e-8491-896e8c4ef06a tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:04.042438 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-79d79a36-a926-432e-8491-896e8c4ef06a tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1492 microversion: 2.1 time: 0.480909 Jul 31 01:25:04.048971 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1736/3523] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:03 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1492 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:04.430588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-25312efd-e1b5-456a-98c6-9121e18c2afe tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:04.431913 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-25312efd-e1b5-456a-98c6-9121e18c2afe tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:04.446444 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25312efd-e1b5-456a-98c6-9121e18c2afe tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:04.448875 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25312efd-e1b5-456a-98c6-9121e18c2afe tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:04.451790 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25312efd-e1b5-456a-98c6-9121e18c2afe tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:04.452445 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25312efd-e1b5-456a-98c6-9121e18c2afe tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:04.733539 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-25312efd-e1b5-456a-98c6-9121e18c2afe tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:04.749695 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-25312efd-e1b5-456a-98c6-9121e18c2afe tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1511 microversion: 2.1 time: 0.323339 Jul 31 01:25:04.751408 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1788/3524] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:04 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:05.069751 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-301f2e2c-9bec-40d3-bd0b-7502a451078b tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:05.070511 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-301f2e2c-9bec-40d3-bd0b-7502a451078b tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:05.083964 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-301f2e2c-9bec-40d3-bd0b-7502a451078b tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:05.087636 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-301f2e2c-9bec-40d3-bd0b-7502a451078b tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:05.090710 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-301f2e2c-9bec-40d3-bd0b-7502a451078b tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:05.093599 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-301f2e2c-9bec-40d3-bd0b-7502a451078b tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:05.787365 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-746caad3-d6d5-4239-8083-780cc2c58c23 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:05.788770 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-746caad3-d6d5-4239-8083-780cc2c58c23 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:05.808326 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-746caad3-d6d5-4239-8083-780cc2c58c23 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:05.808943 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-746caad3-d6d5-4239-8083-780cc2c58c23 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:05.809911 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-746caad3-d6d5-4239-8083-780cc2c58c23 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:05.810767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-746caad3-d6d5-4239-8083-780cc2c58c23 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:06.104509 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-301f2e2c-9bec-40d3-bd0b-7502a451078b tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:06.115039 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-301f2e2c-9bec-40d3-bd0b-7502a451078b tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1492 microversion: 2.1 time: 1.048660 Jul 31 01:25:06.116683 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1737/3525] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:05 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1492 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:06.334258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-746caad3-d6d5-4239-8083-780cc2c58c23 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:06.349672 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-746caad3-d6d5-4239-8083-780cc2c58c23 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1517 microversion: 2.1 time: 0.578223 Jul 31 01:25:06.350631 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1789/3526] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:05 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1517 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:07.141363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6846f1e5-eb25-4af0-b508-143f9490c724 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:07.142202 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6846f1e5-eb25-4af0-b508-143f9490c724 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:07.159940 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6846f1e5-eb25-4af0-b508-143f9490c724 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:07.159940 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6846f1e5-eb25-4af0-b508-143f9490c724 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:07.160685 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6846f1e5-eb25-4af0-b508-143f9490c724 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:07.171359 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6846f1e5-eb25-4af0-b508-143f9490c724 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:07.614767 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6846f1e5-eb25-4af0-b508-143f9490c724 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:07.626249 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6846f1e5-eb25-4af0-b508-143f9490c724 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1498 microversion: 2.1 time: 0.488910 Jul 31 01:25:07.629775 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1738/3527] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:07 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1498 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:07.658373 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a5d8c428-93ab-47e8-a9b8-95a74275a5eb tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:07.659559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a5d8c428-93ab-47e8-a9b8-95a74275a5eb tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:07.674767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5d8c428-93ab-47e8-a9b8-95a74275a5eb tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:07.675645 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5d8c428-93ab-47e8-a9b8-95a74275a5eb tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:07.678490 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5d8c428-93ab-47e8-a9b8-95a74275a5eb tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:07.679154 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5d8c428-93ab-47e8-a9b8-95a74275a5eb tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:07.718873 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a5d8c428-93ab-47e8-a9b8-95a74275a5eb tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:25:07.970174 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a5d8c428-93ab-47e8-a9b8-95a74275a5eb tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 204 len: 0 microversion: 2.1 time: 0.315624 Jul 31 01:25:07.980353 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1790/3528] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:25:07 2022] DELETE /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:25:07.986979 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d3aeab35-d7da-4141-af26-39c8065ccdae tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:07.988183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d3aeab35-d7da-4141-af26-39c8065ccdae tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:08.007313 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d3aeab35-d7da-4141-af26-39c8065ccdae tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:08.010553 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d3aeab35-d7da-4141-af26-39c8065ccdae tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:08.013089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d3aeab35-d7da-4141-af26-39c8065ccdae tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:08.014580 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d3aeab35-d7da-4141-af26-39c8065ccdae tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:08.445083 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d3aeab35-d7da-4141-af26-39c8065ccdae tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:08.469059 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d3aeab35-d7da-4141-af26-39c8065ccdae tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.485572 Jul 31 01:25:08.471329 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1739/3529] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:07 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:09.202032 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-863f3a5b-323d-4595-8638-aa22820bb972 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'create', calling method: .version_select at 0x7fede4704d30>, body: {"keypair": {"name": "tempest-keypair-1819922888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRZ+QF1AhCxjZggSU4DGSBVPXUNYHH/N/4kgpooSaRtHZjj3hjUbygQW32VsJYQfJkzXKbs76TctNur1XrV2bxmxLD253lnlUOhPy9CxK/t+q2mhwojnCR/7Sfn+gZzNA=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:09.251143 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-863f3a5b-323d-4595-8638-aa22820bb972 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Getting quotas for project af1bdeca391f47f3bde21459bf893f89. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:25:09.275412 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-863f3a5b-323d-4595-8638-aa22820bb972 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Getting quotas for user 87e482f360af4e56a325960d834fb9f8 and project af1bdeca391f47f3bde21459bf893f89. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:25:09.319323 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-863f3a5b-323d-4595-8638-aa22820bb972 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122143 Jul 31 01:25:09.320153 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1791/3530] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:25:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:09.492777 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b863e820-f300-498c-b6b0-f2e44128648e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:09.493382 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b863e820-f300-498c-b6b0-f2e44128648e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:09.500626 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b863e820-f300-498c-b6b0-f2e44128648e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:09.501078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b863e820-f300-498c-b6b0-f2e44128648e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:09.501853 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b863e820-f300-498c-b6b0-f2e44128648e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:09.502289 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b863e820-f300-498c-b6b0-f2e44128648e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:09.517120 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:09.812260 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b863e820-f300-498c-b6b0-f2e44128648e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:09.830492 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b863e820-f300-498c-b6b0-f2e44128648e tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.341472 Jul 31 01:25:09.841873 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1740/3531] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:09 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:10.862618 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e4ce00a7-3dfc-4d8e-bc15-9aa9a05e2d8c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:10.863349 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e4ce00a7-3dfc-4d8e-bc15-9aa9a05e2d8c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:10.873829 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4ce00a7-3dfc-4d8e-bc15-9aa9a05e2d8c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:10.874299 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4ce00a7-3dfc-4d8e-bc15-9aa9a05e2d8c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:10.875093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4ce00a7-3dfc-4d8e-bc15-9aa9a05e2d8c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:10.878769 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4ce00a7-3dfc-4d8e-bc15-9aa9a05e2d8c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:11.716902 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e4ce00a7-3dfc-4d8e-bc15-9aa9a05e2d8c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:11.720748 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:11.729992 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e4ce00a7-3dfc-4d8e-bc15-9aa9a05e2d8c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.871530 Jul 31 01:25:11.739796 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1792/3532] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:10 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:12.746342 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ddc553bb-00c4-45b9-bd99-fcf6625113d4 tempest-ComputeTenantNetworksTest-965623522 tempest-ComputeTenantNetworksTest-965623522-project] Calling method '.version_select at 0x7fede443e310>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:12.757271 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ef6fc51b-ce5c-49af-b3c6-1d1addb8f83c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:12.758828 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ef6fc51b-ce5c-49af-b3c6-1d1addb8f83c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:12.804223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef6fc51b-ce5c-49af-b3c6-1d1addb8f83c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:12.805047 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef6fc51b-ce5c-49af-b3c6-1d1addb8f83c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:12.814428 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef6fc51b-ce5c-49af-b3c6-1d1addb8f83c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:12.815005 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef6fc51b-ce5c-49af-b3c6-1d1addb8f83c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:13.454506 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ddc553bb-00c4-45b9-bd99-fcf6625113d4 tempest-ComputeTenantNetworksTest-965623522 tempest-ComputeTenantNetworksTest-965623522-project] 10.222.0.45 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.116695 Jul 31 01:25:13.455192 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1741/3533] 10.222.0.45 () {58 vars in 1158 bytes} [Sun Jul 31 01:25:12 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:13.468013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-58a25f20-032a-4f9a-9cf4-80720f7fb751 tempest-ComputeTenantNetworksTest-965623522 tempest-ComputeTenantNetworksTest-965623522-project] Calling method '.version_select at 0x7fede43b50d0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:13.701975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ef6fc51b-ce5c-49af-b3c6-1d1addb8f83c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:13.727607 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-58a25f20-032a-4f9a-9cf4-80720f7fb751 tempest-ComputeTenantNetworksTest-965623522 tempest-ComputeTenantNetworksTest-965623522-project] 10.222.0.45 "GET /compute/v2.1/os-tenant-networks/7f86e564-d3b5-4c44-abce-e8e763453cb4" status: 200 len: 140 microversion: 2.1 time: 0.265061 Jul 31 01:25:13.728416 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1742/3534] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 01:25:13 2022] GET /compute/v2.1/os-tenant-networks/7f86e564-d3b5-4c44-abce-e8e763453cb4 => generated 140 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:25:13.739531 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ef6fc51b-ce5c-49af-b3c6-1d1addb8f83c tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 200 len: 1504 microversion: 2.1 time: 0.983176 Jul 31 01:25:13.756838 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1793/3535] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:12 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 1504 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:25:13.760463 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-02c8652e-2625-4795-9572-af294a99d893 req-31768bdd-cee5-4945-9f93-96ce78390143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3718ee1b-5f4c-4eff-963f-7cfa870c1121", "name": "network-vif-deleted", "tag": "71702003-7704-491a-a12c-4c1b90917e4f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:13.800646 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-02c8652e-2625-4795-9572-af294a99d893 req-31768bdd-cee5-4945-9f93-96ce78390143 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:13.801570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-02c8652e-2625-4795-9572-af294a99d893 req-31768bdd-cee5-4945-9f93-96ce78390143 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:13.875875 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-02c8652e-2625-4795-9572-af294a99d893 req-31768bdd-cee5-4945-9f93-96ce78390143 service nova] Creating event network-vif-deleted:71702003-7704-491a-a12c-4c1b90917e4f for instance 3718ee1b-5f4c-4eff-963f-7cfa870c1121 on n-h1-master-1 Jul 31 01:25:13.897146 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-02c8652e-2625-4795-9572-af294a99d893 req-31768bdd-cee5-4945-9f93-96ce78390143 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137139 Jul 31 01:25:13.909104 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1743/3536] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:14.783637 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-37a816d5-0c47-46d4-b191-ff4a34ad8c5d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:14.785790 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-37a816d5-0c47-46d4-b191-ff4a34ad8c5d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: 3718ee1b-5f4c-4eff-963f-7cfa870c1121] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:14.802757 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37a816d5-0c47-46d4-b191-ff4a34ad8c5d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:14.805087 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37a816d5-0c47-46d4-b191-ff4a34ad8c5d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:14.806085 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37a816d5-0c47-46d4-b191-ff4a34ad8c5d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:14.806733 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37a816d5-0c47-46d4-b191-ff4a34ad8c5d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:14.841979 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-37a816d5-0c47-46d4-b191-ff4a34ad8c5d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] HTTP exception thrown: Instance 3718ee1b-5f4c-4eff-963f-7cfa870c1121 could not be found. Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-37a816d5-0c47-46d4-b191-ff4a34ad8c5d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Request method failure captured: Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 HTTP/1.1 Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dl5929VesQgkOJ-WG31Cjrm-PZYIBO8WObETlOd7hORHyaObYaU4G49vBSza9ROKcN-bzMoydRaKTh9Adnt984-oQ8zcLDtQ6MFGe48bl61pExG-O4X19TOtm-1LU-W237q_bGUpTtdjDKtfuDxxLxUs-jfyrTULkFEhn_sttOGT1g Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: e67e378ff39c450b9fb120ccb870a002 Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerRescueTestJSON-1564660558 Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e67e378ff39c450b9fb120ccb870a002"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e67e378ff39c450b9fb120ccb870a002"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e67e378ff39c450b9fb120ccb870a002"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e67e378ff39c450b9fb120ccb870a002", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerRescueTestJSON-1564660558 Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: e67e378ff39c450b9fb120ccb870a002 Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerRescueTestJSON-1564660558 Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerRescueTestJSON-1564660558-project Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 7cf700eaa42443f6a6bd64f51ab7f8dd Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerRescueTestJSON-1564660558-project Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 3718ee1b-5f4c-4eff-963f-7cfa870c1121 could not be found. Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '3718ee1b-5f4c-4eff-963f-7cfa870c1121'} Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3718ee1b-5f4c-4eff-963f-7cfa870c1121 could not be found. Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3718ee1b-5f4c-4eff-963f-7cfa870c1121 could not be found. Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:14.851934 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:14.869334 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:14.869334 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:25:14.869334 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:25:14.869334 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:25:14.869334 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:25:14.869334 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3718ee1b-5f4c-4eff-963f-7cfa870c1121 could not be found. Jul 31 01:25:14.869334 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:14.869334 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-37a816d5-0c47-46d4-b191-ff4a34ad8c5d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Returning 404 to user: Instance 3718ee1b-5f4c-4eff-963f-7cfa870c1121 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:25:14.869334 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-37a816d5-0c47-46d4-b191-ff4a34ad8c5d tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121" status: 404 len: 111 microversion: 2.1 time: 0.078232 Jul 31 01:25:14.869334 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1794/3537] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:14 2022] GET /compute/v2.1/servers/3718ee1b-5f4c-4eff-963f-7cfa870c1121 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:25:14.877629 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f23a18f5-103d-4490-8219-08b3c9e6a783 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:14.880850 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f23a18f5-103d-4490-8219-08b3c9e6a783 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:14.896480 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f23a18f5-103d-4490-8219-08b3c9e6a783 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:14.897031 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f23a18f5-103d-4490-8219-08b3c9e6a783 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:14.897704 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f23a18f5-103d-4490-8219-08b3c9e6a783 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:14.900014 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f23a18f5-103d-4490-8219-08b3c9e6a783 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:14.987777 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f23a18f5-103d-4490-8219-08b3c9e6a783 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:25:15.130244 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f23a18f5-103d-4490-8219-08b3c9e6a783 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 204 len: 0 microversion: 2.1 time: 0.258669 Jul 31 01:25:15.136872 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1744/3538] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:25:14 2022] DELETE /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:25:15.139997 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-94ec4d5c-a7bc-4577-988e-ea19f0c259db tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:15.140619 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-94ec4d5c-a7bc-4577-988e-ea19f0c259db tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:15.155172 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-94ec4d5c-a7bc-4577-988e-ea19f0c259db tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:15.156044 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-94ec4d5c-a7bc-4577-988e-ea19f0c259db tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:15.160461 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-94ec4d5c-a7bc-4577-988e-ea19f0c259db tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:15.161204 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-94ec4d5c-a7bc-4577-988e-ea19f0c259db tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:15.495910 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-94ec4d5c-a7bc-4577-988e-ea19f0c259db tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:15.508091 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-94ec4d5c-a7bc-4577-988e-ea19f0c259db tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1492 microversion: 2.1 time: 0.372090 Jul 31 01:25:15.508933 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1795/3539] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:15 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1492 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:16.056570 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-24280ecf-6fff-4a36-ac63-9f2a3c08209b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-957327039", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b031005-156d-4980-9df3-ab75fe4f1154"}], "security_groups": [{"name": "tempest-securitygroup--1286356137"}], "key_name": "tempest-keypair-1819922888", "user_data": "}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:16.483661 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-24280ecf-6fff-4a36-ac63-9f2a3c08209b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] validate_networks() for [('7b031005-156d-4980-9df3-ab75fe4f1154', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:25:16.528878 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fac953f9-f12a-4e2e-8fd6-17dc2d4462d7 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:16.529494 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fac953f9-f12a-4e2e-8fd6-17dc2d4462d7 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:16.540719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fac953f9-f12a-4e2e-8fd6-17dc2d4462d7 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:16.543281 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fac953f9-f12a-4e2e-8fd6-17dc2d4462d7 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:16.547095 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fac953f9-f12a-4e2e-8fd6-17dc2d4462d7 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:16.547784 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fac953f9-f12a-4e2e-8fd6-17dc2d4462d7 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:17.869379 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fac953f9-f12a-4e2e-8fd6-17dc2d4462d7 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:17.881890 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fac953f9-f12a-4e2e-8fd6-17dc2d4462d7 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1492 microversion: 2.1 time: 1.356752 Jul 31 01:25:17.883013 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1796/3540] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:16 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1492 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:25:18.651101 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fca3544b-16bd-4d13-b45f-3c36c53d3072 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:18.651778 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fca3544b-16bd-4d13-b45f-3c36c53d3072 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:18.663698 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fca3544b-16bd-4d13-b45f-3c36c53d3072 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:18.665562 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fca3544b-16bd-4d13-b45f-3c36c53d3072 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:18.668295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fca3544b-16bd-4d13-b45f-3c36c53d3072 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:18.668942 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fca3544b-16bd-4d13-b45f-3c36c53d3072 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:18.679851 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-24280ecf-6fff-4a36-ac63-9f2a3c08209b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:25:18.680343 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-24280ecf-6fff-4a36-ac63-9f2a3c08209b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:25:18.687627 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-24280ecf-6fff-4a36-ac63-9f2a3c08209b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:25:18.688344 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-24280ecf-6fff-4a36-ac63-9f2a3c08209b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:25:18.689962 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-24280ecf-6fff-4a36-ac63-9f2a3c08209b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:25:18.727007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-24280ecf-6fff-4a36-ac63-9f2a3c08209b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:18.727904 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-24280ecf-6fff-4a36-ac63-9f2a3c08209b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:18.729670 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-24280ecf-6fff-4a36-ac63-9f2a3c08209b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:18.730402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-24280ecf-6fff-4a36-ac63-9f2a3c08209b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:18.759669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-24280ecf-6fff-4a36-ac63-9f2a3c08209b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Getting quotas for project af1bdeca391f47f3bde21459bf893f89. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:25:18.767205 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-24280ecf-6fff-4a36-ac63-9f2a3c08209b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Getting quotas for user 87e482f360af4e56a325960d834fb9f8 and project af1bdeca391f47f3bde21459bf893f89. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:25:18.794966 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-24280ecf-6fff-4a36-ac63-9f2a3c08209b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:25:18.799993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-24280ecf-6fff-4a36-ac63-9f2a3c08209b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:25:18.926669 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-24280ecf-6fff-4a36-ac63-9f2a3c08209b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.872179 Jul 31 01:25:18.931016 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1745/3541] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:25:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 2881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:25:18.946088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2f41498e-3c47-4835-bade-c377c77e9046 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:18.955868 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2f41498e-3c47-4835-bade-c377c77e9046 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:18.972233 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2f41498e-3c47-4835-bade-c377c77e9046 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:18.973299 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2f41498e-3c47-4835-bade-c377c77e9046 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:18.976360 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2f41498e-3c47-4835-bade-c377c77e9046 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:18.977904 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2f41498e-3c47-4835-bade-c377c77e9046 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:19.187006 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fca3544b-16bd-4d13-b45f-3c36c53d3072 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:19.195881 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fca3544b-16bd-4d13-b45f-3c36c53d3072 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.553084 Jul 31 01:25:19.215674 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1797/3542] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:18 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:19.221059 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-412008df-34dc-4f3e-b92e-e7d02fe9c6e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:19.221685 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-412008df-34dc-4f3e-b92e-e7d02fe9c6e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:19.289483 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:19.568909 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-412008df-34dc-4f3e-b92e-e7d02fe9c6e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:19.590422 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-412008df-34dc-4f3e-b92e-e7d02fe9c6e5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1245 microversion: 2.1 time: 0.373271 Jul 31 01:25:19.599789 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1798/3543] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:19 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1245 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:19.629333 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9fb4ce18-5fff-47af-a7c0-4286b06d003a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:19.629974 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9fb4ce18-5fff-47af-a7c0-4286b06d003a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:19.661438 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9fb4ce18-5fff-47af-a7c0-4286b06d003a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:19.672390 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9fb4ce18-5fff-47af-a7c0-4286b06d003a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:19.674956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9fb4ce18-5fff-47af-a7c0-4286b06d003a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:19.675442 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9fb4ce18-5fff-47af-a7c0-4286b06d003a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:19.918608 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2f41498e-3c47-4835-bade-c377c77e9046 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:19.927231 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2f41498e-3c47-4835-bade-c377c77e9046 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1492 microversion: 2.1 time: 0.994172 Jul 31 01:25:19.939972 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1746/3544] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:18 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1492 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:20.082106 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9fb4ce18-5fff-47af-a7c0-4286b06d003a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:20.095153 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9fb4ce18-5fff-47af-a7c0-4286b06d003a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.494157 Jul 31 01:25:20.118394 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1799/3545] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:19 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:20.134423 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f71062e9-62d0-4894-87a2-3c45a599805e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:20.147957 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f71062e9-62d0-4894-87a2-3c45a599805e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:20.170268 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f71062e9-62d0-4894-87a2-3c45a599805e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:20.175616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f71062e9-62d0-4894-87a2-3c45a599805e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:20.179736 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f71062e9-62d0-4894-87a2-3c45a599805e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:20.185846 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f71062e9-62d0-4894-87a2-3c45a599805e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:20.253526 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-58dbfe43-09b8-4640-bf38-01875d7d30c0 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Action: 'create', calling method: .version_select at 0x7fede43c23a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-211333682"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:20.759508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f71062e9-62d0-4894-87a2-3c45a599805e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:20.768904 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f71062e9-62d0-4894-87a2-3c45a599805e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.648435 Jul 31 01:25:20.788010 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1800/3546] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:20 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:20.801460 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4d28da80-e9b1-46d3-9871-764fdea45b1d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:20.805313 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4d28da80-e9b1-46d3-9871-764fdea45b1d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:20.813592 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d28da80-e9b1-46d3-9871-764fdea45b1d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:20.814134 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d28da80-e9b1-46d3-9871-764fdea45b1d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:20.815068 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d28da80-e9b1-46d3-9871-764fdea45b1d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:20.815734 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d28da80-e9b1-46d3-9871-764fdea45b1d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:20.906622 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4d28da80-e9b1-46d3-9871-764fdea45b1d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:20.917072 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4d28da80-e9b1-46d3-9871-764fdea45b1d tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1305 microversion: 2.1 time: 0.125668 Jul 31 01:25:20.918274 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1801/3547] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:20 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:20.925211 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e6e638ac-e863-462d-9e47-da5cad491c59 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:20.926090 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e6e638ac-e863-462d-9e47-da5cad491c59 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:20.933875 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6e638ac-e863-462d-9e47-da5cad491c59 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:20.935247 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6e638ac-e863-462d-9e47-da5cad491c59 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:20.937917 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6e638ac-e863-462d-9e47-da5cad491c59 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:20.938561 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6e638ac-e863-462d-9e47-da5cad491c59 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:21.091908 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-58dbfe43-09b8-4640-bf38-01875d7d30c0 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.150574 Jul 31 01:25:21.092533 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1747/3548] 10.222.0.45 () {60 vars in 1155 bytes} [Sun Jul 31 01:25:19 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1152 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 31 01:25:21.098070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bc337ce7-7016-4060-bf71-e63c2bc9ace5 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:21.100155 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bc337ce7-7016-4060-bf71-e63c2bc9ace5 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:21.114766 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc337ce7-7016-4060-bf71-e63c2bc9ace5 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:21.115225 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc337ce7-7016-4060-bf71-e63c2bc9ace5 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:21.116030 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc337ce7-7016-4060-bf71-e63c2bc9ace5 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:21.116466 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc337ce7-7016-4060-bf71-e63c2bc9ace5 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:21.272213 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bc337ce7-7016-4060-bf71-e63c2bc9ace5 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf700eaa42443f6a6bd64f51ab7f8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67e378ff39c450b9fb120ccb870a002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:21.281434 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bc337ce7-7016-4060-bf71-e63c2bc9ace5 tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 200 len: 1450 microversion: 2.1 time: 0.187266 Jul 31 01:25:21.291195 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1748/3549] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:21 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 1450 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:21.306053 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7afe1325-3c3a-4096-b3c9-d8c8e7c681ce tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Calling method '.version_select at 0x7fede4355c10>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:21.339753 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e6e638ac-e863-462d-9e47-da5cad491c59 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:21.352618 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e6e638ac-e863-462d-9e47-da5cad491c59 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.432848 Jul 31 01:25:21.361858 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1802/3550] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:20 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:21.427364 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7afe1325-3c3a-4096-b3c9-d8c8e7c681ce tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f" status: 200 len: 344 microversion: 2.1 time: 0.131551 Jul 31 01:25:21.428158 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1749/3551] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:25:21 2022] GET /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f => generated 344 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:21.550960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5720f423-7035-4286-a2f0-dd41d16405f8 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] Action: 'create', calling method: .version_select at 0x7fede473e1f0>, body: {"pool": null} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:21.709520 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0d2fd7a7-39a8-43fa-a3e1-6e4ea2798144 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-749322109", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "97fe48eb-b52c-4abc-b249-8d6775315204"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:21.818182 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-0d2fd7a7-39a8-43fa-a3e1-6e4ea2798144 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] validate_networks() for [('97fe48eb-b52c-4abc-b249-8d6775315204', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:25:23.454027 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0d2fd7a7-39a8-43fa-a3e1-6e4ea2798144 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:25:23.455010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0d2fd7a7-39a8-43fa-a3e1-6e4ea2798144 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:25:23.455207 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0d2fd7a7-39a8-43fa-a3e1-6e4ea2798144 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:25:23.456152 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0d2fd7a7-39a8-43fa-a3e1-6e4ea2798144 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:25:23.456817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0d2fd7a7-39a8-43fa-a3e1-6e4ea2798144 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:25:23.474423 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d2fd7a7-39a8-43fa-a3e1-6e4ea2798144 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:23.477827 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d2fd7a7-39a8-43fa-a3e1-6e4ea2798144 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:23.479577 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d2fd7a7-39a8-43fa-a3e1-6e4ea2798144 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:23.482370 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d2fd7a7-39a8-43fa-a3e1-6e4ea2798144 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:23.526352 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-0d2fd7a7-39a8-43fa-a3e1-6e4ea2798144 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Getting quotas for project da596310058e4248bf33465f387956f2. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:25:23.543041 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-0d2fd7a7-39a8-43fa-a3e1-6e4ea2798144 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Getting quotas for user 36a36dbb4f6c40a7bb69c8c3f747aaed and project da596310058e4248bf33465f387956f2. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:25:23.576886 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0d2fd7a7-39a8-43fa-a3e1-6e4ea2798144 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:25:23.590854 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0d2fd7a7-39a8-43fa-a3e1-6e4ea2798144 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:25:23.718694 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0d2fd7a7-39a8-43fa-a3e1-6e4ea2798144 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.013144 Jul 31 01:25:23.723144 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1750/3552] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:25:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:25:23.733102 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-60087d8e-e15d-45b4-b8c9-c262b031faa5 req-3aa24ea4-9e1b-461d-9a24-f75b949cceee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6d88e0-7229-441a-9ea6-79179f9c9531", "name": "network-vif-deleted", "tag": "7727b825-f9ff-406c-9b91-708d69a2d9f7"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:23.763606 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-60087d8e-e15d-45b4-b8c9-c262b031faa5 req-3aa24ea4-9e1b-461d-9a24-f75b949cceee service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:23.764329 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-60087d8e-e15d-45b4-b8c9-c262b031faa5 req-3aa24ea4-9e1b-461d-9a24-f75b949cceee service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:23.788861 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-60087d8e-e15d-45b4-b8c9-c262b031faa5 req-3aa24ea4-9e1b-461d-9a24-f75b949cceee service nova] Creating event network-vif-deleted:7727b825-f9ff-406c-9b91-708d69a2d9f7 for instance cc6d88e0-7229-441a-9ea6-79179f9c9531 on n-h2-master-1 Jul 31 01:25:23.807523 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-60087d8e-e15d-45b4-b8c9-c262b031faa5 req-3aa24ea4-9e1b-461d-9a24-f75b949cceee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080519 Jul 31 01:25:23.811196 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1751/3553] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:23.829414 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1c51e604-1b13-423b-af0c-0cf21b3a9c52 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:23.848096 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1c51e604-1b13-423b-af0c-0cf21b3a9c52 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:23.856706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c51e604-1b13-423b-af0c-0cf21b3a9c52 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:23.869113 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c51e604-1b13-423b-af0c-0cf21b3a9c52 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:23.872933 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c51e604-1b13-423b-af0c-0cf21b3a9c52 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:23.873852 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c51e604-1b13-423b-af0c-0cf21b3a9c52 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:24.492355 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1c51e604-1b13-423b-af0c-0cf21b3a9c52 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:24.507986 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1c51e604-1b13-423b-af0c-0cf21b3a9c52 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1371 microversion: 2.1 time: 0.693195 Jul 31 01:25:24.515702 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1752/3554] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:23 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1371 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:24.530551 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-12431f5c-1ece-494a-aa37-f87589f910ca tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:24.531179 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-12431f5c-1ece-494a-aa37-f87589f910ca tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] [instance: cc6d88e0-7229-441a-9ea6-79179f9c9531] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:24.547531 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12431f5c-1ece-494a-aa37-f87589f910ca tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:24.548027 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12431f5c-1ece-494a-aa37-f87589f910ca tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:24.551211 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12431f5c-1ece-494a-aa37-f87589f910ca tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:24.551894 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12431f5c-1ece-494a-aa37-f87589f910ca tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:24.601308 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-12431f5c-1ece-494a-aa37-f87589f910ca tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] HTTP exception thrown: Instance cc6d88e0-7229-441a-9ea6-79179f9c9531 could not be found. Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-12431f5c-1ece-494a-aa37-f87589f910ca tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Request method failure captured: Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 HTTP/1.1 Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dl5929VesQgkOJ-WG31Cjrm-PZYIBO8WObETlOd7hORHyaObYaU4G49vBSza9ROKcN-bzMoydRaKTh9Adnt984-oQ8zcLDtQ6MFGe48bl61pExG-O4X19TOtm-1LU-W237q_bGUpTtdjDKtfuDxxLxUs-jfyrTULkFEhn_sttOGT1g Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e67e378ff39c450b9fb120ccb870a002 Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerRescueTestJSON-1564660558 Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e67e378ff39c450b9fb120ccb870a002"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e67e378ff39c450b9fb120ccb870a002"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e67e378ff39c450b9fb120ccb870a002"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e67e378ff39c450b9fb120ccb870a002", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerRescueTestJSON-1564660558 Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e67e378ff39c450b9fb120ccb870a002 Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerRescueTestJSON-1564660558 Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerRescueTestJSON-1564660558-project Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 7cf700eaa42443f6a6bd64f51ab7f8dd Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerRescueTestJSON-1564660558-project Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: exception: Instance cc6d88e0-7229-441a-9ea6-79179f9c9531 could not be found. Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'cc6d88e0-7229-441a-9ea6-79179f9c9531'} Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc6d88e0-7229-441a-9ea6-79179f9c9531 could not be found. Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc6d88e0-7229-441a-9ea6-79179f9c9531 could not be found. Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:24.603370 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:24.609440 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:24.609440 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:25:24.609440 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:25:24.609440 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:25:24.609440 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:25:24.609440 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc6d88e0-7229-441a-9ea6-79179f9c9531 could not be found. Jul 31 01:25:24.609440 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:24.611242 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-12431f5c-1ece-494a-aa37-f87589f910ca tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] Returning 404 to user: Instance cc6d88e0-7229-441a-9ea6-79179f9c9531 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:25:24.624713 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-12431f5c-1ece-494a-aa37-f87589f910ca tempest-ServerRescueTestJSON-1564660558 tempest-ServerRescueTestJSON-1564660558-project] 10.222.0.45 "GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531" status: 404 len: 111 microversion: 2.1 time: 0.105273 Jul 31 01:25:24.625971 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1753/3555] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:24 2022] GET /compute/v2.1/servers/cc6d88e0-7229-441a-9ea6-79179f9c9531 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:25:24.632429 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5b50a46e-932d-47ab-b7ac-cbe4de526a1e tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Calling method '.version_select at 0x7fede43f6940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:24.753462 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5b50a46e-932d-47ab-b7ac-cbe4de526a1e tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f" status: 200 len: 345 microversion: 2.1 time: 0.126148 Jul 31 01:25:24.754353 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1754/3556] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:25:24 2022] GET /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:24.759158 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8998961d-94bd-4a2a-a0e2-04980930c66d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:24.759803 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8998961d-94bd-4a2a-a0e2-04980930c66d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:25.068516 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8998961d-94bd-4a2a-a0e2-04980930c66d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:25.085756 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8998961d-94bd-4a2a-a0e2-04980930c66d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1214 microversion: 2.1 time: 0.327069 Jul 31 01:25:25.086436 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1755/3557] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:24 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1214 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:25.112340 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-06f3fcb4-5e0b-4990-b304-e51d50c1d1d8 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Action: 'create', calling method: .version_select at 0x7fede43f69d0>, body: {"snapshot": {"volume_id": "f0f9a645-c2be-4bda-a817-2e965ec1a71f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1778994007"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:25.356142 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5720f423-7035-4286-a2f0-dd41d16405f8 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.992646 Jul 31 01:25:25.357654 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1803/3558] 10.222.0.45 () {60 vars in 1170 bytes} [Sun Jul 31 01:25:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:25.370778 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e332ab94-84d3-4ac8-8955-0393c56c93e8 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] Action: 'create', calling method: .version_select at 0x7fede52a7c10>, body: {"pool": null} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:25.563591 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-06f3fcb4-5e0b-4990-b304-e51d50c1d1d8 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.461482 Jul 31 01:25:25.564204 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1756/3559] 10.222.0.45 () {60 vars in 1162 bytes} [Sun Jul 31 01:25:25 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:25.579770 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5141bf17-2c6a-48e4-a9c0-f348384fb0b9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:25.581080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5141bf17-2c6a-48e4-a9c0-f348384fb0b9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:25.592243 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:25.623412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5141bf17-2c6a-48e4-a9c0-f348384fb0b9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:25.625150 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5141bf17-2c6a-48e4-a9c0-f348384fb0b9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:25.626005 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5141bf17-2c6a-48e4-a9c0-f348384fb0b9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:25.626456 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5141bf17-2c6a-48e4-a9c0-f348384fb0b9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:26.490877 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5141bf17-2c6a-48e4-a9c0-f348384fb0b9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:26.500408 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5141bf17-2c6a-48e4-a9c0-f348384fb0b9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1371 microversion: 2.1 time: 0.933053 Jul 31 01:25:26.500995 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1757/3560] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:25 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1371 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:26.527541 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e6aa73ba-8190-41a0-bf2c-86a8618faa50 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Calling method '.version_select at 0x7fede4510a60>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:26.668933 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e6aa73ba-8190-41a0-bf2c-86a8618faa50 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/eb90f304-44ae-4aa3-84fb-cd36c5c310a9" status: 200 len: 287 microversion: 2.1 time: 0.154970 Jul 31 01:25:26.669508 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1758/3561] 10.222.0.45 () {58 vars in 1251 bytes} [Sun Jul 31 01:25:26 2022] GET /compute/v2.1/os-snapshots/eb90f304-44ae-4aa3-84fb-cd36c5c310a9 => generated 287 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:26.675543 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-92aedcd0-dadc-4401-b1d4-abcfa3bfe3bf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:26.676186 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-92aedcd0-dadc-4401-b1d4-abcfa3bfe3bf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:26.694347 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92aedcd0-dadc-4401-b1d4-abcfa3bfe3bf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:26.694814 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92aedcd0-dadc-4401-b1d4-abcfa3bfe3bf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:26.695644 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92aedcd0-dadc-4401-b1d4-abcfa3bfe3bf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:26.696107 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92aedcd0-dadc-4401-b1d4-abcfa3bfe3bf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:26.912799 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-92aedcd0-dadc-4401-b1d4-abcfa3bfe3bf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:26.929112 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-92aedcd0-dadc-4401-b1d4-abcfa3bfe3bf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1272 microversion: 2.1 time: 0.256435 Jul 31 01:25:26.933672 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1759/3562] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:26 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1272 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:26.951526 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0d5a26d2-2879-41da-a036-1aae35180b90 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Calling method '.version_select at 0x7fede455d940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:27.086445 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0d5a26d2-2879-41da-a036-1aae35180b90 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.150105 Jul 31 01:25:27.087961 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1760/3563] 10.222.0.45 () {58 vars in 1140 bytes} [Sun Jul 31 01:25:26 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:27.099419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e4cd275a-2b01-4101-b49d-77a8f782db15 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Calling method '.version_select at 0x7fede4efc9d0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:27.180347 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e4cd275a-2b01-4101-b49d-77a8f782db15 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/eb90f304-44ae-4aa3-84fb-cd36c5c310a9" status: 200 len: 287 microversion: 2.1 time: 0.085684 Jul 31 01:25:27.182008 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1761/3564] 10.222.0.45 () {58 vars in 1251 bytes} [Sun Jul 31 01:25:27 2022] GET /compute/v2.1/os-snapshots/eb90f304-44ae-4aa3-84fb-cd36c5c310a9 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:27.522659 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ae41800d-d9d5-4f7f-9a13-6e931a2024c9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:27.529188 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ae41800d-d9d5-4f7f-9a13-6e931a2024c9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:27.559692 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae41800d-d9d5-4f7f-9a13-6e931a2024c9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:27.570350 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae41800d-d9d5-4f7f-9a13-6e931a2024c9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:27.571625 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae41800d-d9d5-4f7f-9a13-6e931a2024c9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:27.573669 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae41800d-d9d5-4f7f-9a13-6e931a2024c9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:28.489822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ae41800d-d9d5-4f7f-9a13-6e931a2024c9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:28.498153 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ae41800d-d9d5-4f7f-9a13-6e931a2024c9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1371 microversion: 2.1 time: 0.980411 Jul 31 01:25:28.498744 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1762/3565] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:27 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1371 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:25:28.504630 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-606aa646-5137-4396-a446-f89cbdd92c78 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:28.512373 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-606aa646-5137-4396-a446-f89cbdd92c78 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:28.523238 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-606aa646-5137-4396-a446-f89cbdd92c78 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:28.523777 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-606aa646-5137-4396-a446-f89cbdd92c78 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:28.524572 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-606aa646-5137-4396-a446-f89cbdd92c78 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:28.527713 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-606aa646-5137-4396-a446-f89cbdd92c78 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:28.673567 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-606aa646-5137-4396-a446-f89cbdd92c78 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:28.681904 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-606aa646-5137-4396-a446-f89cbdd92c78 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1272 microversion: 2.1 time: 0.181006 Jul 31 01:25:28.698350 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1763/3566] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:28 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:28.705529 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f5f9c81d-5e9c-4e28-bff0-8f49b4f074b6 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Calling method '.version_select at 0x7fede43acca0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:28.746436 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f5f9c81d-5e9c-4e28-bff0-8f49b4f074b6 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/eb90f304-44ae-4aa3-84fb-cd36c5c310a9" status: 200 len: 288 microversion: 2.1 time: 0.046393 Jul 31 01:25:28.747247 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1764/3567] 10.222.0.45 () {58 vars in 1251 bytes} [Sun Jul 31 01:25:28 2022] GET /compute/v2.1/os-snapshots/eb90f304-44ae-4aa3-84fb-cd36c5c310a9 => generated 288 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:28.758141 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c7899c95-4fcb-4ef6-99ee-8e8ea3e45b29 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Calling method '.version_select at 0x7fede43ac280>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:28.836836 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c7899c95-4fcb-4ef6-99ee-8e8ea3e45b29 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/eb90f304-44ae-4aa3-84fb-cd36c5c310a9" status: 202 len: 0 microversion: 2.1 time: 0.082233 Jul 31 01:25:28.842333 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1765/3568] 10.222.0.45 () {58 vars in 1254 bytes} [Sun Jul 31 01:25:28 2022] DELETE /compute/v2.1/os-snapshots/eb90f304-44ae-4aa3-84fb-cd36c5c310a9 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:25:28.851851 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a88c6396-4b2c-410c-a02a-30f292f390a1 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Calling method '.version_select at 0x7fede449dca0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:28.904548 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a88c6396-4b2c-410c-a02a-30f292f390a1 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/eb90f304-44ae-4aa3-84fb-cd36c5c310a9" status: 200 len: 287 microversion: 2.1 time: 0.059901 Jul 31 01:25:28.909835 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1766/3569] 10.222.0.45 () {58 vars in 1251 bytes} [Sun Jul 31 01:25:28 2022] GET /compute/v2.1/os-snapshots/eb90f304-44ae-4aa3-84fb-cd36c5c310a9 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:29.274510 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e332ab94-84d3-4ac8-8955-0393c56c93e8 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.908936 Jul 31 01:25:29.275559 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1804/3570] 10.222.0.45 () {60 vars in 1170 bytes} [Sun Jul 31 01:25:25 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:25:29.288455 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-72962977-65e5-45fa-8945-d4582cee3a36 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] Action: 'create', calling method: .version_select at 0x7fede4602310>, body: {"pool": null} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:29.526272 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f7ef6226-9049-436b-b1b7-a5cf032846da tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:29.528047 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f7ef6226-9049-436b-b1b7-a5cf032846da tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:29.536248 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:29.539583 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7ef6226-9049-436b-b1b7-a5cf032846da tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:29.540404 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7ef6226-9049-436b-b1b7-a5cf032846da tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:29.543393 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7ef6226-9049-436b-b1b7-a5cf032846da tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:29.544306 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7ef6226-9049-436b-b1b7-a5cf032846da tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:29.598269 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:29.920709 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f7ef6226-9049-436b-b1b7-a5cf032846da tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:29.939459 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f7ef6226-9049-436b-b1b7-a5cf032846da tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1371 microversion: 2.1 time: 0.419543 Jul 31 01:25:29.956718 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1805/3571] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:29 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1371 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:25:29.958093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-410e1f9f-247d-4e3e-a014-f406a1b00efd req-edd49be0-3eb9-4bd7-807b-fffb0391c8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1c5a15-18aa-437c-a4fb-77eaaf234ac0", "tag": "6f32f8d1-4311-494f-a106-51bb2bbad03f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:29.998306 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-410e1f9f-247d-4e3e-a014-f406a1b00efd req-edd49be0-3eb9-4bd7-807b-fffb0391c8d2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:29.999018 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-410e1f9f-247d-4e3e-a014-f406a1b00efd req-edd49be0-3eb9-4bd7-807b-fffb0391c8d2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:30.018673 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-410e1f9f-247d-4e3e-a014-f406a1b00efd req-edd49be0-3eb9-4bd7-807b-fffb0391c8d2 service nova] Creating event network-changed:6f32f8d1-4311-494f-a106-51bb2bbad03f for instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 on n-h1-master-1 Jul 31 01:25:30.026073 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-410e1f9f-247d-4e3e-a014-f406a1b00efd req-edd49be0-3eb9-4bd7-807b-fffb0391c8d2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079233 Jul 31 01:25:30.028865 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1806/3572] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:30.037666 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed0e485d-92eb-4137-a777-ffc70a6f6581 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:30.039120 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ed0e485d-92eb-4137-a777-ffc70a6f6581 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:30.050220 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed0e485d-92eb-4137-a777-ffc70a6f6581 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:30.050707 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed0e485d-92eb-4137-a777-ffc70a6f6581 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:30.052251 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed0e485d-92eb-4137-a777-ffc70a6f6581 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:30.052722 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed0e485d-92eb-4137-a777-ffc70a6f6581 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:30.328382 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ed0e485d-92eb-4137-a777-ffc70a6f6581 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:30.336159 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ed0e485d-92eb-4137-a777-ffc70a6f6581 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1314 microversion: 2.1 time: 0.305670 Jul 31 01:25:30.356465 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1807/3573] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:30 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:30.369164 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f329432b-f1f0-45cd-9795-b3bc97c99fd0 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Calling method '.version_select at 0x7fede46bc5e0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:30.444469 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f329432b-f1f0-45cd-9795-b3bc97c99fd0 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/eb90f304-44ae-4aa3-84fb-cd36c5c310a9" status: 200 len: 287 microversion: 2.1 time: 0.079927 Jul 31 01:25:30.446068 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1808/3574] 10.222.0.45 () {58 vars in 1251 bytes} [Sun Jul 31 01:25:30 2022] GET /compute/v2.1/os-snapshots/eb90f304-44ae-4aa3-84fb-cd36c5c310a9 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:30.965252 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-306cd28a-a896-4f3d-926e-f52fde286750 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:30.966703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-306cd28a-a896-4f3d-926e-f52fde286750 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:30.983476 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-306cd28a-a896-4f3d-926e-f52fde286750 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:30.984318 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-306cd28a-a896-4f3d-926e-f52fde286750 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:30.986772 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-306cd28a-a896-4f3d-926e-f52fde286750 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:30.990310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-306cd28a-a896-4f3d-926e-f52fde286750 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:31.883239 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-72962977-65e5-45fa-8945-d4582cee3a36 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.599020 Jul 31 01:25:31.892054 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1767/3575] 10.222.0.45 () {60 vars in 1170 bytes} [Sun Jul 31 01:25:29 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:31.892987 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-306cd28a-a896-4f3d-926e-f52fde286750 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:31.904485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-592265b3-aea0-42c5-ad97-0179e833d5b6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:31.905129 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-592265b3-aea0-42c5-ad97-0179e833d5b6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:31.910409 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-306cd28a-a896-4f3d-926e-f52fde286750 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1371 microversion: 2.1 time: 0.948162 Jul 31 01:25:31.914118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-592265b3-aea0-42c5-ad97-0179e833d5b6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:31.914583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-592265b3-aea0-42c5-ad97-0179e833d5b6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:31.915386 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-592265b3-aea0-42c5-ad97-0179e833d5b6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:31.915838 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-592265b3-aea0-42c5-ad97-0179e833d5b6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:31.919905 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1809/3576] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:30 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1371 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:25:31.924797 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-93f80fc8-942a-4df3-949f-c4691c6d61dd tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Calling method '.version_select at 0x7fede4657dc0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:31.958493 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-93f80fc8-942a-4df3-949f-c4691c6d61dd tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] HTTP exception thrown: Snapshot eb90f304-44ae-4aa3-84fb-cd36c5c310a9 could not be found. Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-93f80fc8-942a-4df3-949f-c4691c6d61dd tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Request method failure captured: Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/os-snapshots/eb90f304-44ae-4aa3-84fb-cd36c5c310a9 HTTP/1.1 Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dn_C_dJnvhrUeMhhZfnQCMh6JroXmxZG0_leAd1SRif8lvwo80AMeN3FmrjCgYL-ek-x1eXwa2DSeDYOVo4JXZy00hlrNzGJNoQLP-9gNEwji1KPKcL0sKyjss6Ci3PO--jaDcIzC9Z1w7uOKlH4LJChNAVqJGqtNM0zc4Vm7A_Hz0 Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2a327a2eb6b44b68b3955b903340a4a1 Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-868772967 Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a327a2eb6b44b68b3955b903340a4a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a327a2eb6b44b68b3955b903340a4a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a327a2eb6b44b68b3955b903340a4a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a327a2eb6b44b68b3955b903340a4a1", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-VolumesSnapshotsTestJSON-868772967 Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2a327a2eb6b44b68b3955b903340a4a1 Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-868772967 Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-VolumesSnapshotsTestJSON-868772967-project Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 298e778ee2124a0aa71177ce9437b2bd Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-VolumesSnapshotsTestJSON-868772967-project Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: exception: Snapshot eb90f304-44ae-4aa3-84fb-cd36c5c310a9 could not be found. Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'eb90f304-44ae-4aa3-84fb-cd36c5c310a9'} Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot eb90f304-44ae-4aa3-84fb-cd36c5c310a9 could not be found. (HTTP 404) (Request-ID: req-e31664de-7286-474d-8eae-446b50c9ecf2) Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 01:25:31.963879 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot eb90f304-44ae-4aa3-84fb-cd36c5c310a9 could not be found. Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot eb90f304-44ae-4aa3-84fb-cd36c5c310a9 could not be found. Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot eb90f304-44ae-4aa3-84fb-cd36c5c310a9 could not be found. Jul 31 01:25:31.969381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:25:31.972896 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-93f80fc8-942a-4df3-949f-c4691c6d61dd tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Returning 404 to user: Snapshot eb90f304-44ae-4aa3-84fb-cd36c5c310a9 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:25:31.972896 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-93f80fc8-942a-4df3-949f-c4691c6d61dd tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/eb90f304-44ae-4aa3-84fb-cd36c5c310a9" status: 404 len: 111 microversion: 2.1 time: 0.051585 Jul 31 01:25:31.973539 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1810/3577] 10.222.0.45 () {58 vars in 1251 bytes} [Sun Jul 31 01:25:31 2022] GET /compute/v2.1/os-snapshots/eb90f304-44ae-4aa3-84fb-cd36c5c310a9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:25:31.984605 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-88a86a3f-bdbd-4914-b0a0-50b2f81f25bd tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] Action: 'create', calling method: .version_select at 0x7fede4721c10>, body: {"pool": null} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:32.168340 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-592265b3-aea0-42c5-ad97-0179e833d5b6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:32.177152 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-592265b3-aea0-42c5-ad97-0179e833d5b6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1314 microversion: 2.1 time: 0.285529 Jul 31 01:25:32.192200 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1768/3578] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:31 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:32.198817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-afc8ba57-f9dc-4a90-8280-d64ff2df97e0 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Calling method '.version_select at 0x7fede43f6f70>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:32.295194 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-afc8ba57-f9dc-4a90-8280-d64ff2df97e0 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f" status: 202 len: 0 microversion: 2.1 time: 0.100843 Jul 31 01:25:32.296231 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1769/3579] 10.222.0.45 () {58 vars in 1248 bytes} [Sun Jul 31 01:25:32 2022] DELETE /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:25:32.309916 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c4f58ff8-1a86-490f-80da-48d61eb10dba tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Calling method '.version_select at 0x7fede43ac940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:32.382695 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c4f58ff8-1a86-490f-80da-48d61eb10dba tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f" status: 200 len: 344 microversion: 2.1 time: 0.081448 Jul 31 01:25:32.384348 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1770/3580] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:25:32 2022] GET /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f => generated 344 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:32.942431 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5c6393a0-f951-477b-817f-e5cbc8981b84 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:32.943307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5c6393a0-f951-477b-817f-e5cbc8981b84 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:32.960933 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c6393a0-f951-477b-817f-e5cbc8981b84 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:32.961924 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c6393a0-f951-477b-817f-e5cbc8981b84 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:32.963759 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c6393a0-f951-477b-817f-e5cbc8981b84 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:32.964622 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c6393a0-f951-477b-817f-e5cbc8981b84 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:33.495172 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:33.628929 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5c6393a0-f951-477b-817f-e5cbc8981b84 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:33.642160 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5c6393a0-f951-477b-817f-e5cbc8981b84 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1371 microversion: 2.1 time: 0.704770 Jul 31 01:25:33.645942 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1771/3581] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:32 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1371 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:25:33.653247 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a6f593b8-f676-4a15-a098-4292dddaa30d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:33.654105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a6f593b8-f676-4a15-a098-4292dddaa30d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:33.669428 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a6f593b8-f676-4a15-a098-4292dddaa30d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:33.677192 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a6f593b8-f676-4a15-a098-4292dddaa30d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:33.678322 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a6f593b8-f676-4a15-a098-4292dddaa30d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:33.678948 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a6f593b8-f676-4a15-a098-4292dddaa30d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:34.016027 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a6f593b8-f676-4a15-a098-4292dddaa30d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:34.034639 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a6f593b8-f676-4a15-a098-4292dddaa30d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1314 microversion: 2.1 time: 0.387100 Jul 31 01:25:34.036491 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1772/3582] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:33 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:34.043510 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-39a42186-0394-439a-8f9b-36c0849eb87b tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Calling method '.version_select at 0x7fede43eb4c0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:34.173416 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-39a42186-0394-439a-8f9b-36c0849eb87b tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f" status: 200 len: 344 microversion: 2.1 time: 0.134418 Jul 31 01:25:34.174777 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1773/3583] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:25:34 2022] GET /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f => generated 344 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:34.289914 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-88a86a3f-bdbd-4914-b0a0-50b2f81f25bd tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.315527 Jul 31 01:25:34.290519 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1811/3584] 10.222.0.45 () {60 vars in 1170 bytes} [Sun Jul 31 01:25:31 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:34.303297 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ecfc1978-825f-4311-8670-1fecf42e9cc8 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] Calling method '.version_select at 0x7fede452f160>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:34.629491 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ecfc1978-825f-4311-8670-1fecf42e9cc8 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ips/3f984926-0fd0-4ad9-af49-2e3feb349682" status: 200 len: 141 microversion: 2.1 time: 0.328076 Jul 31 01:25:34.630329 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1774/3585] 10.222.0.45 () {58 vars in 1260 bytes} [Sun Jul 31 01:25:34 2022] GET /compute/v2.1/os-floating-ips/3f984926-0fd0-4ad9-af49-2e3feb349682 => generated 141 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:34.642735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-057cc6fd-7625-4dc5-b4b8-2ceb96958104 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] Calling method '.version_select at 0x7fede46b4ca0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:34.666312 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cc2c5fb6-94db-40c4-97d6-042b2db76958 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:34.667331 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cc2c5fb6-94db-40c4-97d6-042b2db76958 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:34.678631 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cc2c5fb6-94db-40c4-97d6-042b2db76958 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:34.679426 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cc2c5fb6-94db-40c4-97d6-042b2db76958 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:34.680703 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cc2c5fb6-94db-40c4-97d6-042b2db76958 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:34.681334 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cc2c5fb6-94db-40c4-97d6-042b2db76958 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:35.074196 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=14 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:35.156106 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cc2c5fb6-94db-40c4-97d6-042b2db76958 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:35.165283 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cc2c5fb6-94db-40c4-97d6-042b2db76958 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1371 microversion: 2.1 time: 0.503268 Jul 31 01:25:35.184457 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1775/3586] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:34 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1371 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:25:35.191432 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ded5aad8-d7da-44fb-b786-d4b5a740871f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:35.192290 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ded5aad8-d7da-44fb-b786-d4b5a740871f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:35.202296 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ded5aad8-d7da-44fb-b786-d4b5a740871f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:35.203757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ded5aad8-d7da-44fb-b786-d4b5a740871f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:35.206484 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ded5aad8-d7da-44fb-b786-d4b5a740871f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:35.207531 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ded5aad8-d7da-44fb-b786-d4b5a740871f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:35.236081 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:35.571738 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ded5aad8-d7da-44fb-b786-d4b5a740871f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:35.581580 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ded5aad8-d7da-44fb-b786-d4b5a740871f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1314 microversion: 2.1 time: 0.395565 Jul 31 01:25:35.592506 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1776/3587] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:35 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:35.605118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-3055def2-115d-4d88-b4f1-baa2acf41449 req-136227b2-68d6-49c6-8b1f-2f78d8b0b8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e2b815f-54aa-47b6-91cf-6ca472620070", "tag": "45220733-bc7c-4188-8a14-14203dd2b136"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:35.624040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3055def2-115d-4d88-b4f1-baa2acf41449 req-136227b2-68d6-49c6-8b1f-2f78d8b0b8d5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:35.625026 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3055def2-115d-4d88-b4f1-baa2acf41449 req-136227b2-68d6-49c6-8b1f-2f78d8b0b8d5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:35.652978 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-3055def2-115d-4d88-b4f1-baa2acf41449 req-136227b2-68d6-49c6-8b1f-2f78d8b0b8d5 service nova] Creating event network-changed:45220733-bc7c-4188-8a14-14203dd2b136 for instance 1e2b815f-54aa-47b6-91cf-6ca472620070 on n-h2-master-1 Jul 31 01:25:35.669447 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-3055def2-115d-4d88-b4f1-baa2acf41449 req-136227b2-68d6-49c6-8b1f-2f78d8b0b8d5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074991 Jul 31 01:25:35.677537 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1777/3588] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:35.689173 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-607e7a4f-b667-4f62-9a76-5b0ea95f49cd tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Calling method '.version_select at 0x7fede4355280>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:35.753951 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-607e7a4f-b667-4f62-9a76-5b0ea95f49cd tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] HTTP exception thrown: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-607e7a4f-b667-4f62-9a76-5b0ea95f49cd tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Request method failure captured: Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f HTTP/1.1 Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dn_C_dJnvhrUeMhhZfnQCMh6JroXmxZG0_leAd1SRif8lvwo80AMeN3FmrjCgYL-ek-x1eXwa2DSeDYOVo4JXZy00hlrNzGJNoQLP-9gNEwji1KPKcL0sKyjss6Ci3PO--jaDcIzC9Z1w7uOKlH4LJChNAVqJGqtNM0zc4Vm7A_Hz0 Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2a327a2eb6b44b68b3955b903340a4a1 Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-868772967 Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a327a2eb6b44b68b3955b903340a4a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a327a2eb6b44b68b3955b903340a4a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a327a2eb6b44b68b3955b903340a4a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a327a2eb6b44b68b3955b903340a4a1", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesSnapshotsTestJSON-868772967 Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2a327a2eb6b44b68b3955b903340a4a1 Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-868772967 Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesSnapshotsTestJSON-868772967-project Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 298e778ee2124a0aa71177ce9437b2bd Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesSnapshotsTestJSON-868772967-project Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: exception: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'f0f9a645-c2be-4bda-a817-2e965ec1a71f'} Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. (HTTP 404) (Request-ID: req-6ab6a7a8-04e3-4dda-bf4d-3fe2e3a5a62e) Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 01:25:35.756063 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-607e7a4f-b667-4f62-9a76-5b0ea95f49cd tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Returning 404 to user: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-607e7a4f-b667-4f62-9a76-5b0ea95f49cd tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f" status: 404 len: 109 microversion: 2.1 time: 0.078383 Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1778/3589] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:25:35 2022] GET /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:25:35.769840 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3be72e5f-1422-4d91-b987-f6524964d251 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Calling method '.version_select at 0x7fede4413160>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:35.821311 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-3be72e5f-1422-4d91-b987-f6524964d251 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] HTTP exception thrown: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3be72e5f-1422-4d91-b987-f6524964d251 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Request method failure captured: Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f HTTP/1.1 Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dn_C_dJnvhrUeMhhZfnQCMh6JroXmxZG0_leAd1SRif8lvwo80AMeN3FmrjCgYL-ek-x1eXwa2DSeDYOVo4JXZy00hlrNzGJNoQLP-9gNEwji1KPKcL0sKyjss6Ci3PO--jaDcIzC9Z1w7uOKlH4LJChNAVqJGqtNM0zc4Vm7A_Hz0 Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2a327a2eb6b44b68b3955b903340a4a1 Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-868772967 Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a327a2eb6b44b68b3955b903340a4a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a327a2eb6b44b68b3955b903340a4a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a327a2eb6b44b68b3955b903340a4a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a327a2eb6b44b68b3955b903340a4a1", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesSnapshotsTestJSON-868772967 Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2a327a2eb6b44b68b3955b903340a4a1 Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-868772967 Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesSnapshotsTestJSON-868772967-project Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 298e778ee2124a0aa71177ce9437b2bd Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesSnapshotsTestJSON-868772967-project Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: exception: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'f0f9a645-c2be-4bda-a817-2e965ec1a71f'} Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. (HTTP 404) (Request-ID: req-6a80b79b-3844-45de-8da7-e04d94d0b9db) Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 01:25:35.823303 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3be72e5f-1422-4d91-b987-f6524964d251 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Returning 404 to user: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3be72e5f-1422-4d91-b987-f6524964d251 tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f" status: 404 len: 109 microversion: 2.1 time: 0.059839 Jul 31 01:25:35.832245 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1779/3590] 10.222.0.45 () {58 vars in 1248 bytes} [Sun Jul 31 01:25:35 2022] DELETE /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:25:35.836469 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4d129629-bf31-4809-b577-590c9ea3e39f tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Calling method '.version_select at 0x7fede4413280>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:35.899886 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-4d129629-bf31-4809-b577-590c9ea3e39f tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] HTTP exception thrown: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4d129629-bf31-4809-b577-590c9ea3e39f tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Request method failure captured: Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f HTTP/1.1 Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dn_C_dJnvhrUeMhhZfnQCMh6JroXmxZG0_leAd1SRif8lvwo80AMeN3FmrjCgYL-ek-x1eXwa2DSeDYOVo4JXZy00hlrNzGJNoQLP-9gNEwji1KPKcL0sKyjss6Ci3PO--jaDcIzC9Z1w7uOKlH4LJChNAVqJGqtNM0zc4Vm7A_Hz0 Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2a327a2eb6b44b68b3955b903340a4a1 Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-868772967 Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a327a2eb6b44b68b3955b903340a4a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a327a2eb6b44b68b3955b903340a4a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a327a2eb6b44b68b3955b903340a4a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a327a2eb6b44b68b3955b903340a4a1", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesSnapshotsTestJSON-868772967 Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2a327a2eb6b44b68b3955b903340a4a1 Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-868772967 Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesSnapshotsTestJSON-868772967-project Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 298e778ee2124a0aa71177ce9437b2bd Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesSnapshotsTestJSON-868772967-project Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: exception: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'f0f9a645-c2be-4bda-a817-2e965ec1a71f'} Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. (HTTP 404) (Request-ID: req-b0dc046d-b3eb-4050-a431-ee3a1fe3da75) Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 01:25:35.902354 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4d129629-bf31-4809-b577-590c9ea3e39f tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] Returning 404 to user: Volume f0f9a645-c2be-4bda-a817-2e965ec1a71f could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4d129629-bf31-4809-b577-590c9ea3e39f tempest-VolumesSnapshotsTestJSON-868772967 tempest-VolumesSnapshotsTestJSON-868772967-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f" status: 404 len: 109 microversion: 2.1 time: 0.074228 Jul 31 01:25:35.909264 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1780/3591] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:25:35 2022] GET /compute/v2.1/os-volumes/f0f9a645-c2be-4bda-a817-2e965ec1a71f => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:25:36.192490 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-91ae750d-5698-4412-90e8-e01c3e6ce893 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:36.194052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-91ae750d-5698-4412-90e8-e01c3e6ce893 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:36.204242 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91ae750d-5698-4412-90e8-e01c3e6ce893 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:36.206240 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91ae750d-5698-4412-90e8-e01c3e6ce893 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:36.207283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91ae750d-5698-4412-90e8-e01c3e6ce893 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:36.207979 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91ae750d-5698-4412-90e8-e01c3e6ce893 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:36.292021 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-057cc6fd-7625-4dc5-b4b8-2ceb96958104 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/3f984926-0fd0-4ad9-af49-2e3feb349682" status: 202 len: 0 microversion: 2.1 time: 1.652140 Jul 31 01:25:36.292540 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1812/3592] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:25:34 2022] DELETE /compute/v2.1/os-floating-ips/3f984926-0fd0-4ad9-af49-2e3feb349682 => generated 0 bytes in 1654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:25:36.301564 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-965701f8-ffc6-4dde-8f89-08f3603a6822 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] Calling method '.version_select at 0x7fede46b41f0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:36.683844 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-91ae750d-5698-4412-90e8-e01c3e6ce893 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:36.692143 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-91ae750d-5698-4412-90e8-e01c3e6ce893 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1371 microversion: 2.1 time: 0.504059 Jul 31 01:25:36.695198 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1781/3593] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:36 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1371 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:25:36.703540 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d45a4df2-05cd-43a4-99a4-1573401c86a0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:36.708652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d45a4df2-05cd-43a4-99a4-1573401c86a0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:36.725647 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d45a4df2-05cd-43a4-99a4-1573401c86a0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:36.726489 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d45a4df2-05cd-43a4-99a4-1573401c86a0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:36.727594 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d45a4df2-05cd-43a4-99a4-1573401c86a0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:36.728283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d45a4df2-05cd-43a4-99a4-1573401c86a0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:36.781987 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-965701f8-ffc6-4dde-8f89-08f3603a6822 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.484305 Jul 31 01:25:36.783265 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1813/3594] 10.222.0.45 () {58 vars in 1164 bytes} [Sun Jul 31 01:25:36 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:25:36.794911 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9c5bee38-92bc-494f-8eaf-15cd695ed739 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] Calling method '.version_select at 0x7fede46b4af0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:37.291305 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d45a4df2-05cd-43a4-99a4-1573401c86a0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:37.307548 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d45a4df2-05cd-43a4-99a4-1573401c86a0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1314 microversion: 2.1 time: 0.607241 Jul 31 01:25:37.308156 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1782/3595] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:36 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:37.428964 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9c5bee38-92bc-494f-8eaf-15cd695ed739 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] 10.222.0.45 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.638460 Jul 31 01:25:37.430120 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1814/3596] 10.222.0.45 () {58 vars in 1149 bytes} [Sun Jul 31 01:25:36 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:37.444687 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-17ef10f5-4bd4-42ef-9dfb-a5b61a5678e2 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] Calling method '.version_select at 0x7fede43afd30>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:37.717058 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d5ae7f48-2bf6-43fd-a0cf-8372f300770f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:37.717902 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d5ae7f48-2bf6-43fd-a0cf-8372f300770f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:37.751910 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5ae7f48-2bf6-43fd-a0cf-8372f300770f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:37.752421 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5ae7f48-2bf6-43fd-a0cf-8372f300770f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:37.753256 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5ae7f48-2bf6-43fd-a0cf-8372f300770f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:37.759328 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5ae7f48-2bf6-43fd-a0cf-8372f300770f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:38.501945 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d5ae7f48-2bf6-43fd-a0cf-8372f300770f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:38.517195 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d5ae7f48-2bf6-43fd-a0cf-8372f300770f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1371 microversion: 2.1 time: 0.802366 Jul 31 01:25:38.517844 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1815/3597] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:37 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1371 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:39.025857 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-83f85680-34b6-4a43-9d07-f798e0288d65 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-310570354", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "1b546ccf-8c8b-4206-974d-fd9e824c3855"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:39.130825 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-17ef10f5-4bd4-42ef-9dfb-a5b61a5678e2 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/b46b0e14-de28-436e-ae16-d8884304a284" status: 202 len: 0 microversion: 2.1 time: 1.689951 Jul 31 01:25:39.132025 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1783/3598] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:25:37 2022] DELETE /compute/v2.1/os-floating-ips/b46b0e14-de28-436e-ae16-d8884304a284 => generated 0 bytes in 1692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:25:39.139003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-78e36b59-0ab9-4b63-9be4-27e61c2754ca tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:39.140003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-78e36b59-0ab9-4b63-9be4-27e61c2754ca tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:39.143324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-83f85680-34b6-4a43-9d07-f798e0288d65 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] validate_networks() for [('1b546ccf-8c8b-4206-974d-fd9e824c3855', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:25:39.152743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78e36b59-0ab9-4b63-9be4-27e61c2754ca tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:39.153196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78e36b59-0ab9-4b63-9be4-27e61c2754ca tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:39.153974 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78e36b59-0ab9-4b63-9be4-27e61c2754ca tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:39.159276 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78e36b59-0ab9-4b63-9be4-27e61c2754ca tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:40.016984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-78e36b59-0ab9-4b63-9be4-27e61c2754ca tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:40.056160 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-78e36b59-0ab9-4b63-9be4-27e61c2754ca tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1314 microversion: 2.1 time: 0.919085 Jul 31 01:25:40.057533 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1784/3599] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:39 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1314 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:40.075162 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3d6fd7cd-b2f4-4e2d-ba88-dcf87802e3cc tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] Calling method '.version_select at 0x7fede449d8b0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:41.381407 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-83f85680-34b6-4a43-9d07-f798e0288d65 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:25:41.381904 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-83f85680-34b6-4a43-9d07-f798e0288d65 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:25:41.382302 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-83f85680-34b6-4a43-9d07-f798e0288d65 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:25:41.383991 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-83f85680-34b6-4a43-9d07-f798e0288d65 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:25:41.384439 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-83f85680-34b6-4a43-9d07-f798e0288d65 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:25:41.404752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83f85680-34b6-4a43-9d07-f798e0288d65 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:41.407397 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83f85680-34b6-4a43-9d07-f798e0288d65 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:41.409074 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83f85680-34b6-4a43-9d07-f798e0288d65 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:41.410083 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83f85680-34b6-4a43-9d07-f798e0288d65 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:41.497747 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-83f85680-34b6-4a43-9d07-f798e0288d65 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Getting quotas for project 00d0b808d82040f8a0c2dba3f39aac25. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:25:41.509412 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-83f85680-34b6-4a43-9d07-f798e0288d65 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Getting quotas for user 72d5af8e2a3541e8b4473ef4428e1acb and project 00d0b808d82040f8a0c2dba3f39aac25. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:25:41.546426 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-83f85680-34b6-4a43-9d07-f798e0288d65 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:25:41.573461 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-83f85680-34b6-4a43-9d07-f798e0288d65 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:25:41.756800 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-83f85680-34b6-4a43-9d07-f798e0288d65 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.237082 Jul 31 01:25:41.757474 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1816/3600] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:25:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:25:41.768133 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8a4cf010-e1a7-4c40-b86c-96e98a8575a5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:41.769916 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8a4cf010-e1a7-4c40-b86c-96e98a8575a5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:41.786297 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a4cf010-e1a7-4c40-b86c-96e98a8575a5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:41.787035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a4cf010-e1a7-4c40-b86c-96e98a8575a5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:41.788070 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a4cf010-e1a7-4c40-b86c-96e98a8575a5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:41.788690 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a4cf010-e1a7-4c40-b86c-96e98a8575a5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:42.821184 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8a4cf010-e1a7-4c40-b86c-96e98a8575a5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:42.845518 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3d6fd7cd-b2f4-4e2d-ba88-dcf87802e3cc tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/131e0a40-9526-4e0d-accf-d188cf4dcbaa" status: 202 len: 0 microversion: 2.1 time: 2.785141 Jul 31 01:25:42.847353 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1785/3601] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:25:40 2022] DELETE /compute/v2.1/os-floating-ips/131e0a40-9526-4e0d-accf-d188cf4dcbaa => generated 0 bytes in 2789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:25:42.852559 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8a4cf010-e1a7-4c40-b86c-96e98a8575a5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1371 microversion: 2.1 time: 1.083196 Jul 31 01:25:42.856944 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-a5a86669-05ca-42b8-ab0d-0766163e9998 req-551fa4d1-db66-48cc-8dbf-fa7ae393bcf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1c5a15-18aa-437c-a4fb-77eaaf234ac0", "name": "network-vif-plugged", "status": "completed", "tag": "6f32f8d1-4311-494f-a106-51bb2bbad03f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:42.862400 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1817/3602] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:41 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1371 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:42.900142 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bb29b3b4-1e69-440b-b55f-13bcab6223b1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:42.911690 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bb29b3b4-1e69-440b-b55f-13bcab6223b1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:42.948434 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a5a86669-05ca-42b8-ab0d-0766163e9998 req-551fa4d1-db66-48cc-8dbf-fa7ae393bcf2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:42.951243 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a5a86669-05ca-42b8-ab0d-0766163e9998 req-551fa4d1-db66-48cc-8dbf-fa7ae393bcf2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:42.965903 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bb29b3b4-1e69-440b-b55f-13bcab6223b1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:42.972362 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bb29b3b4-1e69-440b-b55f-13bcab6223b1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:42.974799 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bb29b3b4-1e69-440b-b55f-13bcab6223b1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:42.979272 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bb29b3b4-1e69-440b-b55f-13bcab6223b1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:43.020287 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-a5a86669-05ca-42b8-ab0d-0766163e9998 req-551fa4d1-db66-48cc-8dbf-fa7ae393bcf2 service nova] Creating event network-vif-plugged:6f32f8d1-4311-494f-a106-51bb2bbad03f for instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 on n-h1-master-1 Jul 31 01:25:43.045191 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-a5a86669-05ca-42b8-ab0d-0766163e9998 req-551fa4d1-db66-48cc-8dbf-fa7ae393bcf2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195713 Jul 31 01:25:43.045861 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1786/3603] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:43.051127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f8ec4546-7d57-4e92-b617-c07a367a7318 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:43.068732 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f8ec4546-7d57-4e92-b617-c07a367a7318 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:43.103796 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=85 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:43.107894 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8ec4546-7d57-4e92-b617-c07a367a7318 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:43.108672 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8ec4546-7d57-4e92-b617-c07a367a7318 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:43.111256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8ec4546-7d57-4e92-b617-c07a367a7318 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:43.113922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8ec4546-7d57-4e92-b617-c07a367a7318 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:43.250356 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f8ec4546-7d57-4e92-b617-c07a367a7318 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5af8e2a3541e8b4473ef4428e1acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d0b808d82040f8a0c2dba3f39aac25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:43.270827 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f8ec4546-7d57-4e92-b617-c07a367a7318 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 200 len: 1219 microversion: 2.1 time: 0.223116 Jul 31 01:25:43.279404 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1787/3604] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:43 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 1219 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:43.285770 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4273f0ab-da0e-45b0-89d4-6f2d402602c5 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] Calling method '.version_select at 0x7fede43ac790>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:43.626971 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bb29b3b4-1e69-440b-b55f-13bcab6223b1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:43.635219 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bb29b3b4-1e69-440b-b55f-13bcab6223b1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1314 microversion: 2.1 time: 0.770535 Jul 31 01:25:43.635846 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1818/3605] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:42 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:43.896206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cd06c868-f9c8-4c5b-937a-59cb47394863 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:43.898637 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cd06c868-f9c8-4c5b-937a-59cb47394863 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:43.933368 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd06c868-f9c8-4c5b-937a-59cb47394863 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:43.938697 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd06c868-f9c8-4c5b-937a-59cb47394863 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:43.942420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd06c868-f9c8-4c5b-937a-59cb47394863 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:43.944598 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd06c868-f9c8-4c5b-937a-59cb47394863 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:44.489237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cd06c868-f9c8-4c5b-937a-59cb47394863 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:44.499805 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cd06c868-f9c8-4c5b-937a-59cb47394863 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1371 microversion: 2.1 time: 0.616716 Jul 31 01:25:44.501400 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1819/3606] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:43 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1371 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:44.510456 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-74d3507c-0d4a-47f4-8c56-43e14abbec44 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:44.512317 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-74d3507c-0d4a-47f4-8c56-43e14abbec44 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:44.519813 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74d3507c-0d4a-47f4-8c56-43e14abbec44 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:44.520565 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74d3507c-0d4a-47f4-8c56-43e14abbec44 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:44.521621 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74d3507c-0d4a-47f4-8c56-43e14abbec44 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:44.522300 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74d3507c-0d4a-47f4-8c56-43e14abbec44 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:44.674665 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-74d3507c-0d4a-47f4-8c56-43e14abbec44 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5af8e2a3541e8b4473ef4428e1acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d0b808d82040f8a0c2dba3f39aac25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:44.684716 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-74d3507c-0d4a-47f4-8c56-43e14abbec44 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 200 len: 1273 microversion: 2.1 time: 0.181971 Jul 31 01:25:44.685876 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1820/3607] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:44 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 1273 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:44.692501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0ad420b6-cc5e-4fd5-aaa4-a587a4af243e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:44.693365 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0ad420b6-cc5e-4fd5-aaa4-a587a4af243e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:44.715515 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ad420b6-cc5e-4fd5-aaa4-a587a4af243e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:44.716292 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ad420b6-cc5e-4fd5-aaa4-a587a4af243e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:44.718323 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ad420b6-cc5e-4fd5-aaa4-a587a4af243e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:44.722994 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ad420b6-cc5e-4fd5-aaa4-a587a4af243e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:45.201713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0ad420b6-cc5e-4fd5-aaa4-a587a4af243e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:45.216204 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0ad420b6-cc5e-4fd5-aaa4-a587a4af243e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1314 microversion: 2.1 time: 0.526451 Jul 31 01:25:45.218140 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1821/3608] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:44 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:45.522675 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c5077f9b-c137-4652-b29d-7f022e8b1033 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:45.523315 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c5077f9b-c137-4652-b29d-7f022e8b1033 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:45.539093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5077f9b-c137-4652-b29d-7f022e8b1033 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:45.539661 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5077f9b-c137-4652-b29d-7f022e8b1033 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:45.540474 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5077f9b-c137-4652-b29d-7f022e8b1033 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:45.542737 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5077f9b-c137-4652-b29d-7f022e8b1033 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:46.163331 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4273f0ab-da0e-45b0-89d4-6f2d402602c5 tempest-FloatingIPDetailsTestJSON-673495864 tempest-FloatingIPDetailsTestJSON-673495864-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/fb4f8155-570e-460d-93e2-32b6f4d8bc0c" status: 202 len: 0 microversion: 2.1 time: 2.888308 Jul 31 01:25:46.164885 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1788/3609] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:25:43 2022] DELETE /compute/v2.1/os-floating-ips/fb4f8155-570e-460d-93e2-32b6f4d8bc0c => generated 0 bytes in 2890 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:25:46.171864 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c5077f9b-c137-4652-b29d-7f022e8b1033 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:46.175086 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-dcba7209-afd0-400a-9dd4-a03f04073527 req-e3d84745-b45b-492e-8088-2f1500803a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e2b815f-54aa-47b6-91cf-6ca472620070", "name": "network-vif-plugged", "status": "completed", "tag": "45220733-bc7c-4188-8a14-14203dd2b136"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:46.190162 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c5077f9b-c137-4652-b29d-7f022e8b1033 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1565 microversion: 2.1 time: 0.672678 Jul 31 01:25:46.192563 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1822/3610] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:45 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1565 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:25:46.209272 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-566a363a-b6c1-4f5f-abe2-3af5f61bda5a tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:46.214956 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-566a363a-b6c1-4f5f-abe2-3af5f61bda5a tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:46.218392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-dcba7209-afd0-400a-9dd4-a03f04073527 req-e3d84745-b45b-492e-8088-2f1500803a12 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:46.219111 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-dcba7209-afd0-400a-9dd4-a03f04073527 req-e3d84745-b45b-492e-8088-2f1500803a12 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:46.236116 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-566a363a-b6c1-4f5f-abe2-3af5f61bda5a tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:46.236880 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-566a363a-b6c1-4f5f-abe2-3af5f61bda5a tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:46.237865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-566a363a-b6c1-4f5f-abe2-3af5f61bda5a tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:46.238518 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-566a363a-b6c1-4f5f-abe2-3af5f61bda5a tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:46.241355 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-dcba7209-afd0-400a-9dd4-a03f04073527 req-e3d84745-b45b-492e-8088-2f1500803a12 service nova] Creating event network-vif-plugged:45220733-bc7c-4188-8a14-14203dd2b136 for instance 1e2b815f-54aa-47b6-91cf-6ca472620070 on n-h2-master-1 Jul 31 01:25:46.254296 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-dcba7209-afd0-400a-9dd4-a03f04073527 req-e3d84745-b45b-492e-8088-2f1500803a12 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087131 Jul 31 01:25:46.258125 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1789/3611] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:46.274801 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-622e94ab-0fe5-4408-83b6-32076b0bd767 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:46.277474 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-622e94ab-0fe5-4408-83b6-32076b0bd767 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:46.316550 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-622e94ab-0fe5-4408-83b6-32076b0bd767 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:46.317592 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-622e94ab-0fe5-4408-83b6-32076b0bd767 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:46.318746 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-622e94ab-0fe5-4408-83b6-32076b0bd767 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:46.319446 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-622e94ab-0fe5-4408-83b6-32076b0bd767 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:46.420468 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-566a363a-b6c1-4f5f-abe2-3af5f61bda5a tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5af8e2a3541e8b4473ef4428e1acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d0b808d82040f8a0c2dba3f39aac25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:46.435241 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-566a363a-b6c1-4f5f-abe2-3af5f61bda5a tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 200 len: 1273 microversion: 2.1 time: 0.239895 Jul 31 01:25:46.454902 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1823/3612] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:46 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 1273 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:46.469108 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-15ffa5ec-1c7b-43e9-86dc-eea707beb203 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:46.470880 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-15ffa5ec-1c7b-43e9-86dc-eea707beb203 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:46.488416 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-15ffa5ec-1c7b-43e9-86dc-eea707beb203 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:46.490331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-15ffa5ec-1c7b-43e9-86dc-eea707beb203 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:46.491198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-15ffa5ec-1c7b-43e9-86dc-eea707beb203 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:46.494946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-15ffa5ec-1c7b-43e9-86dc-eea707beb203 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:47.117126 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-622e94ab-0fe5-4408-83b6-32076b0bd767 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.856368 Jul 31 01:25:47.118066 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1790/3613] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:25:46 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-interface => generated 284 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:47.336574 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-15ffa5ec-1c7b-43e9-86dc-eea707beb203 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:47.344917 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-15ffa5ec-1c7b-43e9-86dc-eea707beb203 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1314 microversion: 2.1 time: 0.888429 Jul 31 01:25:47.346338 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1824/3614] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:46 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1314 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:47.457046 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6b194f2f-02f4-4469-9451-805031613fc4 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:47.458644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6b194f2f-02f4-4469-9451-805031613fc4 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:47.471219 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b194f2f-02f4-4469-9451-805031613fc4 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:47.471946 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b194f2f-02f4-4469-9451-805031613fc4 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:47.472917 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b194f2f-02f4-4469-9451-805031613fc4 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:47.473796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b194f2f-02f4-4469-9451-805031613fc4 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:48.249059 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6b194f2f-02f4-4469-9451-805031613fc4 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5af8e2a3541e8b4473ef4428e1acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d0b808d82040f8a0c2dba3f39aac25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:48.259020 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6b194f2f-02f4-4469-9451-805031613fc4 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 200 len: 1315 microversion: 2.1 time: 0.805778 Jul 31 01:25:48.262091 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1791/3615] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:47 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 1315 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:48.368387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-482e3f05-f367-44ce-a40a-2185c1d56cfd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:48.370232 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-482e3f05-f367-44ce-a40a-2185c1d56cfd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:48.383696 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-482e3f05-f367-44ce-a40a-2185c1d56cfd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:48.384165 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-482e3f05-f367-44ce-a40a-2185c1d56cfd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:48.390836 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-482e3f05-f367-44ce-a40a-2185c1d56cfd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:48.392646 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-482e3f05-f367-44ce-a40a-2185c1d56cfd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:49.010392 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-482e3f05-f367-44ce-a40a-2185c1d56cfd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:49.030144 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-482e3f05-f367-44ce-a40a-2185c1d56cfd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1501 microversion: 2.1 time: 0.665301 Jul 31 01:25:49.031487 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1825/3616] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:48 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1501 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:49.053401 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-33906100-97e2-450b-9cd0-820338448a4e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:49.054566 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-33906100-97e2-450b-9cd0-820338448a4e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:49.063556 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33906100-97e2-450b-9cd0-820338448a4e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:49.064377 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33906100-97e2-450b-9cd0-820338448a4e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:49.065370 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33906100-97e2-450b-9cd0-820338448a4e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:49.066163 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33906100-97e2-450b-9cd0-820338448a4e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:49.286141 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0ee66aac-ad9c-415d-9df9-a9217486433b tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:49.287231 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0ee66aac-ad9c-415d-9df9-a9217486433b tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:49.300142 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ee66aac-ad9c-415d-9df9-a9217486433b tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:49.300873 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ee66aac-ad9c-415d-9df9-a9217486433b tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:49.307470 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ee66aac-ad9c-415d-9df9-a9217486433b tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:49.308198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ee66aac-ad9c-415d-9df9-a9217486433b tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:49.805505 n-d-master-1 devstack@n-api.service[119474]: INFO nova.network.security_group_api [None req-33906100-97e2-450b-9cd0-820338448a4e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Removing security group 8100e8ab-c73e-434b-afee-1759cc8d79f8 from port 45220733-bc7c-4188-8a14-14203dd2b136 Jul 31 01:25:50.263565 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0ee66aac-ad9c-415d-9df9-a9217486433b tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5af8e2a3541e8b4473ef4428e1acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d0b808d82040f8a0c2dba3f39aac25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:50.281961 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0ee66aac-ad9c-415d-9df9-a9217486433b tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 200 len: 1315 microversion: 2.1 time: 1.003765 Jul 31 01:25:50.282968 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1826/3617] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:49 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 1315 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:50.893485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-5845175b-f5f5-4583-9e60-45d2c8ec7d7c req-d414f424-35a3-48b6-b1df-0983fe48ed1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72d166cf-218b-4999-8788-afee9450c165", "tag": "2c685145-9ae8-40ba-8780-23f2d9baaea2"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:50.913658 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5845175b-f5f5-4583-9e60-45d2c8ec7d7c req-d414f424-35a3-48b6-b1df-0983fe48ed1a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:50.914094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5845175b-f5f5-4583-9e60-45d2c8ec7d7c req-d414f424-35a3-48b6-b1df-0983fe48ed1a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:51.001100 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-5845175b-f5f5-4583-9e60-45d2c8ec7d7c req-d414f424-35a3-48b6-b1df-0983fe48ed1a service nova] Creating event network-changed:2c685145-9ae8-40ba-8780-23f2d9baaea2 for instance 72d166cf-218b-4999-8788-afee9450c165 on n-h1-master-1 Jul 31 01:25:51.035953 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-5845175b-f5f5-4583-9e60-45d2c8ec7d7c req-d414f424-35a3-48b6-b1df-0983fe48ed1a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139718 Jul 31 01:25:51.039694 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1827/3618] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:25:51.083739 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-dd00b887-caa5-45b4-9ed3-8f04cce86c9d req-f00397db-fbb1-4d19-8c3a-840ca4f01922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1c5a15-18aa-437c-a4fb-77eaaf234ac0", "tag": "6f32f8d1-4311-494f-a106-51bb2bbad03f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:51.150129 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-dd00b887-caa5-45b4-9ed3-8f04cce86c9d req-f00397db-fbb1-4d19-8c3a-840ca4f01922 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:51.150567 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-dd00b887-caa5-45b4-9ed3-8f04cce86c9d req-f00397db-fbb1-4d19-8c3a-840ca4f01922 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:51.202232 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-dd00b887-caa5-45b4-9ed3-8f04cce86c9d req-f00397db-fbb1-4d19-8c3a-840ca4f01922 service nova] Creating event network-changed:6f32f8d1-4311-494f-a106-51bb2bbad03f for instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 on n-h1-master-1 Jul 31 01:25:51.219652 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-dd00b887-caa5-45b4-9ed3-8f04cce86c9d req-f00397db-fbb1-4d19-8c3a-840ca4f01922 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166298 Jul 31 01:25:51.220854 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1828/3619] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:51.304295 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f0f60e36-1ac6-4c52-af62-4a5f8ff08b24 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:51.307073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f0f60e36-1ac6-4c52-af62-4a5f8ff08b24 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:51.328931 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0f60e36-1ac6-4c52-af62-4a5f8ff08b24 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:51.329584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0f60e36-1ac6-4c52-af62-4a5f8ff08b24 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:51.330750 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0f60e36-1ac6-4c52-af62-4a5f8ff08b24 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:51.331450 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0f60e36-1ac6-4c52-af62-4a5f8ff08b24 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:51.464517 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:51.520475 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:51.936756 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-33906100-97e2-450b-9cd0-820338448a4e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070/action" status: 202 len: 0 microversion: 2.1 time: 2.887235 Jul 31 01:25:51.938772 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1792/3620] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:25:49 2022] POST /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070/action => generated 0 bytes in 2890 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:25:51.949476 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fa198fc5-4c72-4373-b12e-9d091e564405 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:51.950580 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fa198fc5-4c72-4373-b12e-9d091e564405 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:51.977028 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa198fc5-4c72-4373-b12e-9d091e564405 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:51.977908 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa198fc5-4c72-4373-b12e-9d091e564405 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:51.980500 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa198fc5-4c72-4373-b12e-9d091e564405 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:51.982177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa198fc5-4c72-4373-b12e-9d091e564405 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:52.280262 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f0f60e36-1ac6-4c52-af62-4a5f8ff08b24 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5af8e2a3541e8b4473ef4428e1acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d0b808d82040f8a0c2dba3f39aac25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:52.292423 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f0f60e36-1ac6-4c52-af62-4a5f8ff08b24 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 200 len: 1315 microversion: 2.1 time: 0.993649 Jul 31 01:25:52.293338 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1829/3621] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:51 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 1315 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:52.381581 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fa198fc5-4c72-4373-b12e-9d091e564405 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:52.395012 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fa198fc5-4c72-4373-b12e-9d091e564405 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1459 microversion: 2.1 time: 0.452384 Jul 31 01:25:52.402789 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1793/3622] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:51 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1459 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:25:52.415977 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-22927c92-35d1-44a9-9300-4b471dbeb3c8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:52.417358 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-22927c92-35d1-44a9-9300-4b471dbeb3c8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:52.424493 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22927c92-35d1-44a9-9300-4b471dbeb3c8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:52.425288 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22927c92-35d1-44a9-9300-4b471dbeb3c8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:52.426317 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22927c92-35d1-44a9-9300-4b471dbeb3c8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:52.426977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22927c92-35d1-44a9-9300-4b471dbeb3c8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:53.068201 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-22927c92-35d1-44a9-9300-4b471dbeb3c8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:53.077306 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-22927c92-35d1-44a9-9300-4b471dbeb3c8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.665229 Jul 31 01:25:53.079979 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1830/3623] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:52 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:53.109256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1a806727-d4cf-4555-aaec-ea6fb4002c10 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:53.111717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1a806727-d4cf-4555-aaec-ea6fb4002c10 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:53.165483 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f6620187-3c85-411e-913b-30a9b73c5da6 req-809d84b6-5001-4dfa-b576-56adb8a68958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e2b815f-54aa-47b6-91cf-6ca472620070", "tag": "45220733-bc7c-4188-8a14-14203dd2b136"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:53.168904 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1a806727-d4cf-4555-aaec-ea6fb4002c10 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:53.172913 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1a806727-d4cf-4555-aaec-ea6fb4002c10 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:53.174389 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1a806727-d4cf-4555-aaec-ea6fb4002c10 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:53.175348 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1a806727-d4cf-4555-aaec-ea6fb4002c10 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:53.202287 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f6620187-3c85-411e-913b-30a9b73c5da6 req-809d84b6-5001-4dfa-b576-56adb8a68958 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:53.204720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f6620187-3c85-411e-913b-30a9b73c5da6 req-809d84b6-5001-4dfa-b576-56adb8a68958 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:53.235947 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f6620187-3c85-411e-913b-30a9b73c5da6 req-809d84b6-5001-4dfa-b576-56adb8a68958 service nova] Creating event network-changed:45220733-bc7c-4188-8a14-14203dd2b136 for instance 1e2b815f-54aa-47b6-91cf-6ca472620070 on n-h2-master-1 Jul 31 01:25:53.255524 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f6620187-3c85-411e-913b-30a9b73c5da6 req-809d84b6-5001-4dfa-b576-56adb8a68958 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094373 Jul 31 01:25:53.256930 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1831/3624] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:53.319668 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4464c718-3cec-4097-8d77-f383e3430b40 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:53.325672 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4464c718-3cec-4097-8d77-f383e3430b40 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:53.339752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4464c718-3cec-4097-8d77-f383e3430b40 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:53.340444 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4464c718-3cec-4097-8d77-f383e3430b40 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:53.341531 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4464c718-3cec-4097-8d77-f383e3430b40 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:53.342227 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4464c718-3cec-4097-8d77-f383e3430b40 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:53.740076 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1a806727-d4cf-4555-aaec-ea6fb4002c10 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:53.754363 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1a806727-d4cf-4555-aaec-ea6fb4002c10 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.653464 Jul 31 01:25:53.755654 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1794/3625] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:53 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:53.778700 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c441772c-39a6-4009-94ab-ffbb6f60e3e7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:53.779224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c441772c-39a6-4009-94ab-ffbb6f60e3e7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:53.789775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c441772c-39a6-4009-94ab-ffbb6f60e3e7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:53.793937 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c441772c-39a6-4009-94ab-ffbb6f60e3e7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:53.795010 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c441772c-39a6-4009-94ab-ffbb6f60e3e7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:53.796405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c441772c-39a6-4009-94ab-ffbb6f60e3e7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:53.987987 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4464c718-3cec-4097-8d77-f383e3430b40 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5af8e2a3541e8b4473ef4428e1acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d0b808d82040f8a0c2dba3f39aac25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:53.997283 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4464c718-3cec-4097-8d77-f383e3430b40 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 200 len: 1315 microversion: 2.1 time: 0.687181 Jul 31 01:25:53.997899 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1832/3626] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:53 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:54.372724 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c441772c-39a6-4009-94ab-ffbb6f60e3e7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:54.383631 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c441772c-39a6-4009-94ab-ffbb6f60e3e7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.610703 Jul 31 01:25:54.384235 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1795/3627] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:53 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:54.408903 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6787054f-4ee9-48bf-b64c-48dae20acca8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:54.410362 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6787054f-4ee9-48bf-b64c-48dae20acca8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:54.423503 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6787054f-4ee9-48bf-b64c-48dae20acca8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:54.424361 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6787054f-4ee9-48bf-b64c-48dae20acca8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:54.425425 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6787054f-4ee9-48bf-b64c-48dae20acca8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:54.426102 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6787054f-4ee9-48bf-b64c-48dae20acca8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:54.983225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6787054f-4ee9-48bf-b64c-48dae20acca8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:55.008131 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6787054f-4ee9-48bf-b64c-48dae20acca8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.602807 Jul 31 01:25:55.015804 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1833/3628] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:54 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:55.018109 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d0ab1867-4c9b-4936-8c5a-f8b3efbd5b68 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:55.018920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d0ab1867-4c9b-4936-8c5a-f8b3efbd5b68 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:55.033308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0ab1867-4c9b-4936-8c5a-f8b3efbd5b68 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:55.033966 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0ab1867-4c9b-4936-8c5a-f8b3efbd5b68 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:55.034929 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0ab1867-4c9b-4936-8c5a-f8b3efbd5b68 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:55.035693 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0ab1867-4c9b-4936-8c5a-f8b3efbd5b68 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:55.159600 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ff95dd42-351d-4bec-8263-2fbb9bc5fcb7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1550957617", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "97fe48eb-b52c-4abc-b249-8d6775315204"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:55.271063 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-ff95dd42-351d-4bec-8263-2fbb9bc5fcb7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] validate_networks() for [('97fe48eb-b52c-4abc-b249-8d6775315204', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:25:56.023922 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d0ab1867-4c9b-4936-8c5a-f8b3efbd5b68 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5af8e2a3541e8b4473ef4428e1acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d0b808d82040f8a0c2dba3f39aac25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:56.041862 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d0ab1867-4c9b-4936-8c5a-f8b3efbd5b68 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 200 len: 1315 microversion: 2.1 time: 1.027623 Jul 31 01:25:56.042454 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1796/3629] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:55 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 1315 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:57.063272 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3aa8cd35-e838-475d-a876-9133b0a579d2 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:57.063996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3aa8cd35-e838-475d-a876-9133b0a579d2 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:57.067098 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=46 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:57.076958 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3aa8cd35-e838-475d-a876-9133b0a579d2 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:57.077406 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3aa8cd35-e838-475d-a876-9133b0a579d2 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:57.079966 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3aa8cd35-e838-475d-a876-9133b0a579d2 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:57.082076 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3aa8cd35-e838-475d-a876-9133b0a579d2 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:57.423700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ff95dd42-351d-4bec-8263-2fbb9bc5fcb7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:25:57.424208 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ff95dd42-351d-4bec-8263-2fbb9bc5fcb7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:25:57.424689 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ff95dd42-351d-4bec-8263-2fbb9bc5fcb7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:25:57.425190 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ff95dd42-351d-4bec-8263-2fbb9bc5fcb7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:25:57.426170 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ff95dd42-351d-4bec-8263-2fbb9bc5fcb7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:25:57.453007 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff95dd42-351d-4bec-8263-2fbb9bc5fcb7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:57.454364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff95dd42-351d-4bec-8263-2fbb9bc5fcb7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:57.456708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff95dd42-351d-4bec-8263-2fbb9bc5fcb7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:57.457796 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff95dd42-351d-4bec-8263-2fbb9bc5fcb7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:57.521888 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-ff95dd42-351d-4bec-8263-2fbb9bc5fcb7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Getting quotas for project da596310058e4248bf33465f387956f2. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:25:57.538107 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-ff95dd42-351d-4bec-8263-2fbb9bc5fcb7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Getting quotas for user 36a36dbb4f6c40a7bb69c8c3f747aaed and project da596310058e4248bf33465f387956f2. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:25:57.597142 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ff95dd42-351d-4bec-8263-2fbb9bc5fcb7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:25:57.601162 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ff95dd42-351d-4bec-8263-2fbb9bc5fcb7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:25:57.751780 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ff95dd42-351d-4bec-8263-2fbb9bc5fcb7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.596219 Jul 31 01:25:57.753146 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1834/3630] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:25:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 01:25:57.766383 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dc4482dd-7fd0-4a32-a56b-fc5d0efda7ad tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:57.767017 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dc4482dd-7fd0-4a32-a56b-fc5d0efda7ad tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:58.006260 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3aa8cd35-e838-475d-a876-9133b0a579d2 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5af8e2a3541e8b4473ef4428e1acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d0b808d82040f8a0c2dba3f39aac25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:58.017759 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3aa8cd35-e838-475d-a876-9133b0a579d2 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 200 len: 1315 microversion: 2.1 time: 0.958264 Jul 31 01:25:58.063816 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1797/3631] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:57 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 1315 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:25:58.138476 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-fb4a96b0-03a7-4be7-81cb-33947fb82e2c req-7511ae53-db0b-453d-8906-b09071f61422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d166cf-218b-4999-8788-afee9450c165", "name": "network-vif-plugged", "status": "completed", "tag": "2c685145-9ae8-40ba-8780-23f2d9baaea2"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:25:58.218359 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fb4a96b0-03a7-4be7-81cb-33947fb82e2c req-7511ae53-db0b-453d-8906-b09071f61422 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:58.218961 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fb4a96b0-03a7-4be7-81cb-33947fb82e2c req-7511ae53-db0b-453d-8906-b09071f61422 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:58.237511 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-fb4a96b0-03a7-4be7-81cb-33947fb82e2c req-7511ae53-db0b-453d-8906-b09071f61422 service nova] Creating event network-vif-plugged:2c685145-9ae8-40ba-8780-23f2d9baaea2 for instance 72d166cf-218b-4999-8788-afee9450c165 on n-h1-master-1 Jul 31 01:25:58.242926 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-fb4a96b0-03a7-4be7-81cb-33947fb82e2c req-7511ae53-db0b-453d-8906-b09071f61422 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177486 Jul 31 01:25:58.244456 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1798/3632] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:25:58.306964 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dc4482dd-7fd0-4a32-a56b-fc5d0efda7ad tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:58.328389 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dc4482dd-7fd0-4a32-a56b-fc5d0efda7ad tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1215 microversion: 2.1 time: 0.565395 Jul 31 01:25:58.329259 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1835/3633] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:57 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1215 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:25:59.044886 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b7b18485-05a2-4447-9feb-bdfee9e98cf9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:59.045563 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b7b18485-05a2-4447-9feb-bdfee9e98cf9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:59.052525 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7b18485-05a2-4447-9feb-bdfee9e98cf9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:59.053308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7b18485-05a2-4447-9feb-bdfee9e98cf9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:59.054115 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7b18485-05a2-4447-9feb-bdfee9e98cf9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:59.054565 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7b18485-05a2-4447-9feb-bdfee9e98cf9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:59.355925 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-70a26bd6-8e12-46f3-96d4-aaedc6a1aa2c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:25:59.357045 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-70a26bd6-8e12-46f3-96d4-aaedc6a1aa2c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:25:59.371693 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-70a26bd6-8e12-46f3-96d4-aaedc6a1aa2c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:59.372775 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-70a26bd6-8e12-46f3-96d4-aaedc6a1aa2c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:59.373788 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-70a26bd6-8e12-46f3-96d4-aaedc6a1aa2c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:25:59.374456 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-70a26bd6-8e12-46f3-96d4-aaedc6a1aa2c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:25:59.575178 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-70a26bd6-8e12-46f3-96d4-aaedc6a1aa2c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:59.595812 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-70a26bd6-8e12-46f3-96d4-aaedc6a1aa2c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1267 microversion: 2.1 time: 0.248682 Jul 31 01:25:59.596955 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1836/3634] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:59 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:25:59.739582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b7b18485-05a2-4447-9feb-bdfee9e98cf9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5af8e2a3541e8b4473ef4428e1acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d0b808d82040f8a0c2dba3f39aac25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:25:59.752098 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b7b18485-05a2-4447-9feb-bdfee9e98cf9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 200 len: 1315 microversion: 2.1 time: 0.712437 Jul 31 01:25:59.776393 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1799/3635] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:25:59 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 1315 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:00.623473 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1f8340aa-e92f-4e7b-b7cd-fb030b196df6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:00.625978 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1f8340aa-e92f-4e7b-b7cd-fb030b196df6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:00.643507 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:00.660659 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f8340aa-e92f-4e7b-b7cd-fb030b196df6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:00.661642 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f8340aa-e92f-4e7b-b7cd-fb030b196df6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:00.662625 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f8340aa-e92f-4e7b-b7cd-fb030b196df6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:00.663811 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f8340aa-e92f-4e7b-b7cd-fb030b196df6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:00.791127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-50d9917e-2b83-444d-8e91-9091502b1b7f tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:00.791775 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-50d9917e-2b83-444d-8e91-9091502b1b7f tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:00.802256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50d9917e-2b83-444d-8e91-9091502b1b7f tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:00.802724 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50d9917e-2b83-444d-8e91-9091502b1b7f tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:00.803554 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50d9917e-2b83-444d-8e91-9091502b1b7f tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:00.805506 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50d9917e-2b83-444d-8e91-9091502b1b7f tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:00.866426 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1f8340aa-e92f-4e7b-b7cd-fb030b196df6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:00.886352 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1f8340aa-e92f-4e7b-b7cd-fb030b196df6 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1273 microversion: 2.1 time: 0.271636 Jul 31 01:26:00.887988 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1837/3636] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:00 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:01.302199 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-50d9917e-2b83-444d-8e91-9091502b1b7f tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5af8e2a3541e8b4473ef4428e1acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d0b808d82040f8a0c2dba3f39aac25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:01.316838 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-50d9917e-2b83-444d-8e91-9091502b1b7f tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 200 len: 1504 microversion: 2.1 time: 0.530445 Jul 31 01:26:01.336562 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1800/3637] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:00 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 1504 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:01.347754 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8e269380-0422-4b78-bbf9-b962e1c44c2d tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:01.348865 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8e269380-0422-4b78-bbf9-b962e1c44c2d tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:01.359192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e269380-0422-4b78-bbf9-b962e1c44c2d tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:01.359955 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e269380-0422-4b78-bbf9-b962e1c44c2d tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:01.361001 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e269380-0422-4b78-bbf9-b962e1c44c2d tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:01.361619 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e269380-0422-4b78-bbf9-b962e1c44c2d tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:01.407144 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:01.502440 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8e269380-0422-4b78-bbf9-b962e1c44c2d tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "DELETE /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.163403 Jul 31 01:26:01.514346 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1838/3638] 10.222.0.45 () {58 vars in 1296 bytes} [Sun Jul 31 01:26:01 2022] DELETE /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165/os-server-password => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:26:01.521232 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8eb4ea5d-8bf3-4b42-a808-e162a243e0fb tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:01.522025 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8eb4ea5d-8bf3-4b42-a808-e162a243e0fb tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:01.533925 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8eb4ea5d-8bf3-4b42-a808-e162a243e0fb tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:01.534310 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8eb4ea5d-8bf3-4b42-a808-e162a243e0fb tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:01.535232 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8eb4ea5d-8bf3-4b42-a808-e162a243e0fb tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:01.540125 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8eb4ea5d-8bf3-4b42-a808-e162a243e0fb tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:01.604254 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8eb4ea5d-8bf3-4b42-a808-e162a243e0fb tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.088125 Jul 31 01:26:01.616466 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1801/3639] 10.222.0.45 () {58 vars in 1293 bytes} [Sun Jul 31 01:26:01 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165/os-server-password => generated 16 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:26:01.630596 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3da58bd5-5bce-4f93-a11a-43a917739de6 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:01.632010 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3da58bd5-5bce-4f93-a11a-43a917739de6 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:01.654554 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3da58bd5-5bce-4f93-a11a-43a917739de6 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:01.655357 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3da58bd5-5bce-4f93-a11a-43a917739de6 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:01.656546 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3da58bd5-5bce-4f93-a11a-43a917739de6 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:01.660638 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3da58bd5-5bce-4f93-a11a-43a917739de6 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:01.727815 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3da58bd5-5bce-4f93-a11a-43a917739de6 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:26:01.916820 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-749d04c8-2103-41e6-a1b5-5830b5bc966b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:01.918654 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-749d04c8-2103-41e6-a1b5-5830b5bc966b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:01.928861 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-749d04c8-2103-41e6-a1b5-5830b5bc966b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:01.930008 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-749d04c8-2103-41e6-a1b5-5830b5bc966b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:01.932822 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-749d04c8-2103-41e6-a1b5-5830b5bc966b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:01.933636 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-749d04c8-2103-41e6-a1b5-5830b5bc966b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:01.944285 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3da58bd5-5bce-4f93-a11a-43a917739de6 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "DELETE /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 204 len: 0 microversion: 2.1 time: 0.319382 Jul 31 01:26:01.951698 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1839/3640] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:26:01 2022] DELETE /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:26:01.965859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-656c423f-ecbb-4f48-952f-2bb2244c0fb9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:01.966638 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-656c423f-ecbb-4f48-952f-2bb2244c0fb9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:01.979332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-656c423f-ecbb-4f48-952f-2bb2244c0fb9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:01.979826 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-656c423f-ecbb-4f48-952f-2bb2244c0fb9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:01.984731 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-656c423f-ecbb-4f48-952f-2bb2244c0fb9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:01.985283 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-656c423f-ecbb-4f48-952f-2bb2244c0fb9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:02.686760 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-656c423f-ecbb-4f48-952f-2bb2244c0fb9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5af8e2a3541e8b4473ef4428e1acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d0b808d82040f8a0c2dba3f39aac25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:02.696730 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-656c423f-ecbb-4f48-952f-2bb2244c0fb9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 200 len: 1510 microversion: 2.1 time: 0.738541 Jul 31 01:26:02.697931 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1840/3641] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:01 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 1510 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:26:02.761279 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-749d04c8-2103-41e6-a1b5-5830b5bc966b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:02.770511 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:02.788975 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-749d04c8-2103-41e6-a1b5-5830b5bc966b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1315 microversion: 2.1 time: 0.879670 Jul 31 01:26:02.805252 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1802/3642] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:01 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1315 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:03.347253 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b4994910-1821-4fbc-b766-93996d1d6c59 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-526214093", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:03.492586 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-b4994910-1821-4fbc-b766-93996d1d6c59 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] validate_networks() for [('20bc1354-9fed-4cd7-ac6a-eff29b084bc2', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:26:03.535100 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-d25a7492-740a-4b01-bb0b-a3f7533031d1 req-5a9a5e0d-917d-4b07-89fd-5d35051217e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c981f91-b847-4b1b-a3c3-4edc7a9221c3", "tag": "8dc1db04-4278-481c-8fb7-ab59e918dc37"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:03.571941 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d25a7492-740a-4b01-bb0b-a3f7533031d1 req-5a9a5e0d-917d-4b07-89fd-5d35051217e4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:03.572572 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d25a7492-740a-4b01-bb0b-a3f7533031d1 req-5a9a5e0d-917d-4b07-89fd-5d35051217e4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:03.586440 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-d25a7492-740a-4b01-bb0b-a3f7533031d1 req-5a9a5e0d-917d-4b07-89fd-5d35051217e4 service nova] Creating event network-changed:8dc1db04-4278-481c-8fb7-ab59e918dc37 for instance 3c981f91-b847-4b1b-a3c3-4edc7a9221c3 on n-h2-master-1 Jul 31 01:26:03.596772 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-d25a7492-740a-4b01-bb0b-a3f7533031d1 req-5a9a5e0d-917d-4b07-89fd-5d35051217e4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065413 Jul 31 01:26:03.599751 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1803/3643] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:26:03.720451 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9f4c22f8-85bd-44ee-a3f2-0d1d1a8ca0f8 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:03.721169 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9f4c22f8-85bd-44ee-a3f2-0d1d1a8ca0f8 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:03.732539 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f4c22f8-85bd-44ee-a3f2-0d1d1a8ca0f8 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:03.738406 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f4c22f8-85bd-44ee-a3f2-0d1d1a8ca0f8 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:03.739547 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f4c22f8-85bd-44ee-a3f2-0d1d1a8ca0f8 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:03.741860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f4c22f8-85bd-44ee-a3f2-0d1d1a8ca0f8 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:04.309455 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9f4c22f8-85bd-44ee-a3f2-0d1d1a8ca0f8 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5af8e2a3541e8b4473ef4428e1acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d0b808d82040f8a0c2dba3f39aac25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:04.318700 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9f4c22f8-85bd-44ee-a3f2-0d1d1a8ca0f8 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 200 len: 1510 microversion: 2.1 time: 0.603158 Jul 31 01:26:04.320288 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1804/3644] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:03 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 1510 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:26:04.344769 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-90ff7367-09b3-4f47-8aff-f1ebe16946a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:04.345509 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-90ff7367-09b3-4f47-8aff-f1ebe16946a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:04.360962 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90ff7367-09b3-4f47-8aff-f1ebe16946a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:04.361424 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90ff7367-09b3-4f47-8aff-f1ebe16946a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:04.363975 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90ff7367-09b3-4f47-8aff-f1ebe16946a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:04.365205 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90ff7367-09b3-4f47-8aff-f1ebe16946a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:05.545375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b4994910-1821-4fbc-b766-93996d1d6c59 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:26:05.547703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b4994910-1821-4fbc-b766-93996d1d6c59 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:26:05.548363 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b4994910-1821-4fbc-b766-93996d1d6c59 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:26:05.549028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b4994910-1821-4fbc-b766-93996d1d6c59 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:26:05.549652 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b4994910-1821-4fbc-b766-93996d1d6c59 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:26:05.593454 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4994910-1821-4fbc-b766-93996d1d6c59 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:05.594186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4994910-1821-4fbc-b766-93996d1d6c59 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:05.595496 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4994910-1821-4fbc-b766-93996d1d6c59 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:05.596298 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4994910-1821-4fbc-b766-93996d1d6c59 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:05.636118 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-b4994910-1821-4fbc-b766-93996d1d6c59 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Getting quotas for project 9939750cc4074991b1da344bf6e18c67. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:26:05.644918 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-b4994910-1821-4fbc-b766-93996d1d6c59 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Getting quotas for user 97473f7af4d943f983d96a23dac67090 and project 9939750cc4074991b1da344bf6e18c67. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:26:05.698574 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b4994910-1821-4fbc-b766-93996d1d6c59 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:26:05.707078 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b4994910-1821-4fbc-b766-93996d1d6c59 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:26:05.892562 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-90ff7367-09b3-4f47-8aff-f1ebe16946a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:05.907923 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-90ff7367-09b3-4f47-8aff-f1ebe16946a7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1315 microversion: 2.1 time: 1.583955 Jul 31 01:26:05.916811 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b4994910-1821-4fbc-b766-93996d1d6c59 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.849596 Jul 31 01:26:05.922996 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1805/3645] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:04 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1315 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:05.931789 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1841/3646] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:26:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 2865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:26:05.936193 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1580cc05-6575-4676-ad18-fcf12be41d18 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:05.937102 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1580cc05-6575-4676-ad18-fcf12be41d18 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:05.939919 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-efb4c1d1-6bca-4f85-aea3-db8da870475b tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:05.940543 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-efb4c1d1-6bca-4f85-aea3-db8da870475b tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:05.953891 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1580cc05-6575-4676-ad18-fcf12be41d18 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:05.955298 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1580cc05-6575-4676-ad18-fcf12be41d18 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:05.956405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1580cc05-6575-4676-ad18-fcf12be41d18 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:05.957332 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1580cc05-6575-4676-ad18-fcf12be41d18 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:06.471506 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-efb4c1d1-6bca-4f85-aea3-db8da870475b tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:06.482420 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-efb4c1d1-6bca-4f85-aea3-db8da870475b tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1222 microversion: 2.1 time: 0.546267 Jul 31 01:26:06.488208 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1842/3647] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:05 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1222 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:06.932064 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ca3e34c3-db7d-43b2-a9f4-f3e6771e7933 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:06.934306 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ca3e34c3-db7d-43b2-a9f4-f3e6771e7933 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:06.957052 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca3e34c3-db7d-43b2-a9f4-f3e6771e7933 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:06.960283 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca3e34c3-db7d-43b2-a9f4-f3e6771e7933 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:06.966074 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1580cc05-6575-4676-ad18-fcf12be41d18 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5af8e2a3541e8b4473ef4428e1acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d0b808d82040f8a0c2dba3f39aac25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:06.973243 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca3e34c3-db7d-43b2-a9f4-f3e6771e7933 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:06.979084 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca3e34c3-db7d-43b2-a9f4-f3e6771e7933 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:06.986489 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1580cc05-6575-4676-ad18-fcf12be41d18 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 200 len: 1510 microversion: 2.1 time: 1.057972 Jul 31 01:26:06.988822 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1806/3648] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:05 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 1510 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:07.398456 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-a88ad53d-ad79-4827-b186-1baaba4f4ed6 req-bef941d6-75bd-4db6-b84b-b2762520392e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d166cf-218b-4999-8788-afee9450c165", "name": "network-vif-deleted", "tag": "2c685145-9ae8-40ba-8780-23f2d9baaea2"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:07.452085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a88ad53d-ad79-4827-b186-1baaba4f4ed6 req-bef941d6-75bd-4db6-b84b-b2762520392e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:07.452612 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a88ad53d-ad79-4827-b186-1baaba4f4ed6 req-bef941d6-75bd-4db6-b84b-b2762520392e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:07.506009 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-a88ad53d-ad79-4827-b186-1baaba4f4ed6 req-bef941d6-75bd-4db6-b84b-b2762520392e service nova] Creating event network-vif-deleted:2c685145-9ae8-40ba-8780-23f2d9baaea2 for instance 72d166cf-218b-4999-8788-afee9450c165 on n-h1-master-1 Jul 31 01:26:07.524223 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-a88ad53d-ad79-4827-b186-1baaba4f4ed6 req-bef941d6-75bd-4db6-b84b-b2762520392e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130374 Jul 31 01:26:07.547708 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1807/3649] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:26:07.585611 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f9f7bda5-3e7f-431f-bc0b-5d61dccb4432 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:07.586726 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f9f7bda5-3e7f-431f-bc0b-5d61dccb4432 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:07.601256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9f7bda5-3e7f-431f-bc0b-5d61dccb4432 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:07.604145 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9f7bda5-3e7f-431f-bc0b-5d61dccb4432 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:07.605249 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9f7bda5-3e7f-431f-bc0b-5d61dccb4432 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:07.610509 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9f7bda5-3e7f-431f-bc0b-5d61dccb4432 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:07.611401 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ca3e34c3-db7d-43b2-a9f4-f3e6771e7933 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:07.619630 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ca3e34c3-db7d-43b2-a9f4-f3e6771e7933 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1315 microversion: 2.1 time: 0.692605 Jul 31 01:26:07.625287 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1843/3650] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:06 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:07.894492 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f9f7bda5-3e7f-431f-bc0b-5d61dccb4432 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:07.903163 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f9f7bda5-3e7f-431f-bc0b-5d61dccb4432 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1274 microversion: 2.1 time: 0.350391 Jul 31 01:26:07.930051 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1808/3651] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:07 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1274 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:08.006909 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2635364c-5ff4-4d07-837c-a31277a442a9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:08.007775 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2635364c-5ff4-4d07-837c-a31277a442a9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:08.018090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2635364c-5ff4-4d07-837c-a31277a442a9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:08.018386 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2635364c-5ff4-4d07-837c-a31277a442a9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:08.019202 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2635364c-5ff4-4d07-837c-a31277a442a9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:08.019696 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2635364c-5ff4-4d07-837c-a31277a442a9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:08.059192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2635364c-5ff4-4d07-837c-a31277a442a9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:08.059695 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2635364c-5ff4-4d07-837c-a31277a442a9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:08.060170 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-2635364c-5ff4-4d07-837c-a31277a442a9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lazy-loading 'fault' on Instance uuid 72d166cf-218b-4999-8788-afee9450c165 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:26:08.654213 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95e78dbf-f6c3-4018-8100-f20222373bb4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:08.656442 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-95e78dbf-f6c3-4018-8100-f20222373bb4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:08.676145 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95e78dbf-f6c3-4018-8100-f20222373bb4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:08.679375 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95e78dbf-f6c3-4018-8100-f20222373bb4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:08.684519 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95e78dbf-f6c3-4018-8100-f20222373bb4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:08.686125 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95e78dbf-f6c3-4018-8100-f20222373bb4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:08.924006 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2635364c-5ff4-4d07-837c-a31277a442a9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72d5af8e2a3541e8b4473ef4428e1acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d0b808d82040f8a0c2dba3f39aac25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:08.939425 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2635364c-5ff4-4d07-837c-a31277a442a9 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 200 len: 1305 microversion: 2.1 time: 0.934626 Jul 31 01:26:08.955086 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1844/3652] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:08 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 1305 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:08.963785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-645b49c0-80f8-4ab9-bf1a-88831980072a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:08.964873 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-645b49c0-80f8-4ab9-bf1a-88831980072a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:08.973085 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-645b49c0-80f8-4ab9-bf1a-88831980072a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:08.974341 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-645b49c0-80f8-4ab9-bf1a-88831980072a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:08.975458 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-645b49c0-80f8-4ab9-bf1a-88831980072a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:08.976112 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-645b49c0-80f8-4ab9-bf1a-88831980072a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:09.216712 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-95e78dbf-f6c3-4018-8100-f20222373bb4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:09.230280 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-95e78dbf-f6c3-4018-8100-f20222373bb4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1315 microversion: 2.1 time: 0.587452 Jul 31 01:26:09.233825 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1809/3653] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:08 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:09.362804 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-645b49c0-80f8-4ab9-bf1a-88831980072a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:09.371069 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-645b49c0-80f8-4ab9-bf1a-88831980072a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1280 microversion: 2.1 time: 0.413852 Jul 31 01:26:09.376210 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1845/3654] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:08 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1280 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:09.964077 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-04e7640b-307c-40a3-959d-74d0d9a87ce7 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:09.964855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-04e7640b-307c-40a3-959d-74d0d9a87ce7 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] [instance: 72d166cf-218b-4999-8788-afee9450c165] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:09.972214 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-04e7640b-307c-40a3-959d-74d0d9a87ce7 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:09.972921 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-04e7640b-307c-40a3-959d-74d0d9a87ce7 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:09.974006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-04e7640b-307c-40a3-959d-74d0d9a87ce7 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:09.974625 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-04e7640b-307c-40a3-959d-74d0d9a87ce7 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:09.989118 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-04e7640b-307c-40a3-959d-74d0d9a87ce7 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] HTTP exception thrown: Instance 72d166cf-218b-4999-8788-afee9450c165 could not be found. Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-04e7640b-307c-40a3-959d-74d0d9a87ce7 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Request method failure captured: Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 HTTP/1.1 Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5doRSJBXOu4z3OH1J3EBGwBDu18fkgegL9gl-b8op3a3l1q49RqTG_se_VeGbgbHF0QqURYQMo-VedzTUdzeL2fXryaJBKnYBNVd3dkVvdT_ZpHafsD9Uo1nFf3IZ-CaEXCUO0Fvr-EV1s02wT4dKpnVCVF9x4tAuZ4jNjsgwgRT518 Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 00d0b808d82040f8a0c2dba3f39aac25 Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerPasswordTestJSON-8856049 Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00d0b808d82040f8a0c2dba3f39aac25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/00d0b808d82040f8a0c2dba3f39aac25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/00d0b808d82040f8a0c2dba3f39aac25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_00d0b808d82040f8a0c2dba3f39aac25", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerPasswordTestJSON-8856049 Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 00d0b808d82040f8a0c2dba3f39aac25 Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerPasswordTestJSON-8856049 Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerPasswordTestJSON-8856049-project Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 72d5af8e2a3541e8b4473ef4428e1acb Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerPasswordTestJSON-8856049-project Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 72d166cf-218b-4999-8788-afee9450c165 could not be found. Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '72d166cf-218b-4999-8788-afee9450c165'} Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72d166cf-218b-4999-8788-afee9450c165 could not be found. Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72d166cf-218b-4999-8788-afee9450c165 could not be found. Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:26:09.991128 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:26:09.995774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:26:09.995774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:26:09.995774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:26:09.995774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:26:09.995774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:26:09.995774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72d166cf-218b-4999-8788-afee9450c165 could not be found. Jul 31 01:26:09.995774 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:26:09.995774 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-04e7640b-307c-40a3-959d-74d0d9a87ce7 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] Returning 404 to user: Instance 72d166cf-218b-4999-8788-afee9450c165 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:26:09.995774 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-04e7640b-307c-40a3-959d-74d0d9a87ce7 tempest-ServerPasswordTestJSON-8856049 tempest-ServerPasswordTestJSON-8856049-project] 10.222.0.45 "GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165" status: 404 len: 111 microversion: 2.1 time: 0.034220 Jul 31 01:26:09.996805 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1810/3655] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:09 2022] GET /compute/v2.1/servers/72d166cf-218b-4999-8788-afee9450c165 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:26:10.264557 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fade89c0-7a91-407b-9cfd-e7e9f3a7109f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:10.265790 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fade89c0-7a91-407b-9cfd-e7e9f3a7109f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:10.279836 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fade89c0-7a91-407b-9cfd-e7e9f3a7109f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:10.280617 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fade89c0-7a91-407b-9cfd-e7e9f3a7109f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:10.295567 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fade89c0-7a91-407b-9cfd-e7e9f3a7109f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:10.297007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fade89c0-7a91-407b-9cfd-e7e9f3a7109f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:10.340063 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bf3fc9f5-beea-4f7f-bb3a-0894b14e83cb tempest-PortsAdminExtendedAttrsTestJSON-454337410 tempest-PortsAdminExtendedAttrsTestJSON-454337410-project-admin] Calling method '.version_select at 0x7fede4634af0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:10.342672 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:26:10.342672 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:26:10.344796 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf3fc9f5-beea-4f7f-bb3a-0894b14e83cb tempest-PortsAdminExtendedAttrsTestJSON-454337410 tempest-PortsAdminExtendedAttrsTestJSON-454337410-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:10.346031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf3fc9f5-beea-4f7f-bb3a-0894b14e83cb tempest-PortsAdminExtendedAttrsTestJSON-454337410 tempest-PortsAdminExtendedAttrsTestJSON-454337410-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:10.404106 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf3fc9f5-beea-4f7f-bb3a-0894b14e83cb tempest-PortsAdminExtendedAttrsTestJSON-454337410 tempest-PortsAdminExtendedAttrsTestJSON-454337410-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:10.405380 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf3fc9f5-beea-4f7f-bb3a-0894b14e83cb tempest-PortsAdminExtendedAttrsTestJSON-454337410 tempest-PortsAdminExtendedAttrsTestJSON-454337410-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:10.420338 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf3fc9f5-beea-4f7f-bb3a-0894b14e83cb tempest-PortsAdminExtendedAttrsTestJSON-454337410 tempest-PortsAdminExtendedAttrsTestJSON-454337410-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:10.421247 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf3fc9f5-beea-4f7f-bb3a-0894b14e83cb tempest-PortsAdminExtendedAttrsTestJSON-454337410 tempest-PortsAdminExtendedAttrsTestJSON-454337410-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:10.430137 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bf3fc9f5-beea-4f7f-bb3a-0894b14e83cb tempest-PortsAdminExtendedAttrsTestJSON-454337410 tempest-PortsAdminExtendedAttrsTestJSON-454337410-project-admin] 10.222.0.45 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.213856 Jul 31 01:26:10.439997 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1846/3656] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:26:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:26:10.449053 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc6a3349-4c9c-4faa-992f-a548828743fa tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:10.451570 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc6a3349-4c9c-4faa-992f-a548828743fa tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:10.462901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc6a3349-4c9c-4faa-992f-a548828743fa tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:10.467755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc6a3349-4c9c-4faa-992f-a548828743fa tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:10.488080 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc6a3349-4c9c-4faa-992f-a548828743fa tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:10.488977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc6a3349-4c9c-4faa-992f-a548828743fa tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:11.347414 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fc6a3349-4c9c-4faa-992f-a548828743fa tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:11.370225 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc6a3349-4c9c-4faa-992f-a548828743fa tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1280 microversion: 2.1 time: 0.922634 Jul 31 01:26:11.385443 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1847/3657] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:10 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1280 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:11.874799 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fade89c0-7a91-407b-9cfd-e7e9f3a7109f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:11.882702 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fade89c0-7a91-407b-9cfd-e7e9f3a7109f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1315 microversion: 2.1 time: 1.626097 Jul 31 01:26:11.883293 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1811/3658] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:10 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1315 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:11.989001 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-de17b797-4e67-4487-bd1c-ab7fa8355355 req-bcaf4b46-706f-4870-9e78-2ad1ebda4caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c981f91-b847-4b1b-a3c3-4edc7a9221c3", "name": "network-vif-plugged", "status": "completed", "tag": "8dc1db04-4278-481c-8fb7-ab59e918dc37"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:12.008861 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-de17b797-4e67-4487-bd1c-ab7fa8355355 req-bcaf4b46-706f-4870-9e78-2ad1ebda4caf service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:12.009873 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-de17b797-4e67-4487-bd1c-ab7fa8355355 req-bcaf4b46-706f-4870-9e78-2ad1ebda4caf service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:12.059002 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-de17b797-4e67-4487-bd1c-ab7fa8355355 req-bcaf4b46-706f-4870-9e78-2ad1ebda4caf service nova] Creating event network-vif-plugged:8dc1db04-4278-481c-8fb7-ab59e918dc37 for instance 3c981f91-b847-4b1b-a3c3-4edc7a9221c3 on n-h2-master-1 Jul 31 01:26:12.072475 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-de17b797-4e67-4487-bd1c-ab7fa8355355 req-bcaf4b46-706f-4870-9e78-2ad1ebda4caf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096058 Jul 31 01:26:12.075222 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1848/3659] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:26:12.399424 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-030bf282-b1ed-4b48-bc01-f4721bc37b18 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:12.400566 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-030bf282-b1ed-4b48-bc01-f4721bc37b18 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:12.409800 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-030bf282-b1ed-4b48-bc01-f4721bc37b18 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:12.416409 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-030bf282-b1ed-4b48-bc01-f4721bc37b18 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:12.418099 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-030bf282-b1ed-4b48-bc01-f4721bc37b18 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:12.418774 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-030bf282-b1ed-4b48-bc01-f4721bc37b18 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:12.908856 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-84993049-67e7-446f-8b0f-901c4521ed13 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:12.920996 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-84993049-67e7-446f-8b0f-901c4521ed13 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:12.937713 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-84993049-67e7-446f-8b0f-901c4521ed13 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:12.938544 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-84993049-67e7-446f-8b0f-901c4521ed13 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:12.940051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-84993049-67e7-446f-8b0f-901c4521ed13 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:12.944079 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-84993049-67e7-446f-8b0f-901c4521ed13 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:13.477892 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-030bf282-b1ed-4b48-bc01-f4721bc37b18 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:13.490732 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-030bf282-b1ed-4b48-bc01-f4721bc37b18 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1322 microversion: 2.1 time: 1.097333 Jul 31 01:26:13.493565 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1812/3660] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:12 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1322 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:14.029792 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-84993049-67e7-446f-8b0f-901c4521ed13 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:14.038311 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-84993049-67e7-446f-8b0f-901c4521ed13 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1315 microversion: 2.1 time: 1.137575 Jul 31 01:26:14.038916 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1849/3661] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:12 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1315 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:14.513921 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-58754ff5-d5ce-4d9f-a602-3cb324908a37 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:14.515293 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-58754ff5-d5ce-4d9f-a602-3cb324908a37 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:14.538408 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58754ff5-d5ce-4d9f-a602-3cb324908a37 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:14.539113 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58754ff5-d5ce-4d9f-a602-3cb324908a37 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:14.540087 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58754ff5-d5ce-4d9f-a602-3cb324908a37 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:14.541219 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58754ff5-d5ce-4d9f-a602-3cb324908a37 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:15.065665 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-53cbb637-8a5e-4b9a-9c74-4a56f4a08964 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:15.066312 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-53cbb637-8a5e-4b9a-9c74-4a56f4a08964 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:15.081352 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53cbb637-8a5e-4b9a-9c74-4a56f4a08964 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:15.081818 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53cbb637-8a5e-4b9a-9c74-4a56f4a08964 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:15.082633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53cbb637-8a5e-4b9a-9c74-4a56f4a08964 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:15.083086 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53cbb637-8a5e-4b9a-9c74-4a56f4a08964 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:15.619497 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:15.650538 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-58754ff5-d5ce-4d9f-a602-3cb324908a37 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:15.684306 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-53cbb637-8a5e-4b9a-9c74-4a56f4a08964 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:15.714530 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-53cbb637-8a5e-4b9a-9c74-4a56f4a08964 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1502 microversion: 2.1 time: 0.648389 Jul 31 01:26:15.718519 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1850/3662] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:15 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1502 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:15.731798 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-58754ff5-d5ce-4d9f-a602-3cb324908a37 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1322 microversion: 2.1 time: 1.222229 Jul 31 01:26:15.744259 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-910aadf6-2ba9-466e-a4bc-696e7167718f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:15.745131 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1813/3663] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:14 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1322 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:15.748826 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-910aadf6-2ba9-466e-a4bc-696e7167718f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:15.770765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-910aadf6-2ba9-466e-a4bc-696e7167718f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:15.776116 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-910aadf6-2ba9-466e-a4bc-696e7167718f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:15.778277 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-910aadf6-2ba9-466e-a4bc-696e7167718f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:15.780218 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-910aadf6-2ba9-466e-a4bc-696e7167718f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:15.968539 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-910aadf6-2ba9-466e-a4bc-696e7167718f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3/action" status: 202 len: 0 microversion: 2.1 time: 0.229385 Jul 31 01:26:15.979220 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1851/3664] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:26:15 2022] POST /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 01:26:15.989649 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-180053a2-e81a-4869-8d57-4434de28950c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:15.991183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-180053a2-e81a-4869-8d57-4434de28950c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:16.002205 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-180053a2-e81a-4869-8d57-4434de28950c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:16.004774 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-180053a2-e81a-4869-8d57-4434de28950c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:16.005823 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-180053a2-e81a-4869-8d57-4434de28950c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:16.006435 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-180053a2-e81a-4869-8d57-4434de28950c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:16.564730 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-180053a2-e81a-4869-8d57-4434de28950c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:16.578078 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-180053a2-e81a-4869-8d57-4434de28950c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1507 microversion: 2.1 time: 0.594213 Jul 31 01:26:16.591983 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1814/3665] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:15 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1507 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:16.601132 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=16 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:16.606799 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-39c2a845-8e4f-495e-889e-8ed3c2d0e322 req-03d64f16-a4b6-4e10-8156-74d8939c24bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82c2878-c1d7-43a4-9b3e-38af00bda820", "tag": "d4f63d82-0064-4811-bcb1-b78632f9ea21"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:16.631277 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-39c2a845-8e4f-495e-889e-8ed3c2d0e322 req-03d64f16-a4b6-4e10-8156-74d8939c24bc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:16.631760 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-39c2a845-8e4f-495e-889e-8ed3c2d0e322 req-03d64f16-a4b6-4e10-8156-74d8939c24bc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:16.673287 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-39c2a845-8e4f-495e-889e-8ed3c2d0e322 req-03d64f16-a4b6-4e10-8156-74d8939c24bc service nova] Creating event network-changed:d4f63d82-0064-4811-bcb1-b78632f9ea21 for instance b82c2878-c1d7-43a4-9b3e-38af00bda820 on n-h1-master-1 Jul 31 01:26:16.684635 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-39c2a845-8e4f-495e-889e-8ed3c2d0e322 req-03d64f16-a4b6-4e10-8156-74d8939c24bc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085836 Jul 31 01:26:16.685887 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1852/3666] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:26:16.770129 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4c3f97c9-1afd-4fc1-ae79-7055cd9e8097 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:16.770740 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4c3f97c9-1afd-4fc1-ae79-7055cd9e8097 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:16.788480 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c3f97c9-1afd-4fc1-ae79-7055cd9e8097 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:16.789082 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c3f97c9-1afd-4fc1-ae79-7055cd9e8097 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:16.789904 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c3f97c9-1afd-4fc1-ae79-7055cd9e8097 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:16.790882 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c3f97c9-1afd-4fc1-ae79-7055cd9e8097 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:17.182105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4c3f97c9-1afd-4fc1-ae79-7055cd9e8097 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:17.194617 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4c3f97c9-1afd-4fc1-ae79-7055cd9e8097 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1322 microversion: 2.1 time: 0.428129 Jul 31 01:26:17.196311 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1815/3667] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:16 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:17.619392 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4b123605-ff98-4971-b443-27aacbcc7d12 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:17.620228 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4b123605-ff98-4971-b443-27aacbcc7d12 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:17.637644 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b123605-ff98-4971-b443-27aacbcc7d12 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:17.638224 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b123605-ff98-4971-b443-27aacbcc7d12 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:17.639126 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b123605-ff98-4971-b443-27aacbcc7d12 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:17.640057 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b123605-ff98-4971-b443-27aacbcc7d12 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:17.874966 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4b123605-ff98-4971-b443-27aacbcc7d12 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:17.877782 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:17.887548 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4b123605-ff98-4971-b443-27aacbcc7d12 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1487 microversion: 2.1 time: 0.282709 Jul 31 01:26:17.899361 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1853/3668] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:17 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1487 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:17.910563 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4040a1b4-c2a7-478e-9157-82fa729b05f7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:17.911114 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4040a1b4-c2a7-478e-9157-82fa729b05f7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:17.924925 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4040a1b4-c2a7-478e-9157-82fa729b05f7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:17.928092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4040a1b4-c2a7-478e-9157-82fa729b05f7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:17.929764 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4040a1b4-c2a7-478e-9157-82fa729b05f7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:17.930219 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4040a1b4-c2a7-478e-9157-82fa729b05f7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:17.972591 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-4040a1b4-c2a7-478e-9157-82fa729b05f7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lazy-loading 'flavor' on Instance uuid 3c981f91-b847-4b1b-a3c3-4edc7a9221c3 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:26:18.217088 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e00f4888-7283-4716-83e7-d2fc9273bb6c tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:18.218166 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e00f4888-7283-4716-83e7-d2fc9273bb6c tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:18.243506 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e00f4888-7283-4716-83e7-d2fc9273bb6c tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:18.245193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e00f4888-7283-4716-83e7-d2fc9273bb6c tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:18.247280 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e00f4888-7283-4716-83e7-d2fc9273bb6c tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:18.248417 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e00f4888-7283-4716-83e7-d2fc9273bb6c tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:18.763505 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4040a1b4-c2a7-478e-9157-82fa729b05f7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3/action" status: 202 len: 0 microversion: 2.1 time: 0.857058 Jul 31 01:26:18.764726 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1816/3669] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:26:17 2022] POST /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3/action => generated 0 bytes in 859 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:26:18.772899 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9ef3bbed-0d43-44df-9763-efa94564d810 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9c9d370-ccce-4c3b-bf07-1b6fad8afa5c"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:18.776825 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9ef3bbed-0d43-44df-9763-efa94564d810 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:18.787810 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ef3bbed-0d43-44df-9763-efa94564d810 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:18.788696 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ef3bbed-0d43-44df-9763-efa94564d810 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:18.791773 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ef3bbed-0d43-44df-9763-efa94564d810 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:18.792838 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ef3bbed-0d43-44df-9763-efa94564d810 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:19.444157 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9ef3bbed-0d43-44df-9763-efa94564d810 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.674641 Jul 31 01:26:19.444870 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1817/3670] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:26:18 2022] POST /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments => generated 194 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:26:19.467731 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f49a021c-7897-411f-9803-71a7f851c0be tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:19.473417 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f49a021c-7897-411f-9803-71a7f851c0be tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:19.490308 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e00f4888-7283-4716-83e7-d2fc9273bb6c tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:19.496141 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f49a021c-7897-411f-9803-71a7f851c0be tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:19.496787 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f49a021c-7897-411f-9803-71a7f851c0be tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:19.497858 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f49a021c-7897-411f-9803-71a7f851c0be tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:19.498458 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f49a021c-7897-411f-9803-71a7f851c0be tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:19.511389 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e00f4888-7283-4716-83e7-d2fc9273bb6c tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1322 microversion: 2.1 time: 1.299314 Jul 31 01:26:19.518387 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1854/3671] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:18 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1322 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:19.593661 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:20.538840 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-57f55105-d62f-4047-b45e-2abaa19e1f6a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:20.539670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-57f55105-d62f-4047-b45e-2abaa19e1f6a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:20.563599 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-57f55105-d62f-4047-b45e-2abaa19e1f6a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:20.567051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-57f55105-d62f-4047-b45e-2abaa19e1f6a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:20.568001 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-57f55105-d62f-4047-b45e-2abaa19e1f6a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:20.568466 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-57f55105-d62f-4047-b45e-2abaa19e1f6a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:20.599192 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f49a021c-7897-411f-9803-71a7f851c0be tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:20.631868 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f49a021c-7897-411f-9803-71a7f851c0be tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1514 microversion: 2.1 time: 1.174168 Jul 31 01:26:20.632520 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1818/3672] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:19 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1514 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:21.501163 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8418880c-ddba-4722-8344-10574bcea4ba tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1421739413", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": "none"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:21.711890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-57f55105-d62f-4047-b45e-2abaa19e1f6a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:21.731502 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-8418880c-ddba-4722-8344-10574bcea4ba tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:26:21.732476 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-8418880c-ddba-4722-8344-10574bcea4ba tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:26:21.733006 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-57f55105-d62f-4047-b45e-2abaa19e1f6a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1322 microversion: 2.1 time: 1.198515 Jul 31 01:26:21.733362 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-8418880c-ddba-4722-8344-10574bcea4ba tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:26:21.733845 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1855/3673] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:20 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1322 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:26:21.734079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-8418880c-ddba-4722-8344-10574bcea4ba tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:26:21.734635 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-8418880c-ddba-4722-8344-10574bcea4ba tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:26:21.759759 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8418880c-ddba-4722-8344-10574bcea4ba tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:21.760521 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8418880c-ddba-4722-8344-10574bcea4ba tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:21.762421 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8418880c-ddba-4722-8344-10574bcea4ba tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:21.763169 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8418880c-ddba-4722-8344-10574bcea4ba tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:21.769591 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4da3c30b-3943-4686-b862-0c2d741459fe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:21.770257 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4da3c30b-3943-4686-b862-0c2d741459fe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:21.799003 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4da3c30b-3943-4686-b862-0c2d741459fe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:21.799493 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4da3c30b-3943-4686-b862-0c2d741459fe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:21.800290 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4da3c30b-3943-4686-b862-0c2d741459fe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:21.800762 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4da3c30b-3943-4686-b862-0c2d741459fe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:21.896008 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-8418880c-ddba-4722-8344-10574bcea4ba tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Getting quotas for project 1a7506ae4e0e455f967a8aed632cf53c. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:26:21.927872 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-8418880c-ddba-4722-8344-10574bcea4ba tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Getting quotas for user 845de7d6f99547c68b193d332bf58799 and project 1a7506ae4e0e455f967a8aed632cf53c. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:26:21.980681 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8418880c-ddba-4722-8344-10574bcea4ba tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:26:22.001464 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8418880c-ddba-4722-8344-10574bcea4ba tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: c0b8a2d9-d933-45ab-a1c8-fc27eccb706e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:26:22.175198 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8418880c-ddba-4722-8344-10574bcea4ba tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.030598 Jul 31 01:26:22.177313 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1819/3674] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:26:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 31 01:26:22.200319 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c56f6294-12b5-4fff-b37b-b5d53d19f64e tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:22.201259 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c56f6294-12b5-4fff-b37b-b5d53d19f64e tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: c0b8a2d9-d933-45ab-a1c8-fc27eccb706e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:22.490641 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c56f6294-12b5-4fff-b37b-b5d53d19f64e tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:22.517480 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c56f6294-12b5-4fff-b37b-b5d53d19f64e tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:22.524790 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c56f6294-12b5-4fff-b37b-b5d53d19f64e tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:22.526022 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c56f6294-12b5-4fff-b37b-b5d53d19f64e tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b8a2d9-d933-45ab-a1c8-fc27eccb706e" status: 200 len: 1278 microversion: 2.47 time: 0.339265 Jul 31 01:26:22.526584 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1820/3675] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:22 2022] GET /compute/v2.1/servers/c0b8a2d9-d933-45ab-a1c8-fc27eccb706e => generated 1278 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:26:22.645445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4da3c30b-3943-4686-b862-0c2d741459fe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:22.655749 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4da3c30b-3943-4686-b862-0c2d741459fe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1509 microversion: 2.1 time: 0.893338 Jul 31 01:26:22.662940 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1856/3676] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:21 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1509 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:22.717046 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-74e93617-9fd3-4a25-866b-5eb78ef3fa2a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-942691915", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": "none"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:22.754208 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2e779ed6-4590-45b7-8a65-e82aa1273838 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:22.754949 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2e779ed6-4590-45b7-8a65-e82aa1273838 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:22.766037 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e779ed6-4590-45b7-8a65-e82aa1273838 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:22.767962 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e779ed6-4590-45b7-8a65-e82aa1273838 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:22.769627 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e779ed6-4590-45b7-8a65-e82aa1273838 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:22.772284 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e779ed6-4590-45b7-8a65-e82aa1273838 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:22.830964 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-74e93617-9fd3-4a25-866b-5eb78ef3fa2a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:26:22.831467 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-74e93617-9fd3-4a25-866b-5eb78ef3fa2a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:26:22.831879 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-74e93617-9fd3-4a25-866b-5eb78ef3fa2a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:26:22.832289 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-74e93617-9fd3-4a25-866b-5eb78ef3fa2a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:26:22.832701 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-74e93617-9fd3-4a25-866b-5eb78ef3fa2a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:26:22.858367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74e93617-9fd3-4a25-866b-5eb78ef3fa2a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:22.858840 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74e93617-9fd3-4a25-866b-5eb78ef3fa2a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:22.859710 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74e93617-9fd3-4a25-866b-5eb78ef3fa2a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:22.860162 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74e93617-9fd3-4a25-866b-5eb78ef3fa2a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:22.917558 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-74e93617-9fd3-4a25-866b-5eb78ef3fa2a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Getting quotas for project 1a7506ae4e0e455f967a8aed632cf53c. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:26:22.942703 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-74e93617-9fd3-4a25-866b-5eb78ef3fa2a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Getting quotas for user 845de7d6f99547c68b193d332bf58799 and project 1a7506ae4e0e455f967a8aed632cf53c. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:26:23.005757 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-74e93617-9fd3-4a25-866b-5eb78ef3fa2a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:26:23.012926 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-74e93617-9fd3-4a25-866b-5eb78ef3fa2a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:26:23.298565 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-74e93617-9fd3-4a25-866b-5eb78ef3fa2a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.581882 Jul 31 01:26:23.299405 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1821/3677] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:26:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 01:26:23.313373 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9b02c38d-c7d8-47a8-aa57-19cf3096a5ab tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:23.339279 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9b02c38d-c7d8-47a8-aa57-19cf3096a5ab tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:23.456641 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9b02c38d-c7d8-47a8-aa57-19cf3096a5ab tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "PUT /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 991 microversion: 2.47 time: 0.148874 Jul 31 01:26:23.459725 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1822/3678] 10.222.0.45 () {62 vars in 1297 bytes} [Sun Jul 31 01:26:23 2022] PUT /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 991 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:26:23.476931 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3f43ab11-c563-400d-a8f7-aa8cddc375c9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:23.477553 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3f43ab11-c563-400d-a8f7-aa8cddc375c9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:24.000470 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3f43ab11-c563-400d-a8f7-aa8cddc375c9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:24.013981 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3f43ab11-c563-400d-a8f7-aa8cddc375c9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:24.020747 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3f43ab11-c563-400d-a8f7-aa8cddc375c9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:24.038557 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3f43ab11-c563-400d-a8f7-aa8cddc375c9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1277 microversion: 2.47 time: 0.565759 Jul 31 01:26:24.039705 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1823/3679] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:23 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1277 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:24.042645 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2e779ed6-4590-45b7-8a65-e82aa1273838 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:24.045588 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8ea7da61-1483-4d4c-ae41-652a9d767644 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:24.048374 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8ea7da61-1483-4d4c-ae41-652a9d767644 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:24.072937 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ea7da61-1483-4d4c-ae41-652a9d767644 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:24.073832 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2e779ed6-4590-45b7-8a65-e82aa1273838 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1322 microversion: 2.1 time: 1.320133 Jul 31 01:26:24.076740 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1857/3680] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:22 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1322 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:26:24.084363 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ea7da61-1483-4d4c-ae41-652a9d767644 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:24.084363 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ea7da61-1483-4d4c-ae41-652a9d767644 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:24.084801 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ea7da61-1483-4d4c-ae41-652a9d767644 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:24.263066 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bcad2f43-7c0e-4c1b-9e05-0d6cc08ea98a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1063650997", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "a8f62231-6d25-478b-9cd8-a54df5b9a877"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:24.413435 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-bcad2f43-7c0e-4c1b-9e05-0d6cc08ea98a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] validate_networks() for [('a8f62231-6d25-478b-9cd8-a54df5b9a877', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:26:25.363789 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8ea7da61-1483-4d4c-ae41-652a9d767644 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:25.372334 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8ea7da61-1483-4d4c-ae41-652a9d767644 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1509 microversion: 2.1 time: 1.331325 Jul 31 01:26:25.380382 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1824/3681] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:24 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1509 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:25.386021 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ed2bf14a-ca88-4088-ad1c-5d8c6d0ff2d5 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:25.389013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ed2bf14a-ca88-4088-ad1c-5d8c6d0ff2d5 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:25.406452 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed2bf14a-ca88-4088-ad1c-5d8c6d0ff2d5 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:25.407171 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed2bf14a-ca88-4088-ad1c-5d8c6d0ff2d5 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:25.408144 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed2bf14a-ca88-4088-ad1c-5d8c6d0ff2d5 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:25.408729 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed2bf14a-ca88-4088-ad1c-5d8c6d0ff2d5 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:25.808611 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ed2bf14a-ca88-4088-ad1c-5d8c6d0ff2d5 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:25.827552 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ed2bf14a-ca88-4088-ad1c-5d8c6d0ff2d5 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:25.829475 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ed2bf14a-ca88-4088-ad1c-5d8c6d0ff2d5 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:25.830941 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ed2bf14a-ca88-4088-ad1c-5d8c6d0ff2d5 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1329 microversion: 2.47 time: 0.449012 Jul 31 01:26:25.832805 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1825/3682] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:25 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1329 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:25.846641 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-df94a947-f35a-466d-ab6f-78f10d7f7685 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:25.847693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-df94a947-f35a-466d-ab6f-78f10d7f7685 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:25.862432 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df94a947-f35a-466d-ab6f-78f10d7f7685 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:25.863285 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df94a947-f35a-466d-ab6f-78f10d7f7685 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:25.864419 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df94a947-f35a-466d-ab6f-78f10d7f7685 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:25.869173 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df94a947-f35a-466d-ab6f-78f10d7f7685 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:27.390966 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-df94a947-f35a-466d-ab6f-78f10d7f7685 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:27.400698 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-df94a947-f35a-466d-ab6f-78f10d7f7685 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1322 microversion: 2.1 time: 1.566530 Jul 31 01:26:27.401290 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1826/3683] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:25 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1322 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:27.428809 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-66801e38-07f7-4ac6-a6f9-3849adc188b9 req-b28fa3c0-8364-4631-8a6e-775cbefbd6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b82c2878-c1d7-43a4-9b3e-38af00bda820", "name": "network-vif-plugged", "status": "completed", "tag": "d4f63d82-0064-4811-bcb1-b78632f9ea21"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:27.460140 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:27.462335 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-66801e38-07f7-4ac6-a6f9-3849adc188b9 req-b28fa3c0-8364-4631-8a6e-775cbefbd6a7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:27.462839 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-66801e38-07f7-4ac6-a6f9-3849adc188b9 req-b28fa3c0-8364-4631-8a6e-775cbefbd6a7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:27.505583 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-66801e38-07f7-4ac6-a6f9-3849adc188b9 req-b28fa3c0-8364-4631-8a6e-775cbefbd6a7 service nova] Creating event network-vif-plugged:d4f63d82-0064-4811-bcb1-b78632f9ea21 for instance b82c2878-c1d7-43a4-9b3e-38af00bda820 on n-h1-master-1 Jul 31 01:26:27.525725 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-66801e38-07f7-4ac6-a6f9-3849adc188b9 req-b28fa3c0-8364-4631-8a6e-775cbefbd6a7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116101 Jul 31 01:26:27.531197 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1827/3684] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:26:27.555017 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ca93f702-d5a9-4141-aa43-edefa370f678 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:27.558730 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ca93f702-d5a9-4141-aa43-edefa370f678 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:27.612862 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca93f702-d5a9-4141-aa43-edefa370f678 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:27.620670 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca93f702-d5a9-4141-aa43-edefa370f678 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:27.621931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca93f702-d5a9-4141-aa43-edefa370f678 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:27.625282 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca93f702-d5a9-4141-aa43-edefa370f678 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:27.816443 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-bcad2f43-7c0e-4c1b-9e05-0d6cc08ea98a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:26:27.818287 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-bcad2f43-7c0e-4c1b-9e05-0d6cc08ea98a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:26:27.819553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-bcad2f43-7c0e-4c1b-9e05-0d6cc08ea98a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:26:27.820766 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-bcad2f43-7c0e-4c1b-9e05-0d6cc08ea98a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:26:27.821992 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-bcad2f43-7c0e-4c1b-9e05-0d6cc08ea98a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:26:27.876896 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcad2f43-7c0e-4c1b-9e05-0d6cc08ea98a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:27.878249 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcad2f43-7c0e-4c1b-9e05-0d6cc08ea98a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:27.884560 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcad2f43-7c0e-4c1b-9e05-0d6cc08ea98a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:27.886107 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcad2f43-7c0e-4c1b-9e05-0d6cc08ea98a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:27.919127 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-bcad2f43-7c0e-4c1b-9e05-0d6cc08ea98a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Getting quotas for project c609eaf96fc84008b10c26b3f56edd69. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:26:27.927362 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-bcad2f43-7c0e-4c1b-9e05-0d6cc08ea98a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Getting quotas for user df0850646f5b4fdeabc4d50297626e27 and project c609eaf96fc84008b10c26b3f56edd69. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:26:27.960656 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bcad2f43-7c0e-4c1b-9e05-0d6cc08ea98a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:26:27.963963 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bcad2f43-7c0e-4c1b-9e05-0d6cc08ea98a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:26:28.065165 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bcad2f43-7c0e-4c1b-9e05-0d6cc08ea98a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.964603 Jul 31 01:26:28.076888 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1858/3685] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:26:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:26:28.092069 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d86ada53-66d4-47e3-a61f-3b6cbfff19cb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:28.111161 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d86ada53-66d4-47e3-a61f-3b6cbfff19cb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:28.143158 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d86ada53-66d4-47e3-a61f-3b6cbfff19cb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:28.143968 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d86ada53-66d4-47e3-a61f-3b6cbfff19cb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:28.147260 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d86ada53-66d4-47e3-a61f-3b6cbfff19cb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:28.150463 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d86ada53-66d4-47e3-a61f-3b6cbfff19cb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:29.201248 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d86ada53-66d4-47e3-a61f-3b6cbfff19cb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:29.220832 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d86ada53-66d4-47e3-a61f-3b6cbfff19cb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:29.221336 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ca93f702-d5a9-4141-aa43-edefa370f678 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:29.223655 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d86ada53-66d4-47e3-a61f-3b6cbfff19cb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:29.228681 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d86ada53-66d4-47e3-a61f-3b6cbfff19cb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1335 microversion: 2.47 time: 1.150193 Jul 31 01:26:29.232369 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1859/3686] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:28 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1335 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:29.239366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cd96ce14-e54c-4b67-a58c-e27025101175 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:29.245718 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cd96ce14-e54c-4b67-a58c-e27025101175 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:29.260563 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd96ce14-e54c-4b67-a58c-e27025101175 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:29.264148 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd96ce14-e54c-4b67-a58c-e27025101175 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:29.266643 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd96ce14-e54c-4b67-a58c-e27025101175 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:29.271476 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd96ce14-e54c-4b67-a58c-e27025101175 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:29.273063 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ca93f702-d5a9-4141-aa43-edefa370f678 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1509 microversion: 2.1 time: 1.724818 Jul 31 01:26:29.302215 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1828/3687] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:27 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1509 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:29.318885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6e43676e-dc3a-44e4-bb8f-97ebad84d99e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:29.333658 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6e43676e-dc3a-44e4-bb8f-97ebad84d99e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:29.354096 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e43676e-dc3a-44e4-bb8f-97ebad84d99e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:29.356495 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e43676e-dc3a-44e4-bb8f-97ebad84d99e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:29.358480 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e43676e-dc3a-44e4-bb8f-97ebad84d99e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:29.360170 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e43676e-dc3a-44e4-bb8f-97ebad84d99e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:29.729135 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cd96ce14-e54c-4b67-a58c-e27025101175 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:29.740755 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cd96ce14-e54c-4b67-a58c-e27025101175 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1229 microversion: 2.1 time: 0.506940 Jul 31 01:26:29.746269 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1860/3688] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:29 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1229 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:29.752122 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-be986b39-aa17-449d-8beb-dad38ac09e6c req-fd044827-7ec2-4f00-9152-2d646d6c4771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c981f91-b847-4b1b-a3c3-4edc7a9221c3", "name": "network-vif-plugged", "status": "completed", "tag": "8dc1db04-4278-481c-8fb7-ab59e918dc37"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:29.789588 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-be986b39-aa17-449d-8beb-dad38ac09e6c req-fd044827-7ec2-4f00-9152-2d646d6c4771 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:29.796320 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-be986b39-aa17-449d-8beb-dad38ac09e6c req-fd044827-7ec2-4f00-9152-2d646d6c4771 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:29.828519 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-be986b39-aa17-449d-8beb-dad38ac09e6c req-fd044827-7ec2-4f00-9152-2d646d6c4771 service nova] Creating event network-vif-plugged:8dc1db04-4278-481c-8fb7-ab59e918dc37 for instance 3c981f91-b847-4b1b-a3c3-4edc7a9221c3 on n-h2-master-1 Jul 31 01:26:29.853429 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-be986b39-aa17-449d-8beb-dad38ac09e6c req-fd044827-7ec2-4f00-9152-2d646d6c4771 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101350 Jul 31 01:26:29.854808 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1861/3689] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:26:29.961563 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6e43676e-dc3a-44e4-bb8f-97ebad84d99e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:29.970590 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6e43676e-dc3a-44e4-bb8f-97ebad84d99e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1322 microversion: 2.1 time: 0.666705 Jul 31 01:26:29.989286 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1829/3690] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:29 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1322 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:30.262066 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a64a3124-4cdc-42b4-867a-071b0186c972 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:30.265890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a64a3124-4cdc-42b4-867a-071b0186c972 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:30.308362 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5929a323-2011-4cb7-8f08-e50933149260 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:30.309513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5929a323-2011-4cb7-8f08-e50933149260 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:30.312187 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a64a3124-4cdc-42b4-867a-071b0186c972 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:30.312717 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a64a3124-4cdc-42b4-867a-071b0186c972 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:30.313568 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a64a3124-4cdc-42b4-867a-071b0186c972 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:30.319349 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a64a3124-4cdc-42b4-867a-071b0186c972 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:30.376490 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5929a323-2011-4cb7-8f08-e50933149260 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:30.377321 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5929a323-2011-4cb7-8f08-e50933149260 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:30.378739 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5929a323-2011-4cb7-8f08-e50933149260 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:30.385912 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5929a323-2011-4cb7-8f08-e50933149260 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:30.536087 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a64a3124-4cdc-42b4-867a-071b0186c972 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:30.552305 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a64a3124-4cdc-42b4-867a-071b0186c972 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:30.554473 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a64a3124-4cdc-42b4-867a-071b0186c972 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:30.558304 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a64a3124-4cdc-42b4-867a-071b0186c972 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1356 microversion: 2.47 time: 0.301423 Jul 31 01:26:30.560669 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1862/3691] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:30 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1356 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:26:30.616286 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0f306572-729b-4b95-a357-79461887e541"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:30.623951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:30.642134 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:30.643622 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:30.644931 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:30.645744 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:30.824435 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:30.846055 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:26:30.846845 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:26:30.847386 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:26:30.849094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:26:30.849558 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:26:31.011207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:31.031327 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:31.032412 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:31.033561 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:31.034288 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:31.107106 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a880451e-ea65-4eef-a98f-7ba3c50e99ac tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "POST /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0/action" status: 202 len: 1078 microversion: 2.47 time: 0.500320 Jul 31 01:26:31.120219 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1863/3692] 10.222.0.45 () {62 vars in 1319 bytes} [Sun Jul 31 01:26:30 2022] POST /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0/action => generated 1078 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 31 01:26:31.125831 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0d15a868-7350-4c55-bbcb-d480e98f6739 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:31.126857 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0d15a868-7350-4c55-bbcb-d480e98f6739 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:31.159452 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d15a868-7350-4c55-bbcb-d480e98f6739 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:31.160806 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d15a868-7350-4c55-bbcb-d480e98f6739 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:31.167467 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d15a868-7350-4c55-bbcb-d480e98f6739 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:31.168447 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d15a868-7350-4c55-bbcb-d480e98f6739 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:31.892660 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0d15a868-7350-4c55-bbcb-d480e98f6739 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:31.945518 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0d15a868-7350-4c55-bbcb-d480e98f6739 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1285 microversion: 2.1 time: 0.822696 Jul 31 01:26:31.964549 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1864/3693] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:31 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1285 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:31.989859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-63e9a6f9-9cc9-4f55-85c1-e336c28ad75d tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:31.992113 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-63e9a6f9-9cc9-4f55-85c1-e336c28ad75d tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:32.014760 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-63e9a6f9-9cc9-4f55-85c1-e336c28ad75d tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:32.024993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-63e9a6f9-9cc9-4f55-85c1-e336c28ad75d tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:32.027734 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-63e9a6f9-9cc9-4f55-85c1-e336c28ad75d tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:32.029507 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-63e9a6f9-9cc9-4f55-85c1-e336c28ad75d tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:32.521218 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5929a323-2011-4cb7-8f08-e50933149260 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:32.553805 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5929a323-2011-4cb7-8f08-e50933149260 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1509 microversion: 2.1 time: 2.254195 Jul 31 01:26:32.591069 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1830/3694] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:30 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1509 bytes in 2292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:32.645031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2d8f6091-a445-4b31-8f54-41cfa64cca48 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:32.646512 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2d8f6091-a445-4b31-8f54-41cfa64cca48 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:32.669454 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d8f6091-a445-4b31-8f54-41cfa64cca48 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:32.670622 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d8f6091-a445-4b31-8f54-41cfa64cca48 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:32.676052 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d8f6091-a445-4b31-8f54-41cfa64cca48 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:32.681183 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d8f6091-a445-4b31-8f54-41cfa64cca48 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:32.893027 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:32.972119 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2d8f6091-a445-4b31-8f54-41cfa64cca48 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:32.988185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2d8f6091-a445-4b31-8f54-41cfa64cca48 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:32.990448 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2d8f6091-a445-4b31-8f54-41cfa64cca48 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:32.993128 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2d8f6091-a445-4b31-8f54-41cfa64cca48 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1365 microversion: 2.47 time: 0.400592 Jul 31 01:26:32.995387 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1831/3695] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:32 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1365 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:33.003799 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-63e9a6f9-9cc9-4f55-85c1-e336c28ad75d tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:33.009921 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b305becf-559c-4d3e-bf9c-2930786ae260 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:33.013583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b305becf-559c-4d3e-bf9c-2930786ae260 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:33.019607 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-63e9a6f9-9cc9-4f55-85c1-e336c28ad75d tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1517 microversion: 2.1 time: 1.049465 Jul 31 01:26:33.021568 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1865/3696] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:31 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1517 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:33.030074 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b305becf-559c-4d3e-bf9c-2930786ae260 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:33.042046 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b305becf-559c-4d3e-bf9c-2930786ae260 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:33.046232 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b305becf-559c-4d3e-bf9c-2930786ae260 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:33.047196 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-37c32f37-9a09-4802-b34c-f4e4d27efb93 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:33.050177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b305becf-559c-4d3e-bf9c-2930786ae260 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:33.051819 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-37c32f37-9a09-4802-b34c-f4e4d27efb93 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:33.069182 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37c32f37-9a09-4802-b34c-f4e4d27efb93 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:33.069663 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37c32f37-9a09-4802-b34c-f4e4d27efb93 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:33.070471 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37c32f37-9a09-4802-b34c-f4e4d27efb93 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:33.090549 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37c32f37-9a09-4802-b34c-f4e4d27efb93 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:33.160660 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-37c32f37-9a09-4802-b34c-f4e4d27efb93 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lazy-loading 'flavor' on Instance uuid b82c2878-c1d7-43a4-9b3e-38af00bda820 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:26:33.318325 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-37c32f37-9a09-4802-b34c-f4e4d27efb93 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "POST /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820/action" status: 200 len: 32 microversion: 2.1 time: 0.280740 Jul 31 01:26:33.325319 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1866/3697] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:26:33 2022] POST /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820/action => generated 32 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 31 01:26:33.332202 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-04b4c94b-37bc-4789-bbe4-aa4ee2080eaa tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:33.338564 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-04b4c94b-37bc-4789-bbe4-aa4ee2080eaa tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:33.358671 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04b4c94b-37bc-4789-bbe4-aa4ee2080eaa tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:33.359499 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04b4c94b-37bc-4789-bbe4-aa4ee2080eaa tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:33.360630 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04b4c94b-37bc-4789-bbe4-aa4ee2080eaa tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:33.361301 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04b4c94b-37bc-4789-bbe4-aa4ee2080eaa tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:33.460276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b305becf-559c-4d3e-bf9c-2930786ae260 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:33.488272 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b305becf-559c-4d3e-bf9c-2930786ae260 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1283 microversion: 2.1 time: 0.490165 Jul 31 01:26:33.496077 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1832/3698] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:32 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1283 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:33.575521 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ce71cf77-c403-47b9-b78b-26d3227fc574 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:33.576454 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ce71cf77-c403-47b9-b78b-26d3227fc574 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:33.589290 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce71cf77-c403-47b9-b78b-26d3227fc574 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:33.589743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce71cf77-c403-47b9-b78b-26d3227fc574 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:33.591557 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce71cf77-c403-47b9-b78b-26d3227fc574 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:33.592358 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce71cf77-c403-47b9-b78b-26d3227fc574 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:34.005449 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=16 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:34.516751 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ce71cf77-c403-47b9-b78b-26d3227fc574 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:34.546167 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ce71cf77-c403-47b9-b78b-26d3227fc574 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1509 microversion: 2.1 time: 0.974308 Jul 31 01:26:34.567622 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1833/3699] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:33 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1509 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:34.588459 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1f983f93-c4a2-4af6-a88e-cde61fdf4887 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:34.589524 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1f983f93-c4a2-4af6-a88e-cde61fdf4887 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:34.617712 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f983f93-c4a2-4af6-a88e-cde61fdf4887 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:34.627499 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f983f93-c4a2-4af6-a88e-cde61fdf4887 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:34.629061 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f983f93-c4a2-4af6-a88e-cde61fdf4887 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:34.629681 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f983f93-c4a2-4af6-a88e-cde61fdf4887 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:34.716129 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-04b4c94b-37bc-4789-bbe4-aa4ee2080eaa tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:34.718831 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:34.736013 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-04b4c94b-37bc-4789-bbe4-aa4ee2080eaa tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1523 microversion: 2.1 time: 1.408986 Jul 31 01:26:34.739089 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1867/3700] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:33 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1523 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:34.753856 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f2e495c3-d250-4a46-9430-edadcd8a680f tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:34.761533 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f2e495c3-d250-4a46-9430-edadcd8a680f tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:34.778653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2e495c3-d250-4a46-9430-edadcd8a680f tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:34.779127 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2e495c3-d250-4a46-9430-edadcd8a680f tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:34.779964 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2e495c3-d250-4a46-9430-edadcd8a680f tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:34.786066 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2e495c3-d250-4a46-9430-edadcd8a680f tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:34.938847 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1f983f93-c4a2-4af6-a88e-cde61fdf4887 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:34.964130 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1f983f93-c4a2-4af6-a88e-cde61fdf4887 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:34.965863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1f983f93-c4a2-4af6-a88e-cde61fdf4887 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:34.967154 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1f983f93-c4a2-4af6-a88e-cde61fdf4887 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1365 microversion: 2.47 time: 0.396662 Jul 31 01:26:34.973478 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1834/3701] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:34 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1365 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:35.036497 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f2e495c3-d250-4a46-9430-edadcd8a680f tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:35.045569 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f2e495c3-d250-4a46-9430-edadcd8a680f tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1283 microversion: 2.1 time: 0.305040 Jul 31 01:26:35.046182 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1868/3702] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:34 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1283 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:35.605786 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6627ce96-4cda-4300-aa55-86f5ca899977 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:35.607159 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6627ce96-4cda-4300-aa55-86f5ca899977 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:35.623278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6627ce96-4cda-4300-aa55-86f5ca899977 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:35.624262 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6627ce96-4cda-4300-aa55-86f5ca899977 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:35.625413 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6627ce96-4cda-4300-aa55-86f5ca899977 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:35.626119 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6627ce96-4cda-4300-aa55-86f5ca899977 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:35.772586 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-663613df-0df4-4263-a53e-da9fcda7533a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:35.773864 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-663613df-0df4-4263-a53e-da9fcda7533a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:35.806509 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-663613df-0df4-4263-a53e-da9fcda7533a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:35.808376 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-663613df-0df4-4263-a53e-da9fcda7533a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:35.811867 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-663613df-0df4-4263-a53e-da9fcda7533a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:35.814321 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-663613df-0df4-4263-a53e-da9fcda7533a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:36.138244 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6627ce96-4cda-4300-aa55-86f5ca899977 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:36.154793 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6627ce96-4cda-4300-aa55-86f5ca899977 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1509 microversion: 2.1 time: 0.550581 Jul 31 01:26:36.157169 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1835/3703] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:35 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1509 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:36.175961 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-714e7038-3a66-431f-854e-85ebc1fe2497 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:36.182052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-714e7038-3a66-431f-854e-85ebc1fe2497 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:36.205487 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-714e7038-3a66-431f-854e-85ebc1fe2497 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:36.210052 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-714e7038-3a66-431f-854e-85ebc1fe2497 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:36.221918 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-714e7038-3a66-431f-854e-85ebc1fe2497 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:36.225029 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-714e7038-3a66-431f-854e-85ebc1fe2497 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:36.546072 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-714e7038-3a66-431f-854e-85ebc1fe2497 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:36.558907 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-714e7038-3a66-431f-854e-85ebc1fe2497 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:36.569424 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-714e7038-3a66-431f-854e-85ebc1fe2497 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:36.584551 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-714e7038-3a66-431f-854e-85ebc1fe2497 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1365 microversion: 2.47 time: 0.415398 Jul 31 01:26:36.600830 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1836/3704] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:36 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1365 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:36.618858 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c278582-75c2-4e9f-9d04-a59bcc6359b4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:36.619582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2c278582-75c2-4e9f-9d04-a59bcc6359b4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:36.646218 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c278582-75c2-4e9f-9d04-a59bcc6359b4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:36.647120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c278582-75c2-4e9f-9d04-a59bcc6359b4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:36.648319 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c278582-75c2-4e9f-9d04-a59bcc6359b4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:36.649071 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c278582-75c2-4e9f-9d04-a59bcc6359b4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:37.579232 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2c278582-75c2-4e9f-9d04-a59bcc6359b4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:37.588085 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2c278582-75c2-4e9f-9d04-a59bcc6359b4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1325 microversion: 2.1 time: 0.985478 Jul 31 01:26:37.588681 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1837/3705] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:36 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1325 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:37.610437 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-663613df-0df4-4263-a53e-da9fcda7533a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:37.614560 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0801ae63-b9ef-4a73-91e2-8f6ba5c66198 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:37.615390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0801ae63-b9ef-4a73-91e2-8f6ba5c66198 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:37.620169 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-663613df-0df4-4263-a53e-da9fcda7533a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1523 microversion: 2.1 time: 1.862577 Jul 31 01:26:37.626647 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0801ae63-b9ef-4a73-91e2-8f6ba5c66198 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:37.628072 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0801ae63-b9ef-4a73-91e2-8f6ba5c66198 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:37.629186 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0801ae63-b9ef-4a73-91e2-8f6ba5c66198 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:37.629956 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0801ae63-b9ef-4a73-91e2-8f6ba5c66198 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:37.638365 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1869/3706] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:35 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1523 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:37.652465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-65f815e1-a429-49c3-8c8e-5d068015576a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:37.652729 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-65f815e1-a429-49c3-8c8e-5d068015576a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:37.669456 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65f815e1-a429-49c3-8c8e-5d068015576a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:37.685169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65f815e1-a429-49c3-8c8e-5d068015576a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:37.688511 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65f815e1-a429-49c3-8c8e-5d068015576a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:37.689451 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65f815e1-a429-49c3-8c8e-5d068015576a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:37.826847 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-65f815e1-a429-49c3-8c8e-5d068015576a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:37.846015 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-65f815e1-a429-49c3-8c8e-5d068015576a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:37.854207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-65f815e1-a429-49c3-8c8e-5d068015576a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:37.856799 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-65f815e1-a429-49c3-8c8e-5d068015576a tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1365 microversion: 2.47 time: 0.219079 Jul 31 01:26:37.857565 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1870/3707] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:37 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:38.268843 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0801ae63-b9ef-4a73-91e2-8f6ba5c66198 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:38.283547 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0801ae63-b9ef-4a73-91e2-8f6ba5c66198 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1509 microversion: 2.1 time: 0.693178 Jul 31 01:26:38.298922 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1838/3708] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:37 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1509 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:38.639094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-81d42023-9716-4d63-8074-ecd2627beb43 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:38.643122 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-81d42023-9716-4d63-8074-ecd2627beb43 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:38.646560 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-171136a0-b720-4a77-b9ab-979037b1cd8c tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:38.647410 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-171136a0-b720-4a77-b9ab-979037b1cd8c tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:38.667115 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:38.672634 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:38.677518 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-171136a0-b720-4a77-b9ab-979037b1cd8c tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:38.677996 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-171136a0-b720-4a77-b9ab-979037b1cd8c tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:38.678848 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-171136a0-b720-4a77-b9ab-979037b1cd8c tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:38.679287 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-171136a0-b720-4a77-b9ab-979037b1cd8c tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:38.680653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81d42023-9716-4d63-8074-ecd2627beb43 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:38.684827 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81d42023-9716-4d63-8074-ecd2627beb43 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:38.688799 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81d42023-9716-4d63-8074-ecd2627beb43 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:38.690583 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81d42023-9716-4d63-8074-ecd2627beb43 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:39.150182 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-171136a0-b720-4a77-b9ab-979037b1cd8c tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:39.161410 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:39.186325 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-171136a0-b720-4a77-b9ab-979037b1cd8c tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1523 microversion: 2.1 time: 0.545017 Jul 31 01:26:39.190959 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1839/3709] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:38 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1523 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:39.198271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-52953a67-4f62-428e-a9ea-cf1819a60212 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:39.224360 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-52953a67-4f62-428e-a9ea-cf1819a60212 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:39.235870 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52953a67-4f62-428e-a9ea-cf1819a60212 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:39.247914 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52953a67-4f62-428e-a9ea-cf1819a60212 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:39.250598 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52953a67-4f62-428e-a9ea-cf1819a60212 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:39.251999 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52953a67-4f62-428e-a9ea-cf1819a60212 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:39.310585 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-81d42023-9716-4d63-8074-ecd2627beb43 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:39.330071 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-81d42023-9716-4d63-8074-ecd2627beb43 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1325 microversion: 2.1 time: 0.712120 Jul 31 01:26:39.334685 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1871/3710] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:38 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1325 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:39.343735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2f9440e4-5399-4440-bd48-c4b3c86d0cba tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:39.344896 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2f9440e4-5399-4440-bd48-c4b3c86d0cba tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:39.376516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2f9440e4-5399-4440-bd48-c4b3c86d0cba tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:39.384957 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2f9440e4-5399-4440-bd48-c4b3c86d0cba tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:39.386087 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2f9440e4-5399-4440-bd48-c4b3c86d0cba tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:39.386574 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2f9440e4-5399-4440-bd48-c4b3c86d0cba tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:39.419753 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-52953a67-4f62-428e-a9ea-cf1819a60212 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:39.438751 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-52953a67-4f62-428e-a9ea-cf1819a60212 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:39.441412 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-52953a67-4f62-428e-a9ea-cf1819a60212 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:39.443070 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-52953a67-4f62-428e-a9ea-cf1819a60212 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1365 microversion: 2.47 time: 0.249652 Jul 31 01:26:39.444086 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1840/3711] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:39 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:39.988119 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2f9440e4-5399-4440-bd48-c4b3c86d0cba tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:40.029753 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2f9440e4-5399-4440-bd48-c4b3c86d0cba tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1509 microversion: 2.1 time: 0.691137 Jul 31 01:26:40.053515 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1872/3712] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:39 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1509 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:40.057795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-9a90ecb1-0d13-44a3-8e04-72e2bc81c6b2 req-b80d1a29-9a1b-42bf-91c1-f623ced5d7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f6a6f7-53a0-437a-a0aa-2cf71c4e606f", "tag": "82a98ea3-f93d-41d8-b248-0935fed4bcb0"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:40.086025 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9a90ecb1-0d13-44a3-8e04-72e2bc81c6b2 req-b80d1a29-9a1b-42bf-91c1-f623ced5d7d3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:40.086787 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9a90ecb1-0d13-44a3-8e04-72e2bc81c6b2 req-b80d1a29-9a1b-42bf-91c1-f623ced5d7d3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:40.103748 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-9a90ecb1-0d13-44a3-8e04-72e2bc81c6b2 req-b80d1a29-9a1b-42bf-91c1-f623ced5d7d3 service nova] Creating event network-changed:82a98ea3-f93d-41d8-b248-0935fed4bcb0 for instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f on n-h1-master-1 Jul 31 01:26:40.112275 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-9a90ecb1-0d13-44a3-8e04-72e2bc81c6b2 req-b80d1a29-9a1b-42bf-91c1-f623ced5d7d3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.425019 Jul 31 01:26:40.113439 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1841/3713] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:26:40.222114 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ec40f541-4745-464f-b42c-b3cb6dac101a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:40.225811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ec40f541-4745-464f-b42c-b3cb6dac101a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:40.250344 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec40f541-4745-464f-b42c-b3cb6dac101a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:40.254670 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec40f541-4745-464f-b42c-b3cb6dac101a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:40.257579 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec40f541-4745-464f-b42c-b3cb6dac101a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:40.262150 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec40f541-4745-464f-b42c-b3cb6dac101a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:40.364684 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-25b2e388-d490-4ddd-b5f8-38fed7325477 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:40.365712 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-25b2e388-d490-4ddd-b5f8-38fed7325477 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:40.385095 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25b2e388-d490-4ddd-b5f8-38fed7325477 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:40.385615 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25b2e388-d490-4ddd-b5f8-38fed7325477 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:40.386469 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25b2e388-d490-4ddd-b5f8-38fed7325477 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:40.392611 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25b2e388-d490-4ddd-b5f8-38fed7325477 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:40.731265 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ec40f541-4745-464f-b42c-b3cb6dac101a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:40.767107 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ec40f541-4745-464f-b42c-b3cb6dac101a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1523 microversion: 2.1 time: 0.551939 Jul 31 01:26:40.772163 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1873/3714] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:40 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1523 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:40.789149 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e0d342d5-eebe-4c79-a6cc-a42363a1e674 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:40.791736 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e0d342d5-eebe-4c79-a6cc-a42363a1e674 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:40.816301 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e0d342d5-eebe-4c79-a6cc-a42363a1e674 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:40.821333 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e0d342d5-eebe-4c79-a6cc-a42363a1e674 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:40.822654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e0d342d5-eebe-4c79-a6cc-a42363a1e674 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:40.823680 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e0d342d5-eebe-4c79-a6cc-a42363a1e674 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:40.931118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-25b2e388-d490-4ddd-b5f8-38fed7325477 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:40.956303 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-25b2e388-d490-4ddd-b5f8-38fed7325477 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1325 microversion: 2.1 time: 0.600316 Jul 31 01:26:40.957947 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1842/3715] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:40 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1325 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:41.059458 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3eba1edf-ea22-4355-8fc0-672aa9dbda95 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:41.060235 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3eba1edf-ea22-4355-8fc0-672aa9dbda95 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:41.074899 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3eba1edf-ea22-4355-8fc0-672aa9dbda95 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:41.074899 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3eba1edf-ea22-4355-8fc0-672aa9dbda95 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:41.079467 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3eba1edf-ea22-4355-8fc0-672aa9dbda95 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:41.082599 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3eba1edf-ea22-4355-8fc0-672aa9dbda95 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:41.149589 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e0d342d5-eebe-4c79-a6cc-a42363a1e674 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:41.161719 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e0d342d5-eebe-4c79-a6cc-a42363a1e674 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:41.166614 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e0d342d5-eebe-4c79-a6cc-a42363a1e674 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:41.168080 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e0d342d5-eebe-4c79-a6cc-a42363a1e674 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1365 microversion: 2.47 time: 0.393893 Jul 31 01:26:41.168896 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1874/3716] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:40 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1365 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:41.181499 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-daa5e1da-ee6f-4fbc-9180-c1d793940dc9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:41.195132 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-daa5e1da-ee6f-4fbc-9180-c1d793940dc9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:41.207398 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daa5e1da-ee6f-4fbc-9180-c1d793940dc9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:41.208187 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daa5e1da-ee6f-4fbc-9180-c1d793940dc9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:41.210789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daa5e1da-ee6f-4fbc-9180-c1d793940dc9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:41.211459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daa5e1da-ee6f-4fbc-9180-c1d793940dc9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:41.261540 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-daa5e1da-ee6f-4fbc-9180-c1d793940dc9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lazy-loading 'flavor' on Instance uuid 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:26:41.509641 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-daa5e1da-ee6f-4fbc-9180-c1d793940dc9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/action" status: 200 len: 32 microversion: 2.1 time: 0.332124 Jul 31 01:26:41.513291 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1875/3717] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:26:41 2022] POST /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/action => generated 32 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:26:41.532356 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5fd22647-0d2e-4f67-9a81-89140a36e28b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:41.535373 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5fd22647-0d2e-4f67-9a81-89140a36e28b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:41.556120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5fd22647-0d2e-4f67-9a81-89140a36e28b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:41.562377 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5fd22647-0d2e-4f67-9a81-89140a36e28b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:41.564919 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5fd22647-0d2e-4f67-9a81-89140a36e28b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:41.566677 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5fd22647-0d2e-4f67-9a81-89140a36e28b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:41.677153 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3eba1edf-ea22-4355-8fc0-672aa9dbda95 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:41.724709 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3eba1edf-ea22-4355-8fc0-672aa9dbda95 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1509 microversion: 2.1 time: 0.668699 Jul 31 01:26:41.739426 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1843/3718] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:41 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1509 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:26:41.798593 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1ab75461-6753-49dc-9784-3f1cfacc4e31 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:41.799430 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1ab75461-6753-49dc-9784-3f1cfacc4e31 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:41.806776 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ab75461-6753-49dc-9784-3f1cfacc4e31 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:41.818066 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ab75461-6753-49dc-9784-3f1cfacc4e31 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:41.824496 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ab75461-6753-49dc-9784-3f1cfacc4e31 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:41.825532 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ab75461-6753-49dc-9784-3f1cfacc4e31 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:41.964747 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5fd22647-0d2e-4f67-9a81-89140a36e28b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:41.978704 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5fd22647-0d2e-4f67-9a81-89140a36e28b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 0.461535 Jul 31 01:26:41.982663 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1876/3719] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:41 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:41.998984 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7828c8c1-d0b2-4926-b604-362f816fc1ce tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:41.999285 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7828c8c1-d0b2-4926-b604-362f816fc1ce tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:42.007395 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7828c8c1-d0b2-4926-b604-362f816fc1ce tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:42.008053 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7828c8c1-d0b2-4926-b604-362f816fc1ce tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:42.009139 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7828c8c1-d0b2-4926-b604-362f816fc1ce tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:42.010015 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7828c8c1-d0b2-4926-b604-362f816fc1ce tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:42.546806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7828c8c1-d0b2-4926-b604-362f816fc1ce tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:42.570916 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7828c8c1-d0b2-4926-b604-362f816fc1ce tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1325 microversion: 2.1 time: 0.585186 Jul 31 01:26:42.571871 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1877/3720] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:41 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1325 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:42.582111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1ab75461-6753-49dc-9784-3f1cfacc4e31 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:42.591286 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a95172ce-8b28-464e-98b5-4df15732f2e9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:42.592258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a95172ce-8b28-464e-98b5-4df15732f2e9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:42.593503 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1ab75461-6753-49dc-9784-3f1cfacc4e31 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1523 microversion: 2.1 time: 0.798815 Jul 31 01:26:42.594100 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1844/3721] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:41 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1523 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:26:42.608651 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a95172ce-8b28-464e-98b5-4df15732f2e9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:42.609268 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a95172ce-8b28-464e-98b5-4df15732f2e9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:42.610192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a95172ce-8b28-464e-98b5-4df15732f2e9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:42.610753 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a95172ce-8b28-464e-98b5-4df15732f2e9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:42.718474 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a95172ce-8b28-464e-98b5-4df15732f2e9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:42.746662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a95172ce-8b28-464e-98b5-4df15732f2e9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:42.751637 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a95172ce-8b28-464e-98b5-4df15732f2e9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:42.753089 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a95172ce-8b28-464e-98b5-4df15732f2e9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1365 microversion: 2.47 time: 0.178972 Jul 31 01:26:42.753955 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1878/3722] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:42 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:42.783973 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-443971ce-a7fe-427e-babd-fcf4976403cd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:42.784872 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-443971ce-a7fe-427e-babd-fcf4976403cd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:42.798912 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-443971ce-a7fe-427e-babd-fcf4976403cd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:42.799408 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-443971ce-a7fe-427e-babd-fcf4976403cd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:42.800227 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-443971ce-a7fe-427e-babd-fcf4976403cd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:42.800674 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-443971ce-a7fe-427e-babd-fcf4976403cd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:43.007655 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b4016d48-fd65-49d6-a02d-157a888375a0 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:43.008521 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b4016d48-fd65-49d6-a02d-157a888375a0 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:43.028969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4016d48-fd65-49d6-a02d-157a888375a0 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:43.029141 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4016d48-fd65-49d6-a02d-157a888375a0 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:43.030296 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4016d48-fd65-49d6-a02d-157a888375a0 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:43.030639 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4016d48-fd65-49d6-a02d-157a888375a0 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:44.659704 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b4016d48-fd65-49d6-a02d-157a888375a0 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:44.671272 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b4016d48-fd65-49d6-a02d-157a888375a0 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 1.667409 Jul 31 01:26:44.674975 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1879/3723] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:43 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:44.691330 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9008b0fd-5896-41c4-bcfb-1c0d1a71f2f0 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:44.691917 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-443971ce-a7fe-427e-babd-fcf4976403cd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:44.692434 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9008b0fd-5896-41c4-bcfb-1c0d1a71f2f0 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:44.706108 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-443971ce-a7fe-427e-babd-fcf4976403cd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1509 microversion: 2.1 time: 1.926042 Jul 31 01:26:44.710072 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9008b0fd-5896-41c4-bcfb-1c0d1a71f2f0 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:44.710449 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1845/3724] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:42 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1509 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:44.710649 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9008b0fd-5896-41c4-bcfb-1c0d1a71f2f0 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:44.713394 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9008b0fd-5896-41c4-bcfb-1c0d1a71f2f0 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:44.713908 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9008b0fd-5896-41c4-bcfb-1c0d1a71f2f0 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:44.729492 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4857bba4-90b9-4b17-add9-a949fc7db711 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:44.735906 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4857bba4-90b9-4b17-add9-a949fc7db711 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:44.747197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4857bba4-90b9-4b17-add9-a949fc7db711 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:44.747910 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4857bba4-90b9-4b17-add9-a949fc7db711 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:44.748869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4857bba4-90b9-4b17-add9-a949fc7db711 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:44.749547 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4857bba4-90b9-4b17-add9-a949fc7db711 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:45.499533 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4857bba4-90b9-4b17-add9-a949fc7db711 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:45.507724 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4857bba4-90b9-4b17-add9-a949fc7db711 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1523 microversion: 2.1 time: 0.795268 Jul 31 01:26:45.508317 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1846/3725] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:44 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1523 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:45.531001 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b7a2aa00-379b-4546-ae24-dbf98f97bdd6 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:45.531674 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b7a2aa00-379b-4546-ae24-dbf98f97bdd6 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:45.573161 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9008b0fd-5896-41c4-bcfb-1c0d1a71f2f0 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:45.575783 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7a2aa00-379b-4546-ae24-dbf98f97bdd6 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:45.576252 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7a2aa00-379b-4546-ae24-dbf98f97bdd6 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:45.577037 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7a2aa00-379b-4546-ae24-dbf98f97bdd6 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:45.577703 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7a2aa00-379b-4546-ae24-dbf98f97bdd6 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:45.640549 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9008b0fd-5896-41c4-bcfb-1c0d1a71f2f0 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1325 microversion: 2.1 time: 0.958737 Jul 31 01:26:45.654243 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1880/3726] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:44 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1325 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:45.704382 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d7a99dd9-0698-4d85-aba1-f8e64f551729 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:45.706448 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d7a99dd9-0698-4d85-aba1-f8e64f551729 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:45.767884 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7a99dd9-0698-4d85-aba1-f8e64f551729 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:45.769236 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7a99dd9-0698-4d85-aba1-f8e64f551729 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:45.793181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7a99dd9-0698-4d85-aba1-f8e64f551729 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:45.799827 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7a99dd9-0698-4d85-aba1-f8e64f551729 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:45.843597 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b7a2aa00-379b-4546-ae24-dbf98f97bdd6 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:45.859606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b7a2aa00-379b-4546-ae24-dbf98f97bdd6 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:45.865620 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b7a2aa00-379b-4546-ae24-dbf98f97bdd6 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:45.879473 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b7a2aa00-379b-4546-ae24-dbf98f97bdd6 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1365 microversion: 2.47 time: 0.361057 Jul 31 01:26:45.884901 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1847/3727] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:45 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1365 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:45.904108 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bf8b51d4-b02c-44ea-af9e-a75c6e5fccaf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:45.905368 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bf8b51d4-b02c-44ea-af9e-a75c6e5fccaf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:45.928663 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf8b51d4-b02c-44ea-af9e-a75c6e5fccaf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:45.929381 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf8b51d4-b02c-44ea-af9e-a75c6e5fccaf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:45.930987 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf8b51d4-b02c-44ea-af9e-a75c6e5fccaf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:45.933241 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf8b51d4-b02c-44ea-af9e-a75c6e5fccaf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:46.716742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d7a99dd9-0698-4d85-aba1-f8e64f551729 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:46.741252 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d7a99dd9-0698-4d85-aba1-f8e64f551729 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 1.045258 Jul 31 01:26:46.759687 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1881/3728] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:45 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:46.765169 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-33b0d0c0-e0a5-4751-a24c-4d4e36d64c6a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:46.770981 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bf8b51d4-b02c-44ea-af9e-a75c6e5fccaf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:46.780099 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bf8b51d4-b02c-44ea-af9e-a75c6e5fccaf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1509 microversion: 2.1 time: 0.893708 Jul 31 01:26:46.785928 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-33b0d0c0-e0a5-4751-a24c-4d4e36d64c6a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:46.790286 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1848/3729] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:45 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1509 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:46.795743 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3c253fcf-9a2e-48bb-940e-5b6abedd104d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:46.799595 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33b0d0c0-e0a5-4751-a24c-4d4e36d64c6a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:46.800590 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3c253fcf-9a2e-48bb-940e-5b6abedd104d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:46.801256 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33b0d0c0-e0a5-4751-a24c-4d4e36d64c6a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:46.805942 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33b0d0c0-e0a5-4751-a24c-4d4e36d64c6a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:46.806729 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33b0d0c0-e0a5-4751-a24c-4d4e36d64c6a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:46.815184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c253fcf-9a2e-48bb-940e-5b6abedd104d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:46.824759 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c253fcf-9a2e-48bb-940e-5b6abedd104d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:46.826012 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c253fcf-9a2e-48bb-940e-5b6abedd104d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:46.826706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c253fcf-9a2e-48bb-940e-5b6abedd104d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:46.854111 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:47.188861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-33b0d0c0-e0a5-4751-a24c-4d4e36d64c6a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:47.202026 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-33b0d0c0-e0a5-4751-a24c-4d4e36d64c6a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1523 microversion: 2.1 time: 0.439580 Jul 31 01:26:47.204496 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1882/3730] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:46 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1523 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:47.210544 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eb42edac-9e96-4245-938e-031a63e6ae77 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:47.211616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eb42edac-9e96-4245-938e-031a63e6ae77 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:47.225930 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3c253fcf-9a2e-48bb-940e-5b6abedd104d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:47.235693 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb42edac-9e96-4245-938e-031a63e6ae77 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:47.238087 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb42edac-9e96-4245-938e-031a63e6ae77 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:47.238970 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3c253fcf-9a2e-48bb-940e-5b6abedd104d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1325 microversion: 2.1 time: 0.447310 Jul 31 01:26:47.240101 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb42edac-9e96-4245-938e-031a63e6ae77 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:47.240946 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1849/3731] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:46 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1325 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:47.241643 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb42edac-9e96-4245-938e-031a63e6ae77 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:47.387922 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eb42edac-9e96-4245-938e-031a63e6ae77 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:47.405061 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eb42edac-9e96-4245-938e-031a63e6ae77 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:47.421206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eb42edac-9e96-4245-938e-031a63e6ae77 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:47.422980 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eb42edac-9e96-4245-938e-031a63e6ae77 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1365 microversion: 2.47 time: 0.217066 Jul 31 01:26:47.431744 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1883/3732] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:47 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:47.776452 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bdeb11b5-60cc-4be5-a540-37316eb98f4f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:47.778860 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bdeb11b5-60cc-4be5-a540-37316eb98f4f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:47.814731 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c429f901-f2ec-4edf-bc32-589f9398cb19 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:47.815388 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c429f901-f2ec-4edf-bc32-589f9398cb19 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:47.827937 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bdeb11b5-60cc-4be5-a540-37316eb98f4f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:47.828522 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bdeb11b5-60cc-4be5-a540-37316eb98f4f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:47.829379 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bdeb11b5-60cc-4be5-a540-37316eb98f4f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:47.829827 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bdeb11b5-60cc-4be5-a540-37316eb98f4f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:47.842737 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c429f901-f2ec-4edf-bc32-589f9398cb19 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:47.843367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c429f901-f2ec-4edf-bc32-589f9398cb19 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:47.847744 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c429f901-f2ec-4edf-bc32-589f9398cb19 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:47.849299 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c429f901-f2ec-4edf-bc32-589f9398cb19 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:48.738002 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bdeb11b5-60cc-4be5-a540-37316eb98f4f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:48.748208 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bdeb11b5-60cc-4be5-a540-37316eb98f4f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 0.984062 Jul 31 01:26:48.755135 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1850/3733] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:47 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:48.778901 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2b964c03-9776-4a10-aba7-6605e770eb6e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:48.783166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2b964c03-9776-4a10-aba7-6605e770eb6e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:48.802423 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b964c03-9776-4a10-aba7-6605e770eb6e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:48.803270 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b964c03-9776-4a10-aba7-6605e770eb6e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:48.813802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b964c03-9776-4a10-aba7-6605e770eb6e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:48.814682 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b964c03-9776-4a10-aba7-6605e770eb6e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:49.019127 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c429f901-f2ec-4edf-bc32-589f9398cb19 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:49.026862 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c429f901-f2ec-4edf-bc32-589f9398cb19 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1509 microversion: 2.1 time: 1.218209 Jul 31 01:26:49.035714 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1884/3734] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:47 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1509 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:26:49.042858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bd4b61af-9213-4b4e-84eb-e068229feebc tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:49.043436 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bd4b61af-9213-4b4e-84eb-e068229feebc tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:49.062648 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd4b61af-9213-4b4e-84eb-e068229feebc tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:49.063278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd4b61af-9213-4b4e-84eb-e068229feebc tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:49.064232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd4b61af-9213-4b4e-84eb-e068229feebc tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:49.066160 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd4b61af-9213-4b4e-84eb-e068229feebc tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:49.339920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2b964c03-9776-4a10-aba7-6605e770eb6e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:49.348553 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2b964c03-9776-4a10-aba7-6605e770eb6e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1523 microversion: 2.1 time: 0.579808 Jul 31 01:26:49.352820 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1851/3735] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:48 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1523 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:49.392892 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8ed9ec2d-0eb9-4d94-8a82-c954a301bfc9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:49.394020 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8ed9ec2d-0eb9-4d94-8a82-c954a301bfc9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:49.414033 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ed9ec2d-0eb9-4d94-8a82-c954a301bfc9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:49.415133 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ed9ec2d-0eb9-4d94-8a82-c954a301bfc9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:49.417512 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ed9ec2d-0eb9-4d94-8a82-c954a301bfc9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:49.420557 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ed9ec2d-0eb9-4d94-8a82-c954a301bfc9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:49.452174 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bd4b61af-9213-4b4e-84eb-e068229feebc tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:49.478196 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bd4b61af-9213-4b4e-84eb-e068229feebc tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1325 microversion: 2.1 time: 0.434777 Jul 31 01:26:49.485904 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1885/3736] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:49 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1325 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:49.494996 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-26acd396-5fb6-4854-9f85-7465ac3e1b28 req-e6b38ae8-bbb2-4b12-be72-0b9d9934732e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f6a6f7-53a0-437a-a0aa-2cf71c4e606f", "name": "network-vif-plugged", "status": "completed", "tag": "82a98ea3-f93d-41d8-b248-0935fed4bcb0"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:49.511917 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-26acd396-5fb6-4854-9f85-7465ac3e1b28 req-e6b38ae8-bbb2-4b12-be72-0b9d9934732e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:49.512545 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-26acd396-5fb6-4854-9f85-7465ac3e1b28 req-e6b38ae8-bbb2-4b12-be72-0b9d9934732e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:49.529100 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-26acd396-5fb6-4854-9f85-7465ac3e1b28 req-e6b38ae8-bbb2-4b12-be72-0b9d9934732e service nova] Creating event network-vif-plugged:82a98ea3-f93d-41d8-b248-0935fed4bcb0 for instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f on n-h1-master-1 Jul 31 01:26:49.537117 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-26acd396-5fb6-4854-9f85-7465ac3e1b28 req-e6b38ae8-bbb2-4b12-be72-0b9d9934732e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049747 Jul 31 01:26:49.537993 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1886/3737] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:26:49.613899 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8ed9ec2d-0eb9-4d94-8a82-c954a301bfc9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:49.623730 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8ed9ec2d-0eb9-4d94-8a82-c954a301bfc9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:49.625776 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8ed9ec2d-0eb9-4d94-8a82-c954a301bfc9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:49.627277 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8ed9ec2d-0eb9-4d94-8a82-c954a301bfc9 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1365 microversion: 2.47 time: 0.272272 Jul 31 01:26:49.629663 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1852/3738] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:49 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:49.779673 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-01ef15f3-a2b4-485b-920c-537b7283f962 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:49.780444 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-01ef15f3-a2b4-485b-920c-537b7283f962 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:49.787906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01ef15f3-a2b4-485b-920c-537b7283f962 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:49.797049 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01ef15f3-a2b4-485b-920c-537b7283f962 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:49.798149 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01ef15f3-a2b4-485b-920c-537b7283f962 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:49.798671 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01ef15f3-a2b4-485b-920c-537b7283f962 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:50.063167 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3c0e1227-9e3a-460a-a4e5-bcfdbc5a10ee tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:50.064080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3c0e1227-9e3a-460a-a4e5-bcfdbc5a10ee tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:50.082925 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c0e1227-9e3a-460a-a4e5-bcfdbc5a10ee tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:50.084829 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c0e1227-9e3a-460a-a4e5-bcfdbc5a10ee tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:50.087004 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c0e1227-9e3a-460a-a4e5-bcfdbc5a10ee tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:50.090999 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c0e1227-9e3a-460a-a4e5-bcfdbc5a10ee tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:50.476617 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3c0e1227-9e3a-460a-a4e5-bcfdbc5a10ee tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:50.489390 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3c0e1227-9e3a-460a-a4e5-bcfdbc5a10ee tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1509 microversion: 2.1 time: 0.434342 Jul 31 01:26:50.490511 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1853/3739] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:50 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1509 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:50.497622 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-32480769-bfa0-4797-ba43-eadb7d678148 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:50.498605 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-32480769-bfa0-4797-ba43-eadb7d678148 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:50.507135 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-32480769-bfa0-4797-ba43-eadb7d678148 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:50.508135 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-32480769-bfa0-4797-ba43-eadb7d678148 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:50.510136 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-32480769-bfa0-4797-ba43-eadb7d678148 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:50.510789 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-32480769-bfa0-4797-ba43-eadb7d678148 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:50.734385 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-01ef15f3-a2b4-485b-920c-537b7283f962 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:50.746318 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-01ef15f3-a2b4-485b-920c-537b7283f962 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 0.972200 Jul 31 01:26:50.751751 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1887/3740] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:49 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:50.752416 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-397ad719-dec2-4ea6-b499-e5f3fe113185 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:50.760440 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-397ad719-dec2-4ea6-b499-e5f3fe113185 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:50.769501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-397ad719-dec2-4ea6-b499-e5f3fe113185 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:50.774431 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-397ad719-dec2-4ea6-b499-e5f3fe113185 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:50.776026 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-397ad719-dec2-4ea6-b499-e5f3fe113185 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:50.780280 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-397ad719-dec2-4ea6-b499-e5f3fe113185 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:50.980835 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-32480769-bfa0-4797-ba43-eadb7d678148 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:50.989139 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-32480769-bfa0-4797-ba43-eadb7d678148 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1523 microversion: 2.1 time: 0.497335 Jul 31 01:26:51.004268 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1854/3741] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:50 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1523 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:51.010095 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4d6bc94a-4361-4960-b63f-db5e98d201a2 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:51.011088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4d6bc94a-4361-4960-b63f-db5e98d201a2 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:51.018216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d6bc94a-4361-4960-b63f-db5e98d201a2 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:51.018868 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d6bc94a-4361-4960-b63f-db5e98d201a2 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:51.020333 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d6bc94a-4361-4960-b63f-db5e98d201a2 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:51.021005 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d6bc94a-4361-4960-b63f-db5e98d201a2 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:51.096080 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-397ad719-dec2-4ea6-b499-e5f3fe113185 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:51.106142 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-397ad719-dec2-4ea6-b499-e5f3fe113185 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1325 microversion: 2.1 time: 0.357360 Jul 31 01:26:51.110953 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1888/3742] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:50 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1325 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:51.169239 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4d6bc94a-4361-4960-b63f-db5e98d201a2 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:51.180456 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4d6bc94a-4361-4960-b63f-db5e98d201a2 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:51.182384 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4d6bc94a-4361-4960-b63f-db5e98d201a2 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:51.189252 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4d6bc94a-4361-4960-b63f-db5e98d201a2 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1365 microversion: 2.47 time: 0.183527 Jul 31 01:26:51.190359 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1855/3743] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:51 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:51.518338 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9d141cd9-f5e7-49fa-afa3-e3c92f1fcbaf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:51.519272 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9d141cd9-f5e7-49fa-afa3-e3c92f1fcbaf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:51.528575 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d141cd9-f5e7-49fa-afa3-e3c92f1fcbaf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:51.530360 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d141cd9-f5e7-49fa-afa3-e3c92f1fcbaf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:51.531544 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d141cd9-f5e7-49fa-afa3-e3c92f1fcbaf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:51.532610 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d141cd9-f5e7-49fa-afa3-e3c92f1fcbaf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:51.769358 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a63bb984-7888-4fd4-b70c-fedd809a17a1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:51.770465 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a63bb984-7888-4fd4-b70c-fedd809a17a1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:51.778464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a63bb984-7888-4fd4-b70c-fedd809a17a1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:51.779277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a63bb984-7888-4fd4-b70c-fedd809a17a1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:51.784785 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a63bb984-7888-4fd4-b70c-fedd809a17a1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:51.785516 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a63bb984-7888-4fd4-b70c-fedd809a17a1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:51.835709 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9d141cd9-f5e7-49fa-afa3-e3c92f1fcbaf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:51.845371 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9d141cd9-f5e7-49fa-afa3-e3c92f1fcbaf tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1506 microversion: 2.1 time: 0.333701 Jul 31 01:26:51.846151 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1889/3744] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:51 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:52.015382 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7383d52c-7492-4814-abc5-7721c5278ff6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:52.016444 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7383d52c-7492-4814-abc5-7721c5278ff6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:52.025490 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7383d52c-7492-4814-abc5-7721c5278ff6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:52.025996 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7383d52c-7492-4814-abc5-7721c5278ff6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:52.026794 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7383d52c-7492-4814-abc5-7721c5278ff6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:52.027237 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7383d52c-7492-4814-abc5-7721c5278ff6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:52.153750 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a63bb984-7888-4fd4-b70c-fedd809a17a1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:52.171125 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a63bb984-7888-4fd4-b70c-fedd809a17a1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 0.406241 Jul 31 01:26:52.171791 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1856/3745] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:51 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:26:52.188123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-862c163b-4eea-4bdd-ba01-abe1620cf6b6 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:52.188771 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-862c163b-4eea-4bdd-ba01-abe1620cf6b6 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:52.202573 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-862c163b-4eea-4bdd-ba01-abe1620cf6b6 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:52.203153 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-862c163b-4eea-4bdd-ba01-abe1620cf6b6 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:52.204592 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-862c163b-4eea-4bdd-ba01-abe1620cf6b6 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:52.207771 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-862c163b-4eea-4bdd-ba01-abe1620cf6b6 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:52.229170 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:52.887863 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7383d52c-7492-4814-abc5-7721c5278ff6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:52.896379 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7383d52c-7492-4814-abc5-7721c5278ff6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1523 microversion: 2.1 time: 0.887847 Jul 31 01:26:52.897217 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1890/3746] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:52 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1523 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:26:52.904109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-13a03354-1a60-4c6e-8011-197f0055dea8 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:52.904971 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-13a03354-1a60-4c6e-8011-197f0055dea8 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:52.917287 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13a03354-1a60-4c6e-8011-197f0055dea8 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:52.918021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13a03354-1a60-4c6e-8011-197f0055dea8 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:52.919038 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13a03354-1a60-4c6e-8011-197f0055dea8 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:52.919689 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13a03354-1a60-4c6e-8011-197f0055dea8 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:53.080244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-13a03354-1a60-4c6e-8011-197f0055dea8 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:53.090023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-13a03354-1a60-4c6e-8011-197f0055dea8 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:53.091667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-13a03354-1a60-4c6e-8011-197f0055dea8 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:53.093676 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-13a03354-1a60-4c6e-8011-197f0055dea8 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1365 microversion: 2.47 time: 0.194969 Jul 31 01:26:53.094530 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1891/3747] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:52 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:53.100383 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-48237171-fb6f-45b7-a983-fc8b49e2f755 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:53.101235 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-48237171-fb6f-45b7-a983-fc8b49e2f755 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:53.111899 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48237171-fb6f-45b7-a983-fc8b49e2f755 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:53.112628 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48237171-fb6f-45b7-a983-fc8b49e2f755 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:53.114149 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48237171-fb6f-45b7-a983-fc8b49e2f755 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:53.114781 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48237171-fb6f-45b7-a983-fc8b49e2f755 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:53.150963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-862c163b-4eea-4bdd-ba01-abe1620cf6b6 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:53.168601 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-862c163b-4eea-4bdd-ba01-abe1620cf6b6 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1521 microversion: 2.1 time: 0.995663 Jul 31 01:26:53.171525 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1857/3748] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:52 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1521 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:53.193647 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b5a63277-b94b-40d5-9537-7f692f00f345 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:53.194425 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b5a63277-b94b-40d5-9537-7f692f00f345 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:53.203112 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5a63277-b94b-40d5-9537-7f692f00f345 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:53.203954 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5a63277-b94b-40d5-9537-7f692f00f345 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:53.205171 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5a63277-b94b-40d5-9537-7f692f00f345 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:53.205885 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5a63277-b94b-40d5-9537-7f692f00f345 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:53.640815 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-48237171-fb6f-45b7-a983-fc8b49e2f755 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:53.649741 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-48237171-fb6f-45b7-a983-fc8b49e2f755 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1506 microversion: 2.1 time: 0.553572 Jul 31 01:26:53.651549 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1892/3749] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:53 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:53.657857 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-be0bc54c-b01a-4b04-a612-554b6fdc3014 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:53.658888 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-be0bc54c-b01a-4b04-a612-554b6fdc3014 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:53.667249 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be0bc54c-b01a-4b04-a612-554b6fdc3014 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:53.668119 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be0bc54c-b01a-4b04-a612-554b6fdc3014 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:53.669132 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be0bc54c-b01a-4b04-a612-554b6fdc3014 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:53.669795 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be0bc54c-b01a-4b04-a612-554b6fdc3014 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:53.710982 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b5a63277-b94b-40d5-9537-7f692f00f345 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:53.720093 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b5a63277-b94b-40d5-9537-7f692f00f345 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 0.531080 Jul 31 01:26:53.736867 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1858/3750] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:53 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:26:53.920182 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c4d08dcc-8762-4f59-8def-03246a8b2cad tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:53.920731 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c4d08dcc-8762-4f59-8def-03246a8b2cad tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:53.936575 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4d08dcc-8762-4f59-8def-03246a8b2cad tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:53.937922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4d08dcc-8762-4f59-8def-03246a8b2cad tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:53.941181 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4d08dcc-8762-4f59-8def-03246a8b2cad tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:53.941646 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4d08dcc-8762-4f59-8def-03246a8b2cad tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:54.107763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-be0bc54c-b01a-4b04-a612-554b6fdc3014 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:54.115317 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-be0bc54c-b01a-4b04-a612-554b6fdc3014 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1521 microversion: 2.1 time: 0.462471 Jul 31 01:26:54.116047 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1893/3751] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:53 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1521 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:54.130710 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b2c024af-f01a-498c-abee-b4a91970c7c1 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:54.131581 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b2c024af-f01a-498c-abee-b4a91970c7c1 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:54.139389 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b2c024af-f01a-498c-abee-b4a91970c7c1 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:54.143825 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b2c024af-f01a-498c-abee-b4a91970c7c1 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:54.145031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b2c024af-f01a-498c-abee-b4a91970c7c1 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:54.151904 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b2c024af-f01a-498c-abee-b4a91970c7c1 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:54.316912 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b2c024af-f01a-498c-abee-b4a91970c7c1 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:54.332503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b2c024af-f01a-498c-abee-b4a91970c7c1 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:54.340444 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b2c024af-f01a-498c-abee-b4a91970c7c1 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:54.346377 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b2c024af-f01a-498c-abee-b4a91970c7c1 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1365 microversion: 2.47 time: 0.218994 Jul 31 01:26:54.360303 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1894/3752] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:54 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:26:54.383376 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-abf0a4d7-ce44-4919-8132-518542d9eba5 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1600001933", "metadata": {"": ""}}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-abf0a4d7-ce44-4919-8132-518542d9eba5 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Request method failure captured: Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f/action HTTP/1.1 Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 107 Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5do_qvGtrm8MFTSKrTw8R7jgmTzyETsET8_Bks35mozq5SQhUaDIA0oib2wHXXTKsc9AVPMwnRA1N8ACvVn62cvXmTWUR5or87UcB5lhe7JDpnHvkxRMhg6Zlak4K6e0-cQsqquMOz1g27fd3AjZnreZQbV510uuuf140sds5ry5cxM Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c609eaf96fc84008b10c26b3f56edd69", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: df0850646f5b4fdeabc4d50297626e27 Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1600001933", "metadata": {"": ""}}} Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '47f6a6f7-53a0-437a-a0aa-2cf71c4e606f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1600001933', 'metadata': {'': ''}}}} Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'': ''} Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:26:54.388691 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:26:54.393401 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:26:54.393401 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:26:54.393401 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:26:54.393401 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:26:54.393401 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:26:54.393401 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:26:54.393401 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:26:54.393401 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:26:54.393401 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:26:54.393401 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:26:54.393401 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:26:54.393401 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:26:54.393401 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:26:54.393401 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:26:54.393401 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:26:54.393401 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:26:54.399659 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-abf0a4d7-ce44-4919-8132-518542d9eba5 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:26:54.400757 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-abf0a4d7-ce44-4919-8132-518542d9eba5 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "POST /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f/action" status: 400 len: 170 microversion: 2.1 time: 0.028538 Jul 31 01:26:54.401971 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1895/3753] 10.222.0.45 () {60 vars in 1279 bytes} [Sun Jul 31 01:26:54 2022] POST /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f/action => generated 170 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:26:54.412798 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4c924536-3c14-46d0-a127-00d7bc7146cd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:54.416160 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4c924536-3c14-46d0-a127-00d7bc7146cd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:54.431844 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c924536-3c14-46d0-a127-00d7bc7146cd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:54.432439 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c924536-3c14-46d0-a127-00d7bc7146cd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:54.433402 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c924536-3c14-46d0-a127-00d7bc7146cd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:54.433857 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c924536-3c14-46d0-a127-00d7bc7146cd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:54.438697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c4d08dcc-8762-4f59-8def-03246a8b2cad tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:54.468046 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c4d08dcc-8762-4f59-8def-03246a8b2cad tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1523 microversion: 2.1 time: 0.551478 Jul 31 01:26:54.471385 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1859/3754] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:53 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1523 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:26:54.685427 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f42062dc-aa23-4fd4-b958-1864f8c3e97e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:54.687012 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f42062dc-aa23-4fd4-b958-1864f8c3e97e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:54.728239 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f42062dc-aa23-4fd4-b958-1864f8c3e97e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:54.732334 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f42062dc-aa23-4fd4-b958-1864f8c3e97e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:54.740721 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f42062dc-aa23-4fd4-b958-1864f8c3e97e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:54.741489 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f42062dc-aa23-4fd4-b958-1864f8c3e97e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:54.878809 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4c924536-3c14-46d0-a127-00d7bc7146cd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:54.897164 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4c924536-3c14-46d0-a127-00d7bc7146cd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1521 microversion: 2.1 time: 0.490583 Jul 31 01:26:54.919168 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1896/3755] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:54 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:26:54.923960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e67fec9-a58c-42ad-9c8a-0fdfc4391306 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:54.924584 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3e67fec9-a58c-42ad-9c8a-0fdfc4391306 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:54.955489 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e67fec9-a58c-42ad-9c8a-0fdfc4391306 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:54.956709 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e67fec9-a58c-42ad-9c8a-0fdfc4391306 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:54.957984 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e67fec9-a58c-42ad-9c8a-0fdfc4391306 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:54.957984 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e67fec9-a58c-42ad-9c8a-0fdfc4391306 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:55.270335 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f42062dc-aa23-4fd4-b958-1864f8c3e97e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:55.278633 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f42062dc-aa23-4fd4-b958-1864f8c3e97e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 200 len: 1509 microversion: 2.1 time: 0.603335 Jul 31 01:26:55.291740 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1860/3756] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:54 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 1509 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:55.300019 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ecf34222-a766-4044-accd-1d4a7d647b02 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:55.300784 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ecf34222-a766-4044-accd-1d4a7d647b02 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:55.307367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecf34222-a766-4044-accd-1d4a7d647b02 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:55.308494 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecf34222-a766-4044-accd-1d4a7d647b02 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:55.309664 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecf34222-a766-4044-accd-1d4a7d647b02 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:55.310312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecf34222-a766-4044-accd-1d4a7d647b02 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:55.337082 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e67fec9-a58c-42ad-9c8a-0fdfc4391306 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:55.346920 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3e67fec9-a58c-42ad-9c8a-0fdfc4391306 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 0.426674 Jul 31 01:26:55.351091 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1897/3757] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:54 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:55.357323 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d784d47f-9858-4e56-b5ab-4d33110ed7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:55.357888 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d784d47f-9858-4e56-b5ab-4d33110ed7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:55.375382 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d784d47f-9858-4e56-b5ab-4d33110ed7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:55.377343 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d784d47f-9858-4e56-b5ab-4d33110ed7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:55.378228 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d784d47f-9858-4e56-b5ab-4d33110ed7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:55.379694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d784d47f-9858-4e56-b5ab-4d33110ed7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:55.692842 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ecf34222-a766-4044-accd-1d4a7d647b02 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:55.696526 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d784d47f-9858-4e56-b5ab-4d33110ed7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:55.709472 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ecf34222-a766-4044-accd-1d4a7d647b02 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1521 microversion: 2.1 time: 0.416325 Jul 31 01:26:55.711457 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d784d47f-9858-4e56-b5ab-4d33110ed7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.359087 Jul 31 01:26:55.712483 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1861/3758] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:55 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:55.712824 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1898/3759] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:55 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:55.723657 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e61ec5d1-345a-4639-a8d8-3bb270ddca30 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:55.728828 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d2aea68d-b429-4659-825c-4b858f9f3a6e tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:55.730729 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e61ec5d1-345a-4639-a8d8-3bb270ddca30 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:55.741994 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d2aea68d-b429-4659-825c-4b858f9f3a6e tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:55.751839 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e61ec5d1-345a-4639-a8d8-3bb270ddca30 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:55.763860 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e61ec5d1-345a-4639-a8d8-3bb270ddca30 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:55.765069 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e61ec5d1-345a-4639-a8d8-3bb270ddca30 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:55.765963 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e61ec5d1-345a-4639-a8d8-3bb270ddca30 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:55.769625 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2aea68d-b429-4659-825c-4b858f9f3a6e tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:55.770182 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2aea68d-b429-4659-825c-4b858f9f3a6e tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:55.772420 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2aea68d-b429-4659-825c-4b858f9f3a6e tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:55.772420 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2aea68d-b429-4659-825c-4b858f9f3a6e tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:55.897406 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d2aea68d-b429-4659-825c-4b858f9f3a6e tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:55.911895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d2aea68d-b429-4659-825c-4b858f9f3a6e tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:55.913972 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d2aea68d-b429-4659-825c-4b858f9f3a6e tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:55.915637 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d2aea68d-b429-4659-825c-4b858f9f3a6e tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1365 microversion: 2.47 time: 0.191045 Jul 31 01:26:55.916823 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1862/3760] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:55 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:55.922114 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0a631c87-a1a9-404e-9126-b9c597635cc0 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2091760594", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0a631c87-a1a9-404e-9126-b9c597635cc0 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Request method failure captured: Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f/action HTTP/1.1 Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 619 Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5do_qvGtrm8MFTSKrTw8R7jgmTzyETsET8_Bks35mozq5SQhUaDIA0oib2wHXXTKsc9AVPMwnRA1N8ACvVn62cvXmTWUR5or87UcB5lhe7JDpnHvkxRMhg6Zlak4K6e0-cQsqquMOz1g27fd3AjZnreZQbV510uuuf140sds5ry5cxM Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c609eaf96fc84008b10c26b3f56edd69", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: df0850646f5b4fdeabc4d50297626e27 Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2091760594", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '47f6a6f7-53a0-437a-a0aa-2cf71c4e606f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2091760594', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:26:55.926890 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 31 01:26:55.929369 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:26:55.944620 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0a631c87-a1a9-404e-9126-b9c597635cc0 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:26:55.946638 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0a631c87-a1a9-404e-9126-b9c597635cc0 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "POST /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f/action" status: 400 len: 938 microversion: 2.1 time: 0.028067 Jul 31 01:26:55.950852 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1863/3761] 10.222.0.45 () {60 vars in 1279 bytes} [Sun Jul 31 01:26:55 2022] POST /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f/action => generated 938 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:26:55.957614 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ef025f8f-a712-4a0f-b4e5-c32474398b34 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:55.960224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ef025f8f-a712-4a0f-b4e5-c32474398b34 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:55.977741 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef025f8f-a712-4a0f-b4e5-c32474398b34 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:55.978450 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef025f8f-a712-4a0f-b4e5-c32474398b34 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:55.979414 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef025f8f-a712-4a0f-b4e5-c32474398b34 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:55.980157 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef025f8f-a712-4a0f-b4e5-c32474398b34 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:56.255071 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e61ec5d1-345a-4639-a8d8-3bb270ddca30 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:56.266878 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e61ec5d1-345a-4639-a8d8-3bb270ddca30 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1503 microversion: 2.1 time: 0.552842 Jul 31 01:26:56.272484 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1899/3762] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:55 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1503 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:56.281611 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-8cdeb6ef-2f54-4e84-9c05-200ab9e3930f req-3608a67d-34ee-4cec-9458-18839abcfb56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c981f91-b847-4b1b-a3c3-4edc7a9221c3", "name": "network-vif-unplugged", "status": "completed", "tag": "8dc1db04-4278-481c-8fb7-ab59e918dc37"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:56.312326 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8cdeb6ef-2f54-4e84-9c05-200ab9e3930f req-3608a67d-34ee-4cec-9458-18839abcfb56 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:56.312790 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8cdeb6ef-2f54-4e84-9c05-200ab9e3930f req-3608a67d-34ee-4cec-9458-18839abcfb56 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:56.325891 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.compute.server_external_events [req-8cdeb6ef-2f54-4e84-9c05-200ab9e3930f req-3608a67d-34ee-4cec-9458-18839abcfb56 service nova] Unable to find a host for instance 3c981f91-b847-4b1b-a3c3-4edc7a9221c3. Dropping event network-vif-unplugged {{(pid=119475) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 31 01:26:56.326899 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-8cdeb6ef-2f54-4e84-9c05-200ab9e3930f req-3608a67d-34ee-4cec-9458-18839abcfb56 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.053165 Jul 31 01:26:56.327900 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1900/3763] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 31 01:26:56.341248 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f3981ec5-ec51-4c9c-a8dc-60c398d0061e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:56.343064 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f3981ec5-ec51-4c9c-a8dc-60c398d0061e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:56.357178 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3981ec5-ec51-4c9c-a8dc-60c398d0061e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:56.359253 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3981ec5-ec51-4c9c-a8dc-60c398d0061e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:56.361367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3981ec5-ec51-4c9c-a8dc-60c398d0061e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:56.362071 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3981ec5-ec51-4c9c-a8dc-60c398d0061e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:56.373694 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ef025f8f-a712-4a0f-b4e5-c32474398b34 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:56.388212 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ef025f8f-a712-4a0f-b4e5-c32474398b34 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.435822 Jul 31 01:26:56.389764 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:56.409790 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1864/3764] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:55 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:56.416039 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fd570f35-311b-48cc-a205-4c417191aaaf tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Action: 'create', calling method: .version_select at 0x7fede451e9d0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1103130491", "description": "tempest-description-512360725"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:56.862102 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f3981ec5-ec51-4c9c-a8dc-60c398d0061e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:56.876818 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f3981ec5-ec51-4c9c-a8dc-60c398d0061e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1521 microversion: 2.1 time: 0.542414 Jul 31 01:26:56.892080 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1901/3765] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:56 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1521 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:56.900216 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ede2bf12-0056-4660-b098-1184eb79264e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:56.900840 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ede2bf12-0056-4660-b098-1184eb79264e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:56.909398 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ede2bf12-0056-4660-b098-1184eb79264e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:56.910220 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ede2bf12-0056-4660-b098-1184eb79264e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:56.911205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ede2bf12-0056-4660-b098-1184eb79264e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:56.911974 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ede2bf12-0056-4660-b098-1184eb79264e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:57.018496 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fd570f35-311b-48cc-a205-4c417191aaaf tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.607009 Jul 31 01:26:57.019090 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1865/3766] 10.222.0.45 () {60 vars in 1180 bytes} [Sun Jul 31 01:26:56 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:26:57.023916 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c92c9de3-9bd5-4cb3-8ef6-895be317d208 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:57.024828 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c92c9de3-9bd5-4cb3-8ef6-895be317d208 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:57.032266 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c92c9de3-9bd5-4cb3-8ef6-895be317d208 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:57.032929 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c92c9de3-9bd5-4cb3-8ef6-895be317d208 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:57.034041 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c92c9de3-9bd5-4cb3-8ef6-895be317d208 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:57.034698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c92c9de3-9bd5-4cb3-8ef6-895be317d208 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:57.678429 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ede2bf12-0056-4660-b098-1184eb79264e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:57.688552 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ede2bf12-0056-4660-b098-1184eb79264e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 0.795223 Jul 31 01:26:57.703254 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1902/3767] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:56 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:57.708471 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d3a0c90d-60cd-4ce0-bdd0-21ea3b2af788 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:57.709392 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d3a0c90d-60cd-4ce0-bdd0-21ea3b2af788 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:57.716471 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3a0c90d-60cd-4ce0-bdd0-21ea3b2af788 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:57.717064 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3a0c90d-60cd-4ce0-bdd0-21ea3b2af788 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:57.717955 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3a0c90d-60cd-4ce0-bdd0-21ea3b2af788 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:57.718501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3a0c90d-60cd-4ce0-bdd0-21ea3b2af788 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:57.771502 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c92c9de3-9bd5-4cb3-8ef6-895be317d208 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:57.784656 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c92c9de3-9bd5-4cb3-8ef6-895be317d208 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.764483 Jul 31 01:26:57.791082 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1866/3768] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:57 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:57.799951 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2b474a38-b388-4fe4-b96f-8cdb0f854567 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:57.804204 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2b474a38-b388-4fe4-b96f-8cdb0f854567 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:57.812376 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=76 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:57.826610 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b474a38-b388-4fe4-b96f-8cdb0f854567 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:57.828231 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b474a38-b388-4fe4-b96f-8cdb0f854567 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:57.831493 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b474a38-b388-4fe4-b96f-8cdb0f854567 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:57.832557 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b474a38-b388-4fe4-b96f-8cdb0f854567 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:58.017327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2b474a38-b388-4fe4-b96f-8cdb0f854567 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:58.032709 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2b474a38-b388-4fe4-b96f-8cdb0f854567 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:58.034362 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2b474a38-b388-4fe4-b96f-8cdb0f854567 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:58.035699 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2b474a38-b388-4fe4-b96f-8cdb0f854567 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1365 microversion: 2.47 time: 0.243304 Jul 31 01:26:58.036272 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1867/3769] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:57 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:58.051436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-399d69bc-625f-47a6-94e8-6c60eb7553ab tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1103130491"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:58.051971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-399d69bc-625f-47a6-94e8-6c60eb7553ab tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:58.064820 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-399d69bc-625f-47a6-94e8-6c60eb7553ab tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:58.065265 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-399d69bc-625f-47a6-94e8-6c60eb7553ab tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:58.066082 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-399d69bc-625f-47a6-94e8-6c60eb7553ab tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:58.066756 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-399d69bc-625f-47a6-94e8-6c60eb7553ab tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:58.081593 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d3a0c90d-60cd-4ce0-bdd0-21ea3b2af788 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:58.097087 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d3a0c90d-60cd-4ce0-bdd0-21ea3b2af788 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1521 microversion: 2.1 time: 0.392310 Jul 31 01:26:58.113292 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1903/3770] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:57 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:58.117680 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bdf88a0c-84dc-49ae-bb4a-fb90ef5f6e0b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:58.127983 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bdf88a0c-84dc-49ae-bb4a-fb90ef5f6e0b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:58.141507 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdf88a0c-84dc-49ae-bb4a-fb90ef5f6e0b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:58.142243 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdf88a0c-84dc-49ae-bb4a-fb90ef5f6e0b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:58.143217 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdf88a0c-84dc-49ae-bb4a-fb90ef5f6e0b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:58.143874 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdf88a0c-84dc-49ae-bb4a-fb90ef5f6e0b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:58.543847 n-d-master-1 devstack@n-api.service[119474]: INFO nova.network.security_group_api [None req-399d69bc-625f-47a6-94e8-6c60eb7553ab tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Adding security group a16c6ff4-57a8-432b-981b-fe2bec2358e0 to port d4f63d82-0064-4811-bcb1-b78632f9ea21 Jul 31 01:26:58.757183 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bdf88a0c-84dc-49ae-bb4a-fb90ef5f6e0b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:58.772179 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bdf88a0c-84dc-49ae-bb4a-fb90ef5f6e0b tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.672887 Jul 31 01:26:58.774663 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1904/3771] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:58 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:58.805077 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2a1b2328-383b-447d-aa45-50d062d1311d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2a1b2328-383b-447d-aa45-50d062d1311d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Request method failure captured: Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f/action HTTP/1.1 Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 285 Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5do_qvGtrm8MFTSKrTw8R7jgmTzyETsET8_Bks35mozq5SQhUaDIA0oib2wHXXTKsc9AVPMwnRA1N8ACvVn62cvXmTWUR5or87UcB5lhe7JDpnHvkxRMhg6Zlak4K6e0-cQsqquMOz1g27fd3AjZnreZQbV510uuuf140sds5ry5cxM Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c609eaf96fc84008b10c26b3f56edd69", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: df0850646f5b4fdeabc4d50297626e27 Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '47f6a6f7-53a0-437a-a0aa-2cf71c4e606f', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:26:58.819324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 31 01:26:58.822298 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:26:58.831093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2a1b2328-383b-447d-aa45-50d062d1311d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:26:58.835406 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2a1b2328-383b-447d-aa45-50d062d1311d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "POST /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f/action" status: 400 len: 619 microversion: 2.1 time: 0.050872 Jul 31 01:26:58.839948 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1905/3772] 10.222.0.45 () {60 vars in 1279 bytes} [Sun Jul 31 01:26:58 2022] POST /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f/action => generated 619 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:26:58.856306 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-da7871f5-c68d-42ac-b4a9-b1d9761efe17 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:58.859837 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-da7871f5-c68d-42ac-b4a9-b1d9761efe17 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:58.881914 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da7871f5-c68d-42ac-b4a9-b1d9761efe17 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:58.883392 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da7871f5-c68d-42ac-b4a9-b1d9761efe17 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:58.887372 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da7871f5-c68d-42ac-b4a9-b1d9761efe17 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:58.888236 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da7871f5-c68d-42ac-b4a9-b1d9761efe17 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:59.279798 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-da7871f5-c68d-42ac-b4a9-b1d9761efe17 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:59.289226 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-da7871f5-c68d-42ac-b4a9-b1d9761efe17 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 0.446834 Jul 31 01:26:59.291611 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1906/3773] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:58 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:26:59.297238 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d7ee7059-573b-400b-8e63-52d3296d8753 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:26:59.308390 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7ee7059-573b-400b-8e63-52d3296d8753 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:59.309056 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7ee7059-573b-400b-8e63-52d3296d8753 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:59.349380 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d7ee7059-573b-400b-8e63-52d3296d8753 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Going to try to stop instance {{(pid=119475) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 01:26:59.444749 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d7ee7059-573b-400b-8e63-52d3296d8753 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 202 len: 0 microversion: 2.1 time: 0.151164 Jul 31 01:26:59.452326 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1907/3774] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:26:59 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:26:59.471699 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-47ceba25-808a-4f6e-9eec-fe6f8cf93704 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:59.473279 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-47ceba25-808a-4f6e-9eec-fe6f8cf93704 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:59.487754 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47ceba25-808a-4f6e-9eec-fe6f8cf93704 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:59.488351 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47ceba25-808a-4f6e-9eec-fe6f8cf93704 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:59.489274 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47ceba25-808a-4f6e-9eec-fe6f8cf93704 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:59.489849 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47ceba25-808a-4f6e-9eec-fe6f8cf93704 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:59.512346 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-399d69bc-625f-47a6-94e8-6c60eb7553ab tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "POST /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820/action" status: 202 len: 0 microversion: 2.1 time: 1.474654 Jul 31 01:26:59.513131 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1868/3775] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:26:58 2022] POST /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820/action => generated 0 bytes in 1476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:26:59.518143 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-26212572-b45a-4a69-83e9-989b92afc1dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:59.518858 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-26212572-b45a-4a69-83e9-989b92afc1dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:59.539227 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26212572-b45a-4a69-83e9-989b92afc1dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:59.540186 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26212572-b45a-4a69-83e9-989b92afc1dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:59.541120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26212572-b45a-4a69-83e9-989b92afc1dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:59.541820 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26212572-b45a-4a69-83e9-989b92afc1dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:59.734262 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-26212572-b45a-4a69-83e9-989b92afc1dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:59.754902 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-26212572-b45a-4a69-83e9-989b92afc1dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:59.759049 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-26212572-b45a-4a69-83e9-989b92afc1dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:26:59.806457 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-26212572-b45a-4a69-83e9-989b92afc1dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1371 microversion: 2.47 time: 0.290698 Jul 31 01:26:59.809469 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1869/3776] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:26:59 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:26:59.823967 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ddc7dd31-0423-4965-8e45-2356daae3ebe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:26:59.824874 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ddc7dd31-0423-4965-8e45-2356daae3ebe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:26:59.856636 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddc7dd31-0423-4965-8e45-2356daae3ebe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:59.865160 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddc7dd31-0423-4965-8e45-2356daae3ebe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:26:59.871031 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddc7dd31-0423-4965-8e45-2356daae3ebe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:26:59.871031 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddc7dd31-0423-4965-8e45-2356daae3ebe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:00.048378 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-47ceba25-808a-4f6e-9eec-fe6f8cf93704 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:00.061379 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-47ceba25-808a-4f6e-9eec-fe6f8cf93704 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1521 microversion: 2.1 time: 0.608525 Jul 31 01:27:00.076133 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1908/3777] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:59 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1521 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:00.087702 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-19b46545-f920-48ec-befc-23c6f2bb5db5 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1103130491"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:00.088625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-19b46545-f920-48ec-befc-23c6f2bb5db5 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:00.095968 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19b46545-f920-48ec-befc-23c6f2bb5db5 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:00.096726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19b46545-f920-48ec-befc-23c6f2bb5db5 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:00.097722 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19b46545-f920-48ec-befc-23c6f2bb5db5 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:00.098399 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19b46545-f920-48ec-befc-23c6f2bb5db5 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:00.293476 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ddc7dd31-0423-4965-8e45-2356daae3ebe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:00.301856 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ddc7dd31-0423-4965-8e45-2356daae3ebe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1680 microversion: 2.1 time: 0.489616 Jul 31 01:27:00.302442 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1870/3778] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:26:59 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1680 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:00.308603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e37c8f63-0d29-4056-8639-c79d833004eb req-bc317a6e-ffbe-4752-8fe8-214d20f512af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82c2878-c1d7-43a4-9b3e-38af00bda820", "tag": "d4f63d82-0064-4811-bcb1-b78632f9ea21"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:00.325972 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e37c8f63-0d29-4056-8639-c79d833004eb req-bc317a6e-ffbe-4752-8fe8-214d20f512af service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:00.326761 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e37c8f63-0d29-4056-8639-c79d833004eb req-bc317a6e-ffbe-4752-8fe8-214d20f512af service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:00.340108 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e37c8f63-0d29-4056-8639-c79d833004eb req-bc317a6e-ffbe-4752-8fe8-214d20f512af service nova] Creating event network-changed:d4f63d82-0064-4811-bcb1-b78632f9ea21 for instance b82c2878-c1d7-43a4-9b3e-38af00bda820 on n-h1-master-1 Jul 31 01:27:00.345627 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e37c8f63-0d29-4056-8639-c79d833004eb req-bc317a6e-ffbe-4752-8fe8-214d20f512af service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041799 Jul 31 01:27:00.346298 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1871/3779] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:00.352162 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e774ff99-3d28-4f62-9b90-a32ca0b7cecb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:00.352817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e774ff99-3d28-4f62-9b90-a32ca0b7cecb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:00.359688 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e774ff99-3d28-4f62-9b90-a32ca0b7cecb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:00.360150 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e774ff99-3d28-4f62-9b90-a32ca0b7cecb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:00.361207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e774ff99-3d28-4f62-9b90-a32ca0b7cecb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:00.361660 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e774ff99-3d28-4f62-9b90-a32ca0b7cecb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:00.548469 n-d-master-1 devstack@n-api.service[119475]: INFO nova.network.security_group_api [None req-19b46545-f920-48ec-befc-23c6f2bb5db5 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Removing security group a16c6ff4-57a8-432b-981b-fe2bec2358e0 from port d4f63d82-0064-4811-bcb1-b78632f9ea21 Jul 31 01:27:00.928052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e774ff99-3d28-4f62-9b90-a32ca0b7cecb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:00.939146 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e774ff99-3d28-4f62-9b90-a32ca0b7cecb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1521 microversion: 2.1 time: 0.591393 Jul 31 01:27:00.946584 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1872/3780] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:00 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1521 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:00.952056 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e4844674-3c35-43ae-9104-75a98601e1ef tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:00.957338 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e4844674-3c35-43ae-9104-75a98601e1ef tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:00.969519 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4844674-3c35-43ae-9104-75a98601e1ef tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:00.977031 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4844674-3c35-43ae-9104-75a98601e1ef tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:00.978206 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4844674-3c35-43ae-9104-75a98601e1ef tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:00.978827 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4844674-3c35-43ae-9104-75a98601e1ef tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:01.555915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e4844674-3c35-43ae-9104-75a98601e1ef tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:01.572850 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e4844674-3c35-43ae-9104-75a98601e1ef tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 0.622411 Jul 31 01:27:01.573290 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1873/3781] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:00 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:01.597449 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a26a8996-6471-4b0b-98b0-04748b2129a4 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:01.598256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a26a8996-6471-4b0b-98b0-04748b2129a4 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:01.601817 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-19b46545-f920-48ec-befc-23c6f2bb5db5 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "POST /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820/action" status: 202 len: 0 microversion: 2.1 time: 1.524056 Jul 31 01:27:01.603276 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1909/3782] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:27:00 2022] POST /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820/action => generated 0 bytes in 1526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:27:01.613148 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a26a8996-6471-4b0b-98b0-04748b2129a4 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:01.613756 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a26a8996-6471-4b0b-98b0-04748b2129a4 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:01.614553 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a26a8996-6471-4b0b-98b0-04748b2129a4 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:01.615054 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a26a8996-6471-4b0b-98b0-04748b2129a4 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:01.626179 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f0650a91-4584-4528-bd99-385d3f1afcf3 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1389171828"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:01.638430 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f0650a91-4584-4528-bd99-385d3f1afcf3 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:01.656950 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=92 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:01.661178 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0650a91-4584-4528-bd99-385d3f1afcf3 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:01.664510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0650a91-4584-4528-bd99-385d3f1afcf3 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:01.667706 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0650a91-4584-4528-bd99-385d3f1afcf3 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:01.673611 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0650a91-4584-4528-bd99-385d3f1afcf3 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:01.770935 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a26a8996-6471-4b0b-98b0-04748b2129a4 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:01.779839 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a26a8996-6471-4b0b-98b0-04748b2129a4 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:01.787270 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a26a8996-6471-4b0b-98b0-04748b2129a4 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:01.788872 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a26a8996-6471-4b0b-98b0-04748b2129a4 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1356 microversion: 2.47 time: 0.200678 Jul 31 01:27:01.792539 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1874/3783] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:27:01 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1356 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:27:01.804341 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2d0309ae-e4bf-49a8-af5b-86fc59af99b1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:01.805122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2d0309ae-e4bf-49a8-af5b-86fc59af99b1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:01.816858 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d0309ae-e4bf-49a8-af5b-86fc59af99b1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:01.817581 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d0309ae-e4bf-49a8-af5b-86fc59af99b1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:01.825424 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d0309ae-e4bf-49a8-af5b-86fc59af99b1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:01.826097 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d0309ae-e4bf-49a8-af5b-86fc59af99b1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:02.095568 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f0650a91-4584-4528-bd99-385d3f1afcf3 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "POST /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f/action" status: 202 len: 0 microversion: 2.1 time: 0.484586 Jul 31 01:27:02.096239 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1910/3784] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:27:01 2022] POST /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 31 01:27:02.113123 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c6d0b3be-d0d7-4ecd-8822-e4dc5908846a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Action: 'create', calling method: .version_select at 0x7fede4723280>, body: {"pool": null} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:02.565721 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2d0309ae-e4bf-49a8-af5b-86fc59af99b1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:02.588248 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2d0309ae-e4bf-49a8-af5b-86fc59af99b1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1680 microversion: 2.1 time: 0.794192 Jul 31 01:27:02.589167 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1875/3785] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:01 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1680 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:02.606911 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0e711d31-ac54-45c0-b1dd-b49c141eb546 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:02.613959 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e711d31-ac54-45c0-b1dd-b49c141eb546 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:02.615307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0e711d31-ac54-45c0-b1dd-b49c141eb546 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Searching by: {'deleted': False, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:27:02.623308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e711d31-ac54-45c0-b1dd-b49c141eb546 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:02.623979 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e711d31-ac54-45c0-b1dd-b49c141eb546 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:02.625308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e711d31-ac54-45c0-b1dd-b49c141eb546 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:02.625911 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e711d31-ac54-45c0-b1dd-b49c141eb546 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:02.778979 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-0e711d31-ac54-45c0-b1dd-b49c141eb546 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:27:02.794406 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:02.880229 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e711d31-ac54-45c0-b1dd-b49c141eb546 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:02.890197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e711d31-ac54-45c0-b1dd-b49c141eb546 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:02.890816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e711d31-ac54-45c0-b1dd-b49c141eb546 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:02.906855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e711d31-ac54-45c0-b1dd-b49c141eb546 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:02.907702 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e711d31-ac54-45c0-b1dd-b49c141eb546 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:03.012844 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0e711d31-ac54-45c0-b1dd-b49c141eb546 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.421640 Jul 31 01:27:03.034786 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1876/3786] 10.222.0.45 () {60 vars in 1187 bytes} [Sun Jul 31 01:27:02 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:27:03.040270 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0991621f-7eab-45e1-808b-ae9a4b491a66 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2050024400"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:03.048886 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0991621f-7eab-45e1-808b-ae9a4b491a66 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:03.058939 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0991621f-7eab-45e1-808b-ae9a4b491a66 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:03.060883 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0991621f-7eab-45e1-808b-ae9a4b491a66 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:03.062356 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0991621f-7eab-45e1-808b-ae9a4b491a66 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:03.063035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0991621f-7eab-45e1-808b-ae9a4b491a66 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:03.128347 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-0991621f-7eab-45e1-808b-ae9a4b491a66 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] HTTP exception thrown: Cannot 'createImage' instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f while it is in task_state image_snapshot Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0991621f-7eab-45e1-808b-ae9a4b491a66 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Request method failure captured: Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f/action HTTP/1.1 Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 85 Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5do_qvGtrm8MFTSKrTw8R7jgmTzyETsET8_Bks35mozq5SQhUaDIA0oib2wHXXTKsc9AVPMwnRA1N8ACvVn62cvXmTWUR5or87UcB5lhe7JDpnHvkxRMhg6Zlak4K6e0-cQsqquMOz1g27fd3AjZnreZQbV510uuuf140sds5ry5cxM Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c609eaf96fc84008b10c26b3f56edd69", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: df0850646f5b4fdeabc4d50297626e27 Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2050024400"}} Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: exception: Cannot 'createImage' instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f while it is in task_state image_snapshot Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '47f6a6f7-53a0-437a-a0aa-2cf71c4e606f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2050024400'}}} Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f in task_state image_snapshot. Cannot snapshot while the instance is in this state. Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 01:27:03.131305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f while it is in task_state image_snapshot Jul 31 01:27:03.139829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:03.139829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:03.139829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:03.139829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:03.139829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:03.139829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:03.139829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:27:03.139829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:27:03.139829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f while it is in task_state image_snapshot Jul 31 01:27:03.139829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:03.139829 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0991621f-7eab-45e1-808b-ae9a4b491a66 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Returning 409 to user: Cannot 'createImage' instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f while it is in task_state image_snapshot {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:27:03.139829 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0991621f-7eab-45e1-808b-ae9a4b491a66 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "POST /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f/action" status: 409 len: 159 microversion: 2.1 time: 0.102297 Jul 31 01:27:03.139829 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1877/3787] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:27:03 2022] POST /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f/action => generated 159 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:27:03.142571 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-f4354100-774b-4325-b8de-266502c7d6dc req-c357e0bc-ad24-41a5-82f5-0cb841acb432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82c2878-c1d7-43a4-9b3e-38af00bda820", "tag": "d4f63d82-0064-4811-bcb1-b78632f9ea21"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:03.153170 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f4354100-774b-4325-b8de-266502c7d6dc req-c357e0bc-ad24-41a5-82f5-0cb841acb432 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:03.153811 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f4354100-774b-4325-b8de-266502c7d6dc req-c357e0bc-ad24-41a5-82f5-0cb841acb432 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:03.171838 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-f4354100-774b-4325-b8de-266502c7d6dc req-c357e0bc-ad24-41a5-82f5-0cb841acb432 service nova] Creating event network-changed:d4f63d82-0064-4811-bcb1-b78632f9ea21 for instance b82c2878-c1d7-43a4-9b3e-38af00bda820 on n-h1-master-1 Jul 31 01:27:03.177396 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-f4354100-774b-4325-b8de-266502c7d6dc req-c357e0bc-ad24-41a5-82f5-0cb841acb432 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040164 Jul 31 01:27:03.178537 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1878/3788] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:03.184617 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0e504458-7067-4fda-a0b4-a1d14183b9f7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:03.185341 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0e504458-7067-4fda-a0b4-a1d14183b9f7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:03.192353 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e504458-7067-4fda-a0b4-a1d14183b9f7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:03.193491 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e504458-7067-4fda-a0b4-a1d14183b9f7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:03.194249 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e504458-7067-4fda-a0b4-a1d14183b9f7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:03.194707 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e504458-7067-4fda-a0b4-a1d14183b9f7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:03.615716 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e504458-7067-4fda-a0b4-a1d14183b9f7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:03.627860 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0e504458-7067-4fda-a0b4-a1d14183b9f7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 0.447849 Jul 31 01:27:03.643097 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1879/3789] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:03 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:03.650966 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e927385d-dc0f-4b6a-abdc-93590baa4506 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:03.651695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e927385d-dc0f-4b6a-abdc-93590baa4506 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:03.659830 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e927385d-dc0f-4b6a-abdc-93590baa4506 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:03.660605 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e927385d-dc0f-4b6a-abdc-93590baa4506 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:03.661594 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e927385d-dc0f-4b6a-abdc-93590baa4506 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:03.662287 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e927385d-dc0f-4b6a-abdc-93590baa4506 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:03.705626 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e927385d-dc0f-4b6a-abdc-93590baa4506 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:27:03.897629 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e927385d-dc0f-4b6a-abdc-93590baa4506 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 204 len: 0 microversion: 2.47 time: 0.252287 Jul 31 01:27:03.899826 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1880/3790] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:27:03 2022] DELETE /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:27:03.914722 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2b21f3ff-1520-4720-8ca0-a75e00d07196 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '.version_select at 0x7fede45a0d30>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:04.143235 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2b21f3ff-1520-4720-8ca0-a75e00d07196 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "DELETE /compute/v2.1/images/b47427f5-d5e3-495e-82ce-41359f0ba07d" status: 204 len: 0 microversion: 2.1 time: 0.241650 Jul 31 01:27:04.144020 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1881/3791] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:03 2022] DELETE /compute/v2.1/images/b47427f5-d5e3-495e-82ce-41359f0ba07d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:27:04.162121 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8d24ad70-3bf8-4522-a1bb-809d463dae67 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:04.163060 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8d24ad70-3bf8-4522-a1bb-809d463dae67 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:04.177901 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d24ad70-3bf8-4522-a1bb-809d463dae67 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:04.179815 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d24ad70-3bf8-4522-a1bb-809d463dae67 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:04.182234 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d24ad70-3bf8-4522-a1bb-809d463dae67 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:04.183124 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d24ad70-3bf8-4522-a1bb-809d463dae67 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:04.590439 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8d24ad70-3bf8-4522-a1bb-809d463dae67 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:04.601804 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8d24ad70-3bf8-4522-a1bb-809d463dae67 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1680 microversion: 2.1 time: 0.456541 Jul 31 01:27:04.602963 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1882/3792] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:04 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1680 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:04.615633 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d5956657-7d0f-4648-96fb-995353887ceb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:04.615633 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d5956657-7d0f-4648-96fb-995353887ceb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:04.637024 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5956657-7d0f-4648-96fb-995353887ceb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:04.637493 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5956657-7d0f-4648-96fb-995353887ceb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:04.638310 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5956657-7d0f-4648-96fb-995353887ceb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:04.638761 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5956657-7d0f-4648-96fb-995353887ceb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:04.789447 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d5956657-7d0f-4648-96fb-995353887ceb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:04.803247 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d5956657-7d0f-4648-96fb-995353887ceb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:04.806363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d5956657-7d0f-4648-96fb-995353887ceb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:04.808141 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d5956657-7d0f-4648-96fb-995353887ceb tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1362 microversion: 2.47 time: 0.203051 Jul 31 01:27:04.811357 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1883/3793] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:27:04 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:27:04.837308 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cb6781fe-e0dc-481c-b705-a9cb3d285773 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:04.842352 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cb6781fe-e0dc-481c-b705-a9cb3d285773 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:04.854492 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb6781fe-e0dc-481c-b705-a9cb3d285773 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:04.854954 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb6781fe-e0dc-481c-b705-a9cb3d285773 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:04.864031 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb6781fe-e0dc-481c-b705-a9cb3d285773 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:04.865778 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb6781fe-e0dc-481c-b705-a9cb3d285773 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:05.369863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cb6781fe-e0dc-481c-b705-a9cb3d285773 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:05.386372 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cb6781fe-e0dc-481c-b705-a9cb3d285773 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1539 microversion: 2.1 time: 0.571132 Jul 31 01:27:05.386984 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1884/3794] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:04 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1539 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:05.391674 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-604b3fbd-eeea-43bd-a38a-e9b9ea292b2a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:05.396187 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-604b3fbd-eeea-43bd-a38a-e9b9ea292b2a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:05.406317 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-604b3fbd-eeea-43bd-a38a-e9b9ea292b2a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:05.407085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-604b3fbd-eeea-43bd-a38a-e9b9ea292b2a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:05.408180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-604b3fbd-eeea-43bd-a38a-e9b9ea292b2a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:05.408793 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-604b3fbd-eeea-43bd-a38a-e9b9ea292b2a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:05.477315 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c6d0b3be-d0d7-4ecd-8822-e4dc5908846a tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.368088 Jul 31 01:27:05.479606 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1911/3795] 10.222.0.45 () {60 vars in 1170 bytes} [Sun Jul 31 01:27:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:05.500141 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0cddfa5d-efc5-4924-8658-85bcbc0f2067 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.116"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:05.509884 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0cddfa5d-efc5-4924-8658-85bcbc0f2067 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:05.520160 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0cddfa5d-efc5-4924-8658-85bcbc0f2067 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:05.521974 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0cddfa5d-efc5-4924-8658-85bcbc0f2067 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:05.523634 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0cddfa5d-efc5-4924-8658-85bcbc0f2067 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:05.528630 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0cddfa5d-efc5-4924-8658-85bcbc0f2067 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:05.578528 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0cddfa5d-efc5-4924-8658-85bcbc0f2067 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Acquired lock "refresh_cache-b82c2878-c1d7-43a4-9b3e-38af00bda820" {{(pid=119475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 01:27:05.856486 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-604b3fbd-eeea-43bd-a38a-e9b9ea292b2a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:05.884800 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-604b3fbd-eeea-43bd-a38a-e9b9ea292b2a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 0.496654 Jul 31 01:27:05.899280 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1885/3796] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:05 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:05.904492 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-637ac66f-b207-4f24-b316-639423553dbd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:05.905196 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-637ac66f-b207-4f24-b316-639423553dbd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:05.917130 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-637ac66f-b207-4f24-b316-639423553dbd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:05.917591 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-637ac66f-b207-4f24-b316-639423553dbd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:05.918388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-637ac66f-b207-4f24-b316-639423553dbd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:05.918881 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-637ac66f-b207-4f24-b316-639423553dbd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:06.316826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-637ac66f-b207-4f24-b316-639423553dbd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:06.328798 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-637ac66f-b207-4f24-b316-639423553dbd tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1680 microversion: 2.1 time: 0.428066 Jul 31 01:27:06.331214 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1886/3797] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:05 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1680 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:06.338999 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-96c469db-bf80-4687-9d33-cbd03e34c648 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:06.340401 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-96c469db-bf80-4687-9d33-cbd03e34c648 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:06.349737 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-96c469db-bf80-4687-9d33-cbd03e34c648 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:06.350693 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-96c469db-bf80-4687-9d33-cbd03e34c648 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:06.351898 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-96c469db-bf80-4687-9d33-cbd03e34c648 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:06.353886 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-96c469db-bf80-4687-9d33-cbd03e34c648 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:06.555270 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-96c469db-bf80-4687-9d33-cbd03e34c648 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:06.575692 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-96c469db-bf80-4687-9d33-cbd03e34c648 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:06.584644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-96c469db-bf80-4687-9d33-cbd03e34c648 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:06.587033 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-96c469db-bf80-4687-9d33-cbd03e34c648 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 200 len: 1362 microversion: 2.47 time: 0.253412 Jul 31 01:27:06.589092 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1887/3798] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:27:06 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:27:06.793209 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e479dc6f-0a45-471c-b4ac-40ced8897d92 req-6ef4cbf8-1413-488e-82d8-383fb44636e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f6a6f7-53a0-437a-a0aa-2cf71c4e606f", "name": "network-vif-plugged", "status": "completed", "tag": "82a98ea3-f93d-41d8-b248-0935fed4bcb0"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:06.805411 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e479dc6f-0a45-471c-b4ac-40ced8897d92 req-6ef4cbf8-1413-488e-82d8-383fb44636e6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:06.806062 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e479dc6f-0a45-471c-b4ac-40ced8897d92 req-6ef4cbf8-1413-488e-82d8-383fb44636e6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:06.835215 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e479dc6f-0a45-471c-b4ac-40ced8897d92 req-6ef4cbf8-1413-488e-82d8-383fb44636e6 service nova] Creating event network-vif-plugged:82a98ea3-f93d-41d8-b248-0935fed4bcb0 for instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f on n-h1-master-1 Jul 31 01:27:06.843231 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e479dc6f-0a45-471c-b4ac-40ced8897d92 req-6ef4cbf8-1413-488e-82d8-383fb44636e6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237811 Jul 31 01:27:06.851175 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1888/3799] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:06.857707 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1797af61-af01-40ed-868c-6f8c3a6bcfc8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:06.859306 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1797af61-af01-40ed-868c-6f8c3a6bcfc8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:06.871530 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1797af61-af01-40ed-868c-6f8c3a6bcfc8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:06.872488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1797af61-af01-40ed-868c-6f8c3a6bcfc8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:06.873850 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1797af61-af01-40ed-868c-6f8c3a6bcfc8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:06.874554 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1797af61-af01-40ed-868c-6f8c3a6bcfc8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:07.568316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1797af61-af01-40ed-868c-6f8c3a6bcfc8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:07.579523 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1797af61-af01-40ed-868c-6f8c3a6bcfc8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1521 microversion: 2.1 time: 0.726682 Jul 31 01:27:07.580497 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1889/3800] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:06 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1521 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:07.585901 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-99cf8399-4d0f-40d2-8ab5-73e4d9d0f553 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:07.587633 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-99cf8399-4d0f-40d2-8ab5-73e4d9d0f553 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:07.594938 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99cf8399-4d0f-40d2-8ab5-73e4d9d0f553 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:07.595754 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99cf8399-4d0f-40d2-8ab5-73e4d9d0f553 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:07.596721 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99cf8399-4d0f-40d2-8ab5-73e4d9d0f553 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:07.597453 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99cf8399-4d0f-40d2-8ab5-73e4d9d0f553 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:08.025205 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-99cf8399-4d0f-40d2-8ab5-73e4d9d0f553 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:08.037686 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-99cf8399-4d0f-40d2-8ab5-73e4d9d0f553 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 0.455651 Jul 31 01:27:08.039080 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1890/3801] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:07 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:08.048194 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-be1df4f8-d789-423e-90b5-6115e16137d1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:08.057611 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-be1df4f8-d789-423e-90b5-6115e16137d1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:08.074065 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be1df4f8-d789-423e-90b5-6115e16137d1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:08.074853 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be1df4f8-d789-423e-90b5-6115e16137d1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:08.075908 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be1df4f8-d789-423e-90b5-6115e16137d1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:08.076585 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be1df4f8-d789-423e-90b5-6115e16137d1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:08.453120 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-be1df4f8-d789-423e-90b5-6115e16137d1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:08.466237 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-be1df4f8-d789-423e-90b5-6115e16137d1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1680 microversion: 2.1 time: 0.424863 Jul 31 01:27:08.467390 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1891/3802] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:08 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1680 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:08.488996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-80da4cd7-d011-4ac2-a712-b7f515cb056c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:08.489812 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-80da4cd7-d011-4ac2-a712-b7f515cb056c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:08.496899 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80da4cd7-d011-4ac2-a712-b7f515cb056c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:08.497491 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80da4cd7-d011-4ac2-a712-b7f515cb056c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:08.498576 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80da4cd7-d011-4ac2-a712-b7f515cb056c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:08.499116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80da4cd7-d011-4ac2-a712-b7f515cb056c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:08.533375 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-80da4cd7-d011-4ac2-a712-b7f515cb056c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:27:08.594600 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:08.677245 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-80da4cd7-d011-4ac2-a712-b7f515cb056c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "DELETE /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 204 len: 0 microversion: 2.1 time: 0.192297 Jul 31 01:27:08.683738 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1892/3803] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:27:08 2022] DELETE /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:27:08.694565 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0846a324-a198-41b7-8030-c0bd485a89dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:08.696606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0846a324-a198-41b7-8030-c0bd485a89dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:08.707230 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0846a324-a198-41b7-8030-c0bd485a89dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:08.707782 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0846a324-a198-41b7-8030-c0bd485a89dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:08.709532 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0846a324-a198-41b7-8030-c0bd485a89dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:08.710210 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0846a324-a198-41b7-8030-c0bd485a89dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:08.728127 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-0846a324-a198-41b7-8030-c0bd485a89dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] HTTP exception thrown: Instance 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 could not be found. Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0846a324-a198-41b7-8030-c0bd485a89dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Request method failure captured: Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 HTTP/1.1 Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5do8-Fdg8nC9_DqPWPKGowtwVEPLt0FvevKQ6rZUWcmdcBPwMsuWzOzVRpWJ40MlCAqCM3p6IA8-1IsZkmxVj8FvTP28La_FvoRT-UONrUx-g05VzZM35ZzOffCdXxVaxbHTKYQPijzD87NOHqSb0ZrNK_5jp8Z7fqD0q3DHToEyWmM Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-Openstack-Nova-Api-Version: 2.47 Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 1a7506ae4e0e455f967a8aed632cf53c Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerShowV247Test-1433366114 Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1a7506ae4e0e455f967a8aed632cf53c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1a7506ae4e0e455f967a8aed632cf53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1a7506ae4e0e455f967a8aed632cf53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1a7506ae4e0e455f967a8aed632cf53c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerShowV247Test-1433366114 Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 1a7506ae4e0e455f967a8aed632cf53c Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerShowV247Test-1433366114 Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerShowV247Test-1433366114-project Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 845de7d6f99547c68b193d332bf58799 Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerShowV247Test-1433366114-project Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 could not be found. Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0'} Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 could not be found. Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 could not be found. Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:08.730548 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:08.735306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:08.735306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:08.735306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:08.735306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:27:08.735306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:27:08.735306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 could not be found. Jul 31 01:27:08.735306 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:08.735306 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0846a324-a198-41b7-8030-c0bd485a89dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Returning 404 to user: Instance 5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:27:08.735306 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0846a324-a198-41b7-8030-c0bd485a89dd tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0" status: 404 len: 111 microversion: 2.47 time: 0.051871 Jul 31 01:27:08.735306 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1893/3804] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:27:08 2022] GET /compute/v2.1/servers/5a07ccdd-7940-4f3c-a6d6-801a4b9b61a0 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:27:08.738742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fc58a1d6-c5cd-4b86-82bb-d97636cdcc72 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:08.740058 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fc58a1d6-c5cd-4b86-82bb-d97636cdcc72 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:08.748516 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc58a1d6-c5cd-4b86-82bb-d97636cdcc72 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:08.748516 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc58a1d6-c5cd-4b86-82bb-d97636cdcc72 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:08.749421 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc58a1d6-c5cd-4b86-82bb-d97636cdcc72 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:08.751127 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc58a1d6-c5cd-4b86-82bb-d97636cdcc72 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:08.968621 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-0cddfa5d-efc5-4924-8658-85bcbc0f2067 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Building network info cache for instance {{(pid=119475) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 31 01:27:09.062686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fc58a1d6-c5cd-4b86-82bb-d97636cdcc72 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:09.080663 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fc58a1d6-c5cd-4b86-82bb-d97636cdcc72 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1527 microversion: 2.1 time: 0.346232 Jul 31 01:27:09.081277 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1894/3805] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:08 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1527 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:09.096003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cf0139a6-87c6-43d7-ae81-b9cad84dee1b tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:09.096765 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cf0139a6-87c6-43d7-ae81-b9cad84dee1b tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: c0b8a2d9-d933-45ab-a1c8-fc27eccb706e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:09.108117 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf0139a6-87c6-43d7-ae81-b9cad84dee1b tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:09.108579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf0139a6-87c6-43d7-ae81-b9cad84dee1b tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:09.109568 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf0139a6-87c6-43d7-ae81-b9cad84dee1b tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:09.110020 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf0139a6-87c6-43d7-ae81-b9cad84dee1b tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:09.143180 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cf0139a6-87c6-43d7-ae81-b9cad84dee1b tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: c0b8a2d9-d933-45ab-a1c8-fc27eccb706e] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:27:09.263176 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cf0139a6-87c6-43d7-ae81-b9cad84dee1b tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c0b8a2d9-d933-45ab-a1c8-fc27eccb706e" status: 204 len: 0 microversion: 2.47 time: 0.180573 Jul 31 01:27:09.266796 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1895/3806] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:27:09 2022] DELETE /compute/v2.1/servers/c0b8a2d9-d933-45ab-a1c8-fc27eccb706e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:27:09.271236 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-c3d1d360-da4d-442b-be2a-c2866c4c2ef0 req-9cb972b4-3d6f-4720-93f0-4c805bdf36d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82c2878-c1d7-43a4-9b3e-38af00bda820", "tag": "d4f63d82-0064-4811-bcb1-b78632f9ea21"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:09.281712 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c3d1d360-da4d-442b-be2a-c2866c4c2ef0 req-9cb972b4-3d6f-4720-93f0-4c805bdf36d4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:09.282215 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c3d1d360-da4d-442b-be2a-c2866c4c2ef0 req-9cb972b4-3d6f-4720-93f0-4c805bdf36d4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:09.297245 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-c3d1d360-da4d-442b-be2a-c2866c4c2ef0 req-9cb972b4-3d6f-4720-93f0-4c805bdf36d4 service nova] Creating event network-changed:d4f63d82-0064-4811-bcb1-b78632f9ea21 for instance b82c2878-c1d7-43a4-9b3e-38af00bda820 on n-h1-master-1 Jul 31 01:27:09.306131 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-c3d1d360-da4d-442b-be2a-c2866c4c2ef0 req-9cb972b4-3d6f-4720-93f0-4c805bdf36d4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038285 Jul 31 01:27:09.307176 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1896/3807] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:09.314233 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5e5080db-925f-493c-b496-5e4c6f8a175b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:09.315003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5e5080db-925f-493c-b496-5e4c6f8a175b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:09.323313 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5e5080db-925f-493c-b496-5e4c6f8a175b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:09.323313 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5e5080db-925f-493c-b496-5e4c6f8a175b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:09.323611 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5e5080db-925f-493c-b496-5e4c6f8a175b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:09.323915 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5e5080db-925f-493c-b496-5e4c6f8a175b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:09.740044 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5e5080db-925f-493c-b496-5e4c6f8a175b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:09.761922 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5e5080db-925f-493c-b496-5e4c6f8a175b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 0.450032 Jul 31 01:27:09.762841 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1897/3808] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:09 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:09.788623 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e48639e5-46b4-416f-b72f-57b22d4803b3 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:09.789520 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e48639e5-46b4-416f-b72f-57b22d4803b3 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: c0b8a2d9-d933-45ab-a1c8-fc27eccb706e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:09.806197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e48639e5-46b4-416f-b72f-57b22d4803b3 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:09.806695 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e48639e5-46b4-416f-b72f-57b22d4803b3 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:09.807463 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e48639e5-46b4-416f-b72f-57b22d4803b3 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:09.807909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e48639e5-46b4-416f-b72f-57b22d4803b3 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:09.920135 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-0cddfa5d-efc5-4924-8658-85bcbc0f2067 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Updating instance_info_cache with network_info: [{"id": "d4f63d82-0064-4811-bcb1-b78632f9ea21", "address": "fa:16:3e:51:b9:d7", "network": {"id": "20bc1354-9fed-4cd7-ac6a-eff29b084bc2", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1525537213-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9939750cc4074991b1da344bf6e18c67", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd4f63d82-00", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119475) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 31 01:27:09.938624 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0cddfa5d-efc5-4924-8658-85bcbc0f2067 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Releasing lock "refresh_cache-b82c2878-c1d7-43a4-9b3e-38af00bda820" {{(pid=119475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 01:27:09.940584 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0cddfa5d-efc5-4924-8658-85bcbc0f2067 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "POST /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820/action" status: 202 len: 0 microversion: 2.1 time: 4.453474 Jul 31 01:27:09.941774 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1912/3809] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:27:05 2022] POST /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820/action => generated 0 bytes in 4455 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 31 01:27:09.949413 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eb05ba4b-f61a-40ec-8361-a45b5a8e0af0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:09.950317 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eb05ba4b-f61a-40ec-8361-a45b5a8e0af0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:09.958804 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb05ba4b-f61a-40ec-8361-a45b5a8e0af0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:09.959647 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb05ba4b-f61a-40ec-8361-a45b5a8e0af0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:09.960618 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb05ba4b-f61a-40ec-8361-a45b5a8e0af0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:09.961232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb05ba4b-f61a-40ec-8361-a45b5a8e0af0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:09.985093 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e48639e5-46b4-416f-b72f-57b22d4803b3 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:10.006967 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e48639e5-46b4-416f-b72f-57b22d4803b3 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:10.011975 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e48639e5-46b4-416f-b72f-57b22d4803b3 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:10.016924 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e48639e5-46b4-416f-b72f-57b22d4803b3 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b8a2d9-d933-45ab-a1c8-fc27eccb706e" status: 200 len: 1363 microversion: 2.47 time: 0.248764 Jul 31 01:27:10.031374 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1898/3810] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:27:09 2022] GET /compute/v2.1/servers/c0b8a2d9-d933-45ab-a1c8-fc27eccb706e => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:27:10.031374 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-960e21bc-fa7d-4bd7-acc4-684bc5d72fd6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.116"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:10.378271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-960e21bc-fa7d-4bd7-acc4-684bc5d72fd6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:10.385698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-960e21bc-fa7d-4bd7-acc4-684bc5d72fd6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:10.386175 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-960e21bc-fa7d-4bd7-acc4-684bc5d72fd6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:10.386986 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-960e21bc-fa7d-4bd7-acc4-684bc5d72fd6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:10.387462 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-960e21bc-fa7d-4bd7-acc4-684bc5d72fd6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:10.421656 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eb05ba4b-f61a-40ec-8361-a45b5a8e0af0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:10.435328 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eb05ba4b-f61a-40ec-8361-a45b5a8e0af0 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1680 microversion: 2.1 time: 0.491441 Jul 31 01:27:10.436761 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1913/3811] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:09 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1680 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:10.457715 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e570a4bc-9015-44f1-9337-d0bece150ccb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:10.458650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e570a4bc-9015-44f1-9337-d0bece150ccb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:10.465201 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e570a4bc-9015-44f1-9337-d0bece150ccb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:10.465663 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e570a4bc-9015-44f1-9337-d0bece150ccb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:10.470833 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e570a4bc-9015-44f1-9337-d0bece150ccb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:10.470833 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e570a4bc-9015-44f1-9337-d0bece150ccb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:10.799185 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e570a4bc-9015-44f1-9337-d0bece150ccb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:10.810813 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e570a4bc-9015-44f1-9337-d0bece150ccb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1527 microversion: 2.1 time: 0.356910 Jul 31 01:27:10.821812 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1914/3812] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:10 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1527 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:10.832980 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-960e21bc-fa7d-4bd7-acc4-684bc5d72fd6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Acquired lock "refresh_cache-b82c2878-c1d7-43a4-9b3e-38af00bda820" {{(pid=119474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 01:27:10.835092 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-82526888-caef-4f63-8f68-3a54d431a4cb tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:10.835784 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-82526888-caef-4f63-8f68-3a54d431a4cb tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:10.855019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-82526888-caef-4f63-8f68-3a54d431a4cb tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:10.855885 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-82526888-caef-4f63-8f68-3a54d431a4cb tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:10.856929 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-82526888-caef-4f63-8f68-3a54d431a4cb tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:10.857425 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-82526888-caef-4f63-8f68-3a54d431a4cb tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:11.890880 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-82526888-caef-4f63-8f68-3a54d431a4cb tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:11.925533 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-82526888-caef-4f63-8f68-3a54d431a4cb tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 1.101858 Jul 31 01:27:11.931681 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1915/3813] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:10 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:11.951183 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8390ef55-4e0d-40b9-bd73-2f54d3e4e031 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:11.952759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8390ef55-4e0d-40b9-bd73-2f54d3e4e031 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: c0b8a2d9-d933-45ab-a1c8-fc27eccb706e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:11.981888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8390ef55-4e0d-40b9-bd73-2f54d3e4e031 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:11.983150 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8390ef55-4e0d-40b9-bd73-2f54d3e4e031 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:11.985008 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8390ef55-4e0d-40b9-bd73-2f54d3e4e031 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:11.986154 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8390ef55-4e0d-40b9-bd73-2f54d3e4e031 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:12.190907 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8390ef55-4e0d-40b9-bd73-2f54d3e4e031 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:12.203686 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8390ef55-4e0d-40b9-bd73-2f54d3e4e031 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:12.205714 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8390ef55-4e0d-40b9-bd73-2f54d3e4e031 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '845de7d6f99547c68b193d332bf58799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a7506ae4e0e455f967a8aed632cf53c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:12.207486 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8390ef55-4e0d-40b9-bd73-2f54d3e4e031 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b8a2d9-d933-45ab-a1c8-fc27eccb706e" status: 200 len: 1363 microversion: 2.47 time: 0.273762 Jul 31 01:27:12.208650 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1916/3814] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:27:11 2022] GET /compute/v2.1/servers/c0b8a2d9-d933-45ab-a1c8-fc27eccb706e => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:27:12.224989 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-af8b66fc-7d6b-402e-ad11-035436728ed4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:12.227087 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-af8b66fc-7d6b-402e-ad11-035436728ed4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:12.247813 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af8b66fc-7d6b-402e-ad11-035436728ed4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:12.248689 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af8b66fc-7d6b-402e-ad11-035436728ed4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:12.249810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af8b66fc-7d6b-402e-ad11-035436728ed4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:12.250473 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af8b66fc-7d6b-402e-ad11-035436728ed4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:12.256724 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:12.672902 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:12.772962 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-af8b66fc-7d6b-402e-ad11-035436728ed4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:12.788392 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-af8b66fc-7d6b-402e-ad11-035436728ed4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1657 microversion: 2.1 time: 0.577609 Jul 31 01:27:12.800833 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1917/3815] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:12 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1657 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:12.810405 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bf38eb5b-926a-4025-864a-cd9dced97b08 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:12.811530 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bf38eb5b-926a-4025-864a-cd9dced97b08 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:12.827790 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf38eb5b-926a-4025-864a-cd9dced97b08 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:12.828510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf38eb5b-926a-4025-864a-cd9dced97b08 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:12.829370 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf38eb5b-926a-4025-864a-cd9dced97b08 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:12.829915 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf38eb5b-926a-4025-864a-cd9dced97b08 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:12.876136 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:13.353744 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-960e21bc-fa7d-4bd7-acc4-684bc5d72fd6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Building network info cache for instance {{(pid=119474) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 31 01:27:13.569998 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bf38eb5b-926a-4025-864a-cd9dced97b08 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:13.586011 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bf38eb5b-926a-4025-864a-cd9dced97b08 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1527 microversion: 2.1 time: 0.782735 Jul 31 01:27:13.588264 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1918/3816] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:12 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1527 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:13.606590 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-1852a15e-b8c9-438d-9976-8c20850a6416 req-c4c1594b-9d06-4f2d-ae94-dde101622941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f6a6f7-53a0-437a-a0aa-2cf71c4e606f", "name": "network-vif-unplugged", "status": "completed", "tag": "82a98ea3-f93d-41d8-b248-0935fed4bcb0"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:13.627261 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1852a15e-b8c9-438d-9976-8c20850a6416 req-c4c1594b-9d06-4f2d-ae94-dde101622941 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:13.628083 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1852a15e-b8c9-438d-9976-8c20850a6416 req-c4c1594b-9d06-4f2d-ae94-dde101622941 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:13.642874 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1852a15e-b8c9-438d-9976-8c20850a6416 req-c4c1594b-9d06-4f2d-ae94-dde101622941 service nova] Creating event network-vif-unplugged:82a98ea3-f93d-41d8-b248-0935fed4bcb0 for instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f on n-h1-master-1 Jul 31 01:27:13.671748 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-1852a15e-b8c9-438d-9976-8c20850a6416 req-c4c1594b-9d06-4f2d-ae94-dde101622941 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080358 Jul 31 01:27:13.672571 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1919/3817] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:13.684044 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-54d997b4-f149-4549-8729-b32eca93f0fa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:13.704060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54d997b4-f149-4549-8729-b32eca93f0fa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:13.704933 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54d997b4-f149-4549-8729-b32eca93f0fa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:13.802254 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-54d997b4-f149-4549-8729-b32eca93f0fa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Going to try to start instance {{(pid=119475) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 31 01:27:13.924719 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-54d997b4-f149-4549-8729-b32eca93f0fa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 202 len: 0 microversion: 2.1 time: 0.233091 Jul 31 01:27:13.928859 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1920/3818] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:27:13 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:27:13.948229 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-61e44dfe-8f58-49b2-b802-ae15007b8300 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:13.957008 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-61e44dfe-8f58-49b2-b802-ae15007b8300 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:13.977974 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61e44dfe-8f58-49b2-b802-ae15007b8300 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:13.981208 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61e44dfe-8f58-49b2-b802-ae15007b8300 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:13.983774 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61e44dfe-8f58-49b2-b802-ae15007b8300 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:13.985788 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61e44dfe-8f58-49b2-b802-ae15007b8300 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:14.760308 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-61e44dfe-8f58-49b2-b802-ae15007b8300 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:14.781573 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-61e44dfe-8f58-49b2-b802-ae15007b8300 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 0.851446 Jul 31 01:27:14.796732 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1921/3819] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:13 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:14.796732 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e749a724-2f28-4f8e-879b-b638bd820f20 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:14.796732 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e749a724-2f28-4f8e-879b-b638bd820f20 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] [instance: c0b8a2d9-d933-45ab-a1c8-fc27eccb706e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:14.820593 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e749a724-2f28-4f8e-879b-b638bd820f20 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:14.821378 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e749a724-2f28-4f8e-879b-b638bd820f20 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:14.822875 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e749a724-2f28-4f8e-879b-b638bd820f20 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:14.824469 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e749a724-2f28-4f8e-879b-b638bd820f20 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:14.888716 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-e749a724-2f28-4f8e-879b-b638bd820f20 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] HTTP exception thrown: Instance c0b8a2d9-d933-45ab-a1c8-fc27eccb706e could not be found. Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e749a724-2f28-4f8e-879b-b638bd820f20 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Request method failure captured: Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/c0b8a2d9-d933-45ab-a1c8-fc27eccb706e HTTP/1.1 Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5do8-Fdg8nC9_DqPWPKGowtwVEPLt0FvevKQ6rZUWcmdcBPwMsuWzOzVRpWJ40MlCAqCM3p6IA8-1IsZkmxVj8FvTP28La_FvoRT-UONrUx-g05VzZM35ZzOffCdXxVaxbHTKYQPijzD87NOHqSb0ZrNK_5jp8Z7fqD0q3DHToEyWmM Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.47 Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 1a7506ae4e0e455f967a8aed632cf53c Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerShowV247Test-1433366114 Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1a7506ae4e0e455f967a8aed632cf53c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1a7506ae4e0e455f967a8aed632cf53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1a7506ae4e0e455f967a8aed632cf53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1a7506ae4e0e455f967a8aed632cf53c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerShowV247Test-1433366114 Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 1a7506ae4e0e455f967a8aed632cf53c Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerShowV247Test-1433366114 Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerShowV247Test-1433366114-project Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 845de7d6f99547c68b193d332bf58799 Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerShowV247Test-1433366114-project Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: exception: Instance c0b8a2d9-d933-45ab-a1c8-fc27eccb706e could not be found. Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'c0b8a2d9-d933-45ab-a1c8-fc27eccb706e'} Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b8a2d9-d933-45ab-a1c8-fc27eccb706e could not be found. Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b8a2d9-d933-45ab-a1c8-fc27eccb706e could not be found. Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:14.893810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:14.898127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:14.898127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:14.898127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:14.898127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:27:14.898127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:27:14.898127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b8a2d9-d933-45ab-a1c8-fc27eccb706e could not be found. Jul 31 01:27:14.898127 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:14.902231 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e749a724-2f28-4f8e-879b-b638bd820f20 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] Returning 404 to user: Instance c0b8a2d9-d933-45ab-a1c8-fc27eccb706e could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:27:14.903957 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e749a724-2f28-4f8e-879b-b638bd820f20 tempest-ServerShowV247Test-1433366114 tempest-ServerShowV247Test-1433366114-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b8a2d9-d933-45ab-a1c8-fc27eccb706e" status: 404 len: 111 microversion: 2.47 time: 0.118410 Jul 31 01:27:14.905390 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1922/3820] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:27:14 2022] GET /compute/v2.1/servers/c0b8a2d9-d933-45ab-a1c8-fc27eccb706e => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:27:14.914469 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-9e8cfa1d-f067-414f-beda-17fd50ca9f44 req-82edb0c3-fe87-4473-bce0-730a25960f8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82c2878-c1d7-43a4-9b3e-38af00bda820", "tag": "d4f63d82-0064-4811-bcb1-b78632f9ea21"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:14.949277 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9e8cfa1d-f067-414f-beda-17fd50ca9f44 req-82edb0c3-fe87-4473-bce0-730a25960f8b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:14.949781 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9e8cfa1d-f067-414f-beda-17fd50ca9f44 req-82edb0c3-fe87-4473-bce0-730a25960f8b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:14.999246 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-9e8cfa1d-f067-414f-beda-17fd50ca9f44 req-82edb0c3-fe87-4473-bce0-730a25960f8b service nova] Creating event network-changed:d4f63d82-0064-4811-bcb1-b78632f9ea21 for instance b82c2878-c1d7-43a4-9b3e-38af00bda820 on n-h1-master-1 Jul 31 01:27:15.013362 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-9e8cfa1d-f067-414f-beda-17fd50ca9f44 req-82edb0c3-fe87-4473-bce0-730a25960f8b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106111 Jul 31 01:27:15.021598 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1923/3821] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:15.028792 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d3915c3d-a693-4968-a81d-52b00fc781d4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:15.030121 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d3915c3d-a693-4968-a81d-52b00fc781d4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:15.046070 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3915c3d-a693-4968-a81d-52b00fc781d4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:15.048918 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3915c3d-a693-4968-a81d-52b00fc781d4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:15.050212 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3915c3d-a693-4968-a81d-52b00fc781d4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:15.050916 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3915c3d-a693-4968-a81d-52b00fc781d4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:15.515684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d3915c3d-a693-4968-a81d-52b00fc781d4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:15.529699 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d3915c3d-a693-4968-a81d-52b00fc781d4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1666 microversion: 2.1 time: 0.506440 Jul 31 01:27:15.530356 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1924/3822] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:15 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1666 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:15.540640 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-149f33ed-b791-4bb5-9457-d4de0f5dec0c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:15.541958 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-149f33ed-b791-4bb5-9457-d4de0f5dec0c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:15.556655 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-149f33ed-b791-4bb5-9457-d4de0f5dec0c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:15.557217 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-149f33ed-b791-4bb5-9457-d4de0f5dec0c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:15.558442 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-149f33ed-b791-4bb5-9457-d4de0f5dec0c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:15.558902 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-149f33ed-b791-4bb5-9457-d4de0f5dec0c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:15.646420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-149f33ed-b791-4bb5-9457-d4de0f5dec0c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:15.646888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-149f33ed-b791-4bb5-9457-d4de0f5dec0c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:15.647630 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-149f33ed-b791-4bb5-9457-d4de0f5dec0c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lazy-loading 'fault' on Instance uuid 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:27:15.828257 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-149f33ed-b791-4bb5-9457-d4de0f5dec0c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:15.842667 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-149f33ed-b791-4bb5-9457-d4de0f5dec0c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 200 len: 1315 microversion: 2.1 time: 0.309329 Jul 31 01:27:15.843271 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1925/3823] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:15 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:15.850312 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cce09433-6621-4da4-9335-c87f0697b8d9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:15.857689 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cce09433-6621-4da4-9335-c87f0697b8d9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:15.879779 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cce09433-6621-4da4-9335-c87f0697b8d9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:15.880254 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cce09433-6621-4da4-9335-c87f0697b8d9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:15.885654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cce09433-6621-4da4-9335-c87f0697b8d9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:15.886220 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cce09433-6621-4da4-9335-c87f0697b8d9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:16.131725 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-960e21bc-fa7d-4bd7-acc4-684bc5d72fd6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Updating instance_info_cache with network_info: [{"id": "d4f63d82-0064-4811-bcb1-b78632f9ea21", "address": "fa:16:3e:51:b9:d7", "network": {"id": "20bc1354-9fed-4cd7-ac6a-eff29b084bc2", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1525537213-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9939750cc4074991b1da344bf6e18c67", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd4f63d82-00", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119474) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 31 01:27:16.140941 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-960e21bc-fa7d-4bd7-acc4-684bc5d72fd6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Releasing lock "refresh_cache-b82c2878-c1d7-43a4-9b3e-38af00bda820" {{(pid=119474) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 01:27:16.144639 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-960e21bc-fa7d-4bd7-acc4-684bc5d72fd6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "POST /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820/action" status: 202 len: 0 microversion: 2.1 time: 6.125232 Jul 31 01:27:16.148136 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1899/3824] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:27:10 2022] POST /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820/action => generated 0 bytes in 6129 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 31 01:27:16.171839 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b0e298fc-b073-43e2-a406-8ec210f7f50b tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '.version_select at 0x7fede4fa21f0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:16.900271 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cce09433-6621-4da4-9335-c87f0697b8d9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:16.919155 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cce09433-6621-4da4-9335-c87f0697b8d9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1736 microversion: 2.1 time: 1.074626 Jul 31 01:27:16.919786 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1926/3825] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:15 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1736 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:16.938136 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e8d49417-654c-459f-be4f-59b1495af96c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:16.938761 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e8d49417-654c-459f-be4f-59b1495af96c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:16.952255 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8d49417-654c-459f-be4f-59b1495af96c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:16.953326 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8d49417-654c-459f-be4f-59b1495af96c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:16.955063 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8d49417-654c-459f-be4f-59b1495af96c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:16.956029 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8d49417-654c-459f-be4f-59b1495af96c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:17.690827 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e8d49417-654c-459f-be4f-59b1495af96c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:17.703893 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e8d49417-654c-459f-be4f-59b1495af96c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1666 microversion: 2.1 time: 0.782977 Jul 31 01:27:17.704888 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1927/3826] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:16 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1666 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:17.716644 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-42a200a2-b6d6-490c-bd3d-9d292d4aae26 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:17.721825 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-42a200a2-b6d6-490c-bd3d-9d292d4aae26 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:17.733487 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42a200a2-b6d6-490c-bd3d-9d292d4aae26 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:17.739101 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42a200a2-b6d6-490c-bd3d-9d292d4aae26 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:17.740653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42a200a2-b6d6-490c-bd3d-9d292d4aae26 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:17.741907 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42a200a2-b6d6-490c-bd3d-9d292d4aae26 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:17.783993 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-42a200a2-b6d6-490c-bd3d-9d292d4aae26 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] HTTP exception thrown: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-42a200a2-b6d6-490c-bd3d-9d292d4aae26 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Request method failure captured: Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f HTTP/1.1 Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5do_qvGtrm8MFTSKrTw8R7jgmTzyETsET8_Bks35mozq5SQhUaDIA0oib2wHXXTKsc9AVPMwnRA1N8ACvVn62cvXmTWUR5or87UcB5lhe7JDpnHvkxRMhg6Zlak4K6e0-cQsqquMOz1g27fd3AjZnreZQbV510uuuf140sds5ry5cxM Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c609eaf96fc84008b10c26b3f56edd69", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: df0850646f5b4fdeabc4d50297626e27 Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '47f6a6f7-53a0-437a-a0aa-2cf71c4e606f'} Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:17.786109 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:17.789563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:17.789563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:17.789563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:17.789563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:17.789563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:27:17.789563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:27:17.789563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. Jul 31 01:27:17.789563 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:17.791495 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-42a200a2-b6d6-490c-bd3d-9d292d4aae26 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Returning 404 to user: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:27:17.792776 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-42a200a2-b6d6-490c-bd3d-9d292d4aae26 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 404 len: 111 microversion: 2.1 time: 0.080730 Jul 31 01:27:17.802905 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1928/3827] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:17 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:27:17.809267 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-5b87b192-88f6-4923-bc25-3d2febc1bdbf req-3c623124-c5eb-4f2f-aa65-22fc98ad0064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f6a6f7-53a0-437a-a0aa-2cf71c4e606f", "name": "network-vif-deleted", "tag": "82a98ea3-f93d-41d8-b248-0935fed4bcb0"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:17.830519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5b87b192-88f6-4923-bc25-3d2febc1bdbf req-3c623124-c5eb-4f2f-aa65-22fc98ad0064 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:17.831375 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5b87b192-88f6-4923-bc25-3d2febc1bdbf req-3c623124-c5eb-4f2f-aa65-22fc98ad0064 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:17.854229 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-5b87b192-88f6-4923-bc25-3d2febc1bdbf req-3c623124-c5eb-4f2f-aa65-22fc98ad0064 service nova] Creating event network-vif-deleted:82a98ea3-f93d-41d8-b248-0935fed4bcb0 for instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f on n-h1-master-1 Jul 31 01:27:17.865234 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-5b87b192-88f6-4923-bc25-3d2febc1bdbf req-3c623124-c5eb-4f2f-aa65-22fc98ad0064 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058934 Jul 31 01:27:17.866864 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1929/3828] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:17.874844 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9b8b0333-b4d3-4a15-ac10-0b8f7d8b1af5 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Action: 'create', calling method: .version_select at 0x7fede4782d30>, body: {"keypair": {"name": "tempest-keypair-2010233348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLEKVhFMmii5QQuB/juK+KNCGgZgwtuQBYZM2wQi710VGH3mJ8PA9TyVTONkgQqypdOWJNIh4zepYMQBJ87Ik9sxAuO4uFvyk7fIrXuo/t134P+Ux7DLzI0sSupqNbGGA=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:17.893496 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-9b8b0333-b4d3-4a15-ac10-0b8f7d8b1af5 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Getting quotas for project c609eaf96fc84008b10c26b3f56edd69. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:27:17.903487 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-9b8b0333-b4d3-4a15-ac10-0b8f7d8b1af5 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Getting quotas for user df0850646f5b4fdeabc4d50297626e27 and project c609eaf96fc84008b10c26b3f56edd69. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:27:17.950175 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9b8b0333-b4d3-4a15-ac10-0b8f7d8b1af5 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080991 Jul 31 01:27:17.950954 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1930/3829] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:27:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:17.961216 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4db04edb-d529-4fee-80bb-8c9041e9df92 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:17.962127 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4db04edb-d529-4fee-80bb-8c9041e9df92 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:17.977732 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4db04edb-d529-4fee-80bb-8c9041e9df92 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:17.984374 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4db04edb-d529-4fee-80bb-8c9041e9df92 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:17.992029 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4db04edb-d529-4fee-80bb-8c9041e9df92 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:17.994112 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4db04edb-d529-4fee-80bb-8c9041e9df92 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:18.632331 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4db04edb-d529-4fee-80bb-8c9041e9df92 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:18.655782 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4db04edb-d529-4fee-80bb-8c9041e9df92 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1716 microversion: 2.1 time: 0.703427 Jul 31 01:27:18.656374 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1931/3830] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:17 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1716 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:18.735978 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-771e3fb8-5d1e-4b27-a73a-0fe1a4ea3e1e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:18.737032 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-771e3fb8-5d1e-4b27-a73a-0fe1a4ea3e1e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:18.748593 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-771e3fb8-5d1e-4b27-a73a-0fe1a4ea3e1e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:18.749050 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-771e3fb8-5d1e-4b27-a73a-0fe1a4ea3e1e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:18.749851 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-771e3fb8-5d1e-4b27-a73a-0fe1a4ea3e1e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:18.750263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-771e3fb8-5d1e-4b27-a73a-0fe1a4ea3e1e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:19.342615 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-771e3fb8-5d1e-4b27-a73a-0fe1a4ea3e1e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:19.369663 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-771e3fb8-5d1e-4b27-a73a-0fe1a4ea3e1e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.634898 Jul 31 01:27:19.383942 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b0e298fc-b073-43e2-a406-8ec210f7f50b tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "DELETE /compute/v2.1/os-floating-ips/93b6b718-40df-4fcf-a2fd-4bf9f37e2ec9" status: 202 len: 0 microversion: 2.1 time: 3.228350 Jul 31 01:27:19.383942 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1900/3831] 10.222.0.45 () {58 vars in 1263 bytes} [Sun Jul 31 01:27:16 2022] DELETE /compute/v2.1/os-floating-ips/93b6b718-40df-4fcf-a2fd-4bf9f37e2ec9 => generated 0 bytes in 3230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:27:19.385949 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1932/3832] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:18 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:19.386090 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ca92b8ab-2538-456c-9041-e66525752828 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:19.386599 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ca92b8ab-2538-456c-9041-e66525752828 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:19.393383 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a1ab2101-d205-414d-af84-8c130d5db002 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '.version_select at 0x7fede47829d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:19.405060 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca92b8ab-2538-456c-9041-e66525752828 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:19.405568 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca92b8ab-2538-456c-9041-e66525752828 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:19.406422 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca92b8ab-2538-456c-9041-e66525752828 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:19.406865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca92b8ab-2538-456c-9041-e66525752828 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:19.712793 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-ca92b8ab-2538-456c-9041-e66525752828 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] HTTP exception thrown: Cannot 'detach_volume' instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 while it is in vm_state rescued Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ca92b8ab-2538-456c-9041-e66525752828 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Request method failure captured: Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments/c9c9d370-ccce-4c3b-bf07-1b6fad8afa5c HTTP/1.1 Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dlxeTMDBunLit2vGiPrRDr1dvwQZdXub1419SqSyDOiGVHpAG6yJGGezx9r9jLdyswls0cvvjHa7zsCjK7Ca5A4yF2d26H1NpXXYaK068O8-NSelNX8BnsHr9p-9TQJIL4Ay7u6mf8S-XLTaElYJgrWyL6gNGdxZnY_92dE9hLD6X8 Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_af1bdeca391f47f3bde21459bf893f89", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 87e482f360af4e56a325960d834fb9f8 Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: exception: Cannot 'detach_volume' instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 while it is in vm_state rescued Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: action_args: {'server_id': '8c1c5a15-18aa-437c-a4fb-77eaaf234ac0', 'id': 'c9c9d370-ccce-4c3b-bf07-1b6fad8afa5c'} Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 while it is in vm_state rescued Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:19.719910 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:19.723969 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:19.723969 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:19.723969 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:27:19.723969 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:27:19.723969 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 while it is in vm_state rescued Jul 31 01:27:19.723969 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:19.723969 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ca92b8ab-2538-456c-9041-e66525752828 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Returning 409 to user: Cannot 'detach_volume' instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 while it is in vm_state rescued {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:27:19.731505 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ca92b8ab-2538-456c-9041-e66525752828 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments/c9c9d370-ccce-4c3b-bf07-1b6fad8afa5c" status: 409 len: 152 microversion: 2.1 time: 0.348212 Jul 31 01:27:19.732486 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1901/3833] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 01:27:19 2022] DELETE /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments/c9c9d370-ccce-4c3b-bf07-1b6fad8afa5c => generated 152 bytes in 353 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:27:19.742504 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3bd3241e-1472-4d32-881b-1d4d00d41fcc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:19.744344 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3bd3241e-1472-4d32-881b-1d4d00d41fcc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:19.762444 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3bd3241e-1472-4d32-881b-1d4d00d41fcc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:19.763947 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3bd3241e-1472-4d32-881b-1d4d00d41fcc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:19.766013 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3bd3241e-1472-4d32-881b-1d4d00d41fcc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:19.768254 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3bd3241e-1472-4d32-881b-1d4d00d41fcc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:20.250551 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a1ab2101-d205-414d-af84-8c130d5db002 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "DELETE /compute/v2.1/os-security-groups/a16c6ff4-57a8-432b-981b-fe2bec2358e0" status: 202 len: 0 microversion: 2.1 time: 0.862358 Jul 31 01:27:20.251526 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1933/3834] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 01:27:19 2022] DELETE /compute/v2.1/os-security-groups/a16c6ff4-57a8-432b-981b-fe2bec2358e0 => generated 0 bytes in 864 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:27:20.257772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3bd3241e-1472-4d32-881b-1d4d00d41fcc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:20.276992 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-aa827b2b-6609-42f1-a17d-11f86e1ed410 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:20.277845 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-aa827b2b-6609-42f1-a17d-11f86e1ed410 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:20.289271 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aa827b2b-6609-42f1-a17d-11f86e1ed410 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:20.290054 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3bd3241e-1472-4d32-881b-1d4d00d41fcc tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.553511 Jul 31 01:27:20.290677 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aa827b2b-6609-42f1-a17d-11f86e1ed410 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:20.292134 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aa827b2b-6609-42f1-a17d-11f86e1ed410 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:20.293494 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aa827b2b-6609-42f1-a17d-11f86e1ed410 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:20.293655 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1902/3835] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:19 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:20.305717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2f06279d-9b90-4a52-8e5c-f9b64f4c9cb6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:20.310044 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2f06279d-9b90-4a52-8e5c-f9b64f4c9cb6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:20.367243 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2f06279d-9b90-4a52-8e5c-f9b64f4c9cb6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:20.370485 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2f06279d-9b90-4a52-8e5c-f9b64f4c9cb6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:20.373104 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2f06279d-9b90-4a52-8e5c-f9b64f4c9cb6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:20.375204 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2f06279d-9b90-4a52-8e5c-f9b64f4c9cb6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:20.447525 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2f06279d-9b90-4a52-8e5c-f9b64f4c9cb6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:27:20.487004 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-aa827b2b-6609-42f1-a17d-11f86e1ed410 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/action" status: 202 len: 0 microversion: 2.1 time: 0.225555 Jul 31 01:27:20.494967 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1934/3836] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:27:20 2022] POST /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:27:20.504144 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-36411f8c-c6c5-40de-a1de-ea4f1a68cc09 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:20.505131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-36411f8c-c6c5-40de-a1de-ea4f1a68cc09 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:20.516881 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36411f8c-c6c5-40de-a1de-ea4f1a68cc09 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:20.518058 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36411f8c-c6c5-40de-a1de-ea4f1a68cc09 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:20.519152 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36411f8c-c6c5-40de-a1de-ea4f1a68cc09 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:20.520157 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36411f8c-c6c5-40de-a1de-ea4f1a68cc09 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:20.621072 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2f06279d-9b90-4a52-8e5c-f9b64f4c9cb6 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 204 len: 0 microversion: 2.1 time: 0.325913 Jul 31 01:27:20.631620 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1903/3837] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:27:20 2022] DELETE /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:27:20.639113 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d6f92be3-7403-4d99-9d63-c6c9ff802d53 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:20.640157 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d6f92be3-7403-4d99-9d63-c6c9ff802d53 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:20.653678 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6f92be3-7403-4d99-9d63-c6c9ff802d53 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:20.654439 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6f92be3-7403-4d99-9d63-c6c9ff802d53 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:20.655545 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6f92be3-7403-4d99-9d63-c6c9ff802d53 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:20.656479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6f92be3-7403-4d99-9d63-c6c9ff802d53 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:21.108342 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d6f92be3-7403-4d99-9d63-c6c9ff802d53 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:21.122424 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d6f92be3-7403-4d99-9d63-c6c9ff802d53 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1724 microversion: 2.1 time: 0.489073 Jul 31 01:27:21.130149 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1904/3838] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:20 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1724 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:21.150735 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b318162d-7658-44b4-91fa-0f518576960e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:21.152930 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b318162d-7658-44b4-91fa-0f518576960e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:21.169820 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b318162d-7658-44b4-91fa-0f518576960e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:21.173195 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b318162d-7658-44b4-91fa-0f518576960e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:21.176621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b318162d-7658-44b4-91fa-0f518576960e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:21.178002 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b318162d-7658-44b4-91fa-0f518576960e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:21.190532 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-36411f8c-c6c5-40de-a1de-ea4f1a68cc09 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:21.204524 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-36411f8c-c6c5-40de-a1de-ea4f1a68cc09 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.708032 Jul 31 01:27:21.205120 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1935/3839] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:20 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:21.233782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-40bb9f93-4cdb-466a-8f80-c94f6e56dada tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:21.234662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-40bb9f93-4cdb-466a-8f80-c94f6e56dada tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:21.248389 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40bb9f93-4cdb-466a-8f80-c94f6e56dada tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:21.249119 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40bb9f93-4cdb-466a-8f80-c94f6e56dada tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:21.250099 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40bb9f93-4cdb-466a-8f80-c94f6e56dada tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:21.253281 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40bb9f93-4cdb-466a-8f80-c94f6e56dada tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:21.794566 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-40bb9f93-4cdb-466a-8f80-c94f6e56dada tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:21.802112 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:21.811984 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-40bb9f93-4cdb-466a-8f80-c94f6e56dada tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 0.582081 Jul 31 01:27:21.819453 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1936/3840] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:21 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:27:21.842723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4fdfab74-9afb-4ec5-9313-8f587660a4f4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:21.843914 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4fdfab74-9afb-4ec5-9313-8f587660a4f4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:21.854876 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4fdfab74-9afb-4ec5-9313-8f587660a4f4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:21.855702 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4fdfab74-9afb-4ec5-9313-8f587660a4f4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:21.856765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4fdfab74-9afb-4ec5-9313-8f587660a4f4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:21.857376 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4fdfab74-9afb-4ec5-9313-8f587660a4f4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:21.945349 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b318162d-7658-44b4-91fa-0f518576960e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:21.956182 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b318162d-7658-44b4-91fa-0f518576960e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1509 microversion: 2.1 time: 0.824581 Jul 31 01:27:21.956771 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1905/3841] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:21 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1509 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:22.149040 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b6cbae6a-107f-46d8-b6e4-24bca0583a86 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:22.149854 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b6cbae6a-107f-46d8-b6e4-24bca0583a86 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:22.151939 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:22.163096 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6cbae6a-107f-46d8-b6e4-24bca0583a86 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:22.163611 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6cbae6a-107f-46d8-b6e4-24bca0583a86 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:22.164621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6cbae6a-107f-46d8-b6e4-24bca0583a86 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:22.165077 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6cbae6a-107f-46d8-b6e4-24bca0583a86 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:23.040738 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4fdfab74-9afb-4ec5-9313-8f587660a4f4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:23.048766 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4fdfab74-9afb-4ec5-9313-8f587660a4f4 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 1.215347 Jul 31 01:27:23.049572 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1937/3842] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:21 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:23.069703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-88649b74-7ea9-428f-ab8f-65fb2eda572e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:23.070636 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-88649b74-7ea9-428f-ab8f-65fb2eda572e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:23.079894 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88649b74-7ea9-428f-ab8f-65fb2eda572e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:23.080623 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88649b74-7ea9-428f-ab8f-65fb2eda572e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:23.081451 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88649b74-7ea9-428f-ab8f-65fb2eda572e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:23.081907 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88649b74-7ea9-428f-ab8f-65fb2eda572e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:23.463411 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b6cbae6a-107f-46d8-b6e4-24bca0583a86 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:23.472865 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:23.476564 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b6cbae6a-107f-46d8-b6e4-24bca0583a86 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1724 microversion: 2.1 time: 1.332102 Jul 31 01:27:23.478235 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1906/3843] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:22 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1724 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:23.502237 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-775469a2-8198-4d89-b207-9c4f721b732c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:23.502957 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-775469a2-8198-4d89-b207-9c4f721b732c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:23.525609 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-775469a2-8198-4d89-b207-9c4f721b732c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:23.526608 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-775469a2-8198-4d89-b207-9c4f721b732c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:23.529873 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-775469a2-8198-4d89-b207-9c4f721b732c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:23.531583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-775469a2-8198-4d89-b207-9c4f721b732c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:23.573122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-775469a2-8198-4d89-b207-9c4f721b732c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lazy-loading 'flavor' on Instance uuid e7f0abec-dd05-4dff-8f15-b56464346b06 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:27:23.661993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-88649b74-7ea9-428f-ab8f-65fb2eda572e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:23.672150 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-88649b74-7ea9-428f-ab8f-65fb2eda572e tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1509 microversion: 2.1 time: 0.607249 Jul 31 01:27:23.673569 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1938/3844] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:23 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1509 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:23.711384 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-775469a2-8198-4d89-b207-9c4f721b732c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 202 len: 0 microversion: 2.1 time: 0.230196 Jul 31 01:27:23.719846 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1907/3845] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:27:23 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:27:23.729734 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fa9bea9f-ae5c-4ff1-8c3c-1414165eafe8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:23.731573 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fa9bea9f-ae5c-4ff1-8c3c-1414165eafe8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:23.741258 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fa9bea9f-ae5c-4ff1-8c3c-1414165eafe8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:23.742165 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fa9bea9f-ae5c-4ff1-8c3c-1414165eafe8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:23.744248 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fa9bea9f-ae5c-4ff1-8c3c-1414165eafe8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:23.744934 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fa9bea9f-ae5c-4ff1-8c3c-1414165eafe8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:24.419331 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fa9bea9f-ae5c-4ff1-8c3c-1414165eafe8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:24.443769 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fa9bea9f-ae5c-4ff1-8c3c-1414165eafe8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1678 microversion: 2.1 time: 0.720509 Jul 31 01:27:24.445432 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1939/3846] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:23 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1678 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:24.508164 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e8943dda-957a-415f-8c4c-8b3d1221a5f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:24.510146 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e8943dda-957a-415f-8c4c-8b3d1221a5f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:24.543515 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8943dda-957a-415f-8c4c-8b3d1221a5f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:24.545923 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8943dda-957a-415f-8c4c-8b3d1221a5f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:24.550710 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8943dda-957a-415f-8c4c-8b3d1221a5f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:24.553340 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8943dda-957a-415f-8c4c-8b3d1221a5f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:24.698713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f0537956-8a66-4eda-84df-894e42d2bbd4 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:24.699959 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f0537956-8a66-4eda-84df-894e42d2bbd4 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:24.710123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0537956-8a66-4eda-84df-894e42d2bbd4 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:24.713052 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0537956-8a66-4eda-84df-894e42d2bbd4 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:24.716382 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0537956-8a66-4eda-84df-894e42d2bbd4 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:24.717060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0537956-8a66-4eda-84df-894e42d2bbd4 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:25.421666 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f0537956-8a66-4eda-84df-894e42d2bbd4 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:25.432319 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f0537956-8a66-4eda-84df-894e42d2bbd4 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1509 microversion: 2.1 time: 0.737482 Jul 31 01:27:25.440050 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1940/3847] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:24 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1509 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:25.456416 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8cc2aea9-7008-4244-87ba-b6823acb9103 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1768514592", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:25.494141 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e8943dda-957a-415f-8c4c-8b3d1221a5f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:25.506269 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e8943dda-957a-415f-8c4c-8b3d1221a5f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1724 microversion: 2.1 time: 1.006146 Jul 31 01:27:25.519374 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1908/3848] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:24 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1724 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:25.520177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-22505103-632a-47d7-aa1e-b24c86d2bc6c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:25.520342 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-22505103-632a-47d7-aa1e-b24c86d2bc6c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:25.567404 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22505103-632a-47d7-aa1e-b24c86d2bc6c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:25.569664 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22505103-632a-47d7-aa1e-b24c86d2bc6c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:25.580283 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-8cc2aea9-7008-4244-87ba-b6823acb9103 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] validate_networks() for [('a8f62231-6d25-478b-9cd8-a54df5b9a877', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:27:25.586803 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22505103-632a-47d7-aa1e-b24c86d2bc6c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:25.587546 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22505103-632a-47d7-aa1e-b24c86d2bc6c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:26.709248 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-22505103-632a-47d7-aa1e-b24c86d2bc6c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:26.771154 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-22505103-632a-47d7-aa1e-b24c86d2bc6c tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1661 microversion: 2.1 time: 1.237282 Jul 31 01:27:26.772135 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1909/3849] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:25 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1661 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:26.782525 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-c0546ba5-ffba-43df-8141-715041d2d471 req-ddbb2690-f100-47e6-9ce0-11e98db515d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b82c2878-c1d7-43a4-9b3e-38af00bda820", "name": "network-vif-deleted", "tag": "d4f63d82-0064-4811-bcb1-b78632f9ea21"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:26.811919 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c0546ba5-ffba-43df-8141-715041d2d471 req-ddbb2690-f100-47e6-9ce0-11e98db515d6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:26.813045 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c0546ba5-ffba-43df-8141-715041d2d471 req-ddbb2690-f100-47e6-9ce0-11e98db515d6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:26.848657 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-c0546ba5-ffba-43df-8141-715041d2d471 req-ddbb2690-f100-47e6-9ce0-11e98db515d6 service nova] Creating event network-vif-deleted:d4f63d82-0064-4811-bcb1-b78632f9ea21 for instance b82c2878-c1d7-43a4-9b3e-38af00bda820 on n-h1-master-1 Jul 31 01:27:26.902644 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-c0546ba5-ffba-43df-8141-715041d2d471 req-ddbb2690-f100-47e6-9ce0-11e98db515d6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128862 Jul 31 01:27:26.905283 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1910/3850] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:26.923872 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-23ec182a-b63b-4141-a604-d911087b3284 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:26.953915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-23ec182a-b63b-4141-a604-d911087b3284 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:26.983685 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23ec182a-b63b-4141-a604-d911087b3284 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:26.985966 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23ec182a-b63b-4141-a604-d911087b3284 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:26.988763 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23ec182a-b63b-4141-a604-d911087b3284 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:26.990069 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23ec182a-b63b-4141-a604-d911087b3284 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:27.087438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23ec182a-b63b-4141-a604-d911087b3284 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:27.088893 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23ec182a-b63b-4141-a604-d911087b3284 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:27.091456 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-23ec182a-b63b-4141-a604-d911087b3284 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lazy-loading 'fault' on Instance uuid b82c2878-c1d7-43a4-9b3e-38af00bda820 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:27:27.368926 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-23ec182a-b63b-4141-a604-d911087b3284 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97473f7af4d943f983d96a23dac67090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9939750cc4074991b1da344bf6e18c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:27.381219 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-23ec182a-b63b-4141-a604-d911087b3284 tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 200 len: 1312 microversion: 2.1 time: 0.472838 Jul 31 01:27:27.381826 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1911/3851] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:26 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 1312 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:27.393324 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-338fbab9-55e7-4f32-a300-45c02449b477 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:27.393971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-338fbab9-55e7-4f32-a300-45c02449b477 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:27.409456 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-338fbab9-55e7-4f32-a300-45c02449b477 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:27.409925 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-338fbab9-55e7-4f32-a300-45c02449b477 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:27.411666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-338fbab9-55e7-4f32-a300-45c02449b477 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:27.412775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-338fbab9-55e7-4f32-a300-45c02449b477 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:27.637724 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8cc2aea9-7008-4244-87ba-b6823acb9103 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:27:27.639332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8cc2aea9-7008-4244-87ba-b6823acb9103 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:27:27.640138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8cc2aea9-7008-4244-87ba-b6823acb9103 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:27:27.640752 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8cc2aea9-7008-4244-87ba-b6823acb9103 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:27:27.641366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8cc2aea9-7008-4244-87ba-b6823acb9103 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:27:27.657856 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8cc2aea9-7008-4244-87ba-b6823acb9103 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:27.662000 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8cc2aea9-7008-4244-87ba-b6823acb9103 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:27.663850 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8cc2aea9-7008-4244-87ba-b6823acb9103 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:27.665120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8cc2aea9-7008-4244-87ba-b6823acb9103 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:27.702826 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-8cc2aea9-7008-4244-87ba-b6823acb9103 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Getting quotas for project c609eaf96fc84008b10c26b3f56edd69. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:27:27.709790 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-8cc2aea9-7008-4244-87ba-b6823acb9103 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Getting quotas for user df0850646f5b4fdeabc4d50297626e27 and project c609eaf96fc84008b10c26b3f56edd69. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:27:27.728825 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8cc2aea9-7008-4244-87ba-b6823acb9103 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:27:27.731639 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8cc2aea9-7008-4244-87ba-b6823acb9103 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:27:27.811754 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-338fbab9-55e7-4f32-a300-45c02449b477 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:27.825200 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-338fbab9-55e7-4f32-a300-45c02449b477 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1730 microversion: 2.1 time: 0.440837 Jul 31 01:27:27.841640 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1912/3852] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:27 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1730 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:27.848494 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1c56b894-cbf2-435e-a1a6-006e34be8cc1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:27.849313 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1c56b894-cbf2-435e-a1a6-006e34be8cc1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:27.858240 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c56b894-cbf2-435e-a1a6-006e34be8cc1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:27.858916 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c56b894-cbf2-435e-a1a6-006e34be8cc1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:27.860156 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c56b894-cbf2-435e-a1a6-006e34be8cc1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:27.862748 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c56b894-cbf2-435e-a1a6-006e34be8cc1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:27.871443 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8cc2aea9-7008-4244-87ba-b6823acb9103 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.429847 Jul 31 01:27:27.876350 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1941/3853] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:27:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:27:27.886165 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3c4f5a84-f486-4533-af17-c94e5a25d4f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:27.887846 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3c4f5a84-f486-4533-af17-c94e5a25d4f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:27.900958 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c4f5a84-f486-4533-af17-c94e5a25d4f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:27.906629 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c4f5a84-f486-4533-af17-c94e5a25d4f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:27.909225 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c4f5a84-f486-4533-af17-c94e5a25d4f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:27.912765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c4f5a84-f486-4533-af17-c94e5a25d4f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:28.013596 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1c56b894-cbf2-435e-a1a6-006e34be8cc1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action" status: 202 len: 0 microversion: 2.1 time: 0.170947 Jul 31 01:27:28.014497 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1913/3854] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:27:27 2022] POST /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:27:28.038719 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9077ee5d-9f88-4989-a750-80e19866ed31 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:28.047137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9077ee5d-9f88-4989-a750-80e19866ed31 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:28.211750 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9077ee5d-9f88-4989-a750-80e19866ed31 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:28.220410 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9077ee5d-9f88-4989-a750-80e19866ed31 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1225 microversion: 2.1 time: 0.189010 Jul 31 01:27:28.224055 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1914/3855] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:28 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1225 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:28.237765 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d0556ec3-261b-40c2-afce-90df64914aae tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:28.238872 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d0556ec3-261b-40c2-afce-90df64914aae tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:28.253357 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3c4f5a84-f486-4533-af17-c94e5a25d4f5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.375338 Jul 31 01:27:28.253960 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1942/3856] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:27:27 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-interface => generated 284 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:28.262695 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0556ec3-261b-40c2-afce-90df64914aae tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:28.264305 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0556ec3-261b-40c2-afce-90df64914aae tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:28.267353 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0556ec3-261b-40c2-afce-90df64914aae tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:28.268065 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0556ec3-261b-40c2-afce-90df64914aae tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:28.408543 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6d9cfd7f-37d8-4a88-bc93-e3518542d0da tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:28.409443 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6d9cfd7f-37d8-4a88-bc93-e3518542d0da tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] [instance: b82c2878-c1d7-43a4-9b3e-38af00bda820] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:28.422956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d9cfd7f-37d8-4a88-bc93-e3518542d0da tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:28.423456 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d9cfd7f-37d8-4a88-bc93-e3518542d0da tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:28.424260 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d9cfd7f-37d8-4a88-bc93-e3518542d0da tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:28.429446 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d9cfd7f-37d8-4a88-bc93-e3518542d0da tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:28.478481 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-6d9cfd7f-37d8-4a88-bc93-e3518542d0da tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] HTTP exception thrown: Instance b82c2878-c1d7-43a4-9b3e-38af00bda820 could not be found. Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6d9cfd7f-37d8-4a88-bc93-e3518542d0da tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Request method failure captured: Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 HTTP/1.1 Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5doqt5_WZbRBN8SCuArzRsOEEvmiZzwy2aLNE0i9eguhjHgF_DPtzNa8MHDophFXbcFfEjCALoyNKUbh336zMS4HLxXKmhTG2ZMNBXxg585DPN-8WMuWDb4rNx2VpkSipnVmpwb1CKRJX-Fb6w_QEkwq6SYkpcXID4mdrN39dKVy87o Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 9939750cc4074991b1da344bf6e18c67 Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1097152639 Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9939750cc4074991b1da344bf6e18c67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/9939750cc4074991b1da344bf6e18c67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/9939750cc4074991b1da344bf6e18c67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_9939750cc4074991b1da344bf6e18c67", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1097152639 Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 9939750cc4074991b1da344bf6e18c67 Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1097152639 Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerRescueTestJSONUnderV235-1097152639-project Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 97473f7af4d943f983d96a23dac67090 Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1097152639-project Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: exception: Instance b82c2878-c1d7-43a4-9b3e-38af00bda820 could not be found. Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'b82c2878-c1d7-43a4-9b3e-38af00bda820'} Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b82c2878-c1d7-43a4-9b3e-38af00bda820 could not be found. Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b82c2878-c1d7-43a4-9b3e-38af00bda820 could not be found. Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:28.481117 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:28.484856 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:28.484856 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:28.484856 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:28.484856 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:28.484856 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:27:28.484856 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:27:28.484856 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b82c2878-c1d7-43a4-9b3e-38af00bda820 could not be found. Jul 31 01:27:28.484856 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:28.484856 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6d9cfd7f-37d8-4a88-bc93-e3518542d0da tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] Returning 404 to user: Instance b82c2878-c1d7-43a4-9b3e-38af00bda820 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:27:28.484856 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6d9cfd7f-37d8-4a88-bc93-e3518542d0da tempest-ServerRescueTestJSONUnderV235-1097152639 tempest-ServerRescueTestJSONUnderV235-1097152639-project] 10.222.0.45 "GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820" status: 404 len: 111 microversion: 2.1 time: 0.079548 Jul 31 01:27:28.484856 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1943/3857] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:28 2022] GET /compute/v2.1/servers/b82c2878-c1d7-43a4-9b3e-38af00bda820 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:27:29.245861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8ea966a9-972f-4ad2-829f-c57a714d86e0 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:29.246551 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8ea966a9-972f-4ad2-829f-c57a714d86e0 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:29.326720 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d0556ec3-261b-40c2-afce-90df64914aae tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:29.334462 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d0556ec3-261b-40c2-afce-90df64914aae tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1667 microversion: 2.1 time: 1.108865 Jul 31 01:27:29.339996 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1915/3858] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:28 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1667 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:29.444104 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8ea966a9-972f-4ad2-829f-c57a714d86e0 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:29.468949 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8ea966a9-972f-4ad2-829f-c57a714d86e0 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1225 microversion: 2.1 time: 0.226920 Jul 31 01:27:29.470960 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1944/3859] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:29 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1225 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:27:30.363454 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-257478c2-0b73-458f-81a0-9acc99db6848 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:30.364129 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-257478c2-0b73-458f-81a0-9acc99db6848 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:30.381772 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-257478c2-0b73-458f-81a0-9acc99db6848 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:30.382237 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-257478c2-0b73-458f-81a0-9acc99db6848 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:30.383089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-257478c2-0b73-458f-81a0-9acc99db6848 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:30.383570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-257478c2-0b73-458f-81a0-9acc99db6848 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:30.498472 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d3a62b0f-0169-46a3-9023-d23e143f24ba tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:30.499849 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d3a62b0f-0169-46a3-9023-d23e143f24ba tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:30.525540 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3a62b0f-0169-46a3-9023-d23e143f24ba tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:30.527158 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3a62b0f-0169-46a3-9023-d23e143f24ba tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:30.531163 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3a62b0f-0169-46a3-9023-d23e143f24ba tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:30.536639 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3a62b0f-0169-46a3-9023-d23e143f24ba tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:31.207728 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d3a62b0f-0169-46a3-9023-d23e143f24ba tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:31.236069 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d3a62b0f-0169-46a3-9023-d23e143f24ba tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1295 microversion: 2.1 time: 0.746992 Jul 31 01:27:31.244437 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1945/3860] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:30 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1295 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:27:31.263993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-257478c2-0b73-458f-81a0-9acc99db6848 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:31.274446 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-257478c2-0b73-458f-81a0-9acc99db6848 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1667 microversion: 2.1 time: 0.915310 Jul 31 01:27:31.288768 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1916/3861] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:30 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1667 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:32.264786 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0b267b42-18d2-46d0-ada6-cb892eb975e4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:32.266417 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0b267b42-18d2-46d0-ada6-cb892eb975e4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:32.275145 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b267b42-18d2-46d0-ada6-cb892eb975e4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:32.283703 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b267b42-18d2-46d0-ada6-cb892eb975e4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:32.288930 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b267b42-18d2-46d0-ada6-cb892eb975e4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:32.289752 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b267b42-18d2-46d0-ada6-cb892eb975e4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:32.298342 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-cc0af78a-d0ac-4360-9b10-a515578cbebd req-fa430140-9ba5-403c-8e3d-c7f2445d9bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1c5a15-18aa-437c-a4fb-77eaaf234ac0", "tag": "6f32f8d1-4311-494f-a106-51bb2bbad03f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:32.303992 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:32.318392 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-cc0af78a-d0ac-4360-9b10-a515578cbebd req-fa430140-9ba5-403c-8e3d-c7f2445d9bb6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:32.322591 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-cc0af78a-d0ac-4360-9b10-a515578cbebd req-fa430140-9ba5-403c-8e3d-c7f2445d9bb6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:32.347155 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-cc0af78a-d0ac-4360-9b10-a515578cbebd req-fa430140-9ba5-403c-8e3d-c7f2445d9bb6 service nova] Creating event network-changed:6f32f8d1-4311-494f-a106-51bb2bbad03f for instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 on n-h1-master-1 Jul 31 01:27:32.365457 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-cc0af78a-d0ac-4360-9b10-a515578cbebd req-fa430140-9ba5-403c-8e3d-c7f2445d9bb6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.373195 Jul 31 01:27:32.366081 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1946/3862] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:32.380581 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7ed5e6e8-cccf-4a5a-9a47-21bf3c6ddc09 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:32.386383 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7ed5e6e8-cccf-4a5a-9a47-21bf3c6ddc09 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:32.408594 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ed5e6e8-cccf-4a5a-9a47-21bf3c6ddc09 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:32.409349 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ed5e6e8-cccf-4a5a-9a47-21bf3c6ddc09 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:32.410467 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ed5e6e8-cccf-4a5a-9a47-21bf3c6ddc09 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:32.411899 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ed5e6e8-cccf-4a5a-9a47-21bf3c6ddc09 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:33.877949 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7ed5e6e8-cccf-4a5a-9a47-21bf3c6ddc09 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:33.894631 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7ed5e6e8-cccf-4a5a-9a47-21bf3c6ddc09 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 1.526933 Jul 31 01:27:33.903170 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1947/3863] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:32 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:33.928138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ea649235-2fdb-4a40-9084-6215b7a4c720 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:33.929299 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ea649235-2fdb-4a40-9084-6215b7a4c720 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:33.947673 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ea649235-2fdb-4a40-9084-6215b7a4c720 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:33.949958 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ea649235-2fdb-4a40-9084-6215b7a4c720 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:33.952275 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ea649235-2fdb-4a40-9084-6215b7a4c720 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:33.953958 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ea649235-2fdb-4a40-9084-6215b7a4c720 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:34.008824 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0b267b42-18d2-46d0-ada6-cb892eb975e4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:34.020914 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0b267b42-18d2-46d0-ada6-cb892eb975e4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1325 microversion: 2.1 time: 1.759014 Jul 31 01:27:34.022675 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1917/3864] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:32 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1325 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:27:34.432130 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-c605652e-e381-4163-92e0-0804bee2ba55 req-8556fc9a-f5e1-4cd4-bd6a-8ec854007988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1c5a15-18aa-437c-a4fb-77eaaf234ac0", "tag": "6f32f8d1-4311-494f-a106-51bb2bbad03f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:34.484337 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c605652e-e381-4163-92e0-0804bee2ba55 req-8556fc9a-f5e1-4cd4-bd6a-8ec854007988 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:34.485402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c605652e-e381-4163-92e0-0804bee2ba55 req-8556fc9a-f5e1-4cd4-bd6a-8ec854007988 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:34.524161 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-c605652e-e381-4163-92e0-0804bee2ba55 req-8556fc9a-f5e1-4cd4-bd6a-8ec854007988 service nova] Creating event network-changed:6f32f8d1-4311-494f-a106-51bb2bbad03f for instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 on n-h1-master-1 Jul 31 01:27:34.533890 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-c605652e-e381-4163-92e0-0804bee2ba55 req-8556fc9a-f5e1-4cd4-bd6a-8ec854007988 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107047 Jul 31 01:27:34.534939 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1918/3865] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:27:35.050250 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5df1b448-8d06-4e50-a660-b6939933402e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:35.051078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5df1b448-8d06-4e50-a660-b6939933402e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:35.064430 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5df1b448-8d06-4e50-a660-b6939933402e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:35.064899 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5df1b448-8d06-4e50-a660-b6939933402e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:35.065716 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5df1b448-8d06-4e50-a660-b6939933402e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:35.069737 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5df1b448-8d06-4e50-a660-b6939933402e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:35.230467 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ea649235-2fdb-4a40-9084-6215b7a4c720 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:35.245870 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ea649235-2fdb-4a40-9084-6215b7a4c720 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1670 microversion: 2.1 time: 1.318905 Jul 31 01:27:35.247368 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1948/3866] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:33 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1670 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:35.276596 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-40d47127-ef35-40ec-9d5f-0f7af7c0ab33 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:35.278476 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-40d47127-ef35-40ec-9d5f-0f7af7c0ab33 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:35.285522 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40d47127-ef35-40ec-9d5f-0f7af7c0ab33 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:35.286296 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40d47127-ef35-40ec-9d5f-0f7af7c0ab33 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:35.288626 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40d47127-ef35-40ec-9d5f-0f7af7c0ab33 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:35.289392 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40d47127-ef35-40ec-9d5f-0f7af7c0ab33 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:35.358740 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-40d47127-ef35-40ec-9d5f-0f7af7c0ab33 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:27:35.371433 n-d-master-1 devstack@n-api.service[119475]: INFO nova.compute.api [None req-40d47127-ef35-40ec-9d5f-0f7af7c0ab33 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Working on deleting snapshot 1da6fbad-d4cc-4cc1-90ef-f80eff83488c from shelved instance... Jul 31 01:27:35.943512 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5df1b448-8d06-4e50-a660-b6939933402e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:35.958870 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5df1b448-8d06-4e50-a660-b6939933402e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1325 microversion: 2.1 time: 0.910046 Jul 31 01:27:35.960310 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1919/3867] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:35 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1325 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:27:36.583797 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-40d47127-ef35-40ec-9d5f-0f7af7c0ab33 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Doing local delete in cell b79bbab3-22fe-4aca-b591-999750c84479(cell1) {{(pid=119475) _delete /opt/stack/nova/nova/compute/api.py:2491}} Jul 31 01:27:36.584876 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40d47127-ef35-40ec-9d5f-0f7af7c0ab33 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:36.585019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40d47127-ef35-40ec-9d5f-0f7af7c0ab33 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:36.585480 n-d-master-1 devstack@n-api.service[119475]: INFO nova.compute.api [None req-40d47127-ef35-40ec-9d5f-0f7af7c0ab33 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 31 01:27:36.594933 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-40d47127-ef35-40ec-9d5f-0f7af7c0ab33 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] deallocate_for_instance() {{(pid=119475) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 31 01:27:36.717794 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-89e3c624-c4bf-4f60-a493-05c0672c535d req-8d7260ea-a8f3-4915-b1ec-28f6e2838650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "714af515-1e35-4ff6-a184-5b246b892425", "tag": "de708352-6ae7-4798-a5ea-b0d89196f1a9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:36.762235 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-89e3c624-c4bf-4f60-a493-05c0672c535d req-8d7260ea-a8f3-4915-b1ec-28f6e2838650 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:36.764375 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-89e3c624-c4bf-4f60-a493-05c0672c535d req-8d7260ea-a8f3-4915-b1ec-28f6e2838650 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:36.818052 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-89e3c624-c4bf-4f60-a493-05c0672c535d req-8d7260ea-a8f3-4915-b1ec-28f6e2838650 service nova] Creating event network-changed:de708352-6ae7-4798-a5ea-b0d89196f1a9 for instance 714af515-1e35-4ff6-a184-5b246b892425 on n-h2-master-1 Jul 31 01:27:36.826624 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-89e3c624-c4bf-4f60-a493-05c0672c535d req-8d7260ea-a8f3-4915-b1ec-28f6e2838650 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117255 Jul 31 01:27:36.827819 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1920/3868] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:27:36.987419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4289521d-04d2-4cc9-82a1-54d84b77dec5 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:36.988394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4289521d-04d2-4cc9-82a1-54d84b77dec5 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:36.999759 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4289521d-04d2-4cc9-82a1-54d84b77dec5 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:37.000809 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4289521d-04d2-4cc9-82a1-54d84b77dec5 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:37.002106 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4289521d-04d2-4cc9-82a1-54d84b77dec5 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:37.002772 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4289521d-04d2-4cc9-82a1-54d84b77dec5 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:37.685126 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:38.220076 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:38.282907 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4289521d-04d2-4cc9-82a1-54d84b77dec5 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:38.291894 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4289521d-04d2-4cc9-82a1-54d84b77dec5 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1325 microversion: 2.1 time: 1.310976 Jul 31 01:27:38.303607 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1921/3869] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:36 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1325 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:39.005455 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 01:27:39.005646 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 01:27:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 01:27:39.330891 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-febade9b-49f8-48c5-8274-e1fbed341b85 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:39.332403 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-febade9b-49f8-48c5-8274-e1fbed341b85 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:39.342360 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-febade9b-49f8-48c5-8274-e1fbed341b85 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:39.343224 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-febade9b-49f8-48c5-8274-e1fbed341b85 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:39.353019 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-febade9b-49f8-48c5-8274-e1fbed341b85 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:39.353952 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-febade9b-49f8-48c5-8274-e1fbed341b85 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:39.450006 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=12 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:40.581498 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-febade9b-49f8-48c5-8274-e1fbed341b85 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:40.597283 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-febade9b-49f8-48c5-8274-e1fbed341b85 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1325 microversion: 2.1 time: 1.268264 Jul 31 01:27:40.600503 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1922/3870] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:39 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1325 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:27:40.604411 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-40d47127-ef35-40ec-9d5f-0f7af7c0ab33 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Updating instance_info_cache with network_info: [] {{(pid=119475) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 31 01:27:40.639179 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-8d137a89-231d-4f94-a1ea-38bb892db609 req-6f6bd964-c3f7-4230-94b1-08acdadd6514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c981f91-b847-4b1b-a3c3-4edc7a9221c3", "name": "network-vif-deleted", "tag": "8dc1db04-4278-481c-8fb7-ab59e918dc37"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:40.688304 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8d137a89-231d-4f94-a1ea-38bb892db609 req-6f6bd964-c3f7-4230-94b1-08acdadd6514 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:40.689490 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8d137a89-231d-4f94-a1ea-38bb892db609 req-6f6bd964-c3f7-4230-94b1-08acdadd6514 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:40.725239 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.compute.server_external_events [req-8d137a89-231d-4f94-a1ea-38bb892db609 req-6f6bd964-c3f7-4230-94b1-08acdadd6514 service nova] Unable to find a host for instance 3c981f91-b847-4b1b-a3c3-4edc7a9221c3. Dropping event network-vif-deleted {{(pid=119474) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 31 01:27:40.729425 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-8d137a89-231d-4f94-a1ea-38bb892db609 req-6f6bd964-c3f7-4230-94b1-08acdadd6514 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.096733 Jul 31 01:27:40.730780 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1923/3871] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 99 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 31 01:27:41.007990 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-40d47127-ef35-40ec-9d5f-0f7af7c0ab33 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 204 len: 0 microversion: 2.1 time: 5.736220 Jul 31 01:27:41.012263 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1949/3872] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:27:35 2022] DELETE /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 0 bytes in 5738 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:27:41.019606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ac75966d-acd3-45c6-9bd0-05c03e6cb9e2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:41.021445 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ac75966d-acd3-45c6-9bd0-05c03e6cb9e2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 3c981f91-b847-4b1b-a3c3-4edc7a9221c3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:41.042795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac75966d-acd3-45c6-9bd0-05c03e6cb9e2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:41.043397 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac75966d-acd3-45c6-9bd0-05c03e6cb9e2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:41.044157 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac75966d-acd3-45c6-9bd0-05c03e6cb9e2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:41.044597 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac75966d-acd3-45c6-9bd0-05c03e6cb9e2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:41.070710 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:41.072727 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-ac75966d-acd3-45c6-9bd0-05c03e6cb9e2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] HTTP exception thrown: Instance 3c981f91-b847-4b1b-a3c3-4edc7a9221c3 could not be found. Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ac75966d-acd3-45c6-9bd0-05c03e6cb9e2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Request method failure captured: Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 HTTP/1.1 Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dhkaGQR0CXWpGPAG4YiZIdd83eiYcwnrL_vFJ3yaYlDHK66u6nP96xvpo7ut6hmJeUxvAmVeOuG6fHMb0MynOrnbx53tSX29FKCgbTIvynvxRGnCTvg3yHoj2O8OMB7aoPhOzqFGyp1k3ddC6-5iirQ3GPjkps3ibXZR3HrXQFzSHc Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: da596310058e4248bf33465f387956f2 Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da596310058e4248bf33465f387956f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da596310058e4248bf33465f387956f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/da596310058e4248bf33465f387956f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_da596310058e4248bf33465f387956f2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: da596310058e4248bf33465f387956f2 Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerActionsTestJSON-1719297789-project Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 36a36dbb4f6c40a7bb69c8c3f747aaed Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerActionsTestJSON-1719297789-project Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 3c981f91-b847-4b1b-a3c3-4edc7a9221c3 could not be found. Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '3c981f91-b847-4b1b-a3c3-4edc7a9221c3'} Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c981f91-b847-4b1b-a3c3-4edc7a9221c3 could not be found. Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c981f91-b847-4b1b-a3c3-4edc7a9221c3 could not be found. Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:41.080254 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:41.088236 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:41.088236 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:41.088236 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:41.088236 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:27:41.088236 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:27:41.088236 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c981f91-b847-4b1b-a3c3-4edc7a9221c3 could not be found. Jul 31 01:27:41.088236 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:41.090709 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ac75966d-acd3-45c6-9bd0-05c03e6cb9e2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Returning 404 to user: Instance 3c981f91-b847-4b1b-a3c3-4edc7a9221c3 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:27:41.092436 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ac75966d-acd3-45c6-9bd0-05c03e6cb9e2 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3" status: 404 len: 111 microversion: 2.1 time: 0.078464 Jul 31 01:27:41.104757 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1924/3873] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:41 2022] GET /compute/v2.1/servers/3c981f91-b847-4b1b-a3c3-4edc7a9221c3 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:27:41.113608 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c3ab24e8-6071-417f-97e4-8d215ae49b2a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:41.114119 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c3ab24e8-6071-417f-97e4-8d215ae49b2a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:41.122754 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3ab24e8-6071-417f-97e4-8d215ae49b2a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:41.123216 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3ab24e8-6071-417f-97e4-8d215ae49b2a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:41.124039 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3ab24e8-6071-417f-97e4-8d215ae49b2a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:41.124491 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3ab24e8-6071-417f-97e4-8d215ae49b2a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:41.163856 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:41.186033 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c3ab24e8-6071-417f-97e4-8d215ae49b2a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:27:41.326999 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c3ab24e8-6071-417f-97e4-8d215ae49b2a tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 204 len: 0 microversion: 2.1 time: 0.216986 Jul 31 01:27:41.331007 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1950/3874] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:27:41 2022] DELETE /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:27:41.339978 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4144a063-8203-4061-b720-1f207a7a3635 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:41.340607 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4144a063-8203-4061-b720-1f207a7a3635 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:41.349279 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4144a063-8203-4061-b720-1f207a7a3635 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:41.356016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4144a063-8203-4061-b720-1f207a7a3635 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:41.356873 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4144a063-8203-4061-b720-1f207a7a3635 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:41.357323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4144a063-8203-4061-b720-1f207a7a3635 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:41.624003 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d8b51fde-2389-4b8f-9d6b-f52ed94642fa tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:41.624850 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d8b51fde-2389-4b8f-9d6b-f52ed94642fa tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:41.642801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8b51fde-2389-4b8f-9d6b-f52ed94642fa tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:41.643269 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8b51fde-2389-4b8f-9d6b-f52ed94642fa tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:41.648068 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8b51fde-2389-4b8f-9d6b-f52ed94642fa tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:41.649094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8b51fde-2389-4b8f-9d6b-f52ed94642fa tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:42.328545 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4144a063-8203-4061-b720-1f207a7a3635 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:42.342432 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4144a063-8203-4061-b720-1f207a7a3635 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1465 microversion: 2.1 time: 1.006305 Jul 31 01:27:42.348030 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1925/3875] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:41 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1465 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:42.901384 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d8b51fde-2389-4b8f-9d6b-f52ed94642fa tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:42.913060 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d8b51fde-2389-4b8f-9d6b-f52ed94642fa tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1325 microversion: 2.1 time: 1.294408 Jul 31 01:27:42.913679 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1951/3876] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:41 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1325 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:27:43.372334 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dc0f52aa-9004-4667-b43b-b66bfa62209d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:43.373152 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dc0f52aa-9004-4667-b43b-b66bfa62209d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:43.402013 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dc0f52aa-9004-4667-b43b-b66bfa62209d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:43.403662 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dc0f52aa-9004-4667-b43b-b66bfa62209d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:43.410241 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dc0f52aa-9004-4667-b43b-b66bfa62209d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:43.411865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dc0f52aa-9004-4667-b43b-b66bfa62209d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:43.761748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dc0f52aa-9004-4667-b43b-b66bfa62209d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:43.801732 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dc0f52aa-9004-4667-b43b-b66bfa62209d tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1465 microversion: 2.1 time: 0.434438 Jul 31 01:27:43.806778 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1926/3877] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:43 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1465 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:43.939784 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-85e56f50-e207-47e4-891b-502b7196de4c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:43.940999 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-85e56f50-e207-47e4-891b-502b7196de4c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:43.974220 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-85e56f50-e207-47e4-891b-502b7196de4c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:43.974693 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-85e56f50-e207-47e4-891b-502b7196de4c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:43.975970 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-85e56f50-e207-47e4-891b-502b7196de4c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:43.977671 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-85e56f50-e207-47e4-891b-502b7196de4c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:44.379557 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-33c91476-859b-42dc-8623-77c2a66803ec tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-458282641", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:44.389213 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-85e56f50-e207-47e4-891b-502b7196de4c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:44.402749 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-85e56f50-e207-47e4-891b-502b7196de4c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1325 microversion: 2.1 time: 0.467211 Jul 31 01:27:44.406315 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1952/3878] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:43 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1325 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:27:44.433136 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2f705a64-f5b8-473f-9523-1fb2dfa5bbcc req-71d09339-0524-482c-9b56-afc5a986a290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714af515-1e35-4ff6-a184-5b246b892425", "name": "network-vif-plugged", "status": "completed", "tag": "de708352-6ae7-4798-a5ea-b0d89196f1a9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:44.461485 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2f705a64-f5b8-473f-9523-1fb2dfa5bbcc req-71d09339-0524-482c-9b56-afc5a986a290 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:44.462766 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2f705a64-f5b8-473f-9523-1fb2dfa5bbcc req-71d09339-0524-482c-9b56-afc5a986a290 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:44.498613 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2f705a64-f5b8-473f-9523-1fb2dfa5bbcc req-71d09339-0524-482c-9b56-afc5a986a290 service nova] Creating event network-vif-plugged:de708352-6ae7-4798-a5ea-b0d89196f1a9 for instance 714af515-1e35-4ff6-a184-5b246b892425 on n-h2-master-1 Jul 31 01:27:44.520476 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-33c91476-859b-42dc-8623-77c2a66803ec tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] validate_networks() for [('045ea8ff-463e-40b5-b75b-322b143e9807', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:27:44.534594 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2f705a64-f5b8-473f-9523-1fb2dfa5bbcc req-71d09339-0524-482c-9b56-afc5a986a290 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113281 Jul 31 01:27:44.535591 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1953/3879] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:44.831328 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e6282425-add9-4154-969e-c805971888eb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:44.832700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e6282425-add9-4154-969e-c805971888eb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:44.846108 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6282425-add9-4154-969e-c805971888eb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:44.859016 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6282425-add9-4154-969e-c805971888eb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:44.860810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6282425-add9-4154-969e-c805971888eb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:44.862837 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6282425-add9-4154-969e-c805971888eb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:45.100424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e6282425-add9-4154-969e-c805971888eb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:45.124757 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e6282425-add9-4154-969e-c805971888eb tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1465 microversion: 2.1 time: 0.299220 Jul 31 01:27:45.129732 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1954/3880] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:44 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1465 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:45.433292 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f2827a05-60db-4bfc-935f-63a6e80e9894 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:45.434990 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f2827a05-60db-4bfc-935f-63a6e80e9894 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:45.450118 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2827a05-60db-4bfc-935f-63a6e80e9894 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:45.451172 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2827a05-60db-4bfc-935f-63a6e80e9894 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:45.452368 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2827a05-60db-4bfc-935f-63a6e80e9894 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:45.452983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2827a05-60db-4bfc-935f-63a6e80e9894 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:45.552371 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-33c91476-859b-42dc-8623-77c2a66803ec tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:27:45.553561 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-33c91476-859b-42dc-8623-77c2a66803ec tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:27:45.554471 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-33c91476-859b-42dc-8623-77c2a66803ec tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:27:45.555936 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-33c91476-859b-42dc-8623-77c2a66803ec tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:27:45.557115 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-33c91476-859b-42dc-8623-77c2a66803ec tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:27:45.607016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33c91476-859b-42dc-8623-77c2a66803ec tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:45.612162 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33c91476-859b-42dc-8623-77c2a66803ec tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:45.615439 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33c91476-859b-42dc-8623-77c2a66803ec tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:45.616711 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33c91476-859b-42dc-8623-77c2a66803ec tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:45.738313 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-33c91476-859b-42dc-8623-77c2a66803ec tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Getting quotas for project 2d307769cdf8430a81a78a4fed8a539c. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:27:45.753743 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-33c91476-859b-42dc-8623-77c2a66803ec tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Getting quotas for user 316ccc283b9047a8a5e3463731025a11 and project 2d307769cdf8430a81a78a4fed8a539c. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:27:45.778632 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-33c91476-859b-42dc-8623-77c2a66803ec tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:27:45.781910 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-33c91476-859b-42dc-8623-77c2a66803ec tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:27:45.874106 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-33c91476-859b-42dc-8623-77c2a66803ec tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.627237 Jul 31 01:27:45.874820 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f2827a05-60db-4bfc-935f-63a6e80e9894 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:45.875108 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1927/3881] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:27:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:27:45.890385 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-45ee4406-09a2-418c-9826-d9ac47cf5db2 req-4d225ae9-c13c-4d5f-a11e-a6f3ed11b9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e2b815f-54aa-47b6-91cf-6ca472620070", "name": "network-vif-deleted", "tag": "45220733-bc7c-4188-8a14-14203dd2b136"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:45.898884 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f2827a05-60db-4bfc-935f-63a6e80e9894 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1325 microversion: 2.1 time: 0.471591 Jul 31 01:27:45.902665 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1955/3882] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:45 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1325 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:27:45.921580 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d742af4d-de48-428b-a395-c2d2be8632c9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:45.921892 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-45ee4406-09a2-418c-9826-d9ac47cf5db2 req-4d225ae9-c13c-4d5f-a11e-a6f3ed11b9e4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:45.922541 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-45ee4406-09a2-418c-9826-d9ac47cf5db2 req-4d225ae9-c13c-4d5f-a11e-a6f3ed11b9e4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:45.927743 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d742af4d-de48-428b-a395-c2d2be8632c9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:45.963516 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-45ee4406-09a2-418c-9826-d9ac47cf5db2 req-4d225ae9-c13c-4d5f-a11e-a6f3ed11b9e4 service nova] Creating event network-vif-deleted:45220733-bc7c-4188-8a14-14203dd2b136 for instance 1e2b815f-54aa-47b6-91cf-6ca472620070 on n-h2-master-1 Jul 31 01:27:45.976067 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-45ee4406-09a2-418c-9826-d9ac47cf5db2 req-4d225ae9-c13c-4d5f-a11e-a6f3ed11b9e4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099617 Jul 31 01:27:45.981326 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1928/3883] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:46.076084 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d742af4d-de48-428b-a395-c2d2be8632c9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:46.087189 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d742af4d-de48-428b-a395-c2d2be8632c9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1216 microversion: 2.1 time: 0.183350 Jul 31 01:27:46.099389 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1956/3884] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:45 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1216 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:46.151560 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fb2cb4bd-7209-4eeb-83fb-e7675c0dbbec tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:46.152556 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fb2cb4bd-7209-4eeb-83fb-e7675c0dbbec tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:46.174210 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb2cb4bd-7209-4eeb-83fb-e7675c0dbbec tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:46.176304 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb2cb4bd-7209-4eeb-83fb-e7675c0dbbec tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:46.178143 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb2cb4bd-7209-4eeb-83fb-e7675c0dbbec tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:46.179955 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb2cb4bd-7209-4eeb-83fb-e7675c0dbbec tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:46.269155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb2cb4bd-7209-4eeb-83fb-e7675c0dbbec tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:46.269825 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb2cb4bd-7209-4eeb-83fb-e7675c0dbbec tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:46.270630 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-fb2cb4bd-7209-4eeb-83fb-e7675c0dbbec tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lazy-loading 'fault' on Instance uuid 1e2b815f-54aa-47b6-91cf-6ca472620070 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:27:46.335625 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fb2cb4bd-7209-4eeb-83fb-e7675c0dbbec tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:46.348537 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fb2cb4bd-7209-4eeb-83fb-e7675c0dbbec tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 200 len: 1304 microversion: 2.1 time: 0.202077 Jul 31 01:27:46.350080 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1929/3885] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:46 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 1304 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:46.922789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ce6545b8-708d-41b5-aed2-507ed4330c04 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:46.923992 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ce6545b8-708d-41b5-aed2-507ed4330c04 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:46.943616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce6545b8-708d-41b5-aed2-507ed4330c04 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:46.944373 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce6545b8-708d-41b5-aed2-507ed4330c04 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:46.946561 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce6545b8-708d-41b5-aed2-507ed4330c04 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:46.947428 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce6545b8-708d-41b5-aed2-507ed4330c04 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:47.129113 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b8fcacf6-f362-4e21-ac6c-3a0fcb79ea8f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:47.129743 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b8fcacf6-f362-4e21-ac6c-3a0fcb79ea8f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:47.139046 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b8fcacf6-f362-4e21-ac6c-3a0fcb79ea8f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:47.139823 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b8fcacf6-f362-4e21-ac6c-3a0fcb79ea8f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:47.142095 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b8fcacf6-f362-4e21-ac6c-3a0fcb79ea8f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:47.142860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b8fcacf6-f362-4e21-ac6c-3a0fcb79ea8f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:47.445187 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ce6545b8-708d-41b5-aed2-507ed4330c04 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:47.467991 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ce6545b8-708d-41b5-aed2-507ed4330c04 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1521 microversion: 2.1 time: 0.549278 Jul 31 01:27:47.483728 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1957/3886] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:46 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1521 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:27:47.516289 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c67dcc1d-9c83-4520-9d0c-0dc7457bd7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:47.519861 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b8fcacf6-f362-4e21-ac6c-3a0fcb79ea8f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:47.528018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c67dcc1d-9c83-4520-9d0c-0dc7457bd7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e2b815f-54aa-47b6-91cf-6ca472620070] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:47.537716 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b8fcacf6-f362-4e21-ac6c-3a0fcb79ea8f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1220 microversion: 2.1 time: 0.427017 Jul 31 01:27:47.538339 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1930/3887] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:47 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1220 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:47.551590 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c67dcc1d-9c83-4520-9d0c-0dc7457bd7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:47.562064 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c67dcc1d-9c83-4520-9d0c-0dc7457bd7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:47.568090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c67dcc1d-9c83-4520-9d0c-0dc7457bd7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:47.569318 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c67dcc1d-9c83-4520-9d0c-0dc7457bd7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:47.602412 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cb62778d-8ade-4313-8913-367355c1404a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:47.605040 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cb62778d-8ade-4313-8913-367355c1404a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:47.622918 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb62778d-8ade-4313-8913-367355c1404a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:47.623667 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb62778d-8ade-4313-8913-367355c1404a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:47.624178 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-c67dcc1d-9c83-4520-9d0c-0dc7457bd7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] HTTP exception thrown: Instance 1e2b815f-54aa-47b6-91cf-6ca472620070 could not be found. Jul 31 01:27:47.624832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb62778d-8ade-4313-8913-367355c1404a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:47.627392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb62778d-8ade-4313-8913-367355c1404a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c67dcc1d-9c83-4520-9d0c-0dc7457bd7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Request method failure captured: Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 HTTP/1.1 Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dhkaGQR0CXWpGPAG4YiZIdd83eiYcwnrL_vFJ3yaYlDHK66u6nP96xvpo7ut6hmJeUxvAmVeOuG6fHMb0MynOrnbx53tSX29FKCgbTIvynvxRGnCTvg3yHoj2O8OMB7aoPhOzqFGyp1k3ddC6-5iirQ3GPjkps3ibXZR3HrXQFzSHc Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: da596310058e4248bf33465f387956f2 Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da596310058e4248bf33465f387956f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da596310058e4248bf33465f387956f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/da596310058e4248bf33465f387956f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_da596310058e4248bf33465f387956f2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: da596310058e4248bf33465f387956f2 Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerActionsTestJSON-1719297789-project Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 36a36dbb4f6c40a7bb69c8c3f747aaed Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerActionsTestJSON-1719297789-project Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 1e2b815f-54aa-47b6-91cf-6ca472620070 could not be found. Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '1e2b815f-54aa-47b6-91cf-6ca472620070'} Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e2b815f-54aa-47b6-91cf-6ca472620070 could not be found. Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e2b815f-54aa-47b6-91cf-6ca472620070 could not be found. Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:47.628780 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:47.633133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:47.633133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:47.633133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:47.633133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:27:47.633133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:27:47.633133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e2b815f-54aa-47b6-91cf-6ca472620070 could not be found. Jul 31 01:27:47.633133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:47.634203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c67dcc1d-9c83-4520-9d0c-0dc7457bd7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Returning 404 to user: Instance 1e2b815f-54aa-47b6-91cf-6ca472620070 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:27:47.636347 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c67dcc1d-9c83-4520-9d0c-0dc7457bd7aa tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070" status: 404 len: 111 microversion: 2.1 time: 0.149862 Jul 31 01:27:47.643530 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1958/3888] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:47 2022] GET /compute/v2.1/servers/1e2b815f-54aa-47b6-91cf-6ca472620070 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:27:47.657073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-800cedb2-24bc-4606-952c-eb1a3a3dac45 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:47.658134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-800cedb2-24bc-4606-952c-eb1a3a3dac45 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:47.682077 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-800cedb2-24bc-4606-952c-eb1a3a3dac45 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:47.683930 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-800cedb2-24bc-4606-952c-eb1a3a3dac45 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:47.685734 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-800cedb2-24bc-4606-952c-eb1a3a3dac45 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:47.686455 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-800cedb2-24bc-4606-952c-eb1a3a3dac45 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:47.777155 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-800cedb2-24bc-4606-952c-eb1a3a3dac45 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:27:47.995801 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-800cedb2-24bc-4606-952c-eb1a3a3dac45 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 204 len: 0 microversion: 2.1 time: 0.350393 Jul 31 01:27:47.996881 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1959/3889] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:27:47 2022] DELETE /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:27:48.009001 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7eb68c65-131e-418b-95d5-c84867ba06a1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:48.010499 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7eb68c65-131e-418b-95d5-c84867ba06a1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:48.019230 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cb62778d-8ade-4313-8913-367355c1404a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:48.029665 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7eb68c65-131e-418b-95d5-c84867ba06a1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:48.035210 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7eb68c65-131e-418b-95d5-c84867ba06a1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:48.036923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7eb68c65-131e-418b-95d5-c84867ba06a1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:48.037545 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7eb68c65-131e-418b-95d5-c84867ba06a1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:48.048874 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cb62778d-8ade-4313-8913-367355c1404a tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1521 microversion: 2.1 time: 0.477170 Jul 31 01:27:48.052691 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1931/3890] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:47 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1521 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:48.090051 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b0f9977d-f531-4fd7-9fe4-a1a42fc6ae10 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-495485104"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:48.105594 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b0f9977d-f531-4fd7-9fe4-a1a42fc6ae10 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:48.122059 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0f9977d-f531-4fd7-9fe4-a1a42fc6ae10 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:48.137614 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0f9977d-f531-4fd7-9fe4-a1a42fc6ae10 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:48.141180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0f9977d-f531-4fd7-9fe4-a1a42fc6ae10 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:48.141650 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0f9977d-f531-4fd7-9fe4-a1a42fc6ae10 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:48.474560 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7eb68c65-131e-418b-95d5-c84867ba06a1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:48.485730 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7eb68c65-131e-418b-95d5-c84867ba06a1 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 200 len: 1508 microversion: 2.1 time: 0.483251 Jul 31 01:27:48.491495 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1960/3891] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:48 2022] GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 1508 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:48.550087 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b0f9977d-f531-4fd7-9fe4-a1a42fc6ae10 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "POST /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425/action" status: 202 len: 0 microversion: 2.1 time: 0.469563 Jul 31 01:27:48.550822 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1932/3892] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:27:48 2022] POST /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 31 01:27:48.567049 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8555891a-fdd6-4d02-9a94-de67cde1fa6e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '.version_select at 0x7fede4834d30>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:48.633901 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dcd0e5ee-003a-4cdb-a0ce-acbedac0ecb7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:48.634648 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dcd0e5ee-003a-4cdb-a0ce-acbedac0ecb7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:48.660984 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dcd0e5ee-003a-4cdb-a0ce-acbedac0ecb7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:48.661338 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dcd0e5ee-003a-4cdb-a0ce-acbedac0ecb7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:48.673264 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dcd0e5ee-003a-4cdb-a0ce-acbedac0ecb7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:48.676761 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dcd0e5ee-003a-4cdb-a0ce-acbedac0ecb7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:48.882876 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8555891a-fdd6-4d02-9a94-de67cde1fa6e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "DELETE /compute/v2.1/images/e8477d21-fe9e-4a0c-b9b8-cec003f0a435" status: 204 len: 0 microversion: 2.1 time: 0.324566 Jul 31 01:27:48.883991 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1961/3893] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:48 2022] DELETE /compute/v2.1/images/e8477d21-fe9e-4a0c-b9b8-cec003f0a435 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:27:48.892322 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-baadbfa7-e8f1-444e-baaa-2766c81c5cf8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '.version_select at 0x7fede4834700>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:48.897407 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dcd0e5ee-003a-4cdb-a0ce-acbedac0ecb7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:48.910560 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dcd0e5ee-003a-4cdb-a0ce-acbedac0ecb7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1276 microversion: 2.1 time: 0.333352 Jul 31 01:27:48.915237 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1933/3894] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:48 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1276 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:48.946113 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-baadbfa7-e8f1-444e-baaa-2766c81c5cf8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] HTTP exception thrown: Image not found. Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-baadbfa7-e8f1-444e-baaa-2766c81c5cf8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Request method failure captured: Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/images/e8477d21-fe9e-4a0c-b9b8-cec003f0a435 HTTP/1.1 Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5do_qvGtrm8MFTSKrTw8R7jgmTzyETsET8_Bks35mozq5SQhUaDIA0oib2wHXXTKsc9AVPMwnRA1N8ACvVn62cvXmTWUR5or87UcB5lhe7JDpnHvkxRMhg6Zlak4K6e0-cQsqquMOz1g27fd3AjZnreZQbV510uuuf140sds5ry5cxM Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c609eaf96fc84008b10c26b3f56edd69", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: df0850646f5b4fdeabc4d50297626e27 Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: exception: Image not found. Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'e8477d21-fe9e-4a0c-b9b8-cec003f0a435'} Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e8477d21-fe9e-4a0c-b9b8-cec003f0a435 Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 31 01:27:48.949772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e8477d21-fe9e-4a0c-b9b8-cec003f0a435 could not be found. Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:27:48.954204 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:27:48.960011 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-baadbfa7-e8f1-444e-baaa-2766c81c5cf8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Returning 404 to user: Image not found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:27:48.961203 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-baadbfa7-e8f1-444e-baaa-2766c81c5cf8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/images/e8477d21-fe9e-4a0c-b9b8-cec003f0a435" status: 404 len: 62 microversion: 2.1 time: 0.072970 Jul 31 01:27:48.962386 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1962/3895] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:27:48 2022] GET /compute/v2.1/images/e8477d21-fe9e-4a0c-b9b8-cec003f0a435 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:27:48.970627 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ca0227b8-7aef-44d1-a881-04f0d58860e8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:48.971246 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ca0227b8-7aef-44d1-a881-04f0d58860e8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:48.984149 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca0227b8-7aef-44d1-a881-04f0d58860e8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:48.984914 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca0227b8-7aef-44d1-a881-04f0d58860e8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:48.985997 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca0227b8-7aef-44d1-a881-04f0d58860e8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:48.989846 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca0227b8-7aef-44d1-a881-04f0d58860e8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:49.520905 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ff30fa4e-23fa-44e3-85e4-9195b5c5c1b8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:49.521548 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ff30fa4e-23fa-44e3-85e4-9195b5c5c1b8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:49.534603 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff30fa4e-23fa-44e3-85e4-9195b5c5c1b8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:49.535071 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff30fa4e-23fa-44e3-85e4-9195b5c5c1b8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:49.548064 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff30fa4e-23fa-44e3-85e4-9195b5c5c1b8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:49.548544 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff30fa4e-23fa-44e3-85e4-9195b5c5c1b8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:50.292695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ca0227b8-7aef-44d1-a881-04f0d58860e8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:50.305089 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ca0227b8-7aef-44d1-a881-04f0d58860e8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1533 microversion: 2.1 time: 1.337940 Jul 31 01:27:50.305702 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1934/3896] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:48 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1533 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:50.322936 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e7f72e9a-2598-4233-897c-cf739e85d269 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:50.323859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e7f72e9a-2598-4233-897c-cf739e85d269 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:50.330661 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7f72e9a-2598-4233-897c-cf739e85d269 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:50.332040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7f72e9a-2598-4233-897c-cf739e85d269 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:50.333200 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7f72e9a-2598-4233-897c-cf739e85d269 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:50.333895 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7f72e9a-2598-4233-897c-cf739e85d269 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:50.566693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e7f72e9a-2598-4233-897c-cf739e85d269 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:50.584063 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e7f72e9a-2598-4233-897c-cf739e85d269 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1274 microversion: 2.1 time: 0.277252 Jul 31 01:27:50.597944 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1935/3897] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:50 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1274 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:50.873960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ff30fa4e-23fa-44e3-85e4-9195b5c5c1b8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:50.883168 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ff30fa4e-23fa-44e3-85e4-9195b5c5c1b8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 200 len: 1508 microversion: 2.1 time: 1.368964 Jul 31 01:27:50.886723 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1963/3898] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:49 2022] GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 1508 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:51.328218 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-05925d9e-80f0-4ec1-8200-bf0dd4ee7814 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:51.330030 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-05925d9e-80f0-4ec1-8200-bf0dd4ee7814 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:51.342973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-05925d9e-80f0-4ec1-8200-bf0dd4ee7814 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:51.348718 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-05925d9e-80f0-4ec1-8200-bf0dd4ee7814 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:51.352145 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-05925d9e-80f0-4ec1-8200-bf0dd4ee7814 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:51.352942 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-05925d9e-80f0-4ec1-8200-bf0dd4ee7814 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:51.607052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-432c6839-8f3f-4137-938d-8c0c565210e1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:51.607986 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-432c6839-8f3f-4137-938d-8c0c565210e1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:51.626901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-432c6839-8f3f-4137-938d-8c0c565210e1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:51.635553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-432c6839-8f3f-4137-938d-8c0c565210e1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:51.637418 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-432c6839-8f3f-4137-938d-8c0c565210e1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:51.638023 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-432c6839-8f3f-4137-938d-8c0c565210e1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:51.883465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-432c6839-8f3f-4137-938d-8c0c565210e1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:51.892735 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-432c6839-8f3f-4137-938d-8c0c565210e1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1274 microversion: 2.1 time: 0.290562 Jul 31 01:27:51.893748 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1964/3899] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:51 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1274 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:51.906740 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b548aff5-3c9d-4dff-8216-96e5f9b8ede7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:51.908423 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b548aff5-3c9d-4dff-8216-96e5f9b8ede7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:51.918661 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b548aff5-3c9d-4dff-8216-96e5f9b8ede7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:51.919910 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b548aff5-3c9d-4dff-8216-96e5f9b8ede7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:51.921415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b548aff5-3c9d-4dff-8216-96e5f9b8ede7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:51.923138 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b548aff5-3c9d-4dff-8216-96e5f9b8ede7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:52.557576 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-05925d9e-80f0-4ec1-8200-bf0dd4ee7814 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:52.571112 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-05925d9e-80f0-4ec1-8200-bf0dd4ee7814 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1539 microversion: 2.1 time: 1.247968 Jul 31 01:27:52.571750 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1936/3900] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:51 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1539 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:52.877159 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b548aff5-3c9d-4dff-8216-96e5f9b8ede7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:52.890635 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b548aff5-3c9d-4dff-8216-96e5f9b8ede7 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 200 len: 1508 microversion: 2.1 time: 0.985480 Jul 31 01:27:52.893070 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1965/3901] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:51 2022] GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 1508 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:27:52.916963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6baf51ac-05ed-429d-835a-4a50a921c2f7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:52.920498 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6baf51ac-05ed-429d-835a-4a50a921c2f7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:52.934898 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:52.938477 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6baf51ac-05ed-429d-835a-4a50a921c2f7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:52.939782 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6baf51ac-05ed-429d-835a-4a50a921c2f7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:52.943313 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6baf51ac-05ed-429d-835a-4a50a921c2f7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:52.946669 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6baf51ac-05ed-429d-835a-4a50a921c2f7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:53.004123 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-8d5b68d2-6c69-4059-8c7c-00a091e536d4 req-60213f27-aa09-4694-8b4f-e3f62df2eeee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8667f0e5-8943-46fb-94fb-ca6bb4dfce3b", "name": "network-vif-deleted", "tag": "30b19f8b-7004-4e0e-8ab1-3a71b9e8ba6d"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:53.034361 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8d5b68d2-6c69-4059-8c7c-00a091e536d4 req-60213f27-aa09-4694-8b4f-e3f62df2eeee service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:53.034842 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8d5b68d2-6c69-4059-8c7c-00a091e536d4 req-60213f27-aa09-4694-8b4f-e3f62df2eeee service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:53.101919 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-8d5b68d2-6c69-4059-8c7c-00a091e536d4 req-60213f27-aa09-4694-8b4f-e3f62df2eeee service nova] Creating event network-vif-deleted:30b19f8b-7004-4e0e-8ab1-3a71b9e8ba6d for instance 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b on n-h1-master-1 Jul 31 01:27:53.137743 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-8d5b68d2-6c69-4059-8c7c-00a091e536d4 req-60213f27-aa09-4694-8b4f-e3f62df2eeee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138880 Jul 31 01:27:53.158326 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1966/3902] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:53.594137 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-496e246f-3942-4caa-be39-5308e07bffdd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:53.595280 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-496e246f-3942-4caa-be39-5308e07bffdd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:53.615105 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-496e246f-3942-4caa-be39-5308e07bffdd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:53.619858 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-496e246f-3942-4caa-be39-5308e07bffdd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:53.621330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-496e246f-3942-4caa-be39-5308e07bffdd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:53.623526 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-496e246f-3942-4caa-be39-5308e07bffdd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:53.930533 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6baf51ac-05ed-429d-835a-4a50a921c2f7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:53.942167 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6baf51ac-05ed-429d-835a-4a50a921c2f7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1316 microversion: 2.1 time: 1.031616 Jul 31 01:27:53.943088 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1937/3903] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:52 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1316 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:53.958326 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8fd4bd9f-6831-41db-abf3-e8ace0484b03 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:53.959243 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8fd4bd9f-6831-41db-abf3-e8ace0484b03 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:53.966256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fd4bd9f-6831-41db-abf3-e8ace0484b03 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:53.966734 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fd4bd9f-6831-41db-abf3-e8ace0484b03 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:53.967561 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fd4bd9f-6831-41db-abf3-e8ace0484b03 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:53.968011 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fd4bd9f-6831-41db-abf3-e8ace0484b03 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:53.998388 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-8fd4bd9f-6831-41db-abf3-e8ace0484b03 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] HTTP exception thrown: Instance 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b could not be found. Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8fd4bd9f-6831-41db-abf3-e8ace0484b03 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Request method failure captured: Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b HTTP/1.1 Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dhkaGQR0CXWpGPAG4YiZIdd83eiYcwnrL_vFJ3yaYlDHK66u6nP96xvpo7ut6hmJeUxvAmVeOuG6fHMb0MynOrnbx53tSX29FKCgbTIvynvxRGnCTvg3yHoj2O8OMB7aoPhOzqFGyp1k3ddC6-5iirQ3GPjkps3ibXZR3HrXQFzSHc Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: da596310058e4248bf33465f387956f2 Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da596310058e4248bf33465f387956f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da596310058e4248bf33465f387956f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/da596310058e4248bf33465f387956f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_da596310058e4248bf33465f387956f2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: da596310058e4248bf33465f387956f2 Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerActionsTestJSON-1719297789-project Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 36a36dbb4f6c40a7bb69c8c3f747aaed Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerActionsTestJSON-1719297789-project Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b could not be found. Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '8667f0e5-8943-46fb-94fb-ca6bb4dfce3b'} Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b could not be found. Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b could not be found. Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:54.000386 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:54.004045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:54.004045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:54.004045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:54.004045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:27:54.004045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:27:54.004045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b could not be found. Jul 31 01:27:54.004045 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:54.004045 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8fd4bd9f-6831-41db-abf3-e8ace0484b03 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Returning 404 to user: Instance 8667f0e5-8943-46fb-94fb-ca6bb4dfce3b could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:27:54.004045 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8fd4bd9f-6831-41db-abf3-e8ace0484b03 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b" status: 404 len: 111 microversion: 2.1 time: 0.057975 Jul 31 01:27:54.004045 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1938/3904] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:53 2022] GET /compute/v2.1/servers/8667f0e5-8943-46fb-94fb-ca6bb4dfce3b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:27:54.017064 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f0ba065-ebcc-43a5-a5e8-b7f60716b20e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:54.019495 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6f0ba065-ebcc-43a5-a5e8-b7f60716b20e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:54.038828 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f0ba065-ebcc-43a5-a5e8-b7f60716b20e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:54.039308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f0ba065-ebcc-43a5-a5e8-b7f60716b20e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:54.042664 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f0ba065-ebcc-43a5-a5e8-b7f60716b20e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:54.043116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f0ba065-ebcc-43a5-a5e8-b7f60716b20e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:54.119193 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6f0ba065-ebcc-43a5-a5e8-b7f60716b20e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:27:54.289770 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-496e246f-3942-4caa-be39-5308e07bffdd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:54.304768 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-496e246f-3942-4caa-be39-5308e07bffdd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1521 microversion: 2.1 time: 0.716255 Jul 31 01:27:54.305583 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1967/3905] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:53 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1521 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:27:54.330445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-65979a1f-db94-4314-9c65-5f8792901557 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:54.331172 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-65979a1f-db94-4314-9c65-5f8792901557 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:54.344923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65979a1f-db94-4314-9c65-5f8792901557 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:54.345726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65979a1f-db94-4314-9c65-5f8792901557 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:54.346756 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65979a1f-db94-4314-9c65-5f8792901557 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:54.350597 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65979a1f-db94-4314-9c65-5f8792901557 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:54.366044 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6f0ba065-ebcc-43a5-a5e8-b7f60716b20e tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 204 len: 0 microversion: 2.1 time: 0.354788 Jul 31 01:27:54.375193 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1939/3906] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:27:54 2022] DELETE /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:27:54.390410 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-07516c0e-283d-4636-9ada-d9736e23b81f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:54.396959 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-07516c0e-283d-4636-9ada-d9736e23b81f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:54.411074 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07516c0e-283d-4636-9ada-d9736e23b81f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:54.412398 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07516c0e-283d-4636-9ada-d9736e23b81f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:54.413216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07516c0e-283d-4636-9ada-d9736e23b81f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:54.414049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07516c0e-283d-4636-9ada-d9736e23b81f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:54.414510 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-65979a1f-db94-4314-9c65-5f8792901557 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:27:54.417904 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:54.501513 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:54.600461 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-65979a1f-db94-4314-9c65-5f8792901557 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "DELETE /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 204 len: 0 microversion: 2.1 time: 0.274466 Jul 31 01:27:54.601053 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1968/3907] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:27:54 2022] DELETE /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:27:54.626475 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-33a4cf9a-462d-40f7-b3ca-d491b442229f tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:54.627485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-33a4cf9a-462d-40f7-b3ca-d491b442229f tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:54.635844 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33a4cf9a-462d-40f7-b3ca-d491b442229f tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:54.636745 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33a4cf9a-462d-40f7-b3ca-d491b442229f tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:54.637710 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33a4cf9a-462d-40f7-b3ca-d491b442229f tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:54.638802 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33a4cf9a-462d-40f7-b3ca-d491b442229f tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:55.391003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-07516c0e-283d-4636-9ada-d9736e23b81f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:55.406958 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-07516c0e-283d-4636-9ada-d9736e23b81f tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1495 microversion: 2.1 time: 1.030053 Jul 31 01:27:55.408265 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1940/3908] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:54 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1495 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:55.416403 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9519c88a-df03-4f5d-b1f3-cb05c5e304ab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:55.417351 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9519c88a-df03-4f5d-b1f3-cb05c5e304ab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:55.430586 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9519c88a-df03-4f5d-b1f3-cb05c5e304ab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:55.431592 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9519c88a-df03-4f5d-b1f3-cb05c5e304ab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:55.432666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9519c88a-df03-4f5d-b1f3-cb05c5e304ab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:55.433240 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9519c88a-df03-4f5d-b1f3-cb05c5e304ab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:55.473896 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-33a4cf9a-462d-40f7-b3ca-d491b442229f tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:55.487649 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-33a4cf9a-462d-40f7-b3ca-d491b442229f tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1527 microversion: 2.1 time: 0.880144 Jul 31 01:27:55.491931 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1969/3909] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:54 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1527 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:55.509244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-460b2681-91f2-476a-a96b-65943a233dbc req-ebc96856-a332-4964-950a-6231047c0ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714af515-1e35-4ff6-a184-5b246b892425", "name": "network-vif-plugged", "status": "completed", "tag": "de708352-6ae7-4798-a5ea-b0d89196f1a9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:55.539607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-460b2681-91f2-476a-a96b-65943a233dbc req-ebc96856-a332-4964-950a-6231047c0ce9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:55.539973 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-460b2681-91f2-476a-a96b-65943a233dbc req-ebc96856-a332-4964-950a-6231047c0ce9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:55.563473 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-460b2681-91f2-476a-a96b-65943a233dbc req-ebc96856-a332-4964-950a-6231047c0ce9 service nova] Creating event network-vif-plugged:de708352-6ae7-4798-a5ea-b0d89196f1a9 for instance 714af515-1e35-4ff6-a184-5b246b892425 on n-h2-master-1 Jul 31 01:27:55.584314 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-460b2681-91f2-476a-a96b-65943a233dbc req-ebc96856-a332-4964-950a-6231047c0ce9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086765 Jul 31 01:27:55.585107 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1970/3910] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:55.689298 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:55.770824 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:55.807809 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9519c88a-df03-4f5d-b1f3-cb05c5e304ab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:55.821073 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9519c88a-df03-4f5d-b1f3-cb05c5e304ab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1316 microversion: 2.1 time: 0.409671 Jul 31 01:27:55.822184 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1941/3911] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:55 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:56.434752 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0f4648c7-0ff0-43e2-9075-f59077921afe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:56.436691 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0f4648c7-0ff0-43e2-9075-f59077921afe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:56.450095 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:56.459866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f4648c7-0ff0-43e2-9075-f59077921afe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:56.462013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f4648c7-0ff0-43e2-9075-f59077921afe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:56.466144 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f4648c7-0ff0-43e2-9075-f59077921afe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:56.467397 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f4648c7-0ff0-43e2-9075-f59077921afe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:56.517308 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-16d24a1a-2856-472f-80e8-21f5ebe84dbb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:56.518025 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-16d24a1a-2856-472f-80e8-21f5ebe84dbb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:56.532046 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16d24a1a-2856-472f-80e8-21f5ebe84dbb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:56.532585 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16d24a1a-2856-472f-80e8-21f5ebe84dbb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:56.534991 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16d24a1a-2856-472f-80e8-21f5ebe84dbb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:56.535788 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16d24a1a-2856-472f-80e8-21f5ebe84dbb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:57.116292 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0f4648c7-0ff0-43e2-9075-f59077921afe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:57.130394 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0f4648c7-0ff0-43e2-9075-f59077921afe tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1495 microversion: 2.1 time: 0.701034 Jul 31 01:27:57.132309 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-16d24a1a-2856-472f-80e8-21f5ebe84dbb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:57.135159 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1971/3912] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:56 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1495 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:57.143913 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-16d24a1a-2856-472f-80e8-21f5ebe84dbb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1527 microversion: 2.1 time: 0.629659 Jul 31 01:27:57.144769 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1942/3913] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:56 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1527 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:27:57.145992 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-81763a27-234d-40c8-acb2-0a8d5dbd48a5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:57.150573 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-81763a27-234d-40c8-acb2-0a8d5dbd48a5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:57.159261 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-54abad19-abe2-478e-97a9-df1d12949141 req-5c5730e3-c042-481e-a3fe-a82eb5d9cb7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76757e35-eebd-46de-a012-82bd864fd1d2", "tag": "a84852a6-e79d-4e96-9273-a29f94e85006"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:57.171095 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81763a27-234d-40c8-acb2-0a8d5dbd48a5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:57.173504 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81763a27-234d-40c8-acb2-0a8d5dbd48a5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:57.174804 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81763a27-234d-40c8-acb2-0a8d5dbd48a5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:57.176814 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81763a27-234d-40c8-acb2-0a8d5dbd48a5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:57.185745 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-54abad19-abe2-478e-97a9-df1d12949141 req-5c5730e3-c042-481e-a3fe-a82eb5d9cb7e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:57.186471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-54abad19-abe2-478e-97a9-df1d12949141 req-5c5730e3-c042-481e-a3fe-a82eb5d9cb7e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:57.223533 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-54abad19-abe2-478e-97a9-df1d12949141 req-5c5730e3-c042-481e-a3fe-a82eb5d9cb7e service nova] Creating event network-changed:a84852a6-e79d-4e96-9273-a29f94e85006 for instance 76757e35-eebd-46de-a012-82bd864fd1d2 on n-h1-master-1 Jul 31 01:27:57.238592 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-54abad19-abe2-478e-97a9-df1d12949141 req-5c5730e3-c042-481e-a3fe-a82eb5d9cb7e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088397 Jul 31 01:27:57.240109 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1943/3914] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:57.469509 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ae3a5af-7a0c-414c-b647-59882c6b3315 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:57.470108 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0ae3a5af-7a0c-414c-b647-59882c6b3315 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:57.479053 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ae3a5af-7a0c-414c-b647-59882c6b3315 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:57.479687 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ae3a5af-7a0c-414c-b647-59882c6b3315 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:57.480678 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ae3a5af-7a0c-414c-b647-59882c6b3315 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:57.481197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ae3a5af-7a0c-414c-b647-59882c6b3315 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:57.666696 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-0ae3a5af-7a0c-414c-b647-59882c6b3315 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lazy-loading 'services' on Instance uuid 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:27:57.826673 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0ae3a5af-7a0c-414c-b647-59882c6b3315 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments/c9c9d370-ccce-4c3b-bf07-1b6fad8afa5c" status: 202 len: 0 microversion: 2.1 time: 0.362150 Jul 31 01:27:57.830179 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1944/3915] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 01:27:57 2022] DELETE /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments/c9c9d370-ccce-4c3b-bf07-1b6fad8afa5c => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 01:27:57.842059 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-42bc7e58-d511-452a-b4b1-a8adbd61ed64 req-aaaf05e6-d60a-44db-aad9-252ddd19b122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714af515-1e35-4ff6-a184-5b246b892425", "name": "network-vif-deleted", "tag": "de708352-6ae7-4798-a5ea-b0d89196f1a9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:57.845270 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-81763a27-234d-40c8-acb2-0a8d5dbd48a5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:57.859210 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-81763a27-234d-40c8-acb2-0a8d5dbd48a5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1316 microversion: 2.1 time: 0.721758 Jul 31 01:27:57.872466 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1972/3916] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:57 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1316 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:57.899642 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-42bc7e58-d511-452a-b4b1-a8adbd61ed64 req-aaaf05e6-d60a-44db-aad9-252ddd19b122 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:57.900145 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-42bc7e58-d511-452a-b4b1-a8adbd61ed64 req-aaaf05e6-d60a-44db-aad9-252ddd19b122 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:57.957385 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-42bc7e58-d511-452a-b4b1-a8adbd61ed64 req-aaaf05e6-d60a-44db-aad9-252ddd19b122 service nova] Creating event network-vif-deleted:de708352-6ae7-4798-a5ea-b0d89196f1a9 for instance 714af515-1e35-4ff6-a184-5b246b892425 on n-h2-master-1 Jul 31 01:27:57.981207 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-42bc7e58-d511-452a-b4b1-a8adbd61ed64 req-aaaf05e6-d60a-44db-aad9-252ddd19b122 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149461 Jul 31 01:27:57.982409 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1945/3917] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:58.161487 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e0e1a9eb-0a40-4c20-85f7-ff5b96fd6909 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:58.162201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e0e1a9eb-0a40-4c20-85f7-ff5b96fd6909 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:58.170098 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0e1a9eb-0a40-4c20-85f7-ff5b96fd6909 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:58.170905 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0e1a9eb-0a40-4c20-85f7-ff5b96fd6909 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:58.171838 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0e1a9eb-0a40-4c20-85f7-ff5b96fd6909 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:58.172518 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0e1a9eb-0a40-4c20-85f7-ff5b96fd6909 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:58.211307 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0e1a9eb-0a40-4c20-85f7-ff5b96fd6909 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:58.212026 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0e1a9eb-0a40-4c20-85f7-ff5b96fd6909 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:58.212687 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-e0e1a9eb-0a40-4c20-85f7-ff5b96fd6909 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lazy-loading 'fault' on Instance uuid 1e6d1238-b717-4469-b7dc-d49276871d99 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:27:58.273340 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e0e1a9eb-0a40-4c20-85f7-ff5b96fd6909 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:58.280838 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-20f90edb-3e5c-4034-a2c1-26c0679e8be7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:58.289408 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-20f90edb-3e5c-4034-a2c1-26c0679e8be7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:58.297805 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e0e1a9eb-0a40-4c20-85f7-ff5b96fd6909 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 200 len: 1304 microversion: 2.1 time: 0.136691 Jul 31 01:27:58.299534 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1946/3918] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:58 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:27:58.318940 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-08582371-e8bd-4111-9dbe-72645922acb8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:58.319863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-08582371-e8bd-4111-9dbe-72645922acb8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:58.324382 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20f90edb-3e5c-4034-a2c1-26c0679e8be7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:58.324780 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20f90edb-3e5c-4034-a2c1-26c0679e8be7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:58.328341 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08582371-e8bd-4111-9dbe-72645922acb8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:58.329151 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08582371-e8bd-4111-9dbe-72645922acb8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:58.330098 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08582371-e8bd-4111-9dbe-72645922acb8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:58.330415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20f90edb-3e5c-4034-a2c1-26c0679e8be7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:58.330888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20f90edb-3e5c-4034-a2c1-26c0679e8be7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:58.331085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08582371-e8bd-4111-9dbe-72645922acb8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:58.377239 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08582371-e8bd-4111-9dbe-72645922acb8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:58.379991 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08582371-e8bd-4111-9dbe-72645922acb8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:58.381856 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-08582371-e8bd-4111-9dbe-72645922acb8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lazy-loading 'fault' on Instance uuid 714af515-1e35-4ff6-a184-5b246b892425 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:27:58.414065 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-20f90edb-3e5c-4034-a2c1-26c0679e8be7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.539053 Jul 31 01:27:58.418108 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1973/3919] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:27:57 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments => generated 197 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:27:58.465341 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-08582371-e8bd-4111-9dbe-72645922acb8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:58.478500 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-08582371-e8bd-4111-9dbe-72645922acb8 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 200 len: 1315 microversion: 2.1 time: 0.165355 Jul 31 01:27:58.479320 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1947/3920] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:58 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:58.890648 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c60f58aa-f02e-4712-9631-2844506320a4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:58.891623 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c60f58aa-f02e-4712-9631-2844506320a4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:58.906678 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c60f58aa-f02e-4712-9631-2844506320a4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:58.907440 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c60f58aa-f02e-4712-9631-2844506320a4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:58.911967 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c60f58aa-f02e-4712-9631-2844506320a4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:58.914246 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c60f58aa-f02e-4712-9631-2844506320a4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:59.191147 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c60f58aa-f02e-4712-9631-2844506320a4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:27:59.200282 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c60f58aa-f02e-4712-9631-2844506320a4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1316 microversion: 2.1 time: 0.315632 Jul 31 01:27:59.202634 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1974/3921] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:58 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:27:59.323929 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0bbb1f2f-dcbd-4cb9-aa99-1b4134c25cab tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:59.325346 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0bbb1f2f-dcbd-4cb9-aa99-1b4134c25cab tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: 1e6d1238-b717-4469-b7dc-d49276871d99] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:59.333749 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0bbb1f2f-dcbd-4cb9-aa99-1b4134c25cab tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:59.334848 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0bbb1f2f-dcbd-4cb9-aa99-1b4134c25cab tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:59.336078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0bbb1f2f-dcbd-4cb9-aa99-1b4134c25cab tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:59.336656 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0bbb1f2f-dcbd-4cb9-aa99-1b4134c25cab tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:59.355217 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-0bbb1f2f-dcbd-4cb9-aa99-1b4134c25cab tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] HTTP exception thrown: Instance 1e6d1238-b717-4469-b7dc-d49276871d99 could not be found. Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0bbb1f2f-dcbd-4cb9-aa99-1b4134c25cab tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Request method failure captured: Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 HTTP/1.1 Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dhkaGQR0CXWpGPAG4YiZIdd83eiYcwnrL_vFJ3yaYlDHK66u6nP96xvpo7ut6hmJeUxvAmVeOuG6fHMb0MynOrnbx53tSX29FKCgbTIvynvxRGnCTvg3yHoj2O8OMB7aoPhOzqFGyp1k3ddC6-5iirQ3GPjkps3ibXZR3HrXQFzSHc Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: da596310058e4248bf33465f387956f2 Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da596310058e4248bf33465f387956f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da596310058e4248bf33465f387956f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/da596310058e4248bf33465f387956f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_da596310058e4248bf33465f387956f2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: da596310058e4248bf33465f387956f2 Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerActionsTestJSON-1719297789-project Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 36a36dbb4f6c40a7bb69c8c3f747aaed Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerActionsTestJSON-1719297789-project Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 1e6d1238-b717-4469-b7dc-d49276871d99 could not be found. Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '1e6d1238-b717-4469-b7dc-d49276871d99'} Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6d1238-b717-4469-b7dc-d49276871d99 could not be found. Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6d1238-b717-4469-b7dc-d49276871d99 could not be found. Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:59.357218 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:59.361111 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:59.361111 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:59.361111 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:59.361111 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:27:59.361111 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:27:59.361111 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6d1238-b717-4469-b7dc-d49276871d99 could not be found. Jul 31 01:27:59.361111 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:59.362954 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0bbb1f2f-dcbd-4cb9-aa99-1b4134c25cab tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Returning 404 to user: Instance 1e6d1238-b717-4469-b7dc-d49276871d99 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:27:59.364329 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0bbb1f2f-dcbd-4cb9-aa99-1b4134c25cab tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99" status: 404 len: 111 microversion: 2.1 time: 0.044689 Jul 31 01:27:59.365242 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1948/3922] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:59 2022] GET /compute/v2.1/servers/1e6d1238-b717-4469-b7dc-d49276871d99 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:27:59.375015 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8502cec3-64fe-4cb7-83b7-6b05b7a738a8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:59.376418 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8502cec3-64fe-4cb7-83b7-6b05b7a738a8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:59.387918 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8502cec3-64fe-4cb7-83b7-6b05b7a738a8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:59.388937 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8502cec3-64fe-4cb7-83b7-6b05b7a738a8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:59.390137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8502cec3-64fe-4cb7-83b7-6b05b7a738a8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:59.390854 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8502cec3-64fe-4cb7-83b7-6b05b7a738a8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:59.430603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cdc61517-d99b-4e32-825c-49391261ff6b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:59.433421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cdc61517-d99b-4e32-825c-49391261ff6b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:59.435867 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8502cec3-64fe-4cb7-83b7-6b05b7a738a8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:27:59.449173 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cdc61517-d99b-4e32-825c-49391261ff6b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:59.450933 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cdc61517-d99b-4e32-825c-49391261ff6b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:59.453904 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cdc61517-d99b-4e32-825c-49391261ff6b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:59.454567 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cdc61517-d99b-4e32-825c-49391261ff6b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:59.523829 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cdc61517-d99b-4e32-825c-49391261ff6b tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098290 Jul 31 01:27:59.524768 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1949/3923] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:27:59 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:27:59.530333 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0249f6e1-54ad-47fb-8b01-2ec76754b63e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:59.531517 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0249f6e1-54ad-47fb-8b01-2ec76754b63e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:59.538434 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0249f6e1-54ad-47fb-8b01-2ec76754b63e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:59.539771 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0249f6e1-54ad-47fb-8b01-2ec76754b63e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:59.540877 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0249f6e1-54ad-47fb-8b01-2ec76754b63e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:59.541652 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0249f6e1-54ad-47fb-8b01-2ec76754b63e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:59.584877 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-0249f6e1-54ad-47fb-8b01-2ec76754b63e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] HTTP exception thrown: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0249f6e1-54ad-47fb-8b01-2ec76754b63e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Request method failure captured: Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 HTTP/1.1 Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5do_qvGtrm8MFTSKrTw8R7jgmTzyETsET8_Bks35mozq5SQhUaDIA0oib2wHXXTKsc9AVPMwnRA1N8ACvVn62cvXmTWUR5or87UcB5lhe7JDpnHvkxRMhg6Zlak4K6e0-cQsqquMOz1g27fd3AjZnreZQbV510uuuf140sds5ry5cxM Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c609eaf96fc84008b10c26b3f56edd69", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: df0850646f5b4fdeabc4d50297626e27 Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '714af515-1e35-4ff6-a184-5b246b892425'} Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:59.587703 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:27:59.592101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:59.592101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:27:59.592101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:27:59.592101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:27:59.592101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:27:59.592101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:27:59.592101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. Jul 31 01:27:59.592101 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:27:59.595014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0249f6e1-54ad-47fb-8b01-2ec76754b63e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Returning 404 to user: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:27:59.596112 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0249f6e1-54ad-47fb-8b01-2ec76754b63e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 404 len: 111 microversion: 2.1 time: 0.070095 Jul 31 01:27:59.597410 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1950/3924] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:59 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:27:59.644008 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8502cec3-64fe-4cb7-83b7-6b05b7a738a8 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 204 len: 0 microversion: 2.1 time: 0.272913 Jul 31 01:27:59.644631 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1975/3925] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:27:59 2022] DELETE /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:27:59.654507 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f26b3c5a-c325-4ebd-ac91-90fbfcd7d916 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:27:59.655087 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f26b3c5a-c325-4ebd-ac91-90fbfcd7d916 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:27:59.667273 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f26b3c5a-c325-4ebd-ac91-90fbfcd7d916 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:59.667857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f26b3c5a-c325-4ebd-ac91-90fbfcd7d916 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:59.668666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f26b3c5a-c325-4ebd-ac91-90fbfcd7d916 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:27:59.672125 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f26b3c5a-c325-4ebd-ac91-90fbfcd7d916 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:27:59.862512 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-34c2d1b0-d14c-4ef6-8d81-dfb9361f061c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1300781236", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:27:59.988394 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-34c2d1b0-d14c-4ef6-8d81-dfb9361f061c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] validate_networks() for [('a8f62231-6d25-478b-9cd8-a54df5b9a877', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:28:00.400403 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f26b3c5a-c325-4ebd-ac91-90fbfcd7d916 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:00.412019 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f26b3c5a-c325-4ebd-ac91-90fbfcd7d916 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1676 microversion: 2.1 time: 0.761641 Jul 31 01:28:00.415865 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1951/3926] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:27:59 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1676 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:00.427078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e8b451a4-b9e7-43e1-a944-5fcdcd91d14c req-fef259b9-971c-4131-b2f8-a98ffd24b0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6d1238-b717-4469-b7dc-d49276871d99", "name": "network-vif-deleted", "tag": "f10cad9b-64dd-4555-8d3b-b1279fecd75b"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:00.457135 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e8b451a4-b9e7-43e1-a944-5fcdcd91d14c req-fef259b9-971c-4131-b2f8-a98ffd24b0b8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:00.458047 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e8b451a4-b9e7-43e1-a944-5fcdcd91d14c req-fef259b9-971c-4131-b2f8-a98ffd24b0b8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:00.489701 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e8b451a4-b9e7-43e1-a944-5fcdcd91d14c req-fef259b9-971c-4131-b2f8-a98ffd24b0b8 service nova] Creating event network-vif-deleted:f10cad9b-64dd-4555-8d3b-b1279fecd75b for instance 1e6d1238-b717-4469-b7dc-d49276871d99 on n-h2-master-1 Jul 31 01:28:00.500712 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e8b451a4-b9e7-43e1-a944-5fcdcd91d14c req-fef259b9-971c-4131-b2f8-a98ffd24b0b8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080710 Jul 31 01:28:00.502967 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1952/3927] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:00.516981 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-164df5fe-c6b3-41cf-a271-81d1d01d8ac2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:00.517781 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-164df5fe-c6b3-41cf-a271-81d1d01d8ac2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:00.533055 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-164df5fe-c6b3-41cf-a271-81d1d01d8ac2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:00.536857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-164df5fe-c6b3-41cf-a271-81d1d01d8ac2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:00.538493 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-164df5fe-c6b3-41cf-a271-81d1d01d8ac2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:00.540249 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-164df5fe-c6b3-41cf-a271-81d1d01d8ac2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:01.170047 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-164df5fe-c6b3-41cf-a271-81d1d01d8ac2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:01.195873 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-164df5fe-c6b3-41cf-a271-81d1d01d8ac2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1316 microversion: 2.1 time: 0.690567 Jul 31 01:28:01.207887 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1953/3928] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:00 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1316 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:01.215090 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-50569942-bf27-4fe1-a73c-d9747e2c9e83 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:01.217822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-50569942-bf27-4fe1-a73c-d9747e2c9e83 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:01.224460 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50569942-bf27-4fe1-a73c-d9747e2c9e83 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:01.225506 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50569942-bf27-4fe1-a73c-d9747e2c9e83 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:01.226545 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50569942-bf27-4fe1-a73c-d9747e2c9e83 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:01.227196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50569942-bf27-4fe1-a73c-d9747e2c9e83 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:01.298543 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-50569942-bf27-4fe1-a73c-d9747e2c9e83 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089329 Jul 31 01:28:01.299503 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1954/3929] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:28:01 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:01.408708 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-34c2d1b0-d14c-4ef6-8d81-dfb9361f061c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:28:01.409353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-34c2d1b0-d14c-4ef6-8d81-dfb9361f061c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:28:01.409914 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-34c2d1b0-d14c-4ef6-8d81-dfb9361f061c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:28:01.410486 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-34c2d1b0-d14c-4ef6-8d81-dfb9361f061c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:28:01.411012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-34c2d1b0-d14c-4ef6-8d81-dfb9361f061c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:28:01.426937 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34c2d1b0-d14c-4ef6-8d81-dfb9361f061c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:01.430285 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34c2d1b0-d14c-4ef6-8d81-dfb9361f061c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:01.431283 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34c2d1b0-d14c-4ef6-8d81-dfb9361f061c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:01.433482 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34c2d1b0-d14c-4ef6-8d81-dfb9361f061c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:01.451615 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-904ac7a5-5f19-43d5-b024-fbb4f30b3b44 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:01.461745 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-904ac7a5-5f19-43d5-b024-fbb4f30b3b44 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:01.484088 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-34c2d1b0-d14c-4ef6-8d81-dfb9361f061c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Getting quotas for project c609eaf96fc84008b10c26b3f56edd69. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:28:01.496856 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-904ac7a5-5f19-43d5-b024-fbb4f30b3b44 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:01.497620 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-904ac7a5-5f19-43d5-b024-fbb4f30b3b44 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:01.498751 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-34c2d1b0-d14c-4ef6-8d81-dfb9361f061c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Getting quotas for user df0850646f5b4fdeabc4d50297626e27 and project c609eaf96fc84008b10c26b3f56edd69. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:28:01.501828 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-904ac7a5-5f19-43d5-b024-fbb4f30b3b44 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:01.502318 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-904ac7a5-5f19-43d5-b024-fbb4f30b3b44 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:01.522304 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=5 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:01.538585 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-34c2d1b0-d14c-4ef6-8d81-dfb9361f061c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:28:01.543129 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-34c2d1b0-d14c-4ef6-8d81-dfb9361f061c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:28:01.658959 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-34c2d1b0-d14c-4ef6-8d81-dfb9361f061c tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.808761 Jul 31 01:28:01.669841 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1976/3930] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:27:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 01:28:01.686691 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-80f2a36e-10cd-4f52-ac9d-f64cbc1377cb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:01.688858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-80f2a36e-10cd-4f52-ac9d-f64cbc1377cb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:01.832743 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-80f2a36e-10cd-4f52-ac9d-f64cbc1377cb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:01.841521 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-80f2a36e-10cd-4f52-ac9d-f64cbc1377cb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1225 microversion: 2.1 time: 0.169548 Jul 31 01:28:01.846956 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1977/3931] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:01 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1225 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:02.129522 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-904ac7a5-5f19-43d5-b024-fbb4f30b3b44 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:02.138493 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-904ac7a5-5f19-43d5-b024-fbb4f30b3b44 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1676 microversion: 2.1 time: 0.704383 Jul 31 01:28:02.139096 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1955/3932] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:01 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1676 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:02.223478 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bce065a3-a227-4391-9e66-9d7f858783c8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:02.224054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bce065a3-a227-4391-9e66-9d7f858783c8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:02.239269 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bce065a3-a227-4391-9e66-9d7f858783c8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:02.241899 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bce065a3-a227-4391-9e66-9d7f858783c8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:02.245627 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bce065a3-a227-4391-9e66-9d7f858783c8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:02.246419 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bce065a3-a227-4391-9e66-9d7f858783c8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:02.312453 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8d900f38-548f-4e18-99d3-b10abfd0f931 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:02.315868 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8d900f38-548f-4e18-99d3-b10abfd0f931 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:02.335139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d900f38-548f-4e18-99d3-b10abfd0f931 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:02.341098 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d900f38-548f-4e18-99d3-b10abfd0f931 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:02.342277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d900f38-548f-4e18-99d3-b10abfd0f931 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:02.347122 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d900f38-548f-4e18-99d3-b10abfd0f931 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:02.471793 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8d900f38-548f-4e18-99d3-b10abfd0f931 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147542 Jul 31 01:28:02.474126 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1956/3933] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:28:02 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:02.494314 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-46947381-4b99-4abf-9f92-9cc76815ada4 req-1b2b82dc-1075-49ee-8f48-e32ec4c1d2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76757e35-eebd-46de-a012-82bd864fd1d2", "name": "network-vif-plugged", "status": "completed", "tag": "a84852a6-e79d-4e96-9273-a29f94e85006"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:02.535264 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-46947381-4b99-4abf-9f92-9cc76815ada4 req-1b2b82dc-1075-49ee-8f48-e32ec4c1d2b8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:02.535898 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-46947381-4b99-4abf-9f92-9cc76815ada4 req-1b2b82dc-1075-49ee-8f48-e32ec4c1d2b8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:02.598741 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-46947381-4b99-4abf-9f92-9cc76815ada4 req-1b2b82dc-1075-49ee-8f48-e32ec4c1d2b8 service nova] Creating event network-vif-plugged:a84852a6-e79d-4e96-9273-a29f94e85006 for instance 76757e35-eebd-46de-a012-82bd864fd1d2 on n-h1-master-1 Jul 31 01:28:02.610893 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-46947381-4b99-4abf-9f92-9cc76815ada4 req-1b2b82dc-1075-49ee-8f48-e32ec4c1d2b8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133568 Jul 31 01:28:02.612744 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1957/3934] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:02.627851 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bce065a3-a227-4391-9e66-9d7f858783c8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:02.653793 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bce065a3-a227-4391-9e66-9d7f858783c8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1316 microversion: 2.1 time: 0.431563 Jul 31 01:28:02.663517 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1978/3935] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:02 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:02.872446 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8959e079-7a35-40a3-be54-110615cec3a4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:02.873408 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8959e079-7a35-40a3-be54-110615cec3a4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:02.897056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8959e079-7a35-40a3-be54-110615cec3a4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:02.900080 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8959e079-7a35-40a3-be54-110615cec3a4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:02.902841 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8959e079-7a35-40a3-be54-110615cec3a4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:02.905947 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8959e079-7a35-40a3-be54-110615cec3a4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:03.038253 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8959e079-7a35-40a3-be54-110615cec3a4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:03.049776 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8959e079-7a35-40a3-be54-110615cec3a4 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1277 microversion: 2.1 time: 0.184237 Jul 31 01:28:03.065340 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1958/3936] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:02 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:03.164943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-35482a49-cbfd-49a9-8763-cc957366fe96 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:03.166023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-35482a49-cbfd-49a9-8763-cc957366fe96 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:03.175227 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35482a49-cbfd-49a9-8763-cc957366fe96 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:03.176654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35482a49-cbfd-49a9-8763-cc957366fe96 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:03.177873 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35482a49-cbfd-49a9-8763-cc957366fe96 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:03.178876 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35482a49-cbfd-49a9-8763-cc957366fe96 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:03.369830 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-35482a49-cbfd-49a9-8763-cc957366fe96 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:03.381208 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-35482a49-cbfd-49a9-8763-cc957366fe96 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1676 microversion: 2.1 time: 0.223969 Jul 31 01:28:03.383158 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1979/3937] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:03 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:03.485476 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8708673b-2d83-44ac-bd75-67e50b3b317a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:03.490459 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8708673b-2d83-44ac-bd75-67e50b3b317a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:03.520665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8708673b-2d83-44ac-bd75-67e50b3b317a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:03.524445 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8708673b-2d83-44ac-bd75-67e50b3b317a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:03.525328 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8708673b-2d83-44ac-bd75-67e50b3b317a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:03.527964 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8708673b-2d83-44ac-bd75-67e50b3b317a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:03.576158 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:03.615204 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8708673b-2d83-44ac-bd75-67e50b3b317a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133777 Jul 31 01:28:03.625899 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1959/3938] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:28:03 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:03.680059 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2818bd53-63a2-4bda-9a17-b01fdf73fbd7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:03.681389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2818bd53-63a2-4bda-9a17-b01fdf73fbd7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:03.700787 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2818bd53-63a2-4bda-9a17-b01fdf73fbd7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:03.701592 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2818bd53-63a2-4bda-9a17-b01fdf73fbd7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:03.702482 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2818bd53-63a2-4bda-9a17-b01fdf73fbd7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:03.703161 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2818bd53-63a2-4bda-9a17-b01fdf73fbd7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:03.993550 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2818bd53-63a2-4bda-9a17-b01fdf73fbd7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:04.003631 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2818bd53-63a2-4bda-9a17-b01fdf73fbd7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1316 microversion: 2.1 time: 0.327675 Jul 31 01:28:04.004823 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1980/3939] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:03 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:04.076645 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-00e68faa-a0e4-4db5-a142-8e444c9210cc tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:04.078404 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-00e68faa-a0e4-4db5-a142-8e444c9210cc tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:04.088804 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-00e68faa-a0e4-4db5-a142-8e444c9210cc tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:04.093758 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-00e68faa-a0e4-4db5-a142-8e444c9210cc tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:04.094975 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-00e68faa-a0e4-4db5-a142-8e444c9210cc tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:04.095670 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-00e68faa-a0e4-4db5-a142-8e444c9210cc tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:04.224439 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-00e68faa-a0e4-4db5-a142-8e444c9210cc tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:04.236403 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-00e68faa-a0e4-4db5-a142-8e444c9210cc tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1283 microversion: 2.1 time: 0.163716 Jul 31 01:28:04.237582 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1960/3940] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:04 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1283 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:04.406795 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-29dc8c5d-8ba9-48e4-85c7-bc4b071b8246 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:04.407492 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-29dc8c5d-8ba9-48e4-85c7-bc4b071b8246 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:04.430171 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29dc8c5d-8ba9-48e4-85c7-bc4b071b8246 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:04.430662 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29dc8c5d-8ba9-48e4-85c7-bc4b071b8246 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:04.436213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29dc8c5d-8ba9-48e4-85c7-bc4b071b8246 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:04.436717 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29dc8c5d-8ba9-48e4-85c7-bc4b071b8246 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:04.632074 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7a8c2bdd-d32f-46a9-a64a-ca85fe73c2ca tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:04.634487 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7a8c2bdd-d32f-46a9-a64a-ca85fe73c2ca tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:04.655617 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a8c2bdd-d32f-46a9-a64a-ca85fe73c2ca tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:04.662439 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a8c2bdd-d32f-46a9-a64a-ca85fe73c2ca tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:04.663549 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a8c2bdd-d32f-46a9-a64a-ca85fe73c2ca tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:04.668467 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a8c2bdd-d32f-46a9-a64a-ca85fe73c2ca tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:04.782924 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7a8c2bdd-d32f-46a9-a64a-ca85fe73c2ca tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155180 Jul 31 01:28:04.783951 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1961/3941] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:28:04 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:28:04.787314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-29dc8c5d-8ba9-48e4-85c7-bc4b071b8246 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:04.809680 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-29dc8c5d-8ba9-48e4-85c7-bc4b071b8246 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1609 microversion: 2.1 time: 0.409117 Jul 31 01:28:04.824208 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1981/3942] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:04 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1609 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:05.027897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-49fa6a0b-34ce-4399-a60c-4f6c8a2e7c77 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:05.028803 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-49fa6a0b-34ce-4399-a60c-4f6c8a2e7c77 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:05.049026 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49fa6a0b-34ce-4399-a60c-4f6c8a2e7c77 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:05.049507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49fa6a0b-34ce-4399-a60c-4f6c8a2e7c77 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:05.050323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49fa6a0b-34ce-4399-a60c-4f6c8a2e7c77 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:05.050774 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49fa6a0b-34ce-4399-a60c-4f6c8a2e7c77 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:05.259171 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0909532a-7249-4824-9c8e-1436e416ccec tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:05.260131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0909532a-7249-4824-9c8e-1436e416ccec tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:05.273013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0909532a-7249-4824-9c8e-1436e416ccec tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:05.273727 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0909532a-7249-4824-9c8e-1436e416ccec tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:05.276054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0909532a-7249-4824-9c8e-1436e416ccec tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:05.276810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0909532a-7249-4824-9c8e-1436e416ccec tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:05.496536 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0909532a-7249-4824-9c8e-1436e416ccec tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:05.509193 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0909532a-7249-4824-9c8e-1436e416ccec tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1283 microversion: 2.1 time: 0.252930 Jul 31 01:28:05.518517 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1982/3943] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:05 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1283 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:05.603520 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-49fa6a0b-34ce-4399-a60c-4f6c8a2e7c77 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:05.620020 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-49fa6a0b-34ce-4399-a60c-4f6c8a2e7c77 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.596289 Jul 31 01:28:05.628315 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1962/3944] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:05 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:05.651264 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-fa51daa5-43df-4f1d-8d4a-30589497b0e8 req-38ed0009-1706-4d7d-bb95-817b02873934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f0abec-dd05-4dff-8f15-b56464346b06", "name": "network-vif-deleted", "tag": "02e5aa3d-f780-459d-9466-4437ed729ddc"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:05.693993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-fa51daa5-43df-4f1d-8d4a-30589497b0e8 req-38ed0009-1706-4d7d-bb95-817b02873934 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:05.694493 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-fa51daa5-43df-4f1d-8d4a-30589497b0e8 req-38ed0009-1706-4d7d-bb95-817b02873934 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:05.758303 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-fa51daa5-43df-4f1d-8d4a-30589497b0e8 req-38ed0009-1706-4d7d-bb95-817b02873934 service nova] Creating event network-vif-deleted:02e5aa3d-f780-459d-9466-4437ed729ddc for instance e7f0abec-dd05-4dff-8f15-b56464346b06 on n-h2-master-1 Jul 31 01:28:05.779066 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-fa51daa5-43df-4f1d-8d4a-30589497b0e8 req-38ed0009-1706-4d7d-bb95-817b02873934 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132199 Jul 31 01:28:05.782359 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1983/3945] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:05.797276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-50e110c0-b3b6-4138-bfd7-130307e26bd9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:05.800669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-50e110c0-b3b6-4138-bfd7-130307e26bd9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:05.831642 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bfa33040-175a-46f2-8fe9-8cd009913443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:05.837691 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bfa33040-175a-46f2-8fe9-8cd009913443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:05.846130 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50e110c0-b3b6-4138-bfd7-130307e26bd9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:05.846596 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50e110c0-b3b6-4138-bfd7-130307e26bd9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:05.850619 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bfa33040-175a-46f2-8fe9-8cd009913443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:05.851427 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bfa33040-175a-46f2-8fe9-8cd009913443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:05.864463 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50e110c0-b3b6-4138-bfd7-130307e26bd9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:05.865441 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50e110c0-b3b6-4138-bfd7-130307e26bd9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:05.876503 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bfa33040-175a-46f2-8fe9-8cd009913443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:05.877287 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bfa33040-175a-46f2-8fe9-8cd009913443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:05.947838 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bfa33040-175a-46f2-8fe9-8cd009913443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:05.949820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bfa33040-175a-46f2-8fe9-8cd009913443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:05.950485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-bfa33040-175a-46f2-8fe9-8cd009913443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lazy-loading 'fault' on Instance uuid e7f0abec-dd05-4dff-8f15-b56464346b06 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:28:06.022875 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-50e110c0-b3b6-4138-bfd7-130307e26bd9 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231491 Jul 31 01:28:06.023645 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1963/3946] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:28:05 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments => generated 197 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:06.035483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-44ea593b-67fd-4bcf-9fa5-5c35199799a3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1686763023", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:06.062821 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bfa33040-175a-46f2-8fe9-8cd009913443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a36dbb4f6c40a7bb69c8c3f747aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da596310058e4248bf33465f387956f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:06.066888 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:06.085399 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bfa33040-175a-46f2-8fe9-8cd009913443 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 200 len: 1329 microversion: 2.1 time: 0.256958 Jul 31 01:28:06.087316 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1984/3947] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:05 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 1329 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:06.210177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-44ea593b-67fd-4bcf-9fa5-5c35199799a3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] validate_networks() for [('045ea8ff-463e-40b5-b75b-322b143e9807', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:28:06.532799 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-08721451-6b76-46e3-9320-d4c94cc01fcf tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:06.533977 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-08721451-6b76-46e3-9320-d4c94cc01fcf tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:06.550985 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08721451-6b76-46e3-9320-d4c94cc01fcf tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:06.557837 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08721451-6b76-46e3-9320-d4c94cc01fcf tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:06.564014 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08721451-6b76-46e3-9320-d4c94cc01fcf tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:06.564785 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08721451-6b76-46e3-9320-d4c94cc01fcf tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:08.378594 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-08721451-6b76-46e3-9320-d4c94cc01fcf tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:08.394804 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-08721451-6b76-46e3-9320-d4c94cc01fcf tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1325 microversion: 2.1 time: 1.865940 Jul 31 01:28:08.399015 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1985/3948] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:06 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1325 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:08.415284 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-658cd122-cac0-42da-8d29-bc9fdd1fa177 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:08.419021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-658cd122-cac0-42da-8d29-bc9fdd1fa177 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:08.433791 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-658cd122-cac0-42da-8d29-bc9fdd1fa177 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:08.434750 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-658cd122-cac0-42da-8d29-bc9fdd1fa177 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:08.435822 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-658cd122-cac0-42da-8d29-bc9fdd1fa177 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:08.436879 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-658cd122-cac0-42da-8d29-bc9fdd1fa177 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:08.518655 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-658cd122-cac0-42da-8d29-bc9fdd1fa177 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118256 Jul 31 01:28:08.524124 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1986/3949] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:28:08 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:08.534433 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bc1d7657-fe27-4613-bc9e-a2dfe0dd9d21 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:08.538862 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bc1d7657-fe27-4613-bc9e-a2dfe0dd9d21 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] [instance: e7f0abec-dd05-4dff-8f15-b56464346b06] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:08.556867 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc1d7657-fe27-4613-bc9e-a2dfe0dd9d21 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:08.557734 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc1d7657-fe27-4613-bc9e-a2dfe0dd9d21 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:08.558732 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc1d7657-fe27-4613-bc9e-a2dfe0dd9d21 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:08.560893 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc1d7657-fe27-4613-bc9e-a2dfe0dd9d21 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:08.605863 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-bc1d7657-fe27-4613-bc9e-a2dfe0dd9d21 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] HTTP exception thrown: Instance e7f0abec-dd05-4dff-8f15-b56464346b06 could not be found. Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bc1d7657-fe27-4613-bc9e-a2dfe0dd9d21 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Request method failure captured: Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 HTTP/1.1 Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dhkaGQR0CXWpGPAG4YiZIdd83eiYcwnrL_vFJ3yaYlDHK66u6nP96xvpo7ut6hmJeUxvAmVeOuG6fHMb0MynOrnbx53tSX29FKCgbTIvynvxRGnCTvg3yHoj2O8OMB7aoPhOzqFGyp1k3ddC6-5iirQ3GPjkps3ibXZR3HrXQFzSHc Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: da596310058e4248bf33465f387956f2 Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da596310058e4248bf33465f387956f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/da596310058e4248bf33465f387956f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/da596310058e4248bf33465f387956f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_da596310058e4248bf33465f387956f2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: da596310058e4248bf33465f387956f2 Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerActionsTestJSON-1719297789 Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerActionsTestJSON-1719297789-project Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 36a36dbb4f6c40a7bb69c8c3f747aaed Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerActionsTestJSON-1719297789-project Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: exception: Instance e7f0abec-dd05-4dff-8f15-b56464346b06 could not be found. Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'e7f0abec-dd05-4dff-8f15-b56464346b06'} Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7f0abec-dd05-4dff-8f15-b56464346b06 could not be found. Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7f0abec-dd05-4dff-8f15-b56464346b06 could not be found. Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:08.609073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:08.613613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:08.613613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:08.613613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:08.613613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:08.613613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:08.613613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7f0abec-dd05-4dff-8f15-b56464346b06 could not be found. Jul 31 01:28:08.613613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:08.619382 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bc1d7657-fe27-4613-bc9e-a2dfe0dd9d21 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Returning 404 to user: Instance e7f0abec-dd05-4dff-8f15-b56464346b06 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:08.622460 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bc1d7657-fe27-4613-bc9e-a2dfe0dd9d21 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06" status: 404 len: 111 microversion: 2.1 time: 0.097057 Jul 31 01:28:08.623532 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1987/3950] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:08 2022] GET /compute/v2.1/servers/e7f0abec-dd05-4dff-8f15-b56464346b06 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:28:08.651253 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9442166b-ed9c-4416-b62a-97afc7495765 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] Calling method '.version_select at 0x7fede4834040>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:08.713157 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9442166b-ed9c-4416-b62a-97afc7495765 tempest-ServerActionsTestJSON-1719297789 tempest-ServerActionsTestJSON-1719297789-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644209376" status: 202 len: 0 microversion: 2.1 time: 0.083049 Jul 31 01:28:08.716376 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1988/3951] 10.222.0.45 () {58 vars in 1221 bytes} [Sun Jul 31 01:28:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644209376 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 01:28:09.294080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-44ea593b-67fd-4bcf-9fa5-5c35199799a3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:28:09.295285 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-44ea593b-67fd-4bcf-9fa5-5c35199799a3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:28:09.295957 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-44ea593b-67fd-4bcf-9fa5-5c35199799a3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:28:09.296557 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-44ea593b-67fd-4bcf-9fa5-5c35199799a3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:28:09.297135 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-44ea593b-67fd-4bcf-9fa5-5c35199799a3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:28:09.314623 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44ea593b-67fd-4bcf-9fa5-5c35199799a3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:09.318794 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44ea593b-67fd-4bcf-9fa5-5c35199799a3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:09.320007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44ea593b-67fd-4bcf-9fa5-5c35199799a3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:09.320643 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44ea593b-67fd-4bcf-9fa5-5c35199799a3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:09.409288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-44ea593b-67fd-4bcf-9fa5-5c35199799a3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Getting quotas for project 2d307769cdf8430a81a78a4fed8a539c. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:28:09.420228 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-801f8c7c-0ec0-4c17-add3-f00f8d4e0ebd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:09.420848 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-801f8c7c-0ec0-4c17-add3-f00f8d4e0ebd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:09.427436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-44ea593b-67fd-4bcf-9fa5-5c35199799a3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Getting quotas for user 316ccc283b9047a8a5e3463731025a11 and project 2d307769cdf8430a81a78a4fed8a539c. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:28:09.433135 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-801f8c7c-0ec0-4c17-add3-f00f8d4e0ebd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:09.433607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-801f8c7c-0ec0-4c17-add3-f00f8d4e0ebd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:09.434412 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-801f8c7c-0ec0-4c17-add3-f00f8d4e0ebd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:09.434856 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-801f8c7c-0ec0-4c17-add3-f00f8d4e0ebd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:09.467700 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-44ea593b-67fd-4bcf-9fa5-5c35199799a3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:28:09.474913 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-44ea593b-67fd-4bcf-9fa5-5c35199799a3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:28:09.589031 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-44ea593b-67fd-4bcf-9fa5-5c35199799a3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.564116 Jul 31 01:28:09.589940 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1964/3952] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:28:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:28:09.602052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-582c4edf-3b3c-4fa6-bbe4-ec3138c97a5c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:09.606138 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-582c4edf-3b3c-4fa6-bbe4-ec3138c97a5c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:09.614118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-582c4edf-3b3c-4fa6-bbe4-ec3138c97a5c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:09.614855 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-582c4edf-3b3c-4fa6-bbe4-ec3138c97a5c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:09.615896 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-582c4edf-3b3c-4fa6-bbe4-ec3138c97a5c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:09.616501 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-582c4edf-3b3c-4fa6-bbe4-ec3138c97a5c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:09.687284 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-582c4edf-3b3c-4fa6-bbe4-ec3138c97a5c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095998 Jul 31 01:28:09.692639 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1965/3953] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:28:09 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:28:09.715008 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9a522beb-3175-4c39-8b2a-4ae094f4cffb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:09.722112 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9a522beb-3175-4c39-8b2a-4ae094f4cffb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:09.938599 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9a522beb-3175-4c39-8b2a-4ae094f4cffb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:09.947306 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9a522beb-3175-4c39-8b2a-4ae094f4cffb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 200 len: 1217 microversion: 2.1 time: 0.253337 Jul 31 01:28:09.966056 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1966/3954] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:09 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 1217 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:10.005403 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1a89f08d-a8ce-441c-90e1-f6db71498eb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:10.015327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1a89f08d-a8ce-441c-90e1-f6db71498eb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:10.025471 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-801f8c7c-0ec0-4c17-add3-f00f8d4e0ebd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:10.037598 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1a89f08d-a8ce-441c-90e1-f6db71498eb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:10.040155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1a89f08d-a8ce-441c-90e1-f6db71498eb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:10.040308 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-801f8c7c-0ec0-4c17-add3-f00f8d4e0ebd tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1325 microversion: 2.1 time: 0.624774 Jul 31 01:28:10.040778 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1989/3955] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:09 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1325 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:10.058796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1a89f08d-a8ce-441c-90e1-f6db71498eb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:10.059417 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1a89f08d-a8ce-441c-90e1-f6db71498eb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:10.130334 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-1a89f08d-a8ce-441c-90e1-f6db71498eb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] HTTP exception thrown: Cannot 'reboot' instance c7733cd2-57de-4174-878c-f68b917b991c while it is in vm_state rescued Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1a89f08d-a8ce-441c-90e1-f6db71498eb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Request method failure captured: Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c/action HTTP/1.1 Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 28 Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dlxeTMDBunLit2vGiPrRDr1dvwQZdXub1419SqSyDOiGVHpAG6yJGGezx9r9jLdyswls0cvvjHa7zsCjK7Ca5A4yF2d26H1NpXXYaK068O8-NSelNX8BnsHr9p-9TQJIL4Ay7u6mf8S-XLTaElYJgrWyL6gNGdxZnY_92dE9hLD6X8 Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_af1bdeca391f47f3bde21459bf893f89", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 87e482f360af4e56a325960d834fb9f8 Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: {"reboot": {"type": "HARD"}} Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: exception: Cannot 'reboot' instance c7733cd2-57de-4174-878c-f68b917b991c while it is in vm_state rescued Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'c7733cd2-57de-4174-878c-f68b917b991c', 'body': {'reboot': {'type': 'HARD'}}} Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3499, in reboot Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c7733cd2-57de-4174-878c-f68b917b991c in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 01:28:10.132132 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 01:28:10.135894 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance c7733cd2-57de-4174-878c-f68b917b991c while it is in vm_state rescued Jul 31 01:28:10.135894 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:10.135894 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:10.135894 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:10.135894 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:10.135894 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:10.135894 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:10.135894 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:10.135894 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:10.135894 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance c7733cd2-57de-4174-878c-f68b917b991c while it is in vm_state rescued Jul 31 01:28:10.135894 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:10.142770 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1a89f08d-a8ce-441c-90e1-f6db71498eb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Returning 409 to user: Cannot 'reboot' instance c7733cd2-57de-4174-878c-f68b917b991c while it is in vm_state rescued {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:10.143890 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1a89f08d-a8ce-441c-90e1-f6db71498eb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c/action" status: 409 len: 145 microversion: 2.1 time: 0.158522 Jul 31 01:28:10.149134 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1967/3956] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:28:09 2022] POST /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c/action => generated 145 bytes in 182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:28:10.161032 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a43d8098-10c5-4f8d-8231-b83e28c4a63c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0f306572-729b-4b95-a357-79461887e541"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:10.169507 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a43d8098-10c5-4f8d-8231-b83e28c4a63c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:10.197224 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a43d8098-10c5-4f8d-8231-b83e28c4a63c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:10.201888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a43d8098-10c5-4f8d-8231-b83e28c4a63c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:10.212353 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a43d8098-10c5-4f8d-8231-b83e28c4a63c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:10.212927 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a43d8098-10c5-4f8d-8231-b83e28c4a63c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:10.255397 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-a43d8098-10c5-4f8d-8231-b83e28c4a63c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] HTTP exception thrown: Cannot 'rebuild' instance c7733cd2-57de-4174-878c-f68b917b991c while it is in vm_state rescued Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a43d8098-10c5-4f8d-8231-b83e28c4a63c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Request method failure captured: Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c/action HTTP/1.1 Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 65 Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dlxeTMDBunLit2vGiPrRDr1dvwQZdXub1419SqSyDOiGVHpAG6yJGGezx9r9jLdyswls0cvvjHa7zsCjK7Ca5A4yF2d26H1NpXXYaK068O8-NSelNX8BnsHr9p-9TQJIL4Ay7u6mf8S-XLTaElYJgrWyL6gNGdxZnY_92dE9hLD6X8 Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_af1bdeca391f47f3bde21459bf893f89", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 87e482f360af4e56a325960d834fb9f8 Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: {"rebuild": {"imageRef": "0f306572-729b-4b95-a357-79461887e541"}} Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: exception: Cannot 'rebuild' instance c7733cd2-57de-4174-878c-f68b917b991c while it is in vm_state rescued Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'c7733cd2-57de-4174-878c-f68b917b991c', 'body': {'rebuild': {'imageRef': '0f306572-729b-4b95-a357-79461887e541'}}} Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c7733cd2-57de-4174-878c-f68b917b991c in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:10.267695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance c7733cd2-57de-4174-878c-f68b917b991c while it is in vm_state rescued Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance c7733cd2-57de-4174-878c-f68b917b991c while it is in vm_state rescued Jul 31 01:28:10.271881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:10.274348 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a43d8098-10c5-4f8d-8231-b83e28c4a63c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Returning 409 to user: Cannot 'rebuild' instance c7733cd2-57de-4174-878c-f68b917b991c while it is in vm_state rescued {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:10.275448 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a43d8098-10c5-4f8d-8231-b83e28c4a63c tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "POST /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c/action" status: 409 len: 146 microversion: 2.1 time: 0.118956 Jul 31 01:28:10.277353 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1990/3957] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:28:10 2022] POST /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c/action => generated 146 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:28:10.292677 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c13862f9-b9a4-4465-b3da-82620e521fb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:10.293288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c13862f9-b9a4-4465-b3da-82620e521fb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:10.321514 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c13862f9-b9a4-4465-b3da-82620e521fb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:10.325935 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c13862f9-b9a4-4465-b3da-82620e521fb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:10.328699 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c13862f9-b9a4-4465-b3da-82620e521fb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:10.331822 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c13862f9-b9a4-4465-b3da-82620e521fb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:10.488489 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c13862f9-b9a4-4465-b3da-82620e521fb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:28:10.712333 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c13862f9-b9a4-4465-b3da-82620e521fb7 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 204 len: 0 microversion: 2.1 time: 0.429186 Jul 31 01:28:10.713247 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1968/3958] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:28:10 2022] DELETE /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:28:10.722603 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-adb5c166-e2d8-418d-bdba-8533b8c16fc1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:10.726567 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-adb5c166-e2d8-418d-bdba-8533b8c16fc1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:10.752806 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-adb5c166-e2d8-418d-bdba-8533b8c16fc1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:10.760527 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-adb5c166-e2d8-418d-bdba-8533b8c16fc1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:10.764639 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-adb5c166-e2d8-418d-bdba-8533b8c16fc1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:10.766932 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-adb5c166-e2d8-418d-bdba-8533b8c16fc1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:10.974163 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c000e51c-fb13-4402-b0cc-d5ab5dc7d225 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:10.975833 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c000e51c-fb13-4402-b0cc-d5ab5dc7d225 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:11.003314 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c000e51c-fb13-4402-b0cc-d5ab5dc7d225 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:11.008583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c000e51c-fb13-4402-b0cc-d5ab5dc7d225 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:11.009661 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c000e51c-fb13-4402-b0cc-d5ab5dc7d225 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:11.014682 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c000e51c-fb13-4402-b0cc-d5ab5dc7d225 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:11.456020 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c000e51c-fb13-4402-b0cc-d5ab5dc7d225 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:11.467102 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:11.480642 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c000e51c-fb13-4402-b0cc-d5ab5dc7d225 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 200 len: 1221 microversion: 2.1 time: 0.511872 Jul 31 01:28:11.483218 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1969/3959] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:10 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 1221 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:11.489985 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1daf70c1-83a2-4ad1-8af3-24906ba2e73d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:11.491241 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1daf70c1-83a2-4ad1-8af3-24906ba2e73d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:11.502358 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1daf70c1-83a2-4ad1-8af3-24906ba2e73d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:11.505690 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1daf70c1-83a2-4ad1-8af3-24906ba2e73d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:11.507036 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1daf70c1-83a2-4ad1-8af3-24906ba2e73d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:11.509379 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1daf70c1-83a2-4ad1-8af3-24906ba2e73d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:11.737694 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-adb5c166-e2d8-418d-bdba-8533b8c16fc1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:11.750134 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-adb5c166-e2d8-418d-bdba-8533b8c16fc1 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1690 microversion: 2.1 time: 1.032557 Jul 31 01:28:11.750917 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1991/3960] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:10 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1690 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:11.763032 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-a9526365-484f-426d-9e59-75c018a67aad req-6580ddd8-6788-48d5-b794-41270ac3ac03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8462cd47-4c52-4f73-8870-397ef8e2f8c8", "tag": "4533ab45-7160-4119-accd-64f31a560fe6"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:11.786523 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a9526365-484f-426d-9e59-75c018a67aad req-6580ddd8-6788-48d5-b794-41270ac3ac03 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:11.787234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a9526365-484f-426d-9e59-75c018a67aad req-6580ddd8-6788-48d5-b794-41270ac3ac03 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:11.806903 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-a9526365-484f-426d-9e59-75c018a67aad req-6580ddd8-6788-48d5-b794-41270ac3ac03 service nova] Creating event network-changed:4533ab45-7160-4119-accd-64f31a560fe6 for instance 8462cd47-4c52-4f73-8870-397ef8e2f8c8 on n-h2-master-1 Jul 31 01:28:11.833412 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-a9526365-484f-426d-9e59-75c018a67aad req-6580ddd8-6788-48d5-b794-41270ac3ac03 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081185 Jul 31 01:28:11.834049 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1992/3961] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:12.510966 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:12.514469 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1daf70c1-83a2-4ad1-8af3-24906ba2e73d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:12.519643 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2044c1a8-648d-4dcc-944f-cd5eb7a8a957 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:12.520659 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2044c1a8-648d-4dcc-944f-cd5eb7a8a957 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:12.529342 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2044c1a8-648d-4dcc-944f-cd5eb7a8a957 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:12.530501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2044c1a8-648d-4dcc-944f-cd5eb7a8a957 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:12.532185 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1daf70c1-83a2-4ad1-8af3-24906ba2e73d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1325 microversion: 2.1 time: 1.045014 Jul 31 01:28:12.532414 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2044c1a8-648d-4dcc-944f-cd5eb7a8a957 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:12.533195 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2044c1a8-648d-4dcc-944f-cd5eb7a8a957 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:12.548192 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1970/3962] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:11 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1325 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:12.773158 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-06b18bdc-c154-4265-81ac-526f21836871 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:12.776352 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-06b18bdc-c154-4265-81ac-526f21836871 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:12.780481 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:12.786223 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06b18bdc-c154-4265-81ac-526f21836871 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:12.787022 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06b18bdc-c154-4265-81ac-526f21836871 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:12.789078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06b18bdc-c154-4265-81ac-526f21836871 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:12.789933 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06b18bdc-c154-4265-81ac-526f21836871 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:12.841917 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2044c1a8-648d-4dcc-944f-cd5eb7a8a957 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:12.853665 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2044c1a8-648d-4dcc-944f-cd5eb7a8a957 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 200 len: 1275 microversion: 2.1 time: 0.343505 Jul 31 01:28:12.854794 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1993/3963] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:12 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 1275 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:13.569088 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c6152663-38c9-4f85-ab77-41b503540075 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:13.570523 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c6152663-38c9-4f85-ab77-41b503540075 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:13.579131 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6152663-38c9-4f85-ab77-41b503540075 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:13.582153 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6152663-38c9-4f85-ab77-41b503540075 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:13.583685 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6152663-38c9-4f85-ab77-41b503540075 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:13.585030 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6152663-38c9-4f85-ab77-41b503540075 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:13.922799 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-06b18bdc-c154-4265-81ac-526f21836871 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:13.935148 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-06b18bdc-c154-4265-81ac-526f21836871 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1690 microversion: 2.1 time: 1.166744 Jul 31 01:28:13.936183 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1971/3964] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:12 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1690 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:13.941756 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cb9e969d-32d7-4f47-bfc1-3a5aa0a2d0e6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:13.942618 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cb9e969d-32d7-4f47-bfc1-3a5aa0a2d0e6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:13.950718 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9e969d-32d7-4f47-bfc1-3a5aa0a2d0e6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:13.951524 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9e969d-32d7-4f47-bfc1-3a5aa0a2d0e6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:13.952533 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9e969d-32d7-4f47-bfc1-3a5aa0a2d0e6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:13.953127 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb9e969d-32d7-4f47-bfc1-3a5aa0a2d0e6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:14.841702 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c6152663-38c9-4f85-ab77-41b503540075 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:14.852210 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c6152663-38c9-4f85-ab77-41b503540075 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1325 microversion: 2.1 time: 1.286475 Jul 31 01:28:14.852846 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1994/3965] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:13 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1325 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:14.957454 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-07080b3d-72f3-48f5-bb7b-ce7a06e7ca69 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:14.958082 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-07080b3d-72f3-48f5-bb7b-ce7a06e7ca69 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:14.980092 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07080b3d-72f3-48f5-bb7b-ce7a06e7ca69 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:14.980710 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07080b3d-72f3-48f5-bb7b-ce7a06e7ca69 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:14.985111 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07080b3d-72f3-48f5-bb7b-ce7a06e7ca69 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:14.985725 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07080b3d-72f3-48f5-bb7b-ce7a06e7ca69 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:15.076409 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cb9e969d-32d7-4f47-bfc1-3a5aa0a2d0e6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:15.088752 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cb9e969d-32d7-4f47-bfc1-3a5aa0a2d0e6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 200 len: 1317 microversion: 2.1 time: 1.148551 Jul 31 01:28:15.089369 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1972/3966] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:13 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 1317 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:15.874707 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9e64f932-5175-4c4f-a134-020a44523eac tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:15.875821 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9e64f932-5175-4c4f-a134-020a44523eac tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:15.891490 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e64f932-5175-4c4f-a134-020a44523eac tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:15.892399 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e64f932-5175-4c4f-a134-020a44523eac tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:15.893716 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e64f932-5175-4c4f-a134-020a44523eac tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:15.894578 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e64f932-5175-4c4f-a134-020a44523eac tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:16.031615 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-07080b3d-72f3-48f5-bb7b-ce7a06e7ca69 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:16.052440 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-07080b3d-72f3-48f5-bb7b-ce7a06e7ca69 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1690 microversion: 2.1 time: 1.099050 Jul 31 01:28:16.053045 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1995/3967] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:14 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1690 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:16.116212 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-00c269cb-f9dd-466e-b52e-8e12b40a1831 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:16.117661 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-00c269cb-f9dd-466e-b52e-8e12b40a1831 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:16.128377 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00c269cb-f9dd-466e-b52e-8e12b40a1831 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:16.130229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00c269cb-f9dd-466e-b52e-8e12b40a1831 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:16.131594 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00c269cb-f9dd-466e-b52e-8e12b40a1831 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:16.132914 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00c269cb-f9dd-466e-b52e-8e12b40a1831 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:17.182203 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9e64f932-5175-4c4f-a134-020a44523eac tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:17.190611 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9e64f932-5175-4c4f-a134-020a44523eac tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1325 microversion: 2.1 time: 1.321103 Jul 31 01:28:17.191209 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1973/3968] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:15 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1325 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:17.196361 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-f9646321-42b8-43e9-86d0-8da3bbd70ff2 req-a63fb403-ffa9-4740-aa59-c5768d678c5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339c7371-6352-4eef-a902-b3f8c7f7c856", "tag": "4c3fc261-2bc8-414d-8e11-12c797d279a9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:17.207373 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f9646321-42b8-43e9-86d0-8da3bbd70ff2 req-a63fb403-ffa9-4740-aa59-c5768d678c5b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:17.207952 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f9646321-42b8-43e9-86d0-8da3bbd70ff2 req-a63fb403-ffa9-4740-aa59-c5768d678c5b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:17.229577 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-f9646321-42b8-43e9-86d0-8da3bbd70ff2 req-a63fb403-ffa9-4740-aa59-c5768d678c5b service nova] Creating event network-changed:4c3fc261-2bc8-414d-8e11-12c797d279a9 for instance 339c7371-6352-4eef-a902-b3f8c7f7c856 on n-h2-master-1 Jul 31 01:28:17.238906 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-f9646321-42b8-43e9-86d0-8da3bbd70ff2 req-a63fb403-ffa9-4740-aa59-c5768d678c5b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046068 Jul 31 01:28:17.240538 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1974/3969] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:17.249357 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-81bcaa54-c655-4936-9052-b66282e758ef tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:17.252426 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-81bcaa54-c655-4936-9052-b66282e758ef tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:17.262513 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81bcaa54-c655-4936-9052-b66282e758ef tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:17.263477 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81bcaa54-c655-4936-9052-b66282e758ef tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:17.265899 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81bcaa54-c655-4936-9052-b66282e758ef tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:17.267155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81bcaa54-c655-4936-9052-b66282e758ef tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:17.388159 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-00c269cb-f9dd-466e-b52e-8e12b40a1831 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:17.412956 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-00c269cb-f9dd-466e-b52e-8e12b40a1831 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 200 len: 1317 microversion: 2.1 time: 1.305349 Jul 31 01:28:17.413922 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1996/3970] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:16 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 1317 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:17.858000 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-81bcaa54-c655-4936-9052-b66282e758ef tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:17.874669 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-81bcaa54-c655-4936-9052-b66282e758ef tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1690 microversion: 2.1 time: 0.632300 Jul 31 01:28:17.876012 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1975/3971] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:17 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1690 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:18.291782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7a45730-73f9-4ff6-a804-29db155f5cf9 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:18.292444 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a7a45730-73f9-4ff6-a804-29db155f5cf9 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:18.309094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7a45730-73f9-4ff6-a804-29db155f5cf9 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:18.309553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7a45730-73f9-4ff6-a804-29db155f5cf9 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:18.310345 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7a45730-73f9-4ff6-a804-29db155f5cf9 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:18.320404 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7a45730-73f9-4ff6-a804-29db155f5cf9 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:18.443996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a62fd470-0cda-4bcc-8af2-f7314a4fd294 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:18.447412 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a62fd470-0cda-4bcc-8af2-f7314a4fd294 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:18.484065 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a62fd470-0cda-4bcc-8af2-f7314a4fd294 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:18.484927 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a62fd470-0cda-4bcc-8af2-f7314a4fd294 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:18.489656 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a62fd470-0cda-4bcc-8af2-f7314a4fd294 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:18.493926 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a62fd470-0cda-4bcc-8af2-f7314a4fd294 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:19.317558 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a62fd470-0cda-4bcc-8af2-f7314a4fd294 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:19.326379 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a62fd470-0cda-4bcc-8af2-f7314a4fd294 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 200 len: 1317 microversion: 2.1 time: 0.895343 Jul 31 01:28:19.326963 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1976/3972] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:18 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 1317 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:19.340172 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-a83ec8c6-0d7e-4ed6-90fe-1373a6dbb362 req-4b304b77-3aa1-463a-a5d6-8ff6637d1220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8462cd47-4c52-4f73-8870-397ef8e2f8c8", "name": "network-vif-plugged", "status": "completed", "tag": "4533ab45-7160-4119-accd-64f31a560fe6"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:19.390670 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:19.401825 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a83ec8c6-0d7e-4ed6-90fe-1373a6dbb362 req-4b304b77-3aa1-463a-a5d6-8ff6637d1220 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:19.402283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a83ec8c6-0d7e-4ed6-90fe-1373a6dbb362 req-4b304b77-3aa1-463a-a5d6-8ff6637d1220 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:19.421006 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:19.462138 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-a83ec8c6-0d7e-4ed6-90fe-1373a6dbb362 req-4b304b77-3aa1-463a-a5d6-8ff6637d1220 service nova] Creating event network-vif-plugged:4533ab45-7160-4119-accd-64f31a560fe6 for instance 8462cd47-4c52-4f73-8870-397ef8e2f8c8 on n-h2-master-1 Jul 31 01:28:19.463739 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a7a45730-73f9-4ff6-a804-29db155f5cf9 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:19.484814 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-a83ec8c6-0d7e-4ed6-90fe-1373a6dbb362 req-4b304b77-3aa1-463a-a5d6-8ff6637d1220 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147270 Jul 31 01:28:19.484814 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1977/3973] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:19.489793 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a7a45730-73f9-4ff6-a804-29db155f5cf9 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1325 microversion: 2.1 time: 1.203330 Jul 31 01:28:19.490961 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1997/3974] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:18 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1325 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:19.496975 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ee4a0aa5-7411-466e-90f4-72b8915e4f25 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:19.497984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ee4a0aa5-7411-466e-90f4-72b8915e4f25 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:19.505226 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee4a0aa5-7411-466e-90f4-72b8915e4f25 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:19.507067 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee4a0aa5-7411-466e-90f4-72b8915e4f25 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:19.508278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee4a0aa5-7411-466e-90f4-72b8915e4f25 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:19.508922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee4a0aa5-7411-466e-90f4-72b8915e4f25 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:19.636870 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ee4a0aa5-7411-466e-90f4-72b8915e4f25 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:19.644596 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ee4a0aa5-7411-466e-90f4-72b8915e4f25 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 200 len: 1622 microversion: 2.1 time: 0.166255 Jul 31 01:28:19.645413 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1978/3975] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:19 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 1622 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:20.353772 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-43778529-0251-475f-b918-fab8f1ab7c04 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:20.354415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-43778529-0251-475f-b918-fab8f1ab7c04 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:20.367654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43778529-0251-475f-b918-fab8f1ab7c04 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:20.369664 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43778529-0251-475f-b918-fab8f1ab7c04 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:20.370500 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43778529-0251-475f-b918-fab8f1ab7c04 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:20.371987 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43778529-0251-475f-b918-fab8f1ab7c04 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:20.437682 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-3d00b7c5-b2e8-4d24-916c-3bc58b3c0bdf req-03a4999c-66dc-430f-bb86-6177fdcd0f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1c5a15-18aa-437c-a4fb-77eaaf234ac0", "name": "network-vif-deleted", "tag": "6f32f8d1-4311-494f-a106-51bb2bbad03f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:20.451215 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=8 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:20.466808 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3d00b7c5-b2e8-4d24-916c-3bc58b3c0bdf req-03a4999c-66dc-430f-bb86-6177fdcd0f33 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:20.470974 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3d00b7c5-b2e8-4d24-916c-3bc58b3c0bdf req-03a4999c-66dc-430f-bb86-6177fdcd0f33 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:20.502358 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-3d00b7c5-b2e8-4d24-916c-3bc58b3c0bdf req-03a4999c-66dc-430f-bb86-6177fdcd0f33 service nova] Creating event network-vif-deleted:6f32f8d1-4311-494f-a106-51bb2bbad03f for instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 on n-h1-master-1 Jul 31 01:28:20.522105 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-3d00b7c5-b2e8-4d24-916c-3bc58b3c0bdf req-03a4999c-66dc-430f-bb86-6177fdcd0f33 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089069 Jul 31 01:28:20.527701 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1979/3976] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:28:20.538755 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-42cd837e-24b2-4b06-a39b-0433ba87d97e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:20.539712 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-42cd837e-24b2-4b06-a39b-0433ba87d97e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:20.555823 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42cd837e-24b2-4b06-a39b-0433ba87d97e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:20.566304 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42cd837e-24b2-4b06-a39b-0433ba87d97e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:20.568232 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42cd837e-24b2-4b06-a39b-0433ba87d97e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:20.573571 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42cd837e-24b2-4b06-a39b-0433ba87d97e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:21.328944 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-43778529-0251-475f-b918-fab8f1ab7c04 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:21.341239 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-43778529-0251-475f-b918-fab8f1ab7c04 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 200 len: 1317 microversion: 2.1 time: 0.993063 Jul 31 01:28:21.343237 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1998/3977] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:20 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 1317 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:21.351923 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed34c13a-8635-4bcc-829b-c45c6bb010b8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:21.357482 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ed34c13a-8635-4bcc-829b-c45c6bb010b8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:21.374402 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed34c13a-8635-4bcc-829b-c45c6bb010b8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:21.374866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed34c13a-8635-4bcc-829b-c45c6bb010b8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:21.375691 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed34c13a-8635-4bcc-829b-c45c6bb010b8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:21.376196 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed34c13a-8635-4bcc-829b-c45c6bb010b8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:21.401014 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-ed34c13a-8635-4bcc-829b-c45c6bb010b8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] HTTP exception thrown: Instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 could not be found. Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed34c13a-8635-4bcc-829b-c45c6bb010b8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Request method failure captured: Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 HTTP/1.1 Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dlxeTMDBunLit2vGiPrRDr1dvwQZdXub1419SqSyDOiGVHpAG6yJGGezx9r9jLdyswls0cvvjHa7zsCjK7Ca5A4yF2d26H1NpXXYaK068O8-NSelNX8BnsHr9p-9TQJIL4Ay7u6mf8S-XLTaElYJgrWyL6gNGdxZnY_92dE9hLD6X8 Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_af1bdeca391f47f3bde21459bf893f89", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 87e482f360af4e56a325960d834fb9f8 Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 could not be found. Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '8c1c5a15-18aa-437c-a4fb-77eaaf234ac0'} Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 could not be found. Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 could not be found. Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:21.403106 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:21.407291 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:21.407291 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:21.407291 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:21.407291 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:21.407291 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:21.407291 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 could not be found. Jul 31 01:28:21.407291 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:21.408644 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed34c13a-8635-4bcc-829b-c45c6bb010b8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Returning 404 to user: Instance 8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:21.409668 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ed34c13a-8635-4bcc-829b-c45c6bb010b8 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0" status: 404 len: 111 microversion: 2.1 time: 0.064622 Jul 31 01:28:21.410706 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 1999/3978] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:21 2022] GET /compute/v2.1/servers/8c1c5a15-18aa-437c-a4fb-77eaaf234ac0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:28:21.419555 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d771c149-25c1-4616-b87b-df0e555963eb tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '.version_select at 0x7fedeaa13d30>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:21.469540 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-42cd837e-24b2-4b06-a39b-0433ba87d97e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:21.470099 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d771c149-25c1-4616-b87b-df0e555963eb tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819922888" status: 202 len: 0 microversion: 2.1 time: 0.053975 Jul 31 01:28:21.473762 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2000/3979] 10.222.0.45 () {58 vars in 1221 bytes} [Sun Jul 31 01:28:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819922888 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:28:21.481764 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-42cd837e-24b2-4b06-a39b-0433ba87d97e tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1325 microversion: 2.1 time: 0.952193 Jul 31 01:28:21.482359 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1980/3980] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:20 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1325 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:22.368921 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-70d35425-7c48-4abb-9e63-9ab7b84ccb5a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:22.369548 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-70d35425-7c48-4abb-9e63-9ab7b84ccb5a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:22.380514 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-70d35425-7c48-4abb-9e63-9ab7b84ccb5a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:22.381043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-70d35425-7c48-4abb-9e63-9ab7b84ccb5a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:22.381761 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-70d35425-7c48-4abb-9e63-9ab7b84ccb5a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:22.382246 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-70d35425-7c48-4abb-9e63-9ab7b84ccb5a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:22.510217 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c43e0ee5-074e-4851-9fc8-ce528e9c201d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:22.510986 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c43e0ee5-074e-4851-9fc8-ce528e9c201d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:22.531456 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c43e0ee5-074e-4851-9fc8-ce528e9c201d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:22.534692 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c43e0ee5-074e-4851-9fc8-ce528e9c201d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:22.537256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c43e0ee5-074e-4851-9fc8-ce528e9c201d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:22.538385 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c43e0ee5-074e-4851-9fc8-ce528e9c201d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:22.839153 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-70d35425-7c48-4abb-9e63-9ab7b84ccb5a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:22.852847 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-70d35425-7c48-4abb-9e63-9ab7b84ccb5a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 200 len: 1317 microversion: 2.1 time: 0.488416 Jul 31 01:28:22.853787 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2001/3981] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:22 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:23.032384 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c43e0ee5-074e-4851-9fc8-ce528e9c201d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:23.071618 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c43e0ee5-074e-4851-9fc8-ce528e9c201d tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1522 microversion: 2.1 time: 0.562981 Jul 31 01:28:23.077220 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1981/3982] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:22 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:23.102591 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0114d52f-f4f2-417d-9afc-b07046e094d1 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:23.103271 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0114d52f-f4f2-417d-9afc-b07046e094d1 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:23.123225 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0114d52f-f4f2-417d-9afc-b07046e094d1 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:23.123869 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0114d52f-f4f2-417d-9afc-b07046e094d1 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:23.125053 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0114d52f-f4f2-417d-9afc-b07046e094d1 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:23.126516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0114d52f-f4f2-417d-9afc-b07046e094d1 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:23.201623 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0114d52f-f4f2-417d-9afc-b07046e094d1 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:28:23.400917 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0114d52f-f4f2-417d-9afc-b07046e094d1 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 204 len: 0 microversion: 2.1 time: 0.303713 Jul 31 01:28:23.403222 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2002/3983] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:28:23 2022] DELETE /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:28:23.415260 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a7633993-76f4-4cd6-88c7-a6a111a81feb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:23.416501 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a7633993-76f4-4cd6-88c7-a6a111a81feb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:23.459573 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7633993-76f4-4cd6-88c7-a6a111a81feb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:23.460043 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7633993-76f4-4cd6-88c7-a6a111a81feb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:23.463184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7633993-76f4-4cd6-88c7-a6a111a81feb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:23.466485 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7633993-76f4-4cd6-88c7-a6a111a81feb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:23.876112 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0dd17b27-6f78-4cdf-a058-a20bd39609a5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:23.877068 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0dd17b27-6f78-4cdf-a058-a20bd39609a5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:23.891989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0dd17b27-6f78-4cdf-a058-a20bd39609a5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:23.894756 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0dd17b27-6f78-4cdf-a058-a20bd39609a5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:23.899770 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0dd17b27-6f78-4cdf-a058-a20bd39609a5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:23.900247 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0dd17b27-6f78-4cdf-a058-a20bd39609a5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:23.949864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a7633993-76f4-4cd6-88c7-a6a111a81feb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:23.961862 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a7633993-76f4-4cd6-88c7-a6a111a81feb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1528 microversion: 2.1 time: 0.555073 Jul 31 01:28:23.962482 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1982/3984] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:23 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1528 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:24.416795 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0dd17b27-6f78-4cdf-a058-a20bd39609a5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:24.442242 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0dd17b27-6f78-4cdf-a058-a20bd39609a5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 200 len: 1317 microversion: 2.1 time: 0.568708 Jul 31 01:28:24.444775 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2003/3985] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:23 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:24.854923 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-49835e95-fa5e-45c8-be0e-e1e9d5c26b1e req-060709c7-c6cb-42a0-830b-1d430ac29505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339c7371-6352-4eef-a902-b3f8c7f7c856", "name": "network-vif-plugged", "status": "completed", "tag": "4c3fc261-2bc8-414d-8e11-12c797d279a9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:24.885318 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-49835e95-fa5e-45c8-be0e-e1e9d5c26b1e req-060709c7-c6cb-42a0-830b-1d430ac29505 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:24.885537 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-49835e95-fa5e-45c8-be0e-e1e9d5c26b1e req-060709c7-c6cb-42a0-830b-1d430ac29505 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:24.912917 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-49835e95-fa5e-45c8-be0e-e1e9d5c26b1e req-060709c7-c6cb-42a0-830b-1d430ac29505 service nova] Creating event network-vif-plugged:4c3fc261-2bc8-414d-8e11-12c797d279a9 for instance 339c7371-6352-4eef-a902-b3f8c7f7c856 on n-h2-master-1 Jul 31 01:28:24.924418 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-49835e95-fa5e-45c8-be0e-e1e9d5c26b1e req-060709c7-c6cb-42a0-830b-1d430ac29505 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075107 Jul 31 01:28:24.925764 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1983/3986] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:28:24.984073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1d2b734f-cd73-4df4-a9da-36f3462ef695 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:24.986384 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1d2b734f-cd73-4df4-a9da-36f3462ef695 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:25.002702 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d2b734f-cd73-4df4-a9da-36f3462ef695 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:25.003659 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d2b734f-cd73-4df4-a9da-36f3462ef695 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:25.004678 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d2b734f-cd73-4df4-a9da-36f3462ef695 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:25.005432 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d2b734f-cd73-4df4-a9da-36f3462ef695 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:25.030947 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:25.298948 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1d2b734f-cd73-4df4-a9da-36f3462ef695 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:25.313487 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1d2b734f-cd73-4df4-a9da-36f3462ef695 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1528 microversion: 2.1 time: 0.334454 Jul 31 01:28:25.315588 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2004/3987] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:24 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1528 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:25.476668 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-06e6e0da-83d9-4727-b135-4fe008c0d796 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:25.478314 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-06e6e0da-83d9-4727-b135-4fe008c0d796 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:25.488205 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06e6e0da-83d9-4727-b135-4fe008c0d796 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:25.489053 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06e6e0da-83d9-4727-b135-4fe008c0d796 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:25.490687 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06e6e0da-83d9-4727-b135-4fe008c0d796 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:25.491378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06e6e0da-83d9-4727-b135-4fe008c0d796 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:25.862526 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-06e6e0da-83d9-4727-b135-4fe008c0d796 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:25.878867 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-06e6e0da-83d9-4727-b135-4fe008c0d796 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 200 len: 1317 microversion: 2.1 time: 0.413548 Jul 31 01:28:25.898375 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1984/3988] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:25 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:26.348211 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a77ec2fd-76a0-41cc-8b52-1304a9fb0d53 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:26.349025 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a77ec2fd-76a0-41cc-8b52-1304a9fb0d53 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:26.359906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a77ec2fd-76a0-41cc-8b52-1304a9fb0d53 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:26.360381 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a77ec2fd-76a0-41cc-8b52-1304a9fb0d53 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:26.361183 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a77ec2fd-76a0-41cc-8b52-1304a9fb0d53 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:26.361641 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a77ec2fd-76a0-41cc-8b52-1304a9fb0d53 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:26.626842 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a77ec2fd-76a0-41cc-8b52-1304a9fb0d53 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:26.637798 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a77ec2fd-76a0-41cc-8b52-1304a9fb0d53 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1528 microversion: 2.1 time: 0.302209 Jul 31 01:28:26.641098 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2005/3989] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:26 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1528 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:26.902584 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4d66db8d-ea42-464f-8819-f23d971c8ae4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:26.903901 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4d66db8d-ea42-464f-8819-f23d971c8ae4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:26.913434 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d66db8d-ea42-464f-8819-f23d971c8ae4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:26.920579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d66db8d-ea42-464f-8819-f23d971c8ae4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:26.921618 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d66db8d-ea42-464f-8819-f23d971c8ae4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:26.922996 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d66db8d-ea42-464f-8819-f23d971c8ae4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:27.370077 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4d66db8d-ea42-464f-8819-f23d971c8ae4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:27.380648 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4d66db8d-ea42-464f-8819-f23d971c8ae4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 200 len: 1506 microversion: 2.1 time: 0.482032 Jul 31 01:28:27.383080 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1985/3990] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:26 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:27.409706 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1cf01de7-b7d8-4577-be8b-16c8723457fc tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:27.414544 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1cf01de7-b7d8-4577-be8b-16c8723457fc tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:27.438998 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1cf01de7-b7d8-4577-be8b-16c8723457fc tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:27.444934 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1cf01de7-b7d8-4577-be8b-16c8723457fc tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:27.448080 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1cf01de7-b7d8-4577-be8b-16c8723457fc tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:27.448963 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1cf01de7-b7d8-4577-be8b-16c8723457fc tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:27.493003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1a492f42-c1b6-4963-84af-3cde53590c55 req-73da7b8c-4826-4adf-b0a2-a2cc81e34834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8462cd47-4c52-4f73-8870-397ef8e2f8c8", "name": "network-vif-deleted", "tag": "4533ab45-7160-4119-accd-64f31a560fe6"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:27.534404 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1a492f42-c1b6-4963-84af-3cde53590c55 req-73da7b8c-4826-4adf-b0a2-a2cc81e34834 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:27.535090 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1a492f42-c1b6-4963-84af-3cde53590c55 req-73da7b8c-4826-4adf-b0a2-a2cc81e34834 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:27.561357 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1cf01de7-b7d8-4577-be8b-16c8723457fc tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:28:27.583004 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1a492f42-c1b6-4963-84af-3cde53590c55 req-73da7b8c-4826-4adf-b0a2-a2cc81e34834 service nova] Creating event network-vif-deleted:4533ab45-7160-4119-accd-64f31a560fe6 for instance 8462cd47-4c52-4f73-8870-397ef8e2f8c8 on n-h2-master-1 Jul 31 01:28:27.598267 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1a492f42-c1b6-4963-84af-3cde53590c55 req-73da7b8c-4826-4adf-b0a2-a2cc81e34834 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109076 Jul 31 01:28:27.599789 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1986/3991] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:27.667377 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7d369588-5a81-45c9-935e-d13c58b37c90 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:27.673488 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7d369588-5a81-45c9-935e-d13c58b37c90 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:27.688277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d369588-5a81-45c9-935e-d13c58b37c90 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:27.694503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d369588-5a81-45c9-935e-d13c58b37c90 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:27.698358 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d369588-5a81-45c9-935e-d13c58b37c90 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:27.698884 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d369588-5a81-45c9-935e-d13c58b37c90 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:27.754243 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1cf01de7-b7d8-4577-be8b-16c8723457fc tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "DELETE /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 204 len: 0 microversion: 2.1 time: 0.353340 Jul 31 01:28:27.755229 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2006/3992] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:28:27 2022] DELETE /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:28:27.767322 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9d3e0ca6-009e-4545-b80b-57eb01808af7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:27.771429 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9d3e0ca6-009e-4545-b80b-57eb01808af7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:27.782048 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d369588-5a81-45c9-935e-d13c58b37c90 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:27.782511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d369588-5a81-45c9-935e-d13c58b37c90 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:27.784079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-7d369588-5a81-45c9-935e-d13c58b37c90 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lazy-loading 'fault' on Instance uuid 8462cd47-4c52-4f73-8870-397ef8e2f8c8 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:28:27.793313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d3e0ca6-009e-4545-b80b-57eb01808af7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:27.795456 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d3e0ca6-009e-4545-b80b-57eb01808af7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:27.797028 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d3e0ca6-009e-4545-b80b-57eb01808af7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:27.798657 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d3e0ca6-009e-4545-b80b-57eb01808af7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:27.866714 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7d369588-5a81-45c9-935e-d13c58b37c90 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:27.876726 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7d369588-5a81-45c9-935e-d13c58b37c90 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1315 microversion: 2.1 time: 0.217017 Jul 31 01:28:27.879984 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1987/3993] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:27 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:28.047875 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9d3e0ca6-009e-4545-b80b-57eb01808af7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:28.058571 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9d3e0ca6-009e-4545-b80b-57eb01808af7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 200 len: 1512 microversion: 2.1 time: 0.297317 Jul 31 01:28:28.058571 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2007/3994] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:27 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 1512 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:28.905577 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-33bb9c74-6585-41c8-861f-8a1f6ebdd725 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:28.908044 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-33bb9c74-6585-41c8-861f-8a1f6ebdd725 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:28.920541 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33bb9c74-6585-41c8-861f-8a1f6ebdd725 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:28.921539 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33bb9c74-6585-41c8-861f-8a1f6ebdd725 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:28.923202 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33bb9c74-6585-41c8-861f-8a1f6ebdd725 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:28.925321 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33bb9c74-6585-41c8-861f-8a1f6ebdd725 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:29.009636 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33bb9c74-6585-41c8-861f-8a1f6ebdd725 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:29.012692 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-33bb9c74-6585-41c8-861f-8a1f6ebdd725 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:29.016307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-33bb9c74-6585-41c8-861f-8a1f6ebdd725 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lazy-loading 'fault' on Instance uuid 8462cd47-4c52-4f73-8870-397ef8e2f8c8 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:28:29.083766 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-224b163c-ab0a-4058-8a6a-136abd7cb4a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:29.084452 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-224b163c-ab0a-4058-8a6a-136abd7cb4a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:29.112098 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-224b163c-ab0a-4058-8a6a-136abd7cb4a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:29.112567 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-224b163c-ab0a-4058-8a6a-136abd7cb4a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:29.119451 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-224b163c-ab0a-4058-8a6a-136abd7cb4a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:29.120021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-224b163c-ab0a-4058-8a6a-136abd7cb4a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:29.291604 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-33bb9c74-6585-41c8-861f-8a1f6ebdd725 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0850646f5b4fdeabc4d50297626e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c609eaf96fc84008b10c26b3f56edd69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:29.315658 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-33bb9c74-6585-41c8-861f-8a1f6ebdd725 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 200 len: 1315 microversion: 2.1 time: 0.418418 Jul 31 01:28:29.319008 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1988/3995] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:28 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:29.681532 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-224b163c-ab0a-4058-8a6a-136abd7cb4a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:29.694044 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-224b163c-ab0a-4058-8a6a-136abd7cb4a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 200 len: 1512 microversion: 2.1 time: 0.616855 Jul 31 01:28:29.710600 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2008/3996] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:29 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 1512 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:30.341875 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f8904501-84ee-4d12-82fb-c1b35f15a769 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:30.342639 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f8904501-84ee-4d12-82fb-c1b35f15a769 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 8462cd47-4c52-4f73-8870-397ef8e2f8c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:30.359084 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8904501-84ee-4d12-82fb-c1b35f15a769 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:30.360571 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8904501-84ee-4d12-82fb-c1b35f15a769 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:30.361407 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8904501-84ee-4d12-82fb-c1b35f15a769 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:30.362969 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8904501-84ee-4d12-82fb-c1b35f15a769 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:30.423185 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-f8904501-84ee-4d12-82fb-c1b35f15a769 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] HTTP exception thrown: Instance 8462cd47-4c52-4f73-8870-397ef8e2f8c8 could not be found. Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f8904501-84ee-4d12-82fb-c1b35f15a769 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Request method failure captured: Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 HTTP/1.1 Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5do_qvGtrm8MFTSKrTw8R7jgmTzyETsET8_Bks35mozq5SQhUaDIA0oib2wHXXTKsc9AVPMwnRA1N8ACvVn62cvXmTWUR5or87UcB5lhe7JDpnHvkxRMhg6Zlak4K6e0-cQsqquMOz1g27fd3AjZnreZQbV510uuuf140sds5ry5cxM Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c609eaf96fc84008b10c26b3f56edd69", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: df0850646f5b4fdeabc4d50297626e27 Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 8462cd47-4c52-4f73-8870-397ef8e2f8c8 could not be found. Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '8462cd47-4c52-4f73-8870-397ef8e2f8c8'} Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8462cd47-4c52-4f73-8870-397ef8e2f8c8 could not be found. Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8462cd47-4c52-4f73-8870-397ef8e2f8c8 could not be found. Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.425702 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:30.430103 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.430103 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:30.430103 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:30.430103 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:30.430103 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:30.430103 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:30.430103 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8462cd47-4c52-4f73-8870-397ef8e2f8c8 could not be found. Jul 31 01:28:30.430103 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.430103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f8904501-84ee-4d12-82fb-c1b35f15a769 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Returning 404 to user: Instance 8462cd47-4c52-4f73-8870-397ef8e2f8c8 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:30.430888 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f8904501-84ee-4d12-82fb-c1b35f15a769 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8" status: 404 len: 111 microversion: 2.1 time: 0.093761 Jul 31 01:28:30.432442 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1989/3997] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:30 2022] GET /compute/v2.1/servers/8462cd47-4c52-4f73-8870-397ef8e2f8c8 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:28:30.439930 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6bf125b6-696f-48b3-9c94-eb879b3de0fb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '.version_select at 0x7fede47ce4c0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:30.472032 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-6bf125b6-696f-48b3-9c94-eb879b3de0fb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] HTTP exception thrown: Image not found. Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6bf125b6-696f-48b3-9c94-eb879b3de0fb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Request method failure captured: Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/images/e8477d21-fe9e-4a0c-b9b8-cec003f0a435 HTTP/1.1 Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5do_qvGtrm8MFTSKrTw8R7jgmTzyETsET8_Bks35mozq5SQhUaDIA0oib2wHXXTKsc9AVPMwnRA1N8ACvVn62cvXmTWUR5or87UcB5lhe7JDpnHvkxRMhg6Zlak4K6e0-cQsqquMOz1g27fd3AjZnreZQbV510uuuf140sds5ry5cxM Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c609eaf96fc84008b10c26b3f56edd69", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: df0850646f5b4fdeabc4d50297626e27 Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: exception: Image not found. Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'e8477d21-fe9e-4a0c-b9b8-cec003f0a435'} Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e8477d21-fe9e-4a0c-b9b8-cec003f0a435 to delete Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e8477d21-fe9e-4a0c-b9b8-cec003f0a435 could not be found. Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:30.480963 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6bf125b6-696f-48b3-9c94-eb879b3de0fb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Returning 404 to user: Image not found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:30.485760 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6bf125b6-696f-48b3-9c94-eb879b3de0fb tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "DELETE /compute/v2.1/images/e8477d21-fe9e-4a0c-b9b8-cec003f0a435" status: 404 len: 62 microversion: 2.1 time: 0.047897 Jul 31 01:28:30.500622 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2009/3998] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:30 2022] DELETE /compute/v2.1/images/e8477d21-fe9e-4a0c-b9b8-cec003f0a435 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:28:30.510267 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-109620aa-04f0-4918-9d8a-c6763e386a42 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:30.510968 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-109620aa-04f0-4918-9d8a-c6763e386a42 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:30.524652 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-109620aa-04f0-4918-9d8a-c6763e386a42 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:30.525270 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-109620aa-04f0-4918-9d8a-c6763e386a42 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:30.526212 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-109620aa-04f0-4918-9d8a-c6763e386a42 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:30.528876 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-109620aa-04f0-4918-9d8a-c6763e386a42 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:30.555322 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-109620aa-04f0-4918-9d8a-c6763e386a42 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] HTTP exception thrown: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-109620aa-04f0-4918-9d8a-c6763e386a42 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Request method failure captured: Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 HTTP/1.1 Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5do_qvGtrm8MFTSKrTw8R7jgmTzyETsET8_Bks35mozq5SQhUaDIA0oib2wHXXTKsc9AVPMwnRA1N8ACvVn62cvXmTWUR5or87UcB5lhe7JDpnHvkxRMhg6Zlak4K6e0-cQsqquMOz1g27fd3AjZnreZQbV510uuuf140sds5ry5cxM Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c609eaf96fc84008b10c26b3f56edd69", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: df0850646f5b4fdeabc4d50297626e27 Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '714af515-1e35-4ff6-a184-5b246b892425'} Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:28:30.557114 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:28:30.561499 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. Jul 31 01:28:30.561499 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.561499 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:30.561499 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.561499 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:30.561499 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:30.561499 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:30.561499 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:30.561499 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:30.561499 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. Jul 31 01:28:30.561499 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.562658 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-109620aa-04f0-4918-9d8a-c6763e386a42 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Returning 404 to user: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:30.563708 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-109620aa-04f0-4918-9d8a-c6763e386a42 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "DELETE /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 404 len: 111 microversion: 2.1 time: 0.058777 Jul 31 01:28:30.564849 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1990/3999] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:28:30 2022] DELETE /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:28:30.574412 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f5610134-f24b-4e8d-8217-d4f44c92d0f7 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:30.575184 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f5610134-f24b-4e8d-8217-d4f44c92d0f7 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 714af515-1e35-4ff6-a184-5b246b892425] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:30.592887 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5610134-f24b-4e8d-8217-d4f44c92d0f7 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:30.593446 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5610134-f24b-4e8d-8217-d4f44c92d0f7 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:30.594400 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5610134-f24b-4e8d-8217-d4f44c92d0f7 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:30.595097 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f5610134-f24b-4e8d-8217-d4f44c92d0f7 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:30.633404 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-f5610134-f24b-4e8d-8217-d4f44c92d0f7 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] HTTP exception thrown: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f5610134-f24b-4e8d-8217-d4f44c92d0f7 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Request method failure captured: Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 HTTP/1.1 Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5do_qvGtrm8MFTSKrTw8R7jgmTzyETsET8_Bks35mozq5SQhUaDIA0oib2wHXXTKsc9AVPMwnRA1N8ACvVn62cvXmTWUR5or87UcB5lhe7JDpnHvkxRMhg6Zlak4K6e0-cQsqquMOz1g27fd3AjZnreZQbV510uuuf140sds5ry5cxM Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c609eaf96fc84008b10c26b3f56edd69", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: df0850646f5b4fdeabc4d50297626e27 Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '714af515-1e35-4ff6-a184-5b246b892425'} Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.635644 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:30.640268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.640268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:30.640268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:30.640268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:30.640268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:30.640268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:30.640268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. Jul 31 01:28:30.640268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:30.641722 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f5610134-f24b-4e8d-8217-d4f44c92d0f7 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Returning 404 to user: Instance 714af515-1e35-4ff6-a184-5b246b892425 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:30.643044 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f5610134-f24b-4e8d-8217-d4f44c92d0f7 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425" status: 404 len: 111 microversion: 2.1 time: 0.074136 Jul 31 01:28:30.644130 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2010/4000] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:30 2022] GET /compute/v2.1/servers/714af515-1e35-4ff6-a184-5b246b892425 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:28:30.653178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cbdc6a7a-cdf9-4c77-a4a3-f209e30714ab tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '.version_select at 0x7fedea83d820>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:30.678582 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cbdc6a7a-cdf9-4c77-a4a3-f209e30714ab tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010233348" status: 202 len: 0 microversion: 2.1 time: 0.029283 Jul 31 01:28:30.679185 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1991/4001] 10.222.0.45 () {58 vars in 1221 bytes} [Sun Jul 31 01:28:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010233348 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:28:30.718373 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c4feeb9c-7ad5-45cd-bc11-517b13b65d53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:30.720469 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c4feeb9c-7ad5-45cd-bc11-517b13b65d53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:30.737817 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c4feeb9c-7ad5-45cd-bc11-517b13b65d53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:30.738649 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c4feeb9c-7ad5-45cd-bc11-517b13b65d53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:30.739803 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c4feeb9c-7ad5-45cd-bc11-517b13b65d53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:30.740598 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c4feeb9c-7ad5-45cd-bc11-517b13b65d53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:31.251384 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c4feeb9c-7ad5-45cd-bc11-517b13b65d53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:31.261689 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c4feeb9c-7ad5-45cd-bc11-517b13b65d53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 200 len: 1512 microversion: 2.1 time: 0.547826 Jul 31 01:28:31.266318 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2011/4002] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:30 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 1512 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:32.288948 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0a59f4b4-3fcc-4416-aad7-75fd20d7106d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:32.289703 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0a59f4b4-3fcc-4416-aad7-75fd20d7106d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:32.308638 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a59f4b4-3fcc-4416-aad7-75fd20d7106d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:32.309115 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a59f4b4-3fcc-4416-aad7-75fd20d7106d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:32.311209 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a59f4b4-3fcc-4416-aad7-75fd20d7106d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:32.312929 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a59f4b4-3fcc-4416-aad7-75fd20d7106d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:32.452877 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-da265fb3-62a3-40b3-bd35-1b1521e046a5 req-7913022c-17e0-4707-9d17-d164778d207e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339c7371-6352-4eef-a902-b3f8c7f7c856", "name": "network-vif-deleted", "tag": "4c3fc261-2bc8-414d-8e11-12c797d279a9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:32.492471 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:32.505116 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0a59f4b4-3fcc-4416-aad7-75fd20d7106d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:32.520078 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-da265fb3-62a3-40b3-bd35-1b1521e046a5 req-7913022c-17e0-4707-9d17-d164778d207e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:32.520392 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0a59f4b4-3fcc-4416-aad7-75fd20d7106d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 200 len: 1470 microversion: 2.1 time: 0.232462 Jul 31 01:28:32.520557 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-da265fb3-62a3-40b3-bd35-1b1521e046a5 req-7913022c-17e0-4707-9d17-d164778d207e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:32.526421 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1992/4003] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:32 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 1470 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:32.624556 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-da265fb3-62a3-40b3-bd35-1b1521e046a5 req-7913022c-17e0-4707-9d17-d164778d207e service nova] Creating event network-vif-deleted:4c3fc261-2bc8-414d-8e11-12c797d279a9 for instance 339c7371-6352-4eef-a902-b3f8c7f7c856 on n-h2-master-1 Jul 31 01:28:32.633839 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-099a1375-e203-4113-8d83-a468e2d99f3f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:32.634443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-099a1375-e203-4113-8d83-a468e2d99f3f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:32.639831 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-da265fb3-62a3-40b3-bd35-1b1521e046a5 req-7913022c-17e0-4707-9d17-d164778d207e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202647 Jul 31 01:28:32.643997 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2012/4004] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:32.649225 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-099a1375-e203-4113-8d83-a468e2d99f3f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:32.650110 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-099a1375-e203-4113-8d83-a468e2d99f3f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:32.654178 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-099a1375-e203-4113-8d83-a468e2d99f3f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:32.658565 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-099a1375-e203-4113-8d83-a468e2d99f3f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:32.761196 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-099a1375-e203-4113-8d83-a468e2d99f3f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:28:32.964795 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-099a1375-e203-4113-8d83-a468e2d99f3f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 204 len: 0 microversion: 2.1 time: 0.335473 Jul 31 01:28:32.966359 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1993/4005] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:28:32 2022] DELETE /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:28:32.977823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dd1f37d1-4ddb-40d0-9534-16b83607ccb5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:32.978596 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dd1f37d1-4ddb-40d0-9534-16b83607ccb5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:33.007083 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd1f37d1-4ddb-40d0-9534-16b83607ccb5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:33.010540 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd1f37d1-4ddb-40d0-9534-16b83607ccb5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:33.014095 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd1f37d1-4ddb-40d0-9534-16b83607ccb5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:33.016649 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd1f37d1-4ddb-40d0-9534-16b83607ccb5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:33.548363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5d338386-875a-45ba-adac-be48f1557a69 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:33.549278 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5d338386-875a-45ba-adac-be48f1557a69 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:33.563795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d338386-875a-45ba-adac-be48f1557a69 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:33.564416 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d338386-875a-45ba-adac-be48f1557a69 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:33.565326 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d338386-875a-45ba-adac-be48f1557a69 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:33.567844 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d338386-875a-45ba-adac-be48f1557a69 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:33.721128 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d338386-875a-45ba-adac-be48f1557a69 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:33.724012 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d338386-875a-45ba-adac-be48f1557a69 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:33.726271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-5d338386-875a-45ba-adac-be48f1557a69 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lazy-loading 'fault' on Instance uuid 339c7371-6352-4eef-a902-b3f8c7f7c856 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:28:34.021511 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5d338386-875a-45ba-adac-be48f1557a69 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:34.042258 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5d338386-875a-45ba-adac-be48f1557a69 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 200 len: 1307 microversion: 2.1 time: 0.498090 Jul 31 01:28:34.043216 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1994/4006] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:33 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 1307 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:34.681130 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dd1f37d1-4ddb-40d0-9534-16b83607ccb5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:34.692457 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dd1f37d1-4ddb-40d0-9534-16b83607ccb5 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1507 microversion: 2.1 time: 1.720355 Jul 31 01:28:34.735076 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2013/4007] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:32 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1507 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:35.070253 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c1257e7c-c7e5-428c-b30b-758fe63f7179 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:35.071755 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c1257e7c-c7e5-428c-b30b-758fe63f7179 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:35.087088 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1257e7c-c7e5-428c-b30b-758fe63f7179 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:35.088839 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1257e7c-c7e5-428c-b30b-758fe63f7179 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:35.092832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1257e7c-c7e5-428c-b30b-758fe63f7179 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:35.093480 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1257e7c-c7e5-428c-b30b-758fe63f7179 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:35.118036 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-c1257e7c-c7e5-428c-b30b-758fe63f7179 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c1257e7c-c7e5-428c-b30b-758fe63f7179 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 HTTP/1.1 Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '339c7371-6352-4eef-a902-b3f8c7f7c856'} Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:35.120500 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:35.125175 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:35.125175 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:35.125175 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:35.125175 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:35.125175 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:35.125175 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:28:35.125175 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:35.125175 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c1257e7c-c7e5-428c-b30b-758fe63f7179 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:35.125175 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c1257e7c-c7e5-428c-b30b-758fe63f7179 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 404 len: 111 microversion: 2.1 time: 0.060565 Jul 31 01:28:35.133527 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1995/4008] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:35 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:28:35.147672 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-97321440-4eec-49b5-93e3-875cd6c9a466 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:35.149680 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-97321440-4eec-49b5-93e3-875cd6c9a466 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:35.158526 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97321440-4eec-49b5-93e3-875cd6c9a466 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:35.159077 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97321440-4eec-49b5-93e3-875cd6c9a466 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:35.159969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97321440-4eec-49b5-93e3-875cd6c9a466 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:35.160834 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97321440-4eec-49b5-93e3-875cd6c9a466 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:35.486764 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1017f7df-33ed-457e-b138-9c82104687fd req-cd89676a-fc92-473a-83a1-166e5d703598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7733cd2-57de-4174-878c-f68b917b991c", "name": "network-vif-deleted", "tag": "70710cea-27b7-4189-8439-7f0de6882981"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:35.511388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1017f7df-33ed-457e-b138-9c82104687fd req-cd89676a-fc92-473a-83a1-166e5d703598 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:35.513926 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1017f7df-33ed-457e-b138-9c82104687fd req-cd89676a-fc92-473a-83a1-166e5d703598 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:35.603019 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1017f7df-33ed-457e-b138-9c82104687fd req-cd89676a-fc92-473a-83a1-166e5d703598 service nova] Creating event network-vif-deleted:70710cea-27b7-4189-8439-7f0de6882981 for instance c7733cd2-57de-4174-878c-f68b917b991c on n-h2-master-1 Jul 31 01:28:35.620328 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1017f7df-33ed-457e-b138-9c82104687fd req-cd89676a-fc92-473a-83a1-166e5d703598 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142251 Jul 31 01:28:35.628332 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1996/4009] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:35.722089 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8665ecca-67e6-483a-9541-7aaa341d0947 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:35.724012 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8665ecca-67e6-483a-9541-7aaa341d0947 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:35.735874 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8665ecca-67e6-483a-9541-7aaa341d0947 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:35.753768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8665ecca-67e6-483a-9541-7aaa341d0947 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:35.757378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8665ecca-67e6-483a-9541-7aaa341d0947 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:35.759873 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8665ecca-67e6-483a-9541-7aaa341d0947 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:35.807878 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:35.871782 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8665ecca-67e6-483a-9541-7aaa341d0947 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:35.872495 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8665ecca-67e6-483a-9541-7aaa341d0947 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:35.874619 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-8665ecca-67e6-483a-9541-7aaa341d0947 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lazy-loading 'fault' on Instance uuid c7733cd2-57de-4174-878c-f68b917b991c {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:28:36.050042 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-97321440-4eec-49b5-93e3-875cd6c9a466 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:36.071533 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-97321440-4eec-49b5-93e3-875cd6c9a466 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.934249 Jul 31 01:28:36.072021 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2014/4010] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:35 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:36.100907 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8665ecca-67e6-483a-9541-7aaa341d0947 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:36.111985 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8665ecca-67e6-483a-9541-7aaa341d0947 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 200 len: 1310 microversion: 2.1 time: 0.394621 Jul 31 01:28:36.115322 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1997/4011] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:35 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 1310 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:36.120273 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b1003759-a972-49b2-879c-548608a96e96 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '.version_select at 0x7fedeaa5c8b0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:36.142931 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-666dc79e-b4a7-48a6-8ab5-0d56c3c000d4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-978213569", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "6620d5ce-66c7-42fc-821f-8f2da6193606"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:36.161179 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-b1003759-a972-49b2-879c-548608a96e96 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] HTTP exception thrown: Image not found. Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b1003759-a972-49b2-879c-548608a96e96 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Request method failure captured: Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/images/b47427f5-d5e3-495e-82ce-41359f0ba07d HTTP/1.1 Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5do_qvGtrm8MFTSKrTw8R7jgmTzyETsET8_Bks35mozq5SQhUaDIA0oib2wHXXTKsc9AVPMwnRA1N8ACvVn62cvXmTWUR5or87UcB5lhe7JDpnHvkxRMhg6Zlak4K6e0-cQsqquMOz1g27fd3AjZnreZQbV510uuuf140sds5ry5cxM Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c609eaf96fc84008b10c26b3f56edd69", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: df0850646f5b4fdeabc4d50297626e27 Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: exception: Image not found. Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'b47427f5-d5e3-495e-82ce-41359f0ba07d'} Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b47427f5-d5e3-495e-82ce-41359f0ba07d to delete Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b47427f5-d5e3-495e-82ce-41359f0ba07d could not be found. Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:36.167382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 31 01:28:36.171596 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.174830 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b1003759-a972-49b2-879c-548608a96e96 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Returning 404 to user: Image not found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:36.181942 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b1003759-a972-49b2-879c-548608a96e96 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "DELETE /compute/v2.1/images/b47427f5-d5e3-495e-82ce-41359f0ba07d" status: 404 len: 62 microversion: 2.1 time: 0.065358 Jul 31 01:28:36.182838 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1998/4012] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:36 2022] DELETE /compute/v2.1/images/b47427f5-d5e3-495e-82ce-41359f0ba07d => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:28:36.191743 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-91813bbe-8b4e-494c-a0fa-64e417336c75 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:36.192568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-91813bbe-8b4e-494c-a0fa-64e417336c75 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:36.212215 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91813bbe-8b4e-494c-a0fa-64e417336c75 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:36.213589 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91813bbe-8b4e-494c-a0fa-64e417336c75 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:36.219041 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91813bbe-8b4e-494c-a0fa-64e417336c75 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:36.219534 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91813bbe-8b4e-494c-a0fa-64e417336c75 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:36.279924 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-91813bbe-8b4e-494c-a0fa-64e417336c75 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] HTTP exception thrown: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-91813bbe-8b4e-494c-a0fa-64e417336c75 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Request method failure captured: Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f HTTP/1.1 Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5do_qvGtrm8MFTSKrTw8R7jgmTzyETsET8_Bks35mozq5SQhUaDIA0oib2wHXXTKsc9AVPMwnRA1N8ACvVn62cvXmTWUR5or87UcB5lhe7JDpnHvkxRMhg6Zlak4K6e0-cQsqquMOz1g27fd3AjZnreZQbV510uuuf140sds5ry5cxM Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c609eaf96fc84008b10c26b3f56edd69", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: df0850646f5b4fdeabc4d50297626e27 Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '47f6a6f7-53a0-437a-a0aa-2cf71c4e606f'} Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:28:36.281689 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:28:36.286182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. Jul 31 01:28:36.286182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.286182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:36.286182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.286182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:36.286182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:36.286182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:36.286182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:36.286182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:36.286182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. Jul 31 01:28:36.286182 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.286182 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-91813bbe-8b4e-494c-a0fa-64e417336c75 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Returning 404 to user: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:36.295878 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-91813bbe-8b4e-494c-a0fa-64e417336c75 tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "DELETE /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 404 len: 111 microversion: 2.1 time: 0.096083 Jul 31 01:28:36.296798 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 1999/4013] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:28:36 2022] DELETE /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:28:36.306843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-666dc79e-b4a7-48a6-8ab5-0d56c3c000d4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] validate_networks() for [('6620d5ce-66c7-42fc-821f-8f2da6193606', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:28:36.308529 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9ab0e2c1-853a-4ce3-a075-42526e2f7bea tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:36.309085 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9ab0e2c1-853a-4ce3-a075-42526e2f7bea tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] [instance: 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:36.337349 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ab0e2c1-853a-4ce3-a075-42526e2f7bea tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:36.337805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ab0e2c1-853a-4ce3-a075-42526e2f7bea tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:36.338589 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ab0e2c1-853a-4ce3-a075-42526e2f7bea tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:36.339024 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9ab0e2c1-853a-4ce3-a075-42526e2f7bea tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:36.368744 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-9ab0e2c1-853a-4ce3-a075-42526e2f7bea tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] HTTP exception thrown: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9ab0e2c1-853a-4ce3-a075-42526e2f7bea tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Request method failure captured: Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f HTTP/1.1 Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5do_qvGtrm8MFTSKrTw8R7jgmTzyETsET8_Bks35mozq5SQhUaDIA0oib2wHXXTKsc9AVPMwnRA1N8ACvVn62cvXmTWUR5or87UcB5lhe7JDpnHvkxRMhg6Zlak4K6e0-cQsqquMOz1g27fd3AjZnreZQbV510uuuf140sds5ry5cxM Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c609eaf96fc84008b10c26b3f56edd69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c609eaf96fc84008b10c26b3f56edd69", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: c609eaf96fc84008b10c26b3f56edd69 Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833 Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: df0850646f5b4fdeabc4d50297626e27 Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1904500833-project Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '47f6a6f7-53a0-437a-a0aa-2cf71c4e606f'} Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.370308 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:36.373897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.373897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:36.373897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:36.373897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:36.373897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:36.373897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:36.373897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. Jul 31 01:28:36.373897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.373897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9ab0e2c1-853a-4ce3-a075-42526e2f7bea tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] Returning 404 to user: Instance 47f6a6f7-53a0-437a-a0aa-2cf71c4e606f could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:36.380019 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9ab0e2c1-853a-4ce3-a075-42526e2f7bea tempest-ImagesOneServerNegativeTestJSON-1904500833 tempest-ImagesOneServerNegativeTestJSON-1904500833-project] 10.222.0.45 "GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f" status: 404 len: 111 microversion: 2.1 time: 0.067206 Jul 31 01:28:36.385636 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2000/4014] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:36 2022] GET /compute/v2.1/servers/47f6a6f7-53a0-437a-a0aa-2cf71c4e606f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:28:36.395706 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63bc44f8-c911-4d37-a528-ca3061183a8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63bc44f8-c911-4d37-a528-ca3061183a8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 163 Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": 12345, "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'networks': [{'uuid': '045ea8ff-463e-40b5-b75b-322b143e9807'}]}}} Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 12345 Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:28:36.401902 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:28:36.406011 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:28:36.406011 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 31 01:28:36.406011 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.406011 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:36.406011 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.406011 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:36.406011 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:36.406011 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:36.406011 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:28:36.406011 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:28:36.406011 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 31 01:28:36.406011 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:36.408812 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63bc44f8-c911-4d37-a528-ca3061183a8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:36.409902 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-63bc44f8-c911-4d37-a528-ca3061183a8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.023041 Jul 31 01:28:36.410856 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2001/4015] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:28:36 2022] POST /compute/v2.1/servers => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:28:36.419732 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9686d294-6e12-4546-af18-b3f28d83feb1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:36.420665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9686d294-6e12-4546-af18-b3f28d83feb1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:36.435476 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9686d294-6e12-4546-af18-b3f28d83feb1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:36.435700 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9686d294-6e12-4546-af18-b3f28d83feb1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:36.447061 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9686d294-6e12-4546-af18-b3f28d83feb1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:36.447666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9686d294-6e12-4546-af18-b3f28d83feb1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:37.171214 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9686d294-6e12-4546-af18-b3f28d83feb1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:37.185974 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9686d294-6e12-4546-af18-b3f28d83feb1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.770673 Jul 31 01:28:37.187097 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2002/4016] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:36 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:37.191853 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1921ecb7-9d29-436e-b216-bd4a1089c53a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:37.199513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1921ecb7-9d29-436e-b216-bd4a1089c53a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: c7733cd2-57de-4174-878c-f68b917b991c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:37.207461 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1921ecb7-9d29-436e-b216-bd4a1089c53a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:37.207917 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1921ecb7-9d29-436e-b216-bd4a1089c53a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:37.208705 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1921ecb7-9d29-436e-b216-bd4a1089c53a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:37.209140 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1921ecb7-9d29-436e-b216-bd4a1089c53a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:37.253439 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-1921ecb7-9d29-436e-b216-bd4a1089c53a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] HTTP exception thrown: Instance c7733cd2-57de-4174-878c-f68b917b991c could not be found. Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1921ecb7-9d29-436e-b216-bd4a1089c53a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Request method failure captured: Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c HTTP/1.1 Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dlxeTMDBunLit2vGiPrRDr1dvwQZdXub1419SqSyDOiGVHpAG6yJGGezx9r9jLdyswls0cvvjHa7zsCjK7Ca5A4yF2d26H1NpXXYaK068O8-NSelNX8BnsHr9p-9TQJIL4Ay7u6mf8S-XLTaElYJgrWyL6gNGdxZnY_92dE9hLD6X8 Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_af1bdeca391f47f3bde21459bf893f89", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 87e482f360af4e56a325960d834fb9f8 Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: exception: Instance c7733cd2-57de-4174-878c-f68b917b991c could not be found. Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'c7733cd2-57de-4174-878c-f68b917b991c'} Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7733cd2-57de-4174-878c-f68b917b991c could not be found. Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7733cd2-57de-4174-878c-f68b917b991c could not be found. Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:37.255005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:37.261088 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:37.261088 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:37.261088 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:37.261088 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:37.261088 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:37.261088 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7733cd2-57de-4174-878c-f68b917b991c could not be found. Jul 31 01:28:37.261088 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:37.261088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1921ecb7-9d29-436e-b216-bd4a1089c53a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Returning 404 to user: Instance c7733cd2-57de-4174-878c-f68b917b991c could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:37.261088 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1921ecb7-9d29-436e-b216-bd4a1089c53a tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c" status: 404 len: 111 microversion: 2.1 time: 0.068225 Jul 31 01:28:37.261088 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2003/4017] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:37 2022] GET /compute/v2.1/servers/c7733cd2-57de-4174-878c-f68b917b991c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:28:37.262490 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aba74bc7-9bab-4949-8afa-7cfab924bf70 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:37.262490 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aba74bc7-9bab-4949-8afa-7cfab924bf70 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:37.281853 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aba74bc7-9bab-4949-8afa-7cfab924bf70 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:37.282315 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aba74bc7-9bab-4949-8afa-7cfab924bf70 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:37.283106 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aba74bc7-9bab-4949-8afa-7cfab924bf70 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:37.283576 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aba74bc7-9bab-4949-8afa-7cfab924bf70 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:38.292061 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-aba74bc7-9bab-4949-8afa-7cfab924bf70 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:38.302881 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aba74bc7-9bab-4949-8afa-7cfab924bf70 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 1.044780 Jul 31 01:28:38.303504 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2004/4018] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:37 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:38.324557 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-34dc1d71-4194-4081-9309-c57cc5795b27 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:38.325351 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-34dc1d71-4194-4081-9309-c57cc5795b27 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:38.333599 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-34dc1d71-4194-4081-9309-c57cc5795b27 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:38.334339 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-34dc1d71-4194-4081-9309-c57cc5795b27 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:38.335928 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-34dc1d71-4194-4081-9309-c57cc5795b27 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:38.336742 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-34dc1d71-4194-4081-9309-c57cc5795b27 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:38.366140 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-34dc1d71-4194-4081-9309-c57cc5795b27 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:28:38.535944 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-34dc1d71-4194-4081-9309-c57cc5795b27 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 204 len: 0 microversion: 2.1 time: 0.218875 Jul 31 01:28:38.539540 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2005/4019] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:28:38 2022] DELETE /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:28:38.571766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5a5fdbc4-87ba-463e-95f7-312c2fbbf448 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:38.573189 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5a5fdbc4-87ba-463e-95f7-312c2fbbf448 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:38.608537 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a5fdbc4-87ba-463e-95f7-312c2fbbf448 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:38.615097 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a5fdbc4-87ba-463e-95f7-312c2fbbf448 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:38.617076 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a5fdbc4-87ba-463e-95f7-312c2fbbf448 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:38.617539 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a5fdbc4-87ba-463e-95f7-312c2fbbf448 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:38.704885 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-666dc79e-b4a7-48a6-8ab5-0d56c3c000d4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:28:38.705387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-666dc79e-b4a7-48a6-8ab5-0d56c3c000d4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:28:38.705858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-666dc79e-b4a7-48a6-8ab5-0d56c3c000d4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:28:38.706289 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-666dc79e-b4a7-48a6-8ab5-0d56c3c000d4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:28:38.706718 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-666dc79e-b4a7-48a6-8ab5-0d56c3c000d4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:28:38.730465 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-666dc79e-b4a7-48a6-8ab5-0d56c3c000d4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:38.731957 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-666dc79e-b4a7-48a6-8ab5-0d56c3c000d4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:38.733418 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-666dc79e-b4a7-48a6-8ab5-0d56c3c000d4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:38.734142 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-666dc79e-b4a7-48a6-8ab5-0d56c3c000d4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:38.766787 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-666dc79e-b4a7-48a6-8ab5-0d56c3c000d4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Getting quotas for project 0d2e6318c9a2499c8a5857683762bf52. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:28:38.776229 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-666dc79e-b4a7-48a6-8ab5-0d56c3c000d4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Getting quotas for user b86f46d7be9f45d0aa7ee53ac4b95371 and project 0d2e6318c9a2499c8a5857683762bf52. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:28:38.798161 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-666dc79e-b4a7-48a6-8ab5-0d56c3c000d4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:28:38.801101 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-666dc79e-b4a7-48a6-8ab5-0d56c3c000d4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:28:38.882461 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-666dc79e-b4a7-48a6-8ab5-0d56c3c000d4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.788265 Jul 31 01:28:38.883927 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2015/4020] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:28:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:28:39.144900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5a5fdbc4-87ba-463e-95f7-312c2fbbf448 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:39.156611 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5a5fdbc4-87ba-463e-95f7-312c2fbbf448 tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.608314 Jul 31 01:28:39.158268 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2006/4021] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:38 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:39.165549 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3342a619-77fb-4927-871f-ef54b93e7d72 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:39.166186 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3342a619-77fb-4927-871f-ef54b93e7d72 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:39.310227 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2828972f-4c19-47cd-aa95-f1c57a4c81ca tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] Action: 'create', calling method: .version_select at 0x7fedeaa15700>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:39.390407 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-2828972f-4c19-47cd-aa95-f1c57a4c81ca tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] Getting quotas for project 4e14e178ab3a45448ae07715b104efe7. Resources: {'server_groups'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:28:39.406318 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-2828972f-4c19-47cd-aa95-f1c57a4c81ca tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] Getting quotas for user 0bc2ee9c07244913ae5c67ea08158f49 and project 4e14e178ab3a45448ae07715b104efe7. Resources: {'server_groups'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:28:39.515712 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3342a619-77fb-4927-871f-ef54b93e7d72 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:39.526711 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3342a619-77fb-4927-871f-ef54b93e7d72 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9" status: 200 len: 1213 microversion: 2.1 time: 0.367297 Jul 31 01:28:39.527307 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2007/4022] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:39 2022] GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 => generated 1213 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:39.608405 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-2828972f-4c19-47cd-aa95-f1c57a4c81ca tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] Getting quotas for project 4e14e178ab3a45448ae07715b104efe7. Resources: {'server_groups'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:28:39.623413 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-2828972f-4c19-47cd-aa95-f1c57a4c81ca tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] Getting quotas for user 0bc2ee9c07244913ae5c67ea08158f49 and project 4e14e178ab3a45448ae07715b104efe7. Resources: {'server_groups'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:28:39.680617 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2828972f-4c19-47cd-aa95-f1c57a4c81ca tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] 10.222.0.45 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.794637 Jul 31 01:28:39.689874 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2016/4023] 10.222.0.45 () {62 vars in 1214 bytes} [Sun Jul 31 01:28:38 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:28:39.701521 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9fa4d0d8-df5a-4aa8-b7cc-6f20b2e33ce4 tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:39.722539 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9fa4d0d8-df5a-4aa8-b7cc-6f20b2e33ce4 tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.029926 Jul 31 01:28:39.729374 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2008/4024] 10.222.0.45 () {60 vars in 1193 bytes} [Sun Jul 31 01:28:39 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:28:39.734330 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6058b62d-afcb-4ecb-b396-91bc1d4a2574 tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:39.748454 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6058b62d-afcb-4ecb-b396-91bc1d4a2574 tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] 10.222.0.45 "GET /compute/v2.1/os-server-groups/82dbe2fc-3f95-4ecc-a127-28bd2d52dddf" status: 200 len: 235 microversion: 2.64 time: 0.017962 Jul 31 01:28:39.755323 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2017/4025] 10.222.0.45 () {60 vars in 1304 bytes} [Sun Jul 31 01:28:39 2022] GET /compute/v2.1/os-server-groups/82dbe2fc-3f95-4ecc-a127-28bd2d52dddf => generated 235 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:28:39.768595 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-79e92917-8c68-4120-9299-a3fdff4149c8 tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:39.791853 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:39.828962 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-79e92917-8c68-4120-9299-a3fdff4149c8 tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/82dbe2fc-3f95-4ecc-a127-28bd2d52dddf" status: 204 len: 0 microversion: 2.64 time: 0.064684 Jul 31 01:28:39.830756 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2009/4026] 10.222.0.45 () {60 vars in 1307 bytes} [Sun Jul 31 01:28:39 2022] DELETE /compute/v2.1/os-server-groups/82dbe2fc-3f95-4ecc-a127-28bd2d52dddf => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:28:39.841281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-45d914f0-f68c-407d-b9f2-0aabcb0e1577 tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:39.848907 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-45d914f0-f68c-407d-b9f2-0aabcb0e1577 tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] HTTP exception thrown: Instance group 82dbe2fc-3f95-4ecc-a127-28bd2d52dddf could not be found. Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-45d914f0-f68c-407d-b9f2-0aabcb0e1577 tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] Request method failure captured: Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/os-server-groups/82dbe2fc-3f95-4ecc-a127-28bd2d52dddf HTTP/1.1 Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5drGE1ts23ZD-W4rv-5lC5VWLzK6S7kPbUPxqAeDgdy5Pb5ni7_Eg405v7KGMLx4t4bim73_2lFhi0nPaJtJYK_-d1E8QaVddHUoTcq3TWKod-KsXUT4OFSChXAwJhvRKab9iPxNZq-UjsxZ24dP8ifMsEMW_j8cyL6jq6W8Q9WwPmY Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.64 Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 4e14e178ab3a45448ae07715b104efe7 Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerGroup264TestJSON-123526679 Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4e14e178ab3a45448ae07715b104efe7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4e14e178ab3a45448ae07715b104efe7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4e14e178ab3a45448ae07715b104efe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4e14e178ab3a45448ae07715b104efe7", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerGroup264TestJSON-123526679 Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 4e14e178ab3a45448ae07715b104efe7 Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerGroup264TestJSON-123526679 Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerGroup264TestJSON-123526679-project Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 0bc2ee9c07244913ae5c67ea08158f49 Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerGroup264TestJSON-123526679-project Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: exception: Instance group 82dbe2fc-3f95-4ecc-a127-28bd2d52dddf could not be found. Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '82dbe2fc-3f95-4ecc-a127-28bd2d52dddf'} Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 82dbe2fc-3f95-4ecc-a127-28bd2d52dddf could not be found. Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 82dbe2fc-3f95-4ecc-a127-28bd2d52dddf could not be found. Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:39.851804 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:39.856232 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:39.856232 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:39.856232 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:39.856232 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:39.856232 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 82dbe2fc-3f95-4ecc-a127-28bd2d52dddf could not be found. Jul 31 01:28:39.856232 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:39.860166 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-45d914f0-f68c-407d-b9f2-0aabcb0e1577 tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] Returning 404 to user: Instance group 82dbe2fc-3f95-4ecc-a127-28bd2d52dddf could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:39.861460 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-45d914f0-f68c-407d-b9f2-0aabcb0e1577 tempest-ServerGroup264TestJSON-123526679 tempest-ServerGroup264TestJSON-123526679-project] 10.222.0.45 "DELETE /compute/v2.1/os-server-groups/82dbe2fc-3f95-4ecc-a127-28bd2d52dddf" status: 404 len: 117 microversion: 2.64 time: 0.025041 Jul 31 01:28:39.862557 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2018/4027] 10.222.0.45 () {60 vars in 1307 bytes} [Sun Jul 31 01:28:39 2022] DELETE /compute/v2.1/os-server-groups/82dbe2fc-3f95-4ecc-a127-28bd2d52dddf => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:28:40.183792 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1dcc15d1-ef47-49f9-bbee-f4d3d4b238ce tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:40.184708 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1dcc15d1-ef47-49f9-bbee-f4d3d4b238ce tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:40.198996 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1dcc15d1-ef47-49f9-bbee-f4d3d4b238ce tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:40.200678 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1dcc15d1-ef47-49f9-bbee-f4d3d4b238ce tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:40.202936 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1dcc15d1-ef47-49f9-bbee-f4d3d4b238ce tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:40.203726 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1dcc15d1-ef47-49f9-bbee-f4d3d4b238ce tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:40.557711 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-64388787-0c4a-4582-a95c-d15cbaf8c9e7 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:40.559780 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-64388787-0c4a-4582-a95c-d15cbaf8c9e7 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:40.591013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64388787-0c4a-4582-a95c-d15cbaf8c9e7 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:40.594297 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64388787-0c4a-4582-a95c-d15cbaf8c9e7 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:40.595978 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64388787-0c4a-4582-a95c-d15cbaf8c9e7 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:40.598389 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64388787-0c4a-4582-a95c-d15cbaf8c9e7 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:41.251670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-64388787-0c4a-4582-a95c-d15cbaf8c9e7 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:41.268856 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-64388787-0c4a-4582-a95c-d15cbaf8c9e7 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9" status: 200 len: 1265 microversion: 2.1 time: 0.718234 Jul 31 01:28:41.269505 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2019/4028] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:40 2022] GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 => generated 1265 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:41.395329 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1dcc15d1-ef47-49f9-bbee-f4d3d4b238ce tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:41.408211 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1dcc15d1-ef47-49f9-bbee-f4d3d4b238ce tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 1.230708 Jul 31 01:28:41.425966 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2010/4029] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:40 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:41.814445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-15558fa5-ff33-4115-8405-c9ab58113c3a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-87556484", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e006c79e-3021-433e-a23b-7202d7c70834", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:42.016133 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-15558fa5-ff33-4115-8405-c9ab58113c3a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Block Device e006c79e-3021-433e-a23b-7202d7c70834 is not bootable. Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-15558fa5-ff33-4115-8405-c9ab58113c3a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 356 Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-87556484", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e006c79e-3021-433e-a23b-7202d7c70834", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: exception: Block Device e006c79e-3021-433e-a23b-7202d7c70834 is not bootable. Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-87556484', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'e006c79e-3021-433e-a23b-7202d7c70834'}], 'networks': [{'uuid': '045ea8ff-463e-40b5-b75b-322b143e9807'}]}}} Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1624, in _create_instance Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device e006c79e-3021-433e-a23b-7202d7c70834 is not bootable. Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:42.026464 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device e006c79e-3021-433e-a23b-7202d7c70834 is not bootable. Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device e006c79e-3021-433e-a23b-7202d7c70834 is not bootable. Jul 31 01:28:42.031497 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:42.036280 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-15558fa5-ff33-4115-8405-c9ab58113c3a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 400 to user: Block Device e006c79e-3021-433e-a23b-7202d7c70834 is not bootable. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:42.037967 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-15558fa5-ff33-4115-8405-c9ab58113c3a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.227531 Jul 31 01:28:42.039696 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2020/4030] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:28:41 2022] POST /compute/v2.1/servers => generated 110 bytes in 230 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:28:42.050125 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-071dabc4-3d5c-41c5-a7cf-a2ff7b1afeb6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:42.051207 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-071dabc4-3d5c-41c5-a7cf-a2ff7b1afeb6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:42.059422 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-071dabc4-3d5c-41c5-a7cf-a2ff7b1afeb6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:42.060140 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-071dabc4-3d5c-41c5-a7cf-a2ff7b1afeb6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:42.062375 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-071dabc4-3d5c-41c5-a7cf-a2ff7b1afeb6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:42.063043 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-071dabc4-3d5c-41c5-a7cf-a2ff7b1afeb6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:42.298603 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-13c93a06-41c6-49fb-9294-94db4e80c12a tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:42.311329 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-13c93a06-41c6-49fb-9294-94db4e80c12a tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:42.322138 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13c93a06-41c6-49fb-9294-94db4e80c12a tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:42.323134 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13c93a06-41c6-49fb-9294-94db4e80c12a tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:42.324185 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13c93a06-41c6-49fb-9294-94db4e80c12a tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:42.325696 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13c93a06-41c6-49fb-9294-94db4e80c12a tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:42.661216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-071dabc4-3d5c-41c5-a7cf-a2ff7b1afeb6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:42.667545 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-13c93a06-41c6-49fb-9294-94db4e80c12a tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:42.675566 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-13c93a06-41c6-49fb-9294-94db4e80c12a tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9" status: 200 len: 1271 microversion: 2.1 time: 0.389213 Jul 31 01:28:42.677035 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-071dabc4-3d5c-41c5-a7cf-a2ff7b1afeb6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.631804 Jul 31 01:28:42.680372 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2011/4031] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:42 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:42.693183 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2021/4032] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:42 2022] GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 => generated 1271 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:42.703460 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b990a4da-06db-4254-a96f-943b08898b13 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:42.704351 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b990a4da-06db-4254-a96f-943b08898b13 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:42.723659 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b990a4da-06db-4254-a96f-943b08898b13 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:42.724354 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b990a4da-06db-4254-a96f-943b08898b13 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:42.724517 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7871f6bb-9304-4664-a089-0c02a0dbf72e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:42.725477 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b990a4da-06db-4254-a96f-943b08898b13 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:42.728595 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7871f6bb-9304-4664-a089-0c02a0dbf72e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:42.729244 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b990a4da-06db-4254-a96f-943b08898b13 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:42.767263 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7871f6bb-9304-4664-a089-0c02a0dbf72e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:42.770901 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7871f6bb-9304-4664-a089-0c02a0dbf72e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:42.772191 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7871f6bb-9304-4664-a089-0c02a0dbf72e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:42.776931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7871f6bb-9304-4664-a089-0c02a0dbf72e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:43.312278 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b990a4da-06db-4254-a96f-943b08898b13 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:43.327645 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b990a4da-06db-4254-a96f-943b08898b13 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.628294 Jul 31 01:28:43.328532 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2022/4033] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:42 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:43.478160 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7871f6bb-9304-4664-a089-0c02a0dbf72e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87e482f360af4e56a325960d834fb9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1bdeca391f47f3bde21459bf893f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:43.485976 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-3cebcb2a-4e87-4a2c-a844-f4262e9a3042 req-75715e69-195a-427e-aa25-72f404d13d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da54db7-290e-4d68-bf4c-4c6f49984fef", "name": "network-vif-deleted", "tag": "1b85d67d-d978-4b7d-b30d-7cc0e62e0604"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:43.504789 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7871f6bb-9304-4664-a089-0c02a0dbf72e tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 200 len: 1523 microversion: 2.1 time: 0.818757 Jul 31 01:28:43.506024 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2012/4034] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:42 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 1523 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:43.531710 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3cebcb2a-4e87-4a2c-a844-f4262e9a3042 req-75715e69-195a-427e-aa25-72f404d13d03 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:43.533848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3cebcb2a-4e87-4a2c-a844-f4262e9a3042 req-75715e69-195a-427e-aa25-72f404d13d03 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:43.578361 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-3cebcb2a-4e87-4a2c-a844-f4262e9a3042 req-75715e69-195a-427e-aa25-72f404d13d03 service nova] Creating event network-vif-deleted:1b85d67d-d978-4b7d-b30d-7cc0e62e0604 for instance 8da54db7-290e-4d68-bf4c-4c6f49984fef on n-h1-master-1 Jul 31 01:28:43.591702 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-3cebcb2a-4e87-4a2c-a844-f4262e9a3042 req-75715e69-195a-427e-aa25-72f404d13d03 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111976 Jul 31 01:28:43.601969 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2023/4035] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:43.702729 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-417478ce-87cc-4dbc-b4b1-84873aa1db0b tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:43.704374 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-417478ce-87cc-4dbc-b4b1-84873aa1db0b tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:43.751041 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-417478ce-87cc-4dbc-b4b1-84873aa1db0b tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:43.755802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-417478ce-87cc-4dbc-b4b1-84873aa1db0b tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:43.757711 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-417478ce-87cc-4dbc-b4b1-84873aa1db0b tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:43.763537 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-417478ce-87cc-4dbc-b4b1-84873aa1db0b tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:44.024837 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-417478ce-87cc-4dbc-b4b1-84873aa1db0b tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:44.035281 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-417478ce-87cc-4dbc-b4b1-84873aa1db0b tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9" status: 200 len: 1271 microversion: 2.1 time: 0.338475 Jul 31 01:28:44.051274 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2013/4036] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:43 2022] GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 => generated 1271 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:44.532401 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-63e6bac6-54ec-43fd-aaa9-3385126dd71f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:44.533035 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-63e6bac6-54ec-43fd-aaa9-3385126dd71f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] [instance: 8da54db7-290e-4d68-bf4c-4c6f49984fef] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:44.542874 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-63e6bac6-54ec-43fd-aaa9-3385126dd71f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:44.543331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-63e6bac6-54ec-43fd-aaa9-3385126dd71f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:44.544402 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-63e6bac6-54ec-43fd-aaa9-3385126dd71f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:44.544851 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-63e6bac6-54ec-43fd-aaa9-3385126dd71f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:44.589706 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-63e6bac6-54ec-43fd-aaa9-3385126dd71f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] HTTP exception thrown: Instance 8da54db7-290e-4d68-bf4c-4c6f49984fef could not be found. Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-63e6bac6-54ec-43fd-aaa9-3385126dd71f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Request method failure captured: Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef HTTP/1.1 Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dlxeTMDBunLit2vGiPrRDr1dvwQZdXub1419SqSyDOiGVHpAG6yJGGezx9r9jLdyswls0cvvjHa7zsCjK7Ca5A4yF2d26H1NpXXYaK068O8-NSelNX8BnsHr9p-9TQJIL4Ay7u6mf8S-XLTaElYJgrWyL6gNGdxZnY_92dE9hLD6X8 Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/af1bdeca391f47f3bde21459bf893f89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_af1bdeca391f47f3bde21459bf893f89", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: af1bdeca391f47f3bde21459bf893f89 Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-478549094 Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 87e482f360af4e56a325960d834fb9f8 Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerRescueNegativeTestJSON-478549094-project Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 8da54db7-290e-4d68-bf4c-4c6f49984fef could not be found. Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '8da54db7-290e-4d68-bf4c-4c6f49984fef'} Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8da54db7-290e-4d68-bf4c-4c6f49984fef could not be found. Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8da54db7-290e-4d68-bf4c-4c6f49984fef could not be found. Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:44.597393 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:44.601956 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:44.601956 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:44.601956 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:44.601956 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:44.601956 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:44.601956 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8da54db7-290e-4d68-bf4c-4c6f49984fef could not be found. Jul 31 01:28:44.601956 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:44.605020 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-63e6bac6-54ec-43fd-aaa9-3385126dd71f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] Returning 404 to user: Instance 8da54db7-290e-4d68-bf4c-4c6f49984fef could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:44.606830 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-63e6bac6-54ec-43fd-aaa9-3385126dd71f tempest-ServerRescueNegativeTestJSON-478549094 tempest-ServerRescueNegativeTestJSON-478549094-project] 10.222.0.45 "GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef" status: 404 len: 111 microversion: 2.1 time: 0.079112 Jul 31 01:28:44.608202 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2024/4037] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:44 2022] GET /compute/v2.1/servers/8da54db7-290e-4d68-bf4c-4c6f49984fef => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:28:45.059514 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-18488019-d132-4393-8bea-0df4bb895f59 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:45.061513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-18488019-d132-4393-8bea-0df4bb895f59 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:45.079332 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18488019-d132-4393-8bea-0df4bb895f59 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:45.080346 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18488019-d132-4393-8bea-0df4bb895f59 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:45.081284 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18488019-d132-4393-8bea-0df4bb895f59 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:45.081845 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18488019-d132-4393-8bea-0df4bb895f59 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:46.064046 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-18488019-d132-4393-8bea-0df4bb895f59 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:46.084324 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-18488019-d132-4393-8bea-0df4bb895f59 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9" status: 200 len: 1313 microversion: 2.1 time: 1.028318 Jul 31 01:28:46.086616 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2014/4038] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:45 2022] GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 => generated 1313 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:46.685307 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-58de26cc-e723-40e0-8588-07ccc9a91be9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1654434863", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "0f306572-729b-4b95-a357-79461887e541", "destination_type": "local"}, {"source_type": "volume", "uuid": "0f0437f0-aff5-4d4d-a8a1-fd3f721b7aed", "destination_type": "invalid"}], "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-58de26cc-e723-40e0-8588-07ccc9a91be9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 495 Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1654434863", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "0f306572-729b-4b95-a357-79461887e541", "destination_type": "local"}, {"source_type": "volume", "uuid": "0f0437f0-aff5-4d4d-a8a1-fd3f721b7aed", "destination_type": "invalid"}], "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1654434863', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '0f306572-729b-4b95-a357-79461887e541', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '0f0437f0-aff5-4d4d-a8a1-fd3f721b7aed', 'destination_type': 'invalid'}], 'networks': [{'uuid': '045ea8ff-463e-40b5-b75b-322b143e9807'}]}}} Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'invalid' Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:46.690098 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 31 01:28:46.694192 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:46.696348 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-58de26cc-e723-40e0-8588-07ccc9a91be9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:46.697381 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-58de26cc-e723-40e0-8588-07ccc9a91be9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.017563 Jul 31 01:28:46.698277 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2025/4039] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:28:46 2022] POST /compute/v2.1/servers => generated 155 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:28:46.708006 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c3f8904e-36cc-4945-bf2c-dd0daedb2f36 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:46.708862 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c3f8904e-36cc-4945-bf2c-dd0daedb2f36 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:46.721252 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3f8904e-36cc-4945-bf2c-dd0daedb2f36 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:46.722403 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3f8904e-36cc-4945-bf2c-dd0daedb2f36 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:46.722673 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3f8904e-36cc-4945-bf2c-dd0daedb2f36 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:46.723581 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3f8904e-36cc-4945-bf2c-dd0daedb2f36 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:47.111050 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cfde1341-f9ef-4794-a39b-04e5b3b85223 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:47.113217 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cfde1341-f9ef-4794-a39b-04e5b3b85223 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:47.130147 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfde1341-f9ef-4794-a39b-04e5b3b85223 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:47.130572 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfde1341-f9ef-4794-a39b-04e5b3b85223 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:47.131510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfde1341-f9ef-4794-a39b-04e5b3b85223 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:47.133531 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfde1341-f9ef-4794-a39b-04e5b3b85223 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:47.668476 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c3f8904e-36cc-4945-bf2c-dd0daedb2f36 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:47.692817 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c3f8904e-36cc-4945-bf2c-dd0daedb2f36 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.989275 Jul 31 01:28:47.707727 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2015/4040] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:46 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:47.773291 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-34f044a3-43d2-4d3b-81cd-9716655b4f9a req-2aaafb47-dc35-48a9-8032-62da0bf7b300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796cb34b-18b4-4f64-b7e8-04bbfe5e76d9", "tag": "72807193-b018-4980-936b-bcf4cd94f4ae"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:47.790915 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-34f044a3-43d2-4d3b-81cd-9716655b4f9a req-2aaafb47-dc35-48a9-8032-62da0bf7b300 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:47.791801 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-34f044a3-43d2-4d3b-81cd-9716655b4f9a req-2aaafb47-dc35-48a9-8032-62da0bf7b300 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:47.807563 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-34f044a3-43d2-4d3b-81cd-9716655b4f9a req-2aaafb47-dc35-48a9-8032-62da0bf7b300 service nova] Creating event network-changed:72807193-b018-4980-936b-bcf4cd94f4ae for instance 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 on n-h2-master-1 Jul 31 01:28:47.813376 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-34f044a3-43d2-4d3b-81cd-9716655b4f9a req-2aaafb47-dc35-48a9-8032-62da0bf7b300 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101727 Jul 31 01:28:47.814692 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2016/4041] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:47.820784 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bede0929-8050-4684-b65e-97e86f7d12ad tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:47.821795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bede0929-8050-4684-b65e-97e86f7d12ad tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:47.824040 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cfde1341-f9ef-4794-a39b-04e5b3b85223 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:47.835158 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cfde1341-f9ef-4794-a39b-04e5b3b85223 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9" status: 200 len: 1313 microversion: 2.1 time: 0.731401 Jul 31 01:28:47.836297 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bede0929-8050-4684-b65e-97e86f7d12ad tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:47.837516 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bede0929-8050-4684-b65e-97e86f7d12ad tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:47.838712 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2026/4042] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:47 2022] GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 => generated 1313 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:47.839171 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bede0929-8050-4684-b65e-97e86f7d12ad tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:47.839868 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bede0929-8050-4684-b65e-97e86f7d12ad tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:48.513722 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bede0929-8050-4684-b65e-97e86f7d12ad tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:48.530618 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bede0929-8050-4684-b65e-97e86f7d12ad tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.714433 Jul 31 01:28:48.531569 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2017/4043] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:47 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:48.616116 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6b8707ce-5d66-4380-a6a3-bb10714a9141 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-696975657", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6b8707ce-5d66-4380-a6a3-bb10714a9141 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 491 Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-696975657", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-696975657', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '045ea8ff-463e-40b5-b75b-322b143e9807'}]}}} Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:48.622004 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 31 01:28:48.625885 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:28:48.631189 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6b8707ce-5d66-4380-a6a3-bb10714a9141 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:48.633169 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6b8707ce-5d66-4380-a6a3-bb10714a9141 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.022871 Jul 31 01:28:48.634270 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2027/4044] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:28:48 2022] POST /compute/v2.1/servers => generated 624 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:28:48.642315 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9e232a8d-b0bc-4aea-9d89-46f44e91e6dd tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:48.642947 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9e232a8d-b0bc-4aea-9d89-46f44e91e6dd tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:48.673566 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e232a8d-b0bc-4aea-9d89-46f44e91e6dd tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:48.675304 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e232a8d-b0bc-4aea-9d89-46f44e91e6dd tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:48.676542 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e232a8d-b0bc-4aea-9d89-46f44e91e6dd tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:48.677190 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e232a8d-b0bc-4aea-9d89-46f44e91e6dd tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:48.855483 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:48.860325 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc8e3ee7-1f07-430c-b1f0-d8f7272cc527 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:48.861212 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc8e3ee7-1f07-430c-b1f0-d8f7272cc527 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:48.870751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc8e3ee7-1f07-430c-b1f0-d8f7272cc527 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:48.871573 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc8e3ee7-1f07-430c-b1f0-d8f7272cc527 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:48.872502 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc8e3ee7-1f07-430c-b1f0-d8f7272cc527 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:48.873056 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc8e3ee7-1f07-430c-b1f0-d8f7272cc527 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:49.356108 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9e232a8d-b0bc-4aea-9d89-46f44e91e6dd tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:49.370350 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9e232a8d-b0bc-4aea-9d89-46f44e91e6dd tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.731822 Jul 31 01:28:49.395615 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2018/4045] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:48 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:49.404209 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-74cc7362-d6ac-4685-9a11-0ff316f27f5a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:49.404806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-74cc7362-d6ac-4685-9a11-0ff316f27f5a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:49.416654 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fc8e3ee7-1f07-430c-b1f0-d8f7272cc527 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:49.418141 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74cc7362-d6ac-4685-9a11-0ff316f27f5a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:49.418612 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74cc7362-d6ac-4685-9a11-0ff316f27f5a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:49.419419 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74cc7362-d6ac-4685-9a11-0ff316f27f5a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:49.423055 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74cc7362-d6ac-4685-9a11-0ff316f27f5a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:49.470263 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc8e3ee7-1f07-430c-b1f0-d8f7272cc527 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9" status: 200 len: 1313 microversion: 2.1 time: 0.613156 Jul 31 01:28:49.473731 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2028/4046] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:48 2022] GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 => generated 1313 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:49.523389 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:50.306962 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-74cc7362-d6ac-4685-9a11-0ff316f27f5a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:50.315823 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:50.338533 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-74cc7362-d6ac-4685-9a11-0ff316f27f5a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.940243 Jul 31 01:28:50.339940 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2019/4047] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:49 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:50.506514 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-abe3a553-785d-4c2b-a720-a2f60cda9ef4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:50.523071 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-abe3a553-785d-4c2b-a720-a2f60cda9ef4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:50.563001 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=14 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:50.597997 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abe3a553-785d-4c2b-a720-a2f60cda9ef4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:50.599752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abe3a553-785d-4c2b-a720-a2f60cda9ef4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:50.601442 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abe3a553-785d-4c2b-a720-a2f60cda9ef4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:50.602825 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abe3a553-785d-4c2b-a720-a2f60cda9ef4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:50.616912 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-67a0d206-7826-49a7-9883-ee3916e9feea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-67a0d206-7826-49a7-9883-ee3916e9feea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 416 Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'networks': [{'uuid': '045ea8ff-463e-40b5-b75b-322b143e9807'}]}}} Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:50.633194 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:50.636719 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-67a0d206-7826-49a7-9883-ee3916e9feea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:50.639543 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-67a0d206-7826-49a7-9883-ee3916e9feea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.027185 Jul 31 01:28:50.645161 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2020/4048] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:28:50 2022] POST /compute/v2.1/servers => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:28:50.668483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2eeba8bb-704e-45e8-aa57-1123ad9ede62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:50.673946 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2eeba8bb-704e-45e8-aa57-1123ad9ede62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:50.744007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2eeba8bb-704e-45e8-aa57-1123ad9ede62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:50.746193 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2eeba8bb-704e-45e8-aa57-1123ad9ede62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:50.749278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2eeba8bb-704e-45e8-aa57-1123ad9ede62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:50.751289 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:50.752214 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2eeba8bb-704e-45e8-aa57-1123ad9ede62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:52.001595 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2eeba8bb-704e-45e8-aa57-1123ad9ede62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:52.010026 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2eeba8bb-704e-45e8-aa57-1123ad9ede62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 1.363295 Jul 31 01:28:52.010539 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2021/4049] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:50 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:52.036285 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9f4cc0f8-3520-4d04-9db4-317ab9fa6648 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:52.037274 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9f4cc0f8-3520-4d04-9db4-317ab9fa6648 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:52.045585 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f4cc0f8-3520-4d04-9db4-317ab9fa6648 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:52.052271 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f4cc0f8-3520-4d04-9db4-317ab9fa6648 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:52.055693 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f4cc0f8-3520-4d04-9db4-317ab9fa6648 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:52.056500 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f4cc0f8-3520-4d04-9db4-317ab9fa6648 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:52.082225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-abe3a553-785d-4c2b-a720-a2f60cda9ef4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:52.100016 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-abe3a553-785d-4c2b-a720-a2f60cda9ef4 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9" status: 200 len: 1313 microversion: 2.1 time: 1.606673 Jul 31 01:28:52.104056 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2029/4050] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:50 2022] GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 => generated 1313 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:52.675513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-84c9f981-5213-4948-b719-6483f859a184 tempest-ListImagesTestJSON-1983571026 tempest-ListImagesTestJSON-1983571026-project] Calling method '.version_select at 0x7fedea9fb820>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:52.746282 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-84c9f981-5213-4948-b719-6483f859a184 tempest-ListImagesTestJSON-1983571026 tempest-ListImagesTestJSON-1983571026-project] 10.222.0.45 "GET /compute/v2.1/images/0f306572-729b-4b95-a357-79461887e541" status: 200 len: 784 microversion: 2.1 time: 0.301726 Jul 31 01:28:52.748119 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2030/4051] 10.222.0.45 () {58 vars in 1233 bytes} [Sun Jul 31 01:28:52 2022] GET /compute/v2.1/images/0f306572-729b-4b95-a357-79461887e541 => generated 784 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:28:52.764498 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-98184b85-f3ce-4a5b-92bc-f866badc6103 tempest-ListImagesTestJSON-1983571026 tempest-ListImagesTestJSON-1983571026-project] Calling method '.version_select at 0x7fede4834ca0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:52.826903 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-98184b85-f3ce-4a5b-92bc-f866badc6103 tempest-ListImagesTestJSON-1983571026 tempest-ListImagesTestJSON-1983571026-project] 10.222.0.45 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.066686 Jul 31 01:28:52.828279 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2031/4052] 10.222.0.45 () {58 vars in 1122 bytes} [Sun Jul 31 01:28:52 2022] GET /compute/v2.1/images => generated 445 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:28:52.840580 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-13221a27-b325-4dc1-bf15-6a6fbffc856d tempest-ListImagesTestJSON-1983571026 tempest-ListImagesTestJSON-1983571026-project] Calling method '.version_select at 0x7fedea9c0d30>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:52.912155 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9f4cc0f8-3520-4d04-9db4-317ab9fa6648 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:52.935093 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9f4cc0f8-3520-4d04-9db4-317ab9fa6648 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.902822 Jul 31 01:28:52.936354 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-13221a27-b325-4dc1-bf15-6a6fbffc856d tempest-ListImagesTestJSON-1983571026 tempest-ListImagesTestJSON-1983571026-project] 10.222.0.45 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.099536 Jul 31 01:28:52.948335 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2032/4053] 10.222.0.45 () {58 vars in 1143 bytes} [Sun Jul 31 01:28:52 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:52.952056 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2022/4054] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:52 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:53.124971 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4e036737-fe21-4d8f-87a5-ca3b9e056bb1 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:53.125608 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4e036737-fe21-4d8f-87a5-ca3b9e056bb1 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:53.134492 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e036737-fe21-4d8f-87a5-ca3b9e056bb1 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:53.137077 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e036737-fe21-4d8f-87a5-ca3b9e056bb1 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:53.138090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e036737-fe21-4d8f-87a5-ca3b9e056bb1 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:53.140625 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e036737-fe21-4d8f-87a5-ca3b9e056bb1 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:53.202871 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-979e61ef-e2ef-4063-ad24-2262178aff0c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1272325679", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": -1, "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:53.241085 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-979e61ef-e2ef-4063-ad24-2262178aff0c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Flavor -1 could not be found. Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-979e61ef-e2ef-4063-ad24-2262178aff0c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 206 Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1272325679", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": -1, "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: exception: Flavor -1 could not be found. Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1272325679', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': -1, 'networks': [{'uuid': '045ea8ff-463e-40b5-b75b-322b143e9807'}]}}} Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:53.246923 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 31 01:28:53.250758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:53.254980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-979e61ef-e2ef-4063-ad24-2262178aff0c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:53.266130 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-979e61ef-e2ef-4063-ad24-2262178aff0c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.065337 Jul 31 01:28:53.269025 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2023/4055] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:28:53 2022] POST /compute/v2.1/servers => generated 73 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 31 01:28:53.286871 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a30d08d8-6569-4d51-b8a1-2ad4ff84f2ff tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:53.292335 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a30d08d8-6569-4d51-b8a1-2ad4ff84f2ff tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:53.303030 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a30d08d8-6569-4d51-b8a1-2ad4ff84f2ff tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:53.304556 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a30d08d8-6569-4d51-b8a1-2ad4ff84f2ff tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:53.305629 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a30d08d8-6569-4d51-b8a1-2ad4ff84f2ff tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:53.306242 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a30d08d8-6569-4d51-b8a1-2ad4ff84f2ff tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:53.935793 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a30d08d8-6569-4d51-b8a1-2ad4ff84f2ff tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:53.945604 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a30d08d8-6569-4d51-b8a1-2ad4ff84f2ff tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.670682 Jul 31 01:28:53.964740 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2024/4056] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:53 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:53.974537 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-35882c9b-a90a-4a18-8b7a-48a749b6615c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:53.975808 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-35882c9b-a90a-4a18-8b7a-48a749b6615c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:53.987931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35882c9b-a90a-4a18-8b7a-48a749b6615c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:53.988671 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35882c9b-a90a-4a18-8b7a-48a749b6615c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:53.990159 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35882c9b-a90a-4a18-8b7a-48a749b6615c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:53.990757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35882c9b-a90a-4a18-8b7a-48a749b6615c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:54.129144 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4e036737-fe21-4d8f-87a5-ca3b9e056bb1 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:54.158823 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4e036737-fe21-4d8f-87a5-ca3b9e056bb1 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9" status: 200 len: 1313 microversion: 2.1 time: 1.038268 Jul 31 01:28:54.175797 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2033/4057] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:53 2022] GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 => generated 1313 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:55.076168 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-35882c9b-a90a-4a18-8b7a-48a749b6615c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:55.084118 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-35882c9b-a90a-4a18-8b7a-48a749b6615c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 1.113765 Jul 31 01:28:55.088573 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2025/4058] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:53 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:55.183932 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-37c43b07-9fab-4ad3-8b3d-aacbf3173a15 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:55.185218 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-37c43b07-9fab-4ad3-8b3d-aacbf3173a15 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:55.202536 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37c43b07-9fab-4ad3-8b3d-aacbf3173a15 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:55.203411 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37c43b07-9fab-4ad3-8b3d-aacbf3173a15 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:55.206110 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37c43b07-9fab-4ad3-8b3d-aacbf3173a15 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:55.207134 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37c43b07-9fab-4ad3-8b3d-aacbf3173a15 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:55.239920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1b810ac8-658d-4ca8-baca-41a594df63c2 req-1ed64d4d-0a6e-4a6b-ac49-cf1c474af297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796cb34b-18b4-4f64-b7e8-04bbfe5e76d9", "name": "network-vif-plugged", "status": "completed", "tag": "72807193-b018-4980-936b-bcf4cd94f4ae"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:55.265570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1b810ac8-658d-4ca8-baca-41a594df63c2 req-1ed64d4d-0a6e-4a6b-ac49-cf1c474af297 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:55.269340 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1b810ac8-658d-4ca8-baca-41a594df63c2 req-1ed64d4d-0a6e-4a6b-ac49-cf1c474af297 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:55.301985 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1b810ac8-658d-4ca8-baca-41a594df63c2 req-1ed64d4d-0a6e-4a6b-ac49-cf1c474af297 service nova] Creating event network-vif-plugged:72807193-b018-4980-936b-bcf4cd94f4ae for instance 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 on n-h2-master-1 Jul 31 01:28:55.312831 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1b810ac8-658d-4ca8-baca-41a594df63c2 req-1ed64d4d-0a6e-4a6b-ac49-cf1c474af297 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078733 Jul 31 01:28:55.316416 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2026/4059] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 31 01:28:55.326313 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3811035b-f984-43b1-9ce7-6966f1d5995c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-651019842", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3811035b-f984-43b1-9ce7-6966f1d5995c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 172 Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-651019842", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-651019842', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '045ea8ff-463e-40b5-b75b-322b143e9807'}]}}} Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi -1 Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:28:55.336382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:28:55.340077 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:28:55.340077 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:28:55.340077 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 31 01:28:55.340077 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:55.340077 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:55.340077 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:55.340077 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:55.340077 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:55.340077 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:55.340077 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:28:55.340077 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:28:55.340077 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 31 01:28:55.340077 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:55.347216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3811035b-f984-43b1-9ce7-6966f1d5995c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:55.351235 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3811035b-f984-43b1-9ce7-6966f1d5995c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.032547 Jul 31 01:28:55.354200 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2027/4060] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:28:55 2022] POST /compute/v2.1/servers => generated 145 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:28:55.364760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-559b7625-3f61-4a5f-ab6e-d2639a956a45 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:55.371636 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-559b7625-3f61-4a5f-ab6e-d2639a956a45 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:55.387114 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-559b7625-3f61-4a5f-ab6e-d2639a956a45 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:55.389891 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-559b7625-3f61-4a5f-ab6e-d2639a956a45 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:55.392932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-559b7625-3f61-4a5f-ab6e-d2639a956a45 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:55.396355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-559b7625-3f61-4a5f-ab6e-d2639a956a45 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:55.809923 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-37c43b07-9fab-4ad3-8b3d-aacbf3173a15 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:55.818855 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-37c43b07-9fab-4ad3-8b3d-aacbf3173a15 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9" status: 200 len: 1313 microversion: 2.1 time: 0.640344 Jul 31 01:28:55.829409 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2034/4061] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:55 2022] GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 => generated 1313 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:56.000646 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-559b7625-3f61-4a5f-ab6e-d2639a956a45 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:56.037675 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-559b7625-3f61-4a5f-ab6e-d2639a956a45 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.669493 Jul 31 01:28:56.041907 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2028/4062] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:55 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:56.066303 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0957a68a-4643-4cdf-a749-8508ebbe1a00 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:56.067963 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0957a68a-4643-4cdf-a749-8508ebbe1a00 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:56.082133 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0957a68a-4643-4cdf-a749-8508ebbe1a00 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:56.084427 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0957a68a-4643-4cdf-a749-8508ebbe1a00 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:56.088710 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0957a68a-4643-4cdf-a749-8508ebbe1a00 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:56.089306 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0957a68a-4643-4cdf-a749-8508ebbe1a00 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:56.395899 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0957a68a-4643-4cdf-a749-8508ebbe1a00 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:56.409469 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0957a68a-4643-4cdf-a749-8508ebbe1a00 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.347158 Jul 31 01:28:56.410463 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2035/4063] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:56 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:56.605206 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-20ccbc5d-2bb9-4d09-b4b0-9321d2b29f6a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-421397586", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:56.612225 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-20ccbc5d-2bb9-4d09-b4b0-9321d2b29f6a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-20ccbc5d-2bb9-4d09-b4b0-9321d2b29f6a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 215 Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-421397586", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-421397586', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:56.614315 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:56.618140 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:56.618140 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:56.618140 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:56.618140 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:56.618140 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:56.618140 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 31 01:28:56.618140 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:56.618140 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-20ccbc5d-2bb9-4d09-b4b0-9321d2b29f6a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:56.618140 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-20ccbc5d-2bb9-4d09-b4b0-9321d2b29f6a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.017606 Jul 31 01:28:56.618140 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2029/4064] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:28:56 2022] POST /compute/v2.1/servers => generated 123 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:28:56.627910 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc40ba3c-6552-4ab5-a493-cd680b914d51 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:56.628646 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc40ba3c-6552-4ab5-a493-cd680b914d51 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:56.637731 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc40ba3c-6552-4ab5-a493-cd680b914d51 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:56.638298 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc40ba3c-6552-4ab5-a493-cd680b914d51 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:56.639234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc40ba3c-6552-4ab5-a493-cd680b914d51 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:56.639820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc40ba3c-6552-4ab5-a493-cd680b914d51 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:56.857596 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f49194d3-fb3c-4362-9b89-d5a9cb2f0ed6 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:56.862915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f49194d3-fb3c-4362-9b89-d5a9cb2f0ed6 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:56.891632 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f49194d3-fb3c-4362-9b89-d5a9cb2f0ed6 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:56.892362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f49194d3-fb3c-4362-9b89-d5a9cb2f0ed6 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:56.893372 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f49194d3-fb3c-4362-9b89-d5a9cb2f0ed6 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:56.896982 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f49194d3-fb3c-4362-9b89-d5a9cb2f0ed6 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:57.550105 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fc40ba3c-6552-4ab5-a493-cd680b914d51 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:57.563855 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc40ba3c-6552-4ab5-a493-cd680b914d51 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.941953 Jul 31 01:28:57.565098 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2036/4065] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:56 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:57.591013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2e39112a-7eed-4980-8435-56b1dd1a629d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:57.592636 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2e39112a-7eed-4980-8435-56b1dd1a629d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:57.601901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e39112a-7eed-4980-8435-56b1dd1a629d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:57.602368 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e39112a-7eed-4980-8435-56b1dd1a629d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:57.603165 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e39112a-7eed-4980-8435-56b1dd1a629d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:57.603644 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e39112a-7eed-4980-8435-56b1dd1a629d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:57.653823 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f49194d3-fb3c-4362-9b89-d5a9cb2f0ed6 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:57.664645 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f49194d3-fb3c-4362-9b89-d5a9cb2f0ed6 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9" status: 200 len: 1313 microversion: 2.1 time: 0.816793 Jul 31 01:28:57.665852 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2030/4066] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:56 2022] GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 => generated 1313 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:58.134473 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2e39112a-7eed-4980-8435-56b1dd1a629d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:58.140059 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f46cc46b-8048-4142-ac4c-5586a5842724 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Action: 'create', calling method: .version_select at 0x7fedea9cc1f0>, body: {"keypair": {"name": "tempest-keypair-586898004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxTMSE1AR46W50A7sHYAqcKxikqd3vukkxJHw241Xkeq3wZvPW+a2De7GIR7VvROLouOhBsWHh6k+XiYEtPJfiY4W11vQAKQL+mpOExM9UxvOstMG7Oole+hWdvfUSqMg=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:58.145994 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2e39112a-7eed-4980-8435-56b1dd1a629d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.557427 Jul 31 01:28:58.148599 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2037/4067] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:57 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:58.177947 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-f46cc46b-8048-4142-ac4c-5586a5842724 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Getting quotas for project 2b9ecf83d049425db227c723658c3546. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:28:58.191946 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-f46cc46b-8048-4142-ac4c-5586a5842724 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Getting quotas for user 137b387942ba4ec89e100148ccb204ab and project 2b9ecf83d049425db227c723658c3546. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:28:58.234725 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f46cc46b-8048-4142-ac4c-5586a5842724 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.564581 Jul 31 01:28:58.236653 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2031/4068] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:28:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:58.248615 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f93f22b6-dc9b-4d27-aca2-6719a875efee tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Calling method '.version_select at 0x7fedeaa69ca0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:58.270926 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f93f22b6-dc9b-4d27-aca2-6719a875efee tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs/tempest-keypair-586898004" status: 200 len: 497 microversion: 2.1 time: 0.026723 Jul 31 01:28:58.281010 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2038/4069] 10.222.0.45 () {58 vars in 1215 bytes} [Sun Jul 31 01:28:58 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-586898004 => generated 497 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:58.289962 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b2280a5b-b98b-49cd-a7bd-3563d4a67846 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Calling method '.version_select at 0x7fedea9cc430>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:58.347917 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b2280a5b-b98b-49cd-a7bd-3563d4a67846 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-586898004" status: 202 len: 0 microversion: 2.1 time: 0.062927 Jul 31 01:28:58.352156 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2032/4070] 10.222.0.45 () {58 vars in 1218 bytes} [Sun Jul 31 01:28:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-586898004 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:28:58.366961 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c7ffe40a-f6dd-45dd-bf14-2b08f411c3ec tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Action: 'create', calling method: .version_select at 0x7fede5b40940>, body: {"keypair": {"name": "tempest-keypair-1800233084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmZAl+f+42Exxlb93/fpHgOY/8bDxLE0d0hM922JfBJwO+u5xcKKTf6DaEJZzY0ogqOTanWI5MM+HKE8zuc3GloTStRqukk+TY3pfHLlHZ1I1BtkTzZDbNfXrSH/CcQMg=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:58.418760 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-c7ffe40a-f6dd-45dd-bf14-2b08f411c3ec tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Getting quotas for project 2b9ecf83d049425db227c723658c3546. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:28:58.435861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-c7ffe40a-f6dd-45dd-bf14-2b08f411c3ec tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Getting quotas for user 137b387942ba4ec89e100148ccb204ab and project 2b9ecf83d049425db227c723658c3546. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:28:58.471477 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5dc21f3f-3394-40f5-bb06-54dd186b3057 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-674298862", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "key_name": "tempest-key-797357071", "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:58.510471 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c7ffe40a-f6dd-45dd-bf14-2b08f411c3ec tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149745 Jul 31 01:28:58.511553 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2039/4071] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:28:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:58.524479 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-360a26bb-f0fa-4f9a-a4fa-887acdf7685d tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Calling method '.version_select at 0x7fede523c820>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:58.575068 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-360a26bb-f0fa-4f9a-a4fa-887acdf7685d tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1800233084" status: 202 len: 0 microversion: 2.1 time: 0.055077 Jul 31 01:28:58.577190 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2040/4072] 10.222.0.45 () {58 vars in 1221 bytes} [Sun Jul 31 01:28:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1800233084 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 01:28:58.590440 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dd811475-8477-401d-9fbf-46ed004d7820 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Action: 'create', calling method: .version_select at 0x7fede46bc820>, body: {"keypair": {"name": "tempest-keypair-75879783", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:58.617374 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:58.623497 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-5dc21f3f-3394-40f5-bb06-54dd186b3057 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] validate_networks() for [('045ea8ff-463e-40b5-b75b-322b143e9807', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:28:58.641131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-dd811475-8477-401d-9fbf-46ed004d7820 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Getting quotas for project 2b9ecf83d049425db227c723658c3546. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:28:58.648830 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-dd811475-8477-401d-9fbf-46ed004d7820 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Getting quotas for user 137b387942ba4ec89e100148ccb204ab and project 2b9ecf83d049425db227c723658c3546. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:28:58.707395 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dd811475-8477-401d-9fbf-46ed004d7820 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 572 microversion: 2.1 time: 0.122271 Jul 31 01:28:58.708580 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2041/4073] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:28:58 2022] POST /compute/v2.1/os-keypairs => generated 572 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:58.726590 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-44c8fe6f-e697-41ad-928b-dfccedf0de80 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:58.727587 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-44c8fe6f-e697-41ad-928b-dfccedf0de80 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:58.746837 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44c8fe6f-e697-41ad-928b-dfccedf0de80 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:58.748042 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44c8fe6f-e697-41ad-928b-dfccedf0de80 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:58.754945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44c8fe6f-e697-41ad-928b-dfccedf0de80 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:58.755922 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44c8fe6f-e697-41ad-928b-dfccedf0de80 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:59.169220 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-44c8fe6f-e697-41ad-928b-dfccedf0de80 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:28:59.177328 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-44c8fe6f-e697-41ad-928b-dfccedf0de80 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9" status: 200 len: 1497 microversion: 2.1 time: 0.467334 Jul 31 01:28:59.178197 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2042/4074] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:58 2022] GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 => generated 1497 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:28:59.183383 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-379f57d9-6c5d-4c5e-a4e0-71996aa60ac3 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Calling method '.version_select at 0x7fedeaa12280>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:59.234389 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-379f57d9-6c5d-4c5e-a4e0-71996aa60ac3 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-75879783" status: 202 len: 0 microversion: 2.1 time: 0.054839 Jul 31 01:28:59.235000 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2043/4075] 10.222.0.45 () {58 vars in 1215 bytes} [Sun Jul 31 01:28:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-75879783 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:28:59.256727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d3715fe7-b07c-4055-9c11-abf1173142d6 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Action: 'create', calling method: .version_select at 0x7fedeaa38dc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1665252307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7ZW0dIWC5TfBrSom5iIraGP3CT7QydalDF1knn9+kcm4xW/GiA42u3rgq0q+7v1+sYvFPkoM3kJBhUA10FlbF1WT0grDVtiVJsiJr0HCTMKVIZ21z9VLnGWOPR5F4T8Q=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:59.293689 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-d3715fe7-b07c-4055-9c11-abf1173142d6 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Getting quotas for project 2b9ecf83d049425db227c723658c3546. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:28:59.296514 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-5dc21f3f-3394-40f5-bb06-54dd186b3057 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Invalid key_name provided. Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5dc21f3f-3394-40f5-bb06-54dd186b3057 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 245 Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-674298862", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "key_name": "tempest-key-797357071", "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid key_name provided. Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-674298862', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'key_name': 'tempest-key-797357071', 'networks': [{'uuid': '045ea8ff-463e-40b5-b75b-322b143e9807'}]}}} Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1077, in _validate_and_build_base_options Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-797357071 not found for user 316ccc283b9047a8a5e3463731025a11 Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:59.299130 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 31 01:28:59.305206 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:28:59.309244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-d3715fe7-b07c-4055-9c11-abf1173142d6 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Getting quotas for user 137b387942ba4ec89e100148ccb204ab and project 2b9ecf83d049425db227c723658c3546. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:28:59.310780 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5dc21f3f-3394-40f5-bb06-54dd186b3057 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 400 to user: Invalid key_name provided. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:28:59.316443 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5dc21f3f-3394-40f5-bb06-54dd186b3057 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.849517 Jul 31 01:28:59.317053 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2033/4076] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:28:58 2022] POST /compute/v2.1/servers => generated 70 bytes in 851 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 31 01:28:59.328177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7d9c3809-d709-4906-b395-9b3c974deeee tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:59.329916 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7d9c3809-d709-4906-b395-9b3c974deeee tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:59.343099 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d3715fe7-b07c-4055-9c11-abf1173142d6 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.098186 Jul 31 01:28:59.344123 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2044/4077] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:28:59 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:59.345590 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d9c3809-d709-4906-b395-9b3c974deeee tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:59.346216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d9c3809-d709-4906-b395-9b3c974deeee tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:59.347179 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d9c3809-d709-4906-b395-9b3c974deeee tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:59.347809 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d9c3809-d709-4906-b395-9b3c974deeee tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:59.360798 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-253b9207-9d91-4339-8963-17827bfb7624 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Action: 'create', calling method: .version_select at 0x7fede5224040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1322516115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4kPWL8YlM2MyrtQgA5I9Qr2i75K++RVjlyuCGaHbbkwdZVFHksUUjkqcV5fLhIRpl6EkdrsX+JVCywr+yDGq4Ybju4W9gI1L0r6Y1pnkbO7/mYuYgnbP37zQeI0Y8zYQ=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:59.381181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-253b9207-9d91-4339-8963-17827bfb7624 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Getting quotas for project 2b9ecf83d049425db227c723658c3546. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:28:59.401167 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-253b9207-9d91-4339-8963-17827bfb7624 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Getting quotas for user 137b387942ba4ec89e100148ccb204ab and project 2b9ecf83d049425db227c723658c3546. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:28:59.437167 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-253b9207-9d91-4339-8963-17827bfb7624 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.082281 Jul 31 01:28:59.439129 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2045/4078] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:28:59 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:59.457677 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a720e8a6-441f-420b-b53c-58c6002cef05 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Action: 'create', calling method: .version_select at 0x7fedeaa388b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-245019704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxFrxZLZZHD88IExWIi6VxUsKFrxt68yU8EJmNVwxSqk3X9+H/JTUmEsf/mbiNN2cFDPlUkJ23bra1hF4X1zDShdYHpVBMAbbxR+f/FkkNM+bSpcMd6RxMfXO4+OIrHIQ=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:28:59.487681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-a720e8a6-441f-420b-b53c-58c6002cef05 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Getting quotas for project 2b9ecf83d049425db227c723658c3546. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:28:59.501028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-a720e8a6-441f-420b-b53c-58c6002cef05 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Getting quotas for user 137b387942ba4ec89e100148ccb204ab and project 2b9ecf83d049425db227c723658c3546. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:28:59.554043 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a720e8a6-441f-420b-b53c-58c6002cef05 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.104796 Jul 31 01:28:59.556779 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2046/4079] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:28:59 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:28:59.580119 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a038d5e8-25a9-4cb2-835a-ba32a1bcbd68 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Calling method '.version_select at 0x7fede46bcaf0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:59.585568 n-d-master-1 devstack@n-api.service[119475]: WARNING oslo_db.sqlalchemy.utils [None req-a038d5e8-25a9-4cb2-835a-ba32a1bcbd68 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 31 01:28:59.611409 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a038d5e8-25a9-4cb2-835a-ba32a1bcbd68 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.049442 Jul 31 01:28:59.611987 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2047/4080] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:28:59 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:28:59.624054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-128d9dd2-351d-447b-91f9-0fa28b6d5b98 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Calling method '.version_select at 0x7fede5b40e50>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:59.688128 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-128d9dd2-351d-447b-91f9-0fa28b6d5b98 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-245019704" status: 202 len: 0 microversion: 2.1 time: 0.068721 Jul 31 01:28:59.699255 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2048/4081] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:28:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-245019704 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:28:59.713126 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b533381b-941f-4d8f-9c9e-4f10c2185f97 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Calling method '.version_select at 0x7fedeaa69040>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:59.746532 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b533381b-941f-4d8f-9c9e-4f10c2185f97 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1322516115" status: 202 len: 0 microversion: 2.1 time: 0.040367 Jul 31 01:28:59.750936 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2049/4082] 10.222.0.45 () {58 vars in 1278 bytes} [Sun Jul 31 01:28:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1322516115 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:28:59.762888 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8f22b2a6-90c5-466d-8581-6f08b39c85e2 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] Calling method '.version_select at 0x7fedeaa383a0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:59.811167 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8f22b2a6-90c5-466d-8581-6f08b39c85e2 tempest-KeyPairsV2TestJSON-1232499026 tempest-KeyPairsV2TestJSON-1232499026-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1665252307" status: 202 len: 0 microversion: 2.1 time: 0.054657 Jul 31 01:28:59.812851 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2050/4083] 10.222.0.45 () {58 vars in 1278 bytes} [Sun Jul 31 01:28:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1665252307 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:28:59.964997 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f19ab222-96bd-4db6-8cf9-d1a4669f8814 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:28:59.966014 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f19ab222-96bd-4db6-8cf9-d1a4669f8814 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:28:59.974988 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f19ab222-96bd-4db6-8cf9-d1a4669f8814 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:59.975726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f19ab222-96bd-4db6-8cf9-d1a4669f8814 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:28:59.976944 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f19ab222-96bd-4db6-8cf9-d1a4669f8814 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:28:59.977584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f19ab222-96bd-4db6-8cf9-d1a4669f8814 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:00.010834 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f19ab222-96bd-4db6-8cf9-d1a4669f8814 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:29:00.149988 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f19ab222-96bd-4db6-8cf9-d1a4669f8814 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "DELETE /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9" status: 204 len: 0 microversion: 2.1 time: 0.191840 Jul 31 01:29:00.154126 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2051/4084] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:28:59 2022] DELETE /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:29:00.164903 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f1e55f3e-9ff2-4fd0-9ced-c6db6cc15343 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:00.165677 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f1e55f3e-9ff2-4fd0-9ced-c6db6cc15343 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:00.180680 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1e55f3e-9ff2-4fd0-9ced-c6db6cc15343 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:00.181148 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1e55f3e-9ff2-4fd0-9ced-c6db6cc15343 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:00.181946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1e55f3e-9ff2-4fd0-9ced-c6db6cc15343 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:00.182393 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1e55f3e-9ff2-4fd0-9ced-c6db6cc15343 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:00.506123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7d9c3809-d709-4906-b395-9b3c974deeee tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:00.519396 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7d9c3809-d709-4906-b395-9b3c974deeee tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 1.196202 Jul 31 01:29:00.535965 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2034/4085] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:28:59 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:00.544822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eb07eb18-b114-4b36-b303-b9839c1cc2d0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:00.545455 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eb07eb18-b114-4b36-b303-b9839c1cc2d0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:00.562547 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb07eb18-b114-4b36-b303-b9839c1cc2d0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:00.563259 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb07eb18-b114-4b36-b303-b9839c1cc2d0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:00.565437 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb07eb18-b114-4b36-b303-b9839c1cc2d0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:00.567203 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb07eb18-b114-4b36-b303-b9839c1cc2d0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:00.821512 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f1e55f3e-9ff2-4fd0-9ced-c6db6cc15343 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:00.835863 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f1e55f3e-9ff2-4fd0-9ced-c6db6cc15343 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9" status: 200 len: 1503 microversion: 2.1 time: 0.679049 Jul 31 01:29:00.851390 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2052/4086] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:00 2022] GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 => generated 1503 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:01.176768 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eb07eb18-b114-4b36-b303-b9839c1cc2d0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:01.185465 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eb07eb18-b114-4b36-b303-b9839c1cc2d0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.644901 Jul 31 01:29:01.186412 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2035/4087] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:00 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:01.411462 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4c95b1a6-d59a-48c2-b392-9e13cab863a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1645934999", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:01.574091 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.security_group_api [None req-4c95b1a6-d59a-48c2-b392-9e13cab863a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Neutron security group does_not_exist not found {{(pid=119475) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 31 01:29:01.575001 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-4c95b1a6-d59a-48c2-b392-9e13cab863a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4c95b1a6-d59a-48c2-b392-9e13cab863a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 258 Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1645934999", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1645934999', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '045ea8ff-463e-40b5-b75b-322b143e9807'}]}}} Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 31 01:29:01.591902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1062, in _validate_and_build_base_options Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 509, in _check_requested_secgroups Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:01.597853 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4c95b1a6-d59a-48c2-b392-9e13cab863a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:01.606217 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4c95b1a6-d59a-48c2-b392-9e13cab863a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.190894 Jul 31 01:29:01.606217 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2053/4088] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:29:01 2022] POST /compute/v2.1/servers => generated 106 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:29:01.608260 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ae40d60d-7ca9-4fec-b7b2-0832e5c394cc tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:01.609694 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ae40d60d-7ca9-4fec-b7b2-0832e5c394cc tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:01.622508 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae40d60d-7ca9-4fec-b7b2-0832e5c394cc tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:01.623001 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae40d60d-7ca9-4fec-b7b2-0832e5c394cc tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:01.624097 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae40d60d-7ca9-4fec-b7b2-0832e5c394cc tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:01.625701 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae40d60d-7ca9-4fec-b7b2-0832e5c394cc tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:01.865609 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b39e7e2a-4d86-429f-b659-05a4e42e7dd0 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:01.866332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b39e7e2a-4d86-429f-b659-05a4e42e7dd0 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:01.882917 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b39e7e2a-4d86-429f-b659-05a4e42e7dd0 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:01.883408 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b39e7e2a-4d86-429f-b659-05a4e42e7dd0 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:01.884228 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b39e7e2a-4d86-429f-b659-05a4e42e7dd0 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:01.884685 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b39e7e2a-4d86-429f-b659-05a4e42e7dd0 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:02.148428 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ae40d60d-7ca9-4fec-b7b2-0832e5c394cc tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:02.158390 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ae40d60d-7ca9-4fec-b7b2-0832e5c394cc tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.554824 Jul 31 01:29:02.175515 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2036/4089] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:01 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:02.186488 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-56ca1968-1b7a-4f98-ae1d-d6a46566603d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:02.187679 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-56ca1968-1b7a-4f98-ae1d-d6a46566603d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:02.197893 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-56ca1968-1b7a-4f98-ae1d-d6a46566603d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:02.198581 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-56ca1968-1b7a-4f98-ae1d-d6a46566603d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:02.199713 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-56ca1968-1b7a-4f98-ae1d-d6a46566603d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:02.200396 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-56ca1968-1b7a-4f98-ae1d-d6a46566603d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:02.794978 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b39e7e2a-4d86-429f-b659-05a4e42e7dd0 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:02.805494 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b39e7e2a-4d86-429f-b659-05a4e42e7dd0 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9" status: 200 len: 1503 microversion: 2.1 time: 0.948122 Jul 31 01:29:02.810547 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2054/4090] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:01 2022] GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 => generated 1503 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:02.947861 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-56ca1968-1b7a-4f98-ae1d-d6a46566603d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:02.959024 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-56ca1968-1b7a-4f98-ae1d-d6a46566603d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.775603 Jul 31 01:29:02.959762 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2037/4091] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:02 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:02.984072 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9cf1ab11-4d79-4675-ba5e-8e50c577f2e3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:02.984663 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9cf1ab11-4d79-4675-ba5e-8e50c577f2e3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 4d919a2c-5774-4079-a822-8ca704b79738] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:02.993424 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-9cf1ab11-4d79-4675-ba5e-8e50c577f2e3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 4d919a2c-5774-4079-a822-8ca704b79738 could not be found. Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9cf1ab11-4d79-4675-ba5e-8e50c577f2e3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/4d919a2c-5774-4079-a822-8ca704b79738 HTTP/1.1 Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 4d919a2c-5774-4079-a822-8ca704b79738 could not be found. Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '4d919a2c-5774-4079-a822-8ca704b79738'} Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d919a2c-5774-4079-a822-8ca704b79738 could not be found. Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d919a2c-5774-4079-a822-8ca704b79738 could not be found. Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:02.997672 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:03.005768 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:03.005768 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:03.005768 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:03.005768 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:03.005768 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:03.005768 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:03.005768 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d919a2c-5774-4079-a822-8ca704b79738 could not be found. Jul 31 01:29:03.005768 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:03.005768 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9cf1ab11-4d79-4675-ba5e-8e50c577f2e3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 4d919a2c-5774-4079-a822-8ca704b79738 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:03.005768 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9cf1ab11-4d79-4675-ba5e-8e50c577f2e3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4d919a2c-5774-4079-a822-8ca704b79738" status: 404 len: 111 microversion: 2.1 time: 0.020922 Jul 31 01:29:03.005768 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2038/4092] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:29:02 2022] DELETE /compute/v2.1/servers/4d919a2c-5774-4079-a822-8ca704b79738 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:29:03.015710 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-80b54097-0854-4fe8-a64f-1aa94d966be7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:03.018196 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-80b54097-0854-4fe8-a64f-1aa94d966be7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:03.036479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80b54097-0854-4fe8-a64f-1aa94d966be7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:03.039382 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80b54097-0854-4fe8-a64f-1aa94d966be7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:03.040264 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80b54097-0854-4fe8-a64f-1aa94d966be7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:03.040719 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80b54097-0854-4fe8-a64f-1aa94d966be7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:03.333895 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d340b21a-d889-44b4-ac25-f7b7a38a1c2c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1789208911", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": "none"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:03.413300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-d340b21a-d889-44b4-ac25-f7b7a38a1c2c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:29:03.413999 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-d340b21a-d889-44b4-ac25-f7b7a38a1c2c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:29:03.414672 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-d340b21a-d889-44b4-ac25-f7b7a38a1c2c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:29:03.415253 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-d340b21a-d889-44b4-ac25-f7b7a38a1c2c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:29:03.416236 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-d340b21a-d889-44b4-ac25-f7b7a38a1c2c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:29:03.427575 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d340b21a-d889-44b4-ac25-f7b7a38a1c2c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:03.427833 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d340b21a-d889-44b4-ac25-f7b7a38a1c2c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:03.429855 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d340b21a-d889-44b4-ac25-f7b7a38a1c2c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:03.430854 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d340b21a-d889-44b4-ac25-f7b7a38a1c2c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:03.454406 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-d340b21a-d889-44b4-ac25-f7b7a38a1c2c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Getting quotas for project 43e3b88e39c44bfba92d40ff5971a7a8. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:03.461777 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-d340b21a-d889-44b4-ac25-f7b7a38a1c2c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Getting quotas for user 9bd76f16e0104a7ead477c3292725c27 and project 43e3b88e39c44bfba92d40ff5971a7a8. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:03.479266 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d340b21a-d889-44b4-ac25-f7b7a38a1c2c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:29:03.482173 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d340b21a-d889-44b4-ac25-f7b7a38a1c2c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:29:03.550072 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d340b21a-d889-44b4-ac25-f7b7a38a1c2c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.737864 Jul 31 01:29:03.569957 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2055/4093] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:29:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 01:29:03.575451 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-08405807-fd83-4358-9426-0cdb76a0e4f1 req-7e92e021-fbba-44b1-bde8-c22783b12c2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796cb34b-18b4-4f64-b7e8-04bbfe5e76d9", "name": "network-vif-deleted", "tag": "72807193-b018-4980-936b-bcf4cd94f4ae"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:03.592265 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-08405807-fd83-4358-9426-0cdb76a0e4f1 req-7e92e021-fbba-44b1-bde8-c22783b12c2d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:03.593449 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-08405807-fd83-4358-9426-0cdb76a0e4f1 req-7e92e021-fbba-44b1-bde8-c22783b12c2d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:03.611283 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-08405807-fd83-4358-9426-0cdb76a0e4f1 req-7e92e021-fbba-44b1-bde8-c22783b12c2d service nova] Creating event network-vif-deleted:72807193-b018-4980-936b-bcf4cd94f4ae for instance 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 on n-h2-master-1 Jul 31 01:29:03.613392 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-80b54097-0854-4fe8-a64f-1aa94d966be7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:03.619867 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-08405807-fd83-4358-9426-0cdb76a0e4f1 req-7e92e021-fbba-44b1-bde8-c22783b12c2d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048147 Jul 31 01:29:03.620773 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2056/4094] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:29:03.645243 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-80b54097-0854-4fe8-a64f-1aa94d966be7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.639252 Jul 31 01:29:03.648735 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2039/4095] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:03 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:03.655881 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c49b3f3d-fec7-469c-9840-f53d7bed73f6 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:03.656713 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c49b3f3d-fec7-469c-9840-f53d7bed73f6 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:03.758051 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5536035a-1d26-406c-82dc-b5a411d2f71e tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Action: 'create', calling method: .version_select at 0x7fede5e77940>, body: {"keypair": {"name": "tempest-keypair-485694772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUyWBRa9BAsiQ423nk1YC2IjYcP/5LvcJmN7dFQOtjn6WizZrXtb0oEnJtLtUw82dPiu8jws75cBp85P8GWWC0UUt86iF/+sH/KU+1Q1UrcRl5E7qtCpXnN00LuTsZ7hA=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:03.770407 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:03.789091 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-5536035a-1d26-406c-82dc-b5a411d2f71e tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:03.797191 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-5536035a-1d26-406c-82dc-b5a411d2f71e tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for user 6a5ab86e9e724d6389acff5a99f2a930 and project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:03.869680 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5536035a-1d26-406c-82dc-b5a411d2f71e tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.246924 Jul 31 01:29:03.870956 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2057/4096] 10.222.0.45 () {62 vars in 1199 bytes} [Sun Jul 31 01:29:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 249 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 31 01:29:03.885225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-913a651c-704e-48a7-a369-86f209033f3e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:03.888123 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-913a651c-704e-48a7-a369-86f209033f3e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:03.904737 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-913a651c-704e-48a7-a369-86f209033f3e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:03.905406 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-913a651c-704e-48a7-a369-86f209033f3e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:03.910362 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-913a651c-704e-48a7-a369-86f209033f3e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:03.911024 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-913a651c-704e-48a7-a369-86f209033f3e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:03.962067 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c49b3f3d-fec7-469c-9840-f53d7bed73f6 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:03.971374 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c49b3f3d-fec7-469c-9840-f53d7bed73f6 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:03.972963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c49b3f3d-fec7-469c-9840-f53d7bed73f6 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:03.974104 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c49b3f3d-fec7-469c-9840-f53d7bed73f6 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1278 microversion: 2.54 time: 0.324095 Jul 31 01:29:03.986735 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2040/4097] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:03 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1278 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:04.006558 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fc0e43c2-29d2-41e7-a7ee-94a1677099aa tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:04.007694 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fc0e43c2-29d2-41e7-a7ee-94a1677099aa tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:04.042666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc0e43c2-29d2-41e7-a7ee-94a1677099aa tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:04.043231 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc0e43c2-29d2-41e7-a7ee-94a1677099aa tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:04.046271 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc0e43c2-29d2-41e7-a7ee-94a1677099aa tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:04.049854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc0e43c2-29d2-41e7-a7ee-94a1677099aa tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:04.072008 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-fc0e43c2-29d2-41e7-a7ee-94a1677099aa tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] HTTP exception thrown: Instance 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 could not be found. Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fc0e43c2-29d2-41e7-a7ee-94a1677099aa tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Request method failure captured: Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 HTTP/1.1 Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dq-Y_wBdws_6EvSDZ44mwMTuz9dLwkPamT4gWrhfV5UqpwkHMlC_uZO8OTvGuW7Y5WTsRsu_6ZF8nx7k7SW1GkZ6Cl0jC5EwPXxNxO82O17COiiz9uQExo64Xmba6UgKlM9CiDY98JFrN6hMr00DsY_cPVYaESbCdOTGq5vIS_h2vk Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 0d2e6318c9a2499c8a5857683762bf52 Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesActionsTest-1926829190 Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d2e6318c9a2499c8a5857683762bf52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d2e6318c9a2499c8a5857683762bf52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0d2e6318c9a2499c8a5857683762bf52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0d2e6318c9a2499c8a5857683762bf52", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesActionsTest-1926829190 Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 0d2e6318c9a2499c8a5857683762bf52 Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesActionsTest-1926829190 Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesActionsTest-1926829190-project Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: b86f46d7be9f45d0aa7ee53ac4b95371 Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesActionsTest-1926829190-project Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 could not be found. Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '796cb34b-18b4-4f64-b7e8-04bbfe5e76d9'} Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 could not be found. Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 could not be found. Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:04.073912 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:04.078373 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:04.078373 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:04.078373 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:04.078373 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:04.078373 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:04.078373 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 could not be found. Jul 31 01:29:04.078373 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:04.080064 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fc0e43c2-29d2-41e7-a7ee-94a1677099aa tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Returning 404 to user: Instance 796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:04.088668 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fc0e43c2-29d2-41e7-a7ee-94a1677099aa tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9" status: 404 len: 111 microversion: 2.1 time: 0.096193 Jul 31 01:29:04.089927 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2041/4098] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:03 2022] GET /compute/v2.1/servers/796cb34b-18b4-4f64-b7e8-04bbfe5e76d9 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:29:04.124863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8f075330-2d2b-4fff-bafc-c384cbae28d0 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Calling method '.version_select at 0x7fede57bd820>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:04.151739 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8f075330-2d2b-4fff-bafc-c384cbae28d0 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs/tempest-keypair-485694772" status: 200 len: 512 microversion: 2.2 time: 0.058289 Jul 31 01:29:04.153932 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2042/4099] 10.222.0.45 () {60 vars in 1255 bytes} [Sun Jul 31 01:29:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-485694772 => generated 512 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:29:04.175753 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1e2be85f-4b39-4aa3-9f79-04f9806f2776 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Calling method '.version_select at 0x7fedea851310>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:04.236607 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1e2be85f-4b39-4aa3-9f79-04f9806f2776 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-485694772" status: 204 len: 0 microversion: 2.2 time: 0.073117 Jul 31 01:29:04.240555 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2043/4100] 10.222.0.45 () {60 vars in 1258 bytes} [Sun Jul 31 01:29:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-485694772 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:29:04.253188 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-feaf0e50-6d0e-4283-a097-670b9446bc9c tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Action: 'create', calling method: .version_select at 0x7fedea9ccca0>, body: {"keypair": {"name": "tempest-keypair-1109084276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSCdKetEMxePFgxA3aIdajXj/a1y6Wxy7xsr1DRXv9mg0f2CP1W2IGtXFg2trlWz635JAPOtkrsMVP7QW1CJi6zXFgd0kzR61WDIPlVKfEvMq4pAcGJxNQNWR/wUW7GNA=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:04.289570 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-feaf0e50-6d0e-4283-a097-670b9446bc9c tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:04.306969 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-feaf0e50-6d0e-4283-a097-670b9446bc9c tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for user 6a5ab86e9e724d6389acff5a99f2a930 and project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:04.367882 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-feaf0e50-6d0e-4283-a097-670b9446bc9c tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.119526 Jul 31 01:29:04.375169 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2044/4101] 10.222.0.45 () {62 vars in 1199 bytes} [Sun Jul 31 01:29:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 31 01:29:04.381052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6cc896cc-47f0-4548-a4b1-125b0a90e07c tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Calling method '.version_select at 0x7fede7fe1940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:04.410167 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6cc896cc-47f0-4548-a4b1-125b0a90e07c tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109084276" status: 204 len: 0 microversion: 2.2 time: 0.030766 Jul 31 01:29:04.416701 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2045/4102] 10.222.0.45 () {60 vars in 1261 bytes} [Sun Jul 31 01:29:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109084276 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:29:04.434757 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-76df8c6e-8b0c-45ee-8513-ade936fd466b tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Action: 'create', calling method: .version_select at 0x7fede58b4430>, body: {"keypair": {"name": "tempest-keypair-1553591870", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:04.449195 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=92,nova_api:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:04.482617 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-76df8c6e-8b0c-45ee-8513-ade936fd466b tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:04.501030 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-76df8c6e-8b0c-45ee-8513-ade936fd466b tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for user 6a5ab86e9e724d6389acff5a99f2a930 and project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:04.571709 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-76df8c6e-8b0c-45ee-8513-ade936fd466b tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.153039 Jul 31 01:29:04.573241 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2046/4103] 10.222.0.45 () {62 vars in 1199 bytes} [Sun Jul 31 01:29:04 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 31 01:29:04.584592 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d614e337-e679-4aad-b06c-61033278e0cb tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-739132008", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "6620d5ce-66c7-42fc-821f-8f2da6193606"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:04.638179 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-913a651c-704e-48a7-a369-86f209033f3e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:04.649420 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-913a651c-704e-48a7-a369-86f209033f3e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.772133 Jul 31 01:29:04.652020 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2058/4104] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:03 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:04.673764 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-23352b2e-07fc-4f1a-8f02-eb961096e69c tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Calling method '.version_select at 0x7fede4834ca0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:04.730845 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-23352b2e-07fc-4f1a-8f02-eb961096e69c tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553591870" status: 204 len: 0 microversion: 2.2 time: 0.066736 Jul 31 01:29:04.732056 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2059/4105] 10.222.0.45 () {60 vars in 1261 bytes} [Sun Jul 31 01:29:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553591870 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:29:04.745596 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-314b08f4-c6be-4c45-8d73-b392920ffbf3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:04.749357 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-314b08f4-c6be-4c45-8d73-b392920ffbf3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2928}} Jul 31 01:29:04.749357 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-314b08f4-c6be-4c45-8d73-b392920ffbf3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-314b08f4-c6be-4c45-8d73-b392920ffbf3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 9223372036854775808 could not be found. Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '9223372036854775808'} Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:04.762072 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:04.765793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:04.765793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:04.765793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:04.765793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 31 01:29:04.765793 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:04.765793 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-314b08f4-c6be-4c45-8d73-b392920ffbf3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:04.766179 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-314b08f4-c6be-4c45-8d73-b392920ffbf3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.025489 Jul 31 01:29:04.767949 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2060/4106] 10.222.0.45 () {58 vars in 1188 bytes} [Sun Jul 31 01:29:04 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:29:04.791955 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-d614e337-e679-4aad-b06c-61033278e0cb tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] validate_networks() for [('6620d5ce-66c7-42fc-821f-8f2da6193606', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:29:04.813110 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8e65077f-5758-4039-9e64-0b8f3caa99d6 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Action: 'create', calling method: .version_select at 0x7fedea924f70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-350919703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVAhnvW2xy2ocIQMZ8OXdj1tIsyOkGIC5JIyG9SXcrmhy3DdAbnm9bR0XG6EzjpN+u36AGeIPF3BeFF5REvwHn91RWaq98ZsDGK6qqHQ7kQ1I/9JAqpKCp+EZy7JuDg8g=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:04.854159 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-8e65077f-5758-4039-9e64-0b8f3caa99d6 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:04.863004 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-8e65077f-5758-4039-9e64-0b8f3caa99d6 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for user 6a5ab86e9e724d6389acff5a99f2a930 and project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:04.914043 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8e65077f-5758-4039-9e64-0b8f3caa99d6 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.111916 Jul 31 01:29:04.928530 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2061/4107] 10.222.0.45 () {62 vars in 1199 bytes} [Sun Jul 31 01:29:04 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 31 01:29:04.940943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e6069cff-8240-4110-8256-c8ec3815cbae tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:04.943103 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e6069cff-8240-4110-8256-c8ec3815cbae tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:04.960912 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6069cff-8240-4110-8256-c8ec3815cbae tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:04.961738 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6069cff-8240-4110-8256-c8ec3815cbae tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:04.963514 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6069cff-8240-4110-8256-c8ec3815cbae tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:04.964985 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e6069cff-8240-4110-8256-c8ec3815cbae tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:05.753763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e6069cff-8240-4110-8256-c8ec3815cbae tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:05.763961 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e6069cff-8240-4110-8256-c8ec3815cbae tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.833196 Jul 31 01:29:05.765558 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2062/4108] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:04 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:05.770630 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-32339676-6eed-4b4a-a727-f5ff31e3e8df tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Action: 'create', calling method: .version_select at 0x7fedeaa38430>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-111798425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAJ1RsyprDOBmGzbC16qwjLyy5kPkxrHgxmDkghZGqAgG7pLxzKgi5aMfblzazqv7rqUjUA2zEfE4a+8H4Fa656ZQ2qbvhhiKmXc37qw2L1ZJoPgJxxpGARtoehoN0Gfg=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:05.797542 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-32339676-6eed-4b4a-a727-f5ff31e3e8df tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:05.805707 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-32339676-6eed-4b4a-a727-f5ff31e3e8df tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for user 6a5ab86e9e724d6389acff5a99f2a930 and project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:05.873409 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-32339676-6eed-4b4a-a727-f5ff31e3e8df tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.106577 Jul 31 01:29:05.874022 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2063/4109] 10.222.0.45 () {62 vars in 1199 bytes} [Sun Jul 31 01:29:05 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 31 01:29:05.892974 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f6f1ecb5-687b-496e-aacc-c2d0b9739f7c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:05.893950 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f6f1ecb5-687b-496e-aacc-c2d0b9739f7c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:05.906475 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6f1ecb5-687b-496e-aacc-c2d0b9739f7c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:05.908771 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6f1ecb5-687b-496e-aacc-c2d0b9739f7c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:05.909803 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6f1ecb5-687b-496e-aacc-c2d0b9739f7c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:05.910615 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6f1ecb5-687b-496e-aacc-c2d0b9739f7c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:06.088547 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f6f1ecb5-687b-496e-aacc-c2d0b9739f7c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:06.096727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f6f1ecb5-687b-496e-aacc-c2d0b9739f7c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:06.108375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f6f1ecb5-687b-496e-aacc-c2d0b9739f7c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:06.109609 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f6f1ecb5-687b-496e-aacc-c2d0b9739f7c tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1336 microversion: 2.54 time: 0.225803 Jul 31 01:29:06.127377 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2064/4110] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:05 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1336 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:06.133327 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed80223c-c202-4522-a240-acbe49743699 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:06.134256 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ed80223c-c202-4522-a240-acbe49743699 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:06.141135 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed80223c-c202-4522-a240-acbe49743699 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:06.141858 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed80223c-c202-4522-a240-acbe49743699 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:06.143034 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed80223c-c202-4522-a240-acbe49743699 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:06.143780 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed80223c-c202-4522-a240-acbe49743699 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:06.573975 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d614e337-e679-4aad-b06c-61033278e0cb tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:29:06.574473 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d614e337-e679-4aad-b06c-61033278e0cb tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:29:06.574903 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d614e337-e679-4aad-b06c-61033278e0cb tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:29:06.575314 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d614e337-e679-4aad-b06c-61033278e0cb tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:29:06.578394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d614e337-e679-4aad-b06c-61033278e0cb tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:29:06.586637 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ed80223c-c202-4522-a240-acbe49743699 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:06.597059 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d614e337-e679-4aad-b06c-61033278e0cb tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:06.597519 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d614e337-e679-4aad-b06c-61033278e0cb tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:06.598323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d614e337-e679-4aad-b06c-61033278e0cb tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:06.598765 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d614e337-e679-4aad-b06c-61033278e0cb tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:06.604390 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ed80223c-c202-4522-a240-acbe49743699 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.475364 Jul 31 01:29:06.604989 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2065/4111] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:06 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:06.610053 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fcc9817b-2699-4e88-90f3-ad20c24afb43 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Action: 'create', calling method: .version_select at 0x7fede5d30ca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-126645007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTp4qyHDFrITKGmad7Al2u4xyEbWS4Gh0mPQDKCOeE5uWDgLqJy8FxtB8BwO1EY4x9jL7UK5wqVX6IAGRXz/OU8UYILCA7J1p+51ApXBLm6aLGWqpBbio4NCrPd+b4m9g=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:06.642310 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-d614e337-e679-4aad-b06c-61033278e0cb tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Getting quotas for project 0d2e6318c9a2499c8a5857683762bf52. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:06.650185 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-fcc9817b-2699-4e88-90f3-ad20c24afb43 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:06.662012 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-d614e337-e679-4aad-b06c-61033278e0cb tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Getting quotas for user b86f46d7be9f45d0aa7ee53ac4b95371 and project 0d2e6318c9a2499c8a5857683762bf52. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:06.663035 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-fcc9817b-2699-4e88-90f3-ad20c24afb43 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for user 6a5ab86e9e724d6389acff5a99f2a930 and project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:06.687125 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d614e337-e679-4aad-b06c-61033278e0cb tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:29:06.689789 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d614e337-e679-4aad-b06c-61033278e0cb tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:29:06.721669 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fcc9817b-2699-4e88-90f3-ad20c24afb43 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.115057 Jul 31 01:29:06.722611 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2066/4112] 10.222.0.45 () {62 vars in 1199 bytes} [Sun Jul 31 01:29:06 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 31 01:29:06.729953 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1bb8de73-eccb-49d3-9994-dcdc2fa38811 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:06.730460 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1bb8de73-eccb-49d3-9994-dcdc2fa38811 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Failed to fetch instance by id -1 {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2928}} Jul 31 01:29:06.730965 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-1bb8de73-eccb-49d3-9994-dcdc2fa38811 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance -1 could not be found. Jul 31 01:29:06.752136 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d614e337-e679-4aad-b06c-61033278e0cb tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.177900 Jul 31 01:29:06.753700 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2047/4113] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:29:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1bb8de73-eccb-49d3-9994-dcdc2fa38811 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: exception: Instance -1 could not be found. Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '-1'} Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:06.759371 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:06.763553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:06.763553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:06.763553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 31 01:29:06.763553 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:06.763553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1bb8de73-eccb-49d3-9994-dcdc2fa38811 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:06.763553 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1bb8de73-eccb-49d3-9994-dcdc2fa38811 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.037256 Jul 31 01:29:06.764433 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-df93ab5c-87da-4d5a-8b33-2dfe12a3d09d tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Calling method '.version_select at 0x7fede567b670>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:06.769212 n-d-master-1 devstack@n-api.service[119474]: WARNING oslo_db.sqlalchemy.utils [None req-df93ab5c-87da-4d5a-8b33-2dfe12a3d09d tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 31 01:29:06.773284 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2067/4114] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:29:06 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:29:06.775795 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-df93ab5c-87da-4d5a-8b33-2dfe12a3d09d tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.020842 Jul 31 01:29:06.776596 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2048/4115] 10.222.0.45 () {60 vars in 1177 bytes} [Sun Jul 31 01:29:06 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:06.781574 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e45522f4-3982-4064-82a7-691c626d0d7e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:06.782371 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e45522f4-3982-4064-82a7-691c626d0d7e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:06.791394 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e45522f4-3982-4064-82a7-691c626d0d7e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:06.791701 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-de3e2584-8409-469f-9df4-bf68eabadcc9 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:06.792405 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-de3e2584-8409-469f-9df4-bf68eabadcc9 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:06.793053 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e45522f4-3982-4064-82a7-691c626d0d7e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:06.794410 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e45522f4-3982-4064-82a7-691c626d0d7e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:06.795195 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e45522f4-3982-4064-82a7-691c626d0d7e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:07.038307 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-de3e2584-8409-469f-9df4-bf68eabadcc9 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:07.049205 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-de3e2584-8409-469f-9df4-bf68eabadcc9 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 200 len: 1213 microversion: 2.1 time: 0.272806 Jul 31 01:29:07.052016 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2068/4116] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:06 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 1213 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:07.061328 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d85236ac-f0db-4901-9bcc-fa03404fa7f9 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Calling method '.version_select at 0x7fedea9c0d30>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:07.132371 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d85236ac-f0db-4901-9bcc-fa03404fa7f9 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-126645007" status: 204 len: 0 microversion: 2.2 time: 0.078215 Jul 31 01:29:07.133114 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2069/4117] 10.222.0.45 () {60 vars in 1318 bytes} [Sun Jul 31 01:29:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-126645007 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:29:07.141519 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-18b5c76d-30cd-4cbb-83c9-24d16747d984 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:07.142139 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-18b5c76d-30cd-4cbb-83c9-24d16747d984 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:07.150464 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18b5c76d-30cd-4cbb-83c9-24d16747d984 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:07.150924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18b5c76d-30cd-4cbb-83c9-24d16747d984 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:07.151744 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18b5c76d-30cd-4cbb-83c9-24d16747d984 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:07.152186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18b5c76d-30cd-4cbb-83c9-24d16747d984 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:07.197323 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e45522f4-3982-4064-82a7-691c626d0d7e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:07.211865 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e45522f4-3982-4064-82a7-691c626d0d7e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.433766 Jul 31 01:29:07.212752 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2049/4118] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:06 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:07.218586 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ea7cb8a0-c9aa-4967-8506-ee03dd5e2273 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Calling method '.version_select at 0x7fede58e9550>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:07.251581 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ea7cb8a0-c9aa-4967-8506-ee03dd5e2273 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-111798425" status: 204 len: 0 microversion: 2.2 time: 0.037408 Jul 31 01:29:07.253011 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2050/4119] 10.222.0.45 () {60 vars in 1318 bytes} [Sun Jul 31 01:29:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-111798425 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:29:07.260772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dd33edea-b11e-41b2-8378-2523182bd96c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:07.261606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dd33edea-b11e-41b2-8378-2523182bd96c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:07.273751 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd33edea-b11e-41b2-8378-2523182bd96c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:07.274763 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd33edea-b11e-41b2-8378-2523182bd96c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:07.276545 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd33edea-b11e-41b2-8378-2523182bd96c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:07.277367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd33edea-b11e-41b2-8378-2523182bd96c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:07.293885 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-18b5c76d-30cd-4cbb-83c9-24d16747d984 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:07.300197 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:07.314583 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-18b5c76d-30cd-4cbb-83c9-24d16747d984 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:07.316297 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-18b5c76d-30cd-4cbb-83c9-24d16747d984 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:07.317514 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-18b5c76d-30cd-4cbb-83c9-24d16747d984 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1336 microversion: 2.54 time: 0.179907 Jul 31 01:29:07.318095 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2070/4120] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:07 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1336 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:07.327576 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2deb2cbe-09b9-44ff-820f-3437823abd3e tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Calling method '.version_select at 0x7fede5b43670>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:07.391307 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2deb2cbe-09b9-44ff-820f-3437823abd3e tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-350919703" status: 204 len: 0 microversion: 2.2 time: 0.072112 Jul 31 01:29:07.392309 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2071/4121] 10.222.0.45 () {60 vars in 1318 bytes} [Sun Jul 31 01:29:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-350919703 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:29:07.404495 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b3e1ea12-6b82-430d-be29-fd1da45dc6bb tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Action: 'create', calling method: .version_select at 0x7fedeaa385e0>, body: {"keypair": {"name": "tempest-keypair-610593347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNB2TnbVdubU5ykv6ak3GGa09C8Z2qj1uzKYTZUqUoLfTpJJsrurQnRe6i46byPxp5JesmIV/YG7hix1AeUfcFTVhD1zIyiOitFoGSRVn/BqFGH76ThlDTBj+I+/PXvfQ=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:07.444548 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-b3e1ea12-6b82-430d-be29-fd1da45dc6bb tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:07.454900 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-b3e1ea12-6b82-430d-be29-fd1da45dc6bb tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for user 6a5ab86e9e724d6389acff5a99f2a930 and project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:07.499163 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b3e1ea12-6b82-430d-be29-fd1da45dc6bb tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.098668 Jul 31 01:29:07.500736 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2072/4122] 10.222.0.45 () {62 vars in 1199 bytes} [Sun Jul 31 01:29:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 31 01:29:07.510960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-caa8d5e7-40a2-4339-8d18-f60ef96d164a tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Calling method '.version_select at 0x7fede52e44c0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:07.520088 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-caa8d5e7-40a2-4339-8d18-f60ef96d164a tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs/tempest-keypair-610593347" status: 200 len: 512 microversion: 2.2 time: 0.013110 Jul 31 01:29:07.527952 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2073/4123] 10.222.0.45 () {60 vars in 1255 bytes} [Sun Jul 31 01:29:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-610593347 => generated 512 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:29:07.533049 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bf0211c5-f637-4960-b468-b8a16740d6ce tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Calling method '.version_select at 0x7fede52dbaf0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:07.538401 n-d-master-1 devstack@n-api.service[119475]: WARNING oslo_db.sqlalchemy.utils [None req-bf0211c5-f637-4960-b468-b8a16740d6ce tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 31 01:29:07.543736 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bf0211c5-f637-4960-b468-b8a16740d6ce tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.014609 Jul 31 01:29:07.550153 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2074/4124] 10.222.0.45 () {60 vars in 1177 bytes} [Sun Jul 31 01:29:07 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:29:07.555058 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-85594ec4-e236-4863-b80d-e4fb6d48871e tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Calling method '.version_select at 0x7fede5b26c10>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:07.588568 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-85594ec4-e236-4863-b80d-e4fb6d48871e tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-610593347" status: 204 len: 0 microversion: 2.2 time: 0.037209 Jul 31 01:29:07.589995 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2075/4125] 10.222.0.45 () {60 vars in 1258 bytes} [Sun Jul 31 01:29:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-610593347 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:29:07.597442 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dd33edea-b11e-41b2-8378-2523182bd96c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:07.601382 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a843087b-7369-4b5c-9fe9-b8c845ca8183 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Action: 'create', calling method: .version_select at 0x7fede486f280>, body: {"keypair": {"name": "tempest-keypair-874504748", "type": "x509"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:07.610655 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dd33edea-b11e-41b2-8378-2523182bd96c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.355472 Jul 31 01:29:07.611534 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2051/4126] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:07 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:07.621010 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-a843087b-7369-4b5c-9fe9-b8c845ca8183 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:07.631218 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dc5b1bdc-e82c-4b17-b986-786b1c899526 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:07.632206 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dc5b1bdc-e82c-4b17-b986-786b1c899526 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: b52a68ee-2a52-49ba-baf6-09d83c75ddde] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:07.636108 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-a843087b-7369-4b5c-9fe9-b8c845ca8183 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for user 6a5ab86e9e724d6389acff5a99f2a930 and project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:07.638748 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:07.640183 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-dc5b1bdc-e82c-4b17-b986-786b1c899526 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance b52a68ee-2a52-49ba-baf6-09d83c75ddde could not be found. Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dc5b1bdc-e82c-4b17-b986-786b1c899526 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/b52a68ee-2a52-49ba-baf6-09d83c75ddde/action HTTP/1.1 Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 19 Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: {"forceDelete": {}} Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: exception: Instance b52a68ee-2a52-49ba-baf6-09d83c75ddde could not be found. Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'b52a68ee-2a52-49ba-baf6-09d83c75ddde', 'body': {'forceDelete': {}}} Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52a68ee-2a52-49ba-baf6-09d83c75ddde could not be found. Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52a68ee-2a52-49ba-baf6-09d83c75ddde could not be found. Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:07.651313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:07.655313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:07.655313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:07.655313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52a68ee-2a52-49ba-baf6-09d83c75ddde could not be found. Jul 31 01:29:07.655313 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:07.658664 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dc5b1bdc-e82c-4b17-b986-786b1c899526 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance b52a68ee-2a52-49ba-baf6-09d83c75ddde could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:07.659960 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dc5b1bdc-e82c-4b17-b986-786b1c899526 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/b52a68ee-2a52-49ba-baf6-09d83c75ddde/action" status: 404 len: 111 microversion: 2.1 time: 0.032819 Jul 31 01:29:07.661810 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2052/4127] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:29:07 2022] POST /compute/v2.1/servers/b52a68ee-2a52-49ba-baf6-09d83c75ddde/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:29:07.671846 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c83631bc-5599-41d2-954e-dd36a1f5a47e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:07.672862 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c83631bc-5599-41d2-954e-dd36a1f5a47e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:07.681802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c83631bc-5599-41d2-954e-dd36a1f5a47e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:07.682405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c83631bc-5599-41d2-954e-dd36a1f5a47e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:07.683362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c83631bc-5599-41d2-954e-dd36a1f5a47e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:07.683952 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c83631bc-5599-41d2-954e-dd36a1f5a47e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:07.689168 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.processutils [None req-a843087b-7369-4b5c-9fe9-b8c845ca8183 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpb94broh6/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpb94broh6/temp.key -subj /CN=6a5ab86e9e724d6389acff5a99f2a930 -extensions v3_req_client {{(pid=119475) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 31 01:29:08.090379 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c83631bc-5599-41d2-954e-dd36a1f5a47e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:08.107985 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c83631bc-5599-41d2-954e-dd36a1f5a47e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.441324 Jul 31 01:29:08.108579 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2053/4128] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:07 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:08.123307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-df275fff-357c-49f7-a046-e397fa7ccef7 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:08.129170 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-df275fff-357c-49f7-a046-e397fa7ccef7 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:08.129439 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.processutils [None req-a843087b-7369-4b5c-9fe9-b8c845ca8183 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpb94broh6/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpb94broh6/temp.key -subj /CN=6a5ab86e9e724d6389acff5a99f2a930 -extensions v3_req_client" returned: 0 in 0.434s {{(pid=119475) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 31 01:29:08.134822 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.processutils [None req-a843087b-7369-4b5c-9fe9-b8c845ca8183 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpb94broh6/temp.key -password pass: {{(pid=119475) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 31 01:29:08.147142 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df275fff-357c-49f7-a046-e397fa7ccef7 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:08.153355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df275fff-357c-49f7-a046-e397fa7ccef7 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:08.157436 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df275fff-357c-49f7-a046-e397fa7ccef7 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:08.160402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df275fff-357c-49f7-a046-e397fa7ccef7 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:08.232006 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.processutils [None req-a843087b-7369-4b5c-9fe9-b8c845ca8183 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpb94broh6/temp.key -password pass:" returned: 0 in 0.100s {{(pid=119475) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 31 01:29:08.318449 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-a843087b-7369-4b5c-9fe9-b8c845ca8183 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:08.330904 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-a843087b-7369-4b5c-9fe9-b8c845ca8183 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Getting quotas for user 6a5ab86e9e724d6389acff5a99f2a930 and project 62cba277db6b4514b6ff20f53d6603c5. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:08.382490 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a843087b-7369-4b5c-9fe9-b8c845ca8183 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.786134 Jul 31 01:29:08.384171 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2076/4129] 10.222.0.45 () {62 vars in 1198 bytes} [Sun Jul 31 01:29:07 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 789 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:29:08.398088 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8b0bc41d-b0d2-4157-8531-4a3ffec0169a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:08.399045 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8b0bc41d-b0d2-4157-8531-4a3ffec0169a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:08.413530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b0bc41d-b0d2-4157-8531-4a3ffec0169a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:08.414336 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b0bc41d-b0d2-4157-8531-4a3ffec0169a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:08.415380 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b0bc41d-b0d2-4157-8531-4a3ffec0169a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:08.415984 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b0bc41d-b0d2-4157-8531-4a3ffec0169a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:08.434072 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-df275fff-357c-49f7-a046-e397fa7ccef7 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:08.446317 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-df275fff-357c-49f7-a046-e397fa7ccef7 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 200 len: 1265 microversion: 2.1 time: 0.336457 Jul 31 01:29:08.446923 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2054/4130] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:08 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 1265 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:08.488159 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-85589d96-48e9-405d-8406-d862b9db91f9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:08.490211 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-85589d96-48e9-405d-8406-d862b9db91f9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:08.508047 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85589d96-48e9-405d-8406-d862b9db91f9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:08.513659 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85589d96-48e9-405d-8406-d862b9db91f9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:08.524489 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85589d96-48e9-405d-8406-d862b9db91f9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:08.525009 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85589d96-48e9-405d-8406-d862b9db91f9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:08.559569 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:08.724881 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-85589d96-48e9-405d-8406-d862b9db91f9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:08.736231 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-85589d96-48e9-405d-8406-d862b9db91f9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:08.738313 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-85589d96-48e9-405d-8406-d862b9db91f9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:08.739955 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-85589d96-48e9-405d-8406-d862b9db91f9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1357 microversion: 2.54 time: 0.270975 Jul 31 01:29:08.761115 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2055/4131] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:08 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1357 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:08.769518 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bcf93b5c-9310-4cc8-a900-ddcb0acd7c2c tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Calling method '.version_select at 0x7fede567baf0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:08.797188 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bcf93b5c-9310-4cc8-a900-ddcb0acd7c2c tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs/tempest-keypair-874504748" status: 200 len: 1533 microversion: 2.2 time: 0.034323 Jul 31 01:29:08.810960 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2056/4132] 10.222.0.45 () {60 vars in 1255 bytes} [Sun Jul 31 01:29:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-874504748 => generated 1533 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:08.816181 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5146a8a7-71f4-4726-bdb8-8a347013d9ae tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Action: 'create', calling method: .version_select at 0x7fede59a7af0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-603576366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/tVy2BARaRYFIsDonpF/XrkEYg/zZD4peSuQqDlpvCrIp4oGg4rZW8qPXnqp8k66NxLXstdDspaOowrveLjaB9zzn0jnVHvBEEFVeRFivLVKGqV+se5DIGjrFSX3XNZg=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:08.864881 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8b0bc41d-b0d2-4157-8531-4a3ffec0169a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:08.865053 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5146a8a7-71f4-4726-bdb8-8a347013d9ae tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Getting quotas for project 43e3b88e39c44bfba92d40ff5971a7a8. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:08.875955 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5146a8a7-71f4-4726-bdb8-8a347013d9ae tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Getting quotas for user 9bd76f16e0104a7ead477c3292725c27 and project 43e3b88e39c44bfba92d40ff5971a7a8. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:08.877690 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8b0bc41d-b0d2-4157-8531-4a3ffec0169a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.486587 Jul 31 01:29:08.880079 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2077/4133] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:08 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:08.891367 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a1e17cc0-09cb-4342-b51e-68d3ebde57e1 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Calling method '.version_select at 0x7fede52dbb80>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:08.908456 n-d-master-1 devstack@n-api.service[119475]: WARNING oslo_db.sqlalchemy.utils [None req-a1e17cc0-09cb-4342-b51e-68d3ebde57e1 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 31 01:29:08.925136 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5146a8a7-71f4-4726-bdb8-8a347013d9ae tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.112649 Jul 31 01:29:08.933434 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2057/4134] 10.222.0.45 () {62 vars in 1200 bytes} [Sun Jul 31 01:29:08 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 31 01:29:08.935254 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a1e17cc0-09cb-4342-b51e-68d3ebde57e1 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.053729 Jul 31 01:29:08.940291 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-61be12a5-2c89-4143-a8b5-ea5010dc6444 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:08.940565 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2078/4135] 10.222.0.45 () {60 vars in 1177 bytes} [Sun Jul 31 01:29:08 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:08.943628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-61be12a5-2c89-4143-a8b5-ea5010dc6444 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 95a79113-7062-46f0-bfb2-55248f322726] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:08.952554 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-603576366", "imageRef": "0f306572-729b-4b95-a357-79461887e541"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:08.952886 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-61be12a5-2c89-4143-a8b5-ea5010dc6444 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 95a79113-7062-46f0-bfb2-55248f322726 could not be found. Jul 31 01:29:08.955852 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-61be12a5-2c89-4143-a8b5-ea5010dc6444 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/95a79113-7062-46f0-bfb2-55248f322726/action HTTP/1.1 Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 39 Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: {"os-getConsoleOutput": {"length": 10}} Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 95a79113-7062-46f0-bfb2-55248f322726 could not be found. Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '95a79113-7062-46f0-bfb2-55248f322726', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a79113-7062-46f0-bfb2-55248f322726 could not be found. Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a79113-7062-46f0-bfb2-55248f322726 could not be found. Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:08.956397 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:08.961514 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:08.961514 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:08.961514 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:08.961514 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:08.961514 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a79113-7062-46f0-bfb2-55248f322726 could not be found. Jul 31 01:29:08.961514 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:08.965002 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-61be12a5-2c89-4143-a8b5-ea5010dc6444 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 95a79113-7062-46f0-bfb2-55248f322726 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:08.966484 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-61be12a5-2c89-4143-a8b5-ea5010dc6444 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/95a79113-7062-46f0-bfb2-55248f322726/action" status: 404 len: 111 microversion: 2.1 time: 0.031754 Jul 31 01:29:08.967673 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2058/4136] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:29:08 2022] POST /compute/v2.1/servers/95a79113-7062-46f0-bfb2-55248f322726/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:29:08.973588 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-59d3a5a6-5502-4feb-a2f7-f937004863b5 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] Calling method '.version_select at 0x7fede557b160>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:08.974213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:08.974676 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:08.985359 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:08.985957 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:09.005770 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-59d3a5a6-5502-4feb-a2f7-f937004863b5 tempest-KeyPairsV22TestJSON-427850296 tempest-KeyPairsV22TestJSON-427850296-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-874504748" status: 204 len: 0 microversion: 2.2 time: 0.036633 Jul 31 01:29:09.008238 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2059/4137] 10.222.0.45 () {60 vars in 1258 bytes} [Sun Jul 31 01:29:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-874504748 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:29:09.015290 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6fe2959e-94db-44d8-b2e8-c19eab416838 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:09.016739 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6fe2959e-94db-44d8-b2e8-c19eab416838 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:09.025303 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6fe2959e-94db-44d8-b2e8-c19eab416838 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:09.026337 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6fe2959e-94db-44d8-b2e8-c19eab416838 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:09.027662 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6fe2959e-94db-44d8-b2e8-c19eab416838 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:09.028378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6fe2959e-94db-44d8-b2e8-c19eab416838 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:09.191189 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:29:09.191780 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:29:09.192266 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:29:09.192692 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:29:09.193119 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:29:09.353345 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:09.399009 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:09.406313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:09.417186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:09.418404 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:09.543332 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f7691906-be53-4a70-bc8a-02ecc3e76e54 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "POST /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d/action" status: 202 len: 1139 microversion: 2.54 time: 0.601523 Jul 31 01:29:09.546340 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2079/4138] 10.222.0.45 () {62 vars in 1320 bytes} [Sun Jul 31 01:29:08 2022] POST /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d/action => generated 1139 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 31 01:29:09.571130 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6d9a6904-13d4-425f-aadc-c30546b84e65 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:09.573906 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6d9a6904-13d4-425f-aadc-c30546b84e65 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:09.585683 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d9a6904-13d4-425f-aadc-c30546b84e65 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:09.586156 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d9a6904-13d4-425f-aadc-c30546b84e65 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:09.587102 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d9a6904-13d4-425f-aadc-c30546b84e65 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:09.587685 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d9a6904-13d4-425f-aadc-c30546b84e65 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:09.852533 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6d9a6904-13d4-425f-aadc-c30546b84e65 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:09.869498 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6d9a6904-13d4-425f-aadc-c30546b84e65 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 200 len: 1271 microversion: 2.1 time: 0.320482 Jul 31 01:29:09.870367 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2080/4139] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:09 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 1271 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:09.875390 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cb191b0a-5acd-4a75-a547-f090a2762c68 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:09.876249 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cb191b0a-5acd-4a75-a547-f090a2762c68 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:09.888998 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb191b0a-5acd-4a75-a547-f090a2762c68 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:09.892992 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb191b0a-5acd-4a75-a547-f090a2762c68 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:09.894209 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb191b0a-5acd-4a75-a547-f090a2762c68 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:09.894841 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb191b0a-5acd-4a75-a547-f090a2762c68 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:10.060777 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cb191b0a-5acd-4a75-a547-f090a2762c68 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:10.082710 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cb191b0a-5acd-4a75-a547-f090a2762c68 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:10.084697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cb191b0a-5acd-4a75-a547-f090a2762c68 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:10.086166 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cb191b0a-5acd-4a75-a547-f090a2762c68 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.214686 Jul 31 01:29:10.086923 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2081/4140] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:09 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:10.148807 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6fe2959e-94db-44d8-b2e8-c19eab416838 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:10.156605 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6fe2959e-94db-44d8-b2e8-c19eab416838 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 1.146893 Jul 31 01:29:10.157207 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2060/4141] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:09 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:10.183530 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4e732671-997f-4dbe-82e4-dba2f1174453 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:10.184464 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4e732671-997f-4dbe-82e4-dba2f1174453 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:10.190799 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e732671-997f-4dbe-82e4-dba2f1174453 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:10.191534 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e732671-997f-4dbe-82e4-dba2f1174453 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:10.192924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e732671-997f-4dbe-82e4-dba2f1174453 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:10.193537 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e732671-997f-4dbe-82e4-dba2f1174453 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:10.658242 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4e732671-997f-4dbe-82e4-dba2f1174453 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:10.672138 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4e732671-997f-4dbe-82e4-dba2f1174453 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.491831 Jul 31 01:29:10.673110 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2082/4142] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:10 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:10.692631 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-31d6071b-bfd6-4198-bdaa-ea496fbe4832 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:10.693631 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-31d6071b-bfd6-4198-bdaa-ea496fbe4832 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 007f9892-b851-44a9-97e7-9cc8999ad37f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:10.705197 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-31d6071b-bfd6-4198-bdaa-ea496fbe4832 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 007f9892-b851-44a9-97e7-9cc8999ad37f could not be found. Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-31d6071b-bfd6-4198-bdaa-ea496fbe4832 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/007f9892-b851-44a9-97e7-9cc8999ad37f HTTP/1.1 Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 007f9892-b851-44a9-97e7-9cc8999ad37f could not be found. Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '007f9892-b851-44a9-97e7-9cc8999ad37f'} Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 007f9892-b851-44a9-97e7-9cc8999ad37f could not be found. Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 007f9892-b851-44a9-97e7-9cc8999ad37f could not be found. Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:10.707033 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:10.711280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:10.711280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:10.711280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:10.711280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 007f9892-b851-44a9-97e7-9cc8999ad37f could not be found. Jul 31 01:29:10.711280 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:10.713172 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-31d6071b-bfd6-4198-bdaa-ea496fbe4832 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 007f9892-b851-44a9-97e7-9cc8999ad37f could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:10.714254 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-31d6071b-bfd6-4198-bdaa-ea496fbe4832 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/007f9892-b851-44a9-97e7-9cc8999ad37f" status: 404 len: 111 microversion: 2.1 time: 0.025614 Jul 31 01:29:10.721142 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2061/4143] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:10 2022] GET /compute/v2.1/servers/007f9892-b851-44a9-97e7-9cc8999ad37f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:29:10.731025 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-487a9655-da68-4c0f-87ef-73cc1a0f8b16 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:10.731917 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-487a9655-da68-4c0f-87ef-73cc1a0f8b16 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:10.751162 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-487a9655-da68-4c0f-87ef-73cc1a0f8b16 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:10.751754 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-487a9655-da68-4c0f-87ef-73cc1a0f8b16 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:10.752616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-487a9655-da68-4c0f-87ef-73cc1a0f8b16 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:10.753147 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-487a9655-da68-4c0f-87ef-73cc1a0f8b16 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:10.890642 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5b509867-606a-4be0-ab23-e3480cb47419 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:10.891556 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5b509867-606a-4be0-ab23-e3480cb47419 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:10.910939 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b509867-606a-4be0-ab23-e3480cb47419 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:10.915919 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b509867-606a-4be0-ab23-e3480cb47419 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:10.917052 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b509867-606a-4be0-ab23-e3480cb47419 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:10.917621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b509867-606a-4be0-ab23-e3480cb47419 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:11.072259 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5b509867-606a-4be0-ab23-e3480cb47419 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:11.081271 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5b509867-606a-4be0-ab23-e3480cb47419 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 200 len: 1271 microversion: 2.1 time: 0.194439 Jul 31 01:29:11.086072 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2062/4144] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:10 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:11.114596 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eb03a2e8-be51-40b4-a0a6-52b8cc129797 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:11.115535 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eb03a2e8-be51-40b4-a0a6-52b8cc129797 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:11.125042 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb03a2e8-be51-40b4-a0a6-52b8cc129797 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:11.130152 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb03a2e8-be51-40b4-a0a6-52b8cc129797 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:11.132044 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb03a2e8-be51-40b4-a0a6-52b8cc129797 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:11.135307 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb03a2e8-be51-40b4-a0a6-52b8cc129797 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:11.204790 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-487a9655-da68-4c0f-87ef-73cc1a0f8b16 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:11.213756 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-487a9655-da68-4c0f-87ef-73cc1a0f8b16 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.488085 Jul 31 01:29:11.222570 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2083/4145] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:10 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:11.245757 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0a474d71-ad8d-4716-a8f2-835ebde5888f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:11.246640 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0a474d71-ad8d-4716-a8f2-835ebde5888f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:11.259161 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a474d71-ad8d-4716-a8f2-835ebde5888f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:11.259860 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a474d71-ad8d-4716-a8f2-835ebde5888f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:11.261324 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a474d71-ad8d-4716-a8f2-835ebde5888f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:11.261973 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a474d71-ad8d-4716-a8f2-835ebde5888f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:11.359546 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eb03a2e8-be51-40b4-a0a6-52b8cc129797 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:11.373897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eb03a2e8-be51-40b4-a0a6-52b8cc129797 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:11.381037 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eb03a2e8-be51-40b4-a0a6-52b8cc129797 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:11.391364 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eb03a2e8-be51-40b4-a0a6-52b8cc129797 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.280030 Jul 31 01:29:11.392214 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2063/4146] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:11 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:11.804301 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0a474d71-ad8d-4716-a8f2-835ebde5888f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:11.817178 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0a474d71-ad8d-4716-a8f2-835ebde5888f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.573580 Jul 31 01:29:11.820099 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2084/4147] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:11 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:12.026387 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1680d5f6-14cc-47e9-b868-7d3e8b4fd5cb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-227530352", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1680d5f6-14cc-47e9-b868-7d3e8b4fd5cb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 237 Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-227530352", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-227530352', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '045ea8ff-463e-40b5-b75b-322b143e9807'}]}}} Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:12.040502 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 31 01:29:12.045147 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:12.047990 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1680d5f6-14cc-47e9-b868-7d3e8b4fd5cb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:12.049380 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1680d5f6-14cc-47e9-b868-7d3e8b4fd5cb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.027263 Jul 31 01:29:12.062480 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ea767676-ef63-4ea8-8a98-6e67830c653d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:12.063154 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ea767676-ef63-4ea8-8a98-6e67830c653d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:12.065324 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2064/4148] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:29:12 2022] POST /compute/v2.1/servers => generated 139 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:29:12.070746 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ea767676-ef63-4ea8-8a98-6e67830c653d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:12.071466 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ea767676-ef63-4ea8-8a98-6e67830c653d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:12.072514 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ea767676-ef63-4ea8-8a98-6e67830c653d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:12.073119 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ea767676-ef63-4ea8-8a98-6e67830c653d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:12.107076 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f8a66e55-2847-4c0d-b580-0455e192b4b3 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:12.107884 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f8a66e55-2847-4c0d-b580-0455e192b4b3 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:12.122640 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8a66e55-2847-4c0d-b580-0455e192b4b3 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:12.123106 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8a66e55-2847-4c0d-b580-0455e192b4b3 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:12.123933 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8a66e55-2847-4c0d-b580-0455e192b4b3 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:12.134735 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8a66e55-2847-4c0d-b580-0455e192b4b3 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:13.444199 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:13.640039 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ea767676-ef63-4ea8-8a98-6e67830c653d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:13.653801 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ea767676-ef63-4ea8-8a98-6e67830c653d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 1.596932 Jul 31 01:29:13.656639 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2085/4149] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:12 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:13.664147 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-caa341a3-64f6-408b-9bda-06e332421964 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:13.665061 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-caa341a3-64f6-408b-9bda-06e332421964 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:13.675851 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-caa341a3-64f6-408b-9bda-06e332421964 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:13.676254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f8a66e55-2847-4c0d-b580-0455e192b4b3 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:13.677451 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-caa341a3-64f6-408b-9bda-06e332421964 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:13.678770 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-caa341a3-64f6-408b-9bda-06e332421964 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:13.680175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-caa341a3-64f6-408b-9bda-06e332421964 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:13.689933 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f8a66e55-2847-4c0d-b580-0455e192b4b3 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 200 len: 1313 microversion: 2.1 time: 1.584555 Jul 31 01:29:13.702472 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2065/4150] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:12 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 1313 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:13.715014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c3f2f82c-ac67-460f-8e8b-eca768aa5921 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:13.729472 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c3f2f82c-ac67-460f-8e8b-eca768aa5921 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:13.791542 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3f2f82c-ac67-460f-8e8b-eca768aa5921 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:13.797217 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3f2f82c-ac67-460f-8e8b-eca768aa5921 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:13.801509 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3f2f82c-ac67-460f-8e8b-eca768aa5921 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:13.807215 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3f2f82c-ac67-460f-8e8b-eca768aa5921 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:14.424076 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-caa341a3-64f6-408b-9bda-06e332421964 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:14.436224 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-caa341a3-64f6-408b-9bda-06e332421964 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:14.438035 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-caa341a3-64f6-408b-9bda-06e332421964 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:14.449590 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-caa341a3-64f6-408b-9bda-06e332421964 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.781409 Jul 31 01:29:14.450902 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2086/4151] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:13 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:14.729594 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4c62bf77-3973-4436-a528-2ad9cf882cdd tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:14.730239 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4c62bf77-3973-4436-a528-2ad9cf882cdd tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:14.746956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c62bf77-3973-4436-a528-2ad9cf882cdd tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:14.751793 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c62bf77-3973-4436-a528-2ad9cf882cdd tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:14.752888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c62bf77-3973-4436-a528-2ad9cf882cdd tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:14.753353 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c62bf77-3973-4436-a528-2ad9cf882cdd tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:15.014470 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c3f2f82c-ac67-460f-8e8b-eca768aa5921 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:15.024854 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c3f2f82c-ac67-460f-8e8b-eca768aa5921 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 1.320620 Jul 31 01:29:15.031310 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2066/4152] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:13 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:15.186458 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8da7bbe2-625c-4aba-8d38-b222600154c4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-837503935", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8da7bbe2-625c-4aba-8d38-b222600154c4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 234 Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-837503935", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-837503935', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '045ea8ff-463e-40b5-b75b-322b143e9807'}]}}} Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:15.190954 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 31 01:29:15.196469 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:15.198169 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8da7bbe2-625c-4aba-8d38-b222600154c4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:15.198851 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8da7bbe2-625c-4aba-8d38-b222600154c4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.016628 Jul 31 01:29:15.201700 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2067/4153] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:29:15 2022] POST /compute/v2.1/servers => generated 133 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:29:15.219480 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cba8bf33-671a-4f77-a3cd-d9575debee8e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:15.224333 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cba8bf33-671a-4f77-a3cd-d9575debee8e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:15.242023 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cba8bf33-671a-4f77-a3cd-d9575debee8e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:15.242548 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cba8bf33-671a-4f77-a3cd-d9575debee8e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:15.243737 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cba8bf33-671a-4f77-a3cd-d9575debee8e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:15.244385 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cba8bf33-671a-4f77-a3cd-d9575debee8e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:16.134034 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4c62bf77-3973-4436-a528-2ad9cf882cdd tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:16.146055 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4c62bf77-3973-4436-a528-2ad9cf882cdd tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 200 len: 1313 microversion: 2.1 time: 1.421379 Jul 31 01:29:16.148265 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2087/4154] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:14 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 1313 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:16.154487 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2b65bb71-80ce-4621-9c03-00fa83ac0331 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:16.157696 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2b65bb71-80ce-4621-9c03-00fa83ac0331 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:16.171131 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b65bb71-80ce-4621-9c03-00fa83ac0331 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:16.172156 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b65bb71-80ce-4621-9c03-00fa83ac0331 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:16.173328 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b65bb71-80ce-4621-9c03-00fa83ac0331 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:16.173945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b65bb71-80ce-4621-9c03-00fa83ac0331 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:16.325014 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2b65bb71-80ce-4621-9c03-00fa83ac0331 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:16.333566 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2b65bb71-80ce-4621-9c03-00fa83ac0331 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:16.335962 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2b65bb71-80ce-4621-9c03-00fa83ac0331 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:16.337205 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2b65bb71-80ce-4621-9c03-00fa83ac0331 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.187434 Jul 31 01:29:16.337794 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2088/4155] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:16 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:16.452537 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cba8bf33-671a-4f77-a3cd-d9575debee8e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:16.464114 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cba8bf33-671a-4f77-a3cd-d9575debee8e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 1.258142 Jul 31 01:29:16.479667 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2068/4156] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:15 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:16.489835 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e1cbd572-e31d-42f6-8860-6f3149ef6404 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:16.490462 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e1cbd572-e31d-42f6-8860-6f3149ef6404 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:16.498249 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1cbd572-e31d-42f6-8860-6f3149ef6404 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:16.498712 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1cbd572-e31d-42f6-8860-6f3149ef6404 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:16.499549 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1cbd572-e31d-42f6-8860-6f3149ef6404 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:16.499999 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1cbd572-e31d-42f6-8860-6f3149ef6404 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:16.961387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e1cbd572-e31d-42f6-8860-6f3149ef6404 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:16.977903 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e1cbd572-e31d-42f6-8860-6f3149ef6404 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.491562 Jul 31 01:29:16.980256 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2089/4157] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:16 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:17.004686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3504d4d2-dfa4-4e8b-afa7-5e2f2dd1409d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:17.005245 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3504d4d2-dfa4-4e8b-afa7-5e2f2dd1409d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 5b24e916-d410-4da7-a558-aa6194ac16f6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:17.010787 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:17.012176 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-3504d4d2-dfa4-4e8b-afa7-5e2f2dd1409d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 5b24e916-d410-4da7-a558-aa6194ac16f6 could not be found. Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3504d4d2-dfa4-4e8b-afa7-5e2f2dd1409d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/5b24e916-d410-4da7-a558-aa6194ac16f6/action HTTP/1.1 Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 13 Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: {"pause": {}} Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 5b24e916-d410-4da7-a558-aa6194ac16f6 could not be found. Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '5b24e916-d410-4da7-a558-aa6194ac16f6', 'body': {'pause': {}}} Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b24e916-d410-4da7-a558-aa6194ac16f6 could not be found. Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b24e916-d410-4da7-a558-aa6194ac16f6 could not be found. Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:17.021462 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:17.029601 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:17.029601 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:17.029601 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b24e916-d410-4da7-a558-aa6194ac16f6 could not be found. Jul 31 01:29:17.029601 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:17.029601 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3504d4d2-dfa4-4e8b-afa7-5e2f2dd1409d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 5b24e916-d410-4da7-a558-aa6194ac16f6 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:17.029601 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3504d4d2-dfa4-4e8b-afa7-5e2f2dd1409d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/5b24e916-d410-4da7-a558-aa6194ac16f6/action" status: 404 len: 111 microversion: 2.1 time: 0.033486 Jul 31 01:29:17.033406 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2069/4158] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:29:16 2022] POST /compute/v2.1/servers/5b24e916-d410-4da7-a558-aa6194ac16f6/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:29:17.039725 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6b351675-42fc-4140-a6eb-fbd7958e8bdf tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:17.040674 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6b351675-42fc-4140-a6eb-fbd7958e8bdf tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:17.047794 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b351675-42fc-4140-a6eb-fbd7958e8bdf tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:17.048555 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b351675-42fc-4140-a6eb-fbd7958e8bdf tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:17.049699 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b351675-42fc-4140-a6eb-fbd7958e8bdf tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:17.050180 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b351675-42fc-4140-a6eb-fbd7958e8bdf tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:17.174506 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6450114a-1d6a-4a65-a420-dc9fc8e4811e tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:17.175706 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6450114a-1d6a-4a65-a420-dc9fc8e4811e tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:17.193731 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6450114a-1d6a-4a65-a420-dc9fc8e4811e tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:17.194324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6450114a-1d6a-4a65-a420-dc9fc8e4811e tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:17.195591 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6450114a-1d6a-4a65-a420-dc9fc8e4811e tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:17.196152 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6450114a-1d6a-4a65-a420-dc9fc8e4811e tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:17.780026 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6b351675-42fc-4140-a6eb-fbd7958e8bdf tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:17.793671 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6b351675-42fc-4140-a6eb-fbd7958e8bdf tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.755658 Jul 31 01:29:17.798102 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2090/4159] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:17 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:17.808004 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a39f6474-5bfc-477c-b16f-1445cec6acfb tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:17.811987 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a39f6474-5bfc-477c-b16f-1445cec6acfb tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:17.829323 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a39f6474-5bfc-477c-b16f-1445cec6acfb tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:17.830052 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a39f6474-5bfc-477c-b16f-1445cec6acfb tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:17.831052 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a39f6474-5bfc-477c-b16f-1445cec6acfb tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:17.832797 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a39f6474-5bfc-477c-b16f-1445cec6acfb tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:17.971553 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6450114a-1d6a-4a65-a420-dc9fc8e4811e tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:18.000005 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6450114a-1d6a-4a65-a420-dc9fc8e4811e tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 200 len: 1313 microversion: 2.1 time: 0.826339 Jul 31 01:29:18.011533 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2070/4160] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:17 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 1313 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:18.017022 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-9778a5e4-2695-4d7d-b1e7-2ae425178fff req-e8166e49-c3aa-43cb-959f-103e5a783b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e89e57-5784-40fe-a6a2-f299fb7e91fd", "tag": "32067df0-68ea-416d-a011-49c3d916cd31"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:18.053239 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9778a5e4-2695-4d7d-b1e7-2ae425178fff req-e8166e49-c3aa-43cb-959f-103e5a783b10 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:18.053886 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9778a5e4-2695-4d7d-b1e7-2ae425178fff req-e8166e49-c3aa-43cb-959f-103e5a783b10 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:18.073656 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-9778a5e4-2695-4d7d-b1e7-2ae425178fff req-e8166e49-c3aa-43cb-959f-103e5a783b10 service nova] Creating event network-changed:32067df0-68ea-416d-a011-49c3d916cd31 for instance 41e89e57-5784-40fe-a6a2-f299fb7e91fd on n-h1-master-1 Jul 31 01:29:18.094929 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-9778a5e4-2695-4d7d-b1e7-2ae425178fff req-e8166e49-c3aa-43cb-959f-103e5a783b10 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081687 Jul 31 01:29:18.096050 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2071/4161] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:29:18.109993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b30d5132-190c-47a7-a2d0-0d91570d47ea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:18.111008 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b30d5132-190c-47a7-a2d0-0d91570d47ea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:18.136566 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b30d5132-190c-47a7-a2d0-0d91570d47ea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:18.137288 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b30d5132-190c-47a7-a2d0-0d91570d47ea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:18.138479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b30d5132-190c-47a7-a2d0-0d91570d47ea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:18.139095 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b30d5132-190c-47a7-a2d0-0d91570d47ea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:18.320796 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a39f6474-5bfc-477c-b16f-1445cec6acfb tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:18.333404 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a39f6474-5bfc-477c-b16f-1445cec6acfb tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:18.338413 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a39f6474-5bfc-477c-b16f-1445cec6acfb tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:18.342933 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a39f6474-5bfc-477c-b16f-1445cec6acfb tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.540776 Jul 31 01:29:18.344844 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2091/4162] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:17 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:18.901776 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=24 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:18.950882 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b30d5132-190c-47a7-a2d0-0d91570d47ea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:18.971079 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b30d5132-190c-47a7-a2d0-0d91570d47ea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.872067 Jul 31 01:29:18.972193 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2072/4163] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:18 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:19.029925 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-63a8da61-9a59-4519-a6e0-d18db297b07b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:19.033559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-63a8da61-9a59-4519-a6e0-d18db297b07b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:19.049773 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=56 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:19.058607 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d22f8456-aeb4-482f-a916-a2104709a03f tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:19.061308 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d22f8456-aeb4-482f-a916-a2104709a03f tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:19.070907 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-63a8da61-9a59-4519-a6e0-d18db297b07b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:19.086033 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d22f8456-aeb4-482f-a916-a2104709a03f tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:19.087282 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-63a8da61-9a59-4519-a6e0-d18db297b07b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:19.089072 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-63a8da61-9a59-4519-a6e0-d18db297b07b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:19.089930 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-63a8da61-9a59-4519-a6e0-d18db297b07b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:19.090805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d22f8456-aeb4-482f-a916-a2104709a03f tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:19.091996 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d22f8456-aeb4-482f-a916-a2104709a03f tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:19.092606 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d22f8456-aeb4-482f-a916-a2104709a03f tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:19.133780 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:19.256396 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-63a8da61-9a59-4519-a6e0-d18db297b07b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action" status: 202 len: 0 microversion: 2.1 time: 0.262906 Jul 31 01:29:19.257568 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2092/4164] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:29:18 2022] POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:29:19.293327 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0b476e1e-1906-4aee-a7cc-348480a44b1e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:19.295811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0b476e1e-1906-4aee-a7cc-348480a44b1e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:19.310031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b476e1e-1906-4aee-a7cc-348480a44b1e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:19.311441 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b476e1e-1906-4aee-a7cc-348480a44b1e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:19.312496 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b476e1e-1906-4aee-a7cc-348480a44b1e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:19.313178 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b476e1e-1906-4aee-a7cc-348480a44b1e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:20.482224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d22f8456-aeb4-482f-a916-a2104709a03f tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:20.503107 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d22f8456-aeb4-482f-a916-a2104709a03f tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 200 len: 1313 microversion: 2.1 time: 1.458649 Jul 31 01:29:20.505060 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2073/4165] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:19 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 1313 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:20.520836 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-61060337-ed4d-486c-a1e4-8ad61c679d47 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:20.523028 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-61060337-ed4d-486c-a1e4-8ad61c679d47 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:20.541739 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61060337-ed4d-486c-a1e4-8ad61c679d47 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:20.542461 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61060337-ed4d-486c-a1e4-8ad61c679d47 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:20.545204 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61060337-ed4d-486c-a1e4-8ad61c679d47 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:20.546070 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61060337-ed4d-486c-a1e4-8ad61c679d47 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:20.653552 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0b476e1e-1906-4aee-a7cc-348480a44b1e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:20.668156 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0b476e1e-1906-4aee-a7cc-348480a44b1e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1510 microversion: 2.1 time: 1.388368 Jul 31 01:29:20.684613 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2093/4166] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:19 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1510 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:20.740934 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-61060337-ed4d-486c-a1e4-8ad61c679d47 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:20.754894 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-61060337-ed4d-486c-a1e4-8ad61c679d47 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:20.762864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-61060337-ed4d-486c-a1e4-8ad61c679d47 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:20.764203 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-61060337-ed4d-486c-a1e4-8ad61c679d47 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.254206 Jul 31 01:29:20.766355 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2074/4167] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:20 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:20.953689 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b8fbad45-75a2-4c5a-99ac-4d94cdb282f0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-773319650", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "ce8b5cb4-aa2f-4dfd-abb4-9273e2a34e90"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:21.070939 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-b8fbad45-75a2-4c5a-99ac-4d94cdb282f0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] validate_networks() for [('ce8b5cb4-aa2f-4dfd-abb4-9273e2a34e90', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:29:21.526181 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1d8d3182-b067-4ac8-9629-988b8c2844e2 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:21.527574 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1d8d3182-b067-4ac8-9629-988b8c2844e2 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:21.576119 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d8d3182-b067-4ac8-9629-988b8c2844e2 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:21.576860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d8d3182-b067-4ac8-9629-988b8c2844e2 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:21.577855 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d8d3182-b067-4ac8-9629-988b8c2844e2 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:21.578502 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d8d3182-b067-4ac8-9629-988b8c2844e2 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:22.171434 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1d8d3182-b067-4ac8-9629-988b8c2844e2 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:22.180527 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1d8d3182-b067-4ac8-9629-988b8c2844e2 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 200 len: 1313 microversion: 2.1 time: 0.658150 Jul 31 01:29:22.184753 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2075/4168] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:21 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 1313 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:22.199147 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e166810e-3bb7-4046-a6fc-593e5b82b740 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:22.200716 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e166810e-3bb7-4046-a6fc-593e5b82b740 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:22.215023 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e166810e-3bb7-4046-a6fc-593e5b82b740 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:22.215668 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e166810e-3bb7-4046-a6fc-593e5b82b740 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:22.216705 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e166810e-3bb7-4046-a6fc-593e5b82b740 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:22.217244 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e166810e-3bb7-4046-a6fc-593e5b82b740 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:22.525289 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b8fbad45-75a2-4c5a-99ac-4d94cdb282f0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:29:22.525849 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b8fbad45-75a2-4c5a-99ac-4d94cdb282f0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:29:22.526417 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b8fbad45-75a2-4c5a-99ac-4d94cdb282f0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:29:22.526930 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b8fbad45-75a2-4c5a-99ac-4d94cdb282f0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:29:22.527685 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b8fbad45-75a2-4c5a-99ac-4d94cdb282f0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:29:22.565345 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b8fbad45-75a2-4c5a-99ac-4d94cdb282f0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:22.572159 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b8fbad45-75a2-4c5a-99ac-4d94cdb282f0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:22.573863 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b8fbad45-75a2-4c5a-99ac-4d94cdb282f0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:22.574526 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b8fbad45-75a2-4c5a-99ac-4d94cdb282f0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:22.617806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-b8fbad45-75a2-4c5a-99ac-4d94cdb282f0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:22.626750 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-b8fbad45-75a2-4c5a-99ac-4d94cdb282f0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for user 159706f59a12427f9a3c03fa31f712f3 and project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:22.654801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b8fbad45-75a2-4c5a-99ac-4d94cdb282f0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:29:22.657269 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e166810e-3bb7-4046-a6fc-593e5b82b740 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:22.658312 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b8fbad45-75a2-4c5a-99ac-4d94cdb282f0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:29:22.666824 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e166810e-3bb7-4046-a6fc-593e5b82b740 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1490 microversion: 2.1 time: 0.480526 Jul 31 01:29:22.667788 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2076/4169] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:22 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1490 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:22.672734 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-106a4340-17f8-4beb-877f-b63e1e652590 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:22.673627 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-106a4340-17f8-4beb-877f-b63e1e652590 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:22.691237 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-106a4340-17f8-4beb-877f-b63e1e652590 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:22.692115 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-106a4340-17f8-4beb-877f-b63e1e652590 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:22.693107 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-106a4340-17f8-4beb-877f-b63e1e652590 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:22.693782 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-106a4340-17f8-4beb-877f-b63e1e652590 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:22.775928 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b8fbad45-75a2-4c5a-99ac-4d94cdb282f0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.089666 Jul 31 01:29:22.777320 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2094/4170] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:29:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:29:22.782810 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-09e78c24-a2ac-428d-a44f-a26d8093289a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:22.783843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-09e78c24-a2ac-428d-a44f-a26d8093289a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:22.795587 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09e78c24-a2ac-428d-a44f-a26d8093289a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:22.796227 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09e78c24-a2ac-428d-a44f-a26d8093289a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:22.802179 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-106a4340-17f8-4beb-877f-b63e1e652590 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:22.802562 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09e78c24-a2ac-428d-a44f-a26d8093289a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:22.803238 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09e78c24-a2ac-428d-a44f-a26d8093289a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:22.826003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-106a4340-17f8-4beb-877f-b63e1e652590 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:22.828910 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-106a4340-17f8-4beb-877f-b63e1e652590 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:22.832399 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-106a4340-17f8-4beb-877f-b63e1e652590 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.163257 Jul 31 01:29:22.833633 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2077/4171] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:22 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:22.839657 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e357bd38-8fc6-432b-9281-2fd68948855a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:22.840569 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e357bd38-8fc6-432b-9281-2fd68948855a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:22.851682 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:22.856443 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-09e78c24-a2ac-428d-a44f-a26d8093289a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Cannot 'pause' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state paused Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-09e78c24-a2ac-428d-a44f-a26d8093289a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action HTTP/1.1 Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 13 Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: {"pause": {}} Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: exception: Cannot 'pause' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state paused Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '76757e35-eebd-46de-a012-82bd864fd1d2', 'body': {'pause': {}}} Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 76757e35-eebd-46de-a012-82bd864fd1d2 in vm_state paused. Cannot pause while the instance is in this state. Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state paused Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:22.868338 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:22.872958 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:22.872958 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:22.872958 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:22.872958 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state paused Jul 31 01:29:22.872958 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:22.875207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-09e78c24-a2ac-428d-a44f-a26d8093289a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 409 to user: Cannot 'pause' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state paused {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:22.876359 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-09e78c24-a2ac-428d-a44f-a26d8093289a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action" status: 409 len: 143 microversion: 2.1 time: 0.097394 Jul 31 01:29:22.877133 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2095/4172] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:29:22 2022] POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action => generated 143 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:29:22.898060 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-18348ae0-197c-45fc-adff-069201361692 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:22.899549 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-18348ae0-197c-45fc-adff-069201361692 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:22.913208 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18348ae0-197c-45fc-adff-069201361692 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:22.913989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18348ae0-197c-45fc-adff-069201361692 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:22.916326 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18348ae0-197c-45fc-adff-069201361692 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:22.917295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18348ae0-197c-45fc-adff-069201361692 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:22.950133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e357bd38-8fc6-432b-9281-2fd68948855a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:22.958626 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e357bd38-8fc6-432b-9281-2fd68948855a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 200 len: 1192 microversion: 2.1 time: 0.122319 Jul 31 01:29:22.960273 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2078/4173] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:22 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 1192 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:23.048283 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-18348ae0-197c-45fc-adff-069201361692 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action" status: 202 len: 0 microversion: 2.1 time: 0.165676 Jul 31 01:29:23.049047 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2096/4174] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:29:22 2022] POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:29:23.057416 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7aeb0b8c-58b8-4ced-bdbb-69f0c4246c12 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:23.057945 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7aeb0b8c-58b8-4ced-bdbb-69f0c4246c12 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:23.069713 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7aeb0b8c-58b8-4ced-bdbb-69f0c4246c12 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:23.071483 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7aeb0b8c-58b8-4ced-bdbb-69f0c4246c12 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:23.073358 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7aeb0b8c-58b8-4ced-bdbb-69f0c4246c12 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:23.075957 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7aeb0b8c-58b8-4ced-bdbb-69f0c4246c12 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:23.213886 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ae1af591-ed13-42a7-975e-c2eab374ac40 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:23.214931 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ae1af591-ed13-42a7-975e-c2eab374ac40 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:23.230975 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae1af591-ed13-42a7-975e-c2eab374ac40 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:23.231828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae1af591-ed13-42a7-975e-c2eab374ac40 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:23.232846 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae1af591-ed13-42a7-975e-c2eab374ac40 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:23.233462 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae1af591-ed13-42a7-975e-c2eab374ac40 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:23.273868 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7aeb0b8c-58b8-4ced-bdbb-69f0c4246c12 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:23.286955 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7aeb0b8c-58b8-4ced-bdbb-69f0c4246c12 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1497 microversion: 2.1 time: 0.233397 Jul 31 01:29:23.295708 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2079/4175] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:23 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1497 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:23.504887 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ae1af591-ed13-42a7-975e-c2eab374ac40 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:23.513288 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ae1af591-ed13-42a7-975e-c2eab374ac40 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 200 len: 1313 microversion: 2.1 time: 0.311062 Jul 31 01:29:23.516101 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2097/4176] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:23 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:23.861857 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-130f4f7a-16e5-48b8-8ee4-fea47be3f0e9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:23.863434 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-130f4f7a-16e5-48b8-8ee4-fea47be3f0e9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:23.878379 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-130f4f7a-16e5-48b8-8ee4-fea47be3f0e9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:23.880415 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-130f4f7a-16e5-48b8-8ee4-fea47be3f0e9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:23.883306 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-130f4f7a-16e5-48b8-8ee4-fea47be3f0e9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:23.884586 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-130f4f7a-16e5-48b8-8ee4-fea47be3f0e9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:23.984490 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-380acbdf-afdc-43f3-b22c-7d0c3598ae1b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:23.985301 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-380acbdf-afdc-43f3-b22c-7d0c3598ae1b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:24.001281 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-380acbdf-afdc-43f3-b22c-7d0c3598ae1b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:24.002463 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-380acbdf-afdc-43f3-b22c-7d0c3598ae1b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:24.004780 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-380acbdf-afdc-43f3-b22c-7d0c3598ae1b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:24.008150 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-380acbdf-afdc-43f3-b22c-7d0c3598ae1b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:24.071732 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-130f4f7a-16e5-48b8-8ee4-fea47be3f0e9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:24.082307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-130f4f7a-16e5-48b8-8ee4-fea47be3f0e9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:24.084221 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-130f4f7a-16e5-48b8-8ee4-fea47be3f0e9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:24.086070 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-130f4f7a-16e5-48b8-8ee4-fea47be3f0e9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.229190 Jul 31 01:29:24.087870 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2080/4177] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:23 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:24.155206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-380acbdf-afdc-43f3-b22c-7d0c3598ae1b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:24.166385 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-380acbdf-afdc-43f3-b22c-7d0c3598ae1b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 200 len: 1244 microversion: 2.1 time: 0.187565 Jul 31 01:29:24.167881 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2098/4178] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:23 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 1244 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:24.320779 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2cfd7a8d-c596-4e6a-8fe2-85c8d03bfb2b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:24.321627 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2cfd7a8d-c596-4e6a-8fe2-85c8d03bfb2b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:24.337589 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cfd7a8d-c596-4e6a-8fe2-85c8d03bfb2b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:24.339895 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cfd7a8d-c596-4e6a-8fe2-85c8d03bfb2b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:24.341810 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cfd7a8d-c596-4e6a-8fe2-85c8d03bfb2b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:24.343255 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cfd7a8d-c596-4e6a-8fe2-85c8d03bfb2b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:24.539541 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1f43b413-03a0-4471-848b-3b3f07423cef tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:24.553043 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1f43b413-03a0-4471-848b-3b3f07423cef tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:24.569340 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f43b413-03a0-4471-848b-3b3f07423cef tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:24.576223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f43b413-03a0-4471-848b-3b3f07423cef tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:24.579848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f43b413-03a0-4471-848b-3b3f07423cef tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:24.580649 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f43b413-03a0-4471-848b-3b3f07423cef tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:25.210782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1f43b413-03a0-4471-848b-3b3f07423cef tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:25.218407 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2cfd7a8d-c596-4e6a-8fe2-85c8d03bfb2b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:25.221901 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:25.227369 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2cfd7a8d-c596-4e6a-8fe2-85c8d03bfb2b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.911259 Jul 31 01:29:25.229080 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1f43b413-03a0-4471-848b-3b3f07423cef tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 200 len: 1313 microversion: 2.1 time: 0.698091 Jul 31 01:29:25.230395 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2099/4179] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:24 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 1313 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:25.238698 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-7172b452-cf11-45bc-9a2c-0f4cb57ddda2 req-0654da36-46df-45fe-8ecf-77463bd11fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e89e57-5784-40fe-a6a2-f299fb7e91fd", "name": "network-vif-plugged", "status": "completed", "tag": "32067df0-68ea-416d-a011-49c3d916cd31"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:25.249057 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2081/4180] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:24 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:25.253680 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ac8a927e-8fcb-4db8-b97c-0739b4dba266 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:25.254303 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ac8a927e-8fcb-4db8-b97c-0739b4dba266 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:25.258363 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7172b452-cf11-45bc-9a2c-0f4cb57ddda2 req-0654da36-46df-45fe-8ecf-77463bd11fd5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:25.259191 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7172b452-cf11-45bc-9a2c-0f4cb57ddda2 req-0654da36-46df-45fe-8ecf-77463bd11fd5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:25.261706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac8a927e-8fcb-4db8-b97c-0739b4dba266 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:25.262167 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac8a927e-8fcb-4db8-b97c-0739b4dba266 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:25.262958 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac8a927e-8fcb-4db8-b97c-0739b4dba266 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:25.263428 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac8a927e-8fcb-4db8-b97c-0739b4dba266 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:25.273829 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-7172b452-cf11-45bc-9a2c-0f4cb57ddda2 req-0654da36-46df-45fe-8ecf-77463bd11fd5 service nova] Creating event network-vif-plugged:32067df0-68ea-416d-a011-49c3d916cd31 for instance 41e89e57-5784-40fe-a6a2-f299fb7e91fd on n-h1-master-1 Jul 31 01:29:25.280312 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-7172b452-cf11-45bc-9a2c-0f4cb57ddda2 req-0654da36-46df-45fe-8ecf-77463bd11fd5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048067 Jul 31 01:29:25.281667 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2100/4181] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:29:25.289947 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cbc317e4-b75f-4422-a8dc-2761f59adf48 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:25.291076 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cbc317e4-b75f-4422-a8dc-2761f59adf48 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:25.301139 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cbc317e4-b75f-4422-a8dc-2761f59adf48 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:25.301952 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cbc317e4-b75f-4422-a8dc-2761f59adf48 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:25.304468 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cbc317e4-b75f-4422-a8dc-2761f59adf48 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:25.305350 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cbc317e4-b75f-4422-a8dc-2761f59adf48 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:25.406606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ac8a927e-8fcb-4db8-b97c-0739b4dba266 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:25.419550 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ac8a927e-8fcb-4db8-b97c-0739b4dba266 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:25.421066 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ac8a927e-8fcb-4db8-b97c-0739b4dba266 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:25.422318 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ac8a927e-8fcb-4db8-b97c-0739b4dba266 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.172503 Jul 31 01:29:25.423541 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2082/4182] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:25 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:25.430295 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a8c83985-f853-4afd-beff-681ea36f4dc7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:25.431457 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a8c83985-f853-4afd-beff-681ea36f4dc7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:25.451324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8c83985-f853-4afd-beff-681ea36f4dc7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:25.452611 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8c83985-f853-4afd-beff-681ea36f4dc7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:25.455081 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8c83985-f853-4afd-beff-681ea36f4dc7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:25.456297 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8c83985-f853-4afd-beff-681ea36f4dc7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:25.621511 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cbc317e4-b75f-4422-a8dc-2761f59adf48 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:25.629919 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cbc317e4-b75f-4422-a8dc-2761f59adf48 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 200 len: 1250 microversion: 2.1 time: 0.346647 Jul 31 01:29:25.634168 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2101/4183] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:25 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 1250 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:25.845899 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a8c83985-f853-4afd-beff-681ea36f4dc7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:25.855854 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a8c83985-f853-4afd-beff-681ea36f4dc7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.430654 Jul 31 01:29:25.856538 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2083/4184] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:25 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:25.884120 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3ad60522-edf9-47b4-9325-11960d75266c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:25.886623 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3ad60522-edf9-47b4-9325-11960d75266c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:25.903386 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ad60522-edf9-47b4-9325-11960d75266c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:25.903910 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ad60522-edf9-47b4-9325-11960d75266c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:25.904828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ad60522-edf9-47b4-9325-11960d75266c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:25.905477 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ad60522-edf9-47b4-9325-11960d75266c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:25.936156 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-3ad60522-edf9-47b4-9325-11960d75266c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3ad60522-edf9-47b4-9325-11960d75266c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856/action HTTP/1.1 Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 28 Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: {"reboot": {"type": "SOFT"}} Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '339c7371-6352-4eef-a902-b3f8c7f7c856', 'body': {'reboot': {'type': 'SOFT'}}} Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:25.937939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:25.942903 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:29:25.942903 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:25.942903 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:25.942903 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:25.942903 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:25.942903 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:25.942903 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:25.942903 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:25.942903 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:25.942903 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:29:25.942903 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:25.947220 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3ad60522-edf9-47b4-9325-11960d75266c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:25.948188 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3ad60522-edf9-47b4-9325-11960d75266c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856/action" status: 404 len: 111 microversion: 2.1 time: 0.075854 Jul 31 01:29:25.948839 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2102/4185] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:29:25 2022] POST /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:29:25.957385 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9cbd0062-98ba-49fe-86e4-ebbb4827f8bf tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:25.958482 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9cbd0062-98ba-49fe-86e4-ebbb4827f8bf tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:25.975069 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cbd0062-98ba-49fe-86e4-ebbb4827f8bf tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:25.975846 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cbd0062-98ba-49fe-86e4-ebbb4827f8bf tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:25.977083 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cbd0062-98ba-49fe-86e4-ebbb4827f8bf tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:25.977791 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9cbd0062-98ba-49fe-86e4-ebbb4827f8bf tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:26.204164 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9cbd0062-98ba-49fe-86e4-ebbb4827f8bf tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:26.215011 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9cbd0062-98ba-49fe-86e4-ebbb4827f8bf tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.261525 Jul 31 01:29:26.221133 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2084/4186] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:25 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:26.237120 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8039ced0-c722-4074-887f-d0fa8158e99e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:26.237906 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8039ced0-c722-4074-887f-d0fa8158e99e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:26.246464 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8039ced0-c722-4074-887f-d0fa8158e99e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:26.247163 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8039ced0-c722-4074-887f-d0fa8158e99e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:26.248515 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8039ced0-c722-4074-887f-d0fa8158e99e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:26.249177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8039ced0-c722-4074-887f-d0fa8158e99e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:26.257481 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-086442be-6e7c-4080-83f6-6f9aa6e83632 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:26.258118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-086442be-6e7c-4080-83f6-6f9aa6e83632 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:26.274118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-086442be-6e7c-4080-83f6-6f9aa6e83632 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:26.274592 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-086442be-6e7c-4080-83f6-6f9aa6e83632 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:26.275437 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-086442be-6e7c-4080-83f6-6f9aa6e83632 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:26.275890 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-086442be-6e7c-4080-83f6-6f9aa6e83632 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:26.545939 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8039ced0-c722-4074-887f-d0fa8158e99e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:26.578192 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8039ced0-c722-4074-887f-d0fa8158e99e tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.342480 Jul 31 01:29:26.581418 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2103/4187] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:26 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:26.591120 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b7785513-924f-41a5-a362-1e5fc69883a2 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:26.592286 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b7785513-924f-41a5-a362-1e5fc69883a2 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:26.614146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7785513-924f-41a5-a362-1e5fc69883a2 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:26.614979 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7785513-924f-41a5-a362-1e5fc69883a2 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:26.616671 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7785513-924f-41a5-a362-1e5fc69883a2 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:26.617416 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7785513-924f-41a5-a362-1e5fc69883a2 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:26.636797 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-086442be-6e7c-4080-83f6-6f9aa6e83632 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:26.651115 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-086442be-6e7c-4080-83f6-6f9aa6e83632 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 200 len: 1313 microversion: 2.1 time: 0.401120 Jul 31 01:29:26.665472 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2085/4188] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:26 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:26.676732 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d111cec6-d4d9-4c6d-90cc-8c927a41f5e6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:26.680207 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d111cec6-d4d9-4c6d-90cc-8c927a41f5e6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 7dce054a-845b-4c58-8208-cfc088cb58a0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:26.688088 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-d111cec6-d4d9-4c6d-90cc-8c927a41f5e6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 7dce054a-845b-4c58-8208-cfc088cb58a0 could not be found. Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d111cec6-d4d9-4c6d-90cc-8c927a41f5e6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/7dce054a-845b-4c58-8208-cfc088cb58a0/action HTTP/1.1 Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 28 Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: {"reboot": {"type": "SOFT"}} Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 7dce054a-845b-4c58-8208-cfc088cb58a0 could not be found. Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '7dce054a-845b-4c58-8208-cfc088cb58a0', 'body': {'reboot': {'type': 'SOFT'}}} Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dce054a-845b-4c58-8208-cfc088cb58a0 could not be found. Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dce054a-845b-4c58-8208-cfc088cb58a0 could not be found. Jul 31 01:29:26.690122 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:26.696060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:26.696060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:26.696060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:26.696060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:26.696060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:26.696060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:26.696060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:26.696060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dce054a-845b-4c58-8208-cfc088cb58a0 could not be found. Jul 31 01:29:26.696060 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:26.696060 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d111cec6-d4d9-4c6d-90cc-8c927a41f5e6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 7dce054a-845b-4c58-8208-cfc088cb58a0 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:26.696060 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d111cec6-d4d9-4c6d-90cc-8c927a41f5e6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/7dce054a-845b-4c58-8208-cfc088cb58a0/action" status: 404 len: 111 microversion: 2.1 time: 0.021137 Jul 31 01:29:26.696060 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2086/4189] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:29:26 2022] POST /compute/v2.1/servers/7dce054a-845b-4c58-8208-cfc088cb58a0/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:29:26.700112 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-248570a2-f85b-4ead-9b2b-3635e3cbd0c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:26.700740 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-248570a2-f85b-4ead-9b2b-3635e3cbd0c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:26.708988 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-248570a2-f85b-4ead-9b2b-3635e3cbd0c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:26.709750 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-248570a2-f85b-4ead-9b2b-3635e3cbd0c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:26.710866 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-248570a2-f85b-4ead-9b2b-3635e3cbd0c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:26.711664 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-248570a2-f85b-4ead-9b2b-3635e3cbd0c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:26.738160 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b7785513-924f-41a5-a362-1e5fc69883a2 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:26.751274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b7785513-924f-41a5-a362-1e5fc69883a2 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:26.757666 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b7785513-924f-41a5-a362-1e5fc69883a2 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:26.760900 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b7785513-924f-41a5-a362-1e5fc69883a2 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.175582 Jul 31 01:29:26.764403 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2104/4190] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:26 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:26.777374 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3505c8a0-e719-4e4c-9dd5-40673782da02 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:26.779983 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3505c8a0-e719-4e4c-9dd5-40673782da02 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:26.796413 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3505c8a0-e719-4e4c-9dd5-40673782da02 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:26.800666 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3505c8a0-e719-4e4c-9dd5-40673782da02 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:26.801532 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3505c8a0-e719-4e4c-9dd5-40673782da02 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:26.802576 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3505c8a0-e719-4e4c-9dd5-40673782da02 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:26.860102 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-248570a2-f85b-4ead-9b2b-3635e3cbd0c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:26.868712 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-248570a2-f85b-4ead-9b2b-3635e3cbd0c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 200 len: 1250 microversion: 2.1 time: 0.172816 Jul 31 01:29:26.869852 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2087/4191] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:26 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 1250 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:26.996858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3505c8a0-e719-4e4c-9dd5-40673782da02 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:27.005477 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3505c8a0-e719-4e4c-9dd5-40673782da02 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.239602 Jul 31 01:29:27.006302 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2105/4192] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:26 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:27.029044 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9717b6e7-2ffa-4b72-96b3-edb6420d7525 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:27.030082 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9717b6e7-2ffa-4b72-96b3-edb6420d7525 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:27.041081 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9717b6e7-2ffa-4b72-96b3-edb6420d7525 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:27.041526 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9717b6e7-2ffa-4b72-96b3-edb6420d7525 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:27.042324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9717b6e7-2ffa-4b72-96b3-edb6420d7525 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:27.043167 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9717b6e7-2ffa-4b72-96b3-edb6420d7525 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:27.258275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9717b6e7-2ffa-4b72-96b3-edb6420d7525 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:27.268307 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9717b6e7-2ffa-4b72-96b3-edb6420d7525 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.243230 Jul 31 01:29:27.275626 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2088/4193] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:27 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:27.301488 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3d25c6a6-cb6f-45e0-b5f7-cd74e5369cb0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0f306572-729b-4b95-a357-79461887e541"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:27.304973 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3d25c6a6-cb6f-45e0-b5f7-cd74e5369cb0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:27.324904 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d25c6a6-cb6f-45e0-b5f7-cd74e5369cb0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:27.325402 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d25c6a6-cb6f-45e0-b5f7-cd74e5369cb0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:27.329909 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d25c6a6-cb6f-45e0-b5f7-cd74e5369cb0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:27.330378 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d25c6a6-cb6f-45e0-b5f7-cd74e5369cb0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:27.363374 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-3d25c6a6-cb6f-45e0-b5f7-cd74e5369cb0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3d25c6a6-cb6f-45e0-b5f7-cd74e5369cb0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856/action HTTP/1.1 Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 65 Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: {"rebuild": {"imageRef": "0f306572-729b-4b95-a357-79461887e541"}} Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '339c7371-6352-4eef-a902-b3f8c7f7c856', 'body': {'rebuild': {'imageRef': '0f306572-729b-4b95-a357-79461887e541'}}} Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 31 01:29:27.369772 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3d25c6a6-cb6f-45e0-b5f7-cd74e5369cb0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:27.373700 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3d25c6a6-cb6f-45e0-b5f7-cd74e5369cb0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856/action" status: 404 len: 111 microversion: 2.1 time: 0.076030 Jul 31 01:29:27.379988 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2106/4194] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:29:27 2022] POST /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856/action => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:29:27.388385 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-840a00c8-0ab8-459b-88f4-3d823de2c247 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:27.389010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-840a00c8-0ab8-459b-88f4-3d823de2c247 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:27.401581 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-840a00c8-0ab8-459b-88f4-3d823de2c247 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:27.402140 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-840a00c8-0ab8-459b-88f4-3d823de2c247 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:27.403040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-840a00c8-0ab8-459b-88f4-3d823de2c247 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:27.407014 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-840a00c8-0ab8-459b-88f4-3d823de2c247 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:27.677696 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-39f3efb6-4d51-4137-bc2b-2170ae851c45 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:27.679026 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-39f3efb6-4d51-4137-bc2b-2170ae851c45 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:27.711234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-39f3efb6-4d51-4137-bc2b-2170ae851c45 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:27.711914 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-39f3efb6-4d51-4137-bc2b-2170ae851c45 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:27.712811 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-39f3efb6-4d51-4137-bc2b-2170ae851c45 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:27.713325 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-39f3efb6-4d51-4137-bc2b-2170ae851c45 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:27.754363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-840a00c8-0ab8-459b-88f4-3d823de2c247 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:27.766755 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-840a00c8-0ab8-459b-88f4-3d823de2c247 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.381798 Jul 31 01:29:27.786115 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2089/4195] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:27 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:27.799472 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c0e18449-9615-40fb-9794-6b7b543157c0 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:27.801653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c0e18449-9615-40fb-9794-6b7b543157c0 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:27.813956 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0e18449-9615-40fb-9794-6b7b543157c0 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:27.815019 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0e18449-9615-40fb-9794-6b7b543157c0 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:27.816864 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0e18449-9615-40fb-9794-6b7b543157c0 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:27.817655 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0e18449-9615-40fb-9794-6b7b543157c0 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:28.073184 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c0e18449-9615-40fb-9794-6b7b543157c0 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:28.103721 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c0e18449-9615-40fb-9794-6b7b543157c0 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:28.110227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c0e18449-9615-40fb-9794-6b7b543157c0 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:28.112133 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c0e18449-9615-40fb-9794-6b7b543157c0 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.322082 Jul 31 01:29:28.113326 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2090/4196] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:27 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:28.120053 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9c9e4157-8d01-40c4-b627-fa6a33041206 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:28.120829 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9c9e4157-8d01-40c4-b627-fa6a33041206 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:28.139700 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9c9e4157-8d01-40c4-b627-fa6a33041206 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:28.141448 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9c9e4157-8d01-40c4-b627-fa6a33041206 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:28.143125 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9c9e4157-8d01-40c4-b627-fa6a33041206 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:28.144016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9c9e4157-8d01-40c4-b627-fa6a33041206 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:28.324214 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-39f3efb6-4d51-4137-bc2b-2170ae851c45 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:28.333138 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-39f3efb6-4d51-4137-bc2b-2170ae851c45 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 200 len: 1496 microversion: 2.1 time: 0.659920 Jul 31 01:29:28.333883 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2107/4197] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:27 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 1496 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:28.348049 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-654d1e0b-68a8-4c46-982f-ca14de4b719d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:28.349150 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-654d1e0b-68a8-4c46-982f-ca14de4b719d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:28.358931 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-654d1e0b-68a8-4c46-982f-ca14de4b719d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:28.360019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-654d1e0b-68a8-4c46-982f-ca14de4b719d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:28.360923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-654d1e0b-68a8-4c46-982f-ca14de4b719d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:28.361462 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-654d1e0b-68a8-4c46-982f-ca14de4b719d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:28.578589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9c9e4157-8d01-40c4-b627-fa6a33041206 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:28.597739 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9c9e4157-8d01-40c4-b627-fa6a33041206 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.483240 Jul 31 01:29:28.598569 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2091/4198] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:28 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:28.633377 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b7da1a33-c556-4fe3-bcfb-52d990cc187c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0f306572-729b-4b95-a357-79461887e541"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:28.636497 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b7da1a33-c556-4fe3-bcfb-52d990cc187c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 4327c508-60bd-4858-abd0-2358f1b8dc58] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:28.648829 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-b7da1a33-c556-4fe3-bcfb-52d990cc187c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 4327c508-60bd-4858-abd0-2358f1b8dc58 could not be found. Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b7da1a33-c556-4fe3-bcfb-52d990cc187c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/4327c508-60bd-4858-abd0-2358f1b8dc58/action HTTP/1.1 Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 65 Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: {"rebuild": {"imageRef": "0f306572-729b-4b95-a357-79461887e541"}} Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 4327c508-60bd-4858-abd0-2358f1b8dc58 could not be found. Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '4327c508-60bd-4858-abd0-2358f1b8dc58', 'body': {'rebuild': {'imageRef': '0f306572-729b-4b95-a357-79461887e541'}}} Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4327c508-60bd-4858-abd0-2358f1b8dc58 could not be found. Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 31 01:29:28.651974 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:29:28.655907 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:29:28.655907 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:28.655907 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:28.655907 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4327c508-60bd-4858-abd0-2358f1b8dc58 could not be found. Jul 31 01:29:28.655907 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:28.655907 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:28.655907 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:28.655907 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:28.655907 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:28.655907 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:28.655907 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:28.655907 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:28.655907 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4327c508-60bd-4858-abd0-2358f1b8dc58 could not be found. Jul 31 01:29:28.655907 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:28.658797 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b7da1a33-c556-4fe3-bcfb-52d990cc187c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 4327c508-60bd-4858-abd0-2358f1b8dc58 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:28.659936 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b7da1a33-c556-4fe3-bcfb-52d990cc187c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/4327c508-60bd-4858-abd0-2358f1b8dc58/action" status: 404 len: 111 microversion: 2.1 time: 0.031898 Jul 31 01:29:28.665418 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2092/4199] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:29:28 2022] POST /compute/v2.1/servers/4327c508-60bd-4858-abd0-2358f1b8dc58/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:29:28.672329 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ecf3ae0b-ff5e-4d03-afba-b77131426252 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:28.673667 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ecf3ae0b-ff5e-4d03-afba-b77131426252 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:28.683143 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecf3ae0b-ff5e-4d03-afba-b77131426252 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:28.684370 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecf3ae0b-ff5e-4d03-afba-b77131426252 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:28.685357 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecf3ae0b-ff5e-4d03-afba-b77131426252 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:28.686497 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecf3ae0b-ff5e-4d03-afba-b77131426252 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:28.727105 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-654d1e0b-68a8-4c46-982f-ca14de4b719d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:28.743052 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-654d1e0b-68a8-4c46-982f-ca14de4b719d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 200 len: 1292 microversion: 2.1 time: 0.407620 Jul 31 01:29:28.751772 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2108/4200] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:28 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 1292 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:29.074181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8001d1f2-56c4-4374-90e0-6939d0ae99f1 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:29.074710 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8001d1f2-56c4-4374-90e0-6939d0ae99f1 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:29.077954 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:29.086924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8001d1f2-56c4-4374-90e0-6939d0ae99f1 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:29.087428 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8001d1f2-56c4-4374-90e0-6939d0ae99f1 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:29.095078 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8001d1f2-56c4-4374-90e0-6939d0ae99f1 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:29.095602 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8001d1f2-56c4-4374-90e0-6939d0ae99f1 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:29.151553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8001d1f2-56c4-4374-90e0-6939d0ae99f1 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:29:29.154618 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:29.224275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ecf3ae0b-ff5e-4d03-afba-b77131426252 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:29.259422 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ecf3ae0b-ff5e-4d03-afba-b77131426252 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.589091 Jul 31 01:29:29.260818 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2093/4201] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:28 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:29.289625 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-210b0907-20ab-401c-836a-8ab9bad41002 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:29.295692 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-210b0907-20ab-401c-836a-8ab9bad41002 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:29.311404 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-210b0907-20ab-401c-836a-8ab9bad41002 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:29.312073 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-210b0907-20ab-401c-836a-8ab9bad41002 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:29.313035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-210b0907-20ab-401c-836a-8ab9bad41002 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:29.313625 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-210b0907-20ab-401c-836a-8ab9bad41002 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:29.338740 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8001d1f2-56c4-4374-90e0-6939d0ae99f1 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "DELETE /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 204 len: 0 microversion: 2.1 time: 0.268684 Jul 31 01:29:29.339426 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2109/4202] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:29:29 2022] DELETE /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:29:29.347980 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e5bc12b6-bf03-4e84-a553-3642291fecde tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:29.348710 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e5bc12b6-bf03-4e84-a553-3642291fecde tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:29.375014 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e5bc12b6-bf03-4e84-a553-3642291fecde tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:29.375813 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e5bc12b6-bf03-4e84-a553-3642291fecde tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:29.377165 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e5bc12b6-bf03-4e84-a553-3642291fecde tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:29.377628 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e5bc12b6-bf03-4e84-a553-3642291fecde tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:29.580415 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-210b0907-20ab-401c-836a-8ab9bad41002 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:29.605433 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-210b0907-20ab-401c-836a-8ab9bad41002 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:29.607202 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-210b0907-20ab-401c-836a-8ab9bad41002 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:29.609477 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-210b0907-20ab-401c-836a-8ab9bad41002 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.346536 Jul 31 01:29:29.610909 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2094/4203] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:29 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:29.626837 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-df9882a9-52f0-4a16-9c12-c4c786b09519 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:29.627689 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-df9882a9-52f0-4a16-9c12-c4c786b09519 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:29.637933 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df9882a9-52f0-4a16-9c12-c4c786b09519 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:29.638400 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df9882a9-52f0-4a16-9c12-c4c786b09519 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:29.639197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df9882a9-52f0-4a16-9c12-c4c786b09519 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:29.639679 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df9882a9-52f0-4a16-9c12-c4c786b09519 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:29.980667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e5bc12b6-bf03-4e84-a553-3642291fecde tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:29.998892 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e5bc12b6-bf03-4e84-a553-3642291fecde tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.654932 Jul 31 01:29:30.000207 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2110/4204] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:29 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:30.006716 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0145f7d2-51b2-4df6-bb8c-b701211f70cf tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:30.007577 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0145f7d2-51b2-4df6-bb8c-b701211f70cf tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:30.029874 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0145f7d2-51b2-4df6-bb8c-b701211f70cf tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:30.030840 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0145f7d2-51b2-4df6-bb8c-b701211f70cf tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:30.034911 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0145f7d2-51b2-4df6-bb8c-b701211f70cf tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:30.035621 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0145f7d2-51b2-4df6-bb8c-b701211f70cf tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:30.162344 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-df9882a9-52f0-4a16-9c12-c4c786b09519 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:30.181658 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-df9882a9-52f0-4a16-9c12-c4c786b09519 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 200 len: 1502 microversion: 2.1 time: 0.569421 Jul 31 01:29:30.195372 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2095/4205] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:29 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 1502 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:30.195372 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-443498af-e7f6-4097-af00-6ad670ce6f4d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:30.195372 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-443498af-e7f6-4097-af00-6ad670ce6f4d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 8fece445-cda6-4d0f-b82e-67281563fb6b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:30.212261 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-443498af-e7f6-4097-af00-6ad670ce6f4d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 8fece445-cda6-4d0f-b82e-67281563fb6b could not be found. Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-443498af-e7f6-4097-af00-6ad670ce6f4d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/8fece445-cda6-4d0f-b82e-67281563fb6b/action HTTP/1.1 Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 15 Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: {"restore": {}} Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 8fece445-cda6-4d0f-b82e-67281563fb6b could not be found. Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '8fece445-cda6-4d0f-b82e-67281563fb6b', 'body': {'restore': {}}} Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fece445-cda6-4d0f-b82e-67281563fb6b could not be found. Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fece445-cda6-4d0f-b82e-67281563fb6b could not be found. Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:30.215039 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:30.224305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:30.224305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:30.224305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fece445-cda6-4d0f-b82e-67281563fb6b could not be found. Jul 31 01:29:30.224305 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:30.224305 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-443498af-e7f6-4097-af00-6ad670ce6f4d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 8fece445-cda6-4d0f-b82e-67281563fb6b could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:30.224305 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-443498af-e7f6-4097-af00-6ad670ce6f4d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/8fece445-cda6-4d0f-b82e-67281563fb6b/action" status: 404 len: 111 microversion: 2.1 time: 0.033179 Jul 31 01:29:30.224305 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2096/4206] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:29:30 2022] POST /compute/v2.1/servers/8fece445-cda6-4d0f-b82e-67281563fb6b/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:29:30.473216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c1df54e2-d575-41a5-920f-2036a434d449 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Action: 'create', calling method: .version_select at 0x7fede55a69d0>, body: {"keypair": {"name": "tempest-keypair-583265666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObIlxMcMXxWEvGFPZKf7h7FCd0AenRsB9LLNIcCt9gC4jQprxyPi3hQPwbAPlGje1ZKL3xNrL1VKb67eS/4gR2gp2Ke8mdA/dRyIJQtMBlfn3G0VmebutvssSE1cTCdOw=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:30.496303 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-c1df54e2-d575-41a5-920f-2036a434d449 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Getting quotas for project c926541f0e1c4cd6b64d09f2a89b4729. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:30.503046 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-c1df54e2-d575-41a5-920f-2036a434d449 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Getting quotas for user b299fe87d4ec478092658a35f882ffa2 and project c926541f0e1c4cd6b64d09f2a89b4729. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:30.534977 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c1df54e2-d575-41a5-920f-2036a434d449 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.315486 Jul 31 01:29:30.535839 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2097/4207] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:29:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:29:30.542102 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0abece61-2915-43a1-acbd-b36c5fc36f2b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:30.542766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0abece61-2915-43a1-acbd-b36c5fc36f2b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:30.549891 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0abece61-2915-43a1-acbd-b36c5fc36f2b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:30.550570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0abece61-2915-43a1-acbd-b36c5fc36f2b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:30.551587 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0abece61-2915-43a1-acbd-b36c5fc36f2b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:30.552088 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0abece61-2915-43a1-acbd-b36c5fc36f2b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:30.620967 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0145f7d2-51b2-4df6-bb8c-b701211f70cf tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:30.635331 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0145f7d2-51b2-4df6-bb8c-b701211f70cf tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 200 len: 1292 microversion: 2.1 time: 0.632064 Jul 31 01:29:30.636474 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2111/4208] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:30 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 1292 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:30.648524 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-78fb7e79-316c-4370-95a1-a5370b70d19f tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:30.652741 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-78fb7e79-316c-4370-95a1-a5370b70d19f tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:30.683572 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-78fb7e79-316c-4370-95a1-a5370b70d19f tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:30.684479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-78fb7e79-316c-4370-95a1-a5370b70d19f tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:30.690747 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-78fb7e79-316c-4370-95a1-a5370b70d19f tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:30.691205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-78fb7e79-316c-4370-95a1-a5370b70d19f tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:31.103278 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-78fb7e79-316c-4370-95a1-a5370b70d19f tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:31.112010 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-78fb7e79-316c-4370-95a1-a5370b70d19f tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:31.113547 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-78fb7e79-316c-4370-95a1-a5370b70d19f tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:31.114790 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-78fb7e79-316c-4370-95a1-a5370b70d19f tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.475435 Jul 31 01:29:31.124069 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2112/4209] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:30 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:31.206946 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f9ae475f-fcd2-4016-b586-2bf1542bd0b6 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:31.207753 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f9ae475f-fcd2-4016-b586-2bf1542bd0b6 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:31.221648 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9ae475f-fcd2-4016-b586-2bf1542bd0b6 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:31.222321 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9ae475f-fcd2-4016-b586-2bf1542bd0b6 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:31.224223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9ae475f-fcd2-4016-b586-2bf1542bd0b6 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:31.226109 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9ae475f-fcd2-4016-b586-2bf1542bd0b6 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:31.382872 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0abece61-2915-43a1-acbd-b36c5fc36f2b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:31.392206 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0abece61-2915-43a1-acbd-b36c5fc36f2b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.855219 Jul 31 01:29:31.409518 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2098/4210] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:30 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:31.415429 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-de271376-2f51-4328-8050-63cc268d38a1 req-e9ce47e2-554e-47e0-85e6-bd54108d07c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8", "tag": "abd05ec8-47bf-48ba-9712-efb525258b6a"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:31.429632 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-de271376-2f51-4328-8050-63cc268d38a1 req-e9ce47e2-554e-47e0-85e6-bd54108d07c4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:31.431187 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-de271376-2f51-4328-8050-63cc268d38a1 req-e9ce47e2-554e-47e0-85e6-bd54108d07c4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:31.449151 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-de271376-2f51-4328-8050-63cc268d38a1 req-e9ce47e2-554e-47e0-85e6-bd54108d07c4 service nova] Creating event network-changed:abd05ec8-47bf-48ba-9712-efb525258b6a for instance ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 on n-h2-master-1 Jul 31 01:29:31.463166 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-de271376-2f51-4328-8050-63cc268d38a1 req-e9ce47e2-554e-47e0-85e6-bd54108d07c4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051817 Jul 31 01:29:31.464071 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2099/4211] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:29:31.480293 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a05ef6ab-2e31-46d7-9f29-33826e68dd84 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:31.481372 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a05ef6ab-2e31-46d7-9f29-33826e68dd84 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:31.489641 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a05ef6ab-2e31-46d7-9f29-33826e68dd84 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:31.495773 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a05ef6ab-2e31-46d7-9f29-33826e68dd84 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:31.497323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a05ef6ab-2e31-46d7-9f29-33826e68dd84 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:31.497890 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a05ef6ab-2e31-46d7-9f29-33826e68dd84 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:32.025770 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f9ae475f-fcd2-4016-b586-2bf1542bd0b6 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:32.057521 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f9ae475f-fcd2-4016-b586-2bf1542bd0b6 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 200 len: 1502 microversion: 2.1 time: 0.855131 Jul 31 01:29:32.059454 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2113/4212] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:31 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 1502 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:32.080473 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0d625e59-059f-4e32-b410-01dbc81e4cc2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:32.083868 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0d625e59-059f-4e32-b410-01dbc81e4cc2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:32.095789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d625e59-059f-4e32-b410-01dbc81e4cc2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:32.096795 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d625e59-059f-4e32-b410-01dbc81e4cc2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:32.098535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d625e59-059f-4e32-b410-01dbc81e4cc2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:32.100591 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d625e59-059f-4e32-b410-01dbc81e4cc2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:32.591272 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:32.636230 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:32.688933 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a05ef6ab-2e31-46d7-9f29-33826e68dd84 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:32.699745 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a05ef6ab-2e31-46d7-9f29-33826e68dd84 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 1.233764 Jul 31 01:29:32.716899 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2100/4213] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:31 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:32.728796 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0711ea62-214c-4d9a-8d12-fe698f0cfae7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:32.730940 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0711ea62-214c-4d9a-8d12-fe698f0cfae7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:32.745460 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0711ea62-214c-4d9a-8d12-fe698f0cfae7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:32.746112 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0711ea62-214c-4d9a-8d12-fe698f0cfae7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:32.747203 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0711ea62-214c-4d9a-8d12-fe698f0cfae7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:32.747935 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0711ea62-214c-4d9a-8d12-fe698f0cfae7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:32.963524 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0711ea62-214c-4d9a-8d12-fe698f0cfae7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:32.973841 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0711ea62-214c-4d9a-8d12-fe698f0cfae7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:32.977026 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0711ea62-214c-4d9a-8d12-fe698f0cfae7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:32.978957 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0711ea62-214c-4d9a-8d12-fe698f0cfae7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.260346 Jul 31 01:29:32.998843 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2101/4214] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:32 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:33.007672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-28859556-6222-4b55-9c9f-9ec02bd5f93c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:33.009599 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-28859556-6222-4b55-9c9f-9ec02bd5f93c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:33.019007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28859556-6222-4b55-9c9f-9ec02bd5f93c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:33.019731 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28859556-6222-4b55-9c9f-9ec02bd5f93c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:33.020932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28859556-6222-4b55-9c9f-9ec02bd5f93c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:33.021644 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28859556-6222-4b55-9c9f-9ec02bd5f93c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:33.052417 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-28859556-6222-4b55-9c9f-9ec02bd5f93c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Cannot 'restore' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-28859556-6222-4b55-9c9f-9ec02bd5f93c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action HTTP/1.1 Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 15 Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: {"restore": {}} Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: exception: Cannot 'restore' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '76757e35-eebd-46de-a012-82bd864fd1d2', 'body': {'restore': {}}} Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 76757e35-eebd-46de-a012-82bd864fd1d2 in vm_state active. Cannot restore while the instance is in this state. Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:33.054737 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:33.059666 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:33.059666 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:33.059666 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:33.059666 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active Jul 31 01:29:33.059666 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:33.059666 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-28859556-6222-4b55-9c9f-9ec02bd5f93c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 409 to user: Cannot 'restore' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:33.059666 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-28859556-6222-4b55-9c9f-9ec02bd5f93c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action" status: 409 len: 145 microversion: 2.1 time: 0.055819 Jul 31 01:29:33.059666 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2102/4215] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:29:32 2022] POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action => generated 145 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:29:33.082121 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9eb39b69-365f-4d00-8232-6b2d28ca2ce1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:33.084941 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9eb39b69-365f-4d00-8232-6b2d28ca2ce1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:33.097536 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9eb39b69-365f-4d00-8232-6b2d28ca2ce1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:33.100093 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9eb39b69-365f-4d00-8232-6b2d28ca2ce1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:33.103889 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9eb39b69-365f-4d00-8232-6b2d28ca2ce1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:33.104632 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9eb39b69-365f-4d00-8232-6b2d28ca2ce1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:33.152662 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:33.206916 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0d625e59-059f-4e32-b410-01dbc81e4cc2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:33.217733 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0d625e59-059f-4e32-b410-01dbc81e4cc2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 200 len: 1292 microversion: 2.1 time: 1.156897 Jul 31 01:29:33.218951 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2114/4216] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:32 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 1292 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:33.235568 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-47ad9596-86fd-4ced-a624-4100891657e0 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:33.236494 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-47ad9596-86fd-4ced-a624-4100891657e0 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:33.246531 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47ad9596-86fd-4ced-a624-4100891657e0 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:33.247000 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47ad9596-86fd-4ced-a624-4100891657e0 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:33.247835 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47ad9596-86fd-4ced-a624-4100891657e0 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:33.248526 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47ad9596-86fd-4ced-a624-4100891657e0 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:33.394778 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-47ad9596-86fd-4ced-a624-4100891657e0 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86f46d7be9f45d0aa7ee53ac4b95371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2e6318c9a2499c8a5857683762bf52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:33.404906 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-47ad9596-86fd-4ced-a624-4100891657e0 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 200 len: 1460 microversion: 2.1 time: 0.184481 Jul 31 01:29:33.405686 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2115/4217] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:33 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 1460 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:33.640532 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-12955436-9951-4320-99d5-d1e96e32f323 req-90b2ee8c-a556-4e3f-90d9-758ac24863f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e89e57-5784-40fe-a6a2-f299fb7e91fd", "name": "network-vif-deleted", "tag": "32067df0-68ea-416d-a011-49c3d916cd31"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:33.653181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-12955436-9951-4320-99d5-d1e96e32f323 req-90b2ee8c-a556-4e3f-90d9-758ac24863f6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:33.653897 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-12955436-9951-4320-99d5-d1e96e32f323 req-90b2ee8c-a556-4e3f-90d9-758ac24863f6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:33.668789 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-12955436-9951-4320-99d5-d1e96e32f323 req-90b2ee8c-a556-4e3f-90d9-758ac24863f6 service nova] Creating event network-vif-deleted:32067df0-68ea-416d-a011-49c3d916cd31 for instance 41e89e57-5784-40fe-a6a2-f299fb7e91fd on n-h1-master-1 Jul 31 01:29:33.674640 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-12955436-9951-4320-99d5-d1e96e32f323 req-90b2ee8c-a556-4e3f-90d9-758ac24863f6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041778 Jul 31 01:29:33.676360 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2116/4218] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:29:33.817118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9eb39b69-365f-4d00-8232-6b2d28ca2ce1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:33.845264 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9eb39b69-365f-4d00-8232-6b2d28ca2ce1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.781956 Jul 31 01:29:33.870051 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2103/4219] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:33 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:33.883920 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d399526c-02c3-44e5-9106-1c4e35c369e5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:33.884706 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d399526c-02c3-44e5-9106-1c4e35c369e5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:33.947222 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d399526c-02c3-44e5-9106-1c4e35c369e5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:33.948085 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d399526c-02c3-44e5-9106-1c4e35c369e5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:33.949137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d399526c-02c3-44e5-9106-1c4e35c369e5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:33.952104 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d399526c-02c3-44e5-9106-1c4e35c369e5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:34.016307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-47c982e9-3c38-400c-8200-93e068a72bef tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:34.017227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-47c982e9-3c38-400c-8200-93e068a72bef tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:34.029314 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47c982e9-3c38-400c-8200-93e068a72bef tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:34.030137 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47c982e9-3c38-400c-8200-93e068a72bef tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:34.031672 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47c982e9-3c38-400c-8200-93e068a72bef tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:34.032436 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47c982e9-3c38-400c-8200-93e068a72bef tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:34.177506 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-47c982e9-3c38-400c-8200-93e068a72bef tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:34.190687 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-47c982e9-3c38-400c-8200-93e068a72bef tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:34.194638 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-47c982e9-3c38-400c-8200-93e068a72bef tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:34.207306 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-47c982e9-3c38-400c-8200-93e068a72bef tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.200343 Jul 31 01:29:34.224668 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2104/4220] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:34 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:34.243408 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8d43c837-c1dc-4f8c-8673-95c81395fd93 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:34.247943 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8d43c837-c1dc-4f8c-8673-95c81395fd93 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:34.260480 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d43c837-c1dc-4f8c-8673-95c81395fd93 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:34.261705 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d43c837-c1dc-4f8c-8673-95c81395fd93 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:34.263220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d43c837-c1dc-4f8c-8673-95c81395fd93 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:34.263863 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8d43c837-c1dc-4f8c-8673-95c81395fd93 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:34.475456 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d399526c-02c3-44e5-9106-1c4e35c369e5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:34.488528 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d399526c-02c3-44e5-9106-1c4e35c369e5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.615566 Jul 31 01:29:34.508698 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2117/4221] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:33 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:34.521325 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c6d8a99e-46d5-4ff0-872d-f30eef8bd821 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:34.522081 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c6d8a99e-46d5-4ff0-872d-f30eef8bd821 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] [instance: 41e89e57-5784-40fe-a6a2-f299fb7e91fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:34.550703 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6d8a99e-46d5-4ff0-872d-f30eef8bd821 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:34.554001 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6d8a99e-46d5-4ff0-872d-f30eef8bd821 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:34.558117 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6d8a99e-46d5-4ff0-872d-f30eef8bd821 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:34.558801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6d8a99e-46d5-4ff0-872d-f30eef8bd821 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:34.592488 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-c6d8a99e-46d5-4ff0-872d-f30eef8bd821 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] HTTP exception thrown: Instance 41e89e57-5784-40fe-a6a2-f299fb7e91fd could not be found. Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c6d8a99e-46d5-4ff0-872d-f30eef8bd821 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Request method failure captured: Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd HTTP/1.1 Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dq-Y_wBdws_6EvSDZ44mwMTuz9dLwkPamT4gWrhfV5UqpwkHMlC_uZO8OTvGuW7Y5WTsRsu_6ZF8nx7k7SW1GkZ6Cl0jC5EwPXxNxO82O17COiiz9uQExo64Xmba6UgKlM9CiDY98JFrN6hMr00DsY_cPVYaESbCdOTGq5vIS_h2vk Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 0d2e6318c9a2499c8a5857683762bf52 Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-VolumesActionsTest-1926829190 Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d2e6318c9a2499c8a5857683762bf52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0d2e6318c9a2499c8a5857683762bf52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0d2e6318c9a2499c8a5857683762bf52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0d2e6318c9a2499c8a5857683762bf52", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-VolumesActionsTest-1926829190 Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 0d2e6318c9a2499c8a5857683762bf52 Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-VolumesActionsTest-1926829190 Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-VolumesActionsTest-1926829190-project Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: b86f46d7be9f45d0aa7ee53ac4b95371 Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-VolumesActionsTest-1926829190-project Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 41e89e57-5784-40fe-a6a2-f299fb7e91fd could not be found. Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '41e89e57-5784-40fe-a6a2-f299fb7e91fd'} Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e89e57-5784-40fe-a6a2-f299fb7e91fd could not be found. Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e89e57-5784-40fe-a6a2-f299fb7e91fd could not be found. Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:34.596200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:34.601826 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:34.601826 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:34.601826 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:34.601826 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:34.601826 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:34.601826 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e89e57-5784-40fe-a6a2-f299fb7e91fd could not be found. Jul 31 01:29:34.601826 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:34.603874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c6d8a99e-46d5-4ff0-872d-f30eef8bd821 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] Returning 404 to user: Instance 41e89e57-5784-40fe-a6a2-f299fb7e91fd could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:34.605787 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c6d8a99e-46d5-4ff0-872d-f30eef8bd821 tempest-VolumesActionsTest-1926829190 tempest-VolumesActionsTest-1926829190-project] 10.222.0.45 "GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd" status: 404 len: 111 microversion: 2.1 time: 0.095524 Jul 31 01:29:34.607071 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2118/4222] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:34 2022] GET /compute/v2.1/servers/41e89e57-5784-40fe-a6a2-f299fb7e91fd => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:29:34.623094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a9288ec-93d8-4b35-8e5c-a986cf54e5b8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:34.627453 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9a9288ec-93d8-4b35-8e5c-a986cf54e5b8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 66684a22-e939-4f1b-ac3e-207dd8f2a446] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:34.636489 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-9a9288ec-93d8-4b35-8e5c-a986cf54e5b8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 66684a22-e939-4f1b-ac3e-207dd8f2a446 could not be found. Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a9288ec-93d8-4b35-8e5c-a986cf54e5b8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/66684a22-e939-4f1b-ac3e-207dd8f2a446/action HTTP/1.1 Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 14 Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: {"resume": {}} Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 66684a22-e939-4f1b-ac3e-207dd8f2a446 could not be found. Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '66684a22-e939-4f1b-ac3e-207dd8f2a446', 'body': {'resume': {}}} Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66684a22-e939-4f1b-ac3e-207dd8f2a446 could not be found. Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66684a22-e939-4f1b-ac3e-207dd8f2a446 could not be found. Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:34.641067 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:34.645958 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:34.645958 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:34.645958 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66684a22-e939-4f1b-ac3e-207dd8f2a446 could not be found. Jul 31 01:29:34.645958 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:34.648817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a9288ec-93d8-4b35-8e5c-a986cf54e5b8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 66684a22-e939-4f1b-ac3e-207dd8f2a446 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:34.649910 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9a9288ec-93d8-4b35-8e5c-a986cf54e5b8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/66684a22-e939-4f1b-ac3e-207dd8f2a446/action" status: 404 len: 111 microversion: 2.1 time: 0.041247 Jul 31 01:29:34.652130 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2119/4223] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:29:34 2022] POST /compute/v2.1/servers/66684a22-e939-4f1b-ac3e-207dd8f2a446/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:29:34.666536 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ab11eb8d-8666-4464-a6ea-b2c60389a9e3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:34.669763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ab11eb8d-8666-4464-a6ea-b2c60389a9e3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:34.688387 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8d43c837-c1dc-4f8c-8673-95c81395fd93 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:34.691698 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab11eb8d-8666-4464-a6ea-b2c60389a9e3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:34.692500 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab11eb8d-8666-4464-a6ea-b2c60389a9e3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:34.693522 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab11eb8d-8666-4464-a6ea-b2c60389a9e3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:34.694711 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab11eb8d-8666-4464-a6ea-b2c60389a9e3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:34.699741 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8d43c837-c1dc-4f8c-8673-95c81395fd93 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 200 len: 1292 microversion: 2.1 time: 0.463073 Jul 31 01:29:34.700333 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2105/4224] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:34 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 1292 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:35.065044 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ab11eb8d-8666-4464-a6ea-b2c60389a9e3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:35.081154 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ab11eb8d-8666-4464-a6ea-b2c60389a9e3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.421963 Jul 31 01:29:35.085441 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2120/4225] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:34 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:35.116731 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-78d00846-e0df-45e0-b3da-f8b10eae35fe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:35.118021 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-78d00846-e0df-45e0-b3da-f8b10eae35fe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:35.128485 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78d00846-e0df-45e0-b3da-f8b10eae35fe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:35.128969 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78d00846-e0df-45e0-b3da-f8b10eae35fe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:35.129779 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78d00846-e0df-45e0-b3da-f8b10eae35fe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:35.130226 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78d00846-e0df-45e0-b3da-f8b10eae35fe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:35.237218 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1463c4d2-61cb-4d58-9f97-d68ad43692a3 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:35.237861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1463c4d2-61cb-4d58-9f97-d68ad43692a3 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:35.260577 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1463c4d2-61cb-4d58-9f97-d68ad43692a3 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:35.260968 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1463c4d2-61cb-4d58-9f97-d68ad43692a3 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:35.261765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1463c4d2-61cb-4d58-9f97-d68ad43692a3 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:35.262208 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1463c4d2-61cb-4d58-9f97-d68ad43692a3 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:35.384207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1463c4d2-61cb-4d58-9f97-d68ad43692a3 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:35.411748 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1463c4d2-61cb-4d58-9f97-d68ad43692a3 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:35.413971 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1463c4d2-61cb-4d58-9f97-d68ad43692a3 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:35.417407 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1463c4d2-61cb-4d58-9f97-d68ad43692a3 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.186801 Jul 31 01:29:35.437551 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2121/4226] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:35 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:35.501778 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-78d00846-e0df-45e0-b3da-f8b10eae35fe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:35.514452 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-78d00846-e0df-45e0-b3da-f8b10eae35fe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.408818 Jul 31 01:29:35.529663 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2106/4227] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:35 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:35.543775 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bb8cd1bd-b20b-4a8f-8357-ac4875e875b8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:35.544330 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bb8cd1bd-b20b-4a8f-8357-ac4875e875b8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:35.561421 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bb8cd1bd-b20b-4a8f-8357-ac4875e875b8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:35.561888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bb8cd1bd-b20b-4a8f-8357-ac4875e875b8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:35.562715 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bb8cd1bd-b20b-4a8f-8357-ac4875e875b8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:35.563166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bb8cd1bd-b20b-4a8f-8357-ac4875e875b8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:35.606267 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-bb8cd1bd-b20b-4a8f-8357-ac4875e875b8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Cannot 'resume' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bb8cd1bd-b20b-4a8f-8357-ac4875e875b8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action HTTP/1.1 Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 14 Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: {"resume": {}} Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: exception: Cannot 'resume' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '76757e35-eebd-46de-a012-82bd864fd1d2', 'body': {'resume': {}}} Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 76757e35-eebd-46de-a012-82bd864fd1d2 in vm_state active. Cannot resume while the instance is in this state. Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:35.608494 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:35.613078 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:35.613078 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:35.613078 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:35.613078 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active Jul 31 01:29:35.613078 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:35.613078 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bb8cd1bd-b20b-4a8f-8357-ac4875e875b8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 409 to user: Cannot 'resume' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:35.613078 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bb8cd1bd-b20b-4a8f-8357-ac4875e875b8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action" status: 409 len: 144 microversion: 2.1 time: 0.078437 Jul 31 01:29:35.615380 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2122/4228] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:29:35 2022] POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action => generated 144 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:29:35.625361 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1802b29f-4c13-419a-af8e-ac47219f54e4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:35.626712 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1802b29f-4c13-419a-af8e-ac47219f54e4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:35.634652 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1802b29f-4c13-419a-af8e-ac47219f54e4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:35.635435 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1802b29f-4c13-419a-af8e-ac47219f54e4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:35.636425 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1802b29f-4c13-419a-af8e-ac47219f54e4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:35.637024 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1802b29f-4c13-419a-af8e-ac47219f54e4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:35.721873 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cdea6d5f-1b9c-4922-a862-ffea8d7c645a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:35.722852 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cdea6d5f-1b9c-4922-a862-ffea8d7c645a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:35.733580 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdea6d5f-1b9c-4922-a862-ffea8d7c645a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:35.734286 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdea6d5f-1b9c-4922-a862-ffea8d7c645a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:35.735520 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdea6d5f-1b9c-4922-a862-ffea8d7c645a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:35.740741 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdea6d5f-1b9c-4922-a862-ffea8d7c645a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:36.107975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cdea6d5f-1b9c-4922-a862-ffea8d7c645a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:36.114061 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1802b29f-4c13-419a-af8e-ac47219f54e4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:36.117308 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cdea6d5f-1b9c-4922-a862-ffea8d7c645a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 200 len: 1292 microversion: 2.1 time: 0.400231 Jul 31 01:29:36.132153 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1802b29f-4c13-419a-af8e-ac47219f54e4 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.503941 Jul 31 01:29:36.132153 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2107/4229] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:35 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:36.136794 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2123/4230] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:35 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 1292 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:36.181632 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fe455bea-2f3a-4a47-862a-1dac7aca1821 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:36.184730 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fe455bea-2f3a-4a47-862a-1dac7aca1821 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:36.222509 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe455bea-2f3a-4a47-862a-1dac7aca1821 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:36.223994 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe455bea-2f3a-4a47-862a-1dac7aca1821 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:36.226399 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe455bea-2f3a-4a47-862a-1dac7aca1821 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:36.227208 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe455bea-2f3a-4a47-862a-1dac7aca1821 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:36.451780 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a315f3df-ca13-4ce4-aec6-ff020dc1e667 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:36.453219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a315f3df-ca13-4ce4-aec6-ff020dc1e667 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:36.465366 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a315f3df-ca13-4ce4-aec6-ff020dc1e667 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:36.467878 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a315f3df-ca13-4ce4-aec6-ff020dc1e667 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:36.469408 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a315f3df-ca13-4ce4-aec6-ff020dc1e667 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:36.469989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a315f3df-ca13-4ce4-aec6-ff020dc1e667 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:36.620465 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fe455bea-2f3a-4a47-862a-1dac7aca1821 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:36.623449 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a315f3df-ca13-4ce4-aec6-ff020dc1e667 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:36.637081 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fe455bea-2f3a-4a47-862a-1dac7aca1821 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.484827 Jul 31 01:29:36.637407 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a315f3df-ca13-4ce4-aec6-ff020dc1e667 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:36.638610 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2108/4231] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:36 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:36.638768 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a315f3df-ca13-4ce4-aec6-ff020dc1e667 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:36.642566 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a315f3df-ca13-4ce4-aec6-ff020dc1e667 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1408 microversion: 2.54 time: 0.196909 Jul 31 01:29:36.643090 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2124/4232] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:36 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:36.926275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ca4304e-815e-4171-9309-9a8001f61b9d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ca4304e-815e-4171-9309-9a8001f61b9d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 160 Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": "", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "045ea8ff-463e-40b5-b75b-322b143e9807"}]}} Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'server': {'name': '', 'imageRef': '0f306572-729b-4b95-a357-79461887e541', 'flavorRef': '452', 'networks': [{'uuid': '045ea8ff-463e-40b5-b75b-322b143e9807'}]}}} Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi '' Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:29:36.931189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:29:36.935718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:29:36.935718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 31 01:29:36.935718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:36.935718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:36.935718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:36.935718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:36.935718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:36.935718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:36.935718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:29:36.935718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:29:36.935718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 31 01:29:36.935718 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:36.937941 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ca4304e-815e-4171-9309-9a8001f61b9d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:36.939394 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0ca4304e-815e-4171-9309-9a8001f61b9d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.019515 Jul 31 01:29:36.940849 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2109/4233] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:29:36 2022] POST /compute/v2.1/servers => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:29:36.949612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-81b3186c-288f-47af-8534-25845a6ae3c2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:36.950636 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-81b3186c-288f-47af-8534-25845a6ae3c2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:36.958770 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81b3186c-288f-47af-8534-25845a6ae3c2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:36.959865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81b3186c-288f-47af-8534-25845a6ae3c2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:36.960851 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81b3186c-288f-47af-8534-25845a6ae3c2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:36.961473 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81b3186c-288f-47af-8534-25845a6ae3c2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:37.095831 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1972847635", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ccac0e89-7492-4124-bdb6-15e91de8338b"}], "security_groups": [{"name": "tempest-securitygroup--580338911"}], "key_name": "tempest-keypair-583265666", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:37.420414 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-81b3186c-288f-47af-8534-25845a6ae3c2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:37.432978 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-81b3186c-288f-47af-8534-25845a6ae3c2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.485002 Jul 31 01:29:37.435158 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2125/4234] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:36 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:37.446690 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ef5ee843-ef21-445d-9ace-11d81596a106 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:37.451224 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ef5ee843-ef21-445d-9ace-11d81596a106 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:37.483291 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef5ee843-ef21-445d-9ace-11d81596a106 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:37.494953 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef5ee843-ef21-445d-9ace-11d81596a106 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:37.497902 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef5ee843-ef21-445d-9ace-11d81596a106 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:37.502323 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef5ee843-ef21-445d-9ace-11d81596a106 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:37.606124 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] validate_networks() for [('ccac0e89-7492-4124-bdb6-15e91de8338b', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:29:38.033857 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ef5ee843-ef21-445d-9ace-11d81596a106 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:38.045438 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ef5ee843-ef21-445d-9ace-11d81596a106 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 200 len: 1292 microversion: 2.1 time: 0.607168 Jul 31 01:29:38.061160 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2126/4235] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:37 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 1292 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:38.069504 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f9fb5ede-44e6-46fd-babd-09d04e080378 req-bc97443e-9f22-4c8f-9703-c12893ad7fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8", "name": "network-vif-plugged", "status": "completed", "tag": "abd05ec8-47bf-48ba-9712-efb525258b6a"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:38.083945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f9fb5ede-44e6-46fd-babd-09d04e080378 req-bc97443e-9f22-4c8f-9703-c12893ad7fb9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:38.084748 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f9fb5ede-44e6-46fd-babd-09d04e080378 req-bc97443e-9f22-4c8f-9703-c12893ad7fb9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:38.097817 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f9fb5ede-44e6-46fd-babd-09d04e080378 req-bc97443e-9f22-4c8f-9703-c12893ad7fb9 service nova] Creating event network-vif-plugged:abd05ec8-47bf-48ba-9712-efb525258b6a for instance ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 on n-h2-master-1 Jul 31 01:29:38.104187 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f9fb5ede-44e6-46fd-babd-09d04e080378 req-bc97443e-9f22-4c8f-9703-c12893ad7fb9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041103 Jul 31 01:29:38.108353 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2127/4236] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:29:38.114134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a400cd2-fca5-4260-837e-894708517b18 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:38.115110 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9a400cd2-fca5-4260-837e-894708517b18 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:38.123005 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a400cd2-fca5-4260-837e-894708517b18 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:38.123778 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a400cd2-fca5-4260-837e-894708517b18 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:38.125217 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a400cd2-fca5-4260-837e-894708517b18 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:38.125879 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a400cd2-fca5-4260-837e-894708517b18 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:38.131069 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:38.358071 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9a400cd2-fca5-4260-837e-894708517b18 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:38.369436 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9a400cd2-fca5-4260-837e-894708517b18 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.259406 Jul 31 01:29:38.373324 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2128/4237] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:38 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:38.392550 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e770b5a1-54c0-4235-bfbf-7db1dc232366 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:38.394319 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e770b5a1-54c0-4235-bfbf-7db1dc232366 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:38.408521 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e770b5a1-54c0-4235-bfbf-7db1dc232366 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:38.412424 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e770b5a1-54c0-4235-bfbf-7db1dc232366 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:38.414203 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e770b5a1-54c0-4235-bfbf-7db1dc232366 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:38.414887 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e770b5a1-54c0-4235-bfbf-7db1dc232366 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:38.532832 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e770b5a1-54c0-4235-bfbf-7db1dc232366 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:38.545597 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e770b5a1-54c0-4235-bfbf-7db1dc232366 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:38.548410 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e770b5a1-54c0-4235-bfbf-7db1dc232366 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:38.549940 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e770b5a1-54c0-4235-bfbf-7db1dc232366 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1414 microversion: 2.54 time: 0.172905 Jul 31 01:29:38.551387 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2129/4238] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:38 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1414 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:38.572450 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-95f5dd57-d469-4597-8873-cb9cbbac05ea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:38.573292 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-95f5dd57-d469-4597-8873-cb9cbbac05ea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 533a1c72-7ff8-4e02-bca4-3ecf245b2e29] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:38.584757 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-95f5dd57-d469-4597-8873-cb9cbbac05ea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 533a1c72-7ff8-4e02-bca4-3ecf245b2e29 could not be found. Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-95f5dd57-d469-4597-8873-cb9cbbac05ea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/533a1c72-7ff8-4e02-bca4-3ecf245b2e29/action HTTP/1.1 Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 14 Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: {"shelve": {}} Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 533a1c72-7ff8-4e02-bca4-3ecf245b2e29 could not be found. Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '533a1c72-7ff8-4e02-bca4-3ecf245b2e29', 'body': {'shelve': {}}} Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 533a1c72-7ff8-4e02-bca4-3ecf245b2e29 could not be found. Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 533a1c72-7ff8-4e02-bca4-3ecf245b2e29 could not be found. Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:38.590766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:38.595519 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:38.595519 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:38.595519 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 533a1c72-7ff8-4e02-bca4-3ecf245b2e29 could not be found. Jul 31 01:29:38.595519 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:38.598670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-95f5dd57-d469-4597-8873-cb9cbbac05ea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 533a1c72-7ff8-4e02-bca4-3ecf245b2e29 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:38.602729 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-95f5dd57-d469-4597-8873-cb9cbbac05ea tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/533a1c72-7ff8-4e02-bca4-3ecf245b2e29/action" status: 404 len: 111 microversion: 2.1 time: 0.047151 Jul 31 01:29:38.604039 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2130/4239] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:29:38 2022] POST /compute/v2.1/servers/533a1c72-7ff8-4e02-bca4-3ecf245b2e29/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:29:38.613858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3cf9e96b-b95d-42a8-ad78-1cc13b0836b7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:38.620885 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3cf9e96b-b95d-42a8-ad78-1cc13b0836b7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:38.629301 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3cf9e96b-b95d-42a8-ad78-1cc13b0836b7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:38.630107 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3cf9e96b-b95d-42a8-ad78-1cc13b0836b7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:38.631750 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3cf9e96b-b95d-42a8-ad78-1cc13b0836b7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:38.632416 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3cf9e96b-b95d-42a8-ad78-1cc13b0836b7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:39.071474 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3cf9e96b-b95d-42a8-ad78-1cc13b0836b7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:39.093147 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3cf9e96b-b95d-42a8-ad78-1cc13b0836b7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.484230 Jul 31 01:29:39.093744 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2131/4240] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:38 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:39.111323 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bd0546c4-1052-4d74-9b63-97c1773d15f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:39.112188 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bd0546c4-1052-4d74-9b63-97c1773d15f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:39.132282 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd0546c4-1052-4d74-9b63-97c1773d15f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:39.133341 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd0546c4-1052-4d74-9b63-97c1773d15f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:39.134344 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd0546c4-1052-4d74-9b63-97c1773d15f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:39.135006 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd0546c4-1052-4d74-9b63-97c1773d15f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:39.329864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Getting quotas for project c926541f0e1c4cd6b64d09f2a89b4729. Resources: dict_keys(['metadata_items']) {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:39.344570 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Getting quotas for user b299fe87d4ec478092658a35f882ffa2 and project c926541f0e1c4cd6b64d09f2a89b4729. Resources: dict_keys(['metadata_items']) {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:39.375509 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:29:39.386979 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:29:39.388046 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:29:39.388852 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:29:39.389525 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:29:39.417408 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:39.418152 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:39.419120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:39.419749 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:39.462152 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Getting quotas for project c926541f0e1c4cd6b64d09f2a89b4729. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:39.477634 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Getting quotas for user b299fe87d4ec478092658a35f882ffa2 and project c926541f0e1c4cd6b64d09f2a89b4729. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:39.506406 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bd0546c4-1052-4d74-9b63-97c1773d15f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:39.517826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:29:39.520707 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:29:39.529528 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bd0546c4-1052-4d74-9b63-97c1773d15f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 200 len: 1292 microversion: 2.1 time: 0.434430 Jul 31 01:29:39.532565 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2132/4241] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:39 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 1292 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:39.548888 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6f36b1db-1bea-43d7-80c3-b32b9d88d5f5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:39.549548 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6f36b1db-1bea-43d7-80c3-b32b9d88d5f5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:39.569467 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6f36b1db-1bea-43d7-80c3-b32b9d88d5f5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:39.569814 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6f36b1db-1bea-43d7-80c3-b32b9d88d5f5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:39.570676 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6f36b1db-1bea-43d7-80c3-b32b9d88d5f5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:39.574880 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6f36b1db-1bea-43d7-80c3-b32b9d88d5f5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:39.657538 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ed470a5b-aa4a-490c-b912-b5b5b4202c6f tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.566578 Jul 31 01:29:39.658202 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2110/4242] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:29:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 2568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:29:39.685272 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9aebcf7c-78de-441a-b872-6f76962983a9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:39.687014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9aebcf7c-78de-441a-b872-6f76962983a9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:39.717471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9aebcf7c-78de-441a-b872-6f76962983a9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:39.721223 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9aebcf7c-78de-441a-b872-6f76962983a9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:39.723654 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9aebcf7c-78de-441a-b872-6f76962983a9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:39.725511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9aebcf7c-78de-441a-b872-6f76962983a9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:39.927426 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9aebcf7c-78de-441a-b872-6f76962983a9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:39.940046 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9aebcf7c-78de-441a-b872-6f76962983a9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:39.943204 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9aebcf7c-78de-441a-b872-6f76962983a9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:39.946634 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9aebcf7c-78de-441a-b872-6f76962983a9 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1414 microversion: 2.54 time: 0.285211 Jul 31 01:29:39.949606 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2111/4243] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:39 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1414 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:39.962016 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7725da8f-afc7-431a-8e45-496e834e78f5 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:39.962657 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7725da8f-afc7-431a-8e45-496e834e78f5 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:39.970541 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:40.146206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6f36b1db-1bea-43d7-80c3-b32b9d88d5f5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:40.158679 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6f36b1db-1bea-43d7-80c3-b32b9d88d5f5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.624245 Jul 31 01:29:40.160899 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2133/4244] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:39 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:40.181042 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5bfbbb04-5e8d-46a5-a2f3-2877f6eaff3d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:40.181784 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5bfbbb04-5e8d-46a5-a2f3-2877f6eaff3d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:40.191394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7725da8f-afc7-431a-8e45-496e834e78f5 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:40.204782 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7725da8f-afc7-431a-8e45-496e834e78f5 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1269 microversion: 2.1 time: 0.252982 Jul 31 01:29:40.208790 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2112/4245] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:39 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1269 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:40.212544 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5bfbbb04-5e8d-46a5-a2f3-2877f6eaff3d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:40.213024 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5bfbbb04-5e8d-46a5-a2f3-2877f6eaff3d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:40.213838 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5bfbbb04-5e8d-46a5-a2f3-2877f6eaff3d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:40.216005 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5bfbbb04-5e8d-46a5-a2f3-2877f6eaff3d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:40.297383 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-5bfbbb04-5e8d-46a5-a2f3-2877f6eaff3d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lazy-loading 'flavor' on Instance uuid 76757e35-eebd-46de-a012-82bd864fd1d2 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:29:40.570345 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f1fc89e1-ecc8-4c83-bf0b-b3dc97e89f26 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:40.570731 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f1fc89e1-ecc8-4c83-bf0b-b3dc97e89f26 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:40.588464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1fc89e1-ecc8-4c83-bf0b-b3dc97e89f26 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:40.594814 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1fc89e1-ecc8-4c83-bf0b-b3dc97e89f26 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:40.603162 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1fc89e1-ecc8-4c83-bf0b-b3dc97e89f26 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:40.603816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1fc89e1-ecc8-4c83-bf0b-b3dc97e89f26 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:40.780707 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5bfbbb04-5e8d-46a5-a2f3-2877f6eaff3d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action" status: 202 len: 0 microversion: 2.1 time: 0.603559 Jul 31 01:29:40.785165 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2134/4246] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:29:40 2022] POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 01:29:40.792397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-16701057-6ea0-42e3-ba87-24e874034b46 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:40.795064 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-16701057-6ea0-42e3-ba87-24e874034b46 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:40.814431 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16701057-6ea0-42e3-ba87-24e874034b46 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:40.815111 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16701057-6ea0-42e3-ba87-24e874034b46 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:40.816181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16701057-6ea0-42e3-ba87-24e874034b46 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:40.816781 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16701057-6ea0-42e3-ba87-24e874034b46 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:41.575932 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-16701057-6ea0-42e3-ba87-24e874034b46 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:41.588047 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-16701057-6ea0-42e3-ba87-24e874034b46 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1511 microversion: 2.1 time: 0.798401 Jul 31 01:29:41.590697 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2135/4247] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:40 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1511 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:41.597626 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f1fc89e1-ecc8-4c83-bf0b-b3dc97e89f26 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:41.604525 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1ddcebb4-10c5-4da7-b440-4e3b393f6768 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:41.606515 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1ddcebb4-10c5-4da7-b440-4e3b393f6768 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:41.619791 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f1fc89e1-ecc8-4c83-bf0b-b3dc97e89f26 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 200 len: 1292 microversion: 2.1 time: 1.069335 Jul 31 01:29:41.630331 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2113/4248] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:40 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 1292 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:41.636481 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0e465c82-76f9-47e3-9e99-91efcc8a5c8c tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:41.643238 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0e465c82-76f9-47e3-9e99-91efcc8a5c8c tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:41.645135 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1ddcebb4-10c5-4da7-b440-4e3b393f6768 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:41.647051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1ddcebb4-10c5-4da7-b440-4e3b393f6768 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:41.649843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1ddcebb4-10c5-4da7-b440-4e3b393f6768 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:41.653622 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1ddcebb4-10c5-4da7-b440-4e3b393f6768 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:41.663622 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e465c82-76f9-47e3-9e99-91efcc8a5c8c tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:41.665333 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e465c82-76f9-47e3-9e99-91efcc8a5c8c tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:41.666404 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e465c82-76f9-47e3-9e99-91efcc8a5c8c tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:41.682337 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e465c82-76f9-47e3-9e99-91efcc8a5c8c tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:41.849652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e465c82-76f9-47e3-9e99-91efcc8a5c8c tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:41.863783 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0e465c82-76f9-47e3-9e99-91efcc8a5c8c tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1265 microversion: 2.1 time: 0.228939 Jul 31 01:29:41.865094 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2114/4249] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:41 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:41.922436 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1ddcebb4-10c5-4da7-b440-4e3b393f6768 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:41.940519 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1ddcebb4-10c5-4da7-b440-4e3b393f6768 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:41.944656 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1ddcebb4-10c5-4da7-b440-4e3b393f6768 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:41.948208 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1ddcebb4-10c5-4da7-b440-4e3b393f6768 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1399 microversion: 2.54 time: 0.355694 Jul 31 01:29:41.949775 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2136/4250] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:41 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1399 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:41.986093 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7f32bf4c-7013-4a51-9f06-3f4fdcda88dc tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '.version_select at 0x7fede58e98b0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:42.029364 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7f32bf4c-7013-4a51-9f06-3f4fdcda88dc tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-603576366" status: 204 len: 0 microversion: 2.54 time: 0.047332 Jul 31 01:29:42.030472 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2115/4251] 10.222.0.45 () {60 vars in 1316 bytes} [Sun Jul 31 01:29:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-603576366 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:29:42.045273 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7479c0b3-529e-4d2d-a2c1-fe9a2f54016e tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:42.045794 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7479c0b3-529e-4d2d-a2c1-fe9a2f54016e tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:42.059099 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7479c0b3-529e-4d2d-a2c1-fe9a2f54016e tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:42.059548 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7479c0b3-529e-4d2d-a2c1-fe9a2f54016e tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:42.060342 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7479c0b3-529e-4d2d-a2c1-fe9a2f54016e tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:42.082689 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7479c0b3-529e-4d2d-a2c1-fe9a2f54016e tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:42.194155 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7479c0b3-529e-4d2d-a2c1-fe9a2f54016e tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:29:42.506976 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7479c0b3-529e-4d2d-a2c1-fe9a2f54016e tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "DELETE /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 204 len: 0 microversion: 2.54 time: 0.466069 Jul 31 01:29:42.509483 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2137/4252] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:29:42 2022] DELETE /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:29:42.519127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eaf16fc6-9cdf-4b3c-92ad-f8789f6852b7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:42.520521 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eaf16fc6-9cdf-4b3c-92ad-f8789f6852b7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:42.542488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eaf16fc6-9cdf-4b3c-92ad-f8789f6852b7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:42.543299 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eaf16fc6-9cdf-4b3c-92ad-f8789f6852b7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:42.545353 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eaf16fc6-9cdf-4b3c-92ad-f8789f6852b7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:42.546191 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eaf16fc6-9cdf-4b3c-92ad-f8789f6852b7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:42.616019 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f8403bd7-6557-4638-9483-4aeaba0680c2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:42.616895 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f8403bd7-6557-4638-9483-4aeaba0680c2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:42.629560 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8403bd7-6557-4638-9483-4aeaba0680c2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:42.631820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8403bd7-6557-4638-9483-4aeaba0680c2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:42.632853 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8403bd7-6557-4638-9483-4aeaba0680c2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:42.633571 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8403bd7-6557-4638-9483-4aeaba0680c2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:43.340309 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eaf16fc6-9cdf-4b3c-92ad-f8789f6852b7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:43.357324 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eaf16fc6-9cdf-4b3c-92ad-f8789f6852b7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:43.371936 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eaf16fc6-9cdf-4b3c-92ad-f8789f6852b7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:43.373597 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eaf16fc6-9cdf-4b3c-92ad-f8789f6852b7 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1405 microversion: 2.54 time: 0.860263 Jul 31 01:29:43.374666 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2116/4253] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:42 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1405 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:43.379608 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-45ecc6b8-ec13-4243-8ad9-c96a217a22ae tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:43.382329 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-45ecc6b8-ec13-4243-8ad9-c96a217a22ae tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:43.401532 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-45ecc6b8-ec13-4243-8ad9-c96a217a22ae tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:43.402444 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-45ecc6b8-ec13-4243-8ad9-c96a217a22ae tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:43.403611 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-45ecc6b8-ec13-4243-8ad9-c96a217a22ae tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:43.404220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-45ecc6b8-ec13-4243-8ad9-c96a217a22ae tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:43.798063 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f8403bd7-6557-4638-9483-4aeaba0680c2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:43.817417 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f8403bd7-6557-4638-9483-4aeaba0680c2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1511 microversion: 2.1 time: 1.204316 Jul 31 01:29:43.819455 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2138/4254] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:42 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1511 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:43.832700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a65fa3f-820e-4d2a-9e73-c20d700654c0 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:43.836236 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9a65fa3f-820e-4d2a-9e73-c20d700654c0 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:43.854158 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a65fa3f-820e-4d2a-9e73-c20d700654c0 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:43.864022 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a65fa3f-820e-4d2a-9e73-c20d700654c0 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:43.865042 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a65fa3f-820e-4d2a-9e73-c20d700654c0 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:43.865679 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a65fa3f-820e-4d2a-9e73-c20d700654c0 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:44.096544 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9a65fa3f-820e-4d2a-9e73-c20d700654c0 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:44.107467 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9a65fa3f-820e-4d2a-9e73-c20d700654c0 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1327 microversion: 2.1 time: 0.286316 Jul 31 01:29:44.108806 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2139/4255] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:43 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1327 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:44.164462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-45ecc6b8-ec13-4243-8ad9-c96a217a22ae tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:44.175703 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-45ecc6b8-ec13-4243-8ad9-c96a217a22ae tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 200 len: 1473 microversion: 2.1 time: 0.799731 Jul 31 01:29:44.179786 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2117/4256] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:43 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 1473 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:44.398569 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a573c6ac-d278-47b2-b4bf-3e4746dc2541 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:44.399218 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a573c6ac-d278-47b2-b4bf-3e4746dc2541 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:44.407626 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a573c6ac-d278-47b2-b4bf-3e4746dc2541 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:44.408332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a573c6ac-d278-47b2-b4bf-3e4746dc2541 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:44.412697 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a573c6ac-d278-47b2-b4bf-3e4746dc2541 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:44.413652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a573c6ac-d278-47b2-b4bf-3e4746dc2541 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:44.508931 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9a94e871-2053-4c4c-81bf-260c26e3eeec tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-654147936", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:44.750300 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-9a94e871-2053-4c4c-81bf-260c26e3eeec tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] validate_networks() for [('ce8b5cb4-aa2f-4dfd-abb4-9273e2a34e90', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:29:44.814902 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a573c6ac-d278-47b2-b4bf-3e4746dc2541 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:44.833033 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a573c6ac-d278-47b2-b4bf-3e4746dc2541 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:44.835381 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a573c6ac-d278-47b2-b4bf-3e4746dc2541 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9bd76f16e0104a7ead477c3292725c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e3b88e39c44bfba92d40ff5971a7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:44.848949 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a573c6ac-d278-47b2-b4bf-3e4746dc2541 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 200 len: 1405 microversion: 2.54 time: 0.455006 Jul 31 01:29:44.855053 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2140/4257] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:44 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 1405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:29:44.869424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8fa4843c-cb71-48ba-a998-1d28d5a19d54 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:44.872594 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8fa4843c-cb71-48ba-a998-1d28d5a19d54 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:44.897561 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fa4843c-cb71-48ba-a998-1d28d5a19d54 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:44.900466 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fa4843c-cb71-48ba-a998-1d28d5a19d54 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:44.905654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fa4843c-cb71-48ba-a998-1d28d5a19d54 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:44.910801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fa4843c-cb71-48ba-a998-1d28d5a19d54 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:45.615508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8fa4843c-cb71-48ba-a998-1d28d5a19d54 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:45.624696 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8fa4843c-cb71-48ba-a998-1d28d5a19d54 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1511 microversion: 2.1 time: 0.768033 Jul 31 01:29:45.628210 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2141/4258] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:44 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1511 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:45.659567 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2741ceaf-7272-4f4b-b6ce-6750848f3ffe tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:45.660794 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2741ceaf-7272-4f4b-b6ce-6750848f3ffe tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:45.670813 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2741ceaf-7272-4f4b-b6ce-6750848f3ffe tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:45.671552 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2741ceaf-7272-4f4b-b6ce-6750848f3ffe tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:45.673708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2741ceaf-7272-4f4b-b6ce-6750848f3ffe tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:45.675936 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2741ceaf-7272-4f4b-b6ce-6750848f3ffe tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:45.725097 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:45.805659 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2741ceaf-7272-4f4b-b6ce-6750848f3ffe tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:45.817111 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2741ceaf-7272-4f4b-b6ce-6750848f3ffe tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1327 microversion: 2.1 time: 0.171505 Jul 31 01:29:45.820172 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2142/4259] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:45 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1327 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:45.881555 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a0b181c6-dabd-4fef-970b-d3cba8ca9882 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:45.882693 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a0b181c6-dabd-4fef-970b-d3cba8ca9882 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] [instance: 292af9de-46da-4a11-a3af-dfb0cd903d9d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:45.895584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0b181c6-dabd-4fef-970b-d3cba8ca9882 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:45.896350 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0b181c6-dabd-4fef-970b-d3cba8ca9882 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:45.897907 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0b181c6-dabd-4fef-970b-d3cba8ca9882 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:45.898530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0b181c6-dabd-4fef-970b-d3cba8ca9882 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:45.931099 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-a0b181c6-dabd-4fef-970b-d3cba8ca9882 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] HTTP exception thrown: Instance 292af9de-46da-4a11-a3af-dfb0cd903d9d could not be found. Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a0b181c6-dabd-4fef-970b-d3cba8ca9882 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Request method failure captured: Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d HTTP/1.1 Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5drePxDZESeQVGolrF7TjC3nByQnCYdrUD8KtxuVSaKFKmX33oi79rCmGmc4jKipjCwAOK-n3p13b4O7f7FnCNYFRz2XPQSqvqWJNA0rbgAebHq7llgL8AO5lTBFmV36n14CUNGC-vcsVK5wzSSokeolbDlBruJJt_nULE-G0R6AONg Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.54 Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 43e3b88e39c44bfba92d40ff5971a7a8 Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerShowV254Test-1616963126 Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/43e3b88e39c44bfba92d40ff5971a7a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/43e3b88e39c44bfba92d40ff5971a7a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/43e3b88e39c44bfba92d40ff5971a7a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_43e3b88e39c44bfba92d40ff5971a7a8", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerShowV254Test-1616963126 Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 43e3b88e39c44bfba92d40ff5971a7a8 Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerShowV254Test-1616963126 Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerShowV254Test-1616963126-project Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 9bd76f16e0104a7ead477c3292725c27 Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerShowV254Test-1616963126-project Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 292af9de-46da-4a11-a3af-dfb0cd903d9d could not be found. Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '292af9de-46da-4a11-a3af-dfb0cd903d9d'} Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 292af9de-46da-4a11-a3af-dfb0cd903d9d could not be found. Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 292af9de-46da-4a11-a3af-dfb0cd903d9d could not be found. Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:45.934555 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:45.939450 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:45.939450 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:45.939450 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:45.939450 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:45.939450 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:45.939450 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 292af9de-46da-4a11-a3af-dfb0cd903d9d could not be found. Jul 31 01:29:45.939450 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:45.942821 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a0b181c6-dabd-4fef-970b-d3cba8ca9882 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] Returning 404 to user: Instance 292af9de-46da-4a11-a3af-dfb0cd903d9d could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:45.948840 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a0b181c6-dabd-4fef-970b-d3cba8ca9882 tempest-ServerShowV254Test-1616963126 tempest-ServerShowV254Test-1616963126-project] 10.222.0.45 "GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d" status: 404 len: 111 microversion: 2.54 time: 0.071692 Jul 31 01:29:45.949421 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2143/4260] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:29:45 2022] GET /compute/v2.1/servers/292af9de-46da-4a11-a3af-dfb0cd903d9d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:29:46.154242 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-9a94e871-2053-4c4c-81bf-260c26e3eeec tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:29:46.154749 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-9a94e871-2053-4c4c-81bf-260c26e3eeec tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:29:46.155167 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-9a94e871-2053-4c4c-81bf-260c26e3eeec tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:29:46.155611 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-9a94e871-2053-4c4c-81bf-260c26e3eeec tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:29:46.156034 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-9a94e871-2053-4c4c-81bf-260c26e3eeec tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:29:46.177380 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a94e871-2053-4c4c-81bf-260c26e3eeec tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:46.177881 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a94e871-2053-4c4c-81bf-260c26e3eeec tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:46.184251 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a94e871-2053-4c4c-81bf-260c26e3eeec tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:46.186281 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a94e871-2053-4c4c-81bf-260c26e3eeec tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:46.266766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9a94e871-2053-4c4c-81bf-260c26e3eeec tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:46.303017 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9a94e871-2053-4c4c-81bf-260c26e3eeec tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for user 159706f59a12427f9a3c03fa31f712f3 and project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:46.380697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9a94e871-2053-4c4c-81bf-260c26e3eeec tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:29:46.383363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9a94e871-2053-4c4c-81bf-260c26e3eeec tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:29:46.651464 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-80786991-3ce1-4ff4-b051-197f636ed552 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:46.652727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-80786991-3ce1-4ff4-b051-197f636ed552 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:46.671012 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9a94e871-2053-4c4c-81bf-260c26e3eeec tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.167461 Jul 31 01:29:46.677391 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2118/4261] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:29:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:29:46.678552 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80786991-3ce1-4ff4-b051-197f636ed552 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:46.679033 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80786991-3ce1-4ff4-b051-197f636ed552 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:46.679874 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80786991-3ce1-4ff4-b051-197f636ed552 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:46.686285 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80786991-3ce1-4ff4-b051-197f636ed552 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:46.699755 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7f4e98dc-b42d-4f09-abbb-a536365c5f85 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:46.703321 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7f4e98dc-b42d-4f09-abbb-a536365c5f85 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:46.869484 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7f4e98dc-b42d-4f09-abbb-a536365c5f85 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:29:47.812607 n-d-master-1 devstack@n-api.service[119474]: INFO nova.scheduler.client.report [None req-7f4e98dc-b42d-4f09-abbb-a536365c5f85 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Deleted allocations for instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a Jul 31 01:29:47.851113 n-d-master-1 devstack@n-api.service[119474]: INFO nova.compute.api [None req-7f4e98dc-b42d-4f09-abbb-a536365c5f85 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a] Instance Mapping does not exist while attempting local delete cleanup. Jul 31 01:29:47.852826 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7f4e98dc-b42d-4f09-abbb-a536365c5f85 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a" status: 204 len: 0 microversion: 2.1 time: 1.167889 Jul 31 01:29:47.864087 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2119/4262] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:29:46 2022] DELETE /compute/v2.1/servers/6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a => generated 0 bytes in 1171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:29:47.876888 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3bd58d70-24c0-4598-9860-7614c92d98a2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:47.877827 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3bd58d70-24c0-4598-9860-7614c92d98a2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:47.900161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3bd58d70-24c0-4598-9860-7614c92d98a2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:47.900881 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3bd58d70-24c0-4598-9860-7614c92d98a2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:47.906347 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3bd58d70-24c0-4598-9860-7614c92d98a2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:47.907280 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3bd58d70-24c0-4598-9860-7614c92d98a2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:48.007038 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-80786991-3ce1-4ff4-b051-197f636ed552 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:48.026047 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-80786991-3ce1-4ff4-b051-197f636ed552 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1511 microversion: 2.1 time: 1.376899 Jul 31 01:29:48.030504 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2144/4263] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:46 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1511 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:48.050770 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a54bef1b-b33e-433e-9dc9-bd740b61e336 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:48.055758 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a54bef1b-b33e-433e-9dc9-bd740b61e336 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:48.069200 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-a54bef1b-b33e-433e-9dc9-bd740b61e336 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a54bef1b-b33e-433e-9dc9-bd740b61e336 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a HTTP/1.1 Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a'} Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:48.071710 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:48.076189 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:48.076189 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:48.076189 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. Jul 31 01:29:48.076189 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:48.079195 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a54bef1b-b33e-433e-9dc9-bd740b61e336 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:48.080678 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a54bef1b-b33e-433e-9dc9-bd740b61e336 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a" status: 404 len: 111 microversion: 2.1 time: 0.047961 Jul 31 01:29:48.081505 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2145/4264] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:48 2022] GET /compute/v2.1/servers/6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:29:48.286497 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4900a092-10e6-4773-982d-b1d57edd37c3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1945080010", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "ce8b5cb4-aa2f-4dfd-abb4-9273e2a34e90"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:48.290943 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3bd58d70-24c0-4598-9860-7614c92d98a2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:48.303325 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3bd58d70-24c0-4598-9860-7614c92d98a2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1394 microversion: 2.1 time: 0.435793 Jul 31 01:29:48.320368 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2120/4265] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:47 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1394 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:48.444675 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-4900a092-10e6-4773-982d-b1d57edd37c3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] validate_networks() for [('ce8b5cb4-aa2f-4dfd-abb4-9273e2a34e90', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:29:49.054963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d03c4c98-a3db-4944-9563-91c96ac79afe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:49.061144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d03c4c98-a3db-4944-9563-91c96ac79afe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:49.077572 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d03c4c98-a3db-4944-9563-91c96ac79afe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:49.084513 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d03c4c98-a3db-4944-9563-91c96ac79afe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:49.097478 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d03c4c98-a3db-4944-9563-91c96ac79afe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:49.107050 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d03c4c98-a3db-4944-9563-91c96ac79afe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:49.775663 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d03c4c98-a3db-4944-9563-91c96ac79afe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:49.799826 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d03c4c98-a3db-4944-9563-91c96ac79afe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1511 microversion: 2.1 time: 0.754118 Jul 31 01:29:49.803079 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2121/4266] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:49 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1511 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:49.821080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95df91e6-d579-4c70-b0c7-cefca1ff4128 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:49.822047 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-95df91e6-d579-4c70-b0c7-cefca1ff4128 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:49.847671 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95df91e6-d579-4c70-b0c7-cefca1ff4128 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:49.854743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95df91e6-d579-4c70-b0c7-cefca1ff4128 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:49.857868 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95df91e6-d579-4c70-b0c7-cefca1ff4128 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:49.864454 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95df91e6-d579-4c70-b0c7-cefca1ff4128 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:51.470838 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4900a092-10e6-4773-982d-b1d57edd37c3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:29:51.472640 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4900a092-10e6-4773-982d-b1d57edd37c3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:29:51.473843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4900a092-10e6-4773-982d-b1d57edd37c3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:29:51.476747 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4900a092-10e6-4773-982d-b1d57edd37c3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:29:51.478155 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-4900a092-10e6-4773-982d-b1d57edd37c3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:29:51.518954 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4900a092-10e6-4773-982d-b1d57edd37c3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:51.520888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4900a092-10e6-4773-982d-b1d57edd37c3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:51.524041 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4900a092-10e6-4773-982d-b1d57edd37c3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:51.525484 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4900a092-10e6-4773-982d-b1d57edd37c3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:51.569823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-4900a092-10e6-4773-982d-b1d57edd37c3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:29:51.586200 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-4900a092-10e6-4773-982d-b1d57edd37c3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for user 159706f59a12427f9a3c03fa31f712f3 and project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:29:51.618244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4900a092-10e6-4773-982d-b1d57edd37c3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:29:51.623487 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4900a092-10e6-4773-982d-b1d57edd37c3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:29:51.681778 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-95df91e6-d579-4c70-b0c7-cefca1ff4128 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:51.761196 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-95df91e6-d579-4c70-b0c7-cefca1ff4128 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1394 microversion: 2.1 time: 1.953853 Jul 31 01:29:51.780219 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2122/4267] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:49 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1394 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:51.817542 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e8352489-a9b6-4d8a-aa2b-b0ab6c6e7207 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:51.825246 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e8352489-a9b6-4d8a-aa2b-b0ab6c6e7207 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:51.860124 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:51.876971 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8352489-a9b6-4d8a-aa2b-b0ab6c6e7207 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:51.882614 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8352489-a9b6-4d8a-aa2b-b0ab6c6e7207 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:51.889990 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8352489-a9b6-4d8a-aa2b-b0ab6c6e7207 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:51.892586 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8352489-a9b6-4d8a-aa2b-b0ab6c6e7207 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:51.974908 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4900a092-10e6-4773-982d-b1d57edd37c3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.697335 Jul 31 01:29:52.000222 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2146/4268] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:29:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:29:52.043270 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc01b907-8b16-4e58-abbc-9a40d9bc0767 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:52.054093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc01b907-8b16-4e58-abbc-9a40d9bc0767 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:52.685003 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fc01b907-8b16-4e58-abbc-9a40d9bc0767 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:52.714055 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc01b907-8b16-4e58-abbc-9a40d9bc0767 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1221 microversion: 2.1 time: 0.709068 Jul 31 01:29:52.716701 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2147/4269] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:52 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1221 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:52.991164 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-46620fff-db8e-46d1-b102-40114e770a44 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Action: 'create', calling method: .version_select at 0x7fede57bfa60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-564863069", "metadata": {"Type": "work"}}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-46620fff-db8e-46d1-b102-40114e770a44 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Request method failure captured: Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 121 Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dsP7MlI9Io3P-A5sH_gKtbIWvLTqBPYIfWhmWL3YRUXw6b2X2ilUqJGzohSXiEh4if39TkYhE3J8e9NUDihs_M7oLcRhCpDocYKvfde4RriSw8sMhhxv5l5CMPxm7HBOzhaRLE-C8LRhfQCmomS3kb9Hs2GaBzl0QesVZhJ4YaytzE Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 6b18417fd9914b36b3dc3dc6b5a437f7 Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6b18417fd9914b36b3dc3dc6b5a437f7", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 6b18417fd9914b36b3dc3dc6b5a437f7 Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-VolumesNegativeTest-576842834-project Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f668c4b251384c9f96ab05437ed2240e Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-VolumesNegativeTest-576842834-project Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-564863069", "metadata": {"Type": "work"}}} Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: method: Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-564863069', 'metadata': {'Type': 'work'}}}} Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi '#$%' Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:29:53.012302 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:29:53.016682 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 31 01:29:53.016682 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.016682 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:53.016682 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.016682 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.016682 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:53.016682 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:53.016682 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:29:53.016682 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:29:53.016682 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 31 01:29:53.016682 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.016682 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-46620fff-db8e-46d1-b102-40114e770a44 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:53.016682 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-46620fff-db8e-46d1-b102-40114e770a44 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.260965 Jul 31 01:29:53.027505 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2148/4270] 10.222.0.45 () {60 vars in 1156 bytes} [Sun Jul 31 01:29:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 273 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:29:53.040549 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6d52123b-111e-4fbd-a6ec-abc5b4a31eb2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:53.050474 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6d52123b-111e-4fbd-a6ec-abc5b4a31eb2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:53.103544 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d52123b-111e-4fbd-a6ec-abc5b4a31eb2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:53.105573 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d52123b-111e-4fbd-a6ec-abc5b4a31eb2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:53.107725 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d52123b-111e-4fbd-a6ec-abc5b4a31eb2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:53.109540 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d52123b-111e-4fbd-a6ec-abc5b4a31eb2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:53.118792 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e8352489-a9b6-4d8a-aa2b-b0ab6c6e7207 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:53.133764 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e8352489-a9b6-4d8a-aa2b-b0ab6c6e7207 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1532 microversion: 2.1 time: 1.346974 Jul 31 01:29:53.140316 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2123/4271] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:51 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1532 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:53.157805 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-abfee61b-68f8-47df-8aae-08fc50ed298b req-c90db829-a309-4a42-8d3a-4eb936cff6cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d515738b-e8ce-4336-8278-1ddd9cd032d9", "tag": "83ab76da-4e9c-430c-9650-352f45e6da6b"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:53.186286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-abfee61b-68f8-47df-8aae-08fc50ed298b req-c90db829-a309-4a42-8d3a-4eb936cff6cb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:53.186996 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-abfee61b-68f8-47df-8aae-08fc50ed298b req-c90db829-a309-4a42-8d3a-4eb936cff6cb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:53.203452 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-abfee61b-68f8-47df-8aae-08fc50ed298b req-c90db829-a309-4a42-8d3a-4eb936cff6cb service nova] Creating event network-changed:83ab76da-4e9c-430c-9650-352f45e6da6b for instance d515738b-e8ce-4336-8278-1ddd9cd032d9 on n-h1-master-1 Jul 31 01:29:53.211928 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-abfee61b-68f8-47df-8aae-08fc50ed298b req-c90db829-a309-4a42-8d3a-4eb936cff6cb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070037 Jul 31 01:29:53.212801 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2124/4272] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:29:53.220879 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e0710bb3-6252-463a-b5d2-e769400911ad tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Action: 'create', calling method: .version_select at 0x7fedeaa539d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-542944978", "metadata": {"Type": "work"}}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e0710bb3-6252-463a-b5d2-e769400911ad tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Request method failure captured: Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 119 Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dsP7MlI9Io3P-A5sH_gKtbIWvLTqBPYIfWhmWL3YRUXw6b2X2ilUqJGzohSXiEh4if39TkYhE3J8e9NUDihs_M7oLcRhCpDocYKvfde4RriSw8sMhhxv5l5CMPxm7HBOzhaRLE-C8LRhfQCmomS3kb9Hs2GaBzl0QesVZhJ4YaytzE Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6b18417fd9914b36b3dc3dc6b5a437f7 Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6b18417fd9914b36b3dc3dc6b5a437f7", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6b18417fd9914b36b3dc3dc6b5a437f7 Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesNegativeTest-576842834-project Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f668c4b251384c9f96ab05437ed2240e Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesNegativeTest-576842834-project Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-542944978", "metadata": {"Type": "work"}}} Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-542944978', 'metadata': {'Type': 'work'}}}} Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi '0' Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:29:53.228620 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:29:53.232679 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 31 01:29:53.232679 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.232679 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:53.232679 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.232679 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.232679 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:53.232679 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:53.232679 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:29:53.232679 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:29:53.232679 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 31 01:29:53.232679 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.245155 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e0710bb3-6252-463a-b5d2-e769400911ad tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:53.246460 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e0710bb3-6252-463a-b5d2-e769400911ad tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.032287 Jul 31 01:29:53.247281 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2125/4273] 10.222.0.45 () {60 vars in 1156 bytes} [Sun Jul 31 01:29:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:29:53.262602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-504a25af-129f-4337-b9bf-2d2fba0b8015 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Action: 'create', calling method: .version_select at 0x7fedeaa09a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1019671379", "metadata": {"Type": "work"}}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-504a25af-129f-4337-b9bf-2d2fba0b8015 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Request method failure captured: Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 119 Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dsP7MlI9Io3P-A5sH_gKtbIWvLTqBPYIfWhmWL3YRUXw6b2X2ilUqJGzohSXiEh4if39TkYhE3J8e9NUDihs_M7oLcRhCpDocYKvfde4RriSw8sMhhxv5l5CMPxm7HBOzhaRLE-C8LRhfQCmomS3kb9Hs2GaBzl0QesVZhJ4YaytzE Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6b18417fd9914b36b3dc3dc6b5a437f7 Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6b18417fd9914b36b3dc3dc6b5a437f7", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6b18417fd9914b36b3dc3dc6b5a437f7 Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesNegativeTest-576842834-project Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f668c4b251384c9f96ab05437ed2240e Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesNegativeTest-576842834-project Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1019671379", "metadata": {"Type": "work"}}} Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1019671379', 'metadata': {'Type': 'work'}}}} Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi '' Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:29:53.269190 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:29:53.273215 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 31 01:29:53.273215 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.273215 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:53.273215 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.273215 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.273215 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:53.273215 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:53.273215 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:29:53.273215 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:29:53.273215 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 31 01:29:53.273215 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.278353 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-504a25af-129f-4337-b9bf-2d2fba0b8015 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:53.282701 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-504a25af-129f-4337-b9bf-2d2fba0b8015 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027619 Jul 31 01:29:53.283632 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2126/4274] 10.222.0.45 () {60 vars in 1156 bytes} [Sun Jul 31 01:29:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 31 01:29:53.303371 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3004af03-78f3-4607-bcf2-de8f7151bd51 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Calling method '.version_select at 0x7fede59940d0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:53.439262 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-3004af03-78f3-4607-bcf2-de8f7151bd51 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] HTTP exception thrown: Volume tempest-invalid-821884526 could not be found. Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3004af03-78f3-4607-bcf2-de8f7151bd51 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Request method failure captured: Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-821884526 HTTP/1.1 Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dsP7MlI9Io3P-A5sH_gKtbIWvLTqBPYIfWhmWL3YRUXw6b2X2ilUqJGzohSXiEh4if39TkYhE3J8e9NUDihs_M7oLcRhCpDocYKvfde4RriSw8sMhhxv5l5CMPxm7HBOzhaRLE-C8LRhfQCmomS3kb9Hs2GaBzl0QesVZhJ4YaytzE Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6b18417fd9914b36b3dc3dc6b5a437f7 Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6b18417fd9914b36b3dc3dc6b5a437f7", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6b18417fd9914b36b3dc3dc6b5a437f7 Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesNegativeTest-576842834-project Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f668c4b251384c9f96ab05437ed2240e Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesNegativeTest-576842834-project Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: exception: Volume tempest-invalid-821884526 could not be found. Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'tempest-invalid-821884526'} Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-821884526 could not be found. (HTTP 404) (Request-ID: req-112d39a1-328d-44d4-b042-2d5368f7dc1c) Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:29:53.441408 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-821884526 could not be found. Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-821884526 could not be found. Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-821884526 could not be found. Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3004af03-78f3-4607-bcf2-de8f7151bd51 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Returning 404 to user: Volume tempest-invalid-821884526 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3004af03-78f3-4607-bcf2-de8f7151bd51 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-821884526" status: 404 len: 98 microversion: 2.1 time: 0.145959 Jul 31 01:29:53.456082 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2127/4275] 10.222.0.45 () {58 vars in 1215 bytes} [Sun Jul 31 01:29:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-821884526 => generated 98 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:29:53.465700 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b1a26e7c-24d6-4b01-a516-c5d60a47dfc1 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003706 Jul 31 01:29:53.465700 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2128/4276] 10.222.0.45 () {58 vars in 1140 bytes} [Sun Jul 31 01:29:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 31 01:29:53.482656 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d92af8de-85c6-48d0-9c7a-47195ccbeeb8 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011096 Jul 31 01:29:53.494337 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2129/4277] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:29:53 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 31 01:29:53.513246 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6e942482-79bd-4ddf-a6c6-d9d94e5cb353 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Calling method '.version_select at 0x7fede58e9c10>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:53.700252 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-6e942482-79bd-4ddf-a6c6-d9d94e5cb353 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] HTTP exception thrown: Volume 9f4085d4-1686-4a79-b14b-3464707e9525 could not be found. Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6e942482-79bd-4ddf-a6c6-d9d94e5cb353 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Request method failure captured: Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/os-volumes/9f4085d4-1686-4a79-b14b-3464707e9525 HTTP/1.1 Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dsP7MlI9Io3P-A5sH_gKtbIWvLTqBPYIfWhmWL3YRUXw6b2X2ilUqJGzohSXiEh4if39TkYhE3J8e9NUDihs_M7oLcRhCpDocYKvfde4RriSw8sMhhxv5l5CMPxm7HBOzhaRLE-C8LRhfQCmomS3kb9Hs2GaBzl0QesVZhJ4YaytzE Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6b18417fd9914b36b3dc3dc6b5a437f7 Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6b18417fd9914b36b3dc3dc6b5a437f7", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6b18417fd9914b36b3dc3dc6b5a437f7 Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesNegativeTest-576842834-project Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f668c4b251384c9f96ab05437ed2240e Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesNegativeTest-576842834-project Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: exception: Volume 9f4085d4-1686-4a79-b14b-3464707e9525 could not be found. Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '9f4085d4-1686-4a79-b14b-3464707e9525'} Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9f4085d4-1686-4a79-b14b-3464707e9525 could not be found. (HTTP 404) (Request-ID: req-d97188b9-8437-4a4b-933a-aafda460c9f6) Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 01:29:53.704164 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9f4085d4-1686-4a79-b14b-3464707e9525 could not be found. Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9f4085d4-1686-4a79-b14b-3464707e9525 could not be found. Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9f4085d4-1686-4a79-b14b-3464707e9525 could not be found. Jul 31 01:29:53.712671 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.738588 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6e942482-79bd-4ddf-a6c6-d9d94e5cb353 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Returning 404 to user: Volume 9f4085d4-1686-4a79-b14b-3464707e9525 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:53.738588 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6e942482-79bd-4ddf-a6c6-d9d94e5cb353 tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/9f4085d4-1686-4a79-b14b-3464707e9525" status: 404 len: 109 microversion: 2.1 time: 0.227480 Jul 31 01:29:53.738588 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2130/4278] 10.222.0.45 () {58 vars in 1248 bytes} [Sun Jul 31 01:29:53 2022] DELETE /compute/v2.1/os-volumes/9f4085d4-1686-4a79-b14b-3464707e9525 => generated 109 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:29:53.741841 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-99eca3f8-ef0b-48e2-96f8-b68895e5010a tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Calling method '.version_select at 0x7fede4fadb80>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:53.839306 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-99eca3f8-ef0b-48e2-96f8-b68895e5010a tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] HTTP exception thrown: Volume c57c28c2-3659-4fcf-90c7-b1b8813c34dc could not be found. Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-99eca3f8-ef0b-48e2-96f8-b68895e5010a tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Request method failure captured: Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/os-volumes/c57c28c2-3659-4fcf-90c7-b1b8813c34dc HTTP/1.1 Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dsP7MlI9Io3P-A5sH_gKtbIWvLTqBPYIfWhmWL3YRUXw6b2X2ilUqJGzohSXiEh4if39TkYhE3J8e9NUDihs_M7oLcRhCpDocYKvfde4RriSw8sMhhxv5l5CMPxm7HBOzhaRLE-C8LRhfQCmomS3kb9Hs2GaBzl0QesVZhJ4YaytzE Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6b18417fd9914b36b3dc3dc6b5a437f7 Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6b18417fd9914b36b3dc3dc6b5a437f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6b18417fd9914b36b3dc3dc6b5a437f7", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6b18417fd9914b36b3dc3dc6b5a437f7 Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesNegativeTest-576842834 Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesNegativeTest-576842834-project Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f668c4b251384c9f96ab05437ed2240e Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesNegativeTest-576842834-project Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: method: Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: exception: Volume c57c28c2-3659-4fcf-90c7-b1b8813c34dc could not be found. Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'c57c28c2-3659-4fcf-90c7-b1b8813c34dc'} Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c57c28c2-3659-4fcf-90c7-b1b8813c34dc could not be found. (HTTP 404) (Request-ID: req-586d820b-a5c8-43cb-8813-96efbdeca4bd) Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 01:29:53.841273 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c57c28c2-3659-4fcf-90c7-b1b8813c34dc could not be found. Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c57c28c2-3659-4fcf-90c7-b1b8813c34dc could not be found. Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c57c28c2-3659-4fcf-90c7-b1b8813c34dc could not be found. Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-99eca3f8-ef0b-48e2-96f8-b68895e5010a tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] Returning 404 to user: Volume c57c28c2-3659-4fcf-90c7-b1b8813c34dc could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-99eca3f8-ef0b-48e2-96f8-b68895e5010a tempest-VolumesNegativeTest-576842834 tempest-VolumesNegativeTest-576842834-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/c57c28c2-3659-4fcf-90c7-b1b8813c34dc" status: 404 len: 109 microversion: 2.1 time: 0.105522 Jul 31 01:29:53.846244 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2131/4279] 10.222.0.45 () {58 vars in 1245 bytes} [Sun Jul 31 01:29:53 2022] GET /compute/v2.1/os-volumes/c57c28c2-3659-4fcf-90c7-b1b8813c34dc => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:29:53.869543 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-abd71b14-5da1-4602-81c3-12c55c6d5c1f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:53.871378 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-abd71b14-5da1-4602-81c3-12c55c6d5c1f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:53.913103 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abd71b14-5da1-4602-81c3-12c55c6d5c1f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:53.913563 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abd71b14-5da1-4602-81c3-12c55c6d5c1f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:53.930164 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abd71b14-5da1-4602-81c3-12c55c6d5c1f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:53.934218 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abd71b14-5da1-4602-81c3-12c55c6d5c1f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:54.149859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-abd71b14-5da1-4602-81c3-12c55c6d5c1f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:54.183439 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-abd71b14-5da1-4602-81c3-12c55c6d5c1f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1217 microversion: 2.1 time: 0.338991 Jul 31 01:29:54.186184 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2132/4280] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:53 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1217 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:54.205798 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9e668dc5-73db-4f4f-95b3-868056351abb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:54.208104 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9e668dc5-73db-4f4f-95b3-868056351abb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:54.216283 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6d52123b-111e-4fbd-a6ec-abc5b4a31eb2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:54.226615 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e668dc5-73db-4f4f-95b3-868056351abb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:54.228782 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e668dc5-73db-4f4f-95b3-868056351abb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:54.231181 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e668dc5-73db-4f4f-95b3-868056351abb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:54.232995 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e668dc5-73db-4f4f-95b3-868056351abb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:54.236328 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6d52123b-111e-4fbd-a6ec-abc5b4a31eb2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1394 microversion: 2.1 time: 1.206890 Jul 31 01:29:54.253721 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2149/4281] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:53 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1394 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:54.273213 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:55.209091 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-aebc2893-b450-4056-8a5c-f7c850a26d0a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:55.210026 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-aebc2893-b450-4056-8a5c-f7c850a26d0a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:55.211551 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9e668dc5-73db-4f4f-95b3-868056351abb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:55.230545 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aebc2893-b450-4056-8a5c-f7c850a26d0a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:55.231778 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aebc2893-b450-4056-8a5c-f7c850a26d0a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:55.237990 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aebc2893-b450-4056-8a5c-f7c850a26d0a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:55.242004 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aebc2893-b450-4056-8a5c-f7c850a26d0a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:55.242796 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9e668dc5-73db-4f4f-95b3-868056351abb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1527 microversion: 2.1 time: 1.048429 Jul 31 01:29:55.245332 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2133/4282] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:54 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1527 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:55.264917 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7b97af31-989b-4b76-a328-390eba0de714 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:55.273492 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7b97af31-989b-4b76-a328-390eba0de714 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:55.307706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b97af31-989b-4b76-a328-390eba0de714 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:55.308550 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b97af31-989b-4b76-a328-390eba0de714 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:55.312374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b97af31-989b-4b76-a328-390eba0de714 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:55.317619 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b97af31-989b-4b76-a328-390eba0de714 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:55.615847 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-aebc2893-b450-4056-8a5c-f7c850a26d0a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:55.627278 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-aebc2893-b450-4056-8a5c-f7c850a26d0a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1279 microversion: 2.1 time: 0.420897 Jul 31 01:29:55.635066 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2150/4283] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:55 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1279 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:56.130503 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7b97af31-989b-4b76-a328-390eba0de714 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:56.147936 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7b97af31-989b-4b76-a328-390eba0de714 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1394 microversion: 2.1 time: 0.882012 Jul 31 01:29:56.155441 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2134/4284] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:55 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1394 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:56.266333 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0973c066-2af6-49c4-8963-8c30b1966400 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:56.266958 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0973c066-2af6-49c4-8963-8c30b1966400 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:56.281521 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0973c066-2af6-49c4-8963-8c30b1966400 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:56.284204 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0973c066-2af6-49c4-8963-8c30b1966400 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:56.293772 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0973c066-2af6-49c4-8963-8c30b1966400 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:56.295599 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0973c066-2af6-49c4-8963-8c30b1966400 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:56.661195 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1a32c3ce-a709-492a-b181-fc937fd6830f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:56.663084 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1a32c3ce-a709-492a-b181-fc937fd6830f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:56.665743 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:56.693863 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1a32c3ce-a709-492a-b181-fc937fd6830f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:56.694655 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1a32c3ce-a709-492a-b181-fc937fd6830f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:56.695738 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1a32c3ce-a709-492a-b181-fc937fd6830f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:56.696378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1a32c3ce-a709-492a-b181-fc937fd6830f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:57.132735 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1a32c3ce-a709-492a-b181-fc937fd6830f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:57.141262 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1a32c3ce-a709-492a-b181-fc937fd6830f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1279 microversion: 2.1 time: 0.488650 Jul 31 01:29:57.149742 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2135/4285] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:56 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1279 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:57.172274 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b14f542a-ebd2-4d5d-825b-84e1ab5b5e79 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:57.173198 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b14f542a-ebd2-4d5d-825b-84e1ab5b5e79 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:57.175307 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=26 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:57.185550 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b14f542a-ebd2-4d5d-825b-84e1ab5b5e79 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:57.188010 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b14f542a-ebd2-4d5d-825b-84e1ab5b5e79 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:57.189050 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b14f542a-ebd2-4d5d-825b-84e1ab5b5e79 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:57.195329 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b14f542a-ebd2-4d5d-825b-84e1ab5b5e79 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:57.386823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0973c066-2af6-49c4-8963-8c30b1966400 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:57.396486 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0973c066-2af6-49c4-8963-8c30b1966400 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1527 microversion: 2.1 time: 1.134192 Jul 31 01:29:57.397620 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2151/4286] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:56 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1527 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:58.015227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b14f542a-ebd2-4d5d-825b-84e1ab5b5e79 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:58.056393 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b14f542a-ebd2-4d5d-825b-84e1ab5b5e79 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1394 microversion: 2.1 time: 0.881916 Jul 31 01:29:58.077478 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2136/4287] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:57 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1394 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:58.167960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-09dd5e7e-3036-4f20-9eea-e3af5b84cceb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:58.168316 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-09dd5e7e-3036-4f20-9eea-e3af5b84cceb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:58.193848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09dd5e7e-3036-4f20-9eea-e3af5b84cceb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:58.194313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09dd5e7e-3036-4f20-9eea-e3af5b84cceb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:58.195124 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09dd5e7e-3036-4f20-9eea-e3af5b84cceb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:58.208923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09dd5e7e-3036-4f20-9eea-e3af5b84cceb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:58.418202 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bc1f262c-7a6f-4ccb-a212-002122a59c8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:58.419122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bc1f262c-7a6f-4ccb-a212-002122a59c8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:58.449838 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc1f262c-7a6f-4ccb-a212-002122a59c8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:58.455694 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc1f262c-7a6f-4ccb-a212-002122a59c8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:58.457497 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc1f262c-7a6f-4ccb-a212-002122a59c8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:58.459324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc1f262c-7a6f-4ccb-a212-002122a59c8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:58.732628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-09dd5e7e-3036-4f20-9eea-e3af5b84cceb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:58.741181 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-09dd5e7e-3036-4f20-9eea-e3af5b84cceb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1279 microversion: 2.1 time: 0.578400 Jul 31 01:29:58.741994 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2152/4288] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:58 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1279 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:29:59.083793 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cacc27be-1758-47d7-9a5a-266e423e15e4 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:59.084469 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cacc27be-1758-47d7-9a5a-266e423e15e4 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:59.093319 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cacc27be-1758-47d7-9a5a-266e423e15e4 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:59.095466 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cacc27be-1758-47d7-9a5a-266e423e15e4 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:59.096332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cacc27be-1758-47d7-9a5a-266e423e15e4 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:59.096789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cacc27be-1758-47d7-9a5a-266e423e15e4 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:59.229318 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bc1f262c-7a6f-4ccb-a212-002122a59c8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:59.242962 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bc1f262c-7a6f-4ccb-a212-002122a59c8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1527 microversion: 2.1 time: 0.828562 Jul 31 01:29:59.256745 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2137/4289] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:58 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1527 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:59.546673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-970f1d09-f686-4e4a-9345-aa682effc7d5 req-1d592274-614c-4a38-b730-2c3ba9a83252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76757e35-eebd-46de-a012-82bd864fd1d2", "name": "network-vif-plugged", "status": "completed", "tag": "a84852a6-e79d-4e96-9273-a29f94e85006"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:29:59.577239 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-970f1d09-f686-4e4a-9345-aa682effc7d5 req-1d592274-614c-4a38-b730-2c3ba9a83252 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:59.579265 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-970f1d09-f686-4e4a-9345-aa682effc7d5 req-1d592274-614c-4a38-b730-2c3ba9a83252 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:59.625789 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-970f1d09-f686-4e4a-9345-aa682effc7d5 req-1d592274-614c-4a38-b730-2c3ba9a83252 service nova] Creating event network-vif-plugged:a84852a6-e79d-4e96-9273-a29f94e85006 for instance 76757e35-eebd-46de-a012-82bd864fd1d2 on n-h1-master-1 Jul 31 01:29:59.636762 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-970f1d09-f686-4e4a-9345-aa682effc7d5 req-1d592274-614c-4a38-b730-2c3ba9a83252 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093570 Jul 31 01:29:59.642667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cacc27be-1758-47d7-9a5a-266e423e15e4 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:29:59.651763 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cacc27be-1758-47d7-9a5a-266e423e15e4 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1394 microversion: 2.1 time: 0.571925 Jul 31 01:29:59.654411 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2138/4290] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:29:59.655178 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2153/4291] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:59 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1394 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:29:59.769215 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fab8504c-a778-47fc-bcf9-1e32e0decd46 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:29:59.770120 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fab8504c-a778-47fc-bcf9-1e32e0decd46 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:29:59.787920 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fab8504c-a778-47fc-bcf9-1e32e0decd46 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:59.794910 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fab8504c-a778-47fc-bcf9-1e32e0decd46 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:29:59.796623 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fab8504c-a778-47fc-bcf9-1e32e0decd46 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:29:59.803999 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fab8504c-a778-47fc-bcf9-1e32e0decd46 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:00.270074 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b95c4074-0975-41a9-9798-2e6acfd67f1b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:00.270840 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b95c4074-0975-41a9-9798-2e6acfd67f1b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:00.293229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b95c4074-0975-41a9-9798-2e6acfd67f1b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:00.297333 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b95c4074-0975-41a9-9798-2e6acfd67f1b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:00.300727 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b95c4074-0975-41a9-9798-2e6acfd67f1b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:00.302069 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b95c4074-0975-41a9-9798-2e6acfd67f1b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:01.101507 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fab8504c-a778-47fc-bcf9-1e32e0decd46 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:01.111992 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fab8504c-a778-47fc-bcf9-1e32e0decd46 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1279 microversion: 2.1 time: 1.350897 Jul 31 01:30:01.113046 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2139/4292] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:29:59 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1279 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:01.119987 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-de70e7a9-96ce-40d6-add3-9fb339b78c57 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:01.120798 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-de70e7a9-96ce-40d6-add3-9fb339b78c57 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:01.128386 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-de70e7a9-96ce-40d6-add3-9fb339b78c57 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:01.132411 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-de70e7a9-96ce-40d6-add3-9fb339b78c57 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:01.149071 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-de70e7a9-96ce-40d6-add3-9fb339b78c57 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:01.149922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-de70e7a9-96ce-40d6-add3-9fb339b78c57 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:01.546696 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:02.706598 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:02.782113 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-de70e7a9-96ce-40d6-add3-9fb339b78c57 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:02.801477 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b95c4074-0975-41a9-9798-2e6acfd67f1b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:02.812368 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b95c4074-0975-41a9-9798-2e6acfd67f1b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1527 microversion: 2.1 time: 2.546078 Jul 31 01:30:02.815266 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-de70e7a9-96ce-40d6-add3-9fb339b78c57 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1394 microversion: 2.1 time: 1.700737 Jul 31 01:30:02.827790 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2140/4293] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:01 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1394 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:02.848337 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2154/4294] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:00 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1527 bytes in 2581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:30:02.891187 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dfb5eecc-9d06-40c3-840d-35a9b2fb5c08 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:02.893394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dfb5eecc-9d06-40c3-840d-35a9b2fb5c08 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:02.925507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dfb5eecc-9d06-40c3-840d-35a9b2fb5c08 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:02.926003 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dfb5eecc-9d06-40c3-840d-35a9b2fb5c08 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:02.929897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dfb5eecc-9d06-40c3-840d-35a9b2fb5c08 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:02.930355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dfb5eecc-9d06-40c3-840d-35a9b2fb5c08 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:03.549298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dfb5eecc-9d06-40c3-840d-35a9b2fb5c08 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:03.559787 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dfb5eecc-9d06-40c3-840d-35a9b2fb5c08 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1321 microversion: 2.1 time: 0.731423 Jul 31 01:30:03.560384 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2141/4295] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:02 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1321 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:03.843765 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-99724c50-ec67-4092-af00-f275bd17295c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:03.848213 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-99724c50-ec67-4092-af00-f275bd17295c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:03.857497 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-962c1073-d8a9-467a-96df-5b429cd488e9 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:03.858157 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-962c1073-d8a9-467a-96df-5b429cd488e9 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:03.864232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99724c50-ec67-4092-af00-f275bd17295c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:03.865615 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99724c50-ec67-4092-af00-f275bd17295c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:03.866161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-962c1073-d8a9-467a-96df-5b429cd488e9 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:03.866590 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-962c1073-d8a9-467a-96df-5b429cd488e9 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:03.867331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99724c50-ec67-4092-af00-f275bd17295c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:03.867478 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-962c1073-d8a9-467a-96df-5b429cd488e9 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:03.868177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99724c50-ec67-4092-af00-f275bd17295c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:03.889984 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-962c1073-d8a9-467a-96df-5b429cd488e9 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:04.670916 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-99724c50-ec67-4092-af00-f275bd17295c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:04.681300 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-99724c50-ec67-4092-af00-f275bd17295c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1527 microversion: 2.1 time: 0.845005 Jul 31 01:30:04.685982 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2155/4296] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:03 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1527 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:04.690904 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2861a7b9-184f-428c-9ab5-a1b724084bc8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:04.703511 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2861a7b9-184f-428c-9ab5-a1b724084bc8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:04.710304 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2861a7b9-184f-428c-9ab5-a1b724084bc8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:04.711262 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2861a7b9-184f-428c-9ab5-a1b724084bc8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:04.712257 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2861a7b9-184f-428c-9ab5-a1b724084bc8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:04.713268 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2861a7b9-184f-428c-9ab5-a1b724084bc8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:04.944363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-962c1073-d8a9-467a-96df-5b429cd488e9 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:04.959080 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-962c1073-d8a9-467a-96df-5b429cd488e9 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1394 microversion: 2.1 time: 1.100427 Jul 31 01:30:04.970218 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2142/4297] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:03 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1394 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:05.222298 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2861a7b9-184f-428c-9ab5-a1b724084bc8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:05.238094 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2861a7b9-184f-428c-9ab5-a1b724084bc8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1321 microversion: 2.1 time: 0.548555 Jul 31 01:30:05.243513 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2156/4298] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:04 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1321 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:05.520596 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-398dd38f-d818-404a-8bd8-e16cd974a1a0 req-856cb3f9-3659-4760-be66-471e1d903e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d515738b-e8ce-4336-8278-1ddd9cd032d9", "name": "network-vif-plugged", "status": "completed", "tag": "83ab76da-4e9c-430c-9650-352f45e6da6b"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:30:05.542245 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-398dd38f-d818-404a-8bd8-e16cd974a1a0 req-856cb3f9-3659-4760-be66-471e1d903e7d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:05.542459 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-398dd38f-d818-404a-8bd8-e16cd974a1a0 req-856cb3f9-3659-4760-be66-471e1d903e7d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:05.585791 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-398dd38f-d818-404a-8bd8-e16cd974a1a0 req-856cb3f9-3659-4760-be66-471e1d903e7d service nova] Creating event network-vif-plugged:83ab76da-4e9c-430c-9650-352f45e6da6b for instance d515738b-e8ce-4336-8278-1ddd9cd032d9 on n-h1-master-1 Jul 31 01:30:05.598232 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-398dd38f-d818-404a-8bd8-e16cd974a1a0 req-856cb3f9-3659-4760-be66-471e1d903e7d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077055 Jul 31 01:30:05.600466 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2143/4299] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:30:05.706704 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dc3c5f01-9a12-4d5b-8b27-b7d31f82f0e2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:05.707747 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dc3c5f01-9a12-4d5b-8b27-b7d31f82f0e2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:05.719579 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc3c5f01-9a12-4d5b-8b27-b7d31f82f0e2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:05.721412 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc3c5f01-9a12-4d5b-8b27-b7d31f82f0e2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:05.722801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc3c5f01-9a12-4d5b-8b27-b7d31f82f0e2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:05.723848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc3c5f01-9a12-4d5b-8b27-b7d31f82f0e2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:06.000873 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a020c4ea-add4-4fb0-b3d9-f83867be4a23 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:06.002717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a020c4ea-add4-4fb0-b3d9-f83867be4a23 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:06.027369 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a020c4ea-add4-4fb0-b3d9-f83867be4a23 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:06.034448 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a020c4ea-add4-4fb0-b3d9-f83867be4a23 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:06.041809 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a020c4ea-add4-4fb0-b3d9-f83867be4a23 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:06.042503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a020c4ea-add4-4fb0-b3d9-f83867be4a23 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:06.439480 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dc3c5f01-9a12-4d5b-8b27-b7d31f82f0e2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:06.454088 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dc3c5f01-9a12-4d5b-8b27-b7d31f82f0e2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1527 microversion: 2.1 time: 0.750358 Jul 31 01:30:06.474174 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2157/4300] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:05 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1527 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:30:06.500748 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d910dcf9-91c5-4d20-95f0-8d8cf0884f04 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:06.514980 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d910dcf9-91c5-4d20-95f0-8d8cf0884f04 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:06.575043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d910dcf9-91c5-4d20-95f0-8d8cf0884f04 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:06.576067 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d910dcf9-91c5-4d20-95f0-8d8cf0884f04 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:06.576919 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d910dcf9-91c5-4d20-95f0-8d8cf0884f04 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:06.578043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d910dcf9-91c5-4d20-95f0-8d8cf0884f04 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:06.655123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a020c4ea-add4-4fb0-b3d9-f83867be4a23 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:06.670328 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a020c4ea-add4-4fb0-b3d9-f83867be4a23 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1394 microversion: 2.1 time: 0.682367 Jul 31 01:30:06.671682 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2144/4301] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:05 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1394 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:07.039801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d910dcf9-91c5-4d20-95f0-8d8cf0884f04 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:07.070075 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d910dcf9-91c5-4d20-95f0-8d8cf0884f04 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1321 microversion: 2.1 time: 0.591843 Jul 31 01:30:07.078937 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2158/4302] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:06 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1321 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:07.481966 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a1bdbcf3-12b1-449d-9ab4-bdf2b153c79f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:07.484115 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a1bdbcf3-12b1-449d-9ab4-bdf2b153c79f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:07.512438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1bdbcf3-12b1-449d-9ab4-bdf2b153c79f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:07.513123 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1bdbcf3-12b1-449d-9ab4-bdf2b153c79f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:07.516318 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1bdbcf3-12b1-449d-9ab4-bdf2b153c79f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:07.516906 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1bdbcf3-12b1-449d-9ab4-bdf2b153c79f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:07.701781 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-be4e211d-e2d7-4db4-9d8e-5104a2e646d2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:07.703466 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-be4e211d-e2d7-4db4-9d8e-5104a2e646d2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:07.722499 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be4e211d-e2d7-4db4-9d8e-5104a2e646d2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:07.725099 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be4e211d-e2d7-4db4-9d8e-5104a2e646d2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:07.731270 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be4e211d-e2d7-4db4-9d8e-5104a2e646d2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:07.733383 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be4e211d-e2d7-4db4-9d8e-5104a2e646d2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:07.900369 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a1bdbcf3-12b1-449d-9ab4-bdf2b153c79f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:07.921869 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a1bdbcf3-12b1-449d-9ab4-bdf2b153c79f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1527 microversion: 2.1 time: 0.444436 Jul 31 01:30:07.924345 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2145/4303] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:07 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1527 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:07.958592 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-843e87ec-c7e7-4367-b8f6-65a4fc393407 req-57ff748b-02a1-414a-9e5c-b5d072417dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fc07337-409d-4721-b4ee-1c19d939eada", "tag": "e1e776bb-bb7e-433d-849c-80151a3448f1"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:30:08.008089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-843e87ec-c7e7-4367-b8f6-65a4fc393407 req-57ff748b-02a1-414a-9e5c-b5d072417dfd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:08.008589 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-843e87ec-c7e7-4367-b8f6-65a4fc393407 req-57ff748b-02a1-414a-9e5c-b5d072417dfd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:08.044518 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-843e87ec-c7e7-4367-b8f6-65a4fc393407 req-57ff748b-02a1-414a-9e5c-b5d072417dfd service nova] Creating event network-changed:e1e776bb-bb7e-433d-849c-80151a3448f1 for instance 5fc07337-409d-4721-b4ee-1c19d939eada on n-h2-master-1 Jul 31 01:30:08.055436 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-843e87ec-c7e7-4367-b8f6-65a4fc393407 req-57ff748b-02a1-414a-9e5c-b5d072417dfd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116198 Jul 31 01:30:08.056894 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2146/4304] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:30:08.101076 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e282bd9e-3079-4eb4-8fd4-9d0e4df319ba tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:08.102308 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e282bd9e-3079-4eb4-8fd4-9d0e4df319ba tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:08.119650 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e282bd9e-3079-4eb4-8fd4-9d0e4df319ba tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:08.124144 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e282bd9e-3079-4eb4-8fd4-9d0e4df319ba tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:08.125639 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e282bd9e-3079-4eb4-8fd4-9d0e4df319ba tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:08.126404 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e282bd9e-3079-4eb4-8fd4-9d0e4df319ba tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:08.523142 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-be4e211d-e2d7-4db4-9d8e-5104a2e646d2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:08.541649 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-be4e211d-e2d7-4db4-9d8e-5104a2e646d2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1574 microversion: 2.1 time: 0.845206 Jul 31 01:30:08.553563 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2159/4305] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:07 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1574 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:08.564452 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9d7589a8-46ea-454d-80fb-0223c4b5e598 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:08.582889 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9d7589a8-46ea-454d-80fb-0223c4b5e598 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:08.602630 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d7589a8-46ea-454d-80fb-0223c4b5e598 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:08.603512 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d7589a8-46ea-454d-80fb-0223c4b5e598 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:08.604578 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d7589a8-46ea-454d-80fb-0223c4b5e598 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:08.605255 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d7589a8-46ea-454d-80fb-0223c4b5e598 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:09.184219 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9d7589a8-46ea-454d-80fb-0223c4b5e598 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.624808 Jul 31 01:30:09.185756 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2160/4306] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:30:08 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9/os-interface => generated 284 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:30:09.202759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0d1e0209-4ab3-4812-b11b-eb3556612949 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:09.204591 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0d1e0209-4ab3-4812-b11b-eb3556612949 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:09.231499 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d1e0209-4ab3-4812-b11b-eb3556612949 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:09.232391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d1e0209-4ab3-4812-b11b-eb3556612949 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:09.233955 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d1e0209-4ab3-4812-b11b-eb3556612949 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:09.235866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d1e0209-4ab3-4812-b11b-eb3556612949 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:09.595538 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e282bd9e-3079-4eb4-8fd4-9d0e4df319ba tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:09.631579 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e282bd9e-3079-4eb4-8fd4-9d0e4df319ba tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1321 microversion: 2.1 time: 1.530916 Jul 31 01:30:09.660194 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2147/4307] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:08 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1321 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:30:10.591531 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0d1e0209-4ab3-4812-b11b-eb3556612949 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:10.602082 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0d1e0209-4ab3-4812-b11b-eb3556612949 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1527 microversion: 2.1 time: 1.406837 Jul 31 01:30:10.611317 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2161/4308] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:09 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1527 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:10.661865 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d2abd15a-81ba-44da-b510-a25cc720c7b0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:10.663332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d2abd15a-81ba-44da-b510-a25cc720c7b0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:10.667056 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:10.699644 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2abd15a-81ba-44da-b510-a25cc720c7b0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:10.701082 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2abd15a-81ba-44da-b510-a25cc720c7b0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:10.702243 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2abd15a-81ba-44da-b510-a25cc720c7b0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:10.702964 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2abd15a-81ba-44da-b510-a25cc720c7b0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:11.611416 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d2abd15a-81ba-44da-b510-a25cc720c7b0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:11.624246 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-49f35d15-9aea-41f2-8b57-deb7874ef405 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:11.624991 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-49f35d15-9aea-41f2-8b57-deb7874ef405 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:11.630109 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d2abd15a-81ba-44da-b510-a25cc720c7b0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1321 microversion: 2.1 time: 0.971655 Jul 31 01:30:11.647413 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49f35d15-9aea-41f2-8b57-deb7874ef405 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:11.648083 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49f35d15-9aea-41f2-8b57-deb7874ef405 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:11.648326 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2148/4309] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:10 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1321 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:11.648708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49f35d15-9aea-41f2-8b57-deb7874ef405 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:11.649166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49f35d15-9aea-41f2-8b57-deb7874ef405 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:12.653874 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-adf5621f-1ee4-42df-a059-88582758dc97 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:12.654669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-adf5621f-1ee4-42df-a059-88582758dc97 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:12.677624 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adf5621f-1ee4-42df-a059-88582758dc97 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:12.677624 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adf5621f-1ee4-42df-a059-88582758dc97 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:12.678242 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adf5621f-1ee4-42df-a059-88582758dc97 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:12.689247 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adf5621f-1ee4-42df-a059-88582758dc97 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:13.219894 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-49f35d15-9aea-41f2-8b57-deb7874ef405 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:13.249427 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-49f35d15-9aea-41f2-8b57-deb7874ef405 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1527 microversion: 2.1 time: 1.622646 Jul 31 01:30:13.251918 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2162/4310] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:11 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1527 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:30:13.428514 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-adf5621f-1ee4-42df-a059-88582758dc97 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:13.445503 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-adf5621f-1ee4-42df-a059-88582758dc97 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1321 microversion: 2.1 time: 0.796124 Jul 31 01:30:13.451047 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2149/4311] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:12 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1321 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:14.278980 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-07384d14-98f6-4330-8bf2-34a6cede4d8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:14.280553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-07384d14-98f6-4330-8bf2-34a6cede4d8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:14.304642 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07384d14-98f6-4330-8bf2-34a6cede4d8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:14.316231 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07384d14-98f6-4330-8bf2-34a6cede4d8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:14.320020 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07384d14-98f6-4330-8bf2-34a6cede4d8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:14.323851 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07384d14-98f6-4330-8bf2-34a6cede4d8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:14.407624 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:14.476470 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5059aeda-d6f3-4d56-afe9-a48ac78e7250 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:14.478564 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5059aeda-d6f3-4d56-afe9-a48ac78e7250 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:14.498454 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5059aeda-d6f3-4d56-afe9-a48ac78e7250 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:14.533112 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5059aeda-d6f3-4d56-afe9-a48ac78e7250 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:14.538370 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5059aeda-d6f3-4d56-afe9-a48ac78e7250 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:14.540086 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5059aeda-d6f3-4d56-afe9-a48ac78e7250 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:15.227095 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-07384d14-98f6-4330-8bf2-34a6cede4d8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:15.243879 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-07384d14-98f6-4330-8bf2-34a6cede4d8a tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1527 microversion: 2.1 time: 0.966456 Jul 31 01:30:15.245149 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2163/4312] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:14 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1527 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:16.099535 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5059aeda-d6f3-4d56-afe9-a48ac78e7250 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:16.117339 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5059aeda-d6f3-4d56-afe9-a48ac78e7250 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1321 microversion: 2.1 time: 1.645224 Jul 31 01:30:16.122278 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2150/4313] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:14 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1321 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:16.271635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-73d07e2f-f948-4b8b-b83d-869d8388b406 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:16.273813 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-73d07e2f-f948-4b8b-b83d-869d8388b406 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:16.288564 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73d07e2f-f948-4b8b-b83d-869d8388b406 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:16.289349 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73d07e2f-f948-4b8b-b83d-869d8388b406 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:16.290330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73d07e2f-f948-4b8b-b83d-869d8388b406 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:16.290936 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73d07e2f-f948-4b8b-b83d-869d8388b406 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:17.042426 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-73d07e2f-f948-4b8b-b83d-869d8388b406 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:17.067164 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-73d07e2f-f948-4b8b-b83d-869d8388b406 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1527 microversion: 2.1 time: 0.802304 Jul 31 01:30:17.080161 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2164/4314] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:16 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1527 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:17.094317 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-959bea25-6bac-4a60-9135-f54f4d394064 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:17.095829 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-959bea25-6bac-4a60-9135-f54f4d394064 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:17.106188 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-1bc4e5de-9ef1-40f0-a46d-cb293903bf1a req-37ae3718-a6d7-45f7-88ab-4809732032a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d515738b-e8ce-4336-8278-1ddd9cd032d9", "tag": "83ab76da-4e9c-430c-9650-352f45e6da6b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:30:17.149418 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-959bea25-6bac-4a60-9135-f54f4d394064 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:17.150670 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-959bea25-6bac-4a60-9135-f54f4d394064 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:17.151730 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-959bea25-6bac-4a60-9135-f54f4d394064 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:17.153282 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-959bea25-6bac-4a60-9135-f54f4d394064 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:17.160522 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1bc4e5de-9ef1-40f0-a46d-cb293903bf1a req-37ae3718-a6d7-45f7-88ab-4809732032a1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:17.167831 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1bc4e5de-9ef1-40f0-a46d-cb293903bf1a req-37ae3718-a6d7-45f7-88ab-4809732032a1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:17.239544 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1bc4e5de-9ef1-40f0-a46d-cb293903bf1a req-37ae3718-a6d7-45f7-88ab-4809732032a1 service nova] Creating event network-changed:83ab76da-4e9c-430c-9650-352f45e6da6b for instance d515738b-e8ce-4336-8278-1ddd9cd032d9 on n-h1-master-1 Jul 31 01:30:17.270818 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-1bc4e5de-9ef1-40f0-a46d-cb293903bf1a req-37ae3718-a6d7-45f7-88ab-4809732032a1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185835 Jul 31 01:30:17.274375 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2165/4315] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:30:17.294446 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a64dab77-e560-47f0-b066-55ab80a156c7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:17.295174 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a64dab77-e560-47f0-b066-55ab80a156c7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:17.339855 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a64dab77-e560-47f0-b066-55ab80a156c7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:17.341174 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a64dab77-e560-47f0-b066-55ab80a156c7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:17.343801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a64dab77-e560-47f0-b066-55ab80a156c7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:17.344449 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a64dab77-e560-47f0-b066-55ab80a156c7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:18.716439 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-959bea25-6bac-4a60-9135-f54f4d394064 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:18.725325 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:18.733990 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-959bea25-6bac-4a60-9135-f54f4d394064 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1574 microversion: 2.1 time: 1.668357 Jul 31 01:30:18.734894 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2151/4316] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:17 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1574 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:30:18.748204 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2cf281b8-3786-49a0-ba32-5fc6f14d7e7f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:18.750443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2cf281b8-3786-49a0-ba32-5fc6f14d7e7f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:18.773012 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cf281b8-3786-49a0-ba32-5fc6f14d7e7f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:18.778660 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cf281b8-3786-49a0-ba32-5fc6f14d7e7f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:18.780695 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cf281b8-3786-49a0-ba32-5fc6f14d7e7f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:18.784726 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cf281b8-3786-49a0-ba32-5fc6f14d7e7f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:19.028186 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a64dab77-e560-47f0-b066-55ab80a156c7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:19.039009 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a64dab77-e560-47f0-b066-55ab80a156c7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1321 microversion: 2.1 time: 1.756729 Jul 31 01:30:19.045696 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2166/4317] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:17 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1321 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:19.069847 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-21e442a5-6c1b-40ab-b68a-4e16bfdc40c6 req-936539b8-9306-4b9e-8c24-e2cbf1b4d2ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fc07337-409d-4721-b4ee-1c19d939eada", "name": "network-vif-plugged", "status": "completed", "tag": "e1e776bb-bb7e-433d-849c-80151a3448f1"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:30:19.137634 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-21e442a5-6c1b-40ab-b68a-4e16bfdc40c6 req-936539b8-9306-4b9e-8c24-e2cbf1b4d2ba service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:19.150685 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-21e442a5-6c1b-40ab-b68a-4e16bfdc40c6 req-936539b8-9306-4b9e-8c24-e2cbf1b4d2ba service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:19.209438 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-21e442a5-6c1b-40ab-b68a-4e16bfdc40c6 req-936539b8-9306-4b9e-8c24-e2cbf1b4d2ba service nova] Creating event network-vif-plugged:e1e776bb-bb7e-433d-849c-80151a3448f1 for instance 5fc07337-409d-4721-b4ee-1c19d939eada on n-h2-master-1 Jul 31 01:30:19.235937 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-21e442a5-6c1b-40ab-b68a-4e16bfdc40c6 req-936539b8-9306-4b9e-8c24-e2cbf1b4d2ba service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188487 Jul 31 01:30:19.236841 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2167/4318] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:30:20.027915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2cf281b8-3786-49a0-ba32-5fc6f14d7e7f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:20.034611 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2cf281b8-3786-49a0-ba32-5fc6f14d7e7f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1527 microversion: 2.1 time: 1.298444 Jul 31 01:30:20.037882 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2152/4319] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:18 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1527 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:20.067766 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3edadda-9ef5-4376-8bbd-5157c68570bf tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:20.068942 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3edadda-9ef5-4376-8bbd-5157c68570bf tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:20.089618 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3edadda-9ef5-4376-8bbd-5157c68570bf tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:20.091797 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3edadda-9ef5-4376-8bbd-5157c68570bf tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:20.093600 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3edadda-9ef5-4376-8bbd-5157c68570bf tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:20.094980 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3edadda-9ef5-4376-8bbd-5157c68570bf tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:20.583730 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3edadda-9ef5-4376-8bbd-5157c68570bf tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:20.608828 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3edadda-9ef5-4376-8bbd-5157c68570bf tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1321 microversion: 2.1 time: 0.546364 Jul 31 01:30:20.648125 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2168/4320] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:20 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1321 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:21.058390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-596d5d34-1093-471b-a8f1-5c6f13133c46 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:21.059032 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-596d5d34-1093-471b-a8f1-5c6f13133c46 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:21.075867 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-596d5d34-1093-471b-a8f1-5c6f13133c46 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:21.076163 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-596d5d34-1093-471b-a8f1-5c6f13133c46 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:21.076963 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-596d5d34-1093-471b-a8f1-5c6f13133c46 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:21.077598 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-596d5d34-1093-471b-a8f1-5c6f13133c46 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:21.657494 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-091bfb64-a120-4cdb-857f-e5301ecfad01 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:21.659516 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-091bfb64-a120-4cdb-857f-e5301ecfad01 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:21.669800 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-091bfb64-a120-4cdb-857f-e5301ecfad01 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:21.670864 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-091bfb64-a120-4cdb-857f-e5301ecfad01 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:21.672547 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-091bfb64-a120-4cdb-857f-e5301ecfad01 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:21.673312 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-091bfb64-a120-4cdb-857f-e5301ecfad01 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:22.504588 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-596d5d34-1093-471b-a8f1-5c6f13133c46 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:22.520621 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-596d5d34-1093-471b-a8f1-5c6f13133c46 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1509 microversion: 2.1 time: 1.464339 Jul 31 01:30:22.523682 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2153/4321] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:21 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1509 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:22.679075 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-091bfb64-a120-4cdb-857f-e5301ecfad01 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:22.696976 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-091bfb64-a120-4cdb-857f-e5301ecfad01 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1501 microversion: 2.1 time: 1.045711 Jul 31 01:30:22.704738 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2169/4322] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:21 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1501 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:30:22.726417 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-874bf7e1-a36a-40ae-a22c-c3cae490cb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:22.729281 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-874bf7e1-a36a-40ae-a22c-c3cae490cb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:22.747222 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-874bf7e1-a36a-40ae-a22c-c3cae490cb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:22.747709 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-874bf7e1-a36a-40ae-a22c-c3cae490cb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:22.754005 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-874bf7e1-a36a-40ae-a22c-c3cae490cb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:22.754480 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-874bf7e1-a36a-40ae-a22c-c3cae490cb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:23.458592 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-874bf7e1-a36a-40ae-a22c-c3cae490cb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:23.471242 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-874bf7e1-a36a-40ae-a22c-c3cae490cb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1501 microversion: 2.1 time: 0.751838 Jul 31 01:30:23.473798 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2154/4323] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:22 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1501 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:23.493793 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f257f9a2-7c04-4cd5-b199-f89d22c9faac tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:23.494311 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f257f9a2-7c04-4cd5-b199-f89d22c9faac tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:23.500510 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=47 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:23.502321 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f257f9a2-7c04-4cd5-b199-f89d22c9faac tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:23.502963 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f257f9a2-7c04-4cd5-b199-f89d22c9faac tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:23.503985 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f257f9a2-7c04-4cd5-b199-f89d22c9faac tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:23.504595 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f257f9a2-7c04-4cd5-b199-f89d22c9faac tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:23.534304 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f257f9a2-7c04-4cd5-b199-f89d22c9faac tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:30:23.545771 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-264b3783-17ff-401f-b2d4-884a6663411b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:23.547023 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-264b3783-17ff-401f-b2d4-884a6663411b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:23.565389 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-264b3783-17ff-401f-b2d4-884a6663411b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:23.566085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-264b3783-17ff-401f-b2d4-884a6663411b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:23.570461 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-264b3783-17ff-401f-b2d4-884a6663411b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:23.571106 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-264b3783-17ff-401f-b2d4-884a6663411b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:23.761490 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f257f9a2-7c04-4cd5-b199-f89d22c9faac tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 204 len: 0 microversion: 2.1 time: 0.271865 Jul 31 01:30:23.762079 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2170/4324] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:30:23 2022] DELETE /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:30:23.780431 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-be594d42-151a-42ba-aee5-a5eb74fc9509 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:23.786501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-be594d42-151a-42ba-aee5-a5eb74fc9509 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:23.814722 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be594d42-151a-42ba-aee5-a5eb74fc9509 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:23.816027 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be594d42-151a-42ba-aee5-a5eb74fc9509 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:23.819860 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be594d42-151a-42ba-aee5-a5eb74fc9509 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:23.820314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be594d42-151a-42ba-aee5-a5eb74fc9509 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:24.215355 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-264b3783-17ff-401f-b2d4-884a6663411b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:24.227055 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-264b3783-17ff-401f-b2d4-884a6663411b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1509 microversion: 2.1 time: 0.684041 Jul 31 01:30:24.240614 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2155/4325] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:23 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1509 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:24.458345 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-be594d42-151a-42ba-aee5-a5eb74fc9509 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:24.469746 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-be594d42-151a-42ba-aee5-a5eb74fc9509 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1507 microversion: 2.1 time: 0.693140 Jul 31 01:30:24.472471 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2171/4326] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:23 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1507 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:25.141185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-61a4ddfa-c5de-4e5f-8a79-2aa2caf4df52 req-790f94ae-4841-4ec4-95ee-704d9c9701bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76757e35-eebd-46de-a012-82bd864fd1d2", "name": "network-vif-unplugged", "status": "completed", "tag": "a84852a6-e79d-4e96-9273-a29f94e85006"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:30:25.161501 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-61a4ddfa-c5de-4e5f-8a79-2aa2caf4df52 req-790f94ae-4841-4ec4-95ee-704d9c9701bd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:25.163604 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-61a4ddfa-c5de-4e5f-8a79-2aa2caf4df52 req-790f94ae-4841-4ec4-95ee-704d9c9701bd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:25.192245 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-61a4ddfa-c5de-4e5f-8a79-2aa2caf4df52 req-790f94ae-4841-4ec4-95ee-704d9c9701bd service nova] Creating event network-vif-unplugged:a84852a6-e79d-4e96-9273-a29f94e85006 for instance 76757e35-eebd-46de-a012-82bd864fd1d2 on n-h1-master-1 Jul 31 01:30:25.203548 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-61a4ddfa-c5de-4e5f-8a79-2aa2caf4df52 req-790f94ae-4841-4ec4-95ee-704d9c9701bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064351 Jul 31 01:30:25.204516 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2156/4327] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:30:25.253295 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5d2b8eb5-13f3-4bfe-9cd5-2cfa9c40b828 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:25.253943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5d2b8eb5-13f3-4bfe-9cd5-2cfa9c40b828 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:25.266113 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d2b8eb5-13f3-4bfe-9cd5-2cfa9c40b828 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:25.266600 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d2b8eb5-13f3-4bfe-9cd5-2cfa9c40b828 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:25.267450 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d2b8eb5-13f3-4bfe-9cd5-2cfa9c40b828 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:25.267908 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d2b8eb5-13f3-4bfe-9cd5-2cfa9c40b828 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:25.497000 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-88d565b8-3782-47c4-97d6-2dfeb091ffca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:25.497723 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-88d565b8-3782-47c4-97d6-2dfeb091ffca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:25.514205 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88d565b8-3782-47c4-97d6-2dfeb091ffca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:25.514678 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88d565b8-3782-47c4-97d6-2dfeb091ffca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:25.515578 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88d565b8-3782-47c4-97d6-2dfeb091ffca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:25.516028 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88d565b8-3782-47c4-97d6-2dfeb091ffca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:26.294735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5d2b8eb5-13f3-4bfe-9cd5-2cfa9c40b828 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:26.307972 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5d2b8eb5-13f3-4bfe-9cd5-2cfa9c40b828 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1509 microversion: 2.1 time: 1.058072 Jul 31 01:30:26.323809 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2172/4328] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:25 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1509 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:26.374261 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-88d565b8-3782-47c4-97d6-2dfeb091ffca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:26.384782 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-88d565b8-3782-47c4-97d6-2dfeb091ffca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1507 microversion: 2.1 time: 0.892149 Jul 31 01:30:26.389962 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2157/4329] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:25 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1507 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:27.014471 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-d64c93f5-140c-44f1-8bb8-955561e9f792 req-259dbd01-8b67-4a57-98b9-f4c9ef2d0021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fc07337-409d-4721-b4ee-1c19d939eada", "name": "network-vif-deleted", "tag": "e1e776bb-bb7e-433d-849c-80151a3448f1"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:30:27.050915 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d64c93f5-140c-44f1-8bb8-955561e9f792 req-259dbd01-8b67-4a57-98b9-f4c9ef2d0021 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:27.051752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d64c93f5-140c-44f1-8bb8-955561e9f792 req-259dbd01-8b67-4a57-98b9-f4c9ef2d0021 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:27.094025 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-d64c93f5-140c-44f1-8bb8-955561e9f792 req-259dbd01-8b67-4a57-98b9-f4c9ef2d0021 service nova] Creating event network-vif-deleted:e1e776bb-bb7e-433d-849c-80151a3448f1 for instance 5fc07337-409d-4721-b4ee-1c19d939eada on n-h2-master-1 Jul 31 01:30:27.108509 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-d64c93f5-140c-44f1-8bb8-955561e9f792 req-259dbd01-8b67-4a57-98b9-f4c9ef2d0021 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097645 Jul 31 01:30:27.113624 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2173/4330] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:30:27.330086 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fdce983f-bfbb-4892-880c-526a69787a1c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:27.331201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fdce983f-bfbb-4892-880c-526a69787a1c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:27.352795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdce983f-bfbb-4892-880c-526a69787a1c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:27.354623 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdce983f-bfbb-4892-880c-526a69787a1c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:27.356580 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdce983f-bfbb-4892-880c-526a69787a1c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:27.358422 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdce983f-bfbb-4892-880c-526a69787a1c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:27.413571 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-96a8c689-697d-4ac5-b6a6-7309fdfd2279 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:27.414767 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-96a8c689-697d-4ac5-b6a6-7309fdfd2279 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:27.450517 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96a8c689-697d-4ac5-b6a6-7309fdfd2279 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:27.451777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96a8c689-697d-4ac5-b6a6-7309fdfd2279 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:27.456803 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96a8c689-697d-4ac5-b6a6-7309fdfd2279 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:27.458881 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96a8c689-697d-4ac5-b6a6-7309fdfd2279 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:27.574038 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96a8c689-697d-4ac5-b6a6-7309fdfd2279 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:27.597052 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96a8c689-697d-4ac5-b6a6-7309fdfd2279 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:27.598156 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-96a8c689-697d-4ac5-b6a6-7309fdfd2279 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lazy-loading 'fault' on Instance uuid 5fc07337-409d-4721-b4ee-1c19d939eada {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:30:27.685445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-96a8c689-697d-4ac5-b6a6-7309fdfd2279 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:27.699903 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-96a8c689-697d-4ac5-b6a6-7309fdfd2279 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 200 len: 1311 microversion: 2.1 time: 0.293484 Jul 31 01:30:27.708365 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2174/4331] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:27 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 1311 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:30:27.908092 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fdce983f-bfbb-4892-880c-526a69787a1c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:27.917741 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fdce983f-bfbb-4892-880c-526a69787a1c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1452 microversion: 2.1 time: 0.591448 Jul 31 01:30:27.926757 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2158/4332] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:27 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1452 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:27.955883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6410f832-8aad-476e-b87c-713ee29a67e1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:27.959026 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6410f832-8aad-476e-b87c-713ee29a67e1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:27.976945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6410f832-8aad-476e-b87c-713ee29a67e1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:27.984566 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6410f832-8aad-476e-b87c-713ee29a67e1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:27.985767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6410f832-8aad-476e-b87c-713ee29a67e1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:27.990605 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6410f832-8aad-476e-b87c-713ee29a67e1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:28.495181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6410f832-8aad-476e-b87c-713ee29a67e1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:28.508017 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6410f832-8aad-476e-b87c-713ee29a67e1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1452 microversion: 2.1 time: 0.563076 Jul 31 01:30:28.508934 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2175/4333] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:27 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1452 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:28.606649 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b6f884b2-d90a-4d92-8c99-4d6a08af0328 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:30:28.607610 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b6f884b2-d90a-4d92-8c99-4d6a08af0328 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:28.627781 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6f884b2-d90a-4d92-8c99-4d6a08af0328 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:28.629993 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6f884b2-d90a-4d92-8c99-4d6a08af0328 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:28.631541 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6f884b2-d90a-4d92-8c99-4d6a08af0328 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:28.634238 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6f884b2-d90a-4d92-8c99-4d6a08af0328 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:28.703764 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-b6f884b2-d90a-4d92-8c99-4d6a08af0328 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lazy-loading 'flavor' on Instance uuid 76757e35-eebd-46de-a012-82bd864fd1d2 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:30:28.721545 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ab1a2aeb-3aa3-44ed-85d5-78d283928335 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:28.722939 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ab1a2aeb-3aa3-44ed-85d5-78d283928335 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:28.730812 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab1a2aeb-3aa3-44ed-85d5-78d283928335 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:28.758212 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab1a2aeb-3aa3-44ed-85d5-78d283928335 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:28.759540 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab1a2aeb-3aa3-44ed-85d5-78d283928335 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:28.760171 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab1a2aeb-3aa3-44ed-85d5-78d283928335 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:28.777175 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-b6f884b2-d90a-4d92-8c99-4d6a08af0328 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Cannot 'shelve' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state shelved_offloaded Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b6f884b2-d90a-4d92-8c99-4d6a08af0328 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action HTTP/1.1 Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 14 Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: {"shelve": {}} Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: exception: Cannot 'shelve' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state shelved_offloaded Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '76757e35-eebd-46de-a012-82bd864fd1d2', 'body': {'shelve': {}}} Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 76757e35-eebd-46de-a012-82bd864fd1d2 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 31 01:30:28.789673 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 01:30:28.794624 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 01:30:28.794624 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 01:30:28.794624 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state shelved_offloaded Jul 31 01:30:28.794624 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:30:28.794624 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:30:28.794624 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:30:28.794624 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:30:28.794624 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:30:28.794624 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:30:28.794624 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:30:28.794624 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:30:28.794624 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state shelved_offloaded Jul 31 01:30:28.794624 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:30:28.796603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b6f884b2-d90a-4d92-8c99-4d6a08af0328 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 409 to user: Cannot 'shelve' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state shelved_offloaded {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:30:28.800408 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b6f884b2-d90a-4d92-8c99-4d6a08af0328 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action" status: 409 len: 155 microversion: 2.1 time: 0.198233 Jul 31 01:30:28.816324 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2159/4334] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:30:28 2022] POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action => generated 155 bytes in 214 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:30:28.830737 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-ab1a2aeb-3aa3-44ed-85d5-78d283928335 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. Jul 31 01:30:28.833510 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-891fbb6c-6f4b-43da-bffa-4396b03769b9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ab1a2aeb-3aa3-44ed-85d5-78d283928335 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada HTTP/1.1 Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '5fc07337-409d-4721-b4ee-1c19d939eada'} Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:30:28.837595 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:30:28.841695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:30:28.841695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:30:28.841695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:30:28.841695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:30:28.841695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. Jul 31 01:30:28.841695 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:30:28.846913 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-891fbb6c-6f4b-43da-bffa-4396b03769b9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:28.848039 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ab1a2aeb-3aa3-44ed-85d5-78d283928335 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:30:28.850898 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ab1a2aeb-3aa3-44ed-85d5-78d283928335 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 404 len: 111 microversion: 2.1 time: 0.133268 Jul 31 01:30:28.855857 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2176/4335] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:28 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:30:28.865340 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-891fbb6c-6f4b-43da-bffa-4396b03769b9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:28.866073 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-891fbb6c-6f4b-43da-bffa-4396b03769b9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:28.867060 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-891fbb6c-6f4b-43da-bffa-4396b03769b9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:28.869830 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-891fbb6c-6f4b-43da-bffa-4396b03769b9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:28.879311 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b5f5b705-9478-4e6a-b9cf-6b4d643d1517 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Action: 'create', calling method: .version_select at 0x7fede5522430>, body: {"keypair": {"name": "tempest-key-831866036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAt6tMPSzbc6QMzrT1pcqR2kAT5riwMB66eT+2qBEObm1S4N5hRJ53P/+zIIR+mQRIgt3ESzMOIMa2y2q/wayjUAbF18d02SrJ4NRqsOaBHWoIk1zVXa6G1L/8XkR737+A=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:30:28.951642 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-b5f5b705-9478-4e6a-b9cf-6b4d643d1517 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:30:28.985751 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-b5f5b705-9478-4e6a-b9cf-6b4d643d1517 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for user 159706f59a12427f9a3c03fa31f712f3 and project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:30:29.077989 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b5f5b705-9478-4e6a-b9cf-6b4d643d1517 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.204492 Jul 31 01:30:29.079268 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2177/4336] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:30:28 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:30:29.089491 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-81789681-248b-4f9c-9dd5-0857357312ab tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '.version_select at 0x7fede5517f70>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:29.098540 n-d-master-1 devstack@n-api.service[119475]: WARNING oslo_db.sqlalchemy.utils [None req-81789681-248b-4f9c-9dd5-0857357312ab tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 31 01:30:29.113452 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-81789681-248b-4f9c-9dd5-0857357312ab tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.027767 Jul 31 01:30:29.116467 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2178/4337] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:30:29 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:30:29.202624 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-891fbb6c-6f4b-43da-bffa-4396b03769b9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119474) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 31 01:30:29.365001 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-891fbb6c-6f4b-43da-bffa-4396b03769b9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action" status: 202 len: 0 microversion: 2.1 time: 0.547082 Jul 31 01:30:29.376572 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d3e45873-f97c-4666-bc8d-35e8821b1c53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:29.376759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d3e45873-f97c-4666-bc8d-35e8821b1c53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:29.382172 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2160/4338] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:30:28 2022] POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:30:29.390788 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3e45873-f97c-4666-bc8d-35e8821b1c53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:29.392105 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3e45873-f97c-4666-bc8d-35e8821b1c53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:29.393175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3e45873-f97c-4666-bc8d-35e8821b1c53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:29.409500 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3e45873-f97c-4666-bc8d-35e8821b1c53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:29.454813 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eed873d6-21c8-4761-9108-9c508751ffd3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-891979027", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "key_name": "tempest-key-831866036", "networks": [{"uuid": "ce8b5cb4-aa2f-4dfd-abb4-9273e2a34e90"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:30:29.587068 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-eed873d6-21c8-4761-9108-9c508751ffd3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] validate_networks() for [('ce8b5cb4-aa2f-4dfd-abb4-9273e2a34e90', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:30:30.249436 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d3e45873-f97c-4666-bc8d-35e8821b1c53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:30.265210 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d3e45873-f97c-4666-bc8d-35e8821b1c53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1460 microversion: 2.1 time: 0.893317 Jul 31 01:30:30.286026 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2179/4339] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:29 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1460 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:31.167620 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-eed873d6-21c8-4761-9108-9c508751ffd3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:30:31.168623 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-eed873d6-21c8-4761-9108-9c508751ffd3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:30:31.169807 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-eed873d6-21c8-4761-9108-9c508751ffd3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:30:31.170172 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-eed873d6-21c8-4761-9108-9c508751ffd3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:30:31.170874 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-eed873d6-21c8-4761-9108-9c508751ffd3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:30:31.192014 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eed873d6-21c8-4761-9108-9c508751ffd3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:31.192657 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eed873d6-21c8-4761-9108-9c508751ffd3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:31.194220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eed873d6-21c8-4761-9108-9c508751ffd3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:31.195543 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eed873d6-21c8-4761-9108-9c508751ffd3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:31.254240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-eed873d6-21c8-4761-9108-9c508751ffd3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:30:31.270310 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-eed873d6-21c8-4761-9108-9c508751ffd3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for user 159706f59a12427f9a3c03fa31f712f3 and project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:30:31.296366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5a4c755e-7c44-4fee-8a29-c4481621e3d0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:31.298711 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5a4c755e-7c44-4fee-8a29-c4481621e3d0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:31.319813 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a4c755e-7c44-4fee-8a29-c4481621e3d0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:31.320862 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a4c755e-7c44-4fee-8a29-c4481621e3d0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:31.322314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a4c755e-7c44-4fee-8a29-c4481621e3d0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:31.328382 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a4c755e-7c44-4fee-8a29-c4481621e3d0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:31.339025 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eed873d6-21c8-4761-9108-9c508751ffd3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:30:31.345720 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eed873d6-21c8-4761-9108-9c508751ffd3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:30:31.496352 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eed873d6-21c8-4761-9108-9c508751ffd3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.046595 Jul 31 01:30:31.499447 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2161/4340] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:30:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 01:30:31.548617 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63ff045d-fc5f-421c-a42f-720f4cc1fb2a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:31.566897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-63ff045d-fc5f-421c-a42f-720f4cc1fb2a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:33.458839 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-63ff045d-fc5f-421c-a42f-720f4cc1fb2a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:33.468100 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-63ff045d-fc5f-421c-a42f-720f4cc1fb2a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1227 microversion: 2.1 time: 1.943920 Jul 31 01:30:33.490329 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2162/4341] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:31 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1227 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:34.315884 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5a4c755e-7c44-4fee-8a29-c4481621e3d0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:34.331574 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5a4c755e-7c44-4fee-8a29-c4481621e3d0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1460 microversion: 2.1 time: 3.041421 Jul 31 01:30:34.342941 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2180/4342] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:31 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1460 bytes in 3054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:34.492531 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1ef1c9af-0bff-41ae-b0cb-e998865d7bb5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:34.494486 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1ef1c9af-0bff-41ae-b0cb-e998865d7bb5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:34.542218 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ef1c9af-0bff-41ae-b0cb-e998865d7bb5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:34.544246 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ef1c9af-0bff-41ae-b0cb-e998865d7bb5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:34.550832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ef1c9af-0bff-41ae-b0cb-e998865d7bb5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:34.556034 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ef1c9af-0bff-41ae-b0cb-e998865d7bb5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:35.300695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1ef1c9af-0bff-41ae-b0cb-e998865d7bb5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:35.313335 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1ef1c9af-0bff-41ae-b0cb-e998865d7bb5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1287 microversion: 2.1 time: 0.826479 Jul 31 01:30:35.334102 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2163/4343] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:34 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1287 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:35.360616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3add70aa-d343-463a-a5b4-57f6d97d6fb1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:35.362112 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3add70aa-d343-463a-a5b4-57f6d97d6fb1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:35.376743 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3add70aa-d343-463a-a5b4-57f6d97d6fb1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:35.379169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3add70aa-d343-463a-a5b4-57f6d97d6fb1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:35.380616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3add70aa-d343-463a-a5b4-57f6d97d6fb1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:35.381301 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3add70aa-d343-463a-a5b4-57f6d97d6fb1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:36.011731 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3add70aa-d343-463a-a5b4-57f6d97d6fb1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:36.041570 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3add70aa-d343-463a-a5b4-57f6d97d6fb1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 0.685716 Jul 31 01:30:36.047069 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2181/4344] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:35 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:36.346985 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-556ac9e0-e1ec-44ce-9154-61a55d386645 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:36.348890 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-556ac9e0-e1ec-44ce-9154-61a55d386645 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:36.368322 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-556ac9e0-e1ec-44ce-9154-61a55d386645 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:36.368807 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-556ac9e0-e1ec-44ce-9154-61a55d386645 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:36.375244 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-556ac9e0-e1ec-44ce-9154-61a55d386645 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:36.377257 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-556ac9e0-e1ec-44ce-9154-61a55d386645 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:36.719087 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-556ac9e0-e1ec-44ce-9154-61a55d386645 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:36.738667 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-556ac9e0-e1ec-44ce-9154-61a55d386645 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1285 microversion: 2.1 time: 0.396612 Jul 31 01:30:36.756396 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2164/4345] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:36 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1285 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:37.083077 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-407972cd-496e-4689-a9a1-07d8b319e9aa tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:37.085799 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-407972cd-496e-4689-a9a1-07d8b319e9aa tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:37.121694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-407972cd-496e-4689-a9a1-07d8b319e9aa tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:37.123097 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-407972cd-496e-4689-a9a1-07d8b319e9aa tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:37.126901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-407972cd-496e-4689-a9a1-07d8b319e9aa tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:37.129082 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-407972cd-496e-4689-a9a1-07d8b319e9aa tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:37.763742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9e7043e9-528a-403f-be0a-0b9c23809701 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:37.764376 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9e7043e9-528a-403f-be0a-0b9c23809701 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:37.785477 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e7043e9-528a-403f-be0a-0b9c23809701 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:37.800874 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e7043e9-528a-403f-be0a-0b9c23809701 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:37.801739 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e7043e9-528a-403f-be0a-0b9c23809701 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:37.802241 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e7043e9-528a-403f-be0a-0b9c23809701 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:38.313556 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9e7043e9-528a-403f-be0a-0b9c23809701 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:38.330585 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9e7043e9-528a-403f-be0a-0b9c23809701 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1285 microversion: 2.1 time: 0.572105 Jul 31 01:30:38.331050 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2165/4346] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:37 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1285 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:38.432612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-407972cd-496e-4689-a9a1-07d8b319e9aa tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:38.449270 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:38.457646 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-407972cd-496e-4689-a9a1-07d8b319e9aa tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 1.385688 Jul 31 01:30:38.461784 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2182/4347] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:37 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:39.357628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bb348020-83d1-4a9d-a4f1-d7a1658feeb3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:39.359139 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bb348020-83d1-4a9d-a4f1-d7a1658feeb3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:39.388018 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bb348020-83d1-4a9d-a4f1-d7a1658feeb3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:39.389869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bb348020-83d1-4a9d-a4f1-d7a1658feeb3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:39.407484 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bb348020-83d1-4a9d-a4f1-d7a1658feeb3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:39.412002 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bb348020-83d1-4a9d-a4f1-d7a1658feeb3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:39.482570 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-139d8607-9de7-4ea5-a3ff-eed96ddd61f6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:39.484118 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-139d8607-9de7-4ea5-a3ff-eed96ddd61f6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:39.517683 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:39.534513 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-139d8607-9de7-4ea5-a3ff-eed96ddd61f6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:39.545893 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-139d8607-9de7-4ea5-a3ff-eed96ddd61f6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:39.547290 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-139d8607-9de7-4ea5-a3ff-eed96ddd61f6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:39.548722 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-139d8607-9de7-4ea5-a3ff-eed96ddd61f6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:39.938566 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bb348020-83d1-4a9d-a4f1-d7a1658feeb3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:39.948340 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bb348020-83d1-4a9d-a4f1-d7a1658feeb3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1285 microversion: 2.1 time: 0.596829 Jul 31 01:30:39.953426 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2166/4348] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:39 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1285 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:40.369607 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-139d8607-9de7-4ea5-a3ff-eed96ddd61f6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:40.379705 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-139d8607-9de7-4ea5-a3ff-eed96ddd61f6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 0.902032 Jul 31 01:30:40.388942 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2183/4349] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:39 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:40.857307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-8d9860a8-43a2-446e-b705-300b050058ca req-a5771903-95de-4890-b5b5-1e007dfecdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76757e35-eebd-46de-a012-82bd864fd1d2", "tag": "a84852a6-e79d-4e96-9273-a29f94e85006"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:30:40.886602 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:40.905506 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8d9860a8-43a2-446e-b705-300b050058ca req-a5771903-95de-4890-b5b5-1e007dfecdc4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:40.906157 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8d9860a8-43a2-446e-b705-300b050058ca req-a5771903-95de-4890-b5b5-1e007dfecdc4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:40.970093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d7a3e8a4-d9b2-453f-875d-87b08859cd0b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:40.970720 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d7a3e8a4-d9b2-453f-875d-87b08859cd0b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:40.992892 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7a3e8a4-d9b2-453f-875d-87b08859cd0b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:41.000981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7a3e8a4-d9b2-453f-875d-87b08859cd0b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:41.003687 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7a3e8a4-d9b2-453f-875d-87b08859cd0b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:41.006276 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7a3e8a4-d9b2-453f-875d-87b08859cd0b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:41.029653 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-8d9860a8-43a2-446e-b705-300b050058ca req-a5771903-95de-4890-b5b5-1e007dfecdc4 service nova] Creating event network-changed:a84852a6-e79d-4e96-9273-a29f94e85006 for instance 76757e35-eebd-46de-a012-82bd864fd1d2 on n-h2-master-1 Jul 31 01:30:41.048499 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-8d9860a8-43a2-446e-b705-300b050058ca req-a5771903-95de-4890-b5b5-1e007dfecdc4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216419 Jul 31 01:30:41.064302 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2167/4350] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:30:41.414905 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a39fd945-10fa-496b-a494-1bda13a4f5ab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:41.416101 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a39fd945-10fa-496b-a494-1bda13a4f5ab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:41.421128 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:41.447197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a39fd945-10fa-496b-a494-1bda13a4f5ab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:41.460767 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a39fd945-10fa-496b-a494-1bda13a4f5ab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:41.465007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a39fd945-10fa-496b-a494-1bda13a4f5ab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:41.469261 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a39fd945-10fa-496b-a494-1bda13a4f5ab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:41.853296 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d7a3e8a4-d9b2-453f-875d-87b08859cd0b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:41.868237 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d7a3e8a4-d9b2-453f-875d-87b08859cd0b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1327 microversion: 2.1 time: 0.902111 Jul 31 01:30:41.872740 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2184/4351] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:40 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1327 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:42.487963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a39fd945-10fa-496b-a494-1bda13a4f5ab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:42.504235 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a39fd945-10fa-496b-a494-1bda13a4f5ab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 1.099091 Jul 31 01:30:42.504235 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2168/4352] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:41 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:42.574306 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e62fd8c-c017-4614-9d72-739ab1a74b7e tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:42.581475 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1e62fd8c-c017-4614-9d72-739ab1a74b7e tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:42.599410 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1e62fd8c-c017-4614-9d72-739ab1a74b7e tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Searching by: {'deleted': False, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:30:42.631815 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e62fd8c-c017-4614-9d72-739ab1a74b7e tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:42.634639 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e62fd8c-c017-4614-9d72-739ab1a74b7e tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:42.643928 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e62fd8c-c017-4614-9d72-739ab1a74b7e tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:42.644564 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e62fd8c-c017-4614-9d72-739ab1a74b7e tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:42.723370 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.multi_cell_list [None req-1e62fd8c-c017-4614-9d72-739ab1a74b7e tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119475) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:30:42.790082 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1e62fd8c-c017-4614-9d72-739ab1a74b7e tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.223543 Jul 31 01:30:42.792587 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2185/4353] 10.222.0.45 () {58 vars in 1125 bytes} [Sun Jul 31 01:30:42 2022] GET /compute/v2.1/servers => generated 334 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:30:42.806714 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dbd66c4f-5298-461c-ac30-5e27720ee4eb tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:42.816517 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dbd66c4f-5298-461c-ac30-5e27720ee4eb tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:42.822026 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dbd66c4f-5298-461c-ac30-5e27720ee4eb tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Searching by: {'deleted': False, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:30:42.850568 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dbd66c4f-5298-461c-ac30-5e27720ee4eb tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:42.855475 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dbd66c4f-5298-461c-ac30-5e27720ee4eb tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:42.858499 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dbd66c4f-5298-461c-ac30-5e27720ee4eb tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:42.860312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dbd66c4f-5298-461c-ac30-5e27720ee4eb tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:42.921293 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1f2a66cb-fbfa-49da-a538-0e5ef8f66a56 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:42.925224 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1f2a66cb-fbfa-49da-a538-0e5ef8f66a56 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:42.966427 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f2a66cb-fbfa-49da-a538-0e5ef8f66a56 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:42.967872 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f2a66cb-fbfa-49da-a538-0e5ef8f66a56 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:42.975043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f2a66cb-fbfa-49da-a538-0e5ef8f66a56 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:42.976457 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f2a66cb-fbfa-49da-a538-0e5ef8f66a56 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:43.034764 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-dbd66c4f-5298-461c-ac30-5e27720ee4eb tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:30:43.200053 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dbd66c4f-5298-461c-ac30-5e27720ee4eb tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:43.220044 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dbd66c4f-5298-461c-ac30-5e27720ee4eb tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:43.223024 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dbd66c4f-5298-461c-ac30-5e27720ee4eb tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:43.229410 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:43.720747 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dbd66c4f-5298-461c-ac30-5e27720ee4eb tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.920409 Jul 31 01:30:43.721730 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2169/4354] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:30:42 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:43.726467 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b4b37a36-b47e-461d-91d4-1fb373a713f9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:43.727089 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b4b37a36-b47e-461d-91d4-1fb373a713f9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:43.737071 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1f2a66cb-fbfa-49da-a538-0e5ef8f66a56 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:43.750369 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4b37a36-b47e-461d-91d4-1fb373a713f9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:43.750824 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4b37a36-b47e-461d-91d4-1fb373a713f9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:43.751077 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1f2a66cb-fbfa-49da-a538-0e5ef8f66a56 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1327 microversion: 2.1 time: 0.855565 Jul 31 01:30:43.751786 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2186/4355] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:42 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1327 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:43.765802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4b37a36-b47e-461d-91d4-1fb373a713f9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:43.772265 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4b37a36-b47e-461d-91d4-1fb373a713f9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:43.805848 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-74e024e1-434d-4a4f-9109-bafd8a0ae716 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:43.830775 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-74e024e1-434d-4a4f-9109-bafd8a0ae716 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.077475 Jul 31 01:30:43.834600 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2187/4356] 10.222.0.45 () {58 vars in 1137 bytes} [Sun Jul 31 01:30:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:30:44.192794 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9802d694-9e60-44ec-a974-ceecdfd446e2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:44.193679 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9802d694-9e60-44ec-a974-ceecdfd446e2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:44.200991 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b4b37a36-b47e-461d-91d4-1fb373a713f9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:44.203160 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9802d694-9e60-44ec-a974-ceecdfd446e2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:44.203699 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9802d694-9e60-44ec-a974-ceecdfd446e2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:44.220522 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9802d694-9e60-44ec-a974-ceecdfd446e2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:44.221070 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9802d694-9e60-44ec-a974-ceecdfd446e2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:44.225381 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b4b37a36-b47e-461d-91d4-1fb373a713f9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 0.498473 Jul 31 01:30:44.227010 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2170/4357] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:43 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:44.300623 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9802d694-9e60-44ec-a974-ceecdfd446e2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:30:44.486203 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9802d694-9e60-44ec-a974-ceecdfd446e2 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 204 len: 0 microversion: 2.1 time: 0.296884 Jul 31 01:30:44.490160 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2188/4358] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:30:44 2022] DELETE /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:30:44.496318 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bce7d809-a82d-4be8-9dc6-28296b13ce98 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:44.497302 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bce7d809-a82d-4be8-9dc6-28296b13ce98 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:44.510318 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bce7d809-a82d-4be8-9dc6-28296b13ce98 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:44.512461 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bce7d809-a82d-4be8-9dc6-28296b13ce98 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:44.514718 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bce7d809-a82d-4be8-9dc6-28296b13ce98 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:44.517103 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bce7d809-a82d-4be8-9dc6-28296b13ce98 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:44.783180 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-25e4fdcf-ca55-4334-adcd-46d7d6367845 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:44.785647 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-25e4fdcf-ca55-4334-adcd-46d7d6367845 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:44.809461 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25e4fdcf-ca55-4334-adcd-46d7d6367845 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:44.811173 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25e4fdcf-ca55-4334-adcd-46d7d6367845 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:44.817459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25e4fdcf-ca55-4334-adcd-46d7d6367845 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:44.819641 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25e4fdcf-ca55-4334-adcd-46d7d6367845 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:44.882359 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bce7d809-a82d-4be8-9dc6-28296b13ce98 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:44.891506 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bce7d809-a82d-4be8-9dc6-28296b13ce98 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1698 microversion: 2.1 time: 0.399674 Jul 31 01:30:44.893018 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2171/4359] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:44 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1698 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:45.162951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-25e4fdcf-ca55-4334-adcd-46d7d6367845 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:45.171876 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-25e4fdcf-ca55-4334-adcd-46d7d6367845 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1327 microversion: 2.1 time: 0.398191 Jul 31 01:30:45.178255 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2189/4360] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:44 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1327 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:45.250001 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8f79665b-8874-4b9d-a091-742d52738ba9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:45.251070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8f79665b-8874-4b9d-a091-742d52738ba9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:45.261888 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f79665b-8874-4b9d-a091-742d52738ba9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:45.265011 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f79665b-8874-4b9d-a091-742d52738ba9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:45.269074 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f79665b-8874-4b9d-a091-742d52738ba9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:45.269766 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f79665b-8874-4b9d-a091-742d52738ba9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:45.605866 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8f79665b-8874-4b9d-a091-742d52738ba9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:45.627786 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8f79665b-8874-4b9d-a091-742d52738ba9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 0.382159 Jul 31 01:30:45.640423 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2172/4361] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:45 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:45.916040 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-039a0f84-3121-49cb-89f0-576d2c704260 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:45.917298 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-039a0f84-3121-49cb-89f0-576d2c704260 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:45.932043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-039a0f84-3121-49cb-89f0-576d2c704260 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:45.932773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-039a0f84-3121-49cb-89f0-576d2c704260 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:45.934039 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-039a0f84-3121-49cb-89f0-576d2c704260 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:45.936641 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-039a0f84-3121-49cb-89f0-576d2c704260 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:46.200822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1e156298-04ba-4319-a1e6-e31defe6a860 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:46.201493 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1e156298-04ba-4319-a1e6-e31defe6a860 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:46.227355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e156298-04ba-4319-a1e6-e31defe6a860 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:46.228654 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e156298-04ba-4319-a1e6-e31defe6a860 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:46.229314 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e156298-04ba-4319-a1e6-e31defe6a860 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:46.235419 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e156298-04ba-4319-a1e6-e31defe6a860 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:46.490731 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-039a0f84-3121-49cb-89f0-576d2c704260 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:46.500952 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-039a0f84-3121-49cb-89f0-576d2c704260 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1698 microversion: 2.1 time: 0.591387 Jul 31 01:30:46.524688 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2190/4362] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:45 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1698 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:46.673110 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b11fef84-2f1d-4c41-8b1f-58c8cf7a94eb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:46.676254 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b11fef84-2f1d-4c41-8b1f-58c8cf7a94eb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:46.719268 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b11fef84-2f1d-4c41-8b1f-58c8cf7a94eb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:46.719841 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b11fef84-2f1d-4c41-8b1f-58c8cf7a94eb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:46.720680 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b11fef84-2f1d-4c41-8b1f-58c8cf7a94eb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:46.721135 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b11fef84-2f1d-4c41-8b1f-58c8cf7a94eb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:48.328967 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1e156298-04ba-4319-a1e6-e31defe6a860 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:48.343120 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1e156298-04ba-4319-a1e6-e31defe6a860 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1327 microversion: 2.1 time: 2.144860 Jul 31 01:30:48.345968 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2173/4363] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:46 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1327 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:48.363665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-690cd6c8-6dae-400c-9b3b-068cb0861698 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:48.375206 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-690cd6c8-6dae-400c-9b3b-068cb0861698 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:48.400830 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-690cd6c8-6dae-400c-9b3b-068cb0861698 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:48.407399 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-690cd6c8-6dae-400c-9b3b-068cb0861698 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:48.412291 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-690cd6c8-6dae-400c-9b3b-068cb0861698 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:48.415092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-690cd6c8-6dae-400c-9b3b-068cb0861698 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:49.553539 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b11fef84-2f1d-4c41-8b1f-58c8cf7a94eb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:49.572647 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b11fef84-2f1d-4c41-8b1f-58c8cf7a94eb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 2.923732 Jul 31 01:30:49.580302 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2191/4364] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:46 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 2932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:49.606440 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-7d8266e2-4ba6-41f4-97cc-4166b5f46bc9 req-7231c961-6484-4afd-b4b4-ec7e7983e0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef55e86b-d3da-4daf-b877-383d7b1d4702", "tag": "d6b752f5-3579-4fe9-853b-7a0a340a14a4"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:30:49.670141 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7d8266e2-4ba6-41f4-97cc-4166b5f46bc9 req-7231c961-6484-4afd-b4b4-ec7e7983e0a0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:49.672644 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7d8266e2-4ba6-41f4-97cc-4166b5f46bc9 req-7231c961-6484-4afd-b4b4-ec7e7983e0a0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:49.735288 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-7d8266e2-4ba6-41f4-97cc-4166b5f46bc9 req-7231c961-6484-4afd-b4b4-ec7e7983e0a0 service nova] Creating event network-changed:d6b752f5-3579-4fe9-853b-7a0a340a14a4 for instance ef55e86b-d3da-4daf-b877-383d7b1d4702 on n-h2-master-1 Jul 31 01:30:49.755869 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-7d8266e2-4ba6-41f4-97cc-4166b5f46bc9 req-7231c961-6484-4afd-b4b4-ec7e7983e0a0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173658 Jul 31 01:30:49.760181 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2192/4365] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:30:49.788648 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fad34155-b77e-436c-a582-c20acb4213af tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:49.789432 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fad34155-b77e-436c-a582-c20acb4213af tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:49.821637 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fad34155-b77e-436c-a582-c20acb4213af tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:49.822396 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fad34155-b77e-436c-a582-c20acb4213af tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:49.826165 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fad34155-b77e-436c-a582-c20acb4213af tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:49.826761 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fad34155-b77e-436c-a582-c20acb4213af tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:50.593057 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-690cd6c8-6dae-400c-9b3b-068cb0861698 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:50.631202 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-690cd6c8-6dae-400c-9b3b-068cb0861698 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1698 microversion: 2.1 time: 2.272262 Jul 31 01:30:50.634756 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2174/4366] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:48 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1698 bytes in 2286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:50.680714 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-97158786-2e25-4256-864b-835e4abd6522 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:50.683117 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-97158786-2e25-4256-864b-835e4abd6522 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:50.706280 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97158786-2e25-4256-864b-835e4abd6522 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:50.706743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97158786-2e25-4256-864b-835e4abd6522 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:50.707573 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97158786-2e25-4256-864b-835e4abd6522 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:50.707997 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97158786-2e25-4256-864b-835e4abd6522 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:52.187809 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-97158786-2e25-4256-864b-835e4abd6522 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:52.205189 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-97158786-2e25-4256-864b-835e4abd6522 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 1.553684 Jul 31 01:30:52.207938 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2175/4367] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:50 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:52.218772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7d6a4de2-a31f-44a4-9114-da781160b2f9 req-d44d92f9-66f8-49c2-9dd4-8b9107dda046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d515738b-e8ce-4336-8278-1ddd9cd032d9", "name": "network-vif-unplugged", "status": "completed", "tag": "83ab76da-4e9c-430c-9650-352f45e6da6b"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:30:52.253808 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7d6a4de2-a31f-44a4-9114-da781160b2f9 req-d44d92f9-66f8-49c2-9dd4-8b9107dda046 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:52.254773 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7d6a4de2-a31f-44a4-9114-da781160b2f9 req-d44d92f9-66f8-49c2-9dd4-8b9107dda046 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:52.275190 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7d6a4de2-a31f-44a4-9114-da781160b2f9 req-d44d92f9-66f8-49c2-9dd4-8b9107dda046 service nova] Creating event network-vif-unplugged:83ab76da-4e9c-430c-9650-352f45e6da6b for instance d515738b-e8ce-4336-8278-1ddd9cd032d9 on n-h1-master-1 Jul 31 01:30:52.283126 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7d6a4de2-a31f-44a4-9114-da781160b2f9 req-d44d92f9-66f8-49c2-9dd4-8b9107dda046 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072693 Jul 31 01:30:52.284236 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2176/4368] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:30:52.292038 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-748331f8-c9a7-421c-bdca-509d43d7d974 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:52.296436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-748331f8-c9a7-421c-bdca-509d43d7d974 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:52.308511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-748331f8-c9a7-421c-bdca-509d43d7d974 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:52.309769 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-748331f8-c9a7-421c-bdca-509d43d7d974 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:52.311630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-748331f8-c9a7-421c-bdca-509d43d7d974 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:52.312475 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-748331f8-c9a7-421c-bdca-509d43d7d974 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:52.459089 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fad34155-b77e-436c-a582-c20acb4213af tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:52.469695 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fad34155-b77e-436c-a582-c20acb4213af tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1327 microversion: 2.1 time: 2.707448 Jul 31 01:30:52.475852 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2193/4369] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:49 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1327 bytes in 2715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:52.940381 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:53.148557 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-748331f8-c9a7-421c-bdca-509d43d7d974 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:53.160083 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-748331f8-c9a7-421c-bdca-509d43d7d974 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1698 microversion: 2.1 time: 0.874346 Jul 31 01:30:53.160690 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2177/4370] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:52 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1698 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:53.237001 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9c94f794-0193-4d66-b847-af137eef194b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:53.237679 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9c94f794-0193-4d66-b847-af137eef194b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:53.258507 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:53.261213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c94f794-0193-4d66-b847-af137eef194b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:53.277486 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c94f794-0193-4d66-b847-af137eef194b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:53.279410 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c94f794-0193-4d66-b847-af137eef194b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:53.280567 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c94f794-0193-4d66-b847-af137eef194b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:53.491173 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-01df88e8-3503-41f4-8400-5355d1ada875 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:53.495379 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-01df88e8-3503-41f4-8400-5355d1ada875 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:53.508935 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=10 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:53.512117 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-01df88e8-3503-41f4-8400-5355d1ada875 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:53.521905 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-01df88e8-3503-41f4-8400-5355d1ada875 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:53.523157 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-01df88e8-3503-41f4-8400-5355d1ada875 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:53.528136 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-01df88e8-3503-41f4-8400-5355d1ada875 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:54.073693 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9c94f794-0193-4d66-b847-af137eef194b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:54.081939 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9c94f794-0193-4d66-b847-af137eef194b tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 0.849287 Jul 31 01:30:54.089527 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2194/4371] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:53 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:54.126380 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-01df88e8-3503-41f4-8400-5355d1ada875 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:54.140947 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-01df88e8-3503-41f4-8400-5355d1ada875 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1327 microversion: 2.1 time: 0.652115 Jul 31 01:30:54.144069 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2178/4372] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:53 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1327 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:54.191226 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-512cd437-815e-4dd8-a938-cda83e214609 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:54.192070 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-512cd437-815e-4dd8-a938-cda83e214609 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:54.202908 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:30:54.209380 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-512cd437-815e-4dd8-a938-cda83e214609 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:54.211941 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-512cd437-815e-4dd8-a938-cda83e214609 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:54.214111 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-512cd437-815e-4dd8-a938-cda83e214609 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:54.217967 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-512cd437-815e-4dd8-a938-cda83e214609 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:54.361096 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-512cd437-815e-4dd8-a938-cda83e214609 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:54.372130 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-512cd437-815e-4dd8-a938-cda83e214609 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1631 microversion: 2.1 time: 0.185576 Jul 31 01:30:54.373551 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2195/4373] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:54 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1631 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:55.111203 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8aeab01a-2a03-4b27-80e2-bdb2545048f5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:55.112565 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8aeab01a-2a03-4b27-80e2-bdb2545048f5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:55.139593 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8aeab01a-2a03-4b27-80e2-bdb2545048f5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:55.142689 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8aeab01a-2a03-4b27-80e2-bdb2545048f5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:55.146070 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8aeab01a-2a03-4b27-80e2-bdb2545048f5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:55.147988 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8aeab01a-2a03-4b27-80e2-bdb2545048f5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:55.164520 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7897e31e-ad89-4122-904f-b4e2777b1ef9 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:55.165877 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7897e31e-ad89-4122-904f-b4e2777b1ef9 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:55.182371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7897e31e-ad89-4122-904f-b4e2777b1ef9 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:55.188153 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7897e31e-ad89-4122-904f-b4e2777b1ef9 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:55.189516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7897e31e-ad89-4122-904f-b4e2777b1ef9 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:55.194634 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7897e31e-ad89-4122-904f-b4e2777b1ef9 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:56.615427 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8aeab01a-2a03-4b27-80e2-bdb2545048f5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:56.635118 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7897e31e-ad89-4122-904f-b4e2777b1ef9 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:56.665169 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8aeab01a-2a03-4b27-80e2-bdb2545048f5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 1.556380 Jul 31 01:30:56.667745 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7897e31e-ad89-4122-904f-b4e2777b1ef9 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1327 microversion: 2.1 time: 1.504856 Jul 31 01:30:56.670195 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2179/4374] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:55 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:30:56.675562 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c019d8cc-d93a-41b4-b900-d5d43222d3d1 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:56.681448 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c019d8cc-d93a-41b4-b900-d5d43222d3d1 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:56.688587 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2196/4375] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:55 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1327 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:30:56.695291 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c019d8cc-d93a-41b4-b900-d5d43222d3d1 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:56.696163 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c019d8cc-d93a-41b4-b900-d5d43222d3d1 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:56.697380 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c019d8cc-d93a-41b4-b900-d5d43222d3d1 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:56.697970 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c019d8cc-d93a-41b4-b900-d5d43222d3d1 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:57.033052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c019d8cc-d93a-41b4-b900-d5d43222d3d1 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b299fe87d4ec478092658a35f882ffa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c926541f0e1c4cd6b64d09f2a89b4729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:57.079516 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c019d8cc-d93a-41b4-b900-d5d43222d3d1 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 200 len: 1631 microversion: 2.1 time: 0.407910 Jul 31 01:30:57.099485 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2180/4376] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:56 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 1631 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:57.109004 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-845af3af-fd16-4ef2-a690-012bd37df14e req-a21f4868-415b-45f7-ad0c-27da27eeba7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d515738b-e8ce-4336-8278-1ddd9cd032d9", "name": "network-vif-deleted", "tag": "83ab76da-4e9c-430c-9650-352f45e6da6b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:30:57.163511 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-845af3af-fd16-4ef2-a690-012bd37df14e req-a21f4868-415b-45f7-ad0c-27da27eeba7a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:57.164438 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-845af3af-fd16-4ef2-a690-012bd37df14e req-a21f4868-415b-45f7-ad0c-27da27eeba7a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:57.192837 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-845af3af-fd16-4ef2-a690-012bd37df14e req-a21f4868-415b-45f7-ad0c-27da27eeba7a service nova] Creating event network-vif-deleted:83ab76da-4e9c-430c-9650-352f45e6da6b for instance d515738b-e8ce-4336-8278-1ddd9cd032d9 on n-h1-master-1 Jul 31 01:30:57.202032 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-845af3af-fd16-4ef2-a690-012bd37df14e req-a21f4868-415b-45f7-ad0c-27da27eeba7a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094259 Jul 31 01:30:57.203518 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2197/4377] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:30:57.690255 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fc8a66f2-ebf3-414d-853b-0521d1e6ebc8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:57.690873 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fc8a66f2-ebf3-414d-853b-0521d1e6ebc8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:57.707223 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc8a66f2-ebf3-414d-853b-0521d1e6ebc8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:57.709571 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1dc02f1d-de94-4daf-aab8-bb7548a78887 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:57.710335 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1dc02f1d-de94-4daf-aab8-bb7548a78887 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:57.717893 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc8a66f2-ebf3-414d-853b-0521d1e6ebc8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:57.722941 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc8a66f2-ebf3-414d-853b-0521d1e6ebc8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:57.731021 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc8a66f2-ebf3-414d-853b-0521d1e6ebc8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:57.738497 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1dc02f1d-de94-4daf-aab8-bb7548a78887 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:57.738959 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1dc02f1d-de94-4daf-aab8-bb7548a78887 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:57.740646 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1dc02f1d-de94-4daf-aab8-bb7548a78887 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:57.741265 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1dc02f1d-de94-4daf-aab8-bb7548a78887 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:58.635166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fc8a66f2-ebf3-414d-853b-0521d1e6ebc8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:58.669309 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fc8a66f2-ebf3-414d-853b-0521d1e6ebc8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 0.965156 Jul 31 01:30:58.674699 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2181/4378] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:57 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:58.710650 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-866f62a1-b811-42b8-8599-7f40bcdf772a tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:58.711488 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-866f62a1-b811-42b8-8599-7f40bcdf772a tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] [instance: d515738b-e8ce-4336-8278-1ddd9cd032d9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:58.759482 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-866f62a1-b811-42b8-8599-7f40bcdf772a tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:58.766410 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-866f62a1-b811-42b8-8599-7f40bcdf772a tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:58.776485 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-866f62a1-b811-42b8-8599-7f40bcdf772a tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:58.783163 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-866f62a1-b811-42b8-8599-7f40bcdf772a tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:58.834496 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1dc02f1d-de94-4daf-aab8-bb7548a78887 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:30:58.851514 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-866f62a1-b811-42b8-8599-7f40bcdf772a tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] HTTP exception thrown: Instance d515738b-e8ce-4336-8278-1ddd9cd032d9 could not be found. Jul 31 01:30:58.855779 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1dc02f1d-de94-4daf-aab8-bb7548a78887 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1327 microversion: 2.1 time: 1.147801 Jul 31 01:30:58.857761 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2198/4379] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:57 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1327 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-866f62a1-b811-42b8-8599-7f40bcdf772a tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Request method failure captured: Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 HTTP/1.1 Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dr51vJu9nKn1RVFjDNfwr6pncyyKO1_-Un1ce_BHrwPpHJ8XJNytLEEA-ugWhEKxTy5S9hokkuo86swCwZjimzCZxw__OzusAgjZYsKb-rcQqMMbViptMoHE2UlxT_iJp6dkd9jkE3cCmaz1r0DFlKkKNo4SpTSP6NvmadYYBGWpZY Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: c926541f0e1c4cd6b64d09f2a89b4729 Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersTestJSON-70239953 Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c926541f0e1c4cd6b64d09f2a89b4729"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c926541f0e1c4cd6b64d09f2a89b4729"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c926541f0e1c4cd6b64d09f2a89b4729"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c926541f0e1c4cd6b64d09f2a89b4729", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersTestJSON-70239953 Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: c926541f0e1c4cd6b64d09f2a89b4729 Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersTestJSON-70239953 Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersTestJSON-70239953-project Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: b299fe87d4ec478092658a35f882ffa2 Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersTestJSON-70239953-project Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: exception: Instance d515738b-e8ce-4336-8278-1ddd9cd032d9 could not be found. Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'd515738b-e8ce-4336-8278-1ddd9cd032d9'} Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d515738b-e8ce-4336-8278-1ddd9cd032d9 could not be found. Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d515738b-e8ce-4336-8278-1ddd9cd032d9 could not be found. Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:30:58.872590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:30:58.877701 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:30:58.877701 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:30:58.877701 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:30:58.877701 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:30:58.877701 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d515738b-e8ce-4336-8278-1ddd9cd032d9 could not be found. Jul 31 01:30:58.877701 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:30:58.883483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-866f62a1-b811-42b8-8599-7f40bcdf772a tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Returning 404 to user: Instance d515738b-e8ce-4336-8278-1ddd9cd032d9 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:30:58.891722 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-866f62a1-b811-42b8-8599-7f40bcdf772a tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9" status: 404 len: 111 microversion: 2.1 time: 0.213722 Jul 31 01:30:58.898062 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2182/4380] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:58 2022] GET /compute/v2.1/servers/d515738b-e8ce-4336-8278-1ddd9cd032d9 => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:30:58.903922 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-421e927e-8344-44c3-9645-c3fe6436e573 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] Calling method '.version_select at 0x7fede52a7160>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:58.966077 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-421e927e-8344-44c3-9645-c3fe6436e573 tempest-ServersTestJSON-70239953 tempest-ServersTestJSON-70239953-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-583265666" status: 202 len: 0 microversion: 2.1 time: 0.062904 Jul 31 01:30:58.976650 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2199/4381] 10.222.0.45 () {58 vars in 1218 bytes} [Sun Jul 31 01:30:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-583265666 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:30:59.690368 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-78a0ee25-d316-40da-9c32-16ad884a679d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:59.690996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-78a0ee25-d316-40da-9c32-16ad884a679d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:59.709979 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78a0ee25-d316-40da-9c32-16ad884a679d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:59.724364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78a0ee25-d316-40da-9c32-16ad884a679d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:59.728672 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78a0ee25-d316-40da-9c32-16ad884a679d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:59.729213 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78a0ee25-d316-40da-9c32-16ad884a679d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:59.879128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-db8f4a46-1eb2-4a78-92bb-a6f2cac3dc40 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:30:59.879810 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-db8f4a46-1eb2-4a78-92bb-a6f2cac3dc40 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:30:59.897023 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db8f4a46-1eb2-4a78-92bb-a6f2cac3dc40 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:59.897478 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db8f4a46-1eb2-4a78-92bb-a6f2cac3dc40 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:30:59.898278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db8f4a46-1eb2-4a78-92bb-a6f2cac3dc40 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:30:59.898716 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db8f4a46-1eb2-4a78-92bb-a6f2cac3dc40 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:00.297809 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-db8f4a46-1eb2-4a78-92bb-a6f2cac3dc40 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:00.301616 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:00.320267 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-db8f4a46-1eb2-4a78-92bb-a6f2cac3dc40 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1327 microversion: 2.1 time: 0.440774 Jul 31 01:31:00.322399 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2200/4382] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:59 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1327 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:01.117182 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-78a0ee25-d316-40da-9c32-16ad884a679d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:01.134921 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-78a0ee25-d316-40da-9c32-16ad884a679d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 1.447592 Jul 31 01:31:01.140693 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2183/4383] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:30:59 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:01.346575 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2f856806-0bb1-4550-b4a9-5b733c0379f8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:01.347617 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2f856806-0bb1-4550-b4a9-5b733c0379f8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:01.400238 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2f856806-0bb1-4550-b4a9-5b733c0379f8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:01.400740 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2f856806-0bb1-4550-b4a9-5b733c0379f8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:01.417027 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2f856806-0bb1-4550-b4a9-5b733c0379f8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:01.418604 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2f856806-0bb1-4550-b4a9-5b733c0379f8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:02.158606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-27930a18-c81e-4a14-9fb2-e57269c45014 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:02.159329 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-27930a18-c81e-4a14-9fb2-e57269c45014 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:02.183378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-27930a18-c81e-4a14-9fb2-e57269c45014 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:02.184503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-27930a18-c81e-4a14-9fb2-e57269c45014 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:02.188312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-27930a18-c81e-4a14-9fb2-e57269c45014 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:02.188973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-27930a18-c81e-4a14-9fb2-e57269c45014 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:03.282599 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-27930a18-c81e-4a14-9fb2-e57269c45014 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:03.292365 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-27930a18-c81e-4a14-9fb2-e57269c45014 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 1.137788 Jul 31 01:31:03.300423 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2184/4384] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:02 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:03.308332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-a8a9513a-2465-4ced-8970-2dfbd02777e4 req-09434b40-d20a-4f98-b3dd-b24f3459c6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef55e86b-d3da-4daf-b877-383d7b1d4702", "name": "network-vif-plugged", "status": "completed", "tag": "d6b752f5-3579-4fe9-853b-7a0a340a14a4"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:03.338099 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a8a9513a-2465-4ced-8970-2dfbd02777e4 req-09434b40-d20a-4f98-b3dd-b24f3459c6fc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:03.338988 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a8a9513a-2465-4ced-8970-2dfbd02777e4 req-09434b40-d20a-4f98-b3dd-b24f3459c6fc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:03.366296 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-a8a9513a-2465-4ced-8970-2dfbd02777e4 req-09434b40-d20a-4f98-b3dd-b24f3459c6fc service nova] Creating event network-vif-plugged:d6b752f5-3579-4fe9-853b-7a0a340a14a4 for instance ef55e86b-d3da-4daf-b877-383d7b1d4702 on n-h2-master-1 Jul 31 01:31:03.386723 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-a8a9513a-2465-4ced-8970-2dfbd02777e4 req-09434b40-d20a-4f98-b3dd-b24f3459c6fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083544 Jul 31 01:31:03.391014 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2185/4385] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:31:03.421581 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2f856806-0bb1-4550-b4a9-5b733c0379f8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:03.433460 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2f856806-0bb1-4550-b4a9-5b733c0379f8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1327 microversion: 2.1 time: 2.093362 Jul 31 01:31:03.437303 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2201/4386] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:01 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1327 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:04.328248 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-72888bae-e61f-4ab2-b71c-a74ff189a194 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:04.329668 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-72888bae-e61f-4ab2-b71c-a74ff189a194 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:04.345421 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72888bae-e61f-4ab2-b71c-a74ff189a194 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:04.346205 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72888bae-e61f-4ab2-b71c-a74ff189a194 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:04.348482 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72888bae-e61f-4ab2-b71c-a74ff189a194 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:04.351616 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72888bae-e61f-4ab2-b71c-a74ff189a194 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:04.469018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4bc00a98-5e90-40a4-9d8f-265e3a63249a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:04.470359 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4bc00a98-5e90-40a4-9d8f-265e3a63249a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:04.493731 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4bc00a98-5e90-40a4-9d8f-265e3a63249a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:04.494198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4bc00a98-5e90-40a4-9d8f-265e3a63249a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:04.501137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4bc00a98-5e90-40a4-9d8f-265e3a63249a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:04.501644 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4bc00a98-5e90-40a4-9d8f-265e3a63249a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:06.805376 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4bc00a98-5e90-40a4-9d8f-265e3a63249a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:06.840565 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4bc00a98-5e90-40a4-9d8f-265e3a63249a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1327 microversion: 2.1 time: 2.370649 Jul 31 01:31:06.864980 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2202/4387] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:04 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1327 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:31:07.165128 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-72888bae-e61f-4ab2-b71c-a74ff189a194 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:07.173048 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-72888bae-e61f-4ab2-b71c-a74ff189a194 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 2.849774 Jul 31 01:31:07.174914 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2186/4388] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:04 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 2852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:07.881873 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0539d506-becf-46a5-9cd2-809ade137aeb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:07.886599 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0539d506-becf-46a5-9cd2-809ade137aeb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:07.920349 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0539d506-becf-46a5-9cd2-809ade137aeb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:07.921003 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0539d506-becf-46a5-9cd2-809ade137aeb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:07.921859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0539d506-becf-46a5-9cd2-809ade137aeb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:07.922310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0539d506-becf-46a5-9cd2-809ade137aeb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:08.196822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c242a7f0-3531-4b4b-ae05-95cd06f9db75 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:08.202854 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c242a7f0-3531-4b4b-ae05-95cd06f9db75 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:08.220820 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c242a7f0-3531-4b4b-ae05-95cd06f9db75 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:08.232999 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c242a7f0-3531-4b4b-ae05-95cd06f9db75 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:08.233777 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c242a7f0-3531-4b4b-ae05-95cd06f9db75 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:08.236892 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c242a7f0-3531-4b4b-ae05-95cd06f9db75 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:09.959381 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c242a7f0-3531-4b4b-ae05-95cd06f9db75 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:09.970294 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c242a7f0-3531-4b4b-ae05-95cd06f9db75 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 1.777308 Jul 31 01:31:09.975611 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2187/4389] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:08 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:31:10.167212 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0539d506-becf-46a5-9cd2-809ade137aeb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:10.187409 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0539d506-becf-46a5-9cd2-809ade137aeb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1507 microversion: 2.1 time: 2.328213 Jul 31 01:31:10.195767 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2203/4390] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:07 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1507 bytes in 2337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:10.214193 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e58e62e6-bec5-4fb4-802d-191dbbf1868c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:10.214874 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e58e62e6-bec5-4fb4-802d-191dbbf1868c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:10.231116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e58e62e6-bec5-4fb4-802d-191dbbf1868c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:10.231616 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e58e62e6-bec5-4fb4-802d-191dbbf1868c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:10.232414 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e58e62e6-bec5-4fb4-802d-191dbbf1868c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:10.232860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e58e62e6-bec5-4fb4-802d-191dbbf1868c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:10.320731 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:10.956129 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e58e62e6-bec5-4fb4-802d-191dbbf1868c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:10.980244 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e58e62e6-bec5-4fb4-802d-191dbbf1868c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1507 microversion: 2.1 time: 0.772336 Jul 31 01:31:10.980954 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2188/4391] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:10 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1507 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:11.004519 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2a1f37b4-105c-4706-a07a-0e8a075dc880 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:11.005741 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2a1f37b4-105c-4706-a07a-0e8a075dc880 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:11.011979 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-57b84352-3dc3-45be-8799-e98ed13c1cda tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:11.012499 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-57b84352-3dc3-45be-8799-e98ed13c1cda tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:11.027538 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2a1f37b4-105c-4706-a07a-0e8a075dc880 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:11.028013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2a1f37b4-105c-4706-a07a-0e8a075dc880 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:11.028818 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2a1f37b4-105c-4706-a07a-0e8a075dc880 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:11.029274 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2a1f37b4-105c-4706-a07a-0e8a075dc880 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:11.042959 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57b84352-3dc3-45be-8799-e98ed13c1cda tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:11.043459 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57b84352-3dc3-45be-8799-e98ed13c1cda tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:11.044261 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57b84352-3dc3-45be-8799-e98ed13c1cda tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:11.044714 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57b84352-3dc3-45be-8799-e98ed13c1cda tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:11.162610 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-57b84352-3dc3-45be-8799-e98ed13c1cda tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:31:11.320894 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-57b84352-3dc3-45be-8799-e98ed13c1cda tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 204 len: 0 microversion: 2.1 time: 0.320157 Jul 31 01:31:11.321976 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2189/4392] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:31:10 2022] DELETE /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:31:11.332828 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6dc747b8-582e-4fb3-9a9b-b9727297eb90 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:11.336080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6dc747b8-582e-4fb3-9a9b-b9727297eb90 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:11.350723 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6dc747b8-582e-4fb3-9a9b-b9727297eb90 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:11.351642 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6dc747b8-582e-4fb3-9a9b-b9727297eb90 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:11.352735 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6dc747b8-582e-4fb3-9a9b-b9727297eb90 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:11.354750 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6dc747b8-582e-4fb3-9a9b-b9727297eb90 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:11.696203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2a1f37b4-105c-4706-a07a-0e8a075dc880 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:11.710077 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2a1f37b4-105c-4706-a07a-0e8a075dc880 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 0.714508 Jul 31 01:31:11.725128 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2204/4393] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:10 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:12.627773 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-593f3b6b-2a96-424c-8e13-ced296caf8a5 req-0d1c0f27-9063-4a5f-b753-d05a57397975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76757e35-eebd-46de-a012-82bd864fd1d2", "name": "network-vif-plugged", "status": "completed", "tag": "a84852a6-e79d-4e96-9273-a29f94e85006"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:12.653964 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-593f3b6b-2a96-424c-8e13-ced296caf8a5 req-0d1c0f27-9063-4a5f-b753-d05a57397975 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:12.655255 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-593f3b6b-2a96-424c-8e13-ced296caf8a5 req-0d1c0f27-9063-4a5f-b753-d05a57397975 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:12.680660 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-593f3b6b-2a96-424c-8e13-ced296caf8a5 req-0d1c0f27-9063-4a5f-b753-d05a57397975 service nova] Creating event network-vif-plugged:a84852a6-e79d-4e96-9273-a29f94e85006 for instance 76757e35-eebd-46de-a012-82bd864fd1d2 on n-h2-master-1 Jul 31 01:31:12.694517 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-593f3b6b-2a96-424c-8e13-ced296caf8a5 req-0d1c0f27-9063-4a5f-b753-d05a57397975 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069959 Jul 31 01:31:12.695750 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2205/4394] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:31:12.734602 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3a0e5652-174b-4233-9103-dbfb2e2857a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:12.735881 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3a0e5652-174b-4233-9103-dbfb2e2857a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:12.747915 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3a0e5652-174b-4233-9103-dbfb2e2857a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:12.748384 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3a0e5652-174b-4233-9103-dbfb2e2857a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:12.754531 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3a0e5652-174b-4233-9103-dbfb2e2857a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:12.759385 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3a0e5652-174b-4233-9103-dbfb2e2857a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:12.794220 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6dc747b8-582e-4fb3-9a9b-b9727297eb90 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:12.820511 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6dc747b8-582e-4fb3-9a9b-b9727297eb90 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1513 microversion: 2.1 time: 1.493857 Jul 31 01:31:12.824551 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2190/4395] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:11 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1513 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:31:13.293898 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3a0e5652-174b-4233-9103-dbfb2e2857a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:13.308241 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3a0e5652-174b-4233-9103-dbfb2e2857a0 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 0.577887 Jul 31 01:31:13.323540 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2206/4396] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:12 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:31:13.849888 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-93d19070-1d04-4c80-a9ee-46b1b184b970 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:13.851127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-93d19070-1d04-4c80-a9ee-46b1b184b970 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:13.879027 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:13.883816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93d19070-1d04-4c80-a9ee-46b1b184b970 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:13.884287 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93d19070-1d04-4c80-a9ee-46b1b184b970 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:13.895264 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93d19070-1d04-4c80-a9ee-46b1b184b970 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:13.895998 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93d19070-1d04-4c80-a9ee-46b1b184b970 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:14.331999 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2b04bd09-6aea-4ba8-a527-b0ed45d305f6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:14.334860 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2b04bd09-6aea-4ba8-a527-b0ed45d305f6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:14.377045 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b04bd09-6aea-4ba8-a527-b0ed45d305f6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:14.378061 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b04bd09-6aea-4ba8-a527-b0ed45d305f6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:14.381545 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b04bd09-6aea-4ba8-a527-b0ed45d305f6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:14.385507 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b04bd09-6aea-4ba8-a527-b0ed45d305f6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:14.463225 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-93d19070-1d04-4c80-a9ee-46b1b184b970 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:14.476042 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-93d19070-1d04-4c80-a9ee-46b1b184b970 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1513 microversion: 2.1 time: 0.635205 Jul 31 01:31:14.476960 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2191/4397] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:13 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1513 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:15.279868 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2b04bd09-6aea-4ba8-a527-b0ed45d305f6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:15.333432 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2b04bd09-6aea-4ba8-a527-b0ed45d305f6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 0.998956 Jul 31 01:31:15.335228 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2207/4398] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:14 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:15.497570 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6c8c1648-c326-463b-8fdb-c8cabc98e842 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:15.499809 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6c8c1648-c326-463b-8fdb-c8cabc98e842 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:15.521042 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c8c1648-c326-463b-8fdb-c8cabc98e842 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:15.521535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c8c1648-c326-463b-8fdb-c8cabc98e842 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:15.522365 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c8c1648-c326-463b-8fdb-c8cabc98e842 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:15.532179 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c8c1648-c326-463b-8fdb-c8cabc98e842 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:16.358068 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ce901156-9a1e-4bcb-9427-397ec634e541 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:16.358703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ce901156-9a1e-4bcb-9427-397ec634e541 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:16.371184 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce901156-9a1e-4bcb-9427-397ec634e541 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:16.372105 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce901156-9a1e-4bcb-9427-397ec634e541 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:16.376969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce901156-9a1e-4bcb-9427-397ec634e541 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:16.380340 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce901156-9a1e-4bcb-9427-397ec634e541 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:16.815620 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6c8c1648-c326-463b-8fdb-c8cabc98e842 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:16.825605 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6c8c1648-c326-463b-8fdb-c8cabc98e842 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 200 len: 1513 microversion: 2.1 time: 1.332764 Jul 31 01:31:16.827607 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2192/4399] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:15 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 1513 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:16.898829 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e0886673-8f15-434a-a4a5-6e420a226afa req-e1fb2fb0-8025-4347-98bd-b594fd367239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef55e86b-d3da-4daf-b877-383d7b1d4702", "name": "network-vif-deleted", "tag": "d6b752f5-3579-4fe9-853b-7a0a340a14a4"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:16.939821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e0886673-8f15-434a-a4a5-6e420a226afa req-e1fb2fb0-8025-4347-98bd-b594fd367239 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:16.940861 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e0886673-8f15-434a-a4a5-6e420a226afa req-e1fb2fb0-8025-4347-98bd-b594fd367239 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:16.972772 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e0886673-8f15-434a-a4a5-6e420a226afa req-e1fb2fb0-8025-4347-98bd-b594fd367239 service nova] Creating event network-vif-deleted:d6b752f5-3579-4fe9-853b-7a0a340a14a4 for instance ef55e86b-d3da-4daf-b877-383d7b1d4702 on n-h2-master-1 Jul 31 01:31:16.981998 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e0886673-8f15-434a-a4a5-6e420a226afa req-e1fb2fb0-8025-4347-98bd-b594fd367239 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087515 Jul 31 01:31:16.983267 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2193/4400] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:31:17.143542 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ce901156-9a1e-4bcb-9427-397ec634e541 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:17.160494 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ce901156-9a1e-4bcb-9427-397ec634e541 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1518 microversion: 2.1 time: 0.807757 Jul 31 01:31:17.163428 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2208/4401] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:16 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1518 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:17.852202 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5faad40c-dc22-4353-951c-558102ea6cff tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:17.853589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5faad40c-dc22-4353-951c-558102ea6cff tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:17.873087 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5faad40c-dc22-4353-951c-558102ea6cff tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:17.873966 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5faad40c-dc22-4353-951c-558102ea6cff tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:17.877374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5faad40c-dc22-4353-951c-558102ea6cff tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:17.878331 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5faad40c-dc22-4353-951c-558102ea6cff tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:17.913759 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-5faad40c-dc22-4353-951c-558102ea6cff tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5faad40c-dc22-4353-951c-558102ea6cff tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 HTTP/1.1 Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: exception: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'ef55e86b-d3da-4daf-b877-383d7b1d4702'} Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:17.916568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:17.922005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:17.922005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:17.922005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:31:17.922005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:31:17.922005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. Jul 31 01:31:17.922005 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:17.924679 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5faad40c-dc22-4353-951c-558102ea6cff tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:31:17.925904 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5faad40c-dc22-4353-951c-558102ea6cff tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 404 len: 111 microversion: 2.1 time: 0.080978 Jul 31 01:31:17.927721 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2194/4402] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:17 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:31:17.939681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bffe12fe-67c3-48f6-8824-2c21197e2f29 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '.version_select at 0x7fede57b1ee0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:17.982412 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bffe12fe-67c3-48f6-8824-2c21197e2f29 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-key-831866036" status: 202 len: 0 microversion: 2.1 time: 0.046007 Jul 31 01:31:17.990149 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2209/4403] 10.222.0.45 () {58 vars in 1206 bytes} [Sun Jul 31 01:31:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-831866036 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:31:18.128134 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bfce2e1d-8b69-4f03-9fa9-92742f3561e8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-465322241", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "ce8b5cb4-aa2f-4dfd-abb4-9273e2a34e90"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:18.195802 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c9892ac4-cafd-4f75-955c-f393a2110997 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:18.198640 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c9892ac4-cafd-4f75-955c-f393a2110997 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:18.240136 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9892ac4-cafd-4f75-955c-f393a2110997 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:18.241030 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9892ac4-cafd-4f75-955c-f393a2110997 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:18.242322 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9892ac4-cafd-4f75-955c-f393a2110997 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:18.243032 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9892ac4-cafd-4f75-955c-f393a2110997 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:18.292652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-bfce2e1d-8b69-4f03-9fa9-92742f3561e8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] validate_networks() for [('ce8b5cb4-aa2f-4dfd-abb4-9273e2a34e90', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:31:19.553898 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c9892ac4-cafd-4f75-955c-f393a2110997 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:19.569368 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c9892ac4-cafd-4f75-955c-f393a2110997 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 1.389915 Jul 31 01:31:19.570285 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2210/4404] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:18 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:31:19.596835 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9011a23d-7363-4198-8399-c8b816f0eece tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:19.597702 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9011a23d-7363-4198-8399-c8b816f0eece tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:19.608630 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9011a23d-7363-4198-8399-c8b816f0eece tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:19.609993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9011a23d-7363-4198-8399-c8b816f0eece tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:19.623549 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9011a23d-7363-4198-8399-c8b816f0eece tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:19.624415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9011a23d-7363-4198-8399-c8b816f0eece tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:21.018406 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-bfce2e1d-8b69-4f03-9fa9-92742f3561e8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:31:21.019428 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-bfce2e1d-8b69-4f03-9fa9-92742f3561e8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:31:21.020089 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-bfce2e1d-8b69-4f03-9fa9-92742f3561e8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:31:21.021241 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-bfce2e1d-8b69-4f03-9fa9-92742f3561e8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:31:21.022050 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-bfce2e1d-8b69-4f03-9fa9-92742f3561e8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:31:21.040823 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfce2e1d-8b69-4f03-9fa9-92742f3561e8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:21.041592 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9011a23d-7363-4198-8399-c8b816f0eece tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:21.044450 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfce2e1d-8b69-4f03-9fa9-92742f3561e8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:21.047468 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfce2e1d-8b69-4f03-9fa9-92742f3561e8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:21.047938 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfce2e1d-8b69-4f03-9fa9-92742f3561e8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:21.051432 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9011a23d-7363-4198-8399-c8b816f0eece tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 1.458974 Jul 31 01:31:21.056190 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2211/4405] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:19 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:31:21.090662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bd239c6f-7755-4df1-9b83-ab951dba4aab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:21.091650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bd239c6f-7755-4df1-9b83-ab951dba4aab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:21.105874 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd239c6f-7755-4df1-9b83-ab951dba4aab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:21.106600 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd239c6f-7755-4df1-9b83-ab951dba4aab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:21.107017 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-bfce2e1d-8b69-4f03-9fa9-92742f3561e8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:31:21.107948 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd239c6f-7755-4df1-9b83-ab951dba4aab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:21.109110 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd239c6f-7755-4df1-9b83-ab951dba4aab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:21.151802 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-bfce2e1d-8b69-4f03-9fa9-92742f3561e8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for user 159706f59a12427f9a3c03fa31f712f3 and project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:31:21.200429 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bfce2e1d-8b69-4f03-9fa9-92742f3561e8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:31:21.204404 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bfce2e1d-8b69-4f03-9fa9-92742f3561e8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:31:21.337497 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bfce2e1d-8b69-4f03-9fa9-92742f3561e8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.214072 Jul 31 01:31:21.338409 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2195/4406] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:31:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:31:21.369067 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c49c0c0b-98a5-4e62-85ec-ef2d5c964d46 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:21.375424 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c49c0c0b-98a5-4e62-85ec-ef2d5c964d46 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:21.702964 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c49c0c0b-98a5-4e62-85ec-ef2d5c964d46 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:21.712755 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c49c0c0b-98a5-4e62-85ec-ef2d5c964d46 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1208 microversion: 2.1 time: 0.362778 Jul 31 01:31:21.720794 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2196/4407] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:21 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1208 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:21.912299 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bd239c6f-7755-4df1-9b83-ab951dba4aab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:21.924780 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bd239c6f-7755-4df1-9b83-ab951dba4aab tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.837188 Jul 31 01:31:21.930004 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2212/4408] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:21 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:31:21.952306 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-88ad390d-1532-43e2-ab51-38f62e0557ce tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:21.963634 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-88ad390d-1532-43e2-ab51-38f62e0557ce tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance bda89c8f-8b03-4ce7-9726-82df785b82eb has no mapping to a cell. Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-88ad390d-1532-43e2-ab51-38f62e0557ce tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/bda89c8f-8b03-4ce7-9726-82df785b82eb/action HTTP/1.1 Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 15 Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: {"os-stop": {}} Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: exception: Instance bda89c8f-8b03-4ce7-9726-82df785b82eb has no mapping to a cell. Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'bda89c8f-8b03-4ce7-9726-82df785b82eb', 'body': {'os-stop': {}}} Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance bda89c8f-8b03-4ce7-9726-82df785b82eb has no mapping to a cell. Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:31:21.969725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bda89c8f-8b03-4ce7-9726-82df785b82eb has no mapping to a cell. Jul 31 01:31:21.975603 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:21.975603 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:21.975603 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:21.975603 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:21.975603 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:21.975603 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:21.975603 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:31:21.975603 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:31:21.975603 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bda89c8f-8b03-4ce7-9726-82df785b82eb has no mapping to a cell. Jul 31 01:31:21.975603 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:21.979234 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-88ad390d-1532-43e2-ab51-38f62e0557ce tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance bda89c8f-8b03-4ce7-9726-82df785b82eb has no mapping to a cell. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:31:21.983313 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-88ad390d-1532-43e2-ab51-38f62e0557ce tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/bda89c8f-8b03-4ce7-9726-82df785b82eb/action" status: 404 len: 117 microversion: 2.1 time: 0.036165 Jul 31 01:31:21.988602 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2197/4409] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:31:21 2022] POST /compute/v2.1/servers/bda89c8f-8b03-4ce7-9726-82df785b82eb/action => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:31:21.996717 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ee5067df-bd64-4d6f-9eb0-6ea92aa965c7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:21.997779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ee5067df-bd64-4d6f-9eb0-6ea92aa965c7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:22.014898 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee5067df-bd64-4d6f-9eb0-6ea92aa965c7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:22.016840 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee5067df-bd64-4d6f-9eb0-6ea92aa965c7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:22.018342 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee5067df-bd64-4d6f-9eb0-6ea92aa965c7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:22.018892 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee5067df-bd64-4d6f-9eb0-6ea92aa965c7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:22.701420 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ee5067df-bd64-4d6f-9eb0-6ea92aa965c7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:22.720184 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ee5067df-bd64-4d6f-9eb0-6ea92aa965c7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.725233 Jul 31 01:31:22.735822 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2213/4410] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:21 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:22.748635 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b792eb93-0cd1-490e-b152-82b5979fefea tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:22.749270 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5a3841d6-16cf-4eb7-b8a2-c82ee168be07 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:22.749383 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5a3841d6-16cf-4eb7-b8a2-c82ee168be07 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:22.750298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b792eb93-0cd1-490e-b152-82b5979fefea tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:22.763771 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b792eb93-0cd1-490e-b152-82b5979fefea tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:22.765549 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a3841d6-16cf-4eb7-b8a2-c82ee168be07 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:22.766013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a3841d6-16cf-4eb7-b8a2-c82ee168be07 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:22.766822 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a3841d6-16cf-4eb7-b8a2-c82ee168be07 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:22.767269 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a3841d6-16cf-4eb7-b8a2-c82ee168be07 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:22.774467 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b792eb93-0cd1-490e-b152-82b5979fefea tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:22.780078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b792eb93-0cd1-490e-b152-82b5979fefea tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:22.784088 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b792eb93-0cd1-490e-b152-82b5979fefea tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:23.231384 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b792eb93-0cd1-490e-b152-82b5979fefea tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:23.257144 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b792eb93-0cd1-490e-b152-82b5979fefea tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1204 microversion: 2.1 time: 0.499139 Jul 31 01:31:23.272376 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2198/4411] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:22 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1204 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:23.669260 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5a3841d6-16cf-4eb7-b8a2-c82ee168be07 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:23.681710 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5a3841d6-16cf-4eb7-b8a2-c82ee168be07 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.937292 Jul 31 01:31:23.685859 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2214/4412] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:22 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:23.710622 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-da924cb2-1766-437c-babd-2537d2abc4be tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:23.711186 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-da924cb2-1766-437c-babd-2537d2abc4be tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 7dc9bec0-ba45-463f-810d-2a9acfa97e43] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:23.735501 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-da924cb2-1766-437c-babd-2537d2abc4be tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 7dc9bec0-ba45-463f-810d-2a9acfa97e43 could not be found. Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-da924cb2-1766-437c-babd-2537d2abc4be tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/7dc9bec0-ba45-463f-810d-2a9acfa97e43/action HTTP/1.1 Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 15 Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: {"suspend": {}} Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 7dc9bec0-ba45-463f-810d-2a9acfa97e43 could not be found. Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '7dc9bec0-ba45-463f-810d-2a9acfa97e43', 'body': {'suspend': {}}} Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dc9bec0-ba45-463f-810d-2a9acfa97e43 could not be found. Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dc9bec0-ba45-463f-810d-2a9acfa97e43 could not be found. Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:23.737268 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:23.742622 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:31:23.742622 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:31:23.742622 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dc9bec0-ba45-463f-810d-2a9acfa97e43 could not be found. Jul 31 01:31:23.742622 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:23.742622 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-da924cb2-1766-437c-babd-2537d2abc4be tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 7dc9bec0-ba45-463f-810d-2a9acfa97e43 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:31:23.742622 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-da924cb2-1766-437c-babd-2537d2abc4be tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/7dc9bec0-ba45-463f-810d-2a9acfa97e43/action" status: 404 len: 111 microversion: 2.1 time: 0.032494 Jul 31 01:31:23.746103 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2199/4413] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:31:23 2022] POST /compute/v2.1/servers/7dc9bec0-ba45-463f-810d-2a9acfa97e43/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:31:23.754477 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2c7463bb-dd8d-40d3-9e30-89171e5e6c6c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:23.755151 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2c7463bb-dd8d-40d3-9e30-89171e5e6c6c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:23.763019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c7463bb-dd8d-40d3-9e30-89171e5e6c6c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:23.763521 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c7463bb-dd8d-40d3-9e30-89171e5e6c6c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:23.764325 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c7463bb-dd8d-40d3-9e30-89171e5e6c6c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:23.764771 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c7463bb-dd8d-40d3-9e30-89171e5e6c6c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:24.278489 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5b594438-d64a-4435-8c5e-111f384d43ed tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:24.279034 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5b594438-d64a-4435-8c5e-111f384d43ed tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:24.308348 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b594438-d64a-4435-8c5e-111f384d43ed tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:24.310262 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b594438-d64a-4435-8c5e-111f384d43ed tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:24.321981 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b594438-d64a-4435-8c5e-111f384d43ed tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:24.322607 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b594438-d64a-4435-8c5e-111f384d43ed tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:24.595039 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2c7463bb-dd8d-40d3-9e30-89171e5e6c6c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:24.610100 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2c7463bb-dd8d-40d3-9e30-89171e5e6c6c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.857984 Jul 31 01:31:24.613176 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2215/4414] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:23 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:24.630879 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5b594438-d64a-4435-8c5e-111f384d43ed tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:24.639545 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dd969770-5f88-4587-b696-1ffd3d08530f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:24.640452 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dd969770-5f88-4587-b696-1ffd3d08530f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:24.642812 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:24.651572 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd969770-5f88-4587-b696-1ffd3d08530f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:24.653397 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5b594438-d64a-4435-8c5e-111f384d43ed tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1266 microversion: 2.1 time: 0.376619 Jul 31 01:31:24.653751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd969770-5f88-4587-b696-1ffd3d08530f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:24.668140 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2200/4415] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:24 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1266 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:24.670908 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd969770-5f88-4587-b696-1ffd3d08530f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:24.673604 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd969770-5f88-4587-b696-1ffd3d08530f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:24.943549 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dd969770-5f88-4587-b696-1ffd3d08530f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:24.959391 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dd969770-5f88-4587-b696-1ffd3d08530f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.323698 Jul 31 01:31:24.960365 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2216/4416] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:24 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:31:24.983363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-26273a8b-1dd3-4942-8b32-d3a500ba31eb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:24.984206 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-26273a8b-1dd3-4942-8b32-d3a500ba31eb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:24.992599 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26273a8b-1dd3-4942-8b32-d3a500ba31eb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:24.993669 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26273a8b-1dd3-4942-8b32-d3a500ba31eb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:24.994693 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26273a8b-1dd3-4942-8b32-d3a500ba31eb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:24.995394 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26273a8b-1dd3-4942-8b32-d3a500ba31eb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:25.037028 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-26273a8b-1dd3-4942-8b32-d3a500ba31eb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lazy-loading 'flavor' on Instance uuid 76757e35-eebd-46de-a012-82bd864fd1d2 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:31:25.206304 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-26273a8b-1dd3-4942-8b32-d3a500ba31eb tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action" status: 202 len: 0 microversion: 2.1 time: 0.228952 Jul 31 01:31:25.215647 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2201/4417] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:31:24 2022] POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:31:25.216179 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3ade1597-f44f-4430-a175-7cf7e5811f82 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:25.216984 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3ade1597-f44f-4430-a175-7cf7e5811f82 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:25.227930 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ade1597-f44f-4430-a175-7cf7e5811f82 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:25.229522 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ade1597-f44f-4430-a175-7cf7e5811f82 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:25.234846 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ade1597-f44f-4430-a175-7cf7e5811f82 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:25.235683 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ade1597-f44f-4430-a175-7cf7e5811f82 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:25.687802 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a37436ca-d339-4f8c-b532-27cff00ba9f1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:25.688689 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a37436ca-d339-4f8c-b532-27cff00ba9f1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:25.715233 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a37436ca-d339-4f8c-b532-27cff00ba9f1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:25.715768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a37436ca-d339-4f8c-b532-27cff00ba9f1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:25.716955 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a37436ca-d339-4f8c-b532-27cff00ba9f1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:25.717399 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a37436ca-d339-4f8c-b532-27cff00ba9f1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:25.969209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3ade1597-f44f-4430-a175-7cf7e5811f82 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:25.981214 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a37436ca-d339-4f8c-b532-27cff00ba9f1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:25.990972 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3ade1597-f44f-4430-a175-7cf7e5811f82 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1513 microversion: 2.1 time: 0.779217 Jul 31 01:31:25.991609 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2217/4418] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:25 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1513 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:26.008665 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a37436ca-d339-4f8c-b532-27cff00ba9f1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1266 microversion: 2.1 time: 0.337987 Jul 31 01:31:26.009274 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2202/4419] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:25 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:31:27.014298 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-65523f21-a57b-473f-8b38-6afc0ccf35fe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:27.015508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-65523f21-a57b-473f-8b38-6afc0ccf35fe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:27.031804 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bcf40381-a7db-4705-97f4-f93baca7505a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:27.033089 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bcf40381-a7db-4705-97f4-f93baca7505a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:27.045529 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65523f21-a57b-473f-8b38-6afc0ccf35fe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:27.048725 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bcf40381-a7db-4705-97f4-f93baca7505a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:27.057501 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bcf40381-a7db-4705-97f4-f93baca7505a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:27.057892 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65523f21-a57b-473f-8b38-6afc0ccf35fe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:27.059313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65523f21-a57b-473f-8b38-6afc0ccf35fe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:27.061182 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bcf40381-a7db-4705-97f4-f93baca7505a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:27.064969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65523f21-a57b-473f-8b38-6afc0ccf35fe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:27.071735 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bcf40381-a7db-4705-97f4-f93baca7505a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:27.446566 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bcf40381-a7db-4705-97f4-f93baca7505a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:27.454995 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bcf40381-a7db-4705-97f4-f93baca7505a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1266 microversion: 2.1 time: 0.427154 Jul 31 01:31:27.474427 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2203/4420] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:27 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1266 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:27.732255 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-65523f21-a57b-473f-8b38-6afc0ccf35fe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:27.767607 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-65523f21-a57b-473f-8b38-6afc0ccf35fe tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1496 microversion: 2.1 time: 0.753422 Jul 31 01:31:27.769445 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2218/4421] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:27 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1496 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:27.799067 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b740f8a6-cd94-4897-b993-f41fc5f06b27 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:27.799926 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b740f8a6-cd94-4897-b993-f41fc5f06b27 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:27.813675 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b740f8a6-cd94-4897-b993-f41fc5f06b27 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:27.820399 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b740f8a6-cd94-4897-b993-f41fc5f06b27 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:27.822652 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b740f8a6-cd94-4897-b993-f41fc5f06b27 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:27.825687 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b740f8a6-cd94-4897-b993-f41fc5f06b27 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:27.879388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-b740f8a6-cd94-4897-b993-f41fc5f06b27 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lazy-loading 'flavor' on Instance uuid 76757e35-eebd-46de-a012-82bd864fd1d2 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:31:27.912328 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-b740f8a6-cd94-4897-b993-f41fc5f06b27 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Cannot 'suspend' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state suspended Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b740f8a6-cd94-4897-b993-f41fc5f06b27 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action HTTP/1.1 Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 15 Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: {"suspend": {}} Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: exception: Cannot 'suspend' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state suspended Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '76757e35-eebd-46de-a012-82bd864fd1d2', 'body': {'suspend': {}}} Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 76757e35-eebd-46de-a012-82bd864fd1d2 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 31 01:31:27.920412 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 01:31:27.924508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 01:31:27.924508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 01:31:27.924508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state suspended Jul 31 01:31:27.924508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:27.924508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:27.924508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:27.924508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:27.924508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:27.924508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:27.924508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:31:27.924508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:31:27.924508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state suspended Jul 31 01:31:27.924508 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:27.933224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b740f8a6-cd94-4897-b993-f41fc5f06b27 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 409 to user: Cannot 'suspend' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state suspended {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:31:27.936563 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b740f8a6-cd94-4897-b993-f41fc5f06b27 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action" status: 409 len: 148 microversion: 2.1 time: 0.143028 Jul 31 01:31:27.942991 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2204/4422] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:31:27 2022] POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action => generated 148 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:31:27.950053 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1b41736c-0dd9-48bc-86b6-d1b08b8d1e53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:27.950779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1b41736c-0dd9-48bc-86b6-d1b08b8d1e53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:27.975193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b41736c-0dd9-48bc-86b6-d1b08b8d1e53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:27.980004 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b41736c-0dd9-48bc-86b6-d1b08b8d1e53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:27.982353 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b41736c-0dd9-48bc-86b6-d1b08b8d1e53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:27.986387 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b41736c-0dd9-48bc-86b6-d1b08b8d1e53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:28.092988 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:28.246581 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1b41736c-0dd9-48bc-86b6-d1b08b8d1e53 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action" status: 202 len: 0 microversion: 2.1 time: 0.301356 Jul 31 01:31:28.247926 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2219/4423] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:31:27 2022] POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:31:28.263761 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ef107959-162a-47e6-96a5-f481325af8c8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:28.264396 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ef107959-162a-47e6-96a5-f481325af8c8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:28.283248 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef107959-162a-47e6-96a5-f481325af8c8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:28.284408 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef107959-162a-47e6-96a5-f481325af8c8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:28.291790 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef107959-162a-47e6-96a5-f481325af8c8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:28.296605 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef107959-162a-47e6-96a5-f481325af8c8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:28.484113 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cc475ecd-2245-48e7-8023-6bb9aa0669e4 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:28.485002 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cc475ecd-2245-48e7-8023-6bb9aa0669e4 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:28.503023 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc475ecd-2245-48e7-8023-6bb9aa0669e4 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:28.503878 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc475ecd-2245-48e7-8023-6bb9aa0669e4 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:28.505051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc475ecd-2245-48e7-8023-6bb9aa0669e4 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:28.508033 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc475ecd-2245-48e7-8023-6bb9aa0669e4 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:29.012986 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ef107959-162a-47e6-96a5-f481325af8c8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:29.027218 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ef107959-162a-47e6-96a5-f481325af8c8 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1502 microversion: 2.1 time: 0.770371 Jul 31 01:31:29.057532 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2205/4424] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:28 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1502 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:29.252405 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cc475ecd-2245-48e7-8023-6bb9aa0669e4 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:29.262610 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cc475ecd-2245-48e7-8023-6bb9aa0669e4 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1308 microversion: 2.1 time: 0.782820 Jul 31 01:31:29.266734 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2220/4425] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:28 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1308 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:30.085418 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-44a604c7-1607-45f3-aba3-e7b5b1d73ba3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:30.140742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-44a604c7-1607-45f3-aba3-e7b5b1d73ba3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:30.168548 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44a604c7-1607-45f3-aba3-e7b5b1d73ba3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:30.170541 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44a604c7-1607-45f3-aba3-e7b5b1d73ba3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:30.172709 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44a604c7-1607-45f3-aba3-e7b5b1d73ba3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:30.173787 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44a604c7-1607-45f3-aba3-e7b5b1d73ba3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:30.313999 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3f80bed8-4e64-46da-9030-ca5f432b48b6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:30.328640 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3f80bed8-4e64-46da-9030-ca5f432b48b6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:30.377920 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f80bed8-4e64-46da-9030-ca5f432b48b6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:30.379595 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f80bed8-4e64-46da-9030-ca5f432b48b6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:30.387354 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f80bed8-4e64-46da-9030-ca5f432b48b6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:30.392757 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f80bed8-4e64-46da-9030-ca5f432b48b6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:31.083302 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:31.469871 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-44a604c7-1607-45f3-aba3-e7b5b1d73ba3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:31.484696 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:31.494183 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-44a604c7-1607-45f3-aba3-e7b5b1d73ba3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1502 microversion: 2.1 time: 1.431762 Jul 31 01:31:31.502420 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2206/4426] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:30 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1502 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:31.512371 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3f80bed8-4e64-46da-9030-ca5f432b48b6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:31.522821 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3f80bed8-4e64-46da-9030-ca5f432b48b6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1308 microversion: 2.1 time: 1.224596 Jul 31 01:31:31.528474 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2221/4427] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:30 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1308 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:31.957777 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-621d3045-1574-4091-9947-8e82630e851d req-1a4201d2-7aa0-43bf-bf07-166b5c9929b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d5b5df6-d433-4917-b181-7cac6503612d", "tag": "046c8a9d-a327-4045-b1f0-229d843599d9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:31.980187 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=8 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:31.994349 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-621d3045-1574-4091-9947-8e82630e851d req-1a4201d2-7aa0-43bf-bf07-166b5c9929b1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:31.995079 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-621d3045-1574-4091-9947-8e82630e851d req-1a4201d2-7aa0-43bf-bf07-166b5c9929b1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:32.028525 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-621d3045-1574-4091-9947-8e82630e851d req-1a4201d2-7aa0-43bf-bf07-166b5c9929b1 service nova] Creating event network-changed:046c8a9d-a327-4045-b1f0-229d843599d9 for instance 5d5b5df6-d433-4917-b181-7cac6503612d on n-h1-master-1 Jul 31 01:31:32.066214 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-621d3045-1574-4091-9947-8e82630e851d req-1a4201d2-7aa0-43bf-bf07-166b5c9929b1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111722 Jul 31 01:31:32.067877 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2207/4428] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:31:32.559728 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f6fb804-e8a8-4edb-b97e-785e702948f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:32.564334 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6f6fb804-e8a8-4edb-b97e-785e702948f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:32.592591 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f12792c9-f232-488e-87d2-37baaf303b74 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:32.594532 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f12792c9-f232-488e-87d2-37baaf303b74 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:32.604102 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f6fb804-e8a8-4edb-b97e-785e702948f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:32.606424 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f6fb804-e8a8-4edb-b97e-785e702948f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:32.610833 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f6fb804-e8a8-4edb-b97e-785e702948f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:32.615285 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f6fb804-e8a8-4edb-b97e-785e702948f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:32.615962 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f12792c9-f232-488e-87d2-37baaf303b74 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:32.618621 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f12792c9-f232-488e-87d2-37baaf303b74 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:32.630678 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f12792c9-f232-488e-87d2-37baaf303b74 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:32.631559 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f12792c9-f232-488e-87d2-37baaf303b74 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:33.618131 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6f6fb804-e8a8-4edb-b97e-785e702948f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:33.659312 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6f6fb804-e8a8-4edb-b97e-785e702948f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1308 microversion: 2.1 time: 1.103828 Jul 31 01:31:33.685874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f12792c9-f232-488e-87d2-37baaf303b74 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:33.690842 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2208/4429] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:32 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1308 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:33.715738 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f12792c9-f232-488e-87d2-37baaf303b74 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1502 microversion: 2.1 time: 1.156161 Jul 31 01:31:33.722090 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2222/4430] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:32 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1502 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:34.698716 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-333ca81e-e0e8-4b42-b299-f68ddb1b6f3c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:34.701022 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-333ca81e-e0e8-4b42-b299-f68ddb1b6f3c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:34.713600 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-333ca81e-e0e8-4b42-b299-f68ddb1b6f3c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:34.714287 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-333ca81e-e0e8-4b42-b299-f68ddb1b6f3c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:34.726486 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-333ca81e-e0e8-4b42-b299-f68ddb1b6f3c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:34.727406 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-333ca81e-e0e8-4b42-b299-f68ddb1b6f3c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:34.746416 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-daffe517-d7ec-44c2-ae68-9ab4b2ba3581 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:34.747081 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-daffe517-d7ec-44c2-ae68-9ab4b2ba3581 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:34.756990 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daffe517-d7ec-44c2-ae68-9ab4b2ba3581 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:34.757273 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daffe517-d7ec-44c2-ae68-9ab4b2ba3581 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:34.760745 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daffe517-d7ec-44c2-ae68-9ab4b2ba3581 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:34.764098 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daffe517-d7ec-44c2-ae68-9ab4b2ba3581 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:35.837719 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-daffe517-d7ec-44c2-ae68-9ab4b2ba3581 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:35.852380 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-daffe517-d7ec-44c2-ae68-9ab4b2ba3581 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 1.106467 Jul 31 01:31:35.868632 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2223/4431] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:34 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:35.878096 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e8ade667-ccbf-47d5-94d8-da3592755f16 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:35.879359 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e8ade667-ccbf-47d5-94d8-da3592755f16 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:35.886304 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8ade667-ccbf-47d5-94d8-da3592755f16 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:35.887026 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8ade667-ccbf-47d5-94d8-da3592755f16 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:35.888089 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8ade667-ccbf-47d5-94d8-da3592755f16 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:35.889160 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8ade667-ccbf-47d5-94d8-da3592755f16 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:35.892708 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-333ca81e-e0e8-4b42-b299-f68ddb1b6f3c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:35.901655 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-333ca81e-e0e8-4b42-b299-f68ddb1b6f3c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1308 microversion: 2.1 time: 1.207262 Jul 31 01:31:35.902480 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2209/4432] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:34 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1308 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:36.946702 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e6a26268-52cb-419e-9d81-d6c25a9f940d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:36.947651 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e6a26268-52cb-419e-9d81-d6c25a9f940d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:36.962291 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a26268-52cb-419e-9d81-d6c25a9f940d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:36.962757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a26268-52cb-419e-9d81-d6c25a9f940d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:36.963589 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a26268-52cb-419e-9d81-d6c25a9f940d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:36.964035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a26268-52cb-419e-9d81-d6c25a9f940d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:37.354128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e8ade667-ccbf-47d5-94d8-da3592755f16 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:37.365921 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e8ade667-ccbf-47d5-94d8-da3592755f16 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 1.491963 Jul 31 01:31:37.383733 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2224/4433] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:35 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:37.399851 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-72516470-2a88-4114-93c7-55fd4b1c0869 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:37.400416 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-72516470-2a88-4114-93c7-55fd4b1c0869 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 0c65a561-13f7-44bf-adb4-5e1bf5ed65c9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:37.422516 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-72516470-2a88-4114-93c7-55fd4b1c0869 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 0c65a561-13f7-44bf-adb4-5e1bf5ed65c9 could not be found. Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-72516470-2a88-4114-93c7-55fd4b1c0869 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/0c65a561-13f7-44bf-adb4-5e1bf5ed65c9/action HTTP/1.1 Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 15 Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: {"unpause": {}} Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 0c65a561-13f7-44bf-adb4-5e1bf5ed65c9 could not be found. Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '0c65a561-13f7-44bf-adb4-5e1bf5ed65c9', 'body': {'unpause': {}}} Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c65a561-13f7-44bf-adb4-5e1bf5ed65c9 could not be found. Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c65a561-13f7-44bf-adb4-5e1bf5ed65c9 could not be found. Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:37.424505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:37.430228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:31:37.430228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:31:37.430228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c65a561-13f7-44bf-adb4-5e1bf5ed65c9 could not be found. Jul 31 01:31:37.430228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:37.431301 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-72516470-2a88-4114-93c7-55fd4b1c0869 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 0c65a561-13f7-44bf-adb4-5e1bf5ed65c9 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:31:37.432436 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-72516470-2a88-4114-93c7-55fd4b1c0869 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/0c65a561-13f7-44bf-adb4-5e1bf5ed65c9/action" status: 404 len: 111 microversion: 2.1 time: 0.045593 Jul 31 01:31:37.444133 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2225/4434] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:31:37 2022] POST /compute/v2.1/servers/0c65a561-13f7-44bf-adb4-5e1bf5ed65c9/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:31:37.452233 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7d4d80fa-7471-4947-b448-3ea676d61c48 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:37.453141 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7d4d80fa-7471-4947-b448-3ea676d61c48 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:37.465282 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7d4d80fa-7471-4947-b448-3ea676d61c48 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:37.466232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7d4d80fa-7471-4947-b448-3ea676d61c48 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:37.467202 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7d4d80fa-7471-4947-b448-3ea676d61c48 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:37.467835 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7d4d80fa-7471-4947-b448-3ea676d61c48 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:37.933196 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e6a26268-52cb-419e-9d81-d6c25a9f940d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:37.947929 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e6a26268-52cb-419e-9d81-d6c25a9f940d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1308 microversion: 2.1 time: 1.004035 Jul 31 01:31:37.964760 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2210/4435] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:36 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1308 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:31:38.064759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7d4d80fa-7471-4947-b448-3ea676d61c48 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:38.079570 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7d4d80fa-7471-4947-b448-3ea676d61c48 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.628326 Jul 31 01:31:38.080637 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2226/4436] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:37 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:31:38.108669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fcd4b186-1dad-4112-8696-abbad6657ff9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:38.109566 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fcd4b186-1dad-4112-8696-abbad6657ff9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:38.119229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcd4b186-1dad-4112-8696-abbad6657ff9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:38.120580 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcd4b186-1dad-4112-8696-abbad6657ff9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:38.121663 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcd4b186-1dad-4112-8696-abbad6657ff9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:38.122388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcd4b186-1dad-4112-8696-abbad6657ff9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:38.740961 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fcd4b186-1dad-4112-8696-abbad6657ff9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:38.759569 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fcd4b186-1dad-4112-8696-abbad6657ff9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.657364 Jul 31 01:31:38.786664 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2211/4437] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:38 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:38.792871 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cd68aee2-a6e4-49f3-8c8b-f2ac4da315f1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:38.794046 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cd68aee2-a6e4-49f3-8c8b-f2ac4da315f1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:38.803833 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd68aee2-a6e4-49f3-8c8b-f2ac4da315f1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:38.805966 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd68aee2-a6e4-49f3-8c8b-f2ac4da315f1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:38.807141 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd68aee2-a6e4-49f3-8c8b-f2ac4da315f1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:38.809481 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd68aee2-a6e4-49f3-8c8b-f2ac4da315f1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:38.874169 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-cd68aee2-a6e4-49f3-8c8b-f2ac4da315f1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Cannot 'unpause' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cd68aee2-a6e4-49f3-8c8b-f2ac4da315f1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action HTTP/1.1 Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 15 Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: {"unpause": {}} Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: exception: Cannot 'unpause' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '76757e35-eebd-46de-a012-82bd864fd1d2', 'body': {'unpause': {}}} Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 76757e35-eebd-46de-a012-82bd864fd1d2 in vm_state active. Cannot unpause while the instance is in this state. Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:38.878593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:38.884095 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:38.884095 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:31:38.884095 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:31:38.884095 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active Jul 31 01:31:38.884095 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:38.886254 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cd68aee2-a6e4-49f3-8c8b-f2ac4da315f1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 409 to user: Cannot 'unpause' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:31:38.889051 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cd68aee2-a6e4-49f3-8c8b-f2ac4da315f1 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action" status: 409 len: 145 microversion: 2.1 time: 0.102086 Jul 31 01:31:38.892258 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2227/4438] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:31:38 2022] POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action => generated 145 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:31:38.901153 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-838f80fc-e222-41e1-a519-30271f841246 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:38.901886 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-838f80fc-e222-41e1-a519-30271f841246 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:38.921924 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-838f80fc-e222-41e1-a519-30271f841246 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:38.922396 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-838f80fc-e222-41e1-a519-30271f841246 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:38.923444 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-838f80fc-e222-41e1-a519-30271f841246 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:38.923898 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-838f80fc-e222-41e1-a519-30271f841246 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:38.972217 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-787bf3ba-7153-4b11-b54f-a3b444822830 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:38.973274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-787bf3ba-7153-4b11-b54f-a3b444822830 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:38.998314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-787bf3ba-7153-4b11-b54f-a3b444822830 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:39.001456 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-787bf3ba-7153-4b11-b54f-a3b444822830 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:39.017324 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-787bf3ba-7153-4b11-b54f-a3b444822830 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:39.023801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-787bf3ba-7153-4b11-b54f-a3b444822830 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:39.893670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-787bf3ba-7153-4b11-b54f-a3b444822830 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:39.912602 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-787bf3ba-7153-4b11-b54f-a3b444822830 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1308 microversion: 2.1 time: 0.942955 Jul 31 01:31:39.914205 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2228/4439] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:38 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1308 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:39.922273 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-838f80fc-e222-41e1-a519-30271f841246 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:39.938904 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-838f80fc-e222-41e1-a519-30271f841246 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 1.041513 Jul 31 01:31:39.969031 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-76e20b8a-5487-4702-b102-10201b7772d7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:39.970032 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-76e20b8a-5487-4702-b102-10201b7772d7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:39.986033 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76e20b8a-5487-4702-b102-10201b7772d7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:39.986696 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76e20b8a-5487-4702-b102-10201b7772d7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:39.992265 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76e20b8a-5487-4702-b102-10201b7772d7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:39.992898 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76e20b8a-5487-4702-b102-10201b7772d7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:39.996583 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2212/4440] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:38 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:31:40.430808 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-848c07e9-9bfc-46a1-97e4-44f500efc6e2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-27595885", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "1fde53fe-0382-4737-b527-4db7e9bd3777"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:40.507141 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-848c07e9-9bfc-46a1-97e4-44f500efc6e2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] validate_networks() for [('1fde53fe-0382-4737-b527-4db7e9bd3777', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:31:40.631126 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-76e20b8a-5487-4702-b102-10201b7772d7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:40.638950 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-76e20b8a-5487-4702-b102-10201b7772d7 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.675280 Jul 31 01:31:40.639616 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2229/4441] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:39 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:40.662145 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0225c573-ccc3-448d-a714-b3202084011c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:40.663191 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0225c573-ccc3-448d-a714-b3202084011c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 63de5b10-2b42-41c3-87fa-332358482f81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:40.684731 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-0225c573-ccc3-448d-a714-b3202084011c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 63de5b10-2b42-41c3-87fa-332358482f81 could not be found. Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0225c573-ccc3-448d-a714-b3202084011c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/63de5b10-2b42-41c3-87fa-332358482f81/action HTTP/1.1 Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 18 Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: {"unshelve": null} Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 63de5b10-2b42-41c3-87fa-332358482f81 could not be found. Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '63de5b10-2b42-41c3-87fa-332358482f81', 'body': {'unshelve': None}} Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63de5b10-2b42-41c3-87fa-332358482f81 could not be found. Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63de5b10-2b42-41c3-87fa-332358482f81 could not be found. Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:40.688228 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:40.693273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:40.693273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:40.693273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:40.693273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:40.693273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:31:40.693273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:31:40.693273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63de5b10-2b42-41c3-87fa-332358482f81 could not be found. Jul 31 01:31:40.693273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:40.696085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0225c573-ccc3-448d-a714-b3202084011c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 63de5b10-2b42-41c3-87fa-332358482f81 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:31:40.697153 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0225c573-ccc3-448d-a714-b3202084011c tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/63de5b10-2b42-41c3-87fa-332358482f81/action" status: 404 len: 111 microversion: 2.1 time: 0.040286 Jul 31 01:31:40.701415 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2230/4442] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:31:40 2022] POST /compute/v2.1/servers/63de5b10-2b42-41c3-87fa-332358482f81/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:31:40.706849 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-02f3d57c-1baa-4f88-891e-6c82c16cc385 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:40.708389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-02f3d57c-1baa-4f88-891e-6c82c16cc385 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:40.719507 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-02f3d57c-1baa-4f88-891e-6c82c16cc385 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:40.720128 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-02f3d57c-1baa-4f88-891e-6c82c16cc385 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:40.721208 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-02f3d57c-1baa-4f88-891e-6c82c16cc385 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:40.721763 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-02f3d57c-1baa-4f88-891e-6c82c16cc385 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:41.122182 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-02f3d57c-1baa-4f88-891e-6c82c16cc385 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:41.134690 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-02f3d57c-1baa-4f88-891e-6c82c16cc385 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.432000 Jul 31 01:31:41.140724 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2231/4443] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:40 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:41.149506 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d39e0e29-3d58-453d-a977-677d522dd845 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:41.150154 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d39e0e29-3d58-453d-a977-677d522dd845 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:41.231545 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d39e0e29-3d58-453d-a977-677d522dd845 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:41.232068 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d39e0e29-3d58-453d-a977-677d522dd845 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:41.250942 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d39e0e29-3d58-453d-a977-677d522dd845 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:41.254359 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d39e0e29-3d58-453d-a977-677d522dd845 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:41.782959 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d39e0e29-3d58-453d-a977-677d522dd845 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:41.796615 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d39e0e29-3d58-453d-a977-677d522dd845 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1308 microversion: 2.1 time: 0.654683 Jul 31 01:31:41.800201 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2232/4444] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:41 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1308 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:41.823604 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2512e868-6632-42d1-ab52-d6f582b0962f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:41.827823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2512e868-6632-42d1-ab52-d6f582b0962f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:41.854691 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2512e868-6632-42d1-ab52-d6f582b0962f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:41.855210 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2512e868-6632-42d1-ab52-d6f582b0962f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:41.856071 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2512e868-6632-42d1-ab52-d6f582b0962f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:41.860866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2512e868-6632-42d1-ab52-d6f582b0962f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:42.246659 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-848c07e9-9bfc-46a1-97e4-44f500efc6e2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:31:42.248618 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-848c07e9-9bfc-46a1-97e4-44f500efc6e2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:31:42.249312 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-848c07e9-9bfc-46a1-97e4-44f500efc6e2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:31:42.250412 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-848c07e9-9bfc-46a1-97e4-44f500efc6e2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:31:42.251006 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-848c07e9-9bfc-46a1-97e4-44f500efc6e2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:31:42.259188 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2512e868-6632-42d1-ab52-d6f582b0962f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:42.267599 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2512e868-6632-42d1-ab52-d6f582b0962f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.466223 Jul 31 01:31:42.271289 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2233/4445] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:41 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:42.277513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-ba81a61c-76c1-48c3-9965-0ef8613cf462 req-677e6b7f-38be-4c2c-8f25-42ed9e1617a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5b5df6-d433-4917-b181-7cac6503612d", "name": "network-vif-plugged", "status": "completed", "tag": "046c8a9d-a327-4045-b1f0-229d843599d9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:42.289000 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ba81a61c-76c1-48c3-9965-0ef8613cf462 req-677e6b7f-38be-4c2c-8f25-42ed9e1617a1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:42.289728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ba81a61c-76c1-48c3-9965-0ef8613cf462 req-677e6b7f-38be-4c2c-8f25-42ed9e1617a1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:42.293513 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-848c07e9-9bfc-46a1-97e4-44f500efc6e2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:42.294934 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-848c07e9-9bfc-46a1-97e4-44f500efc6e2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:42.302454 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-848c07e9-9bfc-46a1-97e4-44f500efc6e2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:42.303691 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-848c07e9-9bfc-46a1-97e4-44f500efc6e2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:42.306482 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-ba81a61c-76c1-48c3-9965-0ef8613cf462 req-677e6b7f-38be-4c2c-8f25-42ed9e1617a1 service nova] Creating event network-vif-plugged:046c8a9d-a327-4045-b1f0-229d843599d9 for instance 5d5b5df6-d433-4917-b181-7cac6503612d on n-h1-master-1 Jul 31 01:31:42.313174 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-ba81a61c-76c1-48c3-9965-0ef8613cf462 req-677e6b7f-38be-4c2c-8f25-42ed9e1617a1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039805 Jul 31 01:31:42.313838 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2234/4446] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:31:42.322256 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a4273ecd-3543-4b63-83af-9d5d1f190026 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:42.323489 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a4273ecd-3543-4b63-83af-9d5d1f190026 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:42.331477 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a4273ecd-3543-4b63-83af-9d5d1f190026 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:42.332179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a4273ecd-3543-4b63-83af-9d5d1f190026 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:42.333741 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a4273ecd-3543-4b63-83af-9d5d1f190026 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:42.334341 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a4273ecd-3543-4b63-83af-9d5d1f190026 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:42.383744 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-a4273ecd-3543-4b63-83af-9d5d1f190026 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Cannot 'unshelve' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a4273ecd-3543-4b63-83af-9d5d1f190026 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action HTTP/1.1 Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 18 Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: {"unshelve": null} Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: exception: Cannot 'unshelve' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '76757e35-eebd-46de-a012-82bd864fd1d2', 'body': {'unshelve': None}} Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 76757e35-eebd-46de-a012-82bd864fd1d2 in vm_state active. Cannot unshelve while the instance is in this state. Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 01:31:42.385881 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 01:31:42.391606 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active Jul 31 01:31:42.391606 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:42.391606 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:42.391606 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:42.391606 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:42.391606 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:42.391606 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:42.391606 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:31:42.391606 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:31:42.391606 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active Jul 31 01:31:42.391606 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:31:42.394374 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a4273ecd-3543-4b63-83af-9d5d1f190026 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 409 to user: Cannot 'unshelve' instance 76757e35-eebd-46de-a012-82bd864fd1d2 while it is in vm_state active {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:31:42.394888 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-848c07e9-9bfc-46a1-97e4-44f500efc6e2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Getting quotas for project e418a04119b843b4a1c218aa9ff1dbc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:31:42.397578 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a4273ecd-3543-4b63-83af-9d5d1f190026 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action" status: 409 len: 146 microversion: 2.1 time: 0.081984 Jul 31 01:31:42.398209 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2235/4447] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:31:42 2022] POST /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2/action => generated 146 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 01:31:42.406819 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-855189b8-84e7-408b-acba-a6b5d276b184 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:42.412255 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-848c07e9-9bfc-46a1-97e4-44f500efc6e2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Getting quotas for user 93eccdea3f1447a693cec10d096876a0 and project e418a04119b843b4a1c218aa9ff1dbc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:31:42.414053 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-855189b8-84e7-408b-acba-a6b5d276b184 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:42.425647 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-855189b8-84e7-408b-acba-a6b5d276b184 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:42.426120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-855189b8-84e7-408b-acba-a6b5d276b184 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:42.429270 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-855189b8-84e7-408b-acba-a6b5d276b184 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:42.431864 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-855189b8-84e7-408b-acba-a6b5d276b184 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:42.441652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-848c07e9-9bfc-46a1-97e4-44f500efc6e2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:31:42.445971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-848c07e9-9bfc-46a1-97e4-44f500efc6e2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:31:42.561532 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-848c07e9-9bfc-46a1-97e4-44f500efc6e2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.402934 Jul 31 01:31:42.572774 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2213/4448] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:31:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 01:31:42.580067 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21c72dc0-217f-4149-a861-6ada2eb63614 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:42.585684 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-21c72dc0-217f-4149-a861-6ada2eb63614 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:42.745874 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-21c72dc0-217f-4149-a861-6ada2eb63614 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:42.753403 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-21c72dc0-217f-4149-a861-6ada2eb63614 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 200 len: 1213 microversion: 2.1 time: 0.179249 Jul 31 01:31:42.755719 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2214/4449] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:42 2022] GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 1213 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:42.824542 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0567d66d-cfa9-405a-b695-953f8fb219b7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:42.825160 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0567d66d-cfa9-405a-b695-953f8fb219b7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:42.832872 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0567d66d-cfa9-405a-b695-953f8fb219b7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:42.833323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0567d66d-cfa9-405a-b695-953f8fb219b7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:42.834108 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0567d66d-cfa9-405a-b695-953f8fb219b7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:42.834543 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0567d66d-cfa9-405a-b695-953f8fb219b7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:43.036605 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-855189b8-84e7-408b-acba-a6b5d276b184 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:43.046464 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-855189b8-84e7-408b-acba-a6b5d276b184 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.643431 Jul 31 01:31:43.070801 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2236/4450] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:42 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:43.083307 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-88aaeb7e-1628-4d83-807b-08a1565bdf92 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:43.085802 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-88aaeb7e-1628-4d83-807b-08a1565bdf92 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:43.113625 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88aaeb7e-1628-4d83-807b-08a1565bdf92 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:43.116672 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88aaeb7e-1628-4d83-807b-08a1565bdf92 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:43.117693 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88aaeb7e-1628-4d83-807b-08a1565bdf92 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:43.120743 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88aaeb7e-1628-4d83-807b-08a1565bdf92 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:43.616644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0567d66d-cfa9-405a-b695-953f8fb219b7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:43.643308 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0567d66d-cfa9-405a-b695-953f8fb219b7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1308 microversion: 2.1 time: 0.822394 Jul 31 01:31:43.646439 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2215/4451] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:42 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1308 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:31:43.683287 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-88aaeb7e-1628-4d83-807b-08a1565bdf92 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:43.691155 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-88aaeb7e-1628-4d83-807b-08a1565bdf92 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.618470 Jul 31 01:31:43.699152 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2237/4452] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:43 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:43.726912 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cb69816b-e221-4d82-81aa-e39e27318cb9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-625468364_updated"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:43.730557 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cb69816b-e221-4d82-81aa-e39e27318cb9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 7410cab4-87cc-47b7-9cdb-db87d04547ca] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:43.744894 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-cb69816b-e221-4d82-81aa-e39e27318cb9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 7410cab4-87cc-47b7-9cdb-db87d04547ca could not be found. Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cb69816b-e221-4d82-81aa-e39e27318cb9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: request: PUT /compute/v2.1/servers/7410cab4-87cc-47b7-9cdb-db87d04547ca HTTP/1.1 Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 80 Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-625468364_updated"}} Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 7410cab4-87cc-47b7-9cdb-db87d04547ca could not be found. Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '7410cab4-87cc-47b7-9cdb-db87d04547ca', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-625468364_updated'}}} Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7410cab4-87cc-47b7-9cdb-db87d04547ca could not be found. Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 31 01:31:43.753127 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:31:43.759076 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:31:43.759076 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:31:43.759076 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:31:43.759076 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7410cab4-87cc-47b7-9cdb-db87d04547ca could not be found. Jul 31 01:31:43.759076 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:43.759076 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:43.759076 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:43.759076 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:43.759076 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:43.759076 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:43.759076 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:31:43.759076 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:31:43.759076 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7410cab4-87cc-47b7-9cdb-db87d04547ca could not be found. Jul 31 01:31:43.759076 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:43.762608 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cb69816b-e221-4d82-81aa-e39e27318cb9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 7410cab4-87cc-47b7-9cdb-db87d04547ca could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:31:43.765838 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cb69816b-e221-4d82-81aa-e39e27318cb9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "PUT /compute/v2.1/servers/7410cab4-87cc-47b7-9cdb-db87d04547ca" status: 404 len: 111 microversion: 2.1 time: 0.045393 Jul 31 01:31:43.770496 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2216/4453] 10.222.0.45 () {60 vars in 1256 bytes} [Sun Jul 31 01:31:43 2022] PUT /compute/v2.1/servers/7410cab4-87cc-47b7-9cdb-db87d04547ca => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:31:43.789117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0aade231-d41f-4c52-b21b-6eb3c593db85 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:43.789755 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0aade231-d41f-4c52-b21b-6eb3c593db85 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:43.816004 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d3b3b765-ca2f-4353-ac70-b4dfa1f7ecf1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:43.818993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d3b3b765-ca2f-4353-ac70-b4dfa1f7ecf1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:43.825940 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0aade231-d41f-4c52-b21b-6eb3c593db85 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:43.827408 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0aade231-d41f-4c52-b21b-6eb3c593db85 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:43.832207 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0aade231-d41f-4c52-b21b-6eb3c593db85 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:43.847990 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0aade231-d41f-4c52-b21b-6eb3c593db85 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:44.006004 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:44.042689 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d3b3b765-ca2f-4353-ac70-b4dfa1f7ecf1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:44.055480 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d3b3b765-ca2f-4353-ac70-b4dfa1f7ecf1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 200 len: 1213 microversion: 2.1 time: 0.260941 Jul 31 01:31:44.056964 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2217/4454] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:43 2022] GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 1213 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:44.467287 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0aade231-d41f-4c52-b21b-6eb3c593db85 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:44.476359 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0aade231-d41f-4c52-b21b-6eb3c593db85 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.699204 Jul 31 01:31:44.483631 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2238/4455] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:43 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:44.508660 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ea4b6b17-ca30-45e4-a0ce-dce49aeb28c6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:44.509316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ea4b6b17-ca30-45e4-a0ce-dce49aeb28c6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:44.521326 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:44.544740 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ea4b6b17-ca30-45e4-a0ce-dce49aeb28c6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:44.546306 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ea4b6b17-ca30-45e4-a0ce-dce49aeb28c6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:44.549836 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ea4b6b17-ca30-45e4-a0ce-dce49aeb28c6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:44.550662 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ea4b6b17-ca30-45e4-a0ce-dce49aeb28c6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:44.670348 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9c30cf69-1f20-4a60-8ceb-a2f95d04ad8a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:44.671107 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9c30cf69-1f20-4a60-8ceb-a2f95d04ad8a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:44.678242 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c30cf69-1f20-4a60-8ceb-a2f95d04ad8a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:44.679825 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c30cf69-1f20-4a60-8ceb-a2f95d04ad8a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:44.680749 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c30cf69-1f20-4a60-8ceb-a2f95d04ad8a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:44.682000 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c30cf69-1f20-4a60-8ceb-a2f95d04ad8a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:45.881807 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9c30cf69-1f20-4a60-8ceb-a2f95d04ad8a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:45.898947 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9c30cf69-1f20-4a60-8ceb-a2f95d04ad8a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1489 microversion: 2.1 time: 1.231224 Jul 31 01:31:45.901870 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2239/4456] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:44 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1489 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:31:45.912448 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ef0a1867-6e1c-4b5c-a119-6fa92f9c3eb6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:45.916546 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ef0a1867-6e1c-4b5c-a119-6fa92f9c3eb6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:45.948969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef0a1867-6e1c-4b5c-a119-6fa92f9c3eb6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:45.951459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef0a1867-6e1c-4b5c-a119-6fa92f9c3eb6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:45.958163 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef0a1867-6e1c-4b5c-a119-6fa92f9c3eb6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:45.960012 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef0a1867-6e1c-4b5c-a119-6fa92f9c3eb6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:46.058013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ea4b6b17-ca30-45e4-a0ce-dce49aeb28c6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:46.072797 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ea4b6b17-ca30-45e4-a0ce-dce49aeb28c6 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 1.568666 Jul 31 01:31:46.075979 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2218/4457] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:44 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:46.096446 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5ad7d3a4-91d1-4bbc-8aa0-c168d0393500 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5ad7d3a4-91d1-4bbc-8aa0-c168d0393500 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: request: PUT /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 HTTP/1.1 Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 280 Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '76757e35-eebd-46de-a012-82bd864fd1d2', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:46.112608 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 31 01:31:46.117267 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:46.121756 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5ad7d3a4-91d1-4bbc-8aa0-c168d0393500 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:31:46.123194 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5ad7d3a4-91d1-4bbc-8aa0-c168d0393500 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "PUT /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 400 len: 619 microversion: 2.1 time: 0.031442 Jul 31 01:31:46.124711 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2219/4458] 10.222.0.45 () {60 vars in 1257 bytes} [Sun Jul 31 01:31:46 2022] PUT /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 31 01:31:46.143421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-58db3b4f-cb9e-490a-962a-f5f46be37088 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:46.145042 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-58db3b4f-cb9e-490a-962a-f5f46be37088 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:46.170932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58db3b4f-cb9e-490a-962a-f5f46be37088 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:46.174055 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58db3b4f-cb9e-490a-962a-f5f46be37088 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:46.178470 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58db3b4f-cb9e-490a-962a-f5f46be37088 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:46.179128 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58db3b4f-cb9e-490a-962a-f5f46be37088 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:46.285206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ef0a1867-6e1c-4b5c-a119-6fa92f9c3eb6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:46.296719 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ef0a1867-6e1c-4b5c-a119-6fa92f9c3eb6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 200 len: 1271 microversion: 2.1 time: 0.392993 Jul 31 01:31:46.318017 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2240/4459] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:45 2022] GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 1271 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:46.326514 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6a6e497d-fcdf-49fd-ac9c-006afacd64d8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-465322241", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "ce8b5cb4-aa2f-4dfd-abb4-9273e2a34e90"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:46.450675 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-6a6e497d-fcdf-49fd-ac9c-006afacd64d8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] validate_networks() for [('ce8b5cb4-aa2f-4dfd-abb4-9273e2a34e90', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:31:46.831267 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-58db3b4f-cb9e-490a-962a-f5f46be37088 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:46.847610 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-58db3b4f-cb9e-490a-962a-f5f46be37088 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.718341 Jul 31 01:31:46.852051 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2220/4460] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:46 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:46.888100 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c788ab2d-4dd1-4142-8b40-cab8efb5d377 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:46.890906 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c788ab2d-4dd1-4142-8b40-cab8efb5d377 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:46.902414 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c788ab2d-4dd1-4142-8b40-cab8efb5d377 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:46.902877 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c788ab2d-4dd1-4142-8b40-cab8efb5d377 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:46.903690 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c788ab2d-4dd1-4142-8b40-cab8efb5d377 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:46.904125 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c788ab2d-4dd1-4142-8b40-cab8efb5d377 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:48.041051 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-6a6e497d-fcdf-49fd-ac9c-006afacd64d8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:31:48.042105 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-6a6e497d-fcdf-49fd-ac9c-006afacd64d8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:31:48.042789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-6a6e497d-fcdf-49fd-ac9c-006afacd64d8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:31:48.043596 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-6a6e497d-fcdf-49fd-ac9c-006afacd64d8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:31:48.044235 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-6a6e497d-fcdf-49fd-ac9c-006afacd64d8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:31:48.069487 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a6e497d-fcdf-49fd-ac9c-006afacd64d8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:48.076021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a6e497d-fcdf-49fd-ac9c-006afacd64d8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:48.077383 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a6e497d-fcdf-49fd-ac9c-006afacd64d8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:48.078755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a6e497d-fcdf-49fd-ac9c-006afacd64d8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:48.126081 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-6a6e497d-fcdf-49fd-ac9c-006afacd64d8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:31:48.137562 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-6a6e497d-fcdf-49fd-ac9c-006afacd64d8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for user 159706f59a12427f9a3c03fa31f712f3 and project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:31:48.180195 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6a6e497d-fcdf-49fd-ac9c-006afacd64d8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:31:48.182760 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6a6e497d-fcdf-49fd-ac9c-006afacd64d8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:31:48.325324 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6a6e497d-fcdf-49fd-ac9c-006afacd64d8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.005740 Jul 31 01:31:48.329971 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2241/4461] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:31:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:31:48.367262 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-34f929da-c826-44ef-9c47-4fd623e665bc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:48.368397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-34f929da-c826-44ef-9c47-4fd623e665bc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:48.385357 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34f929da-c826-44ef-9c47-4fd623e665bc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:48.387233 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34f929da-c826-44ef-9c47-4fd623e665bc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:48.388375 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34f929da-c826-44ef-9c47-4fd623e665bc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:48.389548 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34f929da-c826-44ef-9c47-4fd623e665bc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:48.760030 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c788ab2d-4dd1-4142-8b40-cab8efb5d377 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:48.773768 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c788ab2d-4dd1-4142-8b40-cab8efb5d377 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 1.899378 Jul 31 01:31:48.777813 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2221/4462] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:46 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:48.804669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6d60ced3-aff8-4463-949c-51335de6b6dd tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:48.805605 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6d60ced3-aff8-4463-949c-51335de6b6dd tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:49.058193 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6d60ced3-aff8-4463-949c-51335de6b6dd tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:49.065421 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6d60ced3-aff8-4463-949c-51335de6b6dd tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1208 microversion: 2.1 time: 0.284368 Jul 31 01:31:49.074213 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2222/4463] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:48 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1208 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:49.091107 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-5d5bc902-30c6-4edf-9013-3e18411ef955 req-67029c33-1cd7-48c1-a5c6-2a928caecd5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a17cb70-bf4a-463e-9128-d40c8d2334bc", "tag": "9485e740-b037-4b33-8fbc-4a5fca20ef33"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:49.141889 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-5d5bc902-30c6-4edf-9013-3e18411ef955 req-67029c33-1cd7-48c1-a5c6-2a928caecd5d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:49.144027 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-5d5bc902-30c6-4edf-9013-3e18411ef955 req-67029c33-1cd7-48c1-a5c6-2a928caecd5d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:49.214154 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-5d5bc902-30c6-4edf-9013-3e18411ef955 req-67029c33-1cd7-48c1-a5c6-2a928caecd5d service nova] Creating event network-changed:9485e740-b037-4b33-8fbc-4a5fca20ef33 for instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc on n-h2-master-1 Jul 31 01:31:49.235158 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-5d5bc902-30c6-4edf-9013-3e18411ef955 req-67029c33-1cd7-48c1-a5c6-2a928caecd5d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159325 Jul 31 01:31:49.235820 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2223/4464] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:31:49.275550 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-24293759-4258-4e3e-90c7-f052ece9f5a2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-24293759-4258-4e3e-90c7-f052ece9f5a2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: request: PUT /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 HTTP/1.1 Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 24 Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: {"server": {"name": ""}} Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '76757e35-eebd-46de-a012-82bd864fd1d2', 'body': {'server': {'name': ''}}} Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi '' Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:31:49.305615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 31 01:31:49.310536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:49.310536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:31:49.310536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:49.310536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:31:49.310536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:31:49.310536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:31:49.310536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:31:49.310536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:31:49.310536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 31 01:31:49.310536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:31:49.310536 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-24293759-4258-4e3e-90c7-f052ece9f5a2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:31:49.310536 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-24293759-4258-4e3e-90c7-f052ece9f5a2 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "PUT /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 400 len: 108 microversion: 2.1 time: 0.061733 Jul 31 01:31:49.311828 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2224/4465] 10.222.0.45 () {60 vars in 1256 bytes} [Sun Jul 31 01:31:49 2022] PUT /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 108 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:31:49.319375 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9a07418c-40b1-4974-80af-034fed969b0f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:49.320166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9a07418c-40b1-4974-80af-034fed969b0f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:49.342580 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a07418c-40b1-4974-80af-034fed969b0f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:49.343563 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a07418c-40b1-4974-80af-034fed969b0f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:49.344698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a07418c-40b1-4974-80af-034fed969b0f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:49.348165 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a07418c-40b1-4974-80af-034fed969b0f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:49.420577 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-34f929da-c826-44ef-9c47-4fd623e665bc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:49.446018 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-34f929da-c826-44ef-9c47-4fd623e665bc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 200 len: 1313 microversion: 2.1 time: 1.105998 Jul 31 01:31:49.450002 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2242/4466] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:48 2022] GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 1313 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:49.971816 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9a07418c-40b1-4974-80af-034fed969b0f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:49.989623 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9a07418c-40b1-4974-80af-034fed969b0f tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1505 microversion: 2.1 time: 0.676678 Jul 31 01:31:49.993101 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2225/4467] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:49 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1505 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:50.093421 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8cca3085-5591-445a-b901-87291fbb4758 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:50.094687 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8cca3085-5591-445a-b901-87291fbb4758 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:50.103452 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8cca3085-5591-445a-b901-87291fbb4758 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:50.104491 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8cca3085-5591-445a-b901-87291fbb4758 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:50.105472 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8cca3085-5591-445a-b901-87291fbb4758 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:50.106078 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8cca3085-5591-445a-b901-87291fbb4758 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:50.230622 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8cca3085-5591-445a-b901-87291fbb4758 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:50.246241 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8cca3085-5591-445a-b901-87291fbb4758 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1260 microversion: 2.1 time: 0.161808 Jul 31 01:31:50.247684 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2243/4468] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:50 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:50.470468 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6df479b3-b5bb-4473-8721-22edd01d9b30 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:50.471597 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6df479b3-b5bb-4473-8721-22edd01d9b30 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:50.493853 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6df479b3-b5bb-4473-8721-22edd01d9b30 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:50.496503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6df479b3-b5bb-4473-8721-22edd01d9b30 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:50.508045 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6df479b3-b5bb-4473-8721-22edd01d9b30 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:50.512818 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6df479b3-b5bb-4473-8721-22edd01d9b30 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:51.271655 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c67d596d-25b6-44e8-81b0-4060c6364a51 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:51.274095 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c67d596d-25b6-44e8-81b0-4060c6364a51 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:51.309847 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c67d596d-25b6-44e8-81b0-4060c6364a51 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:51.312847 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c67d596d-25b6-44e8-81b0-4060c6364a51 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:51.318043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c67d596d-25b6-44e8-81b0-4060c6364a51 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:51.319050 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c67d596d-25b6-44e8-81b0-4060c6364a51 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:51.706826 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c67d596d-25b6-44e8-81b0-4060c6364a51 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:51.728043 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c67d596d-25b6-44e8-81b0-4060c6364a51 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1266 microversion: 2.1 time: 0.462231 Jul 31 01:31:51.739887 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2244/4469] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:51 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1266 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:52.155762 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6df479b3-b5bb-4473-8721-22edd01d9b30 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:52.170988 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6df479b3-b5bb-4473-8721-22edd01d9b30 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 200 len: 1313 microversion: 2.1 time: 1.705721 Jul 31 01:31:52.192026 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2226/4470] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:50 2022] GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 1313 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:52.752521 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-270d7043-da35-4441-88fd-688101bd20e0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:52.753156 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-270d7043-da35-4441-88fd-688101bd20e0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:52.773635 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-270d7043-da35-4441-88fd-688101bd20e0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:52.774104 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-270d7043-da35-4441-88fd-688101bd20e0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:52.774913 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-270d7043-da35-4441-88fd-688101bd20e0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:52.775453 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-270d7043-da35-4441-88fd-688101bd20e0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:52.887965 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-270d7043-da35-4441-88fd-688101bd20e0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:52.899188 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-270d7043-da35-4441-88fd-688101bd20e0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1266 microversion: 2.1 time: 0.150607 Jul 31 01:31:52.905225 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2245/4471] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:52 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:53.199878 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ab5b1251-dfc6-41fe-a470-18bea77657cf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:53.201122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ab5b1251-dfc6-41fe-a470-18bea77657cf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:53.203441 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:53.231708 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab5b1251-dfc6-41fe-a470-18bea77657cf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:53.232851 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab5b1251-dfc6-41fe-a470-18bea77657cf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:53.236341 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab5b1251-dfc6-41fe-a470-18bea77657cf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:53.240514 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab5b1251-dfc6-41fe-a470-18bea77657cf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:53.818345 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ab5b1251-dfc6-41fe-a470-18bea77657cf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:53.826835 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ab5b1251-dfc6-41fe-a470-18bea77657cf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 200 len: 1313 microversion: 2.1 time: 0.631362 Jul 31 01:31:53.846058 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2227/4472] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:53 2022] GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 1313 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:53.923203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3349298f-7f5d-46d6-a934-0a8c25ed5f39 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:53.924078 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3349298f-7f5d-46d6-a934-0a8c25ed5f39 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:53.942019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3349298f-7f5d-46d6-a934-0a8c25ed5f39 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:53.942480 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3349298f-7f5d-46d6-a934-0a8c25ed5f39 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:53.952603 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3349298f-7f5d-46d6-a934-0a8c25ed5f39 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:53.952603 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3349298f-7f5d-46d6-a934-0a8c25ed5f39 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:54.259943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3349298f-7f5d-46d6-a934-0a8c25ed5f39 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:54.273301 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3349298f-7f5d-46d6-a934-0a8c25ed5f39 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1266 microversion: 2.1 time: 0.354795 Jul 31 01:31:54.290785 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2246/4473] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:53 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1266 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:54.862505 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d9346022-fda1-46cb-9a68-332c8c849c27 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:54.863205 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d9346022-fda1-46cb-9a68-332c8c849c27 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:54.893878 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d9346022-fda1-46cb-9a68-332c8c849c27 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:54.894349 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d9346022-fda1-46cb-9a68-332c8c849c27 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:54.895201 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d9346022-fda1-46cb-9a68-332c8c849c27 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:54.895677 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d9346022-fda1-46cb-9a68-332c8c849c27 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:55.296297 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc5a901f-3b67-45fe-9491-cf99281ee0ce tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:55.297024 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc5a901f-3b67-45fe-9491-cf99281ee0ce tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:55.301607 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:55.305330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc5a901f-3b67-45fe-9491-cf99281ee0ce tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:55.305789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc5a901f-3b67-45fe-9491-cf99281ee0ce tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:55.306574 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc5a901f-3b67-45fe-9491-cf99281ee0ce tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:55.307029 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc5a901f-3b67-45fe-9491-cf99281ee0ce tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:55.424881 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d9346022-fda1-46cb-9a68-332c8c849c27 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:55.433146 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d9346022-fda1-46cb-9a68-332c8c849c27 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 200 len: 1313 microversion: 2.1 time: 0.575761 Jul 31 01:31:55.444683 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2228/4474] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:54 2022] GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 1313 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:55.768144 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fc5a901f-3b67-45fe-9491-cf99281ee0ce tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:55.782030 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc5a901f-3b67-45fe-9491-cf99281ee0ce tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1308 microversion: 2.1 time: 0.489598 Jul 31 01:31:55.795403 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2247/4475] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:55 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1308 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:31:56.465563 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d4dcef73-87ab-42ca-9700-b518dddaada0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:56.466301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d4dcef73-87ab-42ca-9700-b518dddaada0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:56.483767 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d4dcef73-87ab-42ca-9700-b518dddaada0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:56.484236 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d4dcef73-87ab-42ca-9700-b518dddaada0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:56.485041 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d4dcef73-87ab-42ca-9700-b518dddaada0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:56.485481 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d4dcef73-87ab-42ca-9700-b518dddaada0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:56.820278 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-55b6230e-7560-4f52-aa90-5360e1741361 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:56.821394 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-55b6230e-7560-4f52-aa90-5360e1741361 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:56.833982 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55b6230e-7560-4f52-aa90-5360e1741361 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:56.838201 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55b6230e-7560-4f52-aa90-5360e1741361 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:56.839412 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55b6230e-7560-4f52-aa90-5360e1741361 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:56.840038 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55b6230e-7560-4f52-aa90-5360e1741361 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:58.101449 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:58.159857 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:58.227436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d4dcef73-87ab-42ca-9700-b518dddaada0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:58.238093 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d4dcef73-87ab-42ca-9700-b518dddaada0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 200 len: 1313 microversion: 2.1 time: 1.776691 Jul 31 01:31:58.260137 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2229/4476] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:56 2022] GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 1313 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:58.632236 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-55b6230e-7560-4f52-aa90-5360e1741361 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:31:58.641510 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-55b6230e-7560-4f52-aa90-5360e1741361 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1308 microversion: 2.1 time: 1.825836 Jul 31 01:31:58.663532 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2248/4477] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:56 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1308 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:31:59.072543 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=12 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:59.236118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-9f5d9446-25bf-4bd9-90ed-65bf60dba805 req-9914b39b-a8f7-4c54-94cf-b66b30c199fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0", "tag": "823a5b41-7ac4-4ed3-aad8-d570a664d155"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:59.272804 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d59649d6-3523-4772-b101-b9462579a1e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:59.273425 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d59649d6-3523-4772-b101-b9462579a1e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:59.296507 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d59649d6-3523-4772-b101-b9462579a1e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:59.298505 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d59649d6-3523-4772-b101-b9462579a1e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:59.300774 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d59649d6-3523-4772-b101-b9462579a1e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:59.303672 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d59649d6-3523-4772-b101-b9462579a1e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:59.305128 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9f5d9446-25bf-4bd9-90ed-65bf60dba805 req-9914b39b-a8f7-4c54-94cf-b66b30c199fb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:59.308563 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9f5d9446-25bf-4bd9-90ed-65bf60dba805 req-9914b39b-a8f7-4c54-94cf-b66b30c199fb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:59.334275 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-9f5d9446-25bf-4bd9-90ed-65bf60dba805 req-9914b39b-a8f7-4c54-94cf-b66b30c199fb service nova] Creating event network-changed:823a5b41-7ac4-4ed3-aad8-d570a664d155 for instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 on n-h1-master-1 Jul 31 01:31:59.347754 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-9f5d9446-25bf-4bd9-90ed-65bf60dba805 req-9914b39b-a8f7-4c54-94cf-b66b30c199fb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.640007 Jul 31 01:31:59.354551 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2230/4478] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:31:59.370184 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-eb7a9ee7-e4c3-4bce-8b46-5ba3b6046f0c req-ba197fa5-f878-49d1-8f39-dab65bdd43bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a17cb70-bf4a-463e-9128-d40c8d2334bc", "name": "network-vif-plugged", "status": "completed", "tag": "9485e740-b037-4b33-8fbc-4a5fca20ef33"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:31:59.421900 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-eb7a9ee7-e4c3-4bce-8b46-5ba3b6046f0c req-ba197fa5-f878-49d1-8f39-dab65bdd43bf service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:59.422296 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-eb7a9ee7-e4c3-4bce-8b46-5ba3b6046f0c req-ba197fa5-f878-49d1-8f39-dab65bdd43bf service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:59.456638 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-eb7a9ee7-e4c3-4bce-8b46-5ba3b6046f0c req-ba197fa5-f878-49d1-8f39-dab65bdd43bf service nova] Creating event network-vif-plugged:9485e740-b037-4b33-8fbc-4a5fca20ef33 for instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc on n-h2-master-1 Jul 31 01:31:59.497947 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-eb7a9ee7-e4c3-4bce-8b46-5ba3b6046f0c req-ba197fa5-f878-49d1-8f39-dab65bdd43bf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138645 Jul 31 01:31:59.499026 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2231/4479] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:31:59.682604 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b41cacab-c98d-4bcb-a6e7-9499ccbcec78 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:31:59.686598 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b41cacab-c98d-4bcb-a6e7-9499ccbcec78 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:31:59.720505 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b41cacab-c98d-4bcb-a6e7-9499ccbcec78 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:59.734442 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b41cacab-c98d-4bcb-a6e7-9499ccbcec78 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:31:59.736570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b41cacab-c98d-4bcb-a6e7-9499ccbcec78 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:31:59.741812 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b41cacab-c98d-4bcb-a6e7-9499ccbcec78 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:00.782206 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b41cacab-c98d-4bcb-a6e7-9499ccbcec78 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:00.786817 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:00.814262 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b41cacab-c98d-4bcb-a6e7-9499ccbcec78 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1308 microversion: 2.1 time: 1.147459 Jul 31 01:32:00.824989 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2232/4480] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:59 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1308 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:01.087351 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d59649d6-3523-4772-b101-b9462579a1e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:01.168558 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d59649d6-3523-4772-b101-b9462579a1e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 200 len: 1313 microversion: 2.1 time: 1.902210 Jul 31 01:32:01.183887 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2249/4481] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:31:59 2022] GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 1313 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:01.860855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3d80321c-3a30-4c82-8628-e6b07cc9adfe tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:01.861506 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3d80321c-3a30-4c82-8628-e6b07cc9adfe tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:01.892206 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d80321c-3a30-4c82-8628-e6b07cc9adfe tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:01.894503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d80321c-3a30-4c82-8628-e6b07cc9adfe tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:01.899901 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d80321c-3a30-4c82-8628-e6b07cc9adfe tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:01.904565 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d80321c-3a30-4c82-8628-e6b07cc9adfe tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:01.917398 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d38ce047-adae-44dd-a3d3-97a94cbd7b62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:01.918230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d38ce047-adae-44dd-a3d3-97a94cbd7b62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:01.936033 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d38ce047-adae-44dd-a3d3-97a94cbd7b62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:01.948063 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d38ce047-adae-44dd-a3d3-97a94cbd7b62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:01.949152 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d38ce047-adae-44dd-a3d3-97a94cbd7b62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:01.949761 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d38ce047-adae-44dd-a3d3-97a94cbd7b62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:01.991267 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-d38ce047-adae-44dd-a3d3-97a94cbd7b62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d38ce047-adae-44dd-a3d3-97a94cbd7b62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 HTTP/1.1 Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '339c7371-6352-4eef-a902-b3f8c7f7c856'} Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:32:02.010954 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:32:02.015223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:32:02.015223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:32:02.015223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:32:02.015223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:32:02.015223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:02.015223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:32:02.015223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:32:02.015223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:32:02.015223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:32:02.015223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:32:02.015223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:32:02.021612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d38ce047-adae-44dd-a3d3-97a94cbd7b62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:32:02.027038 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d38ce047-adae-44dd-a3d3-97a94cbd7b62 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "DELETE /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 404 len: 111 microversion: 2.1 time: 0.118562 Jul 31 01:32:02.028135 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2250/4482] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:32:01 2022] DELETE /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:32:02.050324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-90ef1ced-6714-4a24-813b-2a44e6d0512d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:02.050891 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-90ef1ced-6714-4a24-813b-2a44e6d0512d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 339c7371-6352-4eef-a902-b3f8c7f7c856] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:02.085932 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-90ef1ced-6714-4a24-813b-2a44e6d0512d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:02.086393 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-90ef1ced-6714-4a24-813b-2a44e6d0512d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:02.087186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-90ef1ced-6714-4a24-813b-2a44e6d0512d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:02.087655 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-90ef1ced-6714-4a24-813b-2a44e6d0512d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:02.123111 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-90ef1ced-6714-4a24-813b-2a44e6d0512d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-90ef1ced-6714-4a24-813b-2a44e6d0512d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 HTTP/1.1 Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '339c7371-6352-4eef-a902-b3f8c7f7c856'} Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:32:02.137306 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:32:02.142515 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:02.142515 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:32:02.142515 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:32:02.142515 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:32:02.142515 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:32:02.142515 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. Jul 31 01:32:02.142515 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:32:02.142515 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-90ef1ced-6714-4a24-813b-2a44e6d0512d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 339c7371-6352-4eef-a902-b3f8c7f7c856 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:32:02.142515 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-90ef1ced-6714-4a24-813b-2a44e6d0512d tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856" status: 404 len: 111 microversion: 2.1 time: 0.101885 Jul 31 01:32:02.155729 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2251/4483] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:02 2022] GET /compute/v2.1/servers/339c7371-6352-4eef-a902-b3f8c7f7c856 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:32:02.162905 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3297c696-7767-4e9f-97c4-2cfd115f7ba3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:02.163453 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3297c696-7767-4e9f-97c4-2cfd115f7ba3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:02.183778 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3297c696-7767-4e9f-97c4-2cfd115f7ba3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:02.184237 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3297c696-7767-4e9f-97c4-2cfd115f7ba3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:02.185032 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3297c696-7767-4e9f-97c4-2cfd115f7ba3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:02.185474 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3297c696-7767-4e9f-97c4-2cfd115f7ba3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:02.244011 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3297c696-7767-4e9f-97c4-2cfd115f7ba3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:32:02.539896 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3d80321c-3a30-4c82-8628-e6b07cc9adfe tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:02.548689 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3d80321c-3a30-4c82-8628-e6b07cc9adfe tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1308 microversion: 2.1 time: 0.709952 Jul 31 01:32:02.558679 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2233/4484] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:01 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1308 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:02.565095 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95d7bef2-0969-4052-bf66-98e6b9c5188f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:02.592760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-95d7bef2-0969-4052-bf66-98e6b9c5188f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:02.614127 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95d7bef2-0969-4052-bf66-98e6b9c5188f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:02.614692 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95d7bef2-0969-4052-bf66-98e6b9c5188f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:02.616546 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3297c696-7767-4e9f-97c4-2cfd115f7ba3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "DELETE /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 204 len: 0 microversion: 2.1 time: 0.459410 Jul 31 01:32:02.620829 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2252/4485] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:32:02 2022] DELETE /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:32:02.631807 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95d7bef2-0969-4052-bf66-98e6b9c5188f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:02.648092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95d7bef2-0969-4052-bf66-98e6b9c5188f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:02.669181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-abdc62cd-d8ed-458b-a794-6d21a107cba9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:02.672373 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-abdc62cd-d8ed-458b-a794-6d21a107cba9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:02.715041 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abdc62cd-d8ed-458b-a794-6d21a107cba9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:02.720621 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abdc62cd-d8ed-458b-a794-6d21a107cba9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:02.722067 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abdc62cd-d8ed-458b-a794-6d21a107cba9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:02.722765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abdc62cd-d8ed-458b-a794-6d21a107cba9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:03.444141 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-95d7bef2-0969-4052-bf66-98e6b9c5188f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:03.456717 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-95d7bef2-0969-4052-bf66-98e6b9c5188f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 200 len: 1501 microversion: 2.1 time: 0.895385 Jul 31 01:32:03.457297 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2234/4486] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:02 2022] GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 1501 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:03.484035 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-abda32ea-0ba9-4f40-8e33-322f05cb92b6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:03.486931 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-abda32ea-0ba9-4f40-8e33-322f05cb92b6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:03.498688 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abda32ea-0ba9-4f40-8e33-322f05cb92b6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:03.499440 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abda32ea-0ba9-4f40-8e33-322f05cb92b6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:03.500477 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abda32ea-0ba9-4f40-8e33-322f05cb92b6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:03.501284 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abda32ea-0ba9-4f40-8e33-322f05cb92b6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:03.538634 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-abda32ea-0ba9-4f40-8e33-322f05cb92b6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:32:03.723521 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-abdc62cd-d8ed-458b-a794-6d21a107cba9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:03.733711 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-abdc62cd-d8ed-458b-a794-6d21a107cba9 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1511 microversion: 2.1 time: 1.098551 Jul 31 01:32:03.743577 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2253/4487] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:02 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1511 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:03.750331 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e712e3e3-382f-4051-9618-800f1334743b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:03.753765 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e712e3e3-382f-4051-9618-800f1334743b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:03.778516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e712e3e3-382f-4051-9618-800f1334743b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:03.785918 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e712e3e3-382f-4051-9618-800f1334743b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:03.787207 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e712e3e3-382f-4051-9618-800f1334743b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:03.788705 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e712e3e3-382f-4051-9618-800f1334743b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:03.914690 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-abda32ea-0ba9-4f40-8e33-322f05cb92b6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 204 len: 0 microversion: 2.1 time: 0.434453 Jul 31 01:32:03.921756 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2235/4488] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:32:03 2022] DELETE /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:32:03.937111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-86bcea1c-4462-46ac-8f8c-122d9c1d8693 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:03.937975 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-86bcea1c-4462-46ac-8f8c-122d9c1d8693 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:03.962521 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86bcea1c-4462-46ac-8f8c-122d9c1d8693 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:03.962994 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86bcea1c-4462-46ac-8f8c-122d9c1d8693 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:03.963828 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86bcea1c-4462-46ac-8f8c-122d9c1d8693 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:03.971332 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86bcea1c-4462-46ac-8f8c-122d9c1d8693 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:04.833640 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e712e3e3-382f-4051-9618-800f1334743b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:04.854722 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e712e3e3-382f-4051-9618-800f1334743b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1308 microversion: 2.1 time: 1.108536 Jul 31 01:32:04.855718 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2254/4489] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:03 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1308 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:04.861697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f2433d3d-da82-4236-864f-3f1fa483dc14 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:04.867679 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f2433d3d-da82-4236-864f-3f1fa483dc14 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:04.886075 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2433d3d-da82-4236-864f-3f1fa483dc14 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:04.886541 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2433d3d-da82-4236-864f-3f1fa483dc14 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:04.888019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2433d3d-da82-4236-864f-3f1fa483dc14 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:04.890505 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2433d3d-da82-4236-864f-3f1fa483dc14 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:04.908157 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:04.962781 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-86bcea1c-4462-46ac-8f8c-122d9c1d8693 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:04.986769 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-86bcea1c-4462-46ac-8f8c-122d9c1d8693 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 200 len: 1507 microversion: 2.1 time: 1.060367 Jul 31 01:32:05.004159 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2236/4490] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:03 2022] GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 1507 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:05.193644 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f2433d3d-da82-4236-864f-3f1fa483dc14 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:05.203857 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f2433d3d-da82-4236-864f-3f1fa483dc14 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1511 microversion: 2.1 time: 0.346611 Jul 31 01:32:05.206460 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2255/4491] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:04 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1511 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:05.875967 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0cee5210-2f82-4382-9c6f-629d1506c87a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:05.877158 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0cee5210-2f82-4382-9c6f-629d1506c87a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:05.887016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0cee5210-2f82-4382-9c6f-629d1506c87a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:05.888020 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0cee5210-2f82-4382-9c6f-629d1506c87a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:05.892970 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0cee5210-2f82-4382-9c6f-629d1506c87a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:05.898474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0cee5210-2f82-4382-9c6f-629d1506c87a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:06.027753 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-42867b3d-e04c-4a5e-83ea-d4366b2bb369 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:06.028975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-42867b3d-e04c-4a5e-83ea-d4366b2bb369 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:06.044705 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42867b3d-e04c-4a5e-83ea-d4366b2bb369 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:06.045543 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42867b3d-e04c-4a5e-83ea-d4366b2bb369 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:06.046580 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42867b3d-e04c-4a5e-83ea-d4366b2bb369 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:06.047263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42867b3d-e04c-4a5e-83ea-d4366b2bb369 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:06.394104 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0cee5210-2f82-4382-9c6f-629d1506c87a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:06.417076 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0cee5210-2f82-4382-9c6f-629d1506c87a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1308 microversion: 2.1 time: 0.536049 Jul 31 01:32:06.418911 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2237/4492] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:05 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1308 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:06.439769 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e1d72048-f676-4d01-87fd-cabceb0ddbc3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:06.441078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e1d72048-f676-4d01-87fd-cabceb0ddbc3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:06.463790 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e1d72048-f676-4d01-87fd-cabceb0ddbc3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:06.467596 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e1d72048-f676-4d01-87fd-cabceb0ddbc3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:06.469586 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e1d72048-f676-4d01-87fd-cabceb0ddbc3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:06.470603 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e1d72048-f676-4d01-87fd-cabceb0ddbc3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:06.614619 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-42867b3d-e04c-4a5e-83ea-d4366b2bb369 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:06.634551 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-42867b3d-e04c-4a5e-83ea-d4366b2bb369 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 200 len: 1507 microversion: 2.1 time: 0.623065 Jul 31 01:32:06.643370 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2256/4493] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:06 2022] GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 1507 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:06.856322 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e1d72048-f676-4d01-87fd-cabceb0ddbc3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:06.872467 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e1d72048-f676-4d01-87fd-cabceb0ddbc3 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1511 microversion: 2.1 time: 0.441124 Jul 31 01:32:06.880070 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2238/4494] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:06 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1511 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:07.438721 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7ed2844a-fd2c-42ff-ab82-8aef0fb3c4be tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:07.439548 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7ed2844a-fd2c-42ff-ab82-8aef0fb3c4be tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:07.450194 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ed2844a-fd2c-42ff-ab82-8aef0fb3c4be tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:07.468331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ed2844a-fd2c-42ff-ab82-8aef0fb3c4be tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:07.471972 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ed2844a-fd2c-42ff-ab82-8aef0fb3c4be tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:07.472702 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ed2844a-fd2c-42ff-ab82-8aef0fb3c4be tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:07.968390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-ab1b8436-ca12-46a0-8073-97e9c1eb2171 req-c533b8a3-f84b-4d50-a2d0-3cdd41e31274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0", "name": "network-vif-plugged", "status": "completed", "tag": "823a5b41-7ac4-4ed3-aad8-d570a664d155"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:32:07.984626 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-ab1b8436-ca12-46a0-8073-97e9c1eb2171 req-c533b8a3-f84b-4d50-a2d0-3cdd41e31274 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:07.986457 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-ab1b8436-ca12-46a0-8073-97e9c1eb2171 req-c533b8a3-f84b-4d50-a2d0-3cdd41e31274 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:08.013168 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-ab1b8436-ca12-46a0-8073-97e9c1eb2171 req-c533b8a3-f84b-4d50-a2d0-3cdd41e31274 service nova] Creating event network-vif-plugged:823a5b41-7ac4-4ed3-aad8-d570a664d155 for instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 on n-h1-master-1 Jul 31 01:32:08.027619 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-ab1b8436-ca12-46a0-8073-97e9c1eb2171 req-c533b8a3-f84b-4d50-a2d0-3cdd41e31274 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.400774 Jul 31 01:32:08.029861 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2239/4495] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:32:08.044803 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1da0be0a-34c9-4a91-8af5-c81fb0392b6b tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:08.050659 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1da0be0a-34c9-4a91-8af5-c81fb0392b6b tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:08.065463 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1da0be0a-34c9-4a91-8af5-c81fb0392b6b tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:08.066433 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1da0be0a-34c9-4a91-8af5-c81fb0392b6b tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:08.069148 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1da0be0a-34c9-4a91-8af5-c81fb0392b6b tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:08.069924 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1da0be0a-34c9-4a91-8af5-c81fb0392b6b tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:08.380808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7ed2844a-fd2c-42ff-ab82-8aef0fb3c4be tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:08.403114 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7ed2844a-fd2c-42ff-ab82-8aef0fb3c4be tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1308 microversion: 2.1 time: 0.967547 Jul 31 01:32:08.406364 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2257/4496] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:07 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1308 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:08.414601 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-368b39de-68e0-4d2e-8437-c18a36e2c237 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:08.420486 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-368b39de-68e0-4d2e-8437-c18a36e2c237 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:08.432355 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-368b39de-68e0-4d2e-8437-c18a36e2c237 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:08.437248 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-368b39de-68e0-4d2e-8437-c18a36e2c237 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:08.439053 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-368b39de-68e0-4d2e-8437-c18a36e2c237 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:08.448003 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-368b39de-68e0-4d2e-8437-c18a36e2c237 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:08.549505 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-368b39de-68e0-4d2e-8437-c18a36e2c237 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:08.551494 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-368b39de-68e0-4d2e-8437-c18a36e2c237 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:08.552258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-368b39de-68e0-4d2e-8437-c18a36e2c237 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lazy-loading 'fault' on Instance uuid 76757e35-eebd-46de-a012-82bd864fd1d2 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:32:08.619172 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1da0be0a-34c9-4a91-8af5-c81fb0392b6b tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:08.639453 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1da0be0a-34c9-4a91-8af5-c81fb0392b6b tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 200 len: 1465 microversion: 2.1 time: 0.600438 Jul 31 01:32:08.640307 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2240/4497] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:08 2022] GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 1465 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:08.670104 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-dc815ef5-9371-488e-b41d-175c8763b05c req-d6fdf98a-834e-432b-b297-5328dc1395f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a17cb70-bf4a-463e-9128-d40c8d2334bc", "name": "network-vif-deleted", "tag": "9485e740-b037-4b33-8fbc-4a5fca20ef33"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:32:08.683952 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-368b39de-68e0-4d2e-8437-c18a36e2c237 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316ccc283b9047a8a5e3463731025a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d307769cdf8430a81a78a4fed8a539c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:08.695013 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-368b39de-68e0-4d2e-8437-c18a36e2c237 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 200 len: 1306 microversion: 2.1 time: 0.287231 Jul 31 01:32:08.710172 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2258/4498] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:08 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 1306 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:08.736002 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-dc815ef5-9371-488e-b41d-175c8763b05c req-d6fdf98a-834e-432b-b297-5328dc1395f0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:08.736448 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-dc815ef5-9371-488e-b41d-175c8763b05c req-d6fdf98a-834e-432b-b297-5328dc1395f0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:08.772377 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-dc815ef5-9371-488e-b41d-175c8763b05c req-d6fdf98a-834e-432b-b297-5328dc1395f0 service nova] Creating event network-vif-deleted:9485e740-b037-4b33-8fbc-4a5fca20ef33 for instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc on n-h2-master-1 Jul 31 01:32:08.796071 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-dc815ef5-9371-488e-b41d-175c8763b05c req-d6fdf98a-834e-432b-b297-5328dc1395f0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147542 Jul 31 01:32:08.807079 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2241/4499] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:32:09.432185 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-272f5747-0f5b-4eb9-9012-726aba97c5de tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:09.433087 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-272f5747-0f5b-4eb9-9012-726aba97c5de tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:09.447027 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-272f5747-0f5b-4eb9-9012-726aba97c5de tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:09.448454 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-272f5747-0f5b-4eb9-9012-726aba97c5de tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:09.449572 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-272f5747-0f5b-4eb9-9012-726aba97c5de tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:09.450188 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-272f5747-0f5b-4eb9-9012-726aba97c5de tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:09.661627 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f3c48dd4-874d-45a7-aac8-77ddeab744fd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:09.662322 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f3c48dd4-874d-45a7-aac8-77ddeab744fd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:09.672067 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3c48dd4-874d-45a7-aac8-77ddeab744fd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:09.673556 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3c48dd4-874d-45a7-aac8-77ddeab744fd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:09.675638 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3c48dd4-874d-45a7-aac8-77ddeab744fd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:09.676481 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3c48dd4-874d-45a7-aac8-77ddeab744fd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:09.699868 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-f3c48dd4-874d-45a7-aac8-77ddeab744fd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f3c48dd4-874d-45a7-aac8-77ddeab744fd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc HTTP/1.1 Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '6a17cb70-bf4a-463e-9128-d40c8d2334bc'} Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:32:09.701736 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:09.707009 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:09.707009 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:32:09.707009 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:32:09.707009 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:32:09.707009 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:32:09.707009 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. Jul 31 01:32:09.707009 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:09.707009 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f3c48dd4-874d-45a7-aac8-77ddeab744fd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:32:09.707009 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f3c48dd4-874d-45a7-aac8-77ddeab744fd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 404 len: 111 microversion: 2.1 time: 0.045795 Jul 31 01:32:09.707009 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2242/4500] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:09 2022] GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:32:09.730691 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-597a362c-a4e0-4bb6-8df1-ea5730e8f9c5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:09.731527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-597a362c-a4e0-4bb6-8df1-ea5730e8f9c5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] [instance: 76757e35-eebd-46de-a012-82bd864fd1d2] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:09.739811 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-597a362c-a4e0-4bb6-8df1-ea5730e8f9c5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:09.750919 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-597a362c-a4e0-4bb6-8df1-ea5730e8f9c5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:09.750919 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-597a362c-a4e0-4bb6-8df1-ea5730e8f9c5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:09.751446 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-597a362c-a4e0-4bb6-8df1-ea5730e8f9c5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:09.778453 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-597a362c-a4e0-4bb6-8df1-ea5730e8f9c5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] HTTP exception thrown: Instance 76757e35-eebd-46de-a012-82bd864fd1d2 could not be found. Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-597a362c-a4e0-4bb6-8df1-ea5730e8f9c5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Request method failure captured: Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 HTTP/1.1 Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dqPMxkH5JavhlSmnNpan01mXaF2WvuzAhqyKcuEeYpBf-NdEQiGT1GBT8yw4yGrcBaREfVxdAdhIxJ_2wwKtdeZKgWiSy7EhnQmVbBEpFbQ_R39ikxdriyhQAuH4v7voBgpnBATNwL-vMvc4-PcTNEm5T9_NibFG80GwwstdGla6nE Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2d307769cdf8430a81a78a4fed8a539c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2d307769cdf8430a81a78a4fed8a539c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 2d307769cdf8430a81a78a4fed8a539c Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1043789533 Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 316ccc283b9047a8a5e3463731025a11 Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1043789533-project Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 76757e35-eebd-46de-a012-82bd864fd1d2 could not be found. Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '76757e35-eebd-46de-a012-82bd864fd1d2'} Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76757e35-eebd-46de-a012-82bd864fd1d2 could not be found. Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76757e35-eebd-46de-a012-82bd864fd1d2 could not be found. Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:32:09.780829 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:09.785615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:09.785615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:32:09.785615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:32:09.785615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:32:09.785615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:32:09.785615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76757e35-eebd-46de-a012-82bd864fd1d2 could not be found. Jul 31 01:32:09.785615 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:09.787067 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-597a362c-a4e0-4bb6-8df1-ea5730e8f9c5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] Returning 404 to user: Instance 76757e35-eebd-46de-a012-82bd864fd1d2 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:32:09.788246 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-597a362c-a4e0-4bb6-8df1-ea5730e8f9c5 tempest-ServersNegativeTestJSON-1043789533 tempest-ServersNegativeTestJSON-1043789533-project] 10.222.0.45 "GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2" status: 404 len: 111 microversion: 2.1 time: 0.061797 Jul 31 01:32:09.789516 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2243/4501] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:09 2022] GET /compute/v2.1/servers/76757e35-eebd-46de-a012-82bd864fd1d2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:32:09.792225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-272f5747-0f5b-4eb9-9012-726aba97c5de tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:09.804331 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-272f5747-0f5b-4eb9-9012-726aba97c5de tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1308 microversion: 2.1 time: 0.375988 Jul 31 01:32:09.805246 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2259/4502] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:09 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1308 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:09.862669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bad40606-8fb8-447d-9b1f-7687c798ab70 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1555847973", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "1fde53fe-0382-4737-b527-4db7e9bd3777"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:32:09.968957 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-bad40606-8fb8-447d-9b1f-7687c798ab70 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] validate_networks() for [('1fde53fe-0382-4737-b527-4db7e9bd3777', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:32:10.823106 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-9df42822-e2d4-4d3b-ac05-e3909fa975dd req-43d1bd12-38d7-49d1-89b7-3c102da39621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76757e35-eebd-46de-a012-82bd864fd1d2", "name": "network-vif-deleted", "tag": "a84852a6-e79d-4e96-9273-a29f94e85006"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:32:10.858190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9df42822-e2d4-4d3b-ac05-e3909fa975dd req-43d1bd12-38d7-49d1-89b7-3c102da39621 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:10.862102 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9df42822-e2d4-4d3b-ac05-e3909fa975dd req-43d1bd12-38d7-49d1-89b7-3c102da39621 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:10.901640 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-9df42822-e2d4-4d3b-ac05-e3909fa975dd req-43d1bd12-38d7-49d1-89b7-3c102da39621 service nova] Creating event network-vif-deleted:a84852a6-e79d-4e96-9273-a29f94e85006 for instance 76757e35-eebd-46de-a012-82bd864fd1d2 on n-h2-master-1 Jul 31 01:32:10.916693 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-9df42822-e2d4-4d3b-ac05-e3909fa975dd req-43d1bd12-38d7-49d1-89b7-3c102da39621 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097153 Jul 31 01:32:10.917887 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2260/4503] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:32:10.923416 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0741d28b-cc38-4d76-8ea7-af1a829723a6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:10.937463 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0741d28b-cc38-4d76-8ea7-af1a829723a6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:10.950808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0741d28b-cc38-4d76-8ea7-af1a829723a6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:10.953796 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0741d28b-cc38-4d76-8ea7-af1a829723a6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:10.959893 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0741d28b-cc38-4d76-8ea7-af1a829723a6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:10.960473 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0741d28b-cc38-4d76-8ea7-af1a829723a6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:11.110485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-bad40606-8fb8-447d-9b1f-7687c798ab70 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:32:11.110941 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-bad40606-8fb8-447d-9b1f-7687c798ab70 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:32:11.111527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-bad40606-8fb8-447d-9b1f-7687c798ab70 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:32:11.112126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-bad40606-8fb8-447d-9b1f-7687c798ab70 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:32:11.112504 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-bad40606-8fb8-447d-9b1f-7687c798ab70 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:32:11.133747 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bad40606-8fb8-447d-9b1f-7687c798ab70 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:11.134204 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bad40606-8fb8-447d-9b1f-7687c798ab70 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:11.136806 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bad40606-8fb8-447d-9b1f-7687c798ab70 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:11.138676 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bad40606-8fb8-447d-9b1f-7687c798ab70 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:11.188786 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-bad40606-8fb8-447d-9b1f-7687c798ab70 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Getting quotas for project e418a04119b843b4a1c218aa9ff1dbc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:32:11.203130 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-bad40606-8fb8-447d-9b1f-7687c798ab70 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Getting quotas for user 93eccdea3f1447a693cec10d096876a0 and project e418a04119b843b4a1c218aa9ff1dbc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:32:11.239249 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bad40606-8fb8-447d-9b1f-7687c798ab70 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:32:11.246501 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bad40606-8fb8-447d-9b1f-7687c798ab70 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:32:11.355772 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bad40606-8fb8-447d-9b1f-7687c798ab70 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.497918 Jul 31 01:32:11.356446 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2244/4504] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:32:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:32:11.384454 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a3a72fd4-aed3-45c9-94d8-2263aebf8810 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:11.386148 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a3a72fd4-aed3-45c9-94d8-2263aebf8810 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:11.487529 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0741d28b-cc38-4d76-8ea7-af1a829723a6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:11.497613 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0741d28b-cc38-4d76-8ea7-af1a829723a6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1489 microversion: 2.1 time: 0.578360 Jul 31 01:32:11.515802 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2261/4505] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:10 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1489 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:11.529083 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a5752006-15af-4dca-a309-6ceda555f4e2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:11.529789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a5752006-15af-4dca-a309-6ceda555f4e2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:11.554454 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5752006-15af-4dca-a309-6ceda555f4e2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:11.554931 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5752006-15af-4dca-a309-6ceda555f4e2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:11.555779 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5752006-15af-4dca-a309-6ceda555f4e2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:11.556229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5752006-15af-4dca-a309-6ceda555f4e2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:11.576500 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a3a72fd4-aed3-45c9-94d8-2263aebf8810 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:11.597873 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a3a72fd4-aed3-45c9-94d8-2263aebf8810 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1215 microversion: 2.1 time: 0.216315 Jul 31 01:32:11.612556 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2245/4506] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:11 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1215 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:12.027528 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a5752006-15af-4dca-a309-6ceda555f4e2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:12.036525 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a5752006-15af-4dca-a309-6ceda555f4e2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1489 microversion: 2.1 time: 0.511537 Jul 31 01:32:12.041240 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2262/4507] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:11 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1489 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:12.060936 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fb0fa44a-4e63-488d-9958-e550cac70d32 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:12.061573 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fb0fa44a-4e63-488d-9958-e550cac70d32 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:12.070290 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb0fa44a-4e63-488d-9958-e550cac70d32 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:12.070753 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb0fa44a-4e63-488d-9958-e550cac70d32 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:12.071607 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb0fa44a-4e63-488d-9958-e550cac70d32 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:12.072227 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb0fa44a-4e63-488d-9958-e550cac70d32 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:12.414503 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fb0fa44a-4e63-488d-9958-e550cac70d32 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:12.427789 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fb0fa44a-4e63-488d-9958-e550cac70d32 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1489 microversion: 2.1 time: 0.370415 Jul 31 01:32:12.431024 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2246/4508] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:12 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1489 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:12.449521 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7a1855ab-2147-4fb3-a6bd-3c65e656f29e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:12.450030 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7a1855ab-2147-4fb3-a6bd-3c65e656f29e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:12.457367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a1855ab-2147-4fb3-a6bd-3c65e656f29e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:12.457833 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a1855ab-2147-4fb3-a6bd-3c65e656f29e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:12.458642 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a1855ab-2147-4fb3-a6bd-3c65e656f29e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:12.459092 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a1855ab-2147-4fb3-a6bd-3c65e656f29e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:12.541834 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7a1855ab-2147-4fb3-a6bd-3c65e656f29e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:32:12.635120 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c471078f-df45-4def-b509-343041c21631 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:12.638194 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c471078f-df45-4def-b509-343041c21631 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:12.654092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c471078f-df45-4def-b509-343041c21631 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:12.654561 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c471078f-df45-4def-b509-343041c21631 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:12.657838 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c471078f-df45-4def-b509-343041c21631 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:12.659913 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c471078f-df45-4def-b509-343041c21631 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:12.793814 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7a1855ab-2147-4fb3-a6bd-3c65e656f29e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 204 len: 0 microversion: 2.1 time: 0.335688 Jul 31 01:32:12.809322 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2263/4509] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:32:12 2022] DELETE /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:32:12.817993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-241fa57f-9b26-4eed-98db-d742171ffde0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:12.843483 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-241fa57f-9b26-4eed-98db-d742171ffde0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:12.869172 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-241fa57f-9b26-4eed-98db-d742171ffde0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:12.884156 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-241fa57f-9b26-4eed-98db-d742171ffde0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:12.885186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-241fa57f-9b26-4eed-98db-d742171ffde0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:12.885642 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-241fa57f-9b26-4eed-98db-d742171ffde0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:12.896848 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c471078f-df45-4def-b509-343041c21631 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:12.908833 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c471078f-df45-4def-b509-343041c21631 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1219 microversion: 2.1 time: 0.286371 Jul 31 01:32:12.925624 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2247/4510] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:12 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1219 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:13.209045 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-241fa57f-9b26-4eed-98db-d742171ffde0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:13.217829 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-241fa57f-9b26-4eed-98db-d742171ffde0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1495 microversion: 2.1 time: 0.404070 Jul 31 01:32:13.231614 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2264/4511] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:12 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1495 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:13.944605 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1e7f42ef-0e07-4152-9ce0-fdbe1fbb22c4 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:13.945250 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1e7f42ef-0e07-4152-9ce0-fdbe1fbb22c4 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:13.971649 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e7f42ef-0e07-4152-9ce0-fdbe1fbb22c4 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:13.972108 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e7f42ef-0e07-4152-9ce0-fdbe1fbb22c4 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:13.973481 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e7f42ef-0e07-4152-9ce0-fdbe1fbb22c4 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:13.973934 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e7f42ef-0e07-4152-9ce0-fdbe1fbb22c4 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:14.134630 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1e7f42ef-0e07-4152-9ce0-fdbe1fbb22c4 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:14.153010 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1e7f42ef-0e07-4152-9ce0-fdbe1fbb22c4 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1273 microversion: 2.1 time: 0.220294 Jul 31 01:32:14.172466 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2248/4512] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:13 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:14.242893 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-52105690-49a9-47ed-8421-fc36bd4d1157 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:14.244237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-52105690-49a9-47ed-8421-fc36bd4d1157 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:14.278212 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52105690-49a9-47ed-8421-fc36bd4d1157 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:14.282357 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52105690-49a9-47ed-8421-fc36bd4d1157 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:14.289990 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52105690-49a9-47ed-8421-fc36bd4d1157 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:14.292642 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52105690-49a9-47ed-8421-fc36bd4d1157 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:15.145583 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-52105690-49a9-47ed-8421-fc36bd4d1157 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:15.161915 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-52105690-49a9-47ed-8421-fc36bd4d1157 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1495 microversion: 2.1 time: 0.925342 Jul 31 01:32:15.165400 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2265/4513] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:14 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1495 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:15.181070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ed3e3537-1870-41bd-96c6-61c287cbb0bf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:15.181980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ed3e3537-1870-41bd-96c6-61c287cbb0bf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:15.197461 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:15.204851 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed3e3537-1870-41bd-96c6-61c287cbb0bf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:15.205326 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed3e3537-1870-41bd-96c6-61c287cbb0bf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:15.206145 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed3e3537-1870-41bd-96c6-61c287cbb0bf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:15.206593 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ed3e3537-1870-41bd-96c6-61c287cbb0bf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:15.546327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ed3e3537-1870-41bd-96c6-61c287cbb0bf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:15.564086 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ed3e3537-1870-41bd-96c6-61c287cbb0bf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1273 microversion: 2.1 time: 0.389761 Jul 31 01:32:15.568217 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2249/4514] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:15 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1273 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:15.845085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f5a146ed-c667-4215-87a8-5173def23a29 req-e47ed7ff-8688-4dd2-953d-78e106121ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0", "name": "network-vif-deleted", "tag": "823a5b41-7ac4-4ed3-aad8-d570a664d155"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:32:15.907558 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f5a146ed-c667-4215-87a8-5173def23a29 req-e47ed7ff-8688-4dd2-953d-78e106121ec0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:15.908193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f5a146ed-c667-4215-87a8-5173def23a29 req-e47ed7ff-8688-4dd2-953d-78e106121ec0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:15.986842 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f5a146ed-c667-4215-87a8-5173def23a29 req-e47ed7ff-8688-4dd2-953d-78e106121ec0 service nova] Creating event network-vif-deleted:823a5b41-7ac4-4ed3-aad8-d570a664d155 for instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 on n-h1-master-1 Jul 31 01:32:16.013071 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f5a146ed-c667-4215-87a8-5173def23a29 req-e47ed7ff-8688-4dd2-953d-78e106121ec0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167162 Jul 31 01:32:16.013071 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2266/4515] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:32:16.190178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8a71f9c5-9032-46c3-b002-4bdcc196e0dc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:16.190793 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8a71f9c5-9032-46c3-b002-4bdcc196e0dc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:16.226400 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8a71f9c5-9032-46c3-b002-4bdcc196e0dc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:16.231325 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8a71f9c5-9032-46c3-b002-4bdcc196e0dc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:16.237405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8a71f9c5-9032-46c3-b002-4bdcc196e0dc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:16.242678 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8a71f9c5-9032-46c3-b002-4bdcc196e0dc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:16.301545 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8a71f9c5-9032-46c3-b002-4bdcc196e0dc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:16.302611 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8a71f9c5-9032-46c3-b002-4bdcc196e0dc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:16.303369 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-8a71f9c5-9032-46c3-b002-4bdcc196e0dc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lazy-loading 'fault' on Instance uuid 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:32:16.397675 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8a71f9c5-9032-46c3-b002-4bdcc196e0dc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:16.412407 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8a71f9c5-9032-46c3-b002-4bdcc196e0dc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 200 len: 1298 microversion: 2.1 time: 0.223547 Jul 31 01:32:16.413218 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2250/4516] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:16 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 1298 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:16.598623 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0a20ec19-32c8-4783-96d8-b5585c04bb8c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:16.601191 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0a20ec19-32c8-4783-96d8-b5585c04bb8c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:16.637907 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a20ec19-32c8-4783-96d8-b5585c04bb8c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:16.638371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a20ec19-32c8-4783-96d8-b5585c04bb8c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:16.639164 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a20ec19-32c8-4783-96d8-b5585c04bb8c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:16.639633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a20ec19-32c8-4783-96d8-b5585c04bb8c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:16.867072 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0a20ec19-32c8-4783-96d8-b5585c04bb8c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:16.887591 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0a20ec19-32c8-4783-96d8-b5585c04bb8c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1273 microversion: 2.1 time: 0.300306 Jul 31 01:32:16.890752 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2267/4517] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:16 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1273 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:17.435795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0e45d406-785b-4c80-89da-d76a615a2291 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:17.436638 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0e45d406-785b-4c80-89da-d76a615a2291 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:17.445492 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e45d406-785b-4c80-89da-d76a615a2291 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:17.445941 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e45d406-785b-4c80-89da-d76a615a2291 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:17.446713 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e45d406-785b-4c80-89da-d76a615a2291 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:17.447380 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e45d406-785b-4c80-89da-d76a615a2291 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:17.499764 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-0e45d406-785b-4c80-89da-d76a615a2291 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0e45d406-785b-4c80-89da-d76a615a2291 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 HTTP/1.1 Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0'} Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:17.504189 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:17.508964 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:32:17.508964 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:32:17.508964 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:32:17.508964 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:32:17.508964 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. Jul 31 01:32:17.508964 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:17.510201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0e45d406-785b-4c80-89da-d76a615a2291 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:32:17.513670 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0e45d406-785b-4c80-89da-d76a615a2291 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 404 len: 111 microversion: 2.1 time: 0.079762 Jul 31 01:32:17.514944 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2251/4518] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:17 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:32:17.524063 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4cd255f8-7ffd-4635-beb7-30510ff8d3bc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:17.524762 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4cd255f8-7ffd-4635-beb7-30510ff8d3bc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:17.544566 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4cd255f8-7ffd-4635-beb7-30510ff8d3bc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:17.546278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4cd255f8-7ffd-4635-beb7-30510ff8d3bc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:17.549030 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4cd255f8-7ffd-4635-beb7-30510ff8d3bc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:17.550193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4cd255f8-7ffd-4635-beb7-30510ff8d3bc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:17.663559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4cd255f8-7ffd-4635-beb7-30510ff8d3bc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:32:17.909271 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4cd255f8-7ffd-4635-beb7-30510ff8d3bc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 204 len: 0 microversion: 2.1 time: 0.389119 Jul 31 01:32:17.909980 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2268/4519] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:32:17 2022] DELETE /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:32:17.925045 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-27e6c1a0-7b68-4ef8-a8e2-7233624bcda3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:17.926652 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-27e6c1a0-7b68-4ef8-a8e2-7233624bcda3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:17.934521 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6e9ce75b-ea48-45fc-8419-db4e888b9e74 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:17.937445 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6e9ce75b-ea48-45fc-8419-db4e888b9e74 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:17.959481 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e9ce75b-ea48-45fc-8419-db4e888b9e74 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:17.960174 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e9ce75b-ea48-45fc-8419-db4e888b9e74 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:17.961464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e9ce75b-ea48-45fc-8419-db4e888b9e74 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:17.962095 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e9ce75b-ea48-45fc-8419-db4e888b9e74 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:17.966507 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27e6c1a0-7b68-4ef8-a8e2-7233624bcda3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:17.966897 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27e6c1a0-7b68-4ef8-a8e2-7233624bcda3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:17.967736 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27e6c1a0-7b68-4ef8-a8e2-7233624bcda3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:17.968377 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27e6c1a0-7b68-4ef8-a8e2-7233624bcda3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:17.990128 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:18.028334 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:18.701218 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-27e6c1a0-7b68-4ef8-a8e2-7233624bcda3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:18.711845 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-27e6c1a0-7b68-4ef8-a8e2-7233624bcda3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1495 microversion: 2.1 time: 0.794598 Jul 31 01:32:18.736897 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2269/4520] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:17 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1495 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:18.766482 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6e9ce75b-ea48-45fc-8419-db4e888b9e74 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:18.780849 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6e9ce75b-ea48-45fc-8419-db4e888b9e74 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1315 microversion: 2.1 time: 0.865182 Jul 31 01:32:18.781683 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2252/4521] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:17 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1315 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:19.734059 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b9688ab6-71ce-418a-9f97-ecc530fc850a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:19.735325 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b9688ab6-71ce-418a-9f97-ecc530fc850a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:19.747137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9688ab6-71ce-418a-9f97-ecc530fc850a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:19.756977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9688ab6-71ce-418a-9f97-ecc530fc850a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:19.757827 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9688ab6-71ce-418a-9f97-ecc530fc850a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:19.758277 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b9688ab6-71ce-418a-9f97-ecc530fc850a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:19.771242 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-b081c889-e8d8-487a-a668-edc4fb3b9b79 req-1538d7f2-0962-4e06-8cb6-83e616717366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eebeaca1-9bc6-4c6c-830e-6b54f2998fc3", "tag": "52c2cbbe-8278-4110-99be-6a65fe0fc744"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:32:19.825108 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b081c889-e8d8-487a-a668-edc4fb3b9b79 req-1538d7f2-0962-4e06-8cb6-83e616717366 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:19.831101 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b081c889-e8d8-487a-a668-edc4fb3b9b79 req-1538d7f2-0962-4e06-8cb6-83e616717366 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:19.900519 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-b081c889-e8d8-487a-a668-edc4fb3b9b79 req-1538d7f2-0962-4e06-8cb6-83e616717366 service nova] Creating event network-changed:52c2cbbe-8278-4110-99be-6a65fe0fc744 for instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 on n-h2-master-1 Jul 31 01:32:19.924628 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-b081c889-e8d8-487a-a668-edc4fb3b9b79 req-1538d7f2-0962-4e06-8cb6-83e616717366 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166334 Jul 31 01:32:19.926396 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2253/4522] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:32:19.947113 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e8d91732-dcc2-4d3b-b921-d82cb157c97f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:19.953256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e8d91732-dcc2-4d3b-b921-d82cb157c97f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:19.973634 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8d91732-dcc2-4d3b-b921-d82cb157c97f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:19.974949 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8d91732-dcc2-4d3b-b921-d82cb157c97f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:19.978068 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8d91732-dcc2-4d3b-b921-d82cb157c97f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:19.980831 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8d91732-dcc2-4d3b-b921-d82cb157c97f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:20.189666 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b9688ab6-71ce-418a-9f97-ecc530fc850a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:20.210362 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b9688ab6-71ce-418a-9f97-ecc530fc850a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1495 microversion: 2.1 time: 0.470678 Jul 31 01:32:20.224453 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2270/4523] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:19 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1495 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:20.580144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e8d91732-dcc2-4d3b-b921-d82cb157c97f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:20.606023 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e8d91732-dcc2-4d3b-b921-d82cb157c97f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1315 microversion: 2.1 time: 0.677299 Jul 31 01:32:20.608958 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2254/4524] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:19 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1315 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:21.186434 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-694237a2-9d9e-425e-85b4-f0757420ee85 req-bae5c5bc-9e3c-4075-bfdb-ef9dc22b5d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5b5df6-d433-4917-b181-7cac6503612d", "name": "network-vif-deleted", "tag": "046c8a9d-a327-4045-b1f0-229d843599d9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:32:21.198890 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-694237a2-9d9e-425e-85b4-f0757420ee85 req-bae5c5bc-9e3c-4075-bfdb-ef9dc22b5d33 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:21.199478 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-694237a2-9d9e-425e-85b4-f0757420ee85 req-bae5c5bc-9e3c-4075-bfdb-ef9dc22b5d33 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:21.239137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6cd80706-6d22-44d3-b7fa-859a993c5ae3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:21.242161 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6cd80706-6d22-44d3-b7fa-859a993c5ae3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:21.255951 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-694237a2-9d9e-425e-85b4-f0757420ee85 req-bae5c5bc-9e3c-4075-bfdb-ef9dc22b5d33 service nova] Creating event network-vif-deleted:046c8a9d-a327-4045-b1f0-229d843599d9 for instance 5d5b5df6-d433-4917-b181-7cac6503612d on n-h1-master-1 Jul 31 01:32:21.258909 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:21.265755 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6cd80706-6d22-44d3-b7fa-859a993c5ae3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:21.266578 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6cd80706-6d22-44d3-b7fa-859a993c5ae3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:21.269268 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6cd80706-6d22-44d3-b7fa-859a993c5ae3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:21.276486 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-694237a2-9d9e-425e-85b4-f0757420ee85 req-bae5c5bc-9e3c-4075-bfdb-ef9dc22b5d33 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093805 Jul 31 01:32:21.277921 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2271/4525] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:32:21.278118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6cd80706-6d22-44d3-b7fa-859a993c5ae3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:21.508064 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6cd80706-6d22-44d3-b7fa-859a993c5ae3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:21.516607 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6cd80706-6d22-44d3-b7fa-859a993c5ae3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 200 len: 1293 microversion: 2.1 time: 0.282420 Jul 31 01:32:21.543982 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2255/4526] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:21 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 1293 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:21.631002 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d3e60575-9cfd-47aa-ac24-5ad40233ccbe tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:21.633820 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d3e60575-9cfd-47aa-ac24-5ad40233ccbe tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:21.667802 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3e60575-9cfd-47aa-ac24-5ad40233ccbe tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:21.670213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3e60575-9cfd-47aa-ac24-5ad40233ccbe tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:21.671133 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3e60575-9cfd-47aa-ac24-5ad40233ccbe tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:21.671898 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d3e60575-9cfd-47aa-ac24-5ad40233ccbe tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:22.506387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d3e60575-9cfd-47aa-ac24-5ad40233ccbe tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:22.518644 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d3e60575-9cfd-47aa-ac24-5ad40233ccbe tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1315 microversion: 2.1 time: 0.893298 Jul 31 01:32:22.519252 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2272/4527] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:21 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1315 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:22.620162 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-24068dcb-9ce1-4d6c-8389-efbe153e265b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:22.623579 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-24068dcb-9ce1-4d6c-8389-efbe153e265b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:22.643508 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=8 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:22.652657 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-24068dcb-9ce1-4d6c-8389-efbe153e265b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:22.653681 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-24068dcb-9ce1-4d6c-8389-efbe153e265b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:22.657004 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-24068dcb-9ce1-4d6c-8389-efbe153e265b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:22.659730 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-24068dcb-9ce1-4d6c-8389-efbe153e265b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:22.727140 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-24068dcb-9ce1-4d6c-8389-efbe153e265b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-24068dcb-9ce1-4d6c-8389-efbe153e265b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d HTTP/1.1 Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '5d5b5df6-d433-4917-b181-7cac6503612d'} Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:22.732526 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:22.742333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:32:22.742333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:32:22.742333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:32:22.742333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:32:22.742333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. Jul 31 01:32:22.742333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:22.748088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-24068dcb-9ce1-4d6c-8389-efbe153e265b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:32:22.753276 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-24068dcb-9ce1-4d6c-8389-efbe153e265b tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 404 len: 111 microversion: 2.1 time: 0.201871 Jul 31 01:32:22.754890 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2256/4528] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:22 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:32:23.276985 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-51eb695d-5339-40ca-a7ce-4f703e857c4a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1910581704", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "ce8b5cb4-aa2f-4dfd-abb4-9273e2a34e90"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:32:23.405868 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-51eb695d-5339-40ca-a7ce-4f703e857c4a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] validate_networks() for [('ce8b5cb4-aa2f-4dfd-abb4-9273e2a34e90', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:32:23.540566 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-71dad1ed-0ff1-4f27-a26f-2d4a81626451 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:23.541210 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-71dad1ed-0ff1-4f27-a26f-2d4a81626451 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:23.580086 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-71dad1ed-0ff1-4f27-a26f-2d4a81626451 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:23.581818 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-71dad1ed-0ff1-4f27-a26f-2d4a81626451 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:23.584772 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-71dad1ed-0ff1-4f27-a26f-2d4a81626451 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:23.585446 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-71dad1ed-0ff1-4f27-a26f-2d4a81626451 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:24.111772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-71dad1ed-0ff1-4f27-a26f-2d4a81626451 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:24.125978 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-71dad1ed-0ff1-4f27-a26f-2d4a81626451 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1315 microversion: 2.1 time: 0.589190 Jul 31 01:32:24.135949 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2257/4529] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:23 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:24.506972 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-51eb695d-5339-40ca-a7ce-4f703e857c4a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:32:24.507356 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-51eb695d-5339-40ca-a7ce-4f703e857c4a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:32:24.507973 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-51eb695d-5339-40ca-a7ce-4f703e857c4a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:32:24.508445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-51eb695d-5339-40ca-a7ce-4f703e857c4a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:32:24.508912 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-51eb695d-5339-40ca-a7ce-4f703e857c4a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:32:24.525404 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51eb695d-5339-40ca-a7ce-4f703e857c4a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:24.525859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51eb695d-5339-40ca-a7ce-4f703e857c4a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:24.526671 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51eb695d-5339-40ca-a7ce-4f703e857c4a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:24.527090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51eb695d-5339-40ca-a7ce-4f703e857c4a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:24.624721 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-51eb695d-5339-40ca-a7ce-4f703e857c4a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:32:24.647527 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-51eb695d-5339-40ca-a7ce-4f703e857c4a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for user 159706f59a12427f9a3c03fa31f712f3 and project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:32:24.712219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-51eb695d-5339-40ca-a7ce-4f703e857c4a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:32:24.720656 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-51eb695d-5339-40ca-a7ce-4f703e857c4a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:32:24.824374 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-51eb695d-5339-40ca-a7ce-4f703e857c4a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.551500 Jul 31 01:32:24.834796 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2273/4530] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:32:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:32:24.839909 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0a9e94bd-d642-422c-9ef7-335c0807ff6a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:24.840989 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0a9e94bd-d642-422c-9ef7-335c0807ff6a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:25.015282 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0a9e94bd-d642-422c-9ef7-335c0807ff6a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:25.024193 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0a9e94bd-d642-422c-9ef7-335c0807ff6a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1209 microversion: 2.1 time: 0.188457 Jul 31 01:32:25.029893 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2258/4531] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:24 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1209 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:32:25.151479 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a3de5bb8-124a-4be1-8896-215b02ebd0ea tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:25.152302 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a3de5bb8-124a-4be1-8896-215b02ebd0ea tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:25.164276 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3de5bb8-124a-4be1-8896-215b02ebd0ea tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:25.167042 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3de5bb8-124a-4be1-8896-215b02ebd0ea tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:25.168652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3de5bb8-124a-4be1-8896-215b02ebd0ea tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:25.168652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3de5bb8-124a-4be1-8896-215b02ebd0ea tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:25.574221 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a3de5bb8-124a-4be1-8896-215b02ebd0ea tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:25.585116 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a3de5bb8-124a-4be1-8896-215b02ebd0ea tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1315 microversion: 2.1 time: 0.437420 Jul 31 01:32:25.589109 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2274/4532] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:25 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:26.049817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e8a7b6d6-99c4-45ab-aad8-52f783914147 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:26.052412 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e8a7b6d6-99c4-45ab-aad8-52f783914147 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:26.072502 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8a7b6d6-99c4-45ab-aad8-52f783914147 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:26.073464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8a7b6d6-99c4-45ab-aad8-52f783914147 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:26.080506 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8a7b6d6-99c4-45ab-aad8-52f783914147 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:26.081686 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8a7b6d6-99c4-45ab-aad8-52f783914147 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:26.327604 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e8a7b6d6-99c4-45ab-aad8-52f783914147 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:26.342015 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e8a7b6d6-99c4-45ab-aad8-52f783914147 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1213 microversion: 2.1 time: 0.300574 Jul 31 01:32:26.342599 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2259/4533] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:26 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1213 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:26.390180 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9ebacd26-a7ee-437e-85b1-9a8da9dbe6df tempest-ExtensionsTest-2098663181 tempest-ExtensionsTest-2098663181-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:26.393006 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9ebacd26-a7ee-437e-85b1-9a8da9dbe6df tempest-ExtensionsTest-2098663181 tempest-ExtensionsTest-2098663181-project] 10.222.0.45 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.345336 Jul 31 01:32:26.397927 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2275/4534] 10.222.0.45 () {58 vars in 1170 bytes} [Sun Jul 31 01:32:26 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:32:26.404312 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-691d205b-5a8d-445c-9cef-a8e9e06914a2 tempest-ExtensionsTest-2098663181 tempest-ExtensionsTest-2098663181-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:26.407057 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-691d205b-5a8d-445c-9cef-a8e9e06914a2 tempest-ExtensionsTest-2098663181 tempest-ExtensionsTest-2098663181-project] 10.222.0.45 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.008114 Jul 31 01:32:26.408304 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2260/4535] 10.222.0.45 () {58 vars in 1134 bytes} [Sun Jul 31 01:32:26 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 01:32:26.607246 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7b207139-9435-44b7-8c1b-ad0e3ba31714 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:26.608068 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7b207139-9435-44b7-8c1b-ad0e3ba31714 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:26.610229 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:26.618347 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b207139-9435-44b7-8c1b-ad0e3ba31714 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:26.626702 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b207139-9435-44b7-8c1b-ad0e3ba31714 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:26.627802 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b207139-9435-44b7-8c1b-ad0e3ba31714 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:26.628485 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b207139-9435-44b7-8c1b-ad0e3ba31714 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:27.366644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9caaa7a6-0873-4322-8362-6c990387499f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:27.367258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9caaa7a6-0873-4322-8362-6c990387499f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:27.385441 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9caaa7a6-0873-4322-8362-6c990387499f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:27.388250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9caaa7a6-0873-4322-8362-6c990387499f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:27.391783 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9caaa7a6-0873-4322-8362-6c990387499f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:27.396576 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9caaa7a6-0873-4322-8362-6c990387499f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:27.485208 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7b207139-9435-44b7-8c1b-ad0e3ba31714 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:27.496105 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7b207139-9435-44b7-8c1b-ad0e3ba31714 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1315 microversion: 2.1 time: 0.892737 Jul 31 01:32:27.511364 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2276/4536] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:26 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1315 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:27.657645 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9caaa7a6-0873-4322-8362-6c990387499f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:27.679165 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9caaa7a6-0873-4322-8362-6c990387499f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1279 microversion: 2.1 time: 0.317641 Jul 31 01:32:27.684044 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2261/4537] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:27 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1279 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:28.413738 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-bd97343b-efe6-4f26-9075-f192210463ed req-dce5651d-1a8b-49a5-b7b4-6a13bf94647c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eebeaca1-9bc6-4c6c-830e-6b54f2998fc3", "name": "network-vif-plugged", "status": "completed", "tag": "52c2cbbe-8278-4110-99be-6a65fe0fc744"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:32:28.447789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-bd97343b-efe6-4f26-9075-f192210463ed req-dce5651d-1a8b-49a5-b7b4-6a13bf94647c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:28.459307 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-bd97343b-efe6-4f26-9075-f192210463ed req-dce5651d-1a8b-49a5-b7b4-6a13bf94647c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:28.497839 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-bd97343b-efe6-4f26-9075-f192210463ed req-dce5651d-1a8b-49a5-b7b4-6a13bf94647c service nova] Creating event network-vif-plugged:52c2cbbe-8278-4110-99be-6a65fe0fc744 for instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 on n-h2-master-1 Jul 31 01:32:28.529561 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1d948689-c36b-4a6b-926a-1278ca841eb5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:28.530179 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1d948689-c36b-4a6b-926a-1278ca841eb5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:28.542384 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-bd97343b-efe6-4f26-9075-f192210463ed req-dce5651d-1a8b-49a5-b7b4-6a13bf94647c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134861 Jul 31 01:32:28.583215 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2277/4538] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:32:28.587363 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d948689-c36b-4a6b-926a-1278ca841eb5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:28.588287 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d948689-c36b-4a6b-926a-1278ca841eb5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:28.589126 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d948689-c36b-4a6b-926a-1278ca841eb5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:28.589564 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d948689-c36b-4a6b-926a-1278ca841eb5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:28.704932 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-10f2d85f-e4a7-4f51-8ebb-85318be239cc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:28.705870 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-10f2d85f-e4a7-4f51-8ebb-85318be239cc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:28.731378 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10f2d85f-e4a7-4f51-8ebb-85318be239cc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:28.735114 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10f2d85f-e4a7-4f51-8ebb-85318be239cc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:28.736198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10f2d85f-e4a7-4f51-8ebb-85318be239cc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:28.736807 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10f2d85f-e4a7-4f51-8ebb-85318be239cc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:29.058621 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-10f2d85f-e4a7-4f51-8ebb-85318be239cc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:29.080685 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-10f2d85f-e4a7-4f51-8ebb-85318be239cc tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1267 microversion: 2.1 time: 0.380105 Jul 31 01:32:29.087471 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2278/4539] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:28 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1267 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:29.482779 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1d948689-c36b-4a6b-926a-1278ca841eb5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:29.494819 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1d948689-c36b-4a6b-926a-1278ca841eb5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1315 microversion: 2.1 time: 0.970443 Jul 31 01:32:29.512360 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2262/4540] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:28 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1315 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:30.106385 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-77ad48d1-4d61-407a-8758-5f737da44e90 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:30.107012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-77ad48d1-4d61-407a-8758-5f737da44e90 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:30.116488 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77ad48d1-4d61-407a-8758-5f737da44e90 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:30.124559 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77ad48d1-4d61-407a-8758-5f737da44e90 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:30.125816 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77ad48d1-4d61-407a-8758-5f737da44e90 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:30.130926 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77ad48d1-4d61-407a-8758-5f737da44e90 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:30.518726 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-48bcf24d-1ced-4a19-bd6b-34dea60b34ba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:30.520622 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-48bcf24d-1ced-4a19-bd6b-34dea60b34ba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:30.536915 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48bcf24d-1ced-4a19-bd6b-34dea60b34ba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:30.538919 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48bcf24d-1ced-4a19-bd6b-34dea60b34ba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:30.544487 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48bcf24d-1ced-4a19-bd6b-34dea60b34ba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:30.548453 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48bcf24d-1ced-4a19-bd6b-34dea60b34ba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:31.099178 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-77ad48d1-4d61-407a-8758-5f737da44e90 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:31.117818 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-77ad48d1-4d61-407a-8758-5f737da44e90 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1309 microversion: 2.1 time: 1.015565 Jul 31 01:32:31.123819 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2279/4541] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:30 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1309 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:31.457531 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-48bcf24d-1ced-4a19-bd6b-34dea60b34ba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:31.474795 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-48bcf24d-1ced-4a19-bd6b-34dea60b34ba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1503 microversion: 2.1 time: 0.957044 Jul 31 01:32:31.490994 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2263/4542] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:30 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1503 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:32:32.144805 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e66403b6-9a87-4601-89f9-e3eddccccb4f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:32.146658 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e66403b6-9a87-4601-89f9-e3eddccccb4f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:32.183213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e66403b6-9a87-4601-89f9-e3eddccccb4f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:32.185272 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e66403b6-9a87-4601-89f9-e3eddccccb4f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:32.190792 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e66403b6-9a87-4601-89f9-e3eddccccb4f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:32.196086 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e66403b6-9a87-4601-89f9-e3eddccccb4f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:32.725219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e66403b6-9a87-4601-89f9-e3eddccccb4f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:32.740553 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e66403b6-9a87-4601-89f9-e3eddccccb4f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1309 microversion: 2.1 time: 0.593818 Jul 31 01:32:32.741233 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2280/4543] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:32 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1309 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:33.572761 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-74afc707-b6b2-4d37-ac6d-59c93b52324d req-cffca39b-850d-4e4e-aafe-4740bfbb142f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3bf1681-df1e-4407-a184-d8b7dd992d13", "tag": "c9f24716-d0bc-4181-b356-35d65fc62a0f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:32:33.601628 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-74afc707-b6b2-4d37-ac6d-59c93b52324d req-cffca39b-850d-4e4e-aafe-4740bfbb142f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:33.602362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-74afc707-b6b2-4d37-ac6d-59c93b52324d req-cffca39b-850d-4e4e-aafe-4740bfbb142f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:33.671815 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-74afc707-b6b2-4d37-ac6d-59c93b52324d req-cffca39b-850d-4e4e-aafe-4740bfbb142f service nova] Creating event network-changed:c9f24716-d0bc-4181-b356-35d65fc62a0f for instance b3bf1681-df1e-4407-a184-d8b7dd992d13 on n-h1-master-1 Jul 31 01:32:33.689191 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-74afc707-b6b2-4d37-ac6d-59c93b52324d req-cffca39b-850d-4e4e-aafe-4740bfbb142f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121624 Jul 31 01:32:33.695104 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2264/4544] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:32:33.760988 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-68e825b4-9842-4580-882d-37dcd41cfc70 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:33.761610 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-68e825b4-9842-4580-882d-37dcd41cfc70 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:33.785498 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-68e825b4-9842-4580-882d-37dcd41cfc70 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:33.785973 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-68e825b4-9842-4580-882d-37dcd41cfc70 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:33.786879 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-68e825b4-9842-4580-882d-37dcd41cfc70 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:33.787365 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-68e825b4-9842-4580-882d-37dcd41cfc70 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:34.323274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-68e825b4-9842-4580-882d-37dcd41cfc70 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:34.331403 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-68e825b4-9842-4580-882d-37dcd41cfc70 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1309 microversion: 2.1 time: 0.574133 Jul 31 01:32:34.335736 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2281/4545] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:33 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1309 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:35.361717 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:35.381785 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-138e89d0-23c6-4f73-99a1-5e4f625be8b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:35.382934 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-138e89d0-23c6-4f73-99a1-5e4f625be8b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:35.390605 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-138e89d0-23c6-4f73-99a1-5e4f625be8b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:35.391456 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-138e89d0-23c6-4f73-99a1-5e4f625be8b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:35.392551 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-138e89d0-23c6-4f73-99a1-5e4f625be8b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:35.393225 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-138e89d0-23c6-4f73-99a1-5e4f625be8b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:35.690026 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-08b26ad8-a4bd-4de8-85cb-9ac30abbdecf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57a04271-260f-42d7-bded-b75f40548661"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:32:35.694008 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-08b26ad8-a4bd-4de8-85cb-9ac30abbdecf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:35.710098 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:35.711122 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:35.718428 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08b26ad8-a4bd-4de8-85cb-9ac30abbdecf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:35.721663 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08b26ad8-a4bd-4de8-85cb-9ac30abbdecf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:35.722723 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08b26ad8-a4bd-4de8-85cb-9ac30abbdecf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:35.727982 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08b26ad8-a4bd-4de8-85cb-9ac30abbdecf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:36.045184 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-138e89d0-23c6-4f73-99a1-5e4f625be8b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:36.075154 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-138e89d0-23c6-4f73-99a1-5e4f625be8b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1309 microversion: 2.1 time: 0.716961 Jul 31 01:32:36.076823 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2265/4546] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:35 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1309 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:36.377640 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-08b26ad8-a4bd-4de8-85cb-9ac30abbdecf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "POST /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.691945 Jul 31 01:32:36.380053 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2282/4547] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:32:35 2022] POST /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3/os-volume_attachments => generated 194 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:32:37.117738 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2a064f62-7f1b-47da-b036-5e11a87e9fab tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:37.119226 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2a064f62-7f1b-47da-b036-5e11a87e9fab tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:37.135808 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2a064f62-7f1b-47da-b036-5e11a87e9fab tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:37.138458 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2a064f62-7f1b-47da-b036-5e11a87e9fab tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:37.144991 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2a064f62-7f1b-47da-b036-5e11a87e9fab tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:37.149645 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2a064f62-7f1b-47da-b036-5e11a87e9fab tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:37.963256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2a064f62-7f1b-47da-b036-5e11a87e9fab tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:37.971367 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2a064f62-7f1b-47da-b036-5e11a87e9fab tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1309 microversion: 2.1 time: 0.875406 Jul 31 01:32:37.985555 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2266/4548] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:37 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1309 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:39.006593 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-55f89c38-e444-4421-b498-1046cfa72d74 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:39.007478 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-55f89c38-e444-4421-b498-1046cfa72d74 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:39.023856 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 01:32:39.024417 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 01:32:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 01:32:39.024519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55f89c38-e444-4421-b498-1046cfa72d74 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:39.024822 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55f89c38-e444-4421-b498-1046cfa72d74 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:39.025682 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55f89c38-e444-4421-b498-1046cfa72d74 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:39.026196 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55f89c38-e444-4421-b498-1046cfa72d74 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:39.832389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-55f89c38-e444-4421-b498-1046cfa72d74 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:39.846039 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-55f89c38-e444-4421-b498-1046cfa72d74 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1309 microversion: 2.1 time: 0.844477 Jul 31 01:32:39.846948 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2283/4549] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:39 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1309 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:40.870417 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7990bab8-34d7-4b95-b9c1-22741cb5206e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:40.872600 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7990bab8-34d7-4b95-b9c1-22741cb5206e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:40.896149 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7990bab8-34d7-4b95-b9c1-22741cb5206e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:40.907379 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7990bab8-34d7-4b95-b9c1-22741cb5206e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:40.909336 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7990bab8-34d7-4b95-b9c1-22741cb5206e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:40.910359 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7990bab8-34d7-4b95-b9c1-22741cb5206e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:41.516064 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7990bab8-34d7-4b95-b9c1-22741cb5206e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:41.526785 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7990bab8-34d7-4b95-b9c1-22741cb5206e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1309 microversion: 2.1 time: 0.659395 Jul 31 01:32:41.527415 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2267/4550] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:40 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1309 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:41.942215 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-d83cf2f7-095b-47be-8902-0c71998c4907 req-8ff10742-ee40-47ce-b4cc-8606dd4357d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3bf1681-df1e-4407-a184-d8b7dd992d13", "name": "network-vif-plugged", "status": "completed", "tag": "c9f24716-d0bc-4181-b356-35d65fc62a0f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:32:41.993148 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d83cf2f7-095b-47be-8902-0c71998c4907 req-8ff10742-ee40-47ce-b4cc-8606dd4357d0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:41.998829 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d83cf2f7-095b-47be-8902-0c71998c4907 req-8ff10742-ee40-47ce-b4cc-8606dd4357d0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:42.058755 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-d83cf2f7-095b-47be-8902-0c71998c4907 req-8ff10742-ee40-47ce-b4cc-8606dd4357d0 service nova] Creating event network-vif-plugged:c9f24716-d0bc-4181-b356-35d65fc62a0f for instance b3bf1681-df1e-4407-a184-d8b7dd992d13 on n-h1-master-1 Jul 31 01:32:42.074339 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-d83cf2f7-095b-47be-8902-0c71998c4907 req-8ff10742-ee40-47ce-b4cc-8606dd4357d0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137431 Jul 31 01:32:42.085566 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2284/4551] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:32:42.552019 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6602597f-53b9-49ee-8ff5-e85b957e230e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:42.553431 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6602597f-53b9-49ee-8ff5-e85b957e230e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:42.566050 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6602597f-53b9-49ee-8ff5-e85b957e230e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:42.571909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6602597f-53b9-49ee-8ff5-e85b957e230e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:42.574535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6602597f-53b9-49ee-8ff5-e85b957e230e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:42.588875 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6602597f-53b9-49ee-8ff5-e85b957e230e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:43.065706 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6602597f-53b9-49ee-8ff5-e85b957e230e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:43.085618 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6602597f-53b9-49ee-8ff5-e85b957e230e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1309 microversion: 2.1 time: 0.538301 Jul 31 01:32:43.087672 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2268/4552] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:42 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1309 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:32:44.113227 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1c11db62-ad33-4366-a669-b19989be0fa0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:44.114161 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1c11db62-ad33-4366-a669-b19989be0fa0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:44.141050 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c11db62-ad33-4366-a669-b19989be0fa0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:44.142795 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c11db62-ad33-4366-a669-b19989be0fa0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:44.144364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c11db62-ad33-4366-a669-b19989be0fa0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:44.151623 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c11db62-ad33-4366-a669-b19989be0fa0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:44.486355 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1c11db62-ad33-4366-a669-b19989be0fa0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:44.496971 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1c11db62-ad33-4366-a669-b19989be0fa0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1489 microversion: 2.1 time: 0.391798 Jul 31 01:32:44.498170 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2285/4553] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:44 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1489 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:44.521276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0f9c9005-3a68-406e-ac39-b21d2f5bafd5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:32:44.527327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0f9c9005-3a68-406e-ac39-b21d2f5bafd5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:44.543263 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f9c9005-3a68-406e-ac39-b21d2f5bafd5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:44.546450 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f9c9005-3a68-406e-ac39-b21d2f5bafd5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:44.548498 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f9c9005-3a68-406e-ac39-b21d2f5bafd5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:44.552262 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f9c9005-3a68-406e-ac39-b21d2f5bafd5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:44.708826 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0f9c9005-3a68-406e-ac39-b21d2f5bafd5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "PUT /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1084 microversion: 2.1 time: 0.189253 Jul 31 01:32:44.710322 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2269/4554] 10.222.0.45 () {60 vars in 1256 bytes} [Sun Jul 31 01:32:44 2022] PUT /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1084 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:44.733345 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-35a02e77-44d2-46e7-bfb4-793a5a56e83f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:44.733979 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-35a02e77-44d2-46e7-bfb4-793a5a56e83f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:44.749354 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35a02e77-44d2-46e7-bfb4-793a5a56e83f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:44.749810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35a02e77-44d2-46e7-bfb4-793a5a56e83f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:44.750596 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35a02e77-44d2-46e7-bfb4-793a5a56e83f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:44.751041 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-35a02e77-44d2-46e7-bfb4-793a5a56e83f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:45.098814 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-35a02e77-44d2-46e7-bfb4-793a5a56e83f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:45.112277 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-35a02e77-44d2-46e7-bfb4-793a5a56e83f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1510 microversion: 2.1 time: 0.388522 Jul 31 01:32:45.126912 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2286/4555] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:44 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1510 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:45.133501 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-35c1652c-1e84-4f4b-86e3-64e924bf7083 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:45.134345 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-35c1652c-1e84-4f4b-86e3-64e924bf7083 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:45.148490 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35c1652c-1e84-4f4b-86e3-64e924bf7083 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:45.149980 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35c1652c-1e84-4f4b-86e3-64e924bf7083 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:45.156377 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35c1652c-1e84-4f4b-86e3-64e924bf7083 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:45.156977 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35c1652c-1e84-4f4b-86e3-64e924bf7083 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:45.524640 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-35c1652c-1e84-4f4b-86e3-64e924bf7083 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:45.540135 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-35c1652c-1e84-4f4b-86e3-64e924bf7083 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1510 microversion: 2.1 time: 0.410700 Jul 31 01:32:45.541050 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2270/4556] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:45 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1510 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:45.569664 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5e3718fa-a598-4a7a-9583-bbdbc1ed9a5f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:45.570230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5e3718fa-a598-4a7a-9583-bbdbc1ed9a5f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:45.608127 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e3718fa-a598-4a7a-9583-bbdbc1ed9a5f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:45.613938 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e3718fa-a598-4a7a-9583-bbdbc1ed9a5f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:45.619994 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e3718fa-a598-4a7a-9583-bbdbc1ed9a5f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:45.620480 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e3718fa-a598-4a7a-9583-bbdbc1ed9a5f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:45.727683 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5e3718fa-a598-4a7a-9583-bbdbc1ed9a5f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:32:45.809578 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:46.018609 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5e3718fa-a598-4a7a-9583-bbdbc1ed9a5f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 204 len: 0 microversion: 2.1 time: 0.452983 Jul 31 01:32:46.019302 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2287/4557] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:32:45 2022] DELETE /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:32:46.027385 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3a3a76ad-015d-4416-ad98-7209cc5d542a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:46.029010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3a3a76ad-015d-4416-ad98-7209cc5d542a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:46.043930 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=46 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:46.051481 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a3a76ad-015d-4416-ad98-7209cc5d542a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:46.058039 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a3a76ad-015d-4416-ad98-7209cc5d542a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:46.058904 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a3a76ad-015d-4416-ad98-7209cc5d542a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:46.066989 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a3a76ad-015d-4416-ad98-7209cc5d542a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:46.807759 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3a3a76ad-015d-4416-ad98-7209cc5d542a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:46.825789 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3a3a76ad-015d-4416-ad98-7209cc5d542a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1516 microversion: 2.1 time: 0.802037 Jul 31 01:32:46.832341 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2271/4558] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:46 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1516 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:47.867128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8f82c4b3-1cad-4da7-96f8-9d1393b8c1fe tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:47.872745 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8f82c4b3-1cad-4da7-96f8-9d1393b8c1fe tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:47.904924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f82c4b3-1cad-4da7-96f8-9d1393b8c1fe tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:47.909627 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f82c4b3-1cad-4da7-96f8-9d1393b8c1fe tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:47.914787 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f82c4b3-1cad-4da7-96f8-9d1393b8c1fe tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:47.917362 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f82c4b3-1cad-4da7-96f8-9d1393b8c1fe tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:48.429439 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8f82c4b3-1cad-4da7-96f8-9d1393b8c1fe tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:48.442299 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8f82c4b3-1cad-4da7-96f8-9d1393b8c1fe tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1516 microversion: 2.1 time: 0.578597 Jul 31 01:32:48.446025 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2288/4559] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:47 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1516 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:49.345771 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-d52cbbc3-bdb4-44d0-b219-fe18d9323d2f req-5143ef5a-4fdd-45a6-ae61-af0d35dcbfac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3bf1681-df1e-4407-a184-d8b7dd992d13", "name": "network-vif-deleted", "tag": "c9f24716-d0bc-4181-b356-35d65fc62a0f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:32:49.377574 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d52cbbc3-bdb4-44d0-b219-fe18d9323d2f req-5143ef5a-4fdd-45a6-ae61-af0d35dcbfac service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:49.380460 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d52cbbc3-bdb4-44d0-b219-fe18d9323d2f req-5143ef5a-4fdd-45a6-ae61-af0d35dcbfac service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:49.419898 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:49.465597 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-d52cbbc3-bdb4-44d0-b219-fe18d9323d2f req-5143ef5a-4fdd-45a6-ae61-af0d35dcbfac service nova] Creating event network-vif-deleted:c9f24716-d0bc-4181-b356-35d65fc62a0f for instance b3bf1681-df1e-4407-a184-d8b7dd992d13 on n-h1-master-1 Jul 31 01:32:49.466913 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2c9baf7c-416b-46a6-9b91-8df5d0763e59 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:49.467987 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2c9baf7c-416b-46a6-9b91-8df5d0763e59 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:49.485623 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c9baf7c-416b-46a6-9b91-8df5d0763e59 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:49.489146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c9baf7c-416b-46a6-9b91-8df5d0763e59 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:49.491216 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c9baf7c-416b-46a6-9b91-8df5d0763e59 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:49.493149 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-d52cbbc3-bdb4-44d0-b219-fe18d9323d2f req-5143ef5a-4fdd-45a6-ae61-af0d35dcbfac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152996 Jul 31 01:32:49.495035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c9baf7c-416b-46a6-9b91-8df5d0763e59 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:49.503606 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2272/4560] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:32:49.689947 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2c9baf7c-416b-46a6-9b91-8df5d0763e59 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:49.699635 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2c9baf7c-416b-46a6-9b91-8df5d0763e59 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 200 len: 1315 microversion: 2.1 time: 0.237500 Jul 31 01:32:49.700243 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2289/4561] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:49 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:32:50.727029 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dc1fb312-03a5-47ef-a6a4-82556bd2ea96 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:50.727809 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dc1fb312-03a5-47ef-a6a4-82556bd2ea96 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:50.752843 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dc1fb312-03a5-47ef-a6a4-82556bd2ea96 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:50.756716 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dc1fb312-03a5-47ef-a6a4-82556bd2ea96 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:50.763589 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dc1fb312-03a5-47ef-a6a4-82556bd2ea96 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:50.768662 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dc1fb312-03a5-47ef-a6a4-82556bd2ea96 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:50.804483 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-dc1fb312-03a5-47ef-a6a4-82556bd2ea96 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dc1fb312-03a5-47ef-a6a4-82556bd2ea96 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 HTTP/1.1 Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: exception: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'b3bf1681-df1e-4407-a184-d8b7dd992d13'} Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:50.809771 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:32:50.814915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:32:50.814915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:32:50.814915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:32:50.814915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:32:50.814915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. Jul 31 01:32:50.814915 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:32:50.819249 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dc1fb312-03a5-47ef-a6a4-82556bd2ea96 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:32:50.821227 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dc1fb312-03a5-47ef-a6a4-82556bd2ea96 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 404 len: 111 microversion: 2.1 time: 0.100258 Jul 31 01:32:50.839849 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2273/4562] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:50 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:32:51.060291 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-45a07dac-9f3f-4dba-a22b-4f5a6bd40954 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1144560438", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "ce8b5cb4-aa2f-4dfd-abb4-9273e2a34e90"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:32:51.163670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-45a07dac-9f3f-4dba-a22b-4f5a6bd40954 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] validate_networks() for [('ce8b5cb4-aa2f-4dfd-abb4-9273e2a34e90', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:32:52.251956 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-45a07dac-9f3f-4dba-a22b-4f5a6bd40954 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:32:52.252635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-45a07dac-9f3f-4dba-a22b-4f5a6bd40954 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:32:52.253035 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-45a07dac-9f3f-4dba-a22b-4f5a6bd40954 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:32:52.253690 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-45a07dac-9f3f-4dba-a22b-4f5a6bd40954 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:32:52.254271 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-45a07dac-9f3f-4dba-a22b-4f5a6bd40954 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:32:52.272399 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45a07dac-9f3f-4dba-a22b-4f5a6bd40954 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:52.273410 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45a07dac-9f3f-4dba-a22b-4f5a6bd40954 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:52.277361 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45a07dac-9f3f-4dba-a22b-4f5a6bd40954 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:52.277833 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45a07dac-9f3f-4dba-a22b-4f5a6bd40954 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:52.330718 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-45a07dac-9f3f-4dba-a22b-4f5a6bd40954 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:32:52.341612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-45a07dac-9f3f-4dba-a22b-4f5a6bd40954 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Getting quotas for user 159706f59a12427f9a3c03fa31f712f3 and project 46d0eabc1db24b12b1bb23c1d0c206d0. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:32:52.376627 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-45a07dac-9f3f-4dba-a22b-4f5a6bd40954 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:32:52.379300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-45a07dac-9f3f-4dba-a22b-4f5a6bd40954 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:32:52.497481 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-45a07dac-9f3f-4dba-a22b-4f5a6bd40954 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.439707 Jul 31 01:32:52.510071 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b9bc2ea8-8db4-4531-b6d3-96dff6ec0af0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:52.510648 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2290/4563] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:32:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:32:52.510771 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b9bc2ea8-8db4-4531-b6d3-96dff6ec0af0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:52.721191 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b9bc2ea8-8db4-4531-b6d3-96dff6ec0af0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:52.731951 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b9bc2ea8-8db4-4531-b6d3-96dff6ec0af0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1209 microversion: 2.1 time: 0.225662 Jul 31 01:32:52.734552 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2274/4564] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:52 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1209 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:32:53.760057 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6d4451cf-0cde-4fb6-bd76-f7fe10b3cdf3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:53.760681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6d4451cf-0cde-4fb6-bd76-f7fe10b3cdf3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:53.860006 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6d4451cf-0cde-4fb6-bd76-f7fe10b3cdf3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:53.868441 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6d4451cf-0cde-4fb6-bd76-f7fe10b3cdf3 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1209 microversion: 2.1 time: 0.113983 Jul 31 01:32:53.873539 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2291/4565] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:53 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1209 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:54.893887 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f4bcc0fa-f94b-4212-893a-ad73bc0d1964 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:54.894540 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f4bcc0fa-f94b-4212-893a-ad73bc0d1964 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:54.907410 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4bcc0fa-f94b-4212-893a-ad73bc0d1964 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:54.907875 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4bcc0fa-f94b-4212-893a-ad73bc0d1964 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:54.908806 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4bcc0fa-f94b-4212-893a-ad73bc0d1964 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:54.909292 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4bcc0fa-f94b-4212-893a-ad73bc0d1964 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:55.073687 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f4bcc0fa-f94b-4212-893a-ad73bc0d1964 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:55.084250 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f4bcc0fa-f94b-4212-893a-ad73bc0d1964 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1269 microversion: 2.1 time: 0.191927 Jul 31 01:32:55.086367 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2275/4566] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:54 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1269 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:55.799595 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2daf07d9-dbba-47c7-a40d-feb92e7bec0e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:55.800148 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2daf07d9-dbba-47c7-a40d-feb92e7bec0e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:55.815703 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2daf07d9-dbba-47c7-a40d-feb92e7bec0e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:55.816433 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2daf07d9-dbba-47c7-a40d-feb92e7bec0e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:55.819559 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2daf07d9-dbba-47c7-a40d-feb92e7bec0e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:55.820262 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2daf07d9-dbba-47c7-a40d-feb92e7bec0e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:55.917995 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2daf07d9-dbba-47c7-a40d-feb92e7bec0e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:32:56.110081 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c06a26e-1e78-44d2-aea7-ab508fe2d2af tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:56.111304 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2c06a26e-1e78-44d2-aea7-ab508fe2d2af tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:56.124222 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c06a26e-1e78-44d2-aea7-ab508fe2d2af tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:56.125572 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c06a26e-1e78-44d2-aea7-ab508fe2d2af tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:56.127493 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c06a26e-1e78-44d2-aea7-ab508fe2d2af tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:56.132076 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c06a26e-1e78-44d2-aea7-ab508fe2d2af tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:56.141584 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2daf07d9-dbba-47c7-a40d-feb92e7bec0e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 204 len: 0 microversion: 2.1 time: 0.346030 Jul 31 01:32:56.148594 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2292/4567] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:32:55 2022] DELETE /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:32:56.158165 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7b307489-00b6-48f5-8435-faaa0601396d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:56.164506 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7b307489-00b6-48f5-8435-faaa0601396d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:56.178360 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b307489-00b6-48f5-8435-faaa0601396d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:56.178835 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b307489-00b6-48f5-8435-faaa0601396d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:56.183026 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b307489-00b6-48f5-8435-faaa0601396d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:56.183632 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b307489-00b6-48f5-8435-faaa0601396d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:56.472103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2c06a26e-1e78-44d2-aea7-ab508fe2d2af tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:56.480397 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2c06a26e-1e78-44d2-aea7-ab508fe2d2af tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1267 microversion: 2.1 time: 0.375019 Jul 31 01:32:56.484451 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2276/4568] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:56 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1267 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:32:56.780878 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7b307489-00b6-48f5-8435-faaa0601396d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:56.793709 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7b307489-00b6-48f5-8435-faaa0601396d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1555 microversion: 2.1 time: 0.641547 Jul 31 01:32:56.795168 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2293/4569] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:56 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1555 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:57.509183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e3519102-f0e5-460d-99a5-ffbd2a3163f7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:57.510627 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e3519102-f0e5-460d-99a5-ffbd2a3163f7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:57.525703 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3519102-f0e5-460d-99a5-ffbd2a3163f7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:57.528515 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3519102-f0e5-460d-99a5-ffbd2a3163f7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:57.532791 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3519102-f0e5-460d-99a5-ffbd2a3163f7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:57.534634 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3519102-f0e5-460d-99a5-ffbd2a3163f7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:57.822804 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cf8a7c53-a5c3-4bf0-a8d3-2e498240ff24 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:57.824106 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cf8a7c53-a5c3-4bf0-a8d3-2e498240ff24 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:57.832281 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:57.853313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf8a7c53-a5c3-4bf0-a8d3-2e498240ff24 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:57.853897 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf8a7c53-a5c3-4bf0-a8d3-2e498240ff24 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:57.859516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf8a7c53-a5c3-4bf0-a8d3-2e498240ff24 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:57.860431 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf8a7c53-a5c3-4bf0-a8d3-2e498240ff24 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:58.485283 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e3519102-f0e5-460d-99a5-ffbd2a3163f7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:58.503575 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e3519102-f0e5-460d-99a5-ffbd2a3163f7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1309 microversion: 2.1 time: 0.994365 Jul 31 01:32:58.505335 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2277/4570] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:57 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1309 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:32:58.892212 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cf8a7c53-a5c3-4bf0-a8d3-2e498240ff24 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:32:58.909820 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cf8a7c53-a5c3-4bf0-a8d3-2e498240ff24 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1555 microversion: 2.1 time: 1.092196 Jul 31 01:32:58.923513 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2294/4571] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:57 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1555 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:32:59.607885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-574fe85f-5a1e-42c7-a50a-b017b77c2c19 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:59.609133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-574fe85f-5a1e-42c7-a50a-b017b77c2c19 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:59.638013 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-574fe85f-5a1e-42c7-a50a-b017b77c2c19 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:59.640276 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-574fe85f-5a1e-42c7-a50a-b017b77c2c19 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:59.653792 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-574fe85f-5a1e-42c7-a50a-b017b77c2c19 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:59.655417 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-574fe85f-5a1e-42c7-a50a-b017b77c2c19 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:59.932840 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eab9a1f3-cfd7-4dab-ad14-0ddb66260585 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:32:59.933640 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eab9a1f3-cfd7-4dab-ad14-0ddb66260585 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:32:59.963853 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eab9a1f3-cfd7-4dab-ad14-0ddb66260585 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:59.964496 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eab9a1f3-cfd7-4dab-ad14-0ddb66260585 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:32:59.969540 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eab9a1f3-cfd7-4dab-ad14-0ddb66260585 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:32:59.970263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eab9a1f3-cfd7-4dab-ad14-0ddb66260585 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:00.421441 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-574fe85f-5a1e-42c7-a50a-b017b77c2c19 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:00.433110 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-574fe85f-5a1e-42c7-a50a-b017b77c2c19 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1309 microversion: 2.1 time: 0.865097 Jul 31 01:33:00.437680 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2278/4572] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:59 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1309 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:00.695953 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eab9a1f3-cfd7-4dab-ad14-0ddb66260585 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:00.708215 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eab9a1f3-cfd7-4dab-ad14-0ddb66260585 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1555 microversion: 2.1 time: 0.778366 Jul 31 01:33:00.714399 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2295/4573] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:32:59 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1555 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:01.462858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dc1c00f5-b4ed-4c41-94e1-f81d997799fa tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:01.464161 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dc1c00f5-b4ed-4c41-94e1-f81d997799fa tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:01.493234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc1c00f5-b4ed-4c41-94e1-f81d997799fa tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:01.495062 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc1c00f5-b4ed-4c41-94e1-f81d997799fa tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:01.498132 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc1c00f5-b4ed-4c41-94e1-f81d997799fa tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:01.501246 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc1c00f5-b4ed-4c41-94e1-f81d997799fa tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:01.634236 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-3193c9e9-5eab-4ab6-a00f-52bc17f2bc9d req-c5529927-e73f-4d08-b230-6c14df053f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eebeaca1-9bc6-4c6c-830e-6b54f2998fc3", "name": "network-vif-deleted", "tag": "52c2cbbe-8278-4110-99be-6a65fe0fc744"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:01.661154 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3193c9e9-5eab-4ab6-a00f-52bc17f2bc9d req-c5529927-e73f-4d08-b230-6c14df053f31 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:01.662090 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3193c9e9-5eab-4ab6-a00f-52bc17f2bc9d req-c5529927-e73f-4d08-b230-6c14df053f31 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:01.703367 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-3193c9e9-5eab-4ab6-a00f-52bc17f2bc9d req-c5529927-e73f-4d08-b230-6c14df053f31 service nova] Creating event network-vif-deleted:52c2cbbe-8278-4110-99be-6a65fe0fc744 for instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 on n-h2-master-1 Jul 31 01:33:01.719565 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-3193c9e9-5eab-4ab6-a00f-52bc17f2bc9d req-c5529927-e73f-4d08-b230-6c14df053f31 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.534650 Jul 31 01:33:01.720662 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2279/4574] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:33:01.731963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7dda578a-1a26-445a-9cd9-7f8d830d79b3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:01.741590 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7dda578a-1a26-445a-9cd9-7f8d830d79b3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:01.764320 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7dda578a-1a26-445a-9cd9-7f8d830d79b3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:01.764934 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7dda578a-1a26-445a-9cd9-7f8d830d79b3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:01.768463 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7dda578a-1a26-445a-9cd9-7f8d830d79b3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:01.769510 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7dda578a-1a26-445a-9cd9-7f8d830d79b3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:02.138517 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7dda578a-1a26-445a-9cd9-7f8d830d79b3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:02.159005 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7dda578a-1a26-445a-9cd9-7f8d830d79b3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1346 microversion: 2.1 time: 0.431227 Jul 31 01:33:02.173388 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2280/4575] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:01 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1346 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:02.297262 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:02.505077 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dc1c00f5-b4ed-4c41-94e1-f81d997799fa tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:02.514218 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dc1c00f5-b4ed-4c41-94e1-f81d997799fa tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1309 microversion: 2.1 time: 1.056135 Jul 31 01:33:02.514829 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2296/4576] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:01 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1309 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:02.610131 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-0d5cbbd9-4c78-4221-8a9b-225d6bff2062 req-649709e1-dcdf-447c-8160-a9f0f23965d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbee89c5-e6cf-440d-8d1d-11f326d2c595", "tag": "cc26cf0f-1bd2-4024-ac56-2a88f896bfaa"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:02.653270 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0d5cbbd9-4c78-4221-8a9b-225d6bff2062 req-649709e1-dcdf-447c-8160-a9f0f23965d4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:02.655978 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0d5cbbd9-4c78-4221-8a9b-225d6bff2062 req-649709e1-dcdf-447c-8160-a9f0f23965d4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:02.711643 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-0d5cbbd9-4c78-4221-8a9b-225d6bff2062 req-649709e1-dcdf-447c-8160-a9f0f23965d4 service nova] Creating event network-changed:cc26cf0f-1bd2-4024-ac56-2a88f896bfaa for instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 on n-h1-master-1 Jul 31 01:33:02.730779 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-0d5cbbd9-4c78-4221-8a9b-225d6bff2062 req-649709e1-dcdf-447c-8160-a9f0f23965d4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125880 Jul 31 01:33:02.732452 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2281/4577] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:33:03.188021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d363ca55-310f-4bc1-8331-76fba33d3129 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:03.188647 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d363ca55-310f-4bc1-8331-76fba33d3129 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:03.205583 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d363ca55-310f-4bc1-8331-76fba33d3129 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:03.206054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d363ca55-310f-4bc1-8331-76fba33d3129 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:03.206899 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d363ca55-310f-4bc1-8331-76fba33d3129 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:03.207564 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d363ca55-310f-4bc1-8331-76fba33d3129 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:03.492118 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d363ca55-310f-4bc1-8331-76fba33d3129 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:03.526596 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d363ca55-310f-4bc1-8331-76fba33d3129 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1346 microversion: 2.1 time: 0.342112 Jul 31 01:33:03.537848 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5a749479-1a24-455f-ba64-682133520588 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:03.538662 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5a749479-1a24-455f-ba64-682133520588 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:03.541257 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2297/4578] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:03 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1346 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:03.558887 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:03.584010 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a749479-1a24-455f-ba64-682133520588 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:03.588168 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a749479-1a24-455f-ba64-682133520588 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:03.590037 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a749479-1a24-455f-ba64-682133520588 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:03.596255 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a749479-1a24-455f-ba64-682133520588 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:04.079146 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5a749479-1a24-455f-ba64-682133520588 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:04.090560 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5a749479-1a24-455f-ba64-682133520588 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1309 microversion: 2.1 time: 0.557700 Jul 31 01:33:04.093500 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2282/4579] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:03 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1309 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:04.582702 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-876c5d7f-e6f9-408e-87ce-abc3c993d448 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:04.583942 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-876c5d7f-e6f9-408e-87ce-abc3c993d448 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:04.587286 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:04.606239 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-876c5d7f-e6f9-408e-87ce-abc3c993d448 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:04.607301 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-876c5d7f-e6f9-408e-87ce-abc3c993d448 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:04.609764 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-876c5d7f-e6f9-408e-87ce-abc3c993d448 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:04.611121 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-876c5d7f-e6f9-408e-87ce-abc3c993d448 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:04.943490 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-876c5d7f-e6f9-408e-87ce-abc3c993d448 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:04.992219 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-876c5d7f-e6f9-408e-87ce-abc3c993d448 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1346 microversion: 2.1 time: 0.392593 Jul 31 01:33:04.993965 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2298/4580] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:04 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1346 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:05.112229 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ba6fa71e-8583-4ee3-8363-d6e682ddeee8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:05.113410 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ba6fa71e-8583-4ee3-8363-d6e682ddeee8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:05.139976 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba6fa71e-8583-4ee3-8363-d6e682ddeee8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:05.140691 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba6fa71e-8583-4ee3-8363-d6e682ddeee8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:05.152004 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba6fa71e-8583-4ee3-8363-d6e682ddeee8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:05.152716 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba6fa71e-8583-4ee3-8363-d6e682ddeee8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:05.991092 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ba6fa71e-8583-4ee3-8363-d6e682ddeee8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:06.005954 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ba6fa71e-8583-4ee3-8363-d6e682ddeee8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1309 microversion: 2.1 time: 0.898453 Jul 31 01:33:06.006809 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2283/4581] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:05 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1309 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:06.024914 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f60ae534-8973-42fe-bb2e-46cbbbd8653f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:06.026207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f60ae534-8973-42fe-bb2e-46cbbbd8653f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:06.042311 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f60ae534-8973-42fe-bb2e-46cbbbd8653f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:06.044473 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f60ae534-8973-42fe-bb2e-46cbbbd8653f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:06.047007 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f60ae534-8973-42fe-bb2e-46cbbbd8653f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:06.048016 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f60ae534-8973-42fe-bb2e-46cbbbd8653f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:06.181332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f60ae534-8973-42fe-bb2e-46cbbbd8653f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:06.189448 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f60ae534-8973-42fe-bb2e-46cbbbd8653f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1346 microversion: 2.1 time: 0.168798 Jul 31 01:33:06.199690 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2299/4582] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:06 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1346 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:07.033227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-09208d19-ec9c-41f7-833d-cb75336cc839 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:07.033862 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-09208d19-ec9c-41f7-833d-cb75336cc839 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:07.051591 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-09208d19-ec9c-41f7-833d-cb75336cc839 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:07.054316 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-09208d19-ec9c-41f7-833d-cb75336cc839 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:07.055227 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-09208d19-ec9c-41f7-833d-cb75336cc839 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:07.055702 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-09208d19-ec9c-41f7-833d-cb75336cc839 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:07.211718 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c566b60c-5bf9-4dbf-848c-4e50033a2514 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:07.213422 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c566b60c-5bf9-4dbf-848c-4e50033a2514 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:07.231160 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c566b60c-5bf9-4dbf-848c-4e50033a2514 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:07.234571 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c566b60c-5bf9-4dbf-848c-4e50033a2514 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:07.235469 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c566b60c-5bf9-4dbf-848c-4e50033a2514 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:07.235923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c566b60c-5bf9-4dbf-848c-4e50033a2514 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:07.507671 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c566b60c-5bf9-4dbf-848c-4e50033a2514 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:07.526617 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c566b60c-5bf9-4dbf-848c-4e50033a2514 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1346 microversion: 2.1 time: 0.320235 Jul 31 01:33:07.527249 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2300/4583] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:07 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1346 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:07.631461 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-09208d19-ec9c-41f7-833d-cb75336cc839 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:07.640602 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-09208d19-ec9c-41f7-833d-cb75336cc839 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1309 microversion: 2.1 time: 0.612289 Jul 31 01:33:07.641413 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2284/4584] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:07 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1309 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:08.559207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-21ec8adc-a7f5-4ef7-83f8-6e99e01bd9dc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:08.561141 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-21ec8adc-a7f5-4ef7-83f8-6e99e01bd9dc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:08.600838 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21ec8adc-a7f5-4ef7-83f8-6e99e01bd9dc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:08.602448 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21ec8adc-a7f5-4ef7-83f8-6e99e01bd9dc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:08.603314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21ec8adc-a7f5-4ef7-83f8-6e99e01bd9dc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:08.606700 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21ec8adc-a7f5-4ef7-83f8-6e99e01bd9dc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:08.666720 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b573638c-d98a-40df-9cf5-da270ca7b866 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:08.668016 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b573638c-d98a-40df-9cf5-da270ca7b866 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:08.691312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b573638c-d98a-40df-9cf5-da270ca7b866 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:08.691838 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b573638c-d98a-40df-9cf5-da270ca7b866 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:08.692663 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b573638c-d98a-40df-9cf5-da270ca7b866 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:08.697985 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b573638c-d98a-40df-9cf5-da270ca7b866 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:08.890782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-21ec8adc-a7f5-4ef7-83f8-6e99e01bd9dc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:08.900794 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-21ec8adc-a7f5-4ef7-83f8-6e99e01bd9dc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1346 microversion: 2.1 time: 0.348522 Jul 31 01:33:08.903122 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2301/4585] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:08 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1346 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:09.260980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b573638c-d98a-40df-9cf5-da270ca7b866 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:09.276730 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b573638c-d98a-40df-9cf5-da270ca7b866 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1309 microversion: 2.1 time: 0.616172 Jul 31 01:33:09.278551 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2285/4586] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:08 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1309 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:09.924192 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-39305399-3dca-4d42-805c-0b2a195c9be3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:09.924918 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-39305399-3dca-4d42-805c-0b2a195c9be3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:09.939447 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-39305399-3dca-4d42-805c-0b2a195c9be3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:09.943744 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-39305399-3dca-4d42-805c-0b2a195c9be3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:09.949604 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-39305399-3dca-4d42-805c-0b2a195c9be3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:09.951053 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-39305399-3dca-4d42-805c-0b2a195c9be3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:09.987419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-4f6863a9-2754-4b86-bb52-5612c5f179f9 req-3dea9c69-830a-46ef-8fc8-5fcdcb069be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbee89c5-e6cf-440d-8d1d-11f326d2c595", "name": "network-vif-plugged", "status": "completed", "tag": "cc26cf0f-1bd2-4024-ac56-2a88f896bfaa"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:10.017032 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-4f6863a9-2754-4b86-bb52-5612c5f179f9 req-3dea9c69-830a-46ef-8fc8-5fcdcb069be7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:10.022156 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-4f6863a9-2754-4b86-bb52-5612c5f179f9 req-3dea9c69-830a-46ef-8fc8-5fcdcb069be7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:10.067403 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-4f6863a9-2754-4b86-bb52-5612c5f179f9 req-3dea9c69-830a-46ef-8fc8-5fcdcb069be7 service nova] Creating event network-vif-plugged:cc26cf0f-1bd2-4024-ac56-2a88f896bfaa for instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 on n-h1-master-1 Jul 31 01:33:10.087092 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-4f6863a9-2754-4b86-bb52-5612c5f179f9 req-3dea9c69-830a-46ef-8fc8-5fcdcb069be7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103383 Jul 31 01:33:10.092289 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2286/4587] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:33:10.303746 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3b03f8da-f42d-4eef-9384-aa5467e81988 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:10.305147 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3b03f8da-f42d-4eef-9384-aa5467e81988 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:10.316386 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b03f8da-f42d-4eef-9384-aa5467e81988 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:10.318710 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b03f8da-f42d-4eef-9384-aa5467e81988 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:10.325032 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b03f8da-f42d-4eef-9384-aa5467e81988 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:10.327764 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b03f8da-f42d-4eef-9384-aa5467e81988 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:10.351408 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-39305399-3dca-4d42-805c-0b2a195c9be3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:10.378600 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-39305399-3dca-4d42-805c-0b2a195c9be3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1346 microversion: 2.1 time: 0.454759 Jul 31 01:33:10.381233 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2302/4588] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:09 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1346 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:10.781661 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b03f8da-f42d-4eef-9384-aa5467e81988 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:10.795328 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3b03f8da-f42d-4eef-9384-aa5467e81988 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1309 microversion: 2.1 time: 0.497083 Jul 31 01:33:10.796286 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2287/4589] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:10 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1309 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:33:11.405529 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6b4d21b4-ed74-44a4-ac8f-253720c1509d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:11.406670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6b4d21b4-ed74-44a4-ac8f-253720c1509d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:11.446710 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b4d21b4-ed74-44a4-ac8f-253720c1509d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:11.448192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b4d21b4-ed74-44a4-ac8f-253720c1509d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:11.449756 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b4d21b4-ed74-44a4-ac8f-253720c1509d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:11.450778 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b4d21b4-ed74-44a4-ac8f-253720c1509d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:11.543289 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:11.618795 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b4d21b4-ed74-44a4-ac8f-253720c1509d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:11.635769 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b4d21b4-ed74-44a4-ac8f-253720c1509d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:11.636354 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-6b4d21b4-ed74-44a4-ac8f-253720c1509d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lazy-loading 'fault' on Instance uuid eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:33:11.785443 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6b4d21b4-ed74-44a4-ac8f-253720c1509d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:11.804938 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6b4d21b4-ed74-44a4-ac8f-253720c1509d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 200 len: 1351 microversion: 2.1 time: 0.406298 Jul 31 01:33:11.807433 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2303/4590] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:11 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 1351 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:33:11.832714 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e9c8e826-acc6-4cf3-a19b-3763b8fed7f1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:11.833877 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e9c8e826-acc6-4cf3-a19b-3763b8fed7f1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:11.862801 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e9c8e826-acc6-4cf3-a19b-3763b8fed7f1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:11.864549 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e9c8e826-acc6-4cf3-a19b-3763b8fed7f1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:11.867994 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e9c8e826-acc6-4cf3-a19b-3763b8fed7f1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:11.871519 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e9c8e826-acc6-4cf3-a19b-3763b8fed7f1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:12.268267 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e9c8e826-acc6-4cf3-a19b-3763b8fed7f1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:12.279946 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e9c8e826-acc6-4cf3-a19b-3763b8fed7f1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1490 microversion: 2.1 time: 0.454910 Jul 31 01:33:12.280539 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2288/4591] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:11 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1490 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:12.307897 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-04adb122-f3e0-4e99-bc5f-5962cb104c03 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-569150707"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:12.312037 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-04adb122-f3e0-4e99-bc5f-5962cb104c03 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:12.329225 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04adb122-f3e0-4e99-bc5f-5962cb104c03 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:12.329683 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04adb122-f3e0-4e99-bc5f-5962cb104c03 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:12.330474 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04adb122-f3e0-4e99-bc5f-5962cb104c03 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:12.330914 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04adb122-f3e0-4e99-bc5f-5962cb104c03 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:12.491148 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-04adb122-f3e0-4e99-bc5f-5962cb104c03 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "PUT /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1074 microversion: 2.1 time: 0.186300 Jul 31 01:33:12.492365 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2304/4592] 10.222.0.45 () {60 vars in 1256 bytes} [Sun Jul 31 01:33:12 2022] PUT /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1074 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:12.513639 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63e780a6-b337-441b-aaa0-a153b4000656 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:12.514433 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-63e780a6-b337-441b-aaa0-a153b4000656 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:12.528551 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63e780a6-b337-441b-aaa0-a153b4000656 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:12.528901 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63e780a6-b337-441b-aaa0-a153b4000656 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:12.529900 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63e780a6-b337-441b-aaa0-a153b4000656 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:12.530488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63e780a6-b337-441b-aaa0-a153b4000656 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:12.855177 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-81496f96-b255-41fc-972a-2ad426e2be80 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:12.856549 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-81496f96-b255-41fc-972a-2ad426e2be80 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:12.877949 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81496f96-b255-41fc-972a-2ad426e2be80 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:12.879976 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81496f96-b255-41fc-972a-2ad426e2be80 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:12.883414 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81496f96-b255-41fc-972a-2ad426e2be80 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:12.884146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81496f96-b255-41fc-972a-2ad426e2be80 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:12.918096 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-81496f96-b255-41fc-972a-2ad426e2be80 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-81496f96-b255-41fc-972a-2ad426e2be80 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 HTTP/1.1 Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: exception: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'eebeaca1-9bc6-4c6c-830e-6b54f2998fc3'} Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:12.920767 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:12.927811 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:12.927811 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:12.927811 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:12.927811 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:12.927811 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:12.927811 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:33:12.927811 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:12.927811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-81496f96-b255-41fc-972a-2ad426e2be80 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:12.927811 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-81496f96-b255-41fc-972a-2ad426e2be80 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 404 len: 111 microversion: 2.1 time: 0.072467 Jul 31 01:33:12.927811 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2305/4593] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:12 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:33:13.247211 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c63f9541-4b2a-49af-a5a9-fc87d8762f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:13.250667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c63f9541-4b2a-49af-a5a9-fc87d8762f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:13.266361 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c63f9541-4b2a-49af-a5a9-fc87d8762f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:13.269766 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c63f9541-4b2a-49af-a5a9-fc87d8762f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:13.273281 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c63f9541-4b2a-49af-a5a9-fc87d8762f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:13.273924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c63f9541-4b2a-49af-a5a9-fc87d8762f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:13.279303 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-63e780a6-b337-441b-aaa0-a153b4000656 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:13.294083 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-63e780a6-b337-441b-aaa0-a153b4000656 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1500 microversion: 2.1 time: 0.781951 Jul 31 01:33:13.308072 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2289/4594] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:12 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1500 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:13.320309 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bd4cffb5-5645-4eb9-a7db-f8550f9bfa22 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:13.331448 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bd4cffb5-5645-4eb9-a7db-f8550f9bfa22 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:13.333104 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-c63f9541-4b2a-49af-a5a9-fc87d8762f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c63f9541-4b2a-49af-a5a9-fc87d8762f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3/os-volume_attachments HTTP/1.1 Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: exception: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: action_args: {'server_id': 'eebeaca1-9bc6-4c6c-830e-6b54f2998fc3'} Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:13.334713 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:33:13.340099 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:13.340099 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:13.340099 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:13.340099 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:13.340099 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:13.340099 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:13.340099 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:13.340099 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:13.340099 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:33:13.340099 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:13.340099 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c63f9541-4b2a-49af-a5a9-fc87d8762f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:13.340099 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c63f9541-4b2a-49af-a5a9-fc87d8762f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.097388 Jul 31 01:33:13.347646 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2306/4595] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:33:13 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3/os-volume_attachments => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:33:13.353912 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd4cffb5-5645-4eb9-a7db-f8550f9bfa22 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:13.355639 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd4cffb5-5645-4eb9-a7db-f8550f9bfa22 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:13.356478 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd4cffb5-5645-4eb9-a7db-f8550f9bfa22 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:13.356921 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd4cffb5-5645-4eb9-a7db-f8550f9bfa22 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:13.815428 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bd4cffb5-5645-4eb9-a7db-f8550f9bfa22 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:13.824366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-72fbbbd8-4964-4cfd-9a99-c474af473307 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1714599820", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "1fde53fe-0382-4737-b527-4db7e9bd3777"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:13.827200 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bd4cffb5-5645-4eb9-a7db-f8550f9bfa22 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1500 microversion: 2.1 time: 0.511033 Jul 31 01:33:13.830674 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2290/4596] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:13 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1500 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:13.852692 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8c681da5-e50f-484d-af9d-e280d4e81bf0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:13.872009 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8c681da5-e50f-484d-af9d-e280d4e81bf0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:13.872775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8c681da5-e50f-484d-af9d-e280d4e81bf0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:13.928637 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8c681da5-e50f-484d-af9d-e280d4e81bf0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Going to try to stop instance {{(pid=119474) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 01:33:13.952809 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-72fbbbd8-4964-4cfd-9a99-c474af473307 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] validate_networks() for [('1fde53fe-0382-4737-b527-4db7e9bd3777', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:33:14.032836 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8c681da5-e50f-484d-af9d-e280d4e81bf0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "POST /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595/action" status: 202 len: 0 microversion: 2.1 time: 0.184261 Jul 31 01:33:14.037450 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2291/4597] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:33:13 2022] POST /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:33:14.056652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-577bdbbd-00e4-4578-b4e1-2e499d10f9f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:14.061949 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-577bdbbd-00e4-4578-b4e1-2e499d10f9f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:14.080253 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-577bdbbd-00e4-4578-b4e1-2e499d10f9f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:14.082986 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-577bdbbd-00e4-4578-b4e1-2e499d10f9f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:14.085784 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-577bdbbd-00e4-4578-b4e1-2e499d10f9f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:14.089698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-577bdbbd-00e4-4578-b4e1-2e499d10f9f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:14.108461 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:14.966058 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-577bdbbd-00e4-4578-b4e1-2e499d10f9f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:15.001188 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-577bdbbd-00e4-4578-b4e1-2e499d10f9f5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1510 microversion: 2.1 time: 0.961861 Jul 31 01:33:15.008120 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2292/4598] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:14 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1510 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:15.385680 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-72fbbbd8-4964-4cfd-9a99-c474af473307 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:33:15.386723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-72fbbbd8-4964-4cfd-9a99-c474af473307 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:33:15.387420 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-72fbbbd8-4964-4cfd-9a99-c474af473307 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:33:15.388160 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-72fbbbd8-4964-4cfd-9a99-c474af473307 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:33:15.388774 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-72fbbbd8-4964-4cfd-9a99-c474af473307 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:33:15.399528 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72fbbbd8-4964-4cfd-9a99-c474af473307 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:15.400259 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72fbbbd8-4964-4cfd-9a99-c474af473307 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:15.401290 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72fbbbd8-4964-4cfd-9a99-c474af473307 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:15.401918 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72fbbbd8-4964-4cfd-9a99-c474af473307 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:15.423859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-72fbbbd8-4964-4cfd-9a99-c474af473307 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Getting quotas for project e418a04119b843b4a1c218aa9ff1dbc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:33:15.430994 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-72fbbbd8-4964-4cfd-9a99-c474af473307 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Getting quotas for user 93eccdea3f1447a693cec10d096876a0 and project e418a04119b843b4a1c218aa9ff1dbc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:33:15.458763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-72fbbbd8-4964-4cfd-9a99-c474af473307 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:33:15.461465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-72fbbbd8-4964-4cfd-9a99-c474af473307 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: efec0d84-bc3b-45e4-97d0-988e876028c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:33:15.593367 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-72fbbbd8-4964-4cfd-9a99-c474af473307 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.772387 Jul 31 01:33:15.594438 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2307/4599] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:33:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:33:15.606503 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4243d35f-7386-491a-927c-5a65ea6dc3b3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:15.607964 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4243d35f-7386-491a-927c-5a65ea6dc3b3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: efec0d84-bc3b-45e4-97d0-988e876028c7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:15.785602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4243d35f-7386-491a-927c-5a65ea6dc3b3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:15.794305 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4243d35f-7386-491a-927c-5a65ea6dc3b3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/efec0d84-bc3b-45e4-97d0-988e876028c7" status: 200 len: 1215 microversion: 2.1 time: 0.192608 Jul 31 01:33:15.795110 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2293/4600] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:15 2022] GET /compute/v2.1/servers/efec0d84-bc3b-45e4-97d0-988e876028c7 => generated 1215 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:15.818443 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8334b20e-fdb6-45dc-bcfe-0af49ee8ceb7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:15.819275 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8334b20e-fdb6-45dc-bcfe-0af49ee8ceb7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: efec0d84-bc3b-45e4-97d0-988e876028c7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:15.885018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8334b20e-fdb6-45dc-bcfe-0af49ee8ceb7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: efec0d84-bc3b-45e4-97d0-988e876028c7] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:33:16.029230 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ab5fa0c6-6c16-4374-98ff-533ab60e01b1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:16.029843 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ab5fa0c6-6c16-4374-98ff-533ab60e01b1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:16.071671 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab5fa0c6-6c16-4374-98ff-533ab60e01b1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:16.075590 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab5fa0c6-6c16-4374-98ff-533ab60e01b1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:16.080649 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab5fa0c6-6c16-4374-98ff-533ab60e01b1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:16.081125 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab5fa0c6-6c16-4374-98ff-533ab60e01b1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:16.658683 n-d-master-1 devstack@n-api.service[119475]: INFO nova.compute.api [None req-8334b20e-fdb6-45dc-bcfe-0af49ee8ceb7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: efec0d84-bc3b-45e4-97d0-988e876028c7] Instance Mapping does not exist while attempting local delete cleanup. Jul 31 01:33:16.660631 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8334b20e-fdb6-45dc-bcfe-0af49ee8ceb7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "DELETE /compute/v2.1/servers/efec0d84-bc3b-45e4-97d0-988e876028c7" status: 204 len: 0 microversion: 2.1 time: 0.846165 Jul 31 01:33:16.662240 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2308/4601] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:33:15 2022] DELETE /compute/v2.1/servers/efec0d84-bc3b-45e4-97d0-988e876028c7 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:33:16.667132 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ab5fa0c6-6c16-4374-98ff-533ab60e01b1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:16.677686 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ab5fa0c6-6c16-4374-98ff-533ab60e01b1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1510 microversion: 2.1 time: 0.653062 Jul 31 01:33:16.680625 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2294/4602] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:16 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1510 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:16.705009 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-33bffde4-273b-4f5a-a241-cf497c72827c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:16.705839 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-33bffde4-273b-4f5a-a241-cf497c72827c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: efec0d84-bc3b-45e4-97d0-988e876028c7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:16.726618 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-33bffde4-273b-4f5a-a241-cf497c72827c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-33bffde4-273b-4f5a-a241-cf497c72827c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/efec0d84-bc3b-45e4-97d0-988e876028c7 HTTP/1.1 Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: exception: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'efec0d84-bc3b-45e4-97d0-988e876028c7'} Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:16.733392 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:16.740349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:16.740349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:16.740349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:16.740349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. Jul 31 01:33:16.740349 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:16.740349 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-33bffde4-273b-4f5a-a241-cf497c72827c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:16.745293 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-33bffde4-273b-4f5a-a241-cf497c72827c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/efec0d84-bc3b-45e4-97d0-988e876028c7" status: 404 len: 111 microversion: 2.1 time: 0.075865 Jul 31 01:33:16.748866 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2309/4603] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:16 2022] GET /compute/v2.1/servers/efec0d84-bc3b-45e4-97d0-988e876028c7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:33:16.961681 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-68f10332-a86d-4e5d-8b39-0ac04264305c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2109998822", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "1fde53fe-0382-4737-b527-4db7e9bd3777"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:16.989043 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=52 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:17.064554 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-68f10332-a86d-4e5d-8b39-0ac04264305c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] validate_networks() for [('1fde53fe-0382-4737-b527-4db7e9bd3777', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:33:17.724427 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-79b61ddd-c4e9-4e81-8e6f-a52afa04d903 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:17.726353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-79b61ddd-c4e9-4e81-8e6f-a52afa04d903 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:17.751773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-79b61ddd-c4e9-4e81-8e6f-a52afa04d903 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:17.752255 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-79b61ddd-c4e9-4e81-8e6f-a52afa04d903 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:17.758967 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-79b61ddd-c4e9-4e81-8e6f-a52afa04d903 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:17.764288 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-79b61ddd-c4e9-4e81-8e6f-a52afa04d903 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:18.257831 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-79b61ddd-c4e9-4e81-8e6f-a52afa04d903 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:18.281434 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-79b61ddd-c4e9-4e81-8e6f-a52afa04d903 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1510 microversion: 2.1 time: 0.568688 Jul 31 01:33:18.285881 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2310/4604] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:17 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1510 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:18.727842 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-68f10332-a86d-4e5d-8b39-0ac04264305c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:33:18.727842 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-68f10332-a86d-4e5d-8b39-0ac04264305c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:33:18.727842 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-68f10332-a86d-4e5d-8b39-0ac04264305c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:33:18.727842 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-68f10332-a86d-4e5d-8b39-0ac04264305c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:33:18.727842 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-68f10332-a86d-4e5d-8b39-0ac04264305c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:33:18.736155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68f10332-a86d-4e5d-8b39-0ac04264305c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:18.736637 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68f10332-a86d-4e5d-8b39-0ac04264305c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:18.737480 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68f10332-a86d-4e5d-8b39-0ac04264305c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:18.738495 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68f10332-a86d-4e5d-8b39-0ac04264305c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:18.793128 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-68f10332-a86d-4e5d-8b39-0ac04264305c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Getting quotas for project e418a04119b843b4a1c218aa9ff1dbc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:33:18.806510 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-68f10332-a86d-4e5d-8b39-0ac04264305c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Getting quotas for user 93eccdea3f1447a693cec10d096876a0 and project e418a04119b843b4a1c218aa9ff1dbc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:33:18.842839 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-68f10332-a86d-4e5d-8b39-0ac04264305c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:33:18.849465 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-68f10332-a86d-4e5d-8b39-0ac04264305c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:33:18.966961 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-68f10332-a86d-4e5d-8b39-0ac04264305c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.007853 Jul 31 01:33:18.970700 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2295/4605] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:33:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:33:18.993173 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1e8850dc-d496-4fb3-a230-c30dfe991c25 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:18.995188 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1e8850dc-d496-4fb3-a230-c30dfe991c25 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:19.329663 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1e8850dc-d496-4fb3-a230-c30dfe991c25 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:19.338264 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1e8850dc-d496-4fb3-a230-c30dfe991c25 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1215 microversion: 2.1 time: 0.362191 Jul 31 01:33:19.341536 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2296/4606] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:18 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1215 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:19.359961 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-135a258d-0ca0-4ad0-88af-a8d3e5625d95 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:19.363383 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-135a258d-0ca0-4ad0-88af-a8d3e5625d95 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:19.407151 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-135a258d-0ca0-4ad0-88af-a8d3e5625d95 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:19.410373 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-135a258d-0ca0-4ad0-88af-a8d3e5625d95 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:19.412796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-135a258d-0ca0-4ad0-88af-a8d3e5625d95 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:19.415447 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-135a258d-0ca0-4ad0-88af-a8d3e5625d95 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:19.655420 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-22e71603-41cc-4139-bf5b-afaa4b425c2a tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1305171677", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "70f84fbe-24a0-4d8f-883f-5575257098a3"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:19.759655 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-22e71603-41cc-4139-bf5b-afaa4b425c2a tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] validate_networks() for [('70f84fbe-24a0-4d8f-883f-5575257098a3', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:33:19.829382 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-135a258d-0ca0-4ad0-88af-a8d3e5625d95 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:19.840504 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-135a258d-0ca0-4ad0-88af-a8d3e5625d95 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1510 microversion: 2.1 time: 0.485842 Jul 31 01:33:19.843007 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2297/4607] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:19 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1510 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:20.362150 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-798477ae-7cdd-48ac-8318-445e994c3a1c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:20.362906 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-798477ae-7cdd-48ac-8318-445e994c3a1c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:20.374212 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-798477ae-7cdd-48ac-8318-445e994c3a1c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:20.374673 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-798477ae-7cdd-48ac-8318-445e994c3a1c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:20.375496 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-798477ae-7cdd-48ac-8318-445e994c3a1c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:20.378702 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-798477ae-7cdd-48ac-8318-445e994c3a1c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:20.502532 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-798477ae-7cdd-48ac-8318-445e994c3a1c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:20.514772 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-798477ae-7cdd-48ac-8318-445e994c3a1c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1267 microversion: 2.1 time: 0.156459 Jul 31 01:33:20.517204 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2298/4608] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:20 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:20.876762 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9df2e471-d948-4668-bac2-7d29042df9ae tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:20.883070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9df2e471-d948-4668-bac2-7d29042df9ae tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:20.951647 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9df2e471-d948-4668-bac2-7d29042df9ae tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:20.954057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9df2e471-d948-4668-bac2-7d29042df9ae tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:20.954938 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9df2e471-d948-4668-bac2-7d29042df9ae tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:20.955939 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9df2e471-d948-4668-bac2-7d29042df9ae tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:21.591850 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9df2e471-d948-4668-bac2-7d29042df9ae tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:21.595744 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-22e71603-41cc-4139-bf5b-afaa4b425c2a tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:33:21.596190 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-22e71603-41cc-4139-bf5b-afaa4b425c2a tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:33:21.596698 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-22e71603-41cc-4139-bf5b-afaa4b425c2a tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:33:21.599941 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-22e71603-41cc-4139-bf5b-afaa4b425c2a tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:33:21.600426 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-22e71603-41cc-4139-bf5b-afaa4b425c2a tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:33:21.616716 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9df2e471-d948-4668-bac2-7d29042df9ae tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1510 microversion: 2.1 time: 0.750633 Jul 31 01:33:21.617495 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2299/4609] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:20 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1510 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:21.628901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22e71603-41cc-4139-bf5b-afaa4b425c2a tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:21.631123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5c85fedd-3ed5-4aec-ad4e-862d9048c74a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:21.631918 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22e71603-41cc-4139-bf5b-afaa4b425c2a tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:21.635496 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22e71603-41cc-4139-bf5b-afaa4b425c2a tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:21.636231 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22e71603-41cc-4139-bf5b-afaa4b425c2a tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:21.637178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5c85fedd-3ed5-4aec-ad4e-862d9048c74a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:21.659224 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c85fedd-3ed5-4aec-ad4e-862d9048c74a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:21.662813 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c85fedd-3ed5-4aec-ad4e-862d9048c74a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:21.664144 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c85fedd-3ed5-4aec-ad4e-862d9048c74a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:21.672267 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c85fedd-3ed5-4aec-ad4e-862d9048c74a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:21.716754 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-22e71603-41cc-4139-bf5b-afaa4b425c2a tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Getting quotas for project 18ef9ab24d1842d895fd55c54e75806d. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:33:21.742661 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-22e71603-41cc-4139-bf5b-afaa4b425c2a tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Getting quotas for user d7d4bd75067a46eaae6c6e4049500fa9 and project 18ef9ab24d1842d895fd55c54e75806d. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:33:21.789894 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-22e71603-41cc-4139-bf5b-afaa4b425c2a tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:33:21.792461 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-22e71603-41cc-4139-bf5b-afaa4b425c2a tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:33:21.958060 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-22e71603-41cc-4139-bf5b-afaa4b425c2a tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.347989 Jul 31 01:33:21.968542 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2311/4610] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:33:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 01:33:21.990868 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-85142011-4f6e-4f47-a2b4-ac973a770544 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:21.992128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-85142011-4f6e-4f47-a2b4-ac973a770544 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:22.198385 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5c85fedd-3ed5-4aec-ad4e-862d9048c74a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:22.205553 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5c85fedd-3ed5-4aec-ad4e-862d9048c74a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1273 microversion: 2.1 time: 0.581894 Jul 31 01:33:22.206301 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2300/4611] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:21 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1273 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:22.283372 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-85142011-4f6e-4f47-a2b4-ac973a770544 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:22.296181 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-85142011-4f6e-4f47-a2b4-ac973a770544 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1215 microversion: 2.1 time: 0.323697 Jul 31 01:33:22.296822 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2312/4612] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:21 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1215 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:22.639871 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c4ba96cc-45cb-465a-b8c0-2b65bf758bc5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:22.640495 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c4ba96cc-45cb-465a-b8c0-2b65bf758bc5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:22.654312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4ba96cc-45cb-465a-b8c0-2b65bf758bc5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:22.654812 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4ba96cc-45cb-465a-b8c0-2b65bf758bc5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:22.659932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4ba96cc-45cb-465a-b8c0-2b65bf758bc5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:22.660497 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4ba96cc-45cb-465a-b8c0-2b65bf758bc5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:23.285278 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a1c6d899-a9cc-4125-95f9-31ff3ee4638e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:23.285278 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a1c6d899-a9cc-4125-95f9-31ff3ee4638e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:23.285278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1c6d899-a9cc-4125-95f9-31ff3ee4638e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:23.285278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1c6d899-a9cc-4125-95f9-31ff3ee4638e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:23.285278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1c6d899-a9cc-4125-95f9-31ff3ee4638e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:23.285278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1c6d899-a9cc-4125-95f9-31ff3ee4638e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:23.730791 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c4ba96cc-45cb-465a-b8c0-2b65bf758bc5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:23.745761 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c4ba96cc-45cb-465a-b8c0-2b65bf758bc5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1510 microversion: 2.1 time: 1.111336 Jul 31 01:33:23.760700 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2301/4613] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:22 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1510 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:23.791674 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f034bf85-3bde-465a-a0a2-69ccbce6eb8d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:23.794003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f034bf85-3bde-465a-a0a2-69ccbce6eb8d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:23.820056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f034bf85-3bde-465a-a0a2-69ccbce6eb8d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:23.823051 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f034bf85-3bde-465a-a0a2-69ccbce6eb8d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:23.828010 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f034bf85-3bde-465a-a0a2-69ccbce6eb8d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:23.830498 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f034bf85-3bde-465a-a0a2-69ccbce6eb8d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:24.128888 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a1c6d899-a9cc-4125-95f9-31ff3ee4638e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:24.137218 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a1c6d899-a9cc-4125-95f9-31ff3ee4638e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1315 microversion: 2.1 time: 0.905116 Jul 31 01:33:24.146592 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2313/4614] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:23 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1315 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:24.231328 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f034bf85-3bde-465a-a0a2-69ccbce6eb8d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:24.249402 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f034bf85-3bde-465a-a0a2-69ccbce6eb8d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1275 microversion: 2.1 time: 0.485123 Jul 31 01:33:24.251200 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2302/4615] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:23 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1275 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:24.781821 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5b0374cd-b42e-4a01-b6cd-097b37477094 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:24.782980 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5b0374cd-b42e-4a01-b6cd-097b37477094 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:24.801484 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b0374cd-b42e-4a01-b6cd-097b37477094 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:24.803561 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b0374cd-b42e-4a01-b6cd-097b37477094 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:24.806982 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b0374cd-b42e-4a01-b6cd-097b37477094 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:24.812014 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b0374cd-b42e-4a01-b6cd-097b37477094 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:25.167311 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1c876eea-f23e-4052-94ff-c020e2933081 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:25.168550 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1c876eea-f23e-4052-94ff-c020e2933081 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:25.185567 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c876eea-f23e-4052-94ff-c020e2933081 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:25.187309 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c876eea-f23e-4052-94ff-c020e2933081 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:25.190513 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c876eea-f23e-4052-94ff-c020e2933081 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:25.192549 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c876eea-f23e-4052-94ff-c020e2933081 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:25.514549 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5b0374cd-b42e-4a01-b6cd-097b37477094 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:25.546517 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5b0374cd-b42e-4a01-b6cd-097b37477094 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1510 microversion: 2.1 time: 0.766823 Jul 31 01:33:25.548204 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2314/4616] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:24 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1510 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:25.586801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-52d582a7-ea4f-4718-9476-50b072ee2a1d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:25.588058 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-52d582a7-ea4f-4718-9476-50b072ee2a1d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:25.597855 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52d582a7-ea4f-4718-9476-50b072ee2a1d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:25.598764 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52d582a7-ea4f-4718-9476-50b072ee2a1d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:25.601456 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52d582a7-ea4f-4718-9476-50b072ee2a1d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:25.602117 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52d582a7-ea4f-4718-9476-50b072ee2a1d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:25.728663 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1c876eea-f23e-4052-94ff-c020e2933081 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:25.748386 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1c876eea-f23e-4052-94ff-c020e2933081 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1315 microversion: 2.1 time: 0.585611 Jul 31 01:33:25.748994 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2303/4617] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:25 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:25.809921 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-52d582a7-ea4f-4718-9476-50b072ee2a1d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:25.835868 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-52d582a7-ea4f-4718-9476-50b072ee2a1d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1273 microversion: 2.1 time: 0.284976 Jul 31 01:33:25.837569 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2315/4618] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:25 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1273 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:26.569931 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0efde9bc-5a9c-4269-8766-852b57017feb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:26.570560 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0efde9bc-5a9c-4269-8766-852b57017feb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:26.582438 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-7064c88f-fb05-439c-b533-043e3031aefa req-ccda7214-dc1d-460f-864f-b68a8a3ba4ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9", "tag": "a373e940-c2e2-4cab-a511-53d47fe54056"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:26.586622 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0efde9bc-5a9c-4269-8766-852b57017feb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:26.589850 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0efde9bc-5a9c-4269-8766-852b57017feb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:26.592366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0efde9bc-5a9c-4269-8766-852b57017feb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:26.593187 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0efde9bc-5a9c-4269-8766-852b57017feb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:26.634517 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7064c88f-fb05-439c-b533-043e3031aefa req-ccda7214-dc1d-460f-864f-b68a8a3ba4ee service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:26.635087 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7064c88f-fb05-439c-b533-043e3031aefa req-ccda7214-dc1d-460f-864f-b68a8a3ba4ee service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:26.655981 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-7064c88f-fb05-439c-b533-043e3031aefa req-ccda7214-dc1d-460f-864f-b68a8a3ba4ee service nova] Creating event network-changed:a373e940-c2e2-4cab-a511-53d47fe54056 for instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 on n-h1-master-1 Jul 31 01:33:26.667957 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-7064c88f-fb05-439c-b533-043e3031aefa req-ccda7214-dc1d-460f-864f-b68a8a3ba4ee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086838 Jul 31 01:33:26.668956 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2316/4619] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:33:26.783206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5f72e781-f33b-47ad-b6cb-37ab07edd930 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:26.785713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5f72e781-f33b-47ad-b6cb-37ab07edd930 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:26.801177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5f72e781-f33b-47ad-b6cb-37ab07edd930 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:26.810088 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5f72e781-f33b-47ad-b6cb-37ab07edd930 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:26.810088 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5f72e781-f33b-47ad-b6cb-37ab07edd930 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:26.810088 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5f72e781-f33b-47ad-b6cb-37ab07edd930 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:27.366078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0efde9bc-5a9c-4269-8766-852b57017feb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:27.388661 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5f72e781-f33b-47ad-b6cb-37ab07edd930 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:27.400653 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0efde9bc-5a9c-4269-8766-852b57017feb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1510 microversion: 2.1 time: 0.831795 Jul 31 01:33:27.400950 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2304/4620] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:26 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1510 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:27.402865 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5f72e781-f33b-47ad-b6cb-37ab07edd930 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1315 microversion: 2.1 time: 0.624862 Jul 31 01:33:27.403591 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2317/4621] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:26 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:27.407770 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c4cae9ce-31f8-449a-84b6-a50cfddf1fca tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:27.415038 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c4cae9ce-31f8-449a-84b6-a50cfddf1fca tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:27.457435 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4cae9ce-31f8-449a-84b6-a50cfddf1fca tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:27.457921 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4cae9ce-31f8-449a-84b6-a50cfddf1fca tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:27.458856 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4cae9ce-31f8-449a-84b6-a50cfddf1fca tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:27.462345 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4cae9ce-31f8-449a-84b6-a50cfddf1fca tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:27.700496 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c4cae9ce-31f8-449a-84b6-a50cfddf1fca tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:27.713162 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c4cae9ce-31f8-449a-84b6-a50cfddf1fca tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1273 microversion: 2.1 time: 0.311094 Jul 31 01:33:27.713987 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2305/4622] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:27 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1273 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:28.426279 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8e986813-d47a-4552-a132-539ff3e3a4cb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:28.428385 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8e986813-d47a-4552-a132-539ff3e3a4cb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:28.439226 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c0107902-f9ec-4942-a3d6-7425dec2e1c6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:28.441376 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c0107902-f9ec-4942-a3d6-7425dec2e1c6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:28.462334 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:28.464736 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0107902-f9ec-4942-a3d6-7425dec2e1c6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:28.468956 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0107902-f9ec-4942-a3d6-7425dec2e1c6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:28.471376 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e986813-d47a-4552-a132-539ff3e3a4cb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:28.472117 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e986813-d47a-4552-a132-539ff3e3a4cb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:28.472606 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0107902-f9ec-4942-a3d6-7425dec2e1c6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:28.473285 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0107902-f9ec-4942-a3d6-7425dec2e1c6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:28.474354 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e986813-d47a-4552-a132-539ff3e3a4cb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:28.476454 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e986813-d47a-4552-a132-539ff3e3a4cb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:28.772989 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:28.817868 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c0107902-f9ec-4942-a3d6-7425dec2e1c6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:28.827483 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c0107902-f9ec-4942-a3d6-7425dec2e1c6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1315 microversion: 2.1 time: 0.393110 Jul 31 01:33:28.843150 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2306/4623] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:28 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:28.849939 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8e986813-d47a-4552-a132-539ff3e3a4cb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:28.859279 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8e986813-d47a-4552-a132-539ff3e3a4cb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1510 microversion: 2.1 time: 0.440772 Jul 31 01:33:28.863919 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2318/4624] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:28 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1510 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:28.879301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0dd75e55-6130-4ae1-9c7f-9bc572910212 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:28.885050 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0dd75e55-6130-4ae1-9c7f-9bc572910212 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:28.892658 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0dd75e55-6130-4ae1-9c7f-9bc572910212 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:28.894169 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0dd75e55-6130-4ae1-9c7f-9bc572910212 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:28.895243 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0dd75e55-6130-4ae1-9c7f-9bc572910212 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:28.896197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0dd75e55-6130-4ae1-9c7f-9bc572910212 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:29.337932 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=10 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:29.672683 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0dd75e55-6130-4ae1-9c7f-9bc572910212 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:29.682755 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0dd75e55-6130-4ae1-9c7f-9bc572910212 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1315 microversion: 2.1 time: 0.821014 Jul 31 01:33:29.685931 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2307/4625] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:28 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1315 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:29.851088 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-87030485-8038-4a66-b751-38dc36ab68c2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:29.852511 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-87030485-8038-4a66-b751-38dc36ab68c2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:29.865557 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-87030485-8038-4a66-b751-38dc36ab68c2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:29.867262 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-87030485-8038-4a66-b751-38dc36ab68c2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:29.869545 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-87030485-8038-4a66-b751-38dc36ab68c2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:29.871799 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-87030485-8038-4a66-b751-38dc36ab68c2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:29.897269 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1455fb5f-ce08-491e-bf66-38df2740465a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:29.899909 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1455fb5f-ce08-491e-bf66-38df2740465a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:29.915842 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1455fb5f-ce08-491e-bf66-38df2740465a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:29.916613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1455fb5f-ce08-491e-bf66-38df2740465a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:29.920290 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1455fb5f-ce08-491e-bf66-38df2740465a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:29.920992 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1455fb5f-ce08-491e-bf66-38df2740465a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:31.405649 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-87030485-8038-4a66-b751-38dc36ab68c2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:31.441796 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-87030485-8038-4a66-b751-38dc36ab68c2 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1315 microversion: 2.1 time: 1.594702 Jul 31 01:33:31.444398 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2319/4626] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:29 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1315 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:31.461470 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-fa590c29-477f-48f3-82ee-cecc153bcc03 req-b5468315-c949-408d-8b14-9409d5468e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d01a3e7-7e4e-4d3d-90c1-b2f298179089", "tag": "52247038-e569-476e-bd61-fe552d43d446"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:31.484827 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-fa590c29-477f-48f3-82ee-cecc153bcc03 req-b5468315-c949-408d-8b14-9409d5468e10 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:31.486030 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-fa590c29-477f-48f3-82ee-cecc153bcc03 req-b5468315-c949-408d-8b14-9409d5468e10 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:31.488102 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1455fb5f-ce08-491e-bf66-38df2740465a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:31.497741 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1455fb5f-ce08-491e-bf66-38df2740465a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1510 microversion: 2.1 time: 1.612870 Jul 31 01:33:31.501316 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2308/4627] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:29 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1510 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:33:31.508210 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-be612aae-13ad-4717-ad80-a6919d410698 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:31.511559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-be612aae-13ad-4717-ad80-a6919d410698 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:31.520941 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-fa590c29-477f-48f3-82ee-cecc153bcc03 req-b5468315-c949-408d-8b14-9409d5468e10 service nova] Creating event network-changed:52247038-e569-476e-bd61-fe552d43d446 for instance 5d01a3e7-7e4e-4d3d-90c1-b2f298179089 on n-h2-master-1 Jul 31 01:33:31.528205 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be612aae-13ad-4717-ad80-a6919d410698 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:31.529037 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be612aae-13ad-4717-ad80-a6919d410698 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:31.530082 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be612aae-13ad-4717-ad80-a6919d410698 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:31.530847 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be612aae-13ad-4717-ad80-a6919d410698 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:31.538574 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-fa590c29-477f-48f3-82ee-cecc153bcc03 req-b5468315-c949-408d-8b14-9409d5468e10 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085585 Jul 31 01:33:31.539450 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2320/4628] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:33:31.923685 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-be612aae-13ad-4717-ad80-a6919d410698 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:31.934500 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-be612aae-13ad-4717-ad80-a6919d410698 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1315 microversion: 2.1 time: 0.431130 Jul 31 01:33:31.936373 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2309/4629] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:31 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:32.464908 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dbcd4d35-1c0f-45ef-94d5-e168bdd61113 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:32.472539 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dbcd4d35-1c0f-45ef-94d5-e168bdd61113 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:32.475914 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:32.480416 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=16 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:32.491949 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dbcd4d35-1c0f-45ef-94d5-e168bdd61113 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:32.496385 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dbcd4d35-1c0f-45ef-94d5-e168bdd61113 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:32.499575 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dbcd4d35-1c0f-45ef-94d5-e168bdd61113 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:32.501144 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dbcd4d35-1c0f-45ef-94d5-e168bdd61113 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:32.519318 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-66db8cdf-e159-4caa-b0e3-93009f79be11 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:32.520330 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-66db8cdf-e159-4caa-b0e3-93009f79be11 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:32.535960 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66db8cdf-e159-4caa-b0e3-93009f79be11 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:32.543270 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66db8cdf-e159-4caa-b0e3-93009f79be11 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:32.544291 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66db8cdf-e159-4caa-b0e3-93009f79be11 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:32.544750 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66db8cdf-e159-4caa-b0e3-93009f79be11 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:32.891603 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dbcd4d35-1c0f-45ef-94d5-e168bdd61113 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:32.901396 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dbcd4d35-1c0f-45ef-94d5-e168bdd61113 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1315 microversion: 2.1 time: 0.441429 Jul 31 01:33:32.903292 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2321/4630] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:32 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:32.962163 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e90c9322-ce0e-448e-b477-29f82d870eaa tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:32.963969 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e90c9322-ce0e-448e-b477-29f82d870eaa tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:32.970961 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e90c9322-ce0e-448e-b477-29f82d870eaa tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:32.972648 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e90c9322-ce0e-448e-b477-29f82d870eaa tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:32.973783 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e90c9322-ce0e-448e-b477-29f82d870eaa tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:32.974647 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e90c9322-ce0e-448e-b477-29f82d870eaa tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:33.264522 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-66db8cdf-e159-4caa-b0e3-93009f79be11 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:33.305590 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-66db8cdf-e159-4caa-b0e3-93009f79be11 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1510 microversion: 2.1 time: 0.783083 Jul 31 01:33:33.308273 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2310/4631] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:32 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1510 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:33:33.425035 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e90c9322-ce0e-448e-b477-29f82d870eaa tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:33.437404 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e90c9322-ce0e-448e-b477-29f82d870eaa tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1315 microversion: 2.1 time: 0.479391 Jul 31 01:33:33.442204 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2322/4632] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:32 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:33:33.868899 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-4bd416ac-a07a-4518-990f-3bc18ce76b9c req-67cf4d12-53af-45af-942b-03fa8e37f0fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9", "name": "network-vif-plugged", "status": "completed", "tag": "a373e940-c2e2-4cab-a511-53d47fe54056"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:33.891029 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-4bd416ac-a07a-4518-990f-3bc18ce76b9c req-67cf4d12-53af-45af-942b-03fa8e37f0fb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:33.893166 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-4bd416ac-a07a-4518-990f-3bc18ce76b9c req-67cf4d12-53af-45af-942b-03fa8e37f0fb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:33.920618 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-4bd416ac-a07a-4518-990f-3bc18ce76b9c req-67cf4d12-53af-45af-942b-03fa8e37f0fb service nova] Creating event network-vif-plugged:a373e940-c2e2-4cab-a511-53d47fe54056 for instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 on n-h1-master-1 Jul 31 01:33:33.927862 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a8405991-a387-4c7b-99b8-d84effac21bb tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:33.928542 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a8405991-a387-4c7b-99b8-d84effac21bb tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:33.934147 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-4bd416ac-a07a-4518-990f-3bc18ce76b9c req-67cf4d12-53af-45af-942b-03fa8e37f0fb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068996 Jul 31 01:33:33.937015 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2311/4633] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:33:33.939730 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8405991-a387-4c7b-99b8-d84effac21bb tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:33.944261 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8405991-a387-4c7b-99b8-d84effac21bb tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:33.945334 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8405991-a387-4c7b-99b8-d84effac21bb tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:33.945856 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8405991-a387-4c7b-99b8-d84effac21bb tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:34.331885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-117f8a16-e652-4829-a50e-edf2cdfdf8e0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:34.332603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-117f8a16-e652-4829-a50e-edf2cdfdf8e0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:34.368864 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-117f8a16-e652-4829-a50e-edf2cdfdf8e0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:34.371763 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-117f8a16-e652-4829-a50e-edf2cdfdf8e0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:34.375256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-117f8a16-e652-4829-a50e-edf2cdfdf8e0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:34.375504 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-117f8a16-e652-4829-a50e-edf2cdfdf8e0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:34.384421 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a8405991-a387-4c7b-99b8-d84effac21bb tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:34.403067 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a8405991-a387-4c7b-99b8-d84effac21bb tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1315 microversion: 2.1 time: 0.478940 Jul 31 01:33:34.410246 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2323/4634] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:33 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:34.412737 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:34.465135 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4bdc26de-9e5b-4ae0-a653-df01efcc0fa5 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:34.469178 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4bdc26de-9e5b-4ae0-a653-df01efcc0fa5 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:34.492973 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4bdc26de-9e5b-4ae0-a653-df01efcc0fa5 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:34.495619 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4bdc26de-9e5b-4ae0-a653-df01efcc0fa5 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:34.496918 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4bdc26de-9e5b-4ae0-a653-df01efcc0fa5 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:34.501720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4bdc26de-9e5b-4ae0-a653-df01efcc0fa5 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:34.792208 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4bdc26de-9e5b-4ae0-a653-df01efcc0fa5 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:34.806074 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4bdc26de-9e5b-4ae0-a653-df01efcc0fa5 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1315 microversion: 2.1 time: 0.344908 Jul 31 01:33:34.810821 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2324/4635] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:34 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:34.865828 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-117f8a16-e652-4829-a50e-edf2cdfdf8e0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:34.874482 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-117f8a16-e652-4829-a50e-edf2cdfdf8e0 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1510 microversion: 2.1 time: 0.548138 Jul 31 01:33:34.891908 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2312/4636] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:34 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1510 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:33:35.430875 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-948a373e-abdf-4681-941b-de4ba69fc39a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:35.431673 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-948a373e-abdf-4681-941b-de4ba69fc39a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:35.444592 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-948a373e-abdf-4681-941b-de4ba69fc39a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:35.445049 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-948a373e-abdf-4681-941b-de4ba69fc39a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:35.445838 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-948a373e-abdf-4681-941b-de4ba69fc39a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:35.446273 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-948a373e-abdf-4681-941b-de4ba69fc39a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:35.827915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d29944af-478a-4784-9298-9eb948035e18 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:35.828955 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d29944af-478a-4784-9298-9eb948035e18 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:35.839294 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d29944af-478a-4784-9298-9eb948035e18 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:35.844098 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d29944af-478a-4784-9298-9eb948035e18 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:35.847871 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d29944af-478a-4784-9298-9eb948035e18 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:35.859969 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d29944af-478a-4784-9298-9eb948035e18 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:36.048587 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-948a373e-abdf-4681-941b-de4ba69fc39a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:36.064722 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-948a373e-abdf-4681-941b-de4ba69fc39a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1315 microversion: 2.1 time: 0.633969 Jul 31 01:33:36.066406 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2325/4637] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:35 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:36.111560 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-aceb6dc5-925e-4306-abeb-63cac33cb34a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:36.116158 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-aceb6dc5-925e-4306-abeb-63cac33cb34a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:36.129262 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aceb6dc5-925e-4306-abeb-63cac33cb34a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:36.129730 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aceb6dc5-925e-4306-abeb-63cac33cb34a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:36.147281 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aceb6dc5-925e-4306-abeb-63cac33cb34a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:36.157739 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aceb6dc5-925e-4306-abeb-63cac33cb34a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:36.234627 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:36.386448 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d29944af-478a-4784-9298-9eb948035e18 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:36.395190 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d29944af-478a-4784-9298-9eb948035e18 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1315 microversion: 2.1 time: 0.570973 Jul 31 01:33:36.395822 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2313/4638] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:35 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:36.586469 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-aceb6dc5-925e-4306-abeb-63cac33cb34a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:36.597969 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-aceb6dc5-925e-4306-abeb-63cac33cb34a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1510 microversion: 2.1 time: 0.530089 Jul 31 01:33:36.598862 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2326/4639] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:36 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1510 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:37.088693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1fa6a53e-84ef-4759-9b13-30707fd9fd58 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:37.090397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1fa6a53e-84ef-4759-9b13-30707fd9fd58 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:37.102277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fa6a53e-84ef-4759-9b13-30707fd9fd58 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:37.105632 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fa6a53e-84ef-4759-9b13-30707fd9fd58 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:37.106818 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fa6a53e-84ef-4759-9b13-30707fd9fd58 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:37.107381 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fa6a53e-84ef-4759-9b13-30707fd9fd58 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:37.331091 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1fa6a53e-84ef-4759-9b13-30707fd9fd58 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:37.339165 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1fa6a53e-84ef-4759-9b13-30707fd9fd58 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1503 microversion: 2.1 time: 0.255958 Jul 31 01:33:37.340802 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2314/4640] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:37 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1503 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:37.367565 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b22e53d1-b271-4c06-86a8-5ddd5649579b tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:37.386849 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b22e53d1-b271-4c06-86a8-5ddd5649579b tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:37.421631 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-16540636-1030-4a0f-a0f3-2e5758c0d534 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:37.422257 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-16540636-1030-4a0f-a0f3-2e5758c0d534 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:37.423762 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b22e53d1-b271-4c06-86a8-5ddd5649579b tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:37.427433 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b22e53d1-b271-4c06-86a8-5ddd5649579b tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:37.429638 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b22e53d1-b271-4c06-86a8-5ddd5649579b tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:37.432890 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b22e53d1-b271-4c06-86a8-5ddd5649579b tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:37.436151 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16540636-1030-4a0f-a0f3-2e5758c0d534 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:37.436615 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16540636-1030-4a0f-a0f3-2e5758c0d534 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:37.437408 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16540636-1030-4a0f-a0f3-2e5758c0d534 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:37.444272 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16540636-1030-4a0f-a0f3-2e5758c0d534 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:37.616926 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b22e53d1-b271-4c06-86a8-5ddd5649579b tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "POST /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9/action" status: 202 len: 0 microversion: 2.1 time: 0.253380 Jul 31 01:33:37.618610 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2327/4641] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:33:37 2022] POST /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:33:37.630116 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fe4475b6-c928-4e52-8e95-00e89553f5da tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:37.632990 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fe4475b6-c928-4e52-8e95-00e89553f5da tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:37.665710 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe4475b6-c928-4e52-8e95-00e89553f5da tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:37.666188 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe4475b6-c928-4e52-8e95-00e89553f5da tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:37.666992 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe4475b6-c928-4e52-8e95-00e89553f5da tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:37.667475 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe4475b6-c928-4e52-8e95-00e89553f5da tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:37.729380 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-16540636-1030-4a0f-a0f3-2e5758c0d534 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:37.739898 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-16540636-1030-4a0f-a0f3-2e5758c0d534 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1315 microversion: 2.1 time: 0.323219 Jul 31 01:33:37.740516 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2315/4642] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:37 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:37.762769 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6d92fc61-498f-49d7-aeda-e7a7cab09be1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:37.763719 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6d92fc61-498f-49d7-aeda-e7a7cab09be1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:37.777260 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d92fc61-498f-49d7-aeda-e7a7cab09be1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:37.777719 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d92fc61-498f-49d7-aeda-e7a7cab09be1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:37.778511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d92fc61-498f-49d7-aeda-e7a7cab09be1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:37.779288 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d92fc61-498f-49d7-aeda-e7a7cab09be1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:38.059028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fe4475b6-c928-4e52-8e95-00e89553f5da tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:38.075163 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fe4475b6-c928-4e52-8e95-00e89553f5da tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1508 microversion: 2.1 time: 0.452579 Jul 31 01:33:38.076272 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2328/4643] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:37 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1508 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:38.119902 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6d92fc61-498f-49d7-aeda-e7a7cab09be1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:38.128939 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6d92fc61-498f-49d7-aeda-e7a7cab09be1 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1510 microversion: 2.1 time: 0.386775 Jul 31 01:33:38.132626 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2316/4644] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:37 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:38.527360 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-137c41ca-1e6f-4175-a58d-b312e613e576 req-1390c70f-8683-43d1-9387-3525162fb79d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d01a3e7-7e4e-4d3d-90c1-b2f298179089", "name": "network-vif-plugged", "status": "completed", "tag": "52247038-e569-476e-bd61-fe552d43d446"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:38.558273 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-137c41ca-1e6f-4175-a58d-b312e613e576 req-1390c70f-8683-43d1-9387-3525162fb79d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:38.558964 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-137c41ca-1e6f-4175-a58d-b312e613e576 req-1390c70f-8683-43d1-9387-3525162fb79d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:38.595718 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-137c41ca-1e6f-4175-a58d-b312e613e576 req-1390c70f-8683-43d1-9387-3525162fb79d service nova] Creating event network-vif-plugged:52247038-e569-476e-bd61-fe552d43d446 for instance 5d01a3e7-7e4e-4d3d-90c1-b2f298179089 on n-h2-master-1 Jul 31 01:33:38.604848 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-137c41ca-1e6f-4175-a58d-b312e613e576 req-1390c70f-8683-43d1-9387-3525162fb79d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078632 Jul 31 01:33:38.608024 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2329/4645] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:33:38.769043 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a96f08ce-4177-4487-a184-a67fa1a481de tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:38.770014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a96f08ce-4177-4487-a184-a67fa1a481de tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:38.797837 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a96f08ce-4177-4487-a184-a67fa1a481de tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:38.798378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a96f08ce-4177-4487-a184-a67fa1a481de tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:38.799233 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a96f08ce-4177-4487-a184-a67fa1a481de tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:38.799720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a96f08ce-4177-4487-a184-a67fa1a481de tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:39.089695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a96f08ce-4177-4487-a184-a67fa1a481de tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:39.103541 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cd3f6387-d0cc-4bf2-b4a9-9ebbfd798caf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:39.104850 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cd3f6387-d0cc-4bf2-b4a9-9ebbfd798caf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:39.105079 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a96f08ce-4177-4487-a184-a67fa1a481de tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1315 microversion: 2.1 time: 0.347001 Jul 31 01:33:39.119962 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2317/4646] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:38 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:39.133941 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd3f6387-d0cc-4bf2-b4a9-9ebbfd798caf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:39.134618 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd3f6387-d0cc-4bf2-b4a9-9ebbfd798caf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:39.135871 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd3f6387-d0cc-4bf2-b4a9-9ebbfd798caf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:39.138361 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd3f6387-d0cc-4bf2-b4a9-9ebbfd798caf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:39.155489 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2cf12edf-f6a6-497e-b49c-6e6e02b943a7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:39.156118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2cf12edf-f6a6-497e-b49c-6e6e02b943a7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:39.177985 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cf12edf-f6a6-497e-b49c-6e6e02b943a7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:39.178453 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cf12edf-f6a6-497e-b49c-6e6e02b943a7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:39.184428 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cf12edf-f6a6-497e-b49c-6e6e02b943a7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:39.185388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cf12edf-f6a6-497e-b49c-6e6e02b943a7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:39.525054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cd3f6387-d0cc-4bf2-b4a9-9ebbfd798caf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:39.548472 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cd3f6387-d0cc-4bf2-b4a9-9ebbfd798caf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1488 microversion: 2.1 time: 0.449281 Jul 31 01:33:39.550504 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2330/4647] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:39 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1488 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:33:39.574600 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a6fe8c95-9295-4bd8-873c-27f83aafba0d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:39.575093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a6fe8c95-9295-4bd8-873c-27f83aafba0d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:39.591937 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a6fe8c95-9295-4bd8-873c-27f83aafba0d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:39.592759 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a6fe8c95-9295-4bd8-873c-27f83aafba0d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:39.595253 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a6fe8c95-9295-4bd8-873c-27f83aafba0d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:39.598205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a6fe8c95-9295-4bd8-873c-27f83aafba0d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:39.697551 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2cf12edf-f6a6-497e-b49c-6e6e02b943a7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:39.709708 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a6fe8c95-9295-4bd8-873c-27f83aafba0d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:33:39.721430 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2cf12edf-f6a6-497e-b49c-6e6e02b943a7 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1510 microversion: 2.1 time: 0.569736 Jul 31 01:33:39.724155 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2318/4648] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:39 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1510 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:39.882032 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a6fe8c95-9295-4bd8-873c-27f83aafba0d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 204 len: 0 microversion: 2.1 time: 0.310888 Jul 31 01:33:39.886670 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2331/4649] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:33:39 2022] DELETE /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:33:39.894817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fc9027f3-6e1c-4f59-a3c0-9ac5a97a93e0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:39.896160 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fc9027f3-6e1c-4f59-a3c0-9ac5a97a93e0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:39.904443 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc9027f3-6e1c-4f59-a3c0-9ac5a97a93e0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:39.905192 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc9027f3-6e1c-4f59-a3c0-9ac5a97a93e0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:39.906189 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc9027f3-6e1c-4f59-a3c0-9ac5a97a93e0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:39.906813 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc9027f3-6e1c-4f59-a3c0-9ac5a97a93e0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:40.133403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3f004219-da90-457a-8f9c-c9a0aa89a799 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:40.137920 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3f004219-da90-457a-8f9c-c9a0aa89a799 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:40.170305 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f004219-da90-457a-8f9c-c9a0aa89a799 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:40.171129 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f004219-da90-457a-8f9c-c9a0aa89a799 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:40.172355 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f004219-da90-457a-8f9c-c9a0aa89a799 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:40.176134 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f004219-da90-457a-8f9c-c9a0aa89a799 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:40.196396 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fc9027f3-6e1c-4f59-a3c0-9ac5a97a93e0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:40.207305 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fc9027f3-6e1c-4f59-a3c0-9ac5a97a93e0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1494 microversion: 2.1 time: 0.319063 Jul 31 01:33:40.210226 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2319/4650] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:39 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1494 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:40.576427 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3f004219-da90-457a-8f9c-c9a0aa89a799 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:40.586057 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3f004219-da90-457a-8f9c-c9a0aa89a799 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1502 microversion: 2.1 time: 0.463000 Jul 31 01:33:40.586517 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2332/4651] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:40 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1502 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:40.614356 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-590d0bb7-c076-456e-94a0-0d6812e612f3 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:40.614945 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-590d0bb7-c076-456e-94a0-0d6812e612f3 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:40.622954 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-590d0bb7-c076-456e-94a0-0d6812e612f3 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:40.623445 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-590d0bb7-c076-456e-94a0-0d6812e612f3 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:40.624835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-590d0bb7-c076-456e-94a0-0d6812e612f3 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:40.625552 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-590d0bb7-c076-456e-94a0-0d6812e612f3 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:40.747927 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-65a9e191-44ff-41e2-abe7-fafe02c516f9 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:40.748559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-65a9e191-44ff-41e2-abe7-fafe02c516f9 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:40.758372 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65a9e191-44ff-41e2-abe7-fafe02c516f9 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:40.759177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65a9e191-44ff-41e2-abe7-fafe02c516f9 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:40.760537 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65a9e191-44ff-41e2-abe7-fafe02c516f9 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:40.761241 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65a9e191-44ff-41e2-abe7-fafe02c516f9 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:41.404426 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-590d0bb7-c076-456e-94a0-0d6812e612f3 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:41.420970 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-590d0bb7-c076-456e-94a0-0d6812e612f3 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1502 microversion: 2.1 time: 0.817735 Jul 31 01:33:41.421577 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2320/4652] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:40 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1502 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:41.441560 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a0596d5c-d5ae-4717-9877-4b8deb2a43d3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:41.445648 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a0596d5c-d5ae-4717-9877-4b8deb2a43d3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:41.461275 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0596d5c-d5ae-4717-9877-4b8deb2a43d3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:41.461654 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0596d5c-d5ae-4717-9877-4b8deb2a43d3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:41.462445 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0596d5c-d5ae-4717-9877-4b8deb2a43d3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:41.462884 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0596d5c-d5ae-4717-9877-4b8deb2a43d3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:41.509369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-65a9e191-44ff-41e2-abe7-fafe02c516f9 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:41.525158 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-65a9e191-44ff-41e2-abe7-fafe02c516f9 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1487 microversion: 2.1 time: 0.781576 Jul 31 01:33:41.526436 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2333/4653] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:40 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1487 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:33:41.574927 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-67116a05-9e38-4188-8b3d-f76d5c04aa96 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:41.575508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-67116a05-9e38-4188-8b3d-f76d5c04aa96 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:41.616876 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-67116a05-9e38-4188-8b3d-f76d5c04aa96 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:41.617662 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-67116a05-9e38-4188-8b3d-f76d5c04aa96 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:41.619990 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-67116a05-9e38-4188-8b3d-f76d5c04aa96 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:41.623866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-67116a05-9e38-4188-8b3d-f76d5c04aa96 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:41.710196 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-67116a05-9e38-4188-8b3d-f76d5c04aa96 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lazy-loading 'flavor' on Instance uuid 5d01a3e7-7e4e-4d3d-90c1-b2f298179089 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:33:41.925359 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-67116a05-9e38-4188-8b3d-f76d5c04aa96 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "POST /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089/action" status: 202 len: 0 microversion: 2.1 time: 0.396070 Jul 31 01:33:41.928936 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2334/4654] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:33:41 2022] POST /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:33:41.938681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-039fabe7-0c5d-4f1f-87d5-c97634b30397 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2028498203"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:41.947577 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-039fabe7-0c5d-4f1f-87d5-c97634b30397 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:41.962744 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-039fabe7-0c5d-4f1f-87d5-c97634b30397 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:41.963745 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-039fabe7-0c5d-4f1f-87d5-c97634b30397 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:41.964837 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-039fabe7-0c5d-4f1f-87d5-c97634b30397 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:41.965588 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-039fabe7-0c5d-4f1f-87d5-c97634b30397 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:42.134646 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-039fabe7-0c5d-4f1f-87d5-c97634b30397 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "PUT /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1061 microversion: 2.1 time: 0.206833 Jul 31 01:33:42.138549 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2335/4655] 10.222.0.45 () {60 vars in 1256 bytes} [Sun Jul 31 01:33:41 2022] PUT /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1061 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:42.151646 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-61c02eb4-4c99-48b6-b495-588acb13a171 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:42.155973 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-61c02eb4-4c99-48b6-b495-588acb13a171 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:42.184941 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61c02eb4-4c99-48b6-b495-588acb13a171 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:42.186869 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61c02eb4-4c99-48b6-b495-588acb13a171 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:42.192146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61c02eb4-4c99-48b6-b495-588acb13a171 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:42.196152 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61c02eb4-4c99-48b6-b495-588acb13a171 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:42.568913 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a0596d5c-d5ae-4717-9877-4b8deb2a43d3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:42.589251 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a0596d5c-d5ae-4717-9877-4b8deb2a43d3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1494 microversion: 2.1 time: 1.152119 Jul 31 01:33:42.592543 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2321/4656] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:41 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1494 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:42.610346 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b25e9dbb-9c4b-4197-be55-4612e700d3ed tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:42.636160 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b25e9dbb-9c4b-4197-be55-4612e700d3ed tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:42.665146 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b25e9dbb-9c4b-4197-be55-4612e700d3ed tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:42.665839 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b25e9dbb-9c4b-4197-be55-4612e700d3ed tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:42.666805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b25e9dbb-9c4b-4197-be55-4612e700d3ed tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:42.667447 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b25e9dbb-9c4b-4197-be55-4612e700d3ed tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:43.094110 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b25e9dbb-9c4b-4197-be55-4612e700d3ed tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:43.105319 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b25e9dbb-9c4b-4197-be55-4612e700d3ed tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1488 microversion: 2.1 time: 0.499017 Jul 31 01:33:43.106173 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2322/4657] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:42 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1488 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:43.126096 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-35c0ad03-3247-458b-81ab-c24c1be1436f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:43.126979 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-35c0ad03-3247-458b-81ab-c24c1be1436f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:43.135570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35c0ad03-3247-458b-81ab-c24c1be1436f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:43.136261 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35c0ad03-3247-458b-81ab-c24c1be1436f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:43.137578 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35c0ad03-3247-458b-81ab-c24c1be1436f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:43.138186 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35c0ad03-3247-458b-81ab-c24c1be1436f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:43.153936 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-61c02eb4-4c99-48b6-b495-588acb13a171 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:43.166329 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-61c02eb4-4c99-48b6-b495-588acb13a171 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1510 microversion: 2.1 time: 1.026262 Jul 31 01:33:43.170387 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2336/4658] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:42 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1510 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:43.616310 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e30e8e71-97cd-4e11-b7c4-07a24e8a3c14 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:43.618030 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e30e8e71-97cd-4e11-b7c4-07a24e8a3c14 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:43.637981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e30e8e71-97cd-4e11-b7c4-07a24e8a3c14 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:43.642081 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e30e8e71-97cd-4e11-b7c4-07a24e8a3c14 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:43.644235 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e30e8e71-97cd-4e11-b7c4-07a24e8a3c14 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:43.647296 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e30e8e71-97cd-4e11-b7c4-07a24e8a3c14 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:44.230147 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e30e8e71-97cd-4e11-b7c4-07a24e8a3c14 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:44.238576 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e30e8e71-97cd-4e11-b7c4-07a24e8a3c14 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1494 microversion: 2.1 time: 0.629832 Jul 31 01:33:44.240042 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2337/4659] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:43 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1494 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:44.255329 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2469a27c-a170-4f6d-93f4-baf55f927ee8 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:44.257506 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2469a27c-a170-4f6d-93f4-baf55f927ee8 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:44.269075 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2469a27c-a170-4f6d-93f4-baf55f927ee8 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:44.275440 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2469a27c-a170-4f6d-93f4-baf55f927ee8 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:44.277823 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2469a27c-a170-4f6d-93f4-baf55f927ee8 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:44.280836 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2469a27c-a170-4f6d-93f4-baf55f927ee8 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:44.322463 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:44.387911 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-35c0ad03-3247-458b-81ab-c24c1be1436f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:44.399298 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-35c0ad03-3247-458b-81ab-c24c1be1436f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1488 microversion: 2.1 time: 1.274473 Jul 31 01:33:44.419190 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2323/4660] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:43 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1488 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:33:44.429418 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-571e8648-cfb2-45b1-b06c-369a0edd5f6d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:44.429966 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-571e8648-cfb2-45b1-b06c-369a0edd5f6d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:44.443112 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-571e8648-cfb2-45b1-b06c-369a0edd5f6d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:44.446407 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-571e8648-cfb2-45b1-b06c-369a0edd5f6d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:44.447430 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-571e8648-cfb2-45b1-b06c-369a0edd5f6d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:44.447853 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-571e8648-cfb2-45b1-b06c-369a0edd5f6d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:44.519673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-571e8648-cfb2-45b1-b06c-369a0edd5f6d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:33:44.678822 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-571e8648-cfb2-45b1-b06c-369a0edd5f6d tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 204 len: 0 microversion: 2.1 time: 0.258079 Jul 31 01:33:44.680404 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2324/4661] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:33:44 2022] DELETE /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:33:44.687654 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-25dac0d2-2d5c-4b48-a295-040e91ab9f44 req-7eac8d65-a1b6-4cce-a024-96a123fa3f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9", "name": "network-vif-deleted", "tag": "a373e940-c2e2-4cab-a511-53d47fe54056"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:44.704057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-25dac0d2-2d5c-4b48-a295-040e91ab9f44 req-7eac8d65-a1b6-4cce-a024-96a123fa3f60 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:44.705223 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-25dac0d2-2d5c-4b48-a295-040e91ab9f44 req-7eac8d65-a1b6-4cce-a024-96a123fa3f60 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:44.992877 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2469a27c-a170-4f6d-93f4-baf55f927ee8 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:45.002607 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2469a27c-a170-4f6d-93f4-baf55f927ee8 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1493 microversion: 2.1 time: 0.760683 Jul 31 01:33:45.004348 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2338/4662] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:44 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1493 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:45.026150 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ac3f18bf-12bf-4eb7-b3e6-a92d39402f9f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:45.027100 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ac3f18bf-12bf-4eb7-b3e6-a92d39402f9f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:45.042782 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac3f18bf-12bf-4eb7-b3e6-a92d39402f9f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:45.043363 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac3f18bf-12bf-4eb7-b3e6-a92d39402f9f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:45.049427 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac3f18bf-12bf-4eb7-b3e6-a92d39402f9f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:45.051009 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac3f18bf-12bf-4eb7-b3e6-a92d39402f9f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:45.419550 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-25dac0d2-2d5c-4b48-a295-040e91ab9f44 req-7eac8d65-a1b6-4cce-a024-96a123fa3f60 service nova] Creating event network-vif-deleted:a373e940-c2e2-4cab-a511-53d47fe54056 for instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 on n-h1-master-1 Jul 31 01:33:45.427876 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-25dac0d2-2d5c-4b48-a295-040e91ab9f44 req-7eac8d65-a1b6-4cce-a024-96a123fa3f60 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.744714 Jul 31 01:33:45.428745 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2325/4663] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:33:45.437059 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7f2ff258-9996-4816-8364-55c773c9a049 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:45.438126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7f2ff258-9996-4816-8364-55c773c9a049 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:45.448715 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f2ff258-9996-4816-8364-55c773c9a049 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:45.449529 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f2ff258-9996-4816-8364-55c773c9a049 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:45.450474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f2ff258-9996-4816-8364-55c773c9a049 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:45.451074 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f2ff258-9996-4816-8364-55c773c9a049 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:45.543704 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ac3f18bf-12bf-4eb7-b3e6-a92d39402f9f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:45.555515 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ac3f18bf-12bf-4eb7-b3e6-a92d39402f9f tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1494 microversion: 2.1 time: 0.543082 Jul 31 01:33:45.558275 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2339/4664] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:45 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1494 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:45.563411 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7a922ae1-eebb-4ae6-a119-4d8b022925b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:45.564033 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7a922ae1-eebb-4ae6-a119-4d8b022925b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:45.583139 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a922ae1-eebb-4ae6-a119-4d8b022925b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:45.587290 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a922ae1-eebb-4ae6-a119-4d8b022925b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:45.591310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a922ae1-eebb-4ae6-a119-4d8b022925b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:45.592201 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a922ae1-eebb-4ae6-a119-4d8b022925b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:45.631229 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:45.669831 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a922ae1-eebb-4ae6-a119-4d8b022925b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:45.676241 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a922ae1-eebb-4ae6-a119-4d8b022925b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:45.676778 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7f2ff258-9996-4816-8364-55c773c9a049 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "POST /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089/action" status: 202 len: 0 microversion: 2.1 time: 0.246301 Jul 31 01:33:45.677002 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-7a922ae1-eebb-4ae6-a119-4d8b022925b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lazy-loading 'fault' on Instance uuid 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:33:45.689230 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2326/4665] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:33:45 2022] POST /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:33:45.701673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e530cc67-b197-4ac1-8ccf-3f53625e775d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:45.703005 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e530cc67-b197-4ac1-8ccf-3f53625e775d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:45.713773 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e530cc67-b197-4ac1-8ccf-3f53625e775d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:45.714821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e530cc67-b197-4ac1-8ccf-3f53625e775d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:45.715887 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e530cc67-b197-4ac1-8ccf-3f53625e775d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:45.716682 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e530cc67-b197-4ac1-8ccf-3f53625e775d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:45.761301 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7a922ae1-eebb-4ae6-a119-4d8b022925b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:45.769908 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7a922ae1-eebb-4ae6-a119-4d8b022925b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 200 len: 1305 microversion: 2.1 time: 0.210248 Jul 31 01:33:45.770509 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2340/4666] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:45 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 1305 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:46.564464 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e530cc67-b197-4ac1-8ccf-3f53625e775d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:46.581973 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-95aac43f-c76e-4d05-904c-cad4de1a3afb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:46.583404 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-95aac43f-c76e-4d05-904c-cad4de1a3afb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:46.587973 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e530cc67-b197-4ac1-8ccf-3f53625e775d tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1499 microversion: 2.1 time: 0.897243 Jul 31 01:33:46.596023 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2327/4667] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:45 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1499 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:46.598896 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95aac43f-c76e-4d05-904c-cad4de1a3afb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:46.616175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95aac43f-c76e-4d05-904c-cad4de1a3afb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:46.617562 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95aac43f-c76e-4d05-904c-cad4de1a3afb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:46.618249 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95aac43f-c76e-4d05-904c-cad4de1a3afb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:46.791257 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6870d1ac-8d6e-4105-b1a8-db8b9560a516 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:46.792551 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6870d1ac-8d6e-4105-b1a8-db8b9560a516 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:46.806203 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6870d1ac-8d6e-4105-b1a8-db8b9560a516 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:46.816096 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6870d1ac-8d6e-4105-b1a8-db8b9560a516 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:46.818430 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6870d1ac-8d6e-4105-b1a8-db8b9560a516 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:46.822495 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6870d1ac-8d6e-4105-b1a8-db8b9560a516 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:46.864446 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-6870d1ac-8d6e-4105-b1a8-db8b9560a516 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6870d1ac-8d6e-4105-b1a8-db8b9560a516 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 HTTP/1.1 Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9'} Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:46.868240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:46.873995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:46.873995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:46.873995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:46.873995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:46.873995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:46.873995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. Jul 31 01:33:46.873995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:46.878582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6870d1ac-8d6e-4105-b1a8-db8b9560a516 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:46.883821 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6870d1ac-8d6e-4105-b1a8-db8b9560a516 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 404 len: 111 microversion: 2.1 time: 0.096273 Jul 31 01:33:46.890872 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2328/4668] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:46 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:33:47.092415 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a1c363bd-3cf2-4041-a83b-63c8204d2377 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1443282114", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "1fde53fe-0382-4737-b527-4db7e9bd3777"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:47.114645 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:47.210083 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-a1c363bd-3cf2-4041-a83b-63c8204d2377 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] validate_networks() for [('1fde53fe-0382-4737-b527-4db7e9bd3777', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:33:47.663197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-95aac43f-c76e-4d05-904c-cad4de1a3afb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:47.673286 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-95aac43f-c76e-4d05-904c-cad4de1a3afb tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1452 microversion: 2.1 time: 1.096340 Jul 31 01:33:47.677000 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2341/4669] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:46 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1452 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:33:47.695365 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-73fa9959-e219-491c-9481-8cb4a2390bdb tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:47.696219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-73fa9959-e219-491c-9481-8cb4a2390bdb tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:47.713436 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73fa9959-e219-491c-9481-8cb4a2390bdb tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:47.716609 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73fa9959-e219-491c-9481-8cb4a2390bdb tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:47.719609 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73fa9959-e219-491c-9481-8cb4a2390bdb tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:47.721803 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73fa9959-e219-491c-9481-8cb4a2390bdb tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:48.436925 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-73fa9959-e219-491c-9481-8cb4a2390bdb tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:48.466374 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-73fa9959-e219-491c-9481-8cb4a2390bdb tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1499 microversion: 2.1 time: 0.787802 Jul 31 01:33:48.497848 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2342/4670] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:47 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1499 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:48.529666 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2171c733-ea2f-4092-82cc-eeb504d026ec req-1e0e11d2-ecdb-4edf-9b5e-b2f966a77a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbee89c5-e6cf-440d-8d1d-11f326d2c595", "name": "network-vif-deleted", "tag": "cc26cf0f-1bd2-4024-ac56-2a88f896bfaa"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:48.579019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2171c733-ea2f-4092-82cc-eeb504d026ec req-1e0e11d2-ecdb-4edf-9b5e-b2f966a77a64 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:48.580345 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2171c733-ea2f-4092-82cc-eeb504d026ec req-1e0e11d2-ecdb-4edf-9b5e-b2f966a77a64 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:48.608177 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2171c733-ea2f-4092-82cc-eeb504d026ec req-1e0e11d2-ecdb-4edf-9b5e-b2f966a77a64 service nova] Creating event network-vif-deleted:cc26cf0f-1bd2-4024-ac56-2a88f896bfaa for instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 on n-h1-master-1 Jul 31 01:33:48.622384 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2171c733-ea2f-4092-82cc-eeb504d026ec req-1e0e11d2-ecdb-4edf-9b5e-b2f966a77a64 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122780 Jul 31 01:33:48.625523 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2343/4671] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:33:48.698547 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-af105bbf-738b-4e5b-8657-75f8cb0b41a5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:48.699258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-af105bbf-738b-4e5b-8657-75f8cb0b41a5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:48.712227 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af105bbf-738b-4e5b-8657-75f8cb0b41a5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:48.712698 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af105bbf-738b-4e5b-8657-75f8cb0b41a5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:48.713497 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af105bbf-738b-4e5b-8657-75f8cb0b41a5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:48.715581 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af105bbf-738b-4e5b-8657-75f8cb0b41a5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:48.722082 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a1c363bd-3cf2-4041-a83b-63c8204d2377 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:33:48.723126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a1c363bd-3cf2-4041-a83b-63c8204d2377 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:33:48.723642 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a1c363bd-3cf2-4041-a83b-63c8204d2377 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:33:48.724071 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a1c363bd-3cf2-4041-a83b-63c8204d2377 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:33:48.724753 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a1c363bd-3cf2-4041-a83b-63c8204d2377 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:33:48.744460 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1c363bd-3cf2-4041-a83b-63c8204d2377 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:48.745200 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1c363bd-3cf2-4041-a83b-63c8204d2377 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:48.746231 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1c363bd-3cf2-4041-a83b-63c8204d2377 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:48.746857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1c363bd-3cf2-4041-a83b-63c8204d2377 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:48.794227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-a1c363bd-3cf2-4041-a83b-63c8204d2377 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Getting quotas for project e418a04119b843b4a1c218aa9ff1dbc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:33:48.807672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-a1c363bd-3cf2-4041-a83b-63c8204d2377 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Getting quotas for user 93eccdea3f1447a693cec10d096876a0 and project e418a04119b843b4a1c218aa9ff1dbc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:33:48.823088 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af105bbf-738b-4e5b-8657-75f8cb0b41a5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:48.823667 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-af105bbf-738b-4e5b-8657-75f8cb0b41a5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:48.824965 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-af105bbf-738b-4e5b-8657-75f8cb0b41a5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lazy-loading 'fault' on Instance uuid fbee89c5-e6cf-440d-8d1d-11f326d2c595 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:33:48.844576 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a1c363bd-3cf2-4041-a83b-63c8204d2377 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:33:48.856722 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a1c363bd-3cf2-4041-a83b-63c8204d2377 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:33:48.942260 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-af105bbf-738b-4e5b-8657-75f8cb0b41a5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:48.951538 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-af105bbf-738b-4e5b-8657-75f8cb0b41a5 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 200 len: 1310 microversion: 2.1 time: 0.257077 Jul 31 01:33:48.957446 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2344/4672] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:48 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 1310 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:48.985609 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a1c363bd-3cf2-4041-a83b-63c8204d2377 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.896398 Jul 31 01:33:48.986857 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2329/4673] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:33:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:33:48.997590 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-19de5e57-1822-498c-81b6-232c90bdebaa tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:48.998722 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-19de5e57-1822-498c-81b6-232c90bdebaa tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:49.103522 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-19de5e57-1822-498c-81b6-232c90bdebaa tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:49.121584 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-19de5e57-1822-498c-81b6-232c90bdebaa tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1215 microversion: 2.1 time: 0.127812 Jul 31 01:33:49.122716 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2345/4674] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:48 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1215 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:49.493800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-da9a087f-4a79-4f8b-a79b-71101b050614 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:49.494375 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-da9a087f-4a79-4f8b-a79b-71101b050614 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:49.509364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da9a087f-4a79-4f8b-a79b-71101b050614 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:49.510137 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da9a087f-4a79-4f8b-a79b-71101b050614 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:49.513211 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da9a087f-4a79-4f8b-a79b-71101b050614 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:49.513903 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da9a087f-4a79-4f8b-a79b-71101b050614 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:49.977064 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8aef8712-386f-4f99-a6c0-61b2f5a8b5e6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:49.977738 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8aef8712-386f-4f99-a6c0-61b2f5a8b5e6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:49.997264 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8aef8712-386f-4f99-a6c0-61b2f5a8b5e6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:49.997727 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8aef8712-386f-4f99-a6c0-61b2f5a8b5e6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:49.998533 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8aef8712-386f-4f99-a6c0-61b2f5a8b5e6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:49.998984 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8aef8712-386f-4f99-a6c0-61b2f5a8b5e6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.031737 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-da9a087f-4a79-4f8b-a79b-71101b050614 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:50.041590 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-da9a087f-4a79-4f8b-a79b-71101b050614 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1502 microversion: 2.1 time: 0.552214 Jul 31 01:33:50.053762 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2330/4675] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:49 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1502 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:50.075971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c4f965ab-ebe7-4acd-a854-cb33efa2b257 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:50.079897 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-8aef8712-386f-4f99-a6c0-61b2f5a8b5e6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. Jul 31 01:33:50.085132 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c4f965ab-ebe7-4acd-a854-cb33efa2b257 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8aef8712-386f-4f99-a6c0-61b2f5a8b5e6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 HTTP/1.1 Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: exception: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'fbee89c5-e6cf-440d-8d1d-11f326d2c595'} Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.091849 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.097617 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.097617 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.097617 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:50.097617 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:50.097617 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. Jul 31 01:33:50.097617 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.097617 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8aef8712-386f-4f99-a6c0-61b2f5a8b5e6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:50.097617 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8aef8712-386f-4f99-a6c0-61b2f5a8b5e6 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 404 len: 111 microversion: 2.1 time: 0.120265 Jul 31 01:33:50.097617 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2346/4676] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:49 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:33:50.103692 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4f965ab-ebe7-4acd-a854-cb33efa2b257 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.104173 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4f965ab-ebe7-4acd-a854-cb33efa2b257 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.114650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c5ae5473-a21f-4e02-936d-b856ad5d5051 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:50.115681 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4f965ab-ebe7-4acd-a854-cb33efa2b257 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.116479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4f965ab-ebe7-4acd-a854-cb33efa2b257 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.124085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c5ae5473-a21f-4e02-936d-b856ad5d5051 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:50.142638 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5ae5473-a21f-4e02-936d-b856ad5d5051 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.143457 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5ae5473-a21f-4e02-936d-b856ad5d5051 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.144490 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5ae5473-a21f-4e02-936d-b856ad5d5051 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.145120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5ae5473-a21f-4e02-936d-b856ad5d5051 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.173145 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-c5ae5473-a21f-4e02-936d-b856ad5d5051 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. Jul 31 01:33:50.173918 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-c4f965ab-ebe7-4acd-a854-cb33efa2b257 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lazy-loading 'flavor' on Instance uuid 5d01a3e7-7e4e-4d3d-90c1-b2f298179089 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c5ae5473-a21f-4e02-936d-b856ad5d5051 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 HTTP/1.1 Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: exception: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'fbee89c5-e6cf-440d-8d1d-11f326d2c595'} Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:50.181988 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. Jul 31 01:33:50.188270 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.188270 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.188270 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.188270 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.188270 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.188270 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.188270 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:50.188270 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:50.188270 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. Jul 31 01:33:50.188270 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.193181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c5ae5473-a21f-4e02-936d-b856ad5d5051 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:50.194212 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c5ae5473-a21f-4e02-936d-b856ad5d5051 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 404 len: 111 microversion: 2.1 time: 0.086800 Jul 31 01:33:50.194903 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2347/4677] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:33:50 2022] DELETE /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:33:50.205721 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ca9e7408-c373-43bd-b7fa-bd23625af758 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:50.208727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ca9e7408-c373-43bd-b7fa-bd23625af758 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:50.222141 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca9e7408-c373-43bd-b7fa-bd23625af758 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.225371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca9e7408-c373-43bd-b7fa-bd23625af758 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.227082 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca9e7408-c373-43bd-b7fa-bd23625af758 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.227834 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca9e7408-c373-43bd-b7fa-bd23625af758 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.343016 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c4f965ab-ebe7-4acd-a854-cb33efa2b257 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "POST /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089/action" status: 202 len: 0 microversion: 2.1 time: 0.272882 Jul 31 01:33:50.347809 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2331/4678] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:33:50 2022] POST /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:33:50.353900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3ff7f0a7-a386-413e-a3ab-306fd64d4b4c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:50.355036 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3ff7f0a7-a386-413e-a3ab-306fd64d4b4c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: fbee89c5-e6cf-440d-8d1d-11f326d2c595] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:50.363010 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ff7f0a7-a386-413e-a3ab-306fd64d4b4c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.363878 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ff7f0a7-a386-413e-a3ab-306fd64d4b4c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.364919 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ff7f0a7-a386-413e-a3ab-306fd64d4b4c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.365608 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ff7f0a7-a386-413e-a3ab-306fd64d4b4c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.383074 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-3ff7f0a7-a386-413e-a3ab-306fd64d4b4c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3ff7f0a7-a386-413e-a3ab-306fd64d4b4c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 HTTP/1.1 Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: exception: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'fbee89c5-e6cf-440d-8d1d-11f326d2c595'} Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.385083 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.389683 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.389683 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.389683 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:50.389683 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:50.389683 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. Jul 31 01:33:50.389683 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.392770 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3ff7f0a7-a386-413e-a3ab-306fd64d4b4c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance fbee89c5-e6cf-440d-8d1d-11f326d2c595 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:50.394469 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3ff7f0a7-a386-413e-a3ab-306fd64d4b4c tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595" status: 404 len: 111 microversion: 2.1 time: 0.044989 Jul 31 01:33:50.395290 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2332/4679] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:50 2022] GET /compute/v2.1/servers/fbee89c5-e6cf-440d-8d1d-11f326d2c595 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:33:50.400974 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d475efae-0a91-43fb-ac84-24b10c79adae tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:50.401912 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d475efae-0a91-43fb-ac84-24b10c79adae tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:50.408465 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d475efae-0a91-43fb-ac84-24b10c79adae tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.409826 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d475efae-0a91-43fb-ac84-24b10c79adae tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.411010 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d475efae-0a91-43fb-ac84-24b10c79adae tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.411785 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d475efae-0a91-43fb-ac84-24b10c79adae tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.427230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ca9e7408-c373-43bd-b7fa-bd23625af758 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:50.441105 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ca9e7408-c373-43bd-b7fa-bd23625af758 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1219 microversion: 2.1 time: 0.244580 Jul 31 01:33:50.446041 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2348/4680] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:50 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1219 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:50.457400 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc13d0d3-21d8-4986-97d0-cffec2c40670 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:50.458414 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc13d0d3-21d8-4986-97d0-cffec2c40670 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:50.474502 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc13d0d3-21d8-4986-97d0-cffec2c40670 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.475773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc13d0d3-21d8-4986-97d0-cffec2c40670 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.478983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc13d0d3-21d8-4986-97d0-cffec2c40670 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.479593 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc13d0d3-21d8-4986-97d0-cffec2c40670 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.520603 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-fc13d0d3-21d8-4986-97d0-cffec2c40670 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc13d0d3-21d8-4986-97d0-cffec2c40670 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 HTTP/1.1 Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: exception: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'b3bf1681-df1e-4407-a184-d8b7dd992d13'} Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:50.524526 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. Jul 31 01:33:50.531185 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.531185 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.531185 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.531185 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.531185 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.531185 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.531185 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:50.531185 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:50.531185 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. Jul 31 01:33:50.531185 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.531185 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc13d0d3-21d8-4986-97d0-cffec2c40670 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:50.531185 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc13d0d3-21d8-4986-97d0-cffec2c40670 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 404 len: 111 microversion: 2.1 time: 0.078342 Jul 31 01:33:50.531185 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2349/4681] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:33:50 2022] DELETE /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:33:50.541655 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-319daec8-97df-4f60-8ba2-59626c1a43b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:50.544058 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-319daec8-97df-4f60-8ba2-59626c1a43b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: b3bf1681-df1e-4407-a184-d8b7dd992d13] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:50.556608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-319daec8-97df-4f60-8ba2-59626c1a43b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.558217 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-319daec8-97df-4f60-8ba2-59626c1a43b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.560079 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-319daec8-97df-4f60-8ba2-59626c1a43b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.560738 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-319daec8-97df-4f60-8ba2-59626c1a43b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.595202 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-319daec8-97df-4f60-8ba2-59626c1a43b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-319daec8-97df-4f60-8ba2-59626c1a43b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 HTTP/1.1 Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: exception: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'b3bf1681-df1e-4407-a184-d8b7dd992d13'} Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.598187 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.604356 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.604356 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.604356 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:50.604356 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:50.604356 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. Jul 31 01:33:50.604356 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.614065 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-319daec8-97df-4f60-8ba2-59626c1a43b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance b3bf1681-df1e-4407-a184-d8b7dd992d13 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:50.615280 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-319daec8-97df-4f60-8ba2-59626c1a43b2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13" status: 404 len: 111 microversion: 2.1 time: 0.080830 Jul 31 01:33:50.616310 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2350/4682] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:50 2022] GET /compute/v2.1/servers/b3bf1681-df1e-4407-a184-d8b7dd992d13 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:33:50.624619 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-55363aeb-14f8-4552-b014-2ccf5fa246c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:50.625358 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-55363aeb-14f8-4552-b014-2ccf5fa246c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:50.633245 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55363aeb-14f8-4552-b014-2ccf5fa246c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.634230 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55363aeb-14f8-4552-b014-2ccf5fa246c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.635298 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55363aeb-14f8-4552-b014-2ccf5fa246c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.635939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55363aeb-14f8-4552-b014-2ccf5fa246c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.652397 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-55363aeb-14f8-4552-b014-2ccf5fa246c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-55363aeb-14f8-4552-b014-2ccf5fa246c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 HTTP/1.1 Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0'} Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:50.655051 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. Jul 31 01:33:50.660844 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.660844 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.660844 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.660844 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.660844 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.660844 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.660844 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:50.660844 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:50.660844 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. Jul 31 01:33:50.660844 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.662669 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-55363aeb-14f8-4552-b014-2ccf5fa246c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:50.676378 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-55363aeb-14f8-4552-b014-2ccf5fa246c2 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 404 len: 111 microversion: 2.1 time: 0.043265 Jul 31 01:33:50.679460 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2351/4683] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:33:50 2022] DELETE /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:33:50.691875 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-14827bf7-2af9-446d-a8a3-3ec4415db047 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:50.692784 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-14827bf7-2af9-446d-a8a3-3ec4415db047 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:50.729323 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14827bf7-2af9-446d-a8a3-3ec4415db047 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.729803 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14827bf7-2af9-446d-a8a3-3ec4415db047 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.730608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14827bf7-2af9-446d-a8a3-3ec4415db047 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.731380 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14827bf7-2af9-446d-a8a3-3ec4415db047 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.757958 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-14827bf7-2af9-446d-a8a3-3ec4415db047 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-14827bf7-2af9-446d-a8a3-3ec4415db047 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 HTTP/1.1 Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0'} Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.760748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.765638 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.765638 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.765638 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:50.765638 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:50.765638 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. Jul 31 01:33:50.765638 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.765638 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-14827bf7-2af9-446d-a8a3-3ec4415db047 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance 85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:50.765638 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-14827bf7-2af9-446d-a8a3-3ec4415db047 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0" status: 404 len: 111 microversion: 2.1 time: 0.078361 Jul 31 01:33:50.765638 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2352/4684] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:50 2022] GET /compute/v2.1/servers/85bbf76b-d9e4-4be4-b7d7-b9c7c5e235d0 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:33:50.779059 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ff0bf95b-d0bb-454d-966c-68aeaf796f3e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:50.779601 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ff0bf95b-d0bb-454d-966c-68aeaf796f3e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:50.797461 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff0bf95b-d0bb-454d-966c-68aeaf796f3e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.802527 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff0bf95b-d0bb-454d-966c-68aeaf796f3e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.805203 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff0bf95b-d0bb-454d-966c-68aeaf796f3e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.810766 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff0bf95b-d0bb-454d-966c-68aeaf796f3e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.828355 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-ff0bf95b-d0bb-454d-966c-68aeaf796f3e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ff0bf95b-d0bb-454d-966c-68aeaf796f3e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d HTTP/1.1 Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '5d5b5df6-d433-4917-b181-7cac6503612d'} Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:50.830300 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. Jul 31 01:33:50.835394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.835394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.835394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.835394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.835394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.835394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.835394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:50.835394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:50.835394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. Jul 31 01:33:50.835394 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.837927 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ff0bf95b-d0bb-454d-966c-68aeaf796f3e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:50.841169 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ff0bf95b-d0bb-454d-966c-68aeaf796f3e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 404 len: 111 microversion: 2.1 time: 0.070580 Jul 31 01:33:50.843073 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2353/4685] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:33:50 2022] DELETE /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:33:50.853368 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb4c5f81-b912-4bef-9123-cd2e3e9dfb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:50.854657 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fb4c5f81-b912-4bef-9123-cd2e3e9dfb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5d5b5df6-d433-4917-b181-7cac6503612d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:50.866066 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d475efae-0a91-43fb-ac84-24b10c79adae tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:50.869655 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb4c5f81-b912-4bef-9123-cd2e3e9dfb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.870366 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb4c5f81-b912-4bef-9123-cd2e3e9dfb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.871355 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb4c5f81-b912-4bef-9123-cd2e3e9dfb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.871977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb4c5f81-b912-4bef-9123-cd2e3e9dfb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.878664 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d475efae-0a91-43fb-ac84-24b10c79adae tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1510 microversion: 2.1 time: 0.478339 Jul 31 01:33:50.881502 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2333/4686] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:50 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1510 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:50.902683 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-fb4c5f81-b912-4bef-9123-cd2e3e9dfb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb4c5f81-b912-4bef-9123-cd2e3e9dfb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d HTTP/1.1 Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '5d5b5df6-d433-4917-b181-7cac6503612d'} Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.911408 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.916823 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.916823 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.916823 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:50.916823 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:50.916823 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. Jul 31 01:33:50.916823 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.920771 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb4c5f81-b912-4bef-9123-cd2e3e9dfb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance 5d5b5df6-d433-4917-b181-7cac6503612d could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:50.923042 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fb4c5f81-b912-4bef-9123-cd2e3e9dfb2e tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d" status: 404 len: 111 microversion: 2.1 time: 0.073620 Jul 31 01:33:50.927277 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2354/4687] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:50 2022] GET /compute/v2.1/servers/5d5b5df6-d433-4917-b181-7cac6503612d => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:33:50.934137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5d7a5b9c-3c29-44bb-8c05-f0e4902cca72 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:50.934947 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5d7a5b9c-3c29-44bb-8c05-f0e4902cca72 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:50.945080 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d7a5b9c-3c29-44bb-8c05-f0e4902cca72 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.949028 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d7a5b9c-3c29-44bb-8c05-f0e4902cca72 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.951233 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d7a5b9c-3c29-44bb-8c05-f0e4902cca72 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:50.952739 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d7a5b9c-3c29-44bb-8c05-f0e4902cca72 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:50.989909 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-5d7a5b9c-3c29-44bb-8c05-f0e4902cca72 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5d7a5b9c-3c29-44bb-8c05-f0e4902cca72 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 HTTP/1.1 Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: exception: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'ef55e86b-d3da-4daf-b877-383d7b1d4702'} Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:50.995091 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. Jul 31 01:33:51.000156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.000156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:51.000156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.000156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:51.000156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:51.000156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:51.000156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:51.000156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:51.000156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. Jul 31 01:33:51.000156 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.004724 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5d7a5b9c-3c29-44bb-8c05-f0e4902cca72 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:51.007957 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5d7a5b9c-3c29-44bb-8c05-f0e4902cca72 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 404 len: 111 microversion: 2.1 time: 0.078737 Jul 31 01:33:51.010011 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2334/4688] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:33:50 2022] DELETE /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:33:51.025486 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c6fc14fc-7b56-49cd-9745-17ba669cdcca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:51.026313 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c6fc14fc-7b56-49cd-9745-17ba669cdcca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ef55e86b-d3da-4daf-b877-383d7b1d4702] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:51.046490 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6fc14fc-7b56-49cd-9745-17ba669cdcca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:51.048261 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6fc14fc-7b56-49cd-9745-17ba669cdcca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:51.050560 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6fc14fc-7b56-49cd-9745-17ba669cdcca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:51.051831 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6fc14fc-7b56-49cd-9745-17ba669cdcca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:51.123772 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-c6fc14fc-7b56-49cd-9745-17ba669cdcca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c6fc14fc-7b56-49cd-9745-17ba669cdcca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 HTTP/1.1 Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: exception: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'ef55e86b-d3da-4daf-b877-383d7b1d4702'} Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.136693 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:51.143214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:51.143214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:51.143214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:51.143214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:51.143214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. Jul 31 01:33:51.143214 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.143214 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c6fc14fc-7b56-49cd-9745-17ba669cdcca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance ef55e86b-d3da-4daf-b877-383d7b1d4702 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:51.143214 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c6fc14fc-7b56-49cd-9745-17ba669cdcca tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702" status: 404 len: 111 microversion: 2.1 time: 0.127156 Jul 31 01:33:51.146201 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2355/4689] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:51 2022] GET /compute/v2.1/servers/ef55e86b-d3da-4daf-b877-383d7b1d4702 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:33:51.154134 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2096778d-a113-4749-9532-066fce3473a8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:51.154641 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2096778d-a113-4749-9532-066fce3473a8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:51.166437 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2096778d-a113-4749-9532-066fce3473a8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:51.166917 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2096778d-a113-4749-9532-066fce3473a8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:51.167750 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2096778d-a113-4749-9532-066fce3473a8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:51.168193 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2096778d-a113-4749-9532-066fce3473a8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:51.224069 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-2096778d-a113-4749-9532-066fce3473a8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2096778d-a113-4749-9532-066fce3473a8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada HTTP/1.1 Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '5fc07337-409d-4721-b4ee-1c19d939eada'} Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:51.234136 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. Jul 31 01:33:51.238792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.238792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:51.238792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.238792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:51.238792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:51.238792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:51.238792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:51.238792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:51.238792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. Jul 31 01:33:51.238792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.241656 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2096778d-a113-4749-9532-066fce3473a8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:51.242723 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2096778d-a113-4749-9532-066fce3473a8 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 404 len: 111 microversion: 2.1 time: 0.092743 Jul 31 01:33:51.245002 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2335/4690] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:33:51 2022] DELETE /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:33:51.253652 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4aa4b38f-9ff7-4652-9353-aadb09a4804a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:51.254561 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4aa4b38f-9ff7-4652-9353-aadb09a4804a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 5fc07337-409d-4721-b4ee-1c19d939eada] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:51.272651 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4aa4b38f-9ff7-4652-9353-aadb09a4804a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:51.282113 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4aa4b38f-9ff7-4652-9353-aadb09a4804a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:51.287413 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4aa4b38f-9ff7-4652-9353-aadb09a4804a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:51.292916 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4aa4b38f-9ff7-4652-9353-aadb09a4804a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:51.362968 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-4aa4b38f-9ff7-4652-9353-aadb09a4804a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4aa4b38f-9ff7-4652-9353-aadb09a4804a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada HTTP/1.1 Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '5fc07337-409d-4721-b4ee-1c19d939eada'} Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.367186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:51.372200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:51.372200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:51.372200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:51.372200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:51.372200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. Jul 31 01:33:51.372200 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.374138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4aa4b38f-9ff7-4652-9353-aadb09a4804a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance 5fc07337-409d-4721-b4ee-1c19d939eada could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:51.376574 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4aa4b38f-9ff7-4652-9353-aadb09a4804a tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada" status: 404 len: 111 microversion: 2.1 time: 0.127504 Jul 31 01:33:51.384541 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2356/4691] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:51 2022] GET /compute/v2.1/servers/5fc07337-409d-4721-b4ee-1c19d939eada => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:33:51.389829 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4a9bedfc-f2e5-401d-a09e-612bcab26148 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:51.390338 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4a9bedfc-f2e5-401d-a09e-612bcab26148 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:51.404788 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-4a9bedfc-f2e5-401d-a09e-612bcab26148 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4a9bedfc-f2e5-401d-a09e-612bcab26148 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a HTTP/1.1 Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a'} Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:51.412191 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.417864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:51.417864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:51.417864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:51.417864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:51.417864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:51.417864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. Jul 31 01:33:51.417864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.417864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4a9bedfc-f2e5-401d-a09e-612bcab26148 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:51.419112 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4a9bedfc-f2e5-401d-a09e-612bcab26148 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a" status: 404 len: 111 microversion: 2.1 time: 0.031721 Jul 31 01:33:51.431947 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-85b76cf4-71f5-4e3a-a5bf-1ea4296a2445 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:51.432637 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-85b76cf4-71f5-4e3a-a5bf-1ea4296a2445 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:51.439601 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-85b76cf4-71f5-4e3a-a5bf-1ea4296a2445 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-85b76cf4-71f5-4e3a-a5bf-1ea4296a2445 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a HTTP/1.1 Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a'} Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:51.441766 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:51.447186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:51.447186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:51.447186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. Jul 31 01:33:51.447186 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:51.447186 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-85b76cf4-71f5-4e3a-a5bf-1ea4296a2445 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance 6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:51.447186 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-85b76cf4-71f5-4e3a-a5bf-1ea4296a2445 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a" status: 404 len: 111 microversion: 2.1 time: 0.015611 Jul 31 01:33:51.449755 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2357/4692] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:51 2022] GET /compute/v2.1/servers/6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:33:51.454500 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2336/4693] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:33:51 2022] DELETE /compute/v2.1/servers/6430b0f0-b1a3-4ca5-ba56-a2a92f6e7e6a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:33:51.458474 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-39684ec5-5d7a-469b-a737-f53e4aeaa376 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:51.460433 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-39684ec5-5d7a-469b-a737-f53e4aeaa376 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:51.472530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-39684ec5-5d7a-469b-a737-f53e4aeaa376 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:51.476935 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-39684ec5-5d7a-469b-a737-f53e4aeaa376 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:51.478333 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-39684ec5-5d7a-469b-a737-f53e4aeaa376 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:51.479264 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-126f490a-27b3-4f15-81f5-c43959f7a999 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:51.479987 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-126f490a-27b3-4f15-81f5-c43959f7a999 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:51.482758 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-39684ec5-5d7a-469b-a737-f53e4aeaa376 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:51.511172 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-126f490a-27b3-4f15-81f5-c43959f7a999 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:51.511765 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-126f490a-27b3-4f15-81f5-c43959f7a999 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:51.512614 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-126f490a-27b3-4f15-81f5-c43959f7a999 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:51.513073 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-126f490a-27b3-4f15-81f5-c43959f7a999 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:51.557371 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-39684ec5-5d7a-469b-a737-f53e4aeaa376 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:33:51.709201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-126f490a-27b3-4f15-81f5-c43959f7a999 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:51.731487 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-126f490a-27b3-4f15-81f5-c43959f7a999 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1273 microversion: 2.1 time: 0.267900 Jul 31 01:33:51.733779 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2337/4694] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:51 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1273 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:51.784058 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-39684ec5-5d7a-469b-a737-f53e4aeaa376 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 204 len: 0 microversion: 2.1 time: 0.332165 Jul 31 01:33:51.786357 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2358/4695] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:33:51 2022] DELETE /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:33:51.795822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-35108f54-982e-4fe5-8ba0-51f1b7f163ac tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:51.796172 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-35108f54-982e-4fe5-8ba0-51f1b7f163ac tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:51.810153 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35108f54-982e-4fe5-8ba0-51f1b7f163ac tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:51.818708 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35108f54-982e-4fe5-8ba0-51f1b7f163ac tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:51.819706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35108f54-982e-4fe5-8ba0-51f1b7f163ac tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:51.822944 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35108f54-982e-4fe5-8ba0-51f1b7f163ac tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:51.904140 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6289d6cd-fdd3-4a4c-a911-e39f30ce6e88 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:51.905403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6289d6cd-fdd3-4a4c-a911-e39f30ce6e88 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:51.908312 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:51.933957 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6289d6cd-fdd3-4a4c-a911-e39f30ce6e88 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:51.934418 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6289d6cd-fdd3-4a4c-a911-e39f30ce6e88 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:51.938950 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6289d6cd-fdd3-4a4c-a911-e39f30ce6e88 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:51.939820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6289d6cd-fdd3-4a4c-a911-e39f30ce6e88 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:52.797127 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6289d6cd-fdd3-4a4c-a911-e39f30ce6e88 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:52.825327 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6289d6cd-fdd3-4a4c-a911-e39f30ce6e88 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1493 microversion: 2.1 time: 0.926416 Jul 31 01:33:52.844550 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2359/4696] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:51 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1493 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:52.856571 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4e250f90-4d9f-4d71-aaf1-680fdb99914f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:52.860665 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4e250f90-4d9f-4d71-aaf1-680fdb99914f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:52.875380 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e250f90-4d9f-4d71-aaf1-680fdb99914f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:52.876521 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e250f90-4d9f-4d71-aaf1-680fdb99914f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:52.879708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e250f90-4d9f-4d71-aaf1-680fdb99914f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:52.880168 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e250f90-4d9f-4d71-aaf1-680fdb99914f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:53.091946 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-35108f54-982e-4fe5-8ba0-51f1b7f163ac tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:53.115322 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-35108f54-982e-4fe5-8ba0-51f1b7f163ac tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 200 len: 1479 microversion: 2.1 time: 1.324263 Jul 31 01:33:53.121121 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2338/4697] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:51 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 1479 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:53.144327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7e21284e-3c5a-4410-93fe-120c3d5f865e tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:53.145129 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7e21284e-3c5a-4410-93fe-120c3d5f865e tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:53.165794 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e21284e-3c5a-4410-93fe-120c3d5f865e tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:53.169402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e21284e-3c5a-4410-93fe-120c3d5f865e tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:53.173369 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e21284e-3c5a-4410-93fe-120c3d5f865e tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:53.174704 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e21284e-3c5a-4410-93fe-120c3d5f865e tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:53.353566 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7e21284e-3c5a-4410-93fe-120c3d5f865e tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "POST /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089/action" status: 202 len: 0 microversion: 2.1 time: 0.230949 Jul 31 01:33:53.357623 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2339/4698] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:33:53 2022] POST /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:33:53.366783 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-263a0f6f-a2cd-4692-b7a1-51a05bbdd4dd tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:53.370417 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-263a0f6f-a2cd-4692-b7a1-51a05bbdd4dd tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:53.389677 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-263a0f6f-a2cd-4692-b7a1-51a05bbdd4dd tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:53.391700 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-263a0f6f-a2cd-4692-b7a1-51a05bbdd4dd tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:53.392811 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-263a0f6f-a2cd-4692-b7a1-51a05bbdd4dd tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:53.395957 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-263a0f6f-a2cd-4692-b7a1-51a05bbdd4dd tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:53.533551 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4e250f90-4d9f-4d71-aaf1-680fdb99914f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:53.549138 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4e250f90-4d9f-4d71-aaf1-680fdb99914f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1315 microversion: 2.1 time: 0.701784 Jul 31 01:33:53.550401 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2360/4699] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:52 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1315 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:53.774677 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-263a0f6f-a2cd-4692-b7a1-51a05bbdd4dd tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:53.785042 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-263a0f6f-a2cd-4692-b7a1-51a05bbdd4dd tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1499 microversion: 2.1 time: 0.424633 Jul 31 01:33:53.786050 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2340/4700] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:53 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1499 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:54.144191 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-345e987f-569a-47bf-8873-6e2c353cfe26 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:54.144951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-345e987f-569a-47bf-8873-6e2c353cfe26 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:54.157641 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-345e987f-569a-47bf-8873-6e2c353cfe26 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:54.160049 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-345e987f-569a-47bf-8873-6e2c353cfe26 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:54.168032 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-345e987f-569a-47bf-8873-6e2c353cfe26 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:54.169020 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-345e987f-569a-47bf-8873-6e2c353cfe26 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:54.573239 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b5859f36-2ba9-4946-9a06-d8d797107d48 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:54.575636 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b5859f36-2ba9-4946-9a06-d8d797107d48 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:54.594455 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5859f36-2ba9-4946-9a06-d8d797107d48 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:54.598224 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5859f36-2ba9-4946-9a06-d8d797107d48 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:54.601609 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5859f36-2ba9-4946-9a06-d8d797107d48 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:54.602244 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5859f36-2ba9-4946-9a06-d8d797107d48 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:54.702198 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-345e987f-569a-47bf-8873-6e2c353cfe26 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:54.714976 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-345e987f-569a-47bf-8873-6e2c353cfe26 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 200 len: 1479 microversion: 2.1 time: 0.576155 Jul 31 01:33:54.717490 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2361/4701] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:54 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 1479 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:54.806919 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d2cd58d9-540d-4bd4-ba1a-e00205cf90da tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:54.808192 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d2cd58d9-540d-4bd4-ba1a-e00205cf90da tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:54.848620 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2cd58d9-540d-4bd4-ba1a-e00205cf90da tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:54.852946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2cd58d9-540d-4bd4-ba1a-e00205cf90da tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:54.857579 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2cd58d9-540d-4bd4-ba1a-e00205cf90da tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:54.858198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2cd58d9-540d-4bd4-ba1a-e00205cf90da tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:54.878976 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:54.921951 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b5859f36-2ba9-4946-9a06-d8d797107d48 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:54.941470 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b5859f36-2ba9-4946-9a06-d8d797107d48 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1315 microversion: 2.1 time: 0.373621 Jul 31 01:33:54.955397 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2341/4702] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:54 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:54.956820 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-9cf48ef5-6114-49e6-9277-08427531cf4d req-9bd8c2a1-df13-4872-b882-af93807b4c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f3ee80f-59a8-4a65-b305-41ad15d38703", "tag": "940a48a2-7107-4216-b0a3-3b305d1caa68"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:54.982558 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9cf48ef5-6114-49e6-9277-08427531cf4d req-9bd8c2a1-df13-4872-b882-af93807b4c8e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:54.987961 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9cf48ef5-6114-49e6-9277-08427531cf4d req-9bd8c2a1-df13-4872-b882-af93807b4c8e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:55.043310 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-9cf48ef5-6114-49e6-9277-08427531cf4d req-9bd8c2a1-df13-4872-b882-af93807b4c8e service nova] Creating event network-changed:940a48a2-7107-4216-b0a3-3b305d1caa68 for instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 on n-h1-master-1 Jul 31 01:33:55.057560 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-9cf48ef5-6114-49e6-9277-08427531cf4d req-9bd8c2a1-df13-4872-b882-af93807b4c8e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110636 Jul 31 01:33:55.057952 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2342/4703] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:33:55.421430 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d2cd58d9-540d-4bd4-ba1a-e00205cf90da tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:55.433714 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d2cd58d9-540d-4bd4-ba1a-e00205cf90da tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1499 microversion: 2.1 time: 0.628550 Jul 31 01:33:55.437199 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2362/4704] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:54 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1499 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:33:55.741292 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d86be239-3930-4452-88a4-815f5d004d62 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:55.742182 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d86be239-3930-4452-88a4-815f5d004d62 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:55.769937 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d86be239-3930-4452-88a4-815f5d004d62 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:55.770561 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d86be239-3930-4452-88a4-815f5d004d62 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:55.771731 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d86be239-3930-4452-88a4-815f5d004d62 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:55.774237 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d86be239-3930-4452-88a4-815f5d004d62 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:55.973299 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6885aae8-2012-42c4-ae99-438d7683a490 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:55.974061 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6885aae8-2012-42c4-ae99-438d7683a490 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:55.992340 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6885aae8-2012-42c4-ae99-438d7683a490 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:55.992706 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6885aae8-2012-42c4-ae99-438d7683a490 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:55.993503 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6885aae8-2012-42c4-ae99-438d7683a490 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:55.993984 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6885aae8-2012-42c4-ae99-438d7683a490 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:57.337698 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6885aae8-2012-42c4-ae99-438d7683a490 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:57.354247 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6885aae8-2012-42c4-ae99-438d7683a490 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1315 microversion: 2.1 time: 1.389718 Jul 31 01:33:57.355463 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2363/4705] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:55 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1315 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:57.372828 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-08dd2937-af41-40d8-8d0e-471f79a104c1 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:57.373743 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-08dd2937-af41-40d8-8d0e-471f79a104c1 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:57.401213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08dd2937-af41-40d8-8d0e-471f79a104c1 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:57.404113 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08dd2937-af41-40d8-8d0e-471f79a104c1 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:57.407017 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08dd2937-af41-40d8-8d0e-471f79a104c1 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:57.409605 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08dd2937-af41-40d8-8d0e-471f79a104c1 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:57.537839 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d86be239-3930-4452-88a4-815f5d004d62 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159706f59a12427f9a3c03fa31f712f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0eabc1db24b12b1bb23c1d0c206d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:57.593852 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d86be239-3930-4452-88a4-815f5d004d62 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 200 len: 1479 microversion: 2.1 time: 1.859048 Jul 31 01:33:57.594493 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2343/4706] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:55 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 1479 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:57.627075 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-3cf884cc-856c-4005-a260-16fe9b1f647f req-73f54589-91d0-42d7-bee8-dc6bb786b502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8", "name": "network-vif-deleted", "tag": "abd05ec8-47bf-48ba-9712-efb525258b6a"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:33:57.671488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3cf884cc-856c-4005-a260-16fe9b1f647f req-73f54589-91d0-42d7-bee8-dc6bb786b502 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:57.672339 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3cf884cc-856c-4005-a260-16fe9b1f647f req-73f54589-91d0-42d7-bee8-dc6bb786b502 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:57.710371 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-3cf884cc-856c-4005-a260-16fe9b1f647f req-73f54589-91d0-42d7-bee8-dc6bb786b502 service nova] Creating event network-vif-deleted:abd05ec8-47bf-48ba-9712-efb525258b6a for instance ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 on n-h2-master-1 Jul 31 01:33:57.746323 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-3cf884cc-856c-4005-a260-16fe9b1f647f req-73f54589-91d0-42d7-bee8-dc6bb786b502 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145368 Jul 31 01:33:57.748426 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2344/4707] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:33:58.380137 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-08dd2937-af41-40d8-8d0e-471f79a104c1 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:58.392103 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-08dd2937-af41-40d8-8d0e-471f79a104c1 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1499 microversion: 2.1 time: 1.034564 Jul 31 01:33:58.393524 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fda3f055-c410-4c02-8fc6-90d57591da69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:58.394370 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fda3f055-c410-4c02-8fc6-90d57591da69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:58.395785 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2364/4708] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:57 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1499 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:58.440834 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fda3f055-c410-4c02-8fc6-90d57591da69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:58.441448 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fda3f055-c410-4c02-8fc6-90d57591da69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:58.442837 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fda3f055-c410-4c02-8fc6-90d57591da69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:58.445186 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fda3f055-c410-4c02-8fc6-90d57591da69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:58.628975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1c21dd39-95b1-4f0d-b8b5-2411f2210821 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:58.629617 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1c21dd39-95b1-4f0d-b8b5-2411f2210821 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] [instance: ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:58.640234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c21dd39-95b1-4f0d-b8b5-2411f2210821 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:58.640736 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c21dd39-95b1-4f0d-b8b5-2411f2210821 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:58.641543 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c21dd39-95b1-4f0d-b8b5-2411f2210821 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:58.641996 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c21dd39-95b1-4f0d-b8b5-2411f2210821 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:58.676714 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-1c21dd39-95b1-4f0d-b8b5-2411f2210821 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] HTTP exception thrown: Instance ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 could not be found. Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1c21dd39-95b1-4f0d-b8b5-2411f2210821 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Request method failure captured: Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 HTTP/1.1 Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5drv09HtvoTE0Oo5fK0wcGyU8UJPoLvbLkbZ57PMOWAD_3vMP74OiwlNuxHVpiyHgpV5ngWdtWY7hwT8GZ3y_-cenix1GH8Fu_NYI6QkuHzILR0M5bYT9g6KQzoALaaFKxJLsgp9rXiW-qxCA_gV-swT7wP3FH111quOxilxnkURk2A Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/46d0eabc1db24b12b1bb23c1d0c206d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_46d0eabc1db24b12b1bb23c1d0c206d0", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersTestJSON-1841585350 Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 46d0eabc1db24b12b1bb23c1d0c206d0 Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersTestJSON-1841585350 Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 159706f59a12427f9a3c03fa31f712f3 Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersTestJSON-1841585350-project Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: exception: Instance ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 could not be found. Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8'} Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 could not be found. Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 could not be found. Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:58.678466 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:33:58.683545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:33:58.683545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:33:58.683545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:33:58.683545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:33:58.683545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 could not be found. Jul 31 01:33:58.683545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:33:58.683545 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1c21dd39-95b1-4f0d-b8b5-2411f2210821 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] Returning 404 to user: Instance ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:33:58.683545 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1c21dd39-95b1-4f0d-b8b5-2411f2210821 tempest-ServersTestJSON-1841585350 tempest-ServersTestJSON-1841585350-project] 10.222.0.45 "GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8" status: 404 len: 111 microversion: 2.1 time: 0.061972 Jul 31 01:33:58.683545 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2365/4709] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:58 2022] GET /compute/v2.1/servers/ca53f7fc-7d17-4c1e-b4f2-9e82a0c545e8 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:33:58.778325 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:58.832604 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:58.957383 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fda3f055-c410-4c02-8fc6-90d57591da69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:58.972839 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fda3f055-c410-4c02-8fc6-90d57591da69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1315 microversion: 2.1 time: 0.595580 Jul 31 01:33:58.984344 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2345/4710] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:58 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:33:59.425996 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ad59bbc8-e27b-49bc-b66c-1b81bb8d3486 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:59.428782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ad59bbc8-e27b-49bc-b66c-1b81bb8d3486 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:59.448380 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:59.473806 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad59bbc8-e27b-49bc-b66c-1b81bb8d3486 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:59.474703 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad59bbc8-e27b-49bc-b66c-1b81bb8d3486 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:59.475580 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad59bbc8-e27b-49bc-b66c-1b81bb8d3486 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:59.476190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad59bbc8-e27b-49bc-b66c-1b81bb8d3486 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:59.738729 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ad59bbc8-e27b-49bc-b66c-1b81bb8d3486 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:33:59.753228 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ad59bbc8-e27b-49bc-b66c-1b81bb8d3486 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1502 microversion: 2.1 time: 0.341110 Jul 31 01:33:59.754343 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2366/4711] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:59 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1502 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:33:59.778096 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d4cf9cd7-6a63-4a49-96b8-63f3869b7bff tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:33:59.779237 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d4cf9cd7-6a63-4a49-96b8-63f3869b7bff tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:33:59.798278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d4cf9cd7-6a63-4a49-96b8-63f3869b7bff tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:59.800644 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d4cf9cd7-6a63-4a49-96b8-63f3869b7bff tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:59.803261 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d4cf9cd7-6a63-4a49-96b8-63f3869b7bff tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:33:59.805115 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d4cf9cd7-6a63-4a49-96b8-63f3869b7bff tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:33:59.849551 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:59.902285 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d4cf9cd7-6a63-4a49-96b8-63f3869b7bff tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:34:00.000346 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-54dbfd04-8973-4877-9876-1e53fbb466b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:00.002175 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-54dbfd04-8973-4877-9876-1e53fbb466b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:00.035372 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54dbfd04-8973-4877-9876-1e53fbb466b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:00.038244 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54dbfd04-8973-4877-9876-1e53fbb466b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:00.044717 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54dbfd04-8973-4877-9876-1e53fbb466b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:00.047859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54dbfd04-8973-4877-9876-1e53fbb466b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:00.067903 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d4cf9cd7-6a63-4a49-96b8-63f3869b7bff tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 204 len: 0 microversion: 2.1 time: 0.293307 Jul 31 01:34:00.071276 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2346/4712] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:33:59 2022] DELETE /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:34:00.090055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f639a111-9914-4a87-a440-9ee81565293e tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:00.093684 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f639a111-9914-4a87-a440-9ee81565293e tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:00.110802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f639a111-9914-4a87-a440-9ee81565293e tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:00.111745 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f639a111-9914-4a87-a440-9ee81565293e tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:00.113874 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f639a111-9914-4a87-a440-9ee81565293e tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:00.115131 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f639a111-9914-4a87-a440-9ee81565293e tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:00.497940 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-54dbfd04-8973-4877-9876-1e53fbb466b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:00.512169 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-54dbfd04-8973-4877-9876-1e53fbb466b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1315 microversion: 2.1 time: 0.516116 Jul 31 01:34:00.512819 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2367/4713] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:33:59 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:00.615277 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f639a111-9914-4a87-a440-9ee81565293e tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:00.624011 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f639a111-9914-4a87-a440-9ee81565293e tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1508 microversion: 2.1 time: 0.546119 Jul 31 01:34:00.624624 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2347/4714] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:00 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1508 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:01.538827 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f513f693-006f-4243-9413-8c84077e52dd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:01.552089 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f513f693-006f-4243-9413-8c84077e52dd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:01.590382 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f513f693-006f-4243-9413-8c84077e52dd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:01.596497 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f513f693-006f-4243-9413-8c84077e52dd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:01.601871 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f513f693-006f-4243-9413-8c84077e52dd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:01.602634 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f513f693-006f-4243-9413-8c84077e52dd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:01.646407 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-469f036b-4cbb-41f0-b74a-ae938408c13f tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:01.647590 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-469f036b-4cbb-41f0-b74a-ae938408c13f tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:01.655799 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-469f036b-4cbb-41f0-b74a-ae938408c13f tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:01.656470 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-469f036b-4cbb-41f0-b74a-ae938408c13f tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:01.657446 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-469f036b-4cbb-41f0-b74a-ae938408c13f tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:01.658073 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-469f036b-4cbb-41f0-b74a-ae938408c13f tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:02.762947 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-469f036b-4cbb-41f0-b74a-ae938408c13f tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d4bd75067a46eaae6c6e4049500fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ef9ab24d1842d895fd55c54e75806d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:02.780480 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-469f036b-4cbb-41f0-b74a-ae938408c13f tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 200 len: 1508 microversion: 2.1 time: 1.134079 Jul 31 01:34:02.781129 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2348/4715] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:01 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 1508 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:34:02.786368 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-8f2a5072-8f0f-4db8-b136-5cc3df03d1b0 req-fb172138-0858-4eaa-a7b3-9be1c37e1cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3ee80f-59a8-4a65-b305-41ad15d38703", "name": "network-vif-plugged", "status": "completed", "tag": "940a48a2-7107-4216-b0a3-3b305d1caa68"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:34:02.803877 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8f2a5072-8f0f-4db8-b136-5cc3df03d1b0 req-fb172138-0858-4eaa-a7b3-9be1c37e1cec service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:02.804539 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8f2a5072-8f0f-4db8-b136-5cc3df03d1b0 req-fb172138-0858-4eaa-a7b3-9be1c37e1cec service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:02.823714 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-8f2a5072-8f0f-4db8-b136-5cc3df03d1b0 req-fb172138-0858-4eaa-a7b3-9be1c37e1cec service nova] Creating event network-vif-plugged:940a48a2-7107-4216-b0a3-3b305d1caa68 for instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 on n-h1-master-1 Jul 31 01:34:02.831768 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-8f2a5072-8f0f-4db8-b136-5cc3df03d1b0 req-fb172138-0858-4eaa-a7b3-9be1c37e1cec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048482 Jul 31 01:34:02.832486 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2349/4716] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:34:02.949267 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f513f693-006f-4243-9413-8c84077e52dd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:02.980187 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f513f693-006f-4243-9413-8c84077e52dd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1315 microversion: 2.1 time: 1.448261 Jul 31 01:34:02.997472 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2368/4717] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:01 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1315 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:03.127079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-741a27aa-842e-42ac-a9ca-9d92942e2a72 req-0281d62d-4853-443c-a916-c243b7e0135e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d01a3e7-7e4e-4d3d-90c1-b2f298179089", "name": "network-vif-deleted", "tag": "52247038-e569-476e-bd61-fe552d43d446"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:34:03.163229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-741a27aa-842e-42ac-a9ca-9d92942e2a72 req-0281d62d-4853-443c-a916-c243b7e0135e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:03.163870 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-741a27aa-842e-42ac-a9ca-9d92942e2a72 req-0281d62d-4853-443c-a916-c243b7e0135e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:03.209880 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-741a27aa-842e-42ac-a9ca-9d92942e2a72 req-0281d62d-4853-443c-a916-c243b7e0135e service nova] Creating event network-vif-deleted:52247038-e569-476e-bd61-fe552d43d446 for instance 5d01a3e7-7e4e-4d3d-90c1-b2f298179089 on n-h2-master-1 Jul 31 01:34:03.225781 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-741a27aa-842e-42ac-a9ca-9d92942e2a72 req-0281d62d-4853-443c-a916-c243b7e0135e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103327 Jul 31 01:34:03.227620 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2350/4718] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:34:03.807823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8a777cf0-c5fe-4055-85b3-79d412099d85 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:03.808450 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8a777cf0-c5fe-4055-85b3-79d412099d85 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] [instance: 5d01a3e7-7e4e-4d3d-90c1-b2f298179089] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:03.820396 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a777cf0-c5fe-4055-85b3-79d412099d85 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:03.820903 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a777cf0-c5fe-4055-85b3-79d412099d85 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:03.824697 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a777cf0-c5fe-4055-85b3-79d412099d85 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:03.825191 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a777cf0-c5fe-4055-85b3-79d412099d85 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:03.865338 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-8a777cf0-c5fe-4055-85b3-79d412099d85 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] HTTP exception thrown: Instance 5d01a3e7-7e4e-4d3d-90c1-b2f298179089 could not be found. Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8a777cf0-c5fe-4055-85b3-79d412099d85 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Request method failure captured: Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 HTTP/1.1 Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dvZzljLFdQqBnSCRoxq3DVNPeM5FzizDLSUgAmJXXTHNVSI2VtNM25QQ6XJNke_gkYQjFdIv1meklFiAQQAbrfyoIiyM-9mVJFRl19DKpw1-vIKma43TWBbCeiNqMKXDBHtO5DZiRi9kf8rCSTC6z07JvGnzhb1Y6A9RbweyQgiDX4 Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 18ef9ab24d1842d895fd55c54e75806d Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestServerAdvancedOps-1050157813 Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/18ef9ab24d1842d895fd55c54e75806d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/18ef9ab24d1842d895fd55c54e75806d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/18ef9ab24d1842d895fd55c54e75806d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_18ef9ab24d1842d895fd55c54e75806d", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestServerAdvancedOps-1050157813 Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 18ef9ab24d1842d895fd55c54e75806d Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestServerAdvancedOps-1050157813 Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestServerAdvancedOps-1050157813-project Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: d7d4bd75067a46eaae6c6e4049500fa9 Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestServerAdvancedOps-1050157813-project Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 5d01a3e7-7e4e-4d3d-90c1-b2f298179089 could not be found. Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '5d01a3e7-7e4e-4d3d-90c1-b2f298179089'} Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d01a3e7-7e4e-4d3d-90c1-b2f298179089 could not be found. Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d01a3e7-7e4e-4d3d-90c1-b2f298179089 could not be found. Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:34:03.868622 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:34:03.873254 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:34:03.873254 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:34:03.873254 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:34:03.873254 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:34:03.873254 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:34:03.873254 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d01a3e7-7e4e-4d3d-90c1-b2f298179089 could not be found. Jul 31 01:34:03.873254 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:34:03.873254 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8a777cf0-c5fe-4055-85b3-79d412099d85 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] Returning 404 to user: Instance 5d01a3e7-7e4e-4d3d-90c1-b2f298179089 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:34:03.873254 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8a777cf0-c5fe-4055-85b3-79d412099d85 tempest-TestServerAdvancedOps-1050157813 tempest-TestServerAdvancedOps-1050157813-project] 10.222.0.45 "GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089" status: 404 len: 111 microversion: 2.1 time: 0.066927 Jul 31 01:34:03.873254 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2369/4719] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:03 2022] GET /compute/v2.1/servers/5d01a3e7-7e4e-4d3d-90c1-b2f298179089 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:34:04.009907 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5c63d3c9-bede-422e-841c-1aedd7b6c284 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:04.011668 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5c63d3c9-bede-422e-841c-1aedd7b6c284 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:04.033757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c63d3c9-bede-422e-841c-1aedd7b6c284 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:04.035546 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c63d3c9-bede-422e-841c-1aedd7b6c284 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:04.038324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c63d3c9-bede-422e-841c-1aedd7b6c284 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:04.038947 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c63d3c9-bede-422e-841c-1aedd7b6c284 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:04.960203 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5c63d3c9-bede-422e-841c-1aedd7b6c284 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:04.973581 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5c63d3c9-bede-422e-841c-1aedd7b6c284 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1315 microversion: 2.1 time: 0.968513 Jul 31 01:34:04.991071 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2351/4720] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:04 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1315 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:05.998409 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-03e45031-c531-4f7a-bd8e-719cc8d1d9cd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:05.999718 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-03e45031-c531-4f7a-bd8e-719cc8d1d9cd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:06.012501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03e45031-c531-4f7a-bd8e-719cc8d1d9cd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:06.013531 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03e45031-c531-4f7a-bd8e-719cc8d1d9cd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:06.014681 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03e45031-c531-4f7a-bd8e-719cc8d1d9cd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:06.015670 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03e45031-c531-4f7a-bd8e-719cc8d1d9cd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:07.478862 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-03e45031-c531-4f7a-bd8e-719cc8d1d9cd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:07.488611 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-03e45031-c531-4f7a-bd8e-719cc8d1d9cd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1502 microversion: 2.1 time: 1.494388 Jul 31 01:34:07.496447 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2370/4721] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:05 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1502 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:07.520779 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-73894f27-4033-4bb6-b76e-af08376e0f2f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:34:07.521337 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-73894f27-4033-4bb6-b76e-af08376e0f2f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:07.539875 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73894f27-4033-4bb6-b76e-af08376e0f2f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:07.540345 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73894f27-4033-4bb6-b76e-af08376e0f2f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:07.541155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73894f27-4033-4bb6-b76e-af08376e0f2f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:07.541606 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73894f27-4033-4bb6-b76e-af08376e0f2f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:07.607439 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-73894f27-4033-4bb6-b76e-af08376e0f2f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lazy-loading 'flavor' on Instance uuid 8f3ee80f-59a8-4a65-b305-41ad15d38703 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:34:08.098452 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-73894f27-4033-4bb6-b76e-af08376e0f2f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "POST /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703/action" status: 202 len: 0 microversion: 2.1 time: 0.581943 Jul 31 01:34:08.102524 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2352/4722] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:34:07 2022] POST /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:34:08.108151 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a5633a0c-719d-43af-8eae-2e2ea118c672 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:08.108833 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a5633a0c-719d-43af-8eae-2e2ea118c672 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:08.122813 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5633a0c-719d-43af-8eae-2e2ea118c672 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:08.123293 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5633a0c-719d-43af-8eae-2e2ea118c672 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:08.126477 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5633a0c-719d-43af-8eae-2e2ea118c672 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:08.128167 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5633a0c-719d-43af-8eae-2e2ea118c672 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:08.708760 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a5633a0c-719d-43af-8eae-2e2ea118c672 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:08.723627 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a5633a0c-719d-43af-8eae-2e2ea118c672 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.619888 Jul 31 01:34:08.724512 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2371/4723] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:08 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:34:09.749332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-593ef0b3-2722-487d-b83c-e74aebcbc0c9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:09.750620 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-593ef0b3-2722-487d-b83c-e74aebcbc0c9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:09.786854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-593ef0b3-2722-487d-b83c-e74aebcbc0c9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:09.788936 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-593ef0b3-2722-487d-b83c-e74aebcbc0c9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:09.790716 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-593ef0b3-2722-487d-b83c-e74aebcbc0c9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:09.792643 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-593ef0b3-2722-487d-b83c-e74aebcbc0c9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:10.245520 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-593ef0b3-2722-487d-b83c-e74aebcbc0c9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:10.255269 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-593ef0b3-2722-487d-b83c-e74aebcbc0c9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.512716 Jul 31 01:34:10.266472 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2353/4724] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:09 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:11.304579 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8c3e6e35-120d-4b07-8a88-1feaec1504a0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:11.307387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8c3e6e35-120d-4b07-8a88-1feaec1504a0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:11.324337 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c3e6e35-120d-4b07-8a88-1feaec1504a0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:11.328308 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c3e6e35-120d-4b07-8a88-1feaec1504a0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:11.332172 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c3e6e35-120d-4b07-8a88-1feaec1504a0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:11.332644 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c3e6e35-120d-4b07-8a88-1feaec1504a0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:12.163356 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8c3e6e35-120d-4b07-8a88-1feaec1504a0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:12.172447 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8c3e6e35-120d-4b07-8a88-1feaec1504a0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.875487 Jul 31 01:34:12.173551 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2372/4725] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:11 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:13.194074 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c3568248-7740-40a1-85ec-42375deaf1c3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:13.194703 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c3568248-7740-40a1-85ec-42375deaf1c3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:13.204241 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3568248-7740-40a1-85ec-42375deaf1c3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:13.204706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3568248-7740-40a1-85ec-42375deaf1c3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:13.205504 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3568248-7740-40a1-85ec-42375deaf1c3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:13.205974 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3568248-7740-40a1-85ec-42375deaf1c3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:13.470828 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c3568248-7740-40a1-85ec-42375deaf1c3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:13.481659 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c3568248-7740-40a1-85ec-42375deaf1c3 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.291127 Jul 31 01:34:13.484305 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2354/4726] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:13 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:14.505851 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f3df11a6-4986-4971-b33e-50d9365c0a3d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:14.507316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f3df11a6-4986-4971-b33e-50d9365c0a3d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:14.520990 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3df11a6-4986-4971-b33e-50d9365c0a3d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:14.522405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3df11a6-4986-4971-b33e-50d9365c0a3d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:14.525389 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3df11a6-4986-4971-b33e-50d9365c0a3d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:14.526826 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3df11a6-4986-4971-b33e-50d9365c0a3d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:14.707305 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ca7ae343-83d3-44fc-96bd-77326127938e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-237470230", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": "none"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:34:14.795397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ca7ae343-83d3-44fc-96bd-77326127938e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:34:14.796128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ca7ae343-83d3-44fc-96bd-77326127938e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:34:14.800321 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f3df11a6-4986-4971-b33e-50d9365c0a3d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:14.801460 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ca7ae343-83d3-44fc-96bd-77326127938e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:34:14.802456 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ca7ae343-83d3-44fc-96bd-77326127938e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:34:14.803679 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ca7ae343-83d3-44fc-96bd-77326127938e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:34:14.810399 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f3df11a6-4986-4971-b33e-50d9365c0a3d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.309562 Jul 31 01:34:14.811985 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2355/4727] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:14 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:34:14.841946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca7ae343-83d3-44fc-96bd-77326127938e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:14.844325 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca7ae343-83d3-44fc-96bd-77326127938e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:14.849051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca7ae343-83d3-44fc-96bd-77326127938e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:14.851331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca7ae343-83d3-44fc-96bd-77326127938e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:14.899261 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-ca7ae343-83d3-44fc-96bd-77326127938e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Getting quotas for project 088eed88a6b140c88a3c3a29dc65dbae. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:34:14.905668 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-ca7ae343-83d3-44fc-96bd-77326127938e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Getting quotas for user 1ebb4530b4cc4b2d91153ce302578c3a and project 088eed88a6b140c88a3c3a29dc65dbae. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:34:14.921036 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ca7ae343-83d3-44fc-96bd-77326127938e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:34:14.924646 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ca7ae343-83d3-44fc-96bd-77326127938e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:34:15.035518 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ca7ae343-83d3-44fc-96bd-77326127938e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.606139 Jul 31 01:34:15.036776 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2373/4728] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:34:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 01:34:15.050527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bdd2f60a-f6d1-48ff-839c-a5edc01e59b9 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:15.051647 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bdd2f60a-f6d1-48ff-839c-a5edc01e59b9 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:15.177721 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bdd2f60a-f6d1-48ff-839c-a5edc01e59b9 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:15.207676 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bdd2f60a-f6d1-48ff-839c-a5edc01e59b9 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:15.217659 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bdd2f60a-f6d1-48ff-839c-a5edc01e59b9 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:15.218885 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bdd2f60a-f6d1-48ff-839c-a5edc01e59b9 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1277 microversion: 2.57 time: 0.174497 Jul 31 01:34:15.225041 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2356/4729] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:15 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:15.839746 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9734267f-1bd8-48d5-bd7d-218b5cbceb60 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:15.840474 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9734267f-1bd8-48d5-bd7d-218b5cbceb60 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:15.865213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9734267f-1bd8-48d5-bd7d-218b5cbceb60 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:15.865742 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9734267f-1bd8-48d5-bd7d-218b5cbceb60 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:15.868368 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9734267f-1bd8-48d5-bd7d-218b5cbceb60 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:15.868820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9734267f-1bd8-48d5-bd7d-218b5cbceb60 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:16.254652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2071a63f-b48a-472d-a7bd-6f7d91cef081 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:16.255901 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2071a63f-b48a-472d-a7bd-6f7d91cef081 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:16.271495 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2071a63f-b48a-472d-a7bd-6f7d91cef081 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:16.272236 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2071a63f-b48a-472d-a7bd-6f7d91cef081 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:16.273235 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2071a63f-b48a-472d-a7bd-6f7d91cef081 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:16.273884 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2071a63f-b48a-472d-a7bd-6f7d91cef081 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:16.448806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9734267f-1bd8-48d5-bd7d-218b5cbceb60 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:16.461921 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9734267f-1bd8-48d5-bd7d-218b5cbceb60 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.632987 Jul 31 01:34:16.480406 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2374/4730] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:15 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:16.562500 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2071a63f-b48a-472d-a7bd-6f7d91cef081 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:16.588390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2071a63f-b48a-472d-a7bd-6f7d91cef081 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:16.592419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2071a63f-b48a-472d-a7bd-6f7d91cef081 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:16.600481 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2071a63f-b48a-472d-a7bd-6f7d91cef081 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1273 microversion: 2.57 time: 0.354114 Jul 31 01:34:16.602250 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2357/4731] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:16 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1273 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:17.488569 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1d295728-9ec3-44e8-a95b-a29e3f659a99 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:17.489196 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1d295728-9ec3-44e8-a95b-a29e3f659a99 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:17.506285 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d295728-9ec3-44e8-a95b-a29e3f659a99 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:17.512090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d295728-9ec3-44e8-a95b-a29e3f659a99 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:17.512090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d295728-9ec3-44e8-a95b-a29e3f659a99 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:17.512090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d295728-9ec3-44e8-a95b-a29e3f659a99 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:17.630004 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b7080fc1-5f3f-4f02-bd44-5fbc4da2c039 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:17.631239 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b7080fc1-5f3f-4f02-bd44-5fbc4da2c039 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:17.635067 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:17.650397 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7080fc1-5f3f-4f02-bd44-5fbc4da2c039 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:17.652005 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7080fc1-5f3f-4f02-bd44-5fbc4da2c039 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:17.661888 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7080fc1-5f3f-4f02-bd44-5fbc4da2c039 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:17.662474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7080fc1-5f3f-4f02-bd44-5fbc4da2c039 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:17.953351 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b7080fc1-5f3f-4f02-bd44-5fbc4da2c039 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:17.970193 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b7080fc1-5f3f-4f02-bd44-5fbc4da2c039 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:17.978378 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b7080fc1-5f3f-4f02-bd44-5fbc4da2c039 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:17.984459 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b7080fc1-5f3f-4f02-bd44-5fbc4da2c039 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1335 microversion: 2.57 time: 0.355320 Jul 31 01:34:17.986005 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2358/4732] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:17 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1335 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:18.185226 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1d295728-9ec3-44e8-a95b-a29e3f659a99 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:18.203185 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1d295728-9ec3-44e8-a95b-a29e3f659a99 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.714348 Jul 31 01:34:18.222086 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2375/4733] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:17 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:19.012779 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4870a260-f318-428b-ab6f-05ab006ccb9e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:19.013436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4870a260-f318-428b-ab6f-05ab006ccb9e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:19.027022 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4870a260-f318-428b-ab6f-05ab006ccb9e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:19.027920 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4870a260-f318-428b-ab6f-05ab006ccb9e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:19.031019 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4870a260-f318-428b-ab6f-05ab006ccb9e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:19.031538 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4870a260-f318-428b-ab6f-05ab006ccb9e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:19.229281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-71a2cf5c-5c65-416a-9e18-5e88893daccc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:19.230589 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-71a2cf5c-5c65-416a-9e18-5e88893daccc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:19.242440 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71a2cf5c-5c65-416a-9e18-5e88893daccc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:19.245434 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71a2cf5c-5c65-416a-9e18-5e88893daccc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:19.246453 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71a2cf5c-5c65-416a-9e18-5e88893daccc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:19.249178 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71a2cf5c-5c65-416a-9e18-5e88893daccc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:19.270211 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 01:34:19.270390 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 01:34:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 (ip 10.222.0.45) !!! Jul 31 01:34:19.297243 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4870a260-f318-428b-ab6f-05ab006ccb9e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:19.310681 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4870a260-f318-428b-ab6f-05ab006ccb9e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:19.315382 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4870a260-f318-428b-ab6f-05ab006ccb9e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:19.327276 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4870a260-f318-428b-ab6f-05ab006ccb9e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1335 microversion: 2.57 time: 0.312702 Jul 31 01:34:19.347935 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2359/4734] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:19 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1335 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:19.550932 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-71a2cf5c-5c65-416a-9e18-5e88893daccc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:19.559922 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-71a2cf5c-5c65-416a-9e18-5e88893daccc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.334588 Jul 31 01:34:19.574140 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2376/4735] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:19 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:20.354024 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f8ced203-9dad-4478-9052-723be9a5ca58 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:20.354644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f8ced203-9dad-4478-9052-723be9a5ca58 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:20.365965 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8ced203-9dad-4478-9052-723be9a5ca58 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:20.366427 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8ced203-9dad-4478-9052-723be9a5ca58 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:20.367237 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8ced203-9dad-4478-9052-723be9a5ca58 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:20.367817 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8ced203-9dad-4478-9052-723be9a5ca58 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:20.576895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f8ced203-9dad-4478-9052-723be9a5ca58 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:20.585354 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-41658ac6-a993-4062-8a9c-33653fbbbf54 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:20.588483 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-41658ac6-a993-4062-8a9c-33653fbbbf54 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:20.609763 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-41658ac6-a993-4062-8a9c-33653fbbbf54 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:20.610355 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-41658ac6-a993-4062-8a9c-33653fbbbf54 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:20.614043 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f8ced203-9dad-4478-9052-723be9a5ca58 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:20.625653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-41658ac6-a993-4062-8a9c-33653fbbbf54 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:20.629891 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-41658ac6-a993-4062-8a9c-33653fbbbf54 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:20.630382 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f8ced203-9dad-4478-9052-723be9a5ca58 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:20.637485 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f8ced203-9dad-4478-9052-723be9a5ca58 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1356 microversion: 2.57 time: 0.284722 Jul 31 01:34:20.639139 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2360/4736] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:20 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1356 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:20.672936 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "0f306572-729b-4b95-a357-79461887e541"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:34:20.687722 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:20.700645 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:20.702777 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:20.704093 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:20.707501 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:20.832555 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:20.869909 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:34:20.872702 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:34:20.873754 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:34:20.875900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:34:20.877659 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:34:21.016398 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:21.029968 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:21.033454 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:21.037510 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:21.038353 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:21.104152 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bfb4d582-4e70-4c99-8a37-d0a5811b6769 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "POST /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc/action" status: 202 len: 1137 microversion: 2.57 time: 0.439896 Jul 31 01:34:21.106799 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2361/4737] 10.222.0.45 () {62 vars in 1320 bytes} [Sun Jul 31 01:34:20 2022] POST /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc/action => generated 1137 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 31 01:34:21.144742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4847d15a-22e6-48d3-8cc4-275e92971120 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:21.146572 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4847d15a-22e6-48d3-8cc4-275e92971120 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:21.160795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4847d15a-22e6-48d3-8cc4-275e92971120 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:21.162772 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4847d15a-22e6-48d3-8cc4-275e92971120 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:21.165073 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4847d15a-22e6-48d3-8cc4-275e92971120 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:21.165847 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4847d15a-22e6-48d3-8cc4-275e92971120 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:21.256000 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4847d15a-22e6-48d3-8cc4-275e92971120 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:21.271322 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4847d15a-22e6-48d3-8cc4-275e92971120 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:21.273100 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4847d15a-22e6-48d3-8cc4-275e92971120 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:21.278578 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4847d15a-22e6-48d3-8cc4-275e92971120 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.147975 Jul 31 01:34:21.279165 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2362/4738] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:21 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:21.537176 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-41658ac6-a993-4062-8a9c-33653fbbbf54 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:21.548460 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-41658ac6-a993-4062-8a9c-33653fbbbf54 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.970109 Jul 31 01:34:21.577078 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2377/4739] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:20 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:22.308131 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dee72360-3ba9-4adf-a984-1479cb803985 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:22.308767 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dee72360-3ba9-4adf-a984-1479cb803985 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:22.324197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dee72360-3ba9-4adf-a984-1479cb803985 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:22.324940 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dee72360-3ba9-4adf-a984-1479cb803985 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:22.325483 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dee72360-3ba9-4adf-a984-1479cb803985 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:22.326311 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dee72360-3ba9-4adf-a984-1479cb803985 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:22.436918 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dee72360-3ba9-4adf-a984-1479cb803985 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:22.447146 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dee72360-3ba9-4adf-a984-1479cb803985 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:22.449019 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dee72360-3ba9-4adf-a984-1479cb803985 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:22.450431 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dee72360-3ba9-4adf-a984-1479cb803985 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.147361 Jul 31 01:34:22.463368 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2363/4740] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:22 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:22.584860 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0837e7dc-c3c6-45a0-a6a8-43caf9934dab tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:22.585715 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0837e7dc-c3c6-45a0-a6a8-43caf9934dab tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:22.599734 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:22.603406 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0837e7dc-c3c6-45a0-a6a8-43caf9934dab tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:22.603406 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0837e7dc-c3c6-45a0-a6a8-43caf9934dab tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:22.603406 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0837e7dc-c3c6-45a0-a6a8-43caf9934dab tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:22.608139 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0837e7dc-c3c6-45a0-a6a8-43caf9934dab tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:23.108638 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0837e7dc-c3c6-45a0-a6a8-43caf9934dab tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:23.121366 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0837e7dc-c3c6-45a0-a6a8-43caf9934dab tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.538885 Jul 31 01:34:23.123089 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2378/4741] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:22 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:23.479739 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2e466717-4070-4a9c-93e8-c52638005c22 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:23.481081 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2e466717-4070-4a9c-93e8-c52638005c22 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:23.494149 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e466717-4070-4a9c-93e8-c52638005c22 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:23.500131 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e466717-4070-4a9c-93e8-c52638005c22 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:23.501395 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e466717-4070-4a9c-93e8-c52638005c22 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:23.502312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e466717-4070-4a9c-93e8-c52638005c22 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:23.947254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2e466717-4070-4a9c-93e8-c52638005c22 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:23.956812 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2e466717-4070-4a9c-93e8-c52638005c22 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:23.959184 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2e466717-4070-4a9c-93e8-c52638005c22 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:23.961146 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2e466717-4070-4a9c-93e8-c52638005c22 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.489611 Jul 31 01:34:23.962519 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2364/4742] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:23 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:24.155050 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3ec53d61-d121-4716-b399-b5e3d857e8e1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:24.155759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3ec53d61-d121-4716-b399-b5e3d857e8e1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:24.189240 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ec53d61-d121-4716-b399-b5e3d857e8e1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:24.195826 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ec53d61-d121-4716-b399-b5e3d857e8e1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:24.197075 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ec53d61-d121-4716-b399-b5e3d857e8e1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:24.200871 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ec53d61-d121-4716-b399-b5e3d857e8e1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:24.883030 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3ec53d61-d121-4716-b399-b5e3d857e8e1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:24.885261 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:24.895711 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3ec53d61-d121-4716-b399-b5e3d857e8e1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.748312 Jul 31 01:34:24.903646 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2379/4743] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:24 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:24.988135 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-06bcba5f-3115-4511-87cd-852ec03417ea tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:24.988756 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-06bcba5f-3115-4511-87cd-852ec03417ea tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:24.997146 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06bcba5f-3115-4511-87cd-852ec03417ea tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:24.997815 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06bcba5f-3115-4511-87cd-852ec03417ea tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:24.999251 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06bcba5f-3115-4511-87cd-852ec03417ea tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:25.000457 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06bcba5f-3115-4511-87cd-852ec03417ea tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:25.179739 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-06bcba5f-3115-4511-87cd-852ec03417ea tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:25.192611 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-06bcba5f-3115-4511-87cd-852ec03417ea tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:25.194674 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-06bcba5f-3115-4511-87cd-852ec03417ea tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:25.196160 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-06bcba5f-3115-4511-87cd-852ec03417ea tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.213495 Jul 31 01:34:25.197214 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2365/4744] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:24 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:25.924542 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b6f081d0-211b-4046-810f-d9ed4f1d6715 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:25.925347 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b6f081d0-211b-4046-810f-d9ed4f1d6715 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:25.927542 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:25.941357 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6f081d0-211b-4046-810f-d9ed4f1d6715 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:25.942798 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6f081d0-211b-4046-810f-d9ed4f1d6715 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:25.945703 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6f081d0-211b-4046-810f-d9ed4f1d6715 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:25.946265 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6f081d0-211b-4046-810f-d9ed4f1d6715 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:25.955036 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=95 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:26.221455 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-05156ac6-e948-44aa-9704-09b3a4ce52bd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:26.222799 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-05156ac6-e948-44aa-9704-09b3a4ce52bd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:26.230645 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:26.235732 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-05156ac6-e948-44aa-9704-09b3a4ce52bd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:26.242275 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-05156ac6-e948-44aa-9704-09b3a4ce52bd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:26.243551 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-05156ac6-e948-44aa-9704-09b3a4ce52bd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:26.244458 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-05156ac6-e948-44aa-9704-09b3a4ce52bd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:26.415384 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-05156ac6-e948-44aa-9704-09b3a4ce52bd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:26.428508 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-05156ac6-e948-44aa-9704-09b3a4ce52bd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:26.433955 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-05156ac6-e948-44aa-9704-09b3a4ce52bd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:26.437623 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-05156ac6-e948-44aa-9704-09b3a4ce52bd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.220160 Jul 31 01:34:26.439769 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2366/4745] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:26 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:34:26.498011 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b6f081d0-211b-4046-810f-d9ed4f1d6715 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:26.512000 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b6f081d0-211b-4046-810f-d9ed4f1d6715 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.588064 Jul 31 01:34:26.523445 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2380/4746] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:25 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:27.471697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0323ccf2-c604-4ce6-82dd-ef87d94e33a2 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:27.472251 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0323ccf2-c604-4ce6-82dd-ef87d94e33a2 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:27.485324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0323ccf2-c604-4ce6-82dd-ef87d94e33a2 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:27.487211 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0323ccf2-c604-4ce6-82dd-ef87d94e33a2 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:27.488226 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0323ccf2-c604-4ce6-82dd-ef87d94e33a2 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:27.491281 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0323ccf2-c604-4ce6-82dd-ef87d94e33a2 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:27.544750 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ea815742-3d15-41e3-a959-e00f55a24cf0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:27.545380 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ea815742-3d15-41e3-a959-e00f55a24cf0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:27.558890 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ea815742-3d15-41e3-a959-e00f55a24cf0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:27.559375 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ea815742-3d15-41e3-a959-e00f55a24cf0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:27.563026 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ea815742-3d15-41e3-a959-e00f55a24cf0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:27.563495 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ea815742-3d15-41e3-a959-e00f55a24cf0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:27.843234 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0323ccf2-c604-4ce6-82dd-ef87d94e33a2 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:27.859972 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0323ccf2-c604-4ce6-82dd-ef87d94e33a2 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:27.865011 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0323ccf2-c604-4ce6-82dd-ef87d94e33a2 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:27.868938 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0323ccf2-c604-4ce6-82dd-ef87d94e33a2 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.401256 Jul 31 01:34:27.879491 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2367/4747] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:27 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:28.762984 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ea815742-3d15-41e3-a959-e00f55a24cf0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:28.776014 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ea815742-3d15-41e3-a959-e00f55a24cf0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 1.240347 Jul 31 01:34:28.780076 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2381/4748] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:27 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:28.896602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7196128a-721c-4899-8d33-4cd81f813fb5 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:28.898512 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7196128a-721c-4899-8d33-4cd81f813fb5 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:28.912880 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7196128a-721c-4899-8d33-4cd81f813fb5 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:28.914447 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7196128a-721c-4899-8d33-4cd81f813fb5 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:28.915932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7196128a-721c-4899-8d33-4cd81f813fb5 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:28.917128 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7196128a-721c-4899-8d33-4cd81f813fb5 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:29.103438 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7196128a-721c-4899-8d33-4cd81f813fb5 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:29.128033 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7196128a-721c-4899-8d33-4cd81f813fb5 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:29.141944 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7196128a-721c-4899-8d33-4cd81f813fb5 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:29.143410 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7196128a-721c-4899-8d33-4cd81f813fb5 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.252833 Jul 31 01:34:29.159367 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2368/4749] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:28 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:29.809884 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2b075815-510d-446c-9c88-5fe3fbf7ed7f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:29.810513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2b075815-510d-446c-9c88-5fe3fbf7ed7f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:29.822480 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b075815-510d-446c-9c88-5fe3fbf7ed7f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:29.823270 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b075815-510d-446c-9c88-5fe3fbf7ed7f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:29.832896 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b075815-510d-446c-9c88-5fe3fbf7ed7f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:29.834047 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b075815-510d-446c-9c88-5fe3fbf7ed7f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:30.172752 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6af1f01a-2776-41aa-82a6-cc3a91472ece tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:30.173931 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6af1f01a-2776-41aa-82a6-cc3a91472ece tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:30.194339 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6af1f01a-2776-41aa-82a6-cc3a91472ece tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:30.195115 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6af1f01a-2776-41aa-82a6-cc3a91472ece tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:30.196816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6af1f01a-2776-41aa-82a6-cc3a91472ece tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:30.197437 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6af1f01a-2776-41aa-82a6-cc3a91472ece tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:30.363535 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2b075815-510d-446c-9c88-5fe3fbf7ed7f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:30.372199 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2b075815-510d-446c-9c88-5fe3fbf7ed7f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.566146 Jul 31 01:34:30.372785 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2382/4750] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:29 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:30.405453 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6af1f01a-2776-41aa-82a6-cc3a91472ece tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:30.441995 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6af1f01a-2776-41aa-82a6-cc3a91472ece tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:30.445741 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6af1f01a-2776-41aa-82a6-cc3a91472ece tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:30.449948 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6af1f01a-2776-41aa-82a6-cc3a91472ece tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.282239 Jul 31 01:34:30.454019 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2369/4751] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:30 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:31.394501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bd5f680b-c670-4fd6-b0a0-49fabfffe367 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:31.395142 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bd5f680b-c670-4fd6-b0a0-49fabfffe367 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:31.421417 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd5f680b-c670-4fd6-b0a0-49fabfffe367 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:31.422830 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd5f680b-c670-4fd6-b0a0-49fabfffe367 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:31.425118 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd5f680b-c670-4fd6-b0a0-49fabfffe367 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:31.428010 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd5f680b-c670-4fd6-b0a0-49fabfffe367 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:31.477704 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7b145272-77b2-472d-be79-4623719ab501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:31.480912 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7b145272-77b2-472d-be79-4623719ab501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:31.527966 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b145272-77b2-472d-be79-4623719ab501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:31.528441 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b145272-77b2-472d-be79-4623719ab501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:31.545731 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b145272-77b2-472d-be79-4623719ab501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:31.546998 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b145272-77b2-472d-be79-4623719ab501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:31.803625 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7b145272-77b2-472d-be79-4623719ab501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:31.819581 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7b145272-77b2-472d-be79-4623719ab501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:31.824350 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7b145272-77b2-472d-be79-4623719ab501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:31.827007 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7b145272-77b2-472d-be79-4623719ab501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.353128 Jul 31 01:34:31.829510 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2370/4752] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:31 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:31.884625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bd5f680b-c670-4fd6-b0a0-49fabfffe367 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:31.895082 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bd5f680b-c670-4fd6-b0a0-49fabfffe367 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.504669 Jul 31 01:34:31.896616 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2383/4753] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:31 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:32.858277 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1eca56e8-e585-44fd-9294-c85301c41823 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:32.860134 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1eca56e8-e585-44fd-9294-c85301c41823 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:32.877874 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1eca56e8-e585-44fd-9294-c85301c41823 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:32.879612 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1eca56e8-e585-44fd-9294-c85301c41823 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:32.881998 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1eca56e8-e585-44fd-9294-c85301c41823 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:32.883352 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1eca56e8-e585-44fd-9294-c85301c41823 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:32.916920 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e9b7e6b-d3cd-4cfa-a8d5-3126a8f3b291 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:32.918148 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3e9b7e6b-d3cd-4cfa-a8d5-3126a8f3b291 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:32.938672 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e9b7e6b-d3cd-4cfa-a8d5-3126a8f3b291 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:32.941655 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e9b7e6b-d3cd-4cfa-a8d5-3126a8f3b291 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:32.942565 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e9b7e6b-d3cd-4cfa-a8d5-3126a8f3b291 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:32.943031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e9b7e6b-d3cd-4cfa-a8d5-3126a8f3b291 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:33.489659 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1eca56e8-e585-44fd-9294-c85301c41823 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:33.509148 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1eca56e8-e585-44fd-9294-c85301c41823 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:33.513085 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1eca56e8-e585-44fd-9294-c85301c41823 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:33.514439 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1eca56e8-e585-44fd-9294-c85301c41823 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.661545 Jul 31 01:34:33.516543 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2371/4754] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:32 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:33.735802 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e9b7e6b-d3cd-4cfa-a8d5-3126a8f3b291 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:33.746363 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3e9b7e6b-d3cd-4cfa-a8d5-3126a8f3b291 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.833374 Jul 31 01:34:33.764596 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2384/4755] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:32 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:34:34.541780 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2bebe333-7da0-4e0d-8ec0-0163b163848e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:34.542521 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2bebe333-7da0-4e0d-8ec0-0163b163848e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:34.588264 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2bebe333-7da0-4e0d-8ec0-0163b163848e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:34.592202 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2bebe333-7da0-4e0d-8ec0-0163b163848e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:34.610787 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2bebe333-7da0-4e0d-8ec0-0163b163848e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:34.612061 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2bebe333-7da0-4e0d-8ec0-0163b163848e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:34.773737 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-11496872-44ca-4e16-b4c0-b90fe55de08c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:34.774373 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-11496872-44ca-4e16-b4c0-b90fe55de08c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:34.780277 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2bebe333-7da0-4e0d-8ec0-0163b163848e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:34.786117 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-11496872-44ca-4e16-b4c0-b90fe55de08c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:34.786589 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-11496872-44ca-4e16-b4c0-b90fe55de08c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:34.788608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-11496872-44ca-4e16-b4c0-b90fe55de08c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:34.789076 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-11496872-44ca-4e16-b4c0-b90fe55de08c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:34.791855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2bebe333-7da0-4e0d-8ec0-0163b163848e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:34.802672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2bebe333-7da0-4e0d-8ec0-0163b163848e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:34.810753 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2bebe333-7da0-4e0d-8ec0-0163b163848e tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.269181 Jul 31 01:34:34.832355 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2372/4756] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:34 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:34:35.822611 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-11496872-44ca-4e16-b4c0-b90fe55de08c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:35.837754 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-11496872-44ca-4e16-b4c0-b90fe55de08c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 1.068277 Jul 31 01:34:35.838854 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2385/4757] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:34 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:34:35.850228 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8ee5e5c3-3285-493c-a2ca-a5bec0900abd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:35.855447 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8ee5e5c3-3285-493c-a2ca-a5bec0900abd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:35.875740 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ee5e5c3-3285-493c-a2ca-a5bec0900abd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:35.876670 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ee5e5c3-3285-493c-a2ca-a5bec0900abd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:35.878449 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ee5e5c3-3285-493c-a2ca-a5bec0900abd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:35.879074 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ee5e5c3-3285-493c-a2ca-a5bec0900abd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:36.078117 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8ee5e5c3-3285-493c-a2ca-a5bec0900abd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:36.097316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8ee5e5c3-3285-493c-a2ca-a5bec0900abd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:36.099120 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8ee5e5c3-3285-493c-a2ca-a5bec0900abd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:36.101340 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8ee5e5c3-3285-493c-a2ca-a5bec0900abd tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.267163 Jul 31 01:34:36.102401 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2373/4758] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:35 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:34:36.874393 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-856bd3ef-0c07-4d52-8874-433ec129fd76 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:36.875028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-856bd3ef-0c07-4d52-8874-433ec129fd76 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:36.897135 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-856bd3ef-0c07-4d52-8874-433ec129fd76 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:36.897920 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-856bd3ef-0c07-4d52-8874-433ec129fd76 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:36.898905 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-856bd3ef-0c07-4d52-8874-433ec129fd76 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:36.902305 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-856bd3ef-0c07-4d52-8874-433ec129fd76 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:37.130860 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fcf21067-7fd6-4545-b443-fcf7f3ad5db4 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:37.131735 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fcf21067-7fd6-4545-b443-fcf7f3ad5db4 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:37.153751 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcf21067-7fd6-4545-b443-fcf7f3ad5db4 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:37.158020 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcf21067-7fd6-4545-b443-fcf7f3ad5db4 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:37.160932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcf21067-7fd6-4545-b443-fcf7f3ad5db4 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:37.163132 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcf21067-7fd6-4545-b443-fcf7f3ad5db4 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:37.266091 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-856bd3ef-0c07-4d52-8874-433ec129fd76 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:37.281983 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-856bd3ef-0c07-4d52-8874-433ec129fd76 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.420495 Jul 31 01:34:37.299163 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2386/4759] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:36 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:37.390703 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fcf21067-7fd6-4545-b443-fcf7f3ad5db4 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:37.404310 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fcf21067-7fd6-4545-b443-fcf7f3ad5db4 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:37.406695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fcf21067-7fd6-4545-b443-fcf7f3ad5db4 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:37.408323 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fcf21067-7fd6-4545-b443-fcf7f3ad5db4 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.285620 Jul 31 01:34:37.409565 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2374/4760] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:37 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:38.307332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-73d0d616-cb5a-42d7-9706-a75f3013fe61 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:38.309520 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-73d0d616-cb5a-42d7-9706-a75f3013fe61 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:38.323545 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73d0d616-cb5a-42d7-9706-a75f3013fe61 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:38.327859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73d0d616-cb5a-42d7-9706-a75f3013fe61 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:38.332262 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73d0d616-cb5a-42d7-9706-a75f3013fe61 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:38.334919 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73d0d616-cb5a-42d7-9706-a75f3013fe61 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:38.452740 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-22b45256-09f7-42da-92d0-8070cb682cff tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:38.454350 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-22b45256-09f7-42da-92d0-8070cb682cff tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:38.470177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22b45256-09f7-42da-92d0-8070cb682cff tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:38.470702 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22b45256-09f7-42da-92d0-8070cb682cff tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:38.471615 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22b45256-09f7-42da-92d0-8070cb682cff tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:38.472248 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22b45256-09f7-42da-92d0-8070cb682cff tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:38.748738 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-22b45256-09f7-42da-92d0-8070cb682cff tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:38.771781 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-22b45256-09f7-42da-92d0-8070cb682cff tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:38.773696 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-22b45256-09f7-42da-92d0-8070cb682cff tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:38.774985 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-22b45256-09f7-42da-92d0-8070cb682cff tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.346064 Jul 31 01:34:38.777543 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2375/4761] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:38 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:34:39.069650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-73d0d616-cb5a-42d7-9706-a75f3013fe61 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:39.084652 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-73d0d616-cb5a-42d7-9706-a75f3013fe61 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1508 microversion: 2.1 time: 0.782554 Jul 31 01:34:39.088503 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2387/4762] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:38 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1508 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:39.805269 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7a93a33f-ed10-4031-abae-6c0ae379a9b3 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:39.806682 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7a93a33f-ed10-4031-abae-6c0ae379a9b3 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:39.828516 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a93a33f-ed10-4031-abae-6c0ae379a9b3 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:39.829104 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a93a33f-ed10-4031-abae-6c0ae379a9b3 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:39.836542 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a93a33f-ed10-4031-abae-6c0ae379a9b3 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:39.840385 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7a93a33f-ed10-4031-abae-6c0ae379a9b3 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:39.869778 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:39.984199 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7a93a33f-ed10-4031-abae-6c0ae379a9b3 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:39.994707 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7a93a33f-ed10-4031-abae-6c0ae379a9b3 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:39.998055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7a93a33f-ed10-4031-abae-6c0ae379a9b3 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:39.999268 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7a93a33f-ed10-4031-abae-6c0ae379a9b3 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.198402 Jul 31 01:34:39.999864 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2376/4763] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:39 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:34:40.111445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-117de4f3-b13a-4d1b-a941-f327500a1da9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:40.113202 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-117de4f3-b13a-4d1b-a941-f327500a1da9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:40.126564 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-117de4f3-b13a-4d1b-a941-f327500a1da9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:40.127932 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-117de4f3-b13a-4d1b-a941-f327500a1da9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:40.128937 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-117de4f3-b13a-4d1b-a941-f327500a1da9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:40.129562 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-117de4f3-b13a-4d1b-a941-f327500a1da9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:40.661924 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-117de4f3-b13a-4d1b-a941-f327500a1da9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:40.669707 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-117de4f3-b13a-4d1b-a941-f327500a1da9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1529 microversion: 2.1 time: 0.564551 Jul 31 01:34:40.674876 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2388/4764] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:40 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1529 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:41.027233 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-34b1b496-d2c3-4a1b-a7ad-d03831dfd1a9 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:41.032031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-34b1b496-d2c3-4a1b-a7ad-d03831dfd1a9 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:41.051416 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-34b1b496-d2c3-4a1b-a7ad-d03831dfd1a9 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:41.072109 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-34b1b496-d2c3-4a1b-a7ad-d03831dfd1a9 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:41.073412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-34b1b496-d2c3-4a1b-a7ad-d03831dfd1a9 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:41.074049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-34b1b496-d2c3-4a1b-a7ad-d03831dfd1a9 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:41.267613 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-34b1b496-d2c3-4a1b-a7ad-d03831dfd1a9 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:41.281123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-34b1b496-d2c3-4a1b-a7ad-d03831dfd1a9 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:41.281987 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-34b1b496-d2c3-4a1b-a7ad-d03831dfd1a9 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:41.283213 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-34b1b496-d2c3-4a1b-a7ad-d03831dfd1a9 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.259893 Jul 31 01:34:41.288852 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2377/4765] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:41 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:41.692697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-25c132c5-835f-4e4f-87c8-ee1b9fa1a76e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:41.694018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-25c132c5-835f-4e4f-87c8-ee1b9fa1a76e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:41.730843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25c132c5-835f-4e4f-87c8-ee1b9fa1a76e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:41.733264 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25c132c5-835f-4e4f-87c8-ee1b9fa1a76e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:41.734235 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25c132c5-835f-4e4f-87c8-ee1b9fa1a76e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:41.735869 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25c132c5-835f-4e4f-87c8-ee1b9fa1a76e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:42.315718 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-43a3a99f-5830-4b29-b655-c24c35318174 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:42.317185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-43a3a99f-5830-4b29-b655-c24c35318174 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:42.338239 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43a3a99f-5830-4b29-b655-c24c35318174 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:42.339016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43a3a99f-5830-4b29-b655-c24c35318174 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:42.346687 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43a3a99f-5830-4b29-b655-c24c35318174 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:42.347630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43a3a99f-5830-4b29-b655-c24c35318174 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:42.356440 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-25c132c5-835f-4e4f-87c8-ee1b9fa1a76e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:42.366351 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-25c132c5-835f-4e4f-87c8-ee1b9fa1a76e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 0.678871 Jul 31 01:34:42.379630 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2389/4766] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:41 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:42.745223 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-43a3a99f-5830-4b29-b655-c24c35318174 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:42.754099 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-43a3a99f-5830-4b29-b655-c24c35318174 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:42.755647 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-43a3a99f-5830-4b29-b655-c24c35318174 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:42.756867 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-43a3a99f-5830-4b29-b655-c24c35318174 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.446717 Jul 31 01:34:42.781349 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2378/4767] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:42 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:34:43.409146 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-456d3292-c21c-4460-8afa-163e0566f2b5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:43.412250 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-456d3292-c21c-4460-8afa-163e0566f2b5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:43.428889 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-456d3292-c21c-4460-8afa-163e0566f2b5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:43.440969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-456d3292-c21c-4460-8afa-163e0566f2b5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:43.442008 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-456d3292-c21c-4460-8afa-163e0566f2b5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:43.442728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-456d3292-c21c-4460-8afa-163e0566f2b5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:43.784188 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-70b32179-4a53-4e1a-ac3b-fe8db6f8da00 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:43.789155 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-70b32179-4a53-4e1a-ac3b-fe8db6f8da00 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:43.814293 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70b32179-4a53-4e1a-ac3b-fe8db6f8da00 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:43.814739 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70b32179-4a53-4e1a-ac3b-fe8db6f8da00 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:43.818299 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70b32179-4a53-4e1a-ac3b-fe8db6f8da00 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:43.826871 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70b32179-4a53-4e1a-ac3b-fe8db6f8da00 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:44.100240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-70b32179-4a53-4e1a-ac3b-fe8db6f8da00 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:44.136957 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-456d3292-c21c-4460-8afa-163e0566f2b5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:44.163264 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-456d3292-c21c-4460-8afa-163e0566f2b5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 0.760039 Jul 31 01:34:44.163264 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2390/4768] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:43 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:44.210629 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-70b32179-4a53-4e1a-ac3b-fe8db6f8da00 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:44.231091 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-70b32179-4a53-4e1a-ac3b-fe8db6f8da00 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:44.240605 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-70b32179-4a53-4e1a-ac3b-fe8db6f8da00 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.456787 Jul 31 01:34:44.256286 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2379/4769] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:43 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:34:44.308445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-50ec0bde-bfc6-4b66-9331-32be437f4fa6 req-ca12e3f8-0cee-4282-9fd1-2801b6bd20d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3ee80f-59a8-4a65-b305-41ad15d38703", "name": "network-vif-plugged", "status": "completed", "tag": "940a48a2-7107-4216-b0a3-3b305d1caa68"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:34:44.346065 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-50ec0bde-bfc6-4b66-9331-32be437f4fa6 req-ca12e3f8-0cee-4282-9fd1-2801b6bd20d0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:44.347759 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-50ec0bde-bfc6-4b66-9331-32be437f4fa6 req-ca12e3f8-0cee-4282-9fd1-2801b6bd20d0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:44.382097 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-50ec0bde-bfc6-4b66-9331-32be437f4fa6 req-ca12e3f8-0cee-4282-9fd1-2801b6bd20d0 service nova] Creating event network-vif-plugged:940a48a2-7107-4216-b0a3-3b305d1caa68 for instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 on n-h1-master-1 Jul 31 01:34:44.393332 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-50ec0bde-bfc6-4b66-9331-32be437f4fa6 req-ca12e3f8-0cee-4282-9fd1-2801b6bd20d0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091049 Jul 31 01:34:44.396866 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2391/4770] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:34:45.182953 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3b22408b-0dc3-4fae-830a-97bb449eeee9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:45.183625 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3b22408b-0dc3-4fae-830a-97bb449eeee9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:45.195915 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b22408b-0dc3-4fae-830a-97bb449eeee9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:45.196372 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b22408b-0dc3-4fae-830a-97bb449eeee9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:45.197181 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b22408b-0dc3-4fae-830a-97bb449eeee9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:45.197614 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b22408b-0dc3-4fae-830a-97bb449eeee9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:45.270971 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f8d21e2f-124b-4af6-8bf7-728ca4628bbc tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:45.271784 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f8d21e2f-124b-4af6-8bf7-728ca4628bbc tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:45.284732 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8d21e2f-124b-4af6-8bf7-728ca4628bbc tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:45.294745 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8d21e2f-124b-4af6-8bf7-728ca4628bbc tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:45.305493 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8d21e2f-124b-4af6-8bf7-728ca4628bbc tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:45.306483 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8d21e2f-124b-4af6-8bf7-728ca4628bbc tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:45.570887 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f8d21e2f-124b-4af6-8bf7-728ca4628bbc tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:45.583527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b22408b-0dc3-4fae-830a-97bb449eeee9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:45.597520 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3b22408b-0dc3-4fae-830a-97bb449eeee9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 0.419191 Jul 31 01:34:45.598623 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f8d21e2f-124b-4af6-8bf7-728ca4628bbc tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:45.599117 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2380/4771] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:45 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:45.605161 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f8d21e2f-124b-4af6-8bf7-728ca4628bbc tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:45.613742 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f8d21e2f-124b-4af6-8bf7-728ca4628bbc tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.347350 Jul 31 01:34:45.628361 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2392/4772] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:45 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:46.618125 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-155e5cdb-8376-48ad-8163-a30ac2a09db6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:46.618753 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-155e5cdb-8376-48ad-8163-a30ac2a09db6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:46.626635 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-155e5cdb-8376-48ad-8163-a30ac2a09db6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:46.637988 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b57f0a99-7e1c-4278-ba71-a6b695447c75 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:46.638619 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b57f0a99-7e1c-4278-ba71-a6b695447c75 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:46.652918 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-155e5cdb-8376-48ad-8163-a30ac2a09db6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:46.653865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-155e5cdb-8376-48ad-8163-a30ac2a09db6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:46.654332 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-155e5cdb-8376-48ad-8163-a30ac2a09db6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:46.671130 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b57f0a99-7e1c-4278-ba71-a6b695447c75 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:46.671130 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b57f0a99-7e1c-4278-ba71-a6b695447c75 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:46.686851 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b57f0a99-7e1c-4278-ba71-a6b695447c75 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:46.690278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b57f0a99-7e1c-4278-ba71-a6b695447c75 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:47.524553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b57f0a99-7e1c-4278-ba71-a6b695447c75 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:47.536328 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b57f0a99-7e1c-4278-ba71-a6b695447c75 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:47.537834 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b57f0a99-7e1c-4278-ba71-a6b695447c75 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:47.556925 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b57f0a99-7e1c-4278-ba71-a6b695447c75 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1365 microversion: 2.57 time: 0.922757 Jul 31 01:34:47.557606 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2393/4773] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:46 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1365 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:34:48.052430 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-155e5cdb-8376-48ad-8163-a30ac2a09db6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:48.071757 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-155e5cdb-8376-48ad-8163-a30ac2a09db6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 1.446392 Jul 31 01:34:48.085945 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2381/4774] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:46 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:48.583040 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4f9234be-644e-4580-ae81-7323a87263bb tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:48.585002 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4f9234be-644e-4580-ae81-7323a87263bb tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:48.602296 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f9234be-644e-4580-ae81-7323a87263bb tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:48.603152 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f9234be-644e-4580-ae81-7323a87263bb tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:48.604220 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f9234be-644e-4580-ae81-7323a87263bb tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:48.604893 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f9234be-644e-4580-ae81-7323a87263bb tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:49.062517 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4f9234be-644e-4580-ae81-7323a87263bb tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:49.071434 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4f9234be-644e-4580-ae81-7323a87263bb tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:49.094650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4f9234be-644e-4580-ae81-7323a87263bb tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:49.100441 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-87eb2699-f10a-4ee8-a78a-2eff387e5061 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:49.101720 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-87eb2699-f10a-4ee8-a78a-2eff387e5061 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:49.104959 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=52 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:49.110136 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4f9234be-644e-4580-ae81-7323a87263bb tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1371 microversion: 2.57 time: 0.515514 Jul 31 01:34:49.111095 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2394/4775] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:48 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1371 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:49.133057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87eb2699-f10a-4ee8-a78a-2eff387e5061 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:49.133900 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87eb2699-f10a-4ee8-a78a-2eff387e5061 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:49.134913 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87eb2699-f10a-4ee8-a78a-2eff387e5061 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:49.137558 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87eb2699-f10a-4ee8-a78a-2eff387e5061 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:49.813615 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-87eb2699-f10a-4ee8-a78a-2eff387e5061 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:49.828909 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-87eb2699-f10a-4ee8-a78a-2eff387e5061 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 0.729198 Jul 31 01:34:49.829555 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2382/4776] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:49 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:34:50.149140 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-01253512-374b-4b9d-a4f3-6b1bf851ba28 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:50.150552 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-01253512-374b-4b9d-a4f3-6b1bf851ba28 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:50.159823 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01253512-374b-4b9d-a4f3-6b1bf851ba28 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:50.160682 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01253512-374b-4b9d-a4f3-6b1bf851ba28 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:50.161669 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01253512-374b-4b9d-a4f3-6b1bf851ba28 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:50.162323 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01253512-374b-4b9d-a4f3-6b1bf851ba28 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:50.491957 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-01253512-374b-4b9d-a4f3-6b1bf851ba28 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:50.504620 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-01253512-374b-4b9d-a4f3-6b1bf851ba28 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:50.511715 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-01253512-374b-4b9d-a4f3-6b1bf851ba28 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:50.513287 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-01253512-374b-4b9d-a4f3-6b1bf851ba28 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1371 microversion: 2.57 time: 0.378477 Jul 31 01:34:50.514564 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2395/4777] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:50 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1371 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:34:50.875327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-405337c2-a83b-4fe3-aa7e-783979871548 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:50.877328 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-405337c2-a83b-4fe3-aa7e-783979871548 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:50.888442 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-405337c2-a83b-4fe3-aa7e-783979871548 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:50.892029 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-405337c2-a83b-4fe3-aa7e-783979871548 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:50.893262 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-405337c2-a83b-4fe3-aa7e-783979871548 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:50.894890 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-405337c2-a83b-4fe3-aa7e-783979871548 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:51.357856 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-405337c2-a83b-4fe3-aa7e-783979871548 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:51.374338 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-405337c2-a83b-4fe3-aa7e-783979871548 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 0.503839 Jul 31 01:34:51.393991 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2383/4778] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:50 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:51.549740 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eacb261b-e2e5-4eff-9a78-04e569f6f96c tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:51.550373 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eacb261b-e2e5-4eff-9a78-04e569f6f96c tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:51.562953 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eacb261b-e2e5-4eff-9a78-04e569f6f96c tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:51.564442 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eacb261b-e2e5-4eff-9a78-04e569f6f96c tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:51.567287 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eacb261b-e2e5-4eff-9a78-04e569f6f96c tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:51.567812 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eacb261b-e2e5-4eff-9a78-04e569f6f96c tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:51.783249 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eacb261b-e2e5-4eff-9a78-04e569f6f96c tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:51.791605 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eacb261b-e2e5-4eff-9a78-04e569f6f96c tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:51.797061 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eacb261b-e2e5-4eff-9a78-04e569f6f96c tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:51.805688 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eacb261b-e2e5-4eff-9a78-04e569f6f96c tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1356 microversion: 2.57 time: 0.260050 Jul 31 01:34:51.816595 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2396/4779] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:51 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1356 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:51.851670 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cf2e0bbb-133c-4989-bfd7-6c88cb247507 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:51.852185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cf2e0bbb-133c-4989-bfd7-6c88cb247507 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:51.871900 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf2e0bbb-133c-4989-bfd7-6c88cb247507 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:51.872570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf2e0bbb-133c-4989-bfd7-6c88cb247507 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:51.880477 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf2e0bbb-133c-4989-bfd7-6c88cb247507 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:51.881179 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf2e0bbb-133c-4989-bfd7-6c88cb247507 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:51.970939 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cf2e0bbb-133c-4989-bfd7-6c88cb247507 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:34:52.293846 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cf2e0bbb-133c-4989-bfd7-6c88cb247507 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 204 len: 0 microversion: 2.57 time: 0.444290 Jul 31 01:34:52.296675 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2384/4780] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:34:51 2022] DELETE /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:34:52.305763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-48acd810-161e-4681-bef7-a1f1e006d186 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:52.306653 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-48acd810-161e-4681-bef7-a1f1e006d186 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:52.325033 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48acd810-161e-4681-bef7-a1f1e006d186 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:52.325796 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48acd810-161e-4681-bef7-a1f1e006d186 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:52.327453 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48acd810-161e-4681-bef7-a1f1e006d186 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:52.329703 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48acd810-161e-4681-bef7-a1f1e006d186 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:52.382385 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:52.403314 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0cf0bf28-1389-4ddb-ab39-04d6351349f7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:52.404225 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0cf0bf28-1389-4ddb-ab39-04d6351349f7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:52.429382 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0cf0bf28-1389-4ddb-ab39-04d6351349f7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:52.432663 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0cf0bf28-1389-4ddb-ab39-04d6351349f7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:52.438372 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0cf0bf28-1389-4ddb-ab39-04d6351349f7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:52.441204 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0cf0bf28-1389-4ddb-ab39-04d6351349f7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:52.600306 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-48acd810-161e-4681-bef7-a1f1e006d186 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:52.628080 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-48acd810-161e-4681-bef7-a1f1e006d186 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:52.635975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-48acd810-161e-4681-bef7-a1f1e006d186 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:52.641882 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-48acd810-161e-4681-bef7-a1f1e006d186 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1362 microversion: 2.57 time: 0.340382 Jul 31 01:34:52.642646 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2397/4781] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:52 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:52.818029 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0cf0bf28-1389-4ddb-ab39-04d6351349f7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:52.838338 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0cf0bf28-1389-4ddb-ab39-04d6351349f7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 0.439896 Jul 31 01:34:52.853665 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2385/4782] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:52 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:53.686546 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b6137824-fa32-44fb-b555-77b034ece501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:53.687188 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b6137824-fa32-44fb-b555-77b034ece501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:53.694558 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=40 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:53.718068 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6137824-fa32-44fb-b555-77b034ece501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:53.719979 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6137824-fa32-44fb-b555-77b034ece501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:53.721575 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6137824-fa32-44fb-b555-77b034ece501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:53.723962 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6137824-fa32-44fb-b555-77b034ece501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:53.864505 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c5489082-6cdc-4cfe-9082-c74d75eb97a5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:53.865745 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c5489082-6cdc-4cfe-9082-c74d75eb97a5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:53.881647 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5489082-6cdc-4cfe-9082-c74d75eb97a5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:53.884750 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5489082-6cdc-4cfe-9082-c74d75eb97a5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:53.885877 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5489082-6cdc-4cfe-9082-c74d75eb97a5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:53.888504 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c5489082-6cdc-4cfe-9082-c74d75eb97a5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:53.892634 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b6137824-fa32-44fb-b555-77b034ece501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:53.903451 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b6137824-fa32-44fb-b555-77b034ece501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:53.906081 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b6137824-fa32-44fb-b555-77b034ece501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:53.911027 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b6137824-fa32-44fb-b555-77b034ece501 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1362 microversion: 2.57 time: 0.234068 Jul 31 01:34:53.912881 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2398/4783] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:53 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:54.754031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c5489082-6cdc-4cfe-9082-c74d75eb97a5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:54.762676 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c5489082-6cdc-4cfe-9082-c74d75eb97a5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 0.905404 Jul 31 01:34:54.763265 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2386/4784] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:53 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:54.935939 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0683d1c2-a923-46ac-80c5-a1a82f36c2c6 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:54.936597 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0683d1c2-a923-46ac-80c5-a1a82f36c2c6 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:54.957642 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0683d1c2-a923-46ac-80c5-a1a82f36c2c6 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:54.958117 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0683d1c2-a923-46ac-80c5-a1a82f36c2c6 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:54.958919 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0683d1c2-a923-46ac-80c5-a1a82f36c2c6 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:54.959384 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0683d1c2-a923-46ac-80c5-a1a82f36c2c6 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:55.067848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0683d1c2-a923-46ac-80c5-a1a82f36c2c6 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:55.068703 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0683d1c2-a923-46ac-80c5-a1a82f36c2c6 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:55.069588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-0683d1c2-a923-46ac-80c5-a1a82f36c2c6 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lazy-loading 'fault' on Instance uuid cb1130b6-b038-45ea-9b89-64b130f1b9dc {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:34:55.181228 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0683d1c2-a923-46ac-80c5-a1a82f36c2c6 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:55.208006 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0683d1c2-a923-46ac-80c5-a1a82f36c2c6 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:55.213233 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0683d1c2-a923-46ac-80c5-a1a82f36c2c6 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ebb4530b4cc4b2d91153ce302578c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088eed88a6b140c88a3c3a29dc65dbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:55.225317 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0683d1c2-a923-46ac-80c5-a1a82f36c2c6 tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 200 len: 1367 microversion: 2.57 time: 0.289889 Jul 31 01:34:55.228028 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2399/4785] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:54 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:34:55.784532 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ae5686c5-f3a7-40f2-831e-e7d06cd21795 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:55.785816 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ae5686c5-f3a7-40f2-831e-e7d06cd21795 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:55.809551 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae5686c5-f3a7-40f2-831e-e7d06cd21795 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:55.810317 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae5686c5-f3a7-40f2-831e-e7d06cd21795 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:55.811409 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae5686c5-f3a7-40f2-831e-e7d06cd21795 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:55.812037 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae5686c5-f3a7-40f2-831e-e7d06cd21795 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:56.251684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f86f7b58-6e0f-42da-b901-fd24f6d4e55f tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:56.253048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f86f7b58-6e0f-42da-b901-fd24f6d4e55f tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] [instance: cb1130b6-b038-45ea-9b89-64b130f1b9dc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:56.273652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f86f7b58-6e0f-42da-b901-fd24f6d4e55f tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:56.275743 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f86f7b58-6e0f-42da-b901-fd24f6d4e55f tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:56.278722 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f86f7b58-6e0f-42da-b901-fd24f6d4e55f tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:56.285358 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f86f7b58-6e0f-42da-b901-fd24f6d4e55f tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:56.419446 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-f86f7b58-6e0f-42da-b901-fd24f6d4e55f tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] HTTP exception thrown: Instance cb1130b6-b038-45ea-9b89-64b130f1b9dc could not be found. Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f86f7b58-6e0f-42da-b901-fd24f6d4e55f tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Request method failure captured: Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc HTTP/1.1 Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dwW8eTpXpTi2WQULvHU2pPFD93SFNNt3Hv9ziWFsWfi-IsL_71c_vTwb3MHVqw4cOZd3NIhdbS9gi7OLM4_VBif5k88iD1jWTsIGUw5lKDgcEO7Y_sPrjhS1mYEe0YZwsnpUwF1yOjilX5orHJqGzHFyoKt96MbD6PpXrqSn4yLbqU Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.57 Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 088eed88a6b140c88a3c3a29dc65dbae Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerShowV257Test-520394604 Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/088eed88a6b140c88a3c3a29dc65dbae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/088eed88a6b140c88a3c3a29dc65dbae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/088eed88a6b140c88a3c3a29dc65dbae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_088eed88a6b140c88a3c3a29dc65dbae", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerShowV257Test-520394604 Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 088eed88a6b140c88a3c3a29dc65dbae Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerShowV257Test-520394604 Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerShowV257Test-520394604-project Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 1ebb4530b4cc4b2d91153ce302578c3a Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerShowV257Test-520394604-project Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: exception: Instance cb1130b6-b038-45ea-9b89-64b130f1b9dc could not be found. Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'cb1130b6-b038-45ea-9b89-64b130f1b9dc'} Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb1130b6-b038-45ea-9b89-64b130f1b9dc could not be found. Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb1130b6-b038-45ea-9b89-64b130f1b9dc could not be found. Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:34:56.421478 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:34:56.425715 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:34:56.425715 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:34:56.425715 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:34:56.425715 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:34:56.425715 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:34:56.425715 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb1130b6-b038-45ea-9b89-64b130f1b9dc could not be found. Jul 31 01:34:56.425715 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:34:56.433736 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f86f7b58-6e0f-42da-b901-fd24f6d4e55f tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] Returning 404 to user: Instance cb1130b6-b038-45ea-9b89-64b130f1b9dc could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:34:56.434894 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f86f7b58-6e0f-42da-b901-fd24f6d4e55f tempest-ServerShowV257Test-520394604 tempest-ServerShowV257Test-520394604-project] 10.222.0.45 "GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc" status: 404 len: 111 microversion: 2.57 time: 0.188706 Jul 31 01:34:56.436911 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2400/4786] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:34:56 2022] GET /compute/v2.1/servers/cb1130b6-b038-45ea-9b89-64b130f1b9dc => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:34:56.950139 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ae5686c5-f3a7-40f2-831e-e7d06cd21795 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:56.958700 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ae5686c5-f3a7-40f2-831e-e7d06cd21795 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 1.178629 Jul 31 01:34:56.961930 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2387/4787] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:55 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:57.987400 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-41e61ab5-6350-40e9-a51e-c9180371843c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:57.988034 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-41e61ab5-6350-40e9-a51e-c9180371843c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:58.021426 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-41e61ab5-6350-40e9-a51e-c9180371843c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:58.021898 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-41e61ab5-6350-40e9-a51e-c9180371843c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:58.028747 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-41e61ab5-6350-40e9-a51e-c9180371843c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:58.029326 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-41e61ab5-6350-40e9-a51e-c9180371843c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:58.599700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-41e61ab5-6350-40e9-a51e-c9180371843c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:58.617602 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-41e61ab5-6350-40e9-a51e-c9180371843c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 0.628291 Jul 31 01:34:58.619922 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2401/4788] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:57 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:34:59.655161 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-72ecfd84-7084-4f1b-94b8-40c409de251e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:34:59.655828 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-72ecfd84-7084-4f1b-94b8-40c409de251e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:34:59.671152 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72ecfd84-7084-4f1b-94b8-40c409de251e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:59.671660 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72ecfd84-7084-4f1b-94b8-40c409de251e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:59.675744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72ecfd84-7084-4f1b-94b8-40c409de251e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:34:59.676246 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72ecfd84-7084-4f1b-94b8-40c409de251e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:34:59.916416 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-72ecfd84-7084-4f1b-94b8-40c409de251e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:34:59.931441 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-72ecfd84-7084-4f1b-94b8-40c409de251e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 0.282081 Jul 31 01:34:59.932325 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2388/4789] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:34:59 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:00.952741 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5a420fd0-d40c-4276-bd8d-e1b271617607 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:00.953390 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5a420fd0-d40c-4276-bd8d-e1b271617607 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:00.962556 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a420fd0-d40c-4276-bd8d-e1b271617607 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:01.031976 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a420fd0-d40c-4276-bd8d-e1b271617607 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:01.032892 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a420fd0-d40c-4276-bd8d-e1b271617607 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:01.033973 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a420fd0-d40c-4276-bd8d-e1b271617607 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:01.430564 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5a420fd0-d40c-4276-bd8d-e1b271617607 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:01.448763 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5a420fd0-d40c-4276-bd8d-e1b271617607 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 0.499829 Jul 31 01:35:01.449946 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2402/4790] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:00 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:02.480905 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-353e9dd9-b403-4cd0-8805-bf27da325afe tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:02.481605 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-353e9dd9-b403-4cd0-8805-bf27da325afe tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:02.497655 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-353e9dd9-b403-4cd0-8805-bf27da325afe tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:02.498118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-353e9dd9-b403-4cd0-8805-bf27da325afe tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:02.501289 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-353e9dd9-b403-4cd0-8805-bf27da325afe tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:02.502159 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-353e9dd9-b403-4cd0-8805-bf27da325afe tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:03.056371 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-353e9dd9-b403-4cd0-8805-bf27da325afe tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:03.069225 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-353e9dd9-b403-4cd0-8805-bf27da325afe tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 0.592690 Jul 31 01:35:03.069817 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2389/4791] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:02 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:04.096310 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c5c4e8da-38d6-428c-bfcf-d0c975165f21 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:04.096938 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c5c4e8da-38d6-428c-bfcf-d0c975165f21 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:04.110933 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5c4e8da-38d6-428c-bfcf-d0c975165f21 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:04.122125 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5c4e8da-38d6-428c-bfcf-d0c975165f21 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:04.123397 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5c4e8da-38d6-428c-bfcf-d0c975165f21 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:04.124860 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5c4e8da-38d6-428c-bfcf-d0c975165f21 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:04.613409 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c5c4e8da-38d6-428c-bfcf-d0c975165f21 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:04.627328 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c5c4e8da-38d6-428c-bfcf-d0c975165f21 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 0.535535 Jul 31 01:35:04.632972 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2403/4792] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:04 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:05.654343 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-efaf7f01-58fc-4642-8de2-1d1e50495d25 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:05.654928 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-efaf7f01-58fc-4642-8de2-1d1e50495d25 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:05.666121 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efaf7f01-58fc-4642-8de2-1d1e50495d25 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:05.673266 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efaf7f01-58fc-4642-8de2-1d1e50495d25 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:05.677596 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efaf7f01-58fc-4642-8de2-1d1e50495d25 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:05.680887 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efaf7f01-58fc-4642-8de2-1d1e50495d25 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:07.153628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-efaf7f01-58fc-4642-8de2-1d1e50495d25 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:07.197066 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-efaf7f01-58fc-4642-8de2-1d1e50495d25 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 1.546993 Jul 31 01:35:07.198065 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2390/4793] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:05 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:08.232961 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ca2c188b-0bc3-4960-ba81-b3ccb477b383 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:08.234310 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ca2c188b-0bc3-4960-ba81-b3ccb477b383 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:08.265852 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca2c188b-0bc3-4960-ba81-b3ccb477b383 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:08.266606 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca2c188b-0bc3-4960-ba81-b3ccb477b383 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:08.270030 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca2c188b-0bc3-4960-ba81-b3ccb477b383 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:08.272930 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca2c188b-0bc3-4960-ba81-b3ccb477b383 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:08.619321 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ca2c188b-0bc3-4960-ba81-b3ccb477b383 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:08.636216 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ca2c188b-0bc3-4960-ba81-b3ccb477b383 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 0.408590 Jul 31 01:35:08.637165 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2404/4794] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:08 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:09.664554 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dd7fdead-041e-409a-bb4e-a88720c2dacc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:09.665415 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dd7fdead-041e-409a-bb4e-a88720c2dacc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:09.684640 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd7fdead-041e-409a-bb4e-a88720c2dacc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:09.687280 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd7fdead-041e-409a-bb4e-a88720c2dacc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:09.688136 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd7fdead-041e-409a-bb4e-a88720c2dacc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:09.688598 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd7fdead-041e-409a-bb4e-a88720c2dacc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:09.760759 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:10.401159 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dd7fdead-041e-409a-bb4e-a88720c2dacc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:10.411628 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dd7fdead-041e-409a-bb4e-a88720c2dacc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1524 microversion: 2.1 time: 0.752123 Jul 31 01:35:10.412240 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2391/4795] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:09 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1524 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:11.447860 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ae6f2cd1-50fe-418a-8865-13e3d617b3a0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:11.449277 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ae6f2cd1-50fe-418a-8865-13e3d617b3a0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:11.489227 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae6f2cd1-50fe-418a-8865-13e3d617b3a0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:11.490303 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae6f2cd1-50fe-418a-8865-13e3d617b3a0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:11.492224 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae6f2cd1-50fe-418a-8865-13e3d617b3a0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:11.493966 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae6f2cd1-50fe-418a-8865-13e3d617b3a0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:12.851140 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ae6f2cd1-50fe-418a-8865-13e3d617b3a0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:12.865711 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ae6f2cd1-50fe-418a-8865-13e3d617b3a0 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1506 microversion: 2.1 time: 1.432390 Jul 31 01:35:12.880155 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2405/4796] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:11 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1506 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:13.887855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f13271b9-9836-4157-b87c-6b7deab0d323 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:13.894397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f13271b9-9836-4157-b87c-6b7deab0d323 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:13.914504 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f13271b9-9836-4157-b87c-6b7deab0d323 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:13.915234 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f13271b9-9836-4157-b87c-6b7deab0d323 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:13.916224 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f13271b9-9836-4157-b87c-6b7deab0d323 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:13.916818 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f13271b9-9836-4157-b87c-6b7deab0d323 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:14.465136 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f13271b9-9836-4157-b87c-6b7deab0d323 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:14.477407 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f13271b9-9836-4157-b87c-6b7deab0d323 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1506 microversion: 2.1 time: 0.590324 Jul 31 01:35:14.478072 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2392/4797] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:13 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1506 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:15.500353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-64480658-1622-4c5a-9168-e5c48a1e61a9 req-adef57d8-10ff-42d4-a222-00887f46beec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3ee80f-59a8-4a65-b305-41ad15d38703", "name": "network-vif-unplugged", "status": "completed", "tag": "940a48a2-7107-4216-b0a3-3b305d1caa68"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:35:15.521723 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-df15101e-3556-43f1-92a7-654e3bc1dea6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:15.525429 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-df15101e-3556-43f1-92a7-654e3bc1dea6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:15.544179 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df15101e-3556-43f1-92a7-654e3bc1dea6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:15.545026 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df15101e-3556-43f1-92a7-654e3bc1dea6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:15.545989 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df15101e-3556-43f1-92a7-654e3bc1dea6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:15.550597 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df15101e-3556-43f1-92a7-654e3bc1dea6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:15.584906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-64480658-1622-4c5a-9168-e5c48a1e61a9 req-adef57d8-10ff-42d4-a222-00887f46beec service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:15.585371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-64480658-1622-4c5a-9168-e5c48a1e61a9 req-adef57d8-10ff-42d4-a222-00887f46beec service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:15.648293 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-64480658-1622-4c5a-9168-e5c48a1e61a9 req-adef57d8-10ff-42d4-a222-00887f46beec service nova] Creating event network-vif-unplugged:940a48a2-7107-4216-b0a3-3b305d1caa68 for instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 on n-h1-master-1 Jul 31 01:35:15.673521 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-64480658-1622-4c5a-9168-e5c48a1e61a9 req-adef57d8-10ff-42d4-a222-00887f46beec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.190225 Jul 31 01:35:15.674244 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2406/4798] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:35:16.047779 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-df15101e-3556-43f1-92a7-654e3bc1dea6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:16.057446 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-df15101e-3556-43f1-92a7-654e3bc1dea6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 200 len: 1509 microversion: 2.1 time: 0.559280 Jul 31 01:35:16.071708 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2393/4799] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:15 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 1509 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:16.104625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4f3a9f41-b934-4ded-a03c-403c94ce8d69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:16.106491 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4f3a9f41-b934-4ded-a03c-403c94ce8d69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:16.148199 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f3a9f41-b934-4ded-a03c-403c94ce8d69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:16.150230 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f3a9f41-b934-4ded-a03c-403c94ce8d69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:16.151292 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f3a9f41-b934-4ded-a03c-403c94ce8d69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:16.151992 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f3a9f41-b934-4ded-a03c-403c94ce8d69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:16.274062 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4f3a9f41-b934-4ded-a03c-403c94ce8d69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:35:16.307103 n-d-master-1 devstack@n-api.service[119475]: INFO nova.compute.api [None req-4f3a9f41-b934-4ded-a03c-403c94ce8d69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Working on deleting snapshot 6cee365e-f9b0-41ad-bce4-680759c66ae6 from shelved instance... Jul 31 01:35:18.063107 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4f3a9f41-b934-4ded-a03c-403c94ce8d69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Doing local delete in cell b79bbab3-22fe-4aca-b591-999750c84479(cell1) {{(pid=119475) _delete /opt/stack/nova/nova/compute/api.py:2491}} Jul 31 01:35:18.064930 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f3a9f41-b934-4ded-a03c-403c94ce8d69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:18.067906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f3a9f41-b934-4ded-a03c-403c94ce8d69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:18.068472 n-d-master-1 devstack@n-api.service[119475]: INFO nova.compute.api [None req-4f3a9f41-b934-4ded-a03c-403c94ce8d69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 31 01:35:18.096871 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-4f3a9f41-b934-4ded-a03c-403c94ce8d69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] deallocate_for_instance() {{(pid=119475) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 31 01:35:20.945300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-4f3a9f41-b934-4ded-a03c-403c94ce8d69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Updating instance_info_cache with network_info: [] {{(pid=119475) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 31 01:35:21.025960 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-75fb542e-3c03-49ea-b28d-6118470fd754 req-77410404-89f3-47cc-baeb-6d3f3eb04ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3ee80f-59a8-4a65-b305-41ad15d38703", "name": "network-vif-deleted", "tag": "940a48a2-7107-4216-b0a3-3b305d1caa68"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:35:21.073193 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:21.080805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-75fb542e-3c03-49ea-b28d-6118470fd754 req-77410404-89f3-47cc-baeb-6d3f3eb04ad2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:21.087855 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-75fb542e-3c03-49ea-b28d-6118470fd754 req-77410404-89f3-47cc-baeb-6d3f3eb04ad2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:21.164606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.compute.server_external_events [req-75fb542e-3c03-49ea-b28d-6118470fd754 req-77410404-89f3-47cc-baeb-6d3f3eb04ad2 service nova] Unable to find a host for instance 8f3ee80f-59a8-4a65-b305-41ad15d38703. Dropping event network-vif-deleted {{(pid=119474) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 31 01:35:21.166313 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-75fb542e-3c03-49ea-b28d-6118470fd754 req-77410404-89f3-47cc-baeb-6d3f3eb04ad2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.148120 Jul 31 01:35:21.182593 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2394/4800] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 166 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 31 01:35:21.358383 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4f3a9f41-b934-4ded-a03c-403c94ce8d69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 204 len: 0 microversion: 2.1 time: 5.254699 Jul 31 01:35:21.362827 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2407/4801] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:35:16 2022] DELETE /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 0 bytes in 5264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:35:21.371172 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4524e309-eba5-432e-b518-2388b2719240 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:21.372439 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4524e309-eba5-432e-b518-2388b2719240 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:21.388234 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4524e309-eba5-432e-b518-2388b2719240 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:21.391764 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4524e309-eba5-432e-b518-2388b2719240 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:21.392932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4524e309-eba5-432e-b518-2388b2719240 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:21.400381 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4524e309-eba5-432e-b518-2388b2719240 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:21.461090 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-4524e309-eba5-432e-b518-2388b2719240 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4524e309-eba5-432e-b518-2388b2719240 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 HTTP/1.1 Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '8f3ee80f-59a8-4a65-b305-41ad15d38703'} Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:35:21.464241 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:35:21.468034 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:35:21.468034 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:35:21.468034 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:35:21.468034 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:35:21.468034 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:35:21.468034 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. Jul 31 01:35:21.468034 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:35:21.469919 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4524e309-eba5-432e-b518-2388b2719240 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:35:21.473034 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4524e309-eba5-432e-b518-2388b2719240 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 404 len: 111 microversion: 2.1 time: 0.108403 Jul 31 01:35:21.475783 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2395/4802] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:21 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:35:21.796754 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5dbd4a37-a9f5-481a-9493-09e75bfd74b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1806034062", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "1fde53fe-0382-4737-b527-4db7e9bd3777"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:35:21.921134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-5dbd4a37-a9f5-481a-9493-09e75bfd74b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] validate_networks() for [('1fde53fe-0382-4737-b527-4db7e9bd3777', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:35:23.945845 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-5dbd4a37-a9f5-481a-9493-09e75bfd74b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:35:23.946439 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-5dbd4a37-a9f5-481a-9493-09e75bfd74b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:35:23.946772 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-5dbd4a37-a9f5-481a-9493-09e75bfd74b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:35:23.947202 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-5dbd4a37-a9f5-481a-9493-09e75bfd74b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:35:23.947714 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-5dbd4a37-a9f5-481a-9493-09e75bfd74b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:35:23.951271 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:23.977580 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5dbd4a37-a9f5-481a-9493-09e75bfd74b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:23.979375 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5dbd4a37-a9f5-481a-9493-09e75bfd74b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:23.985566 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5dbd4a37-a9f5-481a-9493-09e75bfd74b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:23.986782 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5dbd4a37-a9f5-481a-9493-09e75bfd74b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:24.014468 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:24.055069 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-5dbd4a37-a9f5-481a-9493-09e75bfd74b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Getting quotas for project e418a04119b843b4a1c218aa9ff1dbc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:35:24.073290 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-5dbd4a37-a9f5-481a-9493-09e75bfd74b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Getting quotas for user 93eccdea3f1447a693cec10d096876a0 and project e418a04119b843b4a1c218aa9ff1dbc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:35:24.118974 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5dbd4a37-a9f5-481a-9493-09e75bfd74b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:35:24.121497 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5dbd4a37-a9f5-481a-9493-09e75bfd74b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:35:24.218106 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5dbd4a37-a9f5-481a-9493-09e75bfd74b8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.432259 Jul 31 01:35:24.218723 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2408/4803] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:35:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:35:24.230997 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9af11820-fc50-4e6a-8bf5-2bf5f4db566a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:24.232236 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9af11820-fc50-4e6a-8bf5-2bf5f4db566a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:24.337290 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9af11820-fc50-4e6a-8bf5-2bf5f4db566a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:24.349319 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9af11820-fc50-4e6a-8bf5-2bf5f4db566a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1215 microversion: 2.1 time: 0.121172 Jul 31 01:35:24.364938 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2396/4804] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:24 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:25.373899 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c6dbfd61-0860-4c85-b8f2-991a067d9c82 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:25.375195 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c6dbfd61-0860-4c85-b8f2-991a067d9c82 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:25.400643 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6dbfd61-0860-4c85-b8f2-991a067d9c82 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:25.401126 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6dbfd61-0860-4c85-b8f2-991a067d9c82 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:25.404869 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6dbfd61-0860-4c85-b8f2-991a067d9c82 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:25.406746 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6dbfd61-0860-4c85-b8f2-991a067d9c82 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:25.718256 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c6dbfd61-0860-4c85-b8f2-991a067d9c82 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:25.744100 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c6dbfd61-0860-4c85-b8f2-991a067d9c82 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1219 microversion: 2.1 time: 0.364253 Jul 31 01:35:25.746151 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2409/4805] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:25 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1219 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:26.769762 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c159dfc1-460c-447f-8dfb-be55bac7d90a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:26.773984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c159dfc1-460c-447f-8dfb-be55bac7d90a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:26.796942 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c159dfc1-460c-447f-8dfb-be55bac7d90a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:26.797546 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c159dfc1-460c-447f-8dfb-be55bac7d90a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:26.798912 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c159dfc1-460c-447f-8dfb-be55bac7d90a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:26.801383 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c159dfc1-460c-447f-8dfb-be55bac7d90a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:27.013731 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c159dfc1-460c-447f-8dfb-be55bac7d90a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:27.023689 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c159dfc1-460c-447f-8dfb-be55bac7d90a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1273 microversion: 2.1 time: 0.258993 Jul 31 01:35:27.025257 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2397/4806] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:26 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1273 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:28.046415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7520d98c-edfd-425d-8cbe-ef5a9e6f0313 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:28.047995 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7520d98c-edfd-425d-8cbe-ef5a9e6f0313 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:28.059154 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7520d98c-edfd-425d-8cbe-ef5a9e6f0313 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:28.060524 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7520d98c-edfd-425d-8cbe-ef5a9e6f0313 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:28.061506 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7520d98c-edfd-425d-8cbe-ef5a9e6f0313 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:28.062110 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7520d98c-edfd-425d-8cbe-ef5a9e6f0313 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:28.817197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7520d98c-edfd-425d-8cbe-ef5a9e6f0313 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:28.830797 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7520d98c-edfd-425d-8cbe-ef5a9e6f0313 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1273 microversion: 2.1 time: 0.784672 Jul 31 01:35:28.832322 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2410/4807] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:28 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1273 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:29.856512 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-07a9fce6-c7f1-47d4-a6c4-1aac49ddfafc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:29.857305 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-07a9fce6-c7f1-47d4-a6c4-1aac49ddfafc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:29.871748 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07a9fce6-c7f1-47d4-a6c4-1aac49ddfafc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:29.873782 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07a9fce6-c7f1-47d4-a6c4-1aac49ddfafc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:29.874609 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07a9fce6-c7f1-47d4-a6c4-1aac49ddfafc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:29.875053 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07a9fce6-c7f1-47d4-a6c4-1aac49ddfafc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:30.118439 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-07a9fce6-c7f1-47d4-a6c4-1aac49ddfafc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:30.133605 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-07a9fce6-c7f1-47d4-a6c4-1aac49ddfafc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1273 microversion: 2.1 time: 0.284700 Jul 31 01:35:30.134411 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2398/4808] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:29 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1273 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:31.159673 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-821a0631-b498-49d6-8894-21a97416bdc5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:31.160997 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-821a0631-b498-49d6-8894-21a97416bdc5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:31.169776 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-821a0631-b498-49d6-8894-21a97416bdc5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:31.170717 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-821a0631-b498-49d6-8894-21a97416bdc5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:31.172188 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-821a0631-b498-49d6-8894-21a97416bdc5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:31.174492 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-821a0631-b498-49d6-8894-21a97416bdc5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:32.389124 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-821a0631-b498-49d6-8894-21a97416bdc5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:32.405516 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-821a0631-b498-49d6-8894-21a97416bdc5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1315 microversion: 2.1 time: 1.253577 Jul 31 01:35:32.424103 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2411/4809] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:31 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1315 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:33.435836 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c7a37368-bc24-4151-a101-36057fa2771a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:33.437314 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c7a37368-bc24-4151-a101-36057fa2771a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:33.452398 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c7a37368-bc24-4151-a101-36057fa2771a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:33.457922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c7a37368-bc24-4151-a101-36057fa2771a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:33.463189 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c7a37368-bc24-4151-a101-36057fa2771a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:33.466138 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c7a37368-bc24-4151-a101-36057fa2771a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:34.335990 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c7a37368-bc24-4151-a101-36057fa2771a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:34.350820 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:34.360299 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c7a37368-bc24-4151-a101-36057fa2771a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1315 microversion: 2.1 time: 0.928000 Jul 31 01:35:34.381401 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2399/4810] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:33 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1315 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:35.390480 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e7f83285-d85f-457f-8761-9bc2b42f2be6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:35.391256 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e7f83285-d85f-457f-8761-9bc2b42f2be6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:35.395684 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:35.399019 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:35.425097 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e7f83285-d85f-457f-8761-9bc2b42f2be6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:35.425574 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e7f83285-d85f-457f-8761-9bc2b42f2be6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:35.431089 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e7f83285-d85f-457f-8761-9bc2b42f2be6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:35.431688 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e7f83285-d85f-457f-8761-9bc2b42f2be6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:36.033963 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e7f83285-d85f-457f-8761-9bc2b42f2be6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:36.042471 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e7f83285-d85f-457f-8761-9bc2b42f2be6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1315 microversion: 2.1 time: 0.660288 Jul 31 01:35:36.055926 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2412/4811] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:35 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1315 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:36.218582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-623ef8d2-b6a7-47e5-abe4-daa9418426f9 req-e59c25d2-1fee-4574-a238-94369244219b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33f2207c-b1c3-42ce-88ff-bd28260ad9e6", "tag": "24290284-f581-4a1a-92b2-ed5a36cf83a2"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:35:36.257304 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-623ef8d2-b6a7-47e5-abe4-daa9418426f9 req-e59c25d2-1fee-4574-a238-94369244219b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:36.257774 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-623ef8d2-b6a7-47e5-abe4-daa9418426f9 req-e59c25d2-1fee-4574-a238-94369244219b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:36.305694 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-623ef8d2-b6a7-47e5-abe4-daa9418426f9 req-e59c25d2-1fee-4574-a238-94369244219b service nova] Creating event network-changed:24290284-f581-4a1a-92b2-ed5a36cf83a2 for instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 on n-h1-master-1 Jul 31 01:35:36.322020 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-623ef8d2-b6a7-47e5-abe4-daa9418426f9 req-e59c25d2-1fee-4574-a238-94369244219b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106681 Jul 31 01:35:36.334986 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2400/4812] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:35:37.074603 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8266890e-b33b-411d-93ff-17edf9e73eda tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:37.075552 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8266890e-b33b-411d-93ff-17edf9e73eda tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:37.089051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8266890e-b33b-411d-93ff-17edf9e73eda tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:37.089650 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8266890e-b33b-411d-93ff-17edf9e73eda tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:37.092537 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8266890e-b33b-411d-93ff-17edf9e73eda tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:37.093248 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8266890e-b33b-411d-93ff-17edf9e73eda tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:37.514138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8266890e-b33b-411d-93ff-17edf9e73eda tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:37.527915 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8266890e-b33b-411d-93ff-17edf9e73eda tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1315 microversion: 2.1 time: 0.453380 Jul 31 01:35:37.530405 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2413/4813] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:37 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:38.552244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4211c66a-108e-4953-ad55-3e0baae3c99e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:38.553547 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4211c66a-108e-4953-ad55-3e0baae3c99e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:38.582779 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4211c66a-108e-4953-ad55-3e0baae3c99e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:38.583266 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4211c66a-108e-4953-ad55-3e0baae3c99e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:38.584133 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4211c66a-108e-4953-ad55-3e0baae3c99e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:38.584581 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4211c66a-108e-4953-ad55-3e0baae3c99e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:38.705778 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-25504809-0068-4af3-b6a6-3906841da01e tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-599315581", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "c059f51f-96a2-4290-9003-bf04ab968975"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:35:38.797679 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-25504809-0068-4af3-b6a6-3906841da01e tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] validate_networks() for [('c059f51f-96a2-4290-9003-bf04ab968975', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:35:39.173759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4211c66a-108e-4953-ad55-3e0baae3c99e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:39.187031 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4211c66a-108e-4953-ad55-3e0baae3c99e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1315 microversion: 2.1 time: 0.640020 Jul 31 01:35:39.198681 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2414/4814] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:38 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:40.222533 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-06c57d7e-8e8f-4ac5-99b0-886887716f6f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:40.224821 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-06c57d7e-8e8f-4ac5-99b0-886887716f6f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:40.235281 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06c57d7e-8e8f-4ac5-99b0-886887716f6f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:40.236074 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06c57d7e-8e8f-4ac5-99b0-886887716f6f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:40.237254 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06c57d7e-8e8f-4ac5-99b0-886887716f6f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:40.237867 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06c57d7e-8e8f-4ac5-99b0-886887716f6f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:40.994570 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-06c57d7e-8e8f-4ac5-99b0-886887716f6f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:41.017339 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-06c57d7e-8e8f-4ac5-99b0-886887716f6f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1315 microversion: 2.1 time: 0.800953 Jul 31 01:35:41.021743 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2415/4815] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:40 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1315 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:41.042078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-25504809-0068-4af3-b6a6-3906841da01e tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:35:41.043080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-25504809-0068-4af3-b6a6-3906841da01e tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:35:41.044072 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-25504809-0068-4af3-b6a6-3906841da01e tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:35:41.044656 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-25504809-0068-4af3-b6a6-3906841da01e tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:35:41.045451 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-25504809-0068-4af3-b6a6-3906841da01e tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:35:41.063291 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25504809-0068-4af3-b6a6-3906841da01e tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:41.071378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25504809-0068-4af3-b6a6-3906841da01e tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:41.072521 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25504809-0068-4af3-b6a6-3906841da01e tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:41.073132 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25504809-0068-4af3-b6a6-3906841da01e tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:41.100063 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=40 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:41.110589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-25504809-0068-4af3-b6a6-3906841da01e tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Getting quotas for project d6d8d35e24404250a07086d76518a537. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:35:41.118008 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-25504809-0068-4af3-b6a6-3906841da01e tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Getting quotas for user 14a2cf6dbdcf46caab451047c31a8a3f and project d6d8d35e24404250a07086d76518a537. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:35:41.133595 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-25504809-0068-4af3-b6a6-3906841da01e tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:35:41.138720 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-25504809-0068-4af3-b6a6-3906841da01e tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:35:41.244697 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-25504809-0068-4af3-b6a6-3906841da01e tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.913745 Jul 31 01:35:41.245392 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2401/4816] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:35:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:35:41.259991 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a357b816-d6ba-4f89-9622-e5ade2bc1947 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:41.273286 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a357b816-d6ba-4f89-9622-e5ade2bc1947 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:41.470934 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a357b816-d6ba-4f89-9622-e5ade2bc1947 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a2cf6dbdcf46caab451047c31a8a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8d35e24404250a07086d76518a537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:41.481864 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a357b816-d6ba-4f89-9622-e5ade2bc1947 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] 10.222.0.45 "GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 200 len: 1227 microversion: 2.1 time: 0.226739 Jul 31 01:35:41.482848 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2416/4817] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:41 2022] GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 1227 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:42.045571 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5c8c7896-895e-44b1-be15-7aa49aca6d0a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:42.048755 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5c8c7896-895e-44b1-be15-7aa49aca6d0a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:42.068602 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c8c7896-895e-44b1-be15-7aa49aca6d0a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:42.070660 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c8c7896-895e-44b1-be15-7aa49aca6d0a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:42.071695 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c8c7896-895e-44b1-be15-7aa49aca6d0a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:42.074619 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c8c7896-895e-44b1-be15-7aa49aca6d0a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:42.136964 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8da4aaea-c97f-4238-9367-51187fdfb339 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1010791075", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9ced786e-eebf-42f2-aff3-23f477cd43cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6739ac5e-7d06-4b25-b7ed-29fa35326c6e"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:35:42.341667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-8da4aaea-c97f-4238-9367-51187fdfb339 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] validate_networks() for [('6739ac5e-7d06-4b25-b7ed-29fa35326c6e', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:35:44.073417 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5c8c7896-895e-44b1-be15-7aa49aca6d0a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:44.088834 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5c8c7896-895e-44b1-be15-7aa49aca6d0a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1315 microversion: 2.1 time: 2.046088 Jul 31 01:35:44.089577 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2402/4818] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:42 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1315 bytes in 2052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:44.106294 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-03c40d19-0d82-481b-a563-c01cb9e8ac68 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:44.111438 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-03c40d19-0d82-481b-a563-c01cb9e8ac68 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:44.133825 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03c40d19-0d82-481b-a563-c01cb9e8ac68 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:44.139466 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03c40d19-0d82-481b-a563-c01cb9e8ac68 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:44.141721 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03c40d19-0d82-481b-a563-c01cb9e8ac68 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:44.149194 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03c40d19-0d82-481b-a563-c01cb9e8ac68 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:44.403880 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8da4aaea-c97f-4238-9367-51187fdfb339 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:35:44.404939 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8da4aaea-c97f-4238-9367-51187fdfb339 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:35:44.405674 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8da4aaea-c97f-4238-9367-51187fdfb339 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:35:44.406318 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8da4aaea-c97f-4238-9367-51187fdfb339 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:35:44.406959 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8da4aaea-c97f-4238-9367-51187fdfb339 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:35:44.428094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8da4aaea-c97f-4238-9367-51187fdfb339 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:44.430516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8da4aaea-c97f-4238-9367-51187fdfb339 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:44.431623 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8da4aaea-c97f-4238-9367-51187fdfb339 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:44.438044 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8da4aaea-c97f-4238-9367-51187fdfb339 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:44.507139 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-8da4aaea-c97f-4238-9367-51187fdfb339 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:35:44.528147 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-8da4aaea-c97f-4238-9367-51187fdfb339 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for user f6c26df9a49446c290d6a0b1427f0c14 and project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:35:44.650207 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-03c40d19-0d82-481b-a563-c01cb9e8ac68 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a2cf6dbdcf46caab451047c31a8a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8d35e24404250a07086d76518a537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:44.658338 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-03c40d19-0d82-481b-a563-c01cb9e8ac68 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] 10.222.0.45 "GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 200 len: 1285 microversion: 2.1 time: 0.566069 Jul 31 01:35:44.658811 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2403/4819] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:44 2022] GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 1285 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:44.666422 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8da4aaea-c97f-4238-9367-51187fdfb339 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:35:44.669127 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8da4aaea-c97f-4238-9367-51187fdfb339 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ced786e-eebf-42f2-aff3-23f477cd43cf',volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:35:44.993484 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8da4aaea-c97f-4238-9367-51187fdfb339 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.860358 Jul 31 01:35:44.996516 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2417/4820] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:35:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 01:35:45.018859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8c90e3f0-27ae-42b0-8932-c858ba79ce1a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:45.019720 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8c90e3f0-27ae-42b0-8932-c858ba79ce1a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:45.038565 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-9fe86323-53c6-4fd4-9130-6ad43b069376 req-99854d68-2f8e-4264-aa02-2a10cd15133e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33f2207c-b1c3-42ce-88ff-bd28260ad9e6", "name": "network-vif-plugged", "status": "completed", "tag": "24290284-f581-4a1a-92b2-ed5a36cf83a2"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:35:45.063085 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9fe86323-53c6-4fd4-9130-6ad43b069376 req-99854d68-2f8e-4264-aa02-2a10cd15133e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:45.065219 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9fe86323-53c6-4fd4-9130-6ad43b069376 req-99854d68-2f8e-4264-aa02-2a10cd15133e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:45.087130 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-9fe86323-53c6-4fd4-9130-6ad43b069376 req-99854d68-2f8e-4264-aa02-2a10cd15133e service nova] Creating event network-vif-plugged:24290284-f581-4a1a-92b2-ed5a36cf83a2 for instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 on n-h1-master-1 Jul 31 01:35:45.102680 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-9fe86323-53c6-4fd4-9130-6ad43b069376 req-99854d68-2f8e-4264-aa02-2a10cd15133e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069408 Jul 31 01:35:45.104037 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2418/4821] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:35:45.117920 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-30a06864-88b7-492f-9036-1970c95040d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:45.119073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-30a06864-88b7-492f-9036-1970c95040d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:45.138745 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30a06864-88b7-492f-9036-1970c95040d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:45.141307 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30a06864-88b7-492f-9036-1970c95040d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:45.143599 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30a06864-88b7-492f-9036-1970c95040d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:45.144120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30a06864-88b7-492f-9036-1970c95040d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:45.287956 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8c90e3f0-27ae-42b0-8932-c858ba79ce1a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:45.295212 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8c90e3f0-27ae-42b0-8932-c858ba79ce1a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1057 microversion: 2.1 time: 0.287870 Jul 31 01:35:45.299002 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2404/4822] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:45 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1057 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:45.683885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6cadb475-2035-4e6a-a2dd-0c9274277779 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:45.684498 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6cadb475-2035-4e6a-a2dd-0c9274277779 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:45.703249 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6cadb475-2035-4e6a-a2dd-0c9274277779 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:45.703726 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6cadb475-2035-4e6a-a2dd-0c9274277779 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:45.705782 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6cadb475-2035-4e6a-a2dd-0c9274277779 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:45.707293 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6cadb475-2035-4e6a-a2dd-0c9274277779 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:46.397937 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6cadb475-2035-4e6a-a2dd-0c9274277779 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a2cf6dbdcf46caab451047c31a8a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8d35e24404250a07086d76518a537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:46.406499 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6cadb475-2035-4e6a-a2dd-0c9274277779 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] 10.222.0.45 "GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 200 len: 1327 microversion: 2.1 time: 0.726638 Jul 31 01:35:46.411978 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2405/4823] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:45 2022] GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 1327 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:35:46.422739 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5064de18-8d0c-45b4-a6f7-d92d3aa10894 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:46.424235 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5064de18-8d0c-45b4-a6f7-d92d3aa10894 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:46.440531 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5064de18-8d0c-45b4-a6f7-d92d3aa10894 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:46.443940 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5064de18-8d0c-45b4-a6f7-d92d3aa10894 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:46.444921 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5064de18-8d0c-45b4-a6f7-d92d3aa10894 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:46.445520 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5064de18-8d0c-45b4-a6f7-d92d3aa10894 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:46.545533 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-30a06864-88b7-492f-9036-1970c95040d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:46.573687 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-30a06864-88b7-492f-9036-1970c95040d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1315 microversion: 2.1 time: 1.466155 Jul 31 01:35:46.579391 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2419/4824] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:45 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1315 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:46.727097 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5064de18-8d0c-45b4-a6f7-d92d3aa10894 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:46.739566 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5064de18-8d0c-45b4-a6f7-d92d3aa10894 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1099 microversion: 2.1 time: 0.326113 Jul 31 01:35:46.740390 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2406/4825] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:46 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1099 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:47.379111 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-9d998a74-87cf-4fa0-a6fc-c205f6eaf8e7 req-b8b2301e-c99b-498c-a52f-b5e3da63ed75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1963033e-fe60-4505-a245-130afd1e56fe", "tag": "508dba01-3c6b-4408-a274-e587d2dba021"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:35:47.423938 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9d998a74-87cf-4fa0-a6fc-c205f6eaf8e7 req-b8b2301e-c99b-498c-a52f-b5e3da63ed75 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:47.426192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9d998a74-87cf-4fa0-a6fc-c205f6eaf8e7 req-b8b2301e-c99b-498c-a52f-b5e3da63ed75 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:47.437816 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6d3343cd-3adc-4a36-8319-8eaacab4c1bd tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:47.438551 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6d3343cd-3adc-4a36-8319-8eaacab4c1bd tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:47.499857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d3343cd-3adc-4a36-8319-8eaacab4c1bd tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:47.500361 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d3343cd-3adc-4a36-8319-8eaacab4c1bd tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:47.501196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d3343cd-3adc-4a36-8319-8eaacab4c1bd tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:47.505473 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d3343cd-3adc-4a36-8319-8eaacab4c1bd tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:47.552239 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-9d998a74-87cf-4fa0-a6fc-c205f6eaf8e7 req-b8b2301e-c99b-498c-a52f-b5e3da63ed75 service nova] Creating event network-changed:508dba01-3c6b-4408-a274-e587d2dba021 for instance 1963033e-fe60-4505-a245-130afd1e56fe on n-h2-master-1 Jul 31 01:35:47.573940 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-9d998a74-87cf-4fa0-a6fc-c205f6eaf8e7 req-b8b2301e-c99b-498c-a52f-b5e3da63ed75 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199397 Jul 31 01:35:47.580080 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2420/4826] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:35:47.597387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f88747ab-10b0-4faf-bfc4-30c807d594ef tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:47.612970 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f88747ab-10b0-4faf-bfc4-30c807d594ef tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:47.633412 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f88747ab-10b0-4faf-bfc4-30c807d594ef tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:47.636684 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f88747ab-10b0-4faf-bfc4-30c807d594ef tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:47.641056 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f88747ab-10b0-4faf-bfc4-30c807d594ef tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:47.646634 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f88747ab-10b0-4faf-bfc4-30c807d594ef tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:48.674582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6d3343cd-3adc-4a36-8319-8eaacab4c1bd tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a2cf6dbdcf46caab451047c31a8a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8d35e24404250a07086d76518a537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:48.682956 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6d3343cd-3adc-4a36-8319-8eaacab4c1bd tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] 10.222.0.45 "GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 200 len: 1327 microversion: 2.1 time: 1.249891 Jul 31 01:35:48.705870 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2407/4827] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:47 2022] GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 1327 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:35:48.713136 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-02ca1625-73e6-4445-9451-d2f495de53be tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:48.713770 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-02ca1625-73e6-4445-9451-d2f495de53be tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:48.721325 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02ca1625-73e6-4445-9451-d2f495de53be tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:48.722032 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02ca1625-73e6-4445-9451-d2f495de53be tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:48.723001 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02ca1625-73e6-4445-9451-d2f495de53be tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:48.723777 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02ca1625-73e6-4445-9451-d2f495de53be tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:48.763695 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f88747ab-10b0-4faf-bfc4-30c807d594ef tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:48.773572 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f88747ab-10b0-4faf-bfc4-30c807d594ef tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1315 microversion: 2.1 time: 1.180963 Jul 31 01:35:48.783437 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2421/4828] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:47 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1315 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:48.870099 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-02ca1625-73e6-4445-9451-d2f495de53be tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:48.883839 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-02ca1625-73e6-4445-9451-d2f495de53be tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1173 microversion: 2.1 time: 0.175988 Jul 31 01:35:48.884648 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2408/4829] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:48 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1173 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:49.722242 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5b444d04-c67b-416c-ab9e-78359d01aa71 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:49.723741 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5b444d04-c67b-416c-ab9e-78359d01aa71 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:49.762115 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b444d04-c67b-416c-ab9e-78359d01aa71 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:49.762598 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b444d04-c67b-416c-ab9e-78359d01aa71 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:49.763409 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b444d04-c67b-416c-ab9e-78359d01aa71 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:49.763858 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b444d04-c67b-416c-ab9e-78359d01aa71 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:49.798161 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-03606fce-10d5-47ae-ade4-1f63e2fc746d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:49.800341 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-03606fce-10d5-47ae-ade4-1f63e2fc746d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:49.817621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03606fce-10d5-47ae-ade4-1f63e2fc746d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:49.834329 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03606fce-10d5-47ae-ade4-1f63e2fc746d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:49.837996 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03606fce-10d5-47ae-ade4-1f63e2fc746d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:49.840568 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03606fce-10d5-47ae-ade4-1f63e2fc746d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:50.801397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-03606fce-10d5-47ae-ade4-1f63e2fc746d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:50.811546 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-03606fce-10d5-47ae-ade4-1f63e2fc746d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1502 microversion: 2.1 time: 1.017801 Jul 31 01:35:50.830887 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2409/4830] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:49 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1502 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:50.841810 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5c0ed26f-4894-44d9-aea2-9c36267e1b93 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:50.848318 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5c0ed26f-4894-44d9-aea2-9c36267e1b93 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:50.860841 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c0ed26f-4894-44d9-aea2-9c36267e1b93 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:50.861667 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c0ed26f-4894-44d9-aea2-9c36267e1b93 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:50.862627 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c0ed26f-4894-44d9-aea2-9c36267e1b93 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:50.864316 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c0ed26f-4894-44d9-aea2-9c36267e1b93 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:51.100940 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:51.244864 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5b444d04-c67b-416c-ab9e-78359d01aa71 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a2cf6dbdcf46caab451047c31a8a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8d35e24404250a07086d76518a537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:51.261035 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5b444d04-c67b-416c-ab9e-78359d01aa71 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] 10.222.0.45 "GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 200 len: 1327 microversion: 2.1 time: 1.551559 Jul 31 01:35:51.262159 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2422/4831] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:49 2022] GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 1327 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:51.271880 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7fcaa527-7be9-4750-9079-d8d82ac2cfcf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:35:51.288060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fcaa527-7be9-4750-9079-d8d82ac2cfcf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:51.288678 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7fcaa527-7be9-4750-9079-d8d82ac2cfcf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:51.336926 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7fcaa527-7be9-4750-9079-d8d82ac2cfcf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Going to try to stop instance {{(pid=119475) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 01:35:51.517955 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7fcaa527-7be9-4750-9079-d8d82ac2cfcf tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "POST /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6/action" status: 202 len: 0 microversion: 2.1 time: 0.252385 Jul 31 01:35:51.520698 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2423/4832] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:35:51 2022] POST /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:35:51.543556 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ffd90bfc-8acc-4118-b20a-81b96941f0d8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:51.552327 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ffd90bfc-8acc-4118-b20a-81b96941f0d8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:51.573100 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ffd90bfc-8acc-4118-b20a-81b96941f0d8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:51.573570 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ffd90bfc-8acc-4118-b20a-81b96941f0d8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:51.574574 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ffd90bfc-8acc-4118-b20a-81b96941f0d8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:51.574805 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ffd90bfc-8acc-4118-b20a-81b96941f0d8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:51.680523 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5c0ed26f-4894-44d9-aea2-9c36267e1b93 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:51.697113 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5c0ed26f-4894-44d9-aea2-9c36267e1b93 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1215 microversion: 2.1 time: 0.862968 Jul 31 01:35:51.700831 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2410/4833] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:50 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1215 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:51.978395 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ffd90bfc-8acc-4118-b20a-81b96941f0d8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:51.992174 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ffd90bfc-8acc-4118-b20a-81b96941f0d8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1512 microversion: 2.1 time: 0.462633 Jul 31 01:35:52.011707 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2424/4834] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:51 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1512 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:52.255615 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-129f0282-7f5e-4b17-98dc-751b31716a3b req-2892e28a-ac3e-41e8-8911-e0bce86cc420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493b0ac5-4c13-41eb-b81d-f79717202ff1", "tag": "8c49b471-b0fa-4f4e-b1cd-113919d5ab72"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:35:52.269054 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:52.283996 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bf93cb40-b43a-4bc8-b13a-727296d1b2a8 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:52.286187 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bf93cb40-b43a-4bc8-b13a-727296d1b2a8 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:52.311634 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-129f0282-7f5e-4b17-98dc-751b31716a3b req-2892e28a-ac3e-41e8-8911-e0bce86cc420 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:52.312096 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-129f0282-7f5e-4b17-98dc-751b31716a3b req-2892e28a-ac3e-41e8-8911-e0bce86cc420 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:52.316628 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf93cb40-b43a-4bc8-b13a-727296d1b2a8 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:52.317108 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf93cb40-b43a-4bc8-b13a-727296d1b2a8 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:52.317930 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf93cb40-b43a-4bc8-b13a-727296d1b2a8 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:52.328625 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf93cb40-b43a-4bc8-b13a-727296d1b2a8 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:52.377794 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-129f0282-7f5e-4b17-98dc-751b31716a3b req-2892e28a-ac3e-41e8-8911-e0bce86cc420 service nova] Creating event network-changed:8c49b471-b0fa-4f4e-b1cd-113919d5ab72 for instance 493b0ac5-4c13-41eb-b81d-f79717202ff1 on n-h1-master-1 Jul 31 01:35:52.400376 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-129f0282-7f5e-4b17-98dc-751b31716a3b req-2892e28a-ac3e-41e8-8911-e0bce86cc420 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148592 Jul 31 01:35:52.401212 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2411/4835] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:35:52.729881 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-46521948-8eda-4296-be1a-d8dcb196d776 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:52.731157 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-46521948-8eda-4296-be1a-d8dcb196d776 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:52.754487 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46521948-8eda-4296-be1a-d8dcb196d776 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:52.754969 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46521948-8eda-4296-be1a-d8dcb196d776 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:52.762181 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46521948-8eda-4296-be1a-d8dcb196d776 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:52.763040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46521948-8eda-4296-be1a-d8dcb196d776 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:54.064791 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bf93cb40-b43a-4bc8-b13a-727296d1b2a8 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a2cf6dbdcf46caab451047c31a8a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8d35e24404250a07086d76518a537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:54.083830 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bf93cb40-b43a-4bc8-b13a-727296d1b2a8 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] 10.222.0.45 "GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 200 len: 1327 microversion: 2.1 time: 1.805146 Jul 31 01:35:54.101786 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2425/4836] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:52 2022] GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 1327 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:54.124747 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-be7f55fe-76d8-4c13-bc0d-f2577f9abf7f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:54.125660 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-be7f55fe-76d8-4c13-bc0d-f2577f9abf7f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:54.145503 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:54.153404 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be7f55fe-76d8-4c13-bc0d-f2577f9abf7f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:54.154152 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be7f55fe-76d8-4c13-bc0d-f2577f9abf7f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:54.155435 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be7f55fe-76d8-4c13-bc0d-f2577f9abf7f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:54.156139 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be7f55fe-76d8-4c13-bc0d-f2577f9abf7f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:54.161934 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-46521948-8eda-4296-be1a-d8dcb196d776 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:54.176572 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-46521948-8eda-4296-be1a-d8dcb196d776 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1215 microversion: 2.1 time: 1.460642 Jul 31 01:35:54.178596 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2412/4837] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:52 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1215 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:35:54.196001 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-aa6a9a47-1cc6-4e16-92e3-1cfe8b22b8c4 req-3bc898cc-4c4e-4509-aae7-663ca1636f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1963033e-fe60-4505-a245-130afd1e56fe", "name": "network-vif-plugged", "status": "completed", "tag": "508dba01-3c6b-4408-a274-e587d2dba021"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:35:54.233833 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-aa6a9a47-1cc6-4e16-92e3-1cfe8b22b8c4 req-3bc898cc-4c4e-4509-aae7-663ca1636f37 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:54.235932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-aa6a9a47-1cc6-4e16-92e3-1cfe8b22b8c4 req-3bc898cc-4c4e-4509-aae7-663ca1636f37 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:54.265965 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:54.293425 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-aa6a9a47-1cc6-4e16-92e3-1cfe8b22b8c4 req-3bc898cc-4c4e-4509-aae7-663ca1636f37 service nova] Creating event network-vif-plugged:508dba01-3c6b-4408-a274-e587d2dba021 for instance 1963033e-fe60-4505-a245-130afd1e56fe on n-h2-master-1 Jul 31 01:35:54.305946 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-aa6a9a47-1cc6-4e16-92e3-1cfe8b22b8c4 req-3bc898cc-4c4e-4509-aae7-663ca1636f37 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123797 Jul 31 01:35:54.310487 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2413/4838] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:35:54.474672 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:54.537558 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:54.795921 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-be7f55fe-76d8-4c13-bc0d-f2577f9abf7f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:54.818236 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-be7f55fe-76d8-4c13-bc0d-f2577f9abf7f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1512 microversion: 2.1 time: 0.714186 Jul 31 01:35:54.823064 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2426/4839] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:54 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1512 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:55.111250 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-04f61427-6c02-44bb-b54f-9b8e92d0e6fa tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:55.113105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-04f61427-6c02-44bb-b54f-9b8e92d0e6fa tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:55.135668 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-04f61427-6c02-44bb-b54f-9b8e92d0e6fa tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:55.143712 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-04f61427-6c02-44bb-b54f-9b8e92d0e6fa tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:55.145046 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-04f61427-6c02-44bb-b54f-9b8e92d0e6fa tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:55.145704 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-04f61427-6c02-44bb-b54f-9b8e92d0e6fa tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:55.198275 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bbb6ea79-4089-4170-9731-9cfa25f241db tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:55.199135 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bbb6ea79-4089-4170-9731-9cfa25f241db tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:55.214972 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bbb6ea79-4089-4170-9731-9cfa25f241db tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:55.238468 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bbb6ea79-4089-4170-9731-9cfa25f241db tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:55.244092 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bbb6ea79-4089-4170-9731-9cfa25f241db tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:55.244571 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bbb6ea79-4089-4170-9731-9cfa25f241db tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:55.295001 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=8 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:55.870190 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bbb6ea79-4089-4170-9731-9cfa25f241db tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:55.880231 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-04f61427-6c02-44bb-b54f-9b8e92d0e6fa tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a2cf6dbdcf46caab451047c31a8a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8d35e24404250a07086d76518a537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:55.881611 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bbb6ea79-4089-4170-9731-9cfa25f241db tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1215 microversion: 2.1 time: 0.687143 Jul 31 01:35:55.885153 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2427/4840] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:55 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1215 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:55.896965 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-843eb6d2-d5c6-4726-bfb8-8a729504a0b4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1683939465", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "4fabb740-c08f-4f27-ba3f-37fe98794958"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:35:55.904072 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-04f61427-6c02-44bb-b54f-9b8e92d0e6fa tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] 10.222.0.45 "GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 200 len: 1327 microversion: 2.1 time: 0.796035 Jul 31 01:35:55.905225 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2414/4841] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:55 2022] GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 1327 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:55.921286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4c1159c5-0f5d-4397-8a36-7a0d4ca72423 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:55.921989 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4c1159c5-0f5d-4397-8a36-7a0d4ca72423 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:55.938061 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c1159c5-0f5d-4397-8a36-7a0d4ca72423 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:55.938494 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c1159c5-0f5d-4397-8a36-7a0d4ca72423 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:55.939326 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c1159c5-0f5d-4397-8a36-7a0d4ca72423 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:55.961639 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c1159c5-0f5d-4397-8a36-7a0d4ca72423 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:56.011656 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-843eb6d2-d5c6-4726-bfb8-8a729504a0b4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] validate_networks() for [('4fabb740-c08f-4f27-ba3f-37fe98794958', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:35:56.792583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4c1159c5-0f5d-4397-8a36-7a0d4ca72423 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:56.801697 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4c1159c5-0f5d-4397-8a36-7a0d4ca72423 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1512 microversion: 2.1 time: 0.895204 Jul 31 01:35:56.808183 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2415/4842] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:55 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1512 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:56.902185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6c5630a4-8b95-4d44-9fa1-8ae49a500e5e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:56.902708 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6c5630a4-8b95-4d44-9fa1-8ae49a500e5e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:56.924672 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c5630a4-8b95-4d44-9fa1-8ae49a500e5e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:56.925229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c5630a4-8b95-4d44-9fa1-8ae49a500e5e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:56.926052 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c5630a4-8b95-4d44-9fa1-8ae49a500e5e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:56.926497 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c5630a4-8b95-4d44-9fa1-8ae49a500e5e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:57.489474 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6c5630a4-8b95-4d44-9fa1-8ae49a500e5e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:57.497369 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6c5630a4-8b95-4d44-9fa1-8ae49a500e5e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1215 microversion: 2.1 time: 0.599126 Jul 31 01:35:57.498186 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2416/4843] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:56 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1215 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:35:57.519894 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-07598bf0-2297-4af8-a8a9-eb1064f65013 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:57.520535 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-07598bf0-2297-4af8-a8a9-eb1064f65013 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:57.541165 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07598bf0-2297-4af8-a8a9-eb1064f65013 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:57.541717 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07598bf0-2297-4af8-a8a9-eb1064f65013 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:57.542526 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07598bf0-2297-4af8-a8a9-eb1064f65013 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:57.545143 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07598bf0-2297-4af8-a8a9-eb1064f65013 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:57.628825 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-843eb6d2-d5c6-4726-bfb8-8a729504a0b4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:35:57.629289 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-843eb6d2-d5c6-4726-bfb8-8a729504a0b4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:35:57.629740 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-843eb6d2-d5c6-4726-bfb8-8a729504a0b4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:35:57.630514 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-843eb6d2-d5c6-4726-bfb8-8a729504a0b4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:35:57.631097 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-843eb6d2-d5c6-4726-bfb8-8a729504a0b4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:35:57.652757 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-843eb6d2-d5c6-4726-bfb8-8a729504a0b4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:57.655115 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-843eb6d2-d5c6-4726-bfb8-8a729504a0b4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:57.656024 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-843eb6d2-d5c6-4726-bfb8-8a729504a0b4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:57.659963 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-843eb6d2-d5c6-4726-bfb8-8a729504a0b4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:57.725436 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-843eb6d2-d5c6-4726-bfb8-8a729504a0b4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Getting quotas for project d070c9c7ec3047b0ad5f717036656042. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:35:57.749236 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-843eb6d2-d5c6-4726-bfb8-8a729504a0b4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Getting quotas for user 6091fad22d5c4296b090d98a5fc34ced and project d070c9c7ec3047b0ad5f717036656042. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:35:57.830995 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-843eb6d2-d5c6-4726-bfb8-8a729504a0b4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:35:57.834013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-843eb6d2-d5c6-4726-bfb8-8a729504a0b4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:35:57.916368 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-07598bf0-2297-4af8-a8a9-eb1064f65013 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a2cf6dbdcf46caab451047c31a8a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8d35e24404250a07086d76518a537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:57.928215 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-07598bf0-2297-4af8-a8a9-eb1064f65013 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] 10.222.0.45 "GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 200 len: 1526 microversion: 2.1 time: 0.411966 Jul 31 01:35:57.944359 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2417/4844] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:57 2022] GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 1526 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:57.951227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-47a58c38-76f3-4934-aa64-69f3c07fc91e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:57.952257 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-47a58c38-76f3-4934-aa64-69f3c07fc91e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:57.960795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47a58c38-76f3-4934-aa64-69f3c07fc91e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:57.961543 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47a58c38-76f3-4934-aa64-69f3c07fc91e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:57.962565 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47a58c38-76f3-4934-aa64-69f3c07fc91e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:57.963234 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47a58c38-76f3-4934-aa64-69f3c07fc91e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:57.989528 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-843eb6d2-d5c6-4726-bfb8-8a729504a0b4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.102923 Jul 31 01:35:57.990209 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2428/4845] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:35:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:35:58.000648 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-828bbbf9-5b05-4711-b91d-caf8a53f350b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:58.001173 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-828bbbf9-5b05-4711-b91d-caf8a53f350b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:58.037447 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-828bbbf9-5b05-4711-b91d-caf8a53f350b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:58.037908 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-828bbbf9-5b05-4711-b91d-caf8a53f350b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:58.038693 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-828bbbf9-5b05-4711-b91d-caf8a53f350b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:58.039139 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-828bbbf9-5b05-4711-b91d-caf8a53f350b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:58.191307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-47a58c38-76f3-4934-aa64-69f3c07fc91e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:58.209886 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-47a58c38-76f3-4934-aa64-69f3c07fc91e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1512 microversion: 2.1 time: 0.261800 Jul 31 01:35:58.212123 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2418/4846] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:57 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:58.219959 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eca4ebe8-0d0c-4ead-b5db-d144cb758fd3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:58.221080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eca4ebe8-0d0c-4ead-b5db-d144cb758fd3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:58.380142 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-828bbbf9-5b05-4711-b91d-caf8a53f350b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a2cf6dbdcf46caab451047c31a8a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8d35e24404250a07086d76518a537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:58.389329 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-828bbbf9-5b05-4711-b91d-caf8a53f350b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] 10.222.0.45 "GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 200 len: 1526 microversion: 2.1 time: 0.392466 Jul 31 01:35:58.389829 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2429/4847] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:57 2022] GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 1526 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:58.591206 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eca4ebe8-0d0c-4ead-b5db-d144cb758fd3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:58.606494 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eca4ebe8-0d0c-4ead-b5db-d144cb758fd3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 200 len: 1219 microversion: 2.1 time: 0.389065 Jul 31 01:35:58.609147 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2419/4848] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:58 2022] GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 1219 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:58.622760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c33492f9-ef10-434f-9463-be39d249971c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:58.624891 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c33492f9-ef10-434f-9463-be39d249971c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:58.645189 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c33492f9-ef10-434f-9463-be39d249971c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:58.646353 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c33492f9-ef10-434f-9463-be39d249971c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:58.649154 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c33492f9-ef10-434f-9463-be39d249971c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:58.650826 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c33492f9-ef10-434f-9463-be39d249971c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:58.838007 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c4c5458e-d19d-4164-8823-bb1a37b931c5 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:58.838583 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c4c5458e-d19d-4164-8823-bb1a37b931c5 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:58.848334 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c4c5458e-d19d-4164-8823-bb1a37b931c5 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:58.848810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c4c5458e-d19d-4164-8823-bb1a37b931c5 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:58.849615 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c4c5458e-d19d-4164-8823-bb1a37b931c5 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:58.850209 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c4c5458e-d19d-4164-8823-bb1a37b931c5 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:58.867418 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-c4c5458e-d19d-4164-8823-bb1a37b931c5 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] HTTP exception thrown: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c4c5458e-d19d-4164-8823-bb1a37b931c5 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] Request method failure captured: Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe HTTP/1.1 Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dxpsc1ljVcBCgy3Dx5v5kA0L5Ya4McuSIbn2jruarJ_0Cl_bmsNjMiH_EsxxIlfJ4G4MkIPeKLFIk47tjnpw02pq1-rw7dZsrFzg8xV3SqmA_-wIbotmM6HY9UrmHttfweB-_KHXf8bGuhQsh8BEeQijCihdnb2rQHmJOc-u71hUfg Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 5daa06c1422c4d398959f893c961f8f8 Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1327084851 Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5daa06c1422c4d398959f893c961f8f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5daa06c1422c4d398959f893c961f8f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5daa06c1422c4d398959f893c961f8f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5daa06c1422c4d398959f893c961f8f8", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1327084851 Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 5daa06c1422c4d398959f893c961f8f8 Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1327084851 Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1327084851-project Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: d2a3df3cf25f48c8900e0c6ec6c2b3ef Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1327084851-project Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '1963033e-fe60-4505-a245-130afd1e56fe'} Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:35:58.869422 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:35:58.872899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. Jul 31 01:35:58.872899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:35:58.872899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:35:58.872899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:35:58.872899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:35:58.872899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:35:58.872899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:35:58.872899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:35:58.872899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:35:58.872899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. Jul 31 01:35:58.872899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:35:58.872899 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c4c5458e-d19d-4164-8823-bb1a37b931c5 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] Returning 404 to user: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:35:58.872899 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c4c5458e-d19d-4164-8823-bb1a37b931c5 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 404 len: 111 microversion: 2.1 time: 0.464108 Jul 31 01:35:58.877848 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2430/4849] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:35:58 2022] DELETE /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 111 bytes in 471 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:35:58.883930 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-df139b6d-ff5f-44eb-ab63-0b8a0ab5a5da tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:58.884775 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-df139b6d-ff5f-44eb-ab63-0b8a0ab5a5da tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:58.903137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df139b6d-ff5f-44eb-ab63-0b8a0ab5a5da tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:58.903852 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df139b6d-ff5f-44eb-ab63-0b8a0ab5a5da tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:58.904815 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df139b6d-ff5f-44eb-ab63-0b8a0ab5a5da tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:58.905460 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df139b6d-ff5f-44eb-ab63-0b8a0ab5a5da tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:59.044968 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 01:35:59.045539 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 01:35:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 (ip 10.222.0.45) !!! Jul 31 01:35:59.162111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c33492f9-ef10-434f-9463-be39d249971c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:59.181797 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c33492f9-ef10-434f-9463-be39d249971c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1215 microversion: 2.1 time: 0.571270 Jul 31 01:35:59.182400 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2420/4850] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:58 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1215 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:59.239489 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-53a2ba30-6d18-4ba4-ac1e-7a69a3b0efc8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:59.240226 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-53a2ba30-6d18-4ba4-ac1e-7a69a3b0efc8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:59.269597 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53a2ba30-6d18-4ba4-ac1e-7a69a3b0efc8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:59.270075 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53a2ba30-6d18-4ba4-ac1e-7a69a3b0efc8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:59.270940 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53a2ba30-6d18-4ba4-ac1e-7a69a3b0efc8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:59.271420 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53a2ba30-6d18-4ba4-ac1e-7a69a3b0efc8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:59.324823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-df139b6d-ff5f-44eb-ab63-0b8a0ab5a5da tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a2cf6dbdcf46caab451047c31a8a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8d35e24404250a07086d76518a537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:59.337802 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-df139b6d-ff5f-44eb-ab63-0b8a0ab5a5da tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] 10.222.0.45 "GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 200 len: 1526 microversion: 2.1 time: 0.458519 Jul 31 01:35:59.338400 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2431/4851] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:58 2022] GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 1526 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:59.365725 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7dc802f0-b847-41e8-a91d-479e180d8c97 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] Action: 'update', calling method: >, body: {"server": {"name": "1963033e-fe60-4505-a245-130afd1e56fe_new"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:35:59.368382 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7dc802f0-b847-41e8-a91d-479e180d8c97 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:59.400421 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7dc802f0-b847-41e8-a91d-479e180d8c97 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:59.408118 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7dc802f0-b847-41e8-a91d-479e180d8c97 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:59.408981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7dc802f0-b847-41e8-a91d-479e180d8c97 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:59.409440 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7dc802f0-b847-41e8-a91d-479e180d8c97 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:59.475357 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-7dc802f0-b847-41e8-a91d-479e180d8c97 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] HTTP exception thrown: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7dc802f0-b847-41e8-a91d-479e180d8c97 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] Request method failure captured: Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: request: PUT /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe HTTP/1.1 Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 64 Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dxpsc1ljVcBCgy3Dx5v5kA0L5Ya4McuSIbn2jruarJ_0Cl_bmsNjMiH_EsxxIlfJ4G4MkIPeKLFIk47tjnpw02pq1-rw7dZsrFzg8xV3SqmA_-wIbotmM6HY9UrmHttfweB-_KHXf8bGuhQsh8BEeQijCihdnb2rQHmJOc-u71hUfg Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 5daa06c1422c4d398959f893c961f8f8 Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1327084851 Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5daa06c1422c4d398959f893c961f8f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5daa06c1422c4d398959f893c961f8f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5daa06c1422c4d398959f893c961f8f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5daa06c1422c4d398959f893c961f8f8", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1327084851 Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 5daa06c1422c4d398959f893c961f8f8 Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1327084851 Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1327084851-project Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: d2a3df3cf25f48c8900e0c6ec6c2b3ef Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1327084851-project Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: {"server": {"name": "1963033e-fe60-4505-a245-130afd1e56fe_new"}} Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '1963033e-fe60-4505-a245-130afd1e56fe', 'body': {'server': {'name': '1963033e-fe60-4505-a245-130afd1e56fe_new'}}} Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 31 01:35:59.487893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 31 01:35:59.491318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 31 01:35:59.491318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:35:59.491318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:35:59.491318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:35:59.491318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:35:59.491318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. Jul 31 01:35:59.491318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:35:59.491318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:35:59.491318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:35:59.491318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:35:59.491318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:35:59.491318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:35:59.491318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:35:59.491318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:35:59.491318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. Jul 31 01:35:59.491318 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:35:59.496261 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7dc802f0-b847-41e8-a91d-479e180d8c97 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] Returning 404 to user: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:35:59.497792 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7dc802f0-b847-41e8-a91d-479e180d8c97 tempest-ServersNegativeTestMultiTenantJSON-1327084851 tempest-ServersNegativeTestMultiTenantJSON-1327084851-project] 10.222.0.45 "PUT /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 404 len: 111 microversion: 2.1 time: 0.136498 Jul 31 01:35:59.498661 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2432/4852] 10.222.0.45 () {60 vars in 1256 bytes} [Sun Jul 31 01:35:59 2022] PUT /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:35:59.509999 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc7b86b8-e669-4a63-8256-faf4f81384fd tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:59.512003 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc7b86b8-e669-4a63-8256-faf4f81384fd tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:59.526712 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc7b86b8-e669-4a63-8256-faf4f81384fd tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:59.529695 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc7b86b8-e669-4a63-8256-faf4f81384fd tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:59.530836 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc7b86b8-e669-4a63-8256-faf4f81384fd tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:59.532717 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc7b86b8-e669-4a63-8256-faf4f81384fd tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:59.628734 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc7b86b8-e669-4a63-8256-faf4f81384fd tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:35:59.802238 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc7b86b8-e669-4a63-8256-faf4f81384fd tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 204 len: 0 microversion: 2.1 time: 0.296385 Jul 31 01:35:59.803030 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2433/4853] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:35:59 2022] DELETE /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:35:59.817183 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-51a04fc3-599b-491e-9999-f531f3238e3f tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:59.818063 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-51a04fc3-599b-491e-9999-f531f3238e3f tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:59.830600 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51a04fc3-599b-491e-9999-f531f3238e3f tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:59.834767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51a04fc3-599b-491e-9999-f531f3238e3f tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:59.835820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51a04fc3-599b-491e-9999-f531f3238e3f tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:59.836399 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51a04fc3-599b-491e-9999-f531f3238e3f tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:59.854600 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-53a2ba30-6d18-4ba4-ac1e-7a69a3b0efc8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:35:59.857611 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:59.867363 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-53a2ba30-6d18-4ba4-ac1e-7a69a3b0efc8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1512 microversion: 2.1 time: 0.634649 Jul 31 01:35:59.872113 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2421/4854] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:59 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1512 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:35:59.900384 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c09fe3ef-1146-493b-9c68-47c094818429 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:35:59.901518 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c09fe3ef-1146-493b-9c68-47c094818429 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:35:59.920415 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c09fe3ef-1146-493b-9c68-47c094818429 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:59.922085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c09fe3ef-1146-493b-9c68-47c094818429 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:35:59.928619 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c09fe3ef-1146-493b-9c68-47c094818429 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:35:59.929373 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c09fe3ef-1146-493b-9c68-47c094818429 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:00.117465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-51a04fc3-599b-491e-9999-f531f3238e3f tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:00.128789 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-51a04fc3-599b-491e-9999-f531f3238e3f tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 200 len: 1271 microversion: 2.1 time: 0.323737 Jul 31 01:36:00.129898 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2434/4855] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:59 2022] GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 1271 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:00.203882 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4efef03f-d650-4fdc-8f05-f4518bb08b68 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:00.205412 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4efef03f-d650-4fdc-8f05-f4518bb08b68 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:00.224564 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4efef03f-d650-4fdc-8f05-f4518bb08b68 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:00.227500 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4efef03f-d650-4fdc-8f05-f4518bb08b68 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:00.228755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4efef03f-d650-4fdc-8f05-f4518bb08b68 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:00.232629 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4efef03f-d650-4fdc-8f05-f4518bb08b68 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:00.291397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c09fe3ef-1146-493b-9c68-47c094818429 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a2cf6dbdcf46caab451047c31a8a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8d35e24404250a07086d76518a537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:00.310439 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c09fe3ef-1146-493b-9c68-47c094818429 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] 10.222.0.45 "GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 200 len: 1532 microversion: 2.1 time: 0.436931 Jul 31 01:36:00.312563 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2422/4856] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:35:59 2022] GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 1532 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:00.640953 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4efef03f-d650-4fdc-8f05-f4518bb08b68 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:00.655020 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4efef03f-d650-4fdc-8f05-f4518bb08b68 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1215 microversion: 2.1 time: 0.455757 Jul 31 01:36:00.669024 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2435/4857] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:00 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1215 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:00.894829 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7e3cf8aa-501c-46e0-aa1e-8ceef712b5c8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:00.895865 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7e3cf8aa-501c-46e0-aa1e-8ceef712b5c8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:00.907825 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e3cf8aa-501c-46e0-aa1e-8ceef712b5c8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:00.908609 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e3cf8aa-501c-46e0-aa1e-8ceef712b5c8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:00.909654 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e3cf8aa-501c-46e0-aa1e-8ceef712b5c8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:00.910313 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e3cf8aa-501c-46e0-aa1e-8ceef712b5c8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:01.158918 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-663b03a7-6d98-4e71-a717-5910cb3cb9f2 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:01.164580 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-663b03a7-6d98-4e71-a717-5910cb3cb9f2 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:01.203665 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-663b03a7-6d98-4e71-a717-5910cb3cb9f2 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:01.204418 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-663b03a7-6d98-4e71-a717-5910cb3cb9f2 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:01.205391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-663b03a7-6d98-4e71-a717-5910cb3cb9f2 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:01.205997 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-663b03a7-6d98-4e71-a717-5910cb3cb9f2 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:01.400123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7e3cf8aa-501c-46e0-aa1e-8ceef712b5c8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:01.409211 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7e3cf8aa-501c-46e0-aa1e-8ceef712b5c8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1512 microversion: 2.1 time: 0.521151 Jul 31 01:36:01.411550 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2423/4858] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:00 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1512 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:01.427983 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7032271e-a84e-47e0-923b-218e96f9bb80 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:01.429068 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7032271e-a84e-47e0-923b-218e96f9bb80 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:01.437143 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7032271e-a84e-47e0-923b-218e96f9bb80 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:01.443916 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7032271e-a84e-47e0-923b-218e96f9bb80 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:01.445232 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7032271e-a84e-47e0-923b-218e96f9bb80 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:01.445912 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7032271e-a84e-47e0-923b-218e96f9bb80 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:01.527795 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-663b03a7-6d98-4e71-a717-5910cb3cb9f2 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:01.546916 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-663b03a7-6d98-4e71-a717-5910cb3cb9f2 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 200 len: 1279 microversion: 2.1 time: 0.399405 Jul 31 01:36:01.556751 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2436/4859] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:01 2022] GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 1279 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:36:01.707983 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b5ec755f-2b23-4b07-ba06-ef832986d228 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:01.711242 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b5ec755f-2b23-4b07-ba06-ef832986d228 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:01.714347 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7032271e-a84e-47e0-923b-218e96f9bb80 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a2cf6dbdcf46caab451047c31a8a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8d35e24404250a07086d76518a537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:01.732463 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7032271e-a84e-47e0-923b-218e96f9bb80 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] 10.222.0.45 "GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 200 len: 1532 microversion: 2.1 time: 0.317837 Jul 31 01:36:01.735063 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5ec755f-2b23-4b07-ba06-ef832986d228 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:01.736544 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5ec755f-2b23-4b07-ba06-ef832986d228 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:01.737573 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5ec755f-2b23-4b07-ba06-ef832986d228 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:01.738559 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5ec755f-2b23-4b07-ba06-ef832986d228 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:01.745493 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2424/4860] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:01 2022] GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 1532 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:02.435688 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5a9a6c04-7920-4a7b-936d-c82fd577d6be tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:02.436315 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5a9a6c04-7920-4a7b-936d-c82fd577d6be tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:02.458458 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a9a6c04-7920-4a7b-936d-c82fd577d6be tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:02.458932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a9a6c04-7920-4a7b-936d-c82fd577d6be tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:02.459780 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a9a6c04-7920-4a7b-936d-c82fd577d6be tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:02.460228 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a9a6c04-7920-4a7b-936d-c82fd577d6be tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:02.497791 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b5ec755f-2b23-4b07-ba06-ef832986d228 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:02.522658 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b5ec755f-2b23-4b07-ba06-ef832986d228 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1203 microversion: 2.1 time: 0.847756 Jul 31 01:36:02.524912 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2437/4861] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:01 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1203 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:02.580922 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ad4d14ee-190d-4c94-9ff1-6dcb2d21a569 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:02.582219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ad4d14ee-190d-4c94-9ff1-6dcb2d21a569 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:02.614548 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad4d14ee-190d-4c94-9ff1-6dcb2d21a569 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:02.635503 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad4d14ee-190d-4c94-9ff1-6dcb2d21a569 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:02.636942 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad4d14ee-190d-4c94-9ff1-6dcb2d21a569 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:02.637607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad4d14ee-190d-4c94-9ff1-6dcb2d21a569 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:02.753778 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ad4d14ee-190d-4c94-9ff1-6dcb2d21a569 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:02.763356 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ad4d14ee-190d-4c94-9ff1-6dcb2d21a569 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 200 len: 1277 microversion: 2.1 time: 0.193563 Jul 31 01:36:02.769345 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2438/4862] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:02 2022] GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:36:02.777669 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b6069c1e-3ae6-4cc8-a9c5-6a359adc3008 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:02.780339 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b6069c1e-3ae6-4cc8-a9c5-6a359adc3008 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:02.794517 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6069c1e-3ae6-4cc8-a9c5-6a359adc3008 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:02.799474 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6069c1e-3ae6-4cc8-a9c5-6a359adc3008 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:02.800590 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6069c1e-3ae6-4cc8-a9c5-6a359adc3008 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:02.801596 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6069c1e-3ae6-4cc8-a9c5-6a359adc3008 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:02.864294 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5a9a6c04-7920-4a7b-936d-c82fd577d6be tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:02.877459 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5a9a6c04-7920-4a7b-936d-c82fd577d6be tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1512 microversion: 2.1 time: 0.445280 Jul 31 01:36:02.877594 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2425/4863] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:02 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1512 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:03.048926 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b6069c1e-3ae6-4cc8-a9c5-6a359adc3008 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14a2cf6dbdcf46caab451047c31a8a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8d35e24404250a07086d76518a537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:03.063972 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b6069c1e-3ae6-4cc8-a9c5-6a359adc3008 tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] 10.222.0.45 "GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 200 len: 1532 microversion: 2.1 time: 0.286486 Jul 31 01:36:03.071854 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2439/4864] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:02 2022] GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 1532 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:03.575818 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-4e2996eb-792b-44f6-89cb-4bffd1515121 req-8590d8f5-2b42-4af7-9ef8-408fa5a4ebed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1963033e-fe60-4505-a245-130afd1e56fe", "name": "network-vif-deleted", "tag": "508dba01-3c6b-4408-a274-e587d2dba021"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:36:03.592809 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7760d425-4ca5-4a34-b321-71572946df76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:03.595919 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7760d425-4ca5-4a34-b321-71572946df76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:03.599726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4e2996eb-792b-44f6-89cb-4bffd1515121 req-8590d8f5-2b42-4af7-9ef8-408fa5a4ebed service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:03.601708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4e2996eb-792b-44f6-89cb-4bffd1515121 req-8590d8f5-2b42-4af7-9ef8-408fa5a4ebed service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:03.635122 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7760d425-4ca5-4a34-b321-71572946df76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:03.636562 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7760d425-4ca5-4a34-b321-71572946df76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:03.641098 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7760d425-4ca5-4a34-b321-71572946df76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:03.642035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7760d425-4ca5-4a34-b321-71572946df76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:03.664562 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-4e2996eb-792b-44f6-89cb-4bffd1515121 req-8590d8f5-2b42-4af7-9ef8-408fa5a4ebed service nova] Creating event network-vif-deleted:508dba01-3c6b-4408-a274-e587d2dba021 for instance 1963033e-fe60-4505-a245-130afd1e56fe on n-h2-master-1 Jul 31 01:36:03.692665 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-4e2996eb-792b-44f6-89cb-4bffd1515121 req-8590d8f5-2b42-4af7-9ef8-408fa5a4ebed service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121005 Jul 31 01:36:03.696555 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2440/4865] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:36:03.789445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7db83da7-5432-46a2-83df-b17fe3babd6b tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:03.790461 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7db83da7-5432-46a2-83df-b17fe3babd6b tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:03.804116 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7db83da7-5432-46a2-83df-b17fe3babd6b tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:03.805139 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7db83da7-5432-46a2-83df-b17fe3babd6b tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:03.806182 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7db83da7-5432-46a2-83df-b17fe3babd6b tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:03.806866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7db83da7-5432-46a2-83df-b17fe3babd6b tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:04.084230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7db83da7-5432-46a2-83df-b17fe3babd6b tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:04.123074 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7db83da7-5432-46a2-83df-b17fe3babd6b tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 200 len: 1277 microversion: 2.1 time: 0.335230 Jul 31 01:36:04.125081 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2441/4866] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:03 2022] GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 1277 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:04.130022 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f62832d4-7902-4f8b-8542-980e014d8459 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:04.155163 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f62832d4-7902-4f8b-8542-980e014d8459 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:04.184993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f62832d4-7902-4f8b-8542-980e014d8459 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:04.186806 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f62832d4-7902-4f8b-8542-980e014d8459 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:04.206264 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f62832d4-7902-4f8b-8542-980e014d8459 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:04.207071 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f62832d4-7902-4f8b-8542-980e014d8459 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:05.351513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7760d425-4ca5-4a34-b321-71572946df76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:05.366668 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7760d425-4ca5-4a34-b321-71572946df76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1203 microversion: 2.1 time: 1.822810 Jul 31 01:36:05.368026 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2426/4867] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:03 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1203 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:05.378992 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3ef9b1dc-7b9f-4985-bc18-6677d1a0bb9b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:05.379916 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3ef9b1dc-7b9f-4985-bc18-6677d1a0bb9b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] [instance: 1963033e-fe60-4505-a245-130afd1e56fe] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:05.387958 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ef9b1dc-7b9f-4985-bc18-6677d1a0bb9b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:05.388885 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ef9b1dc-7b9f-4985-bc18-6677d1a0bb9b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:05.390021 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ef9b1dc-7b9f-4985-bc18-6677d1a0bb9b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:05.391778 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3ef9b1dc-7b9f-4985-bc18-6677d1a0bb9b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:05.415245 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f62832d4-7902-4f8b-8542-980e014d8459 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:05.425426 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-3ef9b1dc-7b9f-4985-bc18-6677d1a0bb9b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] HTTP exception thrown: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3ef9b1dc-7b9f-4985-bc18-6677d1a0bb9b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Request method failure captured: Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe HTTP/1.1 Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dxa_QpA4Au8xNM1JkldK-gQpcKnWKeU2OWLMamEwYiVlfQdUIBzncmEsGw2Rq0riNf9NylPQ9XSCpEzq52N3NQ6eCgaCM7pXdAuO1VeHYsGtXz_sNdbAOQyzoVSpOl4naH-fWqQE1NErliU4l4hPRPXDM7nSf2QdpkMenv57BF3NtU Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: d6d8d35e24404250a07086d76518a537 Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-857445270 Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d6d8d35e24404250a07086d76518a537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d6d8d35e24404250a07086d76518a537"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d6d8d35e24404250a07086d76518a537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d6d8d35e24404250a07086d76518a537", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-857445270 Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: d6d8d35e24404250a07086d76518a537 Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-857445270 Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestMultiTenantJSON-857445270-project Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 14a2cf6dbdcf46caab451047c31a8a3f Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-857445270-project Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '1963033e-fe60-4505-a245-130afd1e56fe'} Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:05.427424 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:05.432072 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:05.432072 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:05.432072 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:05.432072 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:05.432072 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:36:05.432072 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:36:05.432072 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. Jul 31 01:36:05.432072 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:05.432604 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f62832d4-7902-4f8b-8542-980e014d8459 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1512 microversion: 2.1 time: 1.302042 Jul 31 01:36:05.432604 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2442/4868] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:04 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1512 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:05.434488 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3ef9b1dc-7b9f-4985-bc18-6677d1a0bb9b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] Returning 404 to user: Instance 1963033e-fe60-4505-a245-130afd1e56fe could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:36:05.435628 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3ef9b1dc-7b9f-4985-bc18-6677d1a0bb9b tempest-ServersNegativeTestMultiTenantJSON-857445270 tempest-ServersNegativeTestMultiTenantJSON-857445270-project] 10.222.0.45 "GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe" status: 404 len: 111 microversion: 2.1 time: 0.066234 Jul 31 01:36:05.436358 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2427/4869] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:05 2022] GET /compute/v2.1/servers/1963033e-fe60-4505-a245-130afd1e56fe => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:36:05.453057 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-abffdd10-5e17-4727-8f72-1337eae15af5 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:05.453700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-abffdd10-5e17-4727-8f72-1337eae15af5 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:05.468317 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abffdd10-5e17-4727-8f72-1337eae15af5 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:05.469069 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abffdd10-5e17-4727-8f72-1337eae15af5 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:05.471361 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abffdd10-5e17-4727-8f72-1337eae15af5 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:05.472753 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abffdd10-5e17-4727-8f72-1337eae15af5 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:05.733018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-abffdd10-5e17-4727-8f72-1337eae15af5 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:05.736071 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:05.742920 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-abffdd10-5e17-4727-8f72-1337eae15af5 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 200 len: 1319 microversion: 2.1 time: 0.299483 Jul 31 01:36:05.751164 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2443/4870] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:05 2022] GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:06.390316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3fca2d10-a6e7-4225-a12a-024328ede071 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:06.390956 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3fca2d10-a6e7-4225-a12a-024328ede071 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:06.409140 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3fca2d10-a6e7-4225-a12a-024328ede071 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:06.409821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3fca2d10-a6e7-4225-a12a-024328ede071 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:06.410814 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3fca2d10-a6e7-4225-a12a-024328ede071 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:06.411271 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3fca2d10-a6e7-4225-a12a-024328ede071 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:06.449700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-72616d1d-eb37-4668-bca1-2a4eca088607 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:06.451486 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-72616d1d-eb37-4668-bca1-2a4eca088607 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:06.462707 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72616d1d-eb37-4668-bca1-2a4eca088607 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:06.463395 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72616d1d-eb37-4668-bca1-2a4eca088607 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:06.464616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72616d1d-eb37-4668-bca1-2a4eca088607 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:06.465223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72616d1d-eb37-4668-bca1-2a4eca088607 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:06.752057 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-72616d1d-eb37-4668-bca1-2a4eca088607 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:06.770851 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3fca2d10-a6e7-4225-a12a-024328ede071 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:06.774716 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-72616d1d-eb37-4668-bca1-2a4eca088607 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1512 microversion: 2.1 time: 0.327574 Jul 31 01:36:06.776067 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2444/4871] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:06 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1512 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:06.783214 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b678678a-e282-4a4f-8e00-8a6ee3dc3d00 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:06.783941 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b678678a-e282-4a4f-8e00-8a6ee3dc3d00 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:06.794170 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b678678a-e282-4a4f-8e00-8a6ee3dc3d00 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:06.794980 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b678678a-e282-4a4f-8e00-8a6ee3dc3d00 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:06.796650 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b678678a-e282-4a4f-8e00-8a6ee3dc3d00 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:06.797319 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b678678a-e282-4a4f-8e00-8a6ee3dc3d00 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:06.812849 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3fca2d10-a6e7-4225-a12a-024328ede071 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1203 microversion: 2.1 time: 0.426475 Jul 31 01:36:06.828611 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2428/4872] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:06 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1203 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:06.999734 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b678678a-e282-4a4f-8e00-8a6ee3dc3d00 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:07.014413 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b678678a-e282-4a4f-8e00-8a6ee3dc3d00 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 200 len: 1319 microversion: 2.1 time: 0.237236 Jul 31 01:36:07.015666 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2445/4873] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:06 2022] GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:07.816831 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21317d84-1afa-4287-9fbe-b0e8ec5da5a8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:07.818023 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-21317d84-1afa-4287-9fbe-b0e8ec5da5a8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:07.834155 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-00317a47-eb6d-4331-a008-171f988420a7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:07.834700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-00317a47-eb6d-4331-a008-171f988420a7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:07.837459 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:07.838084 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:07.846434 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21317d84-1afa-4287-9fbe-b0e8ec5da5a8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:07.847149 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21317d84-1afa-4287-9fbe-b0e8ec5da5a8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:07.847971 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21317d84-1afa-4287-9fbe-b0e8ec5da5a8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:07.848417 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21317d84-1afa-4287-9fbe-b0e8ec5da5a8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:07.856701 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00317a47-eb6d-4331-a008-171f988420a7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:07.858240 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00317a47-eb6d-4331-a008-171f988420a7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:07.859281 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00317a47-eb6d-4331-a008-171f988420a7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:07.859882 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00317a47-eb6d-4331-a008-171f988420a7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:08.393809 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-21317d84-1afa-4287-9fbe-b0e8ec5da5a8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:08.403046 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-21317d84-1afa-4287-9fbe-b0e8ec5da5a8 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1512 microversion: 2.1 time: 0.605845 Jul 31 01:36:08.419261 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2429/4874] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:07 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1512 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:08.426125 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7f68973f-61f9-4c10-81c5-c4937eb21a07 req-e1526f5d-e9f6-4ee3-a41f-938a9d6e2208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c004dd94-50c6-4033-9bcc-47b64014c973", "tag": "de92d0ec-e296-462b-81bb-e3f52972564f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:36:08.430491 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-00317a47-eb6d-4331-a008-171f988420a7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:08.438392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7f68973f-61f9-4c10-81c5-c4937eb21a07 req-e1526f5d-e9f6-4ee3-a41f-938a9d6e2208 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:08.440315 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7f68973f-61f9-4c10-81c5-c4937eb21a07 req-e1526f5d-e9f6-4ee3-a41f-938a9d6e2208 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:08.444034 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-00317a47-eb6d-4331-a008-171f988420a7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1203 microversion: 2.1 time: 0.613810 Jul 31 01:36:08.449049 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2446/4875] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:07 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1203 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:36:08.450419 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a26ae2e4-4302-4d58-b3a9-35a0399b11e2 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:08.456177 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a26ae2e4-4302-4d58-b3a9-35a0399b11e2 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:08.466653 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7f68973f-61f9-4c10-81c5-c4937eb21a07 req-e1526f5d-e9f6-4ee3-a41f-938a9d6e2208 service nova] Creating event network-changed:de92d0ec-e296-462b-81bb-e3f52972564f for instance c004dd94-50c6-4033-9bcc-47b64014c973 on n-h2-master-1 Jul 31 01:36:08.470808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a26ae2e4-4302-4d58-b3a9-35a0399b11e2 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:08.473032 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a26ae2e4-4302-4d58-b3a9-35a0399b11e2 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:08.476055 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a26ae2e4-4302-4d58-b3a9-35a0399b11e2 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:08.476703 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a26ae2e4-4302-4d58-b3a9-35a0399b11e2 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:08.477102 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7f68973f-61f9-4c10-81c5-c4937eb21a07 req-e1526f5d-e9f6-4ee3-a41f-938a9d6e2208 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055342 Jul 31 01:36:08.477714 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2430/4876] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:36:08.691890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a26ae2e4-4302-4d58-b3a9-35a0399b11e2 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:08.704904 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a26ae2e4-4302-4d58-b3a9-35a0399b11e2 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 200 len: 1319 microversion: 2.1 time: 0.258648 Jul 31 01:36:08.713931 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2447/4877] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:08 2022] GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:09.421798 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:09.428019 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-28083814-453b-4353-abc7-31d205eabcca tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:09.428935 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-28083814-453b-4353-abc7-31d205eabcca tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:09.463400 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28083814-453b-4353-abc7-31d205eabcca tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:09.474615 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e4ee8c1e-3fa9-4193-adb8-caa88cbca228 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:09.476005 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e4ee8c1e-3fa9-4193-adb8-caa88cbca228 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:09.476440 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28083814-453b-4353-abc7-31d205eabcca tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:09.477266 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28083814-453b-4353-abc7-31d205eabcca tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:09.477712 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28083814-453b-4353-abc7-31d205eabcca tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:09.493848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4ee8c1e-3fa9-4193-adb8-caa88cbca228 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:09.501808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4ee8c1e-3fa9-4193-adb8-caa88cbca228 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:09.503066 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4ee8c1e-3fa9-4193-adb8-caa88cbca228 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:09.503845 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e4ee8c1e-3fa9-4193-adb8-caa88cbca228 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:10.093882 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-28083814-453b-4353-abc7-31d205eabcca tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:10.106979 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-28083814-453b-4353-abc7-31d205eabcca tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1512 microversion: 2.1 time: 0.685993 Jul 31 01:36:10.134561 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2431/4878] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:09 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1512 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:10.144713 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-07ae68a6-c881-4cd4-b05b-6993f9511c45 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:10.145488 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-07ae68a6-c881-4cd4-b05b-6993f9511c45 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:10.156816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07ae68a6-c881-4cd4-b05b-6993f9511c45 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:10.157539 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07ae68a6-c881-4cd4-b05b-6993f9511c45 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:10.158515 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07ae68a6-c881-4cd4-b05b-6993f9511c45 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:10.159767 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07ae68a6-c881-4cd4-b05b-6993f9511c45 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:10.162332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e4ee8c1e-3fa9-4193-adb8-caa88cbca228 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:10.172950 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e4ee8c1e-3fa9-4193-adb8-caa88cbca228 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1203 microversion: 2.1 time: 0.708793 Jul 31 01:36:10.191142 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2448/4879] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:09 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1203 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:36:10.499795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-07ae68a6-c881-4cd4-b05b-6993f9511c45 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:10.509160 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-07ae68a6-c881-4cd4-b05b-6993f9511c45 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 200 len: 1319 microversion: 2.1 time: 0.373335 Jul 31 01:36:10.510024 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2432/4880] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:10 2022] GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:10.638422 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-27ea3b89-6ca2-484c-bed5-5c83258b546c req-91e4276d-5498-47ea-8965-483c3f00416a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493b0ac5-4c13-41eb-b81d-f79717202ff1", "name": "network-vif-plugged", "status": "completed", "tag": "8c49b471-b0fa-4f4e-b1cd-113919d5ab72"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:36:10.651227 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-27ea3b89-6ca2-484c-bed5-5c83258b546c req-91e4276d-5498-47ea-8965-483c3f00416a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:10.651720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-27ea3b89-6ca2-484c-bed5-5c83258b546c req-91e4276d-5498-47ea-8965-483c3f00416a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:10.666321 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-27ea3b89-6ca2-484c-bed5-5c83258b546c req-91e4276d-5498-47ea-8965-483c3f00416a service nova] Creating event network-vif-plugged:8c49b471-b0fa-4f4e-b1cd-113919d5ab72 for instance 493b0ac5-4c13-41eb-b81d-f79717202ff1 on n-h1-master-1 Jul 31 01:36:10.674195 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-27ea3b89-6ca2-484c-bed5-5c83258b546c req-91e4276d-5498-47ea-8965-483c3f00416a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038776 Jul 31 01:36:10.675368 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2449/4881] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:36:11.132041 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0e05d399-530d-4f85-a2fb-e9ba7c5609ba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:11.132985 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0e05d399-530d-4f85-a2fb-e9ba7c5609ba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:11.143984 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e05d399-530d-4f85-a2fb-e9ba7c5609ba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:11.144640 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e05d399-530d-4f85-a2fb-e9ba7c5609ba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:11.146846 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e05d399-530d-4f85-a2fb-e9ba7c5609ba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:11.154085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e05d399-530d-4f85-a2fb-e9ba7c5609ba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:11.198597 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e09ce660-7838-489c-a1d5-71914d0bcf76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:11.199327 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e09ce660-7838-489c-a1d5-71914d0bcf76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:11.210050 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e09ce660-7838-489c-a1d5-71914d0bcf76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:11.212361 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e09ce660-7838-489c-a1d5-71914d0bcf76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:11.215223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e09ce660-7838-489c-a1d5-71914d0bcf76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:11.215796 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e09ce660-7838-489c-a1d5-71914d0bcf76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:11.619965 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e05d399-530d-4f85-a2fb-e9ba7c5609ba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:11.637004 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0e05d399-530d-4f85-a2fb-e9ba7c5609ba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1512 microversion: 2.1 time: 0.508403 Jul 31 01:36:11.639621 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2433/4882] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:11 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1512 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:11.652508 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1c144c42-1e84-4a77-8018-fd754f5a79c3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:11.653995 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1c144c42-1e84-4a77-8018-fd754f5a79c3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:11.672189 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c144c42-1e84-4a77-8018-fd754f5a79c3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:11.674803 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c144c42-1e84-4a77-8018-fd754f5a79c3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:11.676334 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c144c42-1e84-4a77-8018-fd754f5a79c3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:11.678608 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c144c42-1e84-4a77-8018-fd754f5a79c3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:11.854305 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e09ce660-7838-489c-a1d5-71914d0bcf76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:11.885777 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e09ce660-7838-489c-a1d5-71914d0bcf76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1203 microversion: 2.1 time: 0.688697 Jul 31 01:36:11.887996 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2450/4883] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:11 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1203 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:36:11.992821 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1c144c42-1e84-4a77-8018-fd754f5a79c3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:12.003983 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1c144c42-1e84-4a77-8018-fd754f5a79c3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 200 len: 1319 microversion: 2.1 time: 0.362590 Jul 31 01:36:12.004600 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2434/4884] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:11 2022] GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:12.658726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c5f171ff-73f2-4c8e-9594-76cde2780431 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:12.659362 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c5f171ff-73f2-4c8e-9594-76cde2780431 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:12.674070 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5f171ff-73f2-4c8e-9594-76cde2780431 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:12.674546 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5f171ff-73f2-4c8e-9594-76cde2780431 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:12.675665 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5f171ff-73f2-4c8e-9594-76cde2780431 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:12.678291 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5f171ff-73f2-4c8e-9594-76cde2780431 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:12.908022 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-066e31da-7528-4757-9d74-ce1916d52066 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:12.908658 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-066e31da-7528-4757-9d74-ce1916d52066 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:12.919242 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-066e31da-7528-4757-9d74-ce1916d52066 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:12.920050 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-066e31da-7528-4757-9d74-ce1916d52066 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:12.921034 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-066e31da-7528-4757-9d74-ce1916d52066 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:12.921635 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-066e31da-7528-4757-9d74-ce1916d52066 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:13.820054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c5f171ff-73f2-4c8e-9594-76cde2780431 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:13.828213 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-066e31da-7528-4757-9d74-ce1916d52066 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:13.833482 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c5f171ff-73f2-4c8e-9594-76cde2780431 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1512 microversion: 2.1 time: 1.179125 Jul 31 01:36:13.834831 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2451/4885] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:12 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1512 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:13.839043 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-066e31da-7528-4757-9d74-ce1916d52066 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1388 microversion: 2.1 time: 0.935710 Jul 31 01:36:13.843078 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2435/4886] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:12 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1388 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:13.850450 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-326dfd59-a5ab-45d6-bdac-c6b214c10afc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:13.851418 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-326dfd59-a5ab-45d6-bdac-c6b214c10afc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:13.860149 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d94e98f6-9dae-4ee1-8c5e-6cd7805fdfd8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:13.861645 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d94e98f6-9dae-4ee1-8c5e-6cd7805fdfd8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:13.872998 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d94e98f6-9dae-4ee1-8c5e-6cd7805fdfd8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:13.873786 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-326dfd59-a5ab-45d6-bdac-c6b214c10afc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:13.874316 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-326dfd59-a5ab-45d6-bdac-c6b214c10afc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:13.875128 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-326dfd59-a5ab-45d6-bdac-c6b214c10afc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:13.875986 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-326dfd59-a5ab-45d6-bdac-c6b214c10afc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:13.876717 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d94e98f6-9dae-4ee1-8c5e-6cd7805fdfd8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:13.877681 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d94e98f6-9dae-4ee1-8c5e-6cd7805fdfd8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:13.880265 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d94e98f6-9dae-4ee1-8c5e-6cd7805fdfd8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:14.192084 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-326dfd59-a5ab-45d6-bdac-c6b214c10afc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:14.214234 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-326dfd59-a5ab-45d6-bdac-c6b214c10afc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 200 len: 1319 microversion: 2.1 time: 0.377418 Jul 31 01:36:14.215490 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2452/4887] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:13 2022] GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:14.228340 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d94e98f6-9dae-4ee1-8c5e-6cd7805fdfd8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:14.241080 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d94e98f6-9dae-4ee1-8c5e-6cd7805fdfd8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1388 microversion: 2.1 time: 0.383158 Jul 31 01:36:14.243310 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2436/4888] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:13 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1388 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:14.269367 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-20f10b60-365b-4f93-8d5a-75e10f5cdcc6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:14.270204 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-20f10b60-365b-4f93-8d5a-75e10f5cdcc6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:14.288407 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20f10b60-365b-4f93-8d5a-75e10f5cdcc6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:14.290049 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20f10b60-365b-4f93-8d5a-75e10f5cdcc6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:14.293358 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20f10b60-365b-4f93-8d5a-75e10f5cdcc6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:14.296428 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20f10b60-365b-4f93-8d5a-75e10f5cdcc6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:14.677425 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-20f10b60-365b-4f93-8d5a-75e10f5cdcc6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:14.690847 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-20f10b60-365b-4f93-8d5a-75e10f5cdcc6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1388 microversion: 2.1 time: 0.430205 Jul 31 01:36:14.691464 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2453/4889] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:14 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1388 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:14.711302 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e5bcfb89-c9a2-4485-9525-bc125cc19c97 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:14.712122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e5bcfb89-c9a2-4485-9525-bc125cc19c97 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:14.718541 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5bcfb89-c9a2-4485-9525-bc125cc19c97 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:14.719227 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5bcfb89-c9a2-4485-9525-bc125cc19c97 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:14.720756 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5bcfb89-c9a2-4485-9525-bc125cc19c97 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:14.721422 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5bcfb89-c9a2-4485-9525-bc125cc19c97 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:14.751230 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e5bcfb89-c9a2-4485-9525-bc125cc19c97 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:36:14.861989 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ad69d516-7345-4ed4-b9ef-8c4d4f7d06c6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:14.862684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ad69d516-7345-4ed4-b9ef-8c4d4f7d06c6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:14.871884 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e5bcfb89-c9a2-4485-9525-bc125cc19c97 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "DELETE /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 204 len: 0 microversion: 2.1 time: 0.162704 Jul 31 01:36:14.876705 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2437/4890] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:36:14 2022] DELETE /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:36:14.883129 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad69d516-7345-4ed4-b9ef-8c4d4f7d06c6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:14.884851 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5f391688-146e-4d49-9436-f1d043672308 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:14.885146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad69d516-7345-4ed4-b9ef-8c4d4f7d06c6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:14.886008 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5f391688-146e-4d49-9436-f1d043672308 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:14.892515 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad69d516-7345-4ed4-b9ef-8c4d4f7d06c6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:14.894630 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad69d516-7345-4ed4-b9ef-8c4d4f7d06c6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:14.894783 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f391688-146e-4d49-9436-f1d043672308 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:14.895474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f391688-146e-4d49-9436-f1d043672308 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:14.896486 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f391688-146e-4d49-9436-f1d043672308 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:14.897120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f391688-146e-4d49-9436-f1d043672308 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:14.903683 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:15.226034 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5f391688-146e-4d49-9436-f1d043672308 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:15.240882 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5f391688-146e-4d49-9436-f1d043672308 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1394 microversion: 2.1 time: 0.362455 Jul 31 01:36:15.241587 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2438/4891] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:14 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1394 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:15.268111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f7dfaa23-4784-4c8e-92a7-64f89c71ffba tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:15.272161 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f7dfaa23-4784-4c8e-92a7-64f89c71ffba tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:15.287435 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7dfaa23-4784-4c8e-92a7-64f89c71ffba tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:15.288055 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7dfaa23-4784-4c8e-92a7-64f89c71ffba tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:15.289423 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7dfaa23-4784-4c8e-92a7-64f89c71ffba tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:15.289695 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7dfaa23-4784-4c8e-92a7-64f89c71ffba tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:15.429694 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ad69d516-7345-4ed4-b9ef-8c4d4f7d06c6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:15.443891 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ad69d516-7345-4ed4-b9ef-8c4d4f7d06c6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1512 microversion: 2.1 time: 0.593021 Jul 31 01:36:15.444994 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2454/4892] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:14 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1512 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:36:15.449716 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-e01af09b-9b5c-4eff-b46c-66996a7c1741 req-d60af1ac-285a-4b75-91af-c2c84d47f1cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c004dd94-50c6-4033-9bcc-47b64014c973", "name": "network-vif-plugged", "status": "completed", "tag": "de92d0ec-e296-462b-81bb-e3f52972564f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:36:15.477002 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e01af09b-9b5c-4eff-b46c-66996a7c1741 req-d60af1ac-285a-4b75-91af-c2c84d47f1cd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:15.477708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e01af09b-9b5c-4eff-b46c-66996a7c1741 req-d60af1ac-285a-4b75-91af-c2c84d47f1cd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:15.493727 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-e01af09b-9b5c-4eff-b46c-66996a7c1741 req-d60af1ac-285a-4b75-91af-c2c84d47f1cd service nova] Creating event network-vif-plugged:de92d0ec-e296-462b-81bb-e3f52972564f for instance c004dd94-50c6-4033-9bcc-47b64014c973 on n-h2-master-1 Jul 31 01:36:15.508994 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-e01af09b-9b5c-4eff-b46c-66996a7c1741 req-d60af1ac-285a-4b75-91af-c2c84d47f1cd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062615 Jul 31 01:36:15.510196 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2455/4893] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:36:15.591965 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f7dfaa23-4784-4c8e-92a7-64f89c71ffba tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:15.604342 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f7dfaa23-4784-4c8e-92a7-64f89c71ffba tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 200 len: 1319 microversion: 2.1 time: 0.345054 Jul 31 01:36:15.606943 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2439/4894] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:15 2022] GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:16.268146 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-49b8444b-ba16-4a68-b197-325dbe3f7eb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:16.268873 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-49b8444b-ba16-4a68-b197-325dbe3f7eb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:16.292176 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49b8444b-ba16-4a68-b197-325dbe3f7eb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:16.292675 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49b8444b-ba16-4a68-b197-325dbe3f7eb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:16.293509 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49b8444b-ba16-4a68-b197-325dbe3f7eb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:16.293957 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49b8444b-ba16-4a68-b197-325dbe3f7eb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:16.465246 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-af018506-643e-4dd5-8cea-1601ae123f79 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:16.465900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-af018506-643e-4dd5-8cea-1601ae123f79 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:16.475564 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-af018506-643e-4dd5-8cea-1601ae123f79 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:16.476355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-af018506-643e-4dd5-8cea-1601ae123f79 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:16.477379 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-af018506-643e-4dd5-8cea-1601ae123f79 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:16.478153 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-af018506-643e-4dd5-8cea-1601ae123f79 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:16.985173 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-49b8444b-ba16-4a68-b197-325dbe3f7eb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:17.004297 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-49b8444b-ba16-4a68-b197-325dbe3f7eb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1394 microversion: 2.1 time: 0.745520 Jul 31 01:36:17.005255 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2456/4895] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:16 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1394 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:17.014105 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-01dcef9a-0fcd-440b-98b9-af64443ef17d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:17.019820 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-01dcef9a-0fcd-440b-98b9-af64443ef17d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:17.035040 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01dcef9a-0fcd-440b-98b9-af64443ef17d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:17.036003 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01dcef9a-0fcd-440b-98b9-af64443ef17d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:17.037154 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01dcef9a-0fcd-440b-98b9-af64443ef17d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:17.037778 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01dcef9a-0fcd-440b-98b9-af64443ef17d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:17.198498 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-af018506-643e-4dd5-8cea-1601ae123f79 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:17.215127 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-af018506-643e-4dd5-8cea-1601ae123f79 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1512 microversion: 2.1 time: 0.747608 Jul 31 01:36:17.216509 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2440/4896] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:16 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1512 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:36:17.410439 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-01dcef9a-0fcd-440b-98b9-af64443ef17d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:17.442005 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-01dcef9a-0fcd-440b-98b9-af64443ef17d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 200 len: 1508 microversion: 2.1 time: 0.433161 Jul 31 01:36:17.446375 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2457/4897] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:17 2022] GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 1508 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:18.028324 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b8822293-5cc8-473f-b4ca-7d2686a95b18 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:18.029621 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b8822293-5cc8-473f-b4ca-7d2686a95b18 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:18.043189 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b8822293-5cc8-473f-b4ca-7d2686a95b18 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:18.048453 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b8822293-5cc8-473f-b4ca-7d2686a95b18 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:18.049559 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b8822293-5cc8-473f-b4ca-7d2686a95b18 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:18.055223 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b8822293-5cc8-473f-b4ca-7d2686a95b18 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:18.247248 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-98f25e62-4eda-4fb7-8c1c-2d7b5824aa92 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:18.248003 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-98f25e62-4eda-4fb7-8c1c-2d7b5824aa92 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:18.262041 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-98f25e62-4eda-4fb7-8c1c-2d7b5824aa92 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:18.267611 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-98f25e62-4eda-4fb7-8c1c-2d7b5824aa92 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:18.269228 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-98f25e62-4eda-4fb7-8c1c-2d7b5824aa92 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:18.269924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-98f25e62-4eda-4fb7-8c1c-2d7b5824aa92 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:18.921922 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-98f25e62-4eda-4fb7-8c1c-2d7b5824aa92 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:18.938356 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-98f25e62-4eda-4fb7-8c1c-2d7b5824aa92 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1489 microversion: 2.1 time: 0.696907 Jul 31 01:36:18.940118 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2458/4898] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:18 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1489 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:36:18.960521 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-77a2f829-9e49-471c-ac15-daad839fe7f5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:18.961324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-77a2f829-9e49-471c-ac15-daad839fe7f5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:18.971025 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77a2f829-9e49-471c-ac15-daad839fe7f5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:18.974119 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77a2f829-9e49-471c-ac15-daad839fe7f5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:18.975169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77a2f829-9e49-471c-ac15-daad839fe7f5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:18.978896 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77a2f829-9e49-471c-ac15-daad839fe7f5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:19.048586 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-77a2f829-9e49-471c-ac15-daad839fe7f5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:36:19.242599 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-77a2f829-9e49-471c-ac15-daad839fe7f5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "DELETE /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 204 len: 0 microversion: 2.1 time: 0.286644 Jul 31 01:36:19.246422 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2459/4899] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:36:18 2022] DELETE /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:36:19.258642 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b6dba357-f487-4f6d-ae64-eb1789ac873c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:19.264508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b6dba357-f487-4f6d-ae64-eb1789ac873c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:19.290967 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6dba357-f487-4f6d-ae64-eb1789ac873c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:19.291453 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6dba357-f487-4f6d-ae64-eb1789ac873c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:19.292265 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6dba357-f487-4f6d-ae64-eb1789ac873c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:19.292715 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6dba357-f487-4f6d-ae64-eb1789ac873c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:19.303654 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:19.447198 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b8822293-5cc8-473f-b4ca-7d2686a95b18 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:19.457747 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b8822293-5cc8-473f-b4ca-7d2686a95b18 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1394 microversion: 2.1 time: 1.434549 Jul 31 01:36:19.458355 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2441/4900] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:18 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1394 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:19.470490 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-03a6b583-cc7b-4413-b29a-ae1dd628985c req-4dd1599a-63ea-4552-9b92-082cd0c1624b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493b0ac5-4c13-41eb-b81d-f79717202ff1", "name": "network-vif-deleted", "tag": "8c49b471-b0fa-4f4e-b1cd-113919d5ab72"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:36:19.493945 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-03a6b583-cc7b-4413-b29a-ae1dd628985c req-4dd1599a-63ea-4552-9b92-082cd0c1624b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:19.499371 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-03a6b583-cc7b-4413-b29a-ae1dd628985c req-4dd1599a-63ea-4552-9b92-082cd0c1624b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:19.528199 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-03a6b583-cc7b-4413-b29a-ae1dd628985c req-4dd1599a-63ea-4552-9b92-082cd0c1624b service nova] Creating event network-vif-deleted:8c49b471-b0fa-4f4e-b1cd-113919d5ab72 for instance 493b0ac5-4c13-41eb-b81d-f79717202ff1 on n-h1-master-1 Jul 31 01:36:19.540383 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-03a6b583-cc7b-4413-b29a-ae1dd628985c req-4dd1599a-63ea-4552-9b92-082cd0c1624b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079528 Jul 31 01:36:19.543701 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2442/4901] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:36:20.208237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b6dba357-f487-4f6d-ae64-eb1789ac873c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:20.222022 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b6dba357-f487-4f6d-ae64-eb1789ac873c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1495 microversion: 2.1 time: 0.970944 Jul 31 01:36:20.222621 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2460/4902] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:19 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1495 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:20.482628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5fc66176-9a4e-4018-a25d-5fdec0e30e1c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:20.484316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5fc66176-9a4e-4018-a25d-5fdec0e30e1c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:20.503895 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5fc66176-9a4e-4018-a25d-5fdec0e30e1c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:20.504778 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5fc66176-9a4e-4018-a25d-5fdec0e30e1c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:20.506624 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5fc66176-9a4e-4018-a25d-5fdec0e30e1c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:20.507416 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5fc66176-9a4e-4018-a25d-5fdec0e30e1c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:20.762859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5fc66176-9a4e-4018-a25d-5fdec0e30e1c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:20.784337 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5fc66176-9a4e-4018-a25d-5fdec0e30e1c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1188 microversion: 2.1 time: 0.307499 Jul 31 01:36:20.788029 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2443/4903] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:20 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1188 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:21.246068 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-709eb245-fd9f-4d74-84a0-633f855a003f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:21.247550 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-709eb245-fd9f-4d74-84a0-633f855a003f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:21.262237 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-709eb245-fd9f-4d74-84a0-633f855a003f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:21.263107 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-709eb245-fd9f-4d74-84a0-633f855a003f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:21.264139 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-709eb245-fd9f-4d74-84a0-633f855a003f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:21.264794 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-709eb245-fd9f-4d74-84a0-633f855a003f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:21.741546 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-709eb245-fd9f-4d74-84a0-633f855a003f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:21.755367 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-709eb245-fd9f-4d74-84a0-633f855a003f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1495 microversion: 2.1 time: 0.508932 Jul 31 01:36:21.756156 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2461/4904] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:21 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1495 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:21.818074 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-526ce9c5-127b-473d-885e-99d03d5411c6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:21.821163 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-526ce9c5-127b-473d-885e-99d03d5411c6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:21.836289 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-526ce9c5-127b-473d-885e-99d03d5411c6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:21.836967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-526ce9c5-127b-473d-885e-99d03d5411c6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:21.837887 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-526ce9c5-127b-473d-885e-99d03d5411c6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:21.840406 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-526ce9c5-127b-473d-885e-99d03d5411c6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:22.213581 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-526ce9c5-127b-473d-885e-99d03d5411c6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:22.223492 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-526ce9c5-127b-473d-885e-99d03d5411c6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1188 microversion: 2.1 time: 0.410306 Jul 31 01:36:22.227030 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2444/4905] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:21 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1188 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:22.781137 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-23a6127c-1f1d-4948-9ddc-3096b3f7285f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:22.784808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-23a6127c-1f1d-4948-9ddc-3096b3f7285f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:22.802991 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23a6127c-1f1d-4948-9ddc-3096b3f7285f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:22.808040 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23a6127c-1f1d-4948-9ddc-3096b3f7285f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:22.812456 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23a6127c-1f1d-4948-9ddc-3096b3f7285f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:22.814573 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23a6127c-1f1d-4948-9ddc-3096b3f7285f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:22.876815 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-5e0007cb-f94f-4ef8-b4aa-8bf326ce645b req-67c9fe99-7e62-4761-a4f7-e852e0c27c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33f2207c-b1c3-42ce-88ff-bd28260ad9e6", "name": "network-vif-deleted", "tag": "24290284-f581-4a1a-92b2-ed5a36cf83a2"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:36:22.908454 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:22.913386 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-5e0007cb-f94f-4ef8-b4aa-8bf326ce645b req-67c9fe99-7e62-4761-a4f7-e852e0c27c0d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:22.935104 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-5e0007cb-f94f-4ef8-b4aa-8bf326ce645b req-67c9fe99-7e62-4761-a4f7-e852e0c27c0d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:23.024847 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-5e0007cb-f94f-4ef8-b4aa-8bf326ce645b req-67c9fe99-7e62-4761-a4f7-e852e0c27c0d service nova] Creating event network-vif-deleted:24290284-f581-4a1a-92b2-ed5a36cf83a2 for instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 on n-h1-master-1 Jul 31 01:36:23.041323 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-5e0007cb-f94f-4ef8-b4aa-8bf326ce645b req-67c9fe99-7e62-4761-a4f7-e852e0c27c0d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168620 Jul 31 01:36:23.047323 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2445/4906] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:36:23.184003 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-23a6127c-1f1d-4948-9ddc-3096b3f7285f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:23.191963 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-23a6127c-1f1d-4948-9ddc-3096b3f7285f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 200 len: 1453 microversion: 2.1 time: 0.415095 Jul 31 01:36:23.193680 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2462/4907] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:22 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 1453 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:23.249752 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a0c79b2a-b478-46c8-9131-e570a5138208 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:23.250788 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a0c79b2a-b478-46c8-9131-e570a5138208 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:23.273439 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0c79b2a-b478-46c8-9131-e570a5138208 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:23.276046 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0c79b2a-b478-46c8-9131-e570a5138208 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:23.279917 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0c79b2a-b478-46c8-9131-e570a5138208 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:23.280666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a0c79b2a-b478-46c8-9131-e570a5138208 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:23.469726 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a0c79b2a-b478-46c8-9131-e570a5138208 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:23.488004 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a0c79b2a-b478-46c8-9131-e570a5138208 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1188 microversion: 2.1 time: 0.242844 Jul 31 01:36:23.491094 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2446/4908] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:23 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1188 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:24.217688 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c0129825-2334-4a5d-bd2b-d7eb459df4d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:24.219034 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c0129825-2334-4a5d-bd2b-d7eb459df4d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:24.223139 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:24.238056 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0129825-2334-4a5d-bd2b-d7eb459df4d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:24.245132 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0129825-2334-4a5d-bd2b-d7eb459df4d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:24.246314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0129825-2334-4a5d-bd2b-d7eb459df4d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:24.251445 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0129825-2334-4a5d-bd2b-d7eb459df4d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:24.312022 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-c0129825-2334-4a5d-bd2b-d7eb459df4d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c0129825-2334-4a5d-bd2b-d7eb459df4d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 HTTP/1.1 Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '33f2207c-b1c3-42ce-88ff-bd28260ad9e6'} Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:24.317559 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:36:24.321146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:24.321146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:24.321146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:24.321146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:36:24.321146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:36:24.321146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. Jul 31 01:36:24.321146 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:36:24.328487 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c0129825-2334-4a5d-bd2b-d7eb459df4d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:36:24.331917 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c0129825-2334-4a5d-bd2b-d7eb459df4d1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 404 len: 111 microversion: 2.1 time: 0.117301 Jul 31 01:36:24.338023 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2463/4909] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:24 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:36:24.512922 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a758e926-1fea-4076-ae81-04fad56dc5d6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1647491882", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "1fde53fe-0382-4737-b527-4db7e9bd3777"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:36:24.524654 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fd5d9498-cd5f-490f-9eef-30158665564a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:24.526054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fd5d9498-cd5f-490f-9eef-30158665564a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:24.541267 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd5d9498-cd5f-490f-9eef-30158665564a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:24.546420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd5d9498-cd5f-490f-9eef-30158665564a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:24.548150 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd5d9498-cd5f-490f-9eef-30158665564a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:24.550390 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd5d9498-cd5f-490f-9eef-30158665564a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:24.639015 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-a758e926-1fea-4076-ae81-04fad56dc5d6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] validate_networks() for [('1fde53fe-0382-4737-b527-4db7e9bd3777', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:36:24.967081 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fd5d9498-cd5f-490f-9eef-30158665564a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:25.013334 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fd5d9498-cd5f-490f-9eef-30158665564a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1188 microversion: 2.1 time: 0.489769 Jul 31 01:36:25.014510 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2464/4910] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:24 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1188 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:26.042667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3ee65aa-f09f-4f38-8fb2-ea287b9790fa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:26.044567 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3ee65aa-f09f-4f38-8fb2-ea287b9790fa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:26.068719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3ee65aa-f09f-4f38-8fb2-ea287b9790fa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:26.071451 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3ee65aa-f09f-4f38-8fb2-ea287b9790fa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:26.072294 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3ee65aa-f09f-4f38-8fb2-ea287b9790fa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:26.072730 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3ee65aa-f09f-4f38-8fb2-ea287b9790fa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:26.191173 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3ee65aa-f09f-4f38-8fb2-ea287b9790fa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:26.206886 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3ee65aa-f09f-4f38-8fb2-ea287b9790fa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1188 microversion: 2.1 time: 0.171311 Jul 31 01:36:26.207532 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2465/4911] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:26 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1188 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:26.453213 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a758e926-1fea-4076-ae81-04fad56dc5d6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:36:26.453757 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a758e926-1fea-4076-ae81-04fad56dc5d6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:36:26.454681 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a758e926-1fea-4076-ae81-04fad56dc5d6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:36:26.455031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a758e926-1fea-4076-ae81-04fad56dc5d6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:36:26.455471 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-a758e926-1fea-4076-ae81-04fad56dc5d6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:36:26.476948 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a758e926-1fea-4076-ae81-04fad56dc5d6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:26.477407 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a758e926-1fea-4076-ae81-04fad56dc5d6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:26.478210 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a758e926-1fea-4076-ae81-04fad56dc5d6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:26.478645 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a758e926-1fea-4076-ae81-04fad56dc5d6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:26.520938 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-a758e926-1fea-4076-ae81-04fad56dc5d6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Getting quotas for project e418a04119b843b4a1c218aa9ff1dbc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:36:26.527999 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-a758e926-1fea-4076-ae81-04fad56dc5d6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Getting quotas for user 93eccdea3f1447a693cec10d096876a0 and project e418a04119b843b4a1c218aa9ff1dbc9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:36:26.541957 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a758e926-1fea-4076-ae81-04fad56dc5d6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:36:26.544441 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a758e926-1fea-4076-ae81-04fad56dc5d6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:36:26.602046 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a758e926-1fea-4076-ae81-04fad56dc5d6 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.095342 Jul 31 01:36:26.603378 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2447/4912] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:36:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:36:26.617097 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e4a0f28a-2990-4356-a9ca-eb41513f72d7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:26.618117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e4a0f28a-2990-4356-a9ca-eb41513f72d7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:26.884666 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e4a0f28a-2990-4356-a9ca-eb41513f72d7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:26.901400 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e4a0f28a-2990-4356-a9ca-eb41513f72d7 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1215 microversion: 2.1 time: 0.289131 Jul 31 01:36:26.903435 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2466/4913] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:26 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1215 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:27.232309 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e50a8c2c-c426-4b3b-a05f-749e891c7387 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:27.240439 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e50a8c2c-c426-4b3b-a05f-749e891c7387 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:27.262091 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e50a8c2c-c426-4b3b-a05f-749e891c7387 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:27.262818 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e50a8c2c-c426-4b3b-a05f-749e891c7387 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:27.263795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e50a8c2c-c426-4b3b-a05f-749e891c7387 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:27.264391 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e50a8c2c-c426-4b3b-a05f-749e891c7387 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:27.464466 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e50a8c2c-c426-4b3b-a05f-749e891c7387 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:27.472307 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e50a8c2c-c426-4b3b-a05f-749e891c7387 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1188 microversion: 2.1 time: 0.243785 Jul 31 01:36:27.479857 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2448/4914] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:27 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1188 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:27.928025 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2d4f4160-0d55-477c-88d9-905f12db0998 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:27.928683 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2d4f4160-0d55-477c-88d9-905f12db0998 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:27.942855 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d4f4160-0d55-477c-88d9-905f12db0998 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:27.943605 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d4f4160-0d55-477c-88d9-905f12db0998 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:27.944843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d4f4160-0d55-477c-88d9-905f12db0998 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:27.945767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d4f4160-0d55-477c-88d9-905f12db0998 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:28.239656 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2d4f4160-0d55-477c-88d9-905f12db0998 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:28.252311 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2d4f4160-0d55-477c-88d9-905f12db0998 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1211 microversion: 2.1 time: 0.330406 Jul 31 01:36:28.254138 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2467/4915] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:27 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1211 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:28.499644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3a71a4ba-740b-46e5-ac6f-961debd00096 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:28.500094 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3a71a4ba-740b-46e5-ac6f-961debd00096 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:28.587729 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a71a4ba-740b-46e5-ac6f-961debd00096 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:28.588207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a71a4ba-740b-46e5-ac6f-961debd00096 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:28.592490 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a71a4ba-740b-46e5-ac6f-961debd00096 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:28.593008 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a71a4ba-740b-46e5-ac6f-961debd00096 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:28.967191 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3a71a4ba-740b-46e5-ac6f-961debd00096 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:29.002527 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3a71a4ba-740b-46e5-ac6f-961debd00096 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1188 microversion: 2.1 time: 0.508829 Jul 31 01:36:29.005497 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2449/4916] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:28 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1188 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:29.278691 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c93924b0-a05c-435b-9347-b386600fcb30 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:29.279327 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c93924b0-a05c-435b-9347-b386600fcb30 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:29.296095 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c93924b0-a05c-435b-9347-b386600fcb30 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:29.296599 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c93924b0-a05c-435b-9347-b386600fcb30 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:29.297394 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c93924b0-a05c-435b-9347-b386600fcb30 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:29.298371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c93924b0-a05c-435b-9347-b386600fcb30 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:29.473536 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c93924b0-a05c-435b-9347-b386600fcb30 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:29.489198 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c93924b0-a05c-435b-9347-b386600fcb30 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1273 microversion: 2.1 time: 0.214432 Jul 31 01:36:29.492943 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2468/4917] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:29 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1273 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:30.026150 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c7072da5-6532-4502-b2b5-9287d69dae31 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:30.027506 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c7072da5-6532-4502-b2b5-9287d69dae31 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:30.044564 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c7072da5-6532-4502-b2b5-9287d69dae31 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:30.047386 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c7072da5-6532-4502-b2b5-9287d69dae31 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:30.048857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c7072da5-6532-4502-b2b5-9287d69dae31 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:30.049530 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c7072da5-6532-4502-b2b5-9287d69dae31 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:30.354319 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c7072da5-6532-4502-b2b5-9287d69dae31 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:30.421533 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c7072da5-6532-4502-b2b5-9287d69dae31 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1188 microversion: 2.1 time: 0.386345 Jul 31 01:36:30.428126 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2450/4918] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:30 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1188 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:30.523857 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a302d32f-dde1-4584-967b-c76cdd12893d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:30.526059 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a302d32f-dde1-4584-967b-c76cdd12893d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:30.545237 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a302d32f-dde1-4584-967b-c76cdd12893d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:30.546549 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a302d32f-dde1-4584-967b-c76cdd12893d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:30.549882 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a302d32f-dde1-4584-967b-c76cdd12893d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:30.583567 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a302d32f-dde1-4584-967b-c76cdd12893d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:31.209865 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a302d32f-dde1-4584-967b-c76cdd12893d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:31.218163 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a302d32f-dde1-4584-967b-c76cdd12893d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1273 microversion: 2.1 time: 0.703215 Jul 31 01:36:31.218776 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2469/4919] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:30 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1273 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:31.449321 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c58aec1a-a924-44f0-b4d1-6ffaddbeaa89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:31.459772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c58aec1a-a924-44f0-b4d1-6ffaddbeaa89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:31.484999 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c58aec1a-a924-44f0-b4d1-6ffaddbeaa89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:31.486004 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c58aec1a-a924-44f0-b4d1-6ffaddbeaa89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:31.487872 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c58aec1a-a924-44f0-b4d1-6ffaddbeaa89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:31.489592 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c58aec1a-a924-44f0-b4d1-6ffaddbeaa89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:31.654284 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c58aec1a-a924-44f0-b4d1-6ffaddbeaa89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:31.667271 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c58aec1a-a924-44f0-b4d1-6ffaddbeaa89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:31.668185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-c58aec1a-a924-44f0-b4d1-6ffaddbeaa89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lazy-loading 'fault' on Instance uuid 493b0ac5-4c13-41eb-b81d-f79717202ff1 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:36:31.764569 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c58aec1a-a924-44f0-b4d1-6ffaddbeaa89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:31.772336 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c58aec1a-a924-44f0-b4d1-6ffaddbeaa89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 200 len: 1147 microversion: 2.1 time: 0.328691 Jul 31 01:36:31.773021 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2451/4920] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:31 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 1147 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:32.252291 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-17c28ddf-919a-4286-92a5-e4b78b323e2c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:32.262695 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-17c28ddf-919a-4286-92a5-e4b78b323e2c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:32.309820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17c28ddf-919a-4286-92a5-e4b78b323e2c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:32.310302 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17c28ddf-919a-4286-92a5-e4b78b323e2c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:32.311260 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17c28ddf-919a-4286-92a5-e4b78b323e2c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:32.315069 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17c28ddf-919a-4286-92a5-e4b78b323e2c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:32.794852 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95a6ba19-0789-440c-bbb4-ea58e4d8311f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:32.795501 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-95a6ba19-0789-440c-bbb4-ea58e4d8311f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 493b0ac5-4c13-41eb-b81d-f79717202ff1] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:32.805980 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95a6ba19-0789-440c-bbb4-ea58e4d8311f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:32.810218 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95a6ba19-0789-440c-bbb4-ea58e4d8311f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:32.816280 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95a6ba19-0789-440c-bbb4-ea58e4d8311f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:32.817251 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95a6ba19-0789-440c-bbb4-ea58e4d8311f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:32.847766 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-95a6ba19-0789-440c-bbb4-ea58e4d8311f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] HTTP exception thrown: Instance 493b0ac5-4c13-41eb-b81d-f79717202ff1 could not be found. Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95a6ba19-0789-440c-bbb4-ea58e4d8311f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Request method failure captured: Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 HTTP/1.1 Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dxSWPHv6fiyygfwJR0Ud9gfexnY8DUg1-8n2-EFdlhief1Py8PV4RaH4l0q6aYBanPQ6exn-4iFCGEMH9hqgo4PPVedzZNUDT2YTEgYd9iPN8Zs4wyM3F4Cgzs_D-0CTqdk8e-lZRIuuB9WjXa7g4L7rW4yad6wf_BUOJQbjcH4WNc Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f0892e5f98e48408d15771c9d5805bf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestVolumeBootPattern-640389583 Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f6c26df9a49446c290d6a0b1427f0c14 Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 493b0ac5-4c13-41eb-b81d-f79717202ff1 could not be found. Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '493b0ac5-4c13-41eb-b81d-f79717202ff1'} Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 493b0ac5-4c13-41eb-b81d-f79717202ff1 could not be found. Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 493b0ac5-4c13-41eb-b81d-f79717202ff1 could not be found. Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:32.850528 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:32.854784 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:32.854784 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:32.854784 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:32.854784 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:36:32.854784 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:36:32.854784 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 493b0ac5-4c13-41eb-b81d-f79717202ff1 could not be found. Jul 31 01:36:32.854784 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:32.855631 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-17c28ddf-919a-4286-92a5-e4b78b323e2c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:32.856543 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95a6ba19-0789-440c-bbb4-ea58e4d8311f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Returning 404 to user: Instance 493b0ac5-4c13-41eb-b81d-f79717202ff1 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:36:32.857441 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-95a6ba19-0789-440c-bbb4-ea58e4d8311f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1" status: 404 len: 111 microversion: 2.1 time: 0.067296 Jul 31 01:36:32.862343 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2452/4921] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:32 2022] GET /compute/v2.1/servers/493b0ac5-4c13-41eb-b81d-f79717202ff1 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:36:32.877925 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-17c28ddf-919a-4286-92a5-e4b78b323e2c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1315 microversion: 2.1 time: 0.640123 Jul 31 01:36:32.887419 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2470/4922] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:32 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:33.734477 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-5acae794-6a01-424d-94f6-65e410d60296 req-bb6b6a7d-aa5d-451a-bf71-6de41ad88f53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84246183-db04-4131-b24f-b3abe7a52ce4", "tag": "4c75b27c-dde9-4445-b997-18cc881ecf2a"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:36:33.770265 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-5acae794-6a01-424d-94f6-65e410d60296 req-bb6b6a7d-aa5d-451a-bf71-6de41ad88f53 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:33.771881 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-5acae794-6a01-424d-94f6-65e410d60296 req-bb6b6a7d-aa5d-451a-bf71-6de41ad88f53 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:33.823422 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-5acae794-6a01-424d-94f6-65e410d60296 req-bb6b6a7d-aa5d-451a-bf71-6de41ad88f53 service nova] Creating event network-changed:4c75b27c-dde9-4445-b997-18cc881ecf2a for instance 84246183-db04-4131-b24f-b3abe7a52ce4 on n-h1-master-1 Jul 31 01:36:33.838875 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-5acae794-6a01-424d-94f6-65e410d60296 req-bb6b6a7d-aa5d-451a-bf71-6de41ad88f53 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108514 Jul 31 01:36:33.840477 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2453/4923] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:36:33.907305 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e0496dad-5d2e-4e63-b9cd-ca4ef28c343f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:33.907967 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e0496dad-5d2e-4e63-b9cd-ca4ef28c343f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:33.921981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e0496dad-5d2e-4e63-b9cd-ca4ef28c343f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:33.922697 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e0496dad-5d2e-4e63-b9cd-ca4ef28c343f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:33.925210 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e0496dad-5d2e-4e63-b9cd-ca4ef28c343f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:33.926019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e0496dad-5d2e-4e63-b9cd-ca4ef28c343f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:34.565387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e0496dad-5d2e-4e63-b9cd-ca4ef28c343f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:34.580614 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e0496dad-5d2e-4e63-b9cd-ca4ef28c343f tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1315 microversion: 2.1 time: 0.677138 Jul 31 01:36:34.590694 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2471/4924] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:33 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:35.614612 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-58fa63ef-36dc-46c5-8558-5eac21464a2c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:35.616722 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-58fa63ef-36dc-46c5-8558-5eac21464a2c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:35.636081 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58fa63ef-36dc-46c5-8558-5eac21464a2c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:35.636824 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58fa63ef-36dc-46c5-8558-5eac21464a2c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:35.639144 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58fa63ef-36dc-46c5-8558-5eac21464a2c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:35.640029 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58fa63ef-36dc-46c5-8558-5eac21464a2c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:36.502504 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:36.537246 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:36.861375 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-58fa63ef-36dc-46c5-8558-5eac21464a2c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:36.873327 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-58fa63ef-36dc-46c5-8558-5eac21464a2c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1315 microversion: 2.1 time: 1.270674 Jul 31 01:36:36.878120 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2454/4925] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:35 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1315 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:37.912103 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4454050b-4d2f-4d9f-811e-31a032238581 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:37.913378 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4454050b-4d2f-4d9f-811e-31a032238581 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:37.953857 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:37.955237 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4454050b-4d2f-4d9f-811e-31a032238581 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:37.976027 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4454050b-4d2f-4d9f-811e-31a032238581 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:37.981197 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4454050b-4d2f-4d9f-811e-31a032238581 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:37.981698 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4454050b-4d2f-4d9f-811e-31a032238581 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:38.453767 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4454050b-4d2f-4d9f-811e-31a032238581 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:38.464454 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4454050b-4d2f-4d9f-811e-31a032238581 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1315 microversion: 2.1 time: 0.568483 Jul 31 01:36:38.479724 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2472/4926] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:37 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:40.061324 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7f6c6561-267b-40d1-ae38-9a35a4ea4efd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:40.062907 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7f6c6561-267b-40d1-ae38-9a35a4ea4efd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:40.080361 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f6c6561-267b-40d1-ae38-9a35a4ea4efd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:40.086340 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f6c6561-267b-40d1-ae38-9a35a4ea4efd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:40.087549 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f6c6561-267b-40d1-ae38-9a35a4ea4efd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:40.088524 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f6c6561-267b-40d1-ae38-9a35a4ea4efd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:40.503299 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7f6c6561-267b-40d1-ae38-9a35a4ea4efd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:40.528229 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7f6c6561-267b-40d1-ae38-9a35a4ea4efd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1315 microversion: 2.1 time: 1.043880 Jul 31 01:36:40.548383 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2455/4927] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:39 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1315 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:41.559990 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4b17debb-328d-468e-9609-f2ab98250543 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:41.560605 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4b17debb-328d-468e-9609-f2ab98250543 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:41.584576 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b17debb-328d-468e-9609-f2ab98250543 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:41.585231 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b17debb-328d-468e-9609-f2ab98250543 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:41.586233 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b17debb-328d-468e-9609-f2ab98250543 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:41.586825 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b17debb-328d-468e-9609-f2ab98250543 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:42.479632 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4b17debb-328d-468e-9609-f2ab98250543 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:42.500405 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4b17debb-328d-468e-9609-f2ab98250543 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1315 microversion: 2.1 time: 0.941247 Jul 31 01:36:42.508912 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2473/4928] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:41 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1315 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:43.119879 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-70b7146f-d6c6-45c4-9e9f-b821f5e2e98f req-d247b3ca-dab2-4608-8e08-8014121bbabb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84246183-db04-4131-b24f-b3abe7a52ce4", "name": "network-vif-plugged", "status": "completed", "tag": "4c75b27c-dde9-4445-b997-18cc881ecf2a"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:36:43.141855 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-70b7146f-d6c6-45c4-9e9f-b821f5e2e98f req-d247b3ca-dab2-4608-8e08-8014121bbabb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:43.145563 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-70b7146f-d6c6-45c4-9e9f-b821f5e2e98f req-d247b3ca-dab2-4608-8e08-8014121bbabb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:43.173938 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-70b7146f-d6c6-45c4-9e9f-b821f5e2e98f req-d247b3ca-dab2-4608-8e08-8014121bbabb service nova] Creating event network-vif-plugged:4c75b27c-dde9-4445-b997-18cc881ecf2a for instance 84246183-db04-4131-b24f-b3abe7a52ce4 on n-h1-master-1 Jul 31 01:36:43.187162 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-70b7146f-d6c6-45c4-9e9f-b821f5e2e98f req-d247b3ca-dab2-4608-8e08-8014121bbabb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073170 Jul 31 01:36:43.192805 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2456/4929] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:36:43.534916 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0f68558d-3d57-4394-b0ed-b3507b0f5f0e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:43.543627 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0f68558d-3d57-4394-b0ed-b3507b0f5f0e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:43.562289 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f68558d-3d57-4394-b0ed-b3507b0f5f0e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:43.563006 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f68558d-3d57-4394-b0ed-b3507b0f5f0e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:43.565405 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f68558d-3d57-4394-b0ed-b3507b0f5f0e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:43.566052 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f68558d-3d57-4394-b0ed-b3507b0f5f0e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:43.678194 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7b50476b-c59c-424f-a6db-38df3cebf421 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1024163849", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1bc11147-b661-4e88-b090-d092ecdf6c25", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6739ac5e-7d06-4b25-b7ed-29fa35326c6e"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:36:43.844011 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-7b50476b-c59c-424f-a6db-38df3cebf421 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] validate_networks() for [('6739ac5e-7d06-4b25-b7ed-29fa35326c6e', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:36:44.908865 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0f68558d-3d57-4394-b0ed-b3507b0f5f0e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:44.917895 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0f68558d-3d57-4394-b0ed-b3507b0f5f0e tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1315 microversion: 2.1 time: 1.388652 Jul 31 01:36:44.931458 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2474/4930] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:43 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1315 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:45.736583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-7b50476b-c59c-424f-a6db-38df3cebf421 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:36:45.737515 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-7b50476b-c59c-424f-a6db-38df3cebf421 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:36:45.738267 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-7b50476b-c59c-424f-a6db-38df3cebf421 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:36:45.738628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-7b50476b-c59c-424f-a6db-38df3cebf421 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:36:45.739189 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-7b50476b-c59c-424f-a6db-38df3cebf421 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:36:45.762685 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b50476b-c59c-424f-a6db-38df3cebf421 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:45.763877 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b50476b-c59c-424f-a6db-38df3cebf421 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:45.767639 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b50476b-c59c-424f-a6db-38df3cebf421 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:45.768109 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b50476b-c59c-424f-a6db-38df3cebf421 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:45.799923 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=92 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:45.824859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-7b50476b-c59c-424f-a6db-38df3cebf421 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:36:45.842608 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-7b50476b-c59c-424f-a6db-38df3cebf421 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for user f6c26df9a49446c290d6a0b1427f0c14 and project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:36:45.950768 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-144167e7-9751-467c-9ff8-19a5e07936b5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:45.951368 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-144167e7-9751-467c-9ff8-19a5e07936b5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:45.965038 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7b50476b-c59c-424f-a6db-38df3cebf421 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:36:45.968851 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7b50476b-c59c-424f-a6db-38df3cebf421 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1bc11147-b661-4e88-b090-d092ecdf6c25',volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:36:45.998295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-144167e7-9751-467c-9ff8-19a5e07936b5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:46.003859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-144167e7-9751-467c-9ff8-19a5e07936b5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:46.004710 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-144167e7-9751-467c-9ff8-19a5e07936b5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:46.011782 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-144167e7-9751-467c-9ff8-19a5e07936b5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:46.245525 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7b50476b-c59c-424f-a6db-38df3cebf421 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.574049 Jul 31 01:36:46.247015 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2457/4931] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:36:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 01:36:46.493429 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-da38792a-0b0f-4390-bc99-ebb6cd5f4a8b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Action: 'create', calling method: .version_select at 0x7fede557cee0>, body: {"keypair": {"name": "tempest-keypair-687044670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfxwr+nnxMQZWaNese1W6cM2Np3/EUZ4ku2xAUqWsKmMRp+CNh7eOikMIsARQ6sDdpHwIdp9P243nlQKjdX9QqKxB1GDjvmwdx57dnX/FFXkTJdN5BzZjUYHIYg+mu52g=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:36:46.529487 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-da38792a-0b0f-4390-bc99-ebb6cd5f4a8b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Getting quotas for project fb35771c7e744f859d2c5d29b511d345. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:36:46.537909 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-da38792a-0b0f-4390-bc99-ebb6cd5f4a8b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Getting quotas for user 5da6102ddcb948fa874856fa1ac7226d and project fb35771c7e744f859d2c5d29b511d345. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:36:46.598603 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-144167e7-9751-467c-9ff8-19a5e07936b5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:46.614041 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-144167e7-9751-467c-9ff8-19a5e07936b5 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1503 microversion: 2.1 time: 0.666770 Jul 31 01:36:46.620524 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2475/4932] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:45 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1503 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:36:46.635148 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-da38792a-0b0f-4390-bc99-ebb6cd5f4a8b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.386453 Jul 31 01:36:46.636422 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2458/4933] 10.222.0.45 () {62 vars in 1200 bytes} [Sun Jul 31 01:36:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 389 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 31 01:36:46.654506 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2b959402-5c66-4a1f-a504-73979c9eeaaf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:46.657782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2b959402-5c66-4a1f-a504-73979c9eeaaf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:46.658445 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-88004419-e9ed-4f3a-b85e-47cb4d9a59cc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:36:46.659010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-88004419-e9ed-4f3a-b85e-47cb4d9a59cc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:46.696697 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88004419-e9ed-4f3a-b85e-47cb4d9a59cc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:46.700458 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88004419-e9ed-4f3a-b85e-47cb4d9a59cc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:46.705789 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88004419-e9ed-4f3a-b85e-47cb4d9a59cc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:46.708849 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88004419-e9ed-4f3a-b85e-47cb4d9a59cc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:46.828929 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-88004419-e9ed-4f3a-b85e-47cb4d9a59cc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lazy-loading 'flavor' on Instance uuid 84246183-db04-4131-b24f-b3abe7a52ce4 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:36:46.896574 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2b959402-5c66-4a1f-a504-73979c9eeaaf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:46.909706 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2b959402-5c66-4a1f-a504-73979c9eeaaf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1057 microversion: 2.1 time: 0.286577 Jul 31 01:36:46.911443 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2476/4934] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:46 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1057 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:47.011104 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-88004419-e9ed-4f3a-b85e-47cb4d9a59cc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "POST /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4/action" status: 202 len: 0 microversion: 2.1 time: 0.370167 Jul 31 01:36:47.012496 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2459/4935] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:36:46 2022] POST /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:36:47.020776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-05b4722e-c03c-4c06-a938-d9e9b2971886 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:47.022112 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-05b4722e-c03c-4c06-a938-d9e9b2971886 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:47.035073 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05b4722e-c03c-4c06-a938-d9e9b2971886 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:47.035981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05b4722e-c03c-4c06-a938-d9e9b2971886 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:47.037817 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05b4722e-c03c-4c06-a938-d9e9b2971886 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:47.040154 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05b4722e-c03c-4c06-a938-d9e9b2971886 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:47.423902 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-05b4722e-c03c-4c06-a938-d9e9b2971886 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:47.437451 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-05b4722e-c03c-4c06-a938-d9e9b2971886 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1511 microversion: 2.1 time: 0.416391 Jul 31 01:36:47.442126 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2477/4936] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:47 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1511 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:47.935849 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fb919582-5be6-4024-ac37-dc39d816d2f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:47.937317 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fb919582-5be6-4024-ac37-dc39d816d2f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:47.959627 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb919582-5be6-4024-ac37-dc39d816d2f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:47.968556 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb919582-5be6-4024-ac37-dc39d816d2f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:47.970822 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb919582-5be6-4024-ac37-dc39d816d2f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:47.971506 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb919582-5be6-4024-ac37-dc39d816d2f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:48.273953 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fb919582-5be6-4024-ac37-dc39d816d2f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:48.312240 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fb919582-5be6-4024-ac37-dc39d816d2f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1155 microversion: 2.1 time: 0.381711 Jul 31 01:36:48.318517 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2460/4937] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:47 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1155 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:48.467124 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3bfed47d-12ca-46b4-b1b2-3e854f9aeddc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:48.467919 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3bfed47d-12ca-46b4-b1b2-3e854f9aeddc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:48.487622 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bfed47d-12ca-46b4-b1b2-3e854f9aeddc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:48.488083 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bfed47d-12ca-46b4-b1b2-3e854f9aeddc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:48.488887 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bfed47d-12ca-46b4-b1b2-3e854f9aeddc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:48.489330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bfed47d-12ca-46b4-b1b2-3e854f9aeddc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:49.341887 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dbf045da-a55f-44d7-b7a1-adbe110fd07c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:49.343274 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dbf045da-a55f-44d7-b7a1-adbe110fd07c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:49.361914 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dbf045da-a55f-44d7-b7a1-adbe110fd07c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:49.365366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dbf045da-a55f-44d7-b7a1-adbe110fd07c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:49.367867 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dbf045da-a55f-44d7-b7a1-adbe110fd07c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:49.368518 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dbf045da-a55f-44d7-b7a1-adbe110fd07c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:49.492022 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3bfed47d-12ca-46b4-b1b2-3e854f9aeddc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:49.497560 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:49.521099 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3bfed47d-12ca-46b4-b1b2-3e854f9aeddc tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1494 microversion: 2.1 time: 1.058741 Jul 31 01:36:49.526064 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2478/4938] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:48 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1494 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:49.550582 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4a914115-f2e9-4df1-a8f0-7e4820627664 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:49.551203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4a914115-f2e9-4df1-a8f0-7e4820627664 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:49.562148 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4a914115-f2e9-4df1-a8f0-7e4820627664 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:49.564171 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4a914115-f2e9-4df1-a8f0-7e4820627664 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:49.565950 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4a914115-f2e9-4df1-a8f0-7e4820627664 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:49.568874 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4a914115-f2e9-4df1-a8f0-7e4820627664 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:49.634485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dbf045da-a55f-44d7-b7a1-adbe110fd07c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:49.645331 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dbf045da-a55f-44d7-b7a1-adbe110fd07c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1173 microversion: 2.1 time: 0.308755 Jul 31 01:36:49.654369 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2461/4939] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:49 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1173 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:49.656602 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4a914115-f2e9-4df1-a8f0-7e4820627664 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:36:49.931475 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4a914115-f2e9-4df1-a8f0-7e4820627664 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "DELETE /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 204 len: 0 microversion: 2.1 time: 0.389174 Jul 31 01:36:49.932069 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2479/4940] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:36:49 2022] DELETE /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:36:49.940915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-577cff15-0022-4759-869b-836fd14e4159 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:49.941625 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-577cff15-0022-4759-869b-836fd14e4159 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:49.951660 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-577cff15-0022-4759-869b-836fd14e4159 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:49.952859 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-577cff15-0022-4759-869b-836fd14e4159 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:49.956318 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-577cff15-0022-4759-869b-836fd14e4159 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:49.962678 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-577cff15-0022-4759-869b-836fd14e4159 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:50.401717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-577cff15-0022-4759-869b-836fd14e4159 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:50.429081 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-577cff15-0022-4759-869b-836fd14e4159 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1500 microversion: 2.1 time: 0.490108 Jul 31 01:36:50.449787 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2462/4941] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:49 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1500 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:36:50.672697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d1e9a17b-933c-4d16-911c-1d75c742b5da tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:50.673891 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d1e9a17b-933c-4d16-911c-1d75c742b5da tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:50.684652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d1e9a17b-933c-4d16-911c-1d75c742b5da tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:50.689215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d1e9a17b-933c-4d16-911c-1d75c742b5da tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:50.690047 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d1e9a17b-933c-4d16-911c-1d75c742b5da tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:50.690497 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d1e9a17b-933c-4d16-911c-1d75c742b5da tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:50.880480 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d1e9a17b-933c-4d16-911c-1d75c742b5da tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:50.893755 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d1e9a17b-933c-4d16-911c-1d75c742b5da tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1173 microversion: 2.1 time: 0.226919 Jul 31 01:36:50.912173 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2480/4942] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:50 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1173 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:51.460901 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fbf0bed8-1e6c-45b9-b33a-05a2255322bd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:51.464574 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fbf0bed8-1e6c-45b9-b33a-05a2255322bd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:51.481833 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbf0bed8-1e6c-45b9-b33a-05a2255322bd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:51.482297 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbf0bed8-1e6c-45b9-b33a-05a2255322bd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:51.483091 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbf0bed8-1e6c-45b9-b33a-05a2255322bd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:51.483577 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbf0bed8-1e6c-45b9-b33a-05a2255322bd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:51.919578 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6487f7e0-43db-4af1-aa5a-97b913e0e82f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:51.920823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6487f7e0-43db-4af1-aa5a-97b913e0e82f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:51.934048 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6487f7e0-43db-4af1-aa5a-97b913e0e82f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:51.935627 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6487f7e0-43db-4af1-aa5a-97b913e0e82f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:51.936629 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6487f7e0-43db-4af1-aa5a-97b913e0e82f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:51.938822 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6487f7e0-43db-4af1-aa5a-97b913e0e82f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:52.943659 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fbf0bed8-1e6c-45b9-b33a-05a2255322bd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:52.960228 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fbf0bed8-1e6c-45b9-b33a-05a2255322bd tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1500 microversion: 2.1 time: 1.506945 Jul 31 01:36:52.968076 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2463/4943] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:51 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1500 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:53.012657 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b9f47eb7-2160-46ca-a3f2-e04f45be659b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-302998613", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f3890ca-777f-480e-899c-5bbbe6b23db9"}], "security_groups": [{"name": "tempest-securitygroup--2003802601"}], "key_name": "tempest-keypair-687044670", "user_data": "}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:36:53.043571 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=7 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:53.072635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6487f7e0-43db-4af1-aa5a-97b913e0e82f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:53.098340 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6487f7e0-43db-4af1-aa5a-97b913e0e82f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1215 microversion: 2.1 time: 1.184175 Jul 31 01:36:53.098955 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2481/4944] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:51 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1215 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:53.371070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-b9f47eb7-2160-46ca-a3f2-e04f45be659b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] validate_networks() for [('7f3890ca-777f-480e-899c-5bbbe6b23db9', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:36:53.993511 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-523f25dd-a88c-41ad-ab53-6ee7521c8649 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:53.994217 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-523f25dd-a88c-41ad-ab53-6ee7521c8649 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:54.010898 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-523f25dd-a88c-41ad-ab53-6ee7521c8649 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:54.011838 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-523f25dd-a88c-41ad-ab53-6ee7521c8649 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:54.015771 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-523f25dd-a88c-41ad-ab53-6ee7521c8649 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:54.021264 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-523f25dd-a88c-41ad-ab53-6ee7521c8649 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:55.067928 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-523f25dd-a88c-41ad-ab53-6ee7521c8649 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93eccdea3f1447a693cec10d096876a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e418a04119b843b4a1c218aa9ff1dbc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:55.082219 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-523f25dd-a88c-41ad-ab53-6ee7521c8649 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 200 len: 1458 microversion: 2.1 time: 1.093206 Jul 31 01:36:55.099249 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2482/4945] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:53 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 1458 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:36:55.105453 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a4a57b9b-c8dd-4935-9c2a-200b5d618a4e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:55.106110 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a4a57b9b-c8dd-4935-9c2a-200b5d618a4e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:55.108311 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:36:55.137427 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a4a57b9b-c8dd-4935-9c2a-200b5d618a4e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:55.140889 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a4a57b9b-c8dd-4935-9c2a-200b5d618a4e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:55.141952 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a4a57b9b-c8dd-4935-9c2a-200b5d618a4e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:55.142501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a4a57b9b-c8dd-4935-9c2a-200b5d618a4e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:55.688029 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a4a57b9b-c8dd-4935-9c2a-200b5d618a4e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:55.710356 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b9f47eb7-2160-46ca-a3f2-e04f45be659b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:36:55.715550 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b9f47eb7-2160-46ca-a3f2-e04f45be659b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:36:55.717455 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b9f47eb7-2160-46ca-a3f2-e04f45be659b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:36:55.717849 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a4a57b9b-c8dd-4935-9c2a-200b5d618a4e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1215 microversion: 2.1 time: 0.602581 Jul 31 01:36:55.719144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b9f47eb7-2160-46ca-a3f2-e04f45be659b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:36:55.719792 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b9f47eb7-2160-46ca-a3f2-e04f45be659b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:36:55.733763 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2483/4946] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:55 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1215 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:55.751504 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-6a564eb4-644e-4c30-a6b3-af3b66f24640 req-829372a5-ba2d-4be6-9f08-eb1a2696ff4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31634508-a7b2-4238-a592-e4fdd27166ba", "tag": "9fd7f8da-6e52-4773-ac0a-6a50205ac93f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:36:55.771292 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9f47eb7-2160-46ca-a3f2-e04f45be659b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:55.772130 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9f47eb7-2160-46ca-a3f2-e04f45be659b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:55.773547 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9f47eb7-2160-46ca-a3f2-e04f45be659b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:55.774221 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9f47eb7-2160-46ca-a3f2-e04f45be659b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:55.791203 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6a564eb4-644e-4c30-a6b3-af3b66f24640 req-829372a5-ba2d-4be6-9f08-eb1a2696ff4b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:55.791696 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6a564eb4-644e-4c30-a6b3-af3b66f24640 req-829372a5-ba2d-4be6-9f08-eb1a2696ff4b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:55.837969 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-6a564eb4-644e-4c30-a6b3-af3b66f24640 req-829372a5-ba2d-4be6-9f08-eb1a2696ff4b service nova] Creating event network-changed:9fd7f8da-6e52-4773-ac0a-6a50205ac93f for instance 31634508-a7b2-4238-a592-e4fdd27166ba on n-h2-master-1 Jul 31 01:36:55.857636 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-6a564eb4-644e-4c30-a6b3-af3b66f24640 req-829372a5-ba2d-4be6-9f08-eb1a2696ff4b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118886 Jul 31 01:36:55.862452 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2484/4947] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:36:55.869123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-b9f47eb7-2160-46ca-a3f2-e04f45be659b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Getting quotas for project fb35771c7e744f859d2c5d29b511d345. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:36:55.887524 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-8a4b20bd-1a8d-4871-8fb3-1caaaaae7100 req-8361b2c3-e85c-45e7-a1bf-462dde7d4bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84246183-db04-4131-b24f-b3abe7a52ce4", "name": "network-vif-deleted", "tag": "4c75b27c-dde9-4445-b997-18cc881ecf2a"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:36:55.897276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-b9f47eb7-2160-46ca-a3f2-e04f45be659b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Getting quotas for user 5da6102ddcb948fa874856fa1ac7226d and project fb35771c7e744f859d2c5d29b511d345. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:36:55.935519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8a4b20bd-1a8d-4871-8fb3-1caaaaae7100 req-8361b2c3-e85c-45e7-a1bf-462dde7d4bcf service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:55.936266 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8a4b20bd-1a8d-4871-8fb3-1caaaaae7100 req-8361b2c3-e85c-45e7-a1bf-462dde7d4bcf service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:55.944236 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b9f47eb7-2160-46ca-a3f2-e04f45be659b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:36:55.950755 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b9f47eb7-2160-46ca-a3f2-e04f45be659b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:36:56.002166 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-8a4b20bd-1a8d-4871-8fb3-1caaaaae7100 req-8361b2c3-e85c-45e7-a1bf-462dde7d4bcf service nova] Creating event network-vif-deleted:4c75b27c-dde9-4445-b997-18cc881ecf2a for instance 84246183-db04-4131-b24f-b3abe7a52ce4 on n-h1-master-1 Jul 31 01:36:56.028159 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-8a4b20bd-1a8d-4871-8fb3-1caaaaae7100 req-8361b2c3-e85c-45e7-a1bf-462dde7d4bcf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143083 Jul 31 01:36:56.030539 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2485/4948] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:36:56.051830 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b9f47eb7-2160-46ca-a3f2-e04f45be659b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.065503 Jul 31 01:36:56.052741 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2464/4949] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:36:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 3084 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 01:36:56.071920 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bf429cbb-3034-47b3-aab1-6b0ef2b40b32 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:56.074469 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bf429cbb-3034-47b3-aab1-6b0ef2b40b32 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:56.106356 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9c0723be-d1df-4911-bb55-5179a788b565 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:56.107146 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9c0723be-d1df-4911-bb55-5179a788b565 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:56.119094 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9c0723be-d1df-4911-bb55-5179a788b565 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.119844 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9c0723be-d1df-4911-bb55-5179a788b565 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.121441 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9c0723be-d1df-4911-bb55-5179a788b565 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.124665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9c0723be-d1df-4911-bb55-5179a788b565 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.170098 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-9c0723be-d1df-4911-bb55-5179a788b565 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9c0723be-d1df-4911-bb55-5179a788b565 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 HTTP/1.1 Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '84246183-db04-4131-b24f-b3abe7a52ce4'} Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.173911 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.178609 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.178609 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.178609 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.178609 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:36:56.178609 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:36:56.178609 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. Jul 31 01:36:56.178609 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.183940 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9c0723be-d1df-4911-bb55-5179a788b565 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:36:56.185828 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9c0723be-d1df-4911-bb55-5179a788b565 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 404 len: 111 microversion: 2.1 time: 0.083721 Jul 31 01:36:56.190655 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2465/4950] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:56 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:36:56.201117 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f49f6069-4cf6-4973-88f1-899ecefaf9b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:56.201880 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f49f6069-4cf6-4973-88f1-899ecefaf9b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:56.216303 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f49f6069-4cf6-4973-88f1-899ecefaf9b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.217178 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f49f6069-4cf6-4973-88f1-899ecefaf9b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.218188 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f49f6069-4cf6-4973-88f1-899ecefaf9b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.218848 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f49f6069-4cf6-4973-88f1-899ecefaf9b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.251173 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-f49f6069-4cf6-4973-88f1-899ecefaf9b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f49f6069-4cf6-4973-88f1-899ecefaf9b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 HTTP/1.1 Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '84246183-db04-4131-b24f-b3abe7a52ce4'} Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:36:56.257292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:36:56.260775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. Jul 31 01:36:56.260775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.260775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.260775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.260775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.260775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.260775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.260775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:36:56.260775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:36:56.260775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. Jul 31 01:36:56.260775 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.264862 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f49f6069-4cf6-4973-88f1-899ecefaf9b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:36:56.265970 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f49f6069-4cf6-4973-88f1-899ecefaf9b1 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "DELETE /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 404 len: 111 microversion: 2.1 time: 0.069454 Jul 31 01:36:56.267634 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2466/4951] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:36:56 2022] DELETE /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:36:56.275192 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3418e263-bbc8-4744-917c-6ce2a4773f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:56.288367 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3418e263-bbc8-4744-917c-6ce2a4773f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 84246183-db04-4131-b24f-b3abe7a52ce4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:56.296359 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bf429cbb-3034-47b3-aab1-6b0ef2b40b32 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:56.303019 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3418e263-bbc8-4744-917c-6ce2a4773f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.303439 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3418e263-bbc8-4744-917c-6ce2a4773f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.304234 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3418e263-bbc8-4744-917c-6ce2a4773f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.304678 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3418e263-bbc8-4744-917c-6ce2a4773f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.308426 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bf429cbb-3034-47b3-aab1-6b0ef2b40b32 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:56.310745 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bf429cbb-3034-47b3-aab1-6b0ef2b40b32 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:56.313466 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bf429cbb-3034-47b3-aab1-6b0ef2b40b32 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1280 microversion: 2.20 time: 0.252175 Jul 31 01:36:56.315412 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2486/4952] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:36:56 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1280 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:36:56.351822 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-3418e263-bbc8-4744-917c-6ce2a4773f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3418e263-bbc8-4744-917c-6ce2a4773f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 HTTP/1.1 Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '84246183-db04-4131-b24f-b3abe7a52ce4'} Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.354398 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.358177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.358177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.358177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.358177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:36:56.358177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:36:56.358177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. Jul 31 01:36:56.358177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.360086 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3418e263-bbc8-4744-917c-6ce2a4773f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance 84246183-db04-4131-b24f-b3abe7a52ce4 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:36:56.361243 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3418e263-bbc8-4744-917c-6ce2a4773f16 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4" status: 404 len: 111 microversion: 2.1 time: 0.089772 Jul 31 01:36:56.362220 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2467/4953] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:56 2022] GET /compute/v2.1/servers/84246183-db04-4131-b24f-b3abe7a52ce4 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:36:56.385516 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-122a6a24-276b-4a36-8ef5-5b3c653decba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:56.386824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-122a6a24-276b-4a36-8ef5-5b3c653decba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:56.408643 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-122a6a24-276b-4a36-8ef5-5b3c653decba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.409204 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-122a6a24-276b-4a36-8ef5-5b3c653decba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.413293 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-122a6a24-276b-4a36-8ef5-5b3c653decba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.413776 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-122a6a24-276b-4a36-8ef5-5b3c653decba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.435165 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-122a6a24-276b-4a36-8ef5-5b3c653decba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-122a6a24-276b-4a36-8ef5-5b3c653decba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 HTTP/1.1 Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '33f2207c-b1c3-42ce-88ff-bd28260ad9e6'} Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:36:56.437429 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:36:56.441810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. Jul 31 01:36:56.441810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.441810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.441810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.441810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.441810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.441810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.441810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:36:56.441810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:36:56.441810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. Jul 31 01:36:56.441810 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.443864 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-122a6a24-276b-4a36-8ef5-5b3c653decba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:36:56.444875 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-122a6a24-276b-4a36-8ef5-5b3c653decba tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "DELETE /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 404 len: 111 microversion: 2.1 time: 0.074252 Jul 31 01:36:56.445855 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2487/4954] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:36:56 2022] DELETE /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:36:56.456327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fa01e57b-772c-4992-9e25-a868082c9d2a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:56.456972 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fa01e57b-772c-4992-9e25-a868082c9d2a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 33f2207c-b1c3-42ce-88ff-bd28260ad9e6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:56.510877 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa01e57b-772c-4992-9e25-a868082c9d2a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.511359 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa01e57b-772c-4992-9e25-a868082c9d2a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.515077 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa01e57b-772c-4992-9e25-a868082c9d2a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.515848 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa01e57b-772c-4992-9e25-a868082c9d2a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.554522 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-fa01e57b-772c-4992-9e25-a868082c9d2a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fa01e57b-772c-4992-9e25-a868082c9d2a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 HTTP/1.1 Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '33f2207c-b1c3-42ce-88ff-bd28260ad9e6'} Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.560951 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.565168 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.565168 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.565168 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.565168 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:36:56.565168 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:36:56.565168 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. Jul 31 01:36:56.565168 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.566504 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fa01e57b-772c-4992-9e25-a868082c9d2a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance 33f2207c-b1c3-42ce-88ff-bd28260ad9e6 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:36:56.570174 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fa01e57b-772c-4992-9e25-a868082c9d2a tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6" status: 404 len: 111 microversion: 2.1 time: 0.119037 Jul 31 01:36:56.572535 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2468/4955] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:56 2022] GET /compute/v2.1/servers/33f2207c-b1c3-42ce-88ff-bd28260ad9e6 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:36:56.582279 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7cd1890c-3321-4188-a45a-4b4704834386 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:56.583356 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7cd1890c-3321-4188-a45a-4b4704834386 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:56.592374 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7cd1890c-3321-4188-a45a-4b4704834386 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.593133 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7cd1890c-3321-4188-a45a-4b4704834386 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.595847 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7cd1890c-3321-4188-a45a-4b4704834386 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.597372 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7cd1890c-3321-4188-a45a-4b4704834386 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.627255 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-7cd1890c-3321-4188-a45a-4b4704834386 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7cd1890c-3321-4188-a45a-4b4704834386 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 HTTP/1.1 Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '8f3ee80f-59a8-4a65-b305-41ad15d38703'} Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:36:56.629042 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:36:56.632692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. Jul 31 01:36:56.632692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.632692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.632692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.632692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.632692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.632692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.632692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:36:56.632692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:36:56.632692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. Jul 31 01:36:56.632692 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.632692 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7cd1890c-3321-4188-a45a-4b4704834386 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:36:56.651606 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7cd1890c-3321-4188-a45a-4b4704834386 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 404 len: 111 microversion: 2.1 time: 0.054215 Jul 31 01:36:56.656052 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2488/4956] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:36:56 2022] DELETE /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:36:56.662101 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9effb3bc-a4dd-4c60-8155-28ea4028c56c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:56.663463 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9effb3bc-a4dd-4c60-8155-28ea4028c56c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 8f3ee80f-59a8-4a65-b305-41ad15d38703] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:56.701612 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9effb3bc-a4dd-4c60-8155-28ea4028c56c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.702087 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9effb3bc-a4dd-4c60-8155-28ea4028c56c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.702925 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9effb3bc-a4dd-4c60-8155-28ea4028c56c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.703394 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9effb3bc-a4dd-4c60-8155-28ea4028c56c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.748176 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f7eea545-44f3-427f-a510-d829f0385164 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:56.749204 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f7eea545-44f3-427f-a510-d829f0385164 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:56.760137 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-9effb3bc-a4dd-4c60-8155-28ea4028c56c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9effb3bc-a4dd-4c60-8155-28ea4028c56c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 HTTP/1.1 Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '8f3ee80f-59a8-4a65-b305-41ad15d38703'} Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.761782 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.765382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.765382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.765382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.765382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:36:56.765382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:36:56.765382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. Jul 31 01:36:56.765382 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.765382 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9effb3bc-a4dd-4c60-8155-28ea4028c56c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance 8f3ee80f-59a8-4a65-b305-41ad15d38703 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:36:56.765382 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9effb3bc-a4dd-4c60-8155-28ea4028c56c tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703" status: 404 len: 111 microversion: 2.1 time: 0.106247 Jul 31 01:36:56.765382 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2469/4957] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:56 2022] GET /compute/v2.1/servers/8f3ee80f-59a8-4a65-b305-41ad15d38703 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:36:56.772812 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7eea545-44f3-427f-a510-d829f0385164 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.773301 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7eea545-44f3-427f-a510-d829f0385164 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.773917 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0f54fbca-3c2f-45cc-949d-5c5a52373b69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:56.774485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0f54fbca-3c2f-45cc-949d-5c5a52373b69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:56.776385 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7eea545-44f3-427f-a510-d829f0385164 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.776881 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7eea545-44f3-427f-a510-d829f0385164 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.786982 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f54fbca-3c2f-45cc-949d-5c5a52373b69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.787470 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f54fbca-3c2f-45cc-949d-5c5a52373b69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.788251 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f54fbca-3c2f-45cc-949d-5c5a52373b69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.788698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f54fbca-3c2f-45cc-949d-5c5a52373b69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.823646 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-0f54fbca-3c2f-45cc-949d-5c5a52373b69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0f54fbca-3c2f-45cc-949d-5c5a52373b69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 HTTP/1.1 Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9'} Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:36:56.826073 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:36:56.830178 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. Jul 31 01:36:56.830178 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.830178 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.830178 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.830178 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.830178 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.830178 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.830178 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:36:56.830178 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:36:56.830178 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. Jul 31 01:36:56.830178 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.830178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0f54fbca-3c2f-45cc-949d-5c5a52373b69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:36:56.830178 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0f54fbca-3c2f-45cc-949d-5c5a52373b69 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 404 len: 111 microversion: 2.1 time: 0.058804 Jul 31 01:36:56.830178 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2470/4958] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:36:56 2022] DELETE /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:36:56.844225 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-16e43604-2abb-44be-b61f-5d1c97a6d625 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:56.849361 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-16e43604-2abb-44be-b61f-5d1c97a6d625 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:56.863941 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16e43604-2abb-44be-b61f-5d1c97a6d625 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.869001 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16e43604-2abb-44be-b61f-5d1c97a6d625 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.873049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16e43604-2abb-44be-b61f-5d1c97a6d625 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:56.873864 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16e43604-2abb-44be-b61f-5d1c97a6d625 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:56.916760 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-16e43604-2abb-44be-b61f-5d1c97a6d625 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-16e43604-2abb-44be-b61f-5d1c97a6d625 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 HTTP/1.1 Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9'} Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.928275 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.932148 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.932148 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.932148 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.932148 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:36:56.932148 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:36:56.932148 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. Jul 31 01:36:56.932148 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.940134 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-16e43604-2abb-44be-b61f-5d1c97a6d625 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance 7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:36:56.941197 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-16e43604-2abb-44be-b61f-5d1c97a6d625 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9" status: 404 len: 111 microversion: 2.1 time: 0.106646 Jul 31 01:36:56.944799 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2471/4959] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:56 2022] GET /compute/v2.1/servers/7e7167fa-fc62-4a9c-9e76-5a3f558f9ca9 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:36:56.950072 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-958f5592-b51d-4e10-aaa6-d9a5898d105d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:56.952344 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-958f5592-b51d-4e10-aaa6-d9a5898d105d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: efec0d84-bc3b-45e4-97d0-988e876028c7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:56.970629 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-958f5592-b51d-4e10-aaa6-d9a5898d105d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-958f5592-b51d-4e10-aaa6-d9a5898d105d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/efec0d84-bc3b-45e4-97d0-988e876028c7 HTTP/1.1 Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: exception: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'efec0d84-bc3b-45e4-97d0-988e876028c7'} Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:56.972678 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.977240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:56.977240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:56.977240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:56.977240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:36:56.977240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:36:56.977240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. Jul 31 01:36:56.977240 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:56.984717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-958f5592-b51d-4e10-aaa6-d9a5898d105d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:36:56.997465 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-958f5592-b51d-4e10-aaa6-d9a5898d105d tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "DELETE /compute/v2.1/servers/efec0d84-bc3b-45e4-97d0-988e876028c7" status: 404 len: 111 microversion: 2.1 time: 0.050956 Jul 31 01:36:57.001595 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2472/4960] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:36:56 2022] DELETE /compute/v2.1/servers/efec0d84-bc3b-45e4-97d0-988e876028c7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:36:57.011113 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2530e659-741e-40e2-b791-8a3ea2952d00 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:57.012090 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2530e659-741e-40e2-b791-8a3ea2952d00 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: efec0d84-bc3b-45e4-97d0-988e876028c7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:57.020337 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-2530e659-741e-40e2-b791-8a3ea2952d00 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2530e659-741e-40e2-b791-8a3ea2952d00 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/efec0d84-bc3b-45e4-97d0-988e876028c7 HTTP/1.1 Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: exception: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'efec0d84-bc3b-45e4-97d0-988e876028c7'} Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:36:57.022181 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:36:57.025663 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:36:57.025663 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:36:57.025663 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:36:57.025663 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. Jul 31 01:36:57.025663 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:36:57.028279 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2530e659-741e-40e2-b791-8a3ea2952d00 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance efec0d84-bc3b-45e4-97d0-988e876028c7 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:36:57.029401 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2530e659-741e-40e2-b791-8a3ea2952d00 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/efec0d84-bc3b-45e4-97d0-988e876028c7" status: 404 len: 111 microversion: 2.1 time: 0.026025 Jul 31 01:36:57.033442 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2473/4961] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:57 2022] GET /compute/v2.1/servers/efec0d84-bc3b-45e4-97d0-988e876028c7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:36:57.341380 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4dd86fe7-3b6b-4582-b18f-144bacf7ae47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:57.343515 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4dd86fe7-3b6b-4582-b18f-144bacf7ae47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:57.360604 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4dd86fe7-3b6b-4582-b18f-144bacf7ae47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:57.368168 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4dd86fe7-3b6b-4582-b18f-144bacf7ae47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:57.369294 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4dd86fe7-3b6b-4582-b18f-144bacf7ae47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:57.371072 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4dd86fe7-3b6b-4582-b18f-144bacf7ae47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:57.513108 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f7eea545-44f3-427f-a510-d829f0385164 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:57.526131 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f7eea545-44f3-427f-a510-d829f0385164 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1215 microversion: 2.1 time: 0.787402 Jul 31 01:36:57.541191 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2489/4962] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:56 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1215 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:57.604185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4dd86fe7-3b6b-4582-b18f-144bacf7ae47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:57.629445 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4dd86fe7-3b6b-4582-b18f-144bacf7ae47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:57.634434 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4dd86fe7-3b6b-4582-b18f-144bacf7ae47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:57.636232 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4dd86fe7-3b6b-4582-b18f-144bacf7ae47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1276 microversion: 2.20 time: 0.300692 Jul 31 01:36:57.636805 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2474/4963] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:36:57 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1276 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:36:58.373149 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e5575d8a-3f5e-4fd5-b952-949ca9d069dd tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3464d70-d968-4476-a3ea-61b5c94210fe", "device": "/dev/sdb"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:36:58.376696 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e5575d8a-3f5e-4fd5-b952-949ca9d069dd tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:58.389137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e5575d8a-3f5e-4fd5-b952-949ca9d069dd tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:58.389615 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e5575d8a-3f5e-4fd5-b952-949ca9d069dd tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:58.390420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e5575d8a-3f5e-4fd5-b952-949ca9d069dd tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:58.390873 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e5575d8a-3f5e-4fd5-b952-949ca9d069dd tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:58.571862 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-99a04e4c-081f-402a-9b50-b94e4a450d62 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:58.572238 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-99a04e4c-081f-402a-9b50-b94e4a450d62 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:58.587005 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99a04e4c-081f-402a-9b50-b94e4a450d62 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:58.588790 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99a04e4c-081f-402a-9b50-b94e4a450d62 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:58.589826 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99a04e4c-081f-402a-9b50-b94e4a450d62 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:58.590382 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99a04e4c-081f-402a-9b50-b94e4a450d62 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:58.905222 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-99a04e4c-081f-402a-9b50-b94e4a450d62 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:58.915696 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-99a04e4c-081f-402a-9b50-b94e4a450d62 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1215 microversion: 2.1 time: 0.365954 Jul 31 01:36:58.916959 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2475/4964] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:58 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1215 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:36:58.922865 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ae3e69bb-fea6-4ea3-a9d5-94e70160efeb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:58.923498 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ae3e69bb-fea6-4ea3-a9d5-94e70160efeb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:58.934037 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae3e69bb-fea6-4ea3-a9d5-94e70160efeb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:58.934827 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae3e69bb-fea6-4ea3-a9d5-94e70160efeb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:58.935898 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae3e69bb-fea6-4ea3-a9d5-94e70160efeb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:58.936667 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ae3e69bb-fea6-4ea3-a9d5-94e70160efeb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:59.043087 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ae3e69bb-fea6-4ea3-a9d5-94e70160efeb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:59.054853 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ae3e69bb-fea6-4ea3-a9d5-94e70160efeb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:59.057915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ae3e69bb-fea6-4ea3-a9d5-94e70160efeb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:36:59.059580 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ae3e69bb-fea6-4ea3-a9d5-94e70160efeb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1338 microversion: 2.20 time: 0.141426 Jul 31 01:36:59.060661 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2476/4965] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:36:58 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1338 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:36:59.418744 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e5575d8a-3f5e-4fd5-b952-949ca9d069dd tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "POST /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.049541 Jul 31 01:36:59.425551 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2490/4966] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:36:58 2022] POST /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973/os-volume_attachments => generated 194 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:36:59.936996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a4bedea9-708f-42f6-a8da-622c274a9264 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:36:59.938666 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a4bedea9-708f-42f6-a8da-622c274a9264 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:36:59.959323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a4bedea9-708f-42f6-a8da-622c274a9264 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:59.961503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a4bedea9-708f-42f6-a8da-622c274a9264 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:36:59.963664 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a4bedea9-708f-42f6-a8da-622c274a9264 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:36:59.966997 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a4bedea9-708f-42f6-a8da-622c274a9264 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:00.086450 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8fd44358-b032-4558-bc05-b36566636e59 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:00.087873 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8fd44358-b032-4558-bc05-b36566636e59 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:00.111663 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fd44358-b032-4558-bc05-b36566636e59 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:00.113706 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fd44358-b032-4558-bc05-b36566636e59 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:00.117464 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fd44358-b032-4558-bc05-b36566636e59 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:00.118059 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fd44358-b032-4558-bc05-b36566636e59 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:00.465209 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a4bedea9-708f-42f6-a8da-622c274a9264 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:00.475815 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a4bedea9-708f-42f6-a8da-622c274a9264 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1215 microversion: 2.1 time: 0.540992 Jul 31 01:37:00.477665 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2477/4967] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:36:59 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1215 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:00.559203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8fd44358-b032-4558-bc05-b36566636e59 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:00.576913 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8fd44358-b032-4558-bc05-b36566636e59 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:00.578901 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8fd44358-b032-4558-bc05-b36566636e59 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:00.580353 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8fd44358-b032-4558-bc05-b36566636e59 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1406 microversion: 2.20 time: 0.500609 Jul 31 01:37:00.596388 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2491/4968] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:37:00 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1406 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:37:01.513559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b7248f8a-6a1b-43e7-be92-1bd1a07243b3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:01.516899 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b7248f8a-6a1b-43e7-be92-1bd1a07243b3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:01.536687 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7248f8a-6a1b-43e7-be92-1bd1a07243b3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:01.538254 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7248f8a-6a1b-43e7-be92-1bd1a07243b3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:01.539469 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7248f8a-6a1b-43e7-be92-1bd1a07243b3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:01.540128 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7248f8a-6a1b-43e7-be92-1bd1a07243b3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:01.609173 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-da72ae5a-fafd-443f-ac4e-ea2ddefb3952 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:01.610946 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-da72ae5a-fafd-443f-ac4e-ea2ddefb3952 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:01.643289 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da72ae5a-fafd-443f-ac4e-ea2ddefb3952 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:01.643804 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da72ae5a-fafd-443f-ac4e-ea2ddefb3952 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:01.644633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da72ae5a-fafd-443f-ac4e-ea2ddefb3952 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:01.645087 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da72ae5a-fafd-443f-ac4e-ea2ddefb3952 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:01.920289 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-da72ae5a-fafd-443f-ac4e-ea2ddefb3952 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:01.955884 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-da72ae5a-fafd-443f-ac4e-ea2ddefb3952 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:01.957591 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-da72ae5a-fafd-443f-ac4e-ea2ddefb3952 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:01.960510 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-da72ae5a-fafd-443f-ac4e-ea2ddefb3952 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1406 microversion: 2.20 time: 0.355661 Jul 31 01:37:01.979829 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2492/4969] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:37:01 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1406 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:37:01.980950 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b7248f8a-6a1b-43e7-be92-1bd1a07243b3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:01.994313 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b7248f8a-6a1b-43e7-be92-1bd1a07243b3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1203 microversion: 2.1 time: 0.494291 Jul 31 01:37:02.008881 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2478/4970] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:01 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1203 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:02.342996 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-0255189c-25b0-433a-874d-45b0d9653636 req-676a612f-4738-401a-933b-6c01036af658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b00bb6-bfdc-4ddc-bfd7-dc53016544bd", "tag": "b03d8e12-2d7a-43c2-a2c3-344746d2f716"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:37:02.373810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0255189c-25b0-433a-874d-45b0d9653636 req-676a612f-4738-401a-933b-6c01036af658 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:02.374475 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0255189c-25b0-433a-874d-45b0d9653636 req-676a612f-4738-401a-933b-6c01036af658 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:02.402337 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-0255189c-25b0-433a-874d-45b0d9653636 req-676a612f-4738-401a-933b-6c01036af658 service nova] Creating event network-changed:b03d8e12-2d7a-43c2-a2c3-344746d2f716 for instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd on n-h1-master-1 Jul 31 01:37:02.428946 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-0255189c-25b0-433a-874d-45b0d9653636 req-676a612f-4738-401a-933b-6c01036af658 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.382867 Jul 31 01:37:02.430642 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2493/4971] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:37:02.988211 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-87227984-52ff-4929-ac79-e5a63291ac22 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:02.988844 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-87227984-52ff-4929-ac79-e5a63291ac22 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:03.005180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87227984-52ff-4929-ac79-e5a63291ac22 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:03.005554 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87227984-52ff-4929-ac79-e5a63291ac22 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:03.006532 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87227984-52ff-4929-ac79-e5a63291ac22 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:03.007139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87227984-52ff-4929-ac79-e5a63291ac22 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:03.019999 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-aff3948a-cee0-4831-aece-b2ac04e68473 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:03.021284 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-aff3948a-cee0-4831-aece-b2ac04e68473 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:03.035762 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aff3948a-cee0-4831-aece-b2ac04e68473 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:03.036475 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aff3948a-cee0-4831-aece-b2ac04e68473 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:03.037438 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aff3948a-cee0-4831-aece-b2ac04e68473 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:03.038048 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aff3948a-cee0-4831-aece-b2ac04e68473 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:03.372887 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-aff3948a-cee0-4831-aece-b2ac04e68473 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:03.382669 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-aff3948a-cee0-4831-aece-b2ac04e68473 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1203 microversion: 2.1 time: 0.365380 Jul 31 01:37:03.385730 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2494/4972] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:03 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1203 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:37:03.402553 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-87227984-52ff-4929-ac79-e5a63291ac22 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:03.414411 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-87227984-52ff-4929-ac79-e5a63291ac22 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:03.416860 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-87227984-52ff-4929-ac79-e5a63291ac22 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:03.418542 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-87227984-52ff-4929-ac79-e5a63291ac22 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1406 microversion: 2.20 time: 0.435538 Jul 31 01:37:03.419617 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2479/4973] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:37:02 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1406 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:37:04.403369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cb6dcdb9-c98e-44b3-b9fa-192e9ed112ad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:04.404286 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cb6dcdb9-c98e-44b3-b9fa-192e9ed112ad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:04.421735 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb6dcdb9-c98e-44b3-b9fa-192e9ed112ad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:04.422355 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb6dcdb9-c98e-44b3-b9fa-192e9ed112ad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:04.423909 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb6dcdb9-c98e-44b3-b9fa-192e9ed112ad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:04.428095 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb6dcdb9-c98e-44b3-b9fa-192e9ed112ad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:04.445128 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-418673e2-5574-445e-bc65-6077cfa6d7a2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:04.445969 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-418673e2-5574-445e-bc65-6077cfa6d7a2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:04.464953 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-418673e2-5574-445e-bc65-6077cfa6d7a2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:04.466791 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-418673e2-5574-445e-bc65-6077cfa6d7a2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:04.468913 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-418673e2-5574-445e-bc65-6077cfa6d7a2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:04.471241 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-418673e2-5574-445e-bc65-6077cfa6d7a2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:05.522351 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cb6dcdb9-c98e-44b3-b9fa-192e9ed112ad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:05.532024 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-418673e2-5574-445e-bc65-6077cfa6d7a2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:05.538455 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cb6dcdb9-c98e-44b3-b9fa-192e9ed112ad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1203 microversion: 2.1 time: 1.136495 Jul 31 01:37:05.539106 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2495/4974] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:04 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1203 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:05.542355 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-418673e2-5574-445e-bc65-6077cfa6d7a2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:05.544772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-418673e2-5574-445e-bc65-6077cfa6d7a2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:05.545942 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-418673e2-5574-445e-bc65-6077cfa6d7a2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1406 microversion: 2.20 time: 1.105307 Jul 31 01:37:05.555671 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2480/4975] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:37:04 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1406 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:37:05.588001 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-747c2b5f-3404-4daf-acaa-89e7601de8e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:05.588641 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-747c2b5f-3404-4daf-acaa-89e7601de8e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:05.602838 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-747c2b5f-3404-4daf-acaa-89e7601de8e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:05.604207 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-747c2b5f-3404-4daf-acaa-89e7601de8e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:05.605045 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-747c2b5f-3404-4daf-acaa-89e7601de8e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:05.605512 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-747c2b5f-3404-4daf-acaa-89e7601de8e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:05.660866 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-747c2b5f-3404-4daf-acaa-89e7601de8e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-747c2b5f-3404-4daf-acaa-89e7601de8e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 HTTP/1.1 Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: exception: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'eebeaca1-9bc6-4c6c-830e-6b54f2998fc3'} Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:37:05.664501 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:37:05.668796 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:37:05.668796 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.668796 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:37:05.668796 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.668796 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:05.668796 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:37:05.668796 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:37:05.668796 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:37:05.668796 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:37:05.668796 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:37:05.668796 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.670288 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-747c2b5f-3404-4daf-acaa-89e7601de8e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:37:05.680474 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-747c2b5f-3404-4daf-acaa-89e7601de8e9 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 404 len: 111 microversion: 2.1 time: 0.136133 Jul 31 01:37:05.684067 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2496/4976] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:37:05 2022] DELETE /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:37:05.691122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-795972f8-6816-4f7d-a5ea-fffaf41c3796 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:05.691921 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-795972f8-6816-4f7d-a5ea-fffaf41c3796 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: eebeaca1-9bc6-4c6c-830e-6b54f2998fc3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:05.701093 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-795972f8-6816-4f7d-a5ea-fffaf41c3796 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:05.701545 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-795972f8-6816-4f7d-a5ea-fffaf41c3796 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:05.713151 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-795972f8-6816-4f7d-a5ea-fffaf41c3796 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:05.713607 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-795972f8-6816-4f7d-a5ea-fffaf41c3796 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:05.759071 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:05.761483 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-795972f8-6816-4f7d-a5ea-fffaf41c3796 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-795972f8-6816-4f7d-a5ea-fffaf41c3796 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 HTTP/1.1 Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: exception: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'eebeaca1-9bc6-4c6c-830e-6b54f2998fc3'} Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:37:05.763875 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.770032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:05.770032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:37:05.770032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:37:05.770032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:37:05.770032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:37:05.770032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. Jul 31 01:37:05.770032 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.772189 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-795972f8-6816-4f7d-a5ea-fffaf41c3796 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:37:05.773454 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-795972f8-6816-4f7d-a5ea-fffaf41c3796 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3" status: 404 len: 111 microversion: 2.1 time: 0.086132 Jul 31 01:37:05.774627 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2481/4977] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:05 2022] GET /compute/v2.1/servers/eebeaca1-9bc6-4c6c-830e-6b54f2998fc3 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:37:05.783448 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed05f96f-dfc3-4e60-9bd8-27b16c727e89 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:05.784304 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ed05f96f-dfc3-4e60-9bd8-27b16c727e89 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:05.794000 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed05f96f-dfc3-4e60-9bd8-27b16c727e89 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:05.796358 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed05f96f-dfc3-4e60-9bd8-27b16c727e89 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:05.797510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed05f96f-dfc3-4e60-9bd8-27b16c727e89 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:05.800505 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed05f96f-dfc3-4e60-9bd8-27b16c727e89 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:05.832510 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-ed05f96f-dfc3-4e60-9bd8-27b16c727e89 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed05f96f-dfc3-4e60-9bd8-27b16c727e89 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc HTTP/1.1 Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '6a17cb70-bf4a-463e-9128-d40c8d2334bc'} Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:37:05.839361 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:37:05.842977 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. Jul 31 01:37:05.842977 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.842977 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:37:05.842977 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.842977 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:05.842977 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:37:05.842977 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:37:05.842977 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:37:05.842977 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:37:05.842977 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. Jul 31 01:37:05.842977 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.846136 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed05f96f-dfc3-4e60-9bd8-27b16c727e89 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:37:05.847258 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ed05f96f-dfc3-4e60-9bd8-27b16c727e89 tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 404 len: 111 microversion: 2.1 time: 0.068864 Jul 31 01:37:05.849045 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2497/4978] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:37:05 2022] DELETE /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:37:05.857606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6be7f3c9-14c9-45fc-a3d7-32e052b675ec tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:05.858617 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6be7f3c9-14c9-45fc-a3d7-32e052b675ec tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] [instance: 6a17cb70-bf4a-463e-9128-d40c8d2334bc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:05.878173 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:05.880456 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6be7f3c9-14c9-45fc-a3d7-32e052b675ec tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:05.881154 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6be7f3c9-14c9-45fc-a3d7-32e052b675ec tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:05.882167 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6be7f3c9-14c9-45fc-a3d7-32e052b675ec tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:05.882923 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6be7f3c9-14c9-45fc-a3d7-32e052b675ec tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:05.920292 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-6be7f3c9-14c9-45fc-a3d7-32e052b675ec tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] HTTP exception thrown: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6be7f3c9-14c9-45fc-a3d7-32e052b675ec tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Request method failure captured: Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc HTTP/1.1 Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dt7BmIusZIJOL6gHgbclAAOcjuC8G6-Mi_LnbX-RjWe3_Qlo9JgDs_lK02zh-DC_-h8UyNEuSz7NZ64vHt7nB8ePwJOANTWiVuHvUsIWcnH0LQbEKeu9kv6WtG7k3j_z1RcO3oRf2_jxqcsVKkBcRnBSUpOfvet-i2DIsF9gSaxNo8 Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e418a04119b843b4a1c218aa9ff1dbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e418a04119b843b4a1c218aa9ff1dbc9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersTestJSON-710201771 Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e418a04119b843b4a1c218aa9ff1dbc9 Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersTestJSON-710201771 Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 93eccdea3f1447a693cec10d096876a0 Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersTestJSON-710201771-project Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '6a17cb70-bf4a-463e-9128-d40c8d2334bc'} Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:37:05.922235 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.927143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:05.927143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:37:05.927143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:37:05.927143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:37:05.927143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:37:05.927143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. Jul 31 01:37:05.927143 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:05.929895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6be7f3c9-14c9-45fc-a3d7-32e052b675ec tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] Returning 404 to user: Instance 6a17cb70-bf4a-463e-9128-d40c8d2334bc could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:37:05.931069 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6be7f3c9-14c9-45fc-a3d7-32e052b675ec tempest-DeleteServersTestJSON-710201771 tempest-DeleteServersTestJSON-710201771-project] 10.222.0.45 "GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc" status: 404 len: 111 microversion: 2.1 time: 0.078724 Jul 31 01:37:05.932147 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2482/4979] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:05 2022] GET /compute/v2.1/servers/6a17cb70-bf4a-463e-9128-d40c8d2334bc => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:37:06.572414 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a10d90ec-8a10-4d09-9b45-8395d609366f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:06.574584 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-08398d9e-ff48-449d-8804-d532ab3a1071 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:06.575610 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a10d90ec-8a10-4d09-9b45-8395d609366f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:06.577017 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-08398d9e-ff48-449d-8804-d532ab3a1071 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:06.597453 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=16 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:06.606427 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08398d9e-ff48-449d-8804-d532ab3a1071 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:06.608579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08398d9e-ff48-449d-8804-d532ab3a1071 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:06.612474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08398d9e-ff48-449d-8804-d532ab3a1071 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:06.615130 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08398d9e-ff48-449d-8804-d532ab3a1071 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:06.618223 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:06.626671 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a10d90ec-8a10-4d09-9b45-8395d609366f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:06.636743 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a10d90ec-8a10-4d09-9b45-8395d609366f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:06.644323 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a10d90ec-8a10-4d09-9b45-8395d609366f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:06.649565 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a10d90ec-8a10-4d09-9b45-8395d609366f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:06.653819 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:07.129462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-08398d9e-ff48-449d-8804-d532ab3a1071 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:07.154051 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-08398d9e-ff48-449d-8804-d532ab3a1071 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:07.158701 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-08398d9e-ff48-449d-8804-d532ab3a1071 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:07.160219 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-08398d9e-ff48-449d-8804-d532ab3a1071 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1406 microversion: 2.20 time: 0.589971 Jul 31 01:37:07.161591 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2483/4980] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:37:06 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1406 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:37:07.999071 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a10d90ec-8a10-4d09-9b45-8395d609366f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:08.010027 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a10d90ec-8a10-4d09-9b45-8395d609366f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1203 microversion: 2.1 time: 1.449770 Jul 31 01:37:08.010611 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2498/4981] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:06 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1203 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:08.186768 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a5a7ddb7-6398-4b66-914f-18de4d1acbea tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:08.189055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a5a7ddb7-6398-4b66-914f-18de4d1acbea tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:08.202341 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a5a7ddb7-6398-4b66-914f-18de4d1acbea tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:08.205277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a5a7ddb7-6398-4b66-914f-18de4d1acbea tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:08.207405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a5a7ddb7-6398-4b66-914f-18de4d1acbea tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:08.209630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a5a7ddb7-6398-4b66-914f-18de4d1acbea tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:08.681953 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a5a7ddb7-6398-4b66-914f-18de4d1acbea tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:08.707987 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a5a7ddb7-6398-4b66-914f-18de4d1acbea tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:08.712025 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a5a7ddb7-6398-4b66-914f-18de4d1acbea tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:08.714781 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a5a7ddb7-6398-4b66-914f-18de4d1acbea tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1406 microversion: 2.20 time: 0.532548 Jul 31 01:37:08.722538 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2484/4982] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:37:08 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1406 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:37:09.035067 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-96facdbc-ccff-41df-a594-6da90aa9ca5d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:09.036267 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-96facdbc-ccff-41df-a594-6da90aa9ca5d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:09.064590 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96facdbc-ccff-41df-a594-6da90aa9ca5d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:09.064590 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96facdbc-ccff-41df-a594-6da90aa9ca5d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:09.068600 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96facdbc-ccff-41df-a594-6da90aa9ca5d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:09.070969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96facdbc-ccff-41df-a594-6da90aa9ca5d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:09.465834 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-96facdbc-ccff-41df-a594-6da90aa9ca5d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:09.475367 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-96facdbc-ccff-41df-a594-6da90aa9ca5d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1203 microversion: 2.1 time: 0.445324 Jul 31 01:37:09.481501 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2499/4983] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:09 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1203 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:09.749311 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9bddfb47-ba2b-4574-87f4-233949705f3d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:09.750554 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9bddfb47-ba2b-4574-87f4-233949705f3d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:09.776871 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9bddfb47-ba2b-4574-87f4-233949705f3d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:09.777596 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9bddfb47-ba2b-4574-87f4-233949705f3d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:09.783084 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9bddfb47-ba2b-4574-87f4-233949705f3d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:09.783879 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9bddfb47-ba2b-4574-87f4-233949705f3d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:10.268693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9bddfb47-ba2b-4574-87f4-233949705f3d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:10.278742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9bddfb47-ba2b-4574-87f4-233949705f3d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:10.280285 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9bddfb47-ba2b-4574-87f4-233949705f3d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:10.299964 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9bddfb47-ba2b-4574-87f4-233949705f3d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1406 microversion: 2.20 time: 0.550204 Jul 31 01:37:10.299964 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2485/4984] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:37:09 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1406 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:37:10.498204 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d2956797-4896-4fc0-ae55-b9c7ccc1a1bf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:10.499808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d2956797-4896-4fc0-ae55-b9c7ccc1a1bf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:10.510796 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2956797-4896-4fc0-ae55-b9c7ccc1a1bf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:10.517158 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2956797-4896-4fc0-ae55-b9c7ccc1a1bf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:10.520789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2956797-4896-4fc0-ae55-b9c7ccc1a1bf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:10.524303 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2956797-4896-4fc0-ae55-b9c7ccc1a1bf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:10.890121 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d2956797-4896-4fc0-ae55-b9c7ccc1a1bf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:10.899738 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d2956797-4896-4fc0-ae55-b9c7ccc1a1bf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1203 microversion: 2.1 time: 0.406175 Jul 31 01:37:10.904792 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2500/4985] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:10 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1203 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:11.139221 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-c4c59cac-8df3-4add-b67c-cd53a38152b9 req-1c094130-c0b1-407a-8199-97c5bdf79082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b00bb6-bfdc-4ddc-bfd7-dc53016544bd", "name": "network-vif-plugged", "status": "completed", "tag": "b03d8e12-2d7a-43c2-a2c3-344746d2f716"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:37:11.163257 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c4c59cac-8df3-4add-b67c-cd53a38152b9 req-1c094130-c0b1-407a-8199-97c5bdf79082 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:11.164008 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c4c59cac-8df3-4add-b67c-cd53a38152b9 req-1c094130-c0b1-407a-8199-97c5bdf79082 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:11.177390 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-c4c59cac-8df3-4add-b67c-cd53a38152b9 req-1c094130-c0b1-407a-8199-97c5bdf79082 service nova] Creating event network-vif-plugged:b03d8e12-2d7a-43c2-a2c3-344746d2f716 for instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd on n-h1-master-1 Jul 31 01:37:11.183162 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-c4c59cac-8df3-4add-b67c-cd53a38152b9 req-1c094130-c0b1-407a-8199-97c5bdf79082 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179404 Jul 31 01:37:11.187801 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2486/4986] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:37:11.317263 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f4604eeb-2859-489b-9065-4065a2fd61d2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:11.317905 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f4604eeb-2859-489b-9065-4065a2fd61d2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:11.327368 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f4604eeb-2859-489b-9065-4065a2fd61d2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:11.327828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f4604eeb-2859-489b-9065-4065a2fd61d2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:11.329605 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f4604eeb-2859-489b-9065-4065a2fd61d2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:11.329605 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f4604eeb-2859-489b-9065-4065a2fd61d2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:11.932310 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3f35fedc-4e14-42b2-9a31-9f971de41fc5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:11.933024 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3f35fedc-4e14-42b2-9a31-9f971de41fc5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:11.946293 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f35fedc-4e14-42b2-9a31-9f971de41fc5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:11.947118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f35fedc-4e14-42b2-9a31-9f971de41fc5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:11.950111 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f35fedc-4e14-42b2-9a31-9f971de41fc5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:11.950878 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f35fedc-4e14-42b2-9a31-9f971de41fc5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:11.971962 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f4604eeb-2859-489b-9065-4065a2fd61d2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:11.983195 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f4604eeb-2859-489b-9065-4065a2fd61d2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:11.995606 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f4604eeb-2859-489b-9065-4065a2fd61d2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:12.003136 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f4604eeb-2859-489b-9065-4065a2fd61d2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1406 microversion: 2.20 time: 0.688330 Jul 31 01:37:12.004193 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2501/4987] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:37:11 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1406 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:37:12.247066 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3f35fedc-4e14-42b2-9a31-9f971de41fc5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:12.257932 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3f35fedc-4e14-42b2-9a31-9f971de41fc5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1203 microversion: 2.1 time: 0.333490 Jul 31 01:37:12.265422 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2487/4988] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:11 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1203 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:13.029316 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2e44741c-1cd2-4d9d-b9e6-ecd032616bf1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:13.030236 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2e44741c-1cd2-4d9d-b9e6-ecd032616bf1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:13.042984 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e44741c-1cd2-4d9d-b9e6-ecd032616bf1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:13.049137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e44741c-1cd2-4d9d-b9e6-ecd032616bf1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:13.049996 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e44741c-1cd2-4d9d-b9e6-ecd032616bf1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:13.050447 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e44741c-1cd2-4d9d-b9e6-ecd032616bf1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:13.207900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-4c758dd9-5385-4cb3-9c86-9927e5adbfb0 req-91211e72-e40d-4eea-afe1-78cec7699d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31634508-a7b2-4238-a592-e4fdd27166ba", "name": "network-vif-plugged", "status": "completed", "tag": "9fd7f8da-6e52-4773-ac0a-6a50205ac93f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:37:13.224555 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-4c758dd9-5385-4cb3-9c86-9927e5adbfb0 req-91211e72-e40d-4eea-afe1-78cec7699d85 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:13.227765 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-4c758dd9-5385-4cb3-9c86-9927e5adbfb0 req-91211e72-e40d-4eea-afe1-78cec7699d85 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:13.269796 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-4c758dd9-5385-4cb3-9c86-9927e5adbfb0 req-91211e72-e40d-4eea-afe1-78cec7699d85 service nova] Creating event network-vif-plugged:9fd7f8da-6e52-4773-ac0a-6a50205ac93f for instance 31634508-a7b2-4238-a592-e4fdd27166ba on n-h2-master-1 Jul 31 01:37:13.286137 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-4c758dd9-5385-4cb3-9c86-9927e5adbfb0 req-91211e72-e40d-4eea-afe1-78cec7699d85 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082652 Jul 31 01:37:13.292702 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2488/4989] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:37:13.310481 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-369edfb8-1ca2-450b-aace-0cc34793aba6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:13.318998 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-369edfb8-1ca2-450b-aace-0cc34793aba6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:13.327386 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-369edfb8-1ca2-450b-aace-0cc34793aba6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:13.329104 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-369edfb8-1ca2-450b-aace-0cc34793aba6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:13.330354 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-369edfb8-1ca2-450b-aace-0cc34793aba6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:13.331331 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-369edfb8-1ca2-450b-aace-0cc34793aba6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:13.389086 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2e44741c-1cd2-4d9d-b9e6-ecd032616bf1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:13.397830 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2e44741c-1cd2-4d9d-b9e6-ecd032616bf1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:13.411767 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2e44741c-1cd2-4d9d-b9e6-ecd032616bf1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:13.415230 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2e44741c-1cd2-4d9d-b9e6-ecd032616bf1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1597 microversion: 2.20 time: 0.390610 Jul 31 01:37:13.417147 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2502/4990] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:37:13 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1597 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:37:13.445966 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e9961577-3c3b-4481-9c47-886d87b9494f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:13.446551 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e9961577-3c3b-4481-9c47-886d87b9494f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:13.458708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9961577-3c3b-4481-9c47-886d87b9494f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:13.464043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9961577-3c3b-4481-9c47-886d87b9494f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:13.466304 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9961577-3c3b-4481-9c47-886d87b9494f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:13.467887 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9961577-3c3b-4481-9c47-886d87b9494f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:13.620063 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-369edfb8-1ca2-450b-aace-0cc34793aba6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:13.633535 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-369edfb8-1ca2-450b-aace-0cc34793aba6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1203 microversion: 2.1 time: 0.334388 Jul 31 01:37:13.635276 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2489/4991] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:13 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1203 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:13.671449 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e9961577-3c3b-4481-9c47-886d87b9494f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.229249 Jul 31 01:37:13.671449 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2503/4992] 10.222.0.45 () {60 vars in 1316 bytes} [Sun Jul 31 01:37:13 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-interface => generated 284 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 01:37:14.657821 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-025b2dfc-128b-4ad5-b645-c67ff90e53dd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:14.659673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-025b2dfc-128b-4ad5-b645-c67ff90e53dd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:14.673226 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-025b2dfc-128b-4ad5-b645-c67ff90e53dd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:14.677244 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-025b2dfc-128b-4ad5-b645-c67ff90e53dd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:14.679786 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-025b2dfc-128b-4ad5-b645-c67ff90e53dd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:14.682072 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-025b2dfc-128b-4ad5-b645-c67ff90e53dd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:15.314161 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-025b2dfc-128b-4ad5-b645-c67ff90e53dd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:15.322625 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-025b2dfc-128b-4ad5-b645-c67ff90e53dd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1203 microversion: 2.1 time: 0.668796 Jul 31 01:37:15.326892 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2490/4993] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:14 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1203 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:16.029493 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-994baee1-e080-45fa-a0cb-230b75c373b1 req-903c217b-c05d-46bc-b616-bb96aec2949a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b00bb6-bfdc-4ddc-bfd7-dc53016544bd", "tag": "b03d8e12-2d7a-43c2-a2c3-344746d2f716"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:37:16.049810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-994baee1-e080-45fa-a0cb-230b75c373b1 req-903c217b-c05d-46bc-b616-bb96aec2949a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:16.050341 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-994baee1-e080-45fa-a0cb-230b75c373b1 req-903c217b-c05d-46bc-b616-bb96aec2949a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:16.085645 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-994baee1-e080-45fa-a0cb-230b75c373b1 req-903c217b-c05d-46bc-b616-bb96aec2949a service nova] Creating event network-changed:b03d8e12-2d7a-43c2-a2c3-344746d2f716 for instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd on n-h1-master-1 Jul 31 01:37:16.102821 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-994baee1-e080-45fa-a0cb-230b75c373b1 req-903c217b-c05d-46bc-b616-bb96aec2949a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078488 Jul 31 01:37:16.107406 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2504/4994] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:37:16.350078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5c7335b2-7350-46ba-ac48-ac3a2f95cc5e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:16.350878 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5c7335b2-7350-46ba-ac48-ac3a2f95cc5e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:16.366916 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c7335b2-7350-46ba-ac48-ac3a2f95cc5e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:16.367563 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c7335b2-7350-46ba-ac48-ac3a2f95cc5e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:16.368628 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c7335b2-7350-46ba-ac48-ac3a2f95cc5e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:16.369398 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c7335b2-7350-46ba-ac48-ac3a2f95cc5e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:17.099974 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5c7335b2-7350-46ba-ac48-ac3a2f95cc5e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:17.120492 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5c7335b2-7350-46ba-ac48-ac3a2f95cc5e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1389 microversion: 2.1 time: 0.771858 Jul 31 01:37:17.124038 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2491/4995] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:16 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1389 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:17.148867 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-37490a68-533b-4fe6-895b-5f08a096d0d5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:17.150241 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-37490a68-533b-4fe6-895b-5f08a096d0d5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:17.159135 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37490a68-533b-4fe6-895b-5f08a096d0d5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:17.160033 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37490a68-533b-4fe6-895b-5f08a096d0d5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:17.161787 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37490a68-533b-4fe6-895b-5f08a096d0d5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:17.162648 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-37490a68-533b-4fe6-895b-5f08a096d0d5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:18.511759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-37490a68-533b-4fe6-895b-5f08a096d0d5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:18.546888 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-37490a68-533b-4fe6-895b-5f08a096d0d5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1389 microversion: 2.1 time: 1.399468 Jul 31 01:37:18.569782 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2505/4996] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:17 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1389 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:18.573556 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ef0b6dfc-5cb5-42ff-beaf-132523fe2182 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:18.574336 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ef0b6dfc-5cb5-42ff-beaf-132523fe2182 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:18.590432 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef0b6dfc-5cb5-42ff-beaf-132523fe2182 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:18.593686 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef0b6dfc-5cb5-42ff-beaf-132523fe2182 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:18.599066 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef0b6dfc-5cb5-42ff-beaf-132523fe2182 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:18.599867 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef0b6dfc-5cb5-42ff-beaf-132523fe2182 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:18.920094 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ef0b6dfc-5cb5-42ff-beaf-132523fe2182 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:18.935145 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ef0b6dfc-5cb5-42ff-beaf-132523fe2182 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1389 microversion: 2.1 time: 0.365275 Jul 31 01:37:18.938581 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2492/4997] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:18 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1389 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:18.962469 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a9cf8dc2-03e4-47ea-b173-9d1fdeb23c77 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:18.962984 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a9cf8dc2-03e4-47ea-b173-9d1fdeb23c77 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:18.983698 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9cf8dc2-03e4-47ea-b173-9d1fdeb23c77 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:18.985638 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9cf8dc2-03e4-47ea-b173-9d1fdeb23c77 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:18.987892 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9cf8dc2-03e4-47ea-b173-9d1fdeb23c77 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:18.989965 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9cf8dc2-03e4-47ea-b173-9d1fdeb23c77 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:19.106306 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a9cf8dc2-03e4-47ea-b173-9d1fdeb23c77 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:37:19.348038 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a9cf8dc2-03e4-47ea-b173-9d1fdeb23c77 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "DELETE /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 204 len: 0 microversion: 2.1 time: 0.391719 Jul 31 01:37:19.352064 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2506/4998] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:37:18 2022] DELETE /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:37:19.358945 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5523285a-d271-43e0-be80-630ca577fce2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:19.359677 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5523285a-d271-43e0-be80-630ca577fce2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:19.374277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5523285a-d271-43e0-be80-630ca577fce2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:19.375095 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5523285a-d271-43e0-be80-630ca577fce2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:19.378707 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5523285a-d271-43e0-be80-630ca577fce2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:19.379515 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5523285a-d271-43e0-be80-630ca577fce2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:19.838046 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5523285a-d271-43e0-be80-630ca577fce2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:19.853310 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5523285a-d271-43e0-be80-630ca577fce2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1395 microversion: 2.1 time: 0.499728 Jul 31 01:37:19.859569 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2493/4999] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:19 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1395 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:20.882213 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8fa98dc3-822a-4b32-a1cc-f08df2cbd0ec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:20.883086 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8fa98dc3-822a-4b32-a1cc-f08df2cbd0ec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:20.892700 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fa98dc3-822a-4b32-a1cc-f08df2cbd0ec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:20.898865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fa98dc3-822a-4b32-a1cc-f08df2cbd0ec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:20.901391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fa98dc3-822a-4b32-a1cc-f08df2cbd0ec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:20.902396 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fa98dc3-822a-4b32-a1cc-f08df2cbd0ec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:21.433502 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8fa98dc3-822a-4b32-a1cc-f08df2cbd0ec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:21.463789 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8fa98dc3-822a-4b32-a1cc-f08df2cbd0ec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1395 microversion: 2.1 time: 0.586190 Jul 31 01:37:21.469044 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2507/5000] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:20 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1395 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:21.939397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-b7ade1a0-6a17-4858-bfc1-c754cf45d5db req-8e6f13b3-046c-4532-8cc5-741830c3b668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31634508-a7b2-4238-a592-e4fdd27166ba", "name": "network-vif-deleted", "tag": "9fd7f8da-6e52-4773-ac0a-6a50205ac93f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:37:22.001599 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b7ade1a0-6a17-4858-bfc1-c754cf45d5db req-8e6f13b3-046c-4532-8cc5-741830c3b668 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:22.002104 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b7ade1a0-6a17-4858-bfc1-c754cf45d5db req-8e6f13b3-046c-4532-8cc5-741830c3b668 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:22.029838 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-b7ade1a0-6a17-4858-bfc1-c754cf45d5db req-8e6f13b3-046c-4532-8cc5-741830c3b668 service nova] Creating event network-vif-deleted:9fd7f8da-6e52-4773-ac0a-6a50205ac93f for instance 31634508-a7b2-4238-a592-e4fdd27166ba on n-h2-master-1 Jul 31 01:37:22.037113 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-b7ade1a0-6a17-4858-bfc1-c754cf45d5db req-8e6f13b3-046c-4532-8cc5-741830c3b668 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107290 Jul 31 01:37:22.038858 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2494/5001] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:37:22.511789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-03160133-7470-48fe-b4f2-5cf4ae8f4581 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:22.513594 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-03160133-7470-48fe-b4f2-5cf4ae8f4581 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:22.521153 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03160133-7470-48fe-b4f2-5cf4ae8f4581 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:22.521696 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03160133-7470-48fe-b4f2-5cf4ae8f4581 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:22.523071 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03160133-7470-48fe-b4f2-5cf4ae8f4581 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:22.523711 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03160133-7470-48fe-b4f2-5cf4ae8f4581 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:22.766886 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-03160133-7470-48fe-b4f2-5cf4ae8f4581 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:22.782934 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-03160133-7470-48fe-b4f2-5cf4ae8f4581 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1188 microversion: 2.1 time: 0.290888 Jul 31 01:37:22.797024 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2508/5002] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:22 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1188 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:37:23.804880 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b036adb1-d627-49e3-a4a5-dce8fbddea55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:23.806152 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b036adb1-d627-49e3-a4a5-dce8fbddea55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:23.816244 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:23.818645 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b036adb1-d627-49e3-a4a5-dce8fbddea55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:23.821933 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b036adb1-d627-49e3-a4a5-dce8fbddea55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:23.824058 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b036adb1-d627-49e3-a4a5-dce8fbddea55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:23.825598 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b036adb1-d627-49e3-a4a5-dce8fbddea55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:24.156436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b036adb1-d627-49e3-a4a5-dce8fbddea55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:24.179623 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b036adb1-d627-49e3-a4a5-dce8fbddea55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1188 microversion: 2.1 time: 0.371354 Jul 31 01:37:24.180595 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2495/5003] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:23 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1188 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:24.575785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9bda6f1e-8f08-471e-a530-31148f9caad6 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Action: 'create', calling method: .version_select at 0x7fede5b65790>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-223026333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6+J/LaWSnFFOZkAYso48hG80Uv9odP7u67kbL0684HpdRxs8aYiVWTGkcihw7X0R+bABGGlBOJgQJCmTCJBwwTWHbvh0H8UJklQcaBonKywO7bdfUL2CJV9xDTQHiBxw=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:37:24.624874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-9bda6f1e-8f08-471e-a530-31148f9caad6 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Getting quotas for project e91b99234bbf4863937cc25a97a1d4a9. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:37:24.640380 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-9bda6f1e-8f08-471e-a530-31148f9caad6 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Getting quotas for user 0eea5af26928472d920a9cae8cd6131b and project e91b99234bbf4863937cc25a97a1d4a9. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:37:24.707085 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9bda6f1e-8f08-471e-a530-31148f9caad6 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.518143 Jul 31 01:37:24.713333 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2509/5004] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:37:24 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:37:25.205586 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fd6f38d0-8755-4d91-86aa-208ad7df801e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:25.206407 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fd6f38d0-8755-4d91-86aa-208ad7df801e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:25.220289 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd6f38d0-8755-4d91-86aa-208ad7df801e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:25.226412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd6f38d0-8755-4d91-86aa-208ad7df801e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:25.230524 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd6f38d0-8755-4d91-86aa-208ad7df801e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:25.233735 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd6f38d0-8755-4d91-86aa-208ad7df801e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:25.596937 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fd6f38d0-8755-4d91-86aa-208ad7df801e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:25.609050 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fd6f38d0-8755-4d91-86aa-208ad7df801e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1188 microversion: 2.1 time: 0.407576 Jul 31 01:37:25.614932 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2496/5005] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:25 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1188 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:26.640525 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-636c3382-82e5-4dc1-9868-1ea33e599d97 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:26.641698 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-636c3382-82e5-4dc1-9868-1ea33e599d97 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:26.655744 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:26.660227 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-636c3382-82e5-4dc1-9868-1ea33e599d97 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:26.661939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-636c3382-82e5-4dc1-9868-1ea33e599d97 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:26.663379 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-636c3382-82e5-4dc1-9868-1ea33e599d97 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:26.664762 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-636c3382-82e5-4dc1-9868-1ea33e599d97 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:26.807320 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-636c3382-82e5-4dc1-9868-1ea33e599d97 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:26.817808 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-636c3382-82e5-4dc1-9868-1ea33e599d97 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1188 microversion: 2.1 time: 0.180321 Jul 31 01:37:26.820169 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2510/5006] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:26 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1188 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:27.841093 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-498b24b0-829d-49f2-b8b9-f799a057246e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:27.841699 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-498b24b0-829d-49f2-b8b9-f799a057246e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:27.849595 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-498b24b0-829d-49f2-b8b9-f799a057246e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:27.850056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-498b24b0-829d-49f2-b8b9-f799a057246e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:27.850861 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-498b24b0-829d-49f2-b8b9-f799a057246e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:27.851310 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-498b24b0-829d-49f2-b8b9-f799a057246e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:28.037256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-498b24b0-829d-49f2-b8b9-f799a057246e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:28.048780 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-498b24b0-829d-49f2-b8b9-f799a057246e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1188 microversion: 2.1 time: 0.211562 Jul 31 01:37:28.050494 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2497/5007] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:27 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1188 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:29.076448 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-96ebf396-d2f6-4fae-b255-956aff893f02 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:29.077295 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-96ebf396-d2f6-4fae-b255-956aff893f02 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:29.100472 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96ebf396-d2f6-4fae-b255-956aff893f02 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:29.100960 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96ebf396-d2f6-4fae-b255-956aff893f02 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:29.108469 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96ebf396-d2f6-4fae-b255-956aff893f02 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:29.108933 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96ebf396-d2f6-4fae-b255-956aff893f02 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:29.490454 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-96ebf396-d2f6-4fae-b255-956aff893f02 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:29.503010 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-96ebf396-d2f6-4fae-b255-956aff893f02 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1188 microversion: 2.1 time: 0.433329 Jul 31 01:37:29.511078 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2511/5008] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:29 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1188 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:30.537833 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-474413f3-62ae-4ffd-a7ef-6a5b1ee16415 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:30.540351 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-474413f3-62ae-4ffd-a7ef-6a5b1ee16415 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:30.561946 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-474413f3-62ae-4ffd-a7ef-6a5b1ee16415 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:30.566472 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-474413f3-62ae-4ffd-a7ef-6a5b1ee16415 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:30.577357 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-474413f3-62ae-4ffd-a7ef-6a5b1ee16415 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:30.578055 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-474413f3-62ae-4ffd-a7ef-6a5b1ee16415 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:30.729897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-474413f3-62ae-4ffd-a7ef-6a5b1ee16415 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:30.746796 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-474413f3-62ae-4ffd-a7ef-6a5b1ee16415 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1188 microversion: 2.1 time: 0.213304 Jul 31 01:37:30.747965 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2498/5009] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:30 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1188 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:31.770118 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-51dd9d1b-ec41-4a1d-a060-0555a2832efd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:31.770748 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-51dd9d1b-ec41-4a1d-a060-0555a2832efd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:31.785264 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51dd9d1b-ec41-4a1d-a060-0555a2832efd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:31.786142 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51dd9d1b-ec41-4a1d-a060-0555a2832efd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:31.789046 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51dd9d1b-ec41-4a1d-a060-0555a2832efd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:31.789835 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51dd9d1b-ec41-4a1d-a060-0555a2832efd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:32.518972 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-51dd9d1b-ec41-4a1d-a060-0555a2832efd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:32.531117 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-51dd9d1b-ec41-4a1d-a060-0555a2832efd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 200 len: 1188 microversion: 2.1 time: 0.765219 Jul 31 01:37:32.534930 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2512/5010] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:31 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 1188 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:33.556254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-15305958-cb9b-4748-8e58-9a73e5c992c7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:33.556890 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-15305958-cb9b-4748-8e58-9a73e5c992c7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 31634508-a7b2-4238-a592-e4fdd27166ba] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:33.581960 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15305958-cb9b-4748-8e58-9a73e5c992c7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:33.582933 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15305958-cb9b-4748-8e58-9a73e5c992c7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:33.596325 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15305958-cb9b-4748-8e58-9a73e5c992c7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:33.596893 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15305958-cb9b-4748-8e58-9a73e5c992c7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:33.681690 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-15305958-cb9b-4748-8e58-9a73e5c992c7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] HTTP exception thrown: Instance 31634508-a7b2-4238-a592-e4fdd27166ba could not be found. Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-15305958-cb9b-4748-8e58-9a73e5c992c7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Request method failure captured: Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba HTTP/1.1 Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dxSWPHv6fiyygfwJR0Ud9gfexnY8DUg1-8n2-EFdlhief1Py8PV4RaH4l0q6aYBanPQ6exn-4iFCGEMH9hqgo4PPVedzZNUDT2YTEgYd9iPN8Zs4wyM3F4Cgzs_D-0CTqdk8e-lZRIuuB9WjXa7g4L7rW4yad6wf_BUOJQbjcH4WNc Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f0892e5f98e48408d15771c9d5805bf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestVolumeBootPattern-640389583 Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f6c26df9a49446c290d6a0b1427f0c14 Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 31634508-a7b2-4238-a592-e4fdd27166ba could not be found. Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '31634508-a7b2-4238-a592-e4fdd27166ba'} Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31634508-a7b2-4238-a592-e4fdd27166ba could not be found. Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31634508-a7b2-4238-a592-e4fdd27166ba could not be found. Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:37:33.693004 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:33.698933 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:33.698933 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:37:33.698933 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:37:33.698933 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:37:33.698933 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:37:33.698933 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31634508-a7b2-4238-a592-e4fdd27166ba could not be found. Jul 31 01:37:33.698933 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:33.699541 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-15305958-cb9b-4748-8e58-9a73e5c992c7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Returning 404 to user: Instance 31634508-a7b2-4238-a592-e4fdd27166ba could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:37:33.702813 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-15305958-cb9b-4748-8e58-9a73e5c992c7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba" status: 404 len: 111 microversion: 2.1 time: 0.149167 Jul 31 01:37:33.710408 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2499/5011] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:33 2022] GET /compute/v2.1/servers/31634508-a7b2-4238-a592-e4fdd27166ba => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:37:38.601737 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7b694091-06cb-4ad4-92b2-150e14339a0e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:38.602420 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7b694091-06cb-4ad4-92b2-150e14339a0e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:38.605902 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:38.620288 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b694091-06cb-4ad4-92b2-150e14339a0e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:38.644063 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b694091-06cb-4ad4-92b2-150e14339a0e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:38.645132 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b694091-06cb-4ad4-92b2-150e14339a0e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:38.648335 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b694091-06cb-4ad4-92b2-150e14339a0e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:38.673157 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:38.977982 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-7b694091-06cb-4ad4-92b2-150e14339a0e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lazy-loading 'services' on Instance uuid c004dd94-50c6-4033-9bcc-47b64014c973 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:37:39.117839 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7b694091-06cb-4ad4-92b2-150e14339a0e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973/os-volume_attachments/a3464d70-d968-4476-a3ea-61b5c94210fe" status: 202 len: 0 microversion: 2.1 time: 0.519917 Jul 31 01:37:39.118486 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2513/5012] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 01:37:38 2022] DELETE /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973/os-volume_attachments/a3464d70-d968-4476-a3ea-61b5c94210fe => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:37:40.897753 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-963028503-access_point-405839547", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "ece095c7-3219-4956-b683-53143a42e675"}], "key_name": "tempest-TestSecurityGroupsBasicOps-223026333", "security_groups": [{"name": "tempest-secgroup_access--1913156460"}, {"name": "tempest-secgroup_general--935774422"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:37:41.498625 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] validate_networks() for [('ece095c7-3219-4956-b683-53143a42e675', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:37:43.432052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:37:43.432607 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:37:43.433408 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:37:43.434139 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:37:43.434844 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:37:43.463092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:43.464678 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:43.465521 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:43.465978 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:43.508629 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=90 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:43.562265 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Getting quotas for project e91b99234bbf4863937cc25a97a1d4a9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:37:43.586675 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Getting quotas for user 0eea5af26928472d920a9cae8cd6131b and project e91b99234bbf4863937cc25a97a1d4a9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:37:43.641577 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:37:43.651562 n-d-master-1 devstack@n-api.service[119474]: WARNING nova.utils [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-963028503-access_point-405839547 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-963028503-acc Jul 31 01:37:43.655994 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:37:43.825990 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5fa2fbcf-12db-4ee8-a35b-42ceaded3c8d tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.941545 Jul 31 01:37:43.837503 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2500/5013] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:37:40 2022] POST /compute/v2.1/servers => generated 457 bytes in 2948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:37:43.853477 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a71e651d-412b-4f5c-998e-aad03d1c23e7 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:43.855611 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a71e651d-412b-4f5c-998e-aad03d1c23e7 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:44.455538 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a71e651d-412b-4f5c-998e-aad03d1c23e7 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:44.476858 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a71e651d-412b-4f5c-998e-aad03d1c23e7 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1292 microversion: 2.1 time: 0.636137 Jul 31 01:37:44.480077 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2514/5014] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:43 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1292 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:37:45.506472 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1126b314-c6f7-45a3-8904-9d70518a165a tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:45.507114 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1126b314-c6f7-45a3-8904-9d70518a165a tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:45.526135 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1126b314-c6f7-45a3-8904-9d70518a165a tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:45.527006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1126b314-c6f7-45a3-8904-9d70518a165a tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:45.528021 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1126b314-c6f7-45a3-8904-9d70518a165a tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:45.528991 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1126b314-c6f7-45a3-8904-9d70518a165a tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:46.471736 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1126b314-c6f7-45a3-8904-9d70518a165a tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:46.494999 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1126b314-c6f7-45a3-8904-9d70518a165a tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1344 microversion: 2.1 time: 0.994019 Jul 31 01:37:46.498244 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2501/5015] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:45 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1344 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:47.520092 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7c77db66-3648-4801-8c8f-49ca3679b4de tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:47.520745 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7c77db66-3648-4801-8c8f-49ca3679b4de tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:47.531289 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c77db66-3648-4801-8c8f-49ca3679b4de tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:47.533895 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c77db66-3648-4801-8c8f-49ca3679b4de tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:47.535940 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c77db66-3648-4801-8c8f-49ca3679b4de tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:47.539598 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c77db66-3648-4801-8c8f-49ca3679b4de tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:48.090580 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7c77db66-3648-4801-8c8f-49ca3679b4de tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:48.111805 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7c77db66-3648-4801-8c8f-49ca3679b4de tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1350 microversion: 2.1 time: 0.597216 Jul 31 01:37:48.112750 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2515/5016] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:47 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1350 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:48.674508 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6c2f779f-e9d2-450b-b762-8dd3d69a2f44 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:48.675589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6c2f779f-e9d2-450b-b762-8dd3d69a2f44 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:48.694560 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c2f779f-e9d2-450b-b762-8dd3d69a2f44 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:48.695304 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c2f779f-e9d2-450b-b762-8dd3d69a2f44 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:48.696638 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c2f779f-e9d2-450b-b762-8dd3d69a2f44 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:48.697250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c2f779f-e9d2-450b-b762-8dd3d69a2f44 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:48.751837 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6c2f779f-e9d2-450b-b762-8dd3d69a2f44 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/ips" status: 200 len: 150 microversion: 2.20 time: 0.081750 Jul 31 01:37:48.768002 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2502/5017] 10.222.0.45 () {60 vars in 1289 bytes} [Sun Jul 31 01:37:48 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/ips => generated 150 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:37:49.138146 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e7f2de9a-d055-4728-bbb0-81b2621d84bb tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:49.139484 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e7f2de9a-d055-4728-bbb0-81b2621d84bb tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:49.150028 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e7f2de9a-d055-4728-bbb0-81b2621d84bb tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:49.154469 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e7f2de9a-d055-4728-bbb0-81b2621d84bb tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:49.161708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e7f2de9a-d055-4728-bbb0-81b2621d84bb tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:49.168652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e7f2de9a-d055-4728-bbb0-81b2621d84bb tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:49.655688 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e7f2de9a-d055-4728-bbb0-81b2621d84bb tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:49.674755 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e7f2de9a-d055-4728-bbb0-81b2621d84bb tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1350 microversion: 2.1 time: 0.540424 Jul 31 01:37:49.680753 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2516/5018] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:49 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1350 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:50.695496 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f4b66d43-8288-4a29-9a28-bc97d7a812d0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:50.696134 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f4b66d43-8288-4a29-9a28-bc97d7a812d0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:50.715652 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4b66d43-8288-4a29-9a28-bc97d7a812d0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:50.716124 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4b66d43-8288-4a29-9a28-bc97d7a812d0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:50.720196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4b66d43-8288-4a29-9a28-bc97d7a812d0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:50.720663 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4b66d43-8288-4a29-9a28-bc97d7a812d0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:51.073041 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d56a6b39-ae5f-4409-8558-24be739433e3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:51.074355 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d56a6b39-ae5f-4409-8558-24be739433e3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:51.084512 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d56a6b39-ae5f-4409-8558-24be739433e3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:51.087319 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d56a6b39-ae5f-4409-8558-24be739433e3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:51.089929 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d56a6b39-ae5f-4409-8558-24be739433e3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:51.092656 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d56a6b39-ae5f-4409-8558-24be739433e3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:51.200779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d56a6b39-ae5f-4409-8558-24be739433e3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:37:51.399088 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d56a6b39-ae5f-4409-8558-24be739433e3 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 204 len: 0 microversion: 2.1 time: 0.329674 Jul 31 01:37:51.400017 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2517/5019] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:37:51 2022] DELETE /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:37:51.419602 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d24b0251-6f39-43dc-b430-2d2bb597a5d4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:51.423324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d24b0251-6f39-43dc-b430-2d2bb597a5d4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:51.446730 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d24b0251-6f39-43dc-b430-2d2bb597a5d4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:51.449288 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d24b0251-6f39-43dc-b430-2d2bb597a5d4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:51.451302 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d24b0251-6f39-43dc-b430-2d2bb597a5d4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:51.455172 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d24b0251-6f39-43dc-b430-2d2bb597a5d4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:51.557399 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f4b66d43-8288-4a29-9a28-bc97d7a812d0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:51.566890 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f4b66d43-8288-4a29-9a28-bc97d7a812d0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1469 microversion: 2.1 time: 0.875572 Jul 31 01:37:51.582381 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2503/5020] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:50 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1469 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:52.068044 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d24b0251-6f39-43dc-b430-2d2bb597a5d4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:52.081956 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d24b0251-6f39-43dc-b430-2d2bb597a5d4 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 200 len: 1514 microversion: 2.1 time: 0.676804 Jul 31 01:37:52.095514 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2518/5021] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:51 2022] GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 1514 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:52.595672 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d640a684-1f0a-46ae-9b5f-6ac1190a45f8 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:52.596356 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d640a684-1f0a-46ae-9b5f-6ac1190a45f8 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:52.618118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d640a684-1f0a-46ae-9b5f-6ac1190a45f8 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:52.618574 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d640a684-1f0a-46ae-9b5f-6ac1190a45f8 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:52.620746 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d640a684-1f0a-46ae-9b5f-6ac1190a45f8 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:52.623081 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d640a684-1f0a-46ae-9b5f-6ac1190a45f8 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:52.807911 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-1eaddd30-982b-49ac-bd3f-d456b534d4a7 req-36af3820-5bfd-43f8-a77d-db6348a9c888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49debbf0-7cbe-453d-be83-f9a8082e297d", "tag": "acdc6eff-6dd8-4ef1-9582-9c160bc52431"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:37:52.829532 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1eaddd30-982b-49ac-bd3f-d456b534d4a7 req-36af3820-5bfd-43f8-a77d-db6348a9c888 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:52.831495 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1eaddd30-982b-49ac-bd3f-d456b534d4a7 req-36af3820-5bfd-43f8-a77d-db6348a9c888 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:52.861348 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1eaddd30-982b-49ac-bd3f-d456b534d4a7 req-36af3820-5bfd-43f8-a77d-db6348a9c888 service nova] Creating event network-changed:acdc6eff-6dd8-4ef1-9582-9c160bc52431 for instance 49debbf0-7cbe-453d-be83-f9a8082e297d on n-h1-master-1 Jul 31 01:37:52.881104 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-1eaddd30-982b-49ac-bd3f-d456b534d4a7 req-36af3820-5bfd-43f8-a77d-db6348a9c888 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079849 Jul 31 01:37:52.884120 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2519/5022] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:37:52.957357 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b306bb83-7366-4033-bcec-6c086a210d75 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:37:52.958001 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b306bb83-7366-4033-bcec-6c086a210d75 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:52.978275 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b306bb83-7366-4033-bcec-6c086a210d75 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:52.978741 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b306bb83-7366-4033-bcec-6c086a210d75 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:52.979582 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b306bb83-7366-4033-bcec-6c086a210d75 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:52.980031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b306bb83-7366-4033-bcec-6c086a210d75 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:53.055699 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-b306bb83-7366-4033-bcec-6c086a210d75 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lazy-loading 'flavor' on Instance uuid 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:37:53.384471 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d640a684-1f0a-46ae-9b5f-6ac1190a45f8 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:53.405087 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d640a684-1f0a-46ae-9b5f-6ac1190a45f8 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1469 microversion: 2.1 time: 0.814536 Jul 31 01:37:53.419954 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2504/5023] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:52 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1469 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:53.437040 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f9987996-c3f3-421b-90bb-5aa45b442fc7 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:53.438188 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f9987996-c3f3-421b-90bb-5aa45b442fc7 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:53.456627 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9987996-c3f3-421b-90bb-5aa45b442fc7 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:53.457095 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9987996-c3f3-421b-90bb-5aa45b442fc7 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:53.457926 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9987996-c3f3-421b-90bb-5aa45b442fc7 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:53.458374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f9987996-c3f3-421b-90bb-5aa45b442fc7 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:53.519883 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:53.617582 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:54.010620 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f9987996-c3f3-421b-90bb-5aa45b442fc7 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:54.026770 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f9987996-c3f3-421b-90bb-5aa45b442fc7 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 200 len: 1514 microversion: 2.1 time: 0.605550 Jul 31 01:37:54.028094 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2505/5024] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:53 2022] GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 1514 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:54.033910 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-2f0f485f-710b-44e6-af13-47b704c30df3 req-b090e390-246d-436b-9d1c-6fa50542bd4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c004dd94-50c6-4033-9bcc-47b64014c973", "name": "network-vif-deleted", "tag": "de92d0ec-e296-462b-81bb-e3f52972564f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:37:54.042866 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:54.046853 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2f0f485f-710b-44e6-af13-47b704c30df3 req-b090e390-246d-436b-9d1c-6fa50542bd4c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:54.048233 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2f0f485f-710b-44e6-af13-47b704c30df3 req-b090e390-246d-436b-9d1c-6fa50542bd4c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:54.066562 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-2f0f485f-710b-44e6-af13-47b704c30df3 req-b090e390-246d-436b-9d1c-6fa50542bd4c service nova] Creating event network-vif-deleted:de92d0ec-e296-462b-81bb-e3f52972564f for instance c004dd94-50c6-4033-9bcc-47b64014c973 on n-h2-master-1 Jul 31 01:37:54.078148 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-2f0f485f-710b-44e6-af13-47b704c30df3 req-b090e390-246d-436b-9d1c-6fa50542bd4c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048358 Jul 31 01:37:54.082374 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2506/5025] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:37:54.435592 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-624b0ab0-d706-4754-84e6-9790fbaded1f tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:54.436403 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-624b0ab0-d706-4754-84e6-9790fbaded1f tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:54.449165 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-624b0ab0-d706-4754-84e6-9790fbaded1f tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:54.453040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-624b0ab0-d706-4754-84e6-9790fbaded1f tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:54.456120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-624b0ab0-d706-4754-84e6-9790fbaded1f tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:54.456860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-624b0ab0-d706-4754-84e6-9790fbaded1f tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:54.463987 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:54.763421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-624b0ab0-d706-4754-84e6-9790fbaded1f tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:54.774949 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-624b0ab0-d706-4754-84e6-9790fbaded1f tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1469 microversion: 2.1 time: 0.345172 Jul 31 01:37:54.787385 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2507/5026] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:54 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1469 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:37:55.050128 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-af9ee43c-a72c-4bf1-be0c-374b5c2678bf tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:55.051106 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-af9ee43c-a72c-4bf1-be0c-374b5c2678bf tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: c004dd94-50c6-4033-9bcc-47b64014c973] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:55.060058 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-af9ee43c-a72c-4bf1-be0c-374b5c2678bf tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:55.060873 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-af9ee43c-a72c-4bf1-be0c-374b5c2678bf tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:55.062060 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-af9ee43c-a72c-4bf1-be0c-374b5c2678bf tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:55.062613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-af9ee43c-a72c-4bf1-be0c-374b5c2678bf tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:55.081015 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-af9ee43c-a72c-4bf1-be0c-374b5c2678bf tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] HTTP exception thrown: Instance c004dd94-50c6-4033-9bcc-47b64014c973 could not be found. Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-af9ee43c-a72c-4bf1-be0c-374b5c2678bf tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Request method failure captured: Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 HTTP/1.1 Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dwMogzO9yWTGmyJD4UMZYJIWl-wz83RWLzljYuiDREoGub0Oe9sqBBijOr-h-lnsQ_c1gYiPxhY8b5sdFgHL1mAKTsEDDnIPzxIH80s1AJ4WdhTEdI0X0RKxdxbZWCt0MC7tImAwTMcmn8MzQu9jheNpu-sll16L_jUAsnV1PXaR8E Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: d070c9c7ec3047b0ad5f717036656042 Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesSnapshotTestJSON-43135823 Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d070c9c7ec3047b0ad5f717036656042"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d070c9c7ec3047b0ad5f717036656042"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d070c9c7ec3047b0ad5f717036656042"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d070c9c7ec3047b0ad5f717036656042", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesSnapshotTestJSON-43135823 Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: d070c9c7ec3047b0ad5f717036656042 Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-43135823 Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesSnapshotTestJSON-43135823-project Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 6091fad22d5c4296b090d98a5fc34ced Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesSnapshotTestJSON-43135823-project Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: exception: Instance c004dd94-50c6-4033-9bcc-47b64014c973 could not be found. Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'c004dd94-50c6-4033-9bcc-47b64014c973'} Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c004dd94-50c6-4033-9bcc-47b64014c973 could not be found. Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c004dd94-50c6-4033-9bcc-47b64014c973 could not be found. Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:37:55.085590 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:55.089637 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:37:55.089637 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:37:55.089637 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:37:55.089637 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:37:55.089637 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:37:55.089637 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c004dd94-50c6-4033-9bcc-47b64014c973 could not be found. Jul 31 01:37:55.089637 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:37:55.091910 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-af9ee43c-a72c-4bf1-be0c-374b5c2678bf tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Returning 404 to user: Instance c004dd94-50c6-4033-9bcc-47b64014c973 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:37:55.093041 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-af9ee43c-a72c-4bf1-be0c-374b5c2678bf tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973" status: 404 len: 111 microversion: 2.1 time: 0.048133 Jul 31 01:37:55.094314 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2508/5027] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:55 2022] GET /compute/v2.1/servers/c004dd94-50c6-4033-9bcc-47b64014c973 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:37:55.796324 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fe447448-8be2-4e74-ae5e-ae48a87ca035 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:55.797668 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fe447448-8be2-4e74-ae5e-ae48a87ca035 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:55.809930 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe447448-8be2-4e74-ae5e-ae48a87ca035 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:55.811874 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe447448-8be2-4e74-ae5e-ae48a87ca035 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:55.814504 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe447448-8be2-4e74-ae5e-ae48a87ca035 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:55.814966 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe447448-8be2-4e74-ae5e-ae48a87ca035 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:56.179658 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fe447448-8be2-4e74-ae5e-ae48a87ca035 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:56.197377 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fe447448-8be2-4e74-ae5e-ae48a87ca035 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1469 microversion: 2.1 time: 0.405208 Jul 31 01:37:56.201346 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2509/5028] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:55 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1469 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:37:57.222398 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e71b9d61-3da6-458e-8fdb-d1f691eac36c tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:57.228793 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e71b9d61-3da6-458e-8fdb-d1f691eac36c tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:57.239169 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e71b9d61-3da6-458e-8fdb-d1f691eac36c tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:57.239963 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e71b9d61-3da6-458e-8fdb-d1f691eac36c tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:57.241015 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e71b9d61-3da6-458e-8fdb-d1f691eac36c tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:57.241469 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e71b9d61-3da6-458e-8fdb-d1f691eac36c tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:57.627973 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e71b9d61-3da6-458e-8fdb-d1f691eac36c tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:57.639429 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e71b9d61-3da6-458e-8fdb-d1f691eac36c tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1469 microversion: 2.1 time: 0.421946 Jul 31 01:37:57.649992 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2510/5029] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:57 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1469 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:37:58.671817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7f3bc099-cb00-4242-8e61-e87b9af781aa tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:58.673743 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7f3bc099-cb00-4242-8e61-e87b9af781aa tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:37:58.683402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f3bc099-cb00-4242-8e61-e87b9af781aa tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:58.684241 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f3bc099-cb00-4242-8e61-e87b9af781aa tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:58.685098 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f3bc099-cb00-4242-8e61-e87b9af781aa tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:58.686497 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f3bc099-cb00-4242-8e61-e87b9af781aa tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:58.949472 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7f3bc099-cb00-4242-8e61-e87b9af781aa tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:37:58.967199 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7f3bc099-cb00-4242-8e61-e87b9af781aa tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1469 microversion: 2.1 time: 0.299896 Jul 31 01:37:58.980276 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2511/5030] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:58 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1469 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:37:59.169993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-d52fb432-a700-458f-8b2d-afb02492e427 req-b2f5d860-aa7c-413d-b195-7d10508931bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49debbf0-7cbe-453d-be83-f9a8082e297d", "name": "network-vif-plugged", "status": "completed", "tag": "acdc6eff-6dd8-4ef1-9582-9c160bc52431"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:37:59.188030 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d52fb432-a700-458f-8b2d-afb02492e427 req-b2f5d860-aa7c-413d-b195-7d10508931bd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:37:59.189006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d52fb432-a700-458f-8b2d-afb02492e427 req-b2f5d860-aa7c-413d-b195-7d10508931bd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:37:59.209975 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-d52fb432-a700-458f-8b2d-afb02492e427 req-b2f5d860-aa7c-413d-b195-7d10508931bd service nova] Creating event network-vif-plugged:acdc6eff-6dd8-4ef1-9582-9c160bc52431 for instance 49debbf0-7cbe-453d-be83-f9a8082e297d on n-h1-master-1 Jul 31 01:37:59.216655 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-d52fb432-a700-458f-8b2d-afb02492e427 req-b2f5d860-aa7c-413d-b195-7d10508931bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057294 Jul 31 01:37:59.234260 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2512/5031] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:37:59.993137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c618b878-99f3-4568-88c0-60244e4d7fce tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:37:59.994527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c618b878-99f3-4568-88c0-60244e4d7fce tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:00.009258 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c618b878-99f3-4568-88c0-60244e4d7fce tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:00.010552 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c618b878-99f3-4568-88c0-60244e4d7fce tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:00.021714 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c618b878-99f3-4568-88c0-60244e4d7fce tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:00.022566 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c618b878-99f3-4568-88c0-60244e4d7fce tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:00.405604 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c618b878-99f3-4568-88c0-60244e4d7fce tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:00.417984 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c618b878-99f3-4568-88c0-60244e4d7fce tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1469 microversion: 2.1 time: 0.430813 Jul 31 01:38:00.432129 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2513/5032] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:37:59 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1469 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:01.443060 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5f63ac26-9382-4e9a-bf50-569e2a4bc36c tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:01.444122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5f63ac26-9382-4e9a-bf50-569e2a4bc36c tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:01.465602 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f63ac26-9382-4e9a-bf50-569e2a4bc36c tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:01.466052 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f63ac26-9382-4e9a-bf50-569e2a4bc36c tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:01.466862 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f63ac26-9382-4e9a-bf50-569e2a4bc36c tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:01.467307 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f63ac26-9382-4e9a-bf50-569e2a4bc36c tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:01.794676 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5f63ac26-9382-4e9a-bf50-569e2a4bc36c tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:01.810895 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5f63ac26-9382-4e9a-bf50-569e2a4bc36c tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1640 microversion: 2.1 time: 0.371611 Jul 31 01:38:01.811472 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2514/5033] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:01 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1640 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:01.833055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7f44cacb-2ef2-474c-be37-6576d4ffc1f4 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:01.834542 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7f44cacb-2ef2-474c-be37-6576d4ffc1f4 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:01.845422 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f44cacb-2ef2-474c-be37-6576d4ffc1f4 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:01.846182 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f44cacb-2ef2-474c-be37-6576d4ffc1f4 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:01.847810 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f44cacb-2ef2-474c-be37-6576d4ffc1f4 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:01.848559 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f44cacb-2ef2-474c-be37-6576d4ffc1f4 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:02.081258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7f44cacb-2ef2-474c-be37-6576d4ffc1f4 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:02.090156 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7f44cacb-2ef2-474c-be37-6576d4ffc1f4 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1640 microversion: 2.1 time: 0.261913 Jul 31 01:38:02.105002 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2515/5034] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:01 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1640 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:02.111906 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7e70aede-b831-43d4-b5bd-800b2fb69065 tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:02.112584 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7e70aede-b831-43d4-b5bd-800b2fb69065 tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:02.120000 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e70aede-b831-43d4-b5bd-800b2fb69065 tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:02.120967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e70aede-b831-43d4-b5bd-800b2fb69065 tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:02.122006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e70aede-b831-43d4-b5bd-800b2fb69065 tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:02.122619 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e70aede-b831-43d4-b5bd-800b2fb69065 tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:02.439772 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7e70aede-b831-43d4-b5bd-800b2fb69065 tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1791 microversion: 2.1 time: 0.332134 Jul 31 01:38:02.440396 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2516/5035] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:02 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1791 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:02.978472 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:38:03.201016 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:38:06.543799 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-0fc457f4-a9c4-4db4-8dde-ee41c0e9ec54 req-f92f60fe-aa83-47bc-a7b8-5776bcd70ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49debbf0-7cbe-453d-be83-f9a8082e297d", "tag": "acdc6eff-6dd8-4ef1-9582-9c160bc52431"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:38:06.569405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0fc457f4-a9c4-4db4-8dde-ee41c0e9ec54 req-f92f60fe-aa83-47bc-a7b8-5776bcd70ef1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:06.570807 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0fc457f4-a9c4-4db4-8dde-ee41c0e9ec54 req-f92f60fe-aa83-47bc-a7b8-5776bcd70ef1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:06.597763 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-0fc457f4-a9c4-4db4-8dde-ee41c0e9ec54 req-f92f60fe-aa83-47bc-a7b8-5776bcd70ef1 service nova] Creating event network-changed:acdc6eff-6dd8-4ef1-9582-9c160bc52431 for instance 49debbf0-7cbe-453d-be83-f9a8082e297d on n-h1-master-1 Jul 31 01:38:06.616517 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-0fc457f4-a9c4-4db4-8dde-ee41c0e9ec54 req-f92f60fe-aa83-47bc-a7b8-5776bcd70ef1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.439392 Jul 31 01:38:06.618025 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2517/5036] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:38:06.632296 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d097c25b-2f5b-4ef7-934c-711838c8063d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-794086495", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "4fabb740-c08f-4f27-ba3f-37fe98794958"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:38:12.160982 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b306bb83-7366-4033-bcec-6c086a210d75 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "POST /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/action" status: 202 len: 0 microversion: 2.20 time: 19.211760 Jul 31 01:38:12.165035 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2520/5037] 10.222.0.45 () {62 vars in 1319 bytes} [Sun Jul 31 01:37:52 2022] POST /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/action => generated 0 bytes in 19217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:38:12.170271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-d097c25b-2f5b-4ef7-934c-711838c8063d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] validate_networks() for [('4fabb740-c08f-4f27-ba3f-37fe98794958', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:38:12.176135 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-30521d3b-df38-4a01-bf16-1c123660316a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:12.177415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-30521d3b-df38-4a01-bf16-1c123660316a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:12.187200 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30521d3b-df38-4a01-bf16-1c123660316a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:12.188190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30521d3b-df38-4a01-bf16-1c123660316a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:12.189552 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30521d3b-df38-4a01-bf16-1c123660316a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:12.190387 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30521d3b-df38-4a01-bf16-1c123660316a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:12.659966 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-30521d3b-df38-4a01-bf16-1c123660316a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:12.709757 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-30521d3b-df38-4a01-bf16-1c123660316a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:12.711317 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-30521d3b-df38-4a01-bf16-1c123660316a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:12.712572 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-30521d3b-df38-4a01-bf16-1c123660316a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.545768 Jul 31 01:38:12.713135 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2521/5038] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:12 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:13.294717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d097c25b-2f5b-4ef7-934c-711838c8063d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:38:13.295798 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d097c25b-2f5b-4ef7-934c-711838c8063d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:38:13.296483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d097c25b-2f5b-4ef7-934c-711838c8063d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:38:13.297616 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d097c25b-2f5b-4ef7-934c-711838c8063d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:38:13.298237 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d097c25b-2f5b-4ef7-934c-711838c8063d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:38:13.313417 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d097c25b-2f5b-4ef7-934c-711838c8063d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:13.314452 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d097c25b-2f5b-4ef7-934c-711838c8063d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:13.315572 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d097c25b-2f5b-4ef7-934c-711838c8063d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:13.316254 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d097c25b-2f5b-4ef7-934c-711838c8063d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:13.363309 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-d097c25b-2f5b-4ef7-934c-711838c8063d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Getting quotas for project d070c9c7ec3047b0ad5f717036656042. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:38:13.374088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-d097c25b-2f5b-4ef7-934c-711838c8063d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Getting quotas for user 6091fad22d5c4296b090d98a5fc34ced and project d070c9c7ec3047b0ad5f717036656042. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:38:13.411206 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d097c25b-2f5b-4ef7-934c-711838c8063d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:38:13.425005 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d097c25b-2f5b-4ef7-934c-711838c8063d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:38:13.543846 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d097c25b-2f5b-4ef7-934c-711838c8063d tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.918412 Jul 31 01:38:13.544599 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2518/5039] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:38:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 6926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:38:13.557034 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b1e64e33-8ccd-4707-8841-f7d2f1b876db tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:13.560681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b1e64e33-8ccd-4707-8841-f7d2f1b876db tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:13.651701 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b1e64e33-8ccd-4707-8841-f7d2f1b876db tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:13.663020 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b1e64e33-8ccd-4707-8841-f7d2f1b876db tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab" status: 200 len: 1218 microversion: 2.1 time: 0.109902 Jul 31 01:38:13.665101 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2522/5040] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:13 2022] GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:13.737182 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8abf90ad-9047-4142-ac65-2b63d5094ead tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:13.737812 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8abf90ad-9047-4142-ac65-2b63d5094ead tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:13.772716 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8abf90ad-9047-4142-ac65-2b63d5094ead tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:13.773176 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8abf90ad-9047-4142-ac65-2b63d5094ead tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:13.780882 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8abf90ad-9047-4142-ac65-2b63d5094ead tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:13.782207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8abf90ad-9047-4142-ac65-2b63d5094ead tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:13.809922 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=88 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:38:14.177426 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8abf90ad-9047-4142-ac65-2b63d5094ead tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:14.187547 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8abf90ad-9047-4142-ac65-2b63d5094ead tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:14.191855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8abf90ad-9047-4142-ac65-2b63d5094ead tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:14.199508 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8abf90ad-9047-4142-ac65-2b63d5094ead tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.462524 Jul 31 01:38:14.203597 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2519/5041] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:13 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:14.688771 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ee2feed3-7c60-4b69-9d0b-37861c544046 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:14.700222 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ee2feed3-7c60-4b69-9d0b-37861c544046 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:14.853789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ee2feed3-7c60-4b69-9d0b-37861c544046 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:14.865213 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ee2feed3-7c60-4b69-9d0b-37861c544046 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab" status: 200 len: 1218 microversion: 2.1 time: 0.179345 Jul 31 01:38:14.868643 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2523/5042] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:14 2022] GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab => generated 1218 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:15.233831 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5da8c820-e759-4244-b99b-37d3b5c727b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:15.235314 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5da8c820-e759-4244-b99b-37d3b5c727b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:15.258080 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5da8c820-e759-4244-b99b-37d3b5c727b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:15.260598 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5da8c820-e759-4244-b99b-37d3b5c727b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:15.264936 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5da8c820-e759-4244-b99b-37d3b5c727b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:15.266209 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5da8c820-e759-4244-b99b-37d3b5c727b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:15.722686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5da8c820-e759-4244-b99b-37d3b5c727b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:15.736227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5da8c820-e759-4244-b99b-37d3b5c727b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:15.753460 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5da8c820-e759-4244-b99b-37d3b5c727b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:15.756151 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5da8c820-e759-4244-b99b-37d3b5c727b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.528629 Jul 31 01:38:15.757712 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2520/5043] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:15 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:15.897802 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bdd0886f-f429-4c2e-b26e-24234a9f3e21 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:15.901146 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bdd0886f-f429-4c2e-b26e-24234a9f3e21 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:15.932590 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdd0886f-f429-4c2e-b26e-24234a9f3e21 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:15.935148 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdd0886f-f429-4c2e-b26e-24234a9f3e21 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:15.939499 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdd0886f-f429-4c2e-b26e-24234a9f3e21 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:15.943021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdd0886f-f429-4c2e-b26e-24234a9f3e21 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:16.102743 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bdd0886f-f429-4c2e-b26e-24234a9f3e21 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:16.116533 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bdd0886f-f429-4c2e-b26e-24234a9f3e21 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab" status: 200 len: 1278 microversion: 2.1 time: 0.227382 Jul 31 01:38:16.119660 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2524/5044] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:15 2022] GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:16.784645 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-52b21f04-17ee-4035-8f79-dd81f550efb7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:16.785928 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-52b21f04-17ee-4035-8f79-dd81f550efb7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:16.834700 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52b21f04-17ee-4035-8f79-dd81f550efb7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:16.842330 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52b21f04-17ee-4035-8f79-dd81f550efb7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:16.843666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52b21f04-17ee-4035-8f79-dd81f550efb7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:16.847061 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52b21f04-17ee-4035-8f79-dd81f550efb7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:17.137814 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d36585a6-b5db-46e4-9bf8-604cee6e0078 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:17.138447 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d36585a6-b5db-46e4-9bf8-604cee6e0078 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:17.147148 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d36585a6-b5db-46e4-9bf8-604cee6e0078 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:17.147867 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d36585a6-b5db-46e4-9bf8-604cee6e0078 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:17.148850 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d36585a6-b5db-46e4-9bf8-604cee6e0078 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:17.149462 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d36585a6-b5db-46e4-9bf8-604cee6e0078 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:17.784964 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-52b21f04-17ee-4035-8f79-dd81f550efb7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:17.803704 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-52b21f04-17ee-4035-8f79-dd81f550efb7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:17.805449 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-52b21f04-17ee-4035-8f79-dd81f550efb7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:17.810558 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-52b21f04-17ee-4035-8f79-dd81f550efb7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 1.033286 Jul 31 01:38:17.813274 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2521/5045] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:16 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:17.989803 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d36585a6-b5db-46e4-9bf8-604cee6e0078 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:17.998644 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d36585a6-b5db-46e4-9bf8-604cee6e0078 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab" status: 200 len: 1318 microversion: 2.1 time: 0.865333 Jul 31 01:38:18.001509 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2525/5046] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:17 2022] GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab => generated 1318 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:38:18.823216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e716e86a-b13b-4b31-84a0-be2795fe15ce req-6c520d19-88be-4783-9b2a-7342879a09d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7838837f-88cb-47ca-80ee-aa8b88fee0ab", "tag": "0d66affb-1e2a-4f25-a233-3abfeda14ed1"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:38:18.840658 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-04d26d6d-fe19-4d7e-965d-555df835cee3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:18.842608 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-04d26d6d-fe19-4d7e-965d-555df835cee3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:18.854688 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04d26d6d-fe19-4d7e-965d-555df835cee3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:18.858987 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04d26d6d-fe19-4d7e-965d-555df835cee3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:18.886115 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e716e86a-b13b-4b31-84a0-be2795fe15ce req-6c520d19-88be-4783-9b2a-7342879a09d4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:18.887828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04d26d6d-fe19-4d7e-965d-555df835cee3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:18.888696 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04d26d6d-fe19-4d7e-965d-555df835cee3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:18.902424 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e716e86a-b13b-4b31-84a0-be2795fe15ce req-6c520d19-88be-4783-9b2a-7342879a09d4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:18.939803 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e716e86a-b13b-4b31-84a0-be2795fe15ce req-6c520d19-88be-4783-9b2a-7342879a09d4 service nova] Creating event network-changed:0d66affb-1e2a-4f25-a233-3abfeda14ed1 for instance 7838837f-88cb-47ca-80ee-aa8b88fee0ab on n-h2-master-1 Jul 31 01:38:18.962582 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e716e86a-b13b-4b31-84a0-be2795fe15ce req-6c520d19-88be-4783-9b2a-7342879a09d4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145759 Jul 31 01:38:18.965851 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2522/5047] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:38:19.023262 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-46ca7660-3cbd-4cf6-b122-d94cb8aa8038 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:19.024027 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-46ca7660-3cbd-4cf6-b122-d94cb8aa8038 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:19.039525 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46ca7660-3cbd-4cf6-b122-d94cb8aa8038 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:19.040399 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46ca7660-3cbd-4cf6-b122-d94cb8aa8038 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:19.041578 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46ca7660-3cbd-4cf6-b122-d94cb8aa8038 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:19.042206 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46ca7660-3cbd-4cf6-b122-d94cb8aa8038 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:19.762538 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-04d26d6d-fe19-4d7e-965d-555df835cee3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:19.769059 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-46ca7660-3cbd-4cf6-b122-d94cb8aa8038 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:19.780739 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-04d26d6d-fe19-4d7e-965d-555df835cee3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:19.785601 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-46ca7660-3cbd-4cf6-b122-d94cb8aa8038 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab" status: 200 len: 1318 microversion: 2.1 time: 0.766626 Jul 31 01:38:19.786211 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2523/5048] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:19 2022] GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab => generated 1318 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:38:19.788381 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-04d26d6d-fe19-4d7e-965d-555df835cee3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:19.793839 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-04d26d6d-fe19-4d7e-965d-555df835cee3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.954751 Jul 31 01:38:19.814644 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2526/5049] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:18 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:20.810843 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-25fc25ac-704b-479f-88b0-b20400c8ac5e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:20.812296 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-25fc25ac-704b-479f-88b0-b20400c8ac5e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:20.823014 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-84ce4040-5f32-4d18-92ac-f70b35894972 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:20.824248 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-84ce4040-5f32-4d18-92ac-f70b35894972 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:20.837042 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-84ce4040-5f32-4d18-92ac-f70b35894972 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:20.837719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-84ce4040-5f32-4d18-92ac-f70b35894972 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:20.838713 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-84ce4040-5f32-4d18-92ac-f70b35894972 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:20.839405 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-84ce4040-5f32-4d18-92ac-f70b35894972 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:20.850273 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25fc25ac-704b-479f-88b0-b20400c8ac5e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:20.855489 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25fc25ac-704b-479f-88b0-b20400c8ac5e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:20.858604 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25fc25ac-704b-479f-88b0-b20400c8ac5e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:20.863011 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25fc25ac-704b-479f-88b0-b20400c8ac5e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:21.799602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-25fc25ac-704b-479f-88b0-b20400c8ac5e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:21.809586 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-25fc25ac-704b-479f-88b0-b20400c8ac5e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab" status: 200 len: 1318 microversion: 2.1 time: 1.003038 Jul 31 01:38:21.812154 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2524/5050] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:20 2022] GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab => generated 1318 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:21.831023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-84ce4040-5f32-4d18-92ac-f70b35894972 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:21.844979 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-84ce4040-5f32-4d18-92ac-f70b35894972 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:21.846662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-84ce4040-5f32-4d18-92ac-f70b35894972 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:21.850659 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-84ce4040-5f32-4d18-92ac-f70b35894972 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 1.031647 Jul 31 01:38:21.854421 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2527/5051] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:20 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:22.831058 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1b417a7b-a23b-46a6-8b63-143a59911b4c tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:22.833613 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1b417a7b-a23b-46a6-8b63-143a59911b4c tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:22.859697 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b417a7b-a23b-46a6-8b63-143a59911b4c tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:22.864570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b417a7b-a23b-46a6-8b63-143a59911b4c tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:22.868412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b417a7b-a23b-46a6-8b63-143a59911b4c tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:22.872928 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b417a7b-a23b-46a6-8b63-143a59911b4c tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:22.880714 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-aef9860a-9a32-438c-b3de-fe6bee9094cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:22.882031 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-aef9860a-9a32-438c-b3de-fe6bee9094cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:22.911253 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aef9860a-9a32-438c-b3de-fe6bee9094cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:22.916757 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aef9860a-9a32-438c-b3de-fe6bee9094cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:22.919675 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aef9860a-9a32-438c-b3de-fe6bee9094cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:22.924816 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aef9860a-9a32-438c-b3de-fe6bee9094cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:23.342535 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:38:23.369430 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1b417a7b-a23b-46a6-8b63-143a59911b4c tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:23.386387 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1b417a7b-a23b-46a6-8b63-143a59911b4c tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab" status: 200 len: 1318 microversion: 2.1 time: 0.559859 Jul 31 01:38:23.387002 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2525/5052] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:22 2022] GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab => generated 1318 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:23.407580 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-aef9860a-9a32-438c-b3de-fe6bee9094cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:23.416429 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-aef9860a-9a32-438c-b3de-fe6bee9094cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:23.428646 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-aef9860a-9a32-438c-b3de-fe6bee9094cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:23.429936 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-aef9860a-9a32-438c-b3de-fe6bee9094cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.553516 Jul 31 01:38:23.430503 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2528/5053] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:22 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:24.380475 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b9b47db3-6fe4-4fea-a5a1-6ff56a94eb2a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1721619048", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:38:24.395529 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:38:24.397050 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:38:24.406702 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2da3bb98-fc33-4a2d-a2a4-5e3674f82579 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:24.407282 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2da3bb98-fc33-4a2d-a2a4-5e3674f82579 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:24.420018 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2da3bb98-fc33-4a2d-a2a4-5e3674f82579 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:24.420510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2da3bb98-fc33-4a2d-a2a4-5e3674f82579 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:24.421336 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2da3bb98-fc33-4a2d-a2a4-5e3674f82579 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:24.422330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2da3bb98-fc33-4a2d-a2a4-5e3674f82579 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:24.489981 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-b9b47db3-6fe4-4fea-a5a1-6ff56a94eb2a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] validate_networks() for None {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:38:24.862807 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:38:25.044240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b9b47db3-6fe4-4fea-a5a1-6ff56a94eb2a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:38:25.045266 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b9b47db3-6fe4-4fea-a5a1-6ff56a94eb2a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:38:25.045266 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b9b47db3-6fe4-4fea-a5a1-6ff56a94eb2a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:38:25.045532 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b9b47db3-6fe4-4fea-a5a1-6ff56a94eb2a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:38:25.046182 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b9b47db3-6fe4-4fea-a5a1-6ff56a94eb2a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:38:25.067102 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9b47db3-6fe4-4fea-a5a1-6ff56a94eb2a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:25.068168 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9b47db3-6fe4-4fea-a5a1-6ff56a94eb2a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:25.070410 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9b47db3-6fe4-4fea-a5a1-6ff56a94eb2a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:25.071217 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9b47db3-6fe4-4fea-a5a1-6ff56a94eb2a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:25.076474 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2da3bb98-fc33-4a2d-a2a4-5e3674f82579 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:25.102887 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2da3bb98-fc33-4a2d-a2a4-5e3674f82579 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab" status: 200 len: 1318 microversion: 2.1 time: 0.700422 Jul 31 01:38:25.121707 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2529/5054] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:24 2022] GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:38:25.129851 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-b9b47db3-6fe4-4fea-a5a1-6ff56a94eb2a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Getting quotas for project 6d170e24e07c4985b1a4bb3d8d1211a4. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:38:25.133594 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ce621445-58cb-4d0a-8eec-3ca5c955ce4a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:25.137320 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ce621445-58cb-4d0a-8eec-3ca5c955ce4a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:25.151030 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-b9b47db3-6fe4-4fea-a5a1-6ff56a94eb2a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Getting quotas for user cdea5f17b5074258b8619e11dde1a243 and project 6d170e24e07c4985b1a4bb3d8d1211a4. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:38:25.155550 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce621445-58cb-4d0a-8eec-3ca5c955ce4a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:25.161378 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce621445-58cb-4d0a-8eec-3ca5c955ce4a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:25.167433 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce621445-58cb-4d0a-8eec-3ca5c955ce4a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:25.168077 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce621445-58cb-4d0a-8eec-3ca5c955ce4a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:25.192263 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b9b47db3-6fe4-4fea-a5a1-6ff56a94eb2a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:38:25.194638 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b9b47db3-6fe4-4fea-a5a1-6ff56a94eb2a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:38:25.274312 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b9b47db3-6fe4-4fea-a5a1-6ff56a94eb2a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.894828 Jul 31 01:38:25.280189 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2526/5055] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:38:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:38:25.301984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9ff27824-feaa-42e7-9649-83ceed77cc5e tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:25.303211 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9ff27824-feaa-42e7-9649-83ceed77cc5e tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:25.505069 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9ff27824-feaa-42e7-9649-83ceed77cc5e tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea5f17b5074258b8619e11dde1a243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d170e24e07c4985b1a4bb3d8d1211a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:25.515900 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9ff27824-feaa-42e7-9649-83ceed77cc5e tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771" status: 200 len: 1215 microversion: 2.1 time: 0.221517 Jul 31 01:38:25.516720 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2527/5056] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:25 2022] GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 => generated 1215 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:38:25.638486 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ce621445-58cb-4d0a-8eec-3ca5c955ce4a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:25.653951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ce621445-58cb-4d0a-8eec-3ca5c955ce4a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:25.655700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ce621445-58cb-4d0a-8eec-3ca5c955ce4a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:25.658577 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ce621445-58cb-4d0a-8eec-3ca5c955ce4a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.535132 Jul 31 01:38:25.659306 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2530/5057] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:25 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:26.071785 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-086797b0-5563-4d81-aa6e-d17c2763e9a5 req-d8f912f7-61ec-427f-b6e6-21d7be3fd483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7838837f-88cb-47ca-80ee-aa8b88fee0ab", "name": "network-vif-plugged", "status": "completed", "tag": "0d66affb-1e2a-4f25-a233-3abfeda14ed1"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:38:26.086141 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-086797b0-5563-4d81-aa6e-d17c2763e9a5 req-d8f912f7-61ec-427f-b6e6-21d7be3fd483 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:26.087261 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-086797b0-5563-4d81-aa6e-d17c2763e9a5 req-d8f912f7-61ec-427f-b6e6-21d7be3fd483 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:26.103137 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-086797b0-5563-4d81-aa6e-d17c2763e9a5 req-d8f912f7-61ec-427f-b6e6-21d7be3fd483 service nova] Creating event network-vif-plugged:0d66affb-1e2a-4f25-a233-3abfeda14ed1 for instance 7838837f-88cb-47ca-80ee-aa8b88fee0ab on n-h2-master-1 Jul 31 01:38:26.108890 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-086797b0-5563-4d81-aa6e-d17c2763e9a5 req-d8f912f7-61ec-427f-b6e6-21d7be3fd483 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043515 Jul 31 01:38:26.110190 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2528/5058] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:38:26.125478 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-752e5b56-36b4-452c-8243-da1e8b6bd10e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:26.126331 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-752e5b56-36b4-452c-8243-da1e8b6bd10e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:26.137594 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-752e5b56-36b4-452c-8243-da1e8b6bd10e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:26.138492 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-752e5b56-36b4-452c-8243-da1e8b6bd10e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:26.139650 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-752e5b56-36b4-452c-8243-da1e8b6bd10e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:26.140212 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-752e5b56-36b4-452c-8243-da1e8b6bd10e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:26.358704 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-752e5b56-36b4-452c-8243-da1e8b6bd10e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:26.369898 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-752e5b56-36b4-452c-8243-da1e8b6bd10e tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab" status: 200 len: 1318 microversion: 2.1 time: 0.248346 Jul 31 01:38:26.396681 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2531/5059] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:26 2022] GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:26.540616 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-98a4f869-d106-44c3-872b-e573d92abe68 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:26.541401 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-98a4f869-d106-44c3-872b-e573d92abe68 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:26.555268 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98a4f869-d106-44c3-872b-e573d92abe68 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:26.556226 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98a4f869-d106-44c3-872b-e573d92abe68 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:26.557835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98a4f869-d106-44c3-872b-e573d92abe68 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:26.558557 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-98a4f869-d106-44c3-872b-e573d92abe68 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:26.682793 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c0434adb-572f-41b1-ac1e-7a2045d3fc56 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:26.684665 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c0434adb-572f-41b1-ac1e-7a2045d3fc56 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:26.696376 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-98a4f869-d106-44c3-872b-e573d92abe68 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea5f17b5074258b8619e11dde1a243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d170e24e07c4985b1a4bb3d8d1211a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:26.698624 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0434adb-572f-41b1-ac1e-7a2045d3fc56 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:26.699381 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0434adb-572f-41b1-ac1e-7a2045d3fc56 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:26.701015 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0434adb-572f-41b1-ac1e-7a2045d3fc56 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:26.704029 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0434adb-572f-41b1-ac1e-7a2045d3fc56 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:26.710762 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-98a4f869-d106-44c3-872b-e573d92abe68 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771" status: 200 len: 1267 microversion: 2.1 time: 0.176259 Jul 31 01:38:26.711413 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2529/5060] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:26 2022] GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:27.133690 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c0434adb-572f-41b1-ac1e-7a2045d3fc56 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:27.143612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c0434adb-572f-41b1-ac1e-7a2045d3fc56 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:27.145587 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c0434adb-572f-41b1-ac1e-7a2045d3fc56 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:27.146989 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c0434adb-572f-41b1-ac1e-7a2045d3fc56 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.468976 Jul 31 01:38:27.147797 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2532/5061] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:26 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:27.395110 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f325c79b-e2a5-40d9-8edb-ae6010743881 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:27.396111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f325c79b-e2a5-40d9-8edb-ae6010743881 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:27.406816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f325c79b-e2a5-40d9-8edb-ae6010743881 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:27.412686 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f325c79b-e2a5-40d9-8edb-ae6010743881 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:27.413759 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f325c79b-e2a5-40d9-8edb-ae6010743881 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:27.414361 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f325c79b-e2a5-40d9-8edb-ae6010743881 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:27.673746 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f325c79b-e2a5-40d9-8edb-ae6010743881 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:27.688155 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f325c79b-e2a5-40d9-8edb-ae6010743881 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab" status: 200 len: 1318 microversion: 2.1 time: 0.298531 Jul 31 01:38:27.690317 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2530/5062] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:27 2022] GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:27.733197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-95033f2b-2508-4b8f-a3e5-7a4164b99470 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:27.733860 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-95033f2b-2508-4b8f-a3e5-7a4164b99470 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:27.751195 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95033f2b-2508-4b8f-a3e5-7a4164b99470 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:27.768340 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95033f2b-2508-4b8f-a3e5-7a4164b99470 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:27.769094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95033f2b-2508-4b8f-a3e5-7a4164b99470 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:27.769714 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95033f2b-2508-4b8f-a3e5-7a4164b99470 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:27.935585 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63360f03-bee1-4c6a-88d3-a41394aff368 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-92196697", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "068ae8cc-0cc7-4403-b134-9536c5635596", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6739ac5e-7d06-4b25-b7ed-29fa35326c6e"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:38:27.962214 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-95033f2b-2508-4b8f-a3e5-7a4164b99470 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea5f17b5074258b8619e11dde1a243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d170e24e07c4985b1a4bb3d8d1211a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:27.975107 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-95033f2b-2508-4b8f-a3e5-7a4164b99470 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771" status: 200 len: 1273 microversion: 2.1 time: 0.245391 Jul 31 01:38:27.977321 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2533/5063] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:27 2022] GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:28.112887 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-63360f03-bee1-4c6a-88d3-a41394aff368 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] validate_networks() for [('6739ac5e-7d06-4b25-b7ed-29fa35326c6e', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:38:28.172923 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e67ad72e-432f-442f-9b7a-60e9ed178cb2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:28.173665 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e67ad72e-432f-442f-9b7a-60e9ed178cb2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:28.184227 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e67ad72e-432f-442f-9b7a-60e9ed178cb2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:28.184962 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e67ad72e-432f-442f-9b7a-60e9ed178cb2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:28.185925 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e67ad72e-432f-442f-9b7a-60e9ed178cb2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:28.186546 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e67ad72e-432f-442f-9b7a-60e9ed178cb2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:28.524462 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e67ad72e-432f-442f-9b7a-60e9ed178cb2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:28.538716 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e67ad72e-432f-442f-9b7a-60e9ed178cb2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:28.540612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e67ad72e-432f-442f-9b7a-60e9ed178cb2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:28.542303 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e67ad72e-432f-442f-9b7a-60e9ed178cb2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.375575 Jul 31 01:38:28.559092 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2534/5064] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:28 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:28.710285 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a14a2059-5492-4da3-b679-08de9f20b901 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:28.710923 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a14a2059-5492-4da3-b679-08de9f20b901 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:28.720519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a14a2059-5492-4da3-b679-08de9f20b901 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:28.721665 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a14a2059-5492-4da3-b679-08de9f20b901 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:28.725033 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a14a2059-5492-4da3-b679-08de9f20b901 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:28.725703 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a14a2059-5492-4da3-b679-08de9f20b901 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:29.701954 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a14a2059-5492-4da3-b679-08de9f20b901 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:29.711520 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a14a2059-5492-4da3-b679-08de9f20b901 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab" status: 200 len: 1507 microversion: 2.1 time: 1.005179 Jul 31 01:38:29.716785 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2535/5065] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:28 2022] GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab => generated 1507 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:38:29.722642 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3d9f56c7-569d-44cd-b11a-e8e1ec1ea6dc tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:29.730800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3d9f56c7-569d-44cd-b11a-e8e1ec1ea6dc tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:29.750783 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d9f56c7-569d-44cd-b11a-e8e1ec1ea6dc tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:29.751378 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d9f56c7-569d-44cd-b11a-e8e1ec1ea6dc tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:29.752135 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d9f56c7-569d-44cd-b11a-e8e1ec1ea6dc tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:29.752588 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d9f56c7-569d-44cd-b11a-e8e1ec1ea6dc tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:29.754341 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-63360f03-bee1-4c6a-88d3-a41394aff368 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:38:29.754810 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-63360f03-bee1-4c6a-88d3-a41394aff368 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:38:29.755248 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-63360f03-bee1-4c6a-88d3-a41394aff368 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:38:29.755705 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-63360f03-bee1-4c6a-88d3-a41394aff368 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:38:29.756126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-63360f03-bee1-4c6a-88d3-a41394aff368 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:38:29.772186 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63360f03-bee1-4c6a-88d3-a41394aff368 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:29.772647 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63360f03-bee1-4c6a-88d3-a41394aff368 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:29.773804 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63360f03-bee1-4c6a-88d3-a41394aff368 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:29.773938 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63360f03-bee1-4c6a-88d3-a41394aff368 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:29.813560 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-63360f03-bee1-4c6a-88d3-a41394aff368 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:38:29.830281 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-63360f03-bee1-4c6a-88d3-a41394aff368 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for user f6c26df9a49446c290d6a0b1427f0c14 and project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:38:29.850041 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-63360f03-bee1-4c6a-88d3-a41394aff368 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:38:29.855144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-63360f03-bee1-4c6a-88d3-a41394aff368 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='068ae8cc-0cc7-4403-b134-9536c5635596',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:38:29.956359 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-63360f03-bee1-4c6a-88d3-a41394aff368 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.024490 Jul 31 01:38:29.957828 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2531/5066] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:38:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:38:29.964932 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-034fcbb6-64cc-4497-8238-cec8d658b7d6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:29.967109 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-034fcbb6-64cc-4497-8238-cec8d658b7d6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:29.975605 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-034fcbb6-64cc-4497-8238-cec8d658b7d6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:29.976421 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-034fcbb6-64cc-4497-8238-cec8d658b7d6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:29.977453 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-034fcbb6-64cc-4497-8238-cec8d658b7d6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:29.978113 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-034fcbb6-64cc-4497-8238-cec8d658b7d6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:30.207975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3d9f56c7-569d-44cd-b11a-e8e1ec1ea6dc tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea5f17b5074258b8619e11dde1a243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d170e24e07c4985b1a4bb3d8d1211a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:30.220080 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3d9f56c7-569d-44cd-b11a-e8e1ec1ea6dc tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771" status: 200 len: 1315 microversion: 2.1 time: 0.501884 Jul 31 01:38:30.222215 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2536/5067] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:29 2022] GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:30.238560 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-13093382-6afd-42c0-a5e5-3768d4456744 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb204551-fd0d-4a76-9e73-2d13cbee99de", "device": "/dev/sdb"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:38:30.241756 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-13093382-6afd-42c0-a5e5-3768d4456744 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:30.248997 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13093382-6afd-42c0-a5e5-3768d4456744 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:30.249570 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13093382-6afd-42c0-a5e5-3768d4456744 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:30.251110 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13093382-6afd-42c0-a5e5-3768d4456744 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:30.251687 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13093382-6afd-42c0-a5e5-3768d4456744 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:30.525557 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-034fcbb6-64cc-4497-8238-cec8d658b7d6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:30.552008 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-034fcbb6-64cc-4497-8238-cec8d658b7d6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:30.560985 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-034fcbb6-64cc-4497-8238-cec8d658b7d6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:30.563859 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-034fcbb6-64cc-4497-8238-cec8d658b7d6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.604536 Jul 31 01:38:30.570104 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2532/5068] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:29 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:30.591741 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-68c69532-aa67-42db-9b60-6aaebe32e9a9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:30.592793 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-68c69532-aa67-42db-9b60-6aaebe32e9a9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:30.777096 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-13093382-6afd-42c0-a5e5-3768d4456744 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "POST /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.549102 Jul 31 01:38:30.780226 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2537/5069] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:38:30 2022] POST /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab/os-volume_attachments => generated 194 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:38:30.785548 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-68c69532-aa67-42db-9b60-6aaebe32e9a9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:30.807054 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-68c69532-aa67-42db-9b60-6aaebe32e9a9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1055 microversion: 2.1 time: 0.230149 Jul 31 01:38:30.809985 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2533/5070] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:30 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1055 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:31.244137 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6cfec096-1a23-489e-b0ea-090a9e44c127 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:31.245134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6cfec096-1a23-489e-b0ea-090a9e44c127 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:31.261429 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6cfec096-1a23-489e-b0ea-090a9e44c127 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:31.263842 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6cfec096-1a23-489e-b0ea-090a9e44c127 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:31.266995 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6cfec096-1a23-489e-b0ea-090a9e44c127 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:31.268307 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6cfec096-1a23-489e-b0ea-090a9e44c127 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:31.308244 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:38:31.599791 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f1425b07-125c-4d32-8ad0-986a627b63db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:31.600409 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f1425b07-125c-4d32-8ad0-986a627b63db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:31.617996 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1425b07-125c-4d32-8ad0-986a627b63db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:31.618522 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1425b07-125c-4d32-8ad0-986a627b63db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:31.619313 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1425b07-125c-4d32-8ad0-986a627b63db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:31.619805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1425b07-125c-4d32-8ad0-986a627b63db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:31.927953 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6cfec096-1a23-489e-b0ea-090a9e44c127 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea5f17b5074258b8619e11dde1a243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d170e24e07c4985b1a4bb3d8d1211a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:31.936681 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6cfec096-1a23-489e-b0ea-090a9e44c127 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771" status: 200 len: 1315 microversion: 2.1 time: 0.697463 Jul 31 01:38:31.939545 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2538/5071] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:31 2022] GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:31.955779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-58a58ef9-aeac-4649-b62d-07fa4639fa62 req-c5377689-f60d-466e-95fb-35f3b294ccc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e76bb67-051a-4c3d-b57b-ae1f10669771", "tag": "193f4627-6811-433e-8090-007c089622ba"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:38:31.978383 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-58a58ef9-aeac-4649-b62d-07fa4639fa62 req-c5377689-f60d-466e-95fb-35f3b294ccc5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:31.979218 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-58a58ef9-aeac-4649-b62d-07fa4639fa62 req-c5377689-f60d-466e-95fb-35f3b294ccc5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:31.991539 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-58a58ef9-aeac-4649-b62d-07fa4639fa62 req-c5377689-f60d-466e-95fb-35f3b294ccc5 service nova] Creating event network-changed:193f4627-6811-433e-8090-007c089622ba for instance 0e76bb67-051a-4c3d-b57b-ae1f10669771 on n-h1-master-1 Jul 31 01:38:31.996798 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-58a58ef9-aeac-4649-b62d-07fa4639fa62 req-c5377689-f60d-466e-95fb-35f3b294ccc5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055344 Jul 31 01:38:31.997576 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2539/5072] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:38:32.010624 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3688d28c-71c6-4b31-9cbe-bf6888c095ce tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:32.012059 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3688d28c-71c6-4b31-9cbe-bf6888c095ce tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:32.027897 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3688d28c-71c6-4b31-9cbe-bf6888c095ce tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:32.030765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3688d28c-71c6-4b31-9cbe-bf6888c095ce tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:32.032318 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3688d28c-71c6-4b31-9cbe-bf6888c095ce tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:32.033213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3688d28c-71c6-4b31-9cbe-bf6888c095ce tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:32.211012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3688d28c-71c6-4b31-9cbe-bf6888c095ce tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:32.214284 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f1425b07-125c-4d32-8ad0-986a627b63db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:32.230648 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f1425b07-125c-4d32-8ad0-986a627b63db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:32.231499 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3688d28c-71c6-4b31-9cbe-bf6888c095ce tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1125 microversion: 2.1 time: 0.223155 Jul 31 01:38:32.234215 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2540/5073] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:31 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1125 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:32.236598 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f1425b07-125c-4d32-8ad0-986a627b63db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:32.238275 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f1425b07-125c-4d32-8ad0-986a627b63db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.645209 Jul 31 01:38:32.258011 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2534/5074] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:31 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:38:32.963559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc0fd786-7457-4cb1-bcfb-71242239a1cc tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:32.964199 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc0fd786-7457-4cb1-bcfb-71242239a1cc tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:32.974123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc0fd786-7457-4cb1-bcfb-71242239a1cc tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:32.974834 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc0fd786-7457-4cb1-bcfb-71242239a1cc tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:32.976165 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc0fd786-7457-4cb1-bcfb-71242239a1cc tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:32.976803 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc0fd786-7457-4cb1-bcfb-71242239a1cc tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:33.254548 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fd30e3e5-f0be-4074-899e-fb5fddb8ee89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:33.255167 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fd30e3e5-f0be-4074-899e-fb5fddb8ee89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:33.270044 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd30e3e5-f0be-4074-899e-fb5fddb8ee89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:33.270752 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd30e3e5-f0be-4074-899e-fb5fddb8ee89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:33.271822 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd30e3e5-f0be-4074-899e-fb5fddb8ee89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:33.272416 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd30e3e5-f0be-4074-899e-fb5fddb8ee89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:33.294906 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fc0fd786-7457-4cb1-bcfb-71242239a1cc tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea5f17b5074258b8619e11dde1a243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d170e24e07c4985b1a4bb3d8d1211a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:33.306334 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc0fd786-7457-4cb1-bcfb-71242239a1cc tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771" status: 200 len: 1315 microversion: 2.1 time: 0.346630 Jul 31 01:38:33.306946 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2541/5075] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:32 2022] GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:33.327801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-12b49fd9-1baf-4725-8dba-ebfe0f53a0dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:33.330676 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-12b49fd9-1baf-4725-8dba-ebfe0f53a0dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:33.342177 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=47 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:38:33.349114 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12b49fd9-1baf-4725-8dba-ebfe0f53a0dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:33.367511 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12b49fd9-1baf-4725-8dba-ebfe0f53a0dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:33.379736 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12b49fd9-1baf-4725-8dba-ebfe0f53a0dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:33.380326 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12b49fd9-1baf-4725-8dba-ebfe0f53a0dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:33.689297 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-12b49fd9-1baf-4725-8dba-ebfe0f53a0dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:33.705368 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-12b49fd9-1baf-4725-8dba-ebfe0f53a0dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:33.710946 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-12b49fd9-1baf-4725-8dba-ebfe0f53a0dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:33.714954 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-12b49fd9-1baf-4725-8dba-ebfe0f53a0dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.394423 Jul 31 01:38:33.715999 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2542/5076] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:33 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:33.800762 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fd30e3e5-f0be-4074-899e-fb5fddb8ee89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:33.820211 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fd30e3e5-f0be-4074-899e-fb5fddb8ee89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1167 microversion: 2.1 time: 0.570019 Jul 31 01:38:33.821908 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2535/5077] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:33 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1167 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:34.326380 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5108b2c0-8ff5-478f-bc5f-d1b28b43a0c6 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:34.327172 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5108b2c0-8ff5-478f-bc5f-d1b28b43a0c6 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:34.340021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5108b2c0-8ff5-478f-bc5f-d1b28b43a0c6 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:34.340727 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5108b2c0-8ff5-478f-bc5f-d1b28b43a0c6 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:34.341854 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5108b2c0-8ff5-478f-bc5f-d1b28b43a0c6 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:34.342525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5108b2c0-8ff5-478f-bc5f-d1b28b43a0c6 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:34.741132 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5a9033d1-07a2-43c6-9009-52365fe2cf31 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:34.741889 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5a9033d1-07a2-43c6-9009-52365fe2cf31 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:34.755512 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a9033d1-07a2-43c6-9009-52365fe2cf31 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:34.755976 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a9033d1-07a2-43c6-9009-52365fe2cf31 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:34.756778 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a9033d1-07a2-43c6-9009-52365fe2cf31 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:34.757217 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a9033d1-07a2-43c6-9009-52365fe2cf31 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:35.130139 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5108b2c0-8ff5-478f-bc5f-d1b28b43a0c6 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea5f17b5074258b8619e11dde1a243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d170e24e07c4985b1a4bb3d8d1211a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:35.142298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5a9033d1-07a2-43c6-9009-52365fe2cf31 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:35.143960 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5108b2c0-8ff5-478f-bc5f-d1b28b43a0c6 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771" status: 200 len: 1315 microversion: 2.1 time: 0.819455 Jul 31 01:38:35.156652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5a9033d1-07a2-43c6-9009-52365fe2cf31 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:35.158325 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2543/5078] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:34 2022] GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 => generated 1315 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:35.158547 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5a9033d1-07a2-43c6-9009-52365fe2cf31 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:35.162715 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5a9033d1-07a2-43c6-9009-52365fe2cf31 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.423913 Jul 31 01:38:35.166028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e44e4cb4-d769-40f9-a131-15b59aceb465 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:35.166800 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2536/5079] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:34 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:38:35.167109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e44e4cb4-d769-40f9-a131-15b59aceb465 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:35.174508 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e44e4cb4-d769-40f9-a131-15b59aceb465 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:35.175237 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e44e4cb4-d769-40f9-a131-15b59aceb465 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:35.176271 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e44e4cb4-d769-40f9-a131-15b59aceb465 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:35.176942 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e44e4cb4-d769-40f9-a131-15b59aceb465 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:35.670486 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-995c31c0-4e69-4e80-bb14-5b7646e4b552 req-66b30239-5baa-4dd8-8a3d-82b552fca2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254edd9c-2684-432f-bfd7-e8a2342c66fd", "tag": "22e379ec-5d6e-401a-b245-dcb4299f6177"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:38:35.701554 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-995c31c0-4e69-4e80-bb14-5b7646e4b552 req-66b30239-5baa-4dd8-8a3d-82b552fca2a6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:35.703570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-995c31c0-4e69-4e80-bb14-5b7646e4b552 req-66b30239-5baa-4dd8-8a3d-82b552fca2a6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:35.739216 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-995c31c0-4e69-4e80-bb14-5b7646e4b552 req-66b30239-5baa-4dd8-8a3d-82b552fca2a6 service nova] Creating event network-changed:22e379ec-5d6e-401a-b245-dcb4299f6177 for instance 254edd9c-2684-432f-bfd7-e8a2342c66fd on n-h2-master-1 Jul 31 01:38:35.747424 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-995c31c0-4e69-4e80-bb14-5b7646e4b552 req-66b30239-5baa-4dd8-8a3d-82b552fca2a6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081532 Jul 31 01:38:35.757389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e44e4cb4-d769-40f9-a131-15b59aceb465 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:35.759489 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2537/5080] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:38:35.768296 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e44e4cb4-d769-40f9-a131-15b59aceb465 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1167 microversion: 2.1 time: 0.604911 Jul 31 01:38:35.770812 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2544/5081] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:35 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1167 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:36.165393 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1d48eae8-f475-4e34-8d72-f7c39a5d445b tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:36.166208 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1d48eae8-f475-4e34-8d72-f7c39a5d445b tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:36.175444 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d48eae8-f475-4e34-8d72-f7c39a5d445b tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:36.176003 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d48eae8-f475-4e34-8d72-f7c39a5d445b tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:36.176932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d48eae8-f475-4e34-8d72-f7c39a5d445b tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:36.177565 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1d48eae8-f475-4e34-8d72-f7c39a5d445b tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:36.194698 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-073251a8-061b-471b-9123-63426cc95fcd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:36.195608 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-073251a8-061b-471b-9123-63426cc95fcd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:36.221031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-073251a8-061b-471b-9123-63426cc95fcd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:36.221502 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-073251a8-061b-471b-9123-63426cc95fcd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:36.226500 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-073251a8-061b-471b-9123-63426cc95fcd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:36.227127 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-073251a8-061b-471b-9123-63426cc95fcd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:36.708569 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-073251a8-061b-471b-9123-63426cc95fcd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:36.722689 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1d48eae8-f475-4e34-8d72-f7c39a5d445b tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea5f17b5074258b8619e11dde1a243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d170e24e07c4985b1a4bb3d8d1211a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:36.725550 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-073251a8-061b-471b-9123-63426cc95fcd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:36.727415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-073251a8-061b-471b-9123-63426cc95fcd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:36.729006 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-073251a8-061b-471b-9123-63426cc95fcd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.538899 Jul 31 01:38:36.729823 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2545/5082] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:36 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:36.746063 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1d48eae8-f475-4e34-8d72-f7c39a5d445b tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771" status: 200 len: 1315 microversion: 2.1 time: 0.584741 Jul 31 01:38:36.746733 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2538/5083] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:36 2022] GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:36.792097 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-92ab6110-3918-4ec4-b43e-bb913fc8bf58 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:36.793433 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-92ab6110-3918-4ec4-b43e-bb913fc8bf58 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:36.803041 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92ab6110-3918-4ec4-b43e-bb913fc8bf58 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:36.807660 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92ab6110-3918-4ec4-b43e-bb913fc8bf58 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:36.808547 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92ab6110-3918-4ec4-b43e-bb913fc8bf58 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:36.809019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92ab6110-3918-4ec4-b43e-bb913fc8bf58 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:37.229413 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-92ab6110-3918-4ec4-b43e-bb913fc8bf58 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:37.238035 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-92ab6110-3918-4ec4-b43e-bb913fc8bf58 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1167 microversion: 2.1 time: 0.451225 Jul 31 01:38:37.238639 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2546/5084] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:36 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1167 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:37.683627 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-26054ff2-784a-4504-a30f-b074942f7a20 req-c733beeb-4ac8-4707-ba1e-e8a6afc623a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e76bb67-051a-4c3d-b57b-ae1f10669771", "name": "network-vif-plugged", "status": "completed", "tag": "193f4627-6811-433e-8090-007c089622ba"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:38:37.708667 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-26054ff2-784a-4504-a30f-b074942f7a20 req-c733beeb-4ac8-4707-ba1e-e8a6afc623a8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:37.709646 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-26054ff2-784a-4504-a30f-b074942f7a20 req-c733beeb-4ac8-4707-ba1e-e8a6afc623a8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:37.748071 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-26054ff2-784a-4504-a30f-b074942f7a20 req-c733beeb-4ac8-4707-ba1e-e8a6afc623a8 service nova] Creating event network-vif-plugged:193f4627-6811-433e-8090-007c089622ba for instance 0e76bb67-051a-4c3d-b57b-ae1f10669771 on n-h1-master-1 Jul 31 01:38:37.755596 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d42da482-f38a-41ae-bf43-4ab997b9d8ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:37.756501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d42da482-f38a-41ae-bf43-4ab997b9d8ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:37.758298 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-26054ff2-784a-4504-a30f-b074942f7a20 req-c733beeb-4ac8-4707-ba1e-e8a6afc623a8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079205 Jul 31 01:38:37.766883 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2539/5085] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:38:37.770337 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d42da482-f38a-41ae-bf43-4ab997b9d8ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:37.771031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d42da482-f38a-41ae-bf43-4ab997b9d8ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:37.774655 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1202231a-e3a2-4a87-8735-8ce16a0a6d01 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:37.775818 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d42da482-f38a-41ae-bf43-4ab997b9d8ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:37.778379 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d42da482-f38a-41ae-bf43-4ab997b9d8ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:37.780133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1202231a-e3a2-4a87-8735-8ce16a0a6d01 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:37.800762 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1202231a-e3a2-4a87-8735-8ce16a0a6d01 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:37.803957 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1202231a-e3a2-4a87-8735-8ce16a0a6d01 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:37.805097 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1202231a-e3a2-4a87-8735-8ce16a0a6d01 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:37.807094 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1202231a-e3a2-4a87-8735-8ce16a0a6d01 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:38.430689 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1202231a-e3a2-4a87-8735-8ce16a0a6d01 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea5f17b5074258b8619e11dde1a243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d170e24e07c4985b1a4bb3d8d1211a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:38.446350 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1202231a-e3a2-4a87-8735-8ce16a0a6d01 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771" status: 200 len: 1315 microversion: 2.1 time: 0.678571 Jul 31 01:38:38.455744 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2540/5086] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:37 2022] GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:38.472715 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1b197aff-e7cf-443e-a5ba-cb7ebfb680ca tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:38.480274 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1b197aff-e7cf-443e-a5ba-cb7ebfb680ca tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:38.491670 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b197aff-e7cf-443e-a5ba-cb7ebfb680ca tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:38.492820 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b197aff-e7cf-443e-a5ba-cb7ebfb680ca tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:38.493857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b197aff-e7cf-443e-a5ba-cb7ebfb680ca tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:38.499001 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b197aff-e7cf-443e-a5ba-cb7ebfb680ca tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:38.572075 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d42da482-f38a-41ae-bf43-4ab997b9d8ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:38.585631 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d42da482-f38a-41ae-bf43-4ab997b9d8ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:38.589200 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d42da482-f38a-41ae-bf43-4ab997b9d8ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:38.591463 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d42da482-f38a-41ae-bf43-4ab997b9d8ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.840521 Jul 31 01:38:38.592743 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2547/5087] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:37 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:38.923702 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1b197aff-e7cf-443e-a5ba-cb7ebfb680ca tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:38.932866 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:38:38.948754 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1b197aff-e7cf-443e-a5ba-cb7ebfb680ca tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1167 microversion: 2.1 time: 0.491492 Jul 31 01:38:38.958209 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2541/5088] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:38 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1167 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:39.488787 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-65e0bd2a-467f-472c-b767-7fa74034c40d tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:39.490475 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-65e0bd2a-467f-472c-b767-7fa74034c40d tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:39.519466 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65e0bd2a-467f-472c-b767-7fa74034c40d tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:39.525254 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65e0bd2a-467f-472c-b767-7fa74034c40d tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:39.527289 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65e0bd2a-467f-472c-b767-7fa74034c40d tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:39.528043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65e0bd2a-467f-472c-b767-7fa74034c40d tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:39.617806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1600ad50-9f00-4e29-bba1-3219d18cc74a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:39.618979 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1600ad50-9f00-4e29-bba1-3219d18cc74a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:39.629852 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1600ad50-9f00-4e29-bba1-3219d18cc74a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:39.637056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1600ad50-9f00-4e29-bba1-3219d18cc74a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:39.638432 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1600ad50-9f00-4e29-bba1-3219d18cc74a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:39.639091 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1600ad50-9f00-4e29-bba1-3219d18cc74a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:39.791695 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:38:40.455136 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-65e0bd2a-467f-472c-b767-7fa74034c40d tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea5f17b5074258b8619e11dde1a243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d170e24e07c4985b1a4bb3d8d1211a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:40.516493 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-65e0bd2a-467f-472c-b767-7fa74034c40d tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771" status: 200 len: 1315 microversion: 2.1 time: 1.033927 Jul 31 01:38:40.519865 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2548/5089] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:39 2022] GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 => generated 1315 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:40.581068 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c1db5d9b-898e-4182-afa8-a3643f73faf9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:40.581708 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c1db5d9b-898e-4182-afa8-a3643f73faf9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:40.648331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1db5d9b-898e-4182-afa8-a3643f73faf9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:40.650753 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1db5d9b-898e-4182-afa8-a3643f73faf9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:40.653572 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1db5d9b-898e-4182-afa8-a3643f73faf9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:40.656367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1db5d9b-898e-4182-afa8-a3643f73faf9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:40.669133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1600ad50-9f00-4e29-bba1-3219d18cc74a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:40.687564 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1600ad50-9f00-4e29-bba1-3219d18cc74a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:40.716251 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1600ad50-9f00-4e29-bba1-3219d18cc74a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:40.721246 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1600ad50-9f00-4e29-bba1-3219d18cc74a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1742 microversion: 2.20 time: 1.104954 Jul 31 01:38:40.730390 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2542/5090] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:39 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1742 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:41.265334 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c1db5d9b-898e-4182-afa8-a3643f73faf9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:41.324312 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c1db5d9b-898e-4182-afa8-a3643f73faf9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1167 microversion: 2.1 time: 0.786486 Jul 31 01:38:41.352202 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2549/5091] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:40 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1167 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:41.548603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f3e50aee-9df7-4cf0-b84b-6de45189b74f tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:41.549243 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f3e50aee-9df7-4cf0-b84b-6de45189b74f tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:41.555221 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=16 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:38:41.567575 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3e50aee-9df7-4cf0-b84b-6de45189b74f tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:41.585665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3e50aee-9df7-4cf0-b84b-6de45189b74f tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:41.586618 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3e50aee-9df7-4cf0-b84b-6de45189b74f tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:41.587081 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3e50aee-9df7-4cf0-b84b-6de45189b74f tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:41.783576 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d2b00937-7893-40a1-bbc8-82e77f133457 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:41.785279 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d2b00937-7893-40a1-bbc8-82e77f133457 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:41.836160 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2b00937-7893-40a1-bbc8-82e77f133457 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:41.848259 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2b00937-7893-40a1-bbc8-82e77f133457 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:41.871120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2b00937-7893-40a1-bbc8-82e77f133457 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:41.876808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2b00937-7893-40a1-bbc8-82e77f133457 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:42.731237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d2b00937-7893-40a1-bbc8-82e77f133457 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:42.794890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d2b00937-7893-40a1-bbc8-82e77f133457 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:42.798391 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d2b00937-7893-40a1-bbc8-82e77f133457 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:42.800683 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d2b00937-7893-40a1-bbc8-82e77f133457 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1737 microversion: 2.20 time: 1.023914 Jul 31 01:38:42.802377 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2550/5092] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:41 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1737 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:42.810465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1a8197eb-2729-47a1-bcd6-12311046f668 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:42.814265 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1a8197eb-2729-47a1-bcd6-12311046f668 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:42.891034 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a8197eb-2729-47a1-bcd6-12311046f668 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:42.893530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a8197eb-2729-47a1-bcd6-12311046f668 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:42.895364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a8197eb-2729-47a1-bcd6-12311046f668 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:42.896400 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a8197eb-2729-47a1-bcd6-12311046f668 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:43.061481 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f3e50aee-9df7-4cf0-b84b-6de45189b74f tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea5f17b5074258b8619e11dde1a243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d170e24e07c4985b1a4bb3d8d1211a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:43.095056 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f3e50aee-9df7-4cf0-b84b-6de45189b74f tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771" status: 200 len: 1464 microversion: 2.1 time: 1.551729 Jul 31 01:38:43.096156 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2543/5093] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:41 2022] GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 => generated 1464 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:43.221854 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b2f9ba15-7df1-45a0-94bb-f19e96b86d30 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:43.228176 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b2f9ba15-7df1-45a0-94bb-f19e96b86d30 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:43.294951 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2f9ba15-7df1-45a0-94bb-f19e96b86d30 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:43.295739 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2f9ba15-7df1-45a0-94bb-f19e96b86d30 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:43.301790 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2f9ba15-7df1-45a0-94bb-f19e96b86d30 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:43.303754 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2f9ba15-7df1-45a0-94bb-f19e96b86d30 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:43.492886 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b2f9ba15-7df1-45a0-94bb-f19e96b86d30 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:38:43.713654 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b2f9ba15-7df1-45a0-94bb-f19e96b86d30 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771" status: 204 len: 0 microversion: 2.1 time: 0.500467 Jul 31 01:38:43.713654 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2544/5094] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:38:43 2022] DELETE /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:38:43.728219 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dba8ab04-41fb-4177-bf66-1d418bc287b4 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:43.728950 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dba8ab04-41fb-4177-bf66-1d418bc287b4 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:43.748230 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dba8ab04-41fb-4177-bf66-1d418bc287b4 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:43.748683 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dba8ab04-41fb-4177-bf66-1d418bc287b4 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:43.749501 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dba8ab04-41fb-4177-bf66-1d418bc287b4 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:43.757681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1a8197eb-2729-47a1-bcd6-12311046f668 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:43.768035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dba8ab04-41fb-4177-bf66-1d418bc287b4 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:43.781961 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1a8197eb-2729-47a1-bcd6-12311046f668 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1167 microversion: 2.1 time: 0.977158 Jul 31 01:38:43.814420 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2551/5095] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:42 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1167 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:43.837896 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9b4238c0-56c9-4322-97bc-2268a3b4c5d7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:43.839994 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9b4238c0-56c9-4322-97bc-2268a3b4c5d7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:43.865890 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9b4238c0-56c9-4322-97bc-2268a3b4c5d7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:43.866395 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9b4238c0-56c9-4322-97bc-2268a3b4c5d7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:43.875036 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9b4238c0-56c9-4322-97bc-2268a3b4c5d7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:43.875845 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9b4238c0-56c9-4322-97bc-2268a3b4c5d7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:44.455199 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9b4238c0-56c9-4322-97bc-2268a3b4c5d7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:44.469697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9b4238c0-56c9-4322-97bc-2268a3b4c5d7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:44.477519 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9b4238c0-56c9-4322-97bc-2268a3b4c5d7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:44.486258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dba8ab04-41fb-4177-bf66-1d418bc287b4 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea5f17b5074258b8619e11dde1a243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d170e24e07c4985b1a4bb3d8d1211a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:44.495513 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dba8ab04-41fb-4177-bf66-1d418bc287b4 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771" status: 200 len: 1470 microversion: 2.1 time: 0.775220 Jul 31 01:38:44.498318 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9b4238c0-56c9-4322-97bc-2268a3b4c5d7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1737 microversion: 2.20 time: 0.673858 Jul 31 01:38:44.501294 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2552/5096] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:43 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1737 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:38:44.502135 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2545/5097] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:43 2022] GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 => generated 1470 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:44.821639 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e36ec8ac-e7d7-47e5-94cf-5bf480553790 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:44.822283 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e36ec8ac-e7d7-47e5-94cf-5bf480553790 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:44.838940 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e36ec8ac-e7d7-47e5-94cf-5bf480553790 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:44.842411 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e36ec8ac-e7d7-47e5-94cf-5bf480553790 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:44.850212 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e36ec8ac-e7d7-47e5-94cf-5bf480553790 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:44.851091 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e36ec8ac-e7d7-47e5-94cf-5bf480553790 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:44.967242 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1db7ba49-d3f2-4e2d-b1b2-047eb3b948ed req-cd23df68-e5ce-4e35-9268-2194b28d1c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b00bb6-bfdc-4ddc-bfd7-dc53016544bd", "name": "network-vif-plugged", "status": "completed", "tag": "b03d8e12-2d7a-43c2-a2c3-344746d2f716"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:38:45.058334 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1db7ba49-d3f2-4e2d-b1b2-047eb3b948ed req-cd23df68-e5ce-4e35-9268-2194b28d1c7c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:45.058791 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1db7ba49-d3f2-4e2d-b1b2-047eb3b948ed req-cd23df68-e5ce-4e35-9268-2194b28d1c7c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:45.159170 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1db7ba49-d3f2-4e2d-b1b2-047eb3b948ed req-cd23df68-e5ce-4e35-9268-2194b28d1c7c service nova] Creating event network-vif-plugged:b03d8e12-2d7a-43c2-a2c3-344746d2f716 for instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd on n-h1-master-1 Jul 31 01:38:45.191308 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1db7ba49-d3f2-4e2d-b1b2-047eb3b948ed req-cd23df68-e5ce-4e35-9268-2194b28d1c7c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229226 Jul 31 01:38:45.200587 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2546/5098] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:38:45.217079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-36583fe9-660a-4920-9283-61507b3933a1 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Action: 'create', calling method: .version_select at 0x7fede561ac10>, body: {"keypair": {"name": "tempest-keypair-1596123683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOr/Qmccva4B7a8YuL3trypLK4BSOt+k4CsMBInq0cZTcpdbo0oAV73VRGYolXnLeV5BllwjJ3l3DSr69Olkrt6rjUweoF1nlz7zwccBCN4zjLW+0iY8KNjbeK7NBq/s+A=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:38:45.255996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-36583fe9-660a-4920-9283-61507b3933a1 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Getting quotas for project f08c4f1ed40d49f9844841b0ee4c2817. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:38:45.272258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-36583fe9-660a-4920-9283-61507b3933a1 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Getting quotas for user 96d6f69a3f9f4a3eb556593e124232d2 and project f08c4f1ed40d49f9844841b0ee4c2817. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:38:45.350795 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-36583fe9-660a-4920-9283-61507b3933a1 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.143860 Jul 31 01:38:45.353288 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2547/5099] 10.222.0.45 () {62 vars in 1200 bytes} [Sun Jul 31 01:38:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 31 01:38:45.527436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d49084c3-c00f-4aca-a6bb-0ededfbee6d9 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:45.528888 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d49084c3-c00f-4aca-a6bb-0ededfbee6d9 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:45.550018 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d49084c3-c00f-4aca-a6bb-0ededfbee6d9 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:45.550782 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d49084c3-c00f-4aca-a6bb-0ededfbee6d9 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:45.551812 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d49084c3-c00f-4aca-a6bb-0ededfbee6d9 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:45.552432 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d49084c3-c00f-4aca-a6bb-0ededfbee6d9 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:46.530064 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e36ec8ac-e7d7-47e5-94cf-5bf480553790 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:46.559490 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d49084c3-c00f-4aca-a6bb-0ededfbee6d9 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea5f17b5074258b8619e11dde1a243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d170e24e07c4985b1a4bb3d8d1211a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:46.571111 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d49084c3-c00f-4aca-a6bb-0ededfbee6d9 tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771" status: 200 len: 1470 microversion: 2.1 time: 1.049226 Jul 31 01:38:46.587630 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2548/5100] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:45 2022] GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 => generated 1470 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:46.589685 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e36ec8ac-e7d7-47e5-94cf-5bf480553790 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1167 microversion: 2.1 time: 1.732046 Jul 31 01:38:46.592283 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2553/5101] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:44 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1167 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:46.596710 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cddd8acd-99f7-44ba-8d5a-eeb5c2ea7d55 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:46.598145 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cddd8acd-99f7-44ba-8d5a-eeb5c2ea7d55 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:46.629538 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cddd8acd-99f7-44ba-8d5a-eeb5c2ea7d55 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:46.635956 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cddd8acd-99f7-44ba-8d5a-eeb5c2ea7d55 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:46.636970 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cddd8acd-99f7-44ba-8d5a-eeb5c2ea7d55 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:46.637566 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cddd8acd-99f7-44ba-8d5a-eeb5c2ea7d55 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:47.498406 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cddd8acd-99f7-44ba-8d5a-eeb5c2ea7d55 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:47.516448 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cddd8acd-99f7-44ba-8d5a-eeb5c2ea7d55 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:47.523199 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cddd8acd-99f7-44ba-8d5a-eeb5c2ea7d55 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:47.524779 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cddd8acd-99f7-44ba-8d5a-eeb5c2ea7d55 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1737 microversion: 2.20 time: 0.935953 Jul 31 01:38:47.539471 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2549/5102] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:46 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1737 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:47.594947 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5fc79d38-5d37-4056-8c20-d19879c8d01a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:47.597415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5fc79d38-5d37-4056-8c20-d19879c8d01a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:47.608059 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5fc79d38-5d37-4056-8c20-d19879c8d01a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:47.608981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5fc79d38-5d37-4056-8c20-d19879c8d01a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:47.621806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1ff4706f-e6b3-4724-a9d4-926fc32f0d62 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:47.624000 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1ff4706f-e6b3-4724-a9d4-926fc32f0d62 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:47.629561 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5fc79d38-5d37-4056-8c20-d19879c8d01a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:47.632091 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5fc79d38-5d37-4056-8c20-d19879c8d01a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:47.648039 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ff4706f-e6b3-4724-a9d4-926fc32f0d62 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:47.648613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ff4706f-e6b3-4724-a9d4-926fc32f0d62 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:47.659373 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ff4706f-e6b3-4724-a9d4-926fc32f0d62 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:47.660303 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ff4706f-e6b3-4724-a9d4-926fc32f0d62 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:47.982290 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5fc79d38-5d37-4056-8c20-d19879c8d01a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea5f17b5074258b8619e11dde1a243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d170e24e07c4985b1a4bb3d8d1211a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:47.997825 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5fc79d38-5d37-4056-8c20-d19879c8d01a tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771" status: 200 len: 1428 microversion: 2.1 time: 0.406884 Jul 31 01:38:48.020135 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2554/5103] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:47 2022] GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 => generated 1428 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:48.124701 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-bf6ca1c2-5f18-4b51-aaf4-d3dd2eb6a7a3 req-1a8f7310-9a70-4739-b612-f44ce0c712e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e76bb67-051a-4c3d-b57b-ae1f10669771", "name": "network-vif-deleted", "tag": "193f4627-6811-433e-8090-007c089622ba"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:38:48.158077 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-bf6ca1c2-5f18-4b51-aaf4-d3dd2eb6a7a3 req-1a8f7310-9a70-4739-b612-f44ce0c712e4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:48.170005 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-bf6ca1c2-5f18-4b51-aaf4-d3dd2eb6a7a3 req-1a8f7310-9a70-4739-b612-f44ce0c712e4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:48.247688 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-bf6ca1c2-5f18-4b51-aaf4-d3dd2eb6a7a3 req-1a8f7310-9a70-4739-b612-f44ce0c712e4 service nova] Creating event network-vif-deleted:193f4627-6811-433e-8090-007c089622ba for instance 0e76bb67-051a-4c3d-b57b-ae1f10669771 on n-h1-master-1 Jul 31 01:38:48.262950 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-bf6ca1c2-5f18-4b51-aaf4-d3dd2eb6a7a3 req-1a8f7310-9a70-4739-b612-f44ce0c712e4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142332 Jul 31 01:38:48.275129 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2555/5104] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:38:48.555409 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2abff783-c4d0-40d3-b3ca-827d513dc682 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:48.555853 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2abff783-c4d0-40d3-b3ca-827d513dc682 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:48.583138 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2abff783-c4d0-40d3-b3ca-827d513dc682 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:48.583377 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2abff783-c4d0-40d3-b3ca-827d513dc682 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:48.590155 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2abff783-c4d0-40d3-b3ca-827d513dc682 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:48.590613 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2abff783-c4d0-40d3-b3ca-827d513dc682 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:48.699706 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:38:48.903292 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1ff4706f-e6b3-4724-a9d4-926fc32f0d62 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:48.913250 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1ff4706f-e6b3-4724-a9d4-926fc32f0d62 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1167 microversion: 2.1 time: 1.300587 Jul 31 01:38:48.913832 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2550/5105] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:47 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1167 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:49.029601 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d0a626cb-2722-4b92-9e45-14124556d44c tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:49.030307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d0a626cb-2722-4b92-9e45-14124556d44c tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] [instance: 0e76bb67-051a-4c3d-b57b-ae1f10669771] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:49.060546 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0a626cb-2722-4b92-9e45-14124556d44c tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:49.065936 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0a626cb-2722-4b92-9e45-14124556d44c tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:49.067158 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0a626cb-2722-4b92-9e45-14124556d44c tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:49.068759 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0a626cb-2722-4b92-9e45-14124556d44c tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:49.146428 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-d0a626cb-2722-4b92-9e45-14124556d44c tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] HTTP exception thrown: Instance 0e76bb67-051a-4c3d-b57b-ae1f10669771 could not be found. Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d0a626cb-2722-4b92-9e45-14124556d44c tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Request method failure captured: Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 HTTP/1.1 Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5d0NHN4K5YQh8eGHxXkWPbcqDUzdcoR3aW3M5CTdxrNOtusehuz_B3a5HkCqUbtm-We5mDlmzY9aB0GiiTeMEEVYd3EER25RU2Mu0wDBRmG3bIKALaElrTMOofATnyc7jsCm9Mlk8l9XWEjGYyLjCnVaEfxYw2cK6vIEuN_I8BY9oho Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6d170e24e07c4985b1a4bb3d8d1211a4 Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesNegativeTest-454984649 Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6d170e24e07c4985b1a4bb3d8d1211a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6d170e24e07c4985b1a4bb3d8d1211a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6d170e24e07c4985b1a4bb3d8d1211a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6d170e24e07c4985b1a4bb3d8d1211a4", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesNegativeTest-454984649 Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6d170e24e07c4985b1a4bb3d8d1211a4 Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesNegativeTest-454984649 Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesNegativeTest-454984649-project Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: cdea5f17b5074258b8619e11dde1a243 Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesNegativeTest-454984649-project Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 0e76bb67-051a-4c3d-b57b-ae1f10669771 could not be found. Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '0e76bb67-051a-4c3d-b57b-ae1f10669771'} Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e76bb67-051a-4c3d-b57b-ae1f10669771 could not be found. Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e76bb67-051a-4c3d-b57b-ae1f10669771 could not be found. Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:38:49.149186 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:38:49.154327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:38:49.154327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:38:49.154327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:38:49.154327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:38:49.154327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:38:49.154327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e76bb67-051a-4c3d-b57b-ae1f10669771 could not be found. Jul 31 01:38:49.154327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:38:49.159964 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d0a626cb-2722-4b92-9e45-14124556d44c tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] Returning 404 to user: Instance 0e76bb67-051a-4c3d-b57b-ae1f10669771 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:38:49.184796 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d0a626cb-2722-4b92-9e45-14124556d44c tempest-VolumesNegativeTest-454984649 tempest-VolumesNegativeTest-454984649-project] 10.222.0.45 "GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771" status: 404 len: 111 microversion: 2.1 time: 0.140738 Jul 31 01:38:49.184796 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2551/5106] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:49 2022] GET /compute/v2.1/servers/0e76bb67-051a-4c3d-b57b-ae1f10669771 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:38:49.937363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b4f7db2b-ad87-43a2-a9c0-5a3ae9a811cc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:49.938084 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b4f7db2b-ad87-43a2-a9c0-5a3ae9a811cc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:49.945409 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:38:50.012853 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4f7db2b-ad87-43a2-a9c0-5a3ae9a811cc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:50.021387 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4f7db2b-ad87-43a2-a9c0-5a3ae9a811cc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:50.024863 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4f7db2b-ad87-43a2-a9c0-5a3ae9a811cc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:50.026694 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4f7db2b-ad87-43a2-a9c0-5a3ae9a811cc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:50.086450 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2abff783-c4d0-40d3-b3ca-827d513dc682 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:50.119575 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2abff783-c4d0-40d3-b3ca-827d513dc682 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:50.122422 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2abff783-c4d0-40d3-b3ca-827d513dc682 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:50.124004 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2abff783-c4d0-40d3-b3ca-827d513dc682 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1737 microversion: 2.20 time: 1.577121 Jul 31 01:38:50.139497 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2556/5107] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:48 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1737 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:50.923022 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b4f7db2b-ad87-43a2-a9c0-5a3ae9a811cc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:50.934744 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b4f7db2b-ad87-43a2-a9c0-5a3ae9a811cc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1167 microversion: 2.1 time: 1.004129 Jul 31 01:38:50.935645 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2552/5108] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:49 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1167 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:51.146690 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-694b6446-5bc9-4616-bd3c-4fa8167250ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:51.147351 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-694b6446-5bc9-4616-bd3c-4fa8167250ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:51.160863 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-694b6446-5bc9-4616-bd3c-4fa8167250ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:51.161763 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-694b6446-5bc9-4616-bd3c-4fa8167250ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:51.162976 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-694b6446-5bc9-4616-bd3c-4fa8167250ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:51.166641 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-694b6446-5bc9-4616-bd3c-4fa8167250ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:51.959633 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-92213f05-ed5f-430a-a3fa-0aba0e66e404 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:51.960426 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-92213f05-ed5f-430a-a3fa-0aba0e66e404 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:52.132989 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92213f05-ed5f-430a-a3fa-0aba0e66e404 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:52.133456 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92213f05-ed5f-430a-a3fa-0aba0e66e404 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:52.134266 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92213f05-ed5f-430a-a3fa-0aba0e66e404 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:52.134711 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92213f05-ed5f-430a-a3fa-0aba0e66e404 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:52.586314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-694b6446-5bc9-4616-bd3c-4fa8167250ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:52.615425 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-694b6446-5bc9-4616-bd3c-4fa8167250ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:52.634969 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-694b6446-5bc9-4616-bd3c-4fa8167250ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:52.643535 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-694b6446-5bc9-4616-bd3c-4fa8167250ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1737 microversion: 2.20 time: 1.500376 Jul 31 01:38:52.652844 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2557/5109] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:51 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1737 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:52.781296 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-92213f05-ed5f-430a-a3fa-0aba0e66e404 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:52.793731 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-92213f05-ed5f-430a-a3fa-0aba0e66e404 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1167 microversion: 2.1 time: 0.838019 Jul 31 01:38:52.796916 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2553/5110] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:51 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1167 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:38:53.672588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c64d03d7-19de-42d4-bf5e-748b907beccb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:53.673221 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c64d03d7-19de-42d4-bf5e-748b907beccb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:53.699013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c64d03d7-19de-42d4-bf5e-748b907beccb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:53.699521 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c64d03d7-19de-42d4-bf5e-748b907beccb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:53.700328 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c64d03d7-19de-42d4-bf5e-748b907beccb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:53.700924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c64d03d7-19de-42d4-bf5e-748b907beccb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:53.822581 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ca3791d5-6b53-44ec-9451-42d7a767126b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:53.823250 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ca3791d5-6b53-44ec-9451-42d7a767126b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:53.841813 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca3791d5-6b53-44ec-9451-42d7a767126b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:53.843832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca3791d5-6b53-44ec-9451-42d7a767126b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:53.845284 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca3791d5-6b53-44ec-9451-42d7a767126b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:53.845762 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca3791d5-6b53-44ec-9451-42d7a767126b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:54.675755 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ca3791d5-6b53-44ec-9451-42d7a767126b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:54.687985 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ca3791d5-6b53-44ec-9451-42d7a767126b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1167 microversion: 2.1 time: 0.869595 Jul 31 01:38:54.702113 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2554/5111] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:53 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1167 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:38:54.873696 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c64d03d7-19de-42d4-bf5e-748b907beccb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:54.888742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c64d03d7-19de-42d4-bf5e-748b907beccb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:54.890844 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c64d03d7-19de-42d4-bf5e-748b907beccb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:54.892118 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c64d03d7-19de-42d4-bf5e-748b907beccb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1737 microversion: 2.20 time: 1.224137 Jul 31 01:38:54.892701 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2558/5112] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:53 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1737 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:55.205878 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aad48f2f-8189-40b5-914b-0e7d2f83dccf tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1336545468", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "5d80f63a-0bfa-4bce-802f-06e05d3016eb"}, {"port": "8d439614-2d77-45c4-bece-37999557c985", "tag": "port-1"}, {"port": "5ad3e971-dbb2-4b55-9893-730ef94ad777", "tag": "port-2"}, {"uuid": "ceea4d5f-7949-4ef6-907d-83f33780c520", "tag": "net-1"}, {"uuid": "ceea4d5f-7949-4ef6-907d-83f33780c520"}, {"uuid": "8a0ae667-3fe8-43d5-b31b-b37440fc2565", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "8a0ae667-3fe8-43d5-b31b-b37440fc2565", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f47f6975-9b9b-444e-b7a2-305c6118ec08", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "8539b3f9-5efa-452a-a6a3-1b37099a76c7", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "60a5bd65-f3b2-46cb-8ed5-cc0489af03b8", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--785807712"}], "key_name": "tempest-keypair-1596123683", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:38:55.307442 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:38:55.672855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-aad48f2f-8189-40b5-914b-0e7d2f83dccf tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] validate_networks() for [('5d80f63a-0bfa-4bce-802f-06e05d3016eb', None, None, None, None, None), (None, None, '8d439614-2d77-45c4-bece-37999557c985', None, None, None), (None, None, '5ad3e971-dbb2-4b55-9893-730ef94ad777', None, None, None), ('ceea4d5f-7949-4ef6-907d-83f33780c520', None, None, None, None, None), ('ceea4d5f-7949-4ef6-907d-83f33780c520', None, None, None, None, None), ('8a0ae667-3fe8-43d5-b31b-b37440fc2565', '10.2.2.100', None, None, None, None), ('8a0ae667-3fe8-43d5-b31b-b37440fc2565', '10.2.2.200', None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:38:55.709312 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-40642f75-1018-4642-b613-64af7311e93d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:55.710003 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-40642f75-1018-4642-b613-64af7311e93d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:55.720632 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40642f75-1018-4642-b613-64af7311e93d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:55.721103 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40642f75-1018-4642-b613-64af7311e93d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:55.721901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40642f75-1018-4642-b613-64af7311e93d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:55.722355 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40642f75-1018-4642-b613-64af7311e93d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:56.453167 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-40642f75-1018-4642-b613-64af7311e93d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:56.468000 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-40642f75-1018-4642-b613-64af7311e93d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1167 microversion: 2.1 time: 0.762781 Jul 31 01:38:56.468957 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2559/5113] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:38:55 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1167 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:38:56.476281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-72f52486-7a00-4ddd-8c35-6d09c02c3221 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:38:56.485128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-72f52486-7a00-4ddd-8c35-6d09c02c3221 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:38:56.505090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72f52486-7a00-4ddd-8c35-6d09c02c3221 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:56.508334 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72f52486-7a00-4ddd-8c35-6d09c02c3221 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:56.509522 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72f52486-7a00-4ddd-8c35-6d09c02c3221 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:38:56.513403 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72f52486-7a00-4ddd-8c35-6d09c02c3221 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:38:57.498834 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-72f52486-7a00-4ddd-8c35-6d09c02c3221 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:57.516328 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-72f52486-7a00-4ddd-8c35-6d09c02c3221 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:57.518552 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-72f52486-7a00-4ddd-8c35-6d09c02c3221 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:38:57.529576 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-72f52486-7a00-4ddd-8c35-6d09c02c3221 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1737 microversion: 2.20 time: 1.057716 Jul 31 01:38:57.534782 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2560/5114] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:38:56 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1737 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:38:57.580442 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2fdcd464-86bf-454e-825d-87d507a7f74b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-36763335", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "0eceaee9-9f36-40ec-b873-4efd6687ab71"}], "key_name": "tempest-TestSecurityGroupsBasicOps-223026333", "security_groups": []}, "os:scheduler_hints": {"different_host": ["49debbf0-7cbe-453d-be83-f9a8082e297d"]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:38:57.732483 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-2fdcd464-86bf-454e-825d-87d507a7f74b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] validate_networks() for [('0eceaee9-9f36-40ec-b873-4efd6687ab71', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:39:00.354244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-2fdcd464-86bf-454e-825d-87d507a7f74b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:39:00.354782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-2fdcd464-86bf-454e-825d-87d507a7f74b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:39:00.355394 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-2fdcd464-86bf-454e-825d-87d507a7f74b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:39:00.355905 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-2fdcd464-86bf-454e-825d-87d507a7f74b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:39:00.356433 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-2fdcd464-86bf-454e-825d-87d507a7f74b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:39:00.366556 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2fdcd464-86bf-454e-825d-87d507a7f74b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:00.376614 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2fdcd464-86bf-454e-825d-87d507a7f74b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:00.380294 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2fdcd464-86bf-454e-825d-87d507a7f74b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:00.383967 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2fdcd464-86bf-454e-825d-87d507a7f74b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:00.496096 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-2fdcd464-86bf-454e-825d-87d507a7f74b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Getting quotas for project e91b99234bbf4863937cc25a97a1d4a9. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:39:00.516426 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-2fdcd464-86bf-454e-825d-87d507a7f74b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Getting quotas for user 0eea5af26928472d920a9cae8cd6131b and project e91b99234bbf4863937cc25a97a1d4a9. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:39:00.598386 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2fdcd464-86bf-454e-825d-87d507a7f74b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:39:00.606248 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2fdcd464-86bf-454e-825d-87d507a7f74b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:39:00.831687 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2fdcd464-86bf-454e-825d-87d507a7f74b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 3.267853 Jul 31 01:39:00.833795 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2561/5115] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:38:57 2022] POST /compute/v2.1/servers => generated 361 bytes in 3279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:39:00.864640 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-07fe9b09-9f09-4ab1-bc47-297558c13c03 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:00.867818 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-07fe9b09-9f09-4ab1-bc47-297558c13c03 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:00.886745 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07fe9b09-9f09-4ab1-bc47-297558c13c03 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:00.894859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07fe9b09-9f09-4ab1-bc47-297558c13c03 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:00.896025 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07fe9b09-9f09-4ab1-bc47-297558c13c03 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:00.896647 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07fe9b09-9f09-4ab1-bc47-297558c13c03 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:02.679893 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-07fe9b09-9f09-4ab1-bc47-297558c13c03 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:02.688337 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-07fe9b09-9f09-4ab1-bc47-297558c13c03 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1167 microversion: 2.1 time: 1.850769 Jul 31 01:39:02.688944 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2562/5116] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:00 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1167 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:02.717059 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9252ec16-8e6b-4133-817d-932ad098ee14 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:02.726977 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9252ec16-8e6b-4133-817d-932ad098ee14 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:02.738299 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9252ec16-8e6b-4133-817d-932ad098ee14 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:02.738760 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9252ec16-8e6b-4133-817d-932ad098ee14 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:02.739583 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9252ec16-8e6b-4133-817d-932ad098ee14 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:02.740027 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9252ec16-8e6b-4133-817d-932ad098ee14 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:03.470443 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9252ec16-8e6b-4133-817d-932ad098ee14 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:03.487717 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9252ec16-8e6b-4133-817d-932ad098ee14 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:03.489651 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9252ec16-8e6b-4133-817d-932ad098ee14 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:03.501119 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9252ec16-8e6b-4133-817d-932ad098ee14 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1737 microversion: 2.20 time: 0.791120 Jul 31 01:39:03.502318 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2563/5117] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:02 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1737 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:03.511470 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-170499eb-15f6-42a6-a141-1b06acf1f4e2 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:03.522456 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-170499eb-15f6-42a6-a141-1b06acf1f4e2 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:03.524738 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:03.544127 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-170499eb-15f6-42a6-a141-1b06acf1f4e2 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:03.544583 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-170499eb-15f6-42a6-a141-1b06acf1f4e2 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:03.545378 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-170499eb-15f6-42a6-a141-1b06acf1f4e2 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:03.552926 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-170499eb-15f6-42a6-a141-1b06acf1f4e2 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:04.033228 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-170499eb-15f6-42a6-a141-1b06acf1f4e2 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:04.042340 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-170499eb-15f6-42a6-a141-1b06acf1f4e2 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 200 len: 1297 microversion: 2.1 time: 0.534651 Jul 31 01:39:04.053036 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2564/5118] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:03 2022] GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 1297 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:04.070590 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8902eae2-ae84-49f1-b1b0-8b90ed5c0532 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:04.071592 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8902eae2-ae84-49f1-b1b0-8b90ed5c0532 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:04.091036 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8902eae2-ae84-49f1-b1b0-8b90ed5c0532 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:04.091945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8902eae2-ae84-49f1-b1b0-8b90ed5c0532 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:04.092908 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8902eae2-ae84-49f1-b1b0-8b90ed5c0532 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:04.094894 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8902eae2-ae84-49f1-b1b0-8b90ed5c0532 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:04.682920 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:04.760561 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8902eae2-ae84-49f1-b1b0-8b90ed5c0532 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:04.769399 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8902eae2-ae84-49f1-b1b0-8b90ed5c0532 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1201 microversion: 2.1 time: 0.707883 Jul 31 01:39:04.781365 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2565/5119] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:04 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1201 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:04.797542 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-df66f5e3-6e02-4990-a4a1-d1be40deb9dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:04.812684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-df66f5e3-6e02-4990-a4a1-d1be40deb9dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:04.834850 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df66f5e3-6e02-4990-a4a1-d1be40deb9dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:04.846924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df66f5e3-6e02-4990-a4a1-d1be40deb9dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:04.856860 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df66f5e3-6e02-4990-a4a1-d1be40deb9dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:04.864707 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df66f5e3-6e02-4990-a4a1-d1be40deb9dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:05.781275 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-df66f5e3-6e02-4990-a4a1-d1be40deb9dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:05.806813 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-aad48f2f-8189-40b5-914b-0e7d2f83dccf tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:39:05.817332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-aad48f2f-8189-40b5-914b-0e7d2f83dccf tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:39:05.819143 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-aad48f2f-8189-40b5-914b-0e7d2f83dccf tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:39:05.819822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-aad48f2f-8189-40b5-914b-0e7d2f83dccf tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:39:05.820423 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-aad48f2f-8189-40b5-914b-0e7d2f83dccf tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:39:05.824705 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-df66f5e3-6e02-4990-a4a1-d1be40deb9dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:05.826556 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-df66f5e3-6e02-4990-a4a1-d1be40deb9dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:05.850481 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-df66f5e3-6e02-4990-a4a1-d1be40deb9dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1737 microversion: 2.20 time: 1.044959 Jul 31 01:39:05.853100 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aad48f2f-8189-40b5-914b-0e7d2f83dccf tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:05.870537 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aad48f2f-8189-40b5-914b-0e7d2f83dccf tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:05.887503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aad48f2f-8189-40b5-914b-0e7d2f83dccf tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:05.892023 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aad48f2f-8189-40b5-914b-0e7d2f83dccf tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:05.893690 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2566/5120] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:04 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1737 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:05.929956 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-baa2fb03-3d78-4399-9940-0d747a4b90b0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:05.935976 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-baa2fb03-3d78-4399-9940-0d747a4b90b0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:05.975819 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-aad48f2f-8189-40b5-914b-0e7d2f83dccf tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Getting quotas for project f08c4f1ed40d49f9844841b0ee4c2817. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:39:05.988025 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-baa2fb03-3d78-4399-9940-0d747a4b90b0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:05.992657 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-aad48f2f-8189-40b5-914b-0e7d2f83dccf tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Getting quotas for user 96d6f69a3f9f4a3eb556593e124232d2 and project f08c4f1ed40d49f9844841b0ee4c2817. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:39:05.994263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-baa2fb03-3d78-4399-9940-0d747a4b90b0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:05.997653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-baa2fb03-3d78-4399-9940-0d747a4b90b0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:06.001605 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-baa2fb03-3d78-4399-9940-0d747a4b90b0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:06.318368 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-baa2fb03-3d78-4399-9940-0d747a4b90b0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:06.328708 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-baa2fb03-3d78-4399-9940-0d747a4b90b0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 200 len: 1297 microversion: 2.1 time: 0.432603 Jul 31 01:39:06.345537 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2567/5121] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:05 2022] GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 1297 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:06.350306 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-11c30c6c-55c9-40b4-8142-f18aca4ec5e7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:06.356918 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-11c30c6c-55c9-40b4-8142-f18aca4ec5e7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:06.373898 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-11c30c6c-55c9-40b4-8142-f18aca4ec5e7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:06.374915 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-11c30c6c-55c9-40b4-8142-f18aca4ec5e7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:06.381383 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-11c30c6c-55c9-40b4-8142-f18aca4ec5e7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:06.382675 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-11c30c6c-55c9-40b4-8142-f18aca4ec5e7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:06.520109 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aad48f2f-8189-40b5-914b-0e7d2f83dccf tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:39:06.523875 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aad48f2f-8189-40b5-914b-0e7d2f83dccf tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f47f6975-9b9b-444e-b7a2-305c6118ec08',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='8539b3f9-5efa-452a-a6a3-1b37099a76c7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='60a5bd65-f3b2-46cb-8ed5-cc0489af03b8',volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:39:06.957204 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-11c30c6c-55c9-40b4-8142-f18aca4ec5e7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:06.967419 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-11c30c6c-55c9-40b4-8142-f18aca4ec5e7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1201 microversion: 2.1 time: 0.620661 Jul 31 01:39:06.972542 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2568/5122] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:06 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1201 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:06.984572 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c5566159-8257-4a6c-8668-fc4f0b59bf4c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:06.985548 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c5566159-8257-4a6c-8668-fc4f0b59bf4c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:07.000186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5566159-8257-4a6c-8668-fc4f0b59bf4c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:07.002898 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5566159-8257-4a6c-8668-fc4f0b59bf4c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:07.004297 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5566159-8257-4a6c-8668-fc4f0b59bf4c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:07.006252 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5566159-8257-4a6c-8668-fc4f0b59bf4c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:07.456693 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c5566159-8257-4a6c-8668-fc4f0b59bf4c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:07.472865 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c5566159-8257-4a6c-8668-fc4f0b59bf4c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:07.481971 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aad48f2f-8189-40b5-914b-0e7d2f83dccf tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 12.279117 Jul 31 01:39:07.487869 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c5566159-8257-4a6c-8668-fc4f0b59bf4c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:07.488369 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2555/5123] 10.222.0.45 () {62 vars in 1189 bytes} [Sun Jul 31 01:38:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 12287 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 01:39:07.495603 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c5566159-8257-4a6c-8668-fc4f0b59bf4c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1737 microversion: 2.20 time: 0.520534 Jul 31 01:39:07.498387 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2569/5124] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:06 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1737 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:07.501007 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0a13e5e8-4ce3-4c56-8ffd-407f34744e4e tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:07.504389 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0a13e5e8-4ce3-4c56-8ffd-407f34744e4e tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:07.519025 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a13e5e8-4ce3-4c56-8ffd-407f34744e4e tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:07.519850 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a13e5e8-4ce3-4c56-8ffd-407f34744e4e tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:07.522049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a13e5e8-4ce3-4c56-8ffd-407f34744e4e tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:07.522966 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a13e5e8-4ce3-4c56-8ffd-407f34744e4e tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:07.523504 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b749aa97-478a-49dd-b55a-ddb38932db7f tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:07.524177 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b749aa97-478a-49dd-b55a-ddb38932db7f tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:07.748855 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b749aa97-478a-49dd-b55a-ddb38932db7f tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:07.762217 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b749aa97-478a-49dd-b55a-ddb38932db7f tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:07.763874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b749aa97-478a-49dd-b55a-ddb38932db7f tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:07.765126 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b749aa97-478a-49dd-b55a-ddb38932db7f tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1286 microversion: 2.42 time: 0.262785 Jul 31 01:39:07.765707 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2570/5125] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:07 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1286 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:07.786290 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-935310eb-0322-48ba-a8e5-8f9754e9b79d req-012bfe8d-dde8-46d6-8813-5b485d937af2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a1fd7b-4172-42ad-826b-60c5f38f4499", "tag": "7e16ea30-5a28-4fa5-b4d7-73f31840b609"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:07.840370 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-935310eb-0322-48ba-a8e5-8f9754e9b79d req-012bfe8d-dde8-46d6-8813-5b485d937af2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:07.850261 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-935310eb-0322-48ba-a8e5-8f9754e9b79d req-012bfe8d-dde8-46d6-8813-5b485d937af2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:07.883041 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-935310eb-0322-48ba-a8e5-8f9754e9b79d req-012bfe8d-dde8-46d6-8813-5b485d937af2 service nova] Creating event network-changed:7e16ea30-5a28-4fa5-b4d7-73f31840b609 for instance b2a1fd7b-4172-42ad-826b-60c5f38f4499 on n-h2-master-1 Jul 31 01:39:07.932613 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-935310eb-0322-48ba-a8e5-8f9754e9b79d req-012bfe8d-dde8-46d6-8813-5b485d937af2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149832 Jul 31 01:39:07.938930 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2571/5126] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:07.995309 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-deaec942-9c9f-4e3f-84a3-0af9af01a347 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:07.996080 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-deaec942-9c9f-4e3f-84a3-0af9af01a347 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:08.011211 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-deaec942-9c9f-4e3f-84a3-0af9af01a347 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:08.011935 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-deaec942-9c9f-4e3f-84a3-0af9af01a347 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:08.016172 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-deaec942-9c9f-4e3f-84a3-0af9af01a347 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:08.016850 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-deaec942-9c9f-4e3f-84a3-0af9af01a347 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:08.513845 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0a13e5e8-4ce3-4c56-8ffd-407f34744e4e tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:08.526650 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0a13e5e8-4ce3-4c56-8ffd-407f34744e4e tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 200 len: 1297 microversion: 2.1 time: 1.036970 Jul 31 01:39:08.543678 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2556/5127] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:07 2022] GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 1297 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:08.573481 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c9986c5-a4f3-44c6-8600-68e9af939bd8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:08.574762 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2c9986c5-a4f3-44c6-8600-68e9af939bd8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:08.593280 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c9986c5-a4f3-44c6-8600-68e9af939bd8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:08.593962 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c9986c5-a4f3-44c6-8600-68e9af939bd8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:08.594909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c9986c5-a4f3-44c6-8600-68e9af939bd8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:08.595530 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c9986c5-a4f3-44c6-8600-68e9af939bd8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:08.995270 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-deaec942-9c9f-4e3f-84a3-0af9af01a347 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:09.005909 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-deaec942-9c9f-4e3f-84a3-0af9af01a347 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1201 microversion: 2.1 time: 1.017241 Jul 31 01:39:09.014123 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2572/5128] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:07 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1201 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:09.028951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0044c95c-0934-4ae8-9d8b-a5dd04f916b8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:09.033911 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0044c95c-0934-4ae8-9d8b-a5dd04f916b8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:09.265463 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0044c95c-0934-4ae8-9d8b-a5dd04f916b8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:09.274336 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0044c95c-0934-4ae8-9d8b-a5dd04f916b8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:09.276259 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2c9986c5-a4f3-44c6-8600-68e9af939bd8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:09.286073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0044c95c-0934-4ae8-9d8b-a5dd04f916b8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:09.289418 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2c9986c5-a4f3-44c6-8600-68e9af939bd8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:09.291867 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0044c95c-0934-4ae8-9d8b-a5dd04f916b8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1286 microversion: 2.42 time: 0.271918 Jul 31 01:39:09.294341 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2c9986c5-a4f3-44c6-8600-68e9af939bd8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:09.295949 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2c9986c5-a4f3-44c6-8600-68e9af939bd8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1737 microversion: 2.20 time: 0.750998 Jul 31 01:39:09.299893 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2573/5129] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:09 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1286 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:09.302061 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2557/5130] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:08 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1737 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:09.569540 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-faa65e87-9507-41f9-8ef6-b4aad34dab7b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:09.570412 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-faa65e87-9507-41f9-8ef6-b4aad34dab7b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:09.582310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-faa65e87-9507-41f9-8ef6-b4aad34dab7b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:09.589728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-faa65e87-9507-41f9-8ef6-b4aad34dab7b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:09.590806 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-faa65e87-9507-41f9-8ef6-b4aad34dab7b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:09.591467 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-faa65e87-9507-41f9-8ef6-b4aad34dab7b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:09.845720 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-faa65e87-9507-41f9-8ef6-b4aad34dab7b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:09.880686 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-faa65e87-9507-41f9-8ef6-b4aad34dab7b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 200 len: 1297 microversion: 2.1 time: 0.315232 Jul 31 01:39:09.881323 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2574/5131] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:09 2022] GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 1297 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:09.986257 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c40e9bb2-4e5b-4ed7-9cc6-9a455604ffbd tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:09.987669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c40e9bb2-4e5b-4ed7-9cc6-9a455604ffbd tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:10.022337 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c40e9bb2-4e5b-4ed7-9cc6-9a455604ffbd tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:10.022793 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c40e9bb2-4e5b-4ed7-9cc6-9a455604ffbd tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:10.023811 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c40e9bb2-4e5b-4ed7-9cc6-9a455604ffbd tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:10.027031 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c40e9bb2-4e5b-4ed7-9cc6-9a455604ffbd tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:10.033052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ebec8613-e6ca-4c4d-800b-fd9c95ee59af tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:10.033809 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ebec8613-e6ca-4c4d-800b-fd9c95ee59af tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:10.045111 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ebec8613-e6ca-4c4d-800b-fd9c95ee59af tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:10.047625 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ebec8613-e6ca-4c4d-800b-fd9c95ee59af tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:10.050574 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ebec8613-e6ca-4c4d-800b-fd9c95ee59af tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:10.051821 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ebec8613-e6ca-4c4d-800b-fd9c95ee59af tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:10.165598 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-c40e9bb2-4e5b-4ed7-9cc6-9a455604ffbd tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lazy-loading 'services' on Instance uuid 7838837f-88cb-47ca-80ee-aa8b88fee0ab {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:39:10.275295 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c40e9bb2-4e5b-4ed7-9cc6-9a455604ffbd tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab/os-volume_attachments/fb204551-fd0d-4a76-9e73-2d13cbee99de" status: 202 len: 0 microversion: 2.1 time: 0.297686 Jul 31 01:39:10.278073 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2558/5132] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 01:39:09 2022] DELETE /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab/os-volume_attachments/fb204551-fd0d-4a76-9e73-2d13cbee99de => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:39:10.322856 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2b99ea53-2438-4e1b-a4bf-6909123d2a7d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:10.323896 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2b99ea53-2438-4e1b-a4bf-6909123d2a7d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:10.344456 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ebec8613-e6ca-4c4d-800b-fd9c95ee59af tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:10.372921 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ebec8613-e6ca-4c4d-800b-fd9c95ee59af tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1201 microversion: 2.1 time: 0.346485 Jul 31 01:39:10.375639 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b99ea53-2438-4e1b-a4bf-6909123d2a7d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:10.376218 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b99ea53-2438-4e1b-a4bf-6909123d2a7d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:10.377542 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b99ea53-2438-4e1b-a4bf-6909123d2a7d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:10.378504 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2575/5133] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:10 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1201 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:10.381202 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b99ea53-2438-4e1b-a4bf-6909123d2a7d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:10.393024 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-60def1ac-e13b-4480-bb20-27cba20ad864 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:10.394180 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-60def1ac-e13b-4480-bb20-27cba20ad864 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:10.414219 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-60def1ac-e13b-4480-bb20-27cba20ad864 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:10.416242 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-60def1ac-e13b-4480-bb20-27cba20ad864 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:10.418245 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-60def1ac-e13b-4480-bb20-27cba20ad864 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:10.420149 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-60def1ac-e13b-4480-bb20-27cba20ad864 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:10.477730 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:10.477730 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:10.522392 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2b99ea53-2438-4e1b-a4bf-6909123d2a7d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:10.540228 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2b99ea53-2438-4e1b-a4bf-6909123d2a7d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:10.544868 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2b99ea53-2438-4e1b-a4bf-6909123d2a7d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:10.547488 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2b99ea53-2438-4e1b-a4bf-6909123d2a7d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1576 microversion: 2.42 time: 0.232394 Jul 31 01:39:10.559432 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2559/5134] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:10 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1576 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:10.768764 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-60def1ac-e13b-4480-bb20-27cba20ad864 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:10.777389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-60def1ac-e13b-4480-bb20-27cba20ad864 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:10.778929 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-60def1ac-e13b-4480-bb20-27cba20ad864 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:10.788502 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-60def1ac-e13b-4480-bb20-27cba20ad864 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1737 microversion: 2.20 time: 0.408615 Jul 31 01:39:10.789110 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2576/5135] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:10 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1737 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:10.903080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f98c678-9362-440b-8a8e-9cd49b390838 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:10.904054 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6f98c678-9362-440b-8a8e-9cd49b390838 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:10.918351 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f98c678-9362-440b-8a8e-9cd49b390838 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:10.922228 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f98c678-9362-440b-8a8e-9cd49b390838 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:10.926422 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f98c678-9362-440b-8a8e-9cd49b390838 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:10.927487 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f98c678-9362-440b-8a8e-9cd49b390838 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:11.160589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6f98c678-9362-440b-8a8e-9cd49b390838 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:11.176049 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6f98c678-9362-440b-8a8e-9cd49b390838 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 200 len: 1297 microversion: 2.1 time: 0.278410 Jul 31 01:39:11.176639 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2560/5136] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:10 2022] GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 1297 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:11.400800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-784053fb-2c25-41af-9187-ab227ce6a2b4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:11.402225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-784053fb-2c25-41af-9187-ab227ce6a2b4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:11.417993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-784053fb-2c25-41af-9187-ab227ce6a2b4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:11.419299 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-784053fb-2c25-41af-9187-ab227ce6a2b4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:11.421874 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-784053fb-2c25-41af-9187-ab227ce6a2b4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:11.422764 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-784053fb-2c25-41af-9187-ab227ce6a2b4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:11.588345 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1fc365b5-2ddb-4dd8-bc70-8c65fc7787d2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:11.589317 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1fc365b5-2ddb-4dd8-bc70-8c65fc7787d2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:11.612827 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fc365b5-2ddb-4dd8-bc70-8c65fc7787d2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:11.617309 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fc365b5-2ddb-4dd8-bc70-8c65fc7787d2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:11.618517 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fc365b5-2ddb-4dd8-bc70-8c65fc7787d2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:11.622478 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fc365b5-2ddb-4dd8-bc70-8c65fc7787d2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:12.069202 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1fc365b5-2ddb-4dd8-bc70-8c65fc7787d2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:12.083125 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1fc365b5-2ddb-4dd8-bc70-8c65fc7787d2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:12.094202 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1fc365b5-2ddb-4dd8-bc70-8c65fc7787d2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:12.095536 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1fc365b5-2ddb-4dd8-bc70-8c65fc7787d2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1594 microversion: 2.42 time: 0.521796 Jul 31 01:39:12.096915 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-784053fb-2c25-41af-9187-ab227ce6a2b4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:12.100725 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2561/5137] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:11 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1594 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:39:12.110971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-496c0b19-b21b-4367-a733-7122faf4ff10 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:12.111875 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-496c0b19-b21b-4367-a733-7122faf4ff10 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:12.123309 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-784053fb-2c25-41af-9187-ab227ce6a2b4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1201 microversion: 2.1 time: 0.727121 Jul 31 01:39:12.129890 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2577/5138] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:11 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1201 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:12.130915 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-496c0b19-b21b-4367-a733-7122faf4ff10 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:12.131396 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-496c0b19-b21b-4367-a733-7122faf4ff10 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:12.132188 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-496c0b19-b21b-4367-a733-7122faf4ff10 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:12.134672 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-496c0b19-b21b-4367-a733-7122faf4ff10 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:12.205537 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-53e423b1-e046-4ba0-ba0b-47587092f0af tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:12.214495 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-53e423b1-e046-4ba0-ba0b-47587092f0af tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:12.242591 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53e423b1-e046-4ba0-ba0b-47587092f0af tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:12.245990 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53e423b1-e046-4ba0-ba0b-47587092f0af tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:12.249193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53e423b1-e046-4ba0-ba0b-47587092f0af tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:12.252111 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53e423b1-e046-4ba0-ba0b-47587092f0af tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:12.638439 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-53e423b1-e046-4ba0-ba0b-47587092f0af tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:12.659184 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-53e423b1-e046-4ba0-ba0b-47587092f0af tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 200 len: 1297 microversion: 2.1 time: 0.459608 Jul 31 01:39:12.660893 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2578/5139] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:12 2022] GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 1297 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:39:12.724857 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-496c0b19-b21b-4367-a733-7122faf4ff10 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:12.741915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-496c0b19-b21b-4367-a733-7122faf4ff10 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:12.743590 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-496c0b19-b21b-4367-a733-7122faf4ff10 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:12.744872 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-496c0b19-b21b-4367-a733-7122faf4ff10 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1737 microversion: 2.20 time: 0.642967 Jul 31 01:39:12.745459 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2562/5140] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:12 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1737 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:13.127230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ba758690-0543-4889-ab35-164f723a9fd3 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:13.128452 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ba758690-0543-4889-ab35-164f723a9fd3 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:13.149142 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dc510cb1-2ac0-40a9-9f6c-98a973639a98 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:13.150089 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dc510cb1-2ac0-40a9-9f6c-98a973639a98 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:13.169113 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dc510cb1-2ac0-40a9-9f6c-98a973639a98 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:13.173082 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dc510cb1-2ac0-40a9-9f6c-98a973639a98 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:13.176784 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ba758690-0543-4889-ab35-164f723a9fd3 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:13.181670 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ba758690-0543-4889-ab35-164f723a9fd3 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:13.181997 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dc510cb1-2ac0-40a9-9f6c-98a973639a98 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:13.183835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dc510cb1-2ac0-40a9-9f6c-98a973639a98 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:13.185488 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ba758690-0543-4889-ab35-164f723a9fd3 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:13.188236 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ba758690-0543-4889-ab35-164f723a9fd3 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:13.808137 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ba758690-0543-4889-ab35-164f723a9fd3 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:13.822758 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ba758690-0543-4889-ab35-164f723a9fd3 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:13.824315 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ba758690-0543-4889-ab35-164f723a9fd3 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:13.848436 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ba758690-0543-4889-ab35-164f723a9fd3 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1661 microversion: 2.42 time: 0.725989 Jul 31 01:39:13.851509 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2579/5141] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:13 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1661 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:13.870083 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b3f18ed9-82d5-45d3-9685-490938ca4e32 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:13.870710 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b3f18ed9-82d5-45d3-9685-490938ca4e32 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:13.901373 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3f18ed9-82d5-45d3-9685-490938ca4e32 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:13.904525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3f18ed9-82d5-45d3-9685-490938ca4e32 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:13.907767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3f18ed9-82d5-45d3-9685-490938ca4e32 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:13.911530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3f18ed9-82d5-45d3-9685-490938ca4e32 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:14.064390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dc510cb1-2ac0-40a9-9f6c-98a973639a98 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:14.072834 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dc510cb1-2ac0-40a9-9f6c-98a973639a98 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1201 microversion: 2.1 time: 0.927920 Jul 31 01:39:14.076118 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2563/5142] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:13 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1201 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:39:14.096297 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f72b730b-ad31-4c6a-938a-3391e622a427 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:14.097376 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f72b730b-ad31-4c6a-938a-3391e622a427 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:14.120907 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f72b730b-ad31-4c6a-938a-3391e622a427 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:14.121362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f72b730b-ad31-4c6a-938a-3391e622a427 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:14.122241 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f72b730b-ad31-4c6a-938a-3391e622a427 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:14.122584 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f72b730b-ad31-4c6a-938a-3391e622a427 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:14.204014 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b3f18ed9-82d5-45d3-9685-490938ca4e32 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:14.214368 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b3f18ed9-82d5-45d3-9685-490938ca4e32 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 200 len: 1297 microversion: 2.1 time: 0.361299 Jul 31 01:39:14.215232 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2580/5143] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:13 2022] GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 1297 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:14.614597 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f72b730b-ad31-4c6a-938a-3391e622a427 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:14.628674 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f72b730b-ad31-4c6a-938a-3391e622a427 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:14.631697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f72b730b-ad31-4c6a-938a-3391e622a427 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:14.637371 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f72b730b-ad31-4c6a-938a-3391e622a427 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1737 microversion: 2.20 time: 0.559875 Jul 31 01:39:14.640785 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2564/5144] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:14 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1737 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:14.879131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2cb6f43b-0de2-498d-bea8-2ec54bcbdb3a tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:14.879980 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2cb6f43b-0de2-498d-bea8-2ec54bcbdb3a tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:14.888210 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cb6f43b-0de2-498d-bea8-2ec54bcbdb3a tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:14.897184 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cb6f43b-0de2-498d-bea8-2ec54bcbdb3a tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:14.898346 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cb6f43b-0de2-498d-bea8-2ec54bcbdb3a tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:14.900007 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cb6f43b-0de2-498d-bea8-2ec54bcbdb3a tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:15.095180 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ea70d6e5-5e03-430c-98c3-7bd6504cb277 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:15.096485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ea70d6e5-5e03-430c-98c3-7bd6504cb277 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:15.115000 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ea70d6e5-5e03-430c-98c3-7bd6504cb277 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:15.115497 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ea70d6e5-5e03-430c-98c3-7bd6504cb277 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:15.116291 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ea70d6e5-5e03-430c-98c3-7bd6504cb277 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:15.116860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ea70d6e5-5e03-430c-98c3-7bd6504cb277 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:15.473703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2cb6f43b-0de2-498d-bea8-2ec54bcbdb3a tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:15.493896 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2cb6f43b-0de2-498d-bea8-2ec54bcbdb3a tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:15.495874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2cb6f43b-0de2-498d-bea8-2ec54bcbdb3a tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:15.497239 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2cb6f43b-0de2-498d-bea8-2ec54bcbdb3a tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1661 microversion: 2.42 time: 0.622884 Jul 31 01:39:15.498307 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2581/5145] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:14 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1661 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:15.504948 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-31098553-f378-417b-8937-15d96b1c2aa4 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:15.505777 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-31098553-f378-417b-8937-15d96b1c2aa4 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:15.513524 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31098553-f378-417b-8937-15d96b1c2aa4 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:15.514193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31098553-f378-417b-8937-15d96b1c2aa4 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:15.515809 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31098553-f378-417b-8937-15d96b1c2aa4 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:15.516452 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31098553-f378-417b-8937-15d96b1c2aa4 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:15.883686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ea70d6e5-5e03-430c-98c3-7bd6504cb277 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:15.895003 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ea70d6e5-5e03-430c-98c3-7bd6504cb277 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1201 microversion: 2.1 time: 0.804114 Jul 31 01:39:15.930476 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2565/5146] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:15 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1201 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:15.932175 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-31098553-f378-417b-8937-15d96b1c2aa4 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:15.938967 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-31098553-f378-417b-8937-15d96b1c2aa4 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 200 len: 1297 microversion: 2.1 time: 0.439314 Jul 31 01:39:15.941042 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2582/5147] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:15 2022] GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 1297 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:15.947664 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-73e332ad-3530-4844-ad2e-629d9330f5ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:15.950553 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-73e332ad-3530-4844-ad2e-629d9330f5ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:15.973571 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:15.979801 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73e332ad-3530-4844-ad2e-629d9330f5ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:15.981676 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73e332ad-3530-4844-ad2e-629d9330f5ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:15.983950 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73e332ad-3530-4844-ad2e-629d9330f5ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:15.987515 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73e332ad-3530-4844-ad2e-629d9330f5ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:16.029000 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:16.451513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-d295740b-8d70-4a28-93bb-fb851ad1c189 req-1529d25d-2c74-4b74-bccf-86d8a81f9a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a1fd7b-4172-42ad-826b-60c5f38f4499", "name": "network-vif-plugged", "status": "completed", "tag": "7e16ea30-5a28-4fa5-b4d7-73f31840b609"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:16.476260 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d295740b-8d70-4a28-93bb-fb851ad1c189 req-1529d25d-2c74-4b74-bccf-86d8a81f9a7b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:16.476843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d295740b-8d70-4a28-93bb-fb851ad1c189 req-1529d25d-2c74-4b74-bccf-86d8a81f9a7b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:16.503595 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-d295740b-8d70-4a28-93bb-fb851ad1c189 req-1529d25d-2c74-4b74-bccf-86d8a81f9a7b service nova] Creating event network-vif-plugged:7e16ea30-5a28-4fa5-b4d7-73f31840b609 for instance b2a1fd7b-4172-42ad-826b-60c5f38f4499 on n-h2-master-1 Jul 31 01:39:16.519775 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-d295740b-8d70-4a28-93bb-fb851ad1c189 req-1529d25d-2c74-4b74-bccf-86d8a81f9a7b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070467 Jul 31 01:39:16.524664 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2583/5148] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:16.550488 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b41331df-7be6-4a38-aa54-7efb258c1ce9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:16.556911 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b41331df-7be6-4a38-aa54-7efb258c1ce9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:16.574585 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b41331df-7be6-4a38-aa54-7efb258c1ce9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:16.575057 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b41331df-7be6-4a38-aa54-7efb258c1ce9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:16.579355 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b41331df-7be6-4a38-aa54-7efb258c1ce9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:16.582394 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b41331df-7be6-4a38-aa54-7efb258c1ce9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:16.679266 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-73e332ad-3530-4844-ad2e-629d9330f5ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:16.695305 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-73e332ad-3530-4844-ad2e-629d9330f5ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:16.708442 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-73e332ad-3530-4844-ad2e-629d9330f5ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:16.715264 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-73e332ad-3530-4844-ad2e-629d9330f5ef tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1719 microversion: 2.20 time: 0.793080 Jul 31 01:39:16.715918 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2566/5149] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:15 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1719 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:16.947608 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e2cdae6f-02ae-41ce-8a0e-532c4db4583f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:16.948329 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e2cdae6f-02ae-41ce-8a0e-532c4db4583f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:16.965835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2cdae6f-02ae-41ce-8a0e-532c4db4583f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:16.966305 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2cdae6f-02ae-41ce-8a0e-532c4db4583f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:16.967623 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2cdae6f-02ae-41ce-8a0e-532c4db4583f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:16.973727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2cdae6f-02ae-41ce-8a0e-532c4db4583f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:17.767576 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b41331df-7be6-4a38-aa54-7efb258c1ce9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:17.784867 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b41331df-7be6-4a38-aa54-7efb258c1ce9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:17.787951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b41331df-7be6-4a38-aa54-7efb258c1ce9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:17.791079 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b41331df-7be6-4a38-aa54-7efb258c1ce9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1707 microversion: 2.42 time: 1.264660 Jul 31 01:39:17.793619 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2584/5150] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:16 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1707 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:17.802099 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a22c3462-9456-4130-9d81-b276290e35a6 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:17.803896 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a22c3462-9456-4130-9d81-b276290e35a6 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:17.823832 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a22c3462-9456-4130-9d81-b276290e35a6 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:17.825324 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a22c3462-9456-4130-9d81-b276290e35a6 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:17.831366 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a22c3462-9456-4130-9d81-b276290e35a6 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:17.832213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a22c3462-9456-4130-9d81-b276290e35a6 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:17.842514 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e2cdae6f-02ae-41ce-8a0e-532c4db4583f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:17.860464 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e2cdae6f-02ae-41ce-8a0e-532c4db4583f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1201 microversion: 2.1 time: 0.922858 Jul 31 01:39:17.861858 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2567/5151] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:16 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1201 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:17.877887 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2d1985c6-29ed-4ecc-8c10-ae7452171ab1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:17.880427 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2d1985c6-29ed-4ecc-8c10-ae7452171ab1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:17.906447 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d1985c6-29ed-4ecc-8c10-ae7452171ab1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:17.907850 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d1985c6-29ed-4ecc-8c10-ae7452171ab1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:17.908981 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d1985c6-29ed-4ecc-8c10-ae7452171ab1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:17.909657 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d1985c6-29ed-4ecc-8c10-ae7452171ab1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:18.188828 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a22c3462-9456-4130-9d81-b276290e35a6 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:18.197274 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a22c3462-9456-4130-9d81-b276290e35a6 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 200 len: 1297 microversion: 2.1 time: 0.402346 Jul 31 01:39:18.214213 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2585/5152] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:17 2022] GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 1297 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:18.407643 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2d1985c6-29ed-4ecc-8c10-ae7452171ab1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:18.414180 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2d1985c6-29ed-4ecc-8c10-ae7452171ab1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:18.417863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2d1985c6-29ed-4ecc-8c10-ae7452171ab1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:18.420879 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2d1985c6-29ed-4ecc-8c10-ae7452171ab1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1719 microversion: 2.20 time: 0.556548 Jul 31 01:39:18.441239 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2568/5153] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:17 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1719 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:18.600714 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-ab2cff5c-1031-4b03-bd98-46cdfd7bb877 req-e8906db0-a4ea-46b3-bac9-49d7c0e66a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254edd9c-2684-432f-bfd7-e8a2342c66fd", "name": "network-vif-plugged", "status": "completed", "tag": "22e379ec-5d6e-401a-b245-dcb4299f6177"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:18.631493 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ab2cff5c-1031-4b03-bd98-46cdfd7bb877 req-e8906db0-a4ea-46b3-bac9-49d7c0e66a9c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:18.632293 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ab2cff5c-1031-4b03-bd98-46cdfd7bb877 req-e8906db0-a4ea-46b3-bac9-49d7c0e66a9c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:18.663117 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-ab2cff5c-1031-4b03-bd98-46cdfd7bb877 req-e8906db0-a4ea-46b3-bac9-49d7c0e66a9c service nova] Creating event network-vif-plugged:22e379ec-5d6e-401a-b245-dcb4299f6177 for instance 254edd9c-2684-432f-bfd7-e8a2342c66fd on n-h2-master-1 Jul 31 01:39:18.675885 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-ab2cff5c-1031-4b03-bd98-46cdfd7bb877 req-e8906db0-a4ea-46b3-bac9-49d7c0e66a9c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079777 Jul 31 01:39:18.677791 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2586/5154] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:18.819930 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-79e6d976-d0c3-48a4-a63f-6451eb456820 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:18.825274 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-79e6d976-d0c3-48a4-a63f-6451eb456820 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:18.852190 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79e6d976-d0c3-48a4-a63f-6451eb456820 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:18.853158 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79e6d976-d0c3-48a4-a63f-6451eb456820 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:18.854008 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79e6d976-d0c3-48a4-a63f-6451eb456820 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:18.862757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79e6d976-d0c3-48a4-a63f-6451eb456820 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:18.885453 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-18ec041e-2cfb-463e-bf30-22c82a7a9bb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:18.886923 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-18ec041e-2cfb-463e-bf30-22c82a7a9bb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:18.902473 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18ec041e-2cfb-463e-bf30-22c82a7a9bb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:18.903716 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18ec041e-2cfb-463e-bf30-22c82a7a9bb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:18.906800 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18ec041e-2cfb-463e-bf30-22c82a7a9bb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:18.907274 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18ec041e-2cfb-463e-bf30-22c82a7a9bb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:19.272810 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=10 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:19.549480 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-79e6d976-d0c3-48a4-a63f-6451eb456820 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:19.564280 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-79e6d976-d0c3-48a4-a63f-6451eb456820 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:19.566413 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-79e6d976-d0c3-48a4-a63f-6451eb456820 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:19.573837 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-79e6d976-d0c3-48a4-a63f-6451eb456820 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1753 microversion: 2.42 time: 0.757330 Jul 31 01:39:19.574575 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2569/5155] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:18 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1753 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:19.588681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-18ec041e-2cfb-463e-bf30-22c82a7a9bb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:19.599148 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d6910c2a-6361-47be-ad86-6ce91b199708 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:19.600844 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d6910c2a-6361-47be-ad86-6ce91b199708 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:19.603095 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-18ec041e-2cfb-463e-bf30-22c82a7a9bb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1201 microversion: 2.1 time: 0.722333 Jul 31 01:39:19.608993 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2587/5156] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:18 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1201 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:39:19.622312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6910c2a-6361-47be-ad86-6ce91b199708 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:19.626169 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6910c2a-6361-47be-ad86-6ce91b199708 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:19.628879 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6910c2a-6361-47be-ad86-6ce91b199708 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:19.629401 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-52d962fc-3d36-4504-a015-0240c5712c63 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:19.630018 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d6910c2a-6361-47be-ad86-6ce91b199708 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:19.631257 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-52d962fc-3d36-4504-a015-0240c5712c63 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:19.663484 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52d962fc-3d36-4504-a015-0240c5712c63 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:19.664368 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52d962fc-3d36-4504-a015-0240c5712c63 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:19.665471 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52d962fc-3d36-4504-a015-0240c5712c63 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:19.666449 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52d962fc-3d36-4504-a015-0240c5712c63 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:19.727187 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-52d962fc-3d36-4504-a015-0240c5712c63 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:39:19.901479 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-52d962fc-3d36-4504-a015-0240c5712c63 tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab" status: 204 len: 0 microversion: 2.1 time: 0.290488 Jul 31 01:39:19.906788 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2588/5157] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:39:19 2022] DELETE /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:39:19.931752 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ecfd0e87-7a28-42b1-8ba2-30f7d062983a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:19.932833 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ecfd0e87-7a28-42b1-8ba2-30f7d062983a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:19.947573 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecfd0e87-7a28-42b1-8ba2-30f7d062983a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:19.948263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecfd0e87-7a28-42b1-8ba2-30f7d062983a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:19.950924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecfd0e87-7a28-42b1-8ba2-30f7d062983a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:19.951523 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecfd0e87-7a28-42b1-8ba2-30f7d062983a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:20.113032 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d6910c2a-6361-47be-ad86-6ce91b199708 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:20.124891 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d6910c2a-6361-47be-ad86-6ce91b199708 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 200 len: 1470 microversion: 2.1 time: 0.544336 Jul 31 01:39:20.127057 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2570/5158] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:19 2022] GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 1470 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:20.137967 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-090a991f-cf0e-499b-a1bc-1e4fcd6714bb tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:20.140320 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-090a991f-cf0e-499b-a1bc-1e4fcd6714bb tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:20.145756 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:20.155731 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-090a991f-cf0e-499b-a1bc-1e4fcd6714bb tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:20.159996 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-090a991f-cf0e-499b-a1bc-1e4fcd6714bb tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:20.161993 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-090a991f-cf0e-499b-a1bc-1e4fcd6714bb tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:20.164583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-090a991f-cf0e-499b-a1bc-1e4fcd6714bb tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:20.203682 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:20.369905 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ecfd0e87-7a28-42b1-8ba2-30f7d062983a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:20.383465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ecfd0e87-7a28-42b1-8ba2-30f7d062983a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:20.385008 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ecfd0e87-7a28-42b1-8ba2-30f7d062983a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:20.386215 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ecfd0e87-7a28-42b1-8ba2-30f7d062983a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1722 microversion: 2.20 time: 0.477742 Jul 31 01:39:20.402493 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2589/5159] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:19 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1722 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:20.402493 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1daf3e7a-a026-4653-b9ba-bf16497eb832 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:20.402493 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1daf3e7a-a026-4653-b9ba-bf16497eb832 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:20.416426 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1daf3e7a-a026-4653-b9ba-bf16497eb832 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:20.416889 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1daf3e7a-a026-4653-b9ba-bf16497eb832 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:20.417864 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1daf3e7a-a026-4653-b9ba-bf16497eb832 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:20.418321 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1daf3e7a-a026-4653-b9ba-bf16497eb832 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:20.600880 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-090a991f-cf0e-499b-a1bc-1e4fcd6714bb tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:20.612749 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-090a991f-cf0e-499b-a1bc-1e4fcd6714bb tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab" status: 200 len: 1513 microversion: 2.1 time: 0.479611 Jul 31 01:39:20.622631 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2571/5160] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:20 2022] GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab => generated 1513 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:20.629237 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-60abd79b-c3c2-412e-8843-3b83209c4188 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a1aad0d-0654-4412-8c54-d07a693614fc"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:20.642856 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-60abd79b-c3c2-412e-8843-3b83209c4188 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:20.651980 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60abd79b-c3c2-412e-8843-3b83209c4188 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:20.652852 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60abd79b-c3c2-412e-8843-3b83209c4188 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:20.653763 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60abd79b-c3c2-412e-8843-3b83209c4188 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:20.654324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60abd79b-c3c2-412e-8843-3b83209c4188 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:20.677517 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1daf3e7a-a026-4653-b9ba-bf16497eb832 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:20.690857 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1daf3e7a-a026-4653-b9ba-bf16497eb832 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 200 len: 1470 microversion: 2.1 time: 0.297251 Jul 31 01:39:20.693137 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2590/5161] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:20 2022] GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 1470 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:20.703066 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb7f00f8-5e80-456f-84ea-8c0157a02dd8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:20.704718 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fb7f00f8-5e80-456f-84ea-8c0157a02dd8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:20.713833 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb7f00f8-5e80-456f-84ea-8c0157a02dd8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:20.714865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb7f00f8-5e80-456f-84ea-8c0157a02dd8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:20.715936 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb7f00f8-5e80-456f-84ea-8c0157a02dd8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:20.716768 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb7f00f8-5e80-456f-84ea-8c0157a02dd8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:21.152271 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fb7f00f8-5e80-456f-84ea-8c0157a02dd8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:21.152918 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-60abd79b-c3c2-412e-8843-3b83209c4188 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "POST /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.529003 Jul 31 01:39:21.153524 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2572/5162] 10.222.0.45 () {62 vars in 1364 bytes} [Sun Jul 31 01:39:20 2022] POST /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments => generated 188 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:39:21.160847 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-60911dc5-eca1-431b-a54b-86540205891d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:21.163694 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-60911dc5-eca1-431b-a54b-86540205891d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:21.167313 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fb7f00f8-5e80-456f-84ea-8c0157a02dd8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:21.168864 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fb7f00f8-5e80-456f-84ea-8c0157a02dd8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:21.171471 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fb7f00f8-5e80-456f-84ea-8c0157a02dd8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1753 microversion: 2.42 time: 0.475233 Jul 31 01:39:21.183852 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2591/5163] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:20 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1753 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:21.189474 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-dd063560-fa9e-4a00-be7a-197eb02a1c56 req-82b5afd9-4633-4b82-a8f8-85f0d1ebb4ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b00bb6-bfdc-4ddc-bfd7-dc53016544bd", "name": "network-vif-unplugged", "status": "completed", "tag": "b03d8e12-2d7a-43c2-a2c3-344746d2f716"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:21.190469 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60911dc5-eca1-431b-a54b-86540205891d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:21.192594 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60911dc5-eca1-431b-a54b-86540205891d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:21.195439 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60911dc5-eca1-431b-a54b-86540205891d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:21.197134 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60911dc5-eca1-431b-a54b-86540205891d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:21.212020 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-dd063560-fa9e-4a00-be7a-197eb02a1c56 req-82b5afd9-4633-4b82-a8f8-85f0d1ebb4ac service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:21.212473 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-dd063560-fa9e-4a00-be7a-197eb02a1c56 req-82b5afd9-4633-4b82-a8f8-85f0d1ebb4ac service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:21.244180 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.compute.server_external_events [req-dd063560-fa9e-4a00-be7a-197eb02a1c56 req-82b5afd9-4633-4b82-a8f8-85f0d1ebb4ac service nova] Unable to find a host for instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd. Dropping event network-vif-unplugged {{(pid=119475) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 31 01:39:21.245103 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-dd063560-fa9e-4a00-be7a-197eb02a1c56 req-82b5afd9-4633-4b82-a8f8-85f0d1ebb4ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.060028 Jul 31 01:39:21.255107 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2592/5164] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 70 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 31 01:39:21.274824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3c11d826-3859-4085-8888-9508583d5ef0 tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:21.280162 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3c11d826-3859-4085-8888-9508583d5ef0 tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:21.288132 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c11d826-3859-4085-8888-9508583d5ef0 tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:21.288932 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c11d826-3859-4085-8888-9508583d5ef0 tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:21.289885 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c11d826-3859-4085-8888-9508583d5ef0 tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:21.290485 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c11d826-3859-4085-8888-9508583d5ef0 tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:21.364774 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:21.706285 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-60911dc5-eca1-431b-a54b-86540205891d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:21.724666 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-60911dc5-eca1-431b-a54b-86540205891d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1201 microversion: 2.1 time: 0.569833 Jul 31 01:39:21.729490 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2573/5165] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:21 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1201 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:21.767077 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3c11d826-3859-4085-8888-9508583d5ef0 tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 200 len: 1621 microversion: 2.1 time: 0.510510 Jul 31 01:39:21.767671 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9a9214c7-83d9-4705-8f68-61c3c399cc69 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:21.771519 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9a9214c7-83d9-4705-8f68-61c3c399cc69 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:21.773872 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2593/5166] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:21 2022] GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 1621 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:21.795705 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eae46233-4153-4b13-be5b-603ad443adfb tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:21.797608 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a9214c7-83d9-4705-8f68-61c3c399cc69 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:21.802555 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eae46233-4153-4b13-be5b-603ad443adfb tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:21.805807 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a9214c7-83d9-4705-8f68-61c3c399cc69 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:21.810060 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a9214c7-83d9-4705-8f68-61c3c399cc69 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:21.812079 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a9214c7-83d9-4705-8f68-61c3c399cc69 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:21.830022 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eae46233-4153-4b13-be5b-603ad443adfb tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:21.830467 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eae46233-4153-4b13-be5b-603ad443adfb tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:21.831278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eae46233-4153-4b13-be5b-603ad443adfb tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:21.831752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eae46233-4153-4b13-be5b-603ad443adfb tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:21.865021 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9a9214c7-83d9-4705-8f68-61c3c399cc69 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119474) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 31 01:39:22.047003 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9a9214c7-83d9-4705-8f68-61c3c399cc69 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "POST /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/action" status: 202 len: 0 microversion: 2.20 time: 0.312654 Jul 31 01:39:22.048081 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2574/5167] 10.222.0.45 () {62 vars in 1319 bytes} [Sun Jul 31 01:39:21 2022] POST /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:39:22.058561 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-47934722-106d-44e5-9989-b52cdefd2c0b tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:22.062026 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-47934722-106d-44e5-9989-b52cdefd2c0b tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:22.082074 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47934722-106d-44e5-9989-b52cdefd2c0b tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:22.082945 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47934722-106d-44e5-9989-b52cdefd2c0b tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:22.084402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47934722-106d-44e5-9989-b52cdefd2c0b tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:22.091906 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-47934722-106d-44e5-9989-b52cdefd2c0b tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:22.955981 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eae46233-4153-4b13-be5b-603ad443adfb tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6091fad22d5c4296b090d98a5fc34ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd070c9c7ec3047b0ad5f717036656042', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:22.964321 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eae46233-4153-4b13-be5b-603ad443adfb tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab" status: 200 len: 1513 microversion: 2.1 time: 1.189172 Jul 31 01:39:22.974490 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2594/5168] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:21 2022] GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab => generated 1513 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:22.998961 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7dbcf8c7-9920-4d0d-81c9-da49802e3022 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:23.006508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7dbcf8c7-9920-4d0d-81c9-da49802e3022 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:23.026957 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7dbcf8c7-9920-4d0d-81c9-da49802e3022 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:23.040609 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7dbcf8c7-9920-4d0d-81c9-da49802e3022 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:23.041504 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7dbcf8c7-9920-4d0d-81c9-da49802e3022 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:23.042993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7dbcf8c7-9920-4d0d-81c9-da49802e3022 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:23.200198 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-47934722-106d-44e5-9989-b52cdefd2c0b tempest-TestSecurityGroupsBasicOps-24310263 tempest-TestSecurityGroupsBasicOps-24310263-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1910 microversion: 2.1 time: 1.144544 Jul 31 01:39:23.207238 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2575/5169] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:22 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1910 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:23.246281 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7c7af7aa-d0fb-4ea2-81b7-86ada11de32f tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:23.247396 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7c7af7aa-d0fb-4ea2-81b7-86ada11de32f tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:23.256069 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7c7af7aa-d0fb-4ea2-81b7-86ada11de32f tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:23.256891 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7c7af7aa-d0fb-4ea2-81b7-86ada11de32f tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:23.257829 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7c7af7aa-d0fb-4ea2-81b7-86ada11de32f tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:23.258992 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7c7af7aa-d0fb-4ea2-81b7-86ada11de32f tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:24.172464 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7c7af7aa-d0fb-4ea2-81b7-86ada11de32f tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:24.204088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7c7af7aa-d0fb-4ea2-81b7-86ada11de32f tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:24.211698 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7c7af7aa-d0fb-4ea2-81b7-86ada11de32f tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:24.215102 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7c7af7aa-d0fb-4ea2-81b7-86ada11de32f tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1799 microversion: 2.42 time: 0.987487 Jul 31 01:39:24.219765 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2576/5170] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:23 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1799 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:24.238650 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f2f0023c-7800-40e6-96f9-a72dfe552352 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:24.239717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f2f0023c-7800-40e6-96f9-a72dfe552352 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:24.251248 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f2f0023c-7800-40e6-96f9-a72dfe552352 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:24.258089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f2f0023c-7800-40e6-96f9-a72dfe552352 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:24.259266 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f2f0023c-7800-40e6-96f9-a72dfe552352 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:24.259953 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f2f0023c-7800-40e6-96f9-a72dfe552352 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:24.438316 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7dbcf8c7-9920-4d0d-81c9-da49802e3022 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:24.458755 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7dbcf8c7-9920-4d0d-81c9-da49802e3022 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:24.462750 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7dbcf8c7-9920-4d0d-81c9-da49802e3022 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:24.466490 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7dbcf8c7-9920-4d0d-81c9-da49802e3022 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1748 microversion: 2.20 time: 1.490613 Jul 31 01:39:24.467614 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2595/5171] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:22 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1748 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:24.475287 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-94810142-e528-4055-b15a-761ecfcde938 req-848833c9-d253-44ac-968a-dd54ddb76805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7838837f-88cb-47ca-80ee-aa8b88fee0ab", "name": "network-vif-deleted", "tag": "0d66affb-1e2a-4f25-a233-3abfeda14ed1"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:24.501968 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-94810142-e528-4055-b15a-761ecfcde938 req-848833c9-d253-44ac-968a-dd54ddb76805 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:24.502880 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-94810142-e528-4055-b15a-761ecfcde938 req-848833c9-d253-44ac-968a-dd54ddb76805 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:24.537353 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-94810142-e528-4055-b15a-761ecfcde938 req-848833c9-d253-44ac-968a-dd54ddb76805 service nova] Creating event network-vif-deleted:0d66affb-1e2a-4f25-a233-3abfeda14ed1 for instance 7838837f-88cb-47ca-80ee-aa8b88fee0ab on n-h2-master-1 Jul 31 01:39:24.577661 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-94810142-e528-4055-b15a-761ecfcde938 req-848833c9-d253-44ac-968a-dd54ddb76805 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108473 Jul 31 01:39:24.579014 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2596/5172] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:24.589802 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e698e15a-7aa5-4bd1-96bf-220d04d106ec tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:24.590615 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e698e15a-7aa5-4bd1-96bf-220d04d106ec tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:24.623898 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e698e15a-7aa5-4bd1-96bf-220d04d106ec tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:24.625874 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e698e15a-7aa5-4bd1-96bf-220d04d106ec tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:24.626979 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e698e15a-7aa5-4bd1-96bf-220d04d106ec tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:24.632332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e698e15a-7aa5-4bd1-96bf-220d04d106ec tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:24.705016 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e698e15a-7aa5-4bd1-96bf-220d04d106ec tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:39:24.916470 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e698e15a-7aa5-4bd1-96bf-220d04d106ec tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 204 len: 0 microversion: 2.1 time: 0.332791 Jul 31 01:39:24.918826 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2597/5173] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:39:24 2022] DELETE /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:39:24.935306 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1bd37ec7-7904-46c8-a15e-9f451684cfcc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:24.936104 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1bd37ec7-7904-46c8-a15e-9f451684cfcc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] [instance: 7838837f-88cb-47ca-80ee-aa8b88fee0ab] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:24.953559 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bd37ec7-7904-46c8-a15e-9f451684cfcc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:24.955834 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bd37ec7-7904-46c8-a15e-9f451684cfcc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:24.956458 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bd37ec7-7904-46c8-a15e-9f451684cfcc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:24.956957 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bd37ec7-7904-46c8-a15e-9f451684cfcc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:25.035973 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-1bd37ec7-7904-46c8-a15e-9f451684cfcc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] HTTP exception thrown: Instance 7838837f-88cb-47ca-80ee-aa8b88fee0ab could not be found. Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1bd37ec7-7904-46c8-a15e-9f451684cfcc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Request method failure captured: Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab HTTP/1.1 Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dwMogzO9yWTGmyJD4UMZYJIWl-wz83RWLzljYuiDREoGub0Oe9sqBBijOr-h-lnsQ_c1gYiPxhY8b5sdFgHL1mAKTsEDDnIPzxIH80s1AJ4WdhTEdI0X0RKxdxbZWCt0MC7tImAwTMcmn8MzQu9jheNpu-sll16L_jUAsnV1PXaR8E Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: d070c9c7ec3047b0ad5f717036656042 Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-VolumesSnapshotTestJSON-43135823 Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d070c9c7ec3047b0ad5f717036656042"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d070c9c7ec3047b0ad5f717036656042"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d070c9c7ec3047b0ad5f717036656042"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d070c9c7ec3047b0ad5f717036656042", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-VolumesSnapshotTestJSON-43135823 Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: d070c9c7ec3047b0ad5f717036656042 Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-43135823 Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-VolumesSnapshotTestJSON-43135823-project Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 6091fad22d5c4296b090d98a5fc34ced Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-VolumesSnapshotTestJSON-43135823-project Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 7838837f-88cb-47ca-80ee-aa8b88fee0ab could not be found. Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '7838837f-88cb-47ca-80ee-aa8b88fee0ab'} Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7838837f-88cb-47ca-80ee-aa8b88fee0ab could not be found. Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7838837f-88cb-47ca-80ee-aa8b88fee0ab could not be found. Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:39:25.037739 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:39:25.042892 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:39:25.042892 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:39:25.042892 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:39:25.042892 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:39:25.042892 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:39:25.042892 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7838837f-88cb-47ca-80ee-aa8b88fee0ab could not be found. Jul 31 01:39:25.042892 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:39:25.042892 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1bd37ec7-7904-46c8-a15e-9f451684cfcc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] Returning 404 to user: Instance 7838837f-88cb-47ca-80ee-aa8b88fee0ab could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:39:25.042892 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1bd37ec7-7904-46c8-a15e-9f451684cfcc tempest-VolumesSnapshotTestJSON-43135823 tempest-VolumesSnapshotTestJSON-43135823-project] 10.222.0.45 "GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab" status: 404 len: 111 microversion: 2.1 time: 0.118374 Jul 31 01:39:25.042892 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2598/5174] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:24 2022] GET /compute/v2.1/servers/7838837f-88cb-47ca-80ee-aa8b88fee0ab => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:39:25.076813 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-92a5e72b-1f19-4ff5-a794-7a8a4eb49d3a tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:25.077488 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-92a5e72b-1f19-4ff5-a794-7a8a4eb49d3a tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:25.095296 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92a5e72b-1f19-4ff5-a794-7a8a4eb49d3a tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:25.096940 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92a5e72b-1f19-4ff5-a794-7a8a4eb49d3a tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:25.100802 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92a5e72b-1f19-4ff5-a794-7a8a4eb49d3a tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:25.101592 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92a5e72b-1f19-4ff5-a794-7a8a4eb49d3a tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:25.274290 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f2f0023c-7800-40e6-96f9-a72dfe552352 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:25.282714 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f2f0023c-7800-40e6-96f9-a72dfe552352 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1386 microversion: 2.1 time: 1.060816 Jul 31 01:39:25.291516 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2577/5175] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:24 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1386 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:25.307611 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9408b545-e7cc-42ca-9a64-27471a8acdb9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:25.308649 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9408b545-e7cc-42ca-9a64-27471a8acdb9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:25.334002 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9408b545-e7cc-42ca-9a64-27471a8acdb9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:25.335989 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9408b545-e7cc-42ca-9a64-27471a8acdb9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:25.339025 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9408b545-e7cc-42ca-9a64-27471a8acdb9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:25.340135 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9408b545-e7cc-42ca-9a64-27471a8acdb9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:25.461873 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-92a5e72b-1f19-4ff5-a794-7a8a4eb49d3a tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:25.486374 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-92a5e72b-1f19-4ff5-a794-7a8a4eb49d3a tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 200 len: 1476 microversion: 2.1 time: 0.445281 Jul 31 01:39:25.489948 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2599/5176] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:25 2022] GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 1476 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:25.498751 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-973cd860-4c69-4f49-9207-2ecfd923c618 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:25.500503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-973cd860-4c69-4f49-9207-2ecfd923c618 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:25.509539 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-973cd860-4c69-4f49-9207-2ecfd923c618 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:25.510823 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-973cd860-4c69-4f49-9207-2ecfd923c618 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:25.512041 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-973cd860-4c69-4f49-9207-2ecfd923c618 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:25.512814 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-973cd860-4c69-4f49-9207-2ecfd923c618 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:26.370511 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9408b545-e7cc-42ca-9a64-27471a8acdb9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:26.387076 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9408b545-e7cc-42ca-9a64-27471a8acdb9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:26.389410 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9408b545-e7cc-42ca-9a64-27471a8acdb9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:26.393375 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9408b545-e7cc-42ca-9a64-27471a8acdb9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1799 microversion: 2.42 time: 1.098652 Jul 31 01:39:26.396726 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2578/5177] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:25 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1799 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:26.411220 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cd4c3a02-d251-4aab-b67b-eb6d5629d53e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:26.412763 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cd4c3a02-d251-4aab-b67b-eb6d5629d53e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:26.441151 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd4c3a02-d251-4aab-b67b-eb6d5629d53e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:26.441750 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd4c3a02-d251-4aab-b67b-eb6d5629d53e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:26.442574 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd4c3a02-d251-4aab-b67b-eb6d5629d53e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:26.443689 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd4c3a02-d251-4aab-b67b-eb6d5629d53e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:26.453539 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-973cd860-4c69-4f49-9207-2ecfd923c618 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:26.464211 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-973cd860-4c69-4f49-9207-2ecfd923c618 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1386 microversion: 2.1 time: 0.972151 Jul 31 01:39:26.464853 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2600/5178] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:25 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1386 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:26.489315 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9f43b157-d29f-4184-962c-eac0360ecd58 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:26.489938 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9f43b157-d29f-4184-962c-eac0360ecd58 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:26.501795 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9f43b157-d29f-4184-962c-eac0360ecd58 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:26.509755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9f43b157-d29f-4184-962c-eac0360ecd58 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:26.511053 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9f43b157-d29f-4184-962c-eac0360ecd58 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:26.513085 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9f43b157-d29f-4184-962c-eac0360ecd58 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:27.046456 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9f43b157-d29f-4184-962c-eac0360ecd58 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:27.071362 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9f43b157-d29f-4184-962c-eac0360ecd58 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1386 microversion: 2.1 time: 0.584838 Jul 31 01:39:27.075058 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2601/5179] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:26 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1386 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:39:27.092632 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c798cc8c-0919-497b-8c8c-cc8c8878fdcf tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:27.093144 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c798cc8c-0919-497b-8c8c-cc8c8878fdcf tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:27.122426 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c798cc8c-0919-497b-8c8c-cc8c8878fdcf tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:27.124884 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c798cc8c-0919-497b-8c8c-cc8c8878fdcf tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:27.129269 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cd4c3a02-d251-4aab-b67b-eb6d5629d53e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:27.135043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c798cc8c-0919-497b-8c8c-cc8c8878fdcf tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:27.136034 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c798cc8c-0919-497b-8c8c-cc8c8878fdcf tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:27.143907 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cd4c3a02-d251-4aab-b67b-eb6d5629d53e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:27.145588 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cd4c3a02-d251-4aab-b67b-eb6d5629d53e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:27.151400 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cd4c3a02-d251-4aab-b67b-eb6d5629d53e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1750 microversion: 2.20 time: 0.753301 Jul 31 01:39:27.154218 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2579/5180] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:26 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1750 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:27.422235 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d05c4f4b-afff-45d1-bc34-cd185493ace2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:27.423749 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d05c4f4b-afff-45d1-bc34-cd185493ace2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:27.437488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d05c4f4b-afff-45d1-bc34-cd185493ace2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:27.450850 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d05c4f4b-afff-45d1-bc34-cd185493ace2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:27.452006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d05c4f4b-afff-45d1-bc34-cd185493ace2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:27.454485 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d05c4f4b-afff-45d1-bc34-cd185493ace2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:27.469163 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c798cc8c-0919-497b-8c8c-cc8c8878fdcf tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:27.489245 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c798cc8c-0919-497b-8c8c-cc8c8878fdcf tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 200 len: 1476 microversion: 2.1 time: 0.411894 Jul 31 01:39:27.492445 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2602/5181] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:27 2022] GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 1476 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:27.945432 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-52e8e8f5-85bc-41bc-a6a6-712e4dce2fe0 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:27.945979 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-52e8e8f5-85bc-41bc-a6a6-712e4dce2fe0 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:27.953686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d05c4f4b-afff-45d1-bc34-cd185493ace2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:27.960561 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52e8e8f5-85bc-41bc-a6a6-712e4dce2fe0 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:27.960984 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52e8e8f5-85bc-41bc-a6a6-712e4dce2fe0 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:27.962131 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52e8e8f5-85bc-41bc-a6a6-712e4dce2fe0 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:27.962746 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-52e8e8f5-85bc-41bc-a6a6-712e4dce2fe0 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:27.975023 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d05c4f4b-afff-45d1-bc34-cd185493ace2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:27.978071 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d05c4f4b-afff-45d1-bc34-cd185493ace2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:27.979814 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d05c4f4b-afff-45d1-bc34-cd185493ace2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1845 microversion: 2.42 time: 0.562198 Jul 31 01:39:27.999891 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2580/5182] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:27 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1845 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:28.017117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-52e8e8f5-85bc-41bc-a6a6-712e4dce2fe0 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:39:28.178360 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ae85d0a-51f9-4707-926c-2c7591cce2c1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:28.179076 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0ae85d0a-51f9-4707-926c-2c7591cce2c1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:28.189095 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ae85d0a-51f9-4707-926c-2c7591cce2c1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:28.191199 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ae85d0a-51f9-4707-926c-2c7591cce2c1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:28.192506 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:28.193536 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ae85d0a-51f9-4707-926c-2c7591cce2c1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:28.195148 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ae85d0a-51f9-4707-926c-2c7591cce2c1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:28.217464 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-52e8e8f5-85bc-41bc-a6a6-712e4dce2fe0 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "DELETE /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 204 len: 0 microversion: 2.1 time: 0.275730 Jul 31 01:39:28.222327 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2603/5183] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:39:27 2022] DELETE /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:39:28.233948 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-880e7543-4b43-4be7-9a2b-4a10da38e2a4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:28.236227 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-880e7543-4b43-4be7-9a2b-4a10da38e2a4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:28.251164 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-880e7543-4b43-4be7-9a2b-4a10da38e2a4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:28.252859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-880e7543-4b43-4be7-9a2b-4a10da38e2a4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:28.255833 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-880e7543-4b43-4be7-9a2b-4a10da38e2a4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:28.257138 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-880e7543-4b43-4be7-9a2b-4a10da38e2a4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:28.802045 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0ae85d0a-51f9-4707-926c-2c7591cce2c1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:28.819035 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0ae85d0a-51f9-4707-926c-2c7591cce2c1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:28.830770 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0ae85d0a-51f9-4707-926c-2c7591cce2c1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:28.835122 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0ae85d0a-51f9-4707-926c-2c7591cce2c1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1750 microversion: 2.20 time: 0.657936 Jul 31 01:39:28.847991 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2581/5184] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:28 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1750 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:28.847991 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e2019c1a-6228-4256-bb7f-a494870417bb tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:28.847991 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e2019c1a-6228-4256-bb7f-a494870417bb tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:28.861702 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2019c1a-6228-4256-bb7f-a494870417bb tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:28.862160 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2019c1a-6228-4256-bb7f-a494870417bb tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:28.863216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2019c1a-6228-4256-bb7f-a494870417bb tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:28.863693 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2019c1a-6228-4256-bb7f-a494870417bb tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:28.937555 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-880e7543-4b43-4be7-9a2b-4a10da38e2a4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:28.950684 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-880e7543-4b43-4be7-9a2b-4a10da38e2a4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1392 microversion: 2.1 time: 0.726674 Jul 31 01:39:28.966965 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2604/5185] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:28 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1392 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:39:28.966965 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-1ac12bf2-b4f3-4948-a1f9-44b9ec3b55bb req-b3d549e4-e303-4955-b9e0-c5b3fd836f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a1fd7b-4172-42ad-826b-60c5f38f4499", "name": "network-vif-deleted", "tag": "7e16ea30-5a28-4fa5-b4d7-73f31840b609"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:28.996121 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1ac12bf2-b4f3-4948-a1f9-44b9ec3b55bb req-b3d549e4-e303-4955-b9e0-c5b3fd836f8a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:28.996610 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1ac12bf2-b4f3-4948-a1f9-44b9ec3b55bb req-b3d549e4-e303-4955-b9e0-c5b3fd836f8a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:29.050967 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1ac12bf2-b4f3-4948-a1f9-44b9ec3b55bb req-b3d549e4-e303-4955-b9e0-c5b3fd836f8a service nova] Creating event network-vif-deleted:7e16ea30-5a28-4fa5-b4d7-73f31840b609 for instance b2a1fd7b-4172-42ad-826b-60c5f38f4499 on n-h2-master-1 Jul 31 01:39:29.071615 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-1ac12bf2-b4f3-4948-a1f9-44b9ec3b55bb req-b3d549e4-e303-4955-b9e0-c5b3fd836f8a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115925 Jul 31 01:39:29.077876 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2605/5186] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:29.095144 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-001fea41-66ad-4a98-9f97-19e3e3044628 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:29.095905 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-001fea41-66ad-4a98-9f97-19e3e3044628 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:29.133468 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-001fea41-66ad-4a98-9f97-19e3e3044628 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:29.134241 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-001fea41-66ad-4a98-9f97-19e3e3044628 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:29.135389 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-001fea41-66ad-4a98-9f97-19e3e3044628 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:29.136335 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e2019c1a-6228-4256-bb7f-a494870417bb tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:29.137080 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-001fea41-66ad-4a98-9f97-19e3e3044628 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:29.150221 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e2019c1a-6228-4256-bb7f-a494870417bb tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 200 len: 1476 microversion: 2.1 time: 0.310745 Jul 31 01:39:29.154685 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2582/5187] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:28 2022] GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 1476 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:29.753329 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-001fea41-66ad-4a98-9f97-19e3e3044628 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:29.777356 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-001fea41-66ad-4a98-9f97-19e3e3044628 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:29.783165 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-001fea41-66ad-4a98-9f97-19e3e3044628 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:29.788384 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-001fea41-66ad-4a98-9f97-19e3e3044628 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1845 microversion: 2.42 time: 0.709040 Jul 31 01:39:29.789007 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2606/5188] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:29 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1845 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:29.864484 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-66991b11-c348-41e2-834e-e33df175e87e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:29.865979 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-66991b11-c348-41e2-834e-e33df175e87e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:29.881438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66991b11-c348-41e2-834e-e33df175e87e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:29.883690 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66991b11-c348-41e2-834e-e33df175e87e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:29.884773 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66991b11-c348-41e2-834e-e33df175e87e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:29.886131 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66991b11-c348-41e2-834e-e33df175e87e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:29.975359 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c53e8cd2-5b37-4d09-beba-dd5d30adf551 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:29.976744 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c53e8cd2-5b37-4d09-beba-dd5d30adf551 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:29.994402 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c53e8cd2-5b37-4d09-beba-dd5d30adf551 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:29.995579 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c53e8cd2-5b37-4d09-beba-dd5d30adf551 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:30.000108 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c53e8cd2-5b37-4d09-beba-dd5d30adf551 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:30.003092 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c53e8cd2-5b37-4d09-beba-dd5d30adf551 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:30.693832 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-66991b11-c348-41e2-834e-e33df175e87e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:30.705827 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-66991b11-c348-41e2-834e-e33df175e87e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:30.707352 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-66991b11-c348-41e2-834e-e33df175e87e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:30.718020 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-66991b11-c348-41e2-834e-e33df175e87e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1750 microversion: 2.20 time: 0.848432 Jul 31 01:39:30.721022 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2583/5189] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:29 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1750 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:30.738576 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-30468aa8-94f5-4340-8426-403196cef722 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:30.744615 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-30468aa8-94f5-4340-8426-403196cef722 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: b2a1fd7b-4172-42ad-826b-60c5f38f4499] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:30.761657 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30468aa8-94f5-4340-8426-403196cef722 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:30.762126 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30468aa8-94f5-4340-8426-403196cef722 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:30.762923 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30468aa8-94f5-4340-8426-403196cef722 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:30.763688 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-30468aa8-94f5-4340-8426-403196cef722 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:30.781811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c53e8cd2-5b37-4d09-beba-dd5d30adf551 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:30.790484 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c53e8cd2-5b37-4d09-beba-dd5d30adf551 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1392 microversion: 2.1 time: 0.819620 Jul 31 01:39:30.797980 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2607/5190] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:29 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1392 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:39:30.815905 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2c2db4f6-be99-45d4-821a-abe2a15d3da4 req-94522210-11a2-498d-bc23-a65270f98526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "tag": "e1be7003-6e47-45d7-b637-ed3b70b52701"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:30.821015 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-30468aa8-94f5-4340-8426-403196cef722 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] HTTP exception thrown: Instance b2a1fd7b-4172-42ad-826b-60c5f38f4499 could not be found. Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-30468aa8-94f5-4340-8426-403196cef722 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Request method failure captured: Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 HTTP/1.1 Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dzRatcxsARnFuDm6kPkA982cfnmdsYir3nDQaGOV-fqshwkcP9ud-twosDYjGfS7prGskqBA_kGU2uLU53_i9RyGVq60Jl2ejzt1mzPlL4Js4q6ZOEf_2zssy2cWS007kOZg9YYyCRz_2hZfG5WhDPr0IoYBn-rktdoMqwLEtcqoMw Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e91b99234bbf4863937cc25a97a1d4a9 Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-963028503 Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e91b99234bbf4863937cc25a97a1d4a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e91b99234bbf4863937cc25a97a1d4a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e91b99234bbf4863937cc25a97a1d4a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e91b99234bbf4863937cc25a97a1d4a9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestSecurityGroupsBasicOps-963028503 Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e91b99234bbf4863937cc25a97a1d4a9 Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-963028503 Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestSecurityGroupsBasicOps-963028503-project Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 0eea5af26928472d920a9cae8cd6131b Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestSecurityGroupsBasicOps-963028503-project Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: exception: Instance b2a1fd7b-4172-42ad-826b-60c5f38f4499 could not be found. Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'b2a1fd7b-4172-42ad-826b-60c5f38f4499'} Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a1fd7b-4172-42ad-826b-60c5f38f4499 could not be found. Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a1fd7b-4172-42ad-826b-60c5f38f4499 could not be found. Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:39:30.822727 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:39:30.826781 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:39:30.826781 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:39:30.826781 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:39:30.826781 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:39:30.826781 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:39:30.826781 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a1fd7b-4172-42ad-826b-60c5f38f4499 could not be found. Jul 31 01:39:30.826781 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:39:30.826781 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-30468aa8-94f5-4340-8426-403196cef722 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Returning 404 to user: Instance b2a1fd7b-4172-42ad-826b-60c5f38f4499 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:39:30.833661 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-30468aa8-94f5-4340-8426-403196cef722 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499" status: 404 len: 111 microversion: 2.1 time: 0.109701 Jul 31 01:39:30.834860 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2584/5191] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:30 2022] GET /compute/v2.1/servers/b2a1fd7b-4172-42ad-826b-60c5f38f4499 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:39:30.838775 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2c2db4f6-be99-45d4-821a-abe2a15d3da4 req-94522210-11a2-498d-bc23-a65270f98526 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:30.841309 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2c2db4f6-be99-45d4-821a-abe2a15d3da4 req-94522210-11a2-498d-bc23-a65270f98526 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:30.845632 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0efbb7f7-9b5f-46fa-a425-2467a00a5aa8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:30.846587 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0efbb7f7-9b5f-46fa-a425-2467a00a5aa8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:30.872961 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2c2db4f6-be99-45d4-821a-abe2a15d3da4 req-94522210-11a2-498d-bc23-a65270f98526 service nova] Creating event network-changed:e1be7003-6e47-45d7-b637-ed3b70b52701 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:39:30.881351 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0efbb7f7-9b5f-46fa-a425-2467a00a5aa8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:30.884222 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0efbb7f7-9b5f-46fa-a425-2467a00a5aa8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:30.886399 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2c2db4f6-be99-45d4-821a-abe2a15d3da4 req-94522210-11a2-498d-bc23-a65270f98526 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085480 Jul 31 01:39:30.887366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0efbb7f7-9b5f-46fa-a425-2467a00a5aa8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:30.887497 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2608/5192] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:30.889401 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0efbb7f7-9b5f-46fa-a425-2467a00a5aa8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:30.932740 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:31.751768 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dd3e18d1-066d-4e9b-af0a-ad5c0cc77a8b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:31.753627 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dd3e18d1-066d-4e9b-af0a-ad5c0cc77a8b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:31.766796 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd3e18d1-066d-4e9b-af0a-ad5c0cc77a8b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:31.767937 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd3e18d1-066d-4e9b-af0a-ad5c0cc77a8b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:31.769388 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd3e18d1-066d-4e9b-af0a-ad5c0cc77a8b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:31.771077 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd3e18d1-066d-4e9b-af0a-ad5c0cc77a8b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:31.776448 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:32.655871 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0efbb7f7-9b5f-46fa-a425-2467a00a5aa8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:32.666731 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0efbb7f7-9b5f-46fa-a425-2467a00a5aa8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:32.674035 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0efbb7f7-9b5f-46fa-a425-2467a00a5aa8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:32.674885 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0efbb7f7-9b5f-46fa-a425-2467a00a5aa8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1845 microversion: 2.42 time: 1.838811 Jul 31 01:39:32.675537 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2585/5193] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:30 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1845 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:32.709312 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cf6aba47-7e89-4162-a122-61a105cdd892 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:32.709938 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cf6aba47-7e89-4162-a122-61a105cdd892 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:32.728802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf6aba47-7e89-4162-a122-61a105cdd892 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:32.729373 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf6aba47-7e89-4162-a122-61a105cdd892 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:32.730247 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf6aba47-7e89-4162-a122-61a105cdd892 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:32.730792 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf6aba47-7e89-4162-a122-61a105cdd892 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:32.892785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dd3e18d1-066d-4e9b-af0a-ad5c0cc77a8b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:32.908035 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dd3e18d1-066d-4e9b-af0a-ad5c0cc77a8b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:32.910324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dd3e18d1-066d-4e9b-af0a-ad5c0cc77a8b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:32.911882 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dd3e18d1-066d-4e9b-af0a-ad5c0cc77a8b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1750 microversion: 2.20 time: 1.169261 Jul 31 01:39:32.913248 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2609/5194] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:31 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1750 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:39:32.925197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-c4b27787-b4ef-403a-981f-ad3091fe7f28 req-bfa40aaf-d0ce-4432-b568-5389a5d17525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254edd9c-2684-432f-bfd7-e8a2342c66fd", "name": "network-vif-deleted", "tag": "22e379ec-5d6e-401a-b245-dcb4299f6177"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:32.950969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c4b27787-b4ef-403a-981f-ad3091fe7f28 req-bfa40aaf-d0ce-4432-b568-5389a5d17525 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:32.952650 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c4b27787-b4ef-403a-981f-ad3091fe7f28 req-bfa40aaf-d0ce-4432-b568-5389a5d17525 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:32.984545 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-c4b27787-b4ef-403a-981f-ad3091fe7f28 req-bfa40aaf-d0ce-4432-b568-5389a5d17525 service nova] Creating event network-vif-deleted:22e379ec-5d6e-401a-b245-dcb4299f6177 for instance 254edd9c-2684-432f-bfd7-e8a2342c66fd on n-h2-master-1 Jul 31 01:39:33.009266 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-c4b27787-b4ef-403a-981f-ad3091fe7f28 req-bfa40aaf-d0ce-4432-b568-5389a5d17525 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094369 Jul 31 01:39:33.017166 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2610/5195] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:33.103772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cf6aba47-7e89-4162-a122-61a105cdd892 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:33.111934 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cf6aba47-7e89-4162-a122-61a105cdd892 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1186 microversion: 2.1 time: 0.406407 Jul 31 01:39:33.121651 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2586/5196] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:32 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1186 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:33.702678 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-050a2a26-b45b-41c5-969b-8d8d2ec36179 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:33.703907 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-050a2a26-b45b-41c5-969b-8d8d2ec36179 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:33.715718 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-050a2a26-b45b-41c5-969b-8d8d2ec36179 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:33.716191 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-050a2a26-b45b-41c5-969b-8d8d2ec36179 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:33.717037 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-050a2a26-b45b-41c5-969b-8d8d2ec36179 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:33.722426 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-050a2a26-b45b-41c5-969b-8d8d2ec36179 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:33.959738 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8db6a28b-1aa9-4a7c-88e9-e4866e4c4f58 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:33.961118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8db6a28b-1aa9-4a7c-88e9-e4866e4c4f58 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:33.984141 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8db6a28b-1aa9-4a7c-88e9-e4866e4c4f58 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:33.986397 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8db6a28b-1aa9-4a7c-88e9-e4866e4c4f58 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:33.989289 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8db6a28b-1aa9-4a7c-88e9-e4866e4c4f58 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:33.990317 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8db6a28b-1aa9-4a7c-88e9-e4866e4c4f58 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:34.806369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-050a2a26-b45b-41c5-969b-8d8d2ec36179 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:34.822189 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-050a2a26-b45b-41c5-969b-8d8d2ec36179 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:34.834096 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-050a2a26-b45b-41c5-969b-8d8d2ec36179 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:34.836332 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-050a2a26-b45b-41c5-969b-8d8d2ec36179 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1866 microversion: 2.42 time: 1.137222 Jul 31 01:39:34.837759 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2611/5197] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:33 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1866 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:34.844634 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-44f6a42f-e1cb-47d7-8757-4e238578e8cd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:34.845501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-44f6a42f-e1cb-47d7-8757-4e238578e8cd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:34.853085 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44f6a42f-e1cb-47d7-8757-4e238578e8cd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:34.854651 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44f6a42f-e1cb-47d7-8757-4e238578e8cd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:34.855699 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44f6a42f-e1cb-47d7-8757-4e238578e8cd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:34.856319 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44f6a42f-e1cb-47d7-8757-4e238578e8cd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:34.987289 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-44f6a42f-e1cb-47d7-8757-4e238578e8cd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:34.996369 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-44f6a42f-e1cb-47d7-8757-4e238578e8cd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1186 microversion: 2.1 time: 0.156160 Jul 31 01:39:34.997740 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2612/5198] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:34 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1186 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:35.217074 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8db6a28b-1aa9-4a7c-88e9-e4866e4c4f58 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:35.229715 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8db6a28b-1aa9-4a7c-88e9-e4866e4c4f58 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:35.235960 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8db6a28b-1aa9-4a7c-88e9-e4866e4c4f58 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:35.240202 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8db6a28b-1aa9-4a7c-88e9-e4866e4c4f58 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1750 microversion: 2.20 time: 1.297909 Jul 31 01:39:35.241699 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2587/5199] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:33 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1750 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:35.297960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-c95aadfd-dab7-4ddb-adc9-c829c2225472 req-75b305c6-6a97-4d0f-86e0-b15e39156b82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "tag": "8d439614-2d77-45c4-bece-37999557c985"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:35.321577 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c95aadfd-dab7-4ddb-adc9-c829c2225472 req-75b305c6-6a97-4d0f-86e0-b15e39156b82 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:35.323237 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c95aadfd-dab7-4ddb-adc9-c829c2225472 req-75b305c6-6a97-4d0f-86e0-b15e39156b82 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:35.352035 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-c95aadfd-dab7-4ddb-adc9-c829c2225472 req-75b305c6-6a97-4d0f-86e0-b15e39156b82 service nova] Creating event network-changed:8d439614-2d77-45c4-bece-37999557c985 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:39:35.369886 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-c95aadfd-dab7-4ddb-adc9-c829c2225472 req-75b305c6-6a97-4d0f-86e0-b15e39156b82 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076182 Jul 31 01:39:35.372736 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2613/5200] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:35.860706 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ea63c690-c41b-460b-86c5-c8f9782d19e2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:35.861333 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ea63c690-c41b-460b-86c5-c8f9782d19e2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:35.872230 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ea63c690-c41b-460b-86c5-c8f9782d19e2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:35.872694 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ea63c690-c41b-460b-86c5-c8f9782d19e2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:35.881599 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ea63c690-c41b-460b-86c5-c8f9782d19e2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:35.882156 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ea63c690-c41b-460b-86c5-c8f9782d19e2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:36.019165 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cabba6c6-b166-44d5-89df-5154021789d9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:36.019919 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cabba6c6-b166-44d5-89df-5154021789d9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:36.033138 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cabba6c6-b166-44d5-89df-5154021789d9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:36.033621 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cabba6c6-b166-44d5-89df-5154021789d9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:36.034432 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cabba6c6-b166-44d5-89df-5154021789d9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:36.034890 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cabba6c6-b166-44d5-89df-5154021789d9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:36.141681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cabba6c6-b166-44d5-89df-5154021789d9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:36.152461 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cabba6c6-b166-44d5-89df-5154021789d9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1186 microversion: 2.1 time: 0.137949 Jul 31 01:39:36.156112 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2614/5201] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:36 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1186 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:36.267430 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d5863ede-c373-46e1-ad1c-94a23df857d3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:36.268588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d5863ede-c373-46e1-ad1c-94a23df857d3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:36.277257 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5863ede-c373-46e1-ad1c-94a23df857d3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:36.283699 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5863ede-c373-46e1-ad1c-94a23df857d3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:36.285133 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5863ede-c373-46e1-ad1c-94a23df857d3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:36.285795 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5863ede-c373-46e1-ad1c-94a23df857d3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:36.590912 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ea63c690-c41b-460b-86c5-c8f9782d19e2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:36.605539 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ea63c690-c41b-460b-86c5-c8f9782d19e2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:36.607879 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ea63c690-c41b-460b-86c5-c8f9782d19e2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:36.610238 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ea63c690-c41b-460b-86c5-c8f9782d19e2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1866 microversion: 2.42 time: 0.753666 Jul 31 01:39:36.611685 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2588/5202] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:35 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1866 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:36.884212 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d5863ede-c373-46e1-ad1c-94a23df857d3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:36.897447 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d5863ede-c373-46e1-ad1c-94a23df857d3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:36.902913 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d5863ede-c373-46e1-ad1c-94a23df857d3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:36.904329 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d5863ede-c373-46e1-ad1c-94a23df857d3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1750 microversion: 2.20 time: 0.641456 Jul 31 01:39:36.911172 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2615/5203] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:36 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1750 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:39:37.177841 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-709b4b9b-5275-4e16-94b8-d7ca74fd1194 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:37.178684 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-709b4b9b-5275-4e16-94b8-d7ca74fd1194 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:37.206531 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-709b4b9b-5275-4e16-94b8-d7ca74fd1194 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:37.207376 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-709b4b9b-5275-4e16-94b8-d7ca74fd1194 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:37.214285 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-709b4b9b-5275-4e16-94b8-d7ca74fd1194 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:37.215011 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-709b4b9b-5275-4e16-94b8-d7ca74fd1194 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:37.457317 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-709b4b9b-5275-4e16-94b8-d7ca74fd1194 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:37.469888 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-709b4b9b-5275-4e16-94b8-d7ca74fd1194 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1186 microversion: 2.1 time: 0.300529 Jul 31 01:39:37.490419 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2589/5204] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:37 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1186 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:37.642716 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5c6f66b8-14d9-4a6e-8b1d-36a7927f0716 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:37.643258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5c6f66b8-14d9-4a6e-8b1d-36a7927f0716 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:37.659407 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c6f66b8-14d9-4a6e-8b1d-36a7927f0716 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:37.664542 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c6f66b8-14d9-4a6e-8b1d-36a7927f0716 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:37.665402 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c6f66b8-14d9-4a6e-8b1d-36a7927f0716 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:37.665852 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c6f66b8-14d9-4a6e-8b1d-36a7927f0716 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:37.934554 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ddb403aa-57c1-466c-b6d4-05e3d5001a76 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:37.935186 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ddb403aa-57c1-466c-b6d4-05e3d5001a76 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:37.953999 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddb403aa-57c1-466c-b6d4-05e3d5001a76 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:37.955599 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddb403aa-57c1-466c-b6d4-05e3d5001a76 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:37.962987 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddb403aa-57c1-466c-b6d4-05e3d5001a76 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:37.963570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddb403aa-57c1-466c-b6d4-05e3d5001a76 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:38.446869 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5c6f66b8-14d9-4a6e-8b1d-36a7927f0716 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:38.459093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5c6f66b8-14d9-4a6e-8b1d-36a7927f0716 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:38.460860 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5c6f66b8-14d9-4a6e-8b1d-36a7927f0716 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:38.462464 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5c6f66b8-14d9-4a6e-8b1d-36a7927f0716 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1887 microversion: 2.42 time: 0.825552 Jul 31 01:39:38.463771 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2616/5205] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:37 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1887 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:38.469034 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-569d3b90-6090-4b4b-bfb3-31462d88cfff req-cab35980-9664-456f-a0fd-7d9c867a6da8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "tag": "5ad3e971-dbb2-4b55-9893-730ef94ad777"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:38.483045 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-569d3b90-6090-4b4b-bfb3-31462d88cfff req-cab35980-9664-456f-a0fd-7d9c867a6da8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:38.483847 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-569d3b90-6090-4b4b-bfb3-31462d88cfff req-cab35980-9664-456f-a0fd-7d9c867a6da8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:38.498249 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-569d3b90-6090-4b4b-bfb3-31462d88cfff req-cab35980-9664-456f-a0fd-7d9c867a6da8 service nova] Creating event network-changed:5ad3e971-dbb2-4b55-9893-730ef94ad777 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:39:38.505012 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-569d3b90-6090-4b4b-bfb3-31462d88cfff req-cab35980-9664-456f-a0fd-7d9c867a6da8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039311 Jul 31 01:39:38.506686 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2617/5206] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:38.687817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b7feb174-dcde-4b07-a589-7c67230919b1 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:38.689442 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:39:38.689442 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:39:38.691288 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7feb174-dcde-4b07-a589-7c67230919b1 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:38.693218 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7feb174-dcde-4b07-a589-7c67230919b1 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:38.694551 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7feb174-dcde-4b07-a589-7c67230919b1 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:38.695221 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7feb174-dcde-4b07-a589-7c67230919b1 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:38.731493 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b7feb174-dcde-4b07-a589-7c67230919b1 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.222278 Jul 31 01:39:38.733109 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2618/5207] 10.222.0.45 () {58 vars in 1185 bytes} [Sun Jul 31 01:39:38 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:38.759707 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f0cc8ffb-5edc-489e-a3cf-10d2d6aec1b8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:38.760846 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f0cc8ffb-5edc-489e-a3cf-10d2d6aec1b8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:38.775312 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0cc8ffb-5edc-489e-a3cf-10d2d6aec1b8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:38.776268 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0cc8ffb-5edc-489e-a3cf-10d2d6aec1b8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:38.777443 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0cc8ffb-5edc-489e-a3cf-10d2d6aec1b8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:38.778740 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f0cc8ffb-5edc-489e-a3cf-10d2d6aec1b8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:38.995419 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f0cc8ffb-5edc-489e-a3cf-10d2d6aec1b8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:39.009734 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f0cc8ffb-5edc-489e-a3cf-10d2d6aec1b8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1186 microversion: 2.1 time: 0.274763 Jul 31 01:39:39.010328 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2619/5208] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:38 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1186 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:39.020283 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8dea85b1-c3ac-46d7-9cf4-81532cde63d5 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-975206062", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "availability_zone": "nova:n-h2-master-1", "networks": [{"uuid": "197c4971-91e3-43ca-a312-b527ebbdcc10"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:39.110965 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ddb403aa-57c1-466c-b6d4-05e3d5001a76 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:39.129680 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ddb403aa-57c1-466c-b6d4-05e3d5001a76 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:39.131306 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ddb403aa-57c1-466c-b6d4-05e3d5001a76 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:39.132595 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ddb403aa-57c1-466c-b6d4-05e3d5001a76 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1750 microversion: 2.20 time: 1.202329 Jul 31 01:39:39.138665 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2590/5209] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:37 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1750 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:39.154885 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-8dea85b1-c3ac-46d7-9cf4-81532cde63d5 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] validate_networks() for [('197c4971-91e3-43ca-a312-b527ebbdcc10', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:39:39.486193 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3b275920-28a7-4382-9637-883cf380ed7b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:39.488097 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3b275920-28a7-4382-9637-883cf380ed7b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:39.499388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b275920-28a7-4382-9637-883cf380ed7b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:39.503868 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b275920-28a7-4382-9637-883cf380ed7b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:39.506738 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b275920-28a7-4382-9637-883cf380ed7b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:39.519521 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b275920-28a7-4382-9637-883cf380ed7b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:40.864324 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b275920-28a7-4382-9637-883cf380ed7b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:40.881431 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b275920-28a7-4382-9637-883cf380ed7b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:40.883499 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b275920-28a7-4382-9637-883cf380ed7b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:40.884936 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3b275920-28a7-4382-9637-883cf380ed7b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1887 microversion: 2.42 time: 1.402790 Jul 31 01:39:40.885684 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2591/5210] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:39 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1887 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:39:40.893556 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-40a4a8d0-7321-43f7-98de-400df889744f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:40.896216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-40a4a8d0-7321-43f7-98de-400df889744f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:40.917236 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-40a4a8d0-7321-43f7-98de-400df889744f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:40.917943 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-40a4a8d0-7321-43f7-98de-400df889744f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:40.922404 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-40a4a8d0-7321-43f7-98de-400df889744f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:40.923072 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-40a4a8d0-7321-43f7-98de-400df889744f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:40.953800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8dea85b1-c3ac-46d7-9cf4-81532cde63d5 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:39:40.954305 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8dea85b1-c3ac-46d7-9cf4-81532cde63d5 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:39:40.954734 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8dea85b1-c3ac-46d7-9cf4-81532cde63d5 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:39:40.955135 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8dea85b1-c3ac-46d7-9cf4-81532cde63d5 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:39:40.955577 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8dea85b1-c3ac-46d7-9cf4-81532cde63d5 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:39:40.972328 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8dea85b1-c3ac-46d7-9cf4-81532cde63d5 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:40.972796 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8dea85b1-c3ac-46d7-9cf4-81532cde63d5 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:40.973625 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8dea85b1-c3ac-46d7-9cf4-81532cde63d5 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:40.974088 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8dea85b1-c3ac-46d7-9cf4-81532cde63d5 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:41.033015 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-8dea85b1-c3ac-46d7-9cf4-81532cde63d5 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Getting quotas for project ac1d2a34a5c44820a9c34349d9ebf44c. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:39:41.048075 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-8dea85b1-c3ac-46d7-9cf4-81532cde63d5 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Getting quotas for user c33436d7306a48c8bcd8cd82c9466179 and project ac1d2a34a5c44820a9c34349d9ebf44c. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:39:41.078107 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-40a4a8d0-7321-43f7-98de-400df889744f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:41.095128 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-40a4a8d0-7321-43f7-98de-400df889744f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1186 microversion: 2.1 time: 0.199755 Jul 31 01:39:41.095297 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2592/5211] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:40 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1186 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:41.100311 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8dea85b1-c3ac-46d7-9cf4-81532cde63d5 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:39:41.107088 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8dea85b1-c3ac-46d7-9cf4-81532cde63d5 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:39:41.109784 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-35b20095-a840-4d9d-93d6-78ea494f10c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:41.115414 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-35b20095-a840-4d9d-93d6-78ea494f10c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:41.138338 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35b20095-a840-4d9d-93d6-78ea494f10c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:41.142609 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35b20095-a840-4d9d-93d6-78ea494f10c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:41.143814 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35b20095-a840-4d9d-93d6-78ea494f10c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:41.144428 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35b20095-a840-4d9d-93d6-78ea494f10c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:41.244531 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8dea85b1-c3ac-46d7-9cf4-81532cde63d5 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.227865 Jul 31 01:39:41.245198 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2620/5212] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:39:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:39:41.268993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-7b74a0fe-34fd-49d9-832c-06b1168df4c2 req-693512f3-c81c-4b93-b9aa-25a5b5bea105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "tag": "3af2c975-e18d-4f5c-bf75-5d37fd18e383"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:41.291320 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7b74a0fe-34fd-49d9-832c-06b1168df4c2 req-693512f3-c81c-4b93-b9aa-25a5b5bea105 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:41.305765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7b74a0fe-34fd-49d9-832c-06b1168df4c2 req-693512f3-c81c-4b93-b9aa-25a5b5bea105 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:41.340887 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-7b74a0fe-34fd-49d9-832c-06b1168df4c2 req-693512f3-c81c-4b93-b9aa-25a5b5bea105 service nova] Creating event network-changed:3af2c975-e18d-4f5c-bf75-5d37fd18e383 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:39:41.350331 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-7b74a0fe-34fd-49d9-832c-06b1168df4c2 req-693512f3-c81c-4b93-b9aa-25a5b5bea105 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095821 Jul 31 01:39:41.365085 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2621/5213] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:41.372824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-74bff3b8-1894-408e-bff5-132c7b55ce09 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:41.388650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-74bff3b8-1894-408e-bff5-132c7b55ce09 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:41.696387 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-74bff3b8-1894-408e-bff5-132c7b55ce09 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda" status: 200 len: 1328 microversion: 2.1 time: 0.329831 Jul 31 01:39:41.700834 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2622/5214] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:41 2022] GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda => generated 1328 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:41.911398 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f00f5b0f-982e-4d08-8d4f-f960e8502430 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:41.912350 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f00f5b0f-982e-4d08-8d4f-f960e8502430 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:41.925204 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f00f5b0f-982e-4d08-8d4f-f960e8502430 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:41.932113 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f00f5b0f-982e-4d08-8d4f-f960e8502430 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:41.935032 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f00f5b0f-982e-4d08-8d4f-f960e8502430 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:41.939884 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f00f5b0f-982e-4d08-8d4f-f960e8502430 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:42.480641 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-35b20095-a840-4d9d-93d6-78ea494f10c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:42.491548 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-35b20095-a840-4d9d-93d6-78ea494f10c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:42.503244 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-35b20095-a840-4d9d-93d6-78ea494f10c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:42.511066 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-35b20095-a840-4d9d-93d6-78ea494f10c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1750 microversion: 2.20 time: 1.412461 Jul 31 01:39:42.512890 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2593/5215] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:41 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1750 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:42.529336 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f7fef1ef-8baa-48be-b6f0-f16fe32a4817 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:42.532911 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f7fef1ef-8baa-48be-b6f0-f16fe32a4817 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:42.549824 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7fef1ef-8baa-48be-b6f0-f16fe32a4817 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:42.573908 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7fef1ef-8baa-48be-b6f0-f16fe32a4817 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:42.575937 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7fef1ef-8baa-48be-b6f0-f16fe32a4817 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:42.583279 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7fef1ef-8baa-48be-b6f0-f16fe32a4817 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:42.877010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f7fef1ef-8baa-48be-b6f0-f16fe32a4817 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:42.890822 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f7fef1ef-8baa-48be-b6f0-f16fe32a4817 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1186 microversion: 2.1 time: 0.370540 Jul 31 01:39:42.892359 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2594/5216] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:42 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1186 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:42.908898 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6bbfe6e8-ecd6-4d14-add0-86f5b8742ca6 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:42.909814 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6bbfe6e8-ecd6-4d14-add0-86f5b8742ca6 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:42.942305 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6bbfe6e8-ecd6-4d14-add0-86f5b8742ca6 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:42.944298 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6bbfe6e8-ecd6-4d14-add0-86f5b8742ca6 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:42.946190 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6bbfe6e8-ecd6-4d14-add0-86f5b8742ca6 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:42.947445 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6bbfe6e8-ecd6-4d14-add0-86f5b8742ca6 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:42.958768 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f00f5b0f-982e-4d08-8d4f-f960e8502430 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:42.982232 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f00f5b0f-982e-4d08-8d4f-f960e8502430 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:42.987455 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f00f5b0f-982e-4d08-8d4f-f960e8502430 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:42.989006 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f00f5b0f-982e-4d08-8d4f-f960e8502430 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1887 microversion: 2.42 time: 1.081589 Jul 31 01:39:42.989565 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2623/5217] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:41 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1887 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:39:43.351595 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6bbfe6e8-ecd6-4d14-add0-86f5b8742ca6 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda" status: 200 len: 1415 microversion: 2.1 time: 0.453706 Jul 31 01:39:43.368492 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2595/5218] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:42 2022] GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda => generated 1415 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:43.542614 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0e389b59-85fd-4ba0-ad96-19d54d44d5e6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:43.543246 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0e389b59-85fd-4ba0-ad96-19d54d44d5e6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:43.567607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e389b59-85fd-4ba0-ad96-19d54d44d5e6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:43.568072 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e389b59-85fd-4ba0-ad96-19d54d44d5e6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:43.570326 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e389b59-85fd-4ba0-ad96-19d54d44d5e6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:43.581027 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e389b59-85fd-4ba0-ad96-19d54d44d5e6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:43.695635 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-96997580-9bbd-4aa4-acc2-aade0e41c02e req-9b8bc59f-fabb-4bf3-8e35-3b15fb392620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "tag": "9d106083-b7ba-40a6-aaba-56416aac7485"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:43.731717 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-96997580-9bbd-4aa4-acc2-aade0e41c02e req-9b8bc59f-fabb-4bf3-8e35-3b15fb392620 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:43.732556 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-96997580-9bbd-4aa4-acc2-aade0e41c02e req-9b8bc59f-fabb-4bf3-8e35-3b15fb392620 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:43.765652 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-96997580-9bbd-4aa4-acc2-aade0e41c02e req-9b8bc59f-fabb-4bf3-8e35-3b15fb392620 service nova] Creating event network-changed:9d106083-b7ba-40a6-aaba-56416aac7485 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:39:43.773914 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-96997580-9bbd-4aa4-acc2-aade0e41c02e req-9b8bc59f-fabb-4bf3-8e35-3b15fb392620 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082502 Jul 31 01:39:43.778746 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2596/5219] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:43.914352 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8e0c4219-e3ef-4b53-99e5-70ce53535afa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:43.915479 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8e0c4219-e3ef-4b53-99e5-70ce53535afa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:43.924983 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e0c4219-e3ef-4b53-99e5-70ce53535afa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:43.931860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e0c4219-e3ef-4b53-99e5-70ce53535afa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:43.933154 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e0c4219-e3ef-4b53-99e5-70ce53535afa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:43.933832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e0c4219-e3ef-4b53-99e5-70ce53535afa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:44.438559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8e0c4219-e3ef-4b53-99e5-70ce53535afa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:44.451351 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8e0c4219-e3ef-4b53-99e5-70ce53535afa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1186 microversion: 2.1 time: 0.542432 Jul 31 01:39:44.463846 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2597/5220] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:43 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1186 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:44.463846 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7f99b70c-cbb1-4865-bc47-ce374a8457d7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:44.469253 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7f99b70c-cbb1-4865-bc47-ce374a8457d7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:44.482202 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f99b70c-cbb1-4865-bc47-ce374a8457d7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:44.482922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f99b70c-cbb1-4865-bc47-ce374a8457d7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:44.486114 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f99b70c-cbb1-4865-bc47-ce374a8457d7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:44.486870 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f99b70c-cbb1-4865-bc47-ce374a8457d7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:44.851411 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0e389b59-85fd-4ba0-ad96-19d54d44d5e6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:44.867470 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0e389b59-85fd-4ba0-ad96-19d54d44d5e6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:44.869580 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0e389b59-85fd-4ba0-ad96-19d54d44d5e6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:44.874933 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0e389b59-85fd-4ba0-ad96-19d54d44d5e6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 1.337044 Jul 31 01:39:44.892654 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2624/5221] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:43 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:44.899449 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8aa81412-57d0-49e9-bdbc-10697eda8f09 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:44.900353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8aa81412-57d0-49e9-bdbc-10697eda8f09 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:44.911179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8aa81412-57d0-49e9-bdbc-10697eda8f09 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:44.916103 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8aa81412-57d0-49e9-bdbc-10697eda8f09 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:44.917155 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8aa81412-57d0-49e9-bdbc-10697eda8f09 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:44.917782 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8aa81412-57d0-49e9-bdbc-10697eda8f09 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:45.324744 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8aa81412-57d0-49e9-bdbc-10697eda8f09 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda" status: 200 len: 1421 microversion: 2.1 time: 0.430833 Jul 31 01:39:45.325349 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2625/5222] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:44 2022] GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda => generated 1421 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:45.476777 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-56dc6e3d-9eea-4905-bb0c-4ac28e7aa9d0 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:45.477406 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-56dc6e3d-9eea-4905-bb0c-4ac28e7aa9d0 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:45.491727 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56dc6e3d-9eea-4905-bb0c-4ac28e7aa9d0 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:45.493177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56dc6e3d-9eea-4905-bb0c-4ac28e7aa9d0 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:45.494107 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56dc6e3d-9eea-4905-bb0c-4ac28e7aa9d0 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:45.495729 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56dc6e3d-9eea-4905-bb0c-4ac28e7aa9d0 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:45.806452 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-56dc6e3d-9eea-4905-bb0c-4ac28e7aa9d0 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:45.824633 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-56dc6e3d-9eea-4905-bb0c-4ac28e7aa9d0 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1186 microversion: 2.1 time: 0.343152 Jul 31 01:39:45.831936 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2626/5223] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:45 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1186 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:45.887551 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7f99b70c-cbb1-4865-bc47-ce374a8457d7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:45.905610 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3ab6c222-6e36-401c-a1ab-67282a2680ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:45.907378 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3ab6c222-6e36-401c-a1ab-67282a2680ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:45.911590 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7f99b70c-cbb1-4865-bc47-ce374a8457d7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:45.914682 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7f99b70c-cbb1-4865-bc47-ce374a8457d7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:45.919814 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7f99b70c-cbb1-4865-bc47-ce374a8457d7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1887 microversion: 2.42 time: 1.465567 Jul 31 01:39:45.921195 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ab6c222-6e36-401c-a1ab-67282a2680ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:45.921989 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2598/5224] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:44 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1887 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:45.932482 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ab6c222-6e36-401c-a1ab-67282a2680ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:45.943876 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ab6c222-6e36-401c-a1ab-67282a2680ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:45.944772 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ab6c222-6e36-401c-a1ab-67282a2680ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:46.166509 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3ab6c222-6e36-401c-a1ab-67282a2680ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:46.182786 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3ab6c222-6e36-401c-a1ab-67282a2680ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:46.189669 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3ab6c222-6e36-401c-a1ab-67282a2680ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:46.191140 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3ab6c222-6e36-401c-a1ab-67282a2680ed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 0.290199 Jul 31 01:39:46.212155 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2627/5225] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:45 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:46.350878 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3fe306ba-5957-4b8e-86c7-d6cae09b546a tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:46.351800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3fe306ba-5957-4b8e-86c7-d6cae09b546a tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:46.361013 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3fe306ba-5957-4b8e-86c7-d6cae09b546a tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:46.364283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3fe306ba-5957-4b8e-86c7-d6cae09b546a tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:46.365374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3fe306ba-5957-4b8e-86c7-d6cae09b546a tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:46.372143 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3fe306ba-5957-4b8e-86c7-d6cae09b546a tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:46.776038 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3fe306ba-5957-4b8e-86c7-d6cae09b546a tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda" status: 200 len: 1463 microversion: 2.1 time: 0.433441 Jul 31 01:39:46.776711 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2599/5226] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:46 2022] GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda => generated 1463 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:46.849477 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f6f85f35-a9d2-4448-9876-c3473b4b97e5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:46.850348 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f6f85f35-a9d2-4448-9876-c3473b4b97e5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:46.863662 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6f85f35-a9d2-4448-9876-c3473b4b97e5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:46.866319 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6f85f35-a9d2-4448-9876-c3473b4b97e5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:46.867197 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6f85f35-a9d2-4448-9876-c3473b4b97e5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:46.867856 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6f85f35-a9d2-4448-9876-c3473b4b97e5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:46.970393 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-76a94e2f-6db3-4fef-82cd-44077159b131 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:46.975370 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-76a94e2f-6db3-4fef-82cd-44077159b131 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:46.996913 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-76a94e2f-6db3-4fef-82cd-44077159b131 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:46.997381 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-76a94e2f-6db3-4fef-82cd-44077159b131 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:46.998179 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-76a94e2f-6db3-4fef-82cd-44077159b131 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:47.006076 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-76a94e2f-6db3-4fef-82cd-44077159b131 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:47.018688 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f6f85f35-a9d2-4448-9876-c3473b4b97e5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:47.035983 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f6f85f35-a9d2-4448-9876-c3473b4b97e5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1186 microversion: 2.1 time: 0.183615 Jul 31 01:39:47.039218 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2628/5227] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:46 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1186 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:47.089559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-17d84bf0-71f1-47db-9568-94d25abc6e48 req-9ddb4e85-dcb8-4007-aa0e-51c05623c207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "tag": "7f783da2-6e5d-4ff0-ac0c-23f0c6756d36"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:47.118794 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-17d84bf0-71f1-47db-9568-94d25abc6e48 req-9ddb4e85-dcb8-4007-aa0e-51c05623c207 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:47.119766 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-17d84bf0-71f1-47db-9568-94d25abc6e48 req-9ddb4e85-dcb8-4007-aa0e-51c05623c207 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:47.148660 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-17d84bf0-71f1-47db-9568-94d25abc6e48 req-9ddb4e85-dcb8-4007-aa0e-51c05623c207 service nova] Creating event network-changed:7f783da2-6e5d-4ff0-ac0c-23f0c6756d36 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:39:47.177265 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-17d84bf0-71f1-47db-9568-94d25abc6e48 req-9ddb4e85-dcb8-4007-aa0e-51c05623c207 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091609 Jul 31 01:39:47.178605 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2629/5228] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:39:47.220314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ab0fcde9-0302-40b5-acbe-49004a62356f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:47.221471 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ab0fcde9-0302-40b5-acbe-49004a62356f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:47.231438 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab0fcde9-0302-40b5-acbe-49004a62356f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:47.240749 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab0fcde9-0302-40b5-acbe-49004a62356f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:47.242021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab0fcde9-0302-40b5-acbe-49004a62356f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:47.242702 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab0fcde9-0302-40b5-acbe-49004a62356f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:48.476306 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-76a94e2f-6db3-4fef-82cd-44077159b131 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:48.491366 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-76a94e2f-6db3-4fef-82cd-44077159b131 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:48.519248 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-76a94e2f-6db3-4fef-82cd-44077159b131 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:48.521631 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ab0fcde9-0302-40b5-acbe-49004a62356f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:48.525801 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-76a94e2f-6db3-4fef-82cd-44077159b131 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1887 microversion: 2.42 time: 1.579462 Jul 31 01:39:48.528095 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2600/5229] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:46 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1887 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:48.539941 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ab0fcde9-0302-40b5-acbe-49004a62356f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:48.540153 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-719c72dc-1c55-43c1-bfe4-7c9bbd92ca15 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:48.540445 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-719c72dc-1c55-43c1-bfe4-7c9bbd92ca15 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:48.542412 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ab0fcde9-0302-40b5-acbe-49004a62356f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:48.543320 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ab0fcde9-0302-40b5-acbe-49004a62356f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 1.328287 Jul 31 01:39:48.543981 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2630/5230] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:47 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:39:48.563440 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-16f989f2-e24b-40ce-ae51-fcf71f38259e req-ffaeda22-887e-4d5c-a401-74b4739f70bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49debbf0-7cbe-453d-be83-f9a8082e297d", "tag": "acdc6eff-6dd8-4ef1-9582-9c160bc52431"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:48.564236 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-719c72dc-1c55-43c1-bfe4-7c9bbd92ca15 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:48.566487 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-719c72dc-1c55-43c1-bfe4-7c9bbd92ca15 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:48.567492 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-719c72dc-1c55-43c1-bfe4-7c9bbd92ca15 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:48.569383 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-719c72dc-1c55-43c1-bfe4-7c9bbd92ca15 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:48.612533 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-16f989f2-e24b-40ce-ae51-fcf71f38259e req-ffaeda22-887e-4d5c-a401-74b4739f70bb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:48.613159 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-16f989f2-e24b-40ce-ae51-fcf71f38259e req-ffaeda22-887e-4d5c-a401-74b4739f70bb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:48.624665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-719c72dc-1c55-43c1-bfe4-7c9bbd92ca15 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:39:48.648681 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-16f989f2-e24b-40ce-ae51-fcf71f38259e req-ffaeda22-887e-4d5c-a401-74b4739f70bb service nova] Creating event network-changed:acdc6eff-6dd8-4ef1-9582-9c160bc52431 for instance 49debbf0-7cbe-453d-be83-f9a8082e297d on n-h1-master-1 Jul 31 01:39:48.663924 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-16f989f2-e24b-40ce-ae51-fcf71f38259e req-ffaeda22-887e-4d5c-a401-74b4739f70bb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118335 Jul 31 01:39:48.668579 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2631/5231] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:48.679958 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:48.681096 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f6fd16f6-2f2d-4101-959a-3f1407ff8312 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:48.683007 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f6fd16f6-2f2d-4101-959a-3f1407ff8312 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:48.697032 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6fd16f6-2f2d-4101-959a-3f1407ff8312 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:48.699177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6fd16f6-2f2d-4101-959a-3f1407ff8312 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:48.701256 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6fd16f6-2f2d-4101-959a-3f1407ff8312 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:48.702386 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f6fd16f6-2f2d-4101-959a-3f1407ff8312 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:48.712712 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:48.818854 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-719c72dc-1c55-43c1-bfe4-7c9bbd92ca15 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "DELETE /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 204 len: 0 microversion: 2.1 time: 0.284968 Jul 31 01:39:48.825099 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2601/5232] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:39:48 2022] DELETE /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:39:48.833742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8cac0b88-fcc6-4ddb-b384-e9b812c65a02 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:48.834468 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8cac0b88-fcc6-4ddb-b384-e9b812c65a02 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:48.869592 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cac0b88-fcc6-4ddb-b384-e9b812c65a02 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:48.869972 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cac0b88-fcc6-4ddb-b384-e9b812c65a02 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:48.870781 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cac0b88-fcc6-4ddb-b384-e9b812c65a02 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:48.871228 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cac0b88-fcc6-4ddb-b384-e9b812c65a02 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:49.072557 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8cac0b88-fcc6-4ddb-b384-e9b812c65a02 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:49.083670 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8cac0b88-fcc6-4ddb-b384-e9b812c65a02 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1186 microversion: 2.1 time: 0.259816 Jul 31 01:39:49.089285 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2602/5233] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:48 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1186 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:49.099185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f57ccb76-795a-4d63-bcb2-cf8eae8d3c4b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:49.103404 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f57ccb76-795a-4d63-bcb2-cf8eae8d3c4b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:49.117415 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f57ccb76-795a-4d63-bcb2-cf8eae8d3c4b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:49.119759 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f57ccb76-795a-4d63-bcb2-cf8eae8d3c4b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:49.121261 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f57ccb76-795a-4d63-bcb2-cf8eae8d3c4b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:49.124716 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f57ccb76-795a-4d63-bcb2-cf8eae8d3c4b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:49.456919 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f6fd16f6-2f2d-4101-959a-3f1407ff8312 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda" status: 200 len: 1463 microversion: 2.1 time: 0.786843 Jul 31 01:39:49.457479 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2632/5234] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:48 2022] GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda => generated 1463 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:49.502984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f57ccb76-795a-4d63-bcb2-cf8eae8d3c4b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:49.519807 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f57ccb76-795a-4d63-bcb2-cf8eae8d3c4b tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1765 microversion: 2.1 time: 0.427953 Jul 31 01:39:49.524308 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2603/5235] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:49 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1765 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:49.574130 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f61a92b4-fa2d-4089-833f-0a219d2c767a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:49.574990 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f61a92b4-fa2d-4089-833f-0a219d2c767a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:49.583702 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-48a53e07-9804-47ab-be5d-aeb48661fb18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:49.585129 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-48a53e07-9804-47ab-be5d-aeb48661fb18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:49.585269 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f61a92b4-fa2d-4089-833f-0a219d2c767a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:49.586805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f61a92b4-fa2d-4089-833f-0a219d2c767a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:49.589302 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f61a92b4-fa2d-4089-833f-0a219d2c767a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:49.590232 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f61a92b4-fa2d-4089-833f-0a219d2c767a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:49.597497 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48a53e07-9804-47ab-be5d-aeb48661fb18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:49.602341 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48a53e07-9804-47ab-be5d-aeb48661fb18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:49.603744 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48a53e07-9804-47ab-be5d-aeb48661fb18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:49.608883 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48a53e07-9804-47ab-be5d-aeb48661fb18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:49.926762 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f61a92b4-fa2d-4089-833f-0a219d2c767a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:49.966088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f61a92b4-fa2d-4089-833f-0a219d2c767a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:49.975854 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f61a92b4-fa2d-4089-833f-0a219d2c767a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:49.980137 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f61a92b4-fa2d-4089-833f-0a219d2c767a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 0.410014 Jul 31 01:39:50.000476 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2604/5236] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:49 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:39:50.011025 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7ae909b0-578d-4479-9add-b577c790ae88 req-99f58cb6-a830-4d10-ace1-7679d0c8ee5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "tag": "68c780fc-affd-40cd-9df1-e9eb321110a9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:50.031476 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-48a53e07-9804-47ab-be5d-aeb48661fb18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:50.033849 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7ae909b0-578d-4479-9add-b577c790ae88 req-99f58cb6-a830-4d10-ace1-7679d0c8ee5f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:50.034376 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7ae909b0-578d-4479-9add-b577c790ae88 req-99f58cb6-a830-4d10-ace1-7679d0c8ee5f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:50.057282 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7ae909b0-578d-4479-9add-b577c790ae88 req-99f58cb6-a830-4d10-ace1-7679d0c8ee5f service nova] Creating event network-changed:68c780fc-affd-40cd-9df1-e9eb321110a9 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:39:50.066326 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-48a53e07-9804-47ab-be5d-aeb48661fb18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:50.068480 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-48a53e07-9804-47ab-be5d-aeb48661fb18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:50.068662 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7ae909b0-578d-4479-9add-b577c790ae88 req-99f58cb6-a830-4d10-ace1-7679d0c8ee5f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063584 Jul 31 01:39:50.071656 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-48a53e07-9804-47ab-be5d-aeb48661fb18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1887 microversion: 2.42 time: 0.510678 Jul 31 01:39:50.079924 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2605/5237] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:50.087919 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2633/5238] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:49 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1887 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:50.112378 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-18cfc31b-1ec3-48bb-b8a2-9372c327cbb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:50.114361 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-18cfc31b-1ec3-48bb-b8a2-9372c327cbb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:50.122563 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18cfc31b-1ec3-48bb-b8a2-9372c327cbb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:50.123028 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18cfc31b-1ec3-48bb-b8a2-9372c327cbb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:50.123908 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18cfc31b-1ec3-48bb-b8a2-9372c327cbb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:50.124944 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18cfc31b-1ec3-48bb-b8a2-9372c327cbb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:50.247122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-18cfc31b-1ec3-48bb-b8a2-9372c327cbb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:50.262281 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-18cfc31b-1ec3-48bb-b8a2-9372c327cbb3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 200 len: 1186 microversion: 2.1 time: 0.155324 Jul 31 01:39:50.275273 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2606/5239] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:50 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 1186 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:50.479360 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c5b835a5-9cb5-4503-8311-712e9b7cca21 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:50.480814 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c5b835a5-9cb5-4503-8311-712e9b7cca21 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:50.490227 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5b835a5-9cb5-4503-8311-712e9b7cca21 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:50.490577 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5b835a5-9cb5-4503-8311-712e9b7cca21 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:50.491374 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5b835a5-9cb5-4503-8311-712e9b7cca21 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:50.491817 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5b835a5-9cb5-4503-8311-712e9b7cca21 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:50.542858 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d25669db-a942-4473-897f-628e2a3fc121 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:50.543507 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d25669db-a942-4473-897f-628e2a3fc121 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:50.561139 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:50.566322 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d25669db-a942-4473-897f-628e2a3fc121 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:50.585063 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d25669db-a942-4473-897f-628e2a3fc121 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:50.590882 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d25669db-a942-4473-897f-628e2a3fc121 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:50.591125 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d25669db-a942-4473-897f-628e2a3fc121 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:50.973448 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c5b835a5-9cb5-4503-8311-712e9b7cca21 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda" status: 200 len: 1463 microversion: 2.1 time: 0.498524 Jul 31 01:39:50.984686 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2634/5240] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:50 2022] GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda => generated 1463 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:39:50.997723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-40d429cd-16b8-4232-b835-b645ccdce934 req-deb5e03b-fa81-4275-a072-d9013f18df50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "849fa795-7818-42a1-a063-ed2e2381ebda", "tag": "d9819257-f15a-476b-bc6f-17b85d9a15b9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:51.021889 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:51.038532 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-40d429cd-16b8-4232-b835-b645ccdce934 req-deb5e03b-fa81-4275-a072-d9013f18df50 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:51.045142 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-40d429cd-16b8-4232-b835-b645ccdce934 req-deb5e03b-fa81-4275-a072-d9013f18df50 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:51.078381 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-40d429cd-16b8-4232-b835-b645ccdce934 req-deb5e03b-fa81-4275-a072-d9013f18df50 service nova] Creating event network-changed:d9819257-f15a-476b-bc6f-17b85d9a15b9 for instance 849fa795-7818-42a1-a063-ed2e2381ebda on n-h2-master-1 Jul 31 01:39:51.118396 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-40d429cd-16b8-4232-b835-b645ccdce934 req-deb5e03b-fa81-4275-a072-d9013f18df50 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131431 Jul 31 01:39:51.136483 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2635/5241] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:51.160817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-68488174-c9b9-446d-a63a-f768df1f0d47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:51.175438 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-68488174-c9b9-446d-a63a-f768df1f0d47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:51.201307 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-68488174-c9b9-446d-a63a-f768df1f0d47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:51.204950 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-68488174-c9b9-446d-a63a-f768df1f0d47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:51.206143 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-68488174-c9b9-446d-a63a-f768df1f0d47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:51.208229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-68488174-c9b9-446d-a63a-f768df1f0d47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:51.696811 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:51.904575 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d25669db-a942-4473-897f-628e2a3fc121 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:51.923243 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d25669db-a942-4473-897f-628e2a3fc121 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1765 microversion: 2.1 time: 1.379279 Jul 31 01:39:51.924998 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2607/5242] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:50 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1765 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:51.944743 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-59e9b6d7-18e3-4262-a4c8-1cc4f2ee5985 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:51.946175 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-59e9b6d7-18e3-4262-a4c8-1cc4f2ee5985 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:51.975266 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59e9b6d7-18e3-4262-a4c8-1cc4f2ee5985 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:51.983317 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59e9b6d7-18e3-4262-a4c8-1cc4f2ee5985 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:51.984734 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59e9b6d7-18e3-4262-a4c8-1cc4f2ee5985 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:51.987477 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59e9b6d7-18e3-4262-a4c8-1cc4f2ee5985 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:53.082419 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-68488174-c9b9-446d-a63a-f768df1f0d47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:53.105795 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-68488174-c9b9-446d-a63a-f768df1f0d47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:53.111741 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-68488174-c9b9-446d-a63a-f768df1f0d47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:53.123234 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-68488174-c9b9-446d-a63a-f768df1f0d47 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 1.983645 Jul 31 01:39:53.130471 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2636/5243] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:51 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:53.149550 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7e4fc4e-074e-4016-8f8a-3e6e55170935 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:53.162670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a7e4fc4e-074e-4016-8f8a-3e6e55170935 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:53.196281 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7e4fc4e-074e-4016-8f8a-3e6e55170935 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:53.201577 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7e4fc4e-074e-4016-8f8a-3e6e55170935 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:53.206076 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7e4fc4e-074e-4016-8f8a-3e6e55170935 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:53.214872 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7e4fc4e-074e-4016-8f8a-3e6e55170935 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:53.281495 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-a7e4fc4e-074e-4016-8f8a-3e6e55170935 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] HTTP exception thrown: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7e4fc4e-074e-4016-8f8a-3e6e55170935 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Request method failure captured: Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd HTTP/1.1 Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dxSWPHv6fiyygfwJR0Ud9gfexnY8DUg1-8n2-EFdlhief1Py8PV4RaH4l0q6aYBanPQ6exn-4iFCGEMH9hqgo4PPVedzZNUDT2YTEgYd9iPN8Zs4wyM3F4Cgzs_D-0CTqdk8e-lZRIuuB9WjXa7g4L7rW4yad6wf_BUOJQbjcH4WNc Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f0892e5f98e48408d15771c9d5805bf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestVolumeBootPattern-640389583 Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f6c26df9a49446c290d6a0b1427f0c14 Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '254edd9c-2684-432f-bfd7-e8a2342c66fd'} Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:39:53.298593 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:39:53.304826 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:39:53.304826 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:39:53.304826 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:39:53.304826 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:39:53.304826 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:39:53.304826 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. Jul 31 01:39:53.304826 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:39:53.314085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7e4fc4e-074e-4016-8f8a-3e6e55170935 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Returning 404 to user: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:39:53.316411 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a7e4fc4e-074e-4016-8f8a-3e6e55170935 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 404 len: 111 microversion: 2.1 time: 0.179490 Jul 31 01:39:53.323394 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2637/5244] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:53 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:39:53.339562 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-404daca3-90b3-48e4-98a0-d5c62f3b4813 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:53.345717 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-404daca3-90b3-48e4-98a0-d5c62f3b4813 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:53.375079 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-404daca3-90b3-48e4-98a0-d5c62f3b4813 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:53.376205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-404daca3-90b3-48e4-98a0-d5c62f3b4813 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:53.380644 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-404daca3-90b3-48e4-98a0-d5c62f3b4813 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:53.384294 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-404daca3-90b3-48e4-98a0-d5c62f3b4813 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:54.313128 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-59e9b6d7-18e3-4262-a4c8-1cc4f2ee5985 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:54.330711 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-59e9b6d7-18e3-4262-a4c8-1cc4f2ee5985 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:54.337776 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-59e9b6d7-18e3-4262-a4c8-1cc4f2ee5985 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:54.350346 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-59e9b6d7-18e3-4262-a4c8-1cc4f2ee5985 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1887 microversion: 2.42 time: 2.419975 Jul 31 01:39:54.361535 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2608/5245] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:51 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1887 bytes in 2434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:54.372435 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-db6ef877-bc1b-4428-89c6-af46e1c820f2 req-0c1d1cd8-eaae-443d-a2d0-bf4ade78b748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "849fa795-7818-42a1-a063-ed2e2381ebda", "name": "network-vif-plugged", "status": "completed", "tag": "d9819257-f15a-476b-bc6f-17b85d9a15b9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:54.418049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-db6ef877-bc1b-4428-89c6-af46e1c820f2 req-0c1d1cd8-eaae-443d-a2d0-bf4ade78b748 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:54.421096 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-db6ef877-bc1b-4428-89c6-af46e1c820f2 req-0c1d1cd8-eaae-443d-a2d0-bf4ade78b748 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:54.489551 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-db6ef877-bc1b-4428-89c6-af46e1c820f2 req-0c1d1cd8-eaae-443d-a2d0-bf4ade78b748 service nova] Creating event network-vif-plugged:d9819257-f15a-476b-bc6f-17b85d9a15b9 for instance 849fa795-7818-42a1-a063-ed2e2381ebda on n-h2-master-1 Jul 31 01:39:54.505167 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-db6ef877-bc1b-4428-89c6-af46e1c820f2 req-0c1d1cd8-eaae-443d-a2d0-bf4ade78b748 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141877 Jul 31 01:39:54.517663 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2609/5246] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:54.552448 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e0997663-f7bd-48ae-859a-f33b93b1ed8f tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:54.557778 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e0997663-f7bd-48ae-859a-f33b93b1ed8f tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:54.585975 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0997663-f7bd-48ae-859a-f33b93b1ed8f tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:54.589412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0997663-f7bd-48ae-859a-f33b93b1ed8f tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:54.592161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0997663-f7bd-48ae-859a-f33b93b1ed8f tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:54.593666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0997663-f7bd-48ae-859a-f33b93b1ed8f tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:55.343431 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-404daca3-90b3-48e4-98a0-d5c62f3b4813 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda" status: 200 len: 1463 microversion: 2.1 time: 2.008586 Jul 31 01:39:55.345501 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2638/5247] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:53 2022] GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda => generated 1463 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:55.366722 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e0997663-f7bd-48ae-859a-f33b93b1ed8f tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:55.375945 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ebd9cf3e-9182-40c1-a292-a6c9f62fcd5e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:55.384406 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ebd9cf3e-9182-40c1-a292-a6c9f62fcd5e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:55.385755 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e0997663-f7bd-48ae-859a-f33b93b1ed8f tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1646 microversion: 2.1 time: 0.860933 Jul 31 01:39:55.403104 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2610/5248] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:54 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1646 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:55.436375 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cda544d9-f7ae-4742-a1d2-dfbf19a31dfb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:55.439002 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cda544d9-f7ae-4742-a1d2-dfbf19a31dfb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:55.441361 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ebd9cf3e-9182-40c1-a292-a6c9f62fcd5e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:55.445467 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ebd9cf3e-9182-40c1-a292-a6c9f62fcd5e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:55.446574 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ebd9cf3e-9182-40c1-a292-a6c9f62fcd5e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:55.448090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ebd9cf3e-9182-40c1-a292-a6c9f62fcd5e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:55.468349 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cda544d9-f7ae-4742-a1d2-dfbf19a31dfb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:55.474410 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cda544d9-f7ae-4742-a1d2-dfbf19a31dfb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:55.475601 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cda544d9-f7ae-4742-a1d2-dfbf19a31dfb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:55.476263 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cda544d9-f7ae-4742-a1d2-dfbf19a31dfb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:56.531570 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ebd9cf3e-9182-40c1-a292-a6c9f62fcd5e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:56.552835 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ebd9cf3e-9182-40c1-a292-a6c9f62fcd5e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:56.554497 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ebd9cf3e-9182-40c1-a292-a6c9f62fcd5e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:56.573764 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ebd9cf3e-9182-40c1-a292-a6c9f62fcd5e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 1.208226 Jul 31 01:39:56.574501 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2639/5249] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:55 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:56.595924 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e76252e2-fb24-4ea9-8a81-e0074a333b63 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:56.604009 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e76252e2-fb24-4ea9-8a81-e0074a333b63 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:56.614841 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e76252e2-fb24-4ea9-8a81-e0074a333b63 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:56.615313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e76252e2-fb24-4ea9-8a81-e0074a333b63 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:56.616333 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e76252e2-fb24-4ea9-8a81-e0074a333b63 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:56.617096 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e76252e2-fb24-4ea9-8a81-e0074a333b63 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:57.120163 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cda544d9-f7ae-4742-a1d2-dfbf19a31dfb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:57.135950 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cda544d9-f7ae-4742-a1d2-dfbf19a31dfb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:57.147569 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cda544d9-f7ae-4742-a1d2-dfbf19a31dfb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:57.149818 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cda544d9-f7ae-4742-a1d2-dfbf19a31dfb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1887 microversion: 2.42 time: 1.740267 Jul 31 01:39:57.163363 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2611/5250] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:55 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1887 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:57.163363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dd16ce06-3145-4995-a66d-58d2870dd3ec tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:57.163363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dd16ce06-3145-4995-a66d-58d2870dd3ec tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:57.190271 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd16ce06-3145-4995-a66d-58d2870dd3ec tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:57.190777 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd16ce06-3145-4995-a66d-58d2870dd3ec tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:57.191614 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd16ce06-3145-4995-a66d-58d2870dd3ec tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:57.192055 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd16ce06-3145-4995-a66d-58d2870dd3ec tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:57.448777 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dd16ce06-3145-4995-a66d-58d2870dd3ec tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eea5af26928472d920a9cae8cd6131b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e91b99234bbf4863937cc25a97a1d4a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:57.462748 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dd16ce06-3145-4995-a66d-58d2870dd3ec tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 200 len: 1527 microversion: 2.1 time: 0.307757 Jul 31 01:39:57.463724 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2612/5251] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:57 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 1527 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:57.474613 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-86d652f1-c6fb-4306-bc50-37689ca6864f req-bee1ae6d-23b1-4ca8-bbfb-6c98520bc8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49debbf0-7cbe-453d-be83-f9a8082e297d", "name": "network-vif-unplugged", "status": "completed", "tag": "acdc6eff-6dd8-4ef1-9582-9c160bc52431"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:57.526603 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-86d652f1-c6fb-4306-bc50-37689ca6864f req-bee1ae6d-23b1-4ca8-bbfb-6c98520bc8ec service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:57.527246 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-86d652f1-c6fb-4306-bc50-37689ca6864f req-bee1ae6d-23b1-4ca8-bbfb-6c98520bc8ec service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:57.588882 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e76252e2-fb24-4ea9-8a81-e0074a333b63 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda" status: 200 len: 1648 microversion: 2.1 time: 1.008153 Jul 31 01:39:57.601162 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2640/5252] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:56 2022] GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda => generated 1648 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:57.607754 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-354c2482-686f-4604-a22e-64212d9fd5f7 req-fbb20b1a-0985-4aff-8d11-4fb7026d2c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49debbf0-7cbe-453d-be83-f9a8082e297d", "name": "network-vif-deleted", "tag": "acdc6eff-6dd8-4ef1-9582-9c160bc52431"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:57.611611 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-86d652f1-c6fb-4306-bc50-37689ca6864f req-bee1ae6d-23b1-4ca8-bbfb-6c98520bc8ec service nova] Creating event network-vif-unplugged:acdc6eff-6dd8-4ef1-9582-9c160bc52431 for instance 49debbf0-7cbe-453d-be83-f9a8082e297d on n-h1-master-1 Jul 31 01:39:57.640332 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-86d652f1-c6fb-4306-bc50-37689ca6864f req-bee1ae6d-23b1-4ca8-bbfb-6c98520bc8ec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171402 Jul 31 01:39:57.652005 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2613/5253] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:57.658794 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-354c2482-686f-4604-a22e-64212d9fd5f7 req-fbb20b1a-0985-4aff-8d11-4fb7026d2c51 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:57.665024 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dd2017b1-63ec-4779-8ea7-0fd8d5b89252 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:57.667398 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-354c2482-686f-4604-a22e-64212d9fd5f7 req-fbb20b1a-0985-4aff-8d11-4fb7026d2c51 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:57.674704 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dd2017b1-63ec-4779-8ea7-0fd8d5b89252 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:57.697727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd2017b1-63ec-4779-8ea7-0fd8d5b89252 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:57.703916 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd2017b1-63ec-4779-8ea7-0fd8d5b89252 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:57.706635 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd2017b1-63ec-4779-8ea7-0fd8d5b89252 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:57.707306 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd2017b1-63ec-4779-8ea7-0fd8d5b89252 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:57.716365 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-354c2482-686f-4604-a22e-64212d9fd5f7 req-fbb20b1a-0985-4aff-8d11-4fb7026d2c51 service nova] Creating event network-vif-deleted:acdc6eff-6dd8-4ef1-9582-9c160bc52431 for instance 49debbf0-7cbe-453d-be83-f9a8082e297d on n-h1-master-1 Jul 31 01:39:57.725140 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-354c2482-686f-4604-a22e-64212d9fd5f7 req-fbb20b1a-0985-4aff-8d11-4fb7026d2c51 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122339 Jul 31 01:39:57.726626 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2641/5254] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:39:57.739074 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6e20f43c-66a1-4d04-befd-fe4e97a5ac67 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:57.740084 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6e20f43c-66a1-4d04-befd-fe4e97a5ac67 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:57.761658 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e20f43c-66a1-4d04-befd-fe4e97a5ac67 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:57.762120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e20f43c-66a1-4d04-befd-fe4e97a5ac67 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:57.762911 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e20f43c-66a1-4d04-befd-fe4e97a5ac67 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:57.763364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e20f43c-66a1-4d04-befd-fe4e97a5ac67 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:58.253843 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6e20f43c-66a1-4d04-befd-fe4e97a5ac67 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda" status: 200 len: 1648 microversion: 2.1 time: 0.519150 Jul 31 01:39:58.257219 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dd2017b1-63ec-4779-8ea7-0fd8d5b89252 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:58.265022 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2642/5255] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:57 2022] GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda => generated 1648 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:58.277244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0e790fcc-7aae-467f-880e-139378391aa9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:58.280782 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dd2017b1-63ec-4779-8ea7-0fd8d5b89252 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:58.284401 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dd2017b1-63ec-4779-8ea7-0fd8d5b89252 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:58.286070 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dd2017b1-63ec-4779-8ea7-0fd8d5b89252 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 0.632336 Jul 31 01:39:58.287005 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2614/5256] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:57 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:58.294318 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-edf8797e-0cbc-4782-910e-6f2cfa4ae45f tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:58.295722 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-edf8797e-0cbc-4782-910e-6f2cfa4ae45f tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:58.303118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-edf8797e-0cbc-4782-910e-6f2cfa4ae45f tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:58.304125 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-edf8797e-0cbc-4782-910e-6f2cfa4ae45f tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:58.306504 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-edf8797e-0cbc-4782-910e-6f2cfa4ae45f tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:58.308018 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-edf8797e-0cbc-4782-910e-6f2cfa4ae45f tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:58.322824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0e790fcc-7aae-467f-880e-139378391aa9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:58.334638 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:39:58.337927 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e790fcc-7aae-467f-880e-139378391aa9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:58.338387 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e790fcc-7aae-467f-880e-139378391aa9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:58.339177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e790fcc-7aae-467f-880e-139378391aa9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:58.339653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e790fcc-7aae-467f-880e-139378391aa9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:59.099395 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-edf8797e-0cbc-4782-910e-6f2cfa4ae45f tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda" status: 200 len: 1648 microversion: 2.1 time: 0.810963 Jul 31 01:39:59.099991 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2615/5257] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:58 2022] GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda => generated 1648 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:39:59.141574 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2207839d-5011-4149-bdbe-3ccf8aa28ee0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:59.157027 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2207839d-5011-4149-bdbe-3ccf8aa28ee0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] [instance: 49debbf0-7cbe-453d-be83-f9a8082e297d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:59.203906 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2207839d-5011-4149-bdbe-3ccf8aa28ee0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:59.208339 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2207839d-5011-4149-bdbe-3ccf8aa28ee0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:59.213757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2207839d-5011-4149-bdbe-3ccf8aa28ee0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:59.218903 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2207839d-5011-4149-bdbe-3ccf8aa28ee0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:59.297403 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-2207839d-5011-4149-bdbe-3ccf8aa28ee0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] HTTP exception thrown: Instance 49debbf0-7cbe-453d-be83-f9a8082e297d could not be found. Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2207839d-5011-4149-bdbe-3ccf8aa28ee0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Request method failure captured: Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d HTTP/1.1 Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dzRatcxsARnFuDm6kPkA982cfnmdsYir3nDQaGOV-fqshwkcP9ud-twosDYjGfS7prGskqBA_kGU2uLU53_i9RyGVq60Jl2ejzt1mzPlL4Js4q6ZOEf_2zssy2cWS007kOZg9YYyCRz_2hZfG5WhDPr0IoYBn-rktdoMqwLEtcqoMw Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: e91b99234bbf4863937cc25a97a1d4a9 Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-963028503 Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e91b99234bbf4863937cc25a97a1d4a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e91b99234bbf4863937cc25a97a1d4a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e91b99234bbf4863937cc25a97a1d4a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e91b99234bbf4863937cc25a97a1d4a9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestSecurityGroupsBasicOps-963028503 Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: e91b99234bbf4863937cc25a97a1d4a9 Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-963028503 Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestSecurityGroupsBasicOps-963028503-project Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 0eea5af26928472d920a9cae8cd6131b Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestSecurityGroupsBasicOps-963028503-project Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 49debbf0-7cbe-453d-be83-f9a8082e297d could not be found. Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '49debbf0-7cbe-453d-be83-f9a8082e297d'} Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49debbf0-7cbe-453d-be83-f9a8082e297d could not be found. Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49debbf0-7cbe-453d-be83-f9a8082e297d could not be found. Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:39:59.299123 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:39:59.306298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:39:59.306298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:39:59.306298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:39:59.306298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:39:59.306298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:39:59.306298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49debbf0-7cbe-453d-be83-f9a8082e297d could not be found. Jul 31 01:39:59.306298 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:39:59.306298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2207839d-5011-4149-bdbe-3ccf8aa28ee0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Returning 404 to user: Instance 49debbf0-7cbe-453d-be83-f9a8082e297d could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:39:59.306298 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2207839d-5011-4149-bdbe-3ccf8aa28ee0 tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d" status: 404 len: 111 microversion: 2.1 time: 0.175274 Jul 31 01:39:59.306298 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2616/5258] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:39:59 2022] GET /compute/v2.1/servers/49debbf0-7cbe-453d-be83-f9a8082e297d => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:39:59.317418 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-25b01a61-a175-44ab-bcb3-adb677489227 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-714964063", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "availability_zone": "nova:n-h1-master-1", "networks": [{"uuid": "197c4971-91e3-43ca-a312-b527ebbdcc10"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:39:59.359457 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0e790fcc-7aae-467f-880e-139378391aa9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:59.381949 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0e790fcc-7aae-467f-880e-139378391aa9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:59.398532 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0e790fcc-7aae-467f-880e-139378391aa9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:39:59.400259 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0e790fcc-7aae-467f-880e-139378391aa9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1887 microversion: 2.42 time: 1.134189 Jul 31 01:39:59.404711 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2643/5259] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:58 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1887 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:39:59.416408 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-43c3d0ee-a7be-4685-915e-86523f76547e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:39:59.418099 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-43c3d0ee-a7be-4685-915e-86523f76547e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:39:59.427051 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-25b01a61-a175-44ab-bcb3-adb677489227 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] validate_networks() for [('197c4971-91e3-43ca-a312-b527ebbdcc10', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:39:59.478050 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43c3d0ee-a7be-4685-915e-86523f76547e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:59.490897 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43c3d0ee-a7be-4685-915e-86523f76547e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:39:59.492229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43c3d0ee-a7be-4685-915e-86523f76547e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:39:59.492799 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43c3d0ee-a7be-4685-915e-86523f76547e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:00.498851 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-43c3d0ee-a7be-4685-915e-86523f76547e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:00.512522 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-43c3d0ee-a7be-4685-915e-86523f76547e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:00.519002 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-43c3d0ee-a7be-4685-915e-86523f76547e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:00.532894 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-43c3d0ee-a7be-4685-915e-86523f76547e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 1.126474 Jul 31 01:40:00.533782 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2644/5260] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:39:59 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:00.582314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7b5b1899-a81c-4bc4-a4c9-52486ab7968e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:00.582958 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7b5b1899-a81c-4bc4-a4c9-52486ab7968e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:00.614837 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b5b1899-a81c-4bc4-a4c9-52486ab7968e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:00.615307 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b5b1899-a81c-4bc4-a4c9-52486ab7968e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:00.616136 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b5b1899-a81c-4bc4-a4c9-52486ab7968e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:00.616591 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b5b1899-a81c-4bc4-a4c9-52486ab7968e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:01.407418 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7b5b1899-a81c-4bc4-a4c9-52486ab7968e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:01.431005 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7b5b1899-a81c-4bc4-a4c9-52486ab7968e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:01.446586 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7b5b1899-a81c-4bc4-a4c9-52486ab7968e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:01.447847 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7b5b1899-a81c-4bc4-a4c9-52486ab7968e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1887 microversion: 2.42 time: 0.898982 Jul 31 01:40:01.448430 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2645/5261] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:00 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1887 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:01.559940 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-04198a98-ad27-4973-8040-41c0c0cda17b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:01.561933 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-04198a98-ad27-4973-8040-41c0c0cda17b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:01.577086 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04198a98-ad27-4973-8040-41c0c0cda17b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:01.582261 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04198a98-ad27-4973-8040-41c0c0cda17b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:01.593094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04198a98-ad27-4973-8040-41c0c0cda17b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:01.595780 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04198a98-ad27-4973-8040-41c0c0cda17b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:02.039605 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-25b01a61-a175-44ab-bcb3-adb677489227 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:40:02.040742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-25b01a61-a175-44ab-bcb3-adb677489227 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:40:02.041414 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-25b01a61-a175-44ab-bcb3-adb677489227 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:40:02.042065 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-25b01a61-a175-44ab-bcb3-adb677489227 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:40:02.043040 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-25b01a61-a175-44ab-bcb3-adb677489227 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:40:02.060995 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25b01a61-a175-44ab-bcb3-adb677489227 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:02.062775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25b01a61-a175-44ab-bcb3-adb677489227 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:02.064129 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25b01a61-a175-44ab-bcb3-adb677489227 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:02.067363 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25b01a61-a175-44ab-bcb3-adb677489227 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:02.129809 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-25b01a61-a175-44ab-bcb3-adb677489227 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Getting quotas for project ac1d2a34a5c44820a9c34349d9ebf44c. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:40:02.141678 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-25b01a61-a175-44ab-bcb3-adb677489227 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Getting quotas for user c33436d7306a48c8bcd8cd82c9466179 and project ac1d2a34a5c44820a9c34349d9ebf44c. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:40:02.175002 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-25b01a61-a175-44ab-bcb3-adb677489227 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:40:02.177376 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-25b01a61-a175-44ab-bcb3-adb677489227 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:40:02.293214 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-25b01a61-a175-44ab-bcb3-adb677489227 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.990808 Jul 31 01:40:02.300341 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2617/5262] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:39:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:40:02.311821 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bbf60e08-ed99-45d1-8c19-c01986fab290 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:02.312540 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bbf60e08-ed99-45d1-8c19-c01986fab290 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:02.403827 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-04198a98-ad27-4973-8040-41c0c0cda17b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:02.438261 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-04198a98-ad27-4973-8040-41c0c0cda17b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:02.440426 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-04198a98-ad27-4973-8040-41c0c0cda17b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:02.441862 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-04198a98-ad27-4973-8040-41c0c0cda17b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 0.885871 Jul 31 01:40:02.442938 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2646/5263] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:01 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:02.476858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3d0feca6-082e-4e0a-bfbe-b876528d5e7e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:02.478237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3d0feca6-082e-4e0a-bfbe-b876528d5e7e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:02.488424 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d0feca6-082e-4e0a-bfbe-b876528d5e7e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:02.490130 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d0feca6-082e-4e0a-bfbe-b876528d5e7e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:02.494126 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d0feca6-082e-4e0a-bfbe-b876528d5e7e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:02.495158 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d0feca6-082e-4e0a-bfbe-b876528d5e7e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:02.512201 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bbf60e08-ed99-45d1-8c19-c01986fab290 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1328 microversion: 2.1 time: 0.210361 Jul 31 01:40:02.512798 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2618/5264] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:02 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1328 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:03.479130 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fd114d8f-078b-4df5-8837-743b4b1bc24e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:03.480717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fd114d8f-078b-4df5-8837-743b4b1bc24e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:03.498553 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd114d8f-078b-4df5-8837-743b4b1bc24e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:03.502319 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd114d8f-078b-4df5-8837-743b4b1bc24e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:03.504360 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd114d8f-078b-4df5-8837-743b4b1bc24e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:03.506559 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd114d8f-078b-4df5-8837-743b4b1bc24e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:04.147824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3d0feca6-082e-4e0a-bfbe-b876528d5e7e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:04.165967 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3d0feca6-082e-4e0a-bfbe-b876528d5e7e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:04.179551 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3d0feca6-082e-4e0a-bfbe-b876528d5e7e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:04.190833 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3d0feca6-082e-4e0a-bfbe-b876528d5e7e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1887 microversion: 2.42 time: 1.716899 Jul 31 01:40:04.219233 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2647/5265] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:02 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1887 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:40:04.239493 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-afef6cd3-b9c0-4cab-90e9-0a922d3039b7 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:04.244990 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-afef6cd3-b9c0-4cab-90e9-0a922d3039b7 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:04.273691 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-afef6cd3-b9c0-4cab-90e9-0a922d3039b7 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:04.274537 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-afef6cd3-b9c0-4cab-90e9-0a922d3039b7 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:04.275774 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-afef6cd3-b9c0-4cab-90e9-0a922d3039b7 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:04.278278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-afef6cd3-b9c0-4cab-90e9-0a922d3039b7 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:04.517899 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-afef6cd3-b9c0-4cab-90e9-0a922d3039b7 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1415 microversion: 2.1 time: 0.294797 Jul 31 01:40:04.543163 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2648/5266] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:04 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1415 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:04.549181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-99a03716-c31c-4fb4-991a-580b9595b7b2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:04.550018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-99a03716-c31c-4fb4-991a-580b9595b7b2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:04.565701 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99a03716-c31c-4fb4-991a-580b9595b7b2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:04.566503 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99a03716-c31c-4fb4-991a-580b9595b7b2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:04.567722 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99a03716-c31c-4fb4-991a-580b9595b7b2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:04.569457 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-99a03716-c31c-4fb4-991a-580b9595b7b2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:04.581024 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fd114d8f-078b-4df5-8837-743b4b1bc24e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:04.614888 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fd114d8f-078b-4df5-8837-743b4b1bc24e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:04.630742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fd114d8f-078b-4df5-8837-743b4b1bc24e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:04.639563 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fd114d8f-078b-4df5-8837-743b4b1bc24e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 1.161419 Jul 31 01:40:04.643763 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2619/5267] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:03 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:04.659955 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-99a03716-c31c-4fb4-991a-580b9595b7b2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] HTTP exception thrown: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-99a03716-c31c-4fb4-991a-580b9595b7b2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Request method failure captured: Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd HTTP/1.1 Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dxSWPHv6fiyygfwJR0Ud9gfexnY8DUg1-8n2-EFdlhief1Py8PV4RaH4l0q6aYBanPQ6exn-4iFCGEMH9hqgo4PPVedzZNUDT2YTEgYd9iPN8Zs4wyM3F4Cgzs_D-0CTqdk8e-lZRIuuB9WjXa7g4L7rW4yad6wf_BUOJQbjcH4WNc Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f0892e5f98e48408d15771c9d5805bf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestVolumeBootPattern-640389583 Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f6c26df9a49446c290d6a0b1427f0c14 Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '254edd9c-2684-432f-bfd7-e8a2342c66fd'} Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:40:04.662973 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:40:04.667175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. Jul 31 01:40:04.667175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:40:04.667175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:40:04.667175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:40:04.667175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:40:04.667175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:40:04.667175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:40:04.667175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:40:04.667175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:40:04.667175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. Jul 31 01:40:04.667175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:40:04.673460 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-99a03716-c31c-4fb4-991a-580b9595b7b2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Returning 404 to user: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:40:04.674604 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-99a03716-c31c-4fb4-991a-580b9595b7b2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "DELETE /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 404 len: 111 microversion: 2.1 time: 0.130078 Jul 31 01:40:04.675628 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2649/5268] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:40:04 2022] DELETE /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:40:04.685490 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a9564362-fcc3-4ecb-9147-cd5834a819f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:04.686807 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a9564362-fcc3-4ecb-9147-cd5834a819f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 254edd9c-2684-432f-bfd7-e8a2342c66fd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:04.697366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a9564362-fcc3-4ecb-9147-cd5834a819f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:04.698499 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a9564362-fcc3-4ecb-9147-cd5834a819f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:04.699918 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a9564362-fcc3-4ecb-9147-cd5834a819f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:04.700872 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a9564362-fcc3-4ecb-9147-cd5834a819f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:04.728678 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-a9564362-fcc3-4ecb-9147-cd5834a819f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] HTTP exception thrown: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a9564362-fcc3-4ecb-9147-cd5834a819f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Request method failure captured: Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd HTTP/1.1 Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dxSWPHv6fiyygfwJR0Ud9gfexnY8DUg1-8n2-EFdlhief1Py8PV4RaH4l0q6aYBanPQ6exn-4iFCGEMH9hqgo4PPVedzZNUDT2YTEgYd9iPN8Zs4wyM3F4Cgzs_D-0CTqdk8e-lZRIuuB9WjXa7g4L7rW4yad6wf_BUOJQbjcH4WNc Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f0892e5f98e48408d15771c9d5805bf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestVolumeBootPattern-640389583 Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f6c26df9a49446c290d6a0b1427f0c14 Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '254edd9c-2684-432f-bfd7-e8a2342c66fd'} Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:40:04.730538 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:40:04.735079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:40:04.735079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:40:04.735079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:40:04.735079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:40:04.735079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:40:04.735079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. Jul 31 01:40:04.735079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:40:04.739949 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a9564362-fcc3-4ecb-9147-cd5834a819f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Returning 404 to user: Instance 254edd9c-2684-432f-bfd7-e8a2342c66fd could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:40:04.741159 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a9564362-fcc3-4ecb-9147-cd5834a819f4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd" status: 404 len: 111 microversion: 2.1 time: 0.059827 Jul 31 01:40:04.745581 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2620/5269] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:04 2022] GET /compute/v2.1/servers/254edd9c-2684-432f-bfd7-e8a2342c66fd => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:40:05.229073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a2cbc45b-24f3-4777-a78a-6642fa582060 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:05.231325 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a2cbc45b-24f3-4777-a78a-6642fa582060 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:05.275776 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a2cbc45b-24f3-4777-a78a-6642fa582060 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:05.276989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a2cbc45b-24f3-4777-a78a-6642fa582060 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:05.278811 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a2cbc45b-24f3-4777-a78a-6642fa582060 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:05.279718 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a2cbc45b-24f3-4777-a78a-6642fa582060 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:05.543631 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e26da62e-c591-413c-9273-a58de82291df tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:05.544315 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e26da62e-c591-413c-9273-a58de82291df tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:05.559181 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e26da62e-c591-413c-9273-a58de82291df tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:05.559678 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e26da62e-c591-413c-9273-a58de82291df tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:05.563718 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e26da62e-c591-413c-9273-a58de82291df tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:05.564227 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e26da62e-c591-413c-9273-a58de82291df tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:06.077926 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e26da62e-c591-413c-9273-a58de82291df tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1433 microversion: 2.1 time: 0.533735 Jul 31 01:40:06.082036 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2621/5270] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:05 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1433 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:06.103914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4bb39895-b915-4f33-b2fa-71f894636604 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:06.105781 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4bb39895-b915-4f33-b2fa-71f894636604 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:06.137768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4bb39895-b915-4f33-b2fa-71f894636604 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:06.140736 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4bb39895-b915-4f33-b2fa-71f894636604 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:06.147663 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4bb39895-b915-4f33-b2fa-71f894636604 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:06.148362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4bb39895-b915-4f33-b2fa-71f894636604 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:06.236771 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:06.418894 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a2cbc45b-24f3-4777-a78a-6642fa582060 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:06.441331 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a2cbc45b-24f3-4777-a78a-6642fa582060 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:06.445388 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a2cbc45b-24f3-4777-a78a-6642fa582060 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:06.457085 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a2cbc45b-24f3-4777-a78a-6642fa582060 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1887 microversion: 2.42 time: 1.236954 Jul 31 01:40:06.461300 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2650/5271] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:05 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1887 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:06.606079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4bb39895-b915-4f33-b2fa-71f894636604 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:06.623149 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4bb39895-b915-4f33-b2fa-71f894636604 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:06.629329 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4bb39895-b915-4f33-b2fa-71f894636604 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:06.632054 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4bb39895-b915-4f33-b2fa-71f894636604 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 0.546614 Jul 31 01:40:06.650924 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2622/5272] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:06 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:07.107052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5f9509b4-6274-4bed-897b-972cb424f24d tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:07.107717 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5f9509b4-6274-4bed-897b-972cb424f24d tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:07.118913 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5f9509b4-6274-4bed-897b-972cb424f24d tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:07.119409 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5f9509b4-6274-4bed-897b-972cb424f24d tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:07.120212 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5f9509b4-6274-4bed-897b-972cb424f24d tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:07.120666 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5f9509b4-6274-4bed-897b-972cb424f24d tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:07.192456 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:07.416473 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5f9509b4-6274-4bed-897b-972cb424f24d tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1421 microversion: 2.1 time: 0.312637 Jul 31 01:40:07.419167 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2651/5273] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:07 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1421 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:07.493384 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-57dd701b-f84f-4c69-9bd1-887cc6c6f9a9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:07.494881 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-57dd701b-f84f-4c69-9bd1-887cc6c6f9a9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:07.530436 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57dd701b-f84f-4c69-9bd1-887cc6c6f9a9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:07.537880 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57dd701b-f84f-4c69-9bd1-887cc6c6f9a9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:07.542994 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57dd701b-f84f-4c69-9bd1-887cc6c6f9a9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:07.545130 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-57dd701b-f84f-4c69-9bd1-887cc6c6f9a9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:07.658944 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cd2218de-60e8-4f70-b1a5-019ce23960b6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:07.659703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cd2218de-60e8-4f70-b1a5-019ce23960b6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:07.687203 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd2218de-60e8-4f70-b1a5-019ce23960b6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:07.690530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd2218de-60e8-4f70-b1a5-019ce23960b6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:07.699128 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd2218de-60e8-4f70-b1a5-019ce23960b6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:07.699615 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd2218de-60e8-4f70-b1a5-019ce23960b6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:08.348073 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-57dd701b-f84f-4c69-9bd1-887cc6c6f9a9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:08.368215 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-57dd701b-f84f-4c69-9bd1-887cc6c6f9a9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:08.371988 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-57dd701b-f84f-4c69-9bd1-887cc6c6f9a9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:08.376733 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-57dd701b-f84f-4c69-9bd1-887cc6c6f9a9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.891089 Jul 31 01:40:08.394728 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2623/5274] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:07 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:08.443185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-340c3e27-6078-4f1b-acf2-3407a4c7cdee tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:08.444187 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-340c3e27-6078-4f1b-acf2-3407a4c7cdee tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:08.457879 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-340c3e27-6078-4f1b-acf2-3407a4c7cdee tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:08.460304 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-340c3e27-6078-4f1b-acf2-3407a4c7cdee tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:08.461495 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-340c3e27-6078-4f1b-acf2-3407a4c7cdee tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:08.461956 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-340c3e27-6078-4f1b-acf2-3407a4c7cdee tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:08.527323 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cd2218de-60e8-4f70-b1a5-019ce23960b6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:08.545601 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cd2218de-60e8-4f70-b1a5-019ce23960b6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:08.548174 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cd2218de-60e8-4f70-b1a5-019ce23960b6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:08.549437 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cd2218de-60e8-4f70-b1a5-019ce23960b6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 0.895260 Jul 31 01:40:08.550005 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2652/5275] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:07 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:40:08.609851 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-340c3e27-6078-4f1b-acf2-3407a4c7cdee tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1421 microversion: 2.1 time: 0.171820 Jul 31 01:40:08.623050 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2624/5276] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:08 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1421 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:09.403838 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e29929a-210d-4140-8021-eb1fd6164ec8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:09.404348 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1e29929a-210d-4140-8021-eb1fd6164ec8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:09.443758 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e29929a-210d-4140-8021-eb1fd6164ec8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:09.444866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e29929a-210d-4140-8021-eb1fd6164ec8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:09.446016 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e29929a-210d-4140-8021-eb1fd6164ec8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:09.446653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e29929a-210d-4140-8021-eb1fd6164ec8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:09.474283 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-be809651-f435-468e-992c-627b2260dfcc tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] Calling method '.version_select at 0x7fede451e790>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:09.524218 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-be809651-f435-468e-992c-627b2260dfcc tempest-TestSecurityGroupsBasicOps-963028503 tempest-TestSecurityGroupsBasicOps-963028503-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-223026333" status: 202 len: 0 microversion: 2.1 time: 0.054061 Jul 31 01:40:09.525992 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2625/5277] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:40:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-223026333 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 01:40:09.578335 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f7c4d9f2-223a-4e06-961b-e836d4d67107 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:09.578964 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f7c4d9f2-223a-4e06-961b-e836d4d67107 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:09.617181 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7c4d9f2-223a-4e06-961b-e836d4d67107 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:09.617846 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7c4d9f2-223a-4e06-961b-e836d4d67107 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:09.634129 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7c4d9f2-223a-4e06-961b-e836d4d67107 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:09.634632 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7c4d9f2-223a-4e06-961b-e836d4d67107 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:10.146614 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1e29929a-210d-4140-8021-eb1fd6164ec8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:10.163735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1e29929a-210d-4140-8021-eb1fd6164ec8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:10.172043 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1e29929a-210d-4140-8021-eb1fd6164ec8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:10.179032 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1e29929a-210d-4140-8021-eb1fd6164ec8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.778041 Jul 31 01:40:10.181130 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2653/5278] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:09 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:10.195993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f7f6f324-8175-4f12-bf81-c6354515f8fa tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:10.200032 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f7c4d9f2-223a-4e06-961b-e836d4d67107 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:10.211228 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f7c4d9f2-223a-4e06-961b-e836d4d67107 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:10.218685 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f7c4d9f2-223a-4e06-961b-e836d4d67107 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:10.221136 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f7f6f324-8175-4f12-bf81-c6354515f8fa tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:10.227615 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f7c4d9f2-223a-4e06-961b-e836d4d67107 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 0.655709 Jul 31 01:40:10.233867 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2626/5279] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:09 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:10.243368 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7f6f324-8175-4f12-bf81-c6354515f8fa tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:10.245446 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7f6f324-8175-4f12-bf81-c6354515f8fa tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:10.246255 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7f6f324-8175-4f12-bf81-c6354515f8fa tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:10.246709 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7f6f324-8175-4f12-bf81-c6354515f8fa tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:11.019596 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f7f6f324-8175-4f12-bf81-c6354515f8fa tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1463 microversion: 2.1 time: 0.833318 Jul 31 01:40:11.019823 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2654/5280] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:10 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1463 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:11.208734 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d14fa216-a031-4609-b5d1-bce3a9991bcd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:11.209288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d14fa216-a031-4609-b5d1-bce3a9991bcd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:11.218040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d14fa216-a031-4609-b5d1-bce3a9991bcd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:11.224446 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d14fa216-a031-4609-b5d1-bce3a9991bcd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:11.227574 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d14fa216-a031-4609-b5d1-bce3a9991bcd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:11.228145 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d14fa216-a031-4609-b5d1-bce3a9991bcd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:11.254541 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b83f4ed8-6c66-4bd6-9020-014b5c660d89 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:11.255541 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b83f4ed8-6c66-4bd6-9020-014b5c660d89 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:11.271058 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b83f4ed8-6c66-4bd6-9020-014b5c660d89 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:11.273121 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b83f4ed8-6c66-4bd6-9020-014b5c660d89 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:11.274409 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b83f4ed8-6c66-4bd6-9020-014b5c660d89 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:11.278736 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b83f4ed8-6c66-4bd6-9020-014b5c660d89 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:12.040151 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b83f4ed8-6c66-4bd6-9020-014b5c660d89 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:12.057195 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b83f4ed8-6c66-4bd6-9020-014b5c660d89 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:12.058857 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b83f4ed8-6c66-4bd6-9020-014b5c660d89 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:12.059981 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b83f4ed8-6c66-4bd6-9020-014b5c660d89 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 0.809347 Jul 31 01:40:12.067536 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2655/5281] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:11 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:40:12.089185 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-26428a78-3bf4-4c3c-a5df-823e88e8898b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:12.090633 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-26428a78-3bf4-4c3c-a5df-823e88e8898b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:12.100753 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-26428a78-3bf4-4c3c-a5df-823e88e8898b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:12.101721 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-26428a78-3bf4-4c3c-a5df-823e88e8898b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:12.102759 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-26428a78-3bf4-4c3c-a5df-823e88e8898b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:12.103464 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-26428a78-3bf4-4c3c-a5df-823e88e8898b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:12.110048 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:12.126039 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d14fa216-a031-4609-b5d1-bce3a9991bcd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:12.140132 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d14fa216-a031-4609-b5d1-bce3a9991bcd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:12.142798 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d14fa216-a031-4609-b5d1-bce3a9991bcd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:12.148562 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d14fa216-a031-4609-b5d1-bce3a9991bcd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.944107 Jul 31 01:40:12.152438 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2627/5282] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:11 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:12.364216 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-26428a78-3bf4-4c3c-a5df-823e88e8898b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1463 microversion: 2.1 time: 0.283066 Jul 31 01:40:12.372248 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2656/5283] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:12 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1463 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:12.417537 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-43dc5e72-fcb3-4b2f-b22a-014f150f8d1b req-d82631a9-28f7-4818-8b94-a24b053eae02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce0d125-f1ce-4c2d-81fa-632612f82c73", "tag": "ffe6d3af-7ef9-423b-b253-f037ec9c8300"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:12.433952 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-43dc5e72-fcb3-4b2f-b22a-014f150f8d1b req-d82631a9-28f7-4818-8b94-a24b053eae02 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:12.436784 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-43dc5e72-fcb3-4b2f-b22a-014f150f8d1b req-d82631a9-28f7-4818-8b94-a24b053eae02 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:12.463745 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-43dc5e72-fcb3-4b2f-b22a-014f150f8d1b req-d82631a9-28f7-4818-8b94-a24b053eae02 service nova] Creating event network-changed:ffe6d3af-7ef9-423b-b253-f037ec9c8300 for instance bce0d125-f1ce-4c2d-81fa-632612f82c73 on n-h1-master-1 Jul 31 01:40:12.478743 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-43dc5e72-fcb3-4b2f-b22a-014f150f8d1b req-d82631a9-28f7-4818-8b94-a24b053eae02 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065651 Jul 31 01:40:12.480308 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2628/5284] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:40:13.096597 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-295091ed-4be7-4514-883b-41b163d3bf82 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:13.097550 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-295091ed-4be7-4514-883b-41b163d3bf82 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:13.114858 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-295091ed-4be7-4514-883b-41b163d3bf82 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:13.115871 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-295091ed-4be7-4514-883b-41b163d3bf82 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:13.117532 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-295091ed-4be7-4514-883b-41b163d3bf82 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:13.118200 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-295091ed-4be7-4514-883b-41b163d3bf82 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:13.177452 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=8 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:13.183017 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0957e49b-1e19-4535-98d3-8a3ac54043de tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:13.188864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0957e49b-1e19-4535-98d3-8a3ac54043de tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:13.224315 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0957e49b-1e19-4535-98d3-8a3ac54043de tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:13.224854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0957e49b-1e19-4535-98d3-8a3ac54043de tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:13.225665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0957e49b-1e19-4535-98d3-8a3ac54043de tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:13.227937 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0957e49b-1e19-4535-98d3-8a3ac54043de tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:14.318419 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-295091ed-4be7-4514-883b-41b163d3bf82 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:14.350138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-295091ed-4be7-4514-883b-41b163d3bf82 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:14.359816 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-295091ed-4be7-4514-883b-41b163d3bf82 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:14.382849 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-295091ed-4be7-4514-883b-41b163d3bf82 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 1.288748 Jul 31 01:40:14.383972 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2657/5285] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:13 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:14.402370 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eb72102b-ccf9-4242-8aac-c457605aab89 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:14.406588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eb72102b-ccf9-4242-8aac-c457605aab89 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:14.437372 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb72102b-ccf9-4242-8aac-c457605aab89 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:14.439760 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb72102b-ccf9-4242-8aac-c457605aab89 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:14.442229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb72102b-ccf9-4242-8aac-c457605aab89 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:14.446354 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb72102b-ccf9-4242-8aac-c457605aab89 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:14.584237 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0957e49b-1e19-4535-98d3-8a3ac54043de tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:14.599224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0957e49b-1e19-4535-98d3-8a3ac54043de tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:14.602192 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0957e49b-1e19-4535-98d3-8a3ac54043de tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:14.605200 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0957e49b-1e19-4535-98d3-8a3ac54043de tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 1.427524 Jul 31 01:40:14.610107 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2629/5286] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:13 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:15.009989 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eb72102b-ccf9-4242-8aac-c457605aab89 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1463 microversion: 2.1 time: 0.622113 Jul 31 01:40:15.010598 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2658/5287] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:14 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1463 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:15.410223 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a058a4fa-6886-493a-9974-b4f319020be2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:15.411074 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a058a4fa-6886-493a-9974-b4f319020be2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:15.449375 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a058a4fa-6886-493a-9974-b4f319020be2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:15.451308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a058a4fa-6886-493a-9974-b4f319020be2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:15.454606 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a058a4fa-6886-493a-9974-b4f319020be2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:15.455324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a058a4fa-6886-493a-9974-b4f319020be2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:15.635689 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-db3fd3bb-96e2-4308-9eb4-993c328ebe03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:15.637010 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-db3fd3bb-96e2-4308-9eb4-993c328ebe03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:15.655661 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db3fd3bb-96e2-4308-9eb4-993c328ebe03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:15.656397 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db3fd3bb-96e2-4308-9eb4-993c328ebe03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:15.658107 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db3fd3bb-96e2-4308-9eb4-993c328ebe03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:15.660470 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db3fd3bb-96e2-4308-9eb4-993c328ebe03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:15.789384 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a058a4fa-6886-493a-9974-b4f319020be2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:15.806309 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a058a4fa-6886-493a-9974-b4f319020be2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:15.808751 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a058a4fa-6886-493a-9974-b4f319020be2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:15.809973 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a058a4fa-6886-493a-9974-b4f319020be2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 0.403866 Jul 31 01:40:15.810688 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2630/5288] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:15 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:15.815952 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-c19d94ad-a1e8-4af7-82e9-2f6db41bead2 req-75567465-cd75-49cf-91b0-49f74e88aae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b00bb6-bfdc-4ddc-bfd7-dc53016544bd", "name": "network-vif-plugged", "status": "completed", "tag": "b03d8e12-2d7a-43c2-a2c3-344746d2f716"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:15.848035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c19d94ad-a1e8-4af7-82e9-2f6db41bead2 req-75567465-cd75-49cf-91b0-49f74e88aae1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:15.848741 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c19d94ad-a1e8-4af7-82e9-2f6db41bead2 req-75567465-cd75-49cf-91b0-49f74e88aae1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:15.884268 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-c19d94ad-a1e8-4af7-82e9-2f6db41bead2 req-75567465-cd75-49cf-91b0-49f74e88aae1 service nova] Creating event network-vif-plugged:b03d8e12-2d7a-43c2-a2c3-344746d2f716 for instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd on n-h1-master-1 Jul 31 01:40:15.898748 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-c19d94ad-a1e8-4af7-82e9-2f6db41bead2 req-75567465-cd75-49cf-91b0-49f74e88aae1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086051 Jul 31 01:40:15.900483 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2631/5289] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:40:16.036688 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-db8cd7ac-27e3-43b5-817d-95d73cb4a713 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:16.038404 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-db8cd7ac-27e3-43b5-817d-95d73cb4a713 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:16.055854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db8cd7ac-27e3-43b5-817d-95d73cb4a713 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:16.057298 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db8cd7ac-27e3-43b5-817d-95d73cb4a713 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:16.059293 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db8cd7ac-27e3-43b5-817d-95d73cb4a713 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:16.062302 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db8cd7ac-27e3-43b5-817d-95d73cb4a713 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:16.277668 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-db3fd3bb-96e2-4308-9eb4-993c328ebe03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:16.290147 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-db3fd3bb-96e2-4308-9eb4-993c328ebe03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:16.300808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-db3fd3bb-96e2-4308-9eb4-993c328ebe03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:16.306772 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-db3fd3bb-96e2-4308-9eb4-993c328ebe03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.676222 Jul 31 01:40:16.307452 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2659/5290] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:15 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:16.447722 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-db8cd7ac-27e3-43b5-817d-95d73cb4a713 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1463 microversion: 2.1 time: 0.409220 Jul 31 01:40:16.449780 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2632/5291] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:16 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1463 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:16.837054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5d56202b-1a57-4e6f-bf10-efa8bcefc373 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:16.838259 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5d56202b-1a57-4e6f-bf10-efa8bcefc373 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:16.858589 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d56202b-1a57-4e6f-bf10-efa8bcefc373 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:16.859254 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d56202b-1a57-4e6f-bf10-efa8bcefc373 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:16.861540 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d56202b-1a57-4e6f-bf10-efa8bcefc373 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:16.863654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d56202b-1a57-4e6f-bf10-efa8bcefc373 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:17.118480 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5d56202b-1a57-4e6f-bf10-efa8bcefc373 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:17.131961 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5d56202b-1a57-4e6f-bf10-efa8bcefc373 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:17.133951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5d56202b-1a57-4e6f-bf10-efa8bcefc373 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:17.135254 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5d56202b-1a57-4e6f-bf10-efa8bcefc373 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 0.303347 Jul 31 01:40:17.136483 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2660/5292] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:16 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:17.335046 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d0038ebf-911b-4483-8f96-0b0485a20321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:17.336081 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d0038ebf-911b-4483-8f96-0b0485a20321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:17.344378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0038ebf-911b-4483-8f96-0b0485a20321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:17.345137 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0038ebf-911b-4483-8f96-0b0485a20321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:17.347136 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0038ebf-911b-4483-8f96-0b0485a20321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:17.349898 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0038ebf-911b-4483-8f96-0b0485a20321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:17.474427 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2748c355-7d1e-4e88-8913-85d43bd43f41 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:17.475315 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2748c355-7d1e-4e88-8913-85d43bd43f41 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:17.504713 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2748c355-7d1e-4e88-8913-85d43bd43f41 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:17.507039 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2748c355-7d1e-4e88-8913-85d43bd43f41 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:17.512804 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2748c355-7d1e-4e88-8913-85d43bd43f41 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:17.521602 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2748c355-7d1e-4e88-8913-85d43bd43f41 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:17.938421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d0038ebf-911b-4483-8f96-0b0485a20321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:17.957120 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d0038ebf-911b-4483-8f96-0b0485a20321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:17.961579 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d0038ebf-911b-4483-8f96-0b0485a20321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:17.966282 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d0038ebf-911b-4483-8f96-0b0485a20321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.633863 Jul 31 01:40:17.985743 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2633/5293] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:17 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:18.082041 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2748c355-7d1e-4e88-8913-85d43bd43f41 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1463 microversion: 2.1 time: 0.612409 Jul 31 01:40:18.098024 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2661/5294] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:17 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1463 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:18.163421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0f76e9c7-e411-4e9d-8ed7-d7602f273ebd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:18.164346 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0f76e9c7-e411-4e9d-8ed7-d7602f273ebd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:18.175545 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f76e9c7-e411-4e9d-8ed7-d7602f273ebd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:18.176983 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f76e9c7-e411-4e9d-8ed7-d7602f273ebd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:18.179538 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f76e9c7-e411-4e9d-8ed7-d7602f273ebd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:18.180704 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f76e9c7-e411-4e9d-8ed7-d7602f273ebd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:18.466564 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0f76e9c7-e411-4e9d-8ed7-d7602f273ebd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:18.490638 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0f76e9c7-e411-4e9d-8ed7-d7602f273ebd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:18.500745 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0f76e9c7-e411-4e9d-8ed7-d7602f273ebd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:18.504039 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0f76e9c7-e411-4e9d-8ed7-d7602f273ebd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 0.344390 Jul 31 01:40:18.505222 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2634/5295] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:18 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:19.006121 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1aa4f946-23f7-4a02-802c-cd37f6808c22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:19.006752 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1aa4f946-23f7-4a02-802c-cd37f6808c22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:19.027461 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1aa4f946-23f7-4a02-802c-cd37f6808c22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:19.031142 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1aa4f946-23f7-4a02-802c-cd37f6808c22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:19.032325 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1aa4f946-23f7-4a02-802c-cd37f6808c22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:19.040167 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1aa4f946-23f7-4a02-802c-cd37f6808c22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:19.107118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dee2f519-45d0-4a79-a071-dcf1b728ee03 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:19.108268 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dee2f519-45d0-4a79-a071-dcf1b728ee03 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:19.135636 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dee2f519-45d0-4a79-a071-dcf1b728ee03 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:19.139890 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dee2f519-45d0-4a79-a071-dcf1b728ee03 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:19.143220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dee2f519-45d0-4a79-a071-dcf1b728ee03 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:19.147569 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dee2f519-45d0-4a79-a071-dcf1b728ee03 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:19.883192 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1aa4f946-23f7-4a02-802c-cd37f6808c22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:19.898284 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1aa4f946-23f7-4a02-802c-cd37f6808c22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:19.900801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1aa4f946-23f7-4a02-802c-cd37f6808c22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:19.902204 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1aa4f946-23f7-4a02-802c-cd37f6808c22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.912083 Jul 31 01:40:19.921691 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2662/5296] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:18 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:19.929006 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e98cec8e-f4a8-4566-80d0-5203ed6b5bd4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:19.929870 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e98cec8e-f4a8-4566-80d0-5203ed6b5bd4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:19.938601 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e98cec8e-f4a8-4566-80d0-5203ed6b5bd4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:19.939994 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e98cec8e-f4a8-4566-80d0-5203ed6b5bd4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:19.942283 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e98cec8e-f4a8-4566-80d0-5203ed6b5bd4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:19.943489 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e98cec8e-f4a8-4566-80d0-5203ed6b5bd4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:19.983375 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dee2f519-45d0-4a79-a071-dcf1b728ee03 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1463 microversion: 2.1 time: 0.881580 Jul 31 01:40:20.005943 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2635/5297] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:19 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1463 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:20.282209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e98cec8e-f4a8-4566-80d0-5203ed6b5bd4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:20.299530 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e98cec8e-f4a8-4566-80d0-5203ed6b5bd4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:20.301617 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e98cec8e-f4a8-4566-80d0-5203ed6b5bd4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:20.303061 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e98cec8e-f4a8-4566-80d0-5203ed6b5bd4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1806 microversion: 2.20 time: 0.379517 Jul 31 01:40:20.304094 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2663/5298] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:19 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1806 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:20.929838 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c59b6f16-97ba-4198-b88f-0edd6e43a613 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:20.930270 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c59b6f16-97ba-4198-b88f-0edd6e43a613 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:20.933133 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:20.944366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c59b6f16-97ba-4198-b88f-0edd6e43a613 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:20.944870 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c59b6f16-97ba-4198-b88f-0edd6e43a613 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:20.945634 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c59b6f16-97ba-4198-b88f-0edd6e43a613 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:20.946080 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c59b6f16-97ba-4198-b88f-0edd6e43a613 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:21.015439 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-285781c0-8bb2-4026-88d5-c35cd6e61325 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:21.016558 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-285781c0-8bb2-4026-88d5-c35cd6e61325 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:21.029423 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-285781c0-8bb2-4026-88d5-c35cd6e61325 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:21.031979 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-285781c0-8bb2-4026-88d5-c35cd6e61325 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:21.037598 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-285781c0-8bb2-4026-88d5-c35cd6e61325 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:21.038443 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-285781c0-8bb2-4026-88d5-c35cd6e61325 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:21.283010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c59b6f16-97ba-4198-b88f-0edd6e43a613 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:21.303600 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c59b6f16-97ba-4198-b88f-0edd6e43a613 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:21.309450 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c59b6f16-97ba-4198-b88f-0edd6e43a613 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:21.312999 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c59b6f16-97ba-4198-b88f-0edd6e43a613 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.387372 Jul 31 01:40:21.316441 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2636/5299] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:20 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:40:21.333326 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e7bf72af-4ae4-4070-9a8e-4abc05cd034d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:21.334370 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e7bf72af-4ae4-4070-9a8e-4abc05cd034d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:21.349321 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7bf72af-4ae4-4070-9a8e-4abc05cd034d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:21.350031 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7bf72af-4ae4-4070-9a8e-4abc05cd034d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:21.350995 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7bf72af-4ae4-4070-9a8e-4abc05cd034d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:21.354530 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7bf72af-4ae4-4070-9a8e-4abc05cd034d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:21.708044 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-285781c0-8bb2-4026-88d5-c35cd6e61325 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1463 microversion: 2.1 time: 0.694934 Jul 31 01:40:21.727181 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2664/5300] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:21 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1463 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:40:21.816161 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e7bf72af-4ae4-4070-9a8e-4abc05cd034d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:21.824781 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e7bf72af-4ae4-4070-9a8e-4abc05cd034d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:21.832976 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e7bf72af-4ae4-4070-9a8e-4abc05cd034d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:21.834245 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e7bf72af-4ae4-4070-9a8e-4abc05cd034d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1793 microversion: 2.20 time: 0.504741 Jul 31 01:40:21.834820 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2637/5301] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:21 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1793 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:22.294911 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-3af24879-d546-414d-8bbd-7e84c8bb8a0b req-3bfae2f4-0811-4cbc-89a6-4a430a7cf897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce0d125-f1ce-4c2d-81fa-632612f82c73", "name": "network-vif-plugged", "status": "completed", "tag": "ffe6d3af-7ef9-423b-b253-f037ec9c8300"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:22.321384 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3af24879-d546-414d-8bbd-7e84c8bb8a0b req-3bfae2f4-0811-4cbc-89a6-4a430a7cf897 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:22.322724 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3af24879-d546-414d-8bbd-7e84c8bb8a0b req-3bfae2f4-0811-4cbc-89a6-4a430a7cf897 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:22.343184 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e3c3b9ef-91ab-42c5-8a85-82602c280b24 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:22.344209 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e3c3b9ef-91ab-42c5-8a85-82602c280b24 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:22.364932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3c3b9ef-91ab-42c5-8a85-82602c280b24 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:22.368206 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3c3b9ef-91ab-42c5-8a85-82602c280b24 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:22.369062 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3c3b9ef-91ab-42c5-8a85-82602c280b24 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:22.369514 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3c3b9ef-91ab-42c5-8a85-82602c280b24 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:22.396261 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-3af24879-d546-414d-8bbd-7e84c8bb8a0b req-3bfae2f4-0811-4cbc-89a6-4a430a7cf897 service nova] Creating event network-vif-plugged:ffe6d3af-7ef9-423b-b253-f037ec9c8300 for instance bce0d125-f1ce-4c2d-81fa-632612f82c73 on n-h1-master-1 Jul 31 01:40:22.414696 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-3af24879-d546-414d-8bbd-7e84c8bb8a0b req-3bfae2f4-0811-4cbc-89a6-4a430a7cf897 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125192 Jul 31 01:40:22.423280 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2665/5302] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:40:22.739517 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d9fbfc3a-2f4c-4a99-8a0c-63cdd4faa04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:22.740771 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d9fbfc3a-2f4c-4a99-8a0c-63cdd4faa04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:22.772708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9fbfc3a-2f4c-4a99-8a0c-63cdd4faa04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:22.773255 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9fbfc3a-2f4c-4a99-8a0c-63cdd4faa04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:22.774103 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9fbfc3a-2f4c-4a99-8a0c-63cdd4faa04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:22.774556 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9fbfc3a-2f4c-4a99-8a0c-63cdd4faa04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:23.245415 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e3c3b9ef-91ab-42c5-8a85-82602c280b24 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:23.258788 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e3c3b9ef-91ab-42c5-8a85-82602c280b24 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:23.265138 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e3c3b9ef-91ab-42c5-8a85-82602c280b24 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:23.272466 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e3c3b9ef-91ab-42c5-8a85-82602c280b24 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.935415 Jul 31 01:40:23.273274 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2638/5303] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:22 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:23.304708 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d9fbfc3a-2f4c-4a99-8a0c-63cdd4faa04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1463 microversion: 2.1 time: 0.572128 Jul 31 01:40:23.307128 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2666/5304] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:22 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1463 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:24.300827 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-538697a9-f753-4bba-bdf1-5eeb59284d47 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:24.302010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-538697a9-f753-4bba-bdf1-5eeb59284d47 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:24.338358 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7f8f1818-238e-424c-b8c0-d41d9a4a98f2 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:24.338994 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7f8f1818-238e-424c-b8c0-d41d9a4a98f2 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:24.348334 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-538697a9-f753-4bba-bdf1-5eeb59284d47 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:24.353052 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f8f1818-238e-424c-b8c0-d41d9a4a98f2 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:24.353203 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f8f1818-238e-424c-b8c0-d41d9a4a98f2 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:24.353990 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f8f1818-238e-424c-b8c0-d41d9a4a98f2 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:24.354568 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-538697a9-f753-4bba-bdf1-5eeb59284d47 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:24.368597 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-538697a9-f753-4bba-bdf1-5eeb59284d47 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:24.369370 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-538697a9-f753-4bba-bdf1-5eeb59284d47 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:24.371478 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f8f1818-238e-424c-b8c0-d41d9a4a98f2 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:24.974249 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-538697a9-f753-4bba-bdf1-5eeb59284d47 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:24.990668 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-538697a9-f753-4bba-bdf1-5eeb59284d47 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:24.992256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-538697a9-f753-4bba-bdf1-5eeb59284d47 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:24.993817 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-538697a9-f753-4bba-bdf1-5eeb59284d47 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.698896 Jul 31 01:40:24.994404 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2639/5305] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:24 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:25.034049 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7f8f1818-238e-424c-b8c0-d41d9a4a98f2 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1463 microversion: 2.1 time: 0.704329 Jul 31 01:40:25.034688 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2667/5306] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:24 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1463 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:26.033982 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3694cebd-51f5-42c6-9b6c-e4ee5fa3b80c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:26.036535 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3694cebd-51f5-42c6-9b6c-e4ee5fa3b80c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:26.065517 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b8388fd1-1bb6-400b-bd83-4330b733c13b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:26.066832 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b8388fd1-1bb6-400b-bd83-4330b733c13b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:26.071257 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3694cebd-51f5-42c6-9b6c-e4ee5fa3b80c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:26.071755 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3694cebd-51f5-42c6-9b6c-e4ee5fa3b80c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:26.072567 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3694cebd-51f5-42c6-9b6c-e4ee5fa3b80c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:26.073088 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3694cebd-51f5-42c6-9b6c-e4ee5fa3b80c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:26.100940 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b8388fd1-1bb6-400b-bd83-4330b733c13b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:26.104295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b8388fd1-1bb6-400b-bd83-4330b733c13b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:26.107941 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b8388fd1-1bb6-400b-bd83-4330b733c13b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:26.108760 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b8388fd1-1bb6-400b-bd83-4330b733c13b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:26.634011 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:26.643106 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b8388fd1-1bb6-400b-bd83-4330b733c13b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1649 microversion: 2.1 time: 0.588756 Jul 31 01:40:26.644881 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2668/5307] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:26 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1649 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:26.666767 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1afa482f-9557-4512-a5be-7760cb57b6ed tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:26.668947 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1afa482f-9557-4512-a5be-7760cb57b6ed tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:26.696476 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1afa482f-9557-4512-a5be-7760cb57b6ed tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:26.700482 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1afa482f-9557-4512-a5be-7760cb57b6ed tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:26.701443 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1afa482f-9557-4512-a5be-7760cb57b6ed tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:26.704525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1afa482f-9557-4512-a5be-7760cb57b6ed tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:26.711493 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3694cebd-51f5-42c6-9b6c-e4ee5fa3b80c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:26.730919 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3694cebd-51f5-42c6-9b6c-e4ee5fa3b80c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:26.740165 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3694cebd-51f5-42c6-9b6c-e4ee5fa3b80c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:26.741398 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3694cebd-51f5-42c6-9b6c-e4ee5fa3b80c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.721509 Jul 31 01:40:26.746739 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2640/5308] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:26 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:40:26.917896 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1afa482f-9557-4512-a5be-7760cb57b6ed tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1649 microversion: 2.1 time: 0.255531 Jul 31 01:40:26.932861 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2669/5309] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:26 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1649 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:26.939756 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-376b6500-48e5-4db8-b461-297a4e06c3a3 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:26.940903 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-376b6500-48e5-4db8-b461-297a4e06c3a3 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:26.948268 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-376b6500-48e5-4db8-b461-297a4e06c3a3 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:26.948932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-376b6500-48e5-4db8-b461-297a4e06c3a3 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:26.949894 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-376b6500-48e5-4db8-b461-297a4e06c3a3 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:26.950490 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-376b6500-48e5-4db8-b461-297a4e06c3a3 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:26.983413 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:27.233377 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-376b6500-48e5-4db8-b461-297a4e06c3a3 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1649 microversion: 2.1 time: 0.297448 Jul 31 01:40:27.248788 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2641/5310] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:26 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1649 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:27.258765 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-03e894b0-ab12-476f-a627-836297c2749c tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:27.259881 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-03e894b0-ab12-476f-a627-836297c2749c tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:27.270499 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03e894b0-ab12-476f-a627-836297c2749c tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:27.274479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03e894b0-ab12-476f-a627-836297c2749c tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:27.275757 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03e894b0-ab12-476f-a627-836297c2749c tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:27.276390 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03e894b0-ab12-476f-a627-836297c2749c tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:27.341543 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-03e894b0-ab12-476f-a627-836297c2749c tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:40:27.580879 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-03e894b0-ab12-476f-a627-836297c2749c tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "DELETE /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 204 len: 0 microversion: 2.1 time: 0.325837 Jul 31 01:40:27.583397 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2670/5311] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:40:27 2022] DELETE /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:40:27.591720 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f08bd700-f727-48a9-b822-8e8ce94e31bf tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:27.592982 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f08bd700-f727-48a9-b822-8e8ce94e31bf tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:27.604861 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f08bd700-f727-48a9-b822-8e8ce94e31bf tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:27.606363 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f08bd700-f727-48a9-b822-8e8ce94e31bf tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:27.612329 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f08bd700-f727-48a9-b822-8e8ce94e31bf tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:27.613492 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f08bd700-f727-48a9-b822-8e8ce94e31bf tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:27.775936 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fe6236f1-07b8-4fbb-9fd7-d2e1b0cf2239 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:27.777060 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fe6236f1-07b8-4fbb-9fd7-d2e1b0cf2239 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:27.809367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe6236f1-07b8-4fbb-9fd7-d2e1b0cf2239 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:27.810053 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe6236f1-07b8-4fbb-9fd7-d2e1b0cf2239 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:27.812057 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe6236f1-07b8-4fbb-9fd7-d2e1b0cf2239 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:27.812862 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe6236f1-07b8-4fbb-9fd7-d2e1b0cf2239 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:27.872660 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f08bd700-f727-48a9-b822-8e8ce94e31bf tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1655 microversion: 2.1 time: 0.284826 Jul 31 01:40:27.878067 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2642/5312] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:27 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1655 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:28.250823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fe6236f1-07b8-4fbb-9fd7-d2e1b0cf2239 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:28.265195 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fe6236f1-07b8-4fbb-9fd7-d2e1b0cf2239 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:28.271001 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fe6236f1-07b8-4fbb-9fd7-d2e1b0cf2239 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:28.274117 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fe6236f1-07b8-4fbb-9fd7-d2e1b0cf2239 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.511258 Jul 31 01:40:28.276469 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2671/5313] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:27 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:40:28.898146 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2136d9da-a946-4edd-876d-ffcf702fac40 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:28.899271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2136d9da-a946-4edd-876d-ffcf702fac40 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:28.914308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2136d9da-a946-4edd-876d-ffcf702fac40 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:28.916438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2136d9da-a946-4edd-876d-ffcf702fac40 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:28.917447 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2136d9da-a946-4edd-876d-ffcf702fac40 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:28.919816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2136d9da-a946-4edd-876d-ffcf702fac40 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:29.302672 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b37b62b9-7331-4fd9-be72-0b28fbe2f620 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:29.304185 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b37b62b9-7331-4fd9-be72-0b28fbe2f620 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:29.322822 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:29.325542 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b37b62b9-7331-4fd9-be72-0b28fbe2f620 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:29.328972 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b37b62b9-7331-4fd9-be72-0b28fbe2f620 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:29.336661 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b37b62b9-7331-4fd9-be72-0b28fbe2f620 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:29.337352 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b37b62b9-7331-4fd9-be72-0b28fbe2f620 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:30.811824 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2136d9da-a946-4edd-876d-ffcf702fac40 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1655 microversion: 2.1 time: 1.915606 Jul 31 01:40:30.818487 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2643/5314] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:28 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1655 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:30.956263 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b37b62b9-7331-4fd9-be72-0b28fbe2f620 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:30.978219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b37b62b9-7331-4fd9-be72-0b28fbe2f620 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:30.992066 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b37b62b9-7331-4fd9-be72-0b28fbe2f620 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:30.997097 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b37b62b9-7331-4fd9-be72-0b28fbe2f620 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 1.698615 Jul 31 01:40:31.000138 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2672/5315] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:29 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:31.835765 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a98cb4d4-e089-48ef-8f1c-148a387f3a3a tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:31.836386 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a98cb4d4-e089-48ef-8f1c-148a387f3a3a tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:31.855096 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a98cb4d4-e089-48ef-8f1c-148a387f3a3a tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:31.855958 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a98cb4d4-e089-48ef-8f1c-148a387f3a3a tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:31.856694 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a98cb4d4-e089-48ef-8f1c-148a387f3a3a tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:31.857139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a98cb4d4-e089-48ef-8f1c-148a387f3a3a tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:31.897928 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-52159aa6-a822-4ce4-b7ba-2acb3fe0ebd1 req-ce1a74bf-ec81-4429-aaad-e26678e349a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce0d125-f1ce-4c2d-81fa-632612f82c73", "name": "network-vif-unplugged", "status": "completed", "tag": "ffe6d3af-7ef9-423b-b253-f037ec9c8300"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:31.931168 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-52159aa6-a822-4ce4-b7ba-2acb3fe0ebd1 req-ce1a74bf-ec81-4429-aaad-e26678e349a9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:31.931679 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-52159aa6-a822-4ce4-b7ba-2acb3fe0ebd1 req-ce1a74bf-ec81-4429-aaad-e26678e349a9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:32.013610 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-52159aa6-a822-4ce4-b7ba-2acb3fe0ebd1 req-ce1a74bf-ec81-4429-aaad-e26678e349a9 service nova] Creating event network-vif-unplugged:ffe6d3af-7ef9-423b-b253-f037ec9c8300 for instance bce0d125-f1ce-4c2d-81fa-632612f82c73 on n-h1-master-1 Jul 31 01:40:32.033558 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-52159aa6-a822-4ce4-b7ba-2acb3fe0ebd1 req-ce1a74bf-ec81-4429-aaad-e26678e349a9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139847 Jul 31 01:40:32.039525 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2673/5316] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:40:32.058720 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0a4c811a-fc63-4b09-afde-d8d0965c919e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:32.067052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0a4c811a-fc63-4b09-afde-d8d0965c919e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:32.087608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a4c811a-fc63-4b09-afde-d8d0965c919e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:32.089014 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a4c811a-fc63-4b09-afde-d8d0965c919e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:32.099109 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a4c811a-fc63-4b09-afde-d8d0965c919e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:32.100425 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a4c811a-fc63-4b09-afde-d8d0965c919e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:33.034538 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a98cb4d4-e089-48ef-8f1c-148a387f3a3a tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 200 len: 1655 microversion: 2.1 time: 1.202797 Jul 31 01:40:33.035269 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2644/5317] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:31 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 1655 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:33.065000 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-a930fc8d-1743-4aef-81e7-0191b4d17423 req-eeeeed85-5206-4932-a84f-3ae311ad03a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce0d125-f1ce-4c2d-81fa-632612f82c73", "name": "network-vif-deleted", "tag": "ffe6d3af-7ef9-423b-b253-f037ec9c8300"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:33.117418 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a930fc8d-1743-4aef-81e7-0191b4d17423 req-eeeeed85-5206-4932-a84f-3ae311ad03a7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:33.117875 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a930fc8d-1743-4aef-81e7-0191b4d17423 req-eeeeed85-5206-4932-a84f-3ae311ad03a7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:33.177553 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-a930fc8d-1743-4aef-81e7-0191b4d17423 req-eeeeed85-5206-4932-a84f-3ae311ad03a7 service nova] Creating event network-vif-deleted:ffe6d3af-7ef9-423b-b253-f037ec9c8300 for instance bce0d125-f1ce-4c2d-81fa-632612f82c73 on n-h1-master-1 Jul 31 01:40:33.196964 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-a930fc8d-1743-4aef-81e7-0191b4d17423 req-eeeeed85-5206-4932-a84f-3ae311ad03a7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142581 Jul 31 01:40:33.203705 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2645/5318] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:40:33.337147 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0a4c811a-fc63-4b09-afde-d8d0965c919e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:33.354219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0a4c811a-fc63-4b09-afde-d8d0965c919e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:33.364068 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0a4c811a-fc63-4b09-afde-d8d0965c919e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:33.374886 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0a4c811a-fc63-4b09-afde-d8d0965c919e tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 1.326312 Jul 31 01:40:33.378722 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2674/5319] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:32 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:34.058737 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c1a73c3-e4cb-4b29-9eb3-679ee97961ae tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:34.060093 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2c1a73c3-e4cb-4b29-9eb3-679ee97961ae tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: bce0d125-f1ce-4c2d-81fa-632612f82c73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:34.077137 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c1a73c3-e4cb-4b29-9eb3-679ee97961ae tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:34.077851 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c1a73c3-e4cb-4b29-9eb3-679ee97961ae tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:34.084802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c1a73c3-e4cb-4b29-9eb3-679ee97961ae tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:34.085577 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c1a73c3-e4cb-4b29-9eb3-679ee97961ae tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:34.123892 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-2c1a73c3-e4cb-4b29-9eb3-679ee97961ae tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] HTTP exception thrown: Instance bce0d125-f1ce-4c2d-81fa-632612f82c73 could not be found. Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c1a73c3-e4cb-4b29-9eb3-679ee97961ae tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Request method failure captured: Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 HTTP/1.1 Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5d1a9uI6j04I-hTeej5FHNhA6EJ6ruMWAW9GYq_P8BqV2iyuisVVWOgFcEy8rtuOljZPKbuRgBWgkTxjK71TdkpGuAcrRIPESxbclNksGZWBNBzK-8NDgoNOfCcuxuHsczBYQOb5UlFqPx3WWMNOTyrLZ1Fmp_2k9XZH7K8DBNt0uoo Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: ac1d2a34a5c44820a9c34349d9ebf44c Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestServerMultinode-1790218542 Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ac1d2a34a5c44820a9c34349d9ebf44c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ac1d2a34a5c44820a9c34349d9ebf44c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ac1d2a34a5c44820a9c34349d9ebf44c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ac1d2a34a5c44820a9c34349d9ebf44c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestServerMultinode-1790218542 Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: ac1d2a34a5c44820a9c34349d9ebf44c Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestServerMultinode-1790218542 Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestServerMultinode-1790218542-project-admin Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: c33436d7306a48c8bcd8cd82c9466179 Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestServerMultinode-1790218542-project-admin Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: exception: Instance bce0d125-f1ce-4c2d-81fa-632612f82c73 could not be found. Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'bce0d125-f1ce-4c2d-81fa-632612f82c73'} Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce0d125-f1ce-4c2d-81fa-632612f82c73 could not be found. Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce0d125-f1ce-4c2d-81fa-632612f82c73 could not be found. Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:40:34.125628 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:40:34.130770 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:40:34.130770 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:40:34.130770 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:40:34.130770 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:40:34.130770 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:40:34.130770 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce0d125-f1ce-4c2d-81fa-632612f82c73 could not be found. Jul 31 01:40:34.130770 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:40:34.130770 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c1a73c3-e4cb-4b29-9eb3-679ee97961ae tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Returning 404 to user: Instance bce0d125-f1ce-4c2d-81fa-632612f82c73 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:40:34.130770 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2c1a73c3-e4cb-4b29-9eb3-679ee97961ae tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73" status: 404 len: 111 microversion: 2.1 time: 0.073490 Jul 31 01:40:34.137764 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-31dfb1cb-da66-43e8-89a9-82677465b192 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:34.138578 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-31dfb1cb-da66-43e8-89a9-82677465b192 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:34.150747 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31dfb1cb-da66-43e8-89a9-82677465b192 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:34.161245 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31dfb1cb-da66-43e8-89a9-82677465b192 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:34.162194 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31dfb1cb-da66-43e8-89a9-82677465b192 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:34.162666 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31dfb1cb-da66-43e8-89a9-82677465b192 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:34.167173 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2646/5320] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:34 2022] GET /compute/v2.1/servers/bce0d125-f1ce-4c2d-81fa-632612f82c73 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:40:34.215644 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-31dfb1cb-da66-43e8-89a9-82677465b192 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:40:34.404400 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-74eb39e0-184e-4ddb-82d4-2cbc5047db25 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:34.405062 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-74eb39e0-184e-4ddb-82d4-2cbc5047db25 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:34.426761 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74eb39e0-184e-4ddb-82d4-2cbc5047db25 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:34.427291 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74eb39e0-184e-4ddb-82d4-2cbc5047db25 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:34.428070 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74eb39e0-184e-4ddb-82d4-2cbc5047db25 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:34.431984 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74eb39e0-184e-4ddb-82d4-2cbc5047db25 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:34.464676 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-31dfb1cb-da66-43e8-89a9-82677465b192 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "DELETE /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda" status: 204 len: 0 microversion: 2.1 time: 0.331143 Jul 31 01:40:34.469360 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2675/5321] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:40:34 2022] DELETE /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:40:34.482195 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3be66415-bf3d-4651-a593-e773edfe3639 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:34.495011 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3be66415-bf3d-4651-a593-e773edfe3639 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:34.509453 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3be66415-bf3d-4651-a593-e773edfe3639 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:34.517553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3be66415-bf3d-4651-a593-e773edfe3639 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:34.518591 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3be66415-bf3d-4651-a593-e773edfe3639 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:34.519210 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3be66415-bf3d-4651-a593-e773edfe3639 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:35.086694 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-74eb39e0-184e-4ddb-82d4-2cbc5047db25 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:35.103221 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-74eb39e0-184e-4ddb-82d4-2cbc5047db25 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:35.104982 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-74eb39e0-184e-4ddb-82d4-2cbc5047db25 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:35.108182 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-74eb39e0-184e-4ddb-82d4-2cbc5047db25 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.707609 Jul 31 01:40:35.111109 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2647/5322] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:34 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:35.149829 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3be66415-bf3d-4651-a593-e773edfe3639 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda" status: 200 len: 1654 microversion: 2.1 time: 0.678872 Jul 31 01:40:35.159488 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2676/5323] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:34 2022] GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda => generated 1654 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:36.138985 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-061420cb-9200-4fd3-afc4-75bdba1b7df8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:36.139777 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-061420cb-9200-4fd3-afc4-75bdba1b7df8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:36.163069 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-061420cb-9200-4fd3-afc4-75bdba1b7df8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:36.163069 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-061420cb-9200-4fd3-afc4-75bdba1b7df8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:36.172479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-061420cb-9200-4fd3-afc4-75bdba1b7df8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:36.173362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-061420cb-9200-4fd3-afc4-75bdba1b7df8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:36.177810 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d36560b9-44fe-499e-8743-4147f661e0a3 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:36.178643 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d36560b9-44fe-499e-8743-4147f661e0a3 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:36.186542 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d36560b9-44fe-499e-8743-4147f661e0a3 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:36.187007 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d36560b9-44fe-499e-8743-4147f661e0a3 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:36.187820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d36560b9-44fe-499e-8743-4147f661e0a3 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:36.188270 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d36560b9-44fe-499e-8743-4147f661e0a3 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:37.284703 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d36560b9-44fe-499e-8743-4147f661e0a3 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda" status: 200 len: 1612 microversion: 2.1 time: 1.111243 Jul 31 01:40:37.288339 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2677/5324] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:36 2022] GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda => generated 1612 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:40:37.684857 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-061420cb-9200-4fd3-afc4-75bdba1b7df8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:37.699076 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-061420cb-9200-4fd3-afc4-75bdba1b7df8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:37.703224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-061420cb-9200-4fd3-afc4-75bdba1b7df8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:37.709397 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-061420cb-9200-4fd3-afc4-75bdba1b7df8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 1.574620 Jul 31 01:40:37.715473 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2648/5325] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:36 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:37.966777 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-019e2732-e62c-44de-a68a-bc38e21bd45e req-1e5f2680-144a-4f85-99f3-94b51ab2a6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "849fa795-7818-42a1-a063-ed2e2381ebda", "name": "network-vif-deleted", "tag": "d9819257-f15a-476b-bc6f-17b85d9a15b9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:37.987891 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-019e2732-e62c-44de-a68a-bc38e21bd45e req-1e5f2680-144a-4f85-99f3-94b51ab2a6e2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:37.990033 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-019e2732-e62c-44de-a68a-bc38e21bd45e req-1e5f2680-144a-4f85-99f3-94b51ab2a6e2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:38.025625 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-019e2732-e62c-44de-a68a-bc38e21bd45e req-1e5f2680-144a-4f85-99f3-94b51ab2a6e2 service nova] Creating event network-vif-deleted:d9819257-f15a-476b-bc6f-17b85d9a15b9 for instance 849fa795-7818-42a1-a063-ed2e2381ebda on n-h2-master-1 Jul 31 01:40:38.041107 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-019e2732-e62c-44de-a68a-bc38e21bd45e req-1e5f2680-144a-4f85-99f3-94b51ab2a6e2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075196 Jul 31 01:40:38.046188 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2678/5326] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:40:38.306879 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-12cc909c-7e62-45a6-b05f-8d3cf05a64a0 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:38.307639 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-12cc909c-7e62-45a6-b05f-8d3cf05a64a0 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:38.323241 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12cc909c-7e62-45a6-b05f-8d3cf05a64a0 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:38.323735 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12cc909c-7e62-45a6-b05f-8d3cf05a64a0 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:38.324549 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12cc909c-7e62-45a6-b05f-8d3cf05a64a0 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:38.330049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12cc909c-7e62-45a6-b05f-8d3cf05a64a0 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:38.449165 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12cc909c-7e62-45a6-b05f-8d3cf05a64a0 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:38.449626 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12cc909c-7e62-45a6-b05f-8d3cf05a64a0 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:38.450096 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-12cc909c-7e62-45a6-b05f-8d3cf05a64a0 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lazy-loading 'fault' on Instance uuid 849fa795-7818-42a1-a063-ed2e2381ebda {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:40:38.721910 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-12cc909c-7e62-45a6-b05f-8d3cf05a64a0 tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda" status: 200 len: 1453 microversion: 2.1 time: 0.418691 Jul 31 01:40:38.734705 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-725606a6-7090-4d07-8bc3-6bb2f5074816 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:38.735363 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-725606a6-7090-4d07-8bc3-6bb2f5074816 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:38.742217 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2649/5327] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:38 2022] GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda => generated 1453 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:38.749730 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-725606a6-7090-4d07-8bc3-6bb2f5074816 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:38.752714 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-725606a6-7090-4d07-8bc3-6bb2f5074816 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:38.755270 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-725606a6-7090-4d07-8bc3-6bb2f5074816 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:38.755929 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-725606a6-7090-4d07-8bc3-6bb2f5074816 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:39.745863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-83ceee35-548f-4663-ba8e-2baf67b0c04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:39.746479 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-83ceee35-548f-4663-ba8e-2baf67b0c04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] [instance: 849fa795-7818-42a1-a063-ed2e2381ebda] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:39.759541 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83ceee35-548f-4663-ba8e-2baf67b0c04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:39.760554 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83ceee35-548f-4663-ba8e-2baf67b0c04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:39.763105 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83ceee35-548f-4663-ba8e-2baf67b0c04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:39.763802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-83ceee35-548f-4663-ba8e-2baf67b0c04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:39.780466 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-725606a6-7090-4d07-8bc3-6bb2f5074816 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:39.797712 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-725606a6-7090-4d07-8bc3-6bb2f5074816 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:39.799562 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-725606a6-7090-4d07-8bc3-6bb2f5074816 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:39.800929 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-725606a6-7090-4d07-8bc3-6bb2f5074816 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 1.071034 Jul 31 01:40:39.804168 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2679/5328] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:38 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:39.813403 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-83ceee35-548f-4663-ba8e-2baf67b0c04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] HTTP exception thrown: Instance 849fa795-7818-42a1-a063-ed2e2381ebda could not be found. Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-83ceee35-548f-4663-ba8e-2baf67b0c04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Request method failure captured: Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda HTTP/1.1 Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5d1a9uI6j04I-hTeej5FHNhA6EJ6ruMWAW9GYq_P8BqV2iyuisVVWOgFcEy8rtuOljZPKbuRgBWgkTxjK71TdkpGuAcrRIPESxbclNksGZWBNBzK-8NDgoNOfCcuxuHsczBYQOb5UlFqPx3WWMNOTyrLZ1Fmp_2k9XZH7K8DBNt0uoo Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: ac1d2a34a5c44820a9c34349d9ebf44c Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestServerMultinode-1790218542 Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ac1d2a34a5c44820a9c34349d9ebf44c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ac1d2a34a5c44820a9c34349d9ebf44c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ac1d2a34a5c44820a9c34349d9ebf44c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ac1d2a34a5c44820a9c34349d9ebf44c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestServerMultinode-1790218542 Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: ac1d2a34a5c44820a9c34349d9ebf44c Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestServerMultinode-1790218542 Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestServerMultinode-1790218542-project-admin Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: c33436d7306a48c8bcd8cd82c9466179 Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestServerMultinode-1790218542-project-admin Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 849fa795-7818-42a1-a063-ed2e2381ebda could not be found. Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '849fa795-7818-42a1-a063-ed2e2381ebda'} Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 849fa795-7818-42a1-a063-ed2e2381ebda could not be found. Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 849fa795-7818-42a1-a063-ed2e2381ebda could not be found. Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:40:39.815359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:40:39.820029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:40:39.820029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:40:39.820029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:40:39.820029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:40:39.820029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:40:39.820029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 849fa795-7818-42a1-a063-ed2e2381ebda could not be found. Jul 31 01:40:39.820029 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:40:39.820029 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-83ceee35-548f-4663-ba8e-2baf67b0c04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] Returning 404 to user: Instance 849fa795-7818-42a1-a063-ed2e2381ebda could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:40:39.821159 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-83ceee35-548f-4663-ba8e-2baf67b0c04b tempest-TestServerMultinode-1790218542 tempest-TestServerMultinode-1790218542-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda" status: 404 len: 111 microversion: 2.1 time: 0.077421 Jul 31 01:40:39.823598 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2650/5329] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:39 2022] GET /compute/v2.1/servers/849fa795-7818-42a1-a063-ed2e2381ebda => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:40:40.555359 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6d1c5d7f-108c-45b8-82d7-e0898a1eeee6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Action: 'create', calling method: .version_select at 0x7fede4723c10>, body: {"keypair": {"name": "tempest-TestServerBasicOps-596753606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTD9RBkoTbrnfkfFj7EtO61S4OOgyvey0S2LRbBpQRlf4yYob4jle6g4wPBmAgZXlGYzsLmUvv3NAU9Qa59wPJi69bIs2xM+6ecbQ0tQ+IiM7bUbwtI2T/l1csB0IYA2Q=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:40.649704 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-6d1c5d7f-108c-45b8-82d7-e0898a1eeee6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Getting quotas for project 7c3de71380c941dcb2d2ba9e671ceb43. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:40:40.672632 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-6d1c5d7f-108c-45b8-82d7-e0898a1eeee6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Getting quotas for user cdca92e5eb6e4b3dab4900b42f896050 and project 7c3de71380c941dcb2d2ba9e671ceb43. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:40:40.725810 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6d1c5d7f-108c-45b8-82d7-e0898a1eeee6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.635592 Jul 31 01:40:40.726789 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2680/5330] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:40:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:40:40.752404 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4ba792c5-4e27-4347-a0b7-6f25b9e50031 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-943652913", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "b51443cb-c2ec-4d88-a6b7-2bda5bee40c2"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:40.832551 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6931ddd1-bb4b-4da6-adc2-f892a56e1da4 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:40.834065 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6931ddd1-bb4b-4da6-adc2-f892a56e1da4 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:40.846980 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6931ddd1-bb4b-4da6-adc2-f892a56e1da4 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:40.848823 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6931ddd1-bb4b-4da6-adc2-f892a56e1da4 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:40.850060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6931ddd1-bb4b-4da6-adc2-f892a56e1da4 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:40.851100 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6931ddd1-bb4b-4da6-adc2-f892a56e1da4 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:40.893066 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-4ba792c5-4e27-4347-a0b7-6f25b9e50031 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] validate_networks() for [('b51443cb-c2ec-4d88-a6b7-2bda5bee40c2', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:40:41.319325 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6931ddd1-bb4b-4da6-adc2-f892a56e1da4 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:41.332427 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6931ddd1-bb4b-4da6-adc2-f892a56e1da4 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:41.334258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6931ddd1-bb4b-4da6-adc2-f892a56e1da4 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:41.340455 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6931ddd1-bb4b-4da6-adc2-f892a56e1da4 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.512533 Jul 31 01:40:41.341248 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2681/5331] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:40 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:41.953559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-4ba792c5-4e27-4347-a0b7-6f25b9e50031 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:40:41.954914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-4ba792c5-4e27-4347-a0b7-6f25b9e50031 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:40:41.955717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-4ba792c5-4e27-4347-a0b7-6f25b9e50031 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:40:41.956293 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-4ba792c5-4e27-4347-a0b7-6f25b9e50031 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:40:41.956892 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-4ba792c5-4e27-4347-a0b7-6f25b9e50031 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:40:41.975570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ba792c5-4e27-4347-a0b7-6f25b9e50031 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:41.977546 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ba792c5-4e27-4347-a0b7-6f25b9e50031 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:41.978707 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ba792c5-4e27-4347-a0b7-6f25b9e50031 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:41.979324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ba792c5-4e27-4347-a0b7-6f25b9e50031 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:42.050408 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-4ba792c5-4e27-4347-a0b7-6f25b9e50031 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Getting quotas for project 4466256620a640d39d739453af4c5f15. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:40:42.056918 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-4ba792c5-4e27-4347-a0b7-6f25b9e50031 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Getting quotas for user 16ed635411234fcea462f7564f5c6251 and project 4466256620a640d39d739453af4c5f15. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:40:42.074126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4ba792c5-4e27-4347-a0b7-6f25b9e50031 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:40:42.077327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4ba792c5-4e27-4347-a0b7-6f25b9e50031 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:40:42.137671 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4ba792c5-4e27-4347-a0b7-6f25b9e50031 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.531885 Jul 31 01:40:42.138770 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2651/5332] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:40:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:40:42.158225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c440cb3d-f37c-4a42-8b9d-4b93ec1e952e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:42.161058 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c440cb3d-f37c-4a42-8b9d-4b93ec1e952e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:42.262789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c440cb3d-f37c-4a42-8b9d-4b93ec1e952e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ed635411234fcea462f7564f5c6251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466256620a640d39d739453af4c5f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:42.278358 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c440cb3d-f37c-4a42-8b9d-4b93ec1e952e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] 10.222.0.45 "GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9" status: 200 len: 1213 microversion: 2.1 time: 0.128094 Jul 31 01:40:42.280280 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2682/5333] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:42 2022] GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9 => generated 1213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:42.367171 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9278593d-d8a4-43ca-bb83-3907df33a68c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:42.368125 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9278593d-d8a4-43ca-bb83-3907df33a68c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:42.381108 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9278593d-d8a4-43ca-bb83-3907df33a68c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:42.382199 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9278593d-d8a4-43ca-bb83-3907df33a68c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:42.383775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9278593d-d8a4-43ca-bb83-3907df33a68c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:42.384433 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9278593d-d8a4-43ca-bb83-3907df33a68c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:42.967839 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9278593d-d8a4-43ca-bb83-3907df33a68c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:42.981280 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9278593d-d8a4-43ca-bb83-3907df33a68c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:42.987542 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9278593d-d8a4-43ca-bb83-3907df33a68c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:42.993746 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9278593d-d8a4-43ca-bb83-3907df33a68c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.630917 Jul 31 01:40:42.998047 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2652/5334] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:42 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:43.306289 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5a25e703-c1e6-4774-89a1-a3c8c0db3312 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:43.308562 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5a25e703-c1e6-4774-89a1-a3c8c0db3312 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:43.333053 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a25e703-c1e6-4774-89a1-a3c8c0db3312 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:43.335453 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a25e703-c1e6-4774-89a1-a3c8c0db3312 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:43.336615 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a25e703-c1e6-4774-89a1-a3c8c0db3312 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:43.337700 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5a25e703-c1e6-4774-89a1-a3c8c0db3312 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:43.661096 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5a25e703-c1e6-4774-89a1-a3c8c0db3312 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ed635411234fcea462f7564f5c6251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466256620a640d39d739453af4c5f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:43.682793 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5a25e703-c1e6-4774-89a1-a3c8c0db3312 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] 10.222.0.45 "GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9" status: 200 len: 1217 microversion: 2.1 time: 0.384116 Jul 31 01:40:43.684646 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2683/5335] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:43 2022] GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9 => generated 1217 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:43.817192 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1106793285", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-596753606", "security_groups": [{"name": "tempest-secgroup-smoke-1587624397"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "76c80d21-8875-4eb7-b909-d3df41d9e03a"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:44.026157 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb85ad60-706f-42b1-b278-a7c97dc3a633 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:44.027107 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fb85ad60-706f-42b1-b278-a7c97dc3a633 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:44.047439 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb85ad60-706f-42b1-b278-a7c97dc3a633 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:44.047917 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb85ad60-706f-42b1-b278-a7c97dc3a633 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:44.049313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb85ad60-706f-42b1-b278-a7c97dc3a633 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:44.055683 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb85ad60-706f-42b1-b278-a7c97dc3a633 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:44.096545 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] validate_networks() for [('76c80d21-8875-4eb7-b909-d3df41d9e03a', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:40:45.160618 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fb85ad60-706f-42b1-b278-a7c97dc3a633 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:45.185501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fb85ad60-706f-42b1-b278-a7c97dc3a633 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:45.193809 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fb85ad60-706f-42b1-b278-a7c97dc3a633 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:45.196688 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fb85ad60-706f-42b1-b278-a7c97dc3a633 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 1.175566 Jul 31 01:40:45.212636 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2684/5336] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:44 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:40:45.223566 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-55c99daf-8fbf-483f-8c87-02bff4f4a3c2 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:45.224471 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-55c99daf-8fbf-483f-8c87-02bff4f4a3c2 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:45.233967 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55c99daf-8fbf-483f-8c87-02bff4f4a3c2 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:45.234643 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55c99daf-8fbf-483f-8c87-02bff4f4a3c2 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:45.235653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55c99daf-8fbf-483f-8c87-02bff4f4a3c2 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:45.236670 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55c99daf-8fbf-483f-8c87-02bff4f4a3c2 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:45.282024 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:46.890529 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-55c99daf-8fbf-483f-8c87-02bff4f4a3c2 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ed635411234fcea462f7564f5c6251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466256620a640d39d739453af4c5f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:46.903905 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-55c99daf-8fbf-483f-8c87-02bff4f4a3c2 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] 10.222.0.45 "GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9" status: 200 len: 1313 microversion: 2.1 time: 1.686544 Jul 31 01:40:46.904555 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2685/5337] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:45 2022] GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9 => generated 1313 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:46.913488 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-7766e8c0-922b-4e72-8d34-271388fdf964 req-bdfd1d4f-c0e4-4676-8d8d-d3608e435a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "name": "network-vif-plugged", "status": "completed", "tag": "e1be7003-6e47-45d7-b637-ed3b70b52701"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:46.949326 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7766e8c0-922b-4e72-8d34-271388fdf964 req-bdfd1d4f-c0e4-4676-8d8d-d3608e435a36 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:46.954097 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Getting quotas for project 7c3de71380c941dcb2d2ba9e671ceb43. Resources: dict_keys(['metadata_items']) {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:40:46.955272 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7766e8c0-922b-4e72-8d34-271388fdf964 req-bdfd1d4f-c0e4-4676-8d8d-d3608e435a36 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:46.981117 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Getting quotas for user cdca92e5eb6e4b3dab4900b42f896050 and project 7c3de71380c941dcb2d2ba9e671ceb43. Resources: dict_keys(['metadata_items']) {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:40:46.992832 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-7766e8c0-922b-4e72-8d34-271388fdf964 req-bdfd1d4f-c0e4-4676-8d8d-d3608e435a36 service nova] Creating event network-vif-plugged:e1be7003-6e47-45d7-b637-ed3b70b52701 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:40:47.000605 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-7766e8c0-922b-4e72-8d34-271388fdf964 req-bdfd1d4f-c0e4-4676-8d8d-d3608e435a36 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090638 Jul 31 01:40:47.001374 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2686/5338] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:40:47.011472 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3d39eecd-842a-42b6-802b-a10732879eb2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:47.024419 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3d39eecd-842a-42b6-802b-a10732879eb2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:47.031398 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d39eecd-842a-42b6-802b-a10732879eb2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:47.032159 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d39eecd-842a-42b6-802b-a10732879eb2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:47.033200 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d39eecd-842a-42b6-802b-a10732879eb2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:47.033852 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d39eecd-842a-42b6-802b-a10732879eb2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:47.049805 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:40:47.050227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:40:47.057339 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:40:47.057828 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:40:47.058263 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:40:47.079035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:47.079524 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:47.080334 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:47.080777 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:47.160517 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Getting quotas for project 7c3de71380c941dcb2d2ba9e671ceb43. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:40:47.182271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Getting quotas for user cdca92e5eb6e4b3dab4900b42f896050 and project 7c3de71380c941dcb2d2ba9e671ceb43. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:40:47.212105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:40:47.214304 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:40:47.352824 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ea18ba34-e3f9-4047-b593-2bd6d283cf13 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.539775 Jul 31 01:40:47.356434 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2653/5339] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:40:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 3544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:40:47.372273 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c4078376-61fd-483b-9577-315fe4441ce0 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:47.378370 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c4078376-61fd-483b-9577-315fe4441ce0 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:47.585411 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c4078376-61fd-483b-9577-315fe4441ce0 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdca92e5eb6e4b3dab4900b42f896050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3de71380c941dcb2d2ba9e671ceb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:47.605575 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c4078376-61fd-483b-9577-315fe4441ce0 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 200 len: 1302 microversion: 2.1 time: 0.243951 Jul 31 01:40:47.609032 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2654/5340] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:47 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 1302 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:47.638268 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-40723dea-369c-4a90-811b-9b5fb0583261 req-b2111a31-4102-4b0e-8c05-b9eea29b25c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e3a06f6-118f-445f-b576-db2ed853d9f9", "tag": "5fbb3ec6-185e-4c14-8309-a8589a7d4fd7"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:47.658966 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-40723dea-369c-4a90-811b-9b5fb0583261 req-b2111a31-4102-4b0e-8c05-b9eea29b25c7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:47.660687 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-40723dea-369c-4a90-811b-9b5fb0583261 req-b2111a31-4102-4b0e-8c05-b9eea29b25c7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:47.677196 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-40723dea-369c-4a90-811b-9b5fb0583261 req-b2111a31-4102-4b0e-8c05-b9eea29b25c7 service nova] Creating event network-changed:5fbb3ec6-185e-4c14-8309-a8589a7d4fd7 for instance 7e3a06f6-118f-445f-b576-db2ed853d9f9 on n-h2-master-1 Jul 31 01:40:47.684870 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-40723dea-369c-4a90-811b-9b5fb0583261 req-b2111a31-4102-4b0e-8c05-b9eea29b25c7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053171 Jul 31 01:40:47.685814 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2655/5341] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:40:47.757726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3d39eecd-842a-42b6-802b-a10732879eb2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:47.777300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3d39eecd-842a-42b6-802b-a10732879eb2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:47.778978 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3d39eecd-842a-42b6-802b-a10732879eb2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:47.780357 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3d39eecd-842a-42b6-802b-a10732879eb2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.777531 Jul 31 01:40:47.780957 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2687/5342] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:47 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:47.932156 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4cd9266c-508a-493b-9b9e-85e775881609 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:47.936577 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4cd9266c-508a-493b-9b9e-85e775881609 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:47.962188 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4cd9266c-508a-493b-9b9e-85e775881609 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:47.962834 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4cd9266c-508a-493b-9b9e-85e775881609 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:47.963479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4cd9266c-508a-493b-9b9e-85e775881609 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:47.963932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4cd9266c-508a-493b-9b9e-85e775881609 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:48.258941 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4cd9266c-508a-493b-9b9e-85e775881609 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ed635411234fcea462f7564f5c6251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466256620a640d39d739453af4c5f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:48.267069 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4cd9266c-508a-493b-9b9e-85e775881609 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] 10.222.0.45 "GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9" status: 200 len: 1313 microversion: 2.1 time: 0.343102 Jul 31 01:40:48.277316 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2656/5343] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:47 2022] GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:48.631702 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7a055d97-c73b-47e3-8a63-3c5bc97778f9 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:48.632334 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7a055d97-c73b-47e3-8a63-3c5bc97778f9 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:48.649782 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a055d97-c73b-47e3-8a63-3c5bc97778f9 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:48.650509 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a055d97-c73b-47e3-8a63-3c5bc97778f9 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:48.651582 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a055d97-c73b-47e3-8a63-3c5bc97778f9 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:48.652659 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a055d97-c73b-47e3-8a63-3c5bc97778f9 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:48.798512 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7a055d97-c73b-47e3-8a63-3c5bc97778f9 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdca92e5eb6e4b3dab4900b42f896050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3de71380c941dcb2d2ba9e671ceb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:48.806883 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-959c908e-8e2d-49ed-8f3e-6e71e4781a22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:48.807536 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-959c908e-8e2d-49ed-8f3e-6e71e4781a22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:48.816303 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7a055d97-c73b-47e3-8a63-3c5bc97778f9 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 200 len: 1306 microversion: 2.1 time: 0.188976 Jul 31 01:40:48.831431 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2688/5344] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:48 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 1306 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:48.831768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-959c908e-8e2d-49ed-8f3e-6e71e4781a22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:48.831768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-959c908e-8e2d-49ed-8f3e-6e71e4781a22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:48.831768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-959c908e-8e2d-49ed-8f3e-6e71e4781a22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:48.831768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-959c908e-8e2d-49ed-8f3e-6e71e4781a22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:49.101147 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-6cdf7575-f07e-487b-8640-ee336ff84617 req-f9e88b67-ac17-44dc-81bb-8af47231d696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "name": "network-vif-plugged", "status": "completed", "tag": "68c780fc-affd-40cd-9df1-e9eb321110a9"}, {"server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "name": "network-vif-plugged", "status": "completed", "tag": "7f783da2-6e5d-4ff0-ac0c-23f0c6756d36"}, {"server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "name": "network-vif-plugged", "status": "completed", "tag": "3af2c975-e18d-4f5c-bf75-5d37fd18e383"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:49.123944 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6cdf7575-f07e-487b-8640-ee336ff84617 req-f9e88b67-ac17-44dc-81bb-8af47231d696 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:49.124521 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6cdf7575-f07e-487b-8640-ee336ff84617 req-f9e88b67-ac17-44dc-81bb-8af47231d696 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:49.157481 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-6cdf7575-f07e-487b-8640-ee336ff84617 req-f9e88b67-ac17-44dc-81bb-8af47231d696 service nova] Creating event network-vif-plugged:68c780fc-affd-40cd-9df1-e9eb321110a9 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:40:49.158366 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-6cdf7575-f07e-487b-8640-ee336ff84617 req-f9e88b67-ac17-44dc-81bb-8af47231d696 service nova] Creating event network-vif-plugged:7f783da2-6e5d-4ff0-ac0c-23f0c6756d36 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:40:49.160493 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-6cdf7575-f07e-487b-8640-ee336ff84617 req-f9e88b67-ac17-44dc-81bb-8af47231d696 service nova] Creating event network-vif-plugged:3af2c975-e18d-4f5c-bf75-5d37fd18e383 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:40:49.171774 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-6cdf7575-f07e-487b-8640-ee336ff84617 req-f9e88b67-ac17-44dc-81bb-8af47231d696 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.075329 Jul 31 01:40:49.174307 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2689/5345] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:40:49.300299 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ff0d8d7e-38a8-4fe0-ade1-b7e7eb8e23e9 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:49.301892 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ff0d8d7e-38a8-4fe0-ade1-b7e7eb8e23e9 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:49.313184 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff0d8d7e-38a8-4fe0-ade1-b7e7eb8e23e9 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:49.313655 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff0d8d7e-38a8-4fe0-ade1-b7e7eb8e23e9 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:49.314685 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff0d8d7e-38a8-4fe0-ade1-b7e7eb8e23e9 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:49.315416 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff0d8d7e-38a8-4fe0-ade1-b7e7eb8e23e9 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:49.418407 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-959c908e-8e2d-49ed-8f3e-6e71e4781a22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:49.437192 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-959c908e-8e2d-49ed-8f3e-6e71e4781a22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:49.450227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-959c908e-8e2d-49ed-8f3e-6e71e4781a22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:49.454338 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-959c908e-8e2d-49ed-8f3e-6e71e4781a22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.651239 Jul 31 01:40:49.457967 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2657/5346] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:48 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:49.679881 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ff0d8d7e-38a8-4fe0-ade1-b7e7eb8e23e9 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ed635411234fcea462f7564f5c6251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466256620a640d39d739453af4c5f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:49.700148 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ff0d8d7e-38a8-4fe0-ade1-b7e7eb8e23e9 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] 10.222.0.45 "GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9" status: 200 len: 1313 microversion: 2.1 time: 0.404722 Jul 31 01:40:49.709441 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2690/5347] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:49 2022] GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9 => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:49.846908 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fbac3e4c-c6b1-46f8-bd32-d47bd1c620ae tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:49.847579 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fbac3e4c-c6b1-46f8-bd32-d47bd1c620ae tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:49.866658 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbac3e4c-c6b1-46f8-bd32-d47bd1c620ae tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:49.867162 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbac3e4c-c6b1-46f8-bd32-d47bd1c620ae tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:49.867997 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbac3e4c-c6b1-46f8-bd32-d47bd1c620ae tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:49.871352 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fbac3e4c-c6b1-46f8-bd32-d47bd1c620ae tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:49.878249 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7602e095-e1dc-4d89-aea4-a6070a59c552 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1140355732", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2067ee98-3269-4021-b7a2-eb908b0805cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6739ac5e-7d06-4b25-b7ed-29fa35326c6e"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:50.058438 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fbac3e4c-c6b1-46f8-bd32-d47bd1c620ae tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdca92e5eb6e4b3dab4900b42f896050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3de71380c941dcb2d2ba9e671ceb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:50.066066 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fbac3e4c-c6b1-46f8-bd32-d47bd1c620ae tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 200 len: 1354 microversion: 2.1 time: 0.228443 Jul 31 01:40:50.066658 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2658/5348] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:49 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 1354 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:50.111935 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-7602e095-e1dc-4d89-aea4-a6070a59c552 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] validate_networks() for [('6739ac5e-7d06-4b25-b7ed-29fa35326c6e', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:40:50.484000 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-06981d0a-cb5b-4b61-82b8-f45b0ff09f05 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:50.485373 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-06981d0a-cb5b-4b61-82b8-f45b0ff09f05 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:50.499443 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06981d0a-cb5b-4b61-82b8-f45b0ff09f05 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:50.500120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06981d0a-cb5b-4b61-82b8-f45b0ff09f05 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:50.501081 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06981d0a-cb5b-4b61-82b8-f45b0ff09f05 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:50.501694 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-06981d0a-cb5b-4b61-82b8-f45b0ff09f05 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:51.056413 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-06981d0a-cb5b-4b61-82b8-f45b0ff09f05 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:51.066272 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-06981d0a-cb5b-4b61-82b8-f45b0ff09f05 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:51.068091 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-06981d0a-cb5b-4b61-82b8-f45b0ff09f05 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:51.069755 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-06981d0a-cb5b-4b61-82b8-f45b0ff09f05 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.589750 Jul 31 01:40:51.080477 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2659/5349] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:50 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:40:51.086086 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7be8bbd7-9ca0-456e-8e97-0af3f3d1dda6 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:51.098020 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7be8bbd7-9ca0-456e-8e97-0af3f3d1dda6 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:51.101044 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:51.109527 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7be8bbd7-9ca0-456e-8e97-0af3f3d1dda6 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:51.117602 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7be8bbd7-9ca0-456e-8e97-0af3f3d1dda6 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:51.118644 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7be8bbd7-9ca0-456e-8e97-0af3f3d1dda6 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:51.119169 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7be8bbd7-9ca0-456e-8e97-0af3f3d1dda6 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:51.260781 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7602e095-e1dc-4d89-aea4-a6070a59c552 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:40:51.263076 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7602e095-e1dc-4d89-aea4-a6070a59c552 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:40:51.263954 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7602e095-e1dc-4d89-aea4-a6070a59c552 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:40:51.264587 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7602e095-e1dc-4d89-aea4-a6070a59c552 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:40:51.265908 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7602e095-e1dc-4d89-aea4-a6070a59c552 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:40:51.278646 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7602e095-e1dc-4d89-aea4-a6070a59c552 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:51.280097 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7602e095-e1dc-4d89-aea4-a6070a59c552 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:51.281371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7602e095-e1dc-4d89-aea4-a6070a59c552 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:51.282382 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7602e095-e1dc-4d89-aea4-a6070a59c552 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:51.315449 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7602e095-e1dc-4d89-aea4-a6070a59c552 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:40:51.326984 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7602e095-e1dc-4d89-aea4-a6070a59c552 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for user f6c26df9a49446c290d6a0b1427f0c14 and project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:40:51.374391 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7be8bbd7-9ca0-456e-8e97-0af3f3d1dda6 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ed635411234fcea462f7564f5c6251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466256620a640d39d739453af4c5f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:51.382494 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7be8bbd7-9ca0-456e-8e97-0af3f3d1dda6 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] 10.222.0.45 "GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9" status: 200 len: 1313 microversion: 2.1 time: 0.300685 Jul 31 01:40:51.386118 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2660/5350] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:51 2022] GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:51.398579 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-adf80c48-77c3-4f4c-87d6-f878a2a80887 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:51.399478 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-adf80c48-77c3-4f4c-87d6-f878a2a80887 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:51.412792 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adf80c48-77c3-4f4c-87d6-f878a2a80887 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:51.413245 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adf80c48-77c3-4f4c-87d6-f878a2a80887 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:51.414045 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adf80c48-77c3-4f4c-87d6-f878a2a80887 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:51.414479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adf80c48-77c3-4f4c-87d6-f878a2a80887 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:51.456249 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7602e095-e1dc-4d89-aea4-a6070a59c552 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:40:51.458341 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7602e095-e1dc-4d89-aea4-a6070a59c552 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2067ee98-3269-4021-b7a2-eb908b0805cd',volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:40:51.669051 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7602e095-e1dc-4d89-aea4-a6070a59c552 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.795518 Jul 31 01:40:51.675818 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2691/5351] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:40:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:40:51.687013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-d54b34ad-46a5-44b4-9675-904c417198fc req-a9b4db1b-355d-4dc4-a445-eb76ddfe3eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "name": "network-vif-plugged", "status": "completed", "tag": "8d439614-2d77-45c4-bece-37999557c985"}, {"server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "name": "network-vif-plugged", "status": "completed", "tag": "9d106083-b7ba-40a6-aaba-56416aac7485"}, {"server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "name": "network-vif-plugged", "status": "completed", "tag": "5ad3e971-dbb2-4b55-9893-730ef94ad777"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:51.711593 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d54b34ad-46a5-44b4-9675-904c417198fc req-a9b4db1b-355d-4dc4-a445-eb76ddfe3eba service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:51.712424 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d54b34ad-46a5-44b4-9675-904c417198fc req-a9b4db1b-355d-4dc4-a445-eb76ddfe3eba service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:51.730311 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-d54b34ad-46a5-44b4-9675-904c417198fc req-a9b4db1b-355d-4dc4-a445-eb76ddfe3eba service nova] Creating event network-vif-plugged:8d439614-2d77-45c4-bece-37999557c985 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:40:51.731165 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-d54b34ad-46a5-44b4-9675-904c417198fc req-a9b4db1b-355d-4dc4-a445-eb76ddfe3eba service nova] Creating event network-vif-plugged:9d106083-b7ba-40a6-aaba-56416aac7485 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:40:51.732070 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-d54b34ad-46a5-44b4-9675-904c417198fc req-a9b4db1b-355d-4dc4-a445-eb76ddfe3eba service nova] Creating event network-vif-plugged:5ad3e971-dbb2-4b55-9893-730ef94ad777 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:40:51.742350 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-d54b34ad-46a5-44b4-9675-904c417198fc req-a9b4db1b-355d-4dc4-a445-eb76ddfe3eba service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.066952 Jul 31 01:40:51.744303 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2692/5352] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:40:51.759067 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9948bbdf-f9a2-4282-b491-acde614a2040 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:51.759861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9948bbdf-f9a2-4282-b491-acde614a2040 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:51.760130 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-adf80c48-77c3-4f4c-87d6-f878a2a80887 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdca92e5eb6e4b3dab4900b42f896050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3de71380c941dcb2d2ba9e671ceb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:51.776430 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-adf80c48-77c3-4f4c-87d6-f878a2a80887 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 200 len: 1428 microversion: 2.1 time: 0.388888 Jul 31 01:40:51.777429 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2661/5353] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:51 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 1428 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:51.884322 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9948bbdf-f9a2-4282-b491-acde614a2040 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:51.899712 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9948bbdf-f9a2-4282-b491-acde614a2040 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1071 microversion: 2.1 time: 0.153731 Jul 31 01:40:51.900488 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2693/5354] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:51 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1071 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:52.095578 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e0a6d5dc-c481-44d3-b5cb-1bc3b56fcbc9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:52.097639 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e0a6d5dc-c481-44d3-b5cb-1bc3b56fcbc9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:52.117533 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0a6d5dc-c481-44d3-b5cb-1bc3b56fcbc9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:52.119487 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0a6d5dc-c481-44d3-b5cb-1bc3b56fcbc9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:52.121875 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0a6d5dc-c481-44d3-b5cb-1bc3b56fcbc9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:52.122601 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0a6d5dc-c481-44d3-b5cb-1bc3b56fcbc9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:52.407167 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6c38c7d9-5610-418d-8496-4550b13c0d21 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:52.409127 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6c38c7d9-5610-418d-8496-4550b13c0d21 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:52.419177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c38c7d9-5610-418d-8496-4550b13c0d21 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:52.423934 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c38c7d9-5610-418d-8496-4550b13c0d21 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:52.424989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c38c7d9-5610-418d-8496-4550b13c0d21 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:52.425610 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6c38c7d9-5610-418d-8496-4550b13c0d21 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:52.660882 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e0a6d5dc-c481-44d3-b5cb-1bc3b56fcbc9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:52.695012 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:52.708159 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e0a6d5dc-c481-44d3-b5cb-1bc3b56fcbc9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:52.747917 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e0a6d5dc-c481-44d3-b5cb-1bc3b56fcbc9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:52.749260 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e0a6d5dc-c481-44d3-b5cb-1bc3b56fcbc9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.659946 Jul 31 01:40:52.750352 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2662/5355] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:52 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:52.800208 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-55821b16-98c9-4c59-a169-9dc3799fc240 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:52.801553 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-55821b16-98c9-4c59-a169-9dc3799fc240 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:52.807923 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-55821b16-98c9-4c59-a169-9dc3799fc240 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:52.818342 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-55821b16-98c9-4c59-a169-9dc3799fc240 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:52.819433 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-55821b16-98c9-4c59-a169-9dc3799fc240 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:52.820038 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-55821b16-98c9-4c59-a169-9dc3799fc240 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:52.942277 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6c38c7d9-5610-418d-8496-4550b13c0d21 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ed635411234fcea462f7564f5c6251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466256620a640d39d739453af4c5f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:52.951783 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6c38c7d9-5610-418d-8496-4550b13c0d21 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] 10.222.0.45 "GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9" status: 200 len: 1313 microversion: 2.1 time: 0.548086 Jul 31 01:40:52.972779 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2694/5356] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:52 2022] GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9 => generated 1313 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:52.980059 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ccdb7e4c-7093-4033-bcca-cb2b92e7458b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:52.983310 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ccdb7e4c-7093-4033-bcca-cb2b92e7458b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:53.000774 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ccdb7e4c-7093-4033-bcca-cb2b92e7458b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:53.001255 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ccdb7e4c-7093-4033-bcca-cb2b92e7458b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:53.008423 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ccdb7e4c-7093-4033-bcca-cb2b92e7458b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:53.009051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ccdb7e4c-7093-4033-bcca-cb2b92e7458b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:53.396518 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ccdb7e4c-7093-4033-bcca-cb2b92e7458b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:53.414420 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ccdb7e4c-7093-4033-bcca-cb2b92e7458b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1113 microversion: 2.1 time: 0.440394 Jul 31 01:40:53.437343 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2695/5357] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:52 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1113 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:53.444481 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-4d794e89-e4c0-49ef-b234-9e21bd002f2d req-eb928c0c-4ed0-4872-899d-029cb6976611 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c452a2c9-d379-45c9-9143-92dc63949f69", "tag": "5aa2e5c9-4d77-4747-9f73-a4589654fbba"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:53.468865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4d794e89-e4c0-49ef-b234-9e21bd002f2d req-eb928c0c-4ed0-4872-899d-029cb6976611 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:53.469329 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4d794e89-e4c0-49ef-b234-9e21bd002f2d req-eb928c0c-4ed0-4872-899d-029cb6976611 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:53.488578 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-4d794e89-e4c0-49ef-b234-9e21bd002f2d req-eb928c0c-4ed0-4872-899d-029cb6976611 service nova] Creating event network-changed:5aa2e5c9-4d77-4747-9f73-a4589654fbba for instance c452a2c9-d379-45c9-9143-92dc63949f69 on n-h2-master-1 Jul 31 01:40:53.494987 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-4d794e89-e4c0-49ef-b234-9e21bd002f2d req-eb928c0c-4ed0-4872-899d-029cb6976611 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055679 Jul 31 01:40:53.495895 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2696/5358] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:40:53.567990 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-55821b16-98c9-4c59-a169-9dc3799fc240 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdca92e5eb6e4b3dab4900b42f896050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3de71380c941dcb2d2ba9e671ceb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:53.584970 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-55821b16-98c9-4c59-a169-9dc3799fc240 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 200 len: 1428 microversion: 2.1 time: 0.788509 Jul 31 01:40:53.599421 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2663/5359] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:52 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 1428 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:53.781636 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b72f0ff9-df8c-4f5d-bd65-8779a44d565c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:53.782550 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b72f0ff9-df8c-4f5d-bd65-8779a44d565c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:53.790036 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b72f0ff9-df8c-4f5d-bd65-8779a44d565c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:53.790834 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b72f0ff9-df8c-4f5d-bd65-8779a44d565c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:53.791987 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b72f0ff9-df8c-4f5d-bd65-8779a44d565c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:53.805789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b72f0ff9-df8c-4f5d-bd65-8779a44d565c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:53.980337 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e0f1e4ea-0b26-45dd-9175-e8d6120645f0 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:53.984714 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e0f1e4ea-0b26-45dd-9175-e8d6120645f0 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:54.001567 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0f1e4ea-0b26-45dd-9175-e8d6120645f0 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:54.003151 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0f1e4ea-0b26-45dd-9175-e8d6120645f0 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:54.004382 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0f1e4ea-0b26-45dd-9175-e8d6120645f0 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:54.007045 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e0f1e4ea-0b26-45dd-9175-e8d6120645f0 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:54.346369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b72f0ff9-df8c-4f5d-bd65-8779a44d565c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:54.364632 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b72f0ff9-df8c-4f5d-bd65-8779a44d565c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:54.395796 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b72f0ff9-df8c-4f5d-bd65-8779a44d565c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:54.398836 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b72f0ff9-df8c-4f5d-bd65-8779a44d565c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1875 microversion: 2.42 time: 0.625408 Jul 31 01:40:54.400618 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2697/5360] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:53 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1875 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:54.440407 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8b026fb0-33ed-4db9-9816-ed176ec82436 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:54.449827 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e0f1e4ea-0b26-45dd-9175-e8d6120645f0 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ed635411234fcea462f7564f5c6251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466256620a640d39d739453af4c5f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:54.456307 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8b026fb0-33ed-4db9-9816-ed176ec82436 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:54.468202 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e0f1e4ea-0b26-45dd-9175-e8d6120645f0 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] 10.222.0.45 "GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9" status: 200 len: 1313 microversion: 2.1 time: 0.496978 Jul 31 01:40:54.477603 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2664/5361] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:53 2022] GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9 => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:54.479087 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b026fb0-33ed-4db9-9816-ed176ec82436 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:54.479586 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b026fb0-33ed-4db9-9816-ed176ec82436 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:54.480663 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b026fb0-33ed-4db9-9816-ed176ec82436 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:54.480854 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b026fb0-33ed-4db9-9816-ed176ec82436 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:54.606811 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2b8f63c2-9716-4297-a70c-904686990d47 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:54.609078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2b8f63c2-9716-4297-a70c-904686990d47 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:54.617220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b8f63c2-9716-4297-a70c-904686990d47 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:54.619161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b8f63c2-9716-4297-a70c-904686990d47 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:54.620607 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b8f63c2-9716-4297-a70c-904686990d47 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:54.621061 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b8f63c2-9716-4297-a70c-904686990d47 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:54.748070 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8b026fb0-33ed-4db9-9816-ed176ec82436 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:54.757783 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8b026fb0-33ed-4db9-9816-ed176ec82436 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1187 microversion: 2.1 time: 0.321262 Jul 31 01:40:54.758713 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2698/5362] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:54 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1187 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:40:54.781597 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-1c42477b-9067-474d-9abb-aac68ff44db7 req-78526c61-b629-4bbd-8875-1911cec9c53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e3a06f6-118f-445f-b576-db2ed853d9f9", "name": "network-vif-plugged", "status": "completed", "tag": "5fbb3ec6-185e-4c14-8309-a8589a7d4fd7"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:54.793550 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1c42477b-9067-474d-9abb-aac68ff44db7 req-78526c61-b629-4bbd-8875-1911cec9c53e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:54.794513 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1c42477b-9067-474d-9abb-aac68ff44db7 req-78526c61-b629-4bbd-8875-1911cec9c53e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:54.808310 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1c42477b-9067-474d-9abb-aac68ff44db7 req-78526c61-b629-4bbd-8875-1911cec9c53e service nova] Creating event network-vif-plugged:5fbb3ec6-185e-4c14-8309-a8589a7d4fd7 for instance 7e3a06f6-118f-445f-b576-db2ed853d9f9 on n-h2-master-1 Jul 31 01:40:54.814671 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-1c42477b-9067-474d-9abb-aac68ff44db7 req-78526c61-b629-4bbd-8875-1911cec9c53e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054621 Jul 31 01:40:54.819586 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2699/5363] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:40:55.050188 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2b8f63c2-9716-4297-a70c-904686990d47 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdca92e5eb6e4b3dab4900b42f896050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3de71380c941dcb2d2ba9e671ceb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:55.051092 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f3da4b88-6d14-4a09-89c9-d7eeafe3de8f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:55.051889 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f3da4b88-6d14-4a09-89c9-d7eeafe3de8f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:55.073754 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3da4b88-6d14-4a09-89c9-d7eeafe3de8f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:55.074002 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2b8f63c2-9716-4297-a70c-904686990d47 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 200 len: 1428 microversion: 2.1 time: 0.469606 Jul 31 01:40:55.074722 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3da4b88-6d14-4a09-89c9-d7eeafe3de8f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:55.075752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3da4b88-6d14-4a09-89c9-d7eeafe3de8f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:55.076946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3da4b88-6d14-4a09-89c9-d7eeafe3de8f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:55.097174 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2665/5364] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:54 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 1428 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:40:55.123084 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f3da4b88-6d14-4a09-89c9-d7eeafe3de8f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments/1a1aad0d-0654-4412-8c54-d07a693614fc" status: 200 len: 194 microversion: 2.20 time: 0.076546 Jul 31 01:40:55.124482 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2700/5365] 10.222.0.45 () {60 vars in 1454 bytes} [Sun Jul 31 01:40:55 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments/1a1aad0d-0654-4412-8c54-d07a693614fc => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 01:40:55.214244 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0b9988b3-f2ee-4379-8949-ca39bbd314de tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:55.214746 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0b9988b3-f2ee-4379-8949-ca39bbd314de tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:55.221744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b9988b3-f2ee-4379-8949-ca39bbd314de tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:55.222210 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b9988b3-f2ee-4379-8949-ca39bbd314de tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:55.222993 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b9988b3-f2ee-4379-8949-ca39bbd314de tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:55.223458 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0b9988b3-f2ee-4379-8949-ca39bbd314de tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:55.334865 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-0b9988b3-f2ee-4379-8949-ca39bbd314de tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lazy-loading 'services' on Instance uuid 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:40:55.427262 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0b9988b3-f2ee-4379-8949-ca39bbd314de tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "DELETE /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments/1a1aad0d-0654-4412-8c54-d07a693614fc" status: 202 len: 0 microversion: 2.20 time: 0.216567 Jul 31 01:40:55.428811 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2666/5366] 10.222.0.45 () {60 vars in 1457 bytes} [Sun Jul 31 01:40:55 2022] DELETE /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments/1a1aad0d-0654-4412-8c54-d07a693614fc => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:40:55.446285 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3a4ccef5-f48d-47bb-aa42-5831e30e10db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:55.454975 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3a4ccef5-f48d-47bb-aa42-5831e30e10db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:55.456242 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-03ee8beb-aa3f-4822-8e1e-8452834a6f22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:55.458142 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-03ee8beb-aa3f-4822-8e1e-8452834a6f22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:55.470952 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a4ccef5-f48d-47bb-aa42-5831e30e10db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:55.472112 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03ee8beb-aa3f-4822-8e1e-8452834a6f22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:55.472578 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03ee8beb-aa3f-4822-8e1e-8452834a6f22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:55.473253 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a4ccef5-f48d-47bb-aa42-5831e30e10db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:55.473385 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03ee8beb-aa3f-4822-8e1e-8452834a6f22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:55.475416 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a4ccef5-f48d-47bb-aa42-5831e30e10db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:55.477651 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a4ccef5-f48d-47bb-aa42-5831e30e10db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:55.481669 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03ee8beb-aa3f-4822-8e1e-8452834a6f22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:55.599231 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3a4ccef5-f48d-47bb-aa42-5831e30e10db tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.161103 Jul 31 01:40:55.600142 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2667/5367] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:40:55 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:40:55.610794 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5487a2c0-d348-49e0-998a-e855d51caecc tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:55.611957 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5487a2c0-d348-49e0-998a-e855d51caecc tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:55.619078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5487a2c0-d348-49e0-998a-e855d51caecc tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:55.620022 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5487a2c0-d348-49e0-998a-e855d51caecc tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:55.621062 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5487a2c0-d348-49e0-998a-e855d51caecc tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:55.621742 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5487a2c0-d348-49e0-998a-e855d51caecc tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:55.946786 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-03ee8beb-aa3f-4822-8e1e-8452834a6f22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:55.977342 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-03ee8beb-aa3f-4822-8e1e-8452834a6f22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:55.979997 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-03ee8beb-aa3f-4822-8e1e-8452834a6f22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:55.981913 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-03ee8beb-aa3f-4822-8e1e-8452834a6f22 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 2833 microversion: 2.42 time: 0.558841 Jul 31 01:40:55.983444 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2701/5368] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:40:55 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 2833 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:56.002398 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d4c42055-31da-42dd-80ad-bca6f4719adb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:56.003525 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d4c42055-31da-42dd-80ad-bca6f4719adb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:56.013563 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4c42055-31da-42dd-80ad-bca6f4719adb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:56.015680 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4c42055-31da-42dd-80ad-bca6f4719adb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:56.016851 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4c42055-31da-42dd-80ad-bca6f4719adb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:56.017521 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4c42055-31da-42dd-80ad-bca6f4719adb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:56.021474 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5487a2c0-d348-49e0-998a-e855d51caecc tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ed635411234fcea462f7564f5c6251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466256620a640d39d739453af4c5f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:56.036691 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5487a2c0-d348-49e0-998a-e855d51caecc tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] 10.222.0.45 "GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9" status: 200 len: 1313 microversion: 2.1 time: 0.435081 Jul 31 01:40:56.037290 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2668/5369] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:55 2022] GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:56.044375 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-948afd1f-a6e8-47e8-8ffb-73131db2acfa tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:56.053061 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-948afd1f-a6e8-47e8-8ffb-73131db2acfa tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:56.063002 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-948afd1f-a6e8-47e8-8ffb-73131db2acfa tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:56.063722 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-948afd1f-a6e8-47e8-8ffb-73131db2acfa tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:56.064724 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-948afd1f-a6e8-47e8-8ffb-73131db2acfa tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:56.067429 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-948afd1f-a6e8-47e8-8ffb-73131db2acfa tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:56.145272 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d4c42055-31da-42dd-80ad-bca6f4719adb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:56.156371 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d4c42055-31da-42dd-80ad-bca6f4719adb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1187 microversion: 2.1 time: 0.168579 Jul 31 01:40:56.157280 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2702/5370] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:55 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1187 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:56.162856 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-38feb7fa-7f9e-4592-9306-53b8ddec4fae tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:56.163723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-38feb7fa-7f9e-4592-9306-53b8ddec4fae tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:56.170400 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38feb7fa-7f9e-4592-9306-53b8ddec4fae tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:56.171596 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38feb7fa-7f9e-4592-9306-53b8ddec4fae tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:56.172757 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38feb7fa-7f9e-4592-9306-53b8ddec4fae tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:56.173499 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-38feb7fa-7f9e-4592-9306-53b8ddec4fae tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:56.255522 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-948afd1f-a6e8-47e8-8ffb-73131db2acfa tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.216751 Jul 31 01:40:56.267583 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2669/5371] 10.222.0.45 () {60 vars in 1316 bytes} [Sun Jul 31 01:40:56 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b/os-interface => generated 1831 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:40:56.560029 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-38feb7fa-7f9e-4592-9306-53b8ddec4fae tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdca92e5eb6e4b3dab4900b42f896050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3de71380c941dcb2d2ba9e671ceb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:56.570354 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-38feb7fa-7f9e-4592-9306-53b8ddec4fae tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 200 len: 1428 microversion: 2.1 time: 0.411913 Jul 31 01:40:56.571232 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2703/5372] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:56 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 1428 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:56.612607 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-91d7646e-350b-4977-96e5-1a6f43670067 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:56.615178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-91d7646e-350b-4977-96e5-1a6f43670067 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:56.636964 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91d7646e-350b-4977-96e5-1a6f43670067 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:56.637425 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91d7646e-350b-4977-96e5-1a6f43670067 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:56.638212 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91d7646e-350b-4977-96e5-1a6f43670067 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:56.643536 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91d7646e-350b-4977-96e5-1a6f43670067 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:56.736366 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-91d7646e-350b-4977-96e5-1a6f43670067 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.127845 Jul 31 01:40:56.741847 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2670/5373] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:40:56 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:40:57.057988 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c624fc1a-9dd2-495e-b572-97a822774e15 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:57.058883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c624fc1a-9dd2-495e-b572-97a822774e15 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:57.068007 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c624fc1a-9dd2-495e-b572-97a822774e15 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:57.068720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c624fc1a-9dd2-495e-b572-97a822774e15 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:57.069663 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c624fc1a-9dd2-495e-b572-97a822774e15 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:57.070268 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c624fc1a-9dd2-495e-b572-97a822774e15 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:57.178983 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fdf5fd1c-c467-4a94-a070-718a6d1cb685 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:57.180963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fdf5fd1c-c467-4a94-a070-718a6d1cb685 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:57.191597 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:57.193880 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdf5fd1c-c467-4a94-a070-718a6d1cb685 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:57.194892 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdf5fd1c-c467-4a94-a070-718a6d1cb685 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:57.196265 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdf5fd1c-c467-4a94-a070-718a6d1cb685 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:57.196984 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdf5fd1c-c467-4a94-a070-718a6d1cb685 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:57.367845 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c624fc1a-9dd2-495e-b572-97a822774e15 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ed635411234fcea462f7564f5c6251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466256620a640d39d739453af4c5f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:57.381363 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c624fc1a-9dd2-495e-b572-97a822774e15 tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] 10.222.0.45 "GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9" status: 200 len: 1497 microversion: 2.1 time: 0.327717 Jul 31 01:40:57.388509 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2704/5374] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:57 2022] GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9 => generated 1497 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:57.590488 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fdf5fd1c-c467-4a94-a070-718a6d1cb685 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:57.593455 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=18 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:57.595332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d0516b57-e30a-4d4f-9e41-3ff92a8eda9b tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:57.597726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d0516b57-e30a-4d4f-9e41-3ff92a8eda9b tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:57.604391 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:40:57.604638 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fdf5fd1c-c467-4a94-a070-718a6d1cb685 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1229 microversion: 2.1 time: 0.430879 Jul 31 01:40:57.605375 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2671/5375] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:57 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1229 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:57.613622 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d0516b57-e30a-4d4f-9e41-3ff92a8eda9b tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:57.614696 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d0516b57-e30a-4d4f-9e41-3ff92a8eda9b tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:57.615824 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d0516b57-e30a-4d4f-9e41-3ff92a8eda9b tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:57.616516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d0516b57-e30a-4d4f-9e41-3ff92a8eda9b tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:57.749613 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-37393d15-28a4-40f4-b3be-28714c673d1f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:57.752116 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-37393d15-28a4-40f4-b3be-28714c673d1f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:57.766680 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37393d15-28a4-40f4-b3be-28714c673d1f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:57.767145 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37393d15-28a4-40f4-b3be-28714c673d1f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:57.770878 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37393d15-28a4-40f4-b3be-28714c673d1f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:57.771398 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37393d15-28a4-40f4-b3be-28714c673d1f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:57.816970 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-37393d15-28a4-40f4-b3be-28714c673d1f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072554 Jul 31 01:40:57.822765 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2672/5376] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:40:57 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 01:40:57.848921 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-d233c76a-0a9a-4a86-8439-baf34fb4c6e4 req-8cebd0bb-3ff0-4ae7-bf4f-db0735f46557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a611359d-c8ae-4c03-bdf4-b392393b1ff7", "tag": "2c7043d4-16fd-468b-90c6-9e87076309f7"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:57.872959 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d233c76a-0a9a-4a86-8439-baf34fb4c6e4 req-8cebd0bb-3ff0-4ae7-bf4f-db0735f46557 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:57.873699 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d233c76a-0a9a-4a86-8439-baf34fb4c6e4 req-8cebd0bb-3ff0-4ae7-bf4f-db0735f46557 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:57.909498 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-d233c76a-0a9a-4a86-8439-baf34fb4c6e4 req-8cebd0bb-3ff0-4ae7-bf4f-db0735f46557 service nova] Creating event network-changed:2c7043d4-16fd-468b-90c6-9e87076309f7 for instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 on n-h1-master-1 Jul 31 01:40:57.928730 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-d233c76a-0a9a-4a86-8439-baf34fb4c6e4 req-8cebd0bb-3ff0-4ae7-bf4f-db0735f46557 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076136 Jul 31 01:40:57.931451 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2673/5377] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:40:57.995479 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d0516b57-e30a-4d4f-9e41-3ff92a8eda9b tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdca92e5eb6e4b3dab4900b42f896050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3de71380c941dcb2d2ba9e671ceb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:58.003556 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d0516b57-e30a-4d4f-9e41-3ff92a8eda9b tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 200 len: 1428 microversion: 2.1 time: 0.415323 Jul 31 01:40:58.009338 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2705/5378] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:57 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 1428 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:40:58.130117 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-51c11500-6641-4cde-b98d-e3c53ec3e8c0 req-bc0660a7-7c98-4e30-a9df-1d039268ed08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "tag": "e1be7003-6e47-45d7-b637-ed3b70b52701"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:40:58.155258 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-51c11500-6641-4cde-b98d-e3c53ec3e8c0 req-bc0660a7-7c98-4e30-a9df-1d039268ed08 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:58.157914 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-51c11500-6641-4cde-b98d-e3c53ec3e8c0 req-bc0660a7-7c98-4e30-a9df-1d039268ed08 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:58.189058 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-51c11500-6641-4cde-b98d-e3c53ec3e8c0 req-bc0660a7-7c98-4e30-a9df-1d039268ed08 service nova] Creating event network-changed:e1be7003-6e47-45d7-b637-ed3b70b52701 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:40:58.204264 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-51c11500-6641-4cde-b98d-e3c53ec3e8c0 req-bc0660a7-7c98-4e30-a9df-1d039268ed08 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079140 Jul 31 01:40:58.205383 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2674/5379] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:40:58.626501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-53d1a583-d24d-4831-8778-4a63b0d8ced9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:58.627797 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-53d1a583-d24d-4831-8778-4a63b0d8ced9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:58.641104 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53d1a583-d24d-4831-8778-4a63b0d8ced9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:58.643755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53d1a583-d24d-4831-8778-4a63b0d8ced9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:58.644965 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53d1a583-d24d-4831-8778-4a63b0d8ced9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:58.647230 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53d1a583-d24d-4831-8778-4a63b0d8ced9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:58.832589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4bec6f8e-7365-416c-9a6f-1647ab0ea478 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:58.836552 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4bec6f8e-7365-416c-9a6f-1647ab0ea478 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:58.845326 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4bec6f8e-7365-416c-9a6f-1647ab0ea478 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:58.846748 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4bec6f8e-7365-416c-9a6f-1647ab0ea478 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:58.847796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4bec6f8e-7365-416c-9a6f-1647ab0ea478 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:58.848653 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4bec6f8e-7365-416c-9a6f-1647ab0ea478 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:58.906357 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4bec6f8e-7365-416c-9a6f-1647ab0ea478 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078491 Jul 31 01:40:58.913580 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2675/5380] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:40:58 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:40:59.024501 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8b1d3579-862d-4b90-8281-dc16bb87a020 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:59.025633 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8b1d3579-862d-4b90-8281-dc16bb87a020 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:59.040077 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b1d3579-862d-4b90-8281-dc16bb87a020 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:59.040962 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b1d3579-862d-4b90-8281-dc16bb87a020 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:59.042167 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b1d3579-862d-4b90-8281-dc16bb87a020 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:59.042766 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b1d3579-862d-4b90-8281-dc16bb87a020 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:59.267263 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-53d1a583-d24d-4831-8778-4a63b0d8ced9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:59.281377 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-53d1a583-d24d-4831-8778-4a63b0d8ced9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1229 microversion: 2.1 time: 0.658476 Jul 31 01:40:59.282544 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2706/5381] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:58 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1229 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:59.479913 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8b1d3579-862d-4b90-8281-dc16bb87a020 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdca92e5eb6e4b3dab4900b42f896050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3de71380c941dcb2d2ba9e671ceb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:40:59.493854 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8b1d3579-862d-4b90-8281-dc16bb87a020 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 200 len: 1428 microversion: 2.1 time: 0.470358 Jul 31 01:40:59.504587 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2676/5382] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:40:59 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 1428 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:40:59.933153 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0b33d762-9ba3-451d-a7f1-fc39e044d85c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:40:59.936540 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0b33d762-9ba3-451d-a7f1-fc39e044d85c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:40:59.950248 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b33d762-9ba3-451d-a7f1-fc39e044d85c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:59.951059 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b33d762-9ba3-451d-a7f1-fc39e044d85c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:59.952777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b33d762-9ba3-451d-a7f1-fc39e044d85c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:40:59.955473 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b33d762-9ba3-451d-a7f1-fc39e044d85c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:40:59.967459 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:00.021848 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0b33d762-9ba3-451d-a7f1-fc39e044d85c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101071 Jul 31 01:41:00.022438 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2707/5383] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:40:59 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:41:00.305659 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3d25cea9-f5d4-4f31-b575-624466ee67fb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:00.308083 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3d25cea9-f5d4-4f31-b575-624466ee67fb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:00.320363 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-5dd4d0fd-6f54-4768-a49f-182b536611f0 req-0dd1548d-622a-464f-bc88-f39b50beae6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c452a2c9-d379-45c9-9143-92dc63949f69", "name": "network-vif-plugged", "status": "completed", "tag": "5aa2e5c9-4d77-4747-9f73-a4589654fbba"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:00.321837 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d25cea9-f5d4-4f31-b575-624466ee67fb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:00.323244 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d25cea9-f5d4-4f31-b575-624466ee67fb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:00.324049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d25cea9-f5d4-4f31-b575-624466ee67fb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:00.324497 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d25cea9-f5d4-4f31-b575-624466ee67fb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:00.338121 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5dd4d0fd-6f54-4768-a49f-182b536611f0 req-0dd1548d-622a-464f-bc88-f39b50beae6f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:00.340522 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5dd4d0fd-6f54-4768-a49f-182b536611f0 req-0dd1548d-622a-464f-bc88-f39b50beae6f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:00.357524 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-5dd4d0fd-6f54-4768-a49f-182b536611f0 req-0dd1548d-622a-464f-bc88-f39b50beae6f service nova] Creating event network-vif-plugged:5aa2e5c9-4d77-4747-9f73-a4589654fbba for instance c452a2c9-d379-45c9-9143-92dc63949f69 on n-h2-master-1 Jul 31 01:41:00.379440 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-5dd4d0fd-6f54-4768-a49f-182b536611f0 req-0dd1548d-622a-464f-bc88-f39b50beae6f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062820 Jul 31 01:41:00.382323 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2708/5384] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:41:00.518756 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3033cfa-8204-4e3d-8c2a-c228f467b66f tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:00.519662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3033cfa-8204-4e3d-8c2a-c228f467b66f tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:00.532215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3033cfa-8204-4e3d-8c2a-c228f467b66f tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:00.532931 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3033cfa-8204-4e3d-8c2a-c228f467b66f tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:00.541141 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3033cfa-8204-4e3d-8c2a-c228f467b66f tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:00.542011 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3033cfa-8204-4e3d-8c2a-c228f467b66f tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:00.560151 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3d25cea9-f5d4-4f31-b575-624466ee67fb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:00.571113 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3d25cea9-f5d4-4f31-b575-624466ee67fb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1229 microversion: 2.1 time: 0.272126 Jul 31 01:41:00.572197 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2677/5385] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:00 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1229 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:00.733453 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3033cfa-8204-4e3d-8c2a-c228f467b66f tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdca92e5eb6e4b3dab4900b42f896050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3de71380c941dcb2d2ba9e671ceb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:00.741588 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3033cfa-8204-4e3d-8c2a-c228f467b66f tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 200 len: 1428 microversion: 2.1 time: 0.227672 Jul 31 01:41:00.742522 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2709/5386] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:00 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 1428 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:41:01.034306 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-245f0998-58c1-4933-80cc-dd99807c4ece tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:01.036971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-245f0998-58c1-4933-80cc-dd99807c4ece tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:01.043219 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-245f0998-58c1-4933-80cc-dd99807c4ece tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:01.043883 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-245f0998-58c1-4933-80cc-dd99807c4ece tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:01.044909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-245f0998-58c1-4933-80cc-dd99807c4ece tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:01.045470 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-245f0998-58c1-4933-80cc-dd99807c4ece tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:01.075630 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-245f0998-58c1-4933-80cc-dd99807c4ece tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045308 Jul 31 01:41:01.077181 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2678/5387] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:41:01 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:41:01.597200 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-633ba197-ad30-4850-b156-1e60c6435b3f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:01.598046 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-633ba197-ad30-4850-b156-1e60c6435b3f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:01.601042 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:01.608446 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-633ba197-ad30-4850-b156-1e60c6435b3f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:01.622287 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-633ba197-ad30-4850-b156-1e60c6435b3f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:01.623246 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-633ba197-ad30-4850-b156-1e60c6435b3f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:01.625977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-633ba197-ad30-4850-b156-1e60c6435b3f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:01.768947 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-efda7dd2-fb4e-480b-8374-94bb68155fee tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:01.770105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-efda7dd2-fb4e-480b-8374-94bb68155fee tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:01.791559 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efda7dd2-fb4e-480b-8374-94bb68155fee tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:01.792551 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efda7dd2-fb4e-480b-8374-94bb68155fee tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:01.796522 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efda7dd2-fb4e-480b-8374-94bb68155fee tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:01.799456 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efda7dd2-fb4e-480b-8374-94bb68155fee tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:01.897975 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=14 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:01.956142 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-633ba197-ad30-4850-b156-1e60c6435b3f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:01.966294 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-633ba197-ad30-4850-b156-1e60c6435b3f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1229 microversion: 2.1 time: 0.376238 Jul 31 01:41:01.968372 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2710/5388] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:01 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1229 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:02.033880 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-efda7dd2-fb4e-480b-8374-94bb68155fee tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdca92e5eb6e4b3dab4900b42f896050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3de71380c941dcb2d2ba9e671ceb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:02.056127 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-efda7dd2-fb4e-480b-8374-94bb68155fee tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 200 len: 1608 microversion: 2.1 time: 0.296404 Jul 31 01:41:02.057457 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2679/5389] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:01 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 1608 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:02.083708 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a67cce74-8ce9-4d22-9793-d32d7eba8af6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:02.084073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a67cce74-8ce9-4d22-9793-d32d7eba8af6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:02.091852 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a67cce74-8ce9-4d22-9793-d32d7eba8af6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:02.093178 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a67cce74-8ce9-4d22-9793-d32d7eba8af6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:02.094102 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8cd3078e-3aa3-4b72-9a32-7bae0a3b4ff6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:02.094460 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a67cce74-8ce9-4d22-9793-d32d7eba8af6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:02.095018 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a67cce74-8ce9-4d22-9793-d32d7eba8af6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:02.096929 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8cd3078e-3aa3-4b72-9a32-7bae0a3b4ff6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:02.106112 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cd3078e-3aa3-4b72-9a32-7bae0a3b4ff6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:02.108363 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cd3078e-3aa3-4b72-9a32-7bae0a3b4ff6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:02.111231 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cd3078e-3aa3-4b72-9a32-7bae0a3b4ff6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:02.111873 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cd3078e-3aa3-4b72-9a32-7bae0a3b4ff6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:02.138631 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:02.152406 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8cd3078e-3aa3-4b72-9a32-7bae0a3b4ff6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063957 Jul 31 01:41:02.153631 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2680/5390] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:41:02 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:41:02.242560 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a67cce74-8ce9-4d22-9793-d32d7eba8af6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdca92e5eb6e4b3dab4900b42f896050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3de71380c941dcb2d2ba9e671ceb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:02.251532 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a67cce74-8ce9-4d22-9793-d32d7eba8af6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 200 len: 1608 microversion: 2.1 time: 0.172444 Jul 31 01:41:02.252305 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2711/5391] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:02 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 1608 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:02.272177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e6a1c60f-52c3-471a-aaff-183648b2f92a tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:02.272915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e6a1c60f-52c3-471a-aaff-183648b2f92a tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:02.280054 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a1c60f-52c3-471a-aaff-183648b2f92a tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:02.280621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a1c60f-52c3-471a-aaff-183648b2f92a tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:02.281587 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a1c60f-52c3-471a-aaff-183648b2f92a tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:02.282124 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a1c60f-52c3-471a-aaff-183648b2f92a tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:02.426900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e6a1c60f-52c3-471a-aaff-183648b2f92a tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdca92e5eb6e4b3dab4900b42f896050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3de71380c941dcb2d2ba9e671ceb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:02.435191 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e6a1c60f-52c3-471a-aaff-183648b2f92a tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 200 len: 1608 microversion: 2.1 time: 0.167277 Jul 31 01:41:02.436633 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2681/5392] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:02 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 1608 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:02.993651 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-aafe39c9-0424-447b-9ada-3249c881e123 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:02.995574 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-aafe39c9-0424-447b-9ada-3249c881e123 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:03.006746 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aafe39c9-0424-447b-9ada-3249c881e123 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:03.007714 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aafe39c9-0424-447b-9ada-3249c881e123 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:03.008924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aafe39c9-0424-447b-9ada-3249c881e123 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:03.009639 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aafe39c9-0424-447b-9ada-3249c881e123 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:03.168063 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6cb81c98-0f73-4f31-92b0-61b9dab24420 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:03.170796 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6cb81c98-0f73-4f31-92b0-61b9dab24420 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:03.178424 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6cb81c98-0f73-4f31-92b0-61b9dab24420 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:03.179262 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6cb81c98-0f73-4f31-92b0-61b9dab24420 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:03.180316 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6cb81c98-0f73-4f31-92b0-61b9dab24420 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:03.180969 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6cb81c98-0f73-4f31-92b0-61b9dab24420 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:03.218143 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6cb81c98-0f73-4f31-92b0-61b9dab24420 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055299 Jul 31 01:41:03.219707 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2682/5393] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:41:03 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 01:41:03.226767 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-aafe39c9-0424-447b-9ada-3249c881e123 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:03.235980 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-aafe39c9-0424-447b-9ada-3249c881e123 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1229 microversion: 2.1 time: 0.250262 Jul 31 01:41:03.236895 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2712/5394] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:02 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1229 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:04.230550 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f5479f70-940d-477b-8b4c-7945832f3dd1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:04.233317 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f5479f70-940d-477b-8b4c-7945832f3dd1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:04.240594 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5479f70-940d-477b-8b4c-7945832f3dd1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:04.241048 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5479f70-940d-477b-8b4c-7945832f3dd1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:04.241823 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5479f70-940d-477b-8b4c-7945832f3dd1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:04.242260 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5479f70-940d-477b-8b4c-7945832f3dd1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:04.261135 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f8722137-240a-45f2-ba6e-7eade59523ab tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:04.263883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f8722137-240a-45f2-ba6e-7eade59523ab tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:04.276488 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f5479f70-940d-477b-8b4c-7945832f3dd1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049889 Jul 31 01:41:04.281161 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2683/5395] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:41:04 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:41:04.282279 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8722137-240a-45f2-ba6e-7eade59523ab tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:04.282828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8722137-240a-45f2-ba6e-7eade59523ab tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:04.284043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8722137-240a-45f2-ba6e-7eade59523ab tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:04.284753 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8722137-240a-45f2-ba6e-7eade59523ab tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:04.820607 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f8722137-240a-45f2-ba6e-7eade59523ab tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:04.836164 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f8722137-240a-45f2-ba6e-7eade59523ab tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1229 microversion: 2.1 time: 0.579948 Jul 31 01:41:04.836786 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2713/5396] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:04 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1229 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:05.051383 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-8ffb121f-6a80-481e-8337-a05f43a3a3ae req-05e53a60-1470-462d-bbf1-9a109cacf5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c452a2c9-d379-45c9-9143-92dc63949f69", "tag": "5aa2e5c9-4d77-4747-9f73-a4589654fbba"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:05.068423 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8ffb121f-6a80-481e-8337-a05f43a3a3ae req-05e53a60-1470-462d-bbf1-9a109cacf5d3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:05.068883 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8ffb121f-6a80-481e-8337-a05f43a3a3ae req-05e53a60-1470-462d-bbf1-9a109cacf5d3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:05.117405 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-8ffb121f-6a80-481e-8337-a05f43a3a3ae req-05e53a60-1470-462d-bbf1-9a109cacf5d3 service nova] Creating event network-changed:5aa2e5c9-4d77-4747-9f73-a4589654fbba for instance c452a2c9-d379-45c9-9143-92dc63949f69 on n-h2-master-1 Jul 31 01:41:05.127393 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-8ffb121f-6a80-481e-8337-a05f43a3a3ae req-05e53a60-1470-462d-bbf1-9a109cacf5d3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080109 Jul 31 01:41:05.130628 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2684/5397] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:41:05.290774 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a54345c2-fec1-427d-8736-5695d03bcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:05.294402 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a54345c2-fec1-427d-8736-5695d03bcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:05.313252 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a54345c2-fec1-427d-8736-5695d03bcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:05.314020 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a54345c2-fec1-427d-8736-5695d03bcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:05.316243 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a54345c2-fec1-427d-8736-5695d03bcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:05.316938 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a54345c2-fec1-427d-8736-5695d03bcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:05.396278 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a54345c2-fec1-427d-8736-5695d03bcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.110935 Jul 31 01:41:05.398085 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2714/5398] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:41:05 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:05.525570 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f6508997-e1df-4011-8c35-79410eaeaa1e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:05.526806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f6508997-e1df-4011-8c35-79410eaeaa1e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:05.544048 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6508997-e1df-4011-8c35-79410eaeaa1e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:05.544647 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6508997-e1df-4011-8c35-79410eaeaa1e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:05.547997 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6508997-e1df-4011-8c35-79410eaeaa1e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:05.548523 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6508997-e1df-4011-8c35-79410eaeaa1e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:05.616983 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f6508997-e1df-4011-8c35-79410eaeaa1e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:41:05.781191 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f6508997-e1df-4011-8c35-79410eaeaa1e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "DELETE /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 204 len: 0 microversion: 2.20 time: 0.261754 Jul 31 01:41:05.781794 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2685/5399] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:41:05 2022] DELETE /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:41:05.790574 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7022ab8d-7037-4791-8797-c2566c67c1dd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:05.791247 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7022ab8d-7037-4791-8797-c2566c67c1dd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:05.801295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7022ab8d-7037-4791-8797-c2566c67c1dd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:05.806917 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7022ab8d-7037-4791-8797-c2566c67c1dd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:05.808005 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7022ab8d-7037-4791-8797-c2566c67c1dd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:05.809187 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7022ab8d-7037-4791-8797-c2566c67c1dd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:05.859189 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-58e4313e-19a4-43fe-9c6a-0191003ebcbf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:05.860137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-58e4313e-19a4-43fe-9c6a-0191003ebcbf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:05.873711 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58e4313e-19a4-43fe-9c6a-0191003ebcbf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:05.874471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58e4313e-19a4-43fe-9c6a-0191003ebcbf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:05.875465 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58e4313e-19a4-43fe-9c6a-0191003ebcbf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:05.882446 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58e4313e-19a4-43fe-9c6a-0191003ebcbf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:06.202444 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7022ab8d-7037-4791-8797-c2566c67c1dd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:06.216374 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7022ab8d-7037-4791-8797-c2566c67c1dd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:06.218971 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7022ab8d-7037-4791-8797-c2566c67c1dd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:06.222671 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7022ab8d-7037-4791-8797-c2566c67c1dd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.436033 Jul 31 01:41:06.242089 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2715/5400] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:41:05 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:41:06.273280 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-58e4313e-19a4-43fe-9c6a-0191003ebcbf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:06.282848 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-58e4313e-19a4-43fe-9c6a-0191003ebcbf tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1229 microversion: 2.1 time: 0.428320 Jul 31 01:41:06.308107 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2686/5401] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:05 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1229 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:41:07.257489 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d41f806c-a04d-4273-9e64-e4406a049cad tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:07.258056 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d41f806c-a04d-4273-9e64-e4406a049cad tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:07.266443 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d41f806c-a04d-4273-9e64-e4406a049cad tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:07.267401 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d41f806c-a04d-4273-9e64-e4406a049cad tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:07.268501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d41f806c-a04d-4273-9e64-e4406a049cad tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:07.269237 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d41f806c-a04d-4273-9e64-e4406a049cad tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:07.321540 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fb60d4ba-9346-40e9-bd27-c4dd614e8c46 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:07.322390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fb60d4ba-9346-40e9-bd27-c4dd614e8c46 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:07.331276 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb60d4ba-9346-40e9-bd27-c4dd614e8c46 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:07.331757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb60d4ba-9346-40e9-bd27-c4dd614e8c46 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:07.332548 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb60d4ba-9346-40e9-bd27-c4dd614e8c46 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:07.332992 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb60d4ba-9346-40e9-bd27-c4dd614e8c46 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:07.518292 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d41f806c-a04d-4273-9e64-e4406a049cad tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:07.528681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d41f806c-a04d-4273-9e64-e4406a049cad tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:07.532136 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d41f806c-a04d-4273-9e64-e4406a049cad tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:07.532136 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d41f806c-a04d-4273-9e64-e4406a049cad tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.278988 Jul 31 01:41:07.535146 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2716/5402] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:41:07 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:41:07.560310 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fb60d4ba-9346-40e9-bd27-c4dd614e8c46 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:07.569756 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fb60d4ba-9346-40e9-bd27-c4dd614e8c46 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1217 microversion: 2.1 time: 0.255772 Jul 31 01:41:07.571560 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2687/5403] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:07 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1217 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:41:08.304530 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c405577d-c4d8-4055-80e4-99625748eead tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:08.305174 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c405577d-c4d8-4055-80e4-99625748eead tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:08.313166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c405577d-c4d8-4055-80e4-99625748eead tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:08.313718 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c405577d-c4d8-4055-80e4-99625748eead tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:08.314637 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c405577d-c4d8-4055-80e4-99625748eead tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:08.315310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c405577d-c4d8-4055-80e4-99625748eead tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:08.345355 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c405577d-c4d8-4055-80e4-99625748eead tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:41:08.453822 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c405577d-c4d8-4055-80e4-99625748eead tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9" status: 204 len: 0 microversion: 2.1 time: 0.153388 Jul 31 01:41:08.454512 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2717/5404] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:41:08 2022] DELETE /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:41:08.462823 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c90b9f59-756f-4cd2-bcf6-03ea27f7a99e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:08.464055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c90b9f59-756f-4cd2-bcf6-03ea27f7a99e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:08.471241 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c90b9f59-756f-4cd2-bcf6-03ea27f7a99e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:08.471744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c90b9f59-756f-4cd2-bcf6-03ea27f7a99e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:08.472516 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c90b9f59-756f-4cd2-bcf6-03ea27f7a99e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:08.472960 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c90b9f59-756f-4cd2-bcf6-03ea27f7a99e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:08.566890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3c4593c7-35d1-4bc8-9c28-5e19e512e6dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:08.568571 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3c4593c7-35d1-4bc8-9c28-5e19e512e6dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:08.577203 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c4593c7-35d1-4bc8-9c28-5e19e512e6dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:08.577670 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c4593c7-35d1-4bc8-9c28-5e19e512e6dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:08.578656 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c4593c7-35d1-4bc8-9c28-5e19e512e6dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:08.579222 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c4593c7-35d1-4bc8-9c28-5e19e512e6dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:08.739993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c90b9f59-756f-4cd2-bcf6-03ea27f7a99e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ed635411234fcea462f7564f5c6251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466256620a640d39d739453af4c5f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:08.755179 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c90b9f59-756f-4cd2-bcf6-03ea27f7a99e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] 10.222.0.45 "GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9" status: 200 len: 1503 microversion: 2.1 time: 0.296096 Jul 31 01:41:08.759184 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2688/5405] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:08 2022] GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9 => generated 1503 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:08.764811 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dcb0dca5-53e7-45e2-8044-ab327adf988b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:08.765486 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dcb0dca5-53e7-45e2-8044-ab327adf988b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:08.774166 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dcb0dca5-53e7-45e2-8044-ab327adf988b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:08.775164 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dcb0dca5-53e7-45e2-8044-ab327adf988b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:08.776002 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dcb0dca5-53e7-45e2-8044-ab327adf988b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:08.776445 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dcb0dca5-53e7-45e2-8044-ab327adf988b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:08.887997 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3c4593c7-35d1-4bc8-9c28-5e19e512e6dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:08.897066 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3c4593c7-35d1-4bc8-9c28-5e19e512e6dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:08.898589 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3c4593c7-35d1-4bc8-9c28-5e19e512e6dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:08.899861 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3c4593c7-35d1-4bc8-9c28-5e19e512e6dc tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 200 len: 1721 microversion: 2.20 time: 0.342700 Jul 31 01:41:08.900750 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2718/5406] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:41:08 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 1721 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:41:09.040131 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dcb0dca5-53e7-45e2-8044-ab327adf988b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:09.056830 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dcb0dca5-53e7-45e2-8044-ab327adf988b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1217 microversion: 2.1 time: 0.296336 Jul 31 01:41:09.057474 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2689/5407] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:08 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1217 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:09.235628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-ea57645d-1a48-4b3f-a031-7ac1622a1d36 req-d63adb1d-0804-42de-9501-ded397abe4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b00bb6-bfdc-4ddc-bfd7-dc53016544bd", "name": "network-vif-deleted", "tag": "b03d8e12-2d7a-43c2-a2c3-344746d2f716"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:09.246274 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ea57645d-1a48-4b3f-a031-7ac1622a1d36 req-d63adb1d-0804-42de-9501-ded397abe4d4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:09.247044 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ea57645d-1a48-4b3f-a031-7ac1622a1d36 req-d63adb1d-0804-42de-9501-ded397abe4d4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:09.261861 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-ea57645d-1a48-4b3f-a031-7ac1622a1d36 req-d63adb1d-0804-42de-9501-ded397abe4d4 service nova] Creating event network-vif-deleted:b03d8e12-2d7a-43c2-a2c3-344746d2f716 for instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd on n-h1-master-1 Jul 31 01:41:09.269405 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-ea57645d-1a48-4b3f-a031-7ac1622a1d36 req-d63adb1d-0804-42de-9501-ded397abe4d4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037598 Jul 31 01:41:09.273439 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2719/5408] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:41:09.788224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-17941c8a-83de-4af3-9305-c7103b363b0e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:09.789201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-17941c8a-83de-4af3-9305-c7103b363b0e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:09.799630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17941c8a-83de-4af3-9305-c7103b363b0e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:09.800703 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17941c8a-83de-4af3-9305-c7103b363b0e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:09.802320 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17941c8a-83de-4af3-9305-c7103b363b0e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:09.803540 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17941c8a-83de-4af3-9305-c7103b363b0e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:09.925571 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7cab89dc-35c8-4fe8-986d-8ad047e683f1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:09.926434 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7cab89dc-35c8-4fe8-986d-8ad047e683f1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:09.933069 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7cab89dc-35c8-4fe8-986d-8ad047e683f1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:09.933633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7cab89dc-35c8-4fe8-986d-8ad047e683f1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:09.934610 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7cab89dc-35c8-4fe8-986d-8ad047e683f1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:09.935253 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7cab89dc-35c8-4fe8-986d-8ad047e683f1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:09.960118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-17941c8a-83de-4af3-9305-c7103b363b0e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ed635411234fcea462f7564f5c6251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466256620a640d39d739453af4c5f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:09.967419 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-7cab89dc-35c8-4fe8-986d-8ad047e683f1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] HTTP exception thrown: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7cab89dc-35c8-4fe8-986d-8ad047e683f1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Request method failure captured: Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd HTTP/1.1 Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dytLYovzsdU6l99mr3IwrEW6j42KeQCQufWjpy9PXb0I8z7fgHtiCMZYHjVXnMbSEbhy3qB7zQVfivfwTfD2O0ExbcJOYmSDWnmmV6IZbEn-R0uCQ2RLIXz0YiRptikx5VD6l7jCJanCFClZxjKN6bxH2e1VEQopxnCkkkOhBLkxoU Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: fb35771c7e744f859d2c5d29b511d345 Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fb35771c7e744f859d2c5d29b511d345", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: fb35771c7e744f859d2c5d29b511d345 Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AttachVolumeShelveTestJSON-408575781-project Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 5da6102ddcb948fa874856fa1ac7226d Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AttachVolumeShelveTestJSON-408575781-project Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '62b00bb6-bfdc-4ddc-bfd7-dc53016544bd'} Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:41:09.971133 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:41:09.976720 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:41:09.976720 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:41:09.976720 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:41:09.976720 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:41:09.976720 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:41:09.976720 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:41:09.976720 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. Jul 31 01:41:09.976720 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:41:09.977831 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7cab89dc-35c8-4fe8-986d-8ad047e683f1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Returning 404 to user: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:41:09.978383 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-17941c8a-83de-4af3-9305-c7103b363b0e tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] 10.222.0.45 "GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9" status: 200 len: 1503 microversion: 2.1 time: 0.191962 Jul 31 01:41:09.979832 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7cab89dc-35c8-4fe8-986d-8ad047e683f1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 404 len: 111 microversion: 2.20 time: 0.059349 Jul 31 01:41:09.980450 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2690/5409] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:09 2022] GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9 => generated 1503 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:09.986256 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2720/5410] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:41:09 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 31 01:41:10.003944 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-26852bae-3358-456e-8d57-c00285a61798 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '.version_select at 0x7fede46e3550>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:10.033586 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-26852bae-3358-456e-8d57-c00285a61798 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-687044670" status: 204 len: 0 microversion: 2.20 time: 0.037225 Jul 31 01:41:10.034827 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2721/5411] 10.222.0.45 () {60 vars in 1259 bytes} [Sun Jul 31 01:41:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-687044670 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:41:10.079702 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ba4a0f64-1d19-49b1-a821-2015b87a8ace tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:10.080629 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ba4a0f64-1d19-49b1-a821-2015b87a8ace tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:10.091528 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba4a0f64-1d19-49b1-a821-2015b87a8ace tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:10.092535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba4a0f64-1d19-49b1-a821-2015b87a8ace tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:10.099596 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba4a0f64-1d19-49b1-a821-2015b87a8ace tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:10.100318 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba4a0f64-1d19-49b1-a821-2015b87a8ace tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:10.295911 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ba4a0f64-1d19-49b1-a821-2015b87a8ace tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:10.305491 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ba4a0f64-1d19-49b1-a821-2015b87a8ace tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1217 microversion: 2.1 time: 0.230503 Jul 31 01:41:10.306869 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2691/5412] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:10 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1217 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:10.588632 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-4266201d-c304-4306-b71c-284b6e354fcc req-8036bb4e-4554-4583-a95c-5c067debcb2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e3a06f6-118f-445f-b576-db2ed853d9f9", "name": "network-vif-deleted", "tag": "5fbb3ec6-185e-4c14-8309-a8589a7d4fd7"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:10.609783 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4266201d-c304-4306-b71c-284b6e354fcc req-8036bb4e-4554-4583-a95c-5c067debcb2e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:10.610239 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4266201d-c304-4306-b71c-284b6e354fcc req-8036bb4e-4554-4583-a95c-5c067debcb2e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:10.669926 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-4266201d-c304-4306-b71c-284b6e354fcc req-8036bb4e-4554-4583-a95c-5c067debcb2e service nova] Creating event network-vif-deleted:5fbb3ec6-185e-4c14-8309-a8589a7d4fd7 for instance 7e3a06f6-118f-445f-b576-db2ed853d9f9 on n-h2-master-1 Jul 31 01:41:10.675630 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-4266201d-c304-4306-b71c-284b6e354fcc req-8036bb4e-4554-4583-a95c-5c067debcb2e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097507 Jul 31 01:41:10.676667 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2722/5413] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:41:11.005260 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ca05d13e-bfdd-4b3e-8e21-3e852c5292ad tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:11.005260 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ca05d13e-bfdd-4b3e-8e21-3e852c5292ad tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:11.014137 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca05d13e-bfdd-4b3e-8e21-3e852c5292ad tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:11.014828 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca05d13e-bfdd-4b3e-8e21-3e852c5292ad tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:11.015661 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca05d13e-bfdd-4b3e-8e21-3e852c5292ad tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:11.016273 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca05d13e-bfdd-4b3e-8e21-3e852c5292ad tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:11.038600 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f9f68038-5aed-4894-9e81-6e8fb0613052 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Action: 'create', calling method: .version_select at 0x7fede45d4c10>, body: {"keypair": {"name": "tempest-keypair-2059455023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArCZ/htvLf6BnGyfZi27u3MGvTMCc8CbCytfKN98niK8CwL3D39Su2umgEPU+EjjUZEJmylwmQNe4TtajTBOcdoPQwwUJ+WcVHVONXwMHU55ZbmzPfybnCbcQB+MZp6dw=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:11.053248 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca05d13e-bfdd-4b3e-8e21-3e852c5292ad tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:11.054069 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca05d13e-bfdd-4b3e-8e21-3e852c5292ad tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:11.054667 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-ca05d13e-bfdd-4b3e-8e21-3e852c5292ad tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lazy-loading 'fault' on Instance uuid 7e3a06f6-118f-445f-b576-db2ed853d9f9 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:41:11.055799 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-f9f68038-5aed-4894-9e81-6e8fb0613052 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Getting quotas for project fb35771c7e744f859d2c5d29b511d345. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:41:11.062650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-f9f68038-5aed-4894-9e81-6e8fb0613052 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Getting quotas for user 5da6102ddcb948fa874856fa1ac7226d and project fb35771c7e744f859d2c5d29b511d345. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:41:11.090737 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f9f68038-5aed-4894-9e81-6e8fb0613052 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.060021 Jul 31 01:41:11.098353 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2723/5414] 10.222.0.45 () {62 vars in 1200 bytes} [Sun Jul 31 01:41:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 31 01:41:11.110784 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ca05d13e-bfdd-4b3e-8e21-3e852c5292ad tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ed635411234fcea462f7564f5c6251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4466256620a640d39d739453af4c5f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:11.121907 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ca05d13e-bfdd-4b3e-8e21-3e852c5292ad tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] 10.222.0.45 "GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9" status: 200 len: 1303 microversion: 2.1 time: 0.123153 Jul 31 01:41:11.122515 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2692/5415] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:10 2022] GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9 => generated 1303 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:11.330012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7f2d76de-3177-41b9-97c4-c0a0b6e723a2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:11.330951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7f2d76de-3177-41b9-97c4-c0a0b6e723a2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:11.339139 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f2d76de-3177-41b9-97c4-c0a0b6e723a2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:11.339849 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f2d76de-3177-41b9-97c4-c0a0b6e723a2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:11.340860 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f2d76de-3177-41b9-97c4-c0a0b6e723a2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:11.341332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f2d76de-3177-41b9-97c4-c0a0b6e723a2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:11.812272 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7f2d76de-3177-41b9-97c4-c0a0b6e723a2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:11.820830 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7f2d76de-3177-41b9-97c4-c0a0b6e723a2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1217 microversion: 2.1 time: 0.495710 Jul 31 01:41:11.821413 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2724/5416] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:11 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1217 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:12.146537 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a4a75ac4-c374-4bb2-b7d4-7629b6b4273f tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:12.148837 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a4a75ac4-c374-4bb2-b7d4-7629b6b4273f tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] [instance: 7e3a06f6-118f-445f-b576-db2ed853d9f9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:12.158017 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a4a75ac4-c374-4bb2-b7d4-7629b6b4273f tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:12.158804 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a4a75ac4-c374-4bb2-b7d4-7629b6b4273f tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:12.159976 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a4a75ac4-c374-4bb2-b7d4-7629b6b4273f tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:12.160723 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a4a75ac4-c374-4bb2-b7d4-7629b6b4273f tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:12.177333 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-a4a75ac4-c374-4bb2-b7d4-7629b6b4273f tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] HTTP exception thrown: Instance 7e3a06f6-118f-445f-b576-db2ed853d9f9 could not be found. Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a4a75ac4-c374-4bb2-b7d4-7629b6b4273f tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Request method failure captured: Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9 HTTP/1.1 Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5d2SdT7X-prv4dNeBfHpvKaFaIPsjyWEsreKO7b80L7ziuwMM4tvYKBw0DDGf1J_dBxnmkn8K56-siZMNAB73gLQqkCDVQosFedeOEJmyZHEvuROwTVMrZstwylYabPF_G9jjhB3MPH06Iy3fB9ER8_VdqPaXB9L3mVPHgAjA1wympo Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 4466256620a640d39d739453af4c5f15 Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesActionsTest-779075621 Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4466256620a640d39d739453af4c5f15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4466256620a640d39d739453af4c5f15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4466256620a640d39d739453af4c5f15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4466256620a640d39d739453af4c5f15", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesActionsTest-779075621 Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 4466256620a640d39d739453af4c5f15 Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesActionsTest-779075621 Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesActionsTest-779075621-project Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 16ed635411234fcea462f7564f5c6251 Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesActionsTest-779075621-project Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 7e3a06f6-118f-445f-b576-db2ed853d9f9 could not be found. Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '7e3a06f6-118f-445f-b576-db2ed853d9f9'} Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e3a06f6-118f-445f-b576-db2ed853d9f9 could not be found. Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e3a06f6-118f-445f-b576-db2ed853d9f9 could not be found. Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:41:12.179003 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:41:12.183227 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:41:12.183227 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:41:12.183227 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:41:12.183227 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:41:12.183227 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:41:12.183227 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e3a06f6-118f-445f-b576-db2ed853d9f9 could not be found. Jul 31 01:41:12.183227 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:41:12.183227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a4a75ac4-c374-4bb2-b7d4-7629b6b4273f tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] Returning 404 to user: Instance 7e3a06f6-118f-445f-b576-db2ed853d9f9 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:41:12.183227 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a4a75ac4-c374-4bb2-b7d4-7629b6b4273f tempest-VolumesActionsTest-779075621 tempest-VolumesActionsTest-779075621-project] 10.222.0.45 "GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9" status: 404 len: 111 microversion: 2.1 time: 0.039790 Jul 31 01:41:12.183227 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2693/5417] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:12 2022] GET /compute/v2.1/servers/7e3a06f6-118f-445f-b576-db2ed853d9f9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:41:12.741277 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8b72d761-41fa-46c6-a018-a44e53268684 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2032684205", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f3890ca-777f-480e-899c-5bbbe6b23db9"}], "security_groups": [{"name": "tempest-securitygroup--1211337570"}], "key_name": "tempest-keypair-2059455023", "user_data": "}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:12.844491 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cd4e8964-3343-4dbd-bc72-aa979c78572c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:12.845648 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cd4e8964-3343-4dbd-bc72-aa979c78572c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:12.850531 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-8b72d761-41fa-46c6-a018-a44e53268684 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] validate_networks() for [('7f3890ca-777f-480e-899c-5bbbe6b23db9', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:41:12.855255 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd4e8964-3343-4dbd-bc72-aa979c78572c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:12.856161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd4e8964-3343-4dbd-bc72-aa979c78572c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:12.858581 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd4e8964-3343-4dbd-bc72-aa979c78572c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:12.859213 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd4e8964-3343-4dbd-bc72-aa979c78572c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:13.220867 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cd4e8964-3343-4dbd-bc72-aa979c78572c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:13.232981 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cd4e8964-3343-4dbd-bc72-aa979c78572c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1217 microversion: 2.1 time: 0.393208 Jul 31 01:41:13.235530 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2694/5418] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:12 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1217 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:13.455901 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8b72d761-41fa-46c6-a018-a44e53268684 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:41:13.456336 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8b72d761-41fa-46c6-a018-a44e53268684 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:41:13.456848 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8b72d761-41fa-46c6-a018-a44e53268684 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:41:13.457303 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8b72d761-41fa-46c6-a018-a44e53268684 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:41:13.457886 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-8b72d761-41fa-46c6-a018-a44e53268684 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:41:13.468559 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b72d761-41fa-46c6-a018-a44e53268684 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:13.469051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b72d761-41fa-46c6-a018-a44e53268684 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:13.469979 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b72d761-41fa-46c6-a018-a44e53268684 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:13.470433 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b72d761-41fa-46c6-a018-a44e53268684 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:13.488542 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-8b72d761-41fa-46c6-a018-a44e53268684 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Getting quotas for project fb35771c7e744f859d2c5d29b511d345. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:41:13.495187 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-8b72d761-41fa-46c6-a018-a44e53268684 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Getting quotas for user 5da6102ddcb948fa874856fa1ac7226d and project fb35771c7e744f859d2c5d29b511d345. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:41:13.509589 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8b72d761-41fa-46c6-a018-a44e53268684 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:41:13.512728 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8b72d761-41fa-46c6-a018-a44e53268684 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:41:13.584916 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8b72d761-41fa-46c6-a018-a44e53268684 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.848225 Jul 31 01:41:13.592664 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2725/5419] 10.222.0.45 () {62 vars in 1188 bytes} [Sun Jul 31 01:41:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 01:41:13.597991 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-37f9ab0c-df6e-4c09-987e-119e780d2f92 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:13.598674 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-37f9ab0c-df6e-4c09-987e-119e780d2f92 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:13.670145 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-37f9ab0c-df6e-4c09-987e-119e780d2f92 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:13.679721 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-37f9ab0c-df6e-4c09-987e-119e780d2f92 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:13.681553 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-37f9ab0c-df6e-4c09-987e-119e780d2f92 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:13.682929 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-37f9ab0c-df6e-4c09-987e-119e780d2f92 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1282 microversion: 2.20 time: 0.089018 Jul 31 01:41:13.683986 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2695/5420] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:41:13 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1282 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:41:14.256200 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1bb4659c-2024-4179-8ada-3cab44e80434 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:14.256979 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1bb4659c-2024-4179-8ada-3cab44e80434 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:14.265767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bb4659c-2024-4179-8ada-3cab44e80434 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:14.266505 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bb4659c-2024-4179-8ada-3cab44e80434 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:14.267721 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bb4659c-2024-4179-8ada-3cab44e80434 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:14.268447 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bb4659c-2024-4179-8ada-3cab44e80434 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:14.435128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1bb4659c-2024-4179-8ada-3cab44e80434 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:14.444732 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1bb4659c-2024-4179-8ada-3cab44e80434 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1217 microversion: 2.1 time: 0.193562 Jul 31 01:41:14.445269 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2726/5421] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:14 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1217 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:14.714245 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bf3a7148-d1a1-4816-b7f2-d980642ca8c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:14.734155 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bf3a7148-d1a1-4816-b7f2-d980642ca8c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:14.738482 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf3a7148-d1a1-4816-b7f2-d980642ca8c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:14.739256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf3a7148-d1a1-4816-b7f2-d980642ca8c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:14.749377 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf3a7148-d1a1-4816-b7f2-d980642ca8c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:14.749770 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf3a7148-d1a1-4816-b7f2-d980642ca8c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:14.832208 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bf3a7148-d1a1-4816-b7f2-d980642ca8c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:14.841667 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bf3a7148-d1a1-4816-b7f2-d980642ca8c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:14.844160 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bf3a7148-d1a1-4816-b7f2-d980642ca8c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:14.845514 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bf3a7148-d1a1-4816-b7f2-d980642ca8c3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1334 microversion: 2.20 time: 0.135422 Jul 31 01:41:14.846681 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2696/5422] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:41:14 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1334 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:41:15.466617 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0b3935da-91e8-4057-a91b-7600ade16d42 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:15.468684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0b3935da-91e8-4057-a91b-7600ade16d42 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:15.476778 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b3935da-91e8-4057-a91b-7600ade16d42 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:15.477601 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b3935da-91e8-4057-a91b-7600ade16d42 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:15.478681 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b3935da-91e8-4057-a91b-7600ade16d42 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:15.479581 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b3935da-91e8-4057-a91b-7600ade16d42 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:15.508895 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:15.678457 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0b3935da-91e8-4057-a91b-7600ade16d42 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:15.688746 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0b3935da-91e8-4057-a91b-7600ade16d42 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1217 microversion: 2.1 time: 0.226150 Jul 31 01:41:15.690706 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2727/5423] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:15 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1217 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:15.872659 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ba27a98f-8dff-435c-a475-c6a8e6532468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:15.873930 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ba27a98f-8dff-435c-a475-c6a8e6532468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:15.885079 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba27a98f-8dff-435c-a475-c6a8e6532468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:15.886012 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba27a98f-8dff-435c-a475-c6a8e6532468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:15.887005 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba27a98f-8dff-435c-a475-c6a8e6532468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:15.887654 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba27a98f-8dff-435c-a475-c6a8e6532468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:15.910069 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:16.286733 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ba27a98f-8dff-435c-a475-c6a8e6532468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:16.296445 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ba27a98f-8dff-435c-a475-c6a8e6532468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:16.297973 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ba27a98f-8dff-435c-a475-c6a8e6532468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:16.299122 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ba27a98f-8dff-435c-a475-c6a8e6532468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1408 microversion: 2.20 time: 0.430544 Jul 31 01:41:16.300023 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2697/5424] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:41:15 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1408 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:41:16.712472 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e5db0a6f-d988-4e7e-bf88-f7d9359f5b44 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:16.713271 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e5db0a6f-d988-4e7e-bf88-f7d9359f5b44 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:16.734657 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e5db0a6f-d988-4e7e-bf88-f7d9359f5b44 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:16.734657 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e5db0a6f-d988-4e7e-bf88-f7d9359f5b44 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:16.734657 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e5db0a6f-d988-4e7e-bf88-f7d9359f5b44 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:16.734657 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e5db0a6f-d988-4e7e-bf88-f7d9359f5b44 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:16.771111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-487a0d8a-de34-4286-9d43-624491e548b0 req-0f76e478-83f4-4c6a-ada4-2796bdd50edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66aee0fa-4208-477e-beb0-d989c2bf9079", "tag": "49495de1-4724-4e3b-b374-d34ba9a4db7c"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:16.783286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-487a0d8a-de34-4286-9d43-624491e548b0 req-0f76e478-83f4-4c6a-ada4-2796bdd50edc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:16.784287 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-487a0d8a-de34-4286-9d43-624491e548b0 req-0f76e478-83f4-4c6a-ada4-2796bdd50edc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:16.825598 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-487a0d8a-de34-4286-9d43-624491e548b0 req-0f76e478-83f4-4c6a-ada4-2796bdd50edc service nova] Creating event network-changed:49495de1-4724-4e3b-b374-d34ba9a4db7c for instance 66aee0fa-4208-477e-beb0-d989c2bf9079 on n-h2-master-1 Jul 31 01:41:16.849627 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-487a0d8a-de34-4286-9d43-624491e548b0 req-0f76e478-83f4-4c6a-ada4-2796bdd50edc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083574 Jul 31 01:41:16.850428 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2698/5425] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:41:16.922272 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e5db0a6f-d988-4e7e-bf88-f7d9359f5b44 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:16.936458 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e5db0a6f-d988-4e7e-bf88-f7d9359f5b44 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1217 microversion: 2.1 time: 0.228563 Jul 31 01:41:16.937647 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2728/5426] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:16 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1217 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:17.329556 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-53729693-a903-4f7a-8b93-13376d1ca90b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:17.330296 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-53729693-a903-4f7a-8b93-13376d1ca90b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:17.346009 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53729693-a903-4f7a-8b93-13376d1ca90b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:17.346789 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53729693-a903-4f7a-8b93-13376d1ca90b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:17.352427 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53729693-a903-4f7a-8b93-13376d1ca90b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:17.353518 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53729693-a903-4f7a-8b93-13376d1ca90b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:17.552973 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-53729693-a903-4f7a-8b93-13376d1ca90b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:17.564921 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-53729693-a903-4f7a-8b93-13376d1ca90b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:17.566789 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-53729693-a903-4f7a-8b93-13376d1ca90b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:17.568288 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-53729693-a903-4f7a-8b93-13376d1ca90b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1408 microversion: 2.20 time: 0.245846 Jul 31 01:41:17.582156 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2699/5427] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:41:17 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:41:17.940918 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-154d700c-0cd6-4855-aa60-3502e5761b6e req-ffea7420-c7be-471f-a5ae-cb4a25fed007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a611359d-c8ae-4c03-bdf4-b392393b1ff7", "name": "network-vif-plugged", "status": "completed", "tag": "2c7043d4-16fd-468b-90c6-9e87076309f7"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:17.962249 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-44634a58-40ef-4b78-b6d4-f943db50b9c3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:17.963419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-44634a58-40ef-4b78-b6d4-f943db50b9c3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:17.976489 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44634a58-40ef-4b78-b6d4-f943db50b9c3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:17.977149 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44634a58-40ef-4b78-b6d4-f943db50b9c3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:17.978387 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-154d700c-0cd6-4855-aa60-3502e5761b6e req-ffea7420-c7be-471f-a5ae-cb4a25fed007 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:17.981391 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44634a58-40ef-4b78-b6d4-f943db50b9c3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:17.981773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-154d700c-0cd6-4855-aa60-3502e5761b6e req-ffea7420-c7be-471f-a5ae-cb4a25fed007 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:17.983589 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44634a58-40ef-4b78-b6d4-f943db50b9c3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:18.003583 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-154d700c-0cd6-4855-aa60-3502e5761b6e req-ffea7420-c7be-471f-a5ae-cb4a25fed007 service nova] Creating event network-vif-plugged:2c7043d4-16fd-468b-90c6-9e87076309f7 for instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 on n-h1-master-1 Jul 31 01:41:18.010557 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-154d700c-0cd6-4855-aa60-3502e5761b6e req-ffea7420-c7be-471f-a5ae-cb4a25fed007 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074754 Jul 31 01:41:18.012303 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2729/5428] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:41:18.225448 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-44634a58-40ef-4b78-b6d4-f943db50b9c3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:18.234868 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-44634a58-40ef-4b78-b6d4-f943db50b9c3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1217 microversion: 2.1 time: 0.279909 Jul 31 01:41:18.251461 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2700/5429] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:17 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1217 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:41:18.598561 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4de938cc-0911-4cbd-9970-264303f284f4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:18.599268 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4de938cc-0911-4cbd-9970-264303f284f4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:18.606174 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4de938cc-0911-4cbd-9970-264303f284f4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:18.606640 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4de938cc-0911-4cbd-9970-264303f284f4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:18.608027 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4de938cc-0911-4cbd-9970-264303f284f4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:18.608478 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4de938cc-0911-4cbd-9970-264303f284f4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:18.798266 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4de938cc-0911-4cbd-9970-264303f284f4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:18.810450 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4de938cc-0911-4cbd-9970-264303f284f4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:18.812740 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4de938cc-0911-4cbd-9970-264303f284f4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:18.814269 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4de938cc-0911-4cbd-9970-264303f284f4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1408 microversion: 2.20 time: 0.220114 Jul 31 01:41:18.815536 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2730/5430] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:41:18 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:41:19.257813 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fff9a86b-4ac5-4f87-939a-0d74f1e48ce2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:19.258514 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fff9a86b-4ac5-4f87-939a-0d74f1e48ce2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:19.266272 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fff9a86b-4ac5-4f87-939a-0d74f1e48ce2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:19.266728 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fff9a86b-4ac5-4f87-939a-0d74f1e48ce2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:19.267538 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fff9a86b-4ac5-4f87-939a-0d74f1e48ce2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:19.267977 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fff9a86b-4ac5-4f87-939a-0d74f1e48ce2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:19.429824 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fff9a86b-4ac5-4f87-939a-0d74f1e48ce2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:19.437608 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fff9a86b-4ac5-4f87-939a-0d74f1e48ce2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1217 microversion: 2.1 time: 0.183772 Jul 31 01:41:19.438185 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2701/5431] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:19 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1217 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:19.838109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4bab4866-958d-4840-aa5e-9f0ced593f0d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:19.838834 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4bab4866-958d-4840-aa5e-9f0ced593f0d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:19.846607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4bab4866-958d-4840-aa5e-9f0ced593f0d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:19.847073 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4bab4866-958d-4840-aa5e-9f0ced593f0d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:19.847918 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4bab4866-958d-4840-aa5e-9f0ced593f0d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:19.848371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4bab4866-958d-4840-aa5e-9f0ced593f0d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:20.001839 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4bab4866-958d-4840-aa5e-9f0ced593f0d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:20.010396 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4bab4866-958d-4840-aa5e-9f0ced593f0d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:20.011962 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4bab4866-958d-4840-aa5e-9f0ced593f0d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:20.013126 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4bab4866-958d-4840-aa5e-9f0ced593f0d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1408 microversion: 2.20 time: 0.179130 Jul 31 01:41:20.013942 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2731/5432] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:41:19 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:41:20.463005 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4f6e41cb-ae6a-4def-9058-9f1485d91474 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:20.464362 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4f6e41cb-ae6a-4def-9058-9f1485d91474 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:20.477246 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4f6e41cb-ae6a-4def-9058-9f1485d91474 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:20.479783 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4f6e41cb-ae6a-4def-9058-9f1485d91474 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:20.481650 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4f6e41cb-ae6a-4def-9058-9f1485d91474 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:20.483979 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4f6e41cb-ae6a-4def-9058-9f1485d91474 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:20.664129 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4f6e41cb-ae6a-4def-9058-9f1485d91474 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:20.675503 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4f6e41cb-ae6a-4def-9058-9f1485d91474 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1402 microversion: 2.1 time: 0.218889 Jul 31 01:41:20.689738 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2702/5433] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:20 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1402 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:20.697877 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3931f5f0-6301-4ec7-b348-c0a22a526f89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:20.698511 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3931f5f0-6301-4ec7-b348-c0a22a526f89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:20.705519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3931f5f0-6301-4ec7-b348-c0a22a526f89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:20.705991 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3931f5f0-6301-4ec7-b348-c0a22a526f89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:20.706889 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3931f5f0-6301-4ec7-b348-c0a22a526f89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:20.707570 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3931f5f0-6301-4ec7-b348-c0a22a526f89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:20.892568 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3931f5f0-6301-4ec7-b348-c0a22a526f89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:20.901656 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3931f5f0-6301-4ec7-b348-c0a22a526f89 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1402 microversion: 2.1 time: 0.207623 Jul 31 01:41:20.902204 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2732/5434] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:20 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1402 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:20.925101 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-198bb1d2-acbb-479b-84bd-6677362edaf8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-729349969"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:20.928298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-198bb1d2-acbb-479b-84bd-6677362edaf8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:20.935817 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-198bb1d2-acbb-479b-84bd-6677362edaf8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:20.936292 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-198bb1d2-acbb-479b-84bd-6677362edaf8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:20.937306 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-198bb1d2-acbb-479b-84bd-6677362edaf8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:20.937906 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-198bb1d2-acbb-479b-84bd-6677362edaf8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:21.035695 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-505e9a06-5c6a-48d9-b7a9-f69e52ef4259 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:21.036533 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-505e9a06-5c6a-48d9-b7a9-f69e52ef4259 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:21.043872 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-505e9a06-5c6a-48d9-b7a9-f69e52ef4259 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:21.044614 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-505e9a06-5c6a-48d9-b7a9-f69e52ef4259 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:21.045664 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-505e9a06-5c6a-48d9-b7a9-f69e52ef4259 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:21.046302 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-505e9a06-5c6a-48d9-b7a9-f69e52ef4259 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:21.060988 n-d-master-1 devstack@n-api.service[119474]: INFO nova.compute.api [None req-198bb1d2-acbb-479b-84bd-6677362edaf8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Attempting to quiesce instance before volume snapshot. Jul 31 01:41:21.144784 n-d-master-1 devstack@n-api.service[119474]: INFO nova.compute.api [None req-198bb1d2-acbb-479b-84bd-6677362edaf8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 31 01:41:21.222675 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-505e9a06-5c6a-48d9-b7a9-f69e52ef4259 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:21.235433 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-505e9a06-5c6a-48d9-b7a9-f69e52ef4259 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:21.237886 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-505e9a06-5c6a-48d9-b7a9-f69e52ef4259 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:21.240053 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-505e9a06-5c6a-48d9-b7a9-f69e52ef4259 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1408 microversion: 2.20 time: 0.207760 Jul 31 01:41:21.241694 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2733/5435] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:41:21 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:41:21.247630 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-198bb1d2-acbb-479b-84bd-6677362edaf8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Creating snapshot from volume 2067ee98-3269-4021-b7a2-eb908b0805cd. {{(pid=119474) snapshot_instance /opt/stack/nova/nova/compute/api.py:3456}} Jul 31 01:41:22.266938 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c99af45b-f58c-4f39-a145-52eada9a6e7e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:22.268685 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c99af45b-f58c-4f39-a145-52eada9a6e7e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:22.288551 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c99af45b-f58c-4f39-a145-52eada9a6e7e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:22.289263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c99af45b-f58c-4f39-a145-52eada9a6e7e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:22.290987 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c99af45b-f58c-4f39-a145-52eada9a6e7e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:22.292012 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c99af45b-f58c-4f39-a145-52eada9a6e7e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:22.922660 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-198bb1d2-acbb-479b-84bd-6677362edaf8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "POST /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7/action" status: 202 len: 0 microversion: 2.1 time: 2.002846 Jul 31 01:41:22.925613 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2703/5436] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:41:20 2022] POST /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7/action => generated 0 bytes in 2006 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 31 01:41:22.934599 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-79e6f779-cbe0-486e-9086-1550f88ab5ad req-4d136168-0485-4cc8-a0be-44c8c4db759c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66aee0fa-4208-477e-beb0-d989c2bf9079", "name": "network-vif-plugged", "status": "completed", "tag": "49495de1-4724-4e3b-b374-d34ba9a4db7c"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:22.945996 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:22.949252 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-79e6f779-cbe0-486e-9086-1550f88ab5ad req-4d136168-0485-4cc8-a0be-44c8c4db759c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:22.950004 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-79e6f779-cbe0-486e-9086-1550f88ab5ad req-4d136168-0485-4cc8-a0be-44c8c4db759c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:22.964928 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-79e6f779-cbe0-486e-9086-1550f88ab5ad req-4d136168-0485-4cc8-a0be-44c8c4db759c service nova] Creating event network-vif-plugged:49495de1-4724-4e3b-b374-d34ba9a4db7c for instance 66aee0fa-4208-477e-beb0-d989c2bf9079 on n-h2-master-1 Jul 31 01:41:22.971885 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-79e6f779-cbe0-486e-9086-1550f88ab5ad req-4d136168-0485-4cc8-a0be-44c8c4db759c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043796 Jul 31 01:41:22.973403 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2704/5437] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:41:23.098338 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c99af45b-f58c-4f39-a145-52eada9a6e7e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:23.110907 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c99af45b-f58c-4f39-a145-52eada9a6e7e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:23.113136 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c99af45b-f58c-4f39-a145-52eada9a6e7e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:23.115758 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c99af45b-f58c-4f39-a145-52eada9a6e7e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1408 microversion: 2.20 time: 0.854676 Jul 31 01:41:23.116712 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2734/5438] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:41:22 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1408 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:41:24.138986 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:24.143600 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e342754b-6613-42df-91aa-4cf4af2961d8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:24.144549 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e342754b-6613-42df-91aa-4cf4af2961d8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:24.158407 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e342754b-6613-42df-91aa-4cf4af2961d8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:24.159146 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e342754b-6613-42df-91aa-4cf4af2961d8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:24.162512 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e342754b-6613-42df-91aa-4cf4af2961d8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:24.163329 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e342754b-6613-42df-91aa-4cf4af2961d8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:24.212179 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7ca4785e-0934-4b0e-963b-02c4ceafc07e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-211376916", "imageRef": "8df83cff-28c1-47c5-9e25-7b11ac55e544", "flavorRef": "452", "networks": [{"uuid": "6739ac5e-7d06-4b25-b7ed-29fa35326c6e"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:24.242892 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:24.243997 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=10 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:24.320684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-7ca4785e-0934-4b0e-963b-02c4ceafc07e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] validate_networks() for [('6739ac5e-7d06-4b25-b7ed-29fa35326c6e', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:41:24.394403 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e342754b-6613-42df-91aa-4cf4af2961d8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:24.405118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e342754b-6613-42df-91aa-4cf4af2961d8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:24.406984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e342754b-6613-42df-91aa-4cf4af2961d8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:24.408635 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e342754b-6613-42df-91aa-4cf4af2961d8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1408 microversion: 2.20 time: 0.271485 Jul 31 01:41:24.409726 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2705/5439] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:41:24 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:41:24.777353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7ca4785e-0934-4b0e-963b-02c4ceafc07e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:41:24.778050 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7ca4785e-0934-4b0e-963b-02c4ceafc07e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:41:24.778688 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7ca4785e-0934-4b0e-963b-02c4ceafc07e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:41:24.779464 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7ca4785e-0934-4b0e-963b-02c4ceafc07e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:41:24.779956 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-7ca4785e-0934-4b0e-963b-02c4ceafc07e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:41:24.790129 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ca4785e-0934-4b0e-963b-02c4ceafc07e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:24.790908 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ca4785e-0934-4b0e-963b-02c4ceafc07e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:24.791970 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ca4785e-0934-4b0e-963b-02c4ceafc07e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:24.792485 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ca4785e-0934-4b0e-963b-02c4ceafc07e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:24.811193 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7ca4785e-0934-4b0e-963b-02c4ceafc07e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:41:24.813670 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:24.818215 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7ca4785e-0934-4b0e-963b-02c4ceafc07e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for user f6c26df9a49446c290d6a0b1427f0c14 and project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:41:24.839137 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7ca4785e-0934-4b0e-963b-02c4ceafc07e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:41:24.841811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7ca4785e-0934-4b0e-963b-02c4ceafc07e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2aca58ed-0dd7-46d0-919b-b59262e1b028',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:41:24.928145 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7ca4785e-0934-4b0e-963b-02c4ceafc07e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719739 Jul 31 01:41:24.929221 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2735/5440] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:41:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:41:24.940018 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5508ff55-ec95-49b2-912c-24ba9cfd1bde tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:24.940904 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5508ff55-ec95-49b2-912c-24ba9cfd1bde tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:25.002190 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5508ff55-ec95-49b2-912c-24ba9cfd1bde tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:25.019213 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5508ff55-ec95-49b2-912c-24ba9cfd1bde tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1229 microversion: 2.1 time: 0.083437 Jul 31 01:41:25.019831 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2706/5441] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:24 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1229 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:25.433137 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-784f1bf1-a068-4cf0-826e-6da5ac2132a4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:25.433874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-784f1bf1-a068-4cf0-826e-6da5ac2132a4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:25.442001 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-784f1bf1-a068-4cf0-826e-6da5ac2132a4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:25.442704 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-784f1bf1-a068-4cf0-826e-6da5ac2132a4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:25.443788 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-784f1bf1-a068-4cf0-826e-6da5ac2132a4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:25.444389 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-784f1bf1-a068-4cf0-826e-6da5ac2132a4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:25.630625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-784f1bf1-a068-4cf0-826e-6da5ac2132a4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:25.645992 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-784f1bf1-a068-4cf0-826e-6da5ac2132a4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:25.647816 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-784f1bf1-a068-4cf0-826e-6da5ac2132a4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:25.649411 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-784f1bf1-a068-4cf0-826e-6da5ac2132a4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1600 microversion: 2.20 time: 0.221206 Jul 31 01:41:25.652575 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2736/5442] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:41:25 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1600 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:41:25.677705 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-279bd9ba-788c-4776-9ffd-7f43ea0d8520 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:25.679299 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-279bd9ba-788c-4776-9ffd-7f43ea0d8520 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:25.689001 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-279bd9ba-788c-4776-9ffd-7f43ea0d8520 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:25.689488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-279bd9ba-788c-4776-9ffd-7f43ea0d8520 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:25.690471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-279bd9ba-788c-4776-9ffd-7f43ea0d8520 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:25.690924 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-279bd9ba-788c-4776-9ffd-7f43ea0d8520 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:25.808524 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-279bd9ba-788c-4776-9ffd-7f43ea0d8520 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.137197 Jul 31 01:41:25.809797 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2707/5443] 10.222.0.45 () {60 vars in 1316 bytes} [Sun Jul 31 01:41:25 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:41:26.041133 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d7783d8f-a85f-45b4-8168-2a2b986b2e52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:26.041805 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d7783d8f-a85f-45b4-8168-2a2b986b2e52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:26.049216 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7783d8f-a85f-45b4-8168-2a2b986b2e52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:26.050174 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7783d8f-a85f-45b4-8168-2a2b986b2e52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:26.051454 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7783d8f-a85f-45b4-8168-2a2b986b2e52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:26.052199 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7783d8f-a85f-45b4-8168-2a2b986b2e52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:26.251030 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d7783d8f-a85f-45b4-8168-2a2b986b2e52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:26.272841 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d7783d8f-a85f-45b4-8168-2a2b986b2e52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1281 microversion: 2.1 time: 0.234301 Jul 31 01:41:26.288498 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2737/5444] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:26 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1281 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:27.262482 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-cdb2c7c2-515f-4763-ba27-dc180df0ddc3 req-5ac01519-2b94-4348-9632-ef87103e1eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66aee0fa-4208-477e-beb0-d989c2bf9079", "tag": "49495de1-4724-4e3b-b374-d34ba9a4db7c"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:27.284256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-cdb2c7c2-515f-4763-ba27-dc180df0ddc3 req-5ac01519-2b94-4348-9632-ef87103e1eee service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:27.285043 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-cdb2c7c2-515f-4763-ba27-dc180df0ddc3 req-5ac01519-2b94-4348-9632-ef87103e1eee service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:27.295943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8946d1c9-f24a-48dd-a4c8-89aa73ff878f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:27.296580 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8946d1c9-f24a-48dd-a4c8-89aa73ff878f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:27.313966 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8946d1c9-f24a-48dd-a4c8-89aa73ff878f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:27.314649 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8946d1c9-f24a-48dd-a4c8-89aa73ff878f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:27.316399 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8946d1c9-f24a-48dd-a4c8-89aa73ff878f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:27.320146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8946d1c9-f24a-48dd-a4c8-89aa73ff878f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:27.328730 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-cdb2c7c2-515f-4763-ba27-dc180df0ddc3 req-5ac01519-2b94-4348-9632-ef87103e1eee service nova] Creating event network-changed:49495de1-4724-4e3b-b374-d34ba9a4db7c for instance 66aee0fa-4208-477e-beb0-d989c2bf9079 on n-h2-master-1 Jul 31 01:41:27.342714 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-cdb2c7c2-515f-4763-ba27-dc180df0ddc3 req-5ac01519-2b94-4348-9632-ef87103e1eee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086991 Jul 31 01:41:27.350565 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2708/5445] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:41:28.368479 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8946d1c9-f24a-48dd-a4c8-89aa73ff878f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:28.382435 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8946d1c9-f24a-48dd-a4c8-89aa73ff878f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1341 microversion: 2.1 time: 1.087613 Jul 31 01:41:28.383093 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2738/5446] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:27 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1341 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:41:29.407240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-040026b8-745d-4561-9564-9dcd9c10bc5a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:29.408817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-040026b8-745d-4561-9564-9dcd9c10bc5a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:29.440481 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-431f9b4d-0090-447e-8d27-47f789ffa12e req-88fed866-f574-469a-9f16-57b4a996d9bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692c9042-e397-4f00-8af2-6b90e97d2e6a", "tag": "8a920488-f635-4031-a8b4-fc8a2791e5cf"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:29.448166 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-040026b8-745d-4561-9564-9dcd9c10bc5a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:29.448635 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-040026b8-745d-4561-9564-9dcd9c10bc5a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:29.449622 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-040026b8-745d-4561-9564-9dcd9c10bc5a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:29.453299 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-040026b8-745d-4561-9564-9dcd9c10bc5a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:29.517542 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-431f9b4d-0090-447e-8d27-47f789ffa12e req-88fed866-f574-469a-9f16-57b4a996d9bd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:29.519067 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-431f9b4d-0090-447e-8d27-47f789ffa12e req-88fed866-f574-469a-9f16-57b4a996d9bd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:29.550586 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-431f9b4d-0090-447e-8d27-47f789ffa12e req-88fed866-f574-469a-9f16-57b4a996d9bd service nova] Creating event network-changed:8a920488-f635-4031-a8b4-fc8a2791e5cf for instance 692c9042-e397-4f00-8af2-6b90e97d2e6a on n-h1-master-1 Jul 31 01:41:29.576887 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-431f9b4d-0090-447e-8d27-47f789ffa12e req-88fed866-f574-469a-9f16-57b4a996d9bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142899 Jul 31 01:41:29.588445 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2739/5447] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:41:29.804934 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-040026b8-745d-4561-9564-9dcd9c10bc5a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:29.814265 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-040026b8-745d-4561-9564-9dcd9c10bc5a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1341 microversion: 2.1 time: 0.412716 Jul 31 01:41:29.823351 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2709/5448] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:29 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1341 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:30.849169 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b678b27e-69a7-45d0-9a0d-2b9a564c060b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:30.850727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b678b27e-69a7-45d0-9a0d-2b9a564c060b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:30.863196 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b678b27e-69a7-45d0-9a0d-2b9a564c060b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:30.864166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b678b27e-69a7-45d0-9a0d-2b9a564c060b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:30.866599 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b678b27e-69a7-45d0-9a0d-2b9a564c060b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:30.868747 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b678b27e-69a7-45d0-9a0d-2b9a564c060b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:31.284516 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b678b27e-69a7-45d0-9a0d-2b9a564c060b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:31.302453 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b678b27e-69a7-45d0-9a0d-2b9a564c060b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1341 microversion: 2.1 time: 0.460610 Jul 31 01:41:31.304460 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2740/5449] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:30 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1341 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:32.337208 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-699c4663-2fe5-4b54-a7f3-eafa57845854 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:32.338476 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-699c4663-2fe5-4b54-a7f3-eafa57845854 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:32.348742 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-699c4663-2fe5-4b54-a7f3-eafa57845854 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:32.358287 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-699c4663-2fe5-4b54-a7f3-eafa57845854 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:32.359391 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-699c4663-2fe5-4b54-a7f3-eafa57845854 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:32.360044 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-699c4663-2fe5-4b54-a7f3-eafa57845854 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:32.800608 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-699c4663-2fe5-4b54-a7f3-eafa57845854 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:32.814138 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-699c4663-2fe5-4b54-a7f3-eafa57845854 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1341 microversion: 2.1 time: 0.479763 Jul 31 01:41:32.820916 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2710/5450] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:32 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1341 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:33.844294 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6044ff3c-cb06-4820-b00f-147e0ca0f221 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:33.845121 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6044ff3c-cb06-4820-b00f-147e0ca0f221 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:33.860686 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6044ff3c-cb06-4820-b00f-147e0ca0f221 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:33.862732 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6044ff3c-cb06-4820-b00f-147e0ca0f221 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:33.863743 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6044ff3c-cb06-4820-b00f-147e0ca0f221 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:33.866443 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6044ff3c-cb06-4820-b00f-147e0ca0f221 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:34.675945 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6044ff3c-cb06-4820-b00f-147e0ca0f221 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:34.690303 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6044ff3c-cb06-4820-b00f-147e0ca0f221 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1341 microversion: 2.1 time: 0.850159 Jul 31 01:41:34.711544 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2741/5451] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:33 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1341 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:35.718884 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f7896d82-48c2-413b-bd8a-3ea159e1515f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:35.720289 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f7896d82-48c2-413b-bd8a-3ea159e1515f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:35.742384 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:35.749385 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7896d82-48c2-413b-bd8a-3ea159e1515f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:35.750170 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7896d82-48c2-413b-bd8a-3ea159e1515f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:35.751236 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7896d82-48c2-413b-bd8a-3ea159e1515f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:35.751733 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7896d82-48c2-413b-bd8a-3ea159e1515f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:36.971030 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f7896d82-48c2-413b-bd8a-3ea159e1515f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:36.987815 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f7896d82-48c2-413b-bd8a-3ea159e1515f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1341 microversion: 2.1 time: 1.273911 Jul 31 01:41:36.991635 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2711/5452] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:35 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1341 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:38.033343 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a3f5e243-f231-458a-8782-8efbfe438200 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:38.036502 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a3f5e243-f231-458a-8782-8efbfe438200 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:38.052464 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:38.053755 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:38.061205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3f5e243-f231-458a-8782-8efbfe438200 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:38.064291 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3f5e243-f231-458a-8782-8efbfe438200 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:38.066603 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3f5e243-f231-458a-8782-8efbfe438200 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:38.068445 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3f5e243-f231-458a-8782-8efbfe438200 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:38.644558 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a3f5e243-f231-458a-8782-8efbfe438200 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:38.707629 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a3f5e243-f231-458a-8782-8efbfe438200 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1341 microversion: 2.1 time: 0.679952 Jul 31 01:41:38.709572 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2742/5453] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:38 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1341 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:39.741368 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a721dfb7-7a5e-485b-8bac-bc48051dcc74 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:39.742594 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a721dfb7-7a5e-485b-8bac-bc48051dcc74 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:39.761250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a721dfb7-7a5e-485b-8bac-bc48051dcc74 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:39.762007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a721dfb7-7a5e-485b-8bac-bc48051dcc74 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:39.767060 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a721dfb7-7a5e-485b-8bac-bc48051dcc74 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:39.767060 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a721dfb7-7a5e-485b-8bac-bc48051dcc74 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:40.089763 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a721dfb7-7a5e-485b-8bac-bc48051dcc74 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:40.103034 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a721dfb7-7a5e-485b-8bac-bc48051dcc74 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1341 microversion: 2.1 time: 0.371010 Jul 31 01:41:40.120144 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2712/5454] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:39 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1341 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:41.126823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-07f4800f-1cb3-4610-9399-751abb2c19e5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:41.128602 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-07f4800f-1cb3-4610-9399-751abb2c19e5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:41.140459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07f4800f-1cb3-4610-9399-751abb2c19e5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:41.143582 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07f4800f-1cb3-4610-9399-751abb2c19e5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:41.144595 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07f4800f-1cb3-4610-9399-751abb2c19e5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:41.145219 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07f4800f-1cb3-4610-9399-751abb2c19e5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:41.347900 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-07f4800f-1cb3-4610-9399-751abb2c19e5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:41.358892 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-07f4800f-1cb3-4610-9399-751abb2c19e5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1341 microversion: 2.1 time: 0.236395 Jul 31 01:41:41.377259 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2743/5455] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:41 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1341 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:42.386583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-86e36cb4-c2ef-43cb-86b1-7049a614d96a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:42.387823 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-86e36cb4-c2ef-43cb-86b1-7049a614d96a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:42.398227 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86e36cb4-c2ef-43cb-86b1-7049a614d96a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:42.400170 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86e36cb4-c2ef-43cb-86b1-7049a614d96a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:42.401423 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86e36cb4-c2ef-43cb-86b1-7049a614d96a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:42.405713 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86e36cb4-c2ef-43cb-86b1-7049a614d96a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:42.787666 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-86e36cb4-c2ef-43cb-86b1-7049a614d96a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:42.804095 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-86e36cb4-c2ef-43cb-86b1-7049a614d96a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1341 microversion: 2.1 time: 0.421904 Jul 31 01:41:42.806798 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2713/5456] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:42 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1341 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:43.501861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ce8bc605-0abd-4b26-8c82-378a17a8ba1f tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:43.503002 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ce8bc605-0abd-4b26-8c82-378a17a8ba1f tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:43.511239 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce8bc605-0abd-4b26-8c82-378a17a8ba1f tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:43.512002 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce8bc605-0abd-4b26-8c82-378a17a8ba1f tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:43.517534 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce8bc605-0abd-4b26-8c82-378a17a8ba1f tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:43.519430 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ce8bc605-0abd-4b26-8c82-378a17a8ba1f tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:43.578997 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ce8bc605-0abd-4b26-8c82-378a17a8ba1f tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.082669 Jul 31 01:41:43.580405 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2744/5457] 10.222.0.45 () {58 vars in 1293 bytes} [Sun Jul 31 01:41:43 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69/os-server-password => generated 116 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:41:43.831561 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-777e3d31-3f02-4469-bcc7-aa4c6ac8fc52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:43.832175 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-777e3d31-3f02-4469-bcc7-aa4c6ac8fc52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:43.849972 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-777e3d31-3f02-4469-bcc7-aa4c6ac8fc52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:43.851511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-777e3d31-3f02-4469-bcc7-aa4c6ac8fc52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:43.854386 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-777e3d31-3f02-4469-bcc7-aa4c6ac8fc52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:43.855044 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-777e3d31-3f02-4469-bcc7-aa4c6ac8fc52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:44.317784 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-777e3d31-3f02-4469-bcc7-aa4c6ac8fc52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:44.330621 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-777e3d31-3f02-4469-bcc7-aa4c6ac8fc52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1341 microversion: 2.1 time: 0.499988 Jul 31 01:41:44.331695 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2714/5458] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:43 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1341 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:45.354991 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-846f4b42-4e26-4959-abf5-ce36a8dee897 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:45.356251 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-846f4b42-4e26-4959-abf5-ce36a8dee897 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:45.382002 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-846f4b42-4e26-4959-abf5-ce36a8dee897 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:45.382471 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-846f4b42-4e26-4959-abf5-ce36a8dee897 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:45.383269 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-846f4b42-4e26-4959-abf5-ce36a8dee897 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:45.394414 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-846f4b42-4e26-4959-abf5-ce36a8dee897 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:45.746626 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-846f4b42-4e26-4959-abf5-ce36a8dee897 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:45.756013 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=95 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:45.765269 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-846f4b42-4e26-4959-abf5-ce36a8dee897 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1341 microversion: 2.1 time: 0.416299 Jul 31 01:41:45.765888 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2745/5459] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:45 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1341 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:46.789148 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a09d96b4-5b9c-49e2-bbcb-0e875009213d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:46.789814 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a09d96b4-5b9c-49e2-bbcb-0e875009213d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:46.807096 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a09d96b4-5b9c-49e2-bbcb-0e875009213d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:46.807627 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a09d96b4-5b9c-49e2-bbcb-0e875009213d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:46.808437 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a09d96b4-5b9c-49e2-bbcb-0e875009213d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:46.808892 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a09d96b4-5b9c-49e2-bbcb-0e875009213d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:46.830048 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:47.368790 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a09d96b4-5b9c-49e2-bbcb-0e875009213d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:47.377068 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a09d96b4-5b9c-49e2-bbcb-0e875009213d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1341 microversion: 2.1 time: 0.591793 Jul 31 01:41:47.384212 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2715/5460] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:46 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1341 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:48.331569 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f6b2eacd-e28f-412b-a807-11caf113384a tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1052763322", "availability_zone": "foo_zone"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:48.334855 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:41:48.334855 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:41:48.342412 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.aggregate [None req-f6b2eacd-e28f-412b-a807-11caf113384a tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Generated uuid 7dce6dbf-1e94-46dc-8d3f-e1541ccc2c53 for aggregate {{(pid=119475) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 31 01:41:48.408375 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f6b2eacd-e28f-412b-a807-11caf113384a tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.316910 Jul 31 01:41:48.410422 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2746/5461] 10.222.0.45 () {60 vars in 1164 bytes} [Sun Jul 31 01:41:48 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:41:48.414107 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ad8f4ef9-ad1b-410d-9f67-4ff0e3911285 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:48.415452 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ad8f4ef9-ad1b-410d-9f67-4ff0e3911285 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:48.429453 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2218aee2-e7e3-4c02-8b3c-5d4030a67750 tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:48.432493 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad8f4ef9-ad1b-410d-9f67-4ff0e3911285 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:48.432920 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad8f4ef9-ad1b-410d-9f67-4ff0e3911285 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:48.436792 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad8f4ef9-ad1b-410d-9f67-4ff0e3911285 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:48.439442 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad8f4ef9-ad1b-410d-9f67-4ff0e3911285 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:48.441331 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:41:48.441331 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:41:48.496982 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2218aee2-e7e3-4c02-8b3c-5d4030a67750 tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.076409 Jul 31 01:41:48.502207 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2747/5462] 10.222.0.45 () {60 vars in 1194 bytes} [Sun Jul 31 01:41:48 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:41:48.517607 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2b027f0c-0248-4550-8251-f96bc059023a tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:48.521982 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:41:48.521982 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:41:48.527047 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b027f0c-0248-4550-8251-f96bc059023a tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:48.528558 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b027f0c-0248-4550-8251-f96bc059023a tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:48.529832 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b027f0c-0248-4550-8251-f96bc059023a tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:48.530614 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b027f0c-0248-4550-8251-f96bc059023a tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:48.580152 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2b027f0c-0248-4550-8251-f96bc059023a tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] 10.222.0.45 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.071893 Jul 31 01:41:48.581015 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2748/5463] 10.222.0.45 () {58 vars in 1176 bytes} [Sun Jul 31 01:41:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:41:48.596648 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b66a6e2c-d96c-4a40-ab14-ed53d3951551 tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:48.597929 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:41:48.597929 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:41:48.609256 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b66a6e2c-d96c-4a40-ab14-ed53d3951551 tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.017652 Jul 31 01:41:48.610425 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2749/5464] 10.222.0.45 () {58 vars in 1143 bytes} [Sun Jul 31 01:41:48 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:41:48.622139 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-67e9bcc6-4ac4-4bab-9181-de63a70256e5 tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:48.626615 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:41:48.626615 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:41:48.639659 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-67e9bcc6-4ac4-4bab-9181-de63a70256e5 tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:48.640788 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-67e9bcc6-4ac4-4bab-9181-de63a70256e5 tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:48.746217 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ad8f4ef9-ad1b-410d-9f67-4ff0e3911285 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:48.754725 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ad8f4ef9-ad1b-410d-9f67-4ff0e3911285 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1341 microversion: 2.1 time: 0.348098 Jul 31 01:41:48.755321 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2716/5465] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:48 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1341 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:49.082137 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-67e9bcc6-4ac4-4bab-9181-de63a70256e5 tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.462890 Jul 31 01:41:49.083181 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2750/5466] 10.222.0.45 () {60 vars in 1194 bytes} [Sun Jul 31 01:41:48 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:41:49.095666 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e0f15612-500f-4041-98c1-e74bcfca95ae tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:49.096543 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:41:49.096543 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:41:49.107805 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e0f15612-500f-4041-98c1-e74bcfca95ae tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.016637 Jul 31 01:41:49.109286 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2717/5467] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:41:49 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:41:49.124443 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d639766c-bb8e-4d5a-813c-6bcf1a1ea79d tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1255052940", "availability_zone": "foo_zone"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:49.226936 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:41:49.226936 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:41:49.302642 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d639766c-bb8e-4d5a-813c-6bcf1a1ea79d tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] 10.222.0.45 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.184853 Jul 31 01:41:49.304213 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2751/5468] 10.222.0.45 () {60 vars in 1173 bytes} [Sun Jul 31 01:41:49 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:41:49.317341 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9254a3db-3c95-48d0-9b72-acde174f4227 tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:49.320158 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:41:49.320158 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:41:49.346586 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9254a3db-3c95-48d0-9b72-acde174f4227 tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.033582 Jul 31 01:41:49.349213 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2718/5469] 10.222.0.45 () {60 vars in 1194 bytes} [Sun Jul 31 01:41:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:41:49.368030 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-12581871-4f6a-4010-9915-aaf05ef0c3ec tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:49.369039 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:41:49.369039 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:41:49.392530 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-12581871-4f6a-4010-9915-aaf05ef0c3ec tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] 10.222.0.45 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.034254 Jul 31 01:41:49.393236 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2752/5470] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:41:49 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:41:49.404648 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1eba848a-8c76-43e8-adc9-bb30debfa127 tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:41:49.407205 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:41:49.407205 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:41:49.416815 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1eba848a-8c76-43e8-adc9-bb30debfa127 tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:49.417440 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1eba848a-8c76-43e8-adc9-bb30debfa127 tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:49.783151 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4067979d-cdec-48fe-9822-5f07a5fff902 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:49.783796 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4067979d-cdec-48fe-9822-5f07a5fff902 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:49.794562 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4067979d-cdec-48fe-9822-5f07a5fff902 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:49.795125 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4067979d-cdec-48fe-9822-5f07a5fff902 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:49.795860 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4067979d-cdec-48fe-9822-5f07a5fff902 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:49.801137 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1eba848a-8c76-43e8-adc9-bb30debfa127 tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] 10.222.0.45 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.399737 Jul 31 01:41:49.802101 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2719/5471] 10.222.0.45 () {60 vars in 1194 bytes} [Sun Jul 31 01:41:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:41:49.803117 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4067979d-cdec-48fe-9822-5f07a5fff902 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:49.816450 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-54351aed-271a-4036-8717-5b274111fbba tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:49.819426 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:41:49.819426 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:41:49.881693 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-54351aed-271a-4036-8717-5b274111fbba tempest-TestAggregatesBasicOps-1730440764 tempest-TestAggregatesBasicOps-1730440764-project-admin] 10.222.0.45 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.071950 Jul 31 01:41:49.882413 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2720/5472] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:41:49 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 31 01:41:49.983946 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4067979d-cdec-48fe-9822-5f07a5fff902 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:49.996418 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4067979d-cdec-48fe-9822-5f07a5fff902 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1341 microversion: 2.1 time: 0.219483 Jul 31 01:41:50.011853 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2753/5473] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:49 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1341 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:41:50.919387 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3b5fca70-5a38-4e98-9ed7-6f2d1bc4fc18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:50.920635 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3b5fca70-5a38-4e98-9ed7-6f2d1bc4fc18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:50.941330 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b5fca70-5a38-4e98-9ed7-6f2d1bc4fc18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:50.941994 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b5fca70-5a38-4e98-9ed7-6f2d1bc4fc18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:50.944410 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b5fca70-5a38-4e98-9ed7-6f2d1bc4fc18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:50.945016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b5fca70-5a38-4e98-9ed7-6f2d1bc4fc18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:51.019823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-805e24fb-7863-46ac-8404-224dc5fe8e88 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:51.021205 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-805e24fb-7863-46ac-8404-224dc5fe8e88 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:51.032572 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-805e24fb-7863-46ac-8404-224dc5fe8e88 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:51.034371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-805e24fb-7863-46ac-8404-224dc5fe8e88 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:51.040775 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-805e24fb-7863-46ac-8404-224dc5fe8e88 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:51.041445 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-805e24fb-7863-46ac-8404-224dc5fe8e88 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:51.323739 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b5fca70-5a38-4e98-9ed7-6f2d1bc4fc18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:51.340114 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b5fca70-5a38-4e98-9ed7-6f2d1bc4fc18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:51.341692 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b5fca70-5a38-4e98-9ed7-6f2d1bc4fc18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:51.343033 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3b5fca70-5a38-4e98-9ed7-6f2d1bc4fc18 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 2950 microversion: 2.42 time: 0.430154 Jul 31 01:41:51.374977 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2721/5474] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:41:50 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 2950 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:41:51.387375 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e7054b3b-dafa-432c-ad59-0673e7359ddb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:51.387901 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e7054b3b-dafa-432c-ad59-0673e7359ddb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:51.416829 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7054b3b-dafa-432c-ad59-0673e7359ddb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:51.421123 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7054b3b-dafa-432c-ad59-0673e7359ddb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:51.422166 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7054b3b-dafa-432c-ad59-0673e7359ddb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:51.422794 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7054b3b-dafa-432c-ad59-0673e7359ddb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:51.507292 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-805e24fb-7863-46ac-8404-224dc5fe8e88 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:51.516051 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-805e24fb-7863-46ac-8404-224dc5fe8e88 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1341 microversion: 2.1 time: 0.500679 Jul 31 01:41:51.516649 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2754/5475] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:51 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1341 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:51.640662 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e7054b3b-dafa-432c-ad59-0673e7359ddb tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.259524 Jul 31 01:41:51.641494 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2722/5476] 10.222.0.45 () {60 vars in 1316 bytes} [Sun Jul 31 01:41:51 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b/os-interface => generated 1831 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:41:52.546143 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3b9aef23-2d4c-4a0f-8f22-565043bdfadc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:52.546774 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3b9aef23-2d4c-4a0f-8f22-565043bdfadc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:52.568761 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b9aef23-2d4c-4a0f-8f22-565043bdfadc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:52.569473 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b9aef23-2d4c-4a0f-8f22-565043bdfadc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:52.570415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b9aef23-2d4c-4a0f-8f22-565043bdfadc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:52.571207 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b9aef23-2d4c-4a0f-8f22-565043bdfadc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:52.757625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3b9aef23-2d4c-4a0f-8f22-565043bdfadc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:52.775495 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3b9aef23-2d4c-4a0f-8f22-565043bdfadc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1387 microversion: 2.1 time: 0.237900 Jul 31 01:41:52.781130 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2755/5477] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:52 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1387 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:53.808016 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cc93d17d-8f9f-4b06-8cd6-09c2e00356ee tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:53.808851 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cc93d17d-8f9f-4b06-8cd6-09c2e00356ee tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:53.812217 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:53.823401 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cc93d17d-8f9f-4b06-8cd6-09c2e00356ee tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:53.823937 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cc93d17d-8f9f-4b06-8cd6-09c2e00356ee tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:53.824897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cc93d17d-8f9f-4b06-8cd6-09c2e00356ee tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:53.825562 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cc93d17d-8f9f-4b06-8cd6-09c2e00356ee tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:54.032460 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cc93d17d-8f9f-4b06-8cd6-09c2e00356ee tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:54.043584 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cc93d17d-8f9f-4b06-8cd6-09c2e00356ee tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1375 microversion: 2.1 time: 0.241866 Jul 31 01:41:54.044630 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2723/5478] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:53 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1375 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:55.067551 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d9e93f47-fcd5-4881-b784-3218e3bd93f8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:55.068618 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d9e93f47-fcd5-4881-b784-3218e3bd93f8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:55.074891 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:41:55.077190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9e93f47-fcd5-4881-b784-3218e3bd93f8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:55.077676 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9e93f47-fcd5-4881-b784-3218e3bd93f8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:55.078700 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9e93f47-fcd5-4881-b784-3218e3bd93f8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:55.079151 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9e93f47-fcd5-4881-b784-3218e3bd93f8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:55.232762 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d9e93f47-fcd5-4881-b784-3218e3bd93f8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:55.241287 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d9e93f47-fcd5-4881-b784-3218e3bd93f8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1375 microversion: 2.1 time: 0.177902 Jul 31 01:41:55.241887 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2756/5479] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:55 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:56.266052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9f66995a-b672-4306-b347-da14ce60b033 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:56.267232 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9f66995a-b672-4306-b347-da14ce60b033 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:56.280024 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f66995a-b672-4306-b347-da14ce60b033 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:56.281447 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f66995a-b672-4306-b347-da14ce60b033 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:56.282590 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f66995a-b672-4306-b347-da14ce60b033 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:56.283331 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f66995a-b672-4306-b347-da14ce60b033 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:56.780416 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9f66995a-b672-4306-b347-da14ce60b033 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:56.790861 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9f66995a-b672-4306-b347-da14ce60b033 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1375 microversion: 2.1 time: 0.531914 Jul 31 01:41:56.792264 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2724/5480] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:56 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1375 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:57.814254 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ae333166-200e-495e-b9a3-5618d25e31ae tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:57.815546 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ae333166-200e-495e-b9a3-5618d25e31ae tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:57.823213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae333166-200e-495e-b9a3-5618d25e31ae tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:57.823951 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae333166-200e-495e-b9a3-5618d25e31ae tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:57.824912 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae333166-200e-495e-b9a3-5618d25e31ae tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:57.825530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ae333166-200e-495e-b9a3-5618d25e31ae tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:58.009039 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ae333166-200e-495e-b9a3-5618d25e31ae tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:58.019110 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ae333166-200e-495e-b9a3-5618d25e31ae tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1375 microversion: 2.1 time: 0.209424 Jul 31 01:41:58.024130 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2757/5481] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:57 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1375 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:41:59.045888 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a79ff684-cfff-499e-ae81-c7371a567d82 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:41:59.047677 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a79ff684-cfff-499e-ae81-c7371a567d82 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:41:59.057671 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a79ff684-cfff-499e-ae81-c7371a567d82 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:59.058716 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a79ff684-cfff-499e-ae81-c7371a567d82 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:59.059840 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a79ff684-cfff-499e-ae81-c7371a567d82 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:41:59.061355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a79ff684-cfff-499e-ae81-c7371a567d82 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:41:59.256640 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a79ff684-cfff-499e-ae81-c7371a567d82 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:41:59.264324 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a79ff684-cfff-499e-ae81-c7371a567d82 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1375 microversion: 2.1 time: 0.223095 Jul 31 01:41:59.275357 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2725/5482] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:41:59 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1375 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:00.286070 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8d240634-f758-4a2c-840c-f51f82f482d8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:00.286775 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8d240634-f758-4a2c-840c-f51f82f482d8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:00.288812 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:00.296538 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d240634-f758-4a2c-840c-f51f82f482d8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:00.297160 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d240634-f758-4a2c-840c-f51f82f482d8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:00.297952 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d240634-f758-4a2c-840c-f51f82f482d8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:00.298576 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d240634-f758-4a2c-840c-f51f82f482d8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:00.476769 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8d240634-f758-4a2c-840c-f51f82f482d8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:00.487540 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8d240634-f758-4a2c-840c-f51f82f482d8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1375 microversion: 2.1 time: 0.205420 Jul 31 01:42:00.490639 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2758/5483] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:00 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1375 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:01.512914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1bd940fd-f604-4d4e-8591-5c6e65ce9e27 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:01.514342 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1bd940fd-f604-4d4e-8591-5c6e65ce9e27 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:01.523468 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1bd940fd-f604-4d4e-8591-5c6e65ce9e27 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:01.524603 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1bd940fd-f604-4d4e-8591-5c6e65ce9e27 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:01.525710 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1bd940fd-f604-4d4e-8591-5c6e65ce9e27 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:01.526405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1bd940fd-f604-4d4e-8591-5c6e65ce9e27 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:01.771228 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1bd940fd-f604-4d4e-8591-5c6e65ce9e27 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:01.779968 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1bd940fd-f604-4d4e-8591-5c6e65ce9e27 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1375 microversion: 2.1 time: 0.271444 Jul 31 01:42:01.780683 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2726/5484] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:01 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1375 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:02.242568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-93e84272-36e0-4bd9-9274-f76fe32f240c req-93dad00e-5c86-47df-b761-81b5984f0501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692c9042-e397-4f00-8af2-6b90e97d2e6a", "name": "network-vif-plugged", "status": "completed", "tag": "8a920488-f635-4031-a8b4-fc8a2791e5cf"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:02.272405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-93e84272-36e0-4bd9-9274-f76fe32f240c req-93dad00e-5c86-47df-b761-81b5984f0501 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:02.272889 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-93e84272-36e0-4bd9-9274-f76fe32f240c req-93dad00e-5c86-47df-b761-81b5984f0501 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:02.307101 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-93e84272-36e0-4bd9-9274-f76fe32f240c req-93dad00e-5c86-47df-b761-81b5984f0501 service nova] Creating event network-vif-plugged:8a920488-f635-4031-a8b4-fc8a2791e5cf for instance 692c9042-e397-4f00-8af2-6b90e97d2e6a on n-h1-master-1 Jul 31 01:42:02.313477 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-93e84272-36e0-4bd9-9274-f76fe32f240c req-93dad00e-5c86-47df-b761-81b5984f0501 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075015 Jul 31 01:42:02.316385 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2727/5485] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:42:02.443247 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-951f14ab-0451-4e1f-8a9a-53d5ad0b2adb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:02.443774 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-951f14ab-0451-4e1f-8a9a-53d5ad0b2adb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:02.450190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-951f14ab-0451-4e1f-8a9a-53d5ad0b2adb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:02.451502 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-951f14ab-0451-4e1f-8a9a-53d5ad0b2adb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:02.452599 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-951f14ab-0451-4e1f-8a9a-53d5ad0b2adb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:02.453235 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-951f14ab-0451-4e1f-8a9a-53d5ad0b2adb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:02.484684 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-951f14ab-0451-4e1f-8a9a-53d5ad0b2adb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079/ips" status: 200 len: 152 microversion: 2.20 time: 0.387617 Jul 31 01:42:02.485915 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2759/5486] 10.222.0.45 () {60 vars in 1289 bytes} [Sun Jul 31 01:42:02 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079/ips => generated 152 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:42:02.804173 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d14b1948-462d-4da5-957f-3479d166fe05 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:02.805537 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d14b1948-462d-4da5-957f-3479d166fe05 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:02.815829 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d14b1948-462d-4da5-957f-3479d166fe05 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:02.816825 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d14b1948-462d-4da5-957f-3479d166fe05 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:02.818193 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d14b1948-462d-4da5-957f-3479d166fe05 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:02.819498 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d14b1948-462d-4da5-957f-3479d166fe05 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:03.073783 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d14b1948-462d-4da5-957f-3479d166fe05 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:03.081945 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d14b1948-462d-4da5-957f-3479d166fe05 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1375 microversion: 2.1 time: 0.283405 Jul 31 01:42:03.096075 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2728/5487] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:02 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1375 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:04.107943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bacfc4c2-5899-405b-b2a5-35259a77a0ad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:04.109163 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bacfc4c2-5899-405b-b2a5-35259a77a0ad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:04.120515 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bacfc4c2-5899-405b-b2a5-35259a77a0ad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:04.124120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bacfc4c2-5899-405b-b2a5-35259a77a0ad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:04.126342 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bacfc4c2-5899-405b-b2a5-35259a77a0ad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:04.129615 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bacfc4c2-5899-405b-b2a5-35259a77a0ad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:04.346945 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bacfc4c2-5899-405b-b2a5-35259a77a0ad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:04.355800 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bacfc4c2-5899-405b-b2a5-35259a77a0ad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1561 microversion: 2.1 time: 0.252616 Jul 31 01:42:04.370895 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2760/5488] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:04 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1561 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:04.380357 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ef66329b-ab1c-4ca5-aa42-62a484ede310 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:04.380895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ef66329b-ab1c-4ca5-aa42-62a484ede310 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:04.389290 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef66329b-ab1c-4ca5-aa42-62a484ede310 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:04.389644 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef66329b-ab1c-4ca5-aa42-62a484ede310 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:04.390626 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef66329b-ab1c-4ca5-aa42-62a484ede310 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:04.391272 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef66329b-ab1c-4ca5-aa42-62a484ede310 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:04.749370 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ef66329b-ab1c-4ca5-aa42-62a484ede310 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:04.758102 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ef66329b-ab1c-4ca5-aa42-62a484ede310 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1561 microversion: 2.1 time: 0.382343 Jul 31 01:42:04.774614 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2729/5489] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:04 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1561 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:04.843471 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-da8d320e-9135-480b-9e6a-87b5fc1812a3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:04.844271 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-da8d320e-9135-480b-9e6a-87b5fc1812a3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:04.851046 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da8d320e-9135-480b-9e6a-87b5fc1812a3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:04.855931 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da8d320e-9135-480b-9e6a-87b5fc1812a3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:04.858485 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da8d320e-9135-480b-9e6a-87b5fc1812a3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:04.859169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-da8d320e-9135-480b-9e6a-87b5fc1812a3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:04.901090 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-da8d320e-9135-480b-9e6a-87b5fc1812a3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:42:05.057226 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-da8d320e-9135-480b-9e6a-87b5fc1812a3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "DELETE /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 204 len: 0 microversion: 2.1 time: 0.217939 Jul 31 01:42:05.060582 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2761/5490] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:42:04 2022] DELETE /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:42:05.069474 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b5c5ddd4-e767-4939-84c1-eb91ce2cce45 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:05.073044 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b5c5ddd4-e767-4939-84c1-eb91ce2cce45 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:05.084324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5c5ddd4-e767-4939-84c1-eb91ce2cce45 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:05.085137 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5c5ddd4-e767-4939-84c1-eb91ce2cce45 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:05.086155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5c5ddd4-e767-4939-84c1-eb91ce2cce45 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:05.087065 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b5c5ddd4-e767-4939-84c1-eb91ce2cce45 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:05.283785 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b5c5ddd4-e767-4939-84c1-eb91ce2cce45 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:05.294363 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b5c5ddd4-e767-4939-84c1-eb91ce2cce45 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1567 microversion: 2.1 time: 0.230315 Jul 31 01:42:05.296499 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2730/5491] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:05 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:42:05.684194 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-311121b4-7513-46a4-a0a1-d75484d43f80 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:05.684907 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-311121b4-7513-46a4-a0a1-d75484d43f80 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:05.697093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-311121b4-7513-46a4-a0a1-d75484d43f80 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:05.698085 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-311121b4-7513-46a4-a0a1-d75484d43f80 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:05.698920 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-311121b4-7513-46a4-a0a1-d75484d43f80 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:05.699396 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-311121b4-7513-46a4-a0a1-d75484d43f80 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:05.728274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-311121b4-7513-46a4-a0a1-d75484d43f80 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lazy-loading 'flavor' on Instance uuid 66aee0fa-4208-477e-beb0-d989c2bf9079 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:42:06.079411 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-311121b4-7513-46a4-a0a1-d75484d43f80 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "POST /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079/action" status: 202 len: 0 microversion: 2.20 time: 0.403324 Jul 31 01:42:06.080683 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2762/5492] 10.222.0.45 () {62 vars in 1319 bytes} [Sun Jul 31 01:42:05 2022] POST /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:42:06.088583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aa3363d8-7683-46ed-9df0-c55764a92a85 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:06.090204 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aa3363d8-7683-46ed-9df0-c55764a92a85 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:06.105061 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa3363d8-7683-46ed-9df0-c55764a92a85 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:06.105896 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa3363d8-7683-46ed-9df0-c55764a92a85 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:06.106983 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa3363d8-7683-46ed-9df0-c55764a92a85 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:06.107695 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa3363d8-7683-46ed-9df0-c55764a92a85 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:06.317783 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7c15beae-04bd-4e95-92f0-84ccc41b2626 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:06.318525 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7c15beae-04bd-4e95-92f0-84ccc41b2626 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:06.332639 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c15beae-04bd-4e95-92f0-84ccc41b2626 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:06.336009 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c15beae-04bd-4e95-92f0-84ccc41b2626 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:06.336931 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c15beae-04bd-4e95-92f0-84ccc41b2626 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:06.338033 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c15beae-04bd-4e95-92f0-84ccc41b2626 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:06.537044 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-aa3363d8-7683-46ed-9df0-c55764a92a85 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:06.549993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-aa3363d8-7683-46ed-9df0-c55764a92a85 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:06.574240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-aa3363d8-7683-46ed-9df0-c55764a92a85 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:06.576498 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aa3363d8-7683-46ed-9df0-c55764a92a85 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1725 microversion: 2.20 time: 0.491236 Jul 31 01:42:06.577289 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2731/5493] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:06 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1725 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:06.642128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7c15beae-04bd-4e95-92f0-84ccc41b2626 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:06.652501 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7c15beae-04bd-4e95-92f0-84ccc41b2626 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1567 microversion: 2.1 time: 0.338636 Jul 31 01:42:06.679869 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2763/5494] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:06 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1567 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:07.610681 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d920bd58-773e-4bd8-858d-c5c6ea1ea893 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:07.611751 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d920bd58-773e-4bd8-858d-c5c6ea1ea893 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:07.622913 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d920bd58-773e-4bd8-858d-c5c6ea1ea893 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:07.623995 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d920bd58-773e-4bd8-858d-c5c6ea1ea893 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:07.625016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d920bd58-773e-4bd8-858d-c5c6ea1ea893 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:07.627066 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d920bd58-773e-4bd8-858d-c5c6ea1ea893 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:07.682844 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a3e6059c-7527-4db8-90fc-ae627af0482f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:07.683557 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a3e6059c-7527-4db8-90fc-ae627af0482f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:07.696294 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3e6059c-7527-4db8-90fc-ae627af0482f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:07.696768 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3e6059c-7527-4db8-90fc-ae627af0482f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:07.697580 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3e6059c-7527-4db8-90fc-ae627af0482f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:07.698034 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a3e6059c-7527-4db8-90fc-ae627af0482f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:08.274396 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a3e6059c-7527-4db8-90fc-ae627af0482f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:08.294769 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a3e6059c-7527-4db8-90fc-ae627af0482f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1525 microversion: 2.1 time: 0.617054 Jul 31 01:42:08.299438 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2764/5495] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:07 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1525 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:08.888670 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d920bd58-773e-4bd8-858d-c5c6ea1ea893 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:08.899034 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d920bd58-773e-4bd8-858d-c5c6ea1ea893 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:08.910833 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d920bd58-773e-4bd8-858d-c5c6ea1ea893 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:08.912464 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d920bd58-773e-4bd8-858d-c5c6ea1ea893 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1725 microversion: 2.20 time: 1.312340 Jul 31 01:42:08.916650 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2732/5496] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:07 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1725 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:08.930848 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-62d95856-c4d7-4dc7-83ef-17acb9df275d req-232f0c91-f44b-475f-bcca-dec48d7eadb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692c9042-e397-4f00-8af2-6b90e97d2e6a", "name": "network-vif-deleted", "tag": "8a920488-f635-4031-a8b4-fc8a2791e5cf"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:08.950723 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-62d95856-c4d7-4dc7-83ef-17acb9df275d req-232f0c91-f44b-475f-bcca-dec48d7eadb8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:08.951243 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-62d95856-c4d7-4dc7-83ef-17acb9df275d req-232f0c91-f44b-475f-bcca-dec48d7eadb8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:08.956178 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:08.968498 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-62d95856-c4d7-4dc7-83ef-17acb9df275d req-232f0c91-f44b-475f-bcca-dec48d7eadb8 service nova] Creating event network-vif-deleted:8a920488-f635-4031-a8b4-fc8a2791e5cf for instance 692c9042-e397-4f00-8af2-6b90e97d2e6a on n-h1-master-1 Jul 31 01:42:08.975950 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-62d95856-c4d7-4dc7-83ef-17acb9df275d req-232f0c91-f44b-475f-bcca-dec48d7eadb8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194024 Jul 31 01:42:08.977311 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2765/5497] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:42:09.318766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-318654c3-6422-4a38-8b9b-918c29c32b92 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:09.322958 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-318654c3-6422-4a38-8b9b-918c29c32b92 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:09.375463 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-318654c3-6422-4a38-8b9b-918c29c32b92 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:09.375463 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-318654c3-6422-4a38-8b9b-918c29c32b92 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:09.375463 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-318654c3-6422-4a38-8b9b-918c29c32b92 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:09.375463 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-318654c3-6422-4a38-8b9b-918c29c32b92 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:09.571196 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-318654c3-6422-4a38-8b9b-918c29c32b92 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:09.581692 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-318654c3-6422-4a38-8b9b-918c29c32b92 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1360 microversion: 2.1 time: 0.267261 Jul 31 01:42:09.592836 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2733/5498] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:09 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1360 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:09.949561 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f21a853d-3de2-4a4b-a48f-02acf48ff20f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:09.953341 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f21a853d-3de2-4a4b-a48f-02acf48ff20f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:09.974030 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f21a853d-3de2-4a4b-a48f-02acf48ff20f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:09.974490 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f21a853d-3de2-4a4b-a48f-02acf48ff20f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:09.975281 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f21a853d-3de2-4a4b-a48f-02acf48ff20f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:09.975751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f21a853d-3de2-4a4b-a48f-02acf48ff20f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:10.377788 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f21a853d-3de2-4a4b-a48f-02acf48ff20f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:10.401854 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f21a853d-3de2-4a4b-a48f-02acf48ff20f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:10.408538 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f21a853d-3de2-4a4b-a48f-02acf48ff20f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:10.411828 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f21a853d-3de2-4a4b-a48f-02acf48ff20f tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1725 microversion: 2.20 time: 0.468023 Jul 31 01:42:10.413297 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2766/5499] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:09 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1725 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:10.606166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f0bb9ce2-161c-4ab9-a0e6-8b9637ee98d8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:10.606732 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f0bb9ce2-161c-4ab9-a0e6-8b9637ee98d8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:10.619294 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f0bb9ce2-161c-4ab9-a0e6-8b9637ee98d8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:10.619921 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f0bb9ce2-161c-4ab9-a0e6-8b9637ee98d8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:10.620805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f0bb9ce2-161c-4ab9-a0e6-8b9637ee98d8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:10.632074 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f0bb9ce2-161c-4ab9-a0e6-8b9637ee98d8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:10.767077 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f0bb9ce2-161c-4ab9-a0e6-8b9637ee98d8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:10.786697 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f0bb9ce2-161c-4ab9-a0e6-8b9637ee98d8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1360 microversion: 2.1 time: 0.185074 Jul 31 01:42:10.805879 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2734/5500] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:10 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1360 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:11.224963 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-512e924d-5533-4a7b-8db1-81b2b2f2dfb2 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Action: 'create', calling method: .version_select at 0x7fede477e9d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-678380711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBllgJdthYKVzATrHU8PF/gGFbVEx+UWSV0c10lqVO6CWTkmmKiLDtdZOrPE2AQih/WbNw1VnnQWb9sdWfZ8x4ebm9u768b8JiFFwZmixpBE/39Mt9aN4/4veOqD7dyCRg=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:11.245609 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-512e924d-5533-4a7b-8db1-81b2b2f2dfb2 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Getting quotas for project aa6c59dbacb14a339fa940faf1d7e632. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:42:11.271868 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-512e924d-5533-4a7b-8db1-81b2b2f2dfb2 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Getting quotas for user c632588512b9471b8508c1532f6c9723 and project aa6c59dbacb14a339fa940faf1d7e632. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:42:11.328553 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-512e924d-5533-4a7b-8db1-81b2b2f2dfb2 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.104808 Jul 31 01:42:11.331329 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2767/5501] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:42:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:42:11.440867 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1295eae9-59cc-462f-b37c-2b8f12579a4b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:11.441765 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1295eae9-59cc-462f-b37c-2b8f12579a4b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:11.456375 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1295eae9-59cc-462f-b37c-2b8f12579a4b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:11.457176 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1295eae9-59cc-462f-b37c-2b8f12579a4b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:11.458347 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1295eae9-59cc-462f-b37c-2b8f12579a4b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:11.459031 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1295eae9-59cc-462f-b37c-2b8f12579a4b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:11.782171 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1295eae9-59cc-462f-b37c-2b8f12579a4b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:11.817042 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-81df140b-f1f9-42b0-8ceb-f7a63fbef6d5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:11.818028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-81df140b-f1f9-42b0-8ceb-f7a63fbef6d5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:11.818526 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1295eae9-59cc-462f-b37c-2b8f12579a4b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:11.820179 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1295eae9-59cc-462f-b37c-2b8f12579a4b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:11.821475 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1295eae9-59cc-462f-b37c-2b8f12579a4b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1725 microversion: 2.20 time: 0.384835 Jul 31 01:42:11.826865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81df140b-f1f9-42b0-8ceb-f7a63fbef6d5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:11.828223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81df140b-f1f9-42b0-8ceb-f7a63fbef6d5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:11.829459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81df140b-f1f9-42b0-8ceb-f7a63fbef6d5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:11.830128 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81df140b-f1f9-42b0-8ceb-f7a63fbef6d5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:11.834806 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2735/5502] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:11 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1725 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:42:11.987519 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-81df140b-f1f9-42b0-8ceb-f7a63fbef6d5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:11.999855 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-81df140b-f1f9-42b0-8ceb-f7a63fbef6d5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1360 microversion: 2.1 time: 0.189659 Jul 31 01:42:12.017061 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2768/5503] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:11 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1360 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:12.851453 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-42ea5241-e06d-474e-ab65-d81e79551f5c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:12.864867 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-42ea5241-e06d-474e-ab65-d81e79551f5c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:12.882091 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42ea5241-e06d-474e-ab65-d81e79551f5c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:12.882899 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42ea5241-e06d-474e-ab65-d81e79551f5c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:12.884392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42ea5241-e06d-474e-ab65-d81e79551f5c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:12.885101 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42ea5241-e06d-474e-ab65-d81e79551f5c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:12.908916 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:13.022575 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-24650781-3753-4b48-9872-a8fb2e5b6c47 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:13.023573 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-24650781-3753-4b48-9872-a8fb2e5b6c47 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:13.037510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24650781-3753-4b48-9872-a8fb2e5b6c47 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:13.038236 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24650781-3753-4b48-9872-a8fb2e5b6c47 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:13.039200 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24650781-3753-4b48-9872-a8fb2e5b6c47 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:13.046748 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-24650781-3753-4b48-9872-a8fb2e5b6c47 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:13.209013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-42ea5241-e06d-474e-ab65-d81e79551f5c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:13.236231 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-24650781-3753-4b48-9872-a8fb2e5b6c47 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:13.245292 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-42ea5241-e06d-474e-ab65-d81e79551f5c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:13.247817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-42ea5241-e06d-474e-ab65-d81e79551f5c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:13.249482 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-24650781-3753-4b48-9872-a8fb2e5b6c47 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1360 microversion: 2.1 time: 0.230491 Jul 31 01:42:13.249959 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-42ea5241-e06d-474e-ab65-d81e79551f5c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1725 microversion: 2.20 time: 0.406486 Jul 31 01:42:13.263495 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2769/5504] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:13 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1360 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:42:13.264660 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2736/5505] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:12 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1725 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:13.947806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e9b8884e-9bf5-443b-88cb-f432625d3e46 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-337955812", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "d0fb8361-8916-4640-9e68-9fc1c7b1511b"}], "key_name": "tempest-TestNetworkBasicOps-678380711", "security_groups": [{"name": "tempest-secgroup-smoke-622408386"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:14.106018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-e9b8884e-9bf5-443b-88cb-f432625d3e46 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] validate_networks() for [('d0fb8361-8916-4640-9e68-9fc1c7b1511b', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:42:14.274252 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7ecbe948-f1e2-4e08-b808-f203927535fa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:14.275006 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7ecbe948-f1e2-4e08-b808-f203927535fa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:14.283550 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ecbe948-f1e2-4e08-b808-f203927535fa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:14.284294 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ecbe948-f1e2-4e08-b808-f203927535fa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:14.285738 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ecbe948-f1e2-4e08-b808-f203927535fa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:14.286198 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ecbe948-f1e2-4e08-b808-f203927535fa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:14.409748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7ecbe948-f1e2-4e08-b808-f203927535fa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:14.418719 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7ecbe948-f1e2-4e08-b808-f203927535fa tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1360 microversion: 2.1 time: 0.148486 Jul 31 01:42:14.424314 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2737/5506] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:14 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:14.434889 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f327b0fc-db5f-48f9-be55-9dce257c917d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:14.435653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f327b0fc-db5f-48f9-be55-9dce257c917d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:14.444199 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f327b0fc-db5f-48f9-be55-9dce257c917d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:14.444759 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f327b0fc-db5f-48f9-be55-9dce257c917d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:14.445629 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f327b0fc-db5f-48f9-be55-9dce257c917d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:14.446155 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f327b0fc-db5f-48f9-be55-9dce257c917d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:14.710967 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-e9b8884e-9bf5-443b-88cb-f432625d3e46 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:42:14.711611 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-e9b8884e-9bf5-443b-88cb-f432625d3e46 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:42:14.712536 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-e9b8884e-9bf5-443b-88cb-f432625d3e46 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:42:14.713343 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-e9b8884e-9bf5-443b-88cb-f432625d3e46 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:42:14.714167 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-e9b8884e-9bf5-443b-88cb-f432625d3e46 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:42:14.726967 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9b8884e-9bf5-443b-88cb-f432625d3e46 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:14.727988 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9b8884e-9bf5-443b-88cb-f432625d3e46 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:14.729527 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9b8884e-9bf5-443b-88cb-f432625d3e46 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:14.730399 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e9b8884e-9bf5-443b-88cb-f432625d3e46 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:14.760656 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f327b0fc-db5f-48f9-be55-9dce257c917d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:14.778003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f327b0fc-db5f-48f9-be55-9dce257c917d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:14.780906 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f327b0fc-db5f-48f9-be55-9dce257c917d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:14.781497 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-e9b8884e-9bf5-443b-88cb-f432625d3e46 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Getting quotas for project aa6c59dbacb14a339fa940faf1d7e632. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:42:14.782726 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f327b0fc-db5f-48f9-be55-9dce257c917d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1725 microversion: 2.20 time: 0.356997 Jul 31 01:42:14.783505 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2738/5507] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:14 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1725 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:14.804589 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-e9b8884e-9bf5-443b-88cb-f432625d3e46 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Getting quotas for user c632588512b9471b8508c1532f6c9723 and project aa6c59dbacb14a339fa940faf1d7e632. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:42:14.824643 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e9b8884e-9bf5-443b-88cb-f432625d3e46 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:42:14.828289 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e9b8884e-9bf5-443b-88cb-f432625d3e46 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:42:14.902143 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e9b8884e-9bf5-443b-88cb-f432625d3e46 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.959342 Jul 31 01:42:14.903123 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2770/5508] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:42:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:42:14.914003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ae31b128-c8e0-408a-996f-8547513ff0dd tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:14.914626 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ae31b128-c8e0-408a-996f-8547513ff0dd tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:14.987226 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ae31b128-c8e0-408a-996f-8547513ff0dd tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:14.995366 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ae31b128-c8e0-408a-996f-8547513ff0dd tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 200 len: 1247 microversion: 2.1 time: 0.085095 Jul 31 01:42:14.996000 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2739/5509] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:14 2022] GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 1247 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:15.443751 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-790fe940-92b5-4abb-aaf0-f1d308606987 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:15.445367 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-790fe940-92b5-4abb-aaf0-f1d308606987 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:15.465930 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-790fe940-92b5-4abb-aaf0-f1d308606987 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:15.467116 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-790fe940-92b5-4abb-aaf0-f1d308606987 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:15.469087 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-790fe940-92b5-4abb-aaf0-f1d308606987 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:15.469765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-790fe940-92b5-4abb-aaf0-f1d308606987 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:15.571630 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-790fe940-92b5-4abb-aaf0-f1d308606987 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:15.582808 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-790fe940-92b5-4abb-aaf0-f1d308606987 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 200 len: 1360 microversion: 2.1 time: 0.143816 Jul 31 01:42:15.584407 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2771/5510] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:15 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 1360 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:15.806358 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ac0e2f29-028f-4c69-84f8-68deaef9b3c8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:15.807621 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ac0e2f29-028f-4c69-84f8-68deaef9b3c8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:15.816517 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac0e2f29-028f-4c69-84f8-68deaef9b3c8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:15.817315 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac0e2f29-028f-4c69-84f8-68deaef9b3c8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:15.818279 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac0e2f29-028f-4c69-84f8-68deaef9b3c8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:15.818739 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ac0e2f29-028f-4c69-84f8-68deaef9b3c8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:15.963154 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ac0e2f29-028f-4c69-84f8-68deaef9b3c8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:15.973561 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ac0e2f29-028f-4c69-84f8-68deaef9b3c8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:15.975267 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ac0e2f29-028f-4c69-84f8-68deaef9b3c8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:15.976530 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ac0e2f29-028f-4c69-84f8-68deaef9b3c8 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1725 microversion: 2.20 time: 0.174391 Jul 31 01:42:15.977615 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2740/5511] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:15 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:16.017891 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d4e2dad5-80d9-407c-abd5-5a40d3be912d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:16.019407 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d4e2dad5-80d9-407c-abd5-5a40d3be912d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:16.029434 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4e2dad5-80d9-407c-abd5-5a40d3be912d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:16.030578 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4e2dad5-80d9-407c-abd5-5a40d3be912d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:16.031677 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4e2dad5-80d9-407c-abd5-5a40d3be912d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:16.032378 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4e2dad5-80d9-407c-abd5-5a40d3be912d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:16.118221 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d4e2dad5-80d9-407c-abd5-5a40d3be912d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:16.129364 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d4e2dad5-80d9-407c-abd5-5a40d3be912d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 200 len: 1299 microversion: 2.1 time: 0.116784 Jul 31 01:42:16.143370 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2772/5512] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:16 2022] GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 1299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:16.605989 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-538a809d-46b2-4d6d-8c38-4432aa3c3ada tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:16.606625 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-538a809d-46b2-4d6d-8c38-4432aa3c3ada tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:16.617648 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-538a809d-46b2-4d6d-8c38-4432aa3c3ada tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:16.618120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-538a809d-46b2-4d6d-8c38-4432aa3c3ada tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:16.618925 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-538a809d-46b2-4d6d-8c38-4432aa3c3ada tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:16.619402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-538a809d-46b2-4d6d-8c38-4432aa3c3ada tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:16.643958 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-538a809d-46b2-4d6d-8c38-4432aa3c3ada tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] HTTP exception thrown: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-538a809d-46b2-4d6d-8c38-4432aa3c3ada tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Request method failure captured: Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a HTTP/1.1 Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dxSWPHv6fiyygfwJR0Ud9gfexnY8DUg1-8n2-EFdlhief1Py8PV4RaH4l0q6aYBanPQ6exn-4iFCGEMH9hqgo4PPVedzZNUDT2YTEgYd9iPN8Zs4wyM3F4Cgzs_D-0CTqdk8e-lZRIuuB9WjXa7g4L7rW4yad6wf_BUOJQbjcH4WNc Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f0892e5f98e48408d15771c9d5805bf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f6c26df9a49446c290d6a0b1427f0c14 Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '692c9042-e397-4f00-8af2-6b90e97d2e6a'} Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:42:16.646059 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:16.650781 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:16.650781 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:42:16.650781 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:42:16.650781 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:42:16.650781 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:42:16.650781 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. Jul 31 01:42:16.650781 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:16.652544 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-538a809d-46b2-4d6d-8c38-4432aa3c3ada tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Returning 404 to user: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:42:16.653701 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-538a809d-46b2-4d6d-8c38-4432aa3c3ada tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 404 len: 111 microversion: 2.1 time: 0.051557 Jul 31 01:42:16.654510 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2741/5513] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:16 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:42:17.003733 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f69bb1eb-477e-45da-8507-0d73095dcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:17.005144 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f69bb1eb-477e-45da-8507-0d73095dcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:17.012910 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f69bb1eb-477e-45da-8507-0d73095dcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:17.013822 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f69bb1eb-477e-45da-8507-0d73095dcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:17.015833 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f69bb1eb-477e-45da-8507-0d73095dcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:17.016532 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f69bb1eb-477e-45da-8507-0d73095dcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:17.158147 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5f174a3a-42f3-4848-a35f-8489e8e2c4cc tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:17.158895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5f174a3a-42f3-4848-a35f-8489e8e2c4cc tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:17.175082 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f174a3a-42f3-4848-a35f-8489e8e2c4cc tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:17.175915 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f174a3a-42f3-4848-a35f-8489e8e2c4cc tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:17.176877 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f174a3a-42f3-4848-a35f-8489e8e2c4cc tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:17.177441 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f174a3a-42f3-4848-a35f-8489e8e2c4cc tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:17.203065 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f69bb1eb-477e-45da-8507-0d73095dcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:17.211796 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f69bb1eb-477e-45da-8507-0d73095dcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:17.213502 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f69bb1eb-477e-45da-8507-0d73095dcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:17.214733 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f69bb1eb-477e-45da-8507-0d73095dcb84 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1746 microversion: 2.20 time: 0.215280 Jul 31 01:42:17.215724 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2773/5514] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:16 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1746 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:17.377954 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5f174a3a-42f3-4848-a35f-8489e8e2c4cc tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:17.387124 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5f174a3a-42f3-4848-a35f-8489e8e2c4cc tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 200 len: 1372 microversion: 2.1 time: 0.234669 Jul 31 01:42:17.388850 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2742/5515] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:17 2022] GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 1372 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:18.170052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-693d9b67-6fc9-4c5a-bc09-2326b3926986 req-0c524871-746d-4590-a050-932d63339973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d6ffd9-5d59-41f3-ba4e-d77e585bac38", "tag": "c0b15f67-bc5e-47ec-b14d-da3f98ed789a"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:18.199430 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-693d9b67-6fc9-4c5a-bc09-2326b3926986 req-0c524871-746d-4590-a050-932d63339973 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:18.200111 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-693d9b67-6fc9-4c5a-bc09-2326b3926986 req-0c524871-746d-4590-a050-932d63339973 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:18.222515 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-693d9b67-6fc9-4c5a-bc09-2326b3926986 req-0c524871-746d-4590-a050-932d63339973 service nova] Creating event network-changed:c0b15f67-bc5e-47ec-b14d-da3f98ed789a for instance 86d6ffd9-5d59-41f3-ba4e-d77e585bac38 on n-h2-master-1 Jul 31 01:42:18.229538 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-693d9b67-6fc9-4c5a-bc09-2326b3926986 req-0c524871-746d-4590-a050-932d63339973 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072303 Jul 31 01:42:18.230720 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2774/5516] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:42:18.238103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dacafc27-eb0d-45b2-80fb-82c39c345eed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:18.238727 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dacafc27-eb0d-45b2-80fb-82c39c345eed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:18.252351 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dacafc27-eb0d-45b2-80fb-82c39c345eed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:18.252873 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dacafc27-eb0d-45b2-80fb-82c39c345eed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:18.254074 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dacafc27-eb0d-45b2-80fb-82c39c345eed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:18.254591 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dacafc27-eb0d-45b2-80fb-82c39c345eed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:18.412761 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e80d3679-c924-4a3f-9cb6-59920b478629 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:18.413970 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e80d3679-c924-4a3f-9cb6-59920b478629 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:18.432594 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e80d3679-c924-4a3f-9cb6-59920b478629 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:18.433569 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e80d3679-c924-4a3f-9cb6-59920b478629 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:18.437271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dacafc27-eb0d-45b2-80fb-82c39c345eed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:18.438854 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e80d3679-c924-4a3f-9cb6-59920b478629 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:18.439439 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e80d3679-c924-4a3f-9cb6-59920b478629 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:18.446962 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dacafc27-eb0d-45b2-80fb-82c39c345eed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:18.449015 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dacafc27-eb0d-45b2-80fb-82c39c345eed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:18.450438 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dacafc27-eb0d-45b2-80fb-82c39c345eed tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1746 microversion: 2.20 time: 0.216295 Jul 31 01:42:18.451704 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2743/5517] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:18 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1746 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:18.779185 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e80d3679-c924-4a3f-9cb6-59920b478629 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:18.790578 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e80d3679-c924-4a3f-9cb6-59920b478629 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 200 len: 1372 microversion: 2.1 time: 0.384142 Jul 31 01:42:18.803639 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2775/5518] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:18 2022] GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 1372 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:19.473918 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-845a5521-6744-488b-9687-aa00a7b06815 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:19.475457 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-845a5521-6744-488b-9687-aa00a7b06815 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:19.483438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-845a5521-6744-488b-9687-aa00a7b06815 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:19.484297 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-845a5521-6744-488b-9687-aa00a7b06815 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:19.485345 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-845a5521-6744-488b-9687-aa00a7b06815 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:19.486048 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-845a5521-6744-488b-9687-aa00a7b06815 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:19.630431 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-845a5521-6744-488b-9687-aa00a7b06815 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:19.639576 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-845a5521-6744-488b-9687-aa00a7b06815 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:19.641150 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-845a5521-6744-488b-9687-aa00a7b06815 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:19.642420 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-845a5521-6744-488b-9687-aa00a7b06815 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1746 microversion: 2.20 time: 0.172864 Jul 31 01:42:19.642980 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2744/5519] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:19 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:19.816300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-582cc6a6-099e-46aa-8950-b12077af3bd1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:19.817756 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-582cc6a6-099e-46aa-8950-b12077af3bd1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:19.839268 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-582cc6a6-099e-46aa-8950-b12077af3bd1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:19.840064 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-582cc6a6-099e-46aa-8950-b12077af3bd1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:19.841207 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-582cc6a6-099e-46aa-8950-b12077af3bd1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:19.851276 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-582cc6a6-099e-46aa-8950-b12077af3bd1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:20.148093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-582cc6a6-099e-46aa-8950-b12077af3bd1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:20.157903 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-582cc6a6-099e-46aa-8950-b12077af3bd1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 200 len: 1372 microversion: 2.1 time: 0.347572 Jul 31 01:42:20.172037 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2776/5520] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:19 2022] GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 1372 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:20.669065 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a14f8ad5-72bb-4a43-a30f-6d67b186c320 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:20.669897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a14f8ad5-72bb-4a43-a30f-6d67b186c320 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:20.685461 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a14f8ad5-72bb-4a43-a30f-6d67b186c320 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:20.685939 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a14f8ad5-72bb-4a43-a30f-6d67b186c320 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:20.686748 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a14f8ad5-72bb-4a43-a30f-6d67b186c320 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:20.687212 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a14f8ad5-72bb-4a43-a30f-6d67b186c320 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:20.941308 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-5548b952-a5ea-4389-a1df-10c02385b5f0 req-ecec5c7a-918e-45fb-abfd-caf56e3e7cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66aee0fa-4208-477e-beb0-d989c2bf9079", "name": "network-vif-plugged", "status": "completed", "tag": "49495de1-4724-4e3b-b374-d34ba9a4db7c"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:20.979381 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5548b952-a5ea-4389-a1df-10c02385b5f0 req-ecec5c7a-918e-45fb-abfd-caf56e3e7cc0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:20.979705 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5548b952-a5ea-4389-a1df-10c02385b5f0 req-ecec5c7a-918e-45fb-abfd-caf56e3e7cc0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:20.999197 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-5548b952-a5ea-4389-a1df-10c02385b5f0 req-ecec5c7a-918e-45fb-abfd-caf56e3e7cc0 service nova] Creating event network-vif-plugged:49495de1-4724-4e3b-b374-d34ba9a4db7c for instance 66aee0fa-4208-477e-beb0-d989c2bf9079 on n-h2-master-1 Jul 31 01:42:21.000634 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a14f8ad5-72bb-4a43-a30f-6d67b186c320 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:21.013691 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a14f8ad5-72bb-4a43-a30f-6d67b186c320 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:21.015460 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a14f8ad5-72bb-4a43-a30f-6d67b186c320 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:21.019837 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-5548b952-a5ea-4389-a1df-10c02385b5f0 req-ecec5c7a-918e-45fb-abfd-caf56e3e7cc0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.310932 Jul 31 01:42:21.020384 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a14f8ad5-72bb-4a43-a30f-6d67b186c320 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1741 microversion: 2.20 time: 0.356496 Jul 31 01:42:21.020511 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2777/5521] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:42:21.031604 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2745/5522] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:20 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1741 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:21.189384 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-527382fb-2cf4-4397-b8c8-72a2f1221fa0 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:21.190001 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-527382fb-2cf4-4397-b8c8-72a2f1221fa0 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:21.211530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-527382fb-2cf4-4397-b8c8-72a2f1221fa0 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:21.212001 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-527382fb-2cf4-4397-b8c8-72a2f1221fa0 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:21.212813 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-527382fb-2cf4-4397-b8c8-72a2f1221fa0 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:21.213266 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-527382fb-2cf4-4397-b8c8-72a2f1221fa0 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:21.419739 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-527382fb-2cf4-4397-b8c8-72a2f1221fa0 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:21.428908 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-527382fb-2cf4-4397-b8c8-72a2f1221fa0 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 200 len: 1372 microversion: 2.1 time: 0.248301 Jul 31 01:42:21.443134 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2778/5523] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:21 2022] GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 1372 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:22.048458 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9c190617-a52e-487f-849d-36f7151f2559 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:22.050040 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9c190617-a52e-487f-849d-36f7151f2559 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:22.070825 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9c190617-a52e-487f-849d-36f7151f2559 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:22.072414 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9c190617-a52e-487f-849d-36f7151f2559 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:22.074904 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9c190617-a52e-487f-849d-36f7151f2559 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:22.077682 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9c190617-a52e-487f-849d-36f7151f2559 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:22.204911 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0bed7e6d-77df-4008-8ae7-ef1b5c3e5620 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:22.206120 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0bed7e6d-77df-4008-8ae7-ef1b5c3e5620 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:22.221421 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bed7e6d-77df-4008-8ae7-ef1b5c3e5620 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:22.232453 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bed7e6d-77df-4008-8ae7-ef1b5c3e5620 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:22.233381 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bed7e6d-77df-4008-8ae7-ef1b5c3e5620 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:22.233852 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bed7e6d-77df-4008-8ae7-ef1b5c3e5620 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:22.267531 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0bed7e6d-77df-4008-8ae7-ef1b5c3e5620 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:42:22.313975 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9c190617-a52e-487f-849d-36f7151f2559 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:22.325748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9c190617-a52e-487f-849d-36f7151f2559 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:22.327517 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9c190617-a52e-487f-849d-36f7151f2559 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:22.329037 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9c190617-a52e-487f-849d-36f7151f2559 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1741 microversion: 2.20 time: 0.288530 Jul 31 01:42:22.329873 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2746/5524] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:22 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1741 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:22.391654 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0bed7e6d-77df-4008-8ae7-ef1b5c3e5620 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 204 len: 0 microversion: 2.1 time: 0.189571 Jul 31 01:42:22.393846 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2779/5525] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:42:22 2022] DELETE /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:42:22.403718 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2da0fda2-3688-4cf7-857d-0d52006ef845 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:22.404852 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2da0fda2-3688-4cf7-857d-0d52006ef845 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:22.411835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2da0fda2-3688-4cf7-857d-0d52006ef845 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:22.412436 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2da0fda2-3688-4cf7-857d-0d52006ef845 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:22.413294 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2da0fda2-3688-4cf7-857d-0d52006ef845 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:22.413818 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2da0fda2-3688-4cf7-857d-0d52006ef845 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:22.449951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1a5592f1-3edf-44e9-8a75-16e84fdbf5a1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:22.450996 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1a5592f1-3edf-44e9-8a75-16e84fdbf5a1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:22.460617 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a5592f1-3edf-44e9-8a75-16e84fdbf5a1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:22.461069 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a5592f1-3edf-44e9-8a75-16e84fdbf5a1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:22.461880 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a5592f1-3edf-44e9-8a75-16e84fdbf5a1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:22.462320 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a5592f1-3edf-44e9-8a75-16e84fdbf5a1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:22.620480 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2da0fda2-3688-4cf7-857d-0d52006ef845 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:22.631067 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2da0fda2-3688-4cf7-857d-0d52006ef845 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1408 microversion: 2.1 time: 0.232859 Jul 31 01:42:22.632561 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2747/5526] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:22 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:22.723391 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1a5592f1-3edf-44e9-8a75-16e84fdbf5a1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:22.735409 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1a5592f1-3edf-44e9-8a75-16e84fdbf5a1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 200 len: 1372 microversion: 2.1 time: 0.289876 Jul 31 01:42:22.737906 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2780/5527] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:22 2022] GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 1372 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:42:23.352750 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-17cba35b-2068-4565-afb9-d047a3053c1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:23.354136 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-17cba35b-2068-4565-afb9-d047a3053c1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:23.366656 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17cba35b-2068-4565-afb9-d047a3053c1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:23.369016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17cba35b-2068-4565-afb9-d047a3053c1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:23.370037 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17cba35b-2068-4565-afb9-d047a3053c1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:23.374494 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-17cba35b-2068-4565-afb9-d047a3053c1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:23.584703 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-17cba35b-2068-4565-afb9-d047a3053c1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:23.600561 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-17cba35b-2068-4565-afb9-d047a3053c1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:23.602589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-17cba35b-2068-4565-afb9-d047a3053c1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:23.604012 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-17cba35b-2068-4565-afb9-d047a3053c1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1741 microversion: 2.20 time: 0.256111 Jul 31 01:42:23.604737 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2748/5528] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:23 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1741 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:23.665431 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d4e679ae-100f-45b7-926c-11bdc83eeff1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:23.666693 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d4e679ae-100f-45b7-926c-11bdc83eeff1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:23.678789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4e679ae-100f-45b7-926c-11bdc83eeff1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:23.681157 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4e679ae-100f-45b7-926c-11bdc83eeff1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:23.682493 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4e679ae-100f-45b7-926c-11bdc83eeff1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:23.684662 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4e679ae-100f-45b7-926c-11bdc83eeff1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:23.759078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-49de834e-6c08-4c08-9553-fd4ba3c9a51d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:23.760018 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-49de834e-6c08-4c08-9553-fd4ba3c9a51d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:23.769968 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49de834e-6c08-4c08-9553-fd4ba3c9a51d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:23.770446 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49de834e-6c08-4c08-9553-fd4ba3c9a51d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:23.772419 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49de834e-6c08-4c08-9553-fd4ba3c9a51d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:23.773702 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49de834e-6c08-4c08-9553-fd4ba3c9a51d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:23.890152 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d4e679ae-100f-45b7-926c-11bdc83eeff1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:23.902760 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d4e679ae-100f-45b7-926c-11bdc83eeff1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1408 microversion: 2.1 time: 0.247778 Jul 31 01:42:23.904620 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2781/5529] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:23 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:23.981806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-49de834e-6c08-4c08-9553-fd4ba3c9a51d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:23.998660 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-49de834e-6c08-4c08-9553-fd4ba3c9a51d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 200 len: 1372 microversion: 2.1 time: 0.244313 Jul 31 01:42:24.011474 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2749/5530] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:23 2022] GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 1372 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:24.633071 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eda31b67-4d3f-4dd3-abf5-843aa519a7eb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:24.633883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eda31b67-4d3f-4dd3-abf5-843aa519a7eb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:24.641798 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eda31b67-4d3f-4dd3-abf5-843aa519a7eb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:24.644278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eda31b67-4d3f-4dd3-abf5-843aa519a7eb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:24.644278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eda31b67-4d3f-4dd3-abf5-843aa519a7eb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:24.644278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eda31b67-4d3f-4dd3-abf5-843aa519a7eb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:24.749598 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:24.796262 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-921a6c52-2c70-4045-a928-c47fc9ba5b0f req-86391746-738e-4443-b6b6-8f83a45d97d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a611359d-c8ae-4c03-bdf4-b392393b1ff7", "name": "network-vif-deleted", "tag": "2c7043d4-16fd-468b-90c6-9e87076309f7"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:24.817756 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=10 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:24.836263 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=56 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:24.870424 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-921a6c52-2c70-4045-a928-c47fc9ba5b0f req-86391746-738e-4443-b6b6-8f83a45d97d1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:24.875234 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-921a6c52-2c70-4045-a928-c47fc9ba5b0f req-86391746-738e-4443-b6b6-8f83a45d97d1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:24.886178 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eda31b67-4d3f-4dd3-abf5-843aa519a7eb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:24.897404 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eda31b67-4d3f-4dd3-abf5-843aa519a7eb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:24.899248 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eda31b67-4d3f-4dd3-abf5-843aa519a7eb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:24.900922 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eda31b67-4d3f-4dd3-abf5-843aa519a7eb tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1741 microversion: 2.20 time: 0.276597 Jul 31 01:42:24.901971 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2782/5531] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:24 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1741 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:24.920666 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-921a6c52-2c70-4045-a928-c47fc9ba5b0f req-86391746-738e-4443-b6b6-8f83a45d97d1 service nova] Creating event network-vif-deleted:2c7043d4-16fd-468b-90c6-9e87076309f7 for instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 on n-h1-master-1 Jul 31 01:42:24.925063 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-43e383c7-9f16-4391-97c8-4838ae70564f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:24.925742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-43e383c7-9f16-4391-97c8-4838ae70564f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:24.935656 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-921a6c52-2c70-4045-a928-c47fc9ba5b0f req-86391746-738e-4443-b6b6-8f83a45d97d1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142765 Jul 31 01:42:24.937179 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2750/5532] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:42:24.941936 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43e383c7-9f16-4391-97c8-4838ae70564f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:24.942572 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43e383c7-9f16-4391-97c8-4838ae70564f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:24.943578 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43e383c7-9f16-4391-97c8-4838ae70564f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:24.944279 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43e383c7-9f16-4391-97c8-4838ae70564f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:24.977436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-9d4fd505-e31a-4b43-a552-7ea350095d99 req-74a5a60e-97b1-457e-b198-6be15c22ce58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d6ffd9-5d59-41f3-ba4e-d77e585bac38", "name": "network-vif-plugged", "status": "completed", "tag": "c0b15f67-bc5e-47ec-b14d-da3f98ed789a"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:24.998366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9d4fd505-e31a-4b43-a552-7ea350095d99 req-74a5a60e-97b1-457e-b198-6be15c22ce58 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:24.999117 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9d4fd505-e31a-4b43-a552-7ea350095d99 req-74a5a60e-97b1-457e-b198-6be15c22ce58 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:25.006583 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:25.018604 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-9d4fd505-e31a-4b43-a552-7ea350095d99 req-74a5a60e-97b1-457e-b198-6be15c22ce58 service nova] Creating event network-vif-plugged:c0b15f67-bc5e-47ec-b14d-da3f98ed789a for instance 86d6ffd9-5d59-41f3-ba4e-d77e585bac38 on n-h2-master-1 Jul 31 01:42:25.024350 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-9d4fd505-e31a-4b43-a552-7ea350095d99 req-74a5a60e-97b1-457e-b198-6be15c22ce58 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050846 Jul 31 01:42:25.025015 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2751/5533] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:42:25.029614 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-43e383c7-9f16-4391-97c8-4838ae70564f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:25.032290 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:25.033625 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9e07e10b-b4b5-4b17-bef5-dbde07c72b3e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:25.034552 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9e07e10b-b4b5-4b17-bef5-dbde07c72b3e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:25.043390 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e07e10b-b4b5-4b17-bef5-dbde07c72b3e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:25.044435 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e07e10b-b4b5-4b17-bef5-dbde07c72b3e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:25.045438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e07e10b-b4b5-4b17-bef5-dbde07c72b3e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:25.046060 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e07e10b-b4b5-4b17-bef5-dbde07c72b3e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:25.049315 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-43e383c7-9f16-4391-97c8-4838ae70564f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1202 microversion: 2.1 time: 0.124841 Jul 31 01:42:25.059393 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2783/5534] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:24 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1202 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:25.345583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9e07e10b-b4b5-4b17-bef5-dbde07c72b3e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:25.353550 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9e07e10b-b4b5-4b17-bef5-dbde07c72b3e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 200 len: 1372 microversion: 2.1 time: 0.327091 Jul 31 01:42:25.362939 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2752/5535] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:25 2022] GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 1372 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:25.928997 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-801bf91b-3ad9-42dc-9fd5-cb86d20507cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:25.929650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-801bf91b-3ad9-42dc-9fd5-cb86d20507cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:25.936772 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:25.950391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-801bf91b-3ad9-42dc-9fd5-cb86d20507cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:25.950804 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-801bf91b-3ad9-42dc-9fd5-cb86d20507cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:25.951993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-801bf91b-3ad9-42dc-9fd5-cb86d20507cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:25.952567 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-801bf91b-3ad9-42dc-9fd5-cb86d20507cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:26.072599 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fd52560c-c20d-41e3-a016-11af053ac37d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:26.073800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fd52560c-c20d-41e3-a016-11af053ac37d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:26.087169 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd52560c-c20d-41e3-a016-11af053ac37d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:26.087974 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd52560c-c20d-41e3-a016-11af053ac37d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:26.088949 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd52560c-c20d-41e3-a016-11af053ac37d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:26.089562 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd52560c-c20d-41e3-a016-11af053ac37d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:26.262156 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-801bf91b-3ad9-42dc-9fd5-cb86d20507cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:26.265894 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fd52560c-c20d-41e3-a016-11af053ac37d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:26.273715 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-801bf91b-3ad9-42dc-9fd5-cb86d20507cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:26.275234 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-801bf91b-3ad9-42dc-9fd5-cb86d20507cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:26.283709 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-801bf91b-3ad9-42dc-9fd5-cb86d20507cd tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1741 microversion: 2.20 time: 0.359079 Jul 31 01:42:26.283953 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fd52560c-c20d-41e3-a016-11af053ac37d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1202 microversion: 2.1 time: 0.215641 Jul 31 01:42:26.284543 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2784/5536] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:25 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1741 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:26.300433 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2753/5537] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:26 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1202 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:42:26.374186 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bdcb6a82-899d-41be-9ec9-5d5a6599ffa5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:26.375148 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bdcb6a82-899d-41be-9ec9-5d5a6599ffa5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:26.382649 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdcb6a82-899d-41be-9ec9-5d5a6599ffa5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:26.383123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdcb6a82-899d-41be-9ec9-5d5a6599ffa5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:26.384007 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdcb6a82-899d-41be-9ec9-5d5a6599ffa5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:26.384660 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdcb6a82-899d-41be-9ec9-5d5a6599ffa5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:26.612025 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bdcb6a82-899d-41be-9ec9-5d5a6599ffa5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:26.620856 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bdcb6a82-899d-41be-9ec9-5d5a6599ffa5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 200 len: 1372 microversion: 2.1 time: 0.250486 Jul 31 01:42:26.625963 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2785/5538] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:26 2022] GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 1372 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:27.309506 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cbc00d57-d004-4ddd-9d41-da1131dc0590 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:27.311616 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cbc00d57-d004-4ddd-9d41-da1131dc0590 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:27.321087 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-44110a06-8978-4b51-b4af-84be86d12a4a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:27.322393 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-44110a06-8978-4b51-b4af-84be86d12a4a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:27.334894 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbc00d57-d004-4ddd-9d41-da1131dc0590 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:27.336857 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44110a06-8978-4b51-b4af-84be86d12a4a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:27.337747 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbc00d57-d004-4ddd-9d41-da1131dc0590 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:27.338459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44110a06-8978-4b51-b4af-84be86d12a4a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:27.341933 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbc00d57-d004-4ddd-9d41-da1131dc0590 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:27.342422 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44110a06-8978-4b51-b4af-84be86d12a4a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:27.343330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44110a06-8978-4b51-b4af-84be86d12a4a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:27.343947 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbc00d57-d004-4ddd-9d41-da1131dc0590 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:27.479950 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-44110a06-8978-4b51-b4af-84be86d12a4a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:27.490120 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-44110a06-8978-4b51-b4af-84be86d12a4a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1202 microversion: 2.1 time: 0.173663 Jul 31 01:42:27.496460 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2786/5539] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:27 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1202 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:27.648655 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-17828075-0b0c-402b-a045-22f17b00fcdf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:27.649209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-17828075-0b0c-402b-a045-22f17b00fcdf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:27.658982 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17828075-0b0c-402b-a045-22f17b00fcdf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:27.659553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17828075-0b0c-402b-a045-22f17b00fcdf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:27.662065 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17828075-0b0c-402b-a045-22f17b00fcdf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:27.662554 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17828075-0b0c-402b-a045-22f17b00fcdf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:27.669861 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cbc00d57-d004-4ddd-9d41-da1131dc0590 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:27.683950 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cbc00d57-d004-4ddd-9d41-da1131dc0590 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:27.687243 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cbc00d57-d004-4ddd-9d41-da1131dc0590 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:27.692709 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cbc00d57-d004-4ddd-9d41-da1131dc0590 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1741 microversion: 2.20 time: 0.388140 Jul 31 01:42:27.707401 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2754/5540] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:27 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1741 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:27.881617 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-17828075-0b0c-402b-a045-22f17b00fcdf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:27.895164 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-17828075-0b0c-402b-a045-22f17b00fcdf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 200 len: 1544 microversion: 2.1 time: 0.249877 Jul 31 01:42:27.907464 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2787/5541] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:27 2022] GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 1544 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:42:27.926745 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c3654d15-c88b-4308-a2e0-caaf13d1bebb tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:27.929465 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c3654d15-c88b-4308-a2e0-caaf13d1bebb tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:27.952381 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3654d15-c88b-4308-a2e0-caaf13d1bebb tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:27.967624 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3654d15-c88b-4308-a2e0-caaf13d1bebb tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:27.970477 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3654d15-c88b-4308-a2e0-caaf13d1bebb tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:27.975250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3654d15-c88b-4308-a2e0-caaf13d1bebb tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:28.255625 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c3654d15-c88b-4308-a2e0-caaf13d1bebb tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:28.258599 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:28.269347 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c3654d15-c88b-4308-a2e0-caaf13d1bebb tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 200 len: 1544 microversion: 2.1 time: 0.354381 Jul 31 01:42:28.280260 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2755/5542] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:27 2022] GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 1544 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:28.519675 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5277bd4d-6da8-4ce5-8b7c-79fface81775 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:28.521058 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5277bd4d-6da8-4ce5-8b7c-79fface81775 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:28.536576 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5277bd4d-6da8-4ce5-8b7c-79fface81775 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:28.537103 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5277bd4d-6da8-4ce5-8b7c-79fface81775 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:28.537951 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5277bd4d-6da8-4ce5-8b7c-79fface81775 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:28.539448 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5277bd4d-6da8-4ce5-8b7c-79fface81775 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:28.719047 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7009165e-bec6-4c96-b160-1dbd453da49c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:28.719743 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7009165e-bec6-4c96-b160-1dbd453da49c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:28.744284 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7009165e-bec6-4c96-b160-1dbd453da49c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:28.744809 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7009165e-bec6-4c96-b160-1dbd453da49c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:28.752882 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7009165e-bec6-4c96-b160-1dbd453da49c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:28.753441 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7009165e-bec6-4c96-b160-1dbd453da49c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:28.779491 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5277bd4d-6da8-4ce5-8b7c-79fface81775 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:28.790803 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5277bd4d-6da8-4ce5-8b7c-79fface81775 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1202 microversion: 2.1 time: 0.278220 Jul 31 01:42:28.791437 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2788/5543] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:28 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1202 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:29.107748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7009165e-bec6-4c96-b160-1dbd453da49c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:29.116720 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7009165e-bec6-4c96-b160-1dbd453da49c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:29.118251 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7009165e-bec6-4c96-b160-1dbd453da49c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:29.122955 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7009165e-bec6-4c96-b160-1dbd453da49c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1741 microversion: 2.20 time: 0.408250 Jul 31 01:42:29.125338 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2756/5544] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:28 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1741 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:42:29.816134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2069aa1a-c6c8-4722-9714-956d72edb7a1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:29.817681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2069aa1a-c6c8-4722-9714-956d72edb7a1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:29.845883 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2069aa1a-c6c8-4722-9714-956d72edb7a1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:29.846675 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2069aa1a-c6c8-4722-9714-956d72edb7a1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:29.847894 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2069aa1a-c6c8-4722-9714-956d72edb7a1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:29.850205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2069aa1a-c6c8-4722-9714-956d72edb7a1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:29.994251 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2069aa1a-c6c8-4722-9714-956d72edb7a1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:30.007488 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2069aa1a-c6c8-4722-9714-956d72edb7a1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1202 microversion: 2.1 time: 0.197064 Jul 31 01:42:30.015481 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2789/5545] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:29 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1202 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:30.150059 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-10dc75b0-b48e-462f-adcd-c2d2b4dbad4d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:30.150697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-10dc75b0-b48e-462f-adcd-c2d2b4dbad4d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:30.170077 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10dc75b0-b48e-462f-adcd-c2d2b4dbad4d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:30.170554 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10dc75b0-b48e-462f-adcd-c2d2b4dbad4d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:30.171465 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10dc75b0-b48e-462f-adcd-c2d2b4dbad4d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:30.171826 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10dc75b0-b48e-462f-adcd-c2d2b4dbad4d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:30.481155 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-10dc75b0-b48e-462f-adcd-c2d2b4dbad4d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:30.494968 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-10dc75b0-b48e-462f-adcd-c2d2b4dbad4d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:30.496889 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-10dc75b0-b48e-462f-adcd-c2d2b4dbad4d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:30.503468 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-10dc75b0-b48e-462f-adcd-c2d2b4dbad4d tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1741 microversion: 2.20 time: 0.357174 Jul 31 01:42:30.504213 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2757/5546] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:30 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1741 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:31.039641 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fd2ac355-84ca-4ce1-8070-9936fcfa58ea tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:31.040958 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fd2ac355-84ca-4ce1-8070-9936fcfa58ea tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:31.049043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd2ac355-84ca-4ce1-8070-9936fcfa58ea tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:31.049880 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd2ac355-84ca-4ce1-8070-9936fcfa58ea tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:31.050950 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd2ac355-84ca-4ce1-8070-9936fcfa58ea tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:31.051689 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd2ac355-84ca-4ce1-8070-9936fcfa58ea tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:31.167728 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fd2ac355-84ca-4ce1-8070-9936fcfa58ea tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:31.180729 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fd2ac355-84ca-4ce1-8070-9936fcfa58ea tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 200 len: 1202 microversion: 2.1 time: 0.144988 Jul 31 01:42:31.182614 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2790/5547] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:31 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 1202 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:31.620892 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-459fea93-f7f1-46cc-8929-e4199075a953 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:31.621551 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-459fea93-f7f1-46cc-8929-e4199075a953 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:31.634665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-459fea93-f7f1-46cc-8929-e4199075a953 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:31.635431 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-459fea93-f7f1-46cc-8929-e4199075a953 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:31.639231 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-459fea93-f7f1-46cc-8929-e4199075a953 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:31.639922 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-459fea93-f7f1-46cc-8929-e4199075a953 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:31.923682 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-459fea93-f7f1-46cc-8929-e4199075a953 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:31.938854 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-459fea93-f7f1-46cc-8929-e4199075a953 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:31.945971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-459fea93-f7f1-46cc-8929-e4199075a953 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:31.951563 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-459fea93-f7f1-46cc-8929-e4199075a953 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1741 microversion: 2.20 time: 0.336526 Jul 31 01:42:31.952461 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2758/5548] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:31 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1741 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:32.121959 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-a5749e16-206d-4801-acd8-17f62ef0bbb6 req-3516eb49-dc43-470f-88ab-8688c6737b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d6ffd9-5d59-41f3-ba4e-d77e585bac38", "tag": "c0b15f67-bc5e-47ec-b14d-da3f98ed789a"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:32.152591 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a5749e16-206d-4801-acd8-17f62ef0bbb6 req-3516eb49-dc43-470f-88ab-8688c6737b07 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:32.155877 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a5749e16-206d-4801-acd8-17f62ef0bbb6 req-3516eb49-dc43-470f-88ab-8688c6737b07 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:32.204901 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4c1324a7-5787-4073-920d-583b016854ed tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:32.205818 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4c1324a7-5787-4073-920d-583b016854ed tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:32.206432 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-a5749e16-206d-4801-acd8-17f62ef0bbb6 req-3516eb49-dc43-470f-88ab-8688c6737b07 service nova] Creating event network-changed:c0b15f67-bc5e-47ec-b14d-da3f98ed789a for instance 86d6ffd9-5d59-41f3-ba4e-d77e585bac38 on n-h2-master-1 Jul 31 01:42:32.213097 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c1324a7-5787-4073-920d-583b016854ed tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:32.213834 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c1324a7-5787-4073-920d-583b016854ed tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:32.214836 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c1324a7-5787-4073-920d-583b016854ed tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:32.215499 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4c1324a7-5787-4073-920d-583b016854ed tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:32.228607 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-a5749e16-206d-4801-acd8-17f62ef0bbb6 req-3516eb49-dc43-470f-88ab-8688c6737b07 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110996 Jul 31 01:42:32.229242 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2791/5549] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:42:32.233726 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-4c1324a7-5787-4073-920d-583b016854ed tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] HTTP exception thrown: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4c1324a7-5787-4073-920d-583b016854ed tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Request method failure captured: Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 HTTP/1.1 Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dxSWPHv6fiyygfwJR0Ud9gfexnY8DUg1-8n2-EFdlhief1Py8PV4RaH4l0q6aYBanPQ6exn-4iFCGEMH9hqgo4PPVedzZNUDT2YTEgYd9iPN8Zs4wyM3F4Cgzs_D-0CTqdk8e-lZRIuuB9WjXa7g4L7rW4yad6wf_BUOJQbjcH4WNc Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f0892e5f98e48408d15771c9d5805bf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f6c26df9a49446c290d6a0b1427f0c14 Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: exception: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'a611359d-c8ae-4c03-bdf4-b392393b1ff7'} Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:42:32.235780 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:32.240093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:32.240093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:42:32.240093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:42:32.240093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:42:32.240093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:42:32.240093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. Jul 31 01:42:32.240093 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:32.242753 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4c1324a7-5787-4073-920d-583b016854ed tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Returning 404 to user: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:42:32.243945 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4c1324a7-5787-4073-920d-583b016854ed tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 404 len: 111 microversion: 2.1 time: 0.045797 Jul 31 01:42:32.245094 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2759/5550] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:32 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:42:32.979024 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ac390b17-d455-42aa-b858-9b566e431af5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:32.980368 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ac390b17-d455-42aa-b858-9b566e431af5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:32.995364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac390b17-d455-42aa-b858-9b566e431af5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:33.005608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac390b17-d455-42aa-b858-9b566e431af5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:33.006983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac390b17-d455-42aa-b858-9b566e431af5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:33.008557 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac390b17-d455-42aa-b858-9b566e431af5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:33.243264 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ac390b17-d455-42aa-b858-9b566e431af5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:33.256565 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ac390b17-d455-42aa-b858-9b566e431af5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:33.267675 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ac390b17-d455-42aa-b858-9b566e431af5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:33.268978 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ac390b17-d455-42aa-b858-9b566e431af5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1741 microversion: 2.20 time: 0.294962 Jul 31 01:42:33.269574 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2792/5551] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:32 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1741 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:42:34.292156 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1c691c2d-1870-4f03-8f7b-7b504a5da18c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:34.292928 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1c691c2d-1870-4f03-8f7b-7b504a5da18c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:34.306535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c691c2d-1870-4f03-8f7b-7b504a5da18c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:34.307259 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c691c2d-1870-4f03-8f7b-7b504a5da18c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:34.308595 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c691c2d-1870-4f03-8f7b-7b504a5da18c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:34.310570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c691c2d-1870-4f03-8f7b-7b504a5da18c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:34.532685 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1c691c2d-1870-4f03-8f7b-7b504a5da18c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:34.545288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1c691c2d-1870-4f03-8f7b-7b504a5da18c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:34.547257 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1c691c2d-1870-4f03-8f7b-7b504a5da18c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:34.548866 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1c691c2d-1870-4f03-8f7b-7b504a5da18c tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1741 microversion: 2.20 time: 0.261033 Jul 31 01:42:34.549989 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2760/5552] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:34 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1741 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:35.572519 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d5022a6c-63a1-46c3-914a-1980a6fe96a5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:35.573200 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d5022a6c-63a1-46c3-914a-1980a6fe96a5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:35.586732 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5022a6c-63a1-46c3-914a-1980a6fe96a5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:35.588492 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5022a6c-63a1-46c3-914a-1980a6fe96a5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:35.590310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5022a6c-63a1-46c3-914a-1980a6fe96a5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:35.592179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5022a6c-63a1-46c3-914a-1980a6fe96a5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:35.638823 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b3454069-58c8-4d28-8477-22063c40a4c4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:35.640112 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b3454069-58c8-4d28-8477-22063c40a4c4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:35.651184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3454069-58c8-4d28-8477-22063c40a4c4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:35.656051 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3454069-58c8-4d28-8477-22063c40a4c4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:35.657057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3454069-58c8-4d28-8477-22063c40a4c4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:35.657532 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b3454069-58c8-4d28-8477-22063c40a4c4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:35.687946 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-b3454069-58c8-4d28-8477-22063c40a4c4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] HTTP exception thrown: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b3454069-58c8-4d28-8477-22063c40a4c4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Request method failure captured: Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a HTTP/1.1 Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dxSWPHv6fiyygfwJR0Ud9gfexnY8DUg1-8n2-EFdlhief1Py8PV4RaH4l0q6aYBanPQ6exn-4iFCGEMH9hqgo4PPVedzZNUDT2YTEgYd9iPN8Zs4wyM3F4Cgzs_D-0CTqdk8e-lZRIuuB9WjXa7g4L7rW4yad6wf_BUOJQbjcH4WNc Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f0892e5f98e48408d15771c9d5805bf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f6c26df9a49446c290d6a0b1427f0c14 Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '692c9042-e397-4f00-8af2-6b90e97d2e6a'} Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:42:35.689811 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:42:35.694746 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. Jul 31 01:42:35.694746 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:35.694746 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:42:35.694746 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:35.694746 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:35.694746 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:42:35.694746 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:42:35.694746 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:42:35.694746 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:42:35.694746 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. Jul 31 01:42:35.694746 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:35.696673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b3454069-58c8-4d28-8477-22063c40a4c4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Returning 404 to user: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:42:35.701136 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b3454069-58c8-4d28-8477-22063c40a4c4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "DELETE /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 404 len: 111 microversion: 2.1 time: 0.067724 Jul 31 01:42:35.702331 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2761/5553] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:42:35 2022] DELETE /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:42:35.712785 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-61422caf-b3e9-45d0-8c16-0d4919a2edc7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:35.713713 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-61422caf-b3e9-45d0-8c16-0d4919a2edc7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 692c9042-e397-4f00-8af2-6b90e97d2e6a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:35.721111 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61422caf-b3e9-45d0-8c16-0d4919a2edc7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:35.721884 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61422caf-b3e9-45d0-8c16-0d4919a2edc7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:35.722857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61422caf-b3e9-45d0-8c16-0d4919a2edc7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:35.723504 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61422caf-b3e9-45d0-8c16-0d4919a2edc7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:35.762354 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-61422caf-b3e9-45d0-8c16-0d4919a2edc7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] HTTP exception thrown: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-61422caf-b3e9-45d0-8c16-0d4919a2edc7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Request method failure captured: Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a HTTP/1.1 Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dxSWPHv6fiyygfwJR0Ud9gfexnY8DUg1-8n2-EFdlhief1Py8PV4RaH4l0q6aYBanPQ6exn-4iFCGEMH9hqgo4PPVedzZNUDT2YTEgYd9iPN8Zs4wyM3F4Cgzs_D-0CTqdk8e-lZRIuuB9WjXa7g4L7rW4yad6wf_BUOJQbjcH4WNc Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f0892e5f98e48408d15771c9d5805bf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f6c26df9a49446c290d6a0b1427f0c14 Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '692c9042-e397-4f00-8af2-6b90e97d2e6a'} Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:42:35.766211 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:35.771010 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:35.771010 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:42:35.771010 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:42:35.771010 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:42:35.771010 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:42:35.771010 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. Jul 31 01:42:35.771010 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:35.772302 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-61422caf-b3e9-45d0-8c16-0d4919a2edc7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Returning 404 to user: Instance 692c9042-e397-4f00-8af2-6b90e97d2e6a could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:42:35.780612 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-61422caf-b3e9-45d0-8c16-0d4919a2edc7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a" status: 404 len: 111 microversion: 2.1 time: 0.071521 Jul 31 01:42:35.787936 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2762/5554] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:35 2022] GET /compute/v2.1/servers/692c9042-e397-4f00-8af2-6b90e97d2e6a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:42:35.860154 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d5022a6c-63a1-46c3-914a-1980a6fe96a5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:35.878880 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d5022a6c-63a1-46c3-914a-1980a6fe96a5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:35.881397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d5022a6c-63a1-46c3-914a-1980a6fe96a5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:35.888814 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d5022a6c-63a1-46c3-914a-1980a6fe96a5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1741 microversion: 2.20 time: 0.317314 Jul 31 01:42:35.890357 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2793/5555] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:35 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1741 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:42:36.429486 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fb997c0f-4fe3-4263-9965-b57cffc3b341 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:36.430001 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fb997c0f-4fe3-4263-9965-b57cffc3b341 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:36.438877 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb997c0f-4fe3-4263-9965-b57cffc3b341 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:36.439452 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb997c0f-4fe3-4263-9965-b57cffc3b341 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:36.440451 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb997c0f-4fe3-4263-9965-b57cffc3b341 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:36.441019 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fb997c0f-4fe3-4263-9965-b57cffc3b341 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:36.457615 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-fb997c0f-4fe3-4263-9965-b57cffc3b341 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] HTTP exception thrown: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fb997c0f-4fe3-4263-9965-b57cffc3b341 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Request method failure captured: Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 HTTP/1.1 Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dxSWPHv6fiyygfwJR0Ud9gfexnY8DUg1-8n2-EFdlhief1Py8PV4RaH4l0q6aYBanPQ6exn-4iFCGEMH9hqgo4PPVedzZNUDT2YTEgYd9iPN8Zs4wyM3F4Cgzs_D-0CTqdk8e-lZRIuuB9WjXa7g4L7rW4yad6wf_BUOJQbjcH4WNc Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f0892e5f98e48408d15771c9d5805bf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f6c26df9a49446c290d6a0b1427f0c14 Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: exception: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'a611359d-c8ae-4c03-bdf4-b392393b1ff7'} Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:42:36.459177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:42:36.463792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. Jul 31 01:42:36.463792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:36.463792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:42:36.463792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:36.463792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:36.463792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:42:36.463792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:42:36.463792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:42:36.463792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:42:36.463792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. Jul 31 01:42:36.463792 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:42:36.463792 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fb997c0f-4fe3-4263-9965-b57cffc3b341 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Returning 404 to user: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:42:36.463792 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fb997c0f-4fe3-4263-9965-b57cffc3b341 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 404 len: 111 microversion: 2.1 time: 0.035064 Jul 31 01:42:36.463792 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2763/5556] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:42:36 2022] DELETE /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:42:36.469389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fcb1de12-90a7-4ff1-bdd6-a20415683608 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:36.470027 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fcb1de12-90a7-4ff1-bdd6-a20415683608 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: a611359d-c8ae-4c03-bdf4-b392393b1ff7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:36.476171 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fcb1de12-90a7-4ff1-bdd6-a20415683608 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:36.476638 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fcb1de12-90a7-4ff1-bdd6-a20415683608 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:36.477409 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fcb1de12-90a7-4ff1-bdd6-a20415683608 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:36.477859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fcb1de12-90a7-4ff1-bdd6-a20415683608 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:36.491985 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-fcb1de12-90a7-4ff1-bdd6-a20415683608 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] HTTP exception thrown: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fcb1de12-90a7-4ff1-bdd6-a20415683608 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Request method failure captured: Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 HTTP/1.1 Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dxSWPHv6fiyygfwJR0Ud9gfexnY8DUg1-8n2-EFdlhief1Py8PV4RaH4l0q6aYBanPQ6exn-4iFCGEMH9hqgo4PPVedzZNUDT2YTEgYd9iPN8Zs4wyM3F4Cgzs_D-0CTqdk8e-lZRIuuB9WjXa7g4L7rW4yad6wf_BUOJQbjcH4WNc Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f0892e5f98e48408d15771c9d5805bf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f6c26df9a49446c290d6a0b1427f0c14 Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: exception: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'a611359d-c8ae-4c03-bdf4-b392393b1ff7'} Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:42:36.493643 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:42:36.502765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:42:36.502765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:42:36.502765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:42:36.502765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:42:36.502765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:42:36.502765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. Jul 31 01:42:36.502765 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:42:36.502765 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fcb1de12-90a7-4ff1-bdd6-a20415683608 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Returning 404 to user: Instance a611359d-c8ae-4c03-bdf4-b392393b1ff7 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:42:36.502765 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fcb1de12-90a7-4ff1-bdd6-a20415683608 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7" status: 404 len: 111 microversion: 2.1 time: 0.029634 Jul 31 01:42:36.502765 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2794/5557] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:36 2022] GET /compute/v2.1/servers/a611359d-c8ae-4c03-bdf4-b392393b1ff7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:42:36.584023 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a3919365-dbe5-4aa3-a3f4-8830067e98d4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Action: 'create', calling method: .version_select at 0x7fedea8d1ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-314743935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAy43CGn6oABVAsTyQA/fGspnpwWQCo21vB8LCrG1q3arMF0K/HkB3ul9Z8k1gxr39ljfUtrFApJJt2tRpF811A3lhziJjzrMzVrNy4WTIoGi+HfhHs4Ap1jpy/L0+PIEQ=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:36.599663 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-a3919365-dbe5-4aa3-a3f4-8830067e98d4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:42:36.604764 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-a3919365-dbe5-4aa3-a3f4-8830067e98d4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for user f6c26df9a49446c290d6a0b1427f0c14 and project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:42:36.628755 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a3919365-dbe5-4aa3-a3f4-8830067e98d4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.048620 Jul 31 01:42:36.629355 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2764/5558] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:42:36 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:42:36.915206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c46b9076-8236-4ef7-b2bc-5e0dd29aba05 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:36.915841 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c46b9076-8236-4ef7-b2bc-5e0dd29aba05 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:36.926050 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c46b9076-8236-4ef7-b2bc-5e0dd29aba05 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:36.926504 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c46b9076-8236-4ef7-b2bc-5e0dd29aba05 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:36.927477 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c46b9076-8236-4ef7-b2bc-5e0dd29aba05 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:36.927889 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c46b9076-8236-4ef7-b2bc-5e0dd29aba05 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:36.968632 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-79b10fc3-6618-490a-a57c-89d337359d7b tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1893889970", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:37.024381 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-79b10fc3-6618-490a-a57c-89d337359d7b tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] validate_networks() for None {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:42:37.198244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c46b9076-8236-4ef7-b2bc-5e0dd29aba05 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:37.207784 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c46b9076-8236-4ef7-b2bc-5e0dd29aba05 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:37.209750 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c46b9076-8236-4ef7-b2bc-5e0dd29aba05 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:37.211442 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c46b9076-8236-4ef7-b2bc-5e0dd29aba05 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1723 microversion: 2.20 time: 0.300857 Jul 31 01:42:37.212204 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2795/5559] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:36 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:42:37.356600 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-79b10fc3-6618-490a-a57c-89d337359d7b tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:42:37.357036 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-79b10fc3-6618-490a-a57c-89d337359d7b tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:42:37.357521 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-79b10fc3-6618-490a-a57c-89d337359d7b tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:42:37.357941 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-79b10fc3-6618-490a-a57c-89d337359d7b tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:42:37.358364 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-79b10fc3-6618-490a-a57c-89d337359d7b tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:42:37.368341 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79b10fc3-6618-490a-a57c-89d337359d7b tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:37.368805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79b10fc3-6618-490a-a57c-89d337359d7b tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:37.369625 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79b10fc3-6618-490a-a57c-89d337359d7b tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:37.370052 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79b10fc3-6618-490a-a57c-89d337359d7b tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:37.393126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-79b10fc3-6618-490a-a57c-89d337359d7b tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Getting quotas for project cce7f90b606e4bd585c1ff55ed36664e. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:42:37.399730 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-79b10fc3-6618-490a-a57c-89d337359d7b tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Getting quotas for user b76fa05a2b444947a917c6e84676926c and project cce7f90b606e4bd585c1ff55ed36664e. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:42:37.415033 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-79b10fc3-6618-490a-a57c-89d337359d7b tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:42:37.417453 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-79b10fc3-6618-490a-a57c-89d337359d7b tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:42:37.461626 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-79b10fc3-6618-490a-a57c-89d337359d7b tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498179 Jul 31 01:42:37.462193 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2765/5560] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:42:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 01:42:37.473955 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-803b4b19-d1c2-4981-ae2a-274356b3b2bb tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:37.474589 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-803b4b19-d1c2-4981-ae2a-274356b3b2bb tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:37.536705 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-803b4b19-d1c2-4981-ae2a-274356b3b2bb tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76fa05a2b444947a917c6e84676926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7f90b606e4bd585c1ff55ed36664e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:37.545809 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-803b4b19-d1c2-4981-ae2a-274356b3b2bb tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] 10.222.0.45 "GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca" status: 200 len: 1214 microversion: 2.1 time: 0.075672 Jul 31 01:42:37.546496 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2796/5561] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:37 2022] GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:38.239877 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-499352e6-e075-4888-997c-c879948dcfb3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:38.240474 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-499352e6-e075-4888-997c-c879948dcfb3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:38.250379 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-499352e6-e075-4888-997c-c879948dcfb3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:38.251066 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-499352e6-e075-4888-997c-c879948dcfb3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:38.251876 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-499352e6-e075-4888-997c-c879948dcfb3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:38.252329 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-499352e6-e075-4888-997c-c879948dcfb3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:38.388387 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-499352e6-e075-4888-997c-c879948dcfb3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:38.396844 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-499352e6-e075-4888-997c-c879948dcfb3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:38.398447 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-499352e6-e075-4888-997c-c879948dcfb3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:38.399748 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-499352e6-e075-4888-997c-c879948dcfb3 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1723 microversion: 2.20 time: 0.165213 Jul 31 01:42:38.400305 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2766/5562] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:38 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:42:38.574392 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3c74e0ca-cef5-43af-b701-05e366a602d8 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:38.575954 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3c74e0ca-cef5-43af-b701-05e366a602d8 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:38.586179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c74e0ca-cef5-43af-b701-05e366a602d8 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:38.587003 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c74e0ca-cef5-43af-b701-05e366a602d8 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:38.588268 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c74e0ca-cef5-43af-b701-05e366a602d8 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:38.588983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c74e0ca-cef5-43af-b701-05e366a602d8 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:38.685097 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3c74e0ca-cef5-43af-b701-05e366a602d8 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76fa05a2b444947a917c6e84676926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7f90b606e4bd585c1ff55ed36664e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:38.693120 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3c74e0ca-cef5-43af-b701-05e366a602d8 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] 10.222.0.45 "GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca" status: 200 len: 1284 microversion: 2.1 time: 0.124814 Jul 31 01:42:38.694281 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2797/5563] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:38 2022] GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca => generated 1284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:39.426614 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e548534f-8692-408f-ae82-8c6701e47a83 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:39.427971 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e548534f-8692-408f-ae82-8c6701e47a83 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:39.437159 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e548534f-8692-408f-ae82-8c6701e47a83 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:39.438526 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e548534f-8692-408f-ae82-8c6701e47a83 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:39.444243 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e548534f-8692-408f-ae82-8c6701e47a83 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:39.444977 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e548534f-8692-408f-ae82-8c6701e47a83 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:39.679610 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e548534f-8692-408f-ae82-8c6701e47a83 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:39.693173 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e548534f-8692-408f-ae82-8c6701e47a83 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:39.695614 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e548534f-8692-408f-ae82-8c6701e47a83 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:39.697439 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e548534f-8692-408f-ae82-8c6701e47a83 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1723 microversion: 2.20 time: 0.276647 Jul 31 01:42:39.698953 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2767/5564] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:39 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:39.728547 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc778743-81a7-46c5-b623-380915642929 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:39.730206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc778743-81a7-46c5-b623-380915642929 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:39.740678 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc778743-81a7-46c5-b623-380915642929 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:39.744840 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc778743-81a7-46c5-b623-380915642929 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:39.748319 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc778743-81a7-46c5-b623-380915642929 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:39.749014 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc778743-81a7-46c5-b623-380915642929 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:40.011544 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fc778743-81a7-46c5-b623-380915642929 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76fa05a2b444947a917c6e84676926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7f90b606e4bd585c1ff55ed36664e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:40.020763 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc778743-81a7-46c5-b623-380915642929 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] 10.222.0.45 "GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca" status: 200 len: 1314 microversion: 2.1 time: 0.308802 Jul 31 01:42:40.021354 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2798/5565] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:39 2022] GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:40.332577 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-064a05ba-cc3e-4bf4-84cb-a2e6d532b621 req-e611a6ca-cad6-4257-b3b2-faff2e16b143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2276ed4a-ccc7-4efc-b754-ae66db0b23ca", "tag": "ef8618bd-5984-4766-beff-ff470613c27d"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:40.347832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-064a05ba-cc3e-4bf4-84cb-a2e6d532b621 req-e611a6ca-cad6-4257-b3b2-faff2e16b143 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:40.348385 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-064a05ba-cc3e-4bf4-84cb-a2e6d532b621 req-e611a6ca-cad6-4257-b3b2-faff2e16b143 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:40.361258 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-064a05ba-cc3e-4bf4-84cb-a2e6d532b621 req-e611a6ca-cad6-4257-b3b2-faff2e16b143 service nova] Creating event network-changed:ef8618bd-5984-4766-beff-ff470613c27d for instance 2276ed4a-ccc7-4efc-b754-ae66db0b23ca on n-h1-master-1 Jul 31 01:42:40.367324 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-064a05ba-cc3e-4bf4-84cb-a2e6d532b621 req-e611a6ca-cad6-4257-b3b2-faff2e16b143 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039635 Jul 31 01:42:40.368381 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2768/5566] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:42:40.722629 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e5b16f8-0160-443c-bd4a-4a26e0691d1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:40.723240 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3e5b16f8-0160-443c-bd4a-4a26e0691d1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:40.733752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e5b16f8-0160-443c-bd4a-4a26e0691d1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:40.734383 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e5b16f8-0160-443c-bd4a-4a26e0691d1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:40.734897 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e5b16f8-0160-443c-bd4a-4a26e0691d1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:40.735543 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e5b16f8-0160-443c-bd4a-4a26e0691d1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:40.801724 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-46586f02-a8e9-4289-983c-2b0054907df0 req-da10645a-b1b6-4a21-9500-ad8b94f38440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66aee0fa-4208-477e-beb0-d989c2bf9079", "name": "network-vif-unplugged", "status": "completed", "tag": "49495de1-4724-4e3b-b374-d34ba9a4db7c"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:40.826162 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-46586f02-a8e9-4289-983c-2b0054907df0 req-da10645a-b1b6-4a21-9500-ad8b94f38440 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:40.827914 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-46586f02-a8e9-4289-983c-2b0054907df0 req-da10645a-b1b6-4a21-9500-ad8b94f38440 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:40.862431 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.compute.server_external_events [req-46586f02-a8e9-4289-983c-2b0054907df0 req-da10645a-b1b6-4a21-9500-ad8b94f38440 service nova] Unable to find a host for instance 66aee0fa-4208-477e-beb0-d989c2bf9079. Dropping event network-vif-unplugged {{(pid=119474) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 31 01:42:40.876122 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-46586f02-a8e9-4289-983c-2b0054907df0 req-da10645a-b1b6-4a21-9500-ad8b94f38440 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.086012 Jul 31 01:42:40.878124 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2769/5567] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 89 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 31 01:42:40.925964 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e5b16f8-0160-443c-bd4a-4a26e0691d1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:40.935163 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e5b16f8-0160-443c-bd4a-4a26e0691d1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:40.936817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e5b16f8-0160-443c-bd4a-4a26e0691d1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:40.938077 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3e5b16f8-0160-443c-bd4a-4a26e0691d1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1666 microversion: 2.20 time: 0.219355 Jul 31 01:42:40.938730 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2799/5568] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:40 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1666 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:40.961286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-52dafdef-8493-464a-96f5-dfdaa8c29c97 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01b98387-47c5-4145-9c2f-7cd9ea7a9ec1"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:40.965159 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-52dafdef-8493-464a-96f5-dfdaa8c29c97 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:40.971000 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52dafdef-8493-464a-96f5-dfdaa8c29c97 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:40.971502 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52dafdef-8493-464a-96f5-dfdaa8c29c97 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:40.972299 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52dafdef-8493-464a-96f5-dfdaa8c29c97 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:40.972770 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52dafdef-8493-464a-96f5-dfdaa8c29c97 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:41.042993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ff896961-032c-420b-a21f-009af14ae012 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:41.043951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ff896961-032c-420b-a21f-009af14ae012 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:41.050492 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff896961-032c-420b-a21f-009af14ae012 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:41.051216 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff896961-032c-420b-a21f-009af14ae012 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:41.052022 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff896961-032c-420b-a21f-009af14ae012 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:41.052465 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ff896961-032c-420b-a21f-009af14ae012 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:41.216746 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ff896961-032c-420b-a21f-009af14ae012 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76fa05a2b444947a917c6e84676926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7f90b606e4bd585c1ff55ed36664e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:41.224673 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ff896961-032c-420b-a21f-009af14ae012 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] 10.222.0.45 "GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca" status: 200 len: 1314 microversion: 2.1 time: 0.186347 Jul 31 01:42:41.235208 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2800/5569] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:41 2022] GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:42:41.276732 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-52dafdef-8493-464a-96f5-dfdaa8c29c97 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "POST /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319396 Jul 31 01:42:41.277619 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2770/5570] 10.222.0.45 () {62 vars in 1364 bytes} [Sun Jul 31 01:42:40 2022] POST /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079/os-volume_attachments => generated 188 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:42:41.417611 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c16decdf-f246-4978-97db-39ec1f3a552b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:41.418117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c16decdf-f246-4978-97db-39ec1f3a552b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:41.426945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c16decdf-f246-4978-97db-39ec1f3a552b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:41.427434 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c16decdf-f246-4978-97db-39ec1f3a552b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:41.428223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c16decdf-f246-4978-97db-39ec1f3a552b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:41.429519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c16decdf-f246-4978-97db-39ec1f3a552b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:41.548440 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:41.727777 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c16decdf-f246-4978-97db-39ec1f3a552b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "DELETE /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079/os-volume_attachments/01b98387-47c5-4145-9c2f-7cd9ea7a9ec1" status: 202 len: 0 microversion: 2.20 time: 0.314002 Jul 31 01:42:41.728406 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2801/5571] 10.222.0.45 () {60 vars in 1457 bytes} [Sun Jul 31 01:42:41 2022] DELETE /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079/os-volume_attachments/01b98387-47c5-4145-9c2f-7cd9ea7a9ec1 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:42:41.799426 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6887a4c2-d31f-4609-93ae-6515996601e1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:41.800126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6887a4c2-d31f-4609-93ae-6515996601e1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:41.808085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6887a4c2-d31f-4609-93ae-6515996601e1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:41.808735 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6887a4c2-d31f-4609-93ae-6515996601e1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:41.809400 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6887a4c2-d31f-4609-93ae-6515996601e1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:41.810415 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6887a4c2-d31f-4609-93ae-6515996601e1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:41.859501 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6887a4c2-d31f-4609-93ae-6515996601e1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119474) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 31 01:42:41.943400 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6887a4c2-d31f-4609-93ae-6515996601e1 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "POST /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079/action" status: 202 len: 0 microversion: 2.20 time: 0.147942 Jul 31 01:42:41.945022 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2771/5572] 10.222.0.45 () {62 vars in 1319 bytes} [Sun Jul 31 01:42:41 2022] POST /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:42:41.953316 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4650a2b2-efb7-4fa2-8806-5a6a765144af tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:41.954629 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4650a2b2-efb7-4fa2-8806-5a6a765144af tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:41.962299 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4650a2b2-efb7-4fa2-8806-5a6a765144af tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:41.962761 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4650a2b2-efb7-4fa2-8806-5a6a765144af tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:41.963576 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4650a2b2-efb7-4fa2-8806-5a6a765144af tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:41.964023 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4650a2b2-efb7-4fa2-8806-5a6a765144af tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:42.246328 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4114dc74-e780-4633-81e6-ee216978d8c7 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:42.247211 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4114dc74-e780-4633-81e6-ee216978d8c7 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:42.247869 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4650a2b2-efb7-4fa2-8806-5a6a765144af tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:42.257895 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4114dc74-e780-4633-81e6-ee216978d8c7 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:42.259032 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4114dc74-e780-4633-81e6-ee216978d8c7 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:42.262102 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4650a2b2-efb7-4fa2-8806-5a6a765144af tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:42.263248 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4114dc74-e780-4633-81e6-ee216978d8c7 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:42.263894 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4114dc74-e780-4633-81e6-ee216978d8c7 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:42.267214 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4650a2b2-efb7-4fa2-8806-5a6a765144af tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:42.270586 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4650a2b2-efb7-4fa2-8806-5a6a765144af tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1674 microversion: 2.20 time: 0.320076 Jul 31 01:42:42.271533 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2802/5573] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:41 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1674 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:42.487766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4114dc74-e780-4633-81e6-ee216978d8c7 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76fa05a2b444947a917c6e84676926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7f90b606e4bd585c1ff55ed36664e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:42.496097 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4114dc74-e780-4633-81e6-ee216978d8c7 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] 10.222.0.45 "GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca" status: 200 len: 1314 microversion: 2.1 time: 0.253634 Jul 31 01:42:42.497123 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2772/5574] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:42 2022] GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:43.296890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2db2a8de-1de1-43c5-b45e-0ed162b582ce tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:43.297508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2db2a8de-1de1-43c5-b45e-0ed162b582ce tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:43.306063 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2db2a8de-1de1-43c5-b45e-0ed162b582ce tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:43.306525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2db2a8de-1de1-43c5-b45e-0ed162b582ce tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:43.307298 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2db2a8de-1de1-43c5-b45e-0ed162b582ce tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:43.307767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2db2a8de-1de1-43c5-b45e-0ed162b582ce tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:43.461443 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2db2a8de-1de1-43c5-b45e-0ed162b582ce tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:43.473222 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2db2a8de-1de1-43c5-b45e-0ed162b582ce tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:43.475156 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2db2a8de-1de1-43c5-b45e-0ed162b582ce tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:43.476372 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2db2a8de-1de1-43c5-b45e-0ed162b582ce tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1732 microversion: 2.20 time: 0.184314 Jul 31 01:42:43.477106 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2803/5575] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:43 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:42:43.516473 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7194060e-1a31-45da-80c4-b5dac9afe87d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:43.516947 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7194060e-1a31-45da-80c4-b5dac9afe87d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:43.523652 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7194060e-1a31-45da-80c4-b5dac9afe87d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:43.524117 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7194060e-1a31-45da-80c4-b5dac9afe87d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:43.524921 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7194060e-1a31-45da-80c4-b5dac9afe87d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:43.525367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7194060e-1a31-45da-80c4-b5dac9afe87d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:43.670927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7194060e-1a31-45da-80c4-b5dac9afe87d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76fa05a2b444947a917c6e84676926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7f90b606e4bd585c1ff55ed36664e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:43.679638 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7194060e-1a31-45da-80c4-b5dac9afe87d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] 10.222.0.45 "GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca" status: 200 len: 1314 microversion: 2.1 time: 0.167306 Jul 31 01:42:43.680793 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2773/5576] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:43 2022] GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:44.458151 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-25078070-bfe8-4ed4-be83-22a739849bae req-67860742-b925-4c70-a198-c3b5ff15ec71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2276ed4a-ccc7-4efc-b754-ae66db0b23ca", "name": "network-vif-plugged", "status": "completed", "tag": "ef8618bd-5984-4766-beff-ff470613c27d"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:44.482067 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-25078070-bfe8-4ed4-be83-22a739849bae req-67860742-b925-4c70-a198-c3b5ff15ec71 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:44.483073 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-25078070-bfe8-4ed4-be83-22a739849bae req-67860742-b925-4c70-a198-c3b5ff15ec71 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:44.504051 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4fa57063-b59e-47db-9c9f-4d86647507e0 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:44.505252 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4fa57063-b59e-47db-9c9f-4d86647507e0 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:44.512126 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-25078070-bfe8-4ed4-be83-22a739849bae req-67860742-b925-4c70-a198-c3b5ff15ec71 service nova] Creating event network-vif-plugged:ef8618bd-5984-4766-beff-ff470613c27d for instance 2276ed4a-ccc7-4efc-b754-ae66db0b23ca on n-h1-master-1 Jul 31 01:42:44.521738 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4fa57063-b59e-47db-9c9f-4d86647507e0 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:44.523257 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4fa57063-b59e-47db-9c9f-4d86647507e0 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:44.526017 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-25078070-bfe8-4ed4-be83-22a739849bae req-67860742-b925-4c70-a198-c3b5ff15ec71 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072306 Jul 31 01:42:44.526271 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4fa57063-b59e-47db-9c9f-4d86647507e0 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:44.526883 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4fa57063-b59e-47db-9c9f-4d86647507e0 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:44.529447 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2804/5577] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:42:44.558347 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:44.702405 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ca5637b1-63af-4739-98a2-d35cce4900a9 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:44.703321 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ca5637b1-63af-4739-98a2-d35cce4900a9 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:44.719757 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca5637b1-63af-4739-98a2-d35cce4900a9 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:44.720316 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca5637b1-63af-4739-98a2-d35cce4900a9 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:44.723817 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca5637b1-63af-4739-98a2-d35cce4900a9 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:44.724416 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca5637b1-63af-4739-98a2-d35cce4900a9 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:44.854411 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4fa57063-b59e-47db-9c9f-4d86647507e0 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:44.885472 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4fa57063-b59e-47db-9c9f-4d86647507e0 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:44.894657 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4fa57063-b59e-47db-9c9f-4d86647507e0 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:44.896307 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4fa57063-b59e-47db-9c9f-4d86647507e0 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1732 microversion: 2.20 time: 0.398887 Jul 31 01:42:44.897196 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2774/5578] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:44 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1732 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:45.012946 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ca5637b1-63af-4739-98a2-d35cce4900a9 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76fa05a2b444947a917c6e84676926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7f90b606e4bd585c1ff55ed36664e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:45.023046 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ca5637b1-63af-4739-98a2-d35cce4900a9 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] 10.222.0.45 "GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca" status: 200 len: 1314 microversion: 2.1 time: 0.325706 Jul 31 01:42:45.039427 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2805/5579] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:44 2022] GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:42:45.923550 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-999925d3-8bb7-472d-a269-83033df00102 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:45.925161 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-999925d3-8bb7-472d-a269-83033df00102 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:45.938148 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-999925d3-8bb7-472d-a269-83033df00102 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:45.944376 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-999925d3-8bb7-472d-a269-83033df00102 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:45.945746 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-999925d3-8bb7-472d-a269-83033df00102 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:45.946739 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-999925d3-8bb7-472d-a269-83033df00102 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:46.052570 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f7f29856-aaf4-4f5f-91ae-5c5985ce7724 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:46.053602 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f7f29856-aaf4-4f5f-91ae-5c5985ce7724 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:46.067092 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7f29856-aaf4-4f5f-91ae-5c5985ce7724 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:46.067595 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7f29856-aaf4-4f5f-91ae-5c5985ce7724 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:46.068475 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7f29856-aaf4-4f5f-91ae-5c5985ce7724 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:46.068926 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7f29856-aaf4-4f5f-91ae-5c5985ce7724 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:46.365840 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-999925d3-8bb7-472d-a269-83033df00102 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:46.378825 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-999925d3-8bb7-472d-a269-83033df00102 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:46.381361 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-999925d3-8bb7-472d-a269-83033df00102 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:46.385473 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-999925d3-8bb7-472d-a269-83033df00102 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1732 microversion: 2.20 time: 0.465906 Jul 31 01:42:46.389224 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2775/5580] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:45 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1732 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:42:46.448233 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f7f29856-aaf4-4f5f-91ae-5c5985ce7724 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76fa05a2b444947a917c6e84676926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7f90b606e4bd585c1ff55ed36664e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:46.466802 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f7f29856-aaf4-4f5f-91ae-5c5985ce7724 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] 10.222.0.45 "GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca" status: 200 len: 1464 microversion: 2.1 time: 0.417725 Jul 31 01:42:46.467727 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2806/5581] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:42:46 2022] GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca => generated 1464 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:42:46.498841 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-67401a65-9bc6-42c9-8a06-f115c09350b9 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a31445c5-2e39-42bb-9756-ad7cf2f62313", "device": "/dev/sdb"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:46.501424 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-67401a65-9bc6-42c9-8a06-f115c09350b9 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:46.523224 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-67401a65-9bc6-42c9-8a06-f115c09350b9 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:46.523723 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-67401a65-9bc6-42c9-8a06-f115c09350b9 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:46.524528 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-67401a65-9bc6-42c9-8a06-f115c09350b9 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:46.525097 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-67401a65-9bc6-42c9-8a06-f115c09350b9 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:46.944776 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-67401a65-9bc6-42c9-8a06-f115c09350b9 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] 10.222.0.45 "POST /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.450264 Jul 31 01:42:46.957684 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2776/5582] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:42:46 2022] POST /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca/os-volume_attachments => generated 194 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:42:47.414710 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7f81674d-383c-466e-b9c8-8aaee4f3ecb6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:47.417286 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7f81674d-383c-466e-b9c8-8aaee4f3ecb6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:47.428805 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f81674d-383c-466e-b9c8-8aaee4f3ecb6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:47.429632 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f81674d-383c-466e-b9c8-8aaee4f3ecb6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:47.430650 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f81674d-383c-466e-b9c8-8aaee4f3ecb6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:47.431418 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f81674d-383c-466e-b9c8-8aaee4f3ecb6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:47.540908 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:47.667106 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7f81674d-383c-466e-b9c8-8aaee4f3ecb6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:47.680307 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7f81674d-383c-466e-b9c8-8aaee4f3ecb6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:47.687521 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7f81674d-383c-466e-b9c8-8aaee4f3ecb6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:47.689461 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7f81674d-383c-466e-b9c8-8aaee4f3ecb6 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1732 microversion: 2.20 time: 0.279174 Jul 31 01:42:47.704394 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2807/5583] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:47 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1732 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:48.716571 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-632c5bc7-69a8-42a1-a4d4-4d7638bd0b78 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:48.717288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-632c5bc7-69a8-42a1-a4d4-4d7638bd0b78 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:48.720132 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:48.721731 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=10 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:48.729087 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-632c5bc7-69a8-42a1-a4d4-4d7638bd0b78 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:48.729800 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-632c5bc7-69a8-42a1-a4d4-4d7638bd0b78 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:48.730826 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-632c5bc7-69a8-42a1-a4d4-4d7638bd0b78 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:48.731285 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-632c5bc7-69a8-42a1-a4d4-4d7638bd0b78 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:48.904943 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-632c5bc7-69a8-42a1-a4d4-4d7638bd0b78 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:48.932909 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-632c5bc7-69a8-42a1-a4d4-4d7638bd0b78 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:48.939955 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-632c5bc7-69a8-42a1-a4d4-4d7638bd0b78 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:48.942251 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-632c5bc7-69a8-42a1-a4d4-4d7638bd0b78 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1732 microversion: 2.20 time: 0.229713 Jul 31 01:42:48.943155 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2777/5584] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:48 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1732 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:49.969241 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9f0388d9-095e-40c6-81f5-716867b93468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:49.970531 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9f0388d9-095e-40c6-81f5-716867b93468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:49.983808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9f0388d9-095e-40c6-81f5-716867b93468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:49.984673 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9f0388d9-095e-40c6-81f5-716867b93468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:49.985693 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9f0388d9-095e-40c6-81f5-716867b93468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:49.992952 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9f0388d9-095e-40c6-81f5-716867b93468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:50.263727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9f0388d9-095e-40c6-81f5-716867b93468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:50.276358 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9f0388d9-095e-40c6-81f5-716867b93468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:50.278085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9f0388d9-095e-40c6-81f5-716867b93468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:50.290642 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9f0388d9-095e-40c6-81f5-716867b93468 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1732 microversion: 2.20 time: 0.325073 Jul 31 01:42:50.291480 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2808/5585] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:49 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1732 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:51.321383 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3f8cc792-a5a5-45f8-82b8-71557f195cb4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:51.325868 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3f8cc792-a5a5-45f8-82b8-71557f195cb4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:51.342332 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f8cc792-a5a5-45f8-82b8-71557f195cb4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:51.346045 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f8cc792-a5a5-45f8-82b8-71557f195cb4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:51.349035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f8cc792-a5a5-45f8-82b8-71557f195cb4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:51.349799 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f8cc792-a5a5-45f8-82b8-71557f195cb4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:51.601098 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3f8cc792-a5a5-45f8-82b8-71557f195cb4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:51.617199 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3f8cc792-a5a5-45f8-82b8-71557f195cb4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:51.619454 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3f8cc792-a5a5-45f8-82b8-71557f195cb4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:51.627253 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3f8cc792-a5a5-45f8-82b8-71557f195cb4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1732 microversion: 2.20 time: 0.314124 Jul 31 01:42:51.631678 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2778/5586] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:51 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1732 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:52.630785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d2b784dd-808a-48bb-8707-d505cac79cf7 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:52.633883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d2b784dd-808a-48bb-8707-d505cac79cf7 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:52.641061 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2b784dd-808a-48bb-8707-d505cac79cf7 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:52.641629 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2b784dd-808a-48bb-8707-d505cac79cf7 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:52.642485 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2b784dd-808a-48bb-8707-d505cac79cf7 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:52.642996 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2b784dd-808a-48bb-8707-d505cac79cf7 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:52.659728 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7baa41ef-4ad8-4d2e-8a26-6fe213da7b1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:52.660368 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7baa41ef-4ad8-4d2e-8a26-6fe213da7b1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:52.670549 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7baa41ef-4ad8-4d2e-8a26-6fe213da7b1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:52.673935 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7baa41ef-4ad8-4d2e-8a26-6fe213da7b1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:52.676743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7baa41ef-4ad8-4d2e-8a26-6fe213da7b1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:52.679294 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7baa41ef-4ad8-4d2e-8a26-6fe213da7b1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:52.830752 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7baa41ef-4ad8-4d2e-8a26-6fe213da7b1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:52.839864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7baa41ef-4ad8-4d2e-8a26-6fe213da7b1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:52.842861 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7baa41ef-4ad8-4d2e-8a26-6fe213da7b1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:52.844523 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7baa41ef-4ad8-4d2e-8a26-6fe213da7b1b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1732 microversion: 2.20 time: 0.188684 Jul 31 01:42:52.845572 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2779/5587] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:52 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:53.580410 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d2b784dd-808a-48bb-8707-d505cac79cf7 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "POST /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38/action" status: 200 len: 24497 microversion: 2.1 time: 0.953525 Jul 31 01:42:53.582092 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2809/5588] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:42:52 2022] POST /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38/action => generated 24497 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:42:53.869872 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e614c8d3-668c-4329-8c38-a384c2f1e86e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:53.870499 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e614c8d3-668c-4329-8c38-a384c2f1e86e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:53.878016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e614c8d3-668c-4329-8c38-a384c2f1e86e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:53.878481 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e614c8d3-668c-4329-8c38-a384c2f1e86e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:53.879260 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e614c8d3-668c-4329-8c38-a384c2f1e86e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:53.879734 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e614c8d3-668c-4329-8c38-a384c2f1e86e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:54.024374 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e614c8d3-668c-4329-8c38-a384c2f1e86e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:54.033117 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e614c8d3-668c-4329-8c38-a384c2f1e86e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:54.034637 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e614c8d3-668c-4329-8c38-a384c2f1e86e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:54.035852 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e614c8d3-668c-4329-8c38-a384c2f1e86e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1732 microversion: 2.20 time: 0.170227 Jul 31 01:42:54.036416 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2780/5589] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:53 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:55.061565 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-06c295c2-ed53-455a-a6ca-b983ff29055e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:55.062416 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-06c295c2-ed53-455a-a6ca-b983ff29055e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:55.070316 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06c295c2-ed53-455a-a6ca-b983ff29055e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:55.070782 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06c295c2-ed53-455a-a6ca-b983ff29055e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:55.071604 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06c295c2-ed53-455a-a6ca-b983ff29055e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:55.072059 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06c295c2-ed53-455a-a6ca-b983ff29055e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:55.208544 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-06c295c2-ed53-455a-a6ca-b983ff29055e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:55.216748 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-06c295c2-ed53-455a-a6ca-b983ff29055e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:55.218265 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-06c295c2-ed53-455a-a6ca-b983ff29055e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:55.219475 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-06c295c2-ed53-455a-a6ca-b983ff29055e tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1732 microversion: 2.20 time: 0.162839 Jul 31 01:42:55.220036 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2810/5590] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:55 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:56.247653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8410a6c0-bc59-442a-a8ec-9cee08edd87a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:56.249068 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8410a6c0-bc59-442a-a8ec-9cee08edd87a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:56.251972 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:56.259469 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8410a6c0-bc59-442a-a8ec-9cee08edd87a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:56.261895 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8410a6c0-bc59-442a-a8ec-9cee08edd87a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:56.261895 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8410a6c0-bc59-442a-a8ec-9cee08edd87a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:56.261895 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8410a6c0-bc59-442a-a8ec-9cee08edd87a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:56.401033 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8410a6c0-bc59-442a-a8ec-9cee08edd87a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:56.409772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8410a6c0-bc59-442a-a8ec-9cee08edd87a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:56.411325 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8410a6c0-bc59-442a-a8ec-9cee08edd87a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:56.412555 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8410a6c0-bc59-442a-a8ec-9cee08edd87a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1732 microversion: 2.20 time: 0.169951 Jul 31 01:42:56.413114 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2781/5591] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:56 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:57.436293 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f145df9d-6005-41d1-9d84-0eaf00a8e0a7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:57.436934 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f145df9d-6005-41d1-9d84-0eaf00a8e0a7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:57.439828 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=56 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:57.445943 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f145df9d-6005-41d1-9d84-0eaf00a8e0a7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:57.446399 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f145df9d-6005-41d1-9d84-0eaf00a8e0a7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:57.447171 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f145df9d-6005-41d1-9d84-0eaf00a8e0a7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:57.447647 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f145df9d-6005-41d1-9d84-0eaf00a8e0a7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:57.587113 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f145df9d-6005-41d1-9d84-0eaf00a8e0a7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:57.595655 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f145df9d-6005-41d1-9d84-0eaf00a8e0a7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:57.597153 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f145df9d-6005-41d1-9d84-0eaf00a8e0a7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:57.598335 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f145df9d-6005-41d1-9d84-0eaf00a8e0a7 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1732 microversion: 2.20 time: 0.166705 Jul 31 01:42:57.598891 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2811/5592] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:57 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:58.621676 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1cf69008-e218-4796-8052-61f280c9f795 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:58.622315 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1cf69008-e218-4796-8052-61f280c9f795 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:58.629387 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cf69008-e218-4796-8052-61f280c9f795 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:58.629856 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cf69008-e218-4796-8052-61f280c9f795 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:58.630636 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cf69008-e218-4796-8052-61f280c9f795 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:58.631092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cf69008-e218-4796-8052-61f280c9f795 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:58.762247 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1cf69008-e218-4796-8052-61f280c9f795 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:58.770346 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1cf69008-e218-4796-8052-61f280c9f795 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:58.771870 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1cf69008-e218-4796-8052-61f280c9f795 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:58.773039 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1cf69008-e218-4796-8052-61f280c9f795 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1732 microversion: 2.20 time: 0.155339 Jul 31 01:42:58.773602 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2782/5593] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:58 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:42:58.912569 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-1410de1f-422e-4bb9-95f8-555f9495f8db req-6d1c12f9-1348-40ea-97d3-adeed3fbd749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66aee0fa-4208-477e-beb0-d989c2bf9079", "name": "network-vif-plugged", "status": "completed", "tag": "49495de1-4724-4e3b-b374-d34ba9a4db7c"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:58.923070 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1410de1f-422e-4bb9-95f8-555f9495f8db req-6d1c12f9-1348-40ea-97d3-adeed3fbd749 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:58.923546 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1410de1f-422e-4bb9-95f8-555f9495f8db req-6d1c12f9-1348-40ea-97d3-adeed3fbd749 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:58.937796 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1410de1f-422e-4bb9-95f8-555f9495f8db req-6d1c12f9-1348-40ea-97d3-adeed3fbd749 service nova] Creating event network-vif-plugged:49495de1-4724-4e3b-b374-d34ba9a4db7c for instance 66aee0fa-4208-477e-beb0-d989c2bf9079 on n-h2-master-1 Jul 31 01:42:58.942630 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-1410de1f-422e-4bb9-95f8-555f9495f8db req-6d1c12f9-1348-40ea-97d3-adeed3fbd749 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033766 Jul 31 01:42:58.943571 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2812/5594] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:42:59.417481 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1b52c3ee-0679-4325-a899-e29aaf09c10b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-48143552", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-314743935", "security_groups": [{"name": "tempest-secgroup-smoke-405411779"}], "block_device_mapping_v2": [{"uuid": "104e185c-6029-4f66-b112-dc8e06a8574d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6739ac5e-7d06-4b25-b7ed-29fa35326c6e"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:42:59.535587 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-1b52c3ee-0679-4325-a899-e29aaf09c10b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] validate_networks() for [('6739ac5e-7d06-4b25-b7ed-29fa35326c6e', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:42:59.797779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d31410dd-f5ba-4b00-8b6e-6c6fc270ebc5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:42:59.798484 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d31410dd-f5ba-4b00-8b6e-6c6fc270ebc5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:42:59.804736 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d31410dd-f5ba-4b00-8b6e-6c6fc270ebc5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:59.805208 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d31410dd-f5ba-4b00-8b6e-6c6fc270ebc5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:59.805980 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d31410dd-f5ba-4b00-8b6e-6c6fc270ebc5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:59.806427 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d31410dd-f5ba-4b00-8b6e-6c6fc270ebc5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:59.956624 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-1b52c3ee-0679-4325-a899-e29aaf09c10b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:42:59.957099 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-1b52c3ee-0679-4325-a899-e29aaf09c10b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:42:59.957582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-1b52c3ee-0679-4325-a899-e29aaf09c10b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:42:59.958009 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-1b52c3ee-0679-4325-a899-e29aaf09c10b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:42:59.958443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-1b52c3ee-0679-4325-a899-e29aaf09c10b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:42:59.967629 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b52c3ee-0679-4325-a899-e29aaf09c10b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:59.968102 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b52c3ee-0679-4325-a899-e29aaf09c10b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:59.968927 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b52c3ee-0679-4325-a899-e29aaf09c10b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:42:59.969384 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b52c3ee-0679-4325-a899-e29aaf09c10b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:42:59.986999 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d31410dd-f5ba-4b00-8b6e-6c6fc270ebc5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:59.987536 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-1b52c3ee-0679-4325-a899-e29aaf09c10b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:42:59.993175 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-1b52c3ee-0679-4325-a899-e29aaf09c10b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for user f6c26df9a49446c290d6a0b1427f0c14 and project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:42:59.995918 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d31410dd-f5ba-4b00-8b6e-6c6fc270ebc5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:59.998156 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d31410dd-f5ba-4b00-8b6e-6c6fc270ebc5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:42:59.999451 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d31410dd-f5ba-4b00-8b6e-6c6fc270ebc5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1732 microversion: 2.20 time: 0.206965 Jul 31 01:43:00.007736 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2813/5595] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:42:59 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1732 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:43:00.055562 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1b52c3ee-0679-4325-a899-e29aaf09c10b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:43:00.057683 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1b52c3ee-0679-4325-a899-e29aaf09c10b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='104e185c-6029-4f66-b112-dc8e06a8574d',volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:43:00.206515 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1b52c3ee-0679-4325-a899-e29aaf09c10b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.792818 Jul 31 01:43:00.207451 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2783/5596] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:42:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:43:00.219086 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3523aa3-a90b-4ab2-817a-beda2ba4df20 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:00.219870 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3523aa3-a90b-4ab2-817a-beda2ba4df20 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:00.275920 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3523aa3-a90b-4ab2-817a-beda2ba4df20 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:00.287635 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3523aa3-a90b-4ab2-817a-beda2ba4df20 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1092 microversion: 2.1 time: 0.073036 Jul 31 01:43:00.289782 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2814/5597] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:00 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1092 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:01.022864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-910a8e64-644c-43c2-9be6-e1117114e599 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:01.023681 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-910a8e64-644c-43c2-9be6-e1117114e599 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:01.030496 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-910a8e64-644c-43c2-9be6-e1117114e599 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:01.030847 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-910a8e64-644c-43c2-9be6-e1117114e599 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:01.031926 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-910a8e64-644c-43c2-9be6-e1117114e599 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:01.032414 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-910a8e64-644c-43c2-9be6-e1117114e599 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:01.313207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bc443506-17c4-499e-b65e-6619a76b1f95 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:01.314553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bc443506-17c4-499e-b65e-6619a76b1f95 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:01.324721 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc443506-17c4-499e-b65e-6619a76b1f95 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:01.325590 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc443506-17c4-499e-b65e-6619a76b1f95 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:01.326783 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc443506-17c4-499e-b65e-6619a76b1f95 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:01.327431 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc443506-17c4-499e-b65e-6619a76b1f95 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:01.586832 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bc443506-17c4-499e-b65e-6619a76b1f95 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:01.600909 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bc443506-17c4-499e-b65e-6619a76b1f95 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1198 microversion: 2.1 time: 0.294384 Jul 31 01:43:01.601746 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2815/5598] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:01 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1198 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:01.740995 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-910a8e64-644c-43c2-9be6-e1117114e599 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:01.756895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-910a8e64-644c-43c2-9be6-e1117114e599 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:01.758452 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-910a8e64-644c-43c2-9be6-e1117114e599 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:01.759720 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-910a8e64-644c-43c2-9be6-e1117114e599 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1719 microversion: 2.20 time: 0.741927 Jul 31 01:43:01.761587 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2784/5599] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:43:01 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1719 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:43:02.624147 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8d6e053d-18cf-4bae-ae41-02668cf64f45 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:02.625368 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8d6e053d-18cf-4bae-ae41-02668cf64f45 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:02.632774 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d6e053d-18cf-4bae-ae41-02668cf64f45 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:02.633470 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d6e053d-18cf-4bae-ae41-02668cf64f45 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:02.634464 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d6e053d-18cf-4bae-ae41-02668cf64f45 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:02.635085 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d6e053d-18cf-4bae-ae41-02668cf64f45 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:02.885625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8d6e053d-18cf-4bae-ae41-02668cf64f45 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:02.898475 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8d6e053d-18cf-4bae-ae41-02668cf64f45 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1275 microversion: 2.1 time: 0.278789 Jul 31 01:43:02.899862 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2816/5600] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:02 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1275 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:03.232695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-d6eabdb9-e15b-4489-92c2-3763082d72d2 req-24fd5329-7ed8-4d12-a5e5-57f8c7ee7649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb49b7d2-7bca-4738-b236-dafb09128705", "tag": "086c02f8-d557-4112-b291-0605109fb6ef"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:43:03.258976 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d6eabdb9-e15b-4489-92c2-3763082d72d2 req-24fd5329-7ed8-4d12-a5e5-57f8c7ee7649 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:03.259888 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d6eabdb9-e15b-4489-92c2-3763082d72d2 req-24fd5329-7ed8-4d12-a5e5-57f8c7ee7649 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:03.280744 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-d6eabdb9-e15b-4489-92c2-3763082d72d2 req-24fd5329-7ed8-4d12-a5e5-57f8c7ee7649 service nova] Creating event network-changed:086c02f8-d557-4112-b291-0605109fb6ef for instance cb49b7d2-7bca-4738-b236-dafb09128705 on n-h1-master-1 Jul 31 01:43:03.288338 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-d6eabdb9-e15b-4489-92c2-3763082d72d2 req-24fd5329-7ed8-4d12-a5e5-57f8c7ee7649 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066932 Jul 31 01:43:03.289997 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2785/5601] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:43:03.920444 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-adc37d0c-f8b2-4d2e-ac00-25523d5f096b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:03.921210 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-adc37d0c-f8b2-4d2e-ac00-25523d5f096b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:03.928135 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-adc37d0c-f8b2-4d2e-ac00-25523d5f096b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:03.928948 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-adc37d0c-f8b2-4d2e-ac00-25523d5f096b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:03.929983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-adc37d0c-f8b2-4d2e-ac00-25523d5f096b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:03.930649 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-adc37d0c-f8b2-4d2e-ac00-25523d5f096b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:04.177625 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-adc37d0c-f8b2-4d2e-ac00-25523d5f096b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:04.186234 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-adc37d0c-f8b2-4d2e-ac00-25523d5f096b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1275 microversion: 2.1 time: 0.269656 Jul 31 01:43:04.200466 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2817/5602] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:03 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1275 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:05.208326 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-103c081b-dfa8-40ef-a8f4-255d720294e4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:05.209826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-103c081b-dfa8-40ef-a8f4-255d720294e4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:05.218513 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-103c081b-dfa8-40ef-a8f4-255d720294e4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:05.219192 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-103c081b-dfa8-40ef-a8f4-255d720294e4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:05.220210 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-103c081b-dfa8-40ef-a8f4-255d720294e4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:05.220926 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-103c081b-dfa8-40ef-a8f4-255d720294e4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:05.415088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-103c081b-dfa8-40ef-a8f4-255d720294e4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:05.422703 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-103c081b-dfa8-40ef-a8f4-255d720294e4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1275 microversion: 2.1 time: 0.218936 Jul 31 01:43:05.439173 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2786/5603] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:05 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1275 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:06.464358 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7cd23b7-48f7-486a-abb8-05193b86a078 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:06.467537 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a7cd23b7-48f7-486a-abb8-05193b86a078 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:06.482383 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7cd23b7-48f7-486a-abb8-05193b86a078 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:06.483089 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7cd23b7-48f7-486a-abb8-05193b86a078 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:06.484042 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7cd23b7-48f7-486a-abb8-05193b86a078 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:06.484955 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7cd23b7-48f7-486a-abb8-05193b86a078 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:06.664326 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a7cd23b7-48f7-486a-abb8-05193b86a078 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:06.680608 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a7cd23b7-48f7-486a-abb8-05193b86a078 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1275 microversion: 2.1 time: 0.234604 Jul 31 01:43:06.681845 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2818/5604] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:06 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1275 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:07.706408 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-54423dfa-de26-40a0-bd5f-68405d5c0eec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:07.706975 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-54423dfa-de26-40a0-bd5f-68405d5c0eec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:07.714854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-54423dfa-de26-40a0-bd5f-68405d5c0eec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:07.716523 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-54423dfa-de26-40a0-bd5f-68405d5c0eec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:07.717337 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-54423dfa-de26-40a0-bd5f-68405d5c0eec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:07.717788 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-54423dfa-de26-40a0-bd5f-68405d5c0eec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:07.871574 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-54423dfa-de26-40a0-bd5f-68405d5c0eec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:07.879853 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-54423dfa-de26-40a0-bd5f-68405d5c0eec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1263 microversion: 2.1 time: 0.177720 Jul 31 01:43:07.894715 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2787/5605] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:07 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1263 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:08.111620 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-95bc7a3a-457a-40a7-a6db-8c85df2a277f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Action: 'create', calling method: .version_select at 0x7fede46bc9d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1882510353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEt3ZJXQvF2QqDHAVGBo98rdjJBoYFyb18g9YzqS5tnXirDB4N9DOG/X/jS0DHN2r7TsZltJI8xfYQFH+Ow/uf2qzWrc/WdqsJOFptCPePFNiQUoIToGHkI3pHu524c06Q=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:43:08.129794 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-95bc7a3a-457a-40a7-a6db-8c85df2a277f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Getting quotas for project aa6c59dbacb14a339fa940faf1d7e632. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:43:08.136061 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-95bc7a3a-457a-40a7-a6db-8c85df2a277f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Getting quotas for user c632588512b9471b8508c1532f6c9723 and project aa6c59dbacb14a339fa940faf1d7e632. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:43:08.163075 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-95bc7a3a-457a-40a7-a6db-8c85df2a277f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.055258 Jul 31 01:43:08.170323 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2819/5606] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:43:08 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:43:08.901439 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3d22f13a-7511-407b-bc8d-a1108f0104e1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:08.903200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3d22f13a-7511-407b-bc8d-a1108f0104e1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:08.916060 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d22f13a-7511-407b-bc8d-a1108f0104e1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:08.916599 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d22f13a-7511-407b-bc8d-a1108f0104e1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:08.917409 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d22f13a-7511-407b-bc8d-a1108f0104e1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:08.917862 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3d22f13a-7511-407b-bc8d-a1108f0104e1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:09.168544 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3d22f13a-7511-407b-bc8d-a1108f0104e1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:09.178474 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3d22f13a-7511-407b-bc8d-a1108f0104e1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1263 microversion: 2.1 time: 0.281258 Jul 31 01:43:09.182046 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2788/5607] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:08 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1263 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:09.645417 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e78c058b-024c-47e3-b807-28b8abd38c07 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-570781445", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "c8019e60-1f7d-4440-a290-2f4e091c1c7b"}], "key_name": "tempest-TestNetworkBasicOps-1882510353", "security_groups": [{"name": "tempest-secgroup-smoke-1971594929"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:43:09.817452 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-e78c058b-024c-47e3-b807-28b8abd38c07 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] validate_networks() for [('c8019e60-1f7d-4440-a290-2f4e091c1c7b', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:43:10.203900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5bb5ad06-8785-4c9b-9fe2-8e8287697463 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:10.206045 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5bb5ad06-8785-4c9b-9fe2-8e8287697463 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:10.215095 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:43:10.217050 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:43:10.219117 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5bb5ad06-8785-4c9b-9fe2-8e8287697463 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:10.219923 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5bb5ad06-8785-4c9b-9fe2-8e8287697463 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:10.223124 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5bb5ad06-8785-4c9b-9fe2-8e8287697463 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:10.223124 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5bb5ad06-8785-4c9b-9fe2-8e8287697463 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:10.246598 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-e78c058b-024c-47e3-b807-28b8abd38c07 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:43:10.247814 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-e78c058b-024c-47e3-b807-28b8abd38c07 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:43:10.248302 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-e78c058b-024c-47e3-b807-28b8abd38c07 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:43:10.248780 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-e78c058b-024c-47e3-b807-28b8abd38c07 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:43:10.250067 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-e78c058b-024c-47e3-b807-28b8abd38c07 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:43:10.260991 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e78c058b-024c-47e3-b807-28b8abd38c07 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:10.261777 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e78c058b-024c-47e3-b807-28b8abd38c07 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:10.262655 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e78c058b-024c-47e3-b807-28b8abd38c07 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:10.263219 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e78c058b-024c-47e3-b807-28b8abd38c07 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:10.287232 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-e78c058b-024c-47e3-b807-28b8abd38c07 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Getting quotas for project aa6c59dbacb14a339fa940faf1d7e632. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:43:10.294525 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-e78c058b-024c-47e3-b807-28b8abd38c07 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Getting quotas for user c632588512b9471b8508c1532f6c9723 and project aa6c59dbacb14a339fa940faf1d7e632. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:43:10.315099 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e78c058b-024c-47e3-b807-28b8abd38c07 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:43:10.318165 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e78c058b-024c-47e3-b807-28b8abd38c07 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:43:10.394316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5bb5ad06-8785-4c9b-9fe2-8e8287697463 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:10.402718 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e78c058b-024c-47e3-b807-28b8abd38c07 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762233 Jul 31 01:43:10.403606 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5bb5ad06-8785-4c9b-9fe2-8e8287697463 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1263 microversion: 2.1 time: 0.204970 Jul 31 01:43:10.404770 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2820/5608] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:43:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:43:10.419531 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2789/5609] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:10 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1263 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:10.419720 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc5f2da7-4856-4d69-839d-2eda3f4217b1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:10.419720 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc5f2da7-4856-4d69-839d-2eda3f4217b1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:10.487661 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fc5f2da7-4856-4d69-839d-2eda3f4217b1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:10.495059 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc5f2da7-4856-4d69-839d-2eda3f4217b1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31" status: 200 len: 1248 microversion: 2.1 time: 0.081743 Jul 31 01:43:10.495934 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2821/5610] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:10 2022] GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 => generated 1248 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:11.426392 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f743b0d0-694b-4c2f-912e-c3ac852eb22e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:11.432753 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f743b0d0-694b-4c2f-912e-c3ac852eb22e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:11.443354 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f743b0d0-694b-4c2f-912e-c3ac852eb22e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:11.444760 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f743b0d0-694b-4c2f-912e-c3ac852eb22e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:11.445570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f743b0d0-694b-4c2f-912e-c3ac852eb22e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:11.446063 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f743b0d0-694b-4c2f-912e-c3ac852eb22e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:11.518417 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c2d90b3c-5533-43b6-85ae-46d7d9875b1a tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:11.519397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c2d90b3c-5533-43b6-85ae-46d7d9875b1a tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:11.528925 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2d90b3c-5533-43b6-85ae-46d7d9875b1a tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:11.531826 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2d90b3c-5533-43b6-85ae-46d7d9875b1a tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:11.534979 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2d90b3c-5533-43b6-85ae-46d7d9875b1a tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:11.537360 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2d90b3c-5533-43b6-85ae-46d7d9875b1a tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:11.548804 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:43:11.669802 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f743b0d0-694b-4c2f-912e-c3ac852eb22e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:11.683199 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f743b0d0-694b-4c2f-912e-c3ac852eb22e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1263 microversion: 2.1 time: 0.256738 Jul 31 01:43:11.698711 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2790/5611] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:11 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1263 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:11.716732 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c2d90b3c-5533-43b6-85ae-46d7d9875b1a tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:11.725465 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c2d90b3c-5533-43b6-85ae-46d7d9875b1a tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31" status: 200 len: 1300 microversion: 2.1 time: 0.211053 Jul 31 01:43:11.726431 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2822/5612] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:11 2022] GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 => generated 1300 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:12.706397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-52513ce2-b34c-424a-8e2d-502d6bc35c5c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:12.711877 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-52513ce2-b34c-424a-8e2d-502d6bc35c5c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:12.730710 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52513ce2-b34c-424a-8e2d-502d6bc35c5c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:12.731981 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52513ce2-b34c-424a-8e2d-502d6bc35c5c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:12.732946 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52513ce2-b34c-424a-8e2d-502d6bc35c5c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:12.733560 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52513ce2-b34c-424a-8e2d-502d6bc35c5c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:12.739928 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:43:12.749859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b31ed233-0853-4f71-8849-6de3298dea02 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:12.751178 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b31ed233-0853-4f71-8849-6de3298dea02 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:12.770106 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b31ed233-0853-4f71-8849-6de3298dea02 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:12.772456 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b31ed233-0853-4f71-8849-6de3298dea02 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:12.774082 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b31ed233-0853-4f71-8849-6de3298dea02 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:12.777371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b31ed233-0853-4f71-8849-6de3298dea02 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:13.030349 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-52513ce2-b34c-424a-8e2d-502d6bc35c5c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:13.036786 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b31ed233-0853-4f71-8849-6de3298dea02 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:13.040505 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-52513ce2-b34c-424a-8e2d-502d6bc35c5c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1263 microversion: 2.1 time: 0.338195 Jul 31 01:43:13.044510 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b31ed233-0853-4f71-8849-6de3298dea02 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31" status: 200 len: 1374 microversion: 2.1 time: 0.301271 Jul 31 01:43:13.044682 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2791/5613] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:12 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1263 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:13.045850 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2823/5614] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:12 2022] GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 => generated 1374 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:13.387295 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-c18ce39f-6488-4a97-a677-068a05263e4f req-52be1086-4850-4663-8be7-afe3c1aed1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a0b923-9863-4d97-aaea-5d9d0933be31", "tag": "e2870f53-2450-42ef-9ab3-4990d7f0c053"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:43:13.398885 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c18ce39f-6488-4a97-a677-068a05263e4f req-52be1086-4850-4663-8be7-afe3c1aed1b6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:13.399488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c18ce39f-6488-4a97-a677-068a05263e4f req-52be1086-4850-4663-8be7-afe3c1aed1b6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:13.413247 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-c18ce39f-6488-4a97-a677-068a05263e4f req-52be1086-4850-4663-8be7-afe3c1aed1b6 service nova] Creating event network-changed:e2870f53-2450-42ef-9ab3-4990d7f0c053 for instance 06a0b923-9863-4d97-aaea-5d9d0933be31 on n-h2-master-1 Jul 31 01:43:13.418289 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-c18ce39f-6488-4a97-a677-068a05263e4f req-52be1086-4850-4663-8be7-afe3c1aed1b6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196969 Jul 31 01:43:13.419706 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2792/5615] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:43:14.068459 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-135142e8-2e97-48b0-ba09-02a1d675be05 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:14.069089 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-135142e8-2e97-48b0-ba09-02a1d675be05 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:14.076785 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-135142e8-2e97-48b0-ba09-02a1d675be05 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:14.077223 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5648c0e7-7838-4806-9b01-fdd42c7a00d1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:14.077700 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-135142e8-2e97-48b0-ba09-02a1d675be05 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:14.078021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-135142e8-2e97-48b0-ba09-02a1d675be05 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:14.078201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5648c0e7-7838-4806-9b01-fdd42c7a00d1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:14.078466 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-135142e8-2e97-48b0-ba09-02a1d675be05 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:14.085456 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5648c0e7-7838-4806-9b01-fdd42c7a00d1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:14.086007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5648c0e7-7838-4806-9b01-fdd42c7a00d1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:14.086866 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5648c0e7-7838-4806-9b01-fdd42c7a00d1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:14.087500 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5648c0e7-7838-4806-9b01-fdd42c7a00d1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:14.281297 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-135142e8-2e97-48b0-ba09-02a1d675be05 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:14.286042 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5648c0e7-7838-4806-9b01-fdd42c7a00d1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:14.291708 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-135142e8-2e97-48b0-ba09-02a1d675be05 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1263 microversion: 2.1 time: 0.227095 Jul 31 01:43:14.293100 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2824/5616] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:14 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1263 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:14.294853 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5648c0e7-7838-4806-9b01-fdd42c7a00d1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31" status: 200 len: 1374 microversion: 2.1 time: 0.223353 Jul 31 01:43:14.307775 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2793/5617] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:14 2022] GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 => generated 1374 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:43:15.314236 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5abff332-fd70-4b8c-bdf8-29f16b3fb8ac tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:15.315219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5abff332-fd70-4b8c-bdf8-29f16b3fb8ac tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:15.316014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a144f843-919c-4e79-9d64-d19371acf44c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:15.316716 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a144f843-919c-4e79-9d64-d19371acf44c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:15.325183 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5abff332-fd70-4b8c-bdf8-29f16b3fb8ac tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:15.326122 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5abff332-fd70-4b8c-bdf8-29f16b3fb8ac tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:15.326362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a144f843-919c-4e79-9d64-d19371acf44c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:15.326938 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a144f843-919c-4e79-9d64-d19371acf44c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:15.327625 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5abff332-fd70-4b8c-bdf8-29f16b3fb8ac tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:15.327983 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a144f843-919c-4e79-9d64-d19371acf44c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:15.328234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5abff332-fd70-4b8c-bdf8-29f16b3fb8ac tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:15.328590 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a144f843-919c-4e79-9d64-d19371acf44c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:15.531421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a144f843-919c-4e79-9d64-d19371acf44c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:15.540759 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a144f843-919c-4e79-9d64-d19371acf44c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31" status: 200 len: 1374 microversion: 2.1 time: 0.228827 Jul 31 01:43:15.544803 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5abff332-fd70-4b8c-bdf8-29f16b3fb8ac tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:15.553625 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2794/5618] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:15 2022] GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 => generated 1374 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:43:15.558782 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5abff332-fd70-4b8c-bdf8-29f16b3fb8ac tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1263 microversion: 2.1 time: 0.250335 Jul 31 01:43:15.560163 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2825/5619] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:15 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1263 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:16.430666 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-801376f8-87d6-4bf9-8b55-9b177f4bdff2 req-66f1bfbf-3f32-45c2-bf81-fcf6fdb1e47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb49b7d2-7bca-4738-b236-dafb09128705", "name": "network-vif-plugged", "status": "completed", "tag": "086c02f8-d557-4112-b291-0605109fb6ef"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:43:16.444800 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-801376f8-87d6-4bf9-8b55-9b177f4bdff2 req-66f1bfbf-3f32-45c2-bf81-fcf6fdb1e47c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:16.444800 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-801376f8-87d6-4bf9-8b55-9b177f4bdff2 req-66f1bfbf-3f32-45c2-bf81-fcf6fdb1e47c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:16.455129 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-801376f8-87d6-4bf9-8b55-9b177f4bdff2 req-66f1bfbf-3f32-45c2-bf81-fcf6fdb1e47c service nova] Creating event network-vif-plugged:086c02f8-d557-4112-b291-0605109fb6ef for instance cb49b7d2-7bca-4738-b236-dafb09128705 on n-h1-master-1 Jul 31 01:43:16.460143 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-801376f8-87d6-4bf9-8b55-9b177f4bdff2 req-66f1bfbf-3f32-45c2-bf81-fcf6fdb1e47c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033219 Jul 31 01:43:16.461011 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2795/5620] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:43:16.561399 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-582d7469-b7ae-4e05-820d-c01d20fb08af tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:16.562732 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-582d7469-b7ae-4e05-820d-c01d20fb08af tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:16.570343 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-582d7469-b7ae-4e05-820d-c01d20fb08af tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:16.570813 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-582d7469-b7ae-4e05-820d-c01d20fb08af tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:16.571634 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-582d7469-b7ae-4e05-820d-c01d20fb08af tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:16.572165 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-582d7469-b7ae-4e05-820d-c01d20fb08af tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:16.580815 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9d7248ca-cfb3-4c53-87ed-0f6e60f475cc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:16.582072 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9d7248ca-cfb3-4c53-87ed-0f6e60f475cc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:16.590118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d7248ca-cfb3-4c53-87ed-0f6e60f475cc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:16.591651 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d7248ca-cfb3-4c53-87ed-0f6e60f475cc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:16.592829 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d7248ca-cfb3-4c53-87ed-0f6e60f475cc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:16.593510 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d7248ca-cfb3-4c53-87ed-0f6e60f475cc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:16.814321 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-582d7469-b7ae-4e05-820d-c01d20fb08af tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:16.817720 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9d7248ca-cfb3-4c53-87ed-0f6e60f475cc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:16.822353 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-582d7469-b7ae-4e05-820d-c01d20fb08af tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31" status: 200 len: 1374 microversion: 2.1 time: 0.264990 Jul 31 01:43:16.822937 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2826/5621] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:16 2022] GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 => generated 1374 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:16.825958 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9d7248ca-cfb3-4c53-87ed-0f6e60f475cc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1263 microversion: 2.1 time: 0.249327 Jul 31 01:43:16.826599 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2796/5622] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:16 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1263 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:43:17.843452 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6b57959d-b96c-4dfe-a39d-a5195e6fdb3c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:17.844380 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6b57959d-b96c-4dfe-a39d-a5195e6fdb3c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:17.846889 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b6b8698c-578d-45c0-a986-e9323fe0d6a9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:17.847541 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b6b8698c-578d-45c0-a986-e9323fe0d6a9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:17.852275 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b57959d-b96c-4dfe-a39d-a5195e6fdb3c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:17.853928 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b57959d-b96c-4dfe-a39d-a5195e6fdb3c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:17.854708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b57959d-b96c-4dfe-a39d-a5195e6fdb3c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:17.855004 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6b8698c-578d-45c0-a986-e9323fe0d6a9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:17.855162 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b57959d-b96c-4dfe-a39d-a5195e6fdb3c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:17.855625 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6b8698c-578d-45c0-a986-e9323fe0d6a9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:17.856839 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6b8698c-578d-45c0-a986-e9323fe0d6a9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:17.857300 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6b8698c-578d-45c0-a986-e9323fe0d6a9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:18.073249 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b6b8698c-578d-45c0-a986-e9323fe0d6a9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:18.081735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6b57959d-b96c-4dfe-a39d-a5195e6fdb3c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:18.081934 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b6b8698c-578d-45c0-a986-e9323fe0d6a9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1449 microversion: 2.1 time: 0.239697 Jul 31 01:43:18.082725 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2797/5623] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:17 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1449 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:43:18.094620 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6b57959d-b96c-4dfe-a39d-a5195e6fdb3c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31" status: 200 len: 1374 microversion: 2.1 time: 0.255364 Jul 31 01:43:18.095715 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2827/5624] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:17 2022] GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 => generated 1374 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:18.102999 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-272e685a-e7f3-473f-aa97-6071d6d4986d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:18.103776 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-272e685a-e7f3-473f-aa97-6071d6d4986d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:18.110446 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-272e685a-e7f3-473f-aa97-6071d6d4986d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:18.110916 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-272e685a-e7f3-473f-aa97-6071d6d4986d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:18.111733 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-272e685a-e7f3-473f-aa97-6071d6d4986d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:18.112192 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-272e685a-e7f3-473f-aa97-6071d6d4986d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:18.249287 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-272e685a-e7f3-473f-aa97-6071d6d4986d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:18.257196 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-272e685a-e7f3-473f-aa97-6071d6d4986d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1449 microversion: 2.1 time: 0.157822 Jul 31 01:43:18.264668 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2798/5625] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:18 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:43:19.049475 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-452434fe-33c6-4e76-ace4-8d215fb9447e req-4bd0e423-16ea-45b7-b2a7-f33e996b83e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a0b923-9863-4d97-aaea-5d9d0933be31", "name": "network-vif-plugged", "status": "completed", "tag": "e2870f53-2450-42ef-9ab3-4990d7f0c053"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:43:19.063155 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-452434fe-33c6-4e76-ace4-8d215fb9447e req-4bd0e423-16ea-45b7-b2a7-f33e996b83e3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:19.064099 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-452434fe-33c6-4e76-ace4-8d215fb9447e req-4bd0e423-16ea-45b7-b2a7-f33e996b83e3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:19.079560 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-452434fe-33c6-4e76-ace4-8d215fb9447e req-4bd0e423-16ea-45b7-b2a7-f33e996b83e3 service nova] Creating event network-vif-plugged:e2870f53-2450-42ef-9ab3-4990d7f0c053 for instance 06a0b923-9863-4d97-aaea-5d9d0933be31 on n-h2-master-1 Jul 31 01:43:19.086248 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-452434fe-33c6-4e76-ace4-8d215fb9447e req-4bd0e423-16ea-45b7-b2a7-f33e996b83e3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041811 Jul 31 01:43:19.087836 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2828/5626] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:43:19.118004 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-db0f0325-161a-4255-8d03-7ad06c1ffb8d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:19.119652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-db0f0325-161a-4255-8d03-7ad06c1ffb8d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:19.144905 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db0f0325-161a-4255-8d03-7ad06c1ffb8d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:19.145667 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db0f0325-161a-4255-8d03-7ad06c1ffb8d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:19.146663 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db0f0325-161a-4255-8d03-7ad06c1ffb8d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:19.147279 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db0f0325-161a-4255-8d03-7ad06c1ffb8d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:19.415394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-db0f0325-161a-4255-8d03-7ad06c1ffb8d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:19.423770 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-db0f0325-161a-4255-8d03-7ad06c1ffb8d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31" status: 200 len: 1374 microversion: 2.1 time: 0.310766 Jul 31 01:43:19.424798 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2799/5627] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:19 2022] GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 => generated 1374 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:20.444790 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:43:20.449814 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-58f62a28-b081-41aa-ba17-f417d603d1d5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:20.451213 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-58f62a28-b081-41aa-ba17-f417d603d1d5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:20.469057 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58f62a28-b081-41aa-ba17-f417d603d1d5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:20.476834 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58f62a28-b081-41aa-ba17-f417d603d1d5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:20.478053 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58f62a28-b081-41aa-ba17-f417d603d1d5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:20.478570 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-58f62a28-b081-41aa-ba17-f417d603d1d5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:20.497886 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=14 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:43:20.628759 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-986b5ff6-6ef8-4039-83d2-cda29af07805 req-1b38b0d0-e9b5-4f95-9174-c508d7367378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb49b7d2-7bca-4738-b236-dafb09128705", "tag": "086c02f8-d557-4112-b291-0605109fb6ef"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:43:20.641392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-986b5ff6-6ef8-4039-83d2-cda29af07805 req-1b38b0d0-e9b5-4f95-9174-c508d7367378 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:20.642092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-986b5ff6-6ef8-4039-83d2-cda29af07805 req-1b38b0d0-e9b5-4f95-9174-c508d7367378 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:20.655766 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-986b5ff6-6ef8-4039-83d2-cda29af07805 req-1b38b0d0-e9b5-4f95-9174-c508d7367378 service nova] Creating event network-changed:086c02f8-d557-4112-b291-0605109fb6ef for instance cb49b7d2-7bca-4738-b236-dafb09128705 on n-h1-master-1 Jul 31 01:43:20.661645 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-986b5ff6-6ef8-4039-83d2-cda29af07805 req-1b38b0d0-e9b5-4f95-9174-c508d7367378 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036399 Jul 31 01:43:20.663919 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2800/5628] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:43:20.698664 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-58f62a28-b081-41aa-ba17-f417d603d1d5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:20.711696 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-58f62a28-b081-41aa-ba17-f417d603d1d5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31" status: 200 len: 1374 microversion: 2.1 time: 0.267123 Jul 31 01:43:20.712353 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2829/5629] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:20 2022] GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 => generated 1374 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:21.733103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-179c0092-bf43-4649-ba83-270394f6f0b5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:21.733829 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-179c0092-bf43-4649-ba83-270394f6f0b5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:21.741180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-179c0092-bf43-4649-ba83-270394f6f0b5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:21.742318 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-179c0092-bf43-4649-ba83-270394f6f0b5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:21.742751 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-179c0092-bf43-4649-ba83-270394f6f0b5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:21.743209 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-179c0092-bf43-4649-ba83-270394f6f0b5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:21.903205 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-179c0092-bf43-4649-ba83-270394f6f0b5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:21.911070 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-179c0092-bf43-4649-ba83-270394f6f0b5 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31" status: 200 len: 1547 microversion: 2.1 time: 0.182240 Jul 31 01:43:21.911679 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2801/5630] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:21 2022] GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 => generated 1547 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:21.933259 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-42f117dc-2f53-4fc3-b799-61b88e25fc43 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:21.934044 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-42f117dc-2f53-4fc3-b799-61b88e25fc43 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:21.941115 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42f117dc-2f53-4fc3-b799-61b88e25fc43 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:21.941668 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42f117dc-2f53-4fc3-b799-61b88e25fc43 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:21.942541 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42f117dc-2f53-4fc3-b799-61b88e25fc43 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:21.943073 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42f117dc-2f53-4fc3-b799-61b88e25fc43 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:22.081087 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-42f117dc-2f53-4fc3-b799-61b88e25fc43 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:22.088671 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-42f117dc-2f53-4fc3-b799-61b88e25fc43 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31" status: 200 len: 1547 microversion: 2.1 time: 0.161038 Jul 31 01:43:22.089250 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2830/5631] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:21 2022] GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:34.213180 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3f0292dc-7a2c-4398-8b7f-9c9f47333a88 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:34.215466 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3f0292dc-7a2c-4398-8b7f-9c9f47333a88 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:34.219034 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:43:34.219744 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=53 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:43:34.226766 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f0292dc-7a2c-4398-8b7f-9c9f47333a88 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:34.227390 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f0292dc-7a2c-4398-8b7f-9c9f47333a88 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:34.228196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f0292dc-7a2c-4398-8b7f-9c9f47333a88 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:34.228658 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f0292dc-7a2c-4398-8b7f-9c9f47333a88 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:34.263493 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3f0292dc-7a2c-4398-8b7f-9c9f47333a88 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054543 Jul 31 01:43:34.264403 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2802/5632] 10.222.0.45 () {60 vars in 1343 bytes} [Sun Jul 31 01:43:34 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:34.334104 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6b6b8fd0-9689-4d1d-8dff-18b60c50a521 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:34.334628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6b6b8fd0-9689-4d1d-8dff-18b60c50a521 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:34.343906 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:43:34.344799 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=48 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:43:34.347451 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b6b8fd0-9689-4d1d-8dff-18b60c50a521 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:34.348146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b6b8fd0-9689-4d1d-8dff-18b60c50a521 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:34.349045 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b6b8fd0-9689-4d1d-8dff-18b60c50a521 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:34.349561 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b6b8fd0-9689-4d1d-8dff-18b60c50a521 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:34.379208 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6b6b8fd0-9689-4d1d-8dff-18b60c50a521 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:43:34.460542 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6b6b8fd0-9689-4d1d-8dff-18b60c50a521 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "DELETE /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 204 len: 0 microversion: 2.20 time: 0.129998 Jul 31 01:43:34.461419 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2831/5633] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:43:34 2022] DELETE /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:43:34.471224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-da19b05f-5518-4c4f-aa6d-0bdc14a61dfe tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:34.471951 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-da19b05f-5518-4c4f-aa6d-0bdc14a61dfe tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:34.479736 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da19b05f-5518-4c4f-aa6d-0bdc14a61dfe tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:34.480352 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da19b05f-5518-4c4f-aa6d-0bdc14a61dfe tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:34.481942 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da19b05f-5518-4c4f-aa6d-0bdc14a61dfe tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:34.482401 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da19b05f-5518-4c4f-aa6d-0bdc14a61dfe tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:34.741170 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-da19b05f-5518-4c4f-aa6d-0bdc14a61dfe tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:34.749772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-da19b05f-5518-4c4f-aa6d-0bdc14a61dfe tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:34.751300 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-da19b05f-5518-4c4f-aa6d-0bdc14a61dfe tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:34.752521 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-da19b05f-5518-4c4f-aa6d-0bdc14a61dfe tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1725 microversion: 2.20 time: 0.286039 Jul 31 01:43:34.753086 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2803/5634] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:43:34 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1725 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:43:35.776221 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6a27fe4d-1609-4e0f-a96a-bfeb1fa145b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:35.777045 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6a27fe4d-1609-4e0f-a96a-bfeb1fa145b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:35.783969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a27fe4d-1609-4e0f-a96a-bfeb1fa145b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:35.784428 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a27fe4d-1609-4e0f-a96a-bfeb1fa145b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:35.785193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a27fe4d-1609-4e0f-a96a-bfeb1fa145b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:35.785640 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a27fe4d-1609-4e0f-a96a-bfeb1fa145b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:35.922481 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6a27fe4d-1609-4e0f-a96a-bfeb1fa145b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:35.930750 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6a27fe4d-1609-4e0f-a96a-bfeb1fa145b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:35.932374 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6a27fe4d-1609-4e0f-a96a-bfeb1fa145b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:35.933637 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6a27fe4d-1609-4e0f-a96a-bfeb1fa145b4 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1725 microversion: 2.20 time: 0.161780 Jul 31 01:43:35.934874 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2832/5635] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:43:35 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:43:36.985651 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5d0d4858-fbaf-4f44-bc3f-122238fd0462 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:36.986929 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5d0d4858-fbaf-4f44-bc3f-122238fd0462 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:36.994883 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d0d4858-fbaf-4f44-bc3f-122238fd0462 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:36.995669 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d0d4858-fbaf-4f44-bc3f-122238fd0462 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:36.997209 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d0d4858-fbaf-4f44-bc3f-122238fd0462 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:36.997836 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d0d4858-fbaf-4f44-bc3f-122238fd0462 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:37.079286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5d0d4858-fbaf-4f44-bc3f-122238fd0462 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:37.087889 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5d0d4858-fbaf-4f44-bc3f-122238fd0462 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:37.089475 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5d0d4858-fbaf-4f44-bc3f-122238fd0462 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5da6102ddcb948fa874856fa1ac7226d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb35771c7e744f859d2c5d29b511d345', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:37.090854 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5d0d4858-fbaf-4f44-bc3f-122238fd0462 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 200 len: 1657 microversion: 2.20 time: 0.134130 Jul 31 01:43:37.091522 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2804/5636] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:43:36 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 1657 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:43:37.234050 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-247edf4f-f584-4ca8-99a4-f05b60639ce7 req-715d43d5-21fe-4922-aab2-8eefc421d848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66aee0fa-4208-477e-beb0-d989c2bf9079", "name": "network-vif-deleted", "tag": "49495de1-4724-4e3b-b374-d34ba9a4db7c"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:43:37.251942 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-247edf4f-f584-4ca8-99a4-f05b60639ce7 req-715d43d5-21fe-4922-aab2-8eefc421d848 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:37.252731 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-247edf4f-f584-4ca8-99a4-f05b60639ce7 req-715d43d5-21fe-4922-aab2-8eefc421d848 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:37.265088 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-247edf4f-f584-4ca8-99a4-f05b60639ce7 req-715d43d5-21fe-4922-aab2-8eefc421d848 service nova] Creating event network-vif-deleted:49495de1-4724-4e3b-b374-d34ba9a4db7c for instance 66aee0fa-4208-477e-beb0-d989c2bf9079 on n-h2-master-1 Jul 31 01:43:37.271285 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-247edf4f-f584-4ca8-99a4-f05b60639ce7 req-715d43d5-21fe-4922-aab2-8eefc421d848 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043366 Jul 31 01:43:37.272282 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2833/5637] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:43:38.115054 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-84c786e8-a89f-4ea3-a596-2d50b6cf1d7a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:38.115954 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-84c786e8-a89f-4ea3-a596-2d50b6cf1d7a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:38.126582 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-84c786e8-a89f-4ea3-a596-2d50b6cf1d7a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:38.127058 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-84c786e8-a89f-4ea3-a596-2d50b6cf1d7a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:38.129525 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-84c786e8-a89f-4ea3-a596-2d50b6cf1d7a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:38.130126 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-84c786e8-a89f-4ea3-a596-2d50b6cf1d7a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:38.146038 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-84c786e8-a89f-4ea3-a596-2d50b6cf1d7a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] HTTP exception thrown: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-84c786e8-a89f-4ea3-a596-2d50b6cf1d7a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Request method failure captured: Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 HTTP/1.1 Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dytLYovzsdU6l99mr3IwrEW6j42KeQCQufWjpy9PXb0I8z7fgHtiCMZYHjVXnMbSEbhy3qB7zQVfivfwTfD2O0ExbcJOYmSDWnmmV6IZbEn-R0uCQ2RLIXz0YiRptikx5VD6l7jCJanCFClZxjKN6bxH2e1VEQopxnCkkkOhBLkxoU Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: fb35771c7e744f859d2c5d29b511d345 Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fb35771c7e744f859d2c5d29b511d345", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: fb35771c7e744f859d2c5d29b511d345 Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AttachVolumeShelveTestJSON-408575781-project Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 5da6102ddcb948fa874856fa1ac7226d Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AttachVolumeShelveTestJSON-408575781-project Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '66aee0fa-4208-477e-beb0-d989c2bf9079'} Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:43:38.147854 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:43:38.155786 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:43:38.155786 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:38.155786 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:43:38.155786 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:43:38.155786 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:43:38.155786 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:43:38.155786 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. Jul 31 01:43:38.155786 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:43:38.155786 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-84c786e8-a89f-4ea3-a596-2d50b6cf1d7a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Returning 404 to user: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:43:38.155786 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-84c786e8-a89f-4ea3-a596-2d50b6cf1d7a tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 404 len: 111 microversion: 2.20 time: 0.038231 Jul 31 01:43:38.155786 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2805/5638] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:43:38 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:43:38.160273 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-28ebc9b7-aabe-48fb-b6e5-86404e3098f9 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '.version_select at 0x7fede472b940>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:38.186011 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-28ebc9b7-aabe-48fb-b6e5-86404e3098f9 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2059455023" status: 204 len: 0 microversion: 2.20 time: 0.030221 Jul 31 01:43:38.186897 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2834/5639] 10.222.0.45 () {60 vars in 1262 bytes} [Sun Jul 31 01:43:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2059455023 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:43:41.093673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ddae8c8b-293e-47fc-948d-1dd8adfe38f2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:41.094195 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ddae8c8b-293e-47fc-948d-1dd8adfe38f2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:41.102073 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddae8c8b-293e-47fc-948d-1dd8adfe38f2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:41.102548 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddae8c8b-293e-47fc-948d-1dd8adfe38f2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:41.103355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddae8c8b-293e-47fc-948d-1dd8adfe38f2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:41.103820 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddae8c8b-293e-47fc-948d-1dd8adfe38f2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:41.117952 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-ddae8c8b-293e-47fc-948d-1dd8adfe38f2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] HTTP exception thrown: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ddae8c8b-293e-47fc-948d-1dd8adfe38f2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Request method failure captured: Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 HTTP/1.1 Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dytLYovzsdU6l99mr3IwrEW6j42KeQCQufWjpy9PXb0I8z7fgHtiCMZYHjVXnMbSEbhy3qB7zQVfivfwTfD2O0ExbcJOYmSDWnmmV6IZbEn-R0uCQ2RLIXz0YiRptikx5VD6l7jCJanCFClZxjKN6bxH2e1VEQopxnCkkkOhBLkxoU Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: fb35771c7e744f859d2c5d29b511d345 Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fb35771c7e744f859d2c5d29b511d345", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: fb35771c7e744f859d2c5d29b511d345 Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AttachVolumeShelveTestJSON-408575781-project Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 5da6102ddcb948fa874856fa1ac7226d Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AttachVolumeShelveTestJSON-408575781-project Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '66aee0fa-4208-477e-beb0-d989c2bf9079'} Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:43:41.119685 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:43:41.125250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. Jul 31 01:43:41.125250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:43:41.125250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:43:41.125250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:43:41.125250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:41.125250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:43:41.125250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:43:41.125250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:43:41.125250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:43:41.125250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. Jul 31 01:43:41.125250 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:43:41.125250 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ddae8c8b-293e-47fc-948d-1dd8adfe38f2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Returning 404 to user: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:43:41.125250 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ddae8c8b-293e-47fc-948d-1dd8adfe38f2 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "DELETE /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 404 len: 111 microversion: 2.20 time: 0.032221 Jul 31 01:43:41.125250 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2806/5640] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:43:41 2022] DELETE /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 31 01:43:41.131765 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-19c59d7f-e91a-416b-bbcd-75174b9056e5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:41.132460 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-19c59d7f-e91a-416b-bbcd-75174b9056e5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 66aee0fa-4208-477e-beb0-d989c2bf9079] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:41.143839 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19c59d7f-e91a-416b-bbcd-75174b9056e5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:41.144318 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19c59d7f-e91a-416b-bbcd-75174b9056e5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:41.145352 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19c59d7f-e91a-416b-bbcd-75174b9056e5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:41.145976 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-19c59d7f-e91a-416b-bbcd-75174b9056e5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:41.162590 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-19c59d7f-e91a-416b-bbcd-75174b9056e5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] HTTP exception thrown: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-19c59d7f-e91a-416b-bbcd-75174b9056e5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Request method failure captured: Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 HTTP/1.1 Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dytLYovzsdU6l99mr3IwrEW6j42KeQCQufWjpy9PXb0I8z7fgHtiCMZYHjVXnMbSEbhy3qB7zQVfivfwTfD2O0ExbcJOYmSDWnmmV6IZbEn-R0uCQ2RLIXz0YiRptikx5VD6l7jCJanCFClZxjKN6bxH2e1VEQopxnCkkkOhBLkxoU Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: fb35771c7e744f859d2c5d29b511d345 Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fb35771c7e744f859d2c5d29b511d345", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: fb35771c7e744f859d2c5d29b511d345 Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AttachVolumeShelveTestJSON-408575781-project Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 5da6102ddcb948fa874856fa1ac7226d Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AttachVolumeShelveTestJSON-408575781-project Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '66aee0fa-4208-477e-beb0-d989c2bf9079'} Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:43:41.164645 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:43:41.170544 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:43:41.170544 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:41.170544 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:43:41.170544 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:43:41.170544 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:43:41.170544 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:43:41.170544 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. Jul 31 01:43:41.170544 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:43:41.172196 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-19c59d7f-e91a-416b-bbcd-75174b9056e5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Returning 404 to user: Instance 66aee0fa-4208-477e-beb0-d989c2bf9079 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:43:41.173127 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-19c59d7f-e91a-416b-bbcd-75174b9056e5 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079" status: 404 len: 111 microversion: 2.20 time: 0.046997 Jul 31 01:43:41.173847 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2835/5641] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:43:41 2022] GET /compute/v2.1/servers/66aee0fa-4208-477e-beb0-d989c2bf9079 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:43:44.452070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c3f117f2-6c7d-45c9-ac63-96de6e40ab7b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:44.452765 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c3f117f2-6c7d-45c9-ac63-96de6e40ab7b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:44.460744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3f117f2-6c7d-45c9-ac63-96de6e40ab7b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:44.461206 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3f117f2-6c7d-45c9-ac63-96de6e40ab7b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:44.461996 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3f117f2-6c7d-45c9-ac63-96de6e40ab7b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:44.462448 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3f117f2-6c7d-45c9-ac63-96de6e40ab7b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:44.480068 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-c3f117f2-6c7d-45c9-ac63-96de6e40ab7b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] HTTP exception thrown: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c3f117f2-6c7d-45c9-ac63-96de6e40ab7b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Request method failure captured: Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd HTTP/1.1 Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dytLYovzsdU6l99mr3IwrEW6j42KeQCQufWjpy9PXb0I8z7fgHtiCMZYHjVXnMbSEbhy3qB7zQVfivfwTfD2O0ExbcJOYmSDWnmmV6IZbEn-R0uCQ2RLIXz0YiRptikx5VD6l7jCJanCFClZxjKN6bxH2e1VEQopxnCkkkOhBLkxoU Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: fb35771c7e744f859d2c5d29b511d345 Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fb35771c7e744f859d2c5d29b511d345", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: fb35771c7e744f859d2c5d29b511d345 Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AttachVolumeShelveTestJSON-408575781-project Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 5da6102ddcb948fa874856fa1ac7226d Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AttachVolumeShelveTestJSON-408575781-project Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '62b00bb6-bfdc-4ddc-bfd7-dc53016544bd'} Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:43:44.481711 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:43:44.490604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. Jul 31 01:43:44.490604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:43:44.490604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:43:44.490604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:43:44.490604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:44.490604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:43:44.490604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:43:44.490604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:43:44.490604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:43:44.490604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. Jul 31 01:43:44.490604 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:43:44.490604 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c3f117f2-6c7d-45c9-ac63-96de6e40ab7b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Returning 404 to user: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:43:44.490604 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c3f117f2-6c7d-45c9-ac63-96de6e40ab7b tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "DELETE /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 404 len: 111 microversion: 2.20 time: 0.036023 Jul 31 01:43:44.490604 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2807/5642] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:43:44 2022] DELETE /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:43:44.492085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e141a32f-a8e9-4336-b0ff-de5ff437b637 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:44.492840 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e141a32f-a8e9-4336-b0ff-de5ff437b637 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] [instance: 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:44.501240 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e141a32f-a8e9-4336-b0ff-de5ff437b637 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:44.501707 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e141a32f-a8e9-4336-b0ff-de5ff437b637 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:44.502491 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e141a32f-a8e9-4336-b0ff-de5ff437b637 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:44.503184 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e141a32f-a8e9-4336-b0ff-de5ff437b637 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:44.519286 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-e141a32f-a8e9-4336-b0ff-de5ff437b637 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] HTTP exception thrown: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e141a32f-a8e9-4336-b0ff-de5ff437b637 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Request method failure captured: Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd HTTP/1.1 Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dytLYovzsdU6l99mr3IwrEW6j42KeQCQufWjpy9PXb0I8z7fgHtiCMZYHjVXnMbSEbhy3qB7zQVfivfwTfD2O0ExbcJOYmSDWnmmV6IZbEn-R0uCQ2RLIXz0YiRptikx5VD6l7jCJanCFClZxjKN6bxH2e1VEQopxnCkkkOhBLkxoU Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: fb35771c7e744f859d2c5d29b511d345 Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fb35771c7e744f859d2c5d29b511d345"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fb35771c7e744f859d2c5d29b511d345", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: fb35771c7e744f859d2c5d29b511d345 Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-408575781 Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AttachVolumeShelveTestJSON-408575781-project Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 5da6102ddcb948fa874856fa1ac7226d Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AttachVolumeShelveTestJSON-408575781-project Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '62b00bb6-bfdc-4ddc-bfd7-dc53016544bd'} Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:43:44.521085 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:43:44.527616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:43:44.527616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:44.527616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:43:44.527616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:43:44.527616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:43:44.527616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:43:44.527616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. Jul 31 01:43:44.527616 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:43:44.527616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e141a32f-a8e9-4336-b0ff-de5ff437b637 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] Returning 404 to user: Instance 62b00bb6-bfdc-4ddc-bfd7-dc53016544bd could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:43:44.527616 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e141a32f-a8e9-4336-b0ff-de5ff437b637 tempest-AttachVolumeShelveTestJSON-408575781 tempest-AttachVolumeShelveTestJSON-408575781-project] 10.222.0.45 "GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd" status: 404 len: 111 microversion: 2.20 time: 0.034736 Jul 31 01:43:44.527616 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2836/5643] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:43:44 2022] GET /compute/v2.1/servers/62b00bb6-bfdc-4ddc-bfd7-dc53016544bd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:43:49.304942 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7fe2e46a-b6f7-4a22-a1f2-cba881ec11e3 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:49.305444 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7fe2e46a-b6f7-4a22-a1f2-cba881ec11e3 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:49.329897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fe2e46a-b6f7-4a22-a1f2-cba881ec11e3 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:49.330372 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fe2e46a-b6f7-4a22-a1f2-cba881ec11e3 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:49.331166 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fe2e46a-b6f7-4a22-a1f2-cba881ec11e3 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:49.331655 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fe2e46a-b6f7-4a22-a1f2-cba881ec11e3 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:49.378182 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7fe2e46a-b6f7-4a22-a1f2-cba881ec11e3 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:43:49.477405 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7fe2e46a-b6f7-4a22-a1f2-cba881ec11e3 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "DELETE /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31" status: 204 len: 0 microversion: 2.1 time: 0.175870 Jul 31 01:43:49.478660 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2808/5644] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:43:49 2022] DELETE /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:43:49.488287 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-78fb52ed-5578-4516-9d15-2d45808d4806 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:49.491304 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-78fb52ed-5578-4516-9d15-2d45808d4806 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:49.510597 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-78fb52ed-5578-4516-9d15-2d45808d4806 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:49.511871 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-78fb52ed-5578-4516-9d15-2d45808d4806 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:49.514083 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-78fb52ed-5578-4516-9d15-2d45808d4806 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:49.517503 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-78fb52ed-5578-4516-9d15-2d45808d4806 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:49.767294 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-78fb52ed-5578-4516-9d15-2d45808d4806 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:49.776336 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-78fb52ed-5578-4516-9d15-2d45808d4806 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31" status: 200 len: 1553 microversion: 2.1 time: 0.292236 Jul 31 01:43:49.776539 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2837/5645] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:49 2022] GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 => generated 1553 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:43:50.799927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6b376868-f26f-4574-acbf-6349d22c684f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:50.800712 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6b376868-f26f-4574-acbf-6349d22c684f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:50.807864 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b376868-f26f-4574-acbf-6349d22c684f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:50.808369 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b376868-f26f-4574-acbf-6349d22c684f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:50.809805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b376868-f26f-4574-acbf-6349d22c684f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:50.810415 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b376868-f26f-4574-acbf-6349d22c684f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:50.956915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6b376868-f26f-4574-acbf-6349d22c684f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:50.970721 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6b376868-f26f-4574-acbf-6349d22c684f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31" status: 200 len: 1553 microversion: 2.1 time: 0.176126 Jul 31 01:43:50.971652 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2809/5646] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:50 2022] GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:43:51.492362 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-b963a0b5-00ea-4547-a0dd-319abeadc740 req-8cb53ad9-d74b-4d2b-ac64-105045e04c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a0b923-9863-4d97-aaea-5d9d0933be31", "name": "network-vif-deleted", "tag": "e2870f53-2450-42ef-9ab3-4990d7f0c053"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:43:51.511422 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b963a0b5-00ea-4547-a0dd-319abeadc740 req-8cb53ad9-d74b-4d2b-ac64-105045e04c3a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:51.511882 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b963a0b5-00ea-4547-a0dd-319abeadc740 req-8cb53ad9-d74b-4d2b-ac64-105045e04c3a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:51.528884 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-b963a0b5-00ea-4547-a0dd-319abeadc740 req-8cb53ad9-d74b-4d2b-ac64-105045e04c3a service nova] Creating event network-vif-deleted:e2870f53-2450-42ef-9ab3-4990d7f0c053 for instance 06a0b923-9863-4d97-aaea-5d9d0933be31 on n-h2-master-1 Jul 31 01:43:51.535683 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-b963a0b5-00ea-4547-a0dd-319abeadc740 req-8cb53ad9-d74b-4d2b-ac64-105045e04c3a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045429 Jul 31 01:43:51.538567 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2838/5647] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:43:52.013700 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-37d305f6-f585-496c-b1c7-0e7c58d1c581 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:52.016976 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-37d305f6-f585-496c-b1c7-0e7c58d1c581 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:52.034769 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37d305f6-f585-496c-b1c7-0e7c58d1c581 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:52.035248 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37d305f6-f585-496c-b1c7-0e7c58d1c581 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:52.036296 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37d305f6-f585-496c-b1c7-0e7c58d1c581 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:52.036758 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37d305f6-f585-496c-b1c7-0e7c58d1c581 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:52.077252 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37d305f6-f585-496c-b1c7-0e7c58d1c581 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:52.077824 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37d305f6-f585-496c-b1c7-0e7c58d1c581 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:52.078370 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-37d305f6-f585-496c-b1c7-0e7c58d1c581 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lazy-loading 'fault' on Instance uuid 06a0b923-9863-4d97-aaea-5d9d0933be31 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:43:52.147960 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-37d305f6-f585-496c-b1c7-0e7c58d1c581 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:52.157388 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-37d305f6-f585-496c-b1c7-0e7c58d1c581 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31" status: 200 len: 1338 microversion: 2.1 time: 0.167038 Jul 31 01:43:52.171371 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2810/5648] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:51 2022] GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 => generated 1338 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:53.181043 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cefbbb9f-65a4-44bd-846a-a6c0b9c55192 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:53.181866 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cefbbb9f-65a4-44bd-846a-a6c0b9c55192 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 06a0b923-9863-4d97-aaea-5d9d0933be31] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:53.192067 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cefbbb9f-65a4-44bd-846a-a6c0b9c55192 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:53.192532 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cefbbb9f-65a4-44bd-846a-a6c0b9c55192 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:53.193333 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cefbbb9f-65a4-44bd-846a-a6c0b9c55192 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:53.193788 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cefbbb9f-65a4-44bd-846a-a6c0b9c55192 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:53.216445 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-cefbbb9f-65a4-44bd-846a-a6c0b9c55192 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] HTTP exception thrown: Instance 06a0b923-9863-4d97-aaea-5d9d0933be31 could not be found. Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cefbbb9f-65a4-44bd-846a-a6c0b9c55192 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Request method failure captured: Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 HTTP/1.1 Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5d3ocBVJFkTpVj9AVpu7qEvKEp3tkJNrsf1--EW-d0ubiUzXTpaD2ruwsgXZtHqRfGFz6bZumUjRwR2ap9EoaxN5fhWiGQ2KBr06S6tsGGUVixw3qGjAUxBBPZ3xxGvgzUQXfrhNYiXVDt1DSaG0XT7xH99p_sZQK6SLvopl5e5HHsg Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: aa6c59dbacb14a339fa940faf1d7e632 Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestNetworkBasicOps-1585756169 Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aa6c59dbacb14a339fa940faf1d7e632"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aa6c59dbacb14a339fa940faf1d7e632"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/aa6c59dbacb14a339fa940faf1d7e632"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_aa6c59dbacb14a339fa940faf1d7e632", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestNetworkBasicOps-1585756169 Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: aa6c59dbacb14a339fa940faf1d7e632 Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestNetworkBasicOps-1585756169 Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestNetworkBasicOps-1585756169-project Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: c632588512b9471b8508c1532f6c9723 Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestNetworkBasicOps-1585756169-project Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 06a0b923-9863-4d97-aaea-5d9d0933be31 could not be found. Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '06a0b923-9863-4d97-aaea-5d9d0933be31'} Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06a0b923-9863-4d97-aaea-5d9d0933be31 could not be found. Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06a0b923-9863-4d97-aaea-5d9d0933be31 could not be found. Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:43:53.218119 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:43:53.223703 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:43:53.223703 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:43:53.223703 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:43:53.223703 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:43:53.223703 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:43:53.223703 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06a0b923-9863-4d97-aaea-5d9d0933be31 could not be found. Jul 31 01:43:53.223703 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:43:53.223703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cefbbb9f-65a4-44bd-846a-a6c0b9c55192 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Returning 404 to user: Instance 06a0b923-9863-4d97-aaea-5d9d0933be31 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:43:53.223703 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cefbbb9f-65a4-44bd-846a-a6c0b9c55192 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31" status: 404 len: 111 microversion: 2.1 time: 0.044117 Jul 31 01:43:53.223703 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2839/5649] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:53 2022] GET /compute/v2.1/servers/06a0b923-9863-4d97-aaea-5d9d0933be31 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:43:53.477137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-29e350f2-6b3b-48f5-b15f-ea7aea989066 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '.version_select at 0x7fede4151280>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:53.505799 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-29e350f2-6b3b-48f5-b15f-ea7aea989066 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1882510353" status: 202 len: 0 microversion: 2.1 time: 0.033428 Jul 31 01:43:53.506713 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2811/5650] 10.222.0.45 () {58 vars in 1257 bytes} [Sun Jul 31 01:43:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1882510353 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:43:55.355671 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a26d1bd0-cbfd-40df-a366-78bd14ce5fc6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:55.356909 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a26d1bd0-cbfd-40df-a366-78bd14ce5fc6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:55.366253 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a26d1bd0-cbfd-40df-a366-78bd14ce5fc6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:55.366847 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a26d1bd0-cbfd-40df-a366-78bd14ce5fc6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:55.367551 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a26d1bd0-cbfd-40df-a366-78bd14ce5fc6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:55.368270 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a26d1bd0-cbfd-40df-a366-78bd14ce5fc6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:55.442628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a26d1bd0-cbfd-40df-a366-78bd14ce5fc6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:43:55.649297 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a26d1bd0-cbfd-40df-a366-78bd14ce5fc6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 204 len: 0 microversion: 2.42 time: 0.644417 Jul 31 01:43:55.651887 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2840/5651] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:43:54 2022] DELETE /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 0 bytes in 654 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:43:55.662022 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-811a2aaa-1bbf-43c7-989b-320b6bc8c611 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:55.663307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-811a2aaa-1bbf-43c7-989b-320b6bc8c611 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:55.680798 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-811a2aaa-1bbf-43c7-989b-320b6bc8c611 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:55.682535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-811a2aaa-1bbf-43c7-989b-320b6bc8c611 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:55.683950 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-811a2aaa-1bbf-43c7-989b-320b6bc8c611 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:55.684586 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-811a2aaa-1bbf-43c7-989b-320b6bc8c611 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:56.318645 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-811a2aaa-1bbf-43c7-989b-320b6bc8c611 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:56.329985 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-811a2aaa-1bbf-43c7-989b-320b6bc8c611 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:56.332413 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-811a2aaa-1bbf-43c7-989b-320b6bc8c611 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:56.334371 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-811a2aaa-1bbf-43c7-989b-320b6bc8c611 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 2956 microversion: 2.42 time: 0.677588 Jul 31 01:43:56.335477 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2812/5652] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:43:55 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 2956 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:43:56.533294 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-28b86950-adf1-40d0-b97c-3d889cced2a9 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:56.533887 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-28b86950-adf1-40d0-b97c-3d889cced2a9 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:56.548885 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28b86950-adf1-40d0-b97c-3d889cced2a9 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:56.549384 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28b86950-adf1-40d0-b97c-3d889cced2a9 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:56.550185 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28b86950-adf1-40d0-b97c-3d889cced2a9 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:56.550627 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28b86950-adf1-40d0-b97c-3d889cced2a9 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:56.559117 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-34e53633-db49-4629-8b27-be2dfee1d9b0 req-d34d0048-ae6a-4b22-aed1-ef2ead15a23c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d6ffd9-5d59-41f3-ba4e-d77e585bac38", "tag": "c0b15f67-bc5e-47ec-b14d-da3f98ed789a"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:43:56.596478 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-34e53633-db49-4629-8b27-be2dfee1d9b0 req-d34d0048-ae6a-4b22-aed1-ef2ead15a23c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:56.598523 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-34e53633-db49-4629-8b27-be2dfee1d9b0 req-d34d0048-ae6a-4b22-aed1-ef2ead15a23c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:56.608228 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-28b86950-adf1-40d0-b97c-3d889cced2a9 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:43:56.636798 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-34e53633-db49-4629-8b27-be2dfee1d9b0 req-d34d0048-ae6a-4b22-aed1-ef2ead15a23c service nova] Creating event network-changed:c0b15f67-bc5e-47ec-b14d-da3f98ed789a for instance 86d6ffd9-5d59-41f3-ba4e-d77e585bac38 on n-h2-master-1 Jul 31 01:43:56.644193 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-34e53633-db49-4629-8b27-be2dfee1d9b0 req-d34d0048-ae6a-4b22-aed1-ef2ead15a23c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095443 Jul 31 01:43:56.645186 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2813/5653] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:43:56.751274 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-28b86950-adf1-40d0-b97c-3d889cced2a9 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "DELETE /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 204 len: 0 microversion: 2.1 time: 0.222013 Jul 31 01:43:56.751998 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2841/5654] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:43:56 2022] DELETE /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:43:56.764485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7fd0dcba-afb8-43fe-832c-81064eae6de8 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:56.765379 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7fd0dcba-afb8-43fe-832c-81064eae6de8 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:56.776196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fd0dcba-afb8-43fe-832c-81064eae6de8 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:56.776708 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fd0dcba-afb8-43fe-832c-81064eae6de8 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:56.778538 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fd0dcba-afb8-43fe-832c-81064eae6de8 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:56.779401 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fd0dcba-afb8-43fe-832c-81064eae6de8 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:57.002176 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7fd0dcba-afb8-43fe-832c-81064eae6de8 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:57.010041 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7fd0dcba-afb8-43fe-832c-81064eae6de8 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 200 len: 1669 microversion: 2.1 time: 0.252714 Jul 31 01:43:57.010624 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2814/5655] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:56 2022] GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 1669 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:57.362763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-00a4a9e9-f303-4720-aab6-f01ae6eb4242 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:57.363729 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-00a4a9e9-f303-4720-aab6-f01ae6eb4242 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:57.373102 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00a4a9e9-f303-4720-aab6-f01ae6eb4242 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:57.373897 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00a4a9e9-f303-4720-aab6-f01ae6eb4242 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:57.375500 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00a4a9e9-f303-4720-aab6-f01ae6eb4242 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:57.376318 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00a4a9e9-f303-4720-aab6-f01ae6eb4242 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:57.612840 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-00a4a9e9-f303-4720-aab6-f01ae6eb4242 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:57.624389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-00a4a9e9-f303-4720-aab6-f01ae6eb4242 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:57.626290 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-00a4a9e9-f303-4720-aab6-f01ae6eb4242 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:57.627618 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-00a4a9e9-f303-4720-aab6-f01ae6eb4242 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 2956 microversion: 2.42 time: 0.269886 Jul 31 01:43:57.628180 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2842/5656] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:43:57 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 2956 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:43:58.033502 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5681f5bb-a44e-417a-ac0b-13b84de78d4e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:58.035953 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5681f5bb-a44e-417a-ac0b-13b84de78d4e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:58.051968 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5681f5bb-a44e-417a-ac0b-13b84de78d4e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:58.053268 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5681f5bb-a44e-417a-ac0b-13b84de78d4e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:58.054140 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5681f5bb-a44e-417a-ac0b-13b84de78d4e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:58.054685 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5681f5bb-a44e-417a-ac0b-13b84de78d4e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:58.206377 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5681f5bb-a44e-417a-ac0b-13b84de78d4e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:58.214700 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5681f5bb-a44e-417a-ac0b-13b84de78d4e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 200 len: 1669 microversion: 2.1 time: 0.185532 Jul 31 01:43:58.216366 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2815/5657] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:58 2022] GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 1669 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:43:58.287898 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a252a903-269d-4aeb-bbd4-86df43a93ad2 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:58.288871 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a252a903-269d-4aeb-bbd4-86df43a93ad2 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:58.295833 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a252a903-269d-4aeb-bbd4-86df43a93ad2 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:58.297094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a252a903-269d-4aeb-bbd4-86df43a93ad2 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:58.297399 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a252a903-269d-4aeb-bbd4-86df43a93ad2 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:58.298017 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a252a903-269d-4aeb-bbd4-86df43a93ad2 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:58.390044 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-a252a903-269d-4aeb-bbd4-86df43a93ad2 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lazy-loading 'services' on Instance uuid 2276ed4a-ccc7-4efc-b754-ae66db0b23ca {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:43:58.483453 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a252a903-269d-4aeb-bbd4-86df43a93ad2 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca/os-volume_attachments/a31445c5-2e39-42bb-9756-ad7cf2f62313" status: 202 len: 0 microversion: 2.1 time: 0.199693 Jul 31 01:43:58.484483 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2843/5658] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 01:43:58 2022] DELETE /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca/os-volume_attachments/a31445c5-2e39-42bb-9756-ad7cf2f62313 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:43:58.654497 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b450ee6a-ed5e-4eb1-8013-af41fe7bb75c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:58.655406 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b450ee6a-ed5e-4eb1-8013-af41fe7bb75c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:58.663917 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b450ee6a-ed5e-4eb1-8013-af41fe7bb75c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:58.664910 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b450ee6a-ed5e-4eb1-8013-af41fe7bb75c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:58.665958 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b450ee6a-ed5e-4eb1-8013-af41fe7bb75c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:58.666712 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b450ee6a-ed5e-4eb1-8013-af41fe7bb75c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:58.929604 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-1f52c553-f0c0-4890-8d58-62fcd7ab9c23 req-7dde5873-8fb5-4f27-b6cb-4c3ec562a8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d6ffd9-5d59-41f3-ba4e-d77e585bac38", "name": "network-vif-deleted", "tag": "c0b15f67-bc5e-47ec-b14d-da3f98ed789a"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:43:58.942499 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1f52c553-f0c0-4890-8d58-62fcd7ab9c23 req-7dde5873-8fb5-4f27-b6cb-4c3ec562a8e0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:58.943223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1f52c553-f0c0-4890-8d58-62fcd7ab9c23 req-7dde5873-8fb5-4f27-b6cb-4c3ec562a8e0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:58.958132 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1f52c553-f0c0-4890-8d58-62fcd7ab9c23 req-7dde5873-8fb5-4f27-b6cb-4c3ec562a8e0 service nova] Creating event network-vif-deleted:c0b15f67-bc5e-47ec-b14d-da3f98ed789a for instance 86d6ffd9-5d59-41f3-ba4e-d77e585bac38 on n-h2-master-1 Jul 31 01:43:58.964231 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-1f52c553-f0c0-4890-8d58-62fcd7ab9c23 req-7dde5873-8fb5-4f27-b6cb-4c3ec562a8e0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040740 Jul 31 01:43:58.964842 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2844/5659] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:43:58.999174 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b450ee6a-ed5e-4eb1-8013-af41fe7bb75c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:59.011284 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b450ee6a-ed5e-4eb1-8013-af41fe7bb75c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:59.013364 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b450ee6a-ed5e-4eb1-8013-af41fe7bb75c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:59.014763 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b450ee6a-ed5e-4eb1-8013-af41fe7bb75c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 2956 microversion: 2.42 time: 0.364525 Jul 31 01:43:59.015597 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2816/5660] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:43:58 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 2956 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:43:59.237256 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d8ef0018-9ab0-43c4-a5f9-063cbf54ac68 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:43:59.238036 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d8ef0018-9ab0-43c4-a5f9-063cbf54ac68 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:43:59.251525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8ef0018-9ab0-43c4-a5f9-063cbf54ac68 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:59.253055 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8ef0018-9ab0-43c4-a5f9-063cbf54ac68 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:59.254919 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8ef0018-9ab0-43c4-a5f9-063cbf54ac68 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:59.255426 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8ef0018-9ab0-43c4-a5f9-063cbf54ac68 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:59.313171 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8ef0018-9ab0-43c4-a5f9-063cbf54ac68 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:43:59.313635 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8ef0018-9ab0-43c4-a5f9-063cbf54ac68 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:43:59.314378 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-d8ef0018-9ab0-43c4-a5f9-063cbf54ac68 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lazy-loading 'fault' on Instance uuid 86d6ffd9-5d59-41f3-ba4e-d77e585bac38 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:43:59.393454 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d8ef0018-9ab0-43c4-a5f9-063cbf54ac68 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:43:59.410537 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d8ef0018-9ab0-43c4-a5f9-063cbf54ac68 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 200 len: 1337 microversion: 2.1 time: 0.177366 Jul 31 01:43:59.411428 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2845/5661] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:43:59 2022] GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 1337 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:44:00.042004 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-131bf5aa-7bc8-4c12-b5b3-02b806914c03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:00.043316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-131bf5aa-7bc8-4c12-b5b3-02b806914c03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:00.050359 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-131bf5aa-7bc8-4c12-b5b3-02b806914c03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:00.051588 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-131bf5aa-7bc8-4c12-b5b3-02b806914c03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:00.052454 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-131bf5aa-7bc8-4c12-b5b3-02b806914c03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:00.053138 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-131bf5aa-7bc8-4c12-b5b3-02b806914c03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:00.307791 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-131bf5aa-7bc8-4c12-b5b3-02b806914c03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:00.325148 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-131bf5aa-7bc8-4c12-b5b3-02b806914c03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:00.327088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-131bf5aa-7bc8-4c12-b5b3-02b806914c03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:00.328788 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-131bf5aa-7bc8-4c12-b5b3-02b806914c03 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 2935 microversion: 2.42 time: 0.290745 Jul 31 01:44:00.329959 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2817/5662] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:00 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 2935 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:00.432259 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cee5062b-7748-4163-80ea-cf518c3a754f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:00.433584 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cee5062b-7748-4163-80ea-cf518c3a754f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 86d6ffd9-5d59-41f3-ba4e-d77e585bac38] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:00.441505 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cee5062b-7748-4163-80ea-cf518c3a754f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:00.442318 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cee5062b-7748-4163-80ea-cf518c3a754f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:00.443379 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cee5062b-7748-4163-80ea-cf518c3a754f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:00.444123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cee5062b-7748-4163-80ea-cf518c3a754f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:00.459473 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-cee5062b-7748-4163-80ea-cf518c3a754f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] HTTP exception thrown: Instance 86d6ffd9-5d59-41f3-ba4e-d77e585bac38 could not be found. Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cee5062b-7748-4163-80ea-cf518c3a754f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Request method failure captured: Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 HTTP/1.1 Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5d3ocBVJFkTpVj9AVpu7qEvKEp3tkJNrsf1--EW-d0ubiUzXTpaD2ruwsgXZtHqRfGFz6bZumUjRwR2ap9EoaxN5fhWiGQ2KBr06S6tsGGUVixw3qGjAUxBBPZ3xxGvgzUQXfrhNYiXVDt1DSaG0XT7xH99p_sZQK6SLvopl5e5HHsg Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: aa6c59dbacb14a339fa940faf1d7e632 Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestNetworkBasicOps-1585756169 Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aa6c59dbacb14a339fa940faf1d7e632"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aa6c59dbacb14a339fa940faf1d7e632"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/aa6c59dbacb14a339fa940faf1d7e632"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_aa6c59dbacb14a339fa940faf1d7e632", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestNetworkBasicOps-1585756169 Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: aa6c59dbacb14a339fa940faf1d7e632 Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestNetworkBasicOps-1585756169 Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestNetworkBasicOps-1585756169-project Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: c632588512b9471b8508c1532f6c9723 Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestNetworkBasicOps-1585756169-project Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 86d6ffd9-5d59-41f3-ba4e-d77e585bac38 could not be found. Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '86d6ffd9-5d59-41f3-ba4e-d77e585bac38'} Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86d6ffd9-5d59-41f3-ba4e-d77e585bac38 could not be found. Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86d6ffd9-5d59-41f3-ba4e-d77e585bac38 could not be found. Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:44:00.461545 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:44:00.466524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:44:00.466524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:44:00.466524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:44:00.466524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:44:00.466524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:44:00.466524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86d6ffd9-5d59-41f3-ba4e-d77e585bac38 could not be found. Jul 31 01:44:00.466524 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:44:00.468415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cee5062b-7748-4163-80ea-cf518c3a754f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Returning 404 to user: Instance 86d6ffd9-5d59-41f3-ba4e-d77e585bac38 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:44:00.469749 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cee5062b-7748-4163-80ea-cf518c3a754f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38" status: 404 len: 111 microversion: 2.1 time: 0.041219 Jul 31 01:44:00.471581 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2846/5663] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:44:00 2022] GET /compute/v2.1/servers/86d6ffd9-5d59-41f3-ba4e-d77e585bac38 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:44:00.717217 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2100f315-dc84-4af1-9a52-638708d5f9c7 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '.version_select at 0x7fede41c5820>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:00.756016 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2100f315-dc84-4af1-9a52-638708d5f9c7 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-678380711" status: 202 len: 0 microversion: 2.1 time: 0.042379 Jul 31 01:44:00.758526 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2818/5664] 10.222.0.45 () {58 vars in 1254 bytes} [Sun Jul 31 01:44:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-678380711 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:44:01.092115 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-ff09bf83-4266-4b62-8641-aea50c63c7f8 req-63418fcc-dbad-4a18-909d-4180a7ff788f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "name": "network-vif-deleted", "tag": "68c780fc-affd-40cd-9df1-e9eb321110a9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:44:01.103737 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ff09bf83-4266-4b62-8641-aea50c63c7f8 req-63418fcc-dbad-4a18-909d-4180a7ff788f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:01.104730 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ff09bf83-4266-4b62-8641-aea50c63c7f8 req-63418fcc-dbad-4a18-909d-4180a7ff788f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:01.109791 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:44:01.122413 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-ff09bf83-4266-4b62-8641-aea50c63c7f8 req-63418fcc-dbad-4a18-909d-4180a7ff788f service nova] Creating event network-vif-deleted:68c780fc-affd-40cd-9df1-e9eb321110a9 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:44:01.130858 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-ff09bf83-4266-4b62-8641-aea50c63c7f8 req-63418fcc-dbad-4a18-909d-4180a7ff788f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042770 Jul 31 01:44:01.132348 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2847/5665] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:44:01.356120 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d369807a-e7b6-453f-84c1-9edad6cccd86 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:01.357494 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d369807a-e7b6-453f-84c1-9edad6cccd86 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:01.374661 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d369807a-e7b6-453f-84c1-9edad6cccd86 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:01.375169 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d369807a-e7b6-453f-84c1-9edad6cccd86 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:01.376035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d369807a-e7b6-453f-84c1-9edad6cccd86 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:01.376501 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d369807a-e7b6-453f-84c1-9edad6cccd86 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:01.763976 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d369807a-e7b6-453f-84c1-9edad6cccd86 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:01.780500 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d369807a-e7b6-453f-84c1-9edad6cccd86 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:01.785992 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d369807a-e7b6-453f-84c1-9edad6cccd86 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:01.790981 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d369807a-e7b6-453f-84c1-9edad6cccd86 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 2754 microversion: 2.42 time: 0.439503 Jul 31 01:44:01.804387 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2819/5666] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:01 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 2754 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:02.818826 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-56f6d133-5ddd-479c-a951-b60ba2814f10 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:02.819888 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-56f6d133-5ddd-479c-a951-b60ba2814f10 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:02.833420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56f6d133-5ddd-479c-a951-b60ba2814f10 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:02.833871 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56f6d133-5ddd-479c-a951-b60ba2814f10 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:02.840767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56f6d133-5ddd-479c-a951-b60ba2814f10 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:02.841248 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56f6d133-5ddd-479c-a951-b60ba2814f10 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:02.925928 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-f4ae1f2c-b30e-4a73-b9d5-21710782a5b6 req-7eeef492-d6d2-4d52-8fa4-d5690e726662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "name": "network-vif-unplugged", "status": "completed", "tag": "7f783da2-6e5d-4ff0-ac0c-23f0c6756d36"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:44:02.963200 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f4ae1f2c-b30e-4a73-b9d5-21710782a5b6 req-7eeef492-d6d2-4d52-8fa4-d5690e726662 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:02.963698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f4ae1f2c-b30e-4a73-b9d5-21710782a5b6 req-7eeef492-d6d2-4d52-8fa4-d5690e726662 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:02.990491 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-f4ae1f2c-b30e-4a73-b9d5-21710782a5b6 req-7eeef492-d6d2-4d52-8fa4-d5690e726662 service nova] Creating event network-vif-unplugged:7f783da2-6e5d-4ff0-ac0c-23f0c6756d36 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:44:03.002973 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-f4ae1f2c-b30e-4a73-b9d5-21710782a5b6 req-7eeef492-d6d2-4d52-8fa4-d5690e726662 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080427 Jul 31 01:44:03.006426 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2820/5667] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:44:03.157104 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-08921a8c-8946-4a90-8e37-b1fd159c318f req-d3fa6289-6073-4fdc-8f17-d7bcad51f2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "name": "network-vif-deleted", "tag": "9d106083-b7ba-40a6-aaba-56416aac7485"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:44:03.177604 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-08921a8c-8946-4a90-8e37-b1fd159c318f req-d3fa6289-6073-4fdc-8f17-d7bcad51f2e5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:03.181196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-08921a8c-8946-4a90-8e37-b1fd159c318f req-d3fa6289-6073-4fdc-8f17-d7bcad51f2e5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:03.221717 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-08921a8c-8946-4a90-8e37-b1fd159c318f req-d3fa6289-6073-4fdc-8f17-d7bcad51f2e5 service nova] Creating event network-vif-deleted:9d106083-b7ba-40a6-aaba-56416aac7485 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:44:03.239053 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-08921a8c-8946-4a90-8e37-b1fd159c318f req-d3fa6289-6073-4fdc-8f17-d7bcad51f2e5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087062 Jul 31 01:44:03.239707 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2821/5668] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:44:03.313514 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-56f6d133-5ddd-479c-a951-b60ba2814f10 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:03.329550 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-56f6d133-5ddd-479c-a951-b60ba2814f10 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:03.333559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-56f6d133-5ddd-479c-a951-b60ba2814f10 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:03.334883 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-56f6d133-5ddd-479c-a951-b60ba2814f10 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 2662 microversion: 2.42 time: 0.520240 Jul 31 01:44:03.358496 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2848/5669] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:02 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 2662 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:04.378514 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e5a68aaf-d25e-441b-bb45-e026e50ba9f0 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:04.381538 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e5a68aaf-d25e-441b-bb45-e026e50ba9f0 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:04.389189 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:44:04.406823 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5a68aaf-d25e-441b-bb45-e026e50ba9f0 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:04.408585 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5a68aaf-d25e-441b-bb45-e026e50ba9f0 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:04.409602 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5a68aaf-d25e-441b-bb45-e026e50ba9f0 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:04.412120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5a68aaf-d25e-441b-bb45-e026e50ba9f0 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:04.415980 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:44:05.052096 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f37e43fd-76e4-4c89-a2fb-e1524e4df68a req-ba148c1b-b6d7-4211-9932-25d0436f64c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "name": "network-vif-unplugged", "status": "completed", "tag": "3af2c975-e18d-4f5c-bf75-5d37fd18e383"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:44:05.071223 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:44:05.078266 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f37e43fd-76e4-4c89-a2fb-e1524e4df68a req-ba148c1b-b6d7-4211-9932-25d0436f64c2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:05.081860 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f37e43fd-76e4-4c89-a2fb-e1524e4df68a req-ba148c1b-b6d7-4211-9932-25d0436f64c2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:05.122411 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f37e43fd-76e4-4c89-a2fb-e1524e4df68a req-ba148c1b-b6d7-4211-9932-25d0436f64c2 service nova] Creating event network-vif-unplugged:3af2c975-e18d-4f5c-bf75-5d37fd18e383 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:44:05.137669 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f37e43fd-76e4-4c89-a2fb-e1524e4df68a req-ba148c1b-b6d7-4211-9932-25d0436f64c2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088472 Jul 31 01:44:05.138555 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2849/5670] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:44:05.272292 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-41365208-7b4b-4baf-8fc0-b8a65c69a1fe req-b7986c2d-8f98-4bb0-b2c9-05c02ab2179d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "name": "network-vif-deleted", "tag": "e1be7003-6e47-45d7-b637-ed3b70b52701"}, {"server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "name": "network-vif-deleted", "tag": "3af2c975-e18d-4f5c-bf75-5d37fd18e383"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:44:05.275045 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e5a68aaf-d25e-441b-bb45-e026e50ba9f0 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:05.304800 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-41365208-7b4b-4baf-8fc0-b8a65c69a1fe req-b7986c2d-8f98-4bb0-b2c9-05c02ab2179d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:05.305491 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-41365208-7b4b-4baf-8fc0-b8a65c69a1fe req-b7986c2d-8f98-4bb0-b2c9-05c02ab2179d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:05.314701 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e5a68aaf-d25e-441b-bb45-e026e50ba9f0 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:05.320686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e5a68aaf-d25e-441b-bb45-e026e50ba9f0 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:05.326981 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-41365208-7b4b-4baf-8fc0-b8a65c69a1fe req-b7986c2d-8f98-4bb0-b2c9-05c02ab2179d service nova] Creating event network-vif-deleted:e1be7003-6e47-45d7-b637-ed3b70b52701 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:44:05.327229 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e5a68aaf-d25e-441b-bb45-e026e50ba9f0 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 2503 microversion: 2.42 time: 0.958556 Jul 31 01:44:05.329002 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-41365208-7b4b-4baf-8fc0-b8a65c69a1fe req-b7986c2d-8f98-4bb0-b2c9-05c02ab2179d service nova] Creating event network-vif-deleted:3af2c975-e18d-4f5c-bf75-5d37fd18e383 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:44:05.334981 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2822/5671] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:04 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 2503 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:05.347390 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-41365208-7b4b-4baf-8fc0-b8a65c69a1fe req-b7986c2d-8f98-4bb0-b2c9-05c02ab2179d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082661 Jul 31 01:44:05.349024 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2850/5672] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:44:06.280396 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c66042de-56b3-4762-8719-6e3542379d60 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:06.281616 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c66042de-56b3-4762-8719-6e3542379d60 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:06.297436 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c66042de-56b3-4762-8719-6e3542379d60 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:06.297935 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c66042de-56b3-4762-8719-6e3542379d60 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:06.298764 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c66042de-56b3-4762-8719-6e3542379d60 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:06.299231 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c66042de-56b3-4762-8719-6e3542379d60 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:06.352278 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c66042de-56b3-4762-8719-6e3542379d60 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:44:06.360054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8cfc7c9c-36bc-48ac-b60c-684bab0cdc9b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:06.361576 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8cfc7c9c-36bc-48ac-b60c-684bab0cdc9b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:06.377939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8cfc7c9c-36bc-48ac-b60c-684bab0cdc9b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:06.379252 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8cfc7c9c-36bc-48ac-b60c-684bab0cdc9b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:06.381636 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8cfc7c9c-36bc-48ac-b60c-684bab0cdc9b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:06.384210 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8cfc7c9c-36bc-48ac-b60c-684bab0cdc9b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:06.518290 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c66042de-56b3-4762-8719-6e3542379d60 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca" status: 204 len: 0 microversion: 2.1 time: 0.242165 Jul 31 01:44:06.519891 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2823/5673] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:44:06 2022] DELETE /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:44:06.526114 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8cfc7c9c-36bc-48ac-b60c-684bab0cdc9b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:06.543210 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c9068c33-2d37-402f-8241-c6d47216e370 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:06.544456 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8cfc7c9c-36bc-48ac-b60c-684bab0cdc9b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:06.546264 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8cfc7c9c-36bc-48ac-b60c-684bab0cdc9b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:06.547097 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c9068c33-2d37-402f-8241-c6d47216e370 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:06.548961 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8cfc7c9c-36bc-48ac-b60c-684bab0cdc9b tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1605 microversion: 2.42 time: 0.194559 Jul 31 01:44:06.555122 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c9068c33-2d37-402f-8241-c6d47216e370 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:06.556075 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c9068c33-2d37-402f-8241-c6d47216e370 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:06.557130 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c9068c33-2d37-402f-8241-c6d47216e370 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:06.557811 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c9068c33-2d37-402f-8241-c6d47216e370 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:06.568309 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2851/5674] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:06 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1605 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:44:06.752477 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c9068c33-2d37-402f-8241-c6d47216e370 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76fa05a2b444947a917c6e84676926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7f90b606e4bd585c1ff55ed36664e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:06.775824 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c9068c33-2d37-402f-8241-c6d47216e370 tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] 10.222.0.45 "GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca" status: 200 len: 1470 microversion: 2.1 time: 0.229510 Jul 31 01:44:06.776744 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2824/5675] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:44:06 2022] GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca => generated 1470 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:44:07.391358 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2bc0b1cd-dff4-406c-9581-f1d134b757d1 req-ec3d19ee-908f-45f9-9f3c-64d74f1b8fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5fbc0a-18dc-455e-b987-909ea4ca413b", "name": "network-vif-deleted", "tag": "7f783da2-6e5d-4ff0-ac0c-23f0c6756d36"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:44:07.406386 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2bc0b1cd-dff4-406c-9581-f1d134b757d1 req-ec3d19ee-908f-45f9-9f3c-64d74f1b8fe3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:07.406867 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2bc0b1cd-dff4-406c-9581-f1d134b757d1 req-ec3d19ee-908f-45f9-9f3c-64d74f1b8fe3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:07.419147 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2bc0b1cd-dff4-406c-9581-f1d134b757d1 req-ec3d19ee-908f-45f9-9f3c-64d74f1b8fe3 service nova] Creating event network-vif-deleted:7f783da2-6e5d-4ff0-ac0c-23f0c6756d36 for instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b on n-h1-master-1 Jul 31 01:44:07.423985 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2bc0b1cd-dff4-406c-9581-f1d134b757d1 req-ec3d19ee-908f-45f9-9f3c-64d74f1b8fe3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036360 Jul 31 01:44:07.425303 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2852/5676] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:44:07.576292 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b4b4e58e-8e4e-4d3b-b3b5-7ca18e2e4ed5 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:07.577076 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b4b4e58e-8e4e-4d3b-b3b5-7ca18e2e4ed5 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:07.586527 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4b4e58e-8e4e-4d3b-b3b5-7ca18e2e4ed5 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:07.591947 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4b4e58e-8e4e-4d3b-b3b5-7ca18e2e4ed5 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:07.594601 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4b4e58e-8e4e-4d3b-b3b5-7ca18e2e4ed5 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:07.595498 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4b4e58e-8e4e-4d3b-b3b5-7ca18e2e4ed5 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:07.679732 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b4b4e58e-8e4e-4d3b-b3b5-7ca18e2e4ed5 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:07.695926 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b4b4e58e-8e4e-4d3b-b3b5-7ca18e2e4ed5 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:07.697747 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b4b4e58e-8e4e-4d3b-b3b5-7ca18e2e4ed5 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:07.699182 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b4b4e58e-8e4e-4d3b-b3b5-7ca18e2e4ed5 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1605 microversion: 2.42 time: 0.130055 Jul 31 01:44:07.712407 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2825/5677] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:07 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1605 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:07.802898 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dac2934a-bcf6-4e1e-b6fa-9bdc7498f21c tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:07.803955 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dac2934a-bcf6-4e1e-b6fa-9bdc7498f21c tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:07.822456 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dac2934a-bcf6-4e1e-b6fa-9bdc7498f21c tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:07.823397 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dac2934a-bcf6-4e1e-b6fa-9bdc7498f21c tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:07.826773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dac2934a-bcf6-4e1e-b6fa-9bdc7498f21c tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:07.827266 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dac2934a-bcf6-4e1e-b6fa-9bdc7498f21c tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:08.052445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dac2934a-bcf6-4e1e-b6fa-9bdc7498f21c tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76fa05a2b444947a917c6e84676926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7f90b606e4bd585c1ff55ed36664e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:08.060457 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dac2934a-bcf6-4e1e-b6fa-9bdc7498f21c tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] 10.222.0.45 "GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca" status: 200 len: 1470 microversion: 2.1 time: 0.267062 Jul 31 01:44:08.075735 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2853/5678] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:44:07 2022] GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca => generated 1470 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:44:08.725962 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4a097d21-d437-41ed-9479-5c87a66cc719 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:08.727487 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4a097d21-d437-41ed-9479-5c87a66cc719 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:08.738516 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a097d21-d437-41ed-9479-5c87a66cc719 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:08.751122 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a097d21-d437-41ed-9479-5c87a66cc719 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:08.757803 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a097d21-d437-41ed-9479-5c87a66cc719 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:08.758275 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a097d21-d437-41ed-9479-5c87a66cc719 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:08.909643 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4a097d21-d437-41ed-9479-5c87a66cc719 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:08.924261 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4a097d21-d437-41ed-9479-5c87a66cc719 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:08.925771 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4a097d21-d437-41ed-9479-5c87a66cc719 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:08.928684 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4a097d21-d437-41ed-9479-5c87a66cc719 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1605 microversion: 2.42 time: 0.207183 Jul 31 01:44:08.929329 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2826/5679] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:08 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1605 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:09.089802 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-10905036-bc4c-46ee-aa22-53d14be5fd4d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:09.093689 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-10905036-bc4c-46ee-aa22-53d14be5fd4d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:09.102095 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10905036-bc4c-46ee-aa22-53d14be5fd4d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:09.102929 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10905036-bc4c-46ee-aa22-53d14be5fd4d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:09.105472 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10905036-bc4c-46ee-aa22-53d14be5fd4d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:09.106803 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10905036-bc4c-46ee-aa22-53d14be5fd4d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:09.164818 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10905036-bc4c-46ee-aa22-53d14be5fd4d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:09.165281 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10905036-bc4c-46ee-aa22-53d14be5fd4d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:09.165756 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-10905036-bc4c-46ee-aa22-53d14be5fd4d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lazy-loading 'fault' on Instance uuid 2276ed4a-ccc7-4efc-b754-ae66db0b23ca {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:44:09.244348 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-10905036-bc4c-46ee-aa22-53d14be5fd4d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76fa05a2b444947a917c6e84676926c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce7f90b606e4bd585c1ff55ed36664e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:09.255257 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-10905036-bc4c-46ee-aa22-53d14be5fd4d tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] 10.222.0.45 "GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca" status: 200 len: 1304 microversion: 2.1 time: 0.170353 Jul 31 01:44:09.268309 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2854/5680] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:44:09 2022] GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca => generated 1304 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:44:09.442685 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1fd34941-2af3-413d-a2b3-a6069f214d95 req-c2ab1e5d-5318-4058-954e-8c4c343fe9bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2276ed4a-ccc7-4efc-b754-ae66db0b23ca", "name": "network-vif-deleted", "tag": "ef8618bd-5984-4766-beff-ff470613c27d"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:44:09.459378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1fd34941-2af3-413d-a2b3-a6069f214d95 req-c2ab1e5d-5318-4058-954e-8c4c343fe9bf service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:09.459849 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1fd34941-2af3-413d-a2b3-a6069f214d95 req-c2ab1e5d-5318-4058-954e-8c4c343fe9bf service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:09.483726 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1fd34941-2af3-413d-a2b3-a6069f214d95 req-c2ab1e5d-5318-4058-954e-8c4c343fe9bf service nova] Creating event network-vif-deleted:ef8618bd-5984-4766-beff-ff470613c27d for instance 2276ed4a-ccc7-4efc-b754-ae66db0b23ca on n-h1-master-1 Jul 31 01:44:09.493537 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1fd34941-2af3-413d-a2b3-a6069f214d95 req-c2ab1e5d-5318-4058-954e-8c4c343fe9bf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054146 Jul 31 01:44:09.494153 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2827/5681] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:44:09.954704 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8c3d8f60-492a-45d2-9ea9-b872e9037cc8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:09.955448 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8c3d8f60-492a-45d2-9ea9-b872e9037cc8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:09.971264 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c3d8f60-492a-45d2-9ea9-b872e9037cc8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:09.971857 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c3d8f60-492a-45d2-9ea9-b872e9037cc8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:09.972725 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c3d8f60-492a-45d2-9ea9-b872e9037cc8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:09.973370 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c3d8f60-492a-45d2-9ea9-b872e9037cc8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:10.119823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8c3d8f60-492a-45d2-9ea9-b872e9037cc8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:10.138926 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8c3d8f60-492a-45d2-9ea9-b872e9037cc8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:10.148283 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8c3d8f60-492a-45d2-9ea9-b872e9037cc8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:10.154663 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8c3d8f60-492a-45d2-9ea9-b872e9037cc8 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1605 microversion: 2.42 time: 0.203457 Jul 31 01:44:10.156098 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2855/5682] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:09 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1605 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:10.280704 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9a62bda2-1cd7-46a8-9f65-4726b331c33f tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:10.280704 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9a62bda2-1cd7-46a8-9f65-4726b331c33f tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] [instance: 2276ed4a-ccc7-4efc-b754-ae66db0b23ca] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:10.312141 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a62bda2-1cd7-46a8-9f65-4726b331c33f tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:10.312615 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a62bda2-1cd7-46a8-9f65-4726b331c33f tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:10.313415 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a62bda2-1cd7-46a8-9f65-4726b331c33f tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:10.313875 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a62bda2-1cd7-46a8-9f65-4726b331c33f tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:10.342348 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-9a62bda2-1cd7-46a8-9f65-4726b331c33f tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] HTTP exception thrown: Instance 2276ed4a-ccc7-4efc-b754-ae66db0b23ca could not be found. Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9a62bda2-1cd7-46a8-9f65-4726b331c33f tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Request method failure captured: Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca HTTP/1.1 Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5d4JDQ3HlpuDq7zTFeaobIzYvDZc1QlZoCph9JHd7AoO14UFaHUF5vdZcBuv-9GTxlQf8xDudoD7Ysf__J7G-gAEDATkUYawKcBd5XjeQkKMOlaYPjB32V6wCk8Aev0LvNxLAm3Uh19JD7xc6fT-yroMHy4esp2859-Cx2c-r6GqoMk Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: cce7f90b606e4bd585c1ff55ed36664e Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-VolumesBackupsTest-1204423964 Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cce7f90b606e4bd585c1ff55ed36664e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/cce7f90b606e4bd585c1ff55ed36664e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/cce7f90b606e4bd585c1ff55ed36664e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_cce7f90b606e4bd585c1ff55ed36664e", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-VolumesBackupsTest-1204423964 Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: cce7f90b606e4bd585c1ff55ed36664e Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-VolumesBackupsTest-1204423964 Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-VolumesBackupsTest-1204423964-project Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: b76fa05a2b444947a917c6e84676926c Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-VolumesBackupsTest-1204423964-project Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 2276ed4a-ccc7-4efc-b754-ae66db0b23ca could not be found. Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '2276ed4a-ccc7-4efc-b754-ae66db0b23ca'} Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2276ed4a-ccc7-4efc-b754-ae66db0b23ca could not be found. Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2276ed4a-ccc7-4efc-b754-ae66db0b23ca could not be found. Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:44:10.348634 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:44:10.357552 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:44:10.357552 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:44:10.357552 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:44:10.357552 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:44:10.357552 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:44:10.357552 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2276ed4a-ccc7-4efc-b754-ae66db0b23ca could not be found. Jul 31 01:44:10.357552 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:44:10.357552 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9a62bda2-1cd7-46a8-9f65-4726b331c33f tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] Returning 404 to user: Instance 2276ed4a-ccc7-4efc-b754-ae66db0b23ca could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:44:10.357552 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9a62bda2-1cd7-46a8-9f65-4726b331c33f tempest-VolumesBackupsTest-1204423964 tempest-VolumesBackupsTest-1204423964-project] 10.222.0.45 "GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca" status: 404 len: 111 microversion: 2.1 time: 0.075889 Jul 31 01:44:10.357552 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2828/5683] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:44:10 2022] GET /compute/v2.1/servers/2276ed4a-ccc7-4efc-b754-ae66db0b23ca => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:44:11.183327 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8e91272a-b543-4f7e-a428-bc9891a5181d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:11.185408 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8e91272a-b543-4f7e-a428-bc9891a5181d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:11.194910 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e91272a-b543-4f7e-a428-bc9891a5181d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:11.195560 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e91272a-b543-4f7e-a428-bc9891a5181d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:11.196878 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e91272a-b543-4f7e-a428-bc9891a5181d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:11.198848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e91272a-b543-4f7e-a428-bc9891a5181d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:11.295073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8e91272a-b543-4f7e-a428-bc9891a5181d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:11.312634 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8e91272a-b543-4f7e-a428-bc9891a5181d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:11.315458 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8e91272a-b543-4f7e-a428-bc9891a5181d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:11.316740 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8e91272a-b543-4f7e-a428-bc9891a5181d tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1605 microversion: 2.42 time: 0.138454 Jul 31 01:44:11.328382 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2856/5684] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:11 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1605 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:12.352606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0bc2340f-2026-40ed-9a70-62e09f31d730 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:12.353249 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0bc2340f-2026-40ed-9a70-62e09f31d730 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:12.382300 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0bc2340f-2026-40ed-9a70-62e09f31d730 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:12.397930 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0bc2340f-2026-40ed-9a70-62e09f31d730 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:12.401011 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0bc2340f-2026-40ed-9a70-62e09f31d730 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:12.404924 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0bc2340f-2026-40ed-9a70-62e09f31d730 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:12.540852 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0bc2340f-2026-40ed-9a70-62e09f31d730 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:12.553302 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0bc2340f-2026-40ed-9a70-62e09f31d730 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:12.556444 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0bc2340f-2026-40ed-9a70-62e09f31d730 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:12.557700 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0bc2340f-2026-40ed-9a70-62e09f31d730 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1605 microversion: 2.42 time: 0.209374 Jul 31 01:44:12.558270 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2829/5685] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:12 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1605 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:13.586041 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d53e6769-3968-4304-a754-ddaa969e86a7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:13.588779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d53e6769-3968-4304-a754-ddaa969e86a7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:13.616692 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d53e6769-3968-4304-a754-ddaa969e86a7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:13.617579 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d53e6769-3968-4304-a754-ddaa969e86a7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:13.620032 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d53e6769-3968-4304-a754-ddaa969e86a7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:13.620774 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d53e6769-3968-4304-a754-ddaa969e86a7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:14.116545 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d53e6769-3968-4304-a754-ddaa969e86a7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:14.130578 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d53e6769-3968-4304-a754-ddaa969e86a7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:14.137743 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d53e6769-3968-4304-a754-ddaa969e86a7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:14.139013 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d53e6769-3968-4304-a754-ddaa969e86a7 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1605 microversion: 2.42 time: 0.557093 Jul 31 01:44:14.139862 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2857/5686] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:13 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1605 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:14.547485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-431b298b-e556-4300-993c-cdc777f88ccd tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Action: 'create', calling method: .version_select at 0x7fede41bf310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-383813925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRQRf+U6X38PEtBMDcoby+m5O3kV7l090GjI3zkgngJwPt857My838mslrTjMFiA7Mk6IE6AA/CmrMB6/N+cWit3sgBbWp8KU2oNTUtBYFAoFv/9L2K1Vouy9yOcj/qTA=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:44:14.571755 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-431b298b-e556-4300-993c-cdc777f88ccd tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Getting quotas for project aa6c59dbacb14a339fa940faf1d7e632. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:44:14.579602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-431b298b-e556-4300-993c-cdc777f88ccd tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Getting quotas for user c632588512b9471b8508c1532f6c9723 and project aa6c59dbacb14a339fa940faf1d7e632. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:44:14.611314 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-431b298b-e556-4300-993c-cdc777f88ccd tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.068378 Jul 31 01:44:14.612713 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2830/5687] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:44:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:44:15.164538 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0a0b5216-3ec8-43d3-ae65-b482e0e5be87 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:15.165552 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0a0b5216-3ec8-43d3-ae65-b482e0e5be87 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:15.193733 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a0b5216-3ec8-43d3-ae65-b482e0e5be87 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:15.194605 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a0b5216-3ec8-43d3-ae65-b482e0e5be87 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:15.195562 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a0b5216-3ec8-43d3-ae65-b482e0e5be87 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:15.196199 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a0b5216-3ec8-43d3-ae65-b482e0e5be87 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:15.369571 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0a0b5216-3ec8-43d3-ae65-b482e0e5be87 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:15.385367 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0a0b5216-3ec8-43d3-ae65-b482e0e5be87 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:15.387972 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0a0b5216-3ec8-43d3-ae65-b482e0e5be87 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:15.389857 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0a0b5216-3ec8-43d3-ae65-b482e0e5be87 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1605 microversion: 2.42 time: 0.231705 Jul 31 01:44:15.404677 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2858/5688] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:15 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1605 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:16.417114 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e62073ab-d2bf-4504-87cb-62a8c292b321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:16.419503 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e62073ab-d2bf-4504-87cb-62a8c292b321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:16.442184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e62073ab-d2bf-4504-87cb-62a8c292b321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:16.444324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e62073ab-d2bf-4504-87cb-62a8c292b321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:16.445343 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e62073ab-d2bf-4504-87cb-62a8c292b321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:16.445835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e62073ab-d2bf-4504-87cb-62a8c292b321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:16.628549 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e62073ab-d2bf-4504-87cb-62a8c292b321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:16.638965 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e62073ab-d2bf-4504-87cb-62a8c292b321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:16.640511 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e62073ab-d2bf-4504-87cb-62a8c292b321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:16.641741 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e62073ab-d2bf-4504-87cb-62a8c292b321 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1605 microversion: 2.42 time: 0.231249 Jul 31 01:44:16.642288 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2831/5689] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:16 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:17.129808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a9c00c56-03ba-427c-b441-705b9af38a6f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1720743138", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "885fef8d-fa91-4bcf-a1c3-7c2e2fef30e9"}], "key_name": "tempest-TestNetworkBasicOps-383813925", "security_groups": [{"name": "tempest-secgroup-smoke-338013190"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:44:17.358745 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-a9c00c56-03ba-427c-b441-705b9af38a6f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] validate_networks() for [('885fef8d-fa91-4bcf-a1c3-7c2e2fef30e9', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:44:17.666482 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f8698c0e-2092-460b-9f65-faf68534efce tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:17.667769 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f8698c0e-2092-460b-9f65-faf68534efce tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:17.696139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8698c0e-2092-460b-9f65-faf68534efce tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:17.696861 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8698c0e-2092-460b-9f65-faf68534efce tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:17.697871 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8698c0e-2092-460b-9f65-faf68534efce tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:17.700309 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8698c0e-2092-460b-9f65-faf68534efce tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:17.936742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f8698c0e-2092-460b-9f65-faf68534efce tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:17.950315 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f8698c0e-2092-460b-9f65-faf68534efce tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:17.953033 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f8698c0e-2092-460b-9f65-faf68534efce tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:17.965001 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f8698c0e-2092-460b-9f65-faf68534efce tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1605 microversion: 2.42 time: 0.302871 Jul 31 01:44:17.965659 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2832/5690] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:17 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1605 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 01:44:18.269774 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-a9c00c56-03ba-427c-b441-705b9af38a6f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:44:18.270393 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-a9c00c56-03ba-427c-b441-705b9af38a6f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:44:18.270683 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-a9c00c56-03ba-427c-b441-705b9af38a6f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:44:18.271330 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-a9c00c56-03ba-427c-b441-705b9af38a6f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:44:18.271952 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-a9c00c56-03ba-427c-b441-705b9af38a6f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:44:18.290452 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9c00c56-03ba-427c-b441-705b9af38a6f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:18.290919 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9c00c56-03ba-427c-b441-705b9af38a6f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:18.291781 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9c00c56-03ba-427c-b441-705b9af38a6f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:18.292339 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9c00c56-03ba-427c-b441-705b9af38a6f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:18.312315 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-a9c00c56-03ba-427c-b441-705b9af38a6f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Getting quotas for project aa6c59dbacb14a339fa940faf1d7e632. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:44:18.318912 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-a9c00c56-03ba-427c-b441-705b9af38a6f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Getting quotas for user c632588512b9471b8508c1532f6c9723 and project aa6c59dbacb14a339fa940faf1d7e632. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:44:18.334753 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a9c00c56-03ba-427c-b441-705b9af38a6f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:44:18.337238 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a9c00c56-03ba-427c-b441-705b9af38a6f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:44:18.409297 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a9c00c56-03ba-427c-b441-705b9af38a6f tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.295688 Jul 31 01:44:18.410387 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2859/5691] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:44:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:44:18.422611 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5bd9f71e-7652-4d92-89db-1a01754d808d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:18.423327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5bd9f71e-7652-4d92-89db-1a01754d808d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:18.550215 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5bd9f71e-7652-4d92-89db-1a01754d808d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:18.574076 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5bd9f71e-7652-4d92-89db-1a01754d808d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8" status: 200 len: 1248 microversion: 2.1 time: 0.156867 Jul 31 01:44:18.580465 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2833/5692] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:44:18 2022] GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 => generated 1248 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:44:18.998871 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-65702d23-157a-4442-83a6-3dde7b282669 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:19.000184 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-65702d23-157a-4442-83a6-3dde7b282669 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:19.009293 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65702d23-157a-4442-83a6-3dde7b282669 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:19.010112 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65702d23-157a-4442-83a6-3dde7b282669 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:19.014652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65702d23-157a-4442-83a6-3dde7b282669 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:19.016125 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-65702d23-157a-4442-83a6-3dde7b282669 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:19.100326 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-65702d23-157a-4442-83a6-3dde7b282669 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:19.113981 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-65702d23-157a-4442-83a6-3dde7b282669 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:19.115687 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-65702d23-157a-4442-83a6-3dde7b282669 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:19.117498 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-65702d23-157a-4442-83a6-3dde7b282669 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1605 microversion: 2.42 time: 0.124797 Jul 31 01:44:19.118616 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2860/5693] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:18 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1605 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:19.600350 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6b55ed02-6180-496c-b7be-878d48768e11 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:19.603036 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6b55ed02-6180-496c-b7be-878d48768e11 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:19.612089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b55ed02-6180-496c-b7be-878d48768e11 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:19.612967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b55ed02-6180-496c-b7be-878d48768e11 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:19.613767 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b55ed02-6180-496c-b7be-878d48768e11 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:19.614219 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b55ed02-6180-496c-b7be-878d48768e11 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:19.724725 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6b55ed02-6180-496c-b7be-878d48768e11 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:19.733220 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6b55ed02-6180-496c-b7be-878d48768e11 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8" status: 200 len: 1300 microversion: 2.1 time: 0.136380 Jul 31 01:44:19.734268 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2834/5694] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:44:19 2022] GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 => generated 1300 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:44:20.147143 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3c55b8a1-5f9e-4a83-b053-2ebf06b510d9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:20.148044 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3c55b8a1-5f9e-4a83-b053-2ebf06b510d9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:20.163991 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c55b8a1-5f9e-4a83-b053-2ebf06b510d9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:20.172705 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c55b8a1-5f9e-4a83-b053-2ebf06b510d9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:20.177200 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c55b8a1-5f9e-4a83-b053-2ebf06b510d9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:20.178916 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c55b8a1-5f9e-4a83-b053-2ebf06b510d9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:20.337153 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3c55b8a1-5f9e-4a83-b053-2ebf06b510d9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:20.347263 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3c55b8a1-5f9e-4a83-b053-2ebf06b510d9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:20.349077 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3c55b8a1-5f9e-4a83-b053-2ebf06b510d9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:20.350267 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3c55b8a1-5f9e-4a83-b053-2ebf06b510d9 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1605 microversion: 2.42 time: 0.208106 Jul 31 01:44:20.350846 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2861/5695] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:20 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1605 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:20.757974 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6430c0ea-071c-4cf4-b59e-e364ad83b151 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:20.758529 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6430c0ea-071c-4cf4-b59e-e364ad83b151 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:20.775174 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6430c0ea-071c-4cf4-b59e-e364ad83b151 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:20.775680 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6430c0ea-071c-4cf4-b59e-e364ad83b151 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:20.776490 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6430c0ea-071c-4cf4-b59e-e364ad83b151 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:20.776946 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6430c0ea-071c-4cf4-b59e-e364ad83b151 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:20.889825 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6430c0ea-071c-4cf4-b59e-e364ad83b151 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:20.907227 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6430c0ea-071c-4cf4-b59e-e364ad83b151 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8" status: 200 len: 1306 microversion: 2.1 time: 0.153035 Jul 31 01:44:20.908900 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2835/5696] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:44:20 2022] GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 => generated 1306 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:44:21.382228 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ece80d7c-449b-45d7-9531-63d3b05df6c6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:21.383536 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ece80d7c-449b-45d7-9531-63d3b05df6c6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:21.402300 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ece80d7c-449b-45d7-9531-63d3b05df6c6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:21.403324 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ece80d7c-449b-45d7-9531-63d3b05df6c6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:21.404147 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ece80d7c-449b-45d7-9531-63d3b05df6c6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:21.404603 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ece80d7c-449b-45d7-9531-63d3b05df6c6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:21.505216 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ece80d7c-449b-45d7-9531-63d3b05df6c6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:21.522608 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ece80d7c-449b-45d7-9531-63d3b05df6c6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:21.537503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ece80d7c-449b-45d7-9531-63d3b05df6c6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:21.540471 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ece80d7c-449b-45d7-9531-63d3b05df6c6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1605 microversion: 2.42 time: 0.167841 Jul 31 01:44:21.542380 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2862/5697] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:21 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1605 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:21.929759 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ef610878-9162-42aa-85ea-89b1ce338733 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:21.930528 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ef610878-9162-42aa-85ea-89b1ce338733 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:21.942182 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef610878-9162-42aa-85ea-89b1ce338733 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:21.942659 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef610878-9162-42aa-85ea-89b1ce338733 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:21.943494 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef610878-9162-42aa-85ea-89b1ce338733 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:21.943954 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef610878-9162-42aa-85ea-89b1ce338733 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:22.109476 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-537d15d8-3de3-4e17-b4b4-842e425b1876 req-486a44b6-7dbf-48df-a6e6-88b8b0d498a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c39445-6aa1-4dc8-abd0-1003318612d8", "tag": "f07d78bc-dd7a-4048-858c-98d9b32460c9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:44:22.147199 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-537d15d8-3de3-4e17-b4b4-842e425b1876 req-486a44b6-7dbf-48df-a6e6-88b8b0d498a7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:22.148243 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-537d15d8-3de3-4e17-b4b4-842e425b1876 req-486a44b6-7dbf-48df-a6e6-88b8b0d498a7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:22.170721 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ef610878-9162-42aa-85ea-89b1ce338733 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:22.179096 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-537d15d8-3de3-4e17-b4b4-842e425b1876 req-486a44b6-7dbf-48df-a6e6-88b8b0d498a7 service nova] Creating event network-changed:f07d78bc-dd7a-4048-858c-98d9b32460c9 for instance 56c39445-6aa1-4dc8-abd0-1003318612d8 on n-h2-master-1 Jul 31 01:44:22.181463 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ef610878-9162-42aa-85ea-89b1ce338733 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8" status: 200 len: 1373 microversion: 2.1 time: 0.255862 Jul 31 01:44:22.186911 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2836/5698] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:44:21 2022] GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 => generated 1373 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:44:22.194200 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-537d15d8-3de3-4e17-b4b4-842e425b1876 req-486a44b6-7dbf-48df-a6e6-88b8b0d498a7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091928 Jul 31 01:44:22.195478 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2863/5699] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:44:22.573187 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d41ddbad-24ea-4bd2-92ab-a4bd7e1a5ab6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:22.573941 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d41ddbad-24ea-4bd2-92ab-a4bd7e1a5ab6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:22.582314 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d41ddbad-24ea-4bd2-92ab-a4bd7e1a5ab6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:22.584635 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d41ddbad-24ea-4bd2-92ab-a4bd7e1a5ab6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:22.586262 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d41ddbad-24ea-4bd2-92ab-a4bd7e1a5ab6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:22.590588 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d41ddbad-24ea-4bd2-92ab-a4bd7e1a5ab6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:22.698043 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d41ddbad-24ea-4bd2-92ab-a4bd7e1a5ab6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:22.712177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d41ddbad-24ea-4bd2-92ab-a4bd7e1a5ab6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:22.714003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d41ddbad-24ea-4bd2-92ab-a4bd7e1a5ab6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:22.716012 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d41ddbad-24ea-4bd2-92ab-a4bd7e1a5ab6 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1605 microversion: 2.42 time: 0.147872 Jul 31 01:44:22.717538 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2837/5700] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:22 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1605 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:23.207327 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bfa53f6d-eb81-4e95-b7fa-a16fe2280e2d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:23.208177 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bfa53f6d-eb81-4e95-b7fa-a16fe2280e2d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:23.217166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bfa53f6d-eb81-4e95-b7fa-a16fe2280e2d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:23.217851 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bfa53f6d-eb81-4e95-b7fa-a16fe2280e2d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:23.218772 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bfa53f6d-eb81-4e95-b7fa-a16fe2280e2d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:23.219324 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bfa53f6d-eb81-4e95-b7fa-a16fe2280e2d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:23.457460 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bfa53f6d-eb81-4e95-b7fa-a16fe2280e2d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:23.468936 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bfa53f6d-eb81-4e95-b7fa-a16fe2280e2d tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8" status: 200 len: 1373 microversion: 2.1 time: 0.266146 Jul 31 01:44:23.469725 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2864/5701] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:44:23 2022] GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 => generated 1373 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:44:23.742001 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7261c5a8-294a-424a-9c95-281b9898eb99 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:23.743956 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7261c5a8-294a-424a-9c95-281b9898eb99 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:23.752710 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7261c5a8-294a-424a-9c95-281b9898eb99 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:23.753614 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7261c5a8-294a-424a-9c95-281b9898eb99 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:23.755661 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7261c5a8-294a-424a-9c95-281b9898eb99 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:23.756624 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7261c5a8-294a-424a-9c95-281b9898eb99 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:23.890032 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7261c5a8-294a-424a-9c95-281b9898eb99 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:23.900656 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7261c5a8-294a-424a-9c95-281b9898eb99 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:23.902833 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7261c5a8-294a-424a-9c95-281b9898eb99 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:23.905235 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7261c5a8-294a-424a-9c95-281b9898eb99 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1605 microversion: 2.42 time: 0.167517 Jul 31 01:44:23.905893 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2838/5702] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:23 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1605 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:24.492378 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ada9258a-27f4-46ce-9a4e-1a0beab3e37e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:24.494948 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ada9258a-27f4-46ce-9a4e-1a0beab3e37e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:24.507503 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ada9258a-27f4-46ce-9a4e-1a0beab3e37e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:24.508271 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ada9258a-27f4-46ce-9a4e-1a0beab3e37e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:24.509364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ada9258a-27f4-46ce-9a4e-1a0beab3e37e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:24.509976 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ada9258a-27f4-46ce-9a4e-1a0beab3e37e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:24.793268 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ada9258a-27f4-46ce-9a4e-1a0beab3e37e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:24.802012 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ada9258a-27f4-46ce-9a4e-1a0beab3e37e tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8" status: 200 len: 1373 microversion: 2.1 time: 0.315567 Jul 31 01:44:24.802943 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2865/5703] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:44:24 2022] GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 => generated 1373 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:44:24.933472 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0af99f92-f122-4a6a-8439-f3c4a300dabd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:24.934147 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0af99f92-f122-4a6a-8439-f3c4a300dabd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:24.949580 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0af99f92-f122-4a6a-8439-f3c4a300dabd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:24.950218 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0af99f92-f122-4a6a-8439-f3c4a300dabd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:24.950982 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0af99f92-f122-4a6a-8439-f3c4a300dabd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:24.951502 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0af99f92-f122-4a6a-8439-f3c4a300dabd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:24.997557 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0af99f92-f122-4a6a-8439-f3c4a300dabd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:24.998118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0af99f92-f122-4a6a-8439-f3c4a300dabd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:24.998815 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-0af99f92-f122-4a6a-8439-f3c4a300dabd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lazy-loading 'fault' on Instance uuid 1b5fbc0a-18dc-455e-b987-909ea4ca413b {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:44:25.042561 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0af99f92-f122-4a6a-8439-f3c4a300dabd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:25.053005 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0af99f92-f122-4a6a-8439-f3c4a300dabd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:25.055170 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0af99f92-f122-4a6a-8439-f3c4a300dabd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d6f69a3f9f4a3eb556593e124232d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08c4f1ed40d49f9844841b0ee4c2817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:25.057181 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0af99f92-f122-4a6a-8439-f3c4a300dabd tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 200 len: 1610 microversion: 2.42 time: 0.128567 Jul 31 01:44:25.058024 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2839/5704] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:24 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 1610 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 01:44:25.824723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dd1626a6-38a5-4e11-ae47-10f93095b016 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:25.826110 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dd1626a6-38a5-4e11-ae47-10f93095b016 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:25.833995 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd1626a6-38a5-4e11-ae47-10f93095b016 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:25.834890 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd1626a6-38a5-4e11-ae47-10f93095b016 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:25.835785 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd1626a6-38a5-4e11-ae47-10f93095b016 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:25.836662 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dd1626a6-38a5-4e11-ae47-10f93095b016 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:25.989938 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dd1626a6-38a5-4e11-ae47-10f93095b016 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:26.000488 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dd1626a6-38a5-4e11-ae47-10f93095b016 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8" status: 200 len: 1373 microversion: 2.1 time: 0.180739 Jul 31 01:44:26.001595 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2866/5705] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:44:25 2022] GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:44:26.085518 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-82100000-5782-4075-88a3-3dea892c589c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:26.086565 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-82100000-5782-4075-88a3-3dea892c589c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:26.096284 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-82100000-5782-4075-88a3-3dea892c589c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:26.096816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-82100000-5782-4075-88a3-3dea892c589c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:26.097774 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-82100000-5782-4075-88a3-3dea892c589c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:26.098225 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-82100000-5782-4075-88a3-3dea892c589c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:26.114297 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:44:26.116015 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-82100000-5782-4075-88a3-3dea892c589c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] HTTP exception thrown: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-82100000-5782-4075-88a3-3dea892c589c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Request method failure captured: Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b HTTP/1.1 Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dzYJ0WXko_gUOAvxPsxLFwvVXqcY-i31zE3bfAK4mUYbwxpcJVdf-EtUKi1oCDIePm0SrKvIyMbTXUY-l0axwyYp5q-2aY4268-wYHJBNgSsA9YeTPTfijljqvAfbR5HW98A2ccF-WzXP6cS-C1Lzb7GI31dPgr-Ia3UfjFf7g50h8 Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-Openstack-Nova-Api-Version: 2.42 Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: f08c4f1ed40d49f9844841b0ee4c2817 Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-521650256 Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f08c4f1ed40d49f9844841b0ee4c2817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f08c4f1ed40d49f9844841b0ee4c2817"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f08c4f1ed40d49f9844841b0ee4c2817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f08c4f1ed40d49f9844841b0ee4c2817", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TaggedBootDevicesTest_v242-521650256 Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: f08c4f1ed40d49f9844841b0ee4c2817 Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-521650256 Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TaggedBootDevicesTest_v242-521650256-project Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 96d6f69a3f9f4a3eb556593e124232d2 Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TaggedBootDevicesTest_v242-521650256-project Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '1b5fbc0a-18dc-455e-b987-909ea4ca413b'} Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:44:26.117899 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:44:26.123686 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:44:26.123686 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:44:26.123686 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:44:26.123686 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:44:26.123686 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:44:26.123686 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:44:26.123686 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. Jul 31 01:44:26.123686 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:44:26.123686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-82100000-5782-4075-88a3-3dea892c589c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Returning 404 to user: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:44:26.123686 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-82100000-5782-4075-88a3-3dea892c589c tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 404 len: 111 microversion: 2.42 time: 0.041418 Jul 31 01:44:26.123686 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2840/5706] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:26 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:44:26.128896 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-86730932-5bf4-46ac-a8ce-af4753019103 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '.version_select at 0x7fede46bc040>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:26.149480 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-86730932-5bf4-46ac-a8ce-af4753019103 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596123683" status: 204 len: 0 microversion: 2.42 time: 0.023815 Jul 31 01:44:26.150391 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2867/5707] 10.222.0.45 () {60 vars in 1262 bytes} [Sun Jul 31 01:44:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596123683 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 01:44:27.022360 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-99c13dc8-01e7-474d-83f6-f737040f41e0 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:27.023076 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-99c13dc8-01e7-474d-83f6-f737040f41e0 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:27.030958 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99c13dc8-01e7-474d-83f6-f737040f41e0 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:27.031784 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99c13dc8-01e7-474d-83f6-f737040f41e0 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:27.032655 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99c13dc8-01e7-474d-83f6-f737040f41e0 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:27.033326 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99c13dc8-01e7-474d-83f6-f737040f41e0 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:27.278984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-99c13dc8-01e7-474d-83f6-f737040f41e0 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:27.288620 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-99c13dc8-01e7-474d-83f6-f737040f41e0 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8" status: 200 len: 1373 microversion: 2.1 time: 0.270309 Jul 31 01:44:27.289527 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2841/5708] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:44:27 2022] GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 => generated 1373 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:44:27.464468 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-a5316baa-89a0-4147-af77-9628864e8c46 req-373a3348-ddc5-48e5-ab06-1fc81e3780f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c39445-6aa1-4dc8-abd0-1003318612d8", "name": "network-vif-plugged", "status": "completed", "tag": "f07d78bc-dd7a-4048-858c-98d9b32460c9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:44:27.491556 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a5316baa-89a0-4147-af77-9628864e8c46 req-373a3348-ddc5-48e5-ab06-1fc81e3780f7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:27.493568 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a5316baa-89a0-4147-af77-9628864e8c46 req-373a3348-ddc5-48e5-ab06-1fc81e3780f7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:27.518190 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-a5316baa-89a0-4147-af77-9628864e8c46 req-373a3348-ddc5-48e5-ab06-1fc81e3780f7 service nova] Creating event network-vif-plugged:f07d78bc-dd7a-4048-858c-98d9b32460c9 for instance 56c39445-6aa1-4dc8-abd0-1003318612d8 on n-h2-master-1 Jul 31 01:44:27.538382 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-a5316baa-89a0-4147-af77-9628864e8c46 req-373a3348-ddc5-48e5-ab06-1fc81e3780f7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079054 Jul 31 01:44:27.539477 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2868/5709] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:44:28.311833 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4b4fbd8d-76c1-423f-9f2d-9d4e471b24c8 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:28.312477 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4b4fbd8d-76c1-423f-9f2d-9d4e471b24c8 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:28.330107 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b4fbd8d-76c1-423f-9f2d-9d4e471b24c8 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:28.330953 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b4fbd8d-76c1-423f-9f2d-9d4e471b24c8 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:28.332237 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b4fbd8d-76c1-423f-9f2d-9d4e471b24c8 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:28.332949 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b4fbd8d-76c1-423f-9f2d-9d4e471b24c8 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:28.541309 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4b4fbd8d-76c1-423f-9f2d-9d4e471b24c8 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:28.560338 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:44:28.582185 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4b4fbd8d-76c1-423f-9f2d-9d4e471b24c8 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8" status: 200 len: 1373 microversion: 2.1 time: 0.276120 Jul 31 01:44:28.583127 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2842/5710] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:44:28 2022] GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 => generated 1373 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:44:29.602316 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:44:29.603917 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:44:29.609761 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a77c9f47-3ac4-4355-8ba9-af4c0b8695bb tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:29.610493 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a77c9f47-3ac4-4355-8ba9-af4c0b8695bb tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:29.621719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a77c9f47-3ac4-4355-8ba9-af4c0b8695bb tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:29.622213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a77c9f47-3ac4-4355-8ba9-af4c0b8695bb tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:29.623235 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a77c9f47-3ac4-4355-8ba9-af4c0b8695bb tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:29.624105 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a77c9f47-3ac4-4355-8ba9-af4c0b8695bb tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:29.646240 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:44:29.876299 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a77c9f47-3ac4-4355-8ba9-af4c0b8695bb tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:29.886870 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a77c9f47-3ac4-4355-8ba9-af4c0b8695bb tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8" status: 200 len: 1546 microversion: 2.1 time: 0.285145 Jul 31 01:44:29.888325 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2869/5711] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:44:29 2022] GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 => generated 1546 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:44:29.909249 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8fe9266b-95db-479f-9e54-2b2fc1fef50b tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:29.916850 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8fe9266b-95db-479f-9e54-2b2fc1fef50b tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:29.935819 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fe9266b-95db-479f-9e54-2b2fc1fef50b tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:29.936635 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fe9266b-95db-479f-9e54-2b2fc1fef50b tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:29.938125 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fe9266b-95db-479f-9e54-2b2fc1fef50b tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:29.938809 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8fe9266b-95db-479f-9e54-2b2fc1fef50b tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:30.024403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-26859459-3e2f-424c-a8a4-d480bd40dff2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:30.024919 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-26859459-3e2f-424c-a8a4-d480bd40dff2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:30.032100 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-26859459-3e2f-424c-a8a4-d480bd40dff2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:30.032835 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-26859459-3e2f-424c-a8a4-d480bd40dff2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:30.033617 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-26859459-3e2f-424c-a8a4-d480bd40dff2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:30.034322 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-26859459-3e2f-424c-a8a4-d480bd40dff2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:30.064565 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-26859459-3e2f-424c-a8a4-d480bd40dff2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] HTTP exception thrown: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-26859459-3e2f-424c-a8a4-d480bd40dff2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Request method failure captured: Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b HTTP/1.1 Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dzYJ0WXko_gUOAvxPsxLFwvVXqcY-i31zE3bfAK4mUYbwxpcJVdf-EtUKi1oCDIePm0SrKvIyMbTXUY-l0axwyYp5q-2aY4268-wYHJBNgSsA9YeTPTfijljqvAfbR5HW98A2ccF-WzXP6cS-C1Lzb7GI31dPgr-Ia3UfjFf7g50h8 Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.42 Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: f08c4f1ed40d49f9844841b0ee4c2817 Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-521650256 Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f08c4f1ed40d49f9844841b0ee4c2817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f08c4f1ed40d49f9844841b0ee4c2817"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f08c4f1ed40d49f9844841b0ee4c2817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f08c4f1ed40d49f9844841b0ee4c2817", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TaggedBootDevicesTest_v242-521650256 Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: f08c4f1ed40d49f9844841b0ee4c2817 Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-521650256 Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TaggedBootDevicesTest_v242-521650256-project Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 96d6f69a3f9f4a3eb556593e124232d2 Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TaggedBootDevicesTest_v242-521650256-project Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '1b5fbc0a-18dc-455e-b987-909ea4ca413b'} Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:44:30.068406 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:44:30.076564 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. Jul 31 01:44:30.076564 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:44:30.076564 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:44:30.076564 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:44:30.076564 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:44:30.076564 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:44:30.076564 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:44:30.076564 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:44:30.076564 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:44:30.076564 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. Jul 31 01:44:30.076564 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:44:30.076564 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-26859459-3e2f-424c-a8a4-d480bd40dff2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Returning 404 to user: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:44:30.076564 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-26859459-3e2f-424c-a8a4-d480bd40dff2 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 404 len: 111 microversion: 2.42 time: 0.049766 Jul 31 01:44:30.076564 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2870/5712] 10.222.0.45 () {60 vars in 1280 bytes} [Sun Jul 31 01:44:30 2022] DELETE /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 31 01:44:30.084328 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cc890fbf-220c-43e5-a4c3-dde891aa5f65 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:44:30.084962 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cc890fbf-220c-43e5-a4c3-dde891aa5f65 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] [instance: 1b5fbc0a-18dc-455e-b987-909ea4ca413b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:30.092766 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc890fbf-220c-43e5-a4c3-dde891aa5f65 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:30.093961 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc890fbf-220c-43e5-a4c3-dde891aa5f65 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:30.095449 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc890fbf-220c-43e5-a4c3-dde891aa5f65 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:30.096389 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc890fbf-220c-43e5-a4c3-dde891aa5f65 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:30.127073 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-cc890fbf-220c-43e5-a4c3-dde891aa5f65 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] HTTP exception thrown: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cc890fbf-220c-43e5-a4c3-dde891aa5f65 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Request method failure captured: Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b HTTP/1.1 Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dzYJ0WXko_gUOAvxPsxLFwvVXqcY-i31zE3bfAK4mUYbwxpcJVdf-EtUKi1oCDIePm0SrKvIyMbTXUY-l0axwyYp5q-2aY4268-wYHJBNgSsA9YeTPTfijljqvAfbR5HW98A2ccF-WzXP6cS-C1Lzb7GI31dPgr-Ia3UfjFf7g50h8 Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-Openstack-Nova-Api-Version: 2.42 Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: f08c4f1ed40d49f9844841b0ee4c2817 Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-521650256 Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f08c4f1ed40d49f9844841b0ee4c2817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/f08c4f1ed40d49f9844841b0ee4c2817"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/f08c4f1ed40d49f9844841b0ee4c2817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_f08c4f1ed40d49f9844841b0ee4c2817", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TaggedBootDevicesTest_v242-521650256 Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: f08c4f1ed40d49f9844841b0ee4c2817 Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-521650256 Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TaggedBootDevicesTest_v242-521650256-project Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 96d6f69a3f9f4a3eb556593e124232d2 Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TaggedBootDevicesTest_v242-521650256-project Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '1b5fbc0a-18dc-455e-b987-909ea4ca413b'} Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:44:30.129742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:44:30.137858 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:44:30.137858 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:44:30.137858 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:44:30.137858 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:44:30.137858 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:44:30.137858 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:44:30.137858 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. Jul 31 01:44:30.137858 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:44:30.137858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cc890fbf-220c-43e5-a4c3-dde891aa5f65 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] Returning 404 to user: Instance 1b5fbc0a-18dc-455e-b987-909ea4ca413b could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:44:30.137858 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cc890fbf-220c-43e5-a4c3-dde891aa5f65 tempest-TaggedBootDevicesTest_v242-521650256 tempest-TaggedBootDevicesTest_v242-521650256-project] 10.222.0.45 "GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b" status: 404 len: 111 microversion: 2.42 time: 0.055306 Jul 31 01:44:30.137858 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2871/5713] 10.222.0.45 () {60 vars in 1277 bytes} [Sun Jul 31 01:44:30 2022] GET /compute/v2.1/servers/1b5fbc0a-18dc-455e-b987-909ea4ca413b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:44:30.169106 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8fe9266b-95db-479f-9e54-2b2fc1fef50b tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:44:30.178260 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8fe9266b-95db-479f-9e54-2b2fc1fef50b tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8" status: 200 len: 1546 microversion: 2.1 time: 0.273387 Jul 31 01:44:30.183794 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2843/5714] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:44:29 2022] GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 => generated 1546 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:44:32.344159 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f4eee4e5-859a-4fb1-8f03-fcdfd1787232 req-5055961d-9734-40a7-913a-2a12805813cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c39445-6aa1-4dc8-abd0-1003318612d8", "tag": "f07d78bc-dd7a-4048-858c-98d9b32460c9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:44:32.390600 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f4eee4e5-859a-4fb1-8f03-fcdfd1787232 req-5055961d-9734-40a7-913a-2a12805813cd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:32.392508 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f4eee4e5-859a-4fb1-8f03-fcdfd1787232 req-5055961d-9734-40a7-913a-2a12805813cd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:32.451205 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f4eee4e5-859a-4fb1-8f03-fcdfd1787232 req-5055961d-9734-40a7-913a-2a12805813cd service nova] Creating event network-changed:f07d78bc-dd7a-4048-858c-98d9b32460c9 for instance 56c39445-6aa1-4dc8-abd0-1003318612d8 on n-h2-master-1 Jul 31 01:44:32.478686 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f4eee4e5-859a-4fb1-8f03-fcdfd1787232 req-5055961d-9734-40a7-913a-2a12805813cd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139879 Jul 31 01:44:32.480091 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2872/5715] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:44:53.075599 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8129b472-28c4-4da3-8cc9-887552e3e758 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:44:53.078020 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8129b472-28c4-4da3-8cc9-887552e3e758 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:44:53.082406 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:44:53.090987 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=19 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:44:53.103674 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8129b472-28c4-4da3-8cc9-887552e3e758 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:53.106214 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8129b472-28c4-4da3-8cc9-887552e3e758 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:53.110199 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8129b472-28c4-4da3-8cc9-887552e3e758 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:44:53.110914 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8129b472-28c4-4da3-8cc9-887552e3e758 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:44:53.241522 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8129b472-28c4-4da3-8cc9-887552e3e758 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "POST /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8/action" status: 200 len: 24576 microversion: 2.1 time: 0.170737 Jul 31 01:44:53.250157 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2844/5716] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:44:53 2022] POST /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8/action => generated 24576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:45:01.664629 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:01.665962 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=10 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:01.941446 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1297376399", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "13d0d921-4e43-49af-a14d-53d514d1ec68"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:45:02.016288 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] validate_networks() for [('13d0d921-4e43-49af-a14d-53d514d1ec68', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:45:02.757971 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:45:02.758488 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:45:02.759443 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:45:02.759883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:45:02.760311 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:45:02.771665 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:02.772829 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:02.781388 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:02.782577 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:02.813033 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Getting quotas for project 35c85383076442a7ad717dcc18450380. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:45:02.821366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Getting quotas for user f98c8a4c398b42179763fb7bcb73ab8a and project 35c85383076442a7ad717dcc18450380. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:45:02.837678 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Going to run 3 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:45:02.841064 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 11b952a2-00e5-4c8d-9e31-d9b1221509a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:45:02.879161 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 492355b1-3994-4187-b3d5-14303050e9aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=11b952a2-00e5-4c8d-9e31-d9b1221509a4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:45:02.930894 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=492355b1-3994-4187-b3d5-14303050e9aa,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:45:03.012483 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5e4d7956-1d0a-4e7d-8652-08d7036797d0 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.351635 Jul 31 01:45:03.019758 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2873/5717] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:45:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:45:03.025339 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-36e3da7f-6f46-4f99-a166-bcfbbf9beef2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:03.036574 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-36e3da7f-6f46-4f99-a166-bcfbbf9beef2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:03.040871 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-36e3da7f-6f46-4f99-a166-bcfbbf9beef2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Searching by: {'deleted': False, 'project_id': '35c85383076442a7ad717dcc18450380'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:45:03.085898 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-36e3da7f-6f46-4f99-a166-bcfbbf9beef2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:03.086588 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-36e3da7f-6f46-4f99-a166-bcfbbf9beef2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:03.087630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-36e3da7f-6f46-4f99-a166-bcfbbf9beef2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:03.088283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-36e3da7f-6f46-4f99-a166-bcfbbf9beef2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:03.122420 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-36e3da7f-6f46-4f99-a166-bcfbbf9beef2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.101718 Jul 31 01:45:03.123830 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2845/5718] 10.222.0.45 () {58 vars in 1125 bytes} [Sun Jul 31 01:45:03 2022] GET /compute/v2.1/servers => generated 1018 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:03.136177 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-43a0ac5f-62ee-4dea-a772-4001d026ce0c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:03.137140 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-43a0ac5f-62ee-4dea-a772-4001d026ce0c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:03.222960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-43a0ac5f-62ee-4dea-a772-4001d026ce0c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:03.239211 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-43a0ac5f-62ee-4dea-a772-4001d026ce0c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 200 len: 1223 microversion: 2.1 time: 0.107096 Jul 31 01:45:03.239835 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2874/5719] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:03 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:04.260258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-69dc0e7d-4fe3-498c-bb53-5a388f4db55e tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:04.262279 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-69dc0e7d-4fe3-498c-bb53-5a388f4db55e tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:04.385582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-69dc0e7d-4fe3-498c-bb53-5a388f4db55e tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:04.394266 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-69dc0e7d-4fe3-498c-bb53-5a388f4db55e tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 200 len: 1223 microversion: 2.1 time: 0.137931 Jul 31 01:45:04.397889 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2846/5720] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:04 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 1223 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:04.467417 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7508a48b-108f-438c-ba2e-5fee1b98f1d1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:45:04.470102 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7508a48b-108f-438c-ba2e-5fee1b98f1d1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:04.489420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7508a48b-108f-438c-ba2e-5fee1b98f1d1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:04.490409 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7508a48b-108f-438c-ba2e-5fee1b98f1d1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:04.491322 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7508a48b-108f-438c-ba2e-5fee1b98f1d1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:04.492411 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7508a48b-108f-438c-ba2e-5fee1b98f1d1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:04.658092 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7508a48b-108f-438c-ba2e-5fee1b98f1d1 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "POST /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8/action" status: 200 len: 32649 microversion: 2.1 time: 0.195908 Jul 31 01:45:04.663442 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2875/5721] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:45:04 2022] POST /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8/action => generated 32649 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:45:05.419311 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-81445507-ce18-4579-9e28-72d1a8703dd7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:05.419960 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-81445507-ce18-4579-9e28-72d1a8703dd7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:05.431380 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81445507-ce18-4579-9e28-72d1a8703dd7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:05.431850 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81445507-ce18-4579-9e28-72d1a8703dd7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:05.434138 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81445507-ce18-4579-9e28-72d1a8703dd7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:05.434674 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81445507-ce18-4579-9e28-72d1a8703dd7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:05.938599 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-81445507-ce18-4579-9e28-72d1a8703dd7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:05.952651 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-81445507-ce18-4579-9e28-72d1a8703dd7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 200 len: 1275 microversion: 2.1 time: 0.538307 Jul 31 01:45:05.971366 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2847/5722] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:05 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 1275 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:06.866210 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-317f647b-fc9d-49bd-8b3b-c89629fcaa73 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:06.868753 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-317f647b-fc9d-49bd-8b3b-c89629fcaa73 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:06.869437 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-81b33048-12f3-4baf-bed0-27f6b434f3c9 req-fe35aebe-ed01-4968-ba43-27ba9d45a243 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c39445-6aa1-4dc8-abd0-1003318612d8", "tag": "f07d78bc-dd7a-4048-858c-98d9b32460c9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:45:06.904057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-81b33048-12f3-4baf-bed0-27f6b434f3c9 req-fe35aebe-ed01-4968-ba43-27ba9d45a243 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:06.904900 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-81b33048-12f3-4baf-bed0-27f6b434f3c9 req-fe35aebe-ed01-4968-ba43-27ba9d45a243 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:06.907174 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-317f647b-fc9d-49bd-8b3b-c89629fcaa73 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:06.910988 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-317f647b-fc9d-49bd-8b3b-c89629fcaa73 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:06.912461 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-317f647b-fc9d-49bd-8b3b-c89629fcaa73 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:06.916681 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-317f647b-fc9d-49bd-8b3b-c89629fcaa73 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:06.928765 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-81b33048-12f3-4baf-bed0-27f6b434f3c9 req-fe35aebe-ed01-4968-ba43-27ba9d45a243 service nova] Creating event network-changed:f07d78bc-dd7a-4048-858c-98d9b32460c9 for instance 56c39445-6aa1-4dc8-abd0-1003318612d8 on n-h2-master-1 Jul 31 01:45:06.941439 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-81b33048-12f3-4baf-bed0-27f6b434f3c9 req-fe35aebe-ed01-4968-ba43-27ba9d45a243 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077413 Jul 31 01:45:06.944644 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2848/5723] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:45:06.976619 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-450a0b94-5707-48da-b786-40985eb848b4 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:06.977344 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-450a0b94-5707-48da-b786-40985eb848b4 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:06.985797 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-317f647b-fc9d-49bd-8b3b-c89629fcaa73 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:45:06.999909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-450a0b94-5707-48da-b786-40985eb848b4 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:07.003907 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-450a0b94-5707-48da-b786-40985eb848b4 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:07.007743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-450a0b94-5707-48da-b786-40985eb848b4 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:07.008640 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-450a0b94-5707-48da-b786-40985eb848b4 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:07.166082 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-450a0b94-5707-48da-b786-40985eb848b4 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:07.195995 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-450a0b94-5707-48da-b786-40985eb848b4 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 200 len: 1281 microversion: 2.1 time: 0.216786 Jul 31 01:45:07.199847 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2849/5724] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:06 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 1281 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:07.206156 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-317f647b-fc9d-49bd-8b3b-c89629fcaa73 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "DELETE /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8" status: 204 len: 0 microversion: 2.1 time: 0.347619 Jul 31 01:45:07.207715 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2876/5725] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:45:06 2022] DELETE /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:45:07.222405 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1ce9ac4e-d35f-4f38-a308-4ef1f4dfa6e6 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:07.223386 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1ce9ac4e-d35f-4f38-a308-4ef1f4dfa6e6 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:07.229979 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ce9ac4e-d35f-4f38-a308-4ef1f4dfa6e6 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:07.230687 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ce9ac4e-d35f-4f38-a308-4ef1f4dfa6e6 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:07.231734 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ce9ac4e-d35f-4f38-a308-4ef1f4dfa6e6 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:07.232367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1ce9ac4e-d35f-4f38-a308-4ef1f4dfa6e6 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:07.803282 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1ce9ac4e-d35f-4f38-a308-4ef1f4dfa6e6 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:07.814230 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1ce9ac4e-d35f-4f38-a308-4ef1f4dfa6e6 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8" status: 200 len: 1671 microversion: 2.1 time: 0.602017 Jul 31 01:45:07.815995 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2850/5726] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:07 2022] GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 => generated 1671 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:08.225037 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2b093bcd-a9d3-4f77-babf-d50322998088 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:08.227242 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2b093bcd-a9d3-4f77-babf-d50322998088 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:08.246525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b093bcd-a9d3-4f77-babf-d50322998088 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:08.247264 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b093bcd-a9d3-4f77-babf-d50322998088 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:08.248204 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b093bcd-a9d3-4f77-babf-d50322998088 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:08.248754 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b093bcd-a9d3-4f77-babf-d50322998088 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:08.571857 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2b093bcd-a9d3-4f77-babf-d50322998088 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:08.583539 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2b093bcd-a9d3-4f77-babf-d50322998088 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 200 len: 1281 microversion: 2.1 time: 0.362632 Jul 31 01:45:08.584217 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2877/5727] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:08 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 1281 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:45:08.841434 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8cda7d32-f878-4a0f-8f1f-438b42757ce4 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:08.842842 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8cda7d32-f878-4a0f-8f1f-438b42757ce4 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:08.851534 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cda7d32-f878-4a0f-8f1f-438b42757ce4 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:08.852336 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cda7d32-f878-4a0f-8f1f-438b42757ce4 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:08.854803 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cda7d32-f878-4a0f-8f1f-438b42757ce4 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:08.855600 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8cda7d32-f878-4a0f-8f1f-438b42757ce4 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:09.423288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8cda7d32-f878-4a0f-8f1f-438b42757ce4 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:09.436378 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8cda7d32-f878-4a0f-8f1f-438b42757ce4 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8" status: 200 len: 1671 microversion: 2.1 time: 0.598643 Jul 31 01:45:09.437816 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2851/5728] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:08 2022] GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 => generated 1671 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:09.605516 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eaa297d7-9675-48d8-bca3-459cfc4ffa08 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:09.606318 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eaa297d7-9675-48d8-bca3-459cfc4ffa08 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:09.618753 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eaa297d7-9675-48d8-bca3-459cfc4ffa08 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:09.619530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eaa297d7-9675-48d8-bca3-459cfc4ffa08 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:09.621984 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eaa297d7-9675-48d8-bca3-459cfc4ffa08 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:09.624628 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eaa297d7-9675-48d8-bca3-459cfc4ffa08 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:10.115143 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eaa297d7-9675-48d8-bca3-459cfc4ffa08 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:10.124904 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eaa297d7-9675-48d8-bca3-459cfc4ffa08 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 200 len: 1323 microversion: 2.1 time: 0.524117 Jul 31 01:45:10.136009 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2878/5729] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:09 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 1323 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:10.242993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-cb4a6df2-f75b-4e1a-89b2-535e1e5cd77a req-a71ffb5c-8c13-4804-a500-a66b8d715af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c39445-6aa1-4dc8-abd0-1003318612d8", "name": "network-vif-deleted", "tag": "f07d78bc-dd7a-4048-858c-98d9b32460c9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:45:10.260575 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-cb4a6df2-f75b-4e1a-89b2-535e1e5cd77a req-a71ffb5c-8c13-4804-a500-a66b8d715af0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:10.263207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-cb4a6df2-f75b-4e1a-89b2-535e1e5cd77a req-a71ffb5c-8c13-4804-a500-a66b8d715af0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:10.280966 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-cb4a6df2-f75b-4e1a-89b2-535e1e5cd77a req-a71ffb5c-8c13-4804-a500-a66b8d715af0 service nova] Creating event network-vif-deleted:f07d78bc-dd7a-4048-858c-98d9b32460c9 for instance 56c39445-6aa1-4dc8-abd0-1003318612d8 on n-h2-master-1 Jul 31 01:45:10.300047 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-cb4a6df2-f75b-4e1a-89b2-535e1e5cd77a req-a71ffb5c-8c13-4804-a500-a66b8d715af0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063243 Jul 31 01:45:10.301693 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2852/5730] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:45:10.458029 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-14db5900-bc63-45a8-809a-b95e401947bf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:10.459098 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-14db5900-bc63-45a8-809a-b95e401947bf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:10.477612 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14db5900-bc63-45a8-809a-b95e401947bf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:10.478138 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14db5900-bc63-45a8-809a-b95e401947bf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:10.479035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14db5900-bc63-45a8-809a-b95e401947bf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:10.479692 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14db5900-bc63-45a8-809a-b95e401947bf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:10.522500 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14db5900-bc63-45a8-809a-b95e401947bf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:10.523120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-14db5900-bc63-45a8-809a-b95e401947bf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:10.523762 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-14db5900-bc63-45a8-809a-b95e401947bf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lazy-loading 'fault' on Instance uuid 56c39445-6aa1-4dc8-abd0-1003318612d8 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:45:10.738011 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-14db5900-bc63-45a8-809a-b95e401947bf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c632588512b9471b8508c1532f6c9723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6c59dbacb14a339fa940faf1d7e632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:10.758987 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-14db5900-bc63-45a8-809a-b95e401947bf tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8" status: 200 len: 1338 microversion: 2.1 time: 0.303958 Jul 31 01:45:10.762202 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2879/5731] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:10 2022] GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 => generated 1338 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:10.816564 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-eaca665a-675a-4887-8883-fdd8201b7a3e req-586c781a-62fb-4817-976b-2ce9d94f112c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "492355b1-3994-4187-b3d5-14303050e9aa", "tag": "51ae495b-0aa2-4152-b1ee-0e17d7bb5b30"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:45:10.840990 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-eaca665a-675a-4887-8883-fdd8201b7a3e req-586c781a-62fb-4817-976b-2ce9d94f112c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:10.841535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-eaca665a-675a-4887-8883-fdd8201b7a3e req-586c781a-62fb-4817-976b-2ce9d94f112c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:10.856371 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-eaca665a-675a-4887-8883-fdd8201b7a3e req-586c781a-62fb-4817-976b-2ce9d94f112c service nova] Creating event network-changed:51ae495b-0aa2-4152-b1ee-0e17d7bb5b30 for instance 492355b1-3994-4187-b3d5-14303050e9aa on n-h2-master-1 Jul 31 01:45:10.861739 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-eaca665a-675a-4887-8883-fdd8201b7a3e req-586c781a-62fb-4817-976b-2ce9d94f112c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051219 Jul 31 01:45:10.862982 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2853/5732] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:45:11.151432 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-17503818-1e9d-46b4-93db-64c56792104c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:11.152883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-17503818-1e9d-46b4-93db-64c56792104c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:11.167383 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17503818-1e9d-46b4-93db-64c56792104c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:11.168736 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17503818-1e9d-46b4-93db-64c56792104c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:11.171808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17503818-1e9d-46b4-93db-64c56792104c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:11.172523 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17503818-1e9d-46b4-93db-64c56792104c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:11.475618 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-17503818-1e9d-46b4-93db-64c56792104c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:11.488255 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-17503818-1e9d-46b4-93db-64c56792104c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 200 len: 1323 microversion: 2.1 time: 0.342438 Jul 31 01:45:11.489223 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2880/5733] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:11 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 1323 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:11.785074 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d1ab1ce9-8043-4346-8658-2739f066756c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:11.786447 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d1ab1ce9-8043-4346-8658-2739f066756c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] [instance: 56c39445-6aa1-4dc8-abd0-1003318612d8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:11.795039 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d1ab1ce9-8043-4346-8658-2739f066756c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:11.795815 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d1ab1ce9-8043-4346-8658-2739f066756c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:11.796773 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d1ab1ce9-8043-4346-8658-2739f066756c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:11.797413 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d1ab1ce9-8043-4346-8658-2739f066756c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:11.822289 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-d1ab1ce9-8043-4346-8658-2739f066756c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] HTTP exception thrown: Instance 56c39445-6aa1-4dc8-abd0-1003318612d8 could not be found. Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d1ab1ce9-8043-4346-8658-2739f066756c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Request method failure captured: Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 HTTP/1.1 Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5d3ocBVJFkTpVj9AVpu7qEvKEp3tkJNrsf1--EW-d0ubiUzXTpaD2ruwsgXZtHqRfGFz6bZumUjRwR2ap9EoaxN5fhWiGQ2KBr06S6tsGGUVixw3qGjAUxBBPZ3xxGvgzUQXfrhNYiXVDt1DSaG0XT7xH99p_sZQK6SLvopl5e5HHsg Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: aa6c59dbacb14a339fa940faf1d7e632 Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestNetworkBasicOps-1585756169 Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aa6c59dbacb14a339fa940faf1d7e632"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aa6c59dbacb14a339fa940faf1d7e632"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/aa6c59dbacb14a339fa940faf1d7e632"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_aa6c59dbacb14a339fa940faf1d7e632", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestNetworkBasicOps-1585756169 Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: aa6c59dbacb14a339fa940faf1d7e632 Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestNetworkBasicOps-1585756169 Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestNetworkBasicOps-1585756169-project Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: c632588512b9471b8508c1532f6c9723 Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestNetworkBasicOps-1585756169-project Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 56c39445-6aa1-4dc8-abd0-1003318612d8 could not be found. Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '56c39445-6aa1-4dc8-abd0-1003318612d8'} Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c39445-6aa1-4dc8-abd0-1003318612d8 could not be found. Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c39445-6aa1-4dc8-abd0-1003318612d8 could not be found. Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:11.826995 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:11.833055 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:11.833055 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:11.833055 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:11.833055 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:45:11.833055 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:45:11.833055 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c39445-6aa1-4dc8-abd0-1003318612d8 could not be found. Jul 31 01:45:11.833055 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:11.833055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d1ab1ce9-8043-4346-8658-2739f066756c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Returning 404 to user: Instance 56c39445-6aa1-4dc8-abd0-1003318612d8 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:45:11.833055 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d1ab1ce9-8043-4346-8658-2739f066756c tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8" status: 404 len: 111 microversion: 2.1 time: 0.048608 Jul 31 01:45:11.833055 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2854/5734] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:11 2022] GET /compute/v2.1/servers/56c39445-6aa1-4dc8-abd0-1003318612d8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:45:12.044237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e4e89de7-4300-4b01-b94c-679e8c4a35f7 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] Calling method '.version_select at 0x7fede4534670>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:12.083995 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e4e89de7-4300-4b01-b94c-679e8c4a35f7 tempest-TestNetworkBasicOps-1585756169 tempest-TestNetworkBasicOps-1585756169-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-383813925" status: 202 len: 0 microversion: 2.1 time: 0.043661 Jul 31 01:45:12.084610 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2881/5735] 10.222.0.45 () {58 vars in 1254 bytes} [Sun Jul 31 01:45:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-383813925 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:45:12.345451 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-151277ac-3724-44b0-b041-dfcf0f2b1d90 req-a3e7b938-08e6-4757-b74f-f9bc043e1c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b952a2-00e5-4c8d-9e31-d9b1221509a4", "tag": "2fd0a62b-5d9d-4d85-819e-0cc1c8bb4e73"}, {"name": "network-changed", "server_uuid": "4a6fd310-1020-440e-839c-de3cb2b9dc4e", "tag": "8024f69b-2332-48d1-b8bd-4d7d959bfdbb"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:45:12.369013 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-151277ac-3724-44b0-b041-dfcf0f2b1d90 req-a3e7b938-08e6-4757-b74f-f9bc043e1c73 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:12.369744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-151277ac-3724-44b0-b041-dfcf0f2b1d90 req-a3e7b938-08e6-4757-b74f-f9bc043e1c73 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:12.392607 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-151277ac-3724-44b0-b041-dfcf0f2b1d90 req-a3e7b938-08e6-4757-b74f-f9bc043e1c73 service nova] Creating event network-changed:2fd0a62b-5d9d-4d85-819e-0cc1c8bb4e73 for instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 on n-h1-master-1 Jul 31 01:45:12.393382 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-151277ac-3724-44b0-b041-dfcf0f2b1d90 req-a3e7b938-08e6-4757-b74f-f9bc043e1c73 service nova] Creating event network-changed:8024f69b-2332-48d1-b8bd-4d7d959bfdbb for instance 4a6fd310-1020-440e-839c-de3cb2b9dc4e on n-h1-master-1 Jul 31 01:45:12.412584 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-151277ac-3724-44b0-b041-dfcf0f2b1d90 req-a3e7b938-08e6-4757-b74f-f9bc043e1c73 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.071137 Jul 31 01:45:12.413828 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2855/5736] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:45:12.513731 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-97826689-eff9-4029-87e9-4db43cacb2d1 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:12.514390 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-97826689-eff9-4029-87e9-4db43cacb2d1 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:12.528328 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97826689-eff9-4029-87e9-4db43cacb2d1 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:12.528793 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97826689-eff9-4029-87e9-4db43cacb2d1 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:12.529588 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97826689-eff9-4029-87e9-4db43cacb2d1 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:12.530040 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-97826689-eff9-4029-87e9-4db43cacb2d1 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:12.728434 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-97826689-eff9-4029-87e9-4db43cacb2d1 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:12.747210 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-97826689-eff9-4029-87e9-4db43cacb2d1 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 200 len: 1323 microversion: 2.1 time: 0.238922 Jul 31 01:45:12.748231 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2882/5737] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:12 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 1323 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:13.770626 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:13.775817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f947d2e5-3b7d-4759-9f93-bb5e03aa4c36 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:13.780064 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f947d2e5-3b7d-4759-9f93-bb5e03aa4c36 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:13.801430 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f947d2e5-3b7d-4759-9f93-bb5e03aa4c36 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:13.802204 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f947d2e5-3b7d-4759-9f93-bb5e03aa4c36 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:13.804508 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f947d2e5-3b7d-4759-9f93-bb5e03aa4c36 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:13.806043 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f947d2e5-3b7d-4759-9f93-bb5e03aa4c36 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:14.009630 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f947d2e5-3b7d-4759-9f93-bb5e03aa4c36 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:14.021864 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f947d2e5-3b7d-4759-9f93-bb5e03aa4c36 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 200 len: 1323 microversion: 2.1 time: 0.255636 Jul 31 01:45:14.022944 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2856/5738] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:13 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 1323 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:15.045195 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:15.048979 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:15.053529 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8367fb31-2d4b-4f6e-b9e5-56e617f2ee87 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:15.054249 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8367fb31-2d4b-4f6e-b9e5-56e617f2ee87 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:15.080203 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8367fb31-2d4b-4f6e-b9e5-56e617f2ee87 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:15.080983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8367fb31-2d4b-4f6e-b9e5-56e617f2ee87 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:15.081822 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8367fb31-2d4b-4f6e-b9e5-56e617f2ee87 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:15.082265 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8367fb31-2d4b-4f6e-b9e5-56e617f2ee87 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:15.371592 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8367fb31-2d4b-4f6e-b9e5-56e617f2ee87 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:15.381790 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8367fb31-2d4b-4f6e-b9e5-56e617f2ee87 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 200 len: 1323 microversion: 2.1 time: 0.335037 Jul 31 01:45:15.383776 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2883/5739] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:15 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 1323 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:16.404311 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d9c0126c-eabf-4d15-bb0e-12a76ad3510f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:16.405012 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d9c0126c-eabf-4d15-bb0e-12a76ad3510f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:16.414910 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:16.424396 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d9c0126c-eabf-4d15-bb0e-12a76ad3510f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:16.425304 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d9c0126c-eabf-4d15-bb0e-12a76ad3510f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:16.426503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d9c0126c-eabf-4d15-bb0e-12a76ad3510f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:16.427133 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d9c0126c-eabf-4d15-bb0e-12a76ad3510f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:16.650453 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d9c0126c-eabf-4d15-bb0e-12a76ad3510f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:16.666019 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d9c0126c-eabf-4d15-bb0e-12a76ad3510f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 200 len: 1323 microversion: 2.1 time: 0.265795 Jul 31 01:45:16.682097 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2857/5740] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:16 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 1323 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:17.691792 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4c07b8f8-ae98-4277-9133-7c80501f82fd tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:17.693252 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4c07b8f8-ae98-4277-9133-7c80501f82fd tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:17.708074 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c07b8f8-ae98-4277-9133-7c80501f82fd tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:17.709517 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c07b8f8-ae98-4277-9133-7c80501f82fd tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:17.712450 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c07b8f8-ae98-4277-9133-7c80501f82fd tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:17.713096 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4c07b8f8-ae98-4277-9133-7c80501f82fd tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:18.367527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-616c416f-10e7-4bda-8f53-e01f13207d78 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:18.375419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-616c416f-10e7-4bda-8f53-e01f13207d78 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:18.385079 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-616c416f-10e7-4bda-8f53-e01f13207d78 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:18.385978 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-616c416f-10e7-4bda-8f53-e01f13207d78 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:18.387884 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-616c416f-10e7-4bda-8f53-e01f13207d78 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:18.388505 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-616c416f-10e7-4bda-8f53-e01f13207d78 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:18.433241 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4c07b8f8-ae98-4277-9133-7c80501f82fd tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:18.460280 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4c07b8f8-ae98-4277-9133-7c80501f82fd tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 200 len: 1323 microversion: 2.1 time: 0.773720 Jul 31 01:45:18.461153 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2884/5741] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:17 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 1323 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:18.476540 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-616c416f-10e7-4bda-8f53-e01f13207d78 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:45:18.639399 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-616c416f-10e7-4bda-8f53-e01f13207d78 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 204 len: 0 microversion: 2.1 time: 0.277438 Jul 31 01:45:18.652873 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f83ea79d-2742-4717-907d-4bf794450d55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:18.653647 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f83ea79d-2742-4717-907d-4bf794450d55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:18.661109 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2858/5742] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:45:18 2022] DELETE /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:45:18.667310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f83ea79d-2742-4717-907d-4bf794450d55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:18.668421 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f83ea79d-2742-4717-907d-4bf794450d55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:18.669792 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f83ea79d-2742-4717-907d-4bf794450d55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:18.670584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f83ea79d-2742-4717-907d-4bf794450d55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:18.996796 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f83ea79d-2742-4717-907d-4bf794450d55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:19.013862 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f83ea79d-2742-4717-907d-4bf794450d55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1573 microversion: 2.1 time: 0.358381 Jul 31 01:45:19.031383 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2885/5743] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:18 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1573 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:19.433869 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-bbc109f3-5d87-47c3-abfc-5e2103f0ad98 req-a51a8f5e-a225-4d6e-96ab-8edebfbcbf1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "492355b1-3994-4187-b3d5-14303050e9aa", "name": "network-vif-plugged", "status": "completed", "tag": "51ae495b-0aa2-4152-b1ee-0e17d7bb5b30"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:45:19.452745 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-bbc109f3-5d87-47c3-abfc-5e2103f0ad98 req-a51a8f5e-a225-4d6e-96ab-8edebfbcbf1a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:19.453492 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-bbc109f3-5d87-47c3-abfc-5e2103f0ad98 req-a51a8f5e-a225-4d6e-96ab-8edebfbcbf1a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:19.488964 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4f53f465-794f-4466-a30d-b73d01dbc203 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:19.489656 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4f53f465-794f-4466-a30d-b73d01dbc203 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:19.504332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f53f465-794f-4466-a30d-b73d01dbc203 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:19.505160 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f53f465-794f-4466-a30d-b73d01dbc203 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:19.507146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f53f465-794f-4466-a30d-b73d01dbc203 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:19.507548 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-bbc109f3-5d87-47c3-abfc-5e2103f0ad98 req-a51a8f5e-a225-4d6e-96ab-8edebfbcbf1a service nova] Creating event network-vif-plugged:51ae495b-0aa2-4152-b1ee-0e17d7bb5b30 for instance 492355b1-3994-4187-b3d5-14303050e9aa on n-h2-master-1 Jul 31 01:45:19.510032 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f53f465-794f-4466-a30d-b73d01dbc203 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:19.524297 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-bbc109f3-5d87-47c3-abfc-5e2103f0ad98 req-a51a8f5e-a225-4d6e-96ab-8edebfbcbf1a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095579 Jul 31 01:45:19.527596 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2859/5744] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:45:19.990149 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4f53f465-794f-4466-a30d-b73d01dbc203 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:20.001378 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4f53f465-794f-4466-a30d-b73d01dbc203 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 200 len: 1323 microversion: 2.1 time: 0.519190 Jul 31 01:45:20.005662 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2886/5745] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:19 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 1323 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:20.046961 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7d39b08b-e8d8-4639-b2c6-92f7d5bfad3d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:20.047903 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7d39b08b-e8d8-4639-b2c6-92f7d5bfad3d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:20.058574 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d39b08b-e8d8-4639-b2c6-92f7d5bfad3d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:20.063985 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d39b08b-e8d8-4639-b2c6-92f7d5bfad3d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:20.065089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d39b08b-e8d8-4639-b2c6-92f7d5bfad3d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:20.065705 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d39b08b-e8d8-4639-b2c6-92f7d5bfad3d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:21.025787 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-17c65758-ee84-4d71-8b08-e60c55077b3f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:21.026412 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-17c65758-ee84-4d71-8b08-e60c55077b3f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:21.043547 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17c65758-ee84-4d71-8b08-e60c55077b3f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:21.056137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17c65758-ee84-4d71-8b08-e60c55077b3f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:21.056992 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17c65758-ee84-4d71-8b08-e60c55077b3f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:21.057456 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17c65758-ee84-4d71-8b08-e60c55077b3f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:21.345842 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-17c65758-ee84-4d71-8b08-e60c55077b3f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:21.361804 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-17c65758-ee84-4d71-8b08-e60c55077b3f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 200 len: 1323 microversion: 2.1 time: 0.339815 Jul 31 01:45:21.362724 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2887/5746] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:21 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 1323 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:45:21.386088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7d39b08b-e8d8-4639-b2c6-92f7d5bfad3d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:21.395819 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7d39b08b-e8d8-4639-b2c6-92f7d5bfad3d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1573 microversion: 2.1 time: 1.361845 Jul 31 01:45:21.403120 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2860/5747] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:20 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1573 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:21.576579 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f2c30ee5-4f06-45a8-8d89-7ef5232fb9d9 req-fcb4b5f7-e849-4d0d-9c92-7536b96a2686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6fd310-1020-440e-839c-de3cb2b9dc4e", "name": "network-vif-plugged", "status": "completed", "tag": "8024f69b-2332-48d1-b8bd-4d7d959bfdbb"}, {"server_uuid": "11b952a2-00e5-4c8d-9e31-d9b1221509a4", "name": "network-vif-plugged", "status": "completed", "tag": "2fd0a62b-5d9d-4d85-819e-0cc1c8bb4e73"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:45:21.588505 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f2c30ee5-4f06-45a8-8d89-7ef5232fb9d9 req-fcb4b5f7-e849-4d0d-9c92-7536b96a2686 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:21.588962 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f2c30ee5-4f06-45a8-8d89-7ef5232fb9d9 req-fcb4b5f7-e849-4d0d-9c92-7536b96a2686 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:21.602915 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f2c30ee5-4f06-45a8-8d89-7ef5232fb9d9 req-fcb4b5f7-e849-4d0d-9c92-7536b96a2686 service nova] Creating event network-vif-plugged:8024f69b-2332-48d1-b8bd-4d7d959bfdbb for instance 4a6fd310-1020-440e-839c-de3cb2b9dc4e on n-h1-master-1 Jul 31 01:45:21.603475 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f2c30ee5-4f06-45a8-8d89-7ef5232fb9d9 req-fcb4b5f7-e849-4d0d-9c92-7536b96a2686 service nova] Creating event network-vif-plugged:2fd0a62b-5d9d-4d85-819e-0cc1c8bb4e73 for instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 on n-h1-master-1 Jul 31 01:45:21.610572 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f2c30ee5-4f06-45a8-8d89-7ef5232fb9d9 req-fcb4b5f7-e849-4d0d-9c92-7536b96a2686 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038162 Jul 31 01:45:21.611250 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2888/5748] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:45:22.382985 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f1f2b00b-3751-4063-8cdb-fbb70abede83 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:22.384634 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f1f2b00b-3751-4063-8cdb-fbb70abede83 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:22.396040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1f2b00b-3751-4063-8cdb-fbb70abede83 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:22.398575 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1f2b00b-3751-4063-8cdb-fbb70abede83 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:22.401142 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1f2b00b-3751-4063-8cdb-fbb70abede83 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:22.402958 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1f2b00b-3751-4063-8cdb-fbb70abede83 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:22.426559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-922938b1-1309-4080-bb2a-b1c42dfab335 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:22.426943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-922938b1-1309-4080-bb2a-b1c42dfab335 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:22.439203 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-922938b1-1309-4080-bb2a-b1c42dfab335 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:22.439720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-922938b1-1309-4080-bb2a-b1c42dfab335 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:22.447591 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-922938b1-1309-4080-bb2a-b1c42dfab335 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:22.448395 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-922938b1-1309-4080-bb2a-b1c42dfab335 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:22.625405 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-922938b1-1309-4080-bb2a-b1c42dfab335 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:22.634435 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-922938b1-1309-4080-bb2a-b1c42dfab335 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1506 microversion: 2.1 time: 0.212421 Jul 31 01:45:22.635132 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2889/5749] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:22 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:22.647887 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-fabf6fd9-1a45-4575-b070-bee4a3569750 req-3049778a-aef4-44b9-8553-9bb94fd7c561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb49b7d2-7bca-4738-b236-dafb09128705", "name": "network-vif-deleted", "tag": "086c02f8-d557-4112-b291-0605109fb6ef"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:45:22.679295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-fabf6fd9-1a45-4575-b070-bee4a3569750 req-3049778a-aef4-44b9-8553-9bb94fd7c561 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:22.679771 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-fabf6fd9-1a45-4575-b070-bee4a3569750 req-3049778a-aef4-44b9-8553-9bb94fd7c561 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:22.685900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f1f2b00b-3751-4063-8cdb-fbb70abede83 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:22.716356 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f1f2b00b-3751-4063-8cdb-fbb70abede83 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 200 len: 1323 microversion: 2.1 time: 0.337646 Jul 31 01:45:22.733919 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2861/5750] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:22 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 1323 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:22.738749 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-fabf6fd9-1a45-4575-b070-bee4a3569750 req-3049778a-aef4-44b9-8553-9bb94fd7c561 service nova] Creating event network-vif-deleted:086c02f8-d557-4112-b291-0605109fb6ef for instance cb49b7d2-7bca-4738-b236-dafb09128705 on n-h1-master-1 Jul 31 01:45:22.750761 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-fabf6fd9-1a45-4575-b070-bee4a3569750 req-3049778a-aef4-44b9-8553-9bb94fd7c561 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107980 Jul 31 01:45:22.751445 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2890/5751] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:45:23.656178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f666a865-af84-4fae-a8eb-8d115f7054dd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:23.660860 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f666a865-af84-4fae-a8eb-8d115f7054dd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:23.674908 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:23.677196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f666a865-af84-4fae-a8eb-8d115f7054dd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:23.677788 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f666a865-af84-4fae-a8eb-8d115f7054dd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:23.690210 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f666a865-af84-4fae-a8eb-8d115f7054dd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:23.691456 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f666a865-af84-4fae-a8eb-8d115f7054dd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:23.746634 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-db4959a6-d075-487d-9d45-0d5a8b464c33 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:23.747564 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-db4959a6-d075-487d-9d45-0d5a8b464c33 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:23.757512 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:23.770632 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db4959a6-d075-487d-9d45-0d5a8b464c33 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:23.770632 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db4959a6-d075-487d-9d45-0d5a8b464c33 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:23.770632 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db4959a6-d075-487d-9d45-0d5a8b464c33 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:23.770632 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db4959a6-d075-487d-9d45-0d5a8b464c33 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:23.995158 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f666a865-af84-4fae-a8eb-8d115f7054dd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:24.008798 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f666a865-af84-4fae-a8eb-8d115f7054dd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1223 microversion: 2.1 time: 0.356764 Jul 31 01:45:24.009791 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2862/5752] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:23 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1223 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:24.307695 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-db4959a6-d075-487d-9d45-0d5a8b464c33 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:24.314861 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:24.321692 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-db4959a6-d075-487d-9d45-0d5a8b464c33 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 200 len: 1517 microversion: 2.1 time: 0.585578 Jul 31 01:45:24.346600 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-41a4c9e8-9fcb-4801-9cc3-bfa5ec1832fe tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:24.347684 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-41a4c9e8-9fcb-4801-9cc3-bfa5ec1832fe tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 492355b1-3994-4187-b3d5-14303050e9aa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:24.353588 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2891/5753] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:23 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 1517 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:24.360165 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41a4c9e8-9fcb-4801-9cc3-bfa5ec1832fe tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:24.360692 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41a4c9e8-9fcb-4801-9cc3-bfa5ec1832fe tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:24.366052 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41a4c9e8-9fcb-4801-9cc3-bfa5ec1832fe tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:24.366517 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41a4c9e8-9fcb-4801-9cc3-bfa5ec1832fe tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:24.599457 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-41a4c9e8-9fcb-4801-9cc3-bfa5ec1832fe tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:24.609185 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-41a4c9e8-9fcb-4801-9cc3-bfa5ec1832fe tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/492355b1-3994-4187-b3d5-14303050e9aa" status: 200 len: 1516 microversion: 2.1 time: 0.266945 Jul 31 01:45:24.612258 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2863/5754] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:24 2022] GET /compute/v2.1/servers/492355b1-3994-4187-b3d5-14303050e9aa => generated 1516 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:24.633177 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-515e55b4-327a-4453-a87c-5a2c53770221 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:24.634979 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-515e55b4-327a-4453-a87c-5a2c53770221 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 11b952a2-00e5-4c8d-9e31-d9b1221509a4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:24.644465 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-515e55b4-327a-4453-a87c-5a2c53770221 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:24.646200 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-515e55b4-327a-4453-a87c-5a2c53770221 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:24.647090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-515e55b4-327a-4453-a87c-5a2c53770221 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:24.647853 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-515e55b4-327a-4453-a87c-5a2c53770221 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:24.886778 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-515e55b4-327a-4453-a87c-5a2c53770221 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:24.898832 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-515e55b4-327a-4453-a87c-5a2c53770221 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4" status: 200 len: 1516 microversion: 2.1 time: 0.269179 Jul 31 01:45:24.901064 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2892/5755] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:24 2022] GET /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4 => generated 1516 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:24.920493 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1197e273-83e9-497e-b158-4761cf36c769 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:24.921669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1197e273-83e9-497e-b158-4761cf36c769 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 11b952a2-00e5-4c8d-9e31-d9b1221509a4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:24.929044 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1197e273-83e9-497e-b158-4761cf36c769 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:24.929887 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1197e273-83e9-497e-b158-4761cf36c769 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:24.930940 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1197e273-83e9-497e-b158-4761cf36c769 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:24.931920 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1197e273-83e9-497e-b158-4761cf36c769 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:24.961472 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1197e273-83e9-497e-b158-4761cf36c769 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 11b952a2-00e5-4c8d-9e31-d9b1221509a4] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:45:25.041792 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d05ae9bb-7ffa-4d3d-afc0-500b7dfbbfd5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:25.042539 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d05ae9bb-7ffa-4d3d-afc0-500b7dfbbfd5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:25.063530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d05ae9bb-7ffa-4d3d-afc0-500b7dfbbfd5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:25.064306 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d05ae9bb-7ffa-4d3d-afc0-500b7dfbbfd5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:25.065318 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d05ae9bb-7ffa-4d3d-afc0-500b7dfbbfd5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:25.066022 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d05ae9bb-7ffa-4d3d-afc0-500b7dfbbfd5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:25.102804 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1197e273-83e9-497e-b158-4761cf36c769 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "DELETE /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4" status: 204 len: 0 microversion: 2.1 time: 0.184975 Jul 31 01:45:25.105042 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2864/5756] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:45:24 2022] DELETE /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:45:25.117013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aaf18218-7a16-4761-b987-47afcc6faf50 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:25.119457 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aaf18218-7a16-4761-b987-47afcc6faf50 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 11b952a2-00e5-4c8d-9e31-d9b1221509a4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:25.130805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aaf18218-7a16-4761-b987-47afcc6faf50 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:25.131529 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aaf18218-7a16-4761-b987-47afcc6faf50 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:25.132628 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aaf18218-7a16-4761-b987-47afcc6faf50 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:25.133352 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aaf18218-7a16-4761-b987-47afcc6faf50 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:25.205029 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d05ae9bb-7ffa-4d3d-afc0-500b7dfbbfd5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:25.214402 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d05ae9bb-7ffa-4d3d-afc0-500b7dfbbfd5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1223 microversion: 2.1 time: 0.177917 Jul 31 01:45:25.220372 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2893/5757] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:25 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1223 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:45:25.396741 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-aaf18218-7a16-4761-b987-47afcc6faf50 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:25.412191 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aaf18218-7a16-4761-b987-47afcc6faf50 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4" status: 200 len: 1522 microversion: 2.1 time: 0.301934 Jul 31 01:45:25.413574 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2865/5758] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:25 2022] GET /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:26.236494 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-018774b6-7073-4a24-829d-ab994e07a2fc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:26.237858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-018774b6-7073-4a24-829d-ab994e07a2fc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:26.246669 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-018774b6-7073-4a24-829d-ab994e07a2fc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:26.247508 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-018774b6-7073-4a24-829d-ab994e07a2fc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:26.248473 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-018774b6-7073-4a24-829d-ab994e07a2fc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:26.249180 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-018774b6-7073-4a24-829d-ab994e07a2fc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:26.327752 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-018774b6-7073-4a24-829d-ab994e07a2fc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:26.336138 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-018774b6-7073-4a24-829d-ab994e07a2fc tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1223 microversion: 2.1 time: 0.103620 Jul 31 01:45:26.337045 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2894/5759] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:26 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:26.437632 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-257ebfb3-4bd7-4ba5-93db-fc6bf4ae9637 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:26.438873 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-257ebfb3-4bd7-4ba5-93db-fc6bf4ae9637 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 11b952a2-00e5-4c8d-9e31-d9b1221509a4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:26.456217 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-257ebfb3-4bd7-4ba5-93db-fc6bf4ae9637 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:26.458791 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-257ebfb3-4bd7-4ba5-93db-fc6bf4ae9637 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:26.462537 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-257ebfb3-4bd7-4ba5-93db-fc6bf4ae9637 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:26.463040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-257ebfb3-4bd7-4ba5-93db-fc6bf4ae9637 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:27.037108 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-257ebfb3-4bd7-4ba5-93db-fc6bf4ae9637 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:27.052428 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-257ebfb3-4bd7-4ba5-93db-fc6bf4ae9637 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4" status: 200 len: 1522 microversion: 2.1 time: 0.622155 Jul 31 01:45:27.055307 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2866/5760] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:26 2022] GET /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4 => generated 1522 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:27.357315 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d05ba0bd-f973-4a2a-9517-3c9061185b81 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:27.358097 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d05ba0bd-f973-4a2a-9517-3c9061185b81 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:27.381842 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d05ba0bd-f973-4a2a-9517-3c9061185b81 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:27.382409 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d05ba0bd-f973-4a2a-9517-3c9061185b81 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:27.383305 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d05ba0bd-f973-4a2a-9517-3c9061185b81 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:27.383883 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d05ba0bd-f973-4a2a-9517-3c9061185b81 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:27.834462 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d05ba0bd-f973-4a2a-9517-3c9061185b81 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:27.852852 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d05ba0bd-f973-4a2a-9517-3c9061185b81 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1223 microversion: 2.1 time: 0.493223 Jul 31 01:45:27.860163 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2895/5761] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:27 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1223 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:27.993954 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1c6998f6-ee9f-4e07-b364-06536e19e439 req-7f2539ca-fdac-4c60-8f9f-8499ec6ae910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b952a2-00e5-4c8d-9e31-d9b1221509a4", "name": "network-vif-deleted", "tag": "2fd0a62b-5d9d-4d85-819e-0cc1c8bb4e73"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:45:28.015454 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1c6998f6-ee9f-4e07-b364-06536e19e439 req-7f2539ca-fdac-4c60-8f9f-8499ec6ae910 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:28.018830 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1c6998f6-ee9f-4e07-b364-06536e19e439 req-7f2539ca-fdac-4c60-8f9f-8499ec6ae910 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:28.051165 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1c6998f6-ee9f-4e07-b364-06536e19e439 req-7f2539ca-fdac-4c60-8f9f-8499ec6ae910 service nova] Creating event network-vif-deleted:2fd0a62b-5d9d-4d85-819e-0cc1c8bb4e73 for instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 on n-h1-master-1 Jul 31 01:45:28.063906 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1c6998f6-ee9f-4e07-b364-06536e19e439 req-7f2539ca-fdac-4c60-8f9f-8499ec6ae910 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075045 Jul 31 01:45:28.065849 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2867/5762] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:45:28.079593 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c71a2199-e2c6-4c9b-90b8-8007a27cabf8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:28.080699 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c71a2199-e2c6-4c9b-90b8-8007a27cabf8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 11b952a2-00e5-4c8d-9e31-d9b1221509a4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:28.102503 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c71a2199-e2c6-4c9b-90b8-8007a27cabf8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:28.107866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c71a2199-e2c6-4c9b-90b8-8007a27cabf8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:28.108794 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c71a2199-e2c6-4c9b-90b8-8007a27cabf8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:28.111646 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c71a2199-e2c6-4c9b-90b8-8007a27cabf8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:28.240988 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c71a2199-e2c6-4c9b-90b8-8007a27cabf8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:28.255635 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c71a2199-e2c6-4c9b-90b8-8007a27cabf8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4" status: 200 len: 1308 microversion: 2.1 time: 0.175321 Jul 31 01:45:28.256877 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2896/5763] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:28 2022] GET /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4 => generated 1308 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:28.887763 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-97ace32f-bbf7-4ce0-9a71-626d4696da0d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:28.888929 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-97ace32f-bbf7-4ce0-9a71-626d4696da0d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:28.896548 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97ace32f-bbf7-4ce0-9a71-626d4696da0d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:28.897032 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97ace32f-bbf7-4ce0-9a71-626d4696da0d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:28.897986 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97ace32f-bbf7-4ce0-9a71-626d4696da0d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:28.898587 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97ace32f-bbf7-4ce0-9a71-626d4696da0d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:28.986029 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-97ace32f-bbf7-4ce0-9a71-626d4696da0d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:28.996897 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-97ace32f-bbf7-4ce0-9a71-626d4696da0d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1223 microversion: 2.1 time: 0.115176 Jul 31 01:45:28.998470 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2868/5764] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:28 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1223 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:29.284309 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d468ef75-c6e0-49de-bf8a-dbad1e1af66b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:29.285539 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d468ef75-c6e0-49de-bf8a-dbad1e1af66b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 11b952a2-00e5-4c8d-9e31-d9b1221509a4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:29.293829 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d468ef75-c6e0-49de-bf8a-dbad1e1af66b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:29.294532 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d468ef75-c6e0-49de-bf8a-dbad1e1af66b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:29.295509 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d468ef75-c6e0-49de-bf8a-dbad1e1af66b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:29.296115 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d468ef75-c6e0-49de-bf8a-dbad1e1af66b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:29.311137 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-d468ef75-c6e0-49de-bf8a-dbad1e1af66b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] HTTP exception thrown: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d468ef75-c6e0-49de-bf8a-dbad1e1af66b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Request method failure captured: Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4 HTTP/1.1 Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5d6dNtAtU27fib75KZT3YFP6DAvvXcYsOKFnWrHm7lq4oZUyk1PceL9yJNu7uINPKs_goHobZtO7vfsdyiHSQMmDbI51d4QgyDEXXJ9anKJ7esMAinQanf3IHlgep_pdeNQJL-kAfXsW-7oC6zsF3PY0azu6ZKDHnVc4NXkxN2ulq54 Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 35c85383076442a7ad717dcc18450380 Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35c85383076442a7ad717dcc18450380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35c85383076442a7ad717dcc18450380"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/35c85383076442a7ad717dcc18450380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_35c85383076442a7ad717dcc18450380", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 35c85383076442a7ad717dcc18450380 Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ListServersNegativeTestJSON-599914424-project Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f98c8a4c398b42179763fb7bcb73ab8a Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ListServersNegativeTestJSON-599914424-project Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '11b952a2-00e5-4c8d-9e31-d9b1221509a4'} Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:29.313502 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.318814 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:29.318814 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:29.318814 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:29.318814 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:45:29.318814 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:45:29.318814 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. Jul 31 01:45:29.318814 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.320068 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d468ef75-c6e0-49de-bf8a-dbad1e1af66b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Returning 404 to user: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:45:29.321094 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d468ef75-c6e0-49de-bf8a-dbad1e1af66b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4" status: 404 len: 111 microversion: 2.1 time: 0.046935 Jul 31 01:45:29.322182 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2897/5765] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:29 2022] GET /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:45:29.332201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-18fc2333-20d5-4575-bb31-c51aa50ae332 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:29.339809 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-18fc2333-20d5-4575-bb31-c51aa50ae332 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:29.341076 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-18fc2333-20d5-4575-bb31-c51aa50ae332 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '35c85383076442a7ad717dcc18450380'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:45:29.348468 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18fc2333-20d5-4575-bb31-c51aa50ae332 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:29.349403 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18fc2333-20d5-4575-bb31-c51aa50ae332 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:29.350820 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18fc2333-20d5-4575-bb31-c51aa50ae332 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:29.351659 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18fc2333-20d5-4575-bb31-c51aa50ae332 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:29.443775 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-18fc2333-20d5-4575-bb31-c51aa50ae332 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.116536 Jul 31 01:45:29.445298 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2869/5766] 10.222.0.45 () {58 vars in 1230 bytes} [Sun Jul 31 01:45:29 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:45:29.458436 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ffde13fd-7458-4cf0-81a9-5816ef1004e2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ffde13fd-7458-4cf0-81a9-5816ef1004e2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Request method failure captured: Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5d6dNtAtU27fib75KZT3YFP6DAvvXcYsOKFnWrHm7lq4oZUyk1PceL9yJNu7uINPKs_goHobZtO7vfsdyiHSQMmDbI51d4QgyDEXXJ9anKJ7esMAinQanf3IHlgep_pdeNQJL-kAfXsW-7oC6zsF3PY0azu6ZKDHnVc4NXkxN2ulq54 Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 35c85383076442a7ad717dcc18450380 Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35c85383076442a7ad717dcc18450380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35c85383076442a7ad717dcc18450380"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/35c85383076442a7ad717dcc18450380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_35c85383076442a7ad717dcc18450380", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 35c85383076442a7ad717dcc18450380 Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ListServersNegativeTestJSON-599914424-project Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f98c8a4c398b42179763fb7bcb73ab8a Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ListServersNegativeTestJSON-599914424-project Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: action_args: {} Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 31 01:45:29.462982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:45:29.469230 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:45:29.469230 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:45:29.469230 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:45:29.469230 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 31 01:45:29.469230 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.469230 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:29.469230 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.469230 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:29.469230 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:29.469230 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:29.469230 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:45:29.469230 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:45:29.469230 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 31 01:45:29.469230 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.471593 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ffde13fd-7458-4cf0-81a9-5816ef1004e2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:45:29.475916 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ffde13fd-7458-4cf0-81a9-5816ef1004e2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.019516 Jul 31 01:45:29.483003 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2898/5767] 10.222.0.45 () {58 vars in 1182 bytes} [Sun Jul 31 01:45:29 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:45:29.488807 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-178a0ba5-d93e-4db1-9fc5-171ef062eded tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:29.496131 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-178a0ba5-d93e-4db1-9fc5-171ef062eded tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:29.497070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-178a0ba5-d93e-4db1-9fc5-171ef062eded tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Searching by: {'deleted': False, 'project_id': '35c85383076442a7ad717dcc18450380'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:45:29.502861 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-178a0ba5-d93e-4db1-9fc5-171ef062eded tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:29.503615 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-178a0ba5-d93e-4db1-9fc5-171ef062eded tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:29.504607 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-178a0ba5-d93e-4db1-9fc5-171ef062eded tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:29.505318 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-178a0ba5-d93e-4db1-9fc5-171ef062eded tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:29.541026 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-178a0ba5-d93e-4db1-9fc5-171ef062eded tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:45:29.608613 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-178a0ba5-d93e-4db1-9fc5-171ef062eded tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.124332 Jul 31 01:45:29.609712 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2870/5768] 10.222.0.45 () {58 vars in 1125 bytes} [Sun Jul 31 01:45:29 2022] GET /compute/v2.1/servers => generated 683 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:45:29.621363 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-96abab58-1f24-4909-b1a0-74eebb5de35b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:29.626330 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-96abab58-1f24-4909-b1a0-74eebb5de35b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:29.627065 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.compute.servers [None req-96abab58-1f24-4909-b1a0-74eebb5de35b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Removing options 'limit' from query {{(pid=119475) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 31 01:45:29.628068 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-96abab58-1f24-4909-b1a0-74eebb5de35b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Searching by: {'deleted': False, 'project_id': '35c85383076442a7ad717dcc18450380'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:45:29.635073 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96abab58-1f24-4909-b1a0-74eebb5de35b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:29.636012 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96abab58-1f24-4909-b1a0-74eebb5de35b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:29.637606 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96abab58-1f24-4909-b1a0-74eebb5de35b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:29.638235 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96abab58-1f24-4909-b1a0-74eebb5de35b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:29.671114 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.multi_cell_list [None req-96abab58-1f24-4909-b1a0-74eebb5de35b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119475) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:45:29.732713 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-96abab58-1f24-4909-b1a0-74eebb5de35b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.115247 Jul 31 01:45:29.733331 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2899/5769] 10.222.0.45 () {58 vars in 1144 bytes} [Sun Jul 31 01:45:29 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:45:29.747223 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eb7a5022-15a1-4b61-b7a4-8f6851ccdf93 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eb7a5022-15a1-4b61-b7a4-8f6851ccdf93 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Request method failure captured: Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5d6dNtAtU27fib75KZT3YFP6DAvvXcYsOKFnWrHm7lq4oZUyk1PceL9yJNu7uINPKs_goHobZtO7vfsdyiHSQMmDbI51d4QgyDEXXJ9anKJ7esMAinQanf3IHlgep_pdeNQJL-kAfXsW-7oC6zsF3PY0azu6ZKDHnVc4NXkxN2ulq54 Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 35c85383076442a7ad717dcc18450380 Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35c85383076442a7ad717dcc18450380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35c85383076442a7ad717dcc18450380"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/35c85383076442a7ad717dcc18450380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_35c85383076442a7ad717dcc18450380", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 35c85383076442a7ad717dcc18450380 Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ListServersNegativeTestJSON-599914424-project Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f98c8a4c398b42179763fb7bcb73ab8a Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ListServersNegativeTestJSON-599914424-project Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: action_args: {} Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi '-1' Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 31 01:45:29.751665 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eb7a5022-15a1-4b61-b7a4-8f6851ccdf93 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eb7a5022-15a1-4b61-b7a4-8f6851ccdf93 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.010808 Jul 31 01:45:29.762999 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2871/5770] 10.222.0.45 () {58 vars in 1142 bytes} [Sun Jul 31 01:45:29 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:45:29.767874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-491ed0fd-5e21-4f18-969a-e9f2a1730973 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-491ed0fd-5e21-4f18-969a-e9f2a1730973 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Request method failure captured: Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5d6dNtAtU27fib75KZT3YFP6DAvvXcYsOKFnWrHm7lq4oZUyk1PceL9yJNu7uINPKs_goHobZtO7vfsdyiHSQMmDbI51d4QgyDEXXJ9anKJ7esMAinQanf3IHlgep_pdeNQJL-kAfXsW-7oC6zsF3PY0azu6ZKDHnVc4NXkxN2ulq54 Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 35c85383076442a7ad717dcc18450380 Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35c85383076442a7ad717dcc18450380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35c85383076442a7ad717dcc18450380"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/35c85383076442a7ad717dcc18450380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_35c85383076442a7ad717dcc18450380", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 35c85383076442a7ad717dcc18450380 Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ListServersNegativeTestJSON-599914424-project Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f98c8a4c398b42179763fb7bcb73ab8a Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ListServersNegativeTestJSON-599914424-project Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: action_args: {} Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise error Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi 'testing' Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 31 01:45:29.769435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-491ed0fd-5e21-4f18-969a-e9f2a1730973 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-491ed0fd-5e21-4f18-969a-e9f2a1730973 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.010682 Jul 31 01:45:29.779536 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2900/5771] 10.222.0.45 () {58 vars in 1152 bytes} [Sun Jul 31 01:45:29 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:45:29.783919 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c4ccbb9a-c5e3-4d71-b9ad-08f64a21b760 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:29.789466 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c4ccbb9a-c5e3-4d71-b9ad-08f64a21b760 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:29.790200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c4ccbb9a-c5e3-4d71-b9ad-08f64a21b760 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '35c85383076442a7ad717dcc18450380'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:45:29.798281 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.compute.servers [None req-c4ccbb9a-c5e3-4d71-b9ad-08f64a21b760 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Flavor 'non_existing_flavor' could not be found {{(pid=119474) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 31 01:45:29.799683 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c4ccbb9a-c5e3-4d71-b9ad-08f64a21b760 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.019190 Jul 31 01:45:29.808342 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2872/5772] 10.222.0.45 () {58 vars in 1178 bytes} [Sun Jul 31 01:45:29 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:45:29.813862 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d61f2f4a-5c80-4235-b6b2-10cb9f72d54c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:29.818740 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d61f2f4a-5c80-4235-b6b2-10cb9f72d54c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:29.819445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d61f2f4a-5c80-4235-b6b2-10cb9f72d54c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '35c85383076442a7ad717dcc18450380'} {{(pid=119475) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:45:29.840692 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d61f2f4a-5c80-4235-b6b2-10cb9f72d54c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:29.841157 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d61f2f4a-5c80-4235-b6b2-10cb9f72d54c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:29.841982 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d61f2f4a-5c80-4235-b6b2-10cb9f72d54c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:29.842432 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d61f2f4a-5c80-4235-b6b2-10cb9f72d54c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:29.958933 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d61f2f4a-5c80-4235-b6b2-10cb9f72d54c tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.148766 Jul 31 01:45:29.960607 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2901/5773] 10.222.0.45 () {58 vars in 1174 bytes} [Sun Jul 31 01:45:29 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:45:29.975167 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f4993c07-3020-47d6-bb5f-f040594e97f2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:29.981201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f4993c07-3020-47d6-bb5f-f040594e97f2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:29.981894 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f4993c07-3020-47d6-bb5f-f040594e97f2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '35c85383076442a7ad717dcc18450380'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:45:29.987479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4993c07-3020-47d6-bb5f-f040594e97f2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:29.987995 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4993c07-3020-47d6-bb5f-f040594e97f2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:29.989975 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4993c07-3020-47d6-bb5f-f040594e97f2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:29.990586 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4993c07-3020-47d6-bb5f-f040594e97f2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:30.019947 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-88578218-b5a1-487b-9596-5fd220c6b70a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:30.020582 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-88578218-b5a1-487b-9596-5fd220c6b70a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:30.031535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88578218-b5a1-487b-9596-5fd220c6b70a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:30.032077 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88578218-b5a1-487b-9596-5fd220c6b70a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:30.032937 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88578218-b5a1-487b-9596-5fd220c6b70a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:30.033452 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88578218-b5a1-487b-9596-5fd220c6b70a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:30.134292 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f4993c07-3020-47d6-bb5f-f040594e97f2 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.164990 Jul 31 01:45:30.139131 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2873/5774] 10.222.0.45 () {58 vars in 1184 bytes} [Sun Jul 31 01:45:29 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:45:30.152470 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9aef5c8e-42f8-47d6-bb53-cf8968d3b0f7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:30.166169 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9aef5c8e-42f8-47d6-bb53-cf8968d3b0f7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:30.167556 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9aef5c8e-42f8-47d6-bb53-cf8968d3b0f7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Searching by: {'deleted': False, 'project_id': '35c85383076442a7ad717dcc18450380'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:45:30.178597 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9aef5c8e-42f8-47d6-bb53-cf8968d3b0f7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:30.179538 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9aef5c8e-42f8-47d6-bb53-cf8968d3b0f7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:30.180538 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9aef5c8e-42f8-47d6-bb53-cf8968d3b0f7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:30.181186 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9aef5c8e-42f8-47d6-bb53-cf8968d3b0f7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:30.241610 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-9aef5c8e-42f8-47d6-bb53-cf8968d3b0f7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:45:30.334664 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9aef5c8e-42f8-47d6-bb53-cf8968d3b0f7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:30.342187 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9aef5c8e-42f8-47d6-bb53-cf8968d3b0f7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:30.342656 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9aef5c8e-42f8-47d6-bb53-cf8968d3b0f7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:30.583666 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88578218-b5a1-487b-9596-5fd220c6b70a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:30.584139 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88578218-b5a1-487b-9596-5fd220c6b70a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:30.584698 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-88578218-b5a1-487b-9596-5fd220c6b70a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lazy-loading 'fault' on Instance uuid cb49b7d2-7bca-4738-b236-dafb09128705 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:45:30.670634 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-88578218-b5a1-487b-9596-5fd220c6b70a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:30.677759 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-88578218-b5a1-487b-9596-5fd220c6b70a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 200 len: 1182 microversion: 2.1 time: 0.662957 Jul 31 01:45:30.686606 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2902/5775] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:30 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 1182 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:30.763936 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9aef5c8e-42f8-47d6-bb53-cf8968d3b0f7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.615365 Jul 31 01:45:30.764703 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2874/5776] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:45:30 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:45:30.789850 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-74b541c1-0566-4d42-b31b-98c0f4b8f280 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:30.795533 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-74b541c1-0566-4d42-b31b-98c0f4b8f280 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:30.798091 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-74b541c1-0566-4d42-b31b-98c0f4b8f280 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.012833 Jul 31 01:45:30.806472 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2903/5777] 10.222.0.45 () {58 vars in 1178 bytes} [Sun Jul 31 01:45:30 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:45:30.813259 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9075d7d0-5dde-4c0f-8fa4-902ec08c6760 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:30.824778 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9075d7d0-5dde-4c0f-8fa4-902ec08c6760 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:30.825731 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9075d7d0-5dde-4c0f-8fa4-902ec08c6760 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Searching by: {'deleted': False, 'project_id': '35c85383076442a7ad717dcc18450380'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 01:45:30.839049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9075d7d0-5dde-4c0f-8fa4-902ec08c6760 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:30.840208 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9075d7d0-5dde-4c0f-8fa4-902ec08c6760 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:30.841181 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9075d7d0-5dde-4c0f-8fa4-902ec08c6760 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:30.841896 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9075d7d0-5dde-4c0f-8fa4-902ec08c6760 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:30.884543 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-9075d7d0-5dde-4c0f-8fa4-902ec08c6760 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 01:45:30.930106 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9075d7d0-5dde-4c0f-8fa4-902ec08c6760 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.120950 Jul 31 01:45:30.939589 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2875/5778] 10.222.0.45 () {58 vars in 1125 bytes} [Sun Jul 31 01:45:30 2022] GET /compute/v2.1/servers => generated 683 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:45:30.944671 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8ad5d58b-7ee3-470c-afce-17412a68fc4b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:30.945195 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8ad5d58b-7ee3-470c-afce-17412a68fc4b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 11b952a2-00e5-4c8d-9e31-d9b1221509a4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:30.952643 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ad5d58b-7ee3-470c-afce-17412a68fc4b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:30.953107 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ad5d58b-7ee3-470c-afce-17412a68fc4b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:30.953905 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ad5d58b-7ee3-470c-afce-17412a68fc4b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:30.954352 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ad5d58b-7ee3-470c-afce-17412a68fc4b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:30.974100 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-8ad5d58b-7ee3-470c-afce-17412a68fc4b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] HTTP exception thrown: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8ad5d58b-7ee3-470c-afce-17412a68fc4b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Request method failure captured: Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4 HTTP/1.1 Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5d6dNtAtU27fib75KZT3YFP6DAvvXcYsOKFnWrHm7lq4oZUyk1PceL9yJNu7uINPKs_goHobZtO7vfsdyiHSQMmDbI51d4QgyDEXXJ9anKJ7esMAinQanf3IHlgep_pdeNQJL-kAfXsW-7oC6zsF3PY0azu6ZKDHnVc4NXkxN2ulq54 Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 35c85383076442a7ad717dcc18450380 Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35c85383076442a7ad717dcc18450380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35c85383076442a7ad717dcc18450380"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/35c85383076442a7ad717dcc18450380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_35c85383076442a7ad717dcc18450380", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 35c85383076442a7ad717dcc18450380 Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ListServersNegativeTestJSON-599914424-project Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f98c8a4c398b42179763fb7bcb73ab8a Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ListServersNegativeTestJSON-599914424-project Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '11b952a2-00e5-4c8d-9e31-d9b1221509a4'} Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:45:30.975933 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:45:30.979178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. Jul 31 01:45:30.979178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:30.979178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:30.979178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:30.979178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:30.979178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:30.979178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:30.979178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:45:30.979178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:45:30.979178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. Jul 31 01:45:30.979178 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:30.980966 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8ad5d58b-7ee3-470c-afce-17412a68fc4b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Returning 404 to user: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:45:30.981976 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8ad5d58b-7ee3-470c-afce-17412a68fc4b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "DELETE /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4" status: 404 len: 111 microversion: 2.1 time: 0.041476 Jul 31 01:45:30.983035 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2904/5779] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:45:30 2022] DELETE /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:45:30.993507 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b7375433-f56f-48bc-ad90-47032d30304b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:30.994166 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b7375433-f56f-48bc-ad90-47032d30304b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 492355b1-3994-4187-b3d5-14303050e9aa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:31.002419 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7375433-f56f-48bc-ad90-47032d30304b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:31.003083 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7375433-f56f-48bc-ad90-47032d30304b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:31.004092 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7375433-f56f-48bc-ad90-47032d30304b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:31.005368 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b7375433-f56f-48bc-ad90-47032d30304b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:31.063896 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b7375433-f56f-48bc-ad90-47032d30304b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 492355b1-3994-4187-b3d5-14303050e9aa] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:45:31.158882 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b7375433-f56f-48bc-ad90-47032d30304b tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "DELETE /compute/v2.1/servers/492355b1-3994-4187-b3d5-14303050e9aa" status: 204 len: 0 microversion: 2.1 time: 0.171029 Jul 31 01:45:31.160868 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2876/5780] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:45:30 2022] DELETE /compute/v2.1/servers/492355b1-3994-4187-b3d5-14303050e9aa => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:45:31.168712 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-03ab2d20-6adc-41b4-b5b4-643a88ce26c3 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:31.169433 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-03ab2d20-6adc-41b4-b5b4-643a88ce26c3 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:31.175703 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03ab2d20-6adc-41b4-b5b4-643a88ce26c3 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:31.176170 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03ab2d20-6adc-41b4-b5b4-643a88ce26c3 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:31.177014 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03ab2d20-6adc-41b4-b5b4-643a88ce26c3 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:31.177466 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03ab2d20-6adc-41b4-b5b4-643a88ce26c3 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:31.204201 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-03ab2d20-6adc-41b4-b5b4-643a88ce26c3 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:45:31.287663 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:31.299971 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-03ab2d20-6adc-41b4-b5b4-643a88ce26c3 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 204 len: 0 microversion: 2.1 time: 0.133562 Jul 31 01:45:31.300889 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2905/5781] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:45:31 2022] DELETE /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:45:31.310132 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fe89cf83-d705-4a0c-b071-182b450b4fc8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:31.311067 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fe89cf83-d705-4a0c-b071-182b450b4fc8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 11b952a2-00e5-4c8d-9e31-d9b1221509a4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:31.317476 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe89cf83-d705-4a0c-b071-182b450b4fc8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:31.318128 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe89cf83-d705-4a0c-b071-182b450b4fc8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:31.319074 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe89cf83-d705-4a0c-b071-182b450b4fc8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:31.321073 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fe89cf83-d705-4a0c-b071-182b450b4fc8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:31.338687 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-fe89cf83-d705-4a0c-b071-182b450b4fc8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] HTTP exception thrown: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fe89cf83-d705-4a0c-b071-182b450b4fc8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Request method failure captured: Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4 HTTP/1.1 Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5d6dNtAtU27fib75KZT3YFP6DAvvXcYsOKFnWrHm7lq4oZUyk1PceL9yJNu7uINPKs_goHobZtO7vfsdyiHSQMmDbI51d4QgyDEXXJ9anKJ7esMAinQanf3IHlgep_pdeNQJL-kAfXsW-7oC6zsF3PY0azu6ZKDHnVc4NXkxN2ulq54 Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 35c85383076442a7ad717dcc18450380 Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35c85383076442a7ad717dcc18450380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35c85383076442a7ad717dcc18450380"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/35c85383076442a7ad717dcc18450380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_35c85383076442a7ad717dcc18450380", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 35c85383076442a7ad717dcc18450380 Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ListServersNegativeTestJSON-599914424-project Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f98c8a4c398b42179763fb7bcb73ab8a Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ListServersNegativeTestJSON-599914424-project Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '11b952a2-00e5-4c8d-9e31-d9b1221509a4'} Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:31.341549 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:31.344758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:31.344758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:31.344758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:31.344758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:45:31.344758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:45:31.344758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. Jul 31 01:45:31.344758 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:31.346030 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fe89cf83-d705-4a0c-b071-182b450b4fc8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Returning 404 to user: Instance 11b952a2-00e5-4c8d-9e31-d9b1221509a4 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:45:31.347076 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fe89cf83-d705-4a0c-b071-182b450b4fc8 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4" status: 404 len: 111 microversion: 2.1 time: 0.041941 Jul 31 01:45:31.347808 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2877/5782] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:31 2022] GET /compute/v2.1/servers/11b952a2-00e5-4c8d-9e31-d9b1221509a4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:45:31.356913 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-45cc488c-27e4-4d9a-aec0-08c5d451d50f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:31.358328 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-45cc488c-27e4-4d9a-aec0-08c5d451d50f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 492355b1-3994-4187-b3d5-14303050e9aa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:31.367290 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45cc488c-27e4-4d9a-aec0-08c5d451d50f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:31.367814 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45cc488c-27e4-4d9a-aec0-08c5d451d50f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:31.369380 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45cc488c-27e4-4d9a-aec0-08c5d451d50f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:31.369380 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45cc488c-27e4-4d9a-aec0-08c5d451d50f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:31.690934 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-45cc488c-27e4-4d9a-aec0-08c5d451d50f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:31.701058 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-45cc488c-27e4-4d9a-aec0-08c5d451d50f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/492355b1-3994-4187-b3d5-14303050e9aa" status: 200 len: 1522 microversion: 2.1 time: 0.348722 Jul 31 01:45:31.702399 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2906/5783] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:31 2022] GET /compute/v2.1/servers/492355b1-3994-4187-b3d5-14303050e9aa => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:45:31.705716 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-88a22c91-e6b1-442d-92a0-498fd0808a84 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:31.707376 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-88a22c91-e6b1-442d-92a0-498fd0808a84 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:31.721025 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88a22c91-e6b1-442d-92a0-498fd0808a84 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:31.721713 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88a22c91-e6b1-442d-92a0-498fd0808a84 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:31.722703 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88a22c91-e6b1-442d-92a0-498fd0808a84 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:31.723367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88a22c91-e6b1-442d-92a0-498fd0808a84 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:31.738873 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-88a22c91-e6b1-442d-92a0-498fd0808a84 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] HTTP exception thrown: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-88a22c91-e6b1-442d-92a0-498fd0808a84 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Request method failure captured: Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 HTTP/1.1 Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dxSWPHv6fiyygfwJR0Ud9gfexnY8DUg1-8n2-EFdlhief1Py8PV4RaH4l0q6aYBanPQ6exn-4iFCGEMH9hqgo4PPVedzZNUDT2YTEgYd9iPN8Zs4wyM3F4Cgzs_D-0CTqdk8e-lZRIuuB9WjXa7g4L7rW4yad6wf_BUOJQbjcH4WNc Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f0892e5f98e48408d15771c9d5805bf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestVolumeBootPattern-640389583 Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f6c26df9a49446c290d6a0b1427f0c14 Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: exception: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'cb49b7d2-7bca-4738-b236-dafb09128705'} Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:31.740840 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:31.744312 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:31.744312 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:31.744312 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:31.744312 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:45:31.744312 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:45:31.744312 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. Jul 31 01:45:31.744312 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:31.746663 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-88a22c91-e6b1-442d-92a0-498fd0808a84 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Returning 404 to user: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:45:31.747881 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-88a22c91-e6b1-442d-92a0-498fd0808a84 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 404 len: 111 microversion: 2.1 time: 0.050539 Jul 31 01:45:31.749106 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2878/5784] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:31 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:45:31.939763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-10a69a1a-39d8-4cff-88bb-c71fcebbfdd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-833959033", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-314743935", "security_groups": [{"name": "tempest-secgroup-smoke-405411779"}], "block_device_mapping_v2": [{"uuid": "104e185c-6029-4f66-b112-dc8e06a8574d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6739ac5e-7d06-4b25-b7ed-29fa35326c6e"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:45:32.208247 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-10a69a1a-39d8-4cff-88bb-c71fcebbfdd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] validate_networks() for [('6739ac5e-7d06-4b25-b7ed-29fa35326c6e', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:45:32.725099 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-012e1ee9-fba3-47bf-9bbd-17476c108b8e tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:32.725888 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-012e1ee9-fba3-47bf-9bbd-17476c108b8e tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 492355b1-3994-4187-b3d5-14303050e9aa] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:32.744543 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-012e1ee9-fba3-47bf-9bbd-17476c108b8e tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:32.745693 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-012e1ee9-fba3-47bf-9bbd-17476c108b8e tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:32.746675 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-012e1ee9-fba3-47bf-9bbd-17476c108b8e tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:32.747588 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-012e1ee9-fba3-47bf-9bbd-17476c108b8e tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:32.766998 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:33.610348 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-012e1ee9-fba3-47bf-9bbd-17476c108b8e tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:33.618899 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-012e1ee9-fba3-47bf-9bbd-17476c108b8e tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/492355b1-3994-4187-b3d5-14303050e9aa" status: 200 len: 1522 microversion: 2.1 time: 0.897969 Jul 31 01:45:33.620160 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2879/5785] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:32 2022] GET /compute/v2.1/servers/492355b1-3994-4187-b3d5-14303050e9aa => generated 1522 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:45:34.090872 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-10a69a1a-39d8-4cff-88bb-c71fcebbfdd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:45:34.091375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-10a69a1a-39d8-4cff-88bb-c71fcebbfdd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:45:34.091841 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-10a69a1a-39d8-4cff-88bb-c71fcebbfdd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:45:34.092505 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-10a69a1a-39d8-4cff-88bb-c71fcebbfdd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:45:34.093217 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-10a69a1a-39d8-4cff-88bb-c71fcebbfdd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:45:34.105744 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10a69a1a-39d8-4cff-88bb-c71fcebbfdd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:34.111985 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10a69a1a-39d8-4cff-88bb-c71fcebbfdd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:34.113188 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10a69a1a-39d8-4cff-88bb-c71fcebbfdd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:34.113836 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10a69a1a-39d8-4cff-88bb-c71fcebbfdd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:34.142742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-10a69a1a-39d8-4cff-88bb-c71fcebbfdd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:45:34.149488 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-10a69a1a-39d8-4cff-88bb-c71fcebbfdd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for user f6c26df9a49446c290d6a0b1427f0c14 and project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:45:34.234867 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-10a69a1a-39d8-4cff-88bb-c71fcebbfdd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:45:34.237759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-10a69a1a-39d8-4cff-88bb-c71fcebbfdd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='104e185c-6029-4f66-b112-dc8e06a8574d',volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:45:34.447332 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-10a69a1a-39d8-4cff-88bb-c71fcebbfdd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.514275 Jul 31 01:45:34.448734 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2907/5786] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:45:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 2516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:45:34.459418 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e6dd110e-472a-49c7-9733-00102d6cfb76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:34.461310 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e6dd110e-472a-49c7-9733-00102d6cfb76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:34.616500 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e6dd110e-472a-49c7-9733-00102d6cfb76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:34.625553 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e6dd110e-472a-49c7-9733-00102d6cfb76 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1093 microversion: 2.1 time: 0.170034 Jul 31 01:45:34.639755 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2880/5787] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:34 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1093 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:34.641080 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1c517653-eea1-483a-abde-5a586b4df3d5 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:34.641726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1c517653-eea1-483a-abde-5a586b4df3d5 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 492355b1-3994-4187-b3d5-14303050e9aa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:34.650101 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c517653-eea1-483a-abde-5a586b4df3d5 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:34.650580 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c517653-eea1-483a-abde-5a586b4df3d5 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:34.661434 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c517653-eea1-483a-abde-5a586b4df3d5 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:34.661922 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c517653-eea1-483a-abde-5a586b4df3d5 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:34.813101 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-2a026ac5-197c-4abe-bbf9-1d097b226c0e req-18cb3ad0-e9c1-4d15-81dd-73e91f891947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6fd310-1020-440e-839c-de3cb2b9dc4e", "name": "network-vif-deleted", "tag": "8024f69b-2332-48d1-b8bd-4d7d959bfdbb"}, {"server_uuid": "492355b1-3994-4187-b3d5-14303050e9aa", "name": "network-vif-deleted", "tag": "51ae495b-0aa2-4152-b1ee-0e17d7bb5b30"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:45:34.834971 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2a026ac5-197c-4abe-bbf9-1d097b226c0e req-18cb3ad0-e9c1-4d15-81dd-73e91f891947 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:34.836078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2a026ac5-197c-4abe-bbf9-1d097b226c0e req-18cb3ad0-e9c1-4d15-81dd-73e91f891947 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:34.861215 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-2a026ac5-197c-4abe-bbf9-1d097b226c0e req-18cb3ad0-e9c1-4d15-81dd-73e91f891947 service nova] Creating event network-vif-deleted:8024f69b-2332-48d1-b8bd-4d7d959bfdbb for instance 4a6fd310-1020-440e-839c-de3cb2b9dc4e on n-h1-master-1 Jul 31 01:45:34.861945 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-2a026ac5-197c-4abe-bbf9-1d097b226c0e req-18cb3ad0-e9c1-4d15-81dd-73e91f891947 service nova] Creating event network-vif-deleted:51ae495b-0aa2-4152-b1ee-0e17d7bb5b30 for instance 492355b1-3994-4187-b3d5-14303050e9aa on n-h2-master-1 Jul 31 01:45:34.873182 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-2a026ac5-197c-4abe-bbf9-1d097b226c0e req-18cb3ad0-e9c1-4d15-81dd-73e91f891947 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066390 Jul 31 01:45:34.874762 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2881/5788] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:45:34.885211 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1c517653-eea1-483a-abde-5a586b4df3d5 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c8a4c398b42179763fb7bcb73ab8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c85383076442a7ad717dcc18450380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:34.906675 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1c517653-eea1-483a-abde-5a586b4df3d5 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/492355b1-3994-4187-b3d5-14303050e9aa" status: 200 len: 1480 microversion: 2.1 time: 0.265996 Jul 31 01:45:34.924375 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2908/5789] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:34 2022] GET /compute/v2.1/servers/492355b1-3994-4187-b3d5-14303050e9aa => generated 1480 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:35.647395 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-90e0766b-3a64-47c5-adf7-6467a97bdb52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:35.648213 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-90e0766b-3a64-47c5-adf7-6467a97bdb52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:35.654743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90e0766b-3a64-47c5-adf7-6467a97bdb52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:35.655223 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90e0766b-3a64-47c5-adf7-6467a97bdb52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:35.656116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90e0766b-3a64-47c5-adf7-6467a97bdb52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:35.656576 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90e0766b-3a64-47c5-adf7-6467a97bdb52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:35.740330 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-90e0766b-3a64-47c5-adf7-6467a97bdb52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:35.749116 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-90e0766b-3a64-47c5-adf7-6467a97bdb52 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1191 microversion: 2.1 time: 0.106630 Jul 31 01:45:35.749701 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2882/5790] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:35 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1191 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:35.931112 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e841d45d-a4d1-4504-a906-7935b289d6c7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:35.931938 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e841d45d-a4d1-4504-a906-7935b289d6c7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 492355b1-3994-4187-b3d5-14303050e9aa] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:35.940484 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e841d45d-a4d1-4504-a906-7935b289d6c7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:35.941245 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e841d45d-a4d1-4504-a906-7935b289d6c7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:35.942354 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e841d45d-a4d1-4504-a906-7935b289d6c7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:35.943480 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e841d45d-a4d1-4504-a906-7935b289d6c7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:35.962747 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-e841d45d-a4d1-4504-a906-7935b289d6c7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] HTTP exception thrown: Instance 492355b1-3994-4187-b3d5-14303050e9aa could not be found. Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e841d45d-a4d1-4504-a906-7935b289d6c7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Request method failure captured: Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/492355b1-3994-4187-b3d5-14303050e9aa HTTP/1.1 Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5d6dNtAtU27fib75KZT3YFP6DAvvXcYsOKFnWrHm7lq4oZUyk1PceL9yJNu7uINPKs_goHobZtO7vfsdyiHSQMmDbI51d4QgyDEXXJ9anKJ7esMAinQanf3IHlgep_pdeNQJL-kAfXsW-7oC6zsF3PY0azu6ZKDHnVc4NXkxN2ulq54 Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 35c85383076442a7ad717dcc18450380 Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35c85383076442a7ad717dcc18450380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35c85383076442a7ad717dcc18450380"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/35c85383076442a7ad717dcc18450380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_35c85383076442a7ad717dcc18450380", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 35c85383076442a7ad717dcc18450380 Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ListServersNegativeTestJSON-599914424-project Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f98c8a4c398b42179763fb7bcb73ab8a Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ListServersNegativeTestJSON-599914424-project Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 492355b1-3994-4187-b3d5-14303050e9aa could not be found. Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '492355b1-3994-4187-b3d5-14303050e9aa'} Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 492355b1-3994-4187-b3d5-14303050e9aa could not be found. Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 492355b1-3994-4187-b3d5-14303050e9aa could not be found. Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:35.964899 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:35.968095 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:35.968095 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:35.968095 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:35.968095 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:45:35.968095 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:45:35.968095 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 492355b1-3994-4187-b3d5-14303050e9aa could not be found. Jul 31 01:45:35.968095 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:35.969729 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e841d45d-a4d1-4504-a906-7935b289d6c7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Returning 404 to user: Instance 492355b1-3994-4187-b3d5-14303050e9aa could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:45:35.970657 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e841d45d-a4d1-4504-a906-7935b289d6c7 tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/492355b1-3994-4187-b3d5-14303050e9aa" status: 404 len: 111 microversion: 2.1 time: 0.043914 Jul 31 01:45:35.971307 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2909/5791] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:35 2022] GET /compute/v2.1/servers/492355b1-3994-4187-b3d5-14303050e9aa => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:45:35.984593 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-087277b7-5638-42ec-a4a0-8ac75f30e55f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:35.985711 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-087277b7-5638-42ec-a4a0-8ac75f30e55f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] [instance: 4a6fd310-1020-440e-839c-de3cb2b9dc4e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:35.999460 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-087277b7-5638-42ec-a4a0-8ac75f30e55f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:36.000197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-087277b7-5638-42ec-a4a0-8ac75f30e55f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:36.001214 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-087277b7-5638-42ec-a4a0-8ac75f30e55f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:36.005612 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-087277b7-5638-42ec-a4a0-8ac75f30e55f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:36.021970 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-087277b7-5638-42ec-a4a0-8ac75f30e55f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] HTTP exception thrown: Instance 4a6fd310-1020-440e-839c-de3cb2b9dc4e could not be found. Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-087277b7-5638-42ec-a4a0-8ac75f30e55f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Request method failure captured: Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e HTTP/1.1 Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5d6dNtAtU27fib75KZT3YFP6DAvvXcYsOKFnWrHm7lq4oZUyk1PceL9yJNu7uINPKs_goHobZtO7vfsdyiHSQMmDbI51d4QgyDEXXJ9anKJ7esMAinQanf3IHlgep_pdeNQJL-kAfXsW-7oC6zsF3PY0azu6ZKDHnVc4NXkxN2ulq54 Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 35c85383076442a7ad717dcc18450380 Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35c85383076442a7ad717dcc18450380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/35c85383076442a7ad717dcc18450380"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/35c85383076442a7ad717dcc18450380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_35c85383076442a7ad717dcc18450380", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 35c85383076442a7ad717dcc18450380 Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-599914424 Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ListServersNegativeTestJSON-599914424-project Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f98c8a4c398b42179763fb7bcb73ab8a Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ListServersNegativeTestJSON-599914424-project Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 4a6fd310-1020-440e-839c-de3cb2b9dc4e could not be found. Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '4a6fd310-1020-440e-839c-de3cb2b9dc4e'} Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a6fd310-1020-440e-839c-de3cb2b9dc4e could not be found. Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a6fd310-1020-440e-839c-de3cb2b9dc4e could not be found. Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:36.024079 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:36.027607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:36.027607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:36.027607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:36.027607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:45:36.027607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:45:36.027607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a6fd310-1020-440e-839c-de3cb2b9dc4e could not be found. Jul 31 01:45:36.027607 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:36.027607 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-087277b7-5638-42ec-a4a0-8ac75f30e55f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] Returning 404 to user: Instance 4a6fd310-1020-440e-839c-de3cb2b9dc4e could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:45:36.027607 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-087277b7-5638-42ec-a4a0-8ac75f30e55f tempest-ListServersNegativeTestJSON-599914424 tempest-ListServersNegativeTestJSON-599914424-project] 10.222.0.45 "GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e" status: 404 len: 111 microversion: 2.1 time: 0.049233 Jul 31 01:45:36.033392 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2883/5792] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:35 2022] GET /compute/v2.1/servers/4a6fd310-1020-440e-839c-de3cb2b9dc4e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:45:36.772665 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b87ac496-75dd-4cac-856b-91a03eb06a86 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:36.773362 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b87ac496-75dd-4cac-856b-91a03eb06a86 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:36.790050 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b87ac496-75dd-4cac-856b-91a03eb06a86 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:36.790870 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b87ac496-75dd-4cac-856b-91a03eb06a86 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:36.791945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b87ac496-75dd-4cac-856b-91a03eb06a86 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:36.792579 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b87ac496-75dd-4cac-856b-91a03eb06a86 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:36.978720 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b87ac496-75dd-4cac-856b-91a03eb06a86 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:36.989069 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b87ac496-75dd-4cac-856b-91a03eb06a86 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1209 microversion: 2.1 time: 0.222838 Jul 31 01:45:36.990773 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2910/5793] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:36 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1209 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:38.281340 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2fd08d5c-649a-4167-a4d6-0f798563765b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:38.282000 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2fd08d5c-649a-4167-a4d6-0f798563765b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:38.296185 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2fd08d5c-649a-4167-a4d6-0f798563765b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:38.296881 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2fd08d5c-649a-4167-a4d6-0f798563765b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:38.298867 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2fd08d5c-649a-4167-a4d6-0f798563765b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:38.299369 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2fd08d5c-649a-4167-a4d6-0f798563765b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:38.936456 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2fd08d5c-649a-4167-a4d6-0f798563765b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:38.946602 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2fd08d5c-649a-4167-a4d6-0f798563765b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1276 microversion: 2.1 time: 0.937403 Jul 31 01:45:38.967393 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2884/5794] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:38 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1276 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:39.984920 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d4be88e2-257a-4920-af0f-16186444afad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:39.986802 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d4be88e2-257a-4920-af0f-16186444afad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:40.006134 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4be88e2-257a-4920-af0f-16186444afad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:40.012363 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4be88e2-257a-4920-af0f-16186444afad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:40.014842 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4be88e2-257a-4920-af0f-16186444afad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:40.015476 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4be88e2-257a-4920-af0f-16186444afad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:40.084474 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-a49e93fc-22dd-4c80-88bb-4e75631e2221 req-24e3b903-52e0-4250-94a4-c201623f3b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5185fc2-3256-4435-bf3a-282e4c1b9a8d", "tag": "43fbaaab-d6fb-4b30-9eb7-5fd66c0a92f2"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:45:40.114439 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a49e93fc-22dd-4c80-88bb-4e75631e2221 req-24e3b903-52e0-4250-94a4-c201623f3b61 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:40.115157 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a49e93fc-22dd-4c80-88bb-4e75631e2221 req-24e3b903-52e0-4250-94a4-c201623f3b61 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:40.146622 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-a49e93fc-22dd-4c80-88bb-4e75631e2221 req-24e3b903-52e0-4250-94a4-c201623f3b61 service nova] Creating event network-changed:43fbaaab-d6fb-4b30-9eb7-5fd66c0a92f2 for instance c5185fc2-3256-4435-bf3a-282e4c1b9a8d on n-h1-master-1 Jul 31 01:45:40.161942 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-a49e93fc-22dd-4c80-88bb-4e75631e2221 req-24e3b903-52e0-4250-94a4-c201623f3b61 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081906 Jul 31 01:45:40.166458 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2885/5795] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:45:40.617253 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d4be88e2-257a-4920-af0f-16186444afad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:40.632337 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d4be88e2-257a-4920-af0f-16186444afad tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1276 microversion: 2.1 time: 0.651361 Jul 31 01:45:40.648460 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2911/5796] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:39 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1276 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:41.661286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aded1521-0f15-4cc3-8a0d-acdb5535d043 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:41.663758 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aded1521-0f15-4cc3-8a0d-acdb5535d043 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:41.670857 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=10 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:41.673995 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aded1521-0f15-4cc3-8a0d-acdb5535d043 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:41.674633 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aded1521-0f15-4cc3-8a0d-acdb5535d043 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:41.675965 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aded1521-0f15-4cc3-8a0d-acdb5535d043 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:41.676579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aded1521-0f15-4cc3-8a0d-acdb5535d043 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:41.978021 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-aded1521-0f15-4cc3-8a0d-acdb5535d043 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:41.995238 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aded1521-0f15-4cc3-8a0d-acdb5535d043 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1276 microversion: 2.1 time: 0.340222 Jul 31 01:45:41.996383 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2886/5797] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:41 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1276 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:43.023284 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-05e05c16-47b2-429f-8541-48426cec10bb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:43.024456 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-05e05c16-47b2-429f-8541-48426cec10bb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:43.039772 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05e05c16-47b2-429f-8541-48426cec10bb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:43.041423 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05e05c16-47b2-429f-8541-48426cec10bb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:43.044021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05e05c16-47b2-429f-8541-48426cec10bb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:43.044634 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05e05c16-47b2-429f-8541-48426cec10bb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:43.104360 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:43.505675 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-05e05c16-47b2-429f-8541-48426cec10bb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:43.517953 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-05e05c16-47b2-429f-8541-48426cec10bb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1276 microversion: 2.1 time: 0.503524 Jul 31 01:45:43.518621 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2912/5798] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:43 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1276 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:44.540662 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4d16abfd-bd6e-46d6-827f-ccdf1e7a479d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:44.541810 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4d16abfd-bd6e-46d6-827f-ccdf1e7a479d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:44.561579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d16abfd-bd6e-46d6-827f-ccdf1e7a479d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:44.564037 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d16abfd-bd6e-46d6-827f-ccdf1e7a479d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:44.564923 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d16abfd-bd6e-46d6-827f-ccdf1e7a479d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:44.565393 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d16abfd-bd6e-46d6-827f-ccdf1e7a479d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:44.625795 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:44.827157 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4d16abfd-bd6e-46d6-827f-ccdf1e7a479d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:44.838945 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4d16abfd-bd6e-46d6-827f-ccdf1e7a479d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1264 microversion: 2.1 time: 0.304360 Jul 31 01:45:44.844185 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2887/5799] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:44 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1264 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:45.869138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-30b02312-a216-464f-9623-4ce3b8fd1a82 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:45.870629 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-30b02312-a216-464f-9623-4ce3b8fd1a82 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:45.874518 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:45.884562 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:45.893221 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30b02312-a216-464f-9623-4ce3b8fd1a82 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:45.893697 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30b02312-a216-464f-9623-4ce3b8fd1a82 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:45.899193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30b02312-a216-464f-9623-4ce3b8fd1a82 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:45.899779 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30b02312-a216-464f-9623-4ce3b8fd1a82 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:46.376983 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-30b02312-a216-464f-9623-4ce3b8fd1a82 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:46.390778 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-30b02312-a216-464f-9623-4ce3b8fd1a82 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1264 microversion: 2.1 time: 0.526405 Jul 31 01:45:46.399665 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2913/5800] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:45 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1264 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:47.412202 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1265b025-99fa-4467-b813-275a25e7eb59 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:47.412835 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1265b025-99fa-4467-b813-275a25e7eb59 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:47.425448 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1265b025-99fa-4467-b813-275a25e7eb59 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:47.427945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1265b025-99fa-4467-b813-275a25e7eb59 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:47.431098 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1265b025-99fa-4467-b813-275a25e7eb59 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:47.437244 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1265b025-99fa-4467-b813-275a25e7eb59 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:47.468549 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0bc24a44-6027-4522-a4be-8407beb966be tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:47.469079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0bc24a44-6027-4522-a4be-8407beb966be tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:47.482045 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0bc24a44-6027-4522-a4be-8407beb966be tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:47.482844 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0bc24a44-6027-4522-a4be-8407beb966be tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:47.487830 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0bc24a44-6027-4522-a4be-8407beb966be tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:47.488556 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0bc24a44-6027-4522-a4be-8407beb966be tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:47.572269 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0bc24a44-6027-4522-a4be-8407beb966be tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:45:47.762979 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0bc24a44-6027-4522-a4be-8407beb966be tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 204 len: 0 microversion: 2.1 time: 0.653305 Jul 31 01:45:47.764031 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2888/5801] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:45:47 2022] DELETE /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:45:47.781678 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1aa32aa4-acab-4a20-b85d-5c0f6927646d tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:47.782394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1aa32aa4-acab-4a20-b85d-5c0f6927646d tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:47.799221 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1aa32aa4-acab-4a20-b85d-5c0f6927646d tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:47.799826 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1aa32aa4-acab-4a20-b85d-5c0f6927646d tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:47.800610 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1aa32aa4-acab-4a20-b85d-5c0f6927646d tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:47.801064 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1aa32aa4-acab-4a20-b85d-5c0f6927646d tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:47.891384 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1265b025-99fa-4467-b813-275a25e7eb59 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:47.905056 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1265b025-99fa-4467-b813-275a25e7eb59 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1264 microversion: 2.1 time: 0.495384 Jul 31 01:45:47.923233 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2914/5802] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:47 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1264 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:48.291549 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1aa32aa4-acab-4a20-b85d-5c0f6927646d tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdca92e5eb6e4b3dab4900b42f896050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3de71380c941dcb2d2ba9e671ceb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:48.319996 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1aa32aa4-acab-4a20-b85d-5c0f6927646d tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 200 len: 1732 microversion: 2.1 time: 0.536303 Jul 31 01:45:48.335758 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2889/5803] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:47 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 1732 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:45:48.932190 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8ec14d3b-30b8-47bc-8f7b-1dbf08d6976e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:48.934258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8ec14d3b-30b8-47bc-8f7b-1dbf08d6976e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:48.951510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ec14d3b-30b8-47bc-8f7b-1dbf08d6976e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:48.952164 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ec14d3b-30b8-47bc-8f7b-1dbf08d6976e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:48.956929 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ec14d3b-30b8-47bc-8f7b-1dbf08d6976e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:48.957531 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ec14d3b-30b8-47bc-8f7b-1dbf08d6976e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:49.344766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3122988d-29a8-447b-8e38-a292fa7e75f6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:49.346318 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3122988d-29a8-447b-8e38-a292fa7e75f6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:49.364229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3122988d-29a8-447b-8e38-a292fa7e75f6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:49.364946 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3122988d-29a8-447b-8e38-a292fa7e75f6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:49.365973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3122988d-29a8-447b-8e38-a292fa7e75f6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:49.366796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3122988d-29a8-447b-8e38-a292fa7e75f6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:50.111937 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8ec14d3b-30b8-47bc-8f7b-1dbf08d6976e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:50.129641 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8ec14d3b-30b8-47bc-8f7b-1dbf08d6976e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1264 microversion: 2.1 time: 1.203218 Jul 31 01:45:50.132243 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2915/5804] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:48 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1264 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:50.315600 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3122988d-29a8-447b-8e38-a292fa7e75f6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdca92e5eb6e4b3dab4900b42f896050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3de71380c941dcb2d2ba9e671ceb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:50.334719 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3122988d-29a8-447b-8e38-a292fa7e75f6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 200 len: 1732 microversion: 2.1 time: 0.996641 Jul 31 01:45:50.335906 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2890/5805] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:49 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 1732 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:50.401612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8ec14d3b-30b8-47bc-8f7b-1dbf08d6976e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:50.402614 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8ec14d3b-30b8-47bc-8f7b-1dbf08d6976e tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001393 Jul 31 01:45:50.417808 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2916/5806] 10.222.0.45 () {56 vars in 886 bytes} [Sun Jul 31 01:45:50 2022] GET /compute/ => generated 377 bytes in 16 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 31 01:45:51.153565 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9e4a954d-cb97-41c4-84fe-6b927d0d700d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:51.156259 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9e4a954d-cb97-41c4-84fe-6b927d0d700d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:51.164424 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e4a954d-cb97-41c4-84fe-6b927d0d700d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:51.165159 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e4a954d-cb97-41c4-84fe-6b927d0d700d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:51.166196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e4a954d-cb97-41c4-84fe-6b927d0d700d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:51.166832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e4a954d-cb97-41c4-84fe-6b927d0d700d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:51.355369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-883609d8-e185-4206-92f8-fb217a4d08f6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:51.356038 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-883609d8-e185-4206-92f8-fb217a4d08f6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:51.366501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-883609d8-e185-4206-92f8-fb217a4d08f6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:51.367180 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-883609d8-e185-4206-92f8-fb217a4d08f6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:51.368138 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-883609d8-e185-4206-92f8-fb217a4d08f6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:51.368723 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-883609d8-e185-4206-92f8-fb217a4d08f6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:51.696679 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-883609d8-e185-4206-92f8-fb217a4d08f6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdca92e5eb6e4b3dab4900b42f896050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3de71380c941dcb2d2ba9e671ceb43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:51.706517 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-883609d8-e185-4206-92f8-fb217a4d08f6 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 200 len: 1664 microversion: 2.1 time: 0.355157 Jul 31 01:45:51.715049 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2917/5807] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:51 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 1664 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:51.926995 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-cad0e152-f78b-4746-b85a-0e5ba8a2117b req-b5304d76-389a-42ac-a292-7c351bdab841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c452a2c9-d379-45c9-9143-92dc63949f69", "name": "network-vif-deleted", "tag": "5aa2e5c9-4d77-4747-9f73-a4589654fbba"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:45:51.946190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-cad0e152-f78b-4746-b85a-0e5ba8a2117b req-b5304d76-389a-42ac-a292-7c351bdab841 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:51.946664 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-cad0e152-f78b-4746-b85a-0e5ba8a2117b req-b5304d76-389a-42ac-a292-7c351bdab841 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:51.948547 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9e4a954d-cb97-41c4-84fe-6b927d0d700d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:51.961334 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-cad0e152-f78b-4746-b85a-0e5ba8a2117b req-b5304d76-389a-42ac-a292-7c351bdab841 service nova] Creating event network-vif-deleted:5aa2e5c9-4d77-4747-9f73-a4589654fbba for instance c452a2c9-d379-45c9-9143-92dc63949f69 on n-h2-master-1 Jul 31 01:45:51.964637 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9e4a954d-cb97-41c4-84fe-6b927d0d700d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1264 microversion: 2.1 time: 0.815563 Jul 31 01:45:51.965321 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2891/5808] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:51 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1264 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:51.986049 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-cad0e152-f78b-4746-b85a-0e5ba8a2117b req-b5304d76-389a-42ac-a292-7c351bdab841 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057364 Jul 31 01:45:51.987062 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2918/5809] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:45:52.729233 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d7407cad-110a-4d40-8169-412e41f54c20 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:52.731860 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d7407cad-110a-4d40-8169-412e41f54c20 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:52.747423 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7407cad-110a-4d40-8169-412e41f54c20 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:52.749392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7407cad-110a-4d40-8169-412e41f54c20 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:52.750383 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7407cad-110a-4d40-8169-412e41f54c20 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:52.751886 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7407cad-110a-4d40-8169-412e41f54c20 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:52.789981 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-d7407cad-110a-4d40-8169-412e41f54c20 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] HTTP exception thrown: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d7407cad-110a-4d40-8169-412e41f54c20 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Request method failure captured: Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 HTTP/1.1 Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5d2IXOuiG57fTWtFR2kOhUCeiergPMblARQ5lE1jigVbmS1sG48OhK9xHD9hDHWdSJWc2WNuDAz0rBGn_DS_e0GrHo9sz2DWk5PqHjpYu41AFmZswXObaRWj1dwQKwoVSJtMCn5p0uPeWzEesiDKjWnNvigaWi9PtAJPMS9GS-u5CtE Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 7c3de71380c941dcb2d2ba9e671ceb43 Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestServerBasicOps-463573680 Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7c3de71380c941dcb2d2ba9e671ceb43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7c3de71380c941dcb2d2ba9e671ceb43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7c3de71380c941dcb2d2ba9e671ceb43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7c3de71380c941dcb2d2ba9e671ceb43", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestServerBasicOps-463573680 Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 7c3de71380c941dcb2d2ba9e671ceb43 Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestServerBasicOps-463573680 Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestServerBasicOps-463573680-project Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: cdca92e5eb6e4b3dab4900b42f896050 Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestServerBasicOps-463573680-project Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: exception: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'c452a2c9-d379-45c9-9143-92dc63949f69'} Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:52.791719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:52.794960 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:52.794960 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:52.794960 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:52.794960 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:45:52.794960 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:45:52.794960 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. Jul 31 01:45:52.794960 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:52.794960 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d7407cad-110a-4d40-8169-412e41f54c20 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Returning 404 to user: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:45:52.794960 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d7407cad-110a-4d40-8169-412e41f54c20 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 404 len: 111 microversion: 2.1 time: 0.068645 Jul 31 01:45:52.794960 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2892/5810] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:52 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:45:52.990530 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f3f1b7df-37ef-4bbf-8d1f-5de1f05a4ce7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:52.991883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f3f1b7df-37ef-4bbf-8d1f-5de1f05a4ce7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:53.010178 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3f1b7df-37ef-4bbf-8d1f-5de1f05a4ce7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:53.010652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3f1b7df-37ef-4bbf-8d1f-5de1f05a4ce7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:53.012092 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3f1b7df-37ef-4bbf-8d1f-5de1f05a4ce7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:53.012543 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f3f1b7df-37ef-4bbf-8d1f-5de1f05a4ce7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:53.411620 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f3f1b7df-37ef-4bbf-8d1f-5de1f05a4ce7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:53.420962 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f3f1b7df-37ef-4bbf-8d1f-5de1f05a4ce7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1264 microversion: 2.1 time: 0.434438 Jul 31 01:45:53.427418 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2919/5811] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:52 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1264 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:53.690004 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0096931d-5dec-41ea-af2d-13b850525f02 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:53.690527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0096931d-5dec-41ea-af2d-13b850525f02 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:53.699178 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0096931d-5dec-41ea-af2d-13b850525f02 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:53.699898 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0096931d-5dec-41ea-af2d-13b850525f02 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:53.702251 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0096931d-5dec-41ea-af2d-13b850525f02 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:53.702871 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0096931d-5dec-41ea-af2d-13b850525f02 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:53.722980 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-0096931d-5dec-41ea-af2d-13b850525f02 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] HTTP exception thrown: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0096931d-5dec-41ea-af2d-13b850525f02 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Request method failure captured: Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 HTTP/1.1 Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5d2IXOuiG57fTWtFR2kOhUCeiergPMblARQ5lE1jigVbmS1sG48OhK9xHD9hDHWdSJWc2WNuDAz0rBGn_DS_e0GrHo9sz2DWk5PqHjpYu41AFmZswXObaRWj1dwQKwoVSJtMCn5p0uPeWzEesiDKjWnNvigaWi9PtAJPMS9GS-u5CtE Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 7c3de71380c941dcb2d2ba9e671ceb43 Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestServerBasicOps-463573680 Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7c3de71380c941dcb2d2ba9e671ceb43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7c3de71380c941dcb2d2ba9e671ceb43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7c3de71380c941dcb2d2ba9e671ceb43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7c3de71380c941dcb2d2ba9e671ceb43", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestServerBasicOps-463573680 Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 7c3de71380c941dcb2d2ba9e671ceb43 Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestServerBasicOps-463573680 Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestServerBasicOps-463573680-project Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: cdca92e5eb6e4b3dab4900b42f896050 Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestServerBasicOps-463573680-project Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: exception: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'c452a2c9-d379-45c9-9143-92dc63949f69'} Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:45:53.724897 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. Jul 31 01:45:53.731755 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:53.731755 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:53.731755 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:53.731755 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:53.731755 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:53.731755 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:53.731755 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:45:53.731755 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:45:53.731755 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. Jul 31 01:45:53.731755 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:45:53.740380 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0096931d-5dec-41ea-af2d-13b850525f02 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Returning 404 to user: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:45:53.741858 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0096931d-5dec-41ea-af2d-13b850525f02 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 404 len: 111 microversion: 2.1 time: 0.055964 Jul 31 01:45:53.747166 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2893/5812] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:45:53 2022] DELETE /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:45:53.751270 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-95425c29-5234-4cd6-a92c-14c725b34487 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:53.752103 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-95425c29-5234-4cd6-a92c-14c725b34487 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] [instance: c452a2c9-d379-45c9-9143-92dc63949f69] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:53.762078 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95425c29-5234-4cd6-a92c-14c725b34487 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:53.763903 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95425c29-5234-4cd6-a92c-14c725b34487 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:53.766087 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95425c29-5234-4cd6-a92c-14c725b34487 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:53.767118 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95425c29-5234-4cd6-a92c-14c725b34487 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:53.789995 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-95425c29-5234-4cd6-a92c-14c725b34487 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] HTTP exception thrown: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-95425c29-5234-4cd6-a92c-14c725b34487 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Request method failure captured: Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 HTTP/1.1 Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5d2IXOuiG57fTWtFR2kOhUCeiergPMblARQ5lE1jigVbmS1sG48OhK9xHD9hDHWdSJWc2WNuDAz0rBGn_DS_e0GrHo9sz2DWk5PqHjpYu41AFmZswXObaRWj1dwQKwoVSJtMCn5p0uPeWzEesiDKjWnNvigaWi9PtAJPMS9GS-u5CtE Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 7c3de71380c941dcb2d2ba9e671ceb43 Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestServerBasicOps-463573680 Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7c3de71380c941dcb2d2ba9e671ceb43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7c3de71380c941dcb2d2ba9e671ceb43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7c3de71380c941dcb2d2ba9e671ceb43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7c3de71380c941dcb2d2ba9e671ceb43", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestServerBasicOps-463573680 Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 7c3de71380c941dcb2d2ba9e671ceb43 Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestServerBasicOps-463573680 Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestServerBasicOps-463573680-project Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: cdca92e5eb6e4b3dab4900b42f896050 Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestServerBasicOps-463573680-project Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: exception: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'c452a2c9-d379-45c9-9143-92dc63949f69'} Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:45:53.793310 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:53.797359 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:45:53.797359 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:45:53.797359 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:45:53.797359 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:45:53.797359 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:45:53.797359 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. Jul 31 01:45:53.797359 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:45:53.799622 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-95425c29-5234-4cd6-a92c-14c725b34487 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Returning 404 to user: Instance c452a2c9-d379-45c9-9143-92dc63949f69 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:45:53.801957 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-95425c29-5234-4cd6-a92c-14c725b34487 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69" status: 404 len: 111 microversion: 2.1 time: 0.054511 Jul 31 01:45:53.808110 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2920/5813] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:53 2022] GET /compute/v2.1/servers/c452a2c9-d379-45c9-9143-92dc63949f69 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:45:54.098990 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0a53ea98-9b76-4f9d-8224-382e5bcd6065 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] Calling method '.version_select at 0x7fedea931790>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:54.114092 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:45:54.145724 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0a53ea98-9b76-4f9d-8224-382e5bcd6065 tempest-TestServerBasicOps-463573680 tempest-TestServerBasicOps-463573680-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-596753606" status: 202 len: 0 microversion: 2.1 time: 0.050845 Jul 31 01:45:54.146083 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2894/5814] 10.222.0.45 () {58 vars in 1251 bytes} [Sun Jul 31 01:45:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-596753606 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:45:54.453105 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0949add6-a699-4203-a6b2-2b2420d35c55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:54.455148 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0949add6-a699-4203-a6b2-2b2420d35c55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:54.464600 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0949add6-a699-4203-a6b2-2b2420d35c55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:54.470369 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0949add6-a699-4203-a6b2-2b2420d35c55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:54.477058 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0949add6-a699-4203-a6b2-2b2420d35c55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:54.477767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0949add6-a699-4203-a6b2-2b2420d35c55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:54.826147 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0949add6-a699-4203-a6b2-2b2420d35c55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:54.837205 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0949add6-a699-4203-a6b2-2b2420d35c55 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1264 microversion: 2.1 time: 0.390532 Jul 31 01:45:54.843248 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2921/5815] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:54 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1264 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:55.396151 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-4326da6b-e733-4b55-b1e1-ab61d859f68f req-2c75105e-8c27-459b-bab9-098625fe2ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5185fc2-3256-4435-bf3a-282e4c1b9a8d", "name": "network-vif-plugged", "status": "completed", "tag": "43fbaaab-d6fb-4b30-9eb7-5fd66c0a92f2"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:45:55.424023 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-4326da6b-e733-4b55-b1e1-ab61d859f68f req-2c75105e-8c27-459b-bab9-098625fe2ef7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:55.426415 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-4326da6b-e733-4b55-b1e1-ab61d859f68f req-2c75105e-8c27-459b-bab9-098625fe2ef7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:55.441314 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-4326da6b-e733-4b55-b1e1-ab61d859f68f req-2c75105e-8c27-459b-bab9-098625fe2ef7 service nova] Creating event network-vif-plugged:43fbaaab-d6fb-4b30-9eb7-5fd66c0a92f2 for instance c5185fc2-3256-4435-bf3a-282e4c1b9a8d on n-h1-master-1 Jul 31 01:45:55.449163 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-4326da6b-e733-4b55-b1e1-ab61d859f68f req-2c75105e-8c27-459b-bab9-098625fe2ef7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057587 Jul 31 01:45:55.450902 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2895/5816] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:45:55.871646 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ab98cddc-ce2e-409a-8c23-449e4d333ddb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:55.872932 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ab98cddc-ce2e-409a-8c23-449e4d333ddb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:55.890701 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab98cddc-ce2e-409a-8c23-449e4d333ddb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:55.891116 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab98cddc-ce2e-409a-8c23-449e4d333ddb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:55.894685 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab98cddc-ce2e-409a-8c23-449e4d333ddb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:55.895240 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab98cddc-ce2e-409a-8c23-449e4d333ddb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:56.649047 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ab98cddc-ce2e-409a-8c23-449e4d333ddb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:56.657998 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ab98cddc-ce2e-409a-8c23-449e4d333ddb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1264 microversion: 2.1 time: 0.802254 Jul 31 01:45:56.658592 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2922/5817] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:55 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1264 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:57.683920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eeb635a8-9796-4962-a490-63ff765845e3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:57.684734 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eeb635a8-9796-4962-a490-63ff765845e3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:57.703718 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eeb635a8-9796-4962-a490-63ff765845e3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:57.704319 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eeb635a8-9796-4962-a490-63ff765845e3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:57.705235 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eeb635a8-9796-4962-a490-63ff765845e3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:57.705815 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eeb635a8-9796-4962-a490-63ff765845e3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:57.994445 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eeb635a8-9796-4962-a490-63ff765845e3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:58.004663 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eeb635a8-9796-4962-a490-63ff765845e3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1449 microversion: 2.1 time: 0.326923 Jul 31 01:45:58.010283 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2896/5818] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:57 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1449 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:58.030868 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e7e611f4-e67b-4e11-b065-fb4f44910ed2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:45:58.031470 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e7e611f4-e67b-4e11-b065-fb4f44910ed2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:45:58.051543 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e7e611f4-e67b-4e11-b065-fb4f44910ed2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:58.052027 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e7e611f4-e67b-4e11-b065-fb4f44910ed2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:58.052835 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e7e611f4-e67b-4e11-b065-fb4f44910ed2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:45:58.055939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e7e611f4-e67b-4e11-b065-fb4f44910ed2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:45:58.368894 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e7e611f4-e67b-4e11-b065-fb4f44910ed2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:45:58.382391 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e7e611f4-e67b-4e11-b065-fb4f44910ed2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1449 microversion: 2.1 time: 0.355720 Jul 31 01:45:58.382993 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2923/5819] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:45:58 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1449 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:45:59.057429 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 01:45:59.058716 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 01:45:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 01:46:01.041489 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eeb635a8-9796-4962-a490-63ff765845e3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:46:01.042609 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eeb635a8-9796-4962-a490-63ff765845e3 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001499 Jul 31 01:46:01.043115 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2897/5820] 10.222.0.45 () {56 vars in 886 bytes} [Sun Jul 31 01:46:01 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 31 01:46:03.522197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-62bb230c-9072-424e-8a1a-23d41959a0f2 req-7e24eb2e-61a5-4a1c-ba22-441d47134ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5185fc2-3256-4435-bf3a-282e4c1b9a8d", "tag": "43fbaaab-d6fb-4b30-9eb7-5fd66c0a92f2"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:46:03.533049 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:46:03.548812 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-62bb230c-9072-424e-8a1a-23d41959a0f2 req-7e24eb2e-61a5-4a1c-ba22-441d47134ff7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:03.549911 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-62bb230c-9072-424e-8a1a-23d41959a0f2 req-7e24eb2e-61a5-4a1c-ba22-441d47134ff7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:03.590975 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-62bb230c-9072-424e-8a1a-23d41959a0f2 req-7e24eb2e-61a5-4a1c-ba22-441d47134ff7 service nova] Creating event network-changed:43fbaaab-d6fb-4b30-9eb7-5fd66c0a92f2 for instance c5185fc2-3256-4435-bf3a-282e4c1b9a8d on n-h1-master-1 Jul 31 01:46:03.609396 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-62bb230c-9072-424e-8a1a-23d41959a0f2 req-7e24eb2e-61a5-4a1c-ba22-441d47134ff7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088121 Jul 31 01:46:03.611677 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2924/5821] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:46:14.141630 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:46:14.142790 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:46:14.355273 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-10089991-b15e-4768-bacc-cba6c829410a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Action: 'create', calling method: .version_select at 0x7fede557bdc0>, body: {"keypair": {"name": "tempest-keypair-627240512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOoueGQXFC+load1U3TyIxAiCT8cLVB5436tSzp9U4L+UVbel5E3is7Z6C+iZWdd/iQ5eeYz2sfWehnxWio+3dNH/0C4mhuH5RN3G7AronGgWCbYZqrlqlr2QP3GkY18Q=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:46:14.381222 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-10089991-b15e-4768-bacc-cba6c829410a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Getting quotas for project ab4d167cb1684552a635536adebfbc86. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:46:14.391247 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-10089991-b15e-4768-bacc-cba6c829410a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Getting quotas for user 7eab8ae242c14402b965ffcc92961b2f and project ab4d167cb1684552a635536adebfbc86. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:46:14.432204 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-10089991-b15e-4768-bacc-cba6c829410a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.295520 Jul 31 01:46:14.433065 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2898/5822] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:46:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:46:16.855369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c8886111-8831-4cbe-b6db-268c844eec60 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-469900928", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "664dd9c4-b9c6-4a8c-9bbd-c0e251d6533d"}], "security_groups": [{"name": "tempest-securitygroup--848748283"}], "key_name": "tempest-keypair-627240512", "user_data": "}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:46:16.889467 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=56 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:46:17.352031 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-c8886111-8831-4cbe-b6db-268c844eec60 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] validate_networks() for [('664dd9c4-b9c6-4a8c-9bbd-c0e251d6533d', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:46:18.248228 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-c8886111-8831-4cbe-b6db-268c844eec60 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:46:18.250652 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-c8886111-8831-4cbe-b6db-268c844eec60 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:46:18.251508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-c8886111-8831-4cbe-b6db-268c844eec60 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:46:18.252226 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-c8886111-8831-4cbe-b6db-268c844eec60 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:46:18.252884 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-c8886111-8831-4cbe-b6db-268c844eec60 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:46:18.264940 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8886111-8831-4cbe-b6db-268c844eec60 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:18.265624 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8886111-8831-4cbe-b6db-268c844eec60 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:18.266943 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8886111-8831-4cbe-b6db-268c844eec60 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:18.267616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8886111-8831-4cbe-b6db-268c844eec60 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:18.289459 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-c8886111-8831-4cbe-b6db-268c844eec60 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Getting quotas for project ab4d167cb1684552a635536adebfbc86. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:46:18.297124 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-c8886111-8831-4cbe-b6db-268c844eec60 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Getting quotas for user 7eab8ae242c14402b965ffcc92961b2f and project ab4d167cb1684552a635536adebfbc86. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:46:18.314679 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c8886111-8831-4cbe-b6db-268c844eec60 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:46:18.317439 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c8886111-8831-4cbe-b6db-268c844eec60 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:46:18.398657 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c8886111-8831-4cbe-b6db-268c844eec60 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.550929 Jul 31 01:46:18.399683 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2925/5823] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:46:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 01:46:18.411790 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6588d928-d578-4bfe-b0b6-c4ee57a11103 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:46:18.413187 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6588d928-d578-4bfe-b0b6-c4ee57a11103 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:46:18.698243 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6588d928-d578-4bfe-b0b6-c4ee57a11103 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:46:18.717175 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6588d928-d578-4bfe-b0b6-c4ee57a11103 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1236 microversion: 2.1 time: 0.309686 Jul 31 01:46:18.718314 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2899/5824] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:46:18 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1236 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:46:19.740177 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-492ed187-ef7f-4730-96ac-418d97cb5a93 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:46:19.740889 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-492ed187-ef7f-4730-96ac-418d97cb5a93 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:46:19.756469 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-492ed187-ef7f-4730-96ac-418d97cb5a93 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:19.757094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-492ed187-ef7f-4730-96ac-418d97cb5a93 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:19.758911 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-492ed187-ef7f-4730-96ac-418d97cb5a93 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:19.762247 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-492ed187-ef7f-4730-96ac-418d97cb5a93 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:19.934428 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-492ed187-ef7f-4730-96ac-418d97cb5a93 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:46:19.948995 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-492ed187-ef7f-4730-96ac-418d97cb5a93 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1288 microversion: 2.1 time: 0.212987 Jul 31 01:46:19.959920 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2926/5825] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:46:19 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1288 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:46:20.976054 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-78bb428e-d1b6-4372-b022-13c24e1d0dba tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:46:20.976704 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-78bb428e-d1b6-4372-b022-13c24e1d0dba tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:46:20.992878 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78bb428e-d1b6-4372-b022-13c24e1d0dba tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:20.994618 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78bb428e-d1b6-4372-b022-13c24e1d0dba tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:20.996333 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78bb428e-d1b6-4372-b022-13c24e1d0dba tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:20.997022 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78bb428e-d1b6-4372-b022-13c24e1d0dba tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:21.119864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-78bb428e-d1b6-4372-b022-13c24e1d0dba tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:46:21.131928 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-78bb428e-d1b6-4372-b022-13c24e1d0dba tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1294 microversion: 2.1 time: 0.159976 Jul 31 01:46:21.136765 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2900/5826] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:46:20 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1294 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:46:22.157492 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-04b855ac-b0c9-4fb8-87f8-b2d7bf20e177 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:46:22.158743 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-04b855ac-b0c9-4fb8-87f8-b2d7bf20e177 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:46:22.176215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04b855ac-b0c9-4fb8-87f8-b2d7bf20e177 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:22.177516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04b855ac-b0c9-4fb8-87f8-b2d7bf20e177 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:22.182092 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04b855ac-b0c9-4fb8-87f8-b2d7bf20e177 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:22.187459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04b855ac-b0c9-4fb8-87f8-b2d7bf20e177 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:22.726627 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-04b855ac-b0c9-4fb8-87f8-b2d7bf20e177 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:46:22.743554 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-04b855ac-b0c9-4fb8-87f8-b2d7bf20e177 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1361 microversion: 2.1 time: 0.588248 Jul 31 01:46:22.748147 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2927/5827] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:46:22 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1361 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:46:23.238504 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-aadcff6b-e877-428d-aa2d-1fee00d1cd32 req-f25a8f55-d2ec-4b19-a6a6-7a2fad8aaf18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8488f02-8f89-4fb7-8e4f-30414f9ad09e", "tag": "39901178-6131-4c54-bccd-a82ea9abaacd"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:46:23.254724 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-aadcff6b-e877-428d-aa2d-1fee00d1cd32 req-f25a8f55-d2ec-4b19-a6a6-7a2fad8aaf18 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:23.255570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-aadcff6b-e877-428d-aa2d-1fee00d1cd32 req-f25a8f55-d2ec-4b19-a6a6-7a2fad8aaf18 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:23.271669 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-aadcff6b-e877-428d-aa2d-1fee00d1cd32 req-f25a8f55-d2ec-4b19-a6a6-7a2fad8aaf18 service nova] Creating event network-changed:39901178-6131-4c54-bccd-a82ea9abaacd for instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e on n-h2-master-1 Jul 31 01:46:23.278245 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-aadcff6b-e877-428d-aa2d-1fee00d1cd32 req-f25a8f55-d2ec-4b19-a6a6-7a2fad8aaf18 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044633 Jul 31 01:46:23.281588 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2901/5828] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:46:23.774723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a1630a5-3c65-4298-aa90-0545f5aa8716 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:46:23.776842 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9a1630a5-3c65-4298-aa90-0545f5aa8716 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:46:23.786624 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a1630a5-3c65-4298-aa90-0545f5aa8716 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:23.787825 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a1630a5-3c65-4298-aa90-0545f5aa8716 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:23.788850 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a1630a5-3c65-4298-aa90-0545f5aa8716 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:23.790612 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a1630a5-3c65-4298-aa90-0545f5aa8716 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:24.062851 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9a1630a5-3c65-4298-aa90-0545f5aa8716 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:46:24.087216 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9a1630a5-3c65-4298-aa90-0545f5aa8716 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1361 microversion: 2.1 time: 0.318113 Jul 31 01:46:24.090719 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2928/5829] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:46:23 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1361 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:46:25.112357 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aaaf5e40-c709-48d2-8c6f-01aec7abdd33 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:46:25.113079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aaaf5e40-c709-48d2-8c6f-01aec7abdd33 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:46:25.126858 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aaaf5e40-c709-48d2-8c6f-01aec7abdd33 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:25.127698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aaaf5e40-c709-48d2-8c6f-01aec7abdd33 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:25.129757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aaaf5e40-c709-48d2-8c6f-01aec7abdd33 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:25.130465 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aaaf5e40-c709-48d2-8c6f-01aec7abdd33 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:25.344787 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-aaaf5e40-c709-48d2-8c6f-01aec7abdd33 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:46:25.353663 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aaaf5e40-c709-48d2-8c6f-01aec7abdd33 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1361 microversion: 2.1 time: 0.246569 Jul 31 01:46:25.368320 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2902/5830] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:46:25 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:46:26.376484 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-608377b1-1b0e-499d-9340-4fce966110a4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:46:26.377694 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-608377b1-1b0e-499d-9340-4fce966110a4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:46:26.400818 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-608377b1-1b0e-499d-9340-4fce966110a4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:26.401871 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-608377b1-1b0e-499d-9340-4fce966110a4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:26.402668 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-608377b1-1b0e-499d-9340-4fce966110a4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:26.403113 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-608377b1-1b0e-499d-9340-4fce966110a4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:26.610067 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-608377b1-1b0e-499d-9340-4fce966110a4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:46:26.626744 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-608377b1-1b0e-499d-9340-4fce966110a4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1361 microversion: 2.1 time: 0.252874 Jul 31 01:46:26.627747 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2929/5831] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:46:26 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1361 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:46:27.653091 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0e45669c-f5b3-4566-bd56-3962490bcf62 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:46:27.654338 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0e45669c-f5b3-4566-bd56-3962490bcf62 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:46:27.661740 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e45669c-f5b3-4566-bd56-3962490bcf62 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:27.662206 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e45669c-f5b3-4566-bd56-3962490bcf62 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:27.663316 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e45669c-f5b3-4566-bd56-3962490bcf62 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:27.663804 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e45669c-f5b3-4566-bd56-3962490bcf62 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:27.841333 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e45669c-f5b3-4566-bd56-3962490bcf62 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:46:27.849748 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0e45669c-f5b3-4566-bd56-3962490bcf62 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1361 microversion: 2.1 time: 0.201360 Jul 31 01:46:27.859274 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2903/5832] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:46:27 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:46:28.871028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2c45ac3f-9a01-443c-835d-3390d021dd35 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:46:28.871710 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2c45ac3f-9a01-443c-835d-3390d021dd35 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:46:28.885656 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:46:28.886889 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:46:28.889040 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c45ac3f-9a01-443c-835d-3390d021dd35 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:28.889925 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c45ac3f-9a01-443c-835d-3390d021dd35 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:28.891214 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c45ac3f-9a01-443c-835d-3390d021dd35 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:28.892234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c45ac3f-9a01-443c-835d-3390d021dd35 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:29.187663 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2c45ac3f-9a01-443c-835d-3390d021dd35 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:46:29.195493 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2c45ac3f-9a01-443c-835d-3390d021dd35 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1361 microversion: 2.1 time: 0.329105 Jul 31 01:46:29.205270 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2930/5833] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:46:28 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1361 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:46:30.218349 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5b0ded79-335a-4b96-9321-d748461f3252 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:46:30.220080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5b0ded79-335a-4b96-9321-d748461f3252 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:46:30.224458 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:46:30.243964 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b0ded79-335a-4b96-9321-d748461f3252 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:30.244859 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b0ded79-335a-4b96-9321-d748461f3252 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:30.246134 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b0ded79-335a-4b96-9321-d748461f3252 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:30.251568 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5b0ded79-335a-4b96-9321-d748461f3252 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:30.396153 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-a8ee8e26-d0f8-42b5-9794-6d6dd672184f req-fa1437bf-cebd-4a0f-a7b3-14258645cf25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8488f02-8f89-4fb7-8e4f-30414f9ad09e", "name": "network-vif-plugged", "status": "completed", "tag": "39901178-6131-4c54-bccd-a82ea9abaacd"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:46:30.411253 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a8ee8e26-d0f8-42b5-9794-6d6dd672184f req-fa1437bf-cebd-4a0f-a7b3-14258645cf25 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:30.417837 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a8ee8e26-d0f8-42b5-9794-6d6dd672184f req-fa1437bf-cebd-4a0f-a7b3-14258645cf25 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:30.438693 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-a8ee8e26-d0f8-42b5-9794-6d6dd672184f req-fa1437bf-cebd-4a0f-a7b3-14258645cf25 service nova] Creating event network-vif-plugged:39901178-6131-4c54-bccd-a82ea9abaacd for instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e on n-h2-master-1 Jul 31 01:46:30.449640 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-a8ee8e26-d0f8-42b5-9794-6d6dd672184f req-fa1437bf-cebd-4a0f-a7b3-14258645cf25 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054487 Jul 31 01:46:30.451280 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2931/5834] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:46:30.524204 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5b0ded79-335a-4b96-9321-d748461f3252 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:46:30.539174 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5b0ded79-335a-4b96-9321-d748461f3252 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1361 microversion: 2.1 time: 0.325753 Jul 31 01:46:30.558638 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2904/5835] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:46:30 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1361 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:46:31.565859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c12c208e-4c54-4c04-b3d4-4a8dd25ce2f8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:46:31.566583 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c12c208e-4c54-4c04-b3d4-4a8dd25ce2f8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:46:31.605313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c12c208e-4c54-4c04-b3d4-4a8dd25ce2f8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:31.605787 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c12c208e-4c54-4c04-b3d4-4a8dd25ce2f8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:31.607926 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c12c208e-4c54-4c04-b3d4-4a8dd25ce2f8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:31.611659 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c12c208e-4c54-4c04-b3d4-4a8dd25ce2f8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:32.002359 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c12c208e-4c54-4c04-b3d4-4a8dd25ce2f8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:46:32.010334 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c12c208e-4c54-4c04-b3d4-4a8dd25ce2f8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1361 microversion: 2.1 time: 0.449251 Jul 31 01:46:32.011033 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2932/5836] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:46:31 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1361 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:46:33.030453 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-26e5a380-1784-44da-93b2-b1b6a64338ef tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:46:33.031725 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-26e5a380-1784-44da-93b2-b1b6a64338ef tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:46:33.048605 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26e5a380-1784-44da-93b2-b1b6a64338ef tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:33.049271 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26e5a380-1784-44da-93b2-b1b6a64338ef tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:33.050247 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26e5a380-1784-44da-93b2-b1b6a64338ef tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:33.050859 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26e5a380-1784-44da-93b2-b1b6a64338ef tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:33.282281 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-26e5a380-1784-44da-93b2-b1b6a64338ef tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:46:33.292832 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-26e5a380-1784-44da-93b2-b1b6a64338ef tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1548 microversion: 2.1 time: 0.264097 Jul 31 01:46:33.293455 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2905/5837] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:46:33 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1548 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:46:33.314050 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-20d9e44e-b822-455a-932a-2bc307482f20 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:46:33.315082 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-20d9e44e-b822-455a-932a-2bc307482f20 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:46:33.323672 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20d9e44e-b822-455a-932a-2bc307482f20 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:33.324484 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20d9e44e-b822-455a-932a-2bc307482f20 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:33.325645 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20d9e44e-b822-455a-932a-2bc307482f20 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:33.326258 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20d9e44e-b822-455a-932a-2bc307482f20 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:33.433457 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-20d9e44e-b822-455a-932a-2bc307482f20 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123344 Jul 31 01:46:33.434456 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2933/5838] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:46:33 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:46:35.016591 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-851ee977-8a9e-4b66-a8a3-2806c1caf7f3 req-989d625e-4c61-44f0-a782-7150867df050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8488f02-8f89-4fb7-8e4f-30414f9ad09e", "tag": "39901178-6131-4c54-bccd-a82ea9abaacd"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:46:35.048478 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-851ee977-8a9e-4b66-a8a3-2806c1caf7f3 req-989d625e-4c61-44f0-a782-7150867df050 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:46:35.048618 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-851ee977-8a9e-4b66-a8a3-2806c1caf7f3 req-989d625e-4c61-44f0-a782-7150867df050 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:46:35.077179 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-851ee977-8a9e-4b66-a8a3-2806c1caf7f3 req-989d625e-4c61-44f0-a782-7150867df050 service nova] Creating event network-changed:39901178-6131-4c54-bccd-a82ea9abaacd for instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e on n-h2-master-1 Jul 31 01:46:35.085856 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-851ee977-8a9e-4b66-a8a3-2806c1caf7f3 req-989d625e-4c61-44f0-a782-7150867df050 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073211 Jul 31 01:46:35.093417 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2906/5839] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:47:08.852305 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:08.853420 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=44 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:08.857797 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9897b3e9-88c2-4d58-ade9-3f94cd88513e tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:08.858432 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9897b3e9-88c2-4d58-ade9-3f94cd88513e tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:08.865135 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9897b3e9-88c2-4d58-ade9-3f94cd88513e tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:08.865719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9897b3e9-88c2-4d58-ade9-3f94cd88513e tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:08.866678 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9897b3e9-88c2-4d58-ade9-3f94cd88513e tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:08.867192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9897b3e9-88c2-4d58-ade9-3f94cd88513e tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:08.899962 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9897b3e9-88c2-4d58-ade9-3f94cd88513e tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/ips" status: 200 len: 147 microversion: 2.1 time: 0.049534 Jul 31 01:47:08.900633 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2934/5840] 10.222.0.45 () {58 vars in 1248 bytes} [Sun Jul 31 01:47:08 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/ips => generated 147 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:47:11.247222 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-39299ae6-2608-4da1-98eb-e9fcff7dcc99 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb0ceb19-b9e2-4986-b200-fd1eedcca7f5"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:47:11.250393 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-39299ae6-2608-4da1-98eb-e9fcff7dcc99 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:11.256430 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:11.257592 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=34 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:11.259673 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39299ae6-2608-4da1-98eb-e9fcff7dcc99 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:11.260890 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39299ae6-2608-4da1-98eb-e9fcff7dcc99 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:11.262292 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39299ae6-2608-4da1-98eb-e9fcff7dcc99 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:11.262795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39299ae6-2608-4da1-98eb-e9fcff7dcc99 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:11.574915 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-39299ae6-2608-4da1-98eb-e9fcff7dcc99 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "POST /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332037 Jul 31 01:47:11.575762 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2907/5841] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:47:11 2022] POST /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:47:22.585005 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-72fbf09a-f13e-4f6c-820d-73df91b35292 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:47:22.587922 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:22.588595 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:22.595989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72fbf09a-f13e-4f6c-820d-73df91b35292 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:22.596479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72fbf09a-f13e-4f6c-820d-73df91b35292 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:22.629787 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-72fbf09a-f13e-4f6c-820d-73df91b35292 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Going to try to stop instance {{(pid=119475) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 01:47:22.676440 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-72fbf09a-f13e-4f6c-820d-73df91b35292 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "POST /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/action" status: 202 len: 0 microversion: 2.1 time: 0.095257 Jul 31 01:47:22.689354 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:22.692358 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2935/5842] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:47:22 2022] POST /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:47:22.694879 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:22.703627 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5ef224e8-28ac-4cb0-ae3b-28ac28ce4ce7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:22.705443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5ef224e8-28ac-4cb0-ae3b-28ac28ce4ce7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:22.714984 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ef224e8-28ac-4cb0-ae3b-28ac28ce4ce7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:22.715496 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ef224e8-28ac-4cb0-ae3b-28ac28ce4ce7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:22.716568 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ef224e8-28ac-4cb0-ae3b-28ac28ce4ce7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:22.717184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ef224e8-28ac-4cb0-ae3b-28ac28ce4ce7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:22.861777 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5ef224e8-28ac-4cb0-ae3b-28ac28ce4ce7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:22.872304 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5ef224e8-28ac-4cb0-ae3b-28ac28ce4ce7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1723 microversion: 2.1 time: 0.189487 Jul 31 01:47:22.872907 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2908/5843] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:22 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:23.895533 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9c146f23-9f15-4cfe-a0ce-4f2d23b3246d tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:23.896514 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9c146f23-9f15-4cfe-a0ce-4f2d23b3246d tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:23.904584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c146f23-9f15-4cfe-a0ce-4f2d23b3246d tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:23.904980 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c146f23-9f15-4cfe-a0ce-4f2d23b3246d tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:23.905956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c146f23-9f15-4cfe-a0ce-4f2d23b3246d tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:23.906636 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c146f23-9f15-4cfe-a0ce-4f2d23b3246d tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:24.062879 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9c146f23-9f15-4cfe-a0ce-4f2d23b3246d tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:24.071838 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9c146f23-9f15-4cfe-a0ce-4f2d23b3246d tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1723 microversion: 2.1 time: 0.181730 Jul 31 01:47:24.072412 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2936/5844] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:23 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:25.094167 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0a84ceac-54f0-413e-bdcf-aa1a4855ab61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:25.094804 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0a84ceac-54f0-413e-bdcf-aa1a4855ab61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:25.109331 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a84ceac-54f0-413e-bdcf-aa1a4855ab61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:25.109886 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a84ceac-54f0-413e-bdcf-aa1a4855ab61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:25.110761 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a84ceac-54f0-413e-bdcf-aa1a4855ab61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:25.111286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a84ceac-54f0-413e-bdcf-aa1a4855ab61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:25.560010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0a84ceac-54f0-413e-bdcf-aa1a4855ab61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:25.568877 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0a84ceac-54f0-413e-bdcf-aa1a4855ab61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1723 microversion: 2.1 time: 0.478551 Jul 31 01:47:25.569472 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2909/5845] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:25 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1723 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:26.590763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a81013c2-0adc-4086-993c-e655772cb69a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:26.591316 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a81013c2-0adc-4086-993c-e655772cb69a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:26.598142 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a81013c2-0adc-4086-993c-e655772cb69a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:26.598595 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a81013c2-0adc-4086-993c-e655772cb69a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:26.599381 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a81013c2-0adc-4086-993c-e655772cb69a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:26.599828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a81013c2-0adc-4086-993c-e655772cb69a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:26.731628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a81013c2-0adc-4086-993c-e655772cb69a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:26.740105 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a81013c2-0adc-4086-993c-e655772cb69a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1723 microversion: 2.1 time: 0.153958 Jul 31 01:47:26.741066 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2937/5846] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:26 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:47:27.771224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7595921e-17be-416c-878b-d2a4428009c4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:27.772133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7595921e-17be-416c-878b-d2a4428009c4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:27.780903 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7595921e-17be-416c-878b-d2a4428009c4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:27.781485 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7595921e-17be-416c-878b-d2a4428009c4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:27.782509 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7595921e-17be-416c-878b-d2a4428009c4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:27.782972 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7595921e-17be-416c-878b-d2a4428009c4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:27.934906 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7595921e-17be-416c-878b-d2a4428009c4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:27.943496 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7595921e-17be-416c-878b-d2a4428009c4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1723 microversion: 2.1 time: 0.176520 Jul 31 01:47:27.945213 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2910/5847] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:27 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:28.966684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e84154f6-f2cc-466a-85f3-1cd122fa2ccf tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:28.967315 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e84154f6-f2cc-466a-85f3-1cd122fa2ccf tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:28.974332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e84154f6-f2cc-466a-85f3-1cd122fa2ccf tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:28.974796 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e84154f6-f2cc-466a-85f3-1cd122fa2ccf tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:28.975649 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e84154f6-f2cc-466a-85f3-1cd122fa2ccf tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:28.976102 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e84154f6-f2cc-466a-85f3-1cd122fa2ccf tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:29.130616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e84154f6-f2cc-466a-85f3-1cd122fa2ccf tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:29.139719 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e84154f6-f2cc-466a-85f3-1cd122fa2ccf tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1723 microversion: 2.1 time: 0.177375 Jul 31 01:47:29.140443 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2938/5848] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:28 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:30.161944 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21ac25fb-a494-4032-82ce-726fb9e53e91 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:30.162582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-21ac25fb-a494-4032-82ce-726fb9e53e91 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:30.170554 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21ac25fb-a494-4032-82ce-726fb9e53e91 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:30.172054 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21ac25fb-a494-4032-82ce-726fb9e53e91 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:30.172862 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21ac25fb-a494-4032-82ce-726fb9e53e91 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:30.173323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21ac25fb-a494-4032-82ce-726fb9e53e91 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:30.330308 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-21ac25fb-a494-4032-82ce-726fb9e53e91 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:30.338639 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-21ac25fb-a494-4032-82ce-726fb9e53e91 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1723 microversion: 2.1 time: 0.180700 Jul 31 01:47:30.339208 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2911/5849] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:30 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:31.361050 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-13c1e9e8-761d-404f-a797-ffe8408cc466 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:31.361819 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-13c1e9e8-761d-404f-a797-ffe8408cc466 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:31.370131 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13c1e9e8-761d-404f-a797-ffe8408cc466 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:31.370956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13c1e9e8-761d-404f-a797-ffe8408cc466 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:31.372142 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13c1e9e8-761d-404f-a797-ffe8408cc466 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:31.372732 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13c1e9e8-761d-404f-a797-ffe8408cc466 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:31.585111 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-13c1e9e8-761d-404f-a797-ffe8408cc466 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:31.593832 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-13c1e9e8-761d-404f-a797-ffe8408cc466 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1723 microversion: 2.1 time: 0.237392 Jul 31 01:47:31.594433 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2939/5850] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:31 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:32.616228 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ce0bef53-fa38-44e6-8b77-0890c693f292 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:32.617673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ce0bef53-fa38-44e6-8b77-0890c693f292 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:32.628720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce0bef53-fa38-44e6-8b77-0890c693f292 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:32.630186 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce0bef53-fa38-44e6-8b77-0890c693f292 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:32.631500 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce0bef53-fa38-44e6-8b77-0890c693f292 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:32.632873 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce0bef53-fa38-44e6-8b77-0890c693f292 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:32.941251 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ce0bef53-fa38-44e6-8b77-0890c693f292 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:32.954227 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ce0bef53-fa38-44e6-8b77-0890c693f292 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1723 microversion: 2.1 time: 0.342054 Jul 31 01:47:32.956927 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2912/5851] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:32 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:33.977376 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f46da9d4-d5f2-485d-bc48-af02512c7f51 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:33.978163 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f46da9d4-d5f2-485d-bc48-af02512c7f51 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:34.000263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f46da9d4-d5f2-485d-bc48-af02512c7f51 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:34.001304 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f46da9d4-d5f2-485d-bc48-af02512c7f51 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:34.002326 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f46da9d4-d5f2-485d-bc48-af02512c7f51 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:34.002932 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f46da9d4-d5f2-485d-bc48-af02512c7f51 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:34.222233 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f46da9d4-d5f2-485d-bc48-af02512c7f51 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:34.234130 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f46da9d4-d5f2-485d-bc48-af02512c7f51 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1723 microversion: 2.1 time: 0.259906 Jul 31 01:47:34.235027 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2940/5852] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:33 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:35.255902 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5265d868-3c85-4e7e-ae52-cd7ea13c6677 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:35.256536 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5265d868-3c85-4e7e-ae52-cd7ea13c6677 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:35.264999 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5265d868-3c85-4e7e-ae52-cd7ea13c6677 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:35.265727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5265d868-3c85-4e7e-ae52-cd7ea13c6677 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:35.266783 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5265d868-3c85-4e7e-ae52-cd7ea13c6677 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:35.267437 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5265d868-3c85-4e7e-ae52-cd7ea13c6677 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:35.459047 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5265d868-3c85-4e7e-ae52-cd7ea13c6677 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:35.469789 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5265d868-3c85-4e7e-ae52-cd7ea13c6677 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1723 microversion: 2.1 time: 0.217615 Jul 31 01:47:35.471426 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2913/5853] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:35 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:36.490225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cd30a0f7-be8a-4e4a-98fb-2343764a0227 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:36.491448 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cd30a0f7-be8a-4e4a-98fb-2343764a0227 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:36.500389 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd30a0f7-be8a-4e4a-98fb-2343764a0227 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:36.500859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd30a0f7-be8a-4e4a-98fb-2343764a0227 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:36.501899 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd30a0f7-be8a-4e4a-98fb-2343764a0227 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:36.502636 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd30a0f7-be8a-4e4a-98fb-2343764a0227 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:36.699264 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cd30a0f7-be8a-4e4a-98fb-2343764a0227 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:36.711439 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cd30a0f7-be8a-4e4a-98fb-2343764a0227 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1723 microversion: 2.1 time: 0.225145 Jul 31 01:47:36.721485 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2941/5854] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:36 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:37.732955 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f7991459-7966-4a51-9e6c-8f0c465fe275 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:37.733612 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f7991459-7966-4a51-9e6c-8f0c465fe275 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:37.749531 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7991459-7966-4a51-9e6c-8f0c465fe275 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:37.756057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7991459-7966-4a51-9e6c-8f0c465fe275 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:37.760685 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7991459-7966-4a51-9e6c-8f0c465fe275 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:37.765843 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7991459-7966-4a51-9e6c-8f0c465fe275 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:37.979227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f7991459-7966-4a51-9e6c-8f0c465fe275 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:37.997806 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f7991459-7966-4a51-9e6c-8f0c465fe275 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1723 microversion: 2.1 time: 0.264755 Jul 31 01:47:37.998447 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2914/5855] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:37 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:47:39.027749 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-16a1fe37-c425-44e8-bc42-6dae71a4b310 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:39.028274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-16a1fe37-c425-44e8-bc42-6dae71a4b310 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:39.046272 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16a1fe37-c425-44e8-bc42-6dae71a4b310 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:39.046744 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16a1fe37-c425-44e8-bc42-6dae71a4b310 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:39.047587 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16a1fe37-c425-44e8-bc42-6dae71a4b310 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:39.048206 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16a1fe37-c425-44e8-bc42-6dae71a4b310 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:39.223235 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-16a1fe37-c425-44e8-bc42-6dae71a4b310 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:39.239697 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-16a1fe37-c425-44e8-bc42-6dae71a4b310 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1700 microversion: 2.1 time: 0.216832 Jul 31 01:47:39.251862 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2942/5856] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:39 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1700 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:39.280278 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f979d5bf-10ef-4d92-99d5-99f7b5e79984 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:47:39.295237 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f979d5bf-10ef-4d92-99d5-99f7b5e79984 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:39.296557 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f979d5bf-10ef-4d92-99d5-99f7b5e79984 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:39.318103 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 01:47:39.318429 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 01:47:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 01:47:39.337935 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f979d5bf-10ef-4d92-99d5-99f7b5e79984 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Going to try to start instance {{(pid=119474) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 31 01:47:39.420844 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f979d5bf-10ef-4d92-99d5-99f7b5e79984 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "POST /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/action" status: 202 len: 0 microversion: 2.1 time: 0.151981 Jul 31 01:47:39.434897 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2915/5857] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:47:39 2022] POST /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 01:47:39.443170 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0318ee0b-9778-401f-bad4-7be445822496 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:39.444052 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0318ee0b-9778-401f-bad4-7be445822496 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:39.474845 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0318ee0b-9778-401f-bad4-7be445822496 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:39.486018 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0318ee0b-9778-401f-bad4-7be445822496 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:39.494530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0318ee0b-9778-401f-bad4-7be445822496 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:39.495004 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0318ee0b-9778-401f-bad4-7be445822496 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:39.869294 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0318ee0b-9778-401f-bad4-7be445822496 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:39.880259 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0318ee0b-9778-401f-bad4-7be445822496 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1709 microversion: 2.1 time: 0.441171 Jul 31 01:47:39.881574 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2943/5858] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:39 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1709 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:40.906638 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5cfab11d-6767-4c14-87ee-3e0c93e4710f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:40.907369 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5cfab11d-6767-4c14-87ee-3e0c93e4710f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:40.918109 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5cfab11d-6767-4c14-87ee-3e0c93e4710f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:40.918585 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5cfab11d-6767-4c14-87ee-3e0c93e4710f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:40.919446 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5cfab11d-6767-4c14-87ee-3e0c93e4710f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:40.919906 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5cfab11d-6767-4c14-87ee-3e0c93e4710f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:41.144319 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5cfab11d-6767-4c14-87ee-3e0c93e4710f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:41.155041 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5cfab11d-6767-4c14-87ee-3e0c93e4710f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1709 microversion: 2.1 time: 0.253575 Jul 31 01:47:41.155868 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2916/5859] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:40 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1709 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:42.178229 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-899655ae-81f5-4f60-a7c3-958d8ffc61ec tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:42.179593 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-899655ae-81f5-4f60-a7c3-958d8ffc61ec tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:42.187196 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-899655ae-81f5-4f60-a7c3-958d8ffc61ec tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:42.189727 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-899655ae-81f5-4f60-a7c3-958d8ffc61ec tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:42.190840 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-899655ae-81f5-4f60-a7c3-958d8ffc61ec tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:42.191624 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-899655ae-81f5-4f60-a7c3-958d8ffc61ec tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:42.398001 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-899655ae-81f5-4f60-a7c3-958d8ffc61ec tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:42.407013 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-899655ae-81f5-4f60-a7c3-958d8ffc61ec tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1713 microversion: 2.1 time: 0.233422 Jul 31 01:47:42.441921 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2944/5860] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:42 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1713 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:45.155768 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-655a9a92-dddc-4f6d-9fa8-5a7c5c4db972 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-968531719", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-314743935", "security_groups": [{"name": "tempest-secgroup-smoke-405411779"}], "block_device_mapping_v2": [{"uuid": "d659fd19-bfe8-428b-9ab3-06aa01a5d1c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6739ac5e-7d06-4b25-b7ed-29fa35326c6e"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:47:45.280262 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-655a9a92-dddc-4f6d-9fa8-5a7c5c4db972 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] validate_networks() for [('6739ac5e-7d06-4b25-b7ed-29fa35326c6e', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:47:46.042814 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-655a9a92-dddc-4f6d-9fa8-5a7c5c4db972 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:47:46.043258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-655a9a92-dddc-4f6d-9fa8-5a7c5c4db972 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:47:46.043783 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-655a9a92-dddc-4f6d-9fa8-5a7c5c4db972 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:47:46.044217 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-655a9a92-dddc-4f6d-9fa8-5a7c5c4db972 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:47:46.044653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-655a9a92-dddc-4f6d-9fa8-5a7c5c4db972 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:47:46.054517 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-655a9a92-dddc-4f6d-9fa8-5a7c5c4db972 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:46.054997 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-655a9a92-dddc-4f6d-9fa8-5a7c5c4db972 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:46.055896 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-655a9a92-dddc-4f6d-9fa8-5a7c5c4db972 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:46.056380 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-655a9a92-dddc-4f6d-9fa8-5a7c5c4db972 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:46.075393 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-655a9a92-dddc-4f6d-9fa8-5a7c5c4db972 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:47:46.081137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-655a9a92-dddc-4f6d-9fa8-5a7c5c4db972 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Getting quotas for user f6c26df9a49446c290d6a0b1427f0c14 and project 4f0892e5f98e48408d15771c9d5805bf. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:47:46.152731 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-655a9a92-dddc-4f6d-9fa8-5a7c5c4db972 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:47:46.154847 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-655a9a92-dddc-4f6d-9fa8-5a7c5c4db972 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d659fd19-bfe8-428b-9ab3-06aa01a5d1c0',volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:47:46.351388 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-655a9a92-dddc-4f6d-9fa8-5a7c5c4db972 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.197132 Jul 31 01:47:46.353737 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2917/5861] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:47:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:47:46.365785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e2f3bd6-c865-4b93-92dc-4e96b99eb0e6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:46.366706 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1e2f3bd6-c865-4b93-92dc-4e96b99eb0e6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:46.438505 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1e2f3bd6-c865-4b93-92dc-4e96b99eb0e6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:46.447990 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1e2f3bd6-c865-4b93-92dc-4e96b99eb0e6 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1093 microversion: 2.1 time: 0.086828 Jul 31 01:47:46.449249 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2945/5862] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:46 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1093 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:47.470152 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c419d233-74b7-4c13-961d-a97c4c2bf7d4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:47.470907 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c419d233-74b7-4c13-961d-a97c4c2bf7d4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:47.477327 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c419d233-74b7-4c13-961d-a97c4c2bf7d4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:47.477979 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c419d233-74b7-4c13-961d-a97c4c2bf7d4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:47.478783 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c419d233-74b7-4c13-961d-a97c4c2bf7d4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:47.479242 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c419d233-74b7-4c13-961d-a97c4c2bf7d4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:47.589141 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c419d233-74b7-4c13-961d-a97c4c2bf7d4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:47.604084 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c419d233-74b7-4c13-961d-a97c4c2bf7d4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1191 microversion: 2.1 time: 0.138671 Jul 31 01:47:47.606853 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2918/5863] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:47 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1191 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:48.626877 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-68671ed1-e863-4c5c-bef6-0d3e09c0ac29 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:48.628226 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-68671ed1-e863-4c5c-bef6-0d3e09c0ac29 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:48.639654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-68671ed1-e863-4c5c-bef6-0d3e09c0ac29 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:48.640151 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-68671ed1-e863-4c5c-bef6-0d3e09c0ac29 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:48.641110 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-68671ed1-e863-4c5c-bef6-0d3e09c0ac29 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:48.641567 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-68671ed1-e863-4c5c-bef6-0d3e09c0ac29 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:48.947360 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-68671ed1-e863-4c5c-bef6-0d3e09c0ac29 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:48.959062 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-68671ed1-e863-4c5c-bef6-0d3e09c0ac29 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1276 microversion: 2.1 time: 0.334477 Jul 31 01:47:48.964790 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2946/5864] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:48 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1276 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:49.559517 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-bc055cf8-31c4-4d6b-8ea8-ab80a95428ef req-84e3e8ca-1ac7-4dda-8916-85c8d73e5d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9be455-7503-4a9a-b389-b43bc7a32d81", "tag": "00f95a0e-d9ce-4105-bde0-6fb409422776"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:47:49.572873 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-bc055cf8-31c4-4d6b-8ea8-ab80a95428ef req-84e3e8ca-1ac7-4dda-8916-85c8d73e5d58 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:49.574076 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-bc055cf8-31c4-4d6b-8ea8-ab80a95428ef req-84e3e8ca-1ac7-4dda-8916-85c8d73e5d58 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:49.588566 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-bc055cf8-31c4-4d6b-8ea8-ab80a95428ef req-84e3e8ca-1ac7-4dda-8916-85c8d73e5d58 service nova] Creating event network-changed:00f95a0e-d9ce-4105-bde0-6fb409422776 for instance 3d9be455-7503-4a9a-b389-b43bc7a32d81 on n-h1-master-1 Jul 31 01:47:49.594495 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-bc055cf8-31c4-4d6b-8ea8-ab80a95428ef req-84e3e8ca-1ac7-4dda-8916-85c8d73e5d58 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217192 Jul 31 01:47:49.596174 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2919/5865] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:47:49.980800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e55ffd0b-6aff-4b0a-b1c3-197f0d5a75a8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:49.981728 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e55ffd0b-6aff-4b0a-b1c3-197f0d5a75a8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:49.990123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e55ffd0b-6aff-4b0a-b1c3-197f0d5a75a8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:49.990704 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e55ffd0b-6aff-4b0a-b1c3-197f0d5a75a8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:49.991742 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e55ffd0b-6aff-4b0a-b1c3-197f0d5a75a8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:49.992283 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e55ffd0b-6aff-4b0a-b1c3-197f0d5a75a8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:50.221305 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e55ffd0b-6aff-4b0a-b1c3-197f0d5a75a8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:50.238067 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e55ffd0b-6aff-4b0a-b1c3-197f0d5a75a8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1276 microversion: 2.1 time: 0.261823 Jul 31 01:47:50.238681 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2947/5866] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:49 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:51.262740 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-16b2319c-1c20-4d87-af5f-39991dc97bc4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:51.263812 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-16b2319c-1c20-4d87-af5f-39991dc97bc4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:51.271566 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16b2319c-1c20-4d87-af5f-39991dc97bc4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:51.272337 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16b2319c-1c20-4d87-af5f-39991dc97bc4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:51.273498 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16b2319c-1c20-4d87-af5f-39991dc97bc4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:51.274364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16b2319c-1c20-4d87-af5f-39991dc97bc4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:51.444412 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-16b2319c-1c20-4d87-af5f-39991dc97bc4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:51.463858 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-16b2319c-1c20-4d87-af5f-39991dc97bc4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1276 microversion: 2.1 time: 0.207876 Jul 31 01:47:51.464886 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2920/5867] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:51 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1276 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:52.486436 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-adb65386-591e-4d21-828e-1ce7407d0c22 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:52.487059 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-adb65386-591e-4d21-828e-1ce7407d0c22 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:52.494146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-adb65386-591e-4d21-828e-1ce7407d0c22 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:52.494939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-adb65386-591e-4d21-828e-1ce7407d0c22 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:52.495980 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-adb65386-591e-4d21-828e-1ce7407d0c22 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:52.496926 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-adb65386-591e-4d21-828e-1ce7407d0c22 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:52.674789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-adb65386-591e-4d21-828e-1ce7407d0c22 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:52.681031 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:52.717688 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-adb65386-591e-4d21-828e-1ce7407d0c22 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1276 microversion: 2.1 time: 0.235195 Jul 31 01:47:52.718712 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2948/5868] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:52 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:53.751394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fc8de706-290c-49f3-b0a4-fde12fab5ddd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:53.751891 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fc8de706-290c-49f3-b0a4-fde12fab5ddd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:53.759419 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:53.761177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc8de706-290c-49f3-b0a4-fde12fab5ddd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:53.761653 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc8de706-290c-49f3-b0a4-fde12fab5ddd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:53.762463 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc8de706-290c-49f3-b0a4-fde12fab5ddd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:53.762918 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc8de706-290c-49f3-b0a4-fde12fab5ddd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:53.767160 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:53.932215 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fc8de706-290c-49f3-b0a4-fde12fab5ddd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:53.941697 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fc8de706-290c-49f3-b0a4-fde12fab5ddd tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1276 microversion: 2.1 time: 0.202917 Jul 31 01:47:53.942454 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2921/5869] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:53 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1276 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:54.968292 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2f2a63f2-c9cb-4bc0-91fd-b707c2b185b4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:54.968929 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2f2a63f2-c9cb-4bc0-91fd-b707c2b185b4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:54.975070 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=31 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:54.976814 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2f2a63f2-c9cb-4bc0-91fd-b707c2b185b4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:54.977436 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2f2a63f2-c9cb-4bc0-91fd-b707c2b185b4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:54.978365 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2f2a63f2-c9cb-4bc0-91fd-b707c2b185b4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:54.978815 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2f2a63f2-c9cb-4bc0-91fd-b707c2b185b4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:55.218006 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2f2a63f2-c9cb-4bc0-91fd-b707c2b185b4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:55.304609 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2f2a63f2-c9cb-4bc0-91fd-b707c2b185b4 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1276 microversion: 2.1 time: 0.264922 Jul 31 01:47:55.304609 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2949/5870] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:54 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1276 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:55.836228 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-55b320fd-afe3-48f3-8982-494001c1b061 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'create', calling method: .version_select at 0x7fede451ef70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-111435149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc/dhu4SOqfDXydZ+CW6pC9N2vgpHl4QMZ1Jvv5l3oC6bcNSN4x9kmNIObZTHrpwa3IzgdpLQkeFslufcwxydQfS4eoVvljP2jfYqWy7Dl2TeN95nGzFiT7/PWs1k5SEQ=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:47:55.852525 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-55b320fd-afe3-48f3-8982-494001c1b061 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Getting quotas for project 736abaeccdf44e3899d98fdf2cac4c0f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:47:55.858475 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-55b320fd-afe3-48f3-8982-494001c1b061 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Getting quotas for user b799c19fd26348d3a84198bb76581c87 and project 736abaeccdf44e3899d98fdf2cac4c0f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:47:55.897210 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-55b320fd-afe3-48f3-8982-494001c1b061 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.247833 Jul 31 01:47:55.897814 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2922/5871] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:47:55 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:47:56.247074 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ea42369-6793-4ff9-b0d0-20cca1b388d1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:56.247993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4ea42369-6793-4ff9-b0d0-20cca1b388d1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:56.255977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ea42369-6793-4ff9-b0d0-20cca1b388d1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:56.256772 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ea42369-6793-4ff9-b0d0-20cca1b388d1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:56.257635 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ea42369-6793-4ff9-b0d0-20cca1b388d1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:56.258997 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ea42369-6793-4ff9-b0d0-20cca1b388d1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:56.438048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4ea42369-6793-4ff9-b0d0-20cca1b388d1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:56.446692 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4ea42369-6793-4ff9-b0d0-20cca1b388d1 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1264 microversion: 2.1 time: 0.204336 Jul 31 01:47:56.447267 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2950/5872] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:56 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1264 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:47:57.466020 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:57.471510 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c02e23d7-7562-4c80-b6a6-a138cb64a95b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:57.472177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c02e23d7-7562-4c80-b6a6-a138cb64a95b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:57.479553 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c02e23d7-7562-4c80-b6a6-a138cb64a95b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:57.480017 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c02e23d7-7562-4c80-b6a6-a138cb64a95b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:57.480796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c02e23d7-7562-4c80-b6a6-a138cb64a95b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:57.481243 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c02e23d7-7562-4c80-b6a6-a138cb64a95b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:57.633751 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c02e23d7-7562-4c80-b6a6-a138cb64a95b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:57.642816 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c02e23d7-7562-4c80-b6a6-a138cb64a95b tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1264 microversion: 2.1 time: 0.177308 Jul 31 01:47:57.656585 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2923/5873] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:57 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:58.676233 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8c7c471a-0c98-4af5-bb05-7b4f561cf991 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:58.676873 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8c7c471a-0c98-4af5-bb05-7b4f561cf991 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:58.679862 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:47:58.686085 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c7c471a-0c98-4af5-bb05-7b4f561cf991 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:58.686549 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c7c471a-0c98-4af5-bb05-7b4f561cf991 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:58.696487 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c7c471a-0c98-4af5-bb05-7b4f561cf991 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:58.697041 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8c7c471a-0c98-4af5-bb05-7b4f561cf991 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:58.844229 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8c7c471a-0c98-4af5-bb05-7b4f561cf991 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:47:58.855629 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8c7c471a-0c98-4af5-bb05-7b4f561cf991 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1264 microversion: 2.1 time: 0.195083 Jul 31 01:47:58.856255 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2951/5874] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:58 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:47:59.880307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eaee8187-b3a6-41c1-85d2-85d42a3cc522 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:47:59.881804 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eaee8187-b3a6-41c1-85d2-85d42a3cc522 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:47:59.892787 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eaee8187-b3a6-41c1-85d2-85d42a3cc522 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:59.893533 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eaee8187-b3a6-41c1-85d2-85d42a3cc522 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:47:59.894518 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eaee8187-b3a6-41c1-85d2-85d42a3cc522 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:47:59.895844 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eaee8187-b3a6-41c1-85d2-85d42a3cc522 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:00.102810 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eaee8187-b3a6-41c1-85d2-85d42a3cc522 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:00.111057 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eaee8187-b3a6-41c1-85d2-85d42a3cc522 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1264 microversion: 2.1 time: 0.237325 Jul 31 01:48:00.112047 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2924/5875] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:47:59 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:01.134286 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3a613b2e-12b1-4fee-b8b2-2f974e6820f5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:01.134910 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3a613b2e-12b1-4fee-b8b2-2f974e6820f5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:01.145848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3a613b2e-12b1-4fee-b8b2-2f974e6820f5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:01.146548 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3a613b2e-12b1-4fee-b8b2-2f974e6820f5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:01.147330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3a613b2e-12b1-4fee-b8b2-2f974e6820f5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:01.151644 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3a613b2e-12b1-4fee-b8b2-2f974e6820f5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:01.346522 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3a613b2e-12b1-4fee-b8b2-2f974e6820f5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:01.356044 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3a613b2e-12b1-4fee-b8b2-2f974e6820f5 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1264 microversion: 2.1 time: 0.226895 Jul 31 01:48:01.356643 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2952/5876] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:01 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:02.391449 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cd1262e6-5f0f-49c7-aab4-4594a7a0b501 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:02.392920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cd1262e6-5f0f-49c7-aab4-4594a7a0b501 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:02.411449 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd1262e6-5f0f-49c7-aab4-4594a7a0b501 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:02.411928 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd1262e6-5f0f-49c7-aab4-4594a7a0b501 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:02.412800 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd1262e6-5f0f-49c7-aab4-4594a7a0b501 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:02.414699 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd1262e6-5f0f-49c7-aab4-4594a7a0b501 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:02.630310 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cd1262e6-5f0f-49c7-aab4-4594a7a0b501 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:02.643165 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cd1262e6-5f0f-49c7-aab4-4594a7a0b501 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1264 microversion: 2.1 time: 0.266927 Jul 31 01:48:02.672501 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2925/5877] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:02 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1264 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:02.937112 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cf7b7b16-37a2-47a2-bef4-abf357075b8a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-246003944", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "427bdb8e-653b-4ced-b21e-122a1086d75a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-111435149", "security_groups": [{"name": "tempest-secgroup-smoke-1092074788"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:48:03.138686 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-cf7b7b16-37a2-47a2-bef4-abf357075b8a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] validate_networks() for [('427bdb8e-653b-4ced-b21e-122a1086d75a', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:48:03.599176 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-cf7b7b16-37a2-47a2-bef4-abf357075b8a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:48:03.599706 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-cf7b7b16-37a2-47a2-bef4-abf357075b8a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:48:03.600352 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-cf7b7b16-37a2-47a2-bef4-abf357075b8a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:48:03.601026 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-cf7b7b16-37a2-47a2-bef4-abf357075b8a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:48:03.601839 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-cf7b7b16-37a2-47a2-bef4-abf357075b8a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:48:03.612236 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf7b7b16-37a2-47a2-bef4-abf357075b8a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:03.612790 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf7b7b16-37a2-47a2-bef4-abf357075b8a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:03.613746 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf7b7b16-37a2-47a2-bef4-abf357075b8a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:03.614257 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf7b7b16-37a2-47a2-bef4-abf357075b8a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:03.633995 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-cf7b7b16-37a2-47a2-bef4-abf357075b8a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Getting quotas for project 736abaeccdf44e3899d98fdf2cac4c0f. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:48:03.639541 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-cf7b7b16-37a2-47a2-bef4-abf357075b8a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Getting quotas for user b799c19fd26348d3a84198bb76581c87 and project 736abaeccdf44e3899d98fdf2cac4c0f. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:48:03.653776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cf7b7b16-37a2-47a2-bef4-abf357075b8a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:48:03.661095 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cf7b7b16-37a2-47a2-bef4-abf357075b8a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:48:03.673529 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5f87cac6-3614-4767-8f1b-c487491002ba tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:03.674840 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5f87cac6-3614-4767-8f1b-c487491002ba tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:03.704931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f87cac6-3614-4767-8f1b-c487491002ba tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:03.706444 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f87cac6-3614-4767-8f1b-c487491002ba tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:03.708626 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f87cac6-3614-4767-8f1b-c487491002ba tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:03.710108 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5f87cac6-3614-4767-8f1b-c487491002ba tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:03.726732 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cf7b7b16-37a2-47a2-bef4-abf357075b8a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.793370 Jul 31 01:48:03.734027 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2953/5878] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:48:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:48:03.739064 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1bab9242-1857-4ba9-9422-3372846935cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:03.740003 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1bab9242-1857-4ba9-9422-3372846935cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:03.827724 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1bab9242-1857-4ba9-9422-3372846935cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:03.835640 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1bab9242-1857-4ba9-9422-3372846935cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1265 microversion: 2.1 time: 0.100331 Jul 31 01:48:03.836530 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2954/5879] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:03 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:03.986050 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5f87cac6-3614-4767-8f1b-c487491002ba tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:03.994957 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5f87cac6-3614-4767-8f1b-c487491002ba tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1264 microversion: 2.1 time: 0.326412 Jul 31 01:48:04.014650 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2926/5880] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:03 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1264 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:04.860709 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-df4c316b-f846-48d9-838c-3f9b224275c0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:04.861349 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-df4c316b-f846-48d9-838c-3f9b224275c0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:04.872436 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df4c316b-f846-48d9-838c-3f9b224275c0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:04.873004 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df4c316b-f846-48d9-838c-3f9b224275c0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:04.874045 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df4c316b-f846-48d9-838c-3f9b224275c0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:04.874600 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-df4c316b-f846-48d9-838c-3f9b224275c0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:04.954441 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-df4c316b-f846-48d9-838c-3f9b224275c0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:04.962741 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-df4c316b-f846-48d9-838c-3f9b224275c0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1317 microversion: 2.1 time: 0.109241 Jul 31 01:48:04.964018 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2955/5881] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:04 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1317 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:05.016321 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a1311b42-ed8a-42d7-be9d-5008151bb116 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:05.016963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a1311b42-ed8a-42d7-be9d-5008151bb116 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:05.025054 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1311b42-ed8a-42d7-be9d-5008151bb116 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:05.025533 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1311b42-ed8a-42d7-be9d-5008151bb116 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:05.026340 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1311b42-ed8a-42d7-be9d-5008151bb116 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:05.026806 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1311b42-ed8a-42d7-be9d-5008151bb116 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:05.269618 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a1311b42-ed8a-42d7-be9d-5008151bb116 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:05.279210 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a1311b42-ed8a-42d7-be9d-5008151bb116 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1264 microversion: 2.1 time: 0.266902 Jul 31 01:48:05.280797 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2927/5882] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:05 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1264 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:05.985726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4f46e4b5-98fe-426a-b9f3-f0b463af7e45 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:05.987583 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4f46e4b5-98fe-426a-b9f3-f0b463af7e45 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:05.998293 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f46e4b5-98fe-426a-b9f3-f0b463af7e45 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:05.999186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f46e4b5-98fe-426a-b9f3-f0b463af7e45 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:06.000595 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f46e4b5-98fe-426a-b9f3-f0b463af7e45 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:06.001946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f46e4b5-98fe-426a-b9f3-f0b463af7e45 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:06.028551 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=10 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:06.197287 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-a83faacb-18f8-4db5-b122-0b665bb2ad1b req-43287acd-e9b5-4d5f-96f4-d3d967e235c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9be455-7503-4a9a-b389-b43bc7a32d81", "name": "network-vif-plugged", "status": "completed", "tag": "00f95a0e-d9ce-4105-bde0-6fb409422776"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:48:06.209953 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a83faacb-18f8-4db5-b122-0b665bb2ad1b req-43287acd-e9b5-4d5f-96f4-d3d967e235c2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:06.211751 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a83faacb-18f8-4db5-b122-0b665bb2ad1b req-43287acd-e9b5-4d5f-96f4-d3d967e235c2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:06.243653 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-a83faacb-18f8-4db5-b122-0b665bb2ad1b req-43287acd-e9b5-4d5f-96f4-d3d967e235c2 service nova] Creating event network-vif-plugged:00f95a0e-d9ce-4105-bde0-6fb409422776 for instance 3d9be455-7503-4a9a-b389-b43bc7a32d81 on n-h1-master-1 Jul 31 01:48:06.250428 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-a83faacb-18f8-4db5-b122-0b665bb2ad1b req-43287acd-e9b5-4d5f-96f4-d3d967e235c2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228360 Jul 31 01:48:06.253125 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2928/5883] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:48:06.302154 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4a2aa2fa-c6a8-46e5-bf95-4c0fac1e587a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:06.303053 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4a2aa2fa-c6a8-46e5-bf95-4c0fac1e587a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:06.313178 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a2aa2fa-c6a8-46e5-bf95-4c0fac1e587a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:06.316536 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a2aa2fa-c6a8-46e5-bf95-4c0fac1e587a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:06.318973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a2aa2fa-c6a8-46e5-bf95-4c0fac1e587a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:06.321816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a2aa2fa-c6a8-46e5-bf95-4c0fac1e587a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:06.370448 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4f46e4b5-98fe-426a-b9f3-f0b463af7e45 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:06.380169 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4f46e4b5-98fe-426a-b9f3-f0b463af7e45 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1391 microversion: 2.1 time: 0.399711 Jul 31 01:48:06.388100 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2956/5884] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:05 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1391 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:06.742845 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4a2aa2fa-c6a8-46e5-bf95-4c0fac1e587a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:06.756250 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4a2aa2fa-c6a8-46e5-bf95-4c0fac1e587a tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1264 microversion: 2.1 time: 0.458294 Jul 31 01:48:06.775557 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2929/5885] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:06 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1264 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:48:07.324955 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-b954b9f8-f8a9-46e9-a4d6-fb8662b53288 req-7a4f5330-3e9a-4e89-a0fe-f61b3a64927b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f92c8a2e-dce8-409a-a117-879a319f8cd5", "tag": "f0c13688-0117-437d-8918-32518c254c56"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:48:07.352388 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b954b9f8-f8a9-46e9-a4d6-fb8662b53288 req-7a4f5330-3e9a-4e89-a0fe-f61b3a64927b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:07.353078 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b954b9f8-f8a9-46e9-a4d6-fb8662b53288 req-7a4f5330-3e9a-4e89-a0fe-f61b3a64927b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:07.366579 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-b954b9f8-f8a9-46e9-a4d6-fb8662b53288 req-7a4f5330-3e9a-4e89-a0fe-f61b3a64927b service nova] Creating event network-changed:f0c13688-0117-437d-8918-32518c254c56 for instance f92c8a2e-dce8-409a-a117-879a319f8cd5 on n-h2-master-1 Jul 31 01:48:07.372281 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-b954b9f8-f8a9-46e9-a4d6-fb8662b53288 req-7a4f5330-3e9a-4e89-a0fe-f61b3a64927b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066880 Jul 31 01:48:07.372900 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2957/5886] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:48:07.411568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5832fae7-3170-4a6f-9060-2a22e7b6bb5e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:07.414342 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5832fae7-3170-4a6f-9060-2a22e7b6bb5e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:07.423362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5832fae7-3170-4a6f-9060-2a22e7b6bb5e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:07.424577 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5832fae7-3170-4a6f-9060-2a22e7b6bb5e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:07.425864 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5832fae7-3170-4a6f-9060-2a22e7b6bb5e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:07.426324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5832fae7-3170-4a6f-9060-2a22e7b6bb5e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:07.685547 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5832fae7-3170-4a6f-9060-2a22e7b6bb5e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:07.698253 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5832fae7-3170-4a6f-9060-2a22e7b6bb5e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1391 microversion: 2.1 time: 0.290498 Jul 31 01:48:07.703630 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2930/5887] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:07 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1391 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:07.781134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6e68c938-5a41-4298-8d6b-7ea11c707983 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:07.782257 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6e68c938-5a41-4298-8d6b-7ea11c707983 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:07.789802 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e68c938-5a41-4298-8d6b-7ea11c707983 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:07.790553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e68c938-5a41-4298-8d6b-7ea11c707983 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:07.791684 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e68c938-5a41-4298-8d6b-7ea11c707983 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:07.792144 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e68c938-5a41-4298-8d6b-7ea11c707983 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:08.004618 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6e68c938-5a41-4298-8d6b-7ea11c707983 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:08.013496 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6e68c938-5a41-4298-8d6b-7ea11c707983 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1264 microversion: 2.1 time: 0.237400 Jul 31 01:48:08.014089 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2958/5888] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:07 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:08.718067 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-88abc73f-3a43-4476-a908-54cb7310bae5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:08.718840 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-88abc73f-3a43-4476-a908-54cb7310bae5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:08.726016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88abc73f-3a43-4476-a908-54cb7310bae5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:08.726530 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88abc73f-3a43-4476-a908-54cb7310bae5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:08.727330 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88abc73f-3a43-4476-a908-54cb7310bae5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:08.727809 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88abc73f-3a43-4476-a908-54cb7310bae5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:08.922938 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-88abc73f-3a43-4476-a908-54cb7310bae5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:08.936396 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-88abc73f-3a43-4476-a908-54cb7310bae5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1391 microversion: 2.1 time: 0.221856 Jul 31 01:48:08.938383 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2931/5889] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:08 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1391 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:09.034222 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d6ad69f8-8ba0-4b69-a962-8ea11bc8d575 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:09.034848 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d6ad69f8-8ba0-4b69-a962-8ea11bc8d575 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:09.043117 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d6ad69f8-8ba0-4b69-a962-8ea11bc8d575 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:09.043878 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d6ad69f8-8ba0-4b69-a962-8ea11bc8d575 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:09.044781 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d6ad69f8-8ba0-4b69-a962-8ea11bc8d575 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:09.045337 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d6ad69f8-8ba0-4b69-a962-8ea11bc8d575 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:09.248162 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d6ad69f8-8ba0-4b69-a962-8ea11bc8d575 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:09.256067 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d6ad69f8-8ba0-4b69-a962-8ea11bc8d575 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1450 microversion: 2.1 time: 0.225900 Jul 31 01:48:09.256774 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2959/5890] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:09 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1450 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:09.276904 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6feba44d-c7b6-4474-b06b-897b6230fed7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:09.277460 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6feba44d-c7b6-4474-b06b-897b6230fed7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:09.284259 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6feba44d-c7b6-4474-b06b-897b6230fed7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:09.284731 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6feba44d-c7b6-4474-b06b-897b6230fed7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:09.285519 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6feba44d-c7b6-4474-b06b-897b6230fed7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:09.285973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6feba44d-c7b6-4474-b06b-897b6230fed7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:09.493741 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6feba44d-c7b6-4474-b06b-897b6230fed7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:09.502974 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6feba44d-c7b6-4474-b06b-897b6230fed7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1450 microversion: 2.1 time: 0.229985 Jul 31 01:48:09.504152 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2932/5891] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:09 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1450 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:09.958595 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-44b38814-4dec-45e3-bdac-b7b916e95b0f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:09.959226 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-44b38814-4dec-45e3-bdac-b7b916e95b0f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:09.968080 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44b38814-4dec-45e3-bdac-b7b916e95b0f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:09.968565 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44b38814-4dec-45e3-bdac-b7b916e95b0f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:09.969568 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44b38814-4dec-45e3-bdac-b7b916e95b0f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:09.970025 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44b38814-4dec-45e3-bdac-b7b916e95b0f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:10.518967 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-44b38814-4dec-45e3-bdac-b7b916e95b0f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:10.527062 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-44b38814-4dec-45e3-bdac-b7b916e95b0f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1391 microversion: 2.1 time: 0.572494 Jul 31 01:48:10.527898 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2960/5892] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:09 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1391 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:11.551805 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7b1b2b0e-780d-4c90-b5c6-df48a76056a0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:11.553103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7b1b2b0e-780d-4c90-b5c6-df48a76056a0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:11.569382 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b1b2b0e-780d-4c90-b5c6-df48a76056a0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:11.572018 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b1b2b0e-780d-4c90-b5c6-df48a76056a0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:11.573666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b1b2b0e-780d-4c90-b5c6-df48a76056a0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:11.574361 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b1b2b0e-780d-4c90-b5c6-df48a76056a0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:11.590680 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-34bbe76f-86d4-4101-8f04-21d4fab2a314 req-33bde698-e4e6-442f-ae80-bd62dc6750a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9be455-7503-4a9a-b389-b43bc7a32d81", "tag": "00f95a0e-d9ce-4105-bde0-6fb409422776"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:48:11.611317 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-34bbe76f-86d4-4101-8f04-21d4fab2a314 req-33bde698-e4e6-442f-ae80-bd62dc6750a4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:11.611878 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-34bbe76f-86d4-4101-8f04-21d4fab2a314 req-33bde698-e4e6-442f-ae80-bd62dc6750a4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:11.629809 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-34bbe76f-86d4-4101-8f04-21d4fab2a314 req-33bde698-e4e6-442f-ae80-bd62dc6750a4 service nova] Creating event network-changed:00f95a0e-d9ce-4105-bde0-6fb409422776 for instance 3d9be455-7503-4a9a-b389-b43bc7a32d81 on n-h1-master-1 Jul 31 01:48:11.641822 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-34bbe76f-86d4-4101-8f04-21d4fab2a314 req-33bde698-e4e6-442f-ae80-bd62dc6750a4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054288 Jul 31 01:48:11.642970 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2961/5893] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:48:11.758800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7b1b2b0e-780d-4c90-b5c6-df48a76056a0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:11.768254 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7b1b2b0e-780d-4c90-b5c6-df48a76056a0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1391 microversion: 2.1 time: 0.222974 Jul 31 01:48:11.769479 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2933/5894] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:11 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1391 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:12.791843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-352f3a14-4f4c-4cec-99ea-f52901a0a164 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:12.792560 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-352f3a14-4f4c-4cec-99ea-f52901a0a164 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:12.798887 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-352f3a14-4f4c-4cec-99ea-f52901a0a164 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:12.799408 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-352f3a14-4f4c-4cec-99ea-f52901a0a164 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:12.800226 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-352f3a14-4f4c-4cec-99ea-f52901a0a164 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:12.800675 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-352f3a14-4f4c-4cec-99ea-f52901a0a164 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:12.862819 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-dcffaf74-1714-4701-ba66-44488b860b14 req-65d86c83-3c74-4c8a-85b3-60cfe3ef293b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92c8a2e-dce8-409a-a117-879a319f8cd5", "name": "network-vif-plugged", "status": "completed", "tag": "f0c13688-0117-437d-8918-32518c254c56"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:48:12.876046 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-dcffaf74-1714-4701-ba66-44488b860b14 req-65d86c83-3c74-4c8a-85b3-60cfe3ef293b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:12.876510 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-dcffaf74-1714-4701-ba66-44488b860b14 req-65d86c83-3c74-4c8a-85b3-60cfe3ef293b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:12.888451 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-dcffaf74-1714-4701-ba66-44488b860b14 req-65d86c83-3c74-4c8a-85b3-60cfe3ef293b service nova] Creating event network-vif-plugged:f0c13688-0117-437d-8918-32518c254c56 for instance f92c8a2e-dce8-409a-a117-879a319f8cd5 on n-h2-master-1 Jul 31 01:48:12.893414 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-dcffaf74-1714-4701-ba66-44488b860b14 req-65d86c83-3c74-4c8a-85b3-60cfe3ef293b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034420 Jul 31 01:48:12.894221 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2934/5895] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:48:12.950580 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-352f3a14-4f4c-4cec-99ea-f52901a0a164 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:12.959060 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-352f3a14-4f4c-4cec-99ea-f52901a0a164 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1391 microversion: 2.1 time: 0.172323 Jul 31 01:48:12.959708 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2962/5896] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:12 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:13.983282 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ca76d5d5-5e16-4bf1-a23c-260e855247ba tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:13.984060 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ca76d5d5-5e16-4bf1-a23c-260e855247ba tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:13.990806 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca76d5d5-5e16-4bf1-a23c-260e855247ba tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:13.991286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca76d5d5-5e16-4bf1-a23c-260e855247ba tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:13.992624 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca76d5d5-5e16-4bf1-a23c-260e855247ba tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:13.993080 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ca76d5d5-5e16-4bf1-a23c-260e855247ba tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:14.133830 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ca76d5d5-5e16-4bf1-a23c-260e855247ba tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:14.142016 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ca76d5d5-5e16-4bf1-a23c-260e855247ba tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1391 microversion: 2.1 time: 0.163887 Jul 31 01:48:14.142741 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2935/5897] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:13 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:15.163306 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ffb248d7-d742-46ec-8160-8c33a75c94c3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:15.163947 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ffb248d7-d742-46ec-8160-8c33a75c94c3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:15.165926 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:15.167455 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:15.173410 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ffb248d7-d742-46ec-8160-8c33a75c94c3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:15.173865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ffb248d7-d742-46ec-8160-8c33a75c94c3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:15.174628 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ffb248d7-d742-46ec-8160-8c33a75c94c3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:15.175090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ffb248d7-d742-46ec-8160-8c33a75c94c3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:15.317777 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ffb248d7-d742-46ec-8160-8c33a75c94c3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:15.325879 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ffb248d7-d742-46ec-8160-8c33a75c94c3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1563 microversion: 2.1 time: 0.166549 Jul 31 01:48:15.326459 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2963/5898] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:15 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:15.339097 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0812adf8-095f-4b02-bcfd-3bf533db49ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:15.340070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0812adf8-095f-4b02-bcfd-3bf533db49ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:15.347768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0812adf8-095f-4b02-bcfd-3bf533db49ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:15.348243 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0812adf8-095f-4b02-bcfd-3bf533db49ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:15.348770 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a9249069-5515-48d5-ad2f-61b17add6d69 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:15.349043 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0812adf8-095f-4b02-bcfd-3bf533db49ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:15.350399 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a9249069-5515-48d5-ad2f-61b17add6d69 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:15.351608 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0812adf8-095f-4b02-bcfd-3bf533db49ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:15.357415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9249069-5515-48d5-ad2f-61b17add6d69 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:15.358179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9249069-5515-48d5-ad2f-61b17add6d69 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:15.359062 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9249069-5515-48d5-ad2f-61b17add6d69 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:15.359670 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9249069-5515-48d5-ad2f-61b17add6d69 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:15.447496 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-0812adf8-095f-4b02-bcfd-3bf533db49ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lazy-loading 'services' on Instance uuid b8488f02-8f89-4fb7-8e4f-30414f9ad09e {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:48:15.509150 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a9249069-5515-48d5-ad2f-61b17add6d69 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:15.520519 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a9249069-5515-48d5-ad2f-61b17add6d69 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1563 microversion: 2.1 time: 0.176804 Jul 31 01:48:15.531201 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2964/5899] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:15 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:15.531411 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0812adf8-095f-4b02-bcfd-3bf533db49ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/os-volume_attachments/cb0ceb19-b9e2-4986-b200-fd1eedcca7f5" status: 202 len: 0 microversion: 2.1 time: 0.192700 Jul 31 01:48:15.531411 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2936/5900] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 01:48:15 2022] DELETE /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/os-volume_attachments/cb0ceb19-b9e2-4986-b200-fd1eedcca7f5 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:48:17.786438 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bc494f13-83b7-4508-9fdd-6f6841b833b5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:17.787102 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bc494f13-83b7-4508-9fdd-6f6841b833b5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:17.796382 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-81c6729d-e958-458e-acb4-78b86ab4c2df req-dff59bf6-7f2e-410e-a47c-c4daae4b910c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f92c8a2e-dce8-409a-a117-879a319f8cd5", "tag": "f0c13688-0117-437d-8918-32518c254c56"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:48:17.801345 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc494f13-83b7-4508-9fdd-6f6841b833b5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:17.801742 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc494f13-83b7-4508-9fdd-6f6841b833b5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:17.805698 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc494f13-83b7-4508-9fdd-6f6841b833b5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:17.806202 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc494f13-83b7-4508-9fdd-6f6841b833b5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:17.828839 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-81c6729d-e958-458e-acb4-78b86ab4c2df req-dff59bf6-7f2e-410e-a47c-c4daae4b910c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:17.830520 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-81c6729d-e958-458e-acb4-78b86ab4c2df req-dff59bf6-7f2e-410e-a47c-c4daae4b910c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:17.848065 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-81c6729d-e958-458e-acb4-78b86ab4c2df req-dff59bf6-7f2e-410e-a47c-c4daae4b910c service nova] Creating event network-changed:f0c13688-0117-437d-8918-32518c254c56 for instance f92c8a2e-dce8-409a-a117-879a319f8cd5 on n-h2-master-1 Jul 31 01:48:17.856043 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-81c6729d-e958-458e-acb4-78b86ab4c2df req-dff59bf6-7f2e-410e-a47c-c4daae4b910c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063564 Jul 31 01:48:17.857279 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2937/5901] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:48:18.139533 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bc494f13-83b7-4508-9fdd-6f6841b833b5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:18.155125 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bc494f13-83b7-4508-9fdd-6f6841b833b5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1563 microversion: 2.1 time: 0.369168 Jul 31 01:48:18.155847 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2965/5902] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:17 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1563 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:21.044760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-19d1733e-88c7-4eeb-a690-c1239dc34294 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:48:21.051159 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-19d1733e-88c7-4eeb-a690-c1239dc34294 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:21.051651 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-19d1733e-88c7-4eeb-a690-c1239dc34294 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:21.073897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-19d1733e-88c7-4eeb-a690-c1239dc34294 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Going to try to stop instance {{(pid=119474) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 01:48:21.114716 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-19d1733e-88c7-4eeb-a690-c1239dc34294 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "POST /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/action" status: 202 len: 0 microversion: 2.1 time: 0.075123 Jul 31 01:48:21.115323 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2938/5903] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:48:21 2022] POST /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:48:21.124273 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3d13c7f-ce5c-42e7-8d1d-26ccedde591d tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:21.124901 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3d13c7f-ce5c-42e7-8d1d-26ccedde591d tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:21.132483 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3d13c7f-ce5c-42e7-8d1d-26ccedde591d tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:21.133037 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3d13c7f-ce5c-42e7-8d1d-26ccedde591d tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:21.133819 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3d13c7f-ce5c-42e7-8d1d-26ccedde591d tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:21.134263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3d13c7f-ce5c-42e7-8d1d-26ccedde591d tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:21.278441 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3d13c7f-ce5c-42e7-8d1d-26ccedde591d tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:21.286190 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3d13c7f-ce5c-42e7-8d1d-26ccedde591d tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1677 microversion: 2.1 time: 0.165973 Jul 31 01:48:21.286769 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2966/5904] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:21 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:22.309631 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63dbe392-0a8c-4b2c-bd04-63c325c04e2f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:22.310449 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-63dbe392-0a8c-4b2c-bd04-63c325c04e2f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:22.316893 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63dbe392-0a8c-4b2c-bd04-63c325c04e2f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:22.317364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63dbe392-0a8c-4b2c-bd04-63c325c04e2f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:22.318154 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63dbe392-0a8c-4b2c-bd04-63c325c04e2f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:22.318609 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63dbe392-0a8c-4b2c-bd04-63c325c04e2f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:22.321394 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:22.454857 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-63dbe392-0a8c-4b2c-bd04-63c325c04e2f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:22.463132 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-63dbe392-0a8c-4b2c-bd04-63c325c04e2f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1677 microversion: 2.1 time: 0.158673 Jul 31 01:48:22.463736 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2939/5905] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:22 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:48:23.485566 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e1fbdc31-c880-450a-a820-d79c2de40a99 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:23.486187 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e1fbdc31-c880-450a-a820-d79c2de40a99 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:23.493148 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1fbdc31-c880-450a-a820-d79c2de40a99 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:23.493604 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1fbdc31-c880-450a-a820-d79c2de40a99 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:23.494371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1fbdc31-c880-450a-a820-d79c2de40a99 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:23.494817 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1fbdc31-c880-450a-a820-d79c2de40a99 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:23.635203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e1fbdc31-c880-450a-a820-d79c2de40a99 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:23.642972 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e1fbdc31-c880-450a-a820-d79c2de40a99 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1677 microversion: 2.1 time: 0.161782 Jul 31 01:48:23.643793 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2967/5906] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:23 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:24.665119 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-70e4d5e9-28cb-426b-868f-5f3512b61d81 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:24.668304 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-70e4d5e9-28cb-426b-868f-5f3512b61d81 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:24.681139 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:24.684007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70e4d5e9-28cb-426b-868f-5f3512b61d81 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:24.684773 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70e4d5e9-28cb-426b-868f-5f3512b61d81 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:24.686094 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70e4d5e9-28cb-426b-868f-5f3512b61d81 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:24.686608 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70e4d5e9-28cb-426b-868f-5f3512b61d81 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:24.829705 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-70e4d5e9-28cb-426b-868f-5f3512b61d81 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:24.838404 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-70e4d5e9-28cb-426b-868f-5f3512b61d81 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1677 microversion: 2.1 time: 0.177185 Jul 31 01:48:24.839070 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2940/5907] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:24 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:25.861738 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-71823be2-1ea8-486e-beda-3e3413e59238 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:25.862423 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-71823be2-1ea8-486e-beda-3e3413e59238 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:25.865881 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:25.871584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71823be2-1ea8-486e-beda-3e3413e59238 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:25.872081 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71823be2-1ea8-486e-beda-3e3413e59238 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:25.873168 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71823be2-1ea8-486e-beda-3e3413e59238 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:25.873404 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71823be2-1ea8-486e-beda-3e3413e59238 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:25.877479 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:26.012193 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-71823be2-1ea8-486e-beda-3e3413e59238 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:26.020246 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-71823be2-1ea8-486e-beda-3e3413e59238 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1677 microversion: 2.1 time: 0.163177 Jul 31 01:48:26.020923 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2968/5908] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:25 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:27.041830 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-720361ba-c4a7-4c19-8141-b58f64ff108f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:27.042527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-720361ba-c4a7-4c19-8141-b58f64ff108f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:27.049495 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-720361ba-c4a7-4c19-8141-b58f64ff108f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:27.049959 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-720361ba-c4a7-4c19-8141-b58f64ff108f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:27.050748 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-720361ba-c4a7-4c19-8141-b58f64ff108f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:27.051207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-720361ba-c4a7-4c19-8141-b58f64ff108f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:27.210670 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-720361ba-c4a7-4c19-8141-b58f64ff108f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:27.218981 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-720361ba-c4a7-4c19-8141-b58f64ff108f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1677 microversion: 2.1 time: 0.181083 Jul 31 01:48:27.219709 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2941/5909] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:27 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:28.240524 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c10ae52c-6374-493a-a649-9cf03efbe3e8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:28.241158 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c10ae52c-6374-493a-a649-9cf03efbe3e8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:28.249481 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c10ae52c-6374-493a-a649-9cf03efbe3e8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:28.250096 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c10ae52c-6374-493a-a649-9cf03efbe3e8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:28.251210 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c10ae52c-6374-493a-a649-9cf03efbe3e8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:28.251702 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c10ae52c-6374-493a-a649-9cf03efbe3e8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:28.398467 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c10ae52c-6374-493a-a649-9cf03efbe3e8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:28.406410 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c10ae52c-6374-493a-a649-9cf03efbe3e8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1677 microversion: 2.1 time: 0.170053 Jul 31 01:48:28.406995 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2969/5910] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:28 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:29.429602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eb471962-fce4-4c66-a618-96943154a3b7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:29.430239 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eb471962-fce4-4c66-a618-96943154a3b7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:29.437797 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb471962-fce4-4c66-a618-96943154a3b7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:29.438261 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb471962-fce4-4c66-a618-96943154a3b7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:29.439047 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb471962-fce4-4c66-a618-96943154a3b7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:29.439620 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eb471962-fce4-4c66-a618-96943154a3b7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:29.594378 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eb471962-fce4-4c66-a618-96943154a3b7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:29.602837 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eb471962-fce4-4c66-a618-96943154a3b7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1677 microversion: 2.1 time: 0.177822 Jul 31 01:48:29.603467 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2942/5911] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:29 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:30.624833 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3c7d8f1c-87aa-4f5a-b77e-39d2501dfd48 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:30.625571 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3c7d8f1c-87aa-4f5a-b77e-39d2501dfd48 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:30.633792 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c7d8f1c-87aa-4f5a-b77e-39d2501dfd48 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:30.634363 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c7d8f1c-87aa-4f5a-b77e-39d2501dfd48 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:30.635154 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c7d8f1c-87aa-4f5a-b77e-39d2501dfd48 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:30.635689 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3c7d8f1c-87aa-4f5a-b77e-39d2501dfd48 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:30.778172 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3c7d8f1c-87aa-4f5a-b77e-39d2501dfd48 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:30.786539 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3c7d8f1c-87aa-4f5a-b77e-39d2501dfd48 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1677 microversion: 2.1 time: 0.165198 Jul 31 01:48:30.797996 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2970/5912] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:30 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:31.809152 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-65cd44fb-4226-4fef-a93f-0391db7aab32 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:31.810018 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-65cd44fb-4226-4fef-a93f-0391db7aab32 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:31.817399 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-65cd44fb-4226-4fef-a93f-0391db7aab32 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:31.817877 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-65cd44fb-4226-4fef-a93f-0391db7aab32 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:31.819164 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-65cd44fb-4226-4fef-a93f-0391db7aab32 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:31.819663 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-65cd44fb-4226-4fef-a93f-0391db7aab32 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:31.957253 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-65cd44fb-4226-4fef-a93f-0391db7aab32 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:31.965187 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-65cd44fb-4226-4fef-a93f-0391db7aab32 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1654 microversion: 2.1 time: 0.160120 Jul 31 01:48:31.965775 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2943/5913] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:31 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1654 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:31.986617 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e7a09b2-faf8-4683-852a-a5ac45783d02 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:48:31.994620 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e7a09b2-faf8-4683-852a-a5ac45783d02 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:31.995447 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e7a09b2-faf8-4683-852a-a5ac45783d02 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:32.019533 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3e7a09b2-faf8-4683-852a-a5ac45783d02 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Going to try to start instance {{(pid=119475) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 31 01:48:32.064134 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3e7a09b2-faf8-4683-852a-a5ac45783d02 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "POST /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/action" status: 202 len: 0 microversion: 2.1 time: 0.081115 Jul 31 01:48:32.064775 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2971/5914] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:48:31 2022] POST /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:48:32.076219 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a7e9319c-5fc0-4c39-8942-57ae55e8b786 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:32.077450 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a7e9319c-5fc0-4c39-8942-57ae55e8b786 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:32.085940 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7e9319c-5fc0-4c39-8942-57ae55e8b786 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:32.086898 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7e9319c-5fc0-4c39-8942-57ae55e8b786 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:32.088382 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7e9319c-5fc0-4c39-8942-57ae55e8b786 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:32.088920 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7e9319c-5fc0-4c39-8942-57ae55e8b786 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:32.298989 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a7e9319c-5fc0-4c39-8942-57ae55e8b786 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:32.309864 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a7e9319c-5fc0-4c39-8942-57ae55e8b786 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1663 microversion: 2.1 time: 0.239165 Jul 31 01:48:32.310691 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2944/5915] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:32 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1663 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:33.335113 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b49bac7a-6738-4dd5-a366-28e37e41de3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:33.335873 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b49bac7a-6738-4dd5-a366-28e37e41de3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:33.343867 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b49bac7a-6738-4dd5-a366-28e37e41de3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:33.344819 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b49bac7a-6738-4dd5-a366-28e37e41de3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:33.345843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b49bac7a-6738-4dd5-a366-28e37e41de3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:33.346358 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b49bac7a-6738-4dd5-a366-28e37e41de3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:33.499668 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b49bac7a-6738-4dd5-a366-28e37e41de3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:33.508273 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b49bac7a-6738-4dd5-a366-28e37e41de3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1663 microversion: 2.1 time: 0.178614 Jul 31 01:48:33.508850 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2972/5916] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:33 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1663 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:34.530134 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dec8f570-78ab-4212-b32d-9dab5f1885de tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:34.530888 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dec8f570-78ab-4212-b32d-9dab5f1885de tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:34.538797 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dec8f570-78ab-4212-b32d-9dab5f1885de tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:34.539390 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dec8f570-78ab-4212-b32d-9dab5f1885de tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:34.540285 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dec8f570-78ab-4212-b32d-9dab5f1885de tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:34.540958 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dec8f570-78ab-4212-b32d-9dab5f1885de tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:34.786012 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dec8f570-78ab-4212-b32d-9dab5f1885de tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:34.794424 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dec8f570-78ab-4212-b32d-9dab5f1885de tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1667 microversion: 2.1 time: 0.268173 Jul 31 01:48:34.807288 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2945/5917] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:34 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1667 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:38.494683 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-356400e8-0ae9-4253-9456-17c2fdde7e0f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:48:38.497309 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-356400e8-0ae9-4253-9456-17c2fdde7e0f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:38.505035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-356400e8-0ae9-4253-9456-17c2fdde7e0f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:38.505494 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-356400e8-0ae9-4253-9456-17c2fdde7e0f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:38.506352 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-356400e8-0ae9-4253-9456-17c2fdde7e0f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:38.506799 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-356400e8-0ae9-4253-9456-17c2fdde7e0f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:38.568457 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-356400e8-0ae9-4253-9456-17c2fdde7e0f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5/action" status: 200 len: 24572 microversion: 2.1 time: 0.077866 Jul 31 01:48:38.569114 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2973/5918] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:48:38 2022] POST /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5/action => generated 24572 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:48:49.426929 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3afcf7ba-98e1-4495-8a67-ec69c902147c tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:49.428074 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3afcf7ba-98e1-4495-8a67-ec69c902147c tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:49.430558 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=11 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:49.431486 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=41 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:49.437931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3afcf7ba-98e1-4495-8a67-ec69c902147c tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:49.438577 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3afcf7ba-98e1-4495-8a67-ec69c902147c tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:49.439381 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3afcf7ba-98e1-4495-8a67-ec69c902147c tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:49.439838 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3afcf7ba-98e1-4495-8a67-ec69c902147c tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:49.668322 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3afcf7ba-98e1-4495-8a67-ec69c902147c tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1832 microversion: 2.1 time: 0.245217 Jul 31 01:48:49.669038 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2946/5919] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:49 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1832 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:49.690180 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2ccc51bd-41ca-43d9-92b6-8c72d033063b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:49.690976 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2ccc51bd-41ca-43d9-92b6-8c72d033063b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:49.694043 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=11 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:49.694701 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:48:49.701403 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ccc51bd-41ca-43d9-92b6-8c72d033063b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:49.701871 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ccc51bd-41ca-43d9-92b6-8c72d033063b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:49.702650 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ccc51bd-41ca-43d9-92b6-8c72d033063b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:49.703093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ccc51bd-41ca-43d9-92b6-8c72d033063b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:49.865574 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2ccc51bd-41ca-43d9-92b6-8c72d033063b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:49.873648 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2ccc51bd-41ca-43d9-92b6-8c72d033063b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1681 microversion: 2.1 time: 0.188181 Jul 31 01:48:49.874230 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2974/5920] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:49 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:49.971822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1c257dae-3738-40a4-ae77-9f8665865b02 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:48:49.974157 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1c257dae-3738-40a4-ae77-9f8665865b02 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:49.980989 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c257dae-3738-40a4-ae77-9f8665865b02 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:49.981454 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c257dae-3738-40a4-ae77-9f8665865b02 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:49.982236 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c257dae-3738-40a4-ae77-9f8665865b02 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:49.982692 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c257dae-3738-40a4-ae77-9f8665865b02 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:50.049693 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1c257dae-3738-40a4-ae77-9f8665865b02 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5/action" status: 200 len: 32642 microversion: 2.1 time: 0.081738 Jul 31 01:48:50.050583 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2947/5921] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:48:49 2022] POST /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5/action => generated 32642 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:48:50.197797 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-85e85d84-c6c4-4cb5-b7ce-c0bb5f2a1fdb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:48:50.199448 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-85e85d84-c6c4-4cb5-b7ce-c0bb5f2a1fdb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:50.206104 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-85e85d84-c6c4-4cb5-b7ce-c0bb5f2a1fdb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:50.206510 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-85e85d84-c6c4-4cb5-b7ce-c0bb5f2a1fdb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:50.207288 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-85e85d84-c6c4-4cb5-b7ce-c0bb5f2a1fdb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:50.207800 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-85e85d84-c6c4-4cb5-b7ce-c0bb5f2a1fdb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:50.250163 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-85e85d84-c6c4-4cb5-b7ce-c0bb5f2a1fdb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '39552388905547879b405ed39d8771c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad8e095838647bca23b68732eb92dc8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:50.250835 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-85e85d84-c6c4-4cb5-b7ce-c0bb5f2a1fdb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] flavor_id is None. Assuming migration. {{(pid=119475) resize /opt/stack/nova/nova/compute/api.py:4144}} Jul 31 01:48:50.251294 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-85e85d84-c6c4-4cb5-b7ce-c0bb5f2a1fdb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119475) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 31 01:48:50.483416 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-85e85d84-c6c4-4cb5-b7ce-c0bb5f2a1fdb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5/action" status: 202 len: 0 microversion: 2.1 time: 0.289510 Jul 31 01:48:50.484046 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2975/5922] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:48:50 2022] POST /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:48:50.492879 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c9bdadc0-ace8-422d-aff1-7f6ec7d8676c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:50.494151 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c9bdadc0-ace8-422d-aff1-7f6ec7d8676c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:50.502543 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c9bdadc0-ace8-422d-aff1-7f6ec7d8676c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:50.503014 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c9bdadc0-ace8-422d-aff1-7f6ec7d8676c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:50.503837 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c9bdadc0-ace8-422d-aff1-7f6ec7d8676c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:50.504298 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c9bdadc0-ace8-422d-aff1-7f6ec7d8676c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:50.676207 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c9bdadc0-ace8-422d-aff1-7f6ec7d8676c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:50.686563 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c9bdadc0-ace8-422d-aff1-7f6ec7d8676c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1690 microversion: 2.1 time: 0.197886 Jul 31 01:48:50.687410 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2948/5923] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:50 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1690 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:48:51.711767 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9814eae6-e27f-4dc3-9879-e9321afbe9ae tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:51.713395 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9814eae6-e27f-4dc3-9879-e9321afbe9ae tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:51.721513 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9814eae6-e27f-4dc3-9879-e9321afbe9ae tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:51.722250 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9814eae6-e27f-4dc3-9879-e9321afbe9ae tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:51.723231 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9814eae6-e27f-4dc3-9879-e9321afbe9ae tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:51.723683 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9814eae6-e27f-4dc3-9879-e9321afbe9ae tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:51.867960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9814eae6-e27f-4dc3-9879-e9321afbe9ae tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:51.875853 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9814eae6-e27f-4dc3-9879-e9321afbe9ae tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1690 microversion: 2.1 time: 0.170845 Jul 31 01:48:51.876445 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2976/5924] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:51 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:52.898691 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c9d1a18d-acd3-4bb8-9ed5-a0458976260d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:52.899432 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c9d1a18d-acd3-4bb8-9ed5-a0458976260d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:52.907661 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c9d1a18d-acd3-4bb8-9ed5-a0458976260d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:52.908130 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c9d1a18d-acd3-4bb8-9ed5-a0458976260d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:52.908916 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c9d1a18d-acd3-4bb8-9ed5-a0458976260d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:52.909387 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c9d1a18d-acd3-4bb8-9ed5-a0458976260d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:53.066566 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c9d1a18d-acd3-4bb8-9ed5-a0458976260d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:53.077662 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c9d1a18d-acd3-4bb8-9ed5-a0458976260d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1695 microversion: 2.1 time: 0.183827 Jul 31 01:48:53.078351 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2949/5925] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:52 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:54.102717 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3ece885-9f64-4ee3-b3f1-07b24bbc401c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:54.103426 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3ece885-9f64-4ee3-b3f1-07b24bbc401c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:54.111206 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3ece885-9f64-4ee3-b3f1-07b24bbc401c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:54.111799 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3ece885-9f64-4ee3-b3f1-07b24bbc401c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:54.112680 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3ece885-9f64-4ee3-b3f1-07b24bbc401c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:54.113135 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3ece885-9f64-4ee3-b3f1-07b24bbc401c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:54.269763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3ece885-9f64-4ee3-b3f1-07b24bbc401c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:54.281246 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3ece885-9f64-4ee3-b3f1-07b24bbc401c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1695 microversion: 2.1 time: 0.182491 Jul 31 01:48:54.282043 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2977/5926] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:54 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:48:55.304543 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d77566ae-8916-4091-b124-4d5d721c0d1b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:55.305551 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d77566ae-8916-4091-b124-4d5d721c0d1b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:55.313871 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d77566ae-8916-4091-b124-4d5d721c0d1b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:55.314479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d77566ae-8916-4091-b124-4d5d721c0d1b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:55.315471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d77566ae-8916-4091-b124-4d5d721c0d1b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:55.315968 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d77566ae-8916-4091-b124-4d5d721c0d1b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:55.469485 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d77566ae-8916-4091-b124-4d5d721c0d1b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:55.477433 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d77566ae-8916-4091-b124-4d5d721c0d1b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1695 microversion: 2.1 time: 0.177799 Jul 31 01:48:55.478020 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2950/5927] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:55 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:56.499720 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b5a8eaa4-0ab4-4d42-8dd3-cee4ec19c307 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:56.500622 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b5a8eaa4-0ab4-4d42-8dd3-cee4ec19c307 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:56.512961 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5a8eaa4-0ab4-4d42-8dd3-cee4ec19c307 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:56.513788 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5a8eaa4-0ab4-4d42-8dd3-cee4ec19c307 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:56.514784 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5a8eaa4-0ab4-4d42-8dd3-cee4ec19c307 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:56.515240 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5a8eaa4-0ab4-4d42-8dd3-cee4ec19c307 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:56.660173 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b5a8eaa4-0ab4-4d42-8dd3-cee4ec19c307 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:56.668529 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b5a8eaa4-0ab4-4d42-8dd3-cee4ec19c307 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1695 microversion: 2.1 time: 0.172819 Jul 31 01:48:56.669147 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2978/5928] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:56 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:57.690090 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9f72b2f1-cb1f-496c-aef7-cca164e75cf0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:57.690760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9f72b2f1-cb1f-496c-aef7-cca164e75cf0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:57.698378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f72b2f1-cb1f-496c-aef7-cca164e75cf0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:57.698858 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f72b2f1-cb1f-496c-aef7-cca164e75cf0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:57.699688 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f72b2f1-cb1f-496c-aef7-cca164e75cf0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:57.700146 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f72b2f1-cb1f-496c-aef7-cca164e75cf0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:57.851006 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9f72b2f1-cb1f-496c-aef7-cca164e75cf0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:57.858871 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9f72b2f1-cb1f-496c-aef7-cca164e75cf0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1695 microversion: 2.1 time: 0.172666 Jul 31 01:48:57.859502 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2951/5929] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:57 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:48:58.880209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8ef9aa1f-b23b-4a3b-a4de-1b769e90044c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:48:58.880915 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8ef9aa1f-b23b-4a3b-a4de-1b769e90044c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:48:58.887791 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ef9aa1f-b23b-4a3b-a4de-1b769e90044c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:58.888244 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ef9aa1f-b23b-4a3b-a4de-1b769e90044c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:58.889008 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ef9aa1f-b23b-4a3b-a4de-1b769e90044c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:48:58.889445 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ef9aa1f-b23b-4a3b-a4de-1b769e90044c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:48:59.026450 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8ef9aa1f-b23b-4a3b-a4de-1b769e90044c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:48:59.034038 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8ef9aa1f-b23b-4a3b-a4de-1b769e90044c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1695 microversion: 2.1 time: 0.157682 Jul 31 01:48:59.034620 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2979/5930] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:48:58 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:00.057014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-776acf58-1fde-4768-a42a-80ca2cfc53dc tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:00.057671 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-776acf58-1fde-4768-a42a-80ca2cfc53dc tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:00.064991 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-776acf58-1fde-4768-a42a-80ca2cfc53dc tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:00.065460 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-776acf58-1fde-4768-a42a-80ca2cfc53dc tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:00.066249 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-776acf58-1fde-4768-a42a-80ca2cfc53dc tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:00.066705 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-776acf58-1fde-4768-a42a-80ca2cfc53dc tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:00.205035 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-776acf58-1fde-4768-a42a-80ca2cfc53dc tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:00.213762 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-776acf58-1fde-4768-a42a-80ca2cfc53dc tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1695 microversion: 2.1 time: 0.161130 Jul 31 01:49:00.214341 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2952/5931] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:00 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:01.234491 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c0d6d118-7d4b-4ff8-8d8b-99c8363086b8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:01.235155 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c0d6d118-7d4b-4ff8-8d8b-99c8363086b8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:01.242108 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0d6d118-7d4b-4ff8-8d8b-99c8363086b8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:01.242574 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0d6d118-7d4b-4ff8-8d8b-99c8363086b8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:01.243359 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0d6d118-7d4b-4ff8-8d8b-99c8363086b8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:01.243816 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0d6d118-7d4b-4ff8-8d8b-99c8363086b8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:01.393615 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c0d6d118-7d4b-4ff8-8d8b-99c8363086b8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:01.403127 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c0d6d118-7d4b-4ff8-8d8b-99c8363086b8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1695 microversion: 2.1 time: 0.172142 Jul 31 01:49:01.403969 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2980/5932] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:01 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:02.426647 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cdb3b79d-09f7-47c9-a4bb-24618e6f69b3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:02.427447 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cdb3b79d-09f7-47c9-a4bb-24618e6f69b3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:02.435244 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cdb3b79d-09f7-47c9-a4bb-24618e6f69b3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:02.435834 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cdb3b79d-09f7-47c9-a4bb-24618e6f69b3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:02.436946 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cdb3b79d-09f7-47c9-a4bb-24618e6f69b3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:02.437410 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cdb3b79d-09f7-47c9-a4bb-24618e6f69b3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:02.580121 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cdb3b79d-09f7-47c9-a4bb-24618e6f69b3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:02.588790 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cdb3b79d-09f7-47c9-a4bb-24618e6f69b3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1695 microversion: 2.1 time: 0.165956 Jul 31 01:49:02.589567 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2953/5933] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:02 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:03.610951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-edfab01a-bb27-4289-936b-6421e4a2c01d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:03.611678 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-edfab01a-bb27-4289-936b-6421e4a2c01d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:03.620427 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-edfab01a-bb27-4289-936b-6421e4a2c01d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:03.620946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-edfab01a-bb27-4289-936b-6421e4a2c01d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:03.621940 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-edfab01a-bb27-4289-936b-6421e4a2c01d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:03.622579 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-edfab01a-bb27-4289-936b-6421e4a2c01d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:03.772591 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-edfab01a-bb27-4289-936b-6421e4a2c01d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:03.781702 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-edfab01a-bb27-4289-936b-6421e4a2c01d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1695 microversion: 2.1 time: 0.175473 Jul 31 01:49:03.782321 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2981/5934] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:03 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:04.803916 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aae99fdc-b7fc-430b-84a1-0bcc345aea2c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:04.805215 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aae99fdc-b7fc-430b-84a1-0bcc345aea2c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:04.813330 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aae99fdc-b7fc-430b-84a1-0bcc345aea2c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:04.813815 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aae99fdc-b7fc-430b-84a1-0bcc345aea2c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:04.814625 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aae99fdc-b7fc-430b-84a1-0bcc345aea2c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:04.815088 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aae99fdc-b7fc-430b-84a1-0bcc345aea2c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:04.951676 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-aae99fdc-b7fc-430b-84a1-0bcc345aea2c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:04.959409 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aae99fdc-b7fc-430b-84a1-0bcc345aea2c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1695 microversion: 2.1 time: 0.159400 Jul 31 01:49:04.959984 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2954/5935] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:04 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:05.980284 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-798a26ef-f018-415f-91e2-169cf7d522ff tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:05.980902 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-798a26ef-f018-415f-91e2-169cf7d522ff tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:05.988021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-798a26ef-f018-415f-91e2-169cf7d522ff tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:05.988481 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-798a26ef-f018-415f-91e2-169cf7d522ff tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:05.989257 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-798a26ef-f018-415f-91e2-169cf7d522ff tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:05.989707 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-798a26ef-f018-415f-91e2-169cf7d522ff tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:06.129687 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-798a26ef-f018-415f-91e2-169cf7d522ff tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:06.137986 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-798a26ef-f018-415f-91e2-169cf7d522ff tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1695 microversion: 2.1 time: 0.161757 Jul 31 01:49:06.138574 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2982/5936] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:05 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:06.904065 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c96f70a1-f93d-4c5c-9e57-d84e6375eb56 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:06.906271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c96f70a1-f93d-4c5c-9e57-d84e6375eb56 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:06.913365 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c96f70a1-f93d-4c5c-9e57-d84e6375eb56 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:06.914365 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c96f70a1-f93d-4c5c-9e57-d84e6375eb56 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:06.915147 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c96f70a1-f93d-4c5c-9e57-d84e6375eb56 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:06.915631 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c96f70a1-f93d-4c5c-9e57-d84e6375eb56 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:06.946162 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c96f70a1-f93d-4c5c-9e57-d84e6375eb56 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045889 Jul 31 01:49:06.946862 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2955/5937] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:49:06 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:49:07.008984 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c9117709-9f10-4bc8-aced-3b38a697517c tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:07.009588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c9117709-9f10-4bc8-aced-3b38a697517c tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:07.016857 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9117709-9f10-4bc8-aced-3b38a697517c tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:07.017316 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9117709-9f10-4bc8-aced-3b38a697517c tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:07.018414 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9117709-9f10-4bc8-aced-3b38a697517c tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:07.018865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9117709-9f10-4bc8-aced-3b38a697517c tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:07.044721 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c9117709-9f10-4bc8-aced-3b38a697517c tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:49:07.121243 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c9117709-9f10-4bc8-aced-3b38a697517c tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 204 len: 0 microversion: 2.1 time: 0.115877 Jul 31 01:49:07.125248 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2983/5938] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:49:07 2022] DELETE /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:49:07.130326 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-11e93682-2a0c-4520-bc98-933489f27150 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:07.130964 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-11e93682-2a0c-4520-bc98-933489f27150 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:07.137364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-11e93682-2a0c-4520-bc98-933489f27150 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:07.137840 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-11e93682-2a0c-4520-bc98-933489f27150 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:07.138628 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-11e93682-2a0c-4520-bc98-933489f27150 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:07.139085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-11e93682-2a0c-4520-bc98-933489f27150 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:07.160077 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e07a5c0a-b6a0-402e-bd98-218b05dee760 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:07.161094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e07a5c0a-b6a0-402e-bd98-218b05dee760 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:07.169350 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e07a5c0a-b6a0-402e-bd98-218b05dee760 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:07.170169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e07a5c0a-b6a0-402e-bd98-218b05dee760 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:07.171191 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e07a5c0a-b6a0-402e-bd98-218b05dee760 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:07.171888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e07a5c0a-b6a0-402e-bd98-218b05dee760 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:07.354787 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-11e93682-2a0c-4520-bc98-933489f27150 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:07.362693 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-11e93682-2a0c-4520-bc98-933489f27150 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1673 microversion: 2.1 time: 0.236315 Jul 31 01:49:07.370634 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2956/5939] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:07 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1673 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:49:07.370967 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e07a5c0a-b6a0-402e-bd98-218b05dee760 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:07.376395 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e07a5c0a-b6a0-402e-bd98-218b05dee760 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1695 microversion: 2.1 time: 0.221055 Jul 31 01:49:07.376923 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2984/5940] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:07 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1695 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:49:08.385320 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-94dfa512-7a05-4ebf-85cb-40ef3e8c67d9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:08.386049 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-94dfa512-7a05-4ebf-85cb-40ef3e8c67d9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:08.393417 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-94dfa512-7a05-4ebf-85cb-40ef3e8c67d9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:08.393964 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-94dfa512-7a05-4ebf-85cb-40ef3e8c67d9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:08.394888 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-94dfa512-7a05-4ebf-85cb-40ef3e8c67d9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:08.395425 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-94dfa512-7a05-4ebf-85cb-40ef3e8c67d9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:08.398431 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0848aca3-d775-41bb-8aa8-c35403394daf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:08.399834 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0848aca3-d775-41bb-8aa8-c35403394daf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:08.406534 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0848aca3-d775-41bb-8aa8-c35403394daf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:08.407008 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0848aca3-d775-41bb-8aa8-c35403394daf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:08.407868 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0848aca3-d775-41bb-8aa8-c35403394daf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:08.408320 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0848aca3-d775-41bb-8aa8-c35403394daf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:08.592167 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-94dfa512-7a05-4ebf-85cb-40ef3e8c67d9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:08.600260 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-94dfa512-7a05-4ebf-85cb-40ef3e8c67d9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1673 microversion: 2.1 time: 0.219524 Jul 31 01:49:08.601051 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2957/5941] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:08 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1673 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:08.606323 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0848aca3-d775-41bb-8aa8-c35403394daf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:08.614103 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0848aca3-d775-41bb-8aa8-c35403394daf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1695 microversion: 2.1 time: 0.220122 Jul 31 01:49:08.614697 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2985/5942] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:08 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1695 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:09.621978 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ef91ec63-aa75-4d6e-affc-553c11a78c67 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:09.622600 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ef91ec63-aa75-4d6e-affc-553c11a78c67 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:09.631040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef91ec63-aa75-4d6e-affc-553c11a78c67 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:09.631040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef91ec63-aa75-4d6e-affc-553c11a78c67 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:09.631040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef91ec63-aa75-4d6e-affc-553c11a78c67 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:09.631311 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef91ec63-aa75-4d6e-affc-553c11a78c67 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:09.636928 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0fe7dff7-db45-4646-8eb7-f2d24ae31bdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:09.637707 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0fe7dff7-db45-4646-8eb7-f2d24ae31bdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:09.644682 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0fe7dff7-db45-4646-8eb7-f2d24ae31bdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:09.645448 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0fe7dff7-db45-4646-8eb7-f2d24ae31bdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:09.646425 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0fe7dff7-db45-4646-8eb7-f2d24ae31bdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:09.646883 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0fe7dff7-db45-4646-8eb7-f2d24ae31bdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:09.839597 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ef91ec63-aa75-4d6e-affc-553c11a78c67 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:09.851917 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ef91ec63-aa75-4d6e-affc-553c11a78c67 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1673 microversion: 2.1 time: 0.233031 Jul 31 01:49:09.867362 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2958/5943] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:09 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1673 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:09.868460 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0fe7dff7-db45-4646-8eb7-f2d24ae31bdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:09.872972 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0fe7dff7-db45-4646-8eb7-f2d24ae31bdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1695 microversion: 2.1 time: 0.240282 Jul 31 01:49:09.873809 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2986/5944] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:09 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1695 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:10.880738 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fdea4123-086f-4062-8389-3cfab53ba93f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:10.881377 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fdea4123-086f-4062-8389-3cfab53ba93f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:10.889791 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdea4123-086f-4062-8389-3cfab53ba93f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:10.890274 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdea4123-086f-4062-8389-3cfab53ba93f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:10.891180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdea4123-086f-4062-8389-3cfab53ba93f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:10.891546 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdea4123-086f-4062-8389-3cfab53ba93f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:10.895672 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6dcc0f15-b1f4-4ee0-88fb-873e27083402 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:10.896835 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6dcc0f15-b1f4-4ee0-88fb-873e27083402 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:10.903786 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6dcc0f15-b1f4-4ee0-88fb-873e27083402 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:10.904252 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6dcc0f15-b1f4-4ee0-88fb-873e27083402 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:10.905035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6dcc0f15-b1f4-4ee0-88fb-873e27083402 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:10.906022 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6dcc0f15-b1f4-4ee0-88fb-873e27083402 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:10.910347 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:11.320771 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6dcc0f15-b1f4-4ee0-88fb-873e27083402 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:11.330776 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6dcc0f15-b1f4-4ee0-88fb-873e27083402 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1694 microversion: 2.1 time: 0.439726 Jul 31 01:49:11.332348 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2987/5945] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:10 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1694 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:11.342728 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fdea4123-086f-4062-8389-3cfab53ba93f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:11.352367 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fdea4123-086f-4062-8389-3cfab53ba93f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1673 microversion: 2.1 time: 0.475336 Jul 31 01:49:11.352972 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2959/5946] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:10 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1673 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:11.964939 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-24de755d-bfde-4e0b-8f27-86e923d7c8b3 req-ca547fdf-eb04-4281-a859-cbfb491395e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92c8a2e-dce8-409a-a117-879a319f8cd5", "name": "network-vif-unplugged", "status": "completed", "tag": "f0c13688-0117-437d-8918-32518c254c56"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:49:11.976581 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-24de755d-bfde-4e0b-8f27-86e923d7c8b3 req-ca547fdf-eb04-4281-a859-cbfb491395e9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:11.977186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-24de755d-bfde-4e0b-8f27-86e923d7c8b3 req-ca547fdf-eb04-4281-a859-cbfb491395e9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:11.989986 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-24de755d-bfde-4e0b-8f27-86e923d7c8b3 req-ca547fdf-eb04-4281-a859-cbfb491395e9 service nova] Creating event network-vif-unplugged:f0c13688-0117-437d-8918-32518c254c56 for instance f92c8a2e-dce8-409a-a117-879a319f8cd5 on n-h1-master-1 Jul 31 01:49:11.996237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-24de755d-bfde-4e0b-8f27-86e923d7c8b3 req-ca547fdf-eb04-4281-a859-cbfb491395e9 service nova] Instance f92c8a2e-dce8-409a-a117-879a319f8cd5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:49:12.007777 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-24de755d-bfde-4e0b-8f27-86e923d7c8b3 req-ca547fdf-eb04-4281-a859-cbfb491395e9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046990 Jul 31 01:49:12.008624 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2988/5947] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:49:12.355778 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4894c3a5-7f14-4806-917b-b0736d047810 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:12.356944 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4894c3a5-7f14-4806-917b-b0736d047810 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:12.374861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c5b6025a-8763-4fcb-a038-11a314c26d61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:12.376491 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c5b6025a-8763-4fcb-a038-11a314c26d61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:12.395374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4894c3a5-7f14-4806-917b-b0736d047810 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:12.396299 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4894c3a5-7f14-4806-917b-b0736d047810 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:12.397925 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5b6025a-8763-4fcb-a038-11a314c26d61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:12.398065 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5b6025a-8763-4fcb-a038-11a314c26d61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:12.398934 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4894c3a5-7f14-4806-917b-b0736d047810 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:12.399301 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4894c3a5-7f14-4806-917b-b0736d047810 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:12.399930 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5b6025a-8763-4fcb-a038-11a314c26d61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:12.400367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5b6025a-8763-4fcb-a038-11a314c26d61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:12.474956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5b6025a-8763-4fcb-a038-11a314c26d61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:12.475780 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c5b6025a-8763-4fcb-a038-11a314c26d61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:12.476420 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-c5b6025a-8763-4fcb-a038-11a314c26d61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lazy-loading 'fault' on Instance uuid b8488f02-8f89-4fb7-8e4f-30414f9ad09e {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:49:12.566125 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c5b6025a-8763-4fcb-a038-11a314c26d61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:12.572799 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c5b6025a-8763-4fcb-a038-11a314c26d61 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 200 len: 1326 microversion: 2.1 time: 0.202448 Jul 31 01:49:12.573723 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2989/5948] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:12 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 1326 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:12.768668 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4894c3a5-7f14-4806-917b-b0736d047810 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:12.778099 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4894c3a5-7f14-4806-917b-b0736d047810 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1694 microversion: 2.1 time: 0.428633 Jul 31 01:49:12.780761 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2960/5949] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:12 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1694 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:13.596642 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e5191da-a12f-495a-9064-5e1dad1e173f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:13.597579 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1e5191da-a12f-495a-9064-5e1dad1e173f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:13.605316 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e5191da-a12f-495a-9064-5e1dad1e173f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:13.605858 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e5191da-a12f-495a-9064-5e1dad1e173f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:13.606856 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e5191da-a12f-495a-9064-5e1dad1e173f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:13.607431 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e5191da-a12f-495a-9064-5e1dad1e173f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:13.621971 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-1e5191da-a12f-495a-9064-5e1dad1e173f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] HTTP exception thrown: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e5191da-a12f-495a-9064-5e1dad1e173f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Request method failure captured: Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e HTTP/1.1 Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5d7mM18Voc6Sh2zYDH1Iu1VltwzQ7j3Tn6xiIzhn-bxtVJ_Z8BbBRtoR3OpMce1o0-WJZt0m2O0I7f8rM-3VCzHwzOQI-Ql5GGP_ybQGGlb-kgnr-d_k4GP5behCBU648xjWckcNrKCOj2RaFEjS47dpb3ftcBpFiELkAyZOGV46oQQ Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: ab4d167cb1684552a635536adebfbc86 Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ab4d167cb1684552a635536adebfbc86", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: ab4d167cb1684552a635536adebfbc86 Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AttachVolumeTestJSON-889266397-project Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 7eab8ae242c14402b965ffcc92961b2f Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AttachVolumeTestJSON-889266397-project Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: exception: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'b8488f02-8f89-4fb7-8e4f-30414f9ad09e'} Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:49:13.623860 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:49:13.628381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:49:13.628381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:49:13.628381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:49:13.628381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:49:13.628381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:49:13.628381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. Jul 31 01:49:13.628381 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:49:13.628381 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e5191da-a12f-495a-9064-5e1dad1e173f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Returning 404 to user: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:49:13.628381 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1e5191da-a12f-495a-9064-5e1dad1e173f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 404 len: 111 microversion: 2.1 time: 0.032888 Jul 31 01:49:13.629484 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2990/5950] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:13 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:49:13.635918 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a8c97a1e-29f0-4895-bb06-fa019621b977 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '.version_select at 0x7fede5b604c0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:13.657273 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a8c97a1e-29f0-4895-bb06-fa019621b977 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-627240512" status: 202 len: 0 microversion: 2.1 time: 0.025879 Jul 31 01:49:13.658264 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2961/5951] 10.222.0.45 () {58 vars in 1218 bytes} [Sun Jul 31 01:49:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-627240512 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:49:13.802158 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c7fbbf9c-29a0-4232-8ba6-d4805840eb88 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:13.803169 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c7fbbf9c-29a0-4232-8ba6-d4805840eb88 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:13.812460 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7fbbf9c-29a0-4232-8ba6-d4805840eb88 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:13.813187 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7fbbf9c-29a0-4232-8ba6-d4805840eb88 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:13.814249 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7fbbf9c-29a0-4232-8ba6-d4805840eb88 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:13.815049 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7fbbf9c-29a0-4232-8ba6-d4805840eb88 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:14.035112 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-48c5e113-561e-4f8f-ac1a-b0fafeefcf1b req-f57c34b1-bcaf-4dc3-88d4-1f98aa6c8b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8488f02-8f89-4fb7-8e4f-30414f9ad09e", "name": "network-vif-deleted", "tag": "39901178-6131-4c54-bccd-a82ea9abaacd"}, {"name": "network-changed", "server_uuid": "f92c8a2e-dce8-409a-a117-879a319f8cd5", "tag": "f0c13688-0117-437d-8918-32518c254c56"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:49:14.047004 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-48c5e113-561e-4f8f-ac1a-b0fafeefcf1b req-f57c34b1-bcaf-4dc3-88d4-1f98aa6c8b2b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:14.047859 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-48c5e113-561e-4f8f-ac1a-b0fafeefcf1b req-f57c34b1-bcaf-4dc3-88d4-1f98aa6c8b2b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:14.062294 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-48c5e113-561e-4f8f-ac1a-b0fafeefcf1b req-f57c34b1-bcaf-4dc3-88d4-1f98aa6c8b2b service nova] Creating event network-vif-deleted:39901178-6131-4c54-bccd-a82ea9abaacd for instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e on n-h2-master-1 Jul 31 01:49:14.063011 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-48c5e113-561e-4f8f-ac1a-b0fafeefcf1b req-f57c34b1-bcaf-4dc3-88d4-1f98aa6c8b2b service nova] Creating event network-changed:f0c13688-0117-437d-8918-32518c254c56 for instance f92c8a2e-dce8-409a-a117-879a319f8cd5 on n-h1-master-1 Jul 31 01:49:14.069922 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-48c5e113-561e-4f8f-ac1a-b0fafeefcf1b req-f57c34b1-bcaf-4dc3-88d4-1f98aa6c8b2b service nova] Instance f92c8a2e-dce8-409a-a117-879a319f8cd5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:49:14.083309 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-48c5e113-561e-4f8f-ac1a-b0fafeefcf1b req-f57c34b1-bcaf-4dc3-88d4-1f98aa6c8b2b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.051986 Jul 31 01:49:14.084563 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2962/5952] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:49:14.185818 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c7fbbf9c-29a0-4232-8ba6-d4805840eb88 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:14.203295 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c7fbbf9c-29a0-4232-8ba6-d4805840eb88 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1692 microversion: 2.1 time: 0.405115 Jul 31 01:49:14.204748 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2991/5953] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:13 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1692 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:14.794952 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-22d7dc4d-16bd-49e2-88fb-93d62389e6da tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Action: 'create', calling method: .version_select at 0x7fede46043a0>, body: {"keypair": {"name": "tempest-keypair-1620807244", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhwNMqkD0FmWM47iVxmi8kZTQ8t2Knfx8mO8vw3IPlMwyay3SZjnPelCIEwu/DontVkt5sCiqNhbKPJTlSCye5HJy17d4a4pujSbSn1nfesOhS2QbeBvNLFxe6MWxvZVw=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:49:14.829283 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-22d7dc4d-16bd-49e2-88fb-93d62389e6da tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Getting quotas for project ab4d167cb1684552a635536adebfbc86. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:49:14.835406 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-22d7dc4d-16bd-49e2-88fb-93d62389e6da tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Getting quotas for user 7eab8ae242c14402b965ffcc92961b2f and project ab4d167cb1684552a635536adebfbc86. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:49:14.860583 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-22d7dc4d-16bd-49e2-88fb-93d62389e6da tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071787 Jul 31 01:49:14.861601 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2963/5954] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:49:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:49:15.232259 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-975f7f01-95f5-42cb-a403-febd971ad1ed tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:15.232760 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-975f7f01-95f5-42cb-a403-febd971ad1ed tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:15.240726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-975f7f01-95f5-42cb-a403-febd971ad1ed tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:15.241768 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-975f7f01-95f5-42cb-a403-febd971ad1ed tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:15.242985 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-975f7f01-95f5-42cb-a403-febd971ad1ed tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:15.243698 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-975f7f01-95f5-42cb-a403-febd971ad1ed tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:15.513922 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-975f7f01-95f5-42cb-a403-febd971ad1ed tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:15.534807 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-975f7f01-95f5-42cb-a403-febd971ad1ed tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1689 microversion: 2.1 time: 0.310884 Jul 31 01:49:15.551887 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2992/5955] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:15 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1689 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:15.563463 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-139894b9-6b72-49ac-8a8d-e6b33b98e5ec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:49:15.564693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-139894b9-6b72-49ac-8a8d-e6b33b98e5ec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:15.571899 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-139894b9-6b72-49ac-8a8d-e6b33b98e5ec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:15.572375 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-139894b9-6b72-49ac-8a8d-e6b33b98e5ec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:15.573295 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-139894b9-6b72-49ac-8a8d-e6b33b98e5ec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:15.573756 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-139894b9-6b72-49ac-8a8d-e6b33b98e5ec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:15.620405 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=100 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:15.657568 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-139894b9-6b72-49ac-8a8d-e6b33b98e5ec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5/action" status: 204 len: 0 microversion: 2.1 time: 0.103895 Jul 31 01:49:15.659215 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2964/5956] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:49:15 2022] POST /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5/action => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:49:15.668563 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-db2c7bda-4d53-49f9-aaeb-dc2f1e16b498 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:15.669202 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-db2c7bda-4d53-49f9-aaeb-dc2f1e16b498 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:15.676639 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db2c7bda-4d53-49f9-aaeb-dc2f1e16b498 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:15.677114 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db2c7bda-4d53-49f9-aaeb-dc2f1e16b498 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:15.678579 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db2c7bda-4d53-49f9-aaeb-dc2f1e16b498 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:15.680205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-db2c7bda-4d53-49f9-aaeb-dc2f1e16b498 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:16.305844 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-db2c7bda-4d53-49f9-aaeb-dc2f1e16b498 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:16.315984 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-db2c7bda-4d53-49f9-aaeb-dc2f1e16b498 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1689 microversion: 2.1 time: 0.652222 Jul 31 01:49:16.318086 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2993/5957] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:15 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1689 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:16.902531 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-52b0ed1f-48fe-4b01-b22e-cac4afa106e0 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-261433546", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "664dd9c4-b9c6-4a8c-9bbd-c0e251d6533d"}], "security_groups": [{"name": "tempest-securitygroup--317654725"}], "key_name": "tempest-keypair-1620807244", "user_data": "}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:49:17.091180 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-52b0ed1f-48fe-4b01-b22e-cac4afa106e0 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] validate_networks() for [('664dd9c4-b9c6-4a8c-9bbd-c0e251d6533d', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:49:17.340442 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc19f3da-a921-4ac0-97e3-008b30417f76 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:17.341726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc19f3da-a921-4ac0-97e3-008b30417f76 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:17.349111 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc19f3da-a921-4ac0-97e3-008b30417f76 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:17.349792 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc19f3da-a921-4ac0-97e3-008b30417f76 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:17.351142 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc19f3da-a921-4ac0-97e3-008b30417f76 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:17.351624 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc19f3da-a921-4ac0-97e3-008b30417f76 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:17.581343 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fc19f3da-a921-4ac0-97e3-008b30417f76 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:17.590547 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc19f3da-a921-4ac0-97e3-008b30417f76 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1689 microversion: 2.1 time: 0.253947 Jul 31 01:49:17.591232 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2994/5958] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:17 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1689 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:49:17.676438 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-52b0ed1f-48fe-4b01-b22e-cac4afa106e0 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:49:17.677309 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-52b0ed1f-48fe-4b01-b22e-cac4afa106e0 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:49:17.677837 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-52b0ed1f-48fe-4b01-b22e-cac4afa106e0 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:49:17.678363 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-52b0ed1f-48fe-4b01-b22e-cac4afa106e0 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:49:17.679109 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-52b0ed1f-48fe-4b01-b22e-cac4afa106e0 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:49:17.689638 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52b0ed1f-48fe-4b01-b22e-cac4afa106e0 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:17.690110 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52b0ed1f-48fe-4b01-b22e-cac4afa106e0 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:17.691395 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52b0ed1f-48fe-4b01-b22e-cac4afa106e0 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:17.692045 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52b0ed1f-48fe-4b01-b22e-cac4afa106e0 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:17.714020 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-52b0ed1f-48fe-4b01-b22e-cac4afa106e0 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Getting quotas for project ab4d167cb1684552a635536adebfbc86. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:49:17.720865 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-52b0ed1f-48fe-4b01-b22e-cac4afa106e0 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Getting quotas for user 7eab8ae242c14402b965ffcc92961b2f and project ab4d167cb1684552a635536adebfbc86. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:49:17.735976 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-52b0ed1f-48fe-4b01-b22e-cac4afa106e0 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:49:17.738534 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-52b0ed1f-48fe-4b01-b22e-cac4afa106e0 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:49:17.786003 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-52b0ed1f-48fe-4b01-b22e-cac4afa106e0 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.888835 Jul 31 01:49:17.793188 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2965/5959] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:49:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:49:17.802826 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-22cdba14-3e0f-4d2f-a249-270cb65176ec tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:17.803528 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-22cdba14-3e0f-4d2f-a249-270cb65176ec tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:17.865069 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-22cdba14-3e0f-4d2f-a249-270cb65176ec tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:17.873305 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-22cdba14-3e0f-4d2f-a249-270cb65176ec tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 200 len: 1237 microversion: 2.1 time: 0.079061 Jul 31 01:49:17.874271 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2995/5960] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:17 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:49:18.357602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-3a350326-c33e-46ee-aac7-055c296fd8f8 req-4e90b390-f54e-4b90-a3c4-992f3f14e668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92c8a2e-dce8-409a-a117-879a319f8cd5", "name": "network-vif-plugged", "status": "completed", "tag": "f0c13688-0117-437d-8918-32518c254c56"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:49:18.369059 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3a350326-c33e-46ee-aac7-055c296fd8f8 req-4e90b390-f54e-4b90-a3c4-992f3f14e668 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:18.369727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3a350326-c33e-46ee-aac7-055c296fd8f8 req-4e90b390-f54e-4b90-a3c4-992f3f14e668 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:18.382776 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-3a350326-c33e-46ee-aac7-055c296fd8f8 req-4e90b390-f54e-4b90-a3c4-992f3f14e668 service nova] Creating event network-vif-plugged:f0c13688-0117-437d-8918-32518c254c56 for instance f92c8a2e-dce8-409a-a117-879a319f8cd5 on n-h1-master-1 Jul 31 01:49:18.389740 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-3a350326-c33e-46ee-aac7-055c296fd8f8 req-4e90b390-f54e-4b90-a3c4-992f3f14e668 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036559 Jul 31 01:49:18.390358 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2966/5961] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:49:18.612925 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d4b498e3-79db-4573-bf19-cb47726cc8e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:18.613702 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d4b498e3-79db-4573-bf19-cb47726cc8e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:18.625048 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4b498e3-79db-4573-bf19-cb47726cc8e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:18.625624 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4b498e3-79db-4573-bf19-cb47726cc8e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:18.627586 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4b498e3-79db-4573-bf19-cb47726cc8e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:18.628152 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4b498e3-79db-4573-bf19-cb47726cc8e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:18.772041 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d4b498e3-79db-4573-bf19-cb47726cc8e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:18.780405 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d4b498e3-79db-4573-bf19-cb47726cc8e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1681 microversion: 2.1 time: 0.171589 Jul 31 01:49:18.780995 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2996/5962] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:18 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:18.895967 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c61c00e1-c0f7-447e-be13-c6a25ab90867 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:18.896696 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c61c00e1-c0f7-447e-be13-c6a25ab90867 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:18.904044 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c61c00e1-c0f7-447e-be13-c6a25ab90867 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:18.904738 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c61c00e1-c0f7-447e-be13-c6a25ab90867 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:18.905533 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c61c00e1-c0f7-447e-be13-c6a25ab90867 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:18.905992 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c61c00e1-c0f7-447e-be13-c6a25ab90867 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:19.028750 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c61c00e1-c0f7-447e-be13-c6a25ab90867 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:19.039938 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c61c00e1-c0f7-447e-be13-c6a25ab90867 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 200 len: 1289 microversion: 2.1 time: 0.149462 Jul 31 01:49:19.040913 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2967/5963] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:18 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 1289 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:20.061122 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-13262219-210b-4cae-8c48-ccdc7baf4ff6 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:20.062370 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-13262219-210b-4cae-8c48-ccdc7baf4ff6 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:20.065699 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:20.071266 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13262219-210b-4cae-8c48-ccdc7baf4ff6 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:20.071760 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13262219-210b-4cae-8c48-ccdc7baf4ff6 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:20.072545 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13262219-210b-4cae-8c48-ccdc7baf4ff6 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:20.073154 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13262219-210b-4cae-8c48-ccdc7baf4ff6 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:20.286379 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-13262219-210b-4cae-8c48-ccdc7baf4ff6 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:20.294085 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-13262219-210b-4cae-8c48-ccdc7baf4ff6 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 200 len: 1362 microversion: 2.1 time: 0.236866 Jul 31 01:49:20.294669 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2997/5964] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:20 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:20.638526 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-248cf32b-a859-4ed1-ab18-c30a6cddc0f3 req-9e491a05-f55c-4206-8151-c010325ea162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780", "tag": "4a0edfcd-d380-4110-8ff6-26f859fbf9f1"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:49:20.648489 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:20.652032 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-248cf32b-a859-4ed1-ab18-c30a6cddc0f3 req-9e491a05-f55c-4206-8151-c010325ea162 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:20.652731 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-248cf32b-a859-4ed1-ab18-c30a6cddc0f3 req-9e491a05-f55c-4206-8151-c010325ea162 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:20.665623 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-248cf32b-a859-4ed1-ab18-c30a6cddc0f3 req-9e491a05-f55c-4206-8151-c010325ea162 service nova] Creating event network-changed:4a0edfcd-d380-4110-8ff6-26f859fbf9f1 for instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 on n-h2-master-1 Jul 31 01:49:20.670500 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-248cf32b-a859-4ed1-ab18-c30a6cddc0f3 req-9e491a05-f55c-4206-8151-c010325ea162 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036076 Jul 31 01:49:20.671189 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2968/5965] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:49:21.315359 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-567b7975-b3e6-4489-8e8e-660d2343c14f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:21.316620 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-567b7975-b3e6-4489-8e8e-660d2343c14f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:21.323700 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-567b7975-b3e6-4489-8e8e-660d2343c14f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:21.324169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-567b7975-b3e6-4489-8e8e-660d2343c14f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:21.324955 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-567b7975-b3e6-4489-8e8e-660d2343c14f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:21.325407 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-567b7975-b3e6-4489-8e8e-660d2343c14f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:21.466489 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-567b7975-b3e6-4489-8e8e-660d2343c14f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:21.476292 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-567b7975-b3e6-4489-8e8e-660d2343c14f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 200 len: 1362 microversion: 2.1 time: 0.163728 Jul 31 01:49:21.477288 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2998/5966] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:21 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:22.499953 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aed11da8-ef6e-4cb0-9a56-a62f991879d4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:22.500751 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aed11da8-ef6e-4cb0-9a56-a62f991879d4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:22.508700 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aed11da8-ef6e-4cb0-9a56-a62f991879d4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:22.509274 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aed11da8-ef6e-4cb0-9a56-a62f991879d4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:22.510071 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aed11da8-ef6e-4cb0-9a56-a62f991879d4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:22.510535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aed11da8-ef6e-4cb0-9a56-a62f991879d4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:22.730343 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-aed11da8-ef6e-4cb0-9a56-a62f991879d4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:22.738490 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aed11da8-ef6e-4cb0-9a56-a62f991879d4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 200 len: 1362 microversion: 2.1 time: 0.243778 Jul 31 01:49:22.739501 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2969/5967] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:22 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:23.763383 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8bc45808-f39f-4262-9f9d-c7ec24d98feb tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:23.764075 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8bc45808-f39f-4262-9f9d-c7ec24d98feb tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:23.771064 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8bc45808-f39f-4262-9f9d-c7ec24d98feb tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:23.771570 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8bc45808-f39f-4262-9f9d-c7ec24d98feb tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:23.772417 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8bc45808-f39f-4262-9f9d-c7ec24d98feb tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:23.772854 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8bc45808-f39f-4262-9f9d-c7ec24d98feb tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:24.314184 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8bc45808-f39f-4262-9f9d-c7ec24d98feb tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:24.323083 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8bc45808-f39f-4262-9f9d-c7ec24d98feb tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 200 len: 1362 microversion: 2.1 time: 0.563603 Jul 31 01:49:24.324320 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 2999/5968] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:23 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 1362 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:25.348106 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-abac2513-1c2d-4cd9-979d-cf154d1b0db4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:25.348756 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-abac2513-1c2d-4cd9-979d-cf154d1b0db4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:25.361051 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abac2513-1c2d-4cd9-979d-cf154d1b0db4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:25.361606 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abac2513-1c2d-4cd9-979d-cf154d1b0db4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:25.362441 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abac2513-1c2d-4cd9-979d-cf154d1b0db4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:25.364196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-abac2513-1c2d-4cd9-979d-cf154d1b0db4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:25.526358 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-abac2513-1c2d-4cd9-979d-cf154d1b0db4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:25.533976 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-abac2513-1c2d-4cd9-979d-cf154d1b0db4 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 200 len: 1362 microversion: 2.1 time: 0.191672 Jul 31 01:49:25.534816 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2970/5969] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:25 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:26.556905 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8e894220-b93f-4615-8e95-636bd1a267b9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:26.557910 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8e894220-b93f-4615-8e95-636bd1a267b9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:26.565541 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e894220-b93f-4615-8e95-636bd1a267b9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:26.566028 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e894220-b93f-4615-8e95-636bd1a267b9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:26.566847 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e894220-b93f-4615-8e95-636bd1a267b9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:26.567302 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8e894220-b93f-4615-8e95-636bd1a267b9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:26.721271 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8e894220-b93f-4615-8e95-636bd1a267b9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:26.730347 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8e894220-b93f-4615-8e95-636bd1a267b9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 200 len: 1362 microversion: 2.1 time: 0.178303 Jul 31 01:49:26.745168 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3000/5970] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:26 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:27.160266 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-3c5b14fe-5cbf-4078-b80d-d20aa5c902e5 req-7137a694-e971-4d50-a473-239fff34b1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780", "name": "network-vif-plugged", "status": "completed", "tag": "4a0edfcd-d380-4110-8ff6-26f859fbf9f1"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:49:27.172316 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3c5b14fe-5cbf-4078-b80d-d20aa5c902e5 req-7137a694-e971-4d50-a473-239fff34b1f5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:27.172788 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3c5b14fe-5cbf-4078-b80d-d20aa5c902e5 req-7137a694-e971-4d50-a473-239fff34b1f5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:27.184991 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-3c5b14fe-5cbf-4078-b80d-d20aa5c902e5 req-7137a694-e971-4d50-a473-239fff34b1f5 service nova] Creating event network-vif-plugged:4a0edfcd-d380-4110-8ff6-26f859fbf9f1 for instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 on n-h2-master-1 Jul 31 01:49:27.190174 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-3c5b14fe-5cbf-4078-b80d-d20aa5c902e5 req-7137a694-e971-4d50-a473-239fff34b1f5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034572 Jul 31 01:49:27.191092 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2971/5971] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:49:27.752391 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c6bce959-fdf6-4331-89ac-8d276b9e8ed5 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:27.753025 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c6bce959-fdf6-4331-89ac-8d276b9e8ed5 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:27.759859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6bce959-fdf6-4331-89ac-8d276b9e8ed5 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:27.760330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6bce959-fdf6-4331-89ac-8d276b9e8ed5 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:27.761105 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6bce959-fdf6-4331-89ac-8d276b9e8ed5 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:27.761553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c6bce959-fdf6-4331-89ac-8d276b9e8ed5 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:27.873633 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:27.898549 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c6bce959-fdf6-4331-89ac-8d276b9e8ed5 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:27.907988 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c6bce959-fdf6-4331-89ac-8d276b9e8ed5 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 200 len: 1362 microversion: 2.1 time: 0.159387 Jul 31 01:49:27.908898 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3001/5972] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:27 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:28.927377 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:28.929591 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=10 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:28.936564 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b6c88afa-23b2-4b44-ae8f-3d0b95d725f2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:28.937785 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b6c88afa-23b2-4b44-ae8f-3d0b95d725f2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:28.947956 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6c88afa-23b2-4b44-ae8f-3d0b95d725f2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:28.948801 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6c88afa-23b2-4b44-ae8f-3d0b95d725f2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:28.949991 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6c88afa-23b2-4b44-ae8f-3d0b95d725f2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:28.950855 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6c88afa-23b2-4b44-ae8f-3d0b95d725f2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:29.173452 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b6c88afa-23b2-4b44-ae8f-3d0b95d725f2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:29.182368 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b6c88afa-23b2-4b44-ae8f-3d0b95d725f2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 200 len: 1549 microversion: 2.1 time: 0.255963 Jul 31 01:49:29.183120 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2972/5973] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:28 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 1549 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:29.205268 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3bf12518-96dd-4422-b16f-9f119dabe78f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:29.206401 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3bf12518-96dd-4422-b16f-9f119dabe78f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:29.213218 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bf12518-96dd-4422-b16f-9f119dabe78f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:29.213682 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bf12518-96dd-4422-b16f-9f119dabe78f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:29.214467 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bf12518-96dd-4422-b16f-9f119dabe78f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:29.215188 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bf12518-96dd-4422-b16f-9f119dabe78f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:29.314142 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3bf12518-96dd-4422-b16f-9f119dabe78f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114864 Jul 31 01:49:29.314950 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3002/5974] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:49:29 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:49:30.764800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-433d4dce-8272-4e68-a6f0-05e73cecd7e3 req-e170f0fe-f85c-42cc-8ef7-e438912047b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780", "tag": "4a0edfcd-d380-4110-8ff6-26f859fbf9f1"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:49:30.791547 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-433d4dce-8272-4e68-a6f0-05e73cecd7e3 req-e170f0fe-f85c-42cc-8ef7-e438912047b1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:30.792021 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-433d4dce-8272-4e68-a6f0-05e73cecd7e3 req-e170f0fe-f85c-42cc-8ef7-e438912047b1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:30.814859 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-433d4dce-8272-4e68-a6f0-05e73cecd7e3 req-e170f0fe-f85c-42cc-8ef7-e438912047b1 service nova] Creating event network-changed:4a0edfcd-d380-4110-8ff6-26f859fbf9f1 for instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 on n-h2-master-1 Jul 31 01:49:30.826507 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-433d4dce-8272-4e68-a6f0-05e73cecd7e3 req-e170f0fe-f85c-42cc-8ef7-e438912047b1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261242 Jul 31 01:49:30.838178 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2973/5975] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:49:38.992861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7d02357a-1a5a-4da6-9c1c-68dda0d2330c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:49:39.001454 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7d02357a-1a5a-4da6-9c1c-68dda0d2330c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:39.022938 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7d02357a-1a5a-4da6-9c1c-68dda0d2330c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:39.023455 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7d02357a-1a5a-4da6-9c1c-68dda0d2330c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:39.024426 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7d02357a-1a5a-4da6-9c1c-68dda0d2330c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:39.024753 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7d02357a-1a5a-4da6-9c1c-68dda0d2330c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:39.105192 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7d02357a-1a5a-4da6-9c1c-68dda0d2330c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5/action" status: 200 len: 24581 microversion: 2.1 time: 0.121010 Jul 31 01:49:39.131583 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3003/5976] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:49:38 2022] POST /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5/action => generated 24581 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:49:44.374121 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-36be746b-ca54-49da-86fd-8847a5763a4a req-5361ee8a-2cd4-4ea7-aecd-46f2666bc7ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9be455-7503-4a9a-b389-b43bc7a32d81", "tag": "00f95a0e-d9ce-4105-bde0-6fb409422776"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:49:44.378766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4db57bca-2d1d-4e91-b794-18987044a44c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:44.379652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4db57bca-2d1d-4e91-b794-18987044a44c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:44.387281 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=11 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:44.389496 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:44.395672 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-36be746b-ca54-49da-86fd-8847a5763a4a req-5361ee8a-2cd4-4ea7-aecd-46f2666bc7ef service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:44.396977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-36be746b-ca54-49da-86fd-8847a5763a4a req-5361ee8a-2cd4-4ea7-aecd-46f2666bc7ef service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:44.406752 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4db57bca-2d1d-4e91-b794-18987044a44c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:44.408156 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=87 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:44.410146 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-36be746b-ca54-49da-86fd-8847a5763a4a req-5361ee8a-2cd4-4ea7-aecd-46f2666bc7ef service nova] Creating event network-changed:00f95a0e-d9ce-4105-bde0-6fb409422776 for instance 3d9be455-7503-4a9a-b389-b43bc7a32d81 on n-h1-master-1 Jul 31 01:49:44.412355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4db57bca-2d1d-4e91-b794-18987044a44c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:44.416351 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-36be746b-ca54-49da-86fd-8847a5763a4a req-5361ee8a-2cd4-4ea7-aecd-46f2666bc7ef service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046479 Jul 31 01:49:44.417777 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3004/5977] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:49:44.421556 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4db57bca-2d1d-4e91-b794-18987044a44c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:44.422316 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4db57bca-2d1d-4e91-b794-18987044a44c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:44.457562 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4db57bca-2d1d-4e91-b794-18987044a44c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:49:44.635559 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4db57bca-2d1d-4e91-b794-18987044a44c tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 204 len: 0 microversion: 2.1 time: 0.270179 Jul 31 01:49:44.639378 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2974/5978] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:49:44 2022] DELETE /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:49:44.653299 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a280a4a7-7f06-44e6-8238-dd87a2baf3fb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:44.654029 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a280a4a7-7f06-44e6-8238-dd87a2baf3fb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:44.684532 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a280a4a7-7f06-44e6-8238-dd87a2baf3fb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:44.684995 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a280a4a7-7f06-44e6-8238-dd87a2baf3fb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:44.688950 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a280a4a7-7f06-44e6-8238-dd87a2baf3fb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:44.691223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a280a4a7-7f06-44e6-8238-dd87a2baf3fb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:44.946841 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a280a4a7-7f06-44e6-8238-dd87a2baf3fb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:44.955424 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a280a4a7-7f06-44e6-8238-dd87a2baf3fb tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1575 microversion: 2.1 time: 0.314066 Jul 31 01:49:44.967776 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3005/5979] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:44 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1575 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:45.396194 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3eb197c7-97c2-4df4-b51b-e8eb7b8912fb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:45.396946 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3eb197c7-97c2-4df4-b51b-e8eb7b8912fb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:45.405091 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3eb197c7-97c2-4df4-b51b-e8eb7b8912fb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:45.405656 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3eb197c7-97c2-4df4-b51b-e8eb7b8912fb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:45.406984 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3eb197c7-97c2-4df4-b51b-e8eb7b8912fb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:45.407827 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3eb197c7-97c2-4df4-b51b-e8eb7b8912fb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:45.580367 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3eb197c7-97c2-4df4-b51b-e8eb7b8912fb tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1832 microversion: 2.1 time: 0.188830 Jul 31 01:49:45.591459 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2975/5980] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:45 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1832 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:45.992415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3dd3d214-11ae-4741-9ad3-3543bf9869ee tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:45.999673 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3dd3d214-11ae-4741-9ad3-3543bf9869ee tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:46.018234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3dd3d214-11ae-4741-9ad3-3543bf9869ee tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:46.018234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3dd3d214-11ae-4741-9ad3-3543bf9869ee tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:46.018234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3dd3d214-11ae-4741-9ad3-3543bf9869ee tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:46.018234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3dd3d214-11ae-4741-9ad3-3543bf9869ee tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:46.409349 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3dd3d214-11ae-4741-9ad3-3543bf9869ee tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:46.421299 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3dd3d214-11ae-4741-9ad3-3543bf9869ee tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1575 microversion: 2.1 time: 0.441422 Jul 31 01:49:46.441423 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3006/5981] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:45 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1575 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:47.198560 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d4098e6f-ef3b-45b5-a1ec-f19c0225ecd0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:47.199277 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d4098e6f-ef3b-45b5-a1ec-f19c0225ecd0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:47.209033 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-520f1b59-f62d-42d1-9c93-5d9632e7ff6b req-21a5cac5-4d0c-4839-b568-8ed6a8933542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f92c8a2e-dce8-409a-a117-879a319f8cd5", "tag": "f0c13688-0117-437d-8918-32518c254c56"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:49:47.215937 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d4098e6f-ef3b-45b5-a1ec-f19c0225ecd0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:47.217886 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d4098e6f-ef3b-45b5-a1ec-f19c0225ecd0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:47.221731 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d4098e6f-ef3b-45b5-a1ec-f19c0225ecd0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:47.222891 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d4098e6f-ef3b-45b5-a1ec-f19c0225ecd0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:47.234337 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-520f1b59-f62d-42d1-9c93-5d9632e7ff6b req-21a5cac5-4d0c-4839-b568-8ed6a8933542 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:47.234790 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-520f1b59-f62d-42d1-9c93-5d9632e7ff6b req-21a5cac5-4d0c-4839-b568-8ed6a8933542 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:47.263083 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-520f1b59-f62d-42d1-9c93-5d9632e7ff6b req-21a5cac5-4d0c-4839-b568-8ed6a8933542 service nova] Creating event network-changed:f0c13688-0117-437d-8918-32518c254c56 for instance f92c8a2e-dce8-409a-a117-879a319f8cd5 on n-h1-master-1 Jul 31 01:49:47.276862 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-520f1b59-f62d-42d1-9c93-5d9632e7ff6b req-21a5cac5-4d0c-4839-b568-8ed6a8933542 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072297 Jul 31 01:49:47.281937 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3007/5982] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:49:47.319086 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d4098e6f-ef3b-45b5-a1ec-f19c0225ecd0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:49:47.445441 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-49b531e5-111f-4c89-951c-f6cfd22d5bd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:47.449732 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-49b531e5-111f-4c89-951c-f6cfd22d5bd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:47.469563 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49b531e5-111f-4c89-951c-f6cfd22d5bd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:47.470059 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49b531e5-111f-4c89-951c-f6cfd22d5bd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:47.470866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49b531e5-111f-4c89-951c-f6cfd22d5bd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:47.471319 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49b531e5-111f-4c89-951c-f6cfd22d5bd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:47.601996 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d4098e6f-ef3b-45b5-a1ec-f19c0225ecd0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 204 len: 0 microversion: 2.1 time: 0.408812 Jul 31 01:49:47.602597 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2976/5983] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:49:47 2022] DELETE /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:49:47.613980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d5a103c8-2407-4672-930e-6827360c62a5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:47.616767 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d5a103c8-2407-4672-930e-6827360c62a5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:47.636352 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5a103c8-2407-4672-930e-6827360c62a5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:47.637277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5a103c8-2407-4672-930e-6827360c62a5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:47.638293 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5a103c8-2407-4672-930e-6827360c62a5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:47.639462 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5a103c8-2407-4672-930e-6827360c62a5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:47.665942 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-49b531e5-111f-4c89-951c-f6cfd22d5bd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:47.678531 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-49b531e5-111f-4c89-951c-f6cfd22d5bd9 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1224 microversion: 2.1 time: 0.236402 Jul 31 01:49:47.695949 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3008/5984] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:47 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1224 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:47.869251 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d5a103c8-2407-4672-930e-6827360c62a5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:47.879861 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d5a103c8-2407-4672-930e-6827360c62a5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1687 microversion: 2.1 time: 0.271796 Jul 31 01:49:47.881531 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2977/5985] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:47 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1687 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:48.703900 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-be8c6a57-8a76-4c4d-a687-43aa68357e04 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:48.705312 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-be8c6a57-8a76-4c4d-a687-43aa68357e04 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:48.715458 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be8c6a57-8a76-4c4d-a687-43aa68357e04 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:48.716276 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be8c6a57-8a76-4c4d-a687-43aa68357e04 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:48.718282 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be8c6a57-8a76-4c4d-a687-43aa68357e04 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:48.719759 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be8c6a57-8a76-4c4d-a687-43aa68357e04 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:48.850036 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-be8c6a57-8a76-4c4d-a687-43aa68357e04 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:48.858135 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-be8c6a57-8a76-4c4d-a687-43aa68357e04 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1224 microversion: 2.1 time: 0.159566 Jul 31 01:49:48.860269 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3009/5986] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:48 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1224 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:48.902647 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9d78b66b-900f-4f8a-8d20-918921217cf5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:48.903288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9d78b66b-900f-4f8a-8d20-918921217cf5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:48.921768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d78b66b-900f-4f8a-8d20-918921217cf5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:48.925822 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d78b66b-900f-4f8a-8d20-918921217cf5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:48.926948 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d78b66b-900f-4f8a-8d20-918921217cf5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:48.927647 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d78b66b-900f-4f8a-8d20-918921217cf5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:49.401103 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9d78b66b-900f-4f8a-8d20-918921217cf5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:49.418032 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9d78b66b-900f-4f8a-8d20-918921217cf5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 200 len: 1687 microversion: 2.1 time: 0.519149 Jul 31 01:49:49.418627 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2978/5987] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:48 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 1687 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:49.531787 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-37a32e31-5ab7-4880-b6ff-1382604ad122 req-fbe7f48e-f616-44c7-830d-754b66e525c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9be455-7503-4a9a-b389-b43bc7a32d81", "name": "network-vif-deleted", "tag": "00f95a0e-d9ce-4105-bde0-6fb409422776"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:49:49.573594 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-37a32e31-5ab7-4880-b6ff-1382604ad122 req-fbe7f48e-f616-44c7-830d-754b66e525c2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:49.574050 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-37a32e31-5ab7-4880-b6ff-1382604ad122 req-fbe7f48e-f616-44c7-830d-754b66e525c2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:49.601977 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-37a32e31-5ab7-4880-b6ff-1382604ad122 req-fbe7f48e-f616-44c7-830d-754b66e525c2 service nova] Creating event network-vif-deleted:00f95a0e-d9ce-4105-bde0-6fb409422776 for instance 3d9be455-7503-4a9a-b389-b43bc7a32d81 on n-h1-master-1 Jul 31 01:49:49.607403 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-37a32e31-5ab7-4880-b6ff-1382604ad122 req-fbe7f48e-f616-44c7-830d-754b66e525c2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079892 Jul 31 01:49:49.608349 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3010/5988] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:49:49.878194 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-93e2f8cc-4d1b-4c16-a36a-68902d8ff6f7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:49.878918 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-93e2f8cc-4d1b-4c16-a36a-68902d8ff6f7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:49.886701 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93e2f8cc-4d1b-4c16-a36a-68902d8ff6f7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:49.887173 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93e2f8cc-4d1b-4c16-a36a-68902d8ff6f7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:49.893273 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93e2f8cc-4d1b-4c16-a36a-68902d8ff6f7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:49.894030 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93e2f8cc-4d1b-4c16-a36a-68902d8ff6f7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:49.968123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-93e2f8cc-4d1b-4c16-a36a-68902d8ff6f7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:49.978364 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-93e2f8cc-4d1b-4c16-a36a-68902d8ff6f7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1224 microversion: 2.1 time: 0.104011 Jul 31 01:49:49.979578 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2979/5989] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:49 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:50.443257 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1efc9d35-46ff-4863-957f-c9c7375bae7f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:50.450685 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1efc9d35-46ff-4863-957f-c9c7375bae7f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: f92c8a2e-dce8-409a-a117-879a319f8cd5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:50.460614 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=28 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:49:50.463009 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1efc9d35-46ff-4863-957f-c9c7375bae7f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:50.463781 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1efc9d35-46ff-4863-957f-c9c7375bae7f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:50.465018 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1efc9d35-46ff-4863-957f-c9c7375bae7f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:50.465688 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1efc9d35-46ff-4863-957f-c9c7375bae7f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:50.483603 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-1efc9d35-46ff-4863-957f-c9c7375bae7f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] HTTP exception thrown: Instance f92c8a2e-dce8-409a-a117-879a319f8cd5 could not be found. Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1efc9d35-46ff-4863-957f-c9c7375bae7f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Request method failure captured: Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 HTTP/1.1 Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5d9Kf4E3IZDZUsj11OUUTq3aW5TKVoTTbNXJKKFyTqRkWTfvcurnGmoWdsnkQBC06JOC-RzmfXv9UpgiSjIwgxiuii_gLTCRUhYfcSIeg4jSALKpm0sQONrNpVV2nG8N0HrFSmgFYp_LLq1OtetyO0y_1Ae7AWsoynrjLTPfogUx0M8 Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 736abaeccdf44e3899d98fdf2cac4c0f Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-882728420 Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/736abaeccdf44e3899d98fdf2cac4c0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/736abaeccdf44e3899d98fdf2cac4c0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/736abaeccdf44e3899d98fdf2cac4c0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_736abaeccdf44e3899d98fdf2cac4c0f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestNetworkAdvancedServerOps-882728420 Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 736abaeccdf44e3899d98fdf2cac4c0f Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-882728420 Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestNetworkAdvancedServerOps-882728420-project Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: b799c19fd26348d3a84198bb76581c87 Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestNetworkAdvancedServerOps-882728420-project Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: exception: Instance f92c8a2e-dce8-409a-a117-879a319f8cd5 could not be found. Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'f92c8a2e-dce8-409a-a117-879a319f8cd5'} Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f92c8a2e-dce8-409a-a117-879a319f8cd5 could not be found. Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f92c8a2e-dce8-409a-a117-879a319f8cd5 could not be found. Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:49:50.486457 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:49:50.490672 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:49:50.490672 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:49:50.490672 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:49:50.490672 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:49:50.490672 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:49:50.490672 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f92c8a2e-dce8-409a-a117-879a319f8cd5 could not be found. Jul 31 01:49:50.490672 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:49:50.492187 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1efc9d35-46ff-4863-957f-c9c7375bae7f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Returning 404 to user: Instance f92c8a2e-dce8-409a-a117-879a319f8cd5 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:49:50.493414 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1efc9d35-46ff-4863-957f-c9c7375bae7f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5" status: 404 len: 111 microversion: 2.1 time: 0.055036 Jul 31 01:49:50.494514 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3011/5990] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:50 2022] GET /compute/v2.1/servers/f92c8a2e-dce8-409a-a117-879a319f8cd5 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:49:51.001300 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-441d8a4f-6f93-45c8-bb73-4313c3350186 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:51.002462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-441d8a4f-6f93-45c8-bb73-4313c3350186 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:51.012249 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-441d8a4f-6f93-45c8-bb73-4313c3350186 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:51.012989 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-441d8a4f-6f93-45c8-bb73-4313c3350186 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:51.013973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-441d8a4f-6f93-45c8-bb73-4313c3350186 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:51.014827 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-441d8a4f-6f93-45c8-bb73-4313c3350186 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:51.118494 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-441d8a4f-6f93-45c8-bb73-4313c3350186 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:51.127362 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-441d8a4f-6f93-45c8-bb73-4313c3350186 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1224 microversion: 2.1 time: 0.131166 Jul 31 01:49:51.127986 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2980/5991] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:50 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1224 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:51.681321 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-70d6243d-c444-4ab6-8110-0edc7152bea1 req-cf49fd49-4621-4d43-ad27-b4ae2db6efe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92c8a2e-dce8-409a-a117-879a319f8cd5", "name": "network-vif-deleted", "tag": "f0c13688-0117-437d-8918-32518c254c56"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:49:51.694883 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-70d6243d-c444-4ab6-8110-0edc7152bea1 req-cf49fd49-4621-4d43-ad27-b4ae2db6efe2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:51.695942 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-70d6243d-c444-4ab6-8110-0edc7152bea1 req-cf49fd49-4621-4d43-ad27-b4ae2db6efe2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:51.711251 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-70d6243d-c444-4ab6-8110-0edc7152bea1 req-cf49fd49-4621-4d43-ad27-b4ae2db6efe2 service nova] Creating event network-vif-deleted:f0c13688-0117-437d-8918-32518c254c56 for instance f92c8a2e-dce8-409a-a117-879a319f8cd5 on n-h1-master-1 Jul 31 01:49:51.722790 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-70d6243d-c444-4ab6-8110-0edc7152bea1 req-cf49fd49-4621-4d43-ad27-b4ae2db6efe2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047338 Jul 31 01:49:51.724991 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3012/5992] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:49:52.149066 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-62797fe5-b878-4021-be9b-201adfe8ec86 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:52.149626 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-62797fe5-b878-4021-be9b-201adfe8ec86 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:52.157148 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62797fe5-b878-4021-be9b-201adfe8ec86 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:52.157944 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62797fe5-b878-4021-be9b-201adfe8ec86 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:52.158999 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62797fe5-b878-4021-be9b-201adfe8ec86 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:52.159677 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62797fe5-b878-4021-be9b-201adfe8ec86 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:52.238833 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-62797fe5-b878-4021-be9b-201adfe8ec86 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:52.250739 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-62797fe5-b878-4021-be9b-201adfe8ec86 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1224 microversion: 2.1 time: 0.105605 Jul 31 01:49:52.251367 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2981/5993] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:52 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:53.274224 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c967265f-0c18-49a1-92cf-1ca2970c7cf2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:53.275043 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c967265f-0c18-49a1-92cf-1ca2970c7cf2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:53.283780 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c967265f-0c18-49a1-92cf-1ca2970c7cf2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:53.285006 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c967265f-0c18-49a1-92cf-1ca2970c7cf2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:53.285909 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c967265f-0c18-49a1-92cf-1ca2970c7cf2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:53.286607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c967265f-0c18-49a1-92cf-1ca2970c7cf2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:53.331834 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c967265f-0c18-49a1-92cf-1ca2970c7cf2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:53.333428 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c967265f-0c18-49a1-92cf-1ca2970c7cf2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:53.334140 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-c967265f-0c18-49a1-92cf-1ca2970c7cf2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lazy-loading 'fault' on Instance uuid 3d9be455-7503-4a9a-b389-b43bc7a32d81 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:49:53.382902 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c967265f-0c18-49a1-92cf-1ca2970c7cf2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:49:53.393875 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c967265f-0c18-49a1-92cf-1ca2970c7cf2 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 200 len: 1229 microversion: 2.1 time: 0.125387 Jul 31 01:49:53.394481 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3013/5994] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:53 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 1229 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:49:54.388826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-af72ddfe-8223-4f3c-a64a-c63c7e66c66c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '.version_select at 0x7fede45ef3a0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:54.415366 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-af72ddfe-8223-4f3c-a64a-c63c7e66c66c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-111435149" status: 202 len: 0 microversion: 2.1 time: 0.030270 Jul 31 01:49:54.416591 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2982/5995] 10.222.0.45 () {58 vars in 1281 bytes} [Sun Jul 31 01:49:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-111435149 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:49:54.420225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9daf9c28-b1ee-457d-b925-6f2bfb8c2a2d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:49:54.421668 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9daf9c28-b1ee-457d-b925-6f2bfb8c2a2d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: 3d9be455-7503-4a9a-b389-b43bc7a32d81] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:49:54.436867 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9daf9c28-b1ee-457d-b925-6f2bfb8c2a2d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:54.437601 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9daf9c28-b1ee-457d-b925-6f2bfb8c2a2d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:54.439006 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9daf9c28-b1ee-457d-b925-6f2bfb8c2a2d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:49:54.440040 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9daf9c28-b1ee-457d-b925-6f2bfb8c2a2d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:49:54.442862 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c7896f9c-2c1d-4805-ac42-82bd5eef7322 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'create', calling method: .version_select at 0x7fede4604b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-587133466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRDbC6jGxeExzxUrpqAC1YlbO1fLgNXSpqf1nebCldr4JAFgXZbdc2zF/8U3mPnBWMFs4OC9az2JP6hdH6fcHZ3O9zlLH+iVLLimZg0G0zJA8tl36GmoMpA5KHzf064qQ=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:49:54.462356 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-9daf9c28-b1ee-457d-b925-6f2bfb8c2a2d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] HTTP exception thrown: Instance 3d9be455-7503-4a9a-b389-b43bc7a32d81 could not be found. Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9daf9c28-b1ee-457d-b925-6f2bfb8c2a2d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Request method failure captured: Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 HTTP/1.1 Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dxSWPHv6fiyygfwJR0Ud9gfexnY8DUg1-8n2-EFdlhief1Py8PV4RaH4l0q6aYBanPQ6exn-4iFCGEMH9hqgo4PPVedzZNUDT2YTEgYd9iPN8Zs4wyM3F4Cgzs_D-0CTqdk8e-lZRIuuB9WjXa7g4L7rW4yad6wf_BUOJQbjcH4WNc Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f0892e5f98e48408d15771c9d5805bf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestVolumeBootPattern-640389583 Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f6c26df9a49446c290d6a0b1427f0c14 Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 3d9be455-7503-4a9a-b389-b43bc7a32d81 could not be found. Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '3d9be455-7503-4a9a-b389-b43bc7a32d81'} Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9be455-7503-4a9a-b389-b43bc7a32d81 could not be found. Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9be455-7503-4a9a-b389-b43bc7a32d81 could not be found. Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:49:54.464121 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:49:54.468435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:49:54.468435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:49:54.468435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:49:54.468435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:49:54.468435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:49:54.468435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9be455-7503-4a9a-b389-b43bc7a32d81 could not be found. Jul 31 01:49:54.468435 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:49:54.469962 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9daf9c28-b1ee-457d-b925-6f2bfb8c2a2d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Returning 404 to user: Instance 3d9be455-7503-4a9a-b389-b43bc7a32d81 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:49:54.470088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-c7896f9c-2c1d-4805-ac42-82bd5eef7322 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Getting quotas for project 736abaeccdf44e3899d98fdf2cac4c0f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:49:54.470844 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9daf9c28-b1ee-457d-b925-6f2bfb8c2a2d tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81" status: 404 len: 111 microversion: 2.1 time: 0.058288 Jul 31 01:49:54.471742 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3014/5996] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:49:54 2022] GET /compute/v2.1/servers/3d9be455-7503-4a9a-b389-b43bc7a32d81 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:49:54.480970 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-c7896f9c-2c1d-4805-ac42-82bd5eef7322 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Getting quotas for user b799c19fd26348d3a84198bb76581c87 and project 736abaeccdf44e3899d98fdf2cac4c0f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:49:54.509895 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c7896f9c-2c1d-4805-ac42-82bd5eef7322 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.071728 Jul 31 01:49:54.511464 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2983/5997] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:49:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:50:02.105859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9091f018-b495-478b-91a5-aadca7a42a23 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1444865447", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "6ca8f3e6-230c-4f8b-81e9-1035957011e5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-587133466", "security_groups": [{"name": "tempest-secgroup-smoke-972301618"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:50:02.296432 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-9091f018-b495-478b-91a5-aadca7a42a23 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] validate_networks() for [('6ca8f3e6-230c-4f8b-81e9-1035957011e5', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:50:02.364819 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:50:02.369128 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8b22dafb-2ee0-4b84-abc7-fb8831fb4498 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:02.369640 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8b22dafb-2ee0-4b84-abc7-fb8831fb4498 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:02.378252 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b22dafb-2ee0-4b84-abc7-fb8831fb4498 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:02.378972 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b22dafb-2ee0-4b84-abc7-fb8831fb4498 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:02.380520 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b22dafb-2ee0-4b84-abc7-fb8831fb4498 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:02.392269 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b22dafb-2ee0-4b84-abc7-fb8831fb4498 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:02.440884 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8b22dafb-2ee0-4b84-abc7-fb8831fb4498 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:50:02.669752 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8b22dafb-2ee0-4b84-abc7-fb8831fb4498 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 204 len: 0 microversion: 2.1 time: 0.306685 Jul 31 01:50:02.670644 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2984/5998] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:50:02 2022] DELETE /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:50:02.678946 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-485bdb32-52f8-4dec-afb7-104704ca8091 req-68bb1d64-e9eb-45f4-b21a-1c2efe7bb106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5185fc2-3256-4435-bf3a-282e4c1b9a8d", "tag": "43fbaaab-d6fb-4b30-9eb7-5fd66c0a92f2"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:50:02.708278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-485bdb32-52f8-4dec-afb7-104704ca8091 req-68bb1d64-e9eb-45f4-b21a-1c2efe7bb106 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:02.708770 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-485bdb32-52f8-4dec-afb7-104704ca8091 req-68bb1d64-e9eb-45f4-b21a-1c2efe7bb106 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:02.728143 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-485bdb32-52f8-4dec-afb7-104704ca8091 req-68bb1d64-e9eb-45f4-b21a-1c2efe7bb106 service nova] Creating event network-changed:43fbaaab-d6fb-4b30-9eb7-5fd66c0a92f2 for instance c5185fc2-3256-4435-bf3a-282e4c1b9a8d on n-h1-master-1 Jul 31 01:50:02.735545 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-485bdb32-52f8-4dec-afb7-104704ca8091 req-68bb1d64-e9eb-45f4-b21a-1c2efe7bb106 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063298 Jul 31 01:50:02.762055 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2985/5999] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:50:02.769568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eab07cc5-60cc-4eb5-9ec4-73bc21d13765 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:02.771029 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eab07cc5-60cc-4eb5-9ec4-73bc21d13765 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:02.781977 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eab07cc5-60cc-4eb5-9ec4-73bc21d13765 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:02.783247 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eab07cc5-60cc-4eb5-9ec4-73bc21d13765 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:02.784874 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eab07cc5-60cc-4eb5-9ec4-73bc21d13765 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:02.786013 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eab07cc5-60cc-4eb5-9ec4-73bc21d13765 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:03.094075 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9091f018-b495-478b-91a5-aadca7a42a23 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:50:03.094509 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9091f018-b495-478b-91a5-aadca7a42a23 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:50:03.095184 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9091f018-b495-478b-91a5-aadca7a42a23 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:50:03.095638 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9091f018-b495-478b-91a5-aadca7a42a23 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:50:03.096067 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-9091f018-b495-478b-91a5-aadca7a42a23 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:50:03.111126 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9091f018-b495-478b-91a5-aadca7a42a23 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:03.112516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9091f018-b495-478b-91a5-aadca7a42a23 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:03.113568 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9091f018-b495-478b-91a5-aadca7a42a23 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:03.114209 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9091f018-b495-478b-91a5-aadca7a42a23 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:03.124295 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-eab07cc5-60cc-4eb5-9ec4-73bc21d13765 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:03.136124 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eab07cc5-60cc-4eb5-9ec4-73bc21d13765 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1574 microversion: 2.1 time: 0.372086 Jul 31 01:50:03.139261 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2986/6000] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:02 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1574 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:03.171430 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-9091f018-b495-478b-91a5-aadca7a42a23 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Getting quotas for project 736abaeccdf44e3899d98fdf2cac4c0f. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:50:03.178054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-9091f018-b495-478b-91a5-aadca7a42a23 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Getting quotas for user b799c19fd26348d3a84198bb76581c87 and project 736abaeccdf44e3899d98fdf2cac4c0f. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:50:03.196970 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9091f018-b495-478b-91a5-aadca7a42a23 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:50:03.199729 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9091f018-b495-478b-91a5-aadca7a42a23 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:50:03.267937 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9091f018-b495-478b-91a5-aadca7a42a23 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.165600 Jul 31 01:50:03.269457 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3015/6001] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:50:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:50:03.280262 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-884f241c-83c9-4603-b622-51d985cf6ffc tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:03.280963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-884f241c-83c9-4603-b622-51d985cf6ffc tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:03.425185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-884f241c-83c9-4603-b622-51d985cf6ffc tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:03.434489 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-884f241c-83c9-4603-b622-51d985cf6ffc tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1266 microversion: 2.1 time: 0.158030 Jul 31 01:50:03.437655 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2987/6002] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:03 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:04.164669 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e7afca3b-b801-4ad2-8dc5-2ca639b737e7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:04.165558 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e7afca3b-b801-4ad2-8dc5-2ca639b737e7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:04.174786 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e7afca3b-b801-4ad2-8dc5-2ca639b737e7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:04.175648 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e7afca3b-b801-4ad2-8dc5-2ca639b737e7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:04.177045 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e7afca3b-b801-4ad2-8dc5-2ca639b737e7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:04.177731 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e7afca3b-b801-4ad2-8dc5-2ca639b737e7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:04.458851 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7c94a51b-7e59-4923-a7ce-a49251a328af tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:04.459513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7c94a51b-7e59-4923-a7ce-a49251a328af tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:04.474834 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7c94a51b-7e59-4923-a7ce-a49251a328af tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:04.475316 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7c94a51b-7e59-4923-a7ce-a49251a328af tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:04.496597 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7c94a51b-7e59-4923-a7ce-a49251a328af tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:04.501824 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7c94a51b-7e59-4923-a7ce-a49251a328af tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:04.561248 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e7afca3b-b801-4ad2-8dc5-2ca639b737e7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:04.585206 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e7afca3b-b801-4ad2-8dc5-2ca639b737e7 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1574 microversion: 2.1 time: 0.424327 Jul 31 01:50:04.613708 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3016/6003] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:04 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1574 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:04.782708 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7c94a51b-7e59-4923-a7ce-a49251a328af tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:04.809702 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7c94a51b-7e59-4923-a7ce-a49251a328af tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1318 microversion: 2.1 time: 0.352720 Jul 31 01:50:04.815498 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2988/6004] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:04 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:50:05.079750 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-4f804b31-ad9e-4370-b634-944e2990ea59 req-ebbaf40c-4deb-4ac1-bc1c-0f42a500014a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5185fc2-3256-4435-bf3a-282e4c1b9a8d", "name": "network-vif-deleted", "tag": "43fbaaab-d6fb-4b30-9eb7-5fd66c0a92f2"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:50:05.101685 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4f804b31-ad9e-4370-b634-944e2990ea59 req-ebbaf40c-4deb-4ac1-bc1c-0f42a500014a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:05.102175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4f804b31-ad9e-4370-b634-944e2990ea59 req-ebbaf40c-4deb-4ac1-bc1c-0f42a500014a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:05.128734 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-4f804b31-ad9e-4370-b634-944e2990ea59 req-ebbaf40c-4deb-4ac1-bc1c-0f42a500014a service nova] Creating event network-vif-deleted:43fbaaab-d6fb-4b30-9eb7-5fd66c0a92f2 for instance c5185fc2-3256-4435-bf3a-282e4c1b9a8d on n-h1-master-1 Jul 31 01:50:05.138959 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-4f804b31-ad9e-4370-b634-944e2990ea59 req-ebbaf40c-4deb-4ac1-bc1c-0f42a500014a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063089 Jul 31 01:50:05.141170 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3017/6005] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:50:05.621790 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-36a26b1d-6d7b-45c9-b1d9-e2e6c28ab9ca tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:05.623223 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-36a26b1d-6d7b-45c9-b1d9-e2e6c28ab9ca tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:05.639561 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-36a26b1d-6d7b-45c9-b1d9-e2e6c28ab9ca tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:05.640049 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-36a26b1d-6d7b-45c9-b1d9-e2e6c28ab9ca tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:05.645394 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-36a26b1d-6d7b-45c9-b1d9-e2e6c28ab9ca tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:05.649703 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-36a26b1d-6d7b-45c9-b1d9-e2e6c28ab9ca tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:05.775432 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-36a26b1d-6d7b-45c9-b1d9-e2e6c28ab9ca tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:05.788173 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-36a26b1d-6d7b-45c9-b1d9-e2e6c28ab9ca tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1224 microversion: 2.1 time: 0.170488 Jul 31 01:50:05.789340 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2989/6006] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:05 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1224 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:05.836294 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-11c6884b-fda0-43c5-84ac-b69bd9981886 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:05.838882 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-11c6884b-fda0-43c5-84ac-b69bd9981886 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:05.858884 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-11c6884b-fda0-43c5-84ac-b69bd9981886 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:05.863460 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-11c6884b-fda0-43c5-84ac-b69bd9981886 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:05.864837 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-11c6884b-fda0-43c5-84ac-b69bd9981886 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:05.865920 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-11c6884b-fda0-43c5-84ac-b69bd9981886 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:06.261407 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-11c6884b-fda0-43c5-84ac-b69bd9981886 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:06.276658 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-11c6884b-fda0-43c5-84ac-b69bd9981886 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1391 microversion: 2.1 time: 0.446472 Jul 31 01:50:06.291889 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3018/6007] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:05 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1391 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:06.810202 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-52a46fcc-f870-41a9-948e-b9d3c414e78f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:06.810835 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-52a46fcc-f870-41a9-948e-b9d3c414e78f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:06.817524 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52a46fcc-f870-41a9-948e-b9d3c414e78f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:06.818238 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52a46fcc-f870-41a9-948e-b9d3c414e78f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:06.819190 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52a46fcc-f870-41a9-948e-b9d3c414e78f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:06.819837 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-52a46fcc-f870-41a9-948e-b9d3c414e78f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:06.920147 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-52a46fcc-f870-41a9-948e-b9d3c414e78f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:06.931749 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-52a46fcc-f870-41a9-948e-b9d3c414e78f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1224 microversion: 2.1 time: 0.126174 Jul 31 01:50:06.932656 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2990/6008] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:06 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1224 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:07.036724 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-3971961e-e395-4c03-b6aa-d22cdb376847 req-b09a660d-4bad-47b2-b3da-cd51fd012645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c05df349-4c11-4883-814e-6458443510a7", "tag": "630eb1de-1354-4d3c-9468-f48da959aa77"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:50:07.056632 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3971961e-e395-4c03-b6aa-d22cdb376847 req-b09a660d-4bad-47b2-b3da-cd51fd012645 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:07.057601 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3971961e-e395-4c03-b6aa-d22cdb376847 req-b09a660d-4bad-47b2-b3da-cd51fd012645 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:07.084045 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-3971961e-e395-4c03-b6aa-d22cdb376847 req-b09a660d-4bad-47b2-b3da-cd51fd012645 service nova] Creating event network-changed:630eb1de-1354-4d3c-9468-f48da959aa77 for instance c05df349-4c11-4883-814e-6458443510a7 on n-h2-master-1 Jul 31 01:50:07.093166 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-3971961e-e395-4c03-b6aa-d22cdb376847 req-b09a660d-4bad-47b2-b3da-cd51fd012645 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061728 Jul 31 01:50:07.096153 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3019/6009] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:50:07.298823 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e86b08c1-e37a-4f8d-9281-33f55308f2c7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:07.300017 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e86b08c1-e37a-4f8d-9281-33f55308f2c7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:07.308374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e86b08c1-e37a-4f8d-9281-33f55308f2c7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:07.309170 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e86b08c1-e37a-4f8d-9281-33f55308f2c7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:07.310289 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e86b08c1-e37a-4f8d-9281-33f55308f2c7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:07.310912 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e86b08c1-e37a-4f8d-9281-33f55308f2c7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:07.638596 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e86b08c1-e37a-4f8d-9281-33f55308f2c7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:07.654397 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e86b08c1-e37a-4f8d-9281-33f55308f2c7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1391 microversion: 2.1 time: 0.357403 Jul 31 01:50:07.668604 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2991/6010] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:07 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1391 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:07.955602 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8a47e1c9-b808-458b-a531-e54c17756e47 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:07.956644 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8a47e1c9-b808-458b-a531-e54c17756e47 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:07.963663 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a47e1c9-b808-458b-a531-e54c17756e47 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:07.964129 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a47e1c9-b808-458b-a531-e54c17756e47 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:07.965115 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a47e1c9-b808-458b-a531-e54c17756e47 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:07.965566 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8a47e1c9-b808-458b-a531-e54c17756e47 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:08.032705 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8a47e1c9-b808-458b-a531-e54c17756e47 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:08.042835 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8a47e1c9-b808-458b-a531-e54c17756e47 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1224 microversion: 2.1 time: 0.091536 Jul 31 01:50:08.044490 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3020/6011] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:07 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:08.678700 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b0c7ced6-89c0-4c0a-821c-739c508dcab2 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:08.679462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b0c7ced6-89c0-4c0a-821c-739c508dcab2 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:08.690913 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0c7ced6-89c0-4c0a-821c-739c508dcab2 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:08.691905 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0c7ced6-89c0-4c0a-821c-739c508dcab2 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:08.692932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0c7ced6-89c0-4c0a-821c-739c508dcab2 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:08.693683 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0c7ced6-89c0-4c0a-821c-739c508dcab2 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:08.970006 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b0c7ced6-89c0-4c0a-821c-739c508dcab2 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:08.977973 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b0c7ced6-89c0-4c0a-821c-739c508dcab2 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1391 microversion: 2.1 time: 0.303647 Jul 31 01:50:08.978556 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2992/6012] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:08 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1391 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:09.068046 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-31c2795d-711b-4186-887c-a4c54e0a96ec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:09.068703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-31c2795d-711b-4186-887c-a4c54e0a96ec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:09.077732 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31c2795d-711b-4186-887c-a4c54e0a96ec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:09.078360 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31c2795d-711b-4186-887c-a4c54e0a96ec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:09.079391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31c2795d-711b-4186-887c-a4c54e0a96ec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:09.080024 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31c2795d-711b-4186-887c-a4c54e0a96ec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:09.483066 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-31c2795d-711b-4186-887c-a4c54e0a96ec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c26df9a49446c290d6a0b1427f0c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f0892e5f98e48408d15771c9d5805bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:09.491394 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-31c2795d-711b-4186-887c-a4c54e0a96ec tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 200 len: 1224 microversion: 2.1 time: 0.429975 Jul 31 01:50:09.492101 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3021/6013] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:09 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 1224 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:09.999004 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8e3cb35f-702e-40a1-89c3-b277b74df9f5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:09.999865 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8e3cb35f-702e-40a1-89c3-b277b74df9f5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:10.006993 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e3cb35f-702e-40a1-89c3-b277b74df9f5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:10.007570 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e3cb35f-702e-40a1-89c3-b277b74df9f5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:10.008441 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e3cb35f-702e-40a1-89c3-b277b74df9f5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:10.008989 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e3cb35f-702e-40a1-89c3-b277b74df9f5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:10.154662 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8e3cb35f-702e-40a1-89c3-b277b74df9f5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:10.163231 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8e3cb35f-702e-40a1-89c3-b277b74df9f5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1391 microversion: 2.1 time: 0.168196 Jul 31 01:50:10.163861 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2993/6014] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:09 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:10.514205 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9da531f7-f5aa-4371-a32e-17923d8dc196 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:10.514833 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9da531f7-f5aa-4371-a32e-17923d8dc196 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: c5185fc2-3256-4435-bf3a-282e4c1b9a8d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:10.522423 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9da531f7-f5aa-4371-a32e-17923d8dc196 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:10.522893 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9da531f7-f5aa-4371-a32e-17923d8dc196 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:10.523710 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9da531f7-f5aa-4371-a32e-17923d8dc196 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:10.524162 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9da531f7-f5aa-4371-a32e-17923d8dc196 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:10.537899 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-9da531f7-f5aa-4371-a32e-17923d8dc196 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] HTTP exception thrown: Instance c5185fc2-3256-4435-bf3a-282e4c1b9a8d could not be found. Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9da531f7-f5aa-4371-a32e-17923d8dc196 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Request method failure captured: Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d HTTP/1.1 Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dxSWPHv6fiyygfwJR0Ud9gfexnY8DUg1-8n2-EFdlhief1Py8PV4RaH4l0q6aYBanPQ6exn-4iFCGEMH9hqgo4PPVedzZNUDT2YTEgYd9iPN8Zs4wyM3F4Cgzs_D-0CTqdk8e-lZRIuuB9WjXa7g4L7rW4yad6wf_BUOJQbjcH4WNc Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f0892e5f98e48408d15771c9d5805bf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestVolumeBootPattern-640389583 Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f6c26df9a49446c290d6a0b1427f0c14 Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: exception: Instance c5185fc2-3256-4435-bf3a-282e4c1b9a8d could not be found. Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'c5185fc2-3256-4435-bf3a-282e4c1b9a8d'} Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5185fc2-3256-4435-bf3a-282e4c1b9a8d could not be found. Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5185fc2-3256-4435-bf3a-282e4c1b9a8d could not be found. Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:50:10.539604 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:50:10.544203 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:50:10.544203 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:50:10.544203 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:50:10.544203 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:50:10.544203 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:50:10.544203 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5185fc2-3256-4435-bf3a-282e4c1b9a8d could not be found. Jul 31 01:50:10.544203 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:50:10.544203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9da531f7-f5aa-4371-a32e-17923d8dc196 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Returning 404 to user: Instance c5185fc2-3256-4435-bf3a-282e4c1b9a8d could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:50:10.544203 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9da531f7-f5aa-4371-a32e-17923d8dc196 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d" status: 404 len: 111 microversion: 2.1 time: 0.030796 Jul 31 01:50:10.544203 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3022/6015] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:10 2022] GET /compute/v2.1/servers/c5185fc2-3256-4435-bf3a-282e4c1b9a8d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:50:11.010465 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-70687278-44b9-4ea0-a2e9-61b4b5bc36c8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:11.011005 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-70687278-44b9-4ea0-a2e9-61b4b5bc36c8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:11.018259 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70687278-44b9-4ea0-a2e9-61b4b5bc36c8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:11.018730 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70687278-44b9-4ea0-a2e9-61b4b5bc36c8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:11.019654 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70687278-44b9-4ea0-a2e9-61b4b5bc36c8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:11.020113 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-70687278-44b9-4ea0-a2e9-61b4b5bc36c8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:11.036412 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-70687278-44b9-4ea0-a2e9-61b4b5bc36c8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] HTTP exception thrown: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-70687278-44b9-4ea0-a2e9-61b4b5bc36c8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Request method failure captured: Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 HTTP/1.1 Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5dxSWPHv6fiyygfwJR0Ud9gfexnY8DUg1-8n2-EFdlhief1Py8PV4RaH4l0q6aYBanPQ6exn-4iFCGEMH9hqgo4PPVedzZNUDT2YTEgYd9iPN8Zs4wyM3F4Cgzs_D-0CTqdk8e-lZRIuuB9WjXa7g4L7rW4yad6wf_BUOJQbjcH4WNc Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f0892e5f98e48408d15771c9d5805bf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestVolumeBootPattern-640389583 Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: f6c26df9a49446c290d6a0b1427f0c14 Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: exception: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'cb49b7d2-7bca-4738-b236-dafb09128705'} Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:50:11.038107 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:50:11.045588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. Jul 31 01:50:11.045588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:50:11.045588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:50:11.045588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:50:11.045588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:50:11.045588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:50:11.045588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:50:11.045588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:50:11.045588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:50:11.045588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. Jul 31 01:50:11.045588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:50:11.045588 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-70687278-44b9-4ea0-a2e9-61b4b5bc36c8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Returning 404 to user: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:50:11.045588 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-70687278-44b9-4ea0-a2e9-61b4b5bc36c8 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 404 len: 111 microversion: 2.1 time: 0.033064 Jul 31 01:50:11.045588 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2994/6016] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:50:11 2022] DELETE /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:50:11.052479 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bff4de9b-2271-42be-8627-294ab4d23241 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:11.053117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bff4de9b-2271-42be-8627-294ab4d23241 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] [instance: cb49b7d2-7bca-4738-b236-dafb09128705] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:11.059199 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bff4de9b-2271-42be-8627-294ab4d23241 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:11.059694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bff4de9b-2271-42be-8627-294ab4d23241 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:11.060471 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bff4de9b-2271-42be-8627-294ab4d23241 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:11.060915 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bff4de9b-2271-42be-8627-294ab4d23241 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:11.075460 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-bff4de9b-2271-42be-8627-294ab4d23241 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] HTTP exception thrown: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bff4de9b-2271-42be-8627-294ab4d23241 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Request method failure captured: Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 HTTP/1.1 Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5dxSWPHv6fiyygfwJR0Ud9gfexnY8DUg1-8n2-EFdlhief1Py8PV4RaH4l0q6aYBanPQ6exn-4iFCGEMH9hqgo4PPVedzZNUDT2YTEgYd9iPN8Zs4wyM3F4Cgzs_D-0CTqdk8e-lZRIuuB9WjXa7g4L7rW4yad6wf_BUOJQbjcH4WNc Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4f0892e5f98e48408d15771c9d5805bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4f0892e5f98e48408d15771c9d5805bf", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestVolumeBootPattern-640389583 Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 4f0892e5f98e48408d15771c9d5805bf Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestVolumeBootPattern-640389583 Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: f6c26df9a49446c290d6a0b1427f0c14 Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestVolumeBootPattern-640389583-project Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: exception: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'cb49b7d2-7bca-4738-b236-dafb09128705'} Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:50:11.077008 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:50:11.081013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:50:11.081013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:50:11.081013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:50:11.081013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:50:11.081013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:50:11.081013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. Jul 31 01:50:11.081013 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:50:11.081013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bff4de9b-2271-42be-8627-294ab4d23241 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Returning 404 to user: Instance cb49b7d2-7bca-4738-b236-dafb09128705 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:50:11.081013 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bff4de9b-2271-42be-8627-294ab4d23241 tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705" status: 404 len: 111 microversion: 2.1 time: 0.031127 Jul 31 01:50:11.081013 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3023/6017] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:11 2022] GET /compute/v2.1/servers/cb49b7d2-7bca-4738-b236-dafb09128705 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:50:11.190516 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f2ceac26-f906-457a-91c3-404c0e760ab4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:11.191077 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f2ceac26-f906-457a-91c3-404c0e760ab4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:11.199240 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f2ceac26-f906-457a-91c3-404c0e760ab4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:11.199748 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f2ceac26-f906-457a-91c3-404c0e760ab4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:11.200698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f2ceac26-f906-457a-91c3-404c0e760ab4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:11.201010 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f2ceac26-f906-457a-91c3-404c0e760ab4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:11.354322 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f2ceac26-f906-457a-91c3-404c0e760ab4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:11.362944 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f2ceac26-f906-457a-91c3-404c0e760ab4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1391 microversion: 2.1 time: 0.177285 Jul 31 01:50:11.373774 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2995/6018] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:11 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:12.385301 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-747cca1a-fc1b-4e5a-9ee7-92ee61e609bd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:12.385936 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-747cca1a-fc1b-4e5a-9ee7-92ee61e609bd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:12.392992 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-747cca1a-fc1b-4e5a-9ee7-92ee61e609bd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:12.393462 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-747cca1a-fc1b-4e5a-9ee7-92ee61e609bd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:12.394245 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-747cca1a-fc1b-4e5a-9ee7-92ee61e609bd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:12.395236 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-747cca1a-fc1b-4e5a-9ee7-92ee61e609bd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:12.529815 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-747cca1a-fc1b-4e5a-9ee7-92ee61e609bd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:12.538023 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-747cca1a-fc1b-4e5a-9ee7-92ee61e609bd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1391 microversion: 2.1 time: 0.156650 Jul 31 01:50:12.538603 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3024/6019] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:12 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:13.376599 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-d2840c6e-835e-4ea8-abb2-a4d17071fcfc req-136ba093-3375-4acf-bf45-7897acbfc405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05df349-4c11-4883-814e-6458443510a7", "name": "network-vif-plugged", "status": "completed", "tag": "630eb1de-1354-4d3c-9468-f48da959aa77"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:50:13.393687 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d2840c6e-835e-4ea8-abb2-a4d17071fcfc req-136ba093-3375-4acf-bf45-7897acbfc405 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:13.394406 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d2840c6e-835e-4ea8-abb2-a4d17071fcfc req-136ba093-3375-4acf-bf45-7897acbfc405 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:13.409770 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-d2840c6e-835e-4ea8-abb2-a4d17071fcfc req-136ba093-3375-4acf-bf45-7897acbfc405 service nova] Creating event network-vif-plugged:630eb1de-1354-4d3c-9468-f48da959aa77 for instance c05df349-4c11-4883-814e-6458443510a7 on n-h2-master-1 Jul 31 01:50:13.416244 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-d2840c6e-835e-4ea8-abb2-a4d17071fcfc req-136ba093-3375-4acf-bf45-7897acbfc405 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046275 Jul 31 01:50:13.418633 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2996/6020] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:50:13.562215 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-33d5c491-69b1-42b5-99fa-62fbd4ee70d5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:13.563662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-33d5c491-69b1-42b5-99fa-62fbd4ee70d5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:13.570994 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:50:13.571892 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:50:13.574557 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33d5c491-69b1-42b5-99fa-62fbd4ee70d5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:13.575775 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33d5c491-69b1-42b5-99fa-62fbd4ee70d5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:13.576887 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33d5c491-69b1-42b5-99fa-62fbd4ee70d5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:13.577746 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33d5c491-69b1-42b5-99fa-62fbd4ee70d5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:13.736025 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-33d5c491-69b1-42b5-99fa-62fbd4ee70d5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:13.744444 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-33d5c491-69b1-42b5-99fa-62fbd4ee70d5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1391 microversion: 2.1 time: 0.189849 Jul 31 01:50:13.745572 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3025/6021] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:13 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1391 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:14.769735 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1181c07d-7564-48ab-90d5-2010daa99026 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:14.770788 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1181c07d-7564-48ab-90d5-2010daa99026 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:14.774347 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:50:14.776841 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:50:14.783265 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1181c07d-7564-48ab-90d5-2010daa99026 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:14.784133 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1181c07d-7564-48ab-90d5-2010daa99026 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:14.785233 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1181c07d-7564-48ab-90d5-2010daa99026 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:14.785882 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1181c07d-7564-48ab-90d5-2010daa99026 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:14.961029 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1181c07d-7564-48ab-90d5-2010daa99026 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:14.971920 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1181c07d-7564-48ab-90d5-2010daa99026 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1563 microversion: 2.1 time: 0.207394 Jul 31 01:50:14.984067 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2997/6022] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:14 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1563 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:50:14.994390 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5e996a85-eda6-4787-aa84-5e8ffb4933a0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:14.995032 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5e996a85-eda6-4787-aa84-5e8ffb4933a0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:15.002854 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e996a85-eda6-4787-aa84-5e8ffb4933a0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:15.003326 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e996a85-eda6-4787-aa84-5e8ffb4933a0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:15.004176 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e996a85-eda6-4787-aa84-5e8ffb4933a0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:15.004809 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e996a85-eda6-4787-aa84-5e8ffb4933a0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:15.009554 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=90 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:50:15.173555 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5e996a85-eda6-4787-aa84-5e8ffb4933a0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:15.181646 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5e996a85-eda6-4787-aa84-5e8ffb4933a0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1563 microversion: 2.1 time: 0.191580 Jul 31 01:50:15.182216 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3026/6023] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:14 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1563 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:15.586371 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-552aba96-1f6d-47ee-a335-4c5d5502e51f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] Calling method '.version_select at 0x7fede4fad280>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:15.626490 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-552aba96-1f6d-47ee-a335-4c5d5502e51f tempest-TestVolumeBootPattern-640389583 tempest-TestVolumeBootPattern-640389583-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-314743935" status: 202 len: 0 microversion: 2.1 time: 0.043899 Jul 31 01:50:15.628067 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2998/6024] 10.222.0.45 () {58 vars in 1260 bytes} [Sun Jul 31 01:50:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-314743935 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:50:17.146890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dc998958-8cce-4751-9d7c-6bdedfab0bb4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:17.147629 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dc998958-8cce-4751-9d7c-6bdedfab0bb4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:17.166118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1cac51f5-9bc5-4fae-b93a-29f3190a26d5 req-928a56c5-2f57-4ac3-a533-463f2696b7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c05df349-4c11-4883-814e-6458443510a7", "tag": "630eb1de-1354-4d3c-9468-f48da959aa77"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:50:17.179796 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc998958-8cce-4751-9d7c-6bdedfab0bb4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:17.185741 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc998958-8cce-4751-9d7c-6bdedfab0bb4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:17.186610 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc998958-8cce-4751-9d7c-6bdedfab0bb4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:17.187070 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc998958-8cce-4751-9d7c-6bdedfab0bb4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:17.194567 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1cac51f5-9bc5-4fae-b93a-29f3190a26d5 req-928a56c5-2f57-4ac3-a533-463f2696b7f5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:17.195267 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1cac51f5-9bc5-4fae-b93a-29f3190a26d5 req-928a56c5-2f57-4ac3-a533-463f2696b7f5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:17.209788 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1cac51f5-9bc5-4fae-b93a-29f3190a26d5 req-928a56c5-2f57-4ac3-a533-463f2696b7f5 service nova] Creating event network-changed:630eb1de-1354-4d3c-9468-f48da959aa77 for instance c05df349-4c11-4883-814e-6458443510a7 on n-h2-master-1 Jul 31 01:50:17.221684 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1cac51f5-9bc5-4fae-b93a-29f3190a26d5 req-928a56c5-2f57-4ac3-a533-463f2696b7f5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059886 Jul 31 01:50:17.223321 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 2999/6025] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:50:17.396468 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dc998958-8cce-4751-9d7c-6bdedfab0bb4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:17.406543 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dc998958-8cce-4751-9d7c-6bdedfab0bb4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1563 microversion: 2.1 time: 0.264079 Jul 31 01:50:17.423375 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3027/6026] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:17 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1563 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:33.264326 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63634f50-8ad3-4db4-a5b2-8b3d2361ad5a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:33.264949 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-63634f50-8ad3-4db4-a5b2-8b3d2361ad5a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:33.268028 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:50:33.269474 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:50:33.276465 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63634f50-8ad3-4db4-a5b2-8b3d2361ad5a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:33.276940 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63634f50-8ad3-4db4-a5b2-8b3d2361ad5a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:33.277752 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63634f50-8ad3-4db4-a5b2-8b3d2361ad5a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:33.278195 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63634f50-8ad3-4db4-a5b2-8b3d2361ad5a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:33.303049 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-63634f50-8ad3-4db4-a5b2-8b3d2361ad5a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/ips" status: 200 len: 146 microversion: 2.1 time: 0.043110 Jul 31 01:50:33.303654 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3000/6027] 10.222.0.45 () {58 vars in 1248 bytes} [Sun Jul 31 01:50:33 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:50:34.646800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-286b9e3f-a6d6-41d6-9dfa-bbe53d9f503b tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "053b028f-5031-4a76-9139-509107449a37"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:50:34.649275 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-286b9e3f-a6d6-41d6-9dfa-bbe53d9f503b tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:34.652114 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:50:34.652342 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=11 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:50:34.658955 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-286b9e3f-a6d6-41d6-9dfa-bbe53d9f503b tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:34.659449 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-286b9e3f-a6d6-41d6-9dfa-bbe53d9f503b tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:34.660255 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-286b9e3f-a6d6-41d6-9dfa-bbe53d9f503b tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:34.660709 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-286b9e3f-a6d6-41d6-9dfa-bbe53d9f503b tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:34.932006 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-286b9e3f-a6d6-41d6-9dfa-bbe53d9f503b tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "POST /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289986 Jul 31 01:50:34.933087 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3028/6028] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:50:34 2022] POST /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:50:39.833866 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3cb63e36-63c3-49ae-86c1-50c427b928fa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:50:39.836180 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3cb63e36-63c3-49ae-86c1-50c427b928fa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:39.842800 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3cb63e36-63c3-49ae-86c1-50c427b928fa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:39.843274 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3cb63e36-63c3-49ae-86c1-50c427b928fa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:39.844219 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3cb63e36-63c3-49ae-86c1-50c427b928fa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:39.844695 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3cb63e36-63c3-49ae-86c1-50c427b928fa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:39.912524 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3cb63e36-63c3-49ae-86c1-50c427b928fa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7/action" status: 200 len: 24565 microversion: 2.1 time: 0.083443 Jul 31 01:50:39.913370 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3001/6029] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:50:39 2022] POST /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7/action => generated 24565 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:50:45.668522 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0679c07a-a657-489f-9de6-781c24ef14ff tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:45.671493 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0679c07a-a657-489f-9de6-781c24ef14ff tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:45.676346 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:50:45.677232 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:50:45.681700 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0679c07a-a657-489f-9de6-781c24ef14ff tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:45.682285 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0679c07a-a657-489f-9de6-781c24ef14ff tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:45.683235 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0679c07a-a657-489f-9de6-781c24ef14ff tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:45.683763 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0679c07a-a657-489f-9de6-781c24ef14ff tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:45.719672 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0679c07a-a657-489f-9de6-781c24ef14ff tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055460 Jul 31 01:50:45.720925 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3029/6030] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:50:45 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:50:45.732707 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ecacca22-8cce-4a22-b88b-6bff358c3991 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:45.733303 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ecacca22-8cce-4a22-b88b-6bff358c3991 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:45.742568 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecacca22-8cce-4a22-b88b-6bff358c3991 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:45.743050 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecacca22-8cce-4a22-b88b-6bff358c3991 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:45.743968 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecacca22-8cce-4a22-b88b-6bff358c3991 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:45.744422 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecacca22-8cce-4a22-b88b-6bff358c3991 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:45.777041 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ecacca22-8cce-4a22-b88b-6bff358c3991 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments/053b028f-5031-4a76-9139-509107449a37" status: 200 len: 194 microversion: 2.1 time: 0.049161 Jul 31 01:50:45.777636 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3002/6031] 10.222.0.45 () {58 vars in 1413 bytes} [Sun Jul 31 01:50:45 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments/053b028f-5031-4a76-9139-509107449a37 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:50:46.279968 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3d12195d-c2d8-4c0f-bf54-0556603227a7 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:46.280803 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3d12195d-c2d8-4c0f-bf54-0556603227a7 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:46.297215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d12195d-c2d8-4c0f-bf54-0556603227a7 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:46.297828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d12195d-c2d8-4c0f-bf54-0556603227a7 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:46.298735 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d12195d-c2d8-4c0f-bf54-0556603227a7 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:46.299872 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3d12195d-c2d8-4c0f-bf54-0556603227a7 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:46.445618 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3d12195d-c2d8-4c0f-bf54-0556603227a7 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1832 microversion: 2.1 time: 0.169930 Jul 31 01:50:46.461169 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3030/6032] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:46 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1832 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:46.472636 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8373ad88-d656-4922-9edd-a6806661dee5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:46.473556 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8373ad88-d656-4922-9edd-a6806661dee5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:46.481279 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8373ad88-d656-4922-9edd-a6806661dee5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:46.482226 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8373ad88-d656-4922-9edd-a6806661dee5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:46.483271 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8373ad88-d656-4922-9edd-a6806661dee5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:46.484548 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8373ad88-d656-4922-9edd-a6806661dee5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:46.636346 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8373ad88-d656-4922-9edd-a6806661dee5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:46.644911 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8373ad88-d656-4922-9edd-a6806661dee5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1681 microversion: 2.1 time: 0.178269 Jul 31 01:50:46.645484 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3003/6033] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:46 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:46.752247 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b780239d-0e4d-4dcb-bc19-49a7db80dca7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:50:46.755607 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b780239d-0e4d-4dcb-bc19-49a7db80dca7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:46.764787 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b780239d-0e4d-4dcb-bc19-49a7db80dca7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:46.765548 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b780239d-0e4d-4dcb-bc19-49a7db80dca7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:46.766558 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b780239d-0e4d-4dcb-bc19-49a7db80dca7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:46.767194 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b780239d-0e4d-4dcb-bc19-49a7db80dca7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:46.836160 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b780239d-0e4d-4dcb-bc19-49a7db80dca7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7/action" status: 200 len: 32642 microversion: 2.1 time: 0.089636 Jul 31 01:50:46.838150 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3031/6034] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:50:46 2022] POST /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7/action => generated 32642 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:50:46.999913 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-59a326d9-8871-4f81-9de8-f6b0a12c320d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:50:47.000628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-59a326d9-8871-4f81-9de8-f6b0a12c320d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:47.009035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59a326d9-8871-4f81-9de8-f6b0a12c320d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:47.009751 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59a326d9-8871-4f81-9de8-f6b0a12c320d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:47.010945 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59a326d9-8871-4f81-9de8-f6b0a12c320d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:47.011863 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59a326d9-8871-4f81-9de8-f6b0a12c320d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:47.069905 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-59a326d9-8871-4f81-9de8-f6b0a12c320d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '39552388905547879b405ed39d8771c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad8e095838647bca23b68732eb92dc8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:47.070539 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-59a326d9-8871-4f81-9de8-f6b0a12c320d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] [instance: c05df349-4c11-4883-814e-6458443510a7] flavor_id is None. Assuming migration. {{(pid=119474) resize /opt/stack/nova/nova/compute/api.py:4144}} Jul 31 01:50:47.070998 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-59a326d9-8871-4f81-9de8-f6b0a12c320d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] [instance: c05df349-4c11-4883-814e-6458443510a7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119474) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 31 01:50:47.152667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-67799e03-ad6b-4260-a7ce-52aa81922749 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c8ef734-5c9d-49e5-9eef-652ba136167f"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:50:47.155134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-67799e03-ad6b-4260-a7ce-52aa81922749 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:47.164267 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-67799e03-ad6b-4260-a7ce-52aa81922749 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:47.164723 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-67799e03-ad6b-4260-a7ce-52aa81922749 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:47.165490 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-67799e03-ad6b-4260-a7ce-52aa81922749 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:47.165939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-67799e03-ad6b-4260-a7ce-52aa81922749 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:47.275279 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-59a326d9-8871-4f81-9de8-f6b0a12c320d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7/action" status: 202 len: 0 microversion: 2.1 time: 0.279714 Jul 31 01:50:47.276513 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3004/6035] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:50:46 2022] POST /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:50:47.284449 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-72bae1fc-e361-439a-acce-a80d195c0fe4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:47.285282 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-72bae1fc-e361-439a-acce-a80d195c0fe4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:47.293418 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72bae1fc-e361-439a-acce-a80d195c0fe4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:47.294278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72bae1fc-e361-439a-acce-a80d195c0fe4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:47.295267 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72bae1fc-e361-439a-acce-a80d195c0fe4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:47.295932 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-72bae1fc-e361-439a-acce-a80d195c0fe4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:47.457040 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-72bae1fc-e361-439a-acce-a80d195c0fe4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:47.466371 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-72bae1fc-e361-439a-acce-a80d195c0fe4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1690 microversion: 2.1 time: 0.184527 Jul 31 01:50:47.466371 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3005/6036] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:47 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1690 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:50:47.521536 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-67799e03-ad6b-4260-a7ce-52aa81922749 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "POST /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.374901 Jul 31 01:50:47.522907 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3032/6037] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:50:47 2022] POST /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:50:48.489284 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a31e7493-505a-4277-9943-4b4c0e7e59f4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:48.489923 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a31e7493-505a-4277-9943-4b4c0e7e59f4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:48.497552 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a31e7493-505a-4277-9943-4b4c0e7e59f4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:48.498025 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a31e7493-505a-4277-9943-4b4c0e7e59f4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:48.499860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a31e7493-505a-4277-9943-4b4c0e7e59f4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:48.501958 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a31e7493-505a-4277-9943-4b4c0e7e59f4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:48.712636 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a31e7493-505a-4277-9943-4b4c0e7e59f4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:48.721273 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a31e7493-505a-4277-9943-4b4c0e7e59f4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1690 microversion: 2.1 time: 0.235646 Jul 31 01:50:48.722758 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3006/6038] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:48 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1690 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:50:49.747876 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-237bf615-7227-47c1-9c81-2d8f048df56a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:49.749424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-237bf615-7227-47c1-9c81-2d8f048df56a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:49.757565 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-237bf615-7227-47c1-9c81-2d8f048df56a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:49.758236 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-237bf615-7227-47c1-9c81-2d8f048df56a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:49.759185 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-237bf615-7227-47c1-9c81-2d8f048df56a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:49.759825 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-237bf615-7227-47c1-9c81-2d8f048df56a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:49.906316 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-237bf615-7227-47c1-9c81-2d8f048df56a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:49.914321 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-237bf615-7227-47c1-9c81-2d8f048df56a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1695 microversion: 2.1 time: 0.171727 Jul 31 01:50:49.914926 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3033/6039] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:49 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:50.936818 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-36ded770-3bb2-41b0-9b2a-185e9f6c305e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:50.937455 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-36ded770-3bb2-41b0-9b2a-185e9f6c305e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:50.945719 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-36ded770-3bb2-41b0-9b2a-185e9f6c305e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:50.946185 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-36ded770-3bb2-41b0-9b2a-185e9f6c305e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:50.947184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-36ded770-3bb2-41b0-9b2a-185e9f6c305e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:50.947804 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-36ded770-3bb2-41b0-9b2a-185e9f6c305e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:51.087982 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-36ded770-3bb2-41b0-9b2a-185e9f6c305e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:51.095615 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-36ded770-3bb2-41b0-9b2a-185e9f6c305e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1695 microversion: 2.1 time: 0.162754 Jul 31 01:50:51.096180 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3007/6040] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:50 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:52.117553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2e6b08ab-5628-4a63-bc55-8f1824c69e13 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:52.118178 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2e6b08ab-5628-4a63-bc55-8f1824c69e13 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:52.125231 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e6b08ab-5628-4a63-bc55-8f1824c69e13 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:52.125693 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e6b08ab-5628-4a63-bc55-8f1824c69e13 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:52.126478 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e6b08ab-5628-4a63-bc55-8f1824c69e13 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:52.127103 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e6b08ab-5628-4a63-bc55-8f1824c69e13 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:52.266039 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2e6b08ab-5628-4a63-bc55-8f1824c69e13 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:52.275113 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2e6b08ab-5628-4a63-bc55-8f1824c69e13 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1695 microversion: 2.1 time: 0.161763 Jul 31 01:50:52.275956 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3034/6041] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:52 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:53.298191 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a7a6d0ea-158e-4f19-94d6-3f33e1386dea tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:53.299554 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a7a6d0ea-158e-4f19-94d6-3f33e1386dea tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:53.310420 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7a6d0ea-158e-4f19-94d6-3f33e1386dea tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:53.310936 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7a6d0ea-158e-4f19-94d6-3f33e1386dea tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:53.311765 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7a6d0ea-158e-4f19-94d6-3f33e1386dea tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:53.312229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7a6d0ea-158e-4f19-94d6-3f33e1386dea tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:53.443491 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a7a6d0ea-158e-4f19-94d6-3f33e1386dea tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:53.451255 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a7a6d0ea-158e-4f19-94d6-3f33e1386dea tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1695 microversion: 2.1 time: 0.157380 Jul 31 01:50:53.451866 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3008/6042] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:53 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:54.473505 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e324c3b-7b84-421e-8cd1-524bb9e5217a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:54.474142 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3e324c3b-7b84-421e-8cd1-524bb9e5217a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:54.481129 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e324c3b-7b84-421e-8cd1-524bb9e5217a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:54.481594 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e324c3b-7b84-421e-8cd1-524bb9e5217a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:54.482376 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e324c3b-7b84-421e-8cd1-524bb9e5217a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:54.482826 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e324c3b-7b84-421e-8cd1-524bb9e5217a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:54.620147 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3e324c3b-7b84-421e-8cd1-524bb9e5217a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:54.628314 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3e324c3b-7b84-421e-8cd1-524bb9e5217a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1695 microversion: 2.1 time: 0.158796 Jul 31 01:50:54.628986 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3035/6043] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:54 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:55.649511 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-27811f11-b745-48d0-a6ec-ea503fb07cd8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:55.650177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-27811f11-b745-48d0-a6ec-ea503fb07cd8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:55.657253 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-27811f11-b745-48d0-a6ec-ea503fb07cd8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:55.657722 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-27811f11-b745-48d0-a6ec-ea503fb07cd8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:55.658520 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-27811f11-b745-48d0-a6ec-ea503fb07cd8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:55.658977 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-27811f11-b745-48d0-a6ec-ea503fb07cd8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:55.802993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-27811f11-b745-48d0-a6ec-ea503fb07cd8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:55.811130 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-27811f11-b745-48d0-a6ec-ea503fb07cd8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1695 microversion: 2.1 time: 0.165509 Jul 31 01:50:55.811753 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3009/6044] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:55 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:56.833875 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-56ee52ce-e5e4-4f1d-bf67-9418796e61e5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:56.834779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-56ee52ce-e5e4-4f1d-bf67-9418796e61e5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:56.843287 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56ee52ce-e5e4-4f1d-bf67-9418796e61e5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:56.843791 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56ee52ce-e5e4-4f1d-bf67-9418796e61e5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:56.844584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56ee52ce-e5e4-4f1d-bf67-9418796e61e5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:56.845036 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56ee52ce-e5e4-4f1d-bf67-9418796e61e5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:56.981466 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-56ee52ce-e5e4-4f1d-bf67-9418796e61e5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:56.988967 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-56ee52ce-e5e4-4f1d-bf67-9418796e61e5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1695 microversion: 2.1 time: 0.159518 Jul 31 01:50:56.989548 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3036/6045] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:56 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:58.013478 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-876a1c54-c884-472f-81b5-17de5a7889a7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:58.020855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-876a1c54-c884-472f-81b5-17de5a7889a7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:58.036609 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-876a1c54-c884-472f-81b5-17de5a7889a7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:58.037391 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-876a1c54-c884-472f-81b5-17de5a7889a7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:58.038365 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-876a1c54-c884-472f-81b5-17de5a7889a7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:58.038909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-876a1c54-c884-472f-81b5-17de5a7889a7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:58.195022 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-876a1c54-c884-472f-81b5-17de5a7889a7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:58.202926 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-876a1c54-c884-472f-81b5-17de5a7889a7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1695 microversion: 2.1 time: 0.193760 Jul 31 01:50:58.203519 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3010/6046] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:58 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:50:58.315102 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eb96ae8b-9099-40b5-af6f-abb6713a29e7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:58.317431 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eb96ae8b-9099-40b5-af6f-abb6713a29e7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:58.324534 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb96ae8b-9099-40b5-af6f-abb6713a29e7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:58.324934 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb96ae8b-9099-40b5-af6f-abb6713a29e7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:58.325712 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb96ae8b-9099-40b5-af6f-abb6713a29e7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:58.326163 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb96ae8b-9099-40b5-af6f-abb6713a29e7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:58.358594 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eb96ae8b-9099-40b5-af6f-abb6713a29e7 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047440 Jul 31 01:50:58.359212 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3037/6047] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:50:58 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:50:58.500648 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cb495fa8-7cac-4c1e-9f45-b297ca97f6e9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:58.501197 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cb495fa8-7cac-4c1e-9f45-b297ca97f6e9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:58.508683 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb495fa8-7cac-4c1e-9f45-b297ca97f6e9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:58.509156 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb495fa8-7cac-4c1e-9f45-b297ca97f6e9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:58.509944 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb495fa8-7cac-4c1e-9f45-b297ca97f6e9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:58.510397 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb495fa8-7cac-4c1e-9f45-b297ca97f6e9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:58.539283 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cb495fa8-7cac-4c1e-9f45-b297ca97f6e9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments/053b028f-5031-4a76-9139-509107449a37" status: 200 len: 194 microversion: 2.1 time: 0.042730 Jul 31 01:50:58.545082 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3011/6048] 10.222.0.45 () {58 vars in 1413 bytes} [Sun Jul 31 01:50:58 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments/053b028f-5031-4a76-9139-509107449a37 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:50:58.550166 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2e5f8532-938c-434b-b43b-6ec4dcf26fe3 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:58.550686 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2e5f8532-938c-434b-b43b-6ec4dcf26fe3 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:58.556882 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e5f8532-938c-434b-b43b-6ec4dcf26fe3 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:58.557351 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e5f8532-938c-434b-b43b-6ec4dcf26fe3 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:58.558135 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e5f8532-938c-434b-b43b-6ec4dcf26fe3 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:58.558589 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e5f8532-938c-434b-b43b-6ec4dcf26fe3 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:58.639001 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-2e5f8532-938c-434b-b43b-6ec4dcf26fe3 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lazy-loading 'services' on Instance uuid 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:50:58.713905 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2e5f8532-938c-434b-b43b-6ec4dcf26fe3 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "DELETE /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments/053b028f-5031-4a76-9139-509107449a37" status: 202 len: 0 microversion: 2.1 time: 0.167476 Jul 31 01:50:58.715041 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3038/6049] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 01:50:58 2022] DELETE /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments/053b028f-5031-4a76-9139-509107449a37 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:50:59.225583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fcf5bd5b-e3c0-499d-b3a3-77f83f077fa2 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:50:59.226853 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fcf5bd5b-e3c0-499d-b3a3-77f83f077fa2 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:50:59.233962 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcf5bd5b-e3c0-499d-b3a3-77f83f077fa2 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:59.234418 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcf5bd5b-e3c0-499d-b3a3-77f83f077fa2 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:59.235202 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcf5bd5b-e3c0-499d-b3a3-77f83f077fa2 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:50:59.235701 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fcf5bd5b-e3c0-499d-b3a3-77f83f077fa2 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:50:59.337761 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 01:50:59.338272 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 01:50:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 01:50:59.383031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fcf5bd5b-e3c0-499d-b3a3-77f83f077fa2 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:50:59.391505 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fcf5bd5b-e3c0-499d-b3a3-77f83f077fa2 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1695 microversion: 2.1 time: 0.169556 Jul 31 01:50:59.392424 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3012/6050] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:50:59 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:00.413886 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fd026330-286f-4cb0-b087-a855dc1a159e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:00.416048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fd026330-286f-4cb0-b087-a855dc1a159e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:00.424228 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd026330-286f-4cb0-b087-a855dc1a159e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:00.424733 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd026330-286f-4cb0-b087-a855dc1a159e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:00.426047 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd026330-286f-4cb0-b087-a855dc1a159e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:00.426666 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd026330-286f-4cb0-b087-a855dc1a159e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:00.583029 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fd026330-286f-4cb0-b087-a855dc1a159e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:00.591304 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fd026330-286f-4cb0-b087-a855dc1a159e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1695 microversion: 2.1 time: 0.181804 Jul 31 01:51:00.592035 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3039/6051] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:00 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1695 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:01.613266 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95b5a2ca-ed82-4b62-ab20-40f746905b04 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:01.613936 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-95b5a2ca-ed82-4b62-ab20-40f746905b04 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:01.623974 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95b5a2ca-ed82-4b62-ab20-40f746905b04 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:01.624746 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95b5a2ca-ed82-4b62-ab20-40f746905b04 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:01.630201 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95b5a2ca-ed82-4b62-ab20-40f746905b04 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:01.631584 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95b5a2ca-ed82-4b62-ab20-40f746905b04 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:01.894502 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-95b5a2ca-ed82-4b62-ab20-40f746905b04 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:01.912868 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-95b5a2ca-ed82-4b62-ab20-40f746905b04 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1695 microversion: 2.1 time: 0.303477 Jul 31 01:51:01.913468 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3013/6052] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:01 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1695 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:02.281569 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-454c4b4c-8132-4bc1-a3e9-3c9e0c9019c1 req-7d85a377-0652-4344-ad67-97a1a1591290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05df349-4c11-4883-814e-6458443510a7", "name": "network-vif-unplugged", "status": "completed", "tag": "630eb1de-1354-4d3c-9468-f48da959aa77"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:02.294988 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-454c4b4c-8132-4bc1-a3e9-3c9e0c9019c1 req-7d85a377-0652-4344-ad67-97a1a1591290 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:02.295561 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-454c4b4c-8132-4bc1-a3e9-3c9e0c9019c1 req-7d85a377-0652-4344-ad67-97a1a1591290 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:02.310315 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-454c4b4c-8132-4bc1-a3e9-3c9e0c9019c1 req-7d85a377-0652-4344-ad67-97a1a1591290 service nova] Creating event network-vif-unplugged:630eb1de-1354-4d3c-9468-f48da959aa77 for instance c05df349-4c11-4883-814e-6458443510a7 on n-h1-master-1 Jul 31 01:51:02.317582 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-454c4b4c-8132-4bc1-a3e9-3c9e0c9019c1 req-7d85a377-0652-4344-ad67-97a1a1591290 service nova] Instance c05df349-4c11-4883-814e-6458443510a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:51:02.330527 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-454c4b4c-8132-4bc1-a3e9-3c9e0c9019c1 req-7d85a377-0652-4344-ad67-97a1a1591290 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051851 Jul 31 01:51:02.332163 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3040/6053] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:51:02.935503 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dd1f8483-257e-493d-a2f3-4478a1df5bdf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:02.936781 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dd1f8483-257e-493d-a2f3-4478a1df5bdf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:02.964962 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd1f8483-257e-493d-a2f3-4478a1df5bdf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:02.965761 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd1f8483-257e-493d-a2f3-4478a1df5bdf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:02.966936 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd1f8483-257e-493d-a2f3-4478a1df5bdf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:02.968295 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd1f8483-257e-493d-a2f3-4478a1df5bdf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:03.164862 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dd1f8483-257e-493d-a2f3-4478a1df5bdf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:03.174166 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dd1f8483-257e-493d-a2f3-4478a1df5bdf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1694 microversion: 2.1 time: 0.242018 Jul 31 01:51:03.189212 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3014/6054] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:02 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1694 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:04.140001 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4eac6ec3-7a16-4363-aab4-6a8e71a591e2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:04.140597 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4eac6ec3-7a16-4363-aab4-6a8e71a591e2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:04.148333 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4eac6ec3-7a16-4363-aab4-6a8e71a591e2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:04.148798 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4eac6ec3-7a16-4363-aab4-6a8e71a591e2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:04.149578 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4eac6ec3-7a16-4363-aab4-6a8e71a591e2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:04.150057 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4eac6ec3-7a16-4363-aab4-6a8e71a591e2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:04.181718 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4eac6ec3-7a16-4363-aab4-6a8e71a591e2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments/6c8ef734-5c9d-49e5-9eef-652ba136167f" status: 200 len: 194 microversion: 2.1 time: 0.046061 Jul 31 01:51:04.182322 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3041/6055] 10.222.0.45 () {58 vars in 1413 bytes} [Sun Jul 31 01:51:04 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments/6c8ef734-5c9d-49e5-9eef-652ba136167f => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:51:04.192784 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0e487419-ed68-444f-bedf-9f45139f3f5b tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:04.193513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0e487419-ed68-444f-bedf-9f45139f3f5b tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:04.195672 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4cf7d16e-868a-4ac1-80f0-5ee19d5689f9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:04.196300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4cf7d16e-868a-4ac1-80f0-5ee19d5689f9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:04.196543 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=33 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:04.202069 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e487419-ed68-444f-bedf-9f45139f3f5b tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:04.202537 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e487419-ed68-444f-bedf-9f45139f3f5b tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:04.202652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4cf7d16e-868a-4ac1-80f0-5ee19d5689f9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:04.202998 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4cf7d16e-868a-4ac1-80f0-5ee19d5689f9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:04.203496 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e487419-ed68-444f-bedf-9f45139f3f5b tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:04.203810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4cf7d16e-868a-4ac1-80f0-5ee19d5689f9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:04.203931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e487419-ed68-444f-bedf-9f45139f3f5b tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:04.204257 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4cf7d16e-868a-4ac1-80f0-5ee19d5689f9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:04.209788 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:04.295603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-0e487419-ed68-444f-bedf-9f45139f3f5b tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lazy-loading 'services' on Instance uuid 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:51:04.354213 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4cf7d16e-868a-4ac1-80f0-5ee19d5689f9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:04.372886 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0e487419-ed68-444f-bedf-9f45139f3f5b tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "DELETE /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments/6c8ef734-5c9d-49e5-9eef-652ba136167f" status: 202 len: 0 microversion: 2.1 time: 0.183923 Jul 31 01:51:04.373795 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3015/6056] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 01:51:04 2022] DELETE /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments/6c8ef734-5c9d-49e5-9eef-652ba136167f => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:51:04.374632 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4cf7d16e-868a-4ac1-80f0-5ee19d5689f9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1692 microversion: 2.1 time: 0.181992 Jul 31 01:51:04.375761 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3042/6057] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:04 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1692 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:51:04.390062 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-938ce4b6-897d-41de-9f15-a98cdf355ef3 req-82da78ce-ce63-406d-ba8f-61034b5f1357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c05df349-4c11-4883-814e-6458443510a7", "tag": "630eb1de-1354-4d3c-9468-f48da959aa77"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:04.401297 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-938ce4b6-897d-41de-9f15-a98cdf355ef3 req-82da78ce-ce63-406d-ba8f-61034b5f1357 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:04.401744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-938ce4b6-897d-41de-9f15-a98cdf355ef3 req-82da78ce-ce63-406d-ba8f-61034b5f1357 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:04.414246 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-938ce4b6-897d-41de-9f15-a98cdf355ef3 req-82da78ce-ce63-406d-ba8f-61034b5f1357 service nova] Creating event network-changed:630eb1de-1354-4d3c-9468-f48da959aa77 for instance c05df349-4c11-4883-814e-6458443510a7 on n-h1-master-1 Jul 31 01:51:04.420679 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-938ce4b6-897d-41de-9f15-a98cdf355ef3 req-82da78ce-ce63-406d-ba8f-61034b5f1357 service nova] Instance c05df349-4c11-4883-814e-6458443510a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:51:04.431713 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-938ce4b6-897d-41de-9f15-a98cdf355ef3 req-82da78ce-ce63-406d-ba8f-61034b5f1357 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056244 Jul 31 01:51:04.432422 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3016/6058] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:51:05.397069 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9e38fffb-2f21-4595-9405-e1798d4c091b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:05.397649 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9e38fffb-2f21-4595-9405-e1798d4c091b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:05.404680 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e38fffb-2f21-4595-9405-e1798d4c091b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:05.405131 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e38fffb-2f21-4595-9405-e1798d4c091b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:05.406030 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e38fffb-2f21-4595-9405-e1798d4c091b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:05.406486 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e38fffb-2f21-4595-9405-e1798d4c091b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:05.573405 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9e38fffb-2f21-4595-9405-e1798d4c091b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:05.581425 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9e38fffb-2f21-4595-9405-e1798d4c091b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1689 microversion: 2.1 time: 0.189105 Jul 31 01:51:05.582003 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3043/6059] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:05 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1689 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:05.602366 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-10ab8dac-e3c9-40d2-95fe-b2008b542a1b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:05.603618 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-10ab8dac-e3c9-40d2-95fe-b2008b542a1b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:05.611656 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10ab8dac-e3c9-40d2-95fe-b2008b542a1b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:05.612324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10ab8dac-e3c9-40d2-95fe-b2008b542a1b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:05.613279 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10ab8dac-e3c9-40d2-95fe-b2008b542a1b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:05.613886 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10ab8dac-e3c9-40d2-95fe-b2008b542a1b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:05.730845 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-10ab8dac-e3c9-40d2-95fe-b2008b542a1b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7/action" status: 202 len: 0 microversion: 2.1 time: 0.132225 Jul 31 01:51:05.731682 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3017/6060] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:51:05 2022] POST /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:51:05.744739 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f7cfb3e4-d484-4418-b38a-c91a4c1c8c24 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:05.745555 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f7cfb3e4-d484-4418-b38a-c91a4c1c8c24 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:05.752977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7cfb3e4-d484-4418-b38a-c91a4c1c8c24 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:05.753793 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7cfb3e4-d484-4418-b38a-c91a4c1c8c24 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:05.754835 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7cfb3e4-d484-4418-b38a-c91a4c1c8c24 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:05.755403 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7cfb3e4-d484-4418-b38a-c91a4c1c8c24 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:05.780788 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:05.930281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f7cfb3e4-d484-4418-b38a-c91a4c1c8c24 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:05.940151 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f7cfb3e4-d484-4418-b38a-c91a4c1c8c24 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1688 microversion: 2.1 time: 0.201334 Jul 31 01:51:05.941108 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3044/6061] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:05 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1688 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:06.963286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9fc466a4-b549-474f-9b9d-1c1124db081c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:06.963959 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9fc466a4-b549-474f-9b9d-1c1124db081c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:06.971378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9fc466a4-b549-474f-9b9d-1c1124db081c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:06.971987 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9fc466a4-b549-474f-9b9d-1c1124db081c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:06.972914 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9fc466a4-b549-474f-9b9d-1c1124db081c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:06.973513 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9fc466a4-b549-474f-9b9d-1c1124db081c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:07.115947 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9fc466a4-b549-474f-9b9d-1c1124db081c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:07.143044 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9fc466a4-b549-474f-9b9d-1c1124db081c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1688 microversion: 2.1 time: 0.184934 Jul 31 01:51:07.144572 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3018/6062] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:06 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:08.164930 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f7159ec7-648b-4556-86ee-0639b4ef0df3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:08.165651 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f7159ec7-648b-4556-86ee-0639b4ef0df3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:08.172946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7159ec7-648b-4556-86ee-0639b4ef0df3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:08.173411 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7159ec7-648b-4556-86ee-0639b4ef0df3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:08.174253 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7159ec7-648b-4556-86ee-0639b4ef0df3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:08.174752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7159ec7-648b-4556-86ee-0639b4ef0df3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:08.337657 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f7159ec7-648b-4556-86ee-0639b4ef0df3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:08.347365 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f7159ec7-648b-4556-86ee-0639b4ef0df3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1688 microversion: 2.1 time: 0.186193 Jul 31 01:51:08.348738 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3045/6063] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:08 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:09.369336 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-32091a57-8235-4508-9f12-0e56acd24de1 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:09.369976 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-32091a57-8235-4508-9f12-0e56acd24de1 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:09.384629 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-32091a57-8235-4508-9f12-0e56acd24de1 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:09.385087 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-32091a57-8235-4508-9f12-0e56acd24de1 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:09.386997 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-32091a57-8235-4508-9f12-0e56acd24de1 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:09.387479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-32091a57-8235-4508-9f12-0e56acd24de1 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:09.611132 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-32091a57-8235-4508-9f12-0e56acd24de1 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:09.620031 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-32091a57-8235-4508-9f12-0e56acd24de1 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1688 microversion: 2.1 time: 0.254718 Jul 31 01:51:09.620831 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3019/6064] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:09 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1688 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:09.960124 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d8886ac2-49d5-4ebe-9bb8-c957384a9473 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:09.963070 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d8886ac2-49d5-4ebe-9bb8-c957384a9473 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:09.970810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8886ac2-49d5-4ebe-9bb8-c957384a9473 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:09.971288 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8886ac2-49d5-4ebe-9bb8-c957384a9473 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:09.972117 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8886ac2-49d5-4ebe-9bb8-c957384a9473 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:09.972753 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8886ac2-49d5-4ebe-9bb8-c957384a9473 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:09.999251 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-b6aaa6c3-3c92-4657-9e66-6d09f8b3318a req-8bdd6691-74eb-4e3e-a053-ed498ca9c845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c05df349-4c11-4883-814e-6458443510a7", "tag": "630eb1de-1354-4d3c-9468-f48da959aa77"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:10.012098 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b6aaa6c3-3c92-4657-9e66-6d09f8b3318a req-8bdd6691-74eb-4e3e-a053-ed498ca9c845 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:10.013622 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b6aaa6c3-3c92-4657-9e66-6d09f8b3318a req-8bdd6691-74eb-4e3e-a053-ed498ca9c845 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:10.021487 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d8886ac2-49d5-4ebe-9bb8-c957384a9473 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065365 Jul 31 01:51:10.032452 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-b6aaa6c3-3c92-4657-9e66-6d09f8b3318a req-8bdd6691-74eb-4e3e-a053-ed498ca9c845 service nova] Creating event network-changed:630eb1de-1354-4d3c-9468-f48da959aa77 for instance c05df349-4c11-4883-814e-6458443510a7 on n-h2-master-1 Jul 31 01:51:10.036113 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3046/6065] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:51:09 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:51:10.040866 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-b6aaa6c3-3c92-4657-9e66-6d09f8b3318a req-8bdd6691-74eb-4e3e-a053-ed498ca9c845 service nova] Instance c05df349-4c11-4883-814e-6458443510a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:51:10.054562 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-b6aaa6c3-3c92-4657-9e66-6d09f8b3318a req-8bdd6691-74eb-4e3e-a053-ed498ca9c845 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058954 Jul 31 01:51:10.055866 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3020/6066] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:51:10.156600 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-32a8d334-754b-4b88-8b25-6ccf81da21e1 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:10.159570 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-32a8d334-754b-4b88-8b25-6ccf81da21e1 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:10.165933 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-32a8d334-754b-4b88-8b25-6ccf81da21e1 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:10.166401 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-32a8d334-754b-4b88-8b25-6ccf81da21e1 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:10.167189 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-32a8d334-754b-4b88-8b25-6ccf81da21e1 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:10.167839 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-32a8d334-754b-4b88-8b25-6ccf81da21e1 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:10.202558 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-32a8d334-754b-4b88-8b25-6ccf81da21e1 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049881 Jul 31 01:51:10.212009 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3047/6067] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:51:10 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:51:10.284662 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fa92e7c4-08c5-4924-87b0-cb1f204b7ab2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:10.285277 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fa92e7c4-08c5-4924-87b0-cb1f204b7ab2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:10.301752 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa92e7c4-08c5-4924-87b0-cb1f204b7ab2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:10.302470 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa92e7c4-08c5-4924-87b0-cb1f204b7ab2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:10.303472 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa92e7c4-08c5-4924-87b0-cb1f204b7ab2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:10.304094 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa92e7c4-08c5-4924-87b0-cb1f204b7ab2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:10.332312 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fa92e7c4-08c5-4924-87b0-cb1f204b7ab2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:51:10.442111 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fa92e7c4-08c5-4924-87b0-cb1f204b7ab2 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "DELETE /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 204 len: 0 microversion: 2.1 time: 0.171723 Jul 31 01:51:10.449091 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3021/6068] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:51:10 2022] DELETE /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:51:10.460298 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-824e72d5-cf62-4d55-a247-632c49fab331 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:10.460943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-824e72d5-cf62-4d55-a247-632c49fab331 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:10.478866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-824e72d5-cf62-4d55-a247-632c49fab331 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:10.479603 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-824e72d5-cf62-4d55-a247-632c49fab331 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:10.480576 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-824e72d5-cf62-4d55-a247-632c49fab331 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:10.481029 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-824e72d5-cf62-4d55-a247-632c49fab331 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:10.644316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5dec3279-f2f7-4478-9b74-31c503fd8675 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:10.645356 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5dec3279-f2f7-4478-9b74-31c503fd8675 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:10.652746 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5dec3279-f2f7-4478-9b74-31c503fd8675 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:10.653482 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5dec3279-f2f7-4478-9b74-31c503fd8675 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:10.654607 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5dec3279-f2f7-4478-9b74-31c503fd8675 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:10.655224 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5dec3279-f2f7-4478-9b74-31c503fd8675 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:10.990142 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-824e72d5-cf62-4d55-a247-632c49fab331 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:10.998898 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-824e72d5-cf62-4d55-a247-632c49fab331 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 200 len: 1673 microversion: 2.1 time: 0.544700 Jul 31 01:51:11.000082 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3048/6069] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:10 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 1673 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:51:11.051763 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5dec3279-f2f7-4478-9b74-31c503fd8675 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:11.059201 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5dec3279-f2f7-4478-9b74-31c503fd8675 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1688 microversion: 2.1 time: 0.420811 Jul 31 01:51:11.059801 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3022/6070] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:10 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1688 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:51:12.020424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-773e376d-3599-4330-8963-21aa38e20c01 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:12.021048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-773e376d-3599-4330-8963-21aa38e20c01 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:12.028140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-773e376d-3599-4330-8963-21aa38e20c01 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:12.028504 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-773e376d-3599-4330-8963-21aa38e20c01 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:12.029282 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-773e376d-3599-4330-8963-21aa38e20c01 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:12.029723 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-773e376d-3599-4330-8963-21aa38e20c01 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:12.080897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bc09e063-4303-4489-9778-80104020c7be tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:12.081527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bc09e063-4303-4489-9778-80104020c7be tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:12.088939 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc09e063-4303-4489-9778-80104020c7be tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:12.089560 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc09e063-4303-4489-9778-80104020c7be tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:12.090359 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc09e063-4303-4489-9778-80104020c7be tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:12.090851 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bc09e063-4303-4489-9778-80104020c7be tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:12.294301 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-773e376d-3599-4330-8963-21aa38e20c01 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:12.303271 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-773e376d-3599-4330-8963-21aa38e20c01 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 200 len: 1673 microversion: 2.1 time: 0.286743 Jul 31 01:51:12.304202 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3049/6071] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:12 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 1673 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:12.320138 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bc09e063-4303-4489-9778-80104020c7be tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:12.327733 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bc09e063-4303-4489-9778-80104020c7be tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1688 microversion: 2.1 time: 0.251012 Jul 31 01:51:12.328300 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3023/6072] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:12 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1688 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:51:13.333548 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9e670416-44c8-4a59-89e0-d1a93c6f2162 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:13.334226 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9e670416-44c8-4a59-89e0-d1a93c6f2162 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:13.341664 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e670416-44c8-4a59-89e0-d1a93c6f2162 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:13.342375 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e670416-44c8-4a59-89e0-d1a93c6f2162 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:13.343368 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e670416-44c8-4a59-89e0-d1a93c6f2162 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:13.344033 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e670416-44c8-4a59-89e0-d1a93c6f2162 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:13.351003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-187f2014-6e76-44c6-9767-a4e056b172ae tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:13.352559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-187f2014-6e76-44c6-9767-a4e056b172ae tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:13.371228 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-187f2014-6e76-44c6-9767-a4e056b172ae tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:13.372534 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-187f2014-6e76-44c6-9767-a4e056b172ae tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:13.374005 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-187f2014-6e76-44c6-9767-a4e056b172ae tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:13.374706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-187f2014-6e76-44c6-9767-a4e056b172ae tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:13.676639 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9e670416-44c8-4a59-89e0-d1a93c6f2162 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:13.703006 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9e670416-44c8-4a59-89e0-d1a93c6f2162 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 200 len: 1673 microversion: 2.1 time: 0.381992 Jul 31 01:51:13.707450 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3050/6073] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:13 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 1673 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:13.711014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-187f2014-6e76-44c6-9767-a4e056b172ae tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:13.723026 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-187f2014-6e76-44c6-9767-a4e056b172ae tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1688 microversion: 2.1 time: 0.376432 Jul 31 01:51:13.736411 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3024/6074] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:13 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1688 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:14.338860 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-a2644274-9f06-4a06-a6b5-c0e3d750f6e7 req-d76fe81b-ed64-4b62-a9a6-f6ca06ba8237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780", "name": "network-vif-deleted", "tag": "4a0edfcd-d380-4110-8ff6-26f859fbf9f1"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:14.350665 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a2644274-9f06-4a06-a6b5-c0e3d750f6e7 req-d76fe81b-ed64-4b62-a9a6-f6ca06ba8237 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:14.351127 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-a2644274-9f06-4a06-a6b5-c0e3d750f6e7 req-d76fe81b-ed64-4b62-a9a6-f6ca06ba8237 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:14.369428 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-a2644274-9f06-4a06-a6b5-c0e3d750f6e7 req-d76fe81b-ed64-4b62-a9a6-f6ca06ba8237 service nova] Creating event network-vif-deleted:4a0edfcd-d380-4110-8ff6-26f859fbf9f1 for instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 on n-h2-master-1 Jul 31 01:51:14.376536 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-a2644274-9f06-4a06-a6b5-c0e3d750f6e7 req-d76fe81b-ed64-4b62-a9a6-f6ca06ba8237 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041327 Jul 31 01:51:14.381063 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3051/6075] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:51:14.745926 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-806624e3-57bb-458b-92b3-3e56fb327e4a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:14.746725 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-806624e3-57bb-458b-92b3-3e56fb327e4a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:14.753621 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-806624e3-57bb-458b-92b3-3e56fb327e4a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:14.754353 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-806624e3-57bb-458b-92b3-3e56fb327e4a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:14.755726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-806624e3-57bb-458b-92b3-3e56fb327e4a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:14.756713 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-806624e3-57bb-458b-92b3-3e56fb327e4a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:14.867561 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3b94c9b5-5cc1-437d-9094-0866e4fa59ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:14.868832 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3b94c9b5-5cc1-437d-9094-0866e4fa59ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:14.892842 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b94c9b5-5cc1-437d-9094-0866e4fa59ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:14.893315 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b94c9b5-5cc1-437d-9094-0866e4fa59ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:14.894120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b94c9b5-5cc1-437d-9094-0866e4fa59ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:14.904141 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b94c9b5-5cc1-437d-9094-0866e4fa59ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:14.959501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-806624e3-57bb-458b-92b3-3e56fb327e4a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:14.969569 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-806624e3-57bb-458b-92b3-3e56fb327e4a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1681 microversion: 2.1 time: 0.228215 Jul 31 01:51:14.974695 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b94c9b5-5cc1-437d-9094-0866e4fa59ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:14.975171 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b94c9b5-5cc1-437d-9094-0866e4fa59ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:14.975681 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-3b94c9b5-5cc1-437d-9094-0866e4fa59ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lazy-loading 'fault' on Instance uuid 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:51:14.981911 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3052/6076] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:14 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1681 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:51:15.062732 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b94c9b5-5cc1-437d-9094-0866e4fa59ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eab8ae242c14402b965ffcc92961b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4d167cb1684552a635536adebfbc86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:15.074309 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3b94c9b5-5cc1-437d-9094-0866e4fa59ac tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 200 len: 1327 microversion: 2.1 time: 0.350867 Jul 31 01:51:15.079796 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3025/6077] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:14 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 1327 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:16.097186 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b5116b2f-f80c-4e3a-82e2-e9f0c6cc9d98 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:16.097929 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b5116b2f-f80c-4e3a-82e2-e9f0c6cc9d98 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:16.101177 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=49 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:16.107629 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5116b2f-f80c-4e3a-82e2-e9f0c6cc9d98 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:16.108147 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5116b2f-f80c-4e3a-82e2-e9f0c6cc9d98 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:16.108951 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5116b2f-f80c-4e3a-82e2-e9f0c6cc9d98 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:16.109409 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b5116b2f-f80c-4e3a-82e2-e9f0c6cc9d98 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:16.124693 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-b5116b2f-f80c-4e3a-82e2-e9f0c6cc9d98 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] HTTP exception thrown: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b5116b2f-f80c-4e3a-82e2-e9f0c6cc9d98 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Request method failure captured: Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 HTTP/1.1 Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5d7mM18Voc6Sh2zYDH1Iu1VltwzQ7j3Tn6xiIzhn-bxtVJ_Z8BbBRtoR3OpMce1o0-WJZt0m2O0I7f8rM-3VCzHwzOQI-Ql5GGP_ybQGGlb-kgnr-d_k4GP5behCBU648xjWckcNrKCOj2RaFEjS47dpb3ftcBpFiELkAyZOGV46oQQ Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: ab4d167cb1684552a635536adebfbc86 Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ab4d167cb1684552a635536adebfbc86", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: ab4d167cb1684552a635536adebfbc86 Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AttachVolumeTestJSON-889266397-project Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 7eab8ae242c14402b965ffcc92961b2f Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AttachVolumeTestJSON-889266397-project Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780'} Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:51:16.127074 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:16.131656 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:16.131656 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:51:16.131656 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:51:16.131656 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:51:16.131656 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:51:16.131656 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. Jul 31 01:51:16.131656 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:16.131656 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b5116b2f-f80c-4e3a-82e2-e9f0c6cc9d98 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Returning 404 to user: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:51:16.131656 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b5116b2f-f80c-4e3a-82e2-e9f0c6cc9d98 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 404 len: 111 microversion: 2.1 time: 0.035633 Jul 31 01:51:16.131656 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3053/6078] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:16 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:51:16.137682 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-162ef6c5-3b82-43c4-b1d9-ab75face338f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '.version_select at 0x7fede455b940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:16.159585 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-162ef6c5-3b82-43c4-b1d9-ab75face338f tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620807244" status: 202 len: 0 microversion: 2.1 time: 0.025584 Jul 31 01:51:16.160454 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3026/6079] 10.222.0.45 () {58 vars in 1221 bytes} [Sun Jul 31 01:51:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620807244 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:51:17.719628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-6c395a54-7a26-4f86-af4b-5560cf0c7798 req-f49751fc-ddfd-47f9-8781-e60bf80f33dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05df349-4c11-4883-814e-6458443510a7", "name": "network-vif-plugged", "status": "completed", "tag": "630eb1de-1354-4d3c-9468-f48da959aa77"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:17.732047 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6c395a54-7a26-4f86-af4b-5560cf0c7798 req-f49751fc-ddfd-47f9-8781-e60bf80f33dc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:17.732703 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6c395a54-7a26-4f86-af4b-5560cf0c7798 req-f49751fc-ddfd-47f9-8781-e60bf80f33dc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:17.744415 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-6c395a54-7a26-4f86-af4b-5560cf0c7798 req-f49751fc-ddfd-47f9-8781-e60bf80f33dc service nova] Creating event network-vif-plugged:630eb1de-1354-4d3c-9468-f48da959aa77 for instance c05df349-4c11-4883-814e-6458443510a7 on n-h2-master-1 Jul 31 01:51:17.749732 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-6c395a54-7a26-4f86-af4b-5560cf0c7798 req-f49751fc-ddfd-47f9-8781-e60bf80f33dc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035503 Jul 31 01:51:17.750891 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3054/6080] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:51:24.400495 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6a22ebac-44e6-40ba-9a53-a4aec0a0ebb8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:24.401002 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6a22ebac-44e6-40ba-9a53-a4aec0a0ebb8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:24.408834 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a22ebac-44e6-40ba-9a53-a4aec0a0ebb8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:24.409307 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a22ebac-44e6-40ba-9a53-a4aec0a0ebb8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:24.410099 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a22ebac-44e6-40ba-9a53-a4aec0a0ebb8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:24.410589 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a22ebac-44e6-40ba-9a53-a4aec0a0ebb8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:24.424286 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-6a22ebac-44e6-40ba-9a53-a4aec0a0ebb8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] HTTP exception thrown: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6a22ebac-44e6-40ba-9a53-a4aec0a0ebb8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Request method failure captured: Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 HTTP/1.1 Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5d7mM18Voc6Sh2zYDH1Iu1VltwzQ7j3Tn6xiIzhn-bxtVJ_Z8BbBRtoR3OpMce1o0-WJZt0m2O0I7f8rM-3VCzHwzOQI-Ql5GGP_ybQGGlb-kgnr-d_k4GP5behCBU648xjWckcNrKCOj2RaFEjS47dpb3ftcBpFiELkAyZOGV46oQQ Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: ab4d167cb1684552a635536adebfbc86 Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ab4d167cb1684552a635536adebfbc86", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: ab4d167cb1684552a635536adebfbc86 Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AttachVolumeTestJSON-889266397-project Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 7eab8ae242c14402b965ffcc92961b2f Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AttachVolumeTestJSON-889266397-project Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780'} Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:51:24.425981 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:51:24.430929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. Jul 31 01:51:24.430929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:51:24.430929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:51:24.430929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:51:24.430929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:24.430929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:51:24.430929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:51:24.430929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:51:24.430929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:51:24.430929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. Jul 31 01:51:24.430929 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:51:24.430929 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6a22ebac-44e6-40ba-9a53-a4aec0a0ebb8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Returning 404 to user: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:51:24.430929 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6a22ebac-44e6-40ba-9a53-a4aec0a0ebb8 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "DELETE /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 404 len: 111 microversion: 2.1 time: 0.032189 Jul 31 01:51:24.430929 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3027/6081] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:51:24 2022] DELETE /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:51:24.436402 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-40fa3106-898e-470e-a4dc-42cdeeb68d3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:24.437119 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-40fa3106-898e-470e-a4dc-42cdeeb68d3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:24.444213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40fa3106-898e-470e-a4dc-42cdeeb68d3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:24.444681 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40fa3106-898e-470e-a4dc-42cdeeb68d3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:24.445448 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40fa3106-898e-470e-a4dc-42cdeeb68d3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:24.445893 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40fa3106-898e-470e-a4dc-42cdeeb68d3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:24.460446 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-40fa3106-898e-470e-a4dc-42cdeeb68d3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] HTTP exception thrown: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-40fa3106-898e-470e-a4dc-42cdeeb68d3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Request method failure captured: Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 HTTP/1.1 Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5d7mM18Voc6Sh2zYDH1Iu1VltwzQ7j3Tn6xiIzhn-bxtVJ_Z8BbBRtoR3OpMce1o0-WJZt0m2O0I7f8rM-3VCzHwzOQI-Ql5GGP_ybQGGlb-kgnr-d_k4GP5behCBU648xjWckcNrKCOj2RaFEjS47dpb3ftcBpFiELkAyZOGV46oQQ Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: ab4d167cb1684552a635536adebfbc86 Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ab4d167cb1684552a635536adebfbc86", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: ab4d167cb1684552a635536adebfbc86 Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AttachVolumeTestJSON-889266397-project Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 7eab8ae242c14402b965ffcc92961b2f Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AttachVolumeTestJSON-889266397-project Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780'} Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:51:24.462175 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:24.466694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:24.466694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:51:24.466694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:51:24.466694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:51:24.466694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:51:24.466694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. Jul 31 01:51:24.466694 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:24.466694 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-40fa3106-898e-470e-a4dc-42cdeeb68d3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Returning 404 to user: Instance 675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:51:24.466694 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-40fa3106-898e-470e-a4dc-42cdeeb68d3a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780" status: 404 len: 111 microversion: 2.1 time: 0.031405 Jul 31 01:51:24.466694 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3055/6082] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:24 2022] GET /compute/v2.1/servers/675ddf6d-ba8e-49d2-ac34-f6ba7b2cd780 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:51:29.856755 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-027523ac-8bb3-4716-8825-422b898cffb9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:29.857551 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-027523ac-8bb3-4716-8825-422b898cffb9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:29.865034 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-027523ac-8bb3-4716-8825-422b898cffb9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:29.865858 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-027523ac-8bb3-4716-8825-422b898cffb9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:29.867022 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-027523ac-8bb3-4716-8825-422b898cffb9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:29.867745 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-027523ac-8bb3-4716-8825-422b898cffb9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:29.887546 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-027523ac-8bb3-4716-8825-422b898cffb9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] HTTP exception thrown: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-027523ac-8bb3-4716-8825-422b898cffb9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Request method failure captured: Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e HTTP/1.1 Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5d7mM18Voc6Sh2zYDH1Iu1VltwzQ7j3Tn6xiIzhn-bxtVJ_Z8BbBRtoR3OpMce1o0-WJZt0m2O0I7f8rM-3VCzHwzOQI-Ql5GGP_ybQGGlb-kgnr-d_k4GP5behCBU648xjWckcNrKCOj2RaFEjS47dpb3ftcBpFiELkAyZOGV46oQQ Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: ab4d167cb1684552a635536adebfbc86 Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ab4d167cb1684552a635536adebfbc86", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: ab4d167cb1684552a635536adebfbc86 Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AttachVolumeTestJSON-889266397-project Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 7eab8ae242c14402b965ffcc92961b2f Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AttachVolumeTestJSON-889266397-project Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: exception: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'b8488f02-8f89-4fb7-8e4f-30414f9ad09e'} Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:51:29.889333 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:51:29.894228 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. Jul 31 01:51:29.894228 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:51:29.894228 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:51:29.894228 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:51:29.894228 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:29.894228 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:51:29.894228 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:51:29.894228 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:51:29.894228 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:51:29.894228 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. Jul 31 01:51:29.894228 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:51:29.894999 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-027523ac-8bb3-4716-8825-422b898cffb9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Returning 404 to user: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:51:29.896064 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-027523ac-8bb3-4716-8825-422b898cffb9 tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 404 len: 111 microversion: 2.1 time: 0.043444 Jul 31 01:51:29.896818 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3028/6083] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:51:29 2022] DELETE /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:51:29.904796 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c3e57d75-6f74-45c5-88ed-b7d99d87261a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:29.905558 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c3e57d75-6f74-45c5-88ed-b7d99d87261a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] [instance: b8488f02-8f89-4fb7-8e4f-30414f9ad09e] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:29.913635 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3e57d75-6f74-45c5-88ed-b7d99d87261a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:29.914217 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3e57d75-6f74-45c5-88ed-b7d99d87261a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:29.915292 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3e57d75-6f74-45c5-88ed-b7d99d87261a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:29.915980 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3e57d75-6f74-45c5-88ed-b7d99d87261a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:29.931966 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-c3e57d75-6f74-45c5-88ed-b7d99d87261a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] HTTP exception thrown: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c3e57d75-6f74-45c5-88ed-b7d99d87261a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Request method failure captured: Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e HTTP/1.1 Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5d7mM18Voc6Sh2zYDH1Iu1VltwzQ7j3Tn6xiIzhn-bxtVJ_Z8BbBRtoR3OpMce1o0-WJZt0m2O0I7f8rM-3VCzHwzOQI-Ql5GGP_ybQGGlb-kgnr-d_k4GP5behCBU648xjWckcNrKCOj2RaFEjS47dpb3ftcBpFiELkAyZOGV46oQQ Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: ab4d167cb1684552a635536adebfbc86 Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ab4d167cb1684552a635536adebfbc86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ab4d167cb1684552a635536adebfbc86", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: ab4d167cb1684552a635536adebfbc86 Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AttachVolumeTestJSON-889266397 Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AttachVolumeTestJSON-889266397-project Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 7eab8ae242c14402b965ffcc92961b2f Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AttachVolumeTestJSON-889266397-project Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: exception: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'b8488f02-8f89-4fb7-8e4f-30414f9ad09e'} Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:51:29.933876 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:29.939301 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:29.939301 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:51:29.939301 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:51:29.939301 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:51:29.939301 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:51:29.939301 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. Jul 31 01:51:29.939301 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:29.939301 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c3e57d75-6f74-45c5-88ed-b7d99d87261a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] Returning 404 to user: Instance b8488f02-8f89-4fb7-8e4f-30414f9ad09e could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:51:29.939301 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c3e57d75-6f74-45c5-88ed-b7d99d87261a tempest-AttachVolumeTestJSON-889266397 tempest-AttachVolumeTestJSON-889266397-project] 10.222.0.45 "GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e" status: 404 len: 111 microversion: 2.1 time: 0.034420 Jul 31 01:51:29.940380 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3056/6084] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:29 2022] GET /compute/v2.1/servers/b8488f02-8f89-4fb7-8e4f-30414f9ad09e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:51:39.211969 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ecbc7c8a-4ddd-48bb-836c-ac2ae0826cfb tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:39.220304 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ecbc7c8a-4ddd-48bb-836c-ac2ae0826cfb tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:39.239424 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:39.242529 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecbc7c8a-4ddd-48bb-836c-ac2ae0826cfb tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:39.243632 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecbc7c8a-4ddd-48bb-836c-ac2ae0826cfb tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:39.245324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecbc7c8a-4ddd-48bb-836c-ac2ae0826cfb tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:39.246204 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecbc7c8a-4ddd-48bb-836c-ac2ae0826cfb tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:39.293341 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:39.351116 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ecbc7c8a-4ddd-48bb-836c-ac2ae0826cfb tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7/action" status: 200 len: 63010 microversion: 2.1 time: 0.144987 Jul 31 01:51:39.351851 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3029/6085] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:51:39 2022] POST /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7/action => generated 63010 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:51:39.912451 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=7 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:39.929142 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=56 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:51:40.060184 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d652a38f-a32f-4053-97d1-4e3dc39f7a54 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Action: 'create', calling method: .version_select at 0x7fede52db670>, body: {"keypair": {"name": "tempest-keypair-196827809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsWZsnIRGoBx0r/hT7E1lB6rsohA30E1qD4sLg/hd0gLJ2JPn30dPQ0MtXnK+3V23RJaFSqTWnVy+AzVl0uUzrYqnsOl1t+CQTWqkgTrpzIC2cO1XXyfHNqfoJ/hX6DUw=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:40.078763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-d652a38f-a32f-4053-97d1-4e3dc39f7a54 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Getting quotas for project 29818dc3fb6e4de198be5662dc764989. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:51:40.084557 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-d652a38f-a32f-4053-97d1-4e3dc39f7a54 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Getting quotas for user 145ff42ae8134ad697f09fd339933bb9 and project 29818dc3fb6e4de198be5662dc764989. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:51:40.126365 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d652a38f-a32f-4053-97d1-4e3dc39f7a54 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.258746 Jul 31 01:51:40.127263 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3057/6086] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:51:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:51:41.681374 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0d7400d7-1b5c-4223-91da-8ff02eca4534 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-287751465", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c763115-7f67-4122-8316-1251598f7da5"}], "security_groups": [{"name": "tempest-securitygroup--536188623"}], "key_name": "tempest-keypair-196827809", "user_data": "}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:41.957555 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-0d7400d7-1b5c-4223-91da-8ff02eca4534 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] validate_networks() for [('3c763115-7f67-4122-8316-1251598f7da5', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:51:42.407386 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0d7400d7-1b5c-4223-91da-8ff02eca4534 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:51:42.408026 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0d7400d7-1b5c-4223-91da-8ff02eca4534 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:51:42.408697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0d7400d7-1b5c-4223-91da-8ff02eca4534 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:51:42.409297 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0d7400d7-1b5c-4223-91da-8ff02eca4534 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:51:42.409897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0d7400d7-1b5c-4223-91da-8ff02eca4534 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:51:42.419913 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d7400d7-1b5c-4223-91da-8ff02eca4534 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:42.420623 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d7400d7-1b5c-4223-91da-8ff02eca4534 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:42.422686 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d7400d7-1b5c-4223-91da-8ff02eca4534 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:42.423306 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0d7400d7-1b5c-4223-91da-8ff02eca4534 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:42.447783 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-0d7400d7-1b5c-4223-91da-8ff02eca4534 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Getting quotas for project 29818dc3fb6e4de198be5662dc764989. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:51:42.463876 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-0d7400d7-1b5c-4223-91da-8ff02eca4534 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Getting quotas for user 145ff42ae8134ad697f09fd339933bb9 and project 29818dc3fb6e4de198be5662dc764989. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:51:42.478650 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0d7400d7-1b5c-4223-91da-8ff02eca4534 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:51:42.481177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0d7400d7-1b5c-4223-91da-8ff02eca4534 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:51:42.539787 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0d7400d7-1b5c-4223-91da-8ff02eca4534 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.862952 Jul 31 01:51:42.547126 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3030/6087] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:51:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 01:51:42.573956 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-996b64ee-0516-48f3-82f8-799b2016c8c9 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:42.574986 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-996b64ee-0516-48f3-82f8-799b2016c8c9 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:42.722634 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-996b64ee-0516-48f3-82f8-799b2016c8c9 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:42.736070 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-996b64ee-0516-48f3-82f8-799b2016c8c9 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d" status: 200 len: 1240 microversion: 2.1 time: 0.185297 Jul 31 01:51:42.738111 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3058/6088] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:42 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d => generated 1240 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:43.759312 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a1bc3cdf-05df-45d1-bb5e-3b41c0dd91d9 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:43.760136 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a1bc3cdf-05df-45d1-bb5e-3b41c0dd91d9 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:43.774140 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1bc3cdf-05df-45d1-bb5e-3b41c0dd91d9 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:43.774727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1bc3cdf-05df-45d1-bb5e-3b41c0dd91d9 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:43.775727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1bc3cdf-05df-45d1-bb5e-3b41c0dd91d9 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:43.776191 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a1bc3cdf-05df-45d1-bb5e-3b41c0dd91d9 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:43.865290 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a1bc3cdf-05df-45d1-bb5e-3b41c0dd91d9 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:43.877346 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a1bc3cdf-05df-45d1-bb5e-3b41c0dd91d9 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d" status: 200 len: 1292 microversion: 2.1 time: 0.122735 Jul 31 01:51:43.878763 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3031/6089] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:43 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d => generated 1292 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:44.898081 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cf7c13b8-c901-4553-9a1f-b2be1a9300e2 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:44.898736 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cf7c13b8-c901-4553-9a1f-b2be1a9300e2 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:44.909231 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf7c13b8-c901-4553-9a1f-b2be1a9300e2 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:44.910219 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf7c13b8-c901-4553-9a1f-b2be1a9300e2 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:44.911134 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf7c13b8-c901-4553-9a1f-b2be1a9300e2 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:44.911756 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf7c13b8-c901-4553-9a1f-b2be1a9300e2 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:45.090036 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cf7c13b8-c901-4553-9a1f-b2be1a9300e2 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:45.098643 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cf7c13b8-c901-4553-9a1f-b2be1a9300e2 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d" status: 200 len: 1365 microversion: 2.1 time: 0.204341 Jul 31 01:51:45.112934 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3059/6090] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:44 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:45.502766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-8ec19e4e-dda5-496f-8c79-e06f2ba8c225 req-64ba9bdd-d201-493e-a413-40f7f9f068f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1353bba5-65a1-4282-8c94-49e748b2b16d", "tag": "5857dbc8-0d83-4d68-9212-08fef174f2d0"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:45.545131 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8ec19e4e-dda5-496f-8c79-e06f2ba8c225 req-64ba9bdd-d201-493e-a413-40f7f9f068f9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:45.545656 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-8ec19e4e-dda5-496f-8c79-e06f2ba8c225 req-64ba9bdd-d201-493e-a413-40f7f9f068f9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:45.558424 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-8ec19e4e-dda5-496f-8c79-e06f2ba8c225 req-64ba9bdd-d201-493e-a413-40f7f9f068f9 service nova] Creating event network-changed:5857dbc8-0d83-4d68-9212-08fef174f2d0 for instance 1353bba5-65a1-4282-8c94-49e748b2b16d on n-h1-master-1 Jul 31 01:51:45.568450 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-8ec19e4e-dda5-496f-8c79-e06f2ba8c225 req-64ba9bdd-d201-493e-a413-40f7f9f068f9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084079 Jul 31 01:51:45.569458 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3032/6091] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:51:45.860926 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3b82478-f757-4868-b6b3-a311e2764dc7 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:45.862112 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3b82478-f757-4868-b6b3-a311e2764dc7 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:45.869703 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3b82478-f757-4868-b6b3-a311e2764dc7 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:45.870488 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3b82478-f757-4868-b6b3-a311e2764dc7 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:45.871555 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3b82478-f757-4868-b6b3-a311e2764dc7 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:45.872242 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3b82478-f757-4868-b6b3-a311e2764dc7 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:46.042914 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3b82478-f757-4868-b6b3-a311e2764dc7 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1832 microversion: 2.1 time: 0.187092 Jul 31 01:51:46.055781 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3060/6092] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:45 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1832 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:46.120788 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9948f93d-a228-4920-a8bc-886ea16343bb tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:46.121544 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9948f93d-a228-4920-a8bc-886ea16343bb tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:46.129737 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9948f93d-a228-4920-a8bc-886ea16343bb tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:46.130514 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9948f93d-a228-4920-a8bc-886ea16343bb tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:46.131699 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9948f93d-a228-4920-a8bc-886ea16343bb tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:46.132486 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9948f93d-a228-4920-a8bc-886ea16343bb tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:46.291701 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9948f93d-a228-4920-a8bc-886ea16343bb tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:46.301135 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9948f93d-a228-4920-a8bc-886ea16343bb tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d" status: 200 len: 1365 microversion: 2.1 time: 0.185020 Jul 31 01:51:46.302305 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3033/6093] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:46 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:47.322527 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-53319bb0-8f20-43e2-a91d-6f1a6be73206 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:47.323303 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-53319bb0-8f20-43e2-a91d-6f1a6be73206 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:47.330714 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53319bb0-8f20-43e2-a91d-6f1a6be73206 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:47.331410 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53319bb0-8f20-43e2-a91d-6f1a6be73206 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:47.332604 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53319bb0-8f20-43e2-a91d-6f1a6be73206 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:47.333202 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-53319bb0-8f20-43e2-a91d-6f1a6be73206 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:47.477963 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-53319bb0-8f20-43e2-a91d-6f1a6be73206 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:47.488147 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-53319bb0-8f20-43e2-a91d-6f1a6be73206 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d" status: 200 len: 1365 microversion: 2.1 time: 0.169828 Jul 31 01:51:47.489036 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3061/6094] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:47 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:51:47.572856 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0123933f-298a-4437-81db-0ad9dee17696 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:47.573811 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0123933f-298a-4437-81db-0ad9dee17696 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:47.582826 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0123933f-298a-4437-81db-0ad9dee17696 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:47.583298 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0123933f-298a-4437-81db-0ad9dee17696 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:47.584140 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0123933f-298a-4437-81db-0ad9dee17696 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:47.584598 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0123933f-298a-4437-81db-0ad9dee17696 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:47.605102 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-3da1b940-b65b-45eb-9230-5dc52c965195 req-d943063f-c519-481c-b496-770637bff334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c05df349-4c11-4883-814e-6458443510a7", "tag": "630eb1de-1354-4d3c-9468-f48da959aa77"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:47.613513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0123933f-298a-4437-81db-0ad9dee17696 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:51:47.624608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3da1b940-b65b-45eb-9230-5dc52c965195 req-d943063f-c519-481c-b496-770637bff334 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:47.627970 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3da1b940-b65b-45eb-9230-5dc52c965195 req-d943063f-c519-481c-b496-770637bff334 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:47.644257 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-3da1b940-b65b-45eb-9230-5dc52c965195 req-d943063f-c519-481c-b496-770637bff334 service nova] Creating event network-changed:630eb1de-1354-4d3c-9468-f48da959aa77 for instance c05df349-4c11-4883-814e-6458443510a7 on n-h2-master-1 Jul 31 01:51:47.654120 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-3da1b940-b65b-45eb-9230-5dc52c965195 req-d943063f-c519-481c-b496-770637bff334 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052612 Jul 31 01:51:47.658674 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3062/6095] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:51:47.720088 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0123933f-298a-4437-81db-0ad9dee17696 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 204 len: 0 microversion: 2.1 time: 0.155014 Jul 31 01:51:47.721059 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3034/6096] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:51:47 2022] DELETE /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:51:47.732717 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2cb90eb5-ef79-42e6-96d4-3ef1e9d13738 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:47.733769 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2cb90eb5-ef79-42e6-96d4-3ef1e9d13738 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:47.744385 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cb90eb5-ef79-42e6-96d4-3ef1e9d13738 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:47.745137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cb90eb5-ef79-42e6-96d4-3ef1e9d13738 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:47.746207 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cb90eb5-ef79-42e6-96d4-3ef1e9d13738 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:47.746831 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cb90eb5-ef79-42e6-96d4-3ef1e9d13738 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:47.888998 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2cb90eb5-ef79-42e6-96d4-3ef1e9d13738 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:47.898231 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2cb90eb5-ef79-42e6-96d4-3ef1e9d13738 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1687 microversion: 2.1 time: 0.171118 Jul 31 01:51:47.905444 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3063/6097] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:47 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:51:48.509995 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5aa5f577-3782-4a18-b715-aaa7428aaf8d tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:48.510746 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5aa5f577-3782-4a18-b715-aaa7428aaf8d tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:48.517628 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5aa5f577-3782-4a18-b715-aaa7428aaf8d tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:48.518105 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5aa5f577-3782-4a18-b715-aaa7428aaf8d tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:48.518904 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5aa5f577-3782-4a18-b715-aaa7428aaf8d tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:48.520329 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5aa5f577-3782-4a18-b715-aaa7428aaf8d tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:48.681733 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5aa5f577-3782-4a18-b715-aaa7428aaf8d tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:48.689325 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5aa5f577-3782-4a18-b715-aaa7428aaf8d tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d" status: 200 len: 1365 microversion: 2.1 time: 0.183777 Jul 31 01:51:48.689899 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3035/6098] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:48 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:48.923810 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f19d3426-ae21-45d6-b2a0-3ebb0f7caabd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:48.924477 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f19d3426-ae21-45d6-b2a0-3ebb0f7caabd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:48.934229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f19d3426-ae21-45d6-b2a0-3ebb0f7caabd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:48.934931 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f19d3426-ae21-45d6-b2a0-3ebb0f7caabd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:48.935891 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f19d3426-ae21-45d6-b2a0-3ebb0f7caabd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:48.936680 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f19d3426-ae21-45d6-b2a0-3ebb0f7caabd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:49.098983 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f19d3426-ae21-45d6-b2a0-3ebb0f7caabd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:49.107438 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f19d3426-ae21-45d6-b2a0-3ebb0f7caabd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1687 microversion: 2.1 time: 0.190226 Jul 31 01:51:49.108406 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3064/6099] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:48 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1687 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:49.645111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-74569d92-8078-4066-bf1d-902d37505f73 req-aead8515-9e6d-4fae-820e-491181c75dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c05df349-4c11-4883-814e-6458443510a7", "name": "network-vif-deleted", "tag": "630eb1de-1354-4d3c-9468-f48da959aa77"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:49.658917 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-74569d92-8078-4066-bf1d-902d37505f73 req-aead8515-9e6d-4fae-820e-491181c75dc6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:49.659736 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-74569d92-8078-4066-bf1d-902d37505f73 req-aead8515-9e6d-4fae-820e-491181c75dc6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:49.674858 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-74569d92-8078-4066-bf1d-902d37505f73 req-aead8515-9e6d-4fae-820e-491181c75dc6 service nova] Creating event network-vif-deleted:630eb1de-1354-4d3c-9468-f48da959aa77 for instance c05df349-4c11-4883-814e-6458443510a7 on n-h2-master-1 Jul 31 01:51:49.682983 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-74569d92-8078-4066-bf1d-902d37505f73 req-aead8515-9e6d-4fae-820e-491181c75dc6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042224 Jul 31 01:51:49.683947 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3036/6100] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:51:49.710100 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-47e145df-08ef-4fc6-aa73-4ebc2a3e0963 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:49.710734 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-47e145df-08ef-4fc6-aa73-4ebc2a3e0963 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:49.719604 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47e145df-08ef-4fc6-aa73-4ebc2a3e0963 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:49.720071 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47e145df-08ef-4fc6-aa73-4ebc2a3e0963 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:49.720857 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47e145df-08ef-4fc6-aa73-4ebc2a3e0963 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:49.721443 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47e145df-08ef-4fc6-aa73-4ebc2a3e0963 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:49.857611 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-47e145df-08ef-4fc6-aa73-4ebc2a3e0963 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:49.865277 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-47e145df-08ef-4fc6-aa73-4ebc2a3e0963 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d" status: 200 len: 1365 microversion: 2.1 time: 0.159247 Jul 31 01:51:49.866119 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3065/6101] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:49 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:50.131070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-92e605ad-b513-4d06-9c85-382f306387e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:50.132132 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-92e605ad-b513-4d06-9c85-382f306387e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:50.140619 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92e605ad-b513-4d06-9c85-382f306387e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:50.141097 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92e605ad-b513-4d06-9c85-382f306387e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:50.142476 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92e605ad-b513-4d06-9c85-382f306387e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:50.142648 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92e605ad-b513-4d06-9c85-382f306387e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:50.177002 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92e605ad-b513-4d06-9c85-382f306387e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:50.177686 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-92e605ad-b513-4d06-9c85-382f306387e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:50.178152 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-92e605ad-b513-4d06-9c85-382f306387e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lazy-loading 'fault' on Instance uuid c05df349-4c11-4883-814e-6458443510a7 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:51:50.201532 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7980edf4-063f-4ff5-95cf-f6fbe3a1faea tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Action: 'create', calling method: .version_select at 0x7fede51e4160>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1549827024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHth4LxlOhCJ5vNmwDOVuKkgQ4+TVFmeacUlBu2j8CiEksnGwIJt/iB8YH44fsFYGyD3fPamT5o/J360tBoe8FO8Ky+g6hWalpqn6HEGMCxSMt1idBV09AcouqQ8ILxJ/A=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:50.218417 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7980edf4-063f-4ff5-95cf-f6fbe3a1faea tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Getting quotas for project 7483fc54931f40ea8eba3508b60e158d. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:51:50.224495 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-7980edf4-063f-4ff5-95cf-f6fbe3a1faea tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Getting quotas for user 6c112f6022494bdeb9ee7cd5d9ec31c6 and project 7483fc54931f40ea8eba3508b60e158d. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:51:50.230700 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-92e605ad-b513-4d06-9c85-382f306387e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:50.237745 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-92e605ad-b513-4d06-9c85-382f306387e0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 200 len: 1356 microversion: 2.1 time: 0.111212 Jul 31 01:51:50.238319 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3037/6102] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:50 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 1356 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:50.253947 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7980edf4-063f-4ff5-95cf-f6fbe3a1faea tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056258 Jul 31 01:51:50.254560 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3066/6103] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:51:50 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:51:50.887042 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-082e8e51-8c85-427e-b629-e6bd568fdac6 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:50.888134 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-082e8e51-8c85-427e-b629-e6bd568fdac6 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:50.898310 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-082e8e51-8c85-427e-b629-e6bd568fdac6 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:50.899286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-082e8e51-8c85-427e-b629-e6bd568fdac6 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:50.900214 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-082e8e51-8c85-427e-b629-e6bd568fdac6 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:50.900735 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-082e8e51-8c85-427e-b629-e6bd568fdac6 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:50.903516 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-455883ca-c25d-42d4-b348-1c304b60ad9d req-faaf205f-e41d-486b-9ed8-9a353fde4a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1353bba5-65a1-4282-8c94-49e748b2b16d", "name": "network-vif-plugged", "status": "completed", "tag": "5857dbc8-0d83-4d68-9212-08fef174f2d0"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:50.919960 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-455883ca-c25d-42d4-b348-1c304b60ad9d req-faaf205f-e41d-486b-9ed8-9a353fde4a3c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:50.920817 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-455883ca-c25d-42d4-b348-1c304b60ad9d req-faaf205f-e41d-486b-9ed8-9a353fde4a3c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:50.938815 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-455883ca-c25d-42d4-b348-1c304b60ad9d req-faaf205f-e41d-486b-9ed8-9a353fde4a3c service nova] Creating event network-vif-plugged:5857dbc8-0d83-4d68-9212-08fef174f2d0 for instance 1353bba5-65a1-4282-8c94-49e748b2b16d on n-h1-master-1 Jul 31 01:51:50.945443 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-455883ca-c25d-42d4-b348-1c304b60ad9d req-faaf205f-e41d-486b-9ed8-9a353fde4a3c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050105 Jul 31 01:51:50.946614 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3067/6104] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:51:51.116900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-082e8e51-8c85-427e-b629-e6bd568fdac6 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:51.125343 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-082e8e51-8c85-427e-b629-e6bd568fdac6 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d" status: 200 len: 1365 microversion: 2.1 time: 0.242864 Jul 31 01:51:51.125936 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3038/6105] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:50 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:51.260998 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e2e02af9-e6f7-42e0-90e3-4a13fe6fbfdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:51.262029 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e2e02af9-e6f7-42e0-90e3-4a13fe6fbfdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: c05df349-4c11-4883-814e-6458443510a7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:51.272388 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e2e02af9-e6f7-42e0-90e3-4a13fe6fbfdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:51.272851 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e2e02af9-e6f7-42e0-90e3-4a13fe6fbfdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:51.273642 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e2e02af9-e6f7-42e0-90e3-4a13fe6fbfdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:51.274093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e2e02af9-e6f7-42e0-90e3-4a13fe6fbfdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:51.288002 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-e2e02af9-e6f7-42e0-90e3-4a13fe6fbfdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] HTTP exception thrown: Instance c05df349-4c11-4883-814e-6458443510a7 could not be found. Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e2e02af9-e6f7-42e0-90e3-4a13fe6fbfdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Request method failure captured: Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 HTTP/1.1 Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5d9Kf4E3IZDZUsj11OUUTq3aW5TKVoTTbNXJKKFyTqRkWTfvcurnGmoWdsnkQBC06JOC-RzmfXv9UpgiSjIwgxiuii_gLTCRUhYfcSIeg4jSALKpm0sQONrNpVV2nG8N0HrFSmgFYp_LLq1OtetyO0y_1Ae7AWsoynrjLTPfogUx0M8 Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 736abaeccdf44e3899d98fdf2cac4c0f Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-882728420 Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/736abaeccdf44e3899d98fdf2cac4c0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/736abaeccdf44e3899d98fdf2cac4c0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/736abaeccdf44e3899d98fdf2cac4c0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_736abaeccdf44e3899d98fdf2cac4c0f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestNetworkAdvancedServerOps-882728420 Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 736abaeccdf44e3899d98fdf2cac4c0f Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-882728420 Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestNetworkAdvancedServerOps-882728420-project Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: b799c19fd26348d3a84198bb76581c87 Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestNetworkAdvancedServerOps-882728420-project Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: exception: Instance c05df349-4c11-4883-814e-6458443510a7 could not be found. Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'c05df349-4c11-4883-814e-6458443510a7'} Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c05df349-4c11-4883-814e-6458443510a7 could not be found. Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c05df349-4c11-4883-814e-6458443510a7 could not be found. Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:51:51.289678 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:51.294144 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:51:51.294144 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:51:51.294144 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:51:51.294144 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:51:51.294144 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:51:51.294144 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c05df349-4c11-4883-814e-6458443510a7 could not be found. Jul 31 01:51:51.294144 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:51:51.294144 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e2e02af9-e6f7-42e0-90e3-4a13fe6fbfdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Returning 404 to user: Instance c05df349-4c11-4883-814e-6458443510a7 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:51:51.294144 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e2e02af9-e6f7-42e0-90e3-4a13fe6fbfdd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7" status: 404 len: 111 microversion: 2.1 time: 0.034419 Jul 31 01:51:51.294144 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3068/6106] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:51 2022] GET /compute/v2.1/servers/c05df349-4c11-4883-814e-6458443510a7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:51:51.344626 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-085f68cf-1c0b-4159-afee-739d69bdf34a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1569761756", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cabc541c-8146-4f0d-9c53-6b368c34b59f", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1549827024", "security_groups": [{"name": "tempest-secgroup-smoke-2011235010"}], "networks": [{"uuid": "6ccddd7a-5fa8-4187-ba80-cc525c873866"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:51.460376 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-085f68cf-1c0b-4159-afee-739d69bdf34a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] validate_networks() for [('6ccddd7a-5fa8-4187-ba80-cc525c873866', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:51:51.852921 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-085f68cf-1c0b-4159-afee-739d69bdf34a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:51:51.853396 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-085f68cf-1c0b-4159-afee-739d69bdf34a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:51:51.853885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-085f68cf-1c0b-4159-afee-739d69bdf34a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:51:51.854340 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-085f68cf-1c0b-4159-afee-739d69bdf34a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:51:51.854767 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-085f68cf-1c0b-4159-afee-739d69bdf34a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:51:51.864608 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-085f68cf-1c0b-4159-afee-739d69bdf34a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:51.865074 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-085f68cf-1c0b-4159-afee-739d69bdf34a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:51.866158 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-085f68cf-1c0b-4159-afee-739d69bdf34a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:51.866616 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-085f68cf-1c0b-4159-afee-739d69bdf34a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:51.884317 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-085f68cf-1c0b-4159-afee-739d69bdf34a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Getting quotas for project 7483fc54931f40ea8eba3508b60e158d. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:51:51.889526 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-085f68cf-1c0b-4159-afee-739d69bdf34a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Getting quotas for user 6c112f6022494bdeb9ee7cd5d9ec31c6 and project 7483fc54931f40ea8eba3508b60e158d. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:51:51.949578 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-085f68cf-1c0b-4159-afee-739d69bdf34a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:51:51.951748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-085f68cf-1c0b-4159-afee-739d69bdf34a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cabc541c-8146-4f0d-9c53-6b368c34b59f',volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:51:52.083793 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-085f68cf-1c0b-4159-afee-739d69bdf34a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.744166 Jul 31 01:51:52.084900 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3039/6107] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:51:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:51:52.103387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ad2e56ef-a2ea-4e7d-a85f-bb006d4e35a2 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:52.107086 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ad2e56ef-a2ea-4e7d-a85f-bb006d4e35a2 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:52.155301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-450446d7-1503-40a7-823a-e39a83295e2f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:52.159869 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-450446d7-1503-40a7-823a-e39a83295e2f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:52.184178 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-450446d7-1503-40a7-823a-e39a83295e2f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:52.184983 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-450446d7-1503-40a7-823a-e39a83295e2f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:52.186407 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-450446d7-1503-40a7-823a-e39a83295e2f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:52.187812 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-450446d7-1503-40a7-823a-e39a83295e2f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:52.211238 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ad2e56ef-a2ea-4e7d-a85f-bb006d4e35a2 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:52.255097 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ad2e56ef-a2ea-4e7d-a85f-bb006d4e35a2 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1099 microversion: 2.1 time: 0.151710 Jul 31 01:51:52.277647 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3069/6108] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:52 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1099 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:52.381276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-450446d7-1503-40a7-823a-e39a83295e2f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:52.389501 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-450446d7-1503-40a7-823a-e39a83295e2f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d" status: 200 len: 1556 microversion: 2.1 time: 0.246469 Jul 31 01:51:52.403080 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3040/6109] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:52 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d => generated 1556 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:52.411497 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-496d730e-6980-45c6-813e-d214ebbab3da tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:52.411986 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-496d730e-6980-45c6-813e-d214ebbab3da tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:52.424415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-496d730e-6980-45c6-813e-d214ebbab3da tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:52.425018 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-496d730e-6980-45c6-813e-d214ebbab3da tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:52.425899 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-496d730e-6980-45c6-813e-d214ebbab3da tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:52.426410 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-496d730e-6980-45c6-813e-d214ebbab3da tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:52.532237 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-496d730e-6980-45c6-813e-d214ebbab3da tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124779 Jul 31 01:51:52.533498 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3070/6110] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:51:52 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:51:53.301876 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b6525006-39ca-483e-a835-9759c1574534 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:53.303233 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b6525006-39ca-483e-a835-9759c1574534 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:53.323385 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6525006-39ca-483e-a835-9759c1574534 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:53.324284 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6525006-39ca-483e-a835-9759c1574534 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:53.325356 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6525006-39ca-483e-a835-9759c1574534 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:53.326184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6525006-39ca-483e-a835-9759c1574534 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:53.537995 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b6525006-39ca-483e-a835-9759c1574534 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:53.552734 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b6525006-39ca-483e-a835-9759c1574534 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1197 microversion: 2.1 time: 0.255846 Jul 31 01:51:53.553346 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3041/6111] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:53 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:54.385682 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-428bd896-24f2-4761-b9ae-e01a071ac028 req-41edaa9b-a933-4356-96bd-142fb230d9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1353bba5-65a1-4282-8c94-49e748b2b16d", "tag": "5857dbc8-0d83-4d68-9212-08fef174f2d0"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:54.406217 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-428bd896-24f2-4761-b9ae-e01a071ac028 req-41edaa9b-a933-4356-96bd-142fb230d9b3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:54.412104 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-428bd896-24f2-4761-b9ae-e01a071ac028 req-41edaa9b-a933-4356-96bd-142fb230d9b3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:54.426591 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-428bd896-24f2-4761-b9ae-e01a071ac028 req-41edaa9b-a933-4356-96bd-142fb230d9b3 service nova] Creating event network-changed:5857dbc8-0d83-4d68-9212-08fef174f2d0 for instance 1353bba5-65a1-4282-8c94-49e748b2b16d on n-h1-master-1 Jul 31 01:51:54.433307 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-428bd896-24f2-4761-b9ae-e01a071ac028 req-41edaa9b-a933-4356-96bd-142fb230d9b3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053098 Jul 31 01:51:54.434289 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3071/6112] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:51:54.584140 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1f2b13d2-610e-402b-a937-056f0ed067c1 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:54.584787 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1f2b13d2-610e-402b-a937-056f0ed067c1 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:54.604254 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f2b13d2-610e-402b-a937-056f0ed067c1 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:54.607081 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f2b13d2-610e-402b-a937-056f0ed067c1 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:54.608973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f2b13d2-610e-402b-a937-056f0ed067c1 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:54.612171 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f2b13d2-610e-402b-a937-056f0ed067c1 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:54.761656 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1f2b13d2-610e-402b-a937-056f0ed067c1 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:54.771022 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1f2b13d2-610e-402b-a937-056f0ed067c1 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1215 microversion: 2.1 time: 0.200214 Jul 31 01:51:54.773942 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3042/6113] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:54 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1215 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:55.797007 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-71920e71-ac8a-4cb3-aa6d-a35df203adbf tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:55.798008 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-71920e71-ac8a-4cb3-aa6d-a35df203adbf tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:55.805136 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71920e71-ac8a-4cb3-aa6d-a35df203adbf tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:55.805610 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71920e71-ac8a-4cb3-aa6d-a35df203adbf tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:55.806433 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71920e71-ac8a-4cb3-aa6d-a35df203adbf tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:55.806883 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-71920e71-ac8a-4cb3-aa6d-a35df203adbf tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:56.052086 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5fba0e21-f581-49c2-98e8-9ce65d2fea6e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '.version_select at 0x7fede4f604c0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:56.086867 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5fba0e21-f581-49c2-98e8-9ce65d2fea6e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-587133466" status: 202 len: 0 microversion: 2.1 time: 0.037842 Jul 31 01:51:56.089905 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3043/6114] 10.222.0.45 () {58 vars in 1281 bytes} [Sun Jul 31 01:51:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-587133466 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:51:56.092999 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-71920e71-ac8a-4cb3-aa6d-a35df203adbf tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:56.107971 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-71920e71-ac8a-4cb3-aa6d-a35df203adbf tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1283 microversion: 2.1 time: 0.315671 Jul 31 01:51:56.109262 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3072/6115] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:55 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1283 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:56.134852 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b1cce6fa-3509-4584-ac1a-dd9aa0109dee tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'create', calling method: .version_select at 0x7fede4e3edc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1901530457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDugKS967qsYpex5ZXxrvoBgPIrTDLi+uMHNR5L/VVMpXSQusAuqUpFo5KT/q0pkkS4Bk9caaaMRvrO1nsEx9/EbPlaCyHIHjWJtJbY26yHa5VoF0DgYJZy8u6oj8akmJA=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:56.155983 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-b1cce6fa-3509-4584-ac1a-dd9aa0109dee tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Getting quotas for project 736abaeccdf44e3899d98fdf2cac4c0f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:51:56.162482 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-b1cce6fa-3509-4584-ac1a-dd9aa0109dee tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Getting quotas for user b799c19fd26348d3a84198bb76581c87 and project 736abaeccdf44e3899d98fdf2cac4c0f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:51:56.194148 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b1cce6fa-3509-4584-ac1a-dd9aa0109dee tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.066029 Jul 31 01:51:56.197055 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3044/6116] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:51:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:51:56.454449 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-05579eae-458b-4750-a9d6-e4bc653ce6dc req-d9f65005-da26-4b11-9e8e-b6bf86657c5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e736db7f-287e-4b48-92e5-23c3d1b5369b", "tag": "1ea132e6-d2b3-4bbf-8e6e-5903b8eaca0e"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:51:56.465284 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-05579eae-458b-4750-a9d6-e4bc653ce6dc req-d9f65005-da26-4b11-9e8e-b6bf86657c5f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:56.465742 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-05579eae-458b-4750-a9d6-e4bc653ce6dc req-d9f65005-da26-4b11-9e8e-b6bf86657c5f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:56.478045 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-05579eae-458b-4750-a9d6-e4bc653ce6dc req-d9f65005-da26-4b11-9e8e-b6bf86657c5f service nova] Creating event network-changed:1ea132e6-d2b3-4bbf-8e6e-5903b8eaca0e for instance e736db7f-287e-4b48-92e5-23c3d1b5369b on n-h2-master-1 Jul 31 01:51:56.483039 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-05579eae-458b-4750-a9d6-e4bc653ce6dc req-d9f65005-da26-4b11-9e8e-b6bf86657c5f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032861 Jul 31 01:51:56.484614 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3073/6117] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:51:57.136520 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-42bb0f9f-4bd1-4cc1-a832-3a2de466c0c3 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:57.137149 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-42bb0f9f-4bd1-4cc1-a832-3a2de466c0c3 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:57.146748 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42bb0f9f-4bd1-4cc1-a832-3a2de466c0c3 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:57.147616 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42bb0f9f-4bd1-4cc1-a832-3a2de466c0c3 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:57.148607 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42bb0f9f-4bd1-4cc1-a832-3a2de466c0c3 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:57.149059 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42bb0f9f-4bd1-4cc1-a832-3a2de466c0c3 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:57.462145 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-42bb0f9f-4bd1-4cc1-a832-3a2de466c0c3 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:57.473235 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-42bb0f9f-4bd1-4cc1-a832-3a2de466c0c3 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1283 microversion: 2.1 time: 0.343149 Jul 31 01:51:57.476367 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3045/6118] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:57 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1283 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:58.498004 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1bfda2b6-fe1e-4f0a-a1e7-abf71010b9f0 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:58.499369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1bfda2b6-fe1e-4f0a-a1e7-abf71010b9f0 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:58.506897 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bfda2b6-fe1e-4f0a-a1e7-abf71010b9f0 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:58.507545 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bfda2b6-fe1e-4f0a-a1e7-abf71010b9f0 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:58.508452 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bfda2b6-fe1e-4f0a-a1e7-abf71010b9f0 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:58.509008 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bfda2b6-fe1e-4f0a-a1e7-abf71010b9f0 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:58.737823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1bfda2b6-fe1e-4f0a-a1e7-abf71010b9f0 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:58.748403 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1bfda2b6-fe1e-4f0a-a1e7-abf71010b9f0 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1283 microversion: 2.1 time: 0.254780 Jul 31 01:51:58.749802 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3074/6119] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:58 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1283 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:51:59.770323 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3b12216f-43b5-4813-8798-e162d5edd359 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:51:59.770906 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3b12216f-43b5-4813-8798-e162d5edd359 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:51:59.778269 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b12216f-43b5-4813-8798-e162d5edd359 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:59.778741 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b12216f-43b5-4813-8798-e162d5edd359 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:59.779573 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b12216f-43b5-4813-8798-e162d5edd359 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:51:59.780998 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3b12216f-43b5-4813-8798-e162d5edd359 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:51:59.983504 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3b12216f-43b5-4813-8798-e162d5edd359 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:51:59.992524 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3b12216f-43b5-4813-8798-e162d5edd359 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1271 microversion: 2.1 time: 0.226248 Jul 31 01:51:59.993094 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3046/6120] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:51:59 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1271 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:01.014524 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3b5b466d-aafd-493e-8526-c4416326f5e5 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:01.015729 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3b5b466d-aafd-493e-8526-c4416326f5e5 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:01.025023 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b5b466d-aafd-493e-8526-c4416326f5e5 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:01.025755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b5b466d-aafd-493e-8526-c4416326f5e5 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:01.027119 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b5b466d-aafd-493e-8526-c4416326f5e5 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:01.027900 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b5b466d-aafd-493e-8526-c4416326f5e5 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:01.195479 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3b5b466d-aafd-493e-8526-c4416326f5e5 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:01.205838 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3b5b466d-aafd-493e-8526-c4416326f5e5 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1271 microversion: 2.1 time: 0.195479 Jul 31 01:52:01.206868 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3075/6121] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:01 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:02.231081 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-174c3c22-ec62-4c7d-b8e4-f717307bc213 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:02.231956 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-174c3c22-ec62-4c7d-b8e4-f717307bc213 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:02.234979 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:02.242120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-174c3c22-ec62-4c7d-b8e4-f717307bc213 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:02.242854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-174c3c22-ec62-4c7d-b8e4-f717307bc213 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:02.243833 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-174c3c22-ec62-4c7d-b8e4-f717307bc213 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:02.244330 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-174c3c22-ec62-4c7d-b8e4-f717307bc213 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:02.410013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-174c3c22-ec62-4c7d-b8e4-f717307bc213 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:02.422503 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-174c3c22-ec62-4c7d-b8e4-f717307bc213 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1271 microversion: 2.1 time: 0.195392 Jul 31 01:52:02.423921 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3047/6122] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:02 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:02.701303 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc695abe-1d89-4ea1-a26d-6da512008e93 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-630318956", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "b1bda936-e4d0-4761-bf4f-0f08f036dffa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1901530457", "security_groups": [{"name": "tempest-secgroup-smoke-2065859728"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:02.710872 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=12 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:02.827790 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-fc695abe-1d89-4ea1-a26d-6da512008e93 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] validate_networks() for [('b1bda936-e4d0-4761-bf4f-0f08f036dffa', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:52:03.318499 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-fc695abe-1d89-4ea1-a26d-6da512008e93 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:52:03.318936 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-fc695abe-1d89-4ea1-a26d-6da512008e93 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:52:03.319463 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-fc695abe-1d89-4ea1-a26d-6da512008e93 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:52:03.319915 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-fc695abe-1d89-4ea1-a26d-6da512008e93 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:52:03.320361 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-fc695abe-1d89-4ea1-a26d-6da512008e93 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:52:03.330276 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc695abe-1d89-4ea1-a26d-6da512008e93 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:03.330876 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc695abe-1d89-4ea1-a26d-6da512008e93 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:03.331888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc695abe-1d89-4ea1-a26d-6da512008e93 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:03.332720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc695abe-1d89-4ea1-a26d-6da512008e93 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:03.351812 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-fc695abe-1d89-4ea1-a26d-6da512008e93 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Getting quotas for project 736abaeccdf44e3899d98fdf2cac4c0f. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:52:03.357761 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-fc695abe-1d89-4ea1-a26d-6da512008e93 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Getting quotas for user b799c19fd26348d3a84198bb76581c87 and project 736abaeccdf44e3899d98fdf2cac4c0f. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:52:03.373008 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc695abe-1d89-4ea1-a26d-6da512008e93 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:52:03.375847 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc695abe-1d89-4ea1-a26d-6da512008e93 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:52:03.423533 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc695abe-1d89-4ea1-a26d-6da512008e93 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726413 Jul 31 01:52:03.424473 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3076/6123] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:52:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:52:03.435697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cb4563cb-727b-4f22-943c-4fdaede1209d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:03.436393 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cb4563cb-727b-4f22-943c-4fdaede1209d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:03.445092 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2d13843a-9f15-4407-b720-0fee2f951d47 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:03.446102 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2d13843a-9f15-4407-b720-0fee2f951d47 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:03.455296 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d13843a-9f15-4407-b720-0fee2f951d47 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:03.455716 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d13843a-9f15-4407-b720-0fee2f951d47 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:03.456629 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d13843a-9f15-4407-b720-0fee2f951d47 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:03.457109 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d13843a-9f15-4407-b720-0fee2f951d47 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:03.509010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cb4563cb-727b-4f22-943c-4fdaede1209d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:03.517123 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cb4563cb-727b-4f22-943c-4fdaede1209d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1266 microversion: 2.1 time: 0.085278 Jul 31 01:52:03.531434 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3048/6124] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:03 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:03.640452 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2d13843a-9f15-4407-b720-0fee2f951d47 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:03.649582 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2d13843a-9f15-4407-b720-0fee2f951d47 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1271 microversion: 2.1 time: 0.210106 Jul 31 01:52:03.650655 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3077/6125] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:03 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1271 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:52:04.538996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-27541e80-f0fc-4162-a8a2-3ec8ff4e2344 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:04.540748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-27541e80-f0fc-4162-a8a2-3ec8ff4e2344 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:04.567142 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-27541e80-f0fc-4162-a8a2-3ec8ff4e2344 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:04.568250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-27541e80-f0fc-4162-a8a2-3ec8ff4e2344 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:04.569254 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-27541e80-f0fc-4162-a8a2-3ec8ff4e2344 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:04.570014 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-27541e80-f0fc-4162-a8a2-3ec8ff4e2344 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:04.663106 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-27541e80-f0fc-4162-a8a2-3ec8ff4e2344 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:04.670899 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e51fc781-fc72-4e7a-a3ff-668041c5428a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:04.672145 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e51fc781-fc72-4e7a-a3ff-668041c5428a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:04.672743 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:04.687182 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-27541e80-f0fc-4162-a8a2-3ec8ff4e2344 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1326 microversion: 2.1 time: 0.151355 Jul 31 01:52:04.688677 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3049/6126] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:04 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1326 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:04.698231 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e51fc781-fc72-4e7a-a3ff-668041c5428a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:04.698961 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e51fc781-fc72-4e7a-a3ff-668041c5428a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:04.699860 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e51fc781-fc72-4e7a-a3ff-668041c5428a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:04.700318 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e51fc781-fc72-4e7a-a3ff-668041c5428a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:04.854003 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e51fc781-fc72-4e7a-a3ff-668041c5428a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:04.862065 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e51fc781-fc72-4e7a-a3ff-668041c5428a tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1271 microversion: 2.1 time: 0.195008 Jul 31 01:52:04.867068 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3078/6127] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:04 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1271 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:05.711535 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a976348a-0f35-4971-908f-aec99edbe3fd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:05.713580 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a976348a-0f35-4971-908f-aec99edbe3fd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:05.723852 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a976348a-0f35-4971-908f-aec99edbe3fd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:05.724716 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a976348a-0f35-4971-908f-aec99edbe3fd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:05.726993 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a976348a-0f35-4971-908f-aec99edbe3fd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:05.727844 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a976348a-0f35-4971-908f-aec99edbe3fd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:05.885277 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-097d2b13-d7bf-43e4-b230-8ae2cbd5ba68 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:05.885986 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-097d2b13-d7bf-43e4-b230-8ae2cbd5ba68 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:05.893237 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a976348a-0f35-4971-908f-aec99edbe3fd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:05.895443 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-097d2b13-d7bf-43e4-b230-8ae2cbd5ba68 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:05.897229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-097d2b13-d7bf-43e4-b230-8ae2cbd5ba68 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:05.897459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-097d2b13-d7bf-43e4-b230-8ae2cbd5ba68 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:05.897928 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-097d2b13-d7bf-43e4-b230-8ae2cbd5ba68 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:05.906143 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a976348a-0f35-4971-908f-aec99edbe3fd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1392 microversion: 2.1 time: 0.200367 Jul 31 01:52:05.906947 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3050/6128] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:05 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1392 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:06.053439 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-097d2b13-d7bf-43e4-b230-8ae2cbd5ba68 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:06.061938 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-097d2b13-d7bf-43e4-b230-8ae2cbd5ba68 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1271 microversion: 2.1 time: 0.181211 Jul 31 01:52:06.062710 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3079/6129] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:05 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:06.363167 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-21d06a60-a5c5-47bf-aec8-aeb25dd92669 req-8b3456a4-7089-42f9-87e0-6038e31f1507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836693e0-6da6-453c-ae50-8595401eeaa6", "tag": "be6f1d93-71fd-4590-a692-85e9f6f6c86b"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:06.377500 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-21d06a60-a5c5-47bf-aec8-aeb25dd92669 req-8b3456a4-7089-42f9-87e0-6038e31f1507 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:06.377883 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-21d06a60-a5c5-47bf-aec8-aeb25dd92669 req-8b3456a4-7089-42f9-87e0-6038e31f1507 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:06.400945 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-21d06a60-a5c5-47bf-aec8-aeb25dd92669 req-8b3456a4-7089-42f9-87e0-6038e31f1507 service nova] Creating event network-changed:be6f1d93-71fd-4590-a692-85e9f6f6c86b for instance 836693e0-6da6-453c-ae50-8595401eeaa6 on n-h1-master-1 Jul 31 01:52:06.407720 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-21d06a60-a5c5-47bf-aec8-aeb25dd92669 req-8b3456a4-7089-42f9-87e0-6038e31f1507 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049773 Jul 31 01:52:06.408613 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3051/6130] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:52:06.927360 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fef9bf53-1f94-4c46-949c-04e15c14dce4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:06.928179 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fef9bf53-1f94-4c46-949c-04e15c14dce4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:06.935053 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fef9bf53-1f94-4c46-949c-04e15c14dce4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:06.935639 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fef9bf53-1f94-4c46-949c-04e15c14dce4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:06.936330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fef9bf53-1f94-4c46-949c-04e15c14dce4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:06.936779 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fef9bf53-1f94-4c46-949c-04e15c14dce4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:07.072451 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fef9bf53-1f94-4c46-949c-04e15c14dce4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:07.080817 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fef9bf53-1f94-4c46-949c-04e15c14dce4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1392 microversion: 2.1 time: 0.157325 Jul 31 01:52:07.081404 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3080/6131] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:06 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:07.083300 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a9c2066d-1ee1-49e0-9012-c8a6fed6fa90 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:07.084616 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a9c2066d-1ee1-49e0-9012-c8a6fed6fa90 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:07.088466 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:07.093251 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a9c2066d-1ee1-49e0-9012-c8a6fed6fa90 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:07.093727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a9c2066d-1ee1-49e0-9012-c8a6fed6fa90 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:07.094522 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a9c2066d-1ee1-49e0-9012-c8a6fed6fa90 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:07.094987 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a9c2066d-1ee1-49e0-9012-c8a6fed6fa90 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:07.228897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a9c2066d-1ee1-49e0-9012-c8a6fed6fa90 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:07.236829 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a9c2066d-1ee1-49e0-9012-c8a6fed6fa90 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1271 microversion: 2.1 time: 0.157957 Jul 31 01:52:07.237433 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3052/6132] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:07 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:52:08.102235 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3daea130-1d7e-4552-bb57-95791bcc1ec5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:08.102789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3daea130-1d7e-4552-bb57-95791bcc1ec5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:08.110175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3daea130-1d7e-4552-bb57-95791bcc1ec5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:08.110633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3daea130-1d7e-4552-bb57-95791bcc1ec5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:08.111432 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3daea130-1d7e-4552-bb57-95791bcc1ec5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:08.111872 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3daea130-1d7e-4552-bb57-95791bcc1ec5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:08.247876 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3daea130-1d7e-4552-bb57-95791bcc1ec5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:08.251399 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:08.256285 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3daea130-1d7e-4552-bb57-95791bcc1ec5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1392 microversion: 2.1 time: 0.158092 Jul 31 01:52:08.256871 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3081/6133] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:08 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:08.268021 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e3df4740-17ad-4af0-87f5-1de8590c6a48 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:08.268662 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e3df4740-17ad-4af0-87f5-1de8590c6a48 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:08.277177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3df4740-17ad-4af0-87f5-1de8590c6a48 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:08.277655 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3df4740-17ad-4af0-87f5-1de8590c6a48 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:08.278467 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3df4740-17ad-4af0-87f5-1de8590c6a48 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:08.278930 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3df4740-17ad-4af0-87f5-1de8590c6a48 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:08.411252 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e3df4740-17ad-4af0-87f5-1de8590c6a48 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:08.419058 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e3df4740-17ad-4af0-87f5-1de8590c6a48 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1271 microversion: 2.1 time: 0.161327 Jul 31 01:52:08.419674 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3053/6134] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:08 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:52:09.276866 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a78b4a0b-2d2d-45ae-84fa-45b55760dae8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:09.277403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a78b4a0b-2d2d-45ae-84fa-45b55760dae8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:09.285036 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a78b4a0b-2d2d-45ae-84fa-45b55760dae8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:09.285492 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a78b4a0b-2d2d-45ae-84fa-45b55760dae8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:09.286257 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a78b4a0b-2d2d-45ae-84fa-45b55760dae8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:09.286955 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a78b4a0b-2d2d-45ae-84fa-45b55760dae8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:09.438084 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a78b4a0b-2d2d-45ae-84fa-45b55760dae8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:09.440888 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4869ab14-c7eb-41ed-ac73-11403128ac49 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:09.441952 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4869ab14-c7eb-41ed-ac73-11403128ac49 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:09.445647 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a78b4a0b-2d2d-45ae-84fa-45b55760dae8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1392 microversion: 2.1 time: 0.173009 Jul 31 01:52:09.446235 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3082/6135] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:09 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:09.452105 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4869ab14-c7eb-41ed-ac73-11403128ac49 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:09.452105 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4869ab14-c7eb-41ed-ac73-11403128ac49 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:09.452105 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4869ab14-c7eb-41ed-ac73-11403128ac49 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:09.452377 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4869ab14-c7eb-41ed-ac73-11403128ac49 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:09.589878 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4869ab14-c7eb-41ed-ac73-11403128ac49 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:09.598429 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4869ab14-c7eb-41ed-ac73-11403128ac49 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1271 microversion: 2.1 time: 0.162367 Jul 31 01:52:09.599035 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3054/6136] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:09 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:52:09.856101 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2343ce13-8ccf-48da-81ec-de1361c78022 req-4863aefd-b106-4a82-be12-0892107a0109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e736db7f-287e-4b48-92e5-23c3d1b5369b", "name": "network-vif-plugged", "status": "completed", "tag": "1ea132e6-d2b3-4bbf-8e6e-5903b8eaca0e"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:09.867593 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2343ce13-8ccf-48da-81ec-de1361c78022 req-4863aefd-b106-4a82-be12-0892107a0109 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:09.868044 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2343ce13-8ccf-48da-81ec-de1361c78022 req-4863aefd-b106-4a82-be12-0892107a0109 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:09.880112 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2343ce13-8ccf-48da-81ec-de1361c78022 req-4863aefd-b106-4a82-be12-0892107a0109 service nova] Creating event network-vif-plugged:1ea132e6-d2b3-4bbf-8e6e-5903b8eaca0e for instance e736db7f-287e-4b48-92e5-23c3d1b5369b on n-h2-master-1 Jul 31 01:52:09.885287 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2343ce13-8ccf-48da-81ec-de1361c78022 req-4863aefd-b106-4a82-be12-0892107a0109 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033245 Jul 31 01:52:09.886045 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3083/6137] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:52:10.467215 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-46b4a018-6a66-4c34-83ed-080c93d9056e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:10.468391 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-46b4a018-6a66-4c34-83ed-080c93d9056e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:10.475564 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46b4a018-6a66-4c34-83ed-080c93d9056e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:10.476036 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46b4a018-6a66-4c34-83ed-080c93d9056e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:10.476820 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46b4a018-6a66-4c34-83ed-080c93d9056e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:10.477278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46b4a018-6a66-4c34-83ed-080c93d9056e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:10.606966 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-46b4a018-6a66-4c34-83ed-080c93d9056e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:10.615369 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-46b4a018-6a66-4c34-83ed-080c93d9056e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1392 microversion: 2.1 time: 0.152113 Jul 31 01:52:10.616321 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3055/6138] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:10 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:10.620073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b4eb85fd-ce4a-472d-84e4-6b1ecbe2c974 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:10.620789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b4eb85fd-ce4a-472d-84e4-6b1ecbe2c974 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:10.624639 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:10.628515 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4eb85fd-ce4a-472d-84e4-6b1ecbe2c974 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:10.628975 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4eb85fd-ce4a-472d-84e4-6b1ecbe2c974 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:10.629750 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4eb85fd-ce4a-472d-84e4-6b1ecbe2c974 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:10.630195 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4eb85fd-ce4a-472d-84e4-6b1ecbe2c974 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:10.760176 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b4eb85fd-ce4a-472d-84e4-6b1ecbe2c974 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:10.767678 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b4eb85fd-ce4a-472d-84e4-6b1ecbe2c974 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1271 microversion: 2.1 time: 0.152425 Jul 31 01:52:10.768261 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3084/6139] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:10 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:52:11.636688 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8f0c8ff2-1c1a-4f42-966b-5f39236e26fd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:11.637316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8f0c8ff2-1c1a-4f42-966b-5f39236e26fd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:11.643918 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f0c8ff2-1c1a-4f42-966b-5f39236e26fd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:11.644387 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f0c8ff2-1c1a-4f42-966b-5f39236e26fd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:11.645164 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f0c8ff2-1c1a-4f42-966b-5f39236e26fd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:11.645619 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f0c8ff2-1c1a-4f42-966b-5f39236e26fd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:11.779732 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8f0c8ff2-1c1a-4f42-966b-5f39236e26fd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:11.787499 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8f0c8ff2-1c1a-4f42-966b-5f39236e26fd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1392 microversion: 2.1 time: 0.154840 Jul 31 01:52:11.788076 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3056/6140] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:11 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:11.788690 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d023a7ec-cfb6-4281-b6a6-18f765adb97f tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:11.789324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d023a7ec-cfb6-4281-b6a6-18f765adb97f tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:11.796419 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d023a7ec-cfb6-4281-b6a6-18f765adb97f tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:11.796886 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d023a7ec-cfb6-4281-b6a6-18f765adb97f tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:11.797678 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d023a7ec-cfb6-4281-b6a6-18f765adb97f tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:11.798132 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d023a7ec-cfb6-4281-b6a6-18f765adb97f tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:11.901298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-3e9ac0bb-ecdb-4e15-8258-eae3547a6d56 req-07a2b152-3c75-4c75-8090-9f336d51cc61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836693e0-6da6-453c-ae50-8595401eeaa6", "name": "network-vif-plugged", "status": "completed", "tag": "be6f1d93-71fd-4590-a692-85e9f6f6c86b"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:11.911511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3e9ac0bb-ecdb-4e15-8258-eae3547a6d56 req-07a2b152-3c75-4c75-8090-9f336d51cc61 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:11.912090 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-3e9ac0bb-ecdb-4e15-8258-eae3547a6d56 req-07a2b152-3c75-4c75-8090-9f336d51cc61 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:11.925580 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-3e9ac0bb-ecdb-4e15-8258-eae3547a6d56 req-07a2b152-3c75-4c75-8090-9f336d51cc61 service nova] Creating event network-vif-plugged:be6f1d93-71fd-4590-a692-85e9f6f6c86b for instance 836693e0-6da6-453c-ae50-8595401eeaa6 on n-h1-master-1 Jul 31 01:52:11.930497 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-3e9ac0bb-ecdb-4e15-8258-eae3547a6d56 req-07a2b152-3c75-4c75-8090-9f336d51cc61 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032932 Jul 31 01:52:11.930631 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d023a7ec-cfb6-4281-b6a6-18f765adb97f tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:11.931095 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3057/6141] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:52:11.938884 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d023a7ec-cfb6-4281-b6a6-18f765adb97f tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1461 microversion: 2.1 time: 0.154055 Jul 31 01:52:11.939464 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3085/6142] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:11 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1461 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:52:11.959770 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a317ec60-3011-400c-ba40-9bdb6c012dc6 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:11.960486 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a317ec60-3011-400c-ba40-9bdb6c012dc6 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:11.966709 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a317ec60-3011-400c-ba40-9bdb6c012dc6 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:11.967179 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a317ec60-3011-400c-ba40-9bdb6c012dc6 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:11.968054 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a317ec60-3011-400c-ba40-9bdb6c012dc6 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:11.968506 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a317ec60-3011-400c-ba40-9bdb6c012dc6 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:12.104759 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a317ec60-3011-400c-ba40-9bdb6c012dc6 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:12.112464 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a317ec60-3011-400c-ba40-9bdb6c012dc6 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1461 microversion: 2.1 time: 0.156893 Jul 31 01:52:12.113039 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3058/6143] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:11 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1461 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:52:12.810814 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eb8dcd10-8830-4254-9f2e-b3ce0a705de9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:12.811532 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eb8dcd10-8830-4254-9f2e-b3ce0a705de9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:12.818498 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb8dcd10-8830-4254-9f2e-b3ce0a705de9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:12.818966 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb8dcd10-8830-4254-9f2e-b3ce0a705de9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:12.819784 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb8dcd10-8830-4254-9f2e-b3ce0a705de9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:12.820240 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb8dcd10-8830-4254-9f2e-b3ce0a705de9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:12.953788 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eb8dcd10-8830-4254-9f2e-b3ce0a705de9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:12.961649 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eb8dcd10-8830-4254-9f2e-b3ce0a705de9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1392 microversion: 2.1 time: 0.154822 Jul 31 01:52:12.962331 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3086/6144] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:12 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:13.797574 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-5de269ad-f35f-4e57-a59d-3f65227a42bb req-c4cfd592-cf59-4a16-9307-581fc3407f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e736db7f-287e-4b48-92e5-23c3d1b5369b", "tag": "1ea132e6-d2b3-4bbf-8e6e-5903b8eaca0e"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:13.804144 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=18 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:13.810712 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-5de269ad-f35f-4e57-a59d-3f65227a42bb req-c4cfd592-cf59-4a16-9307-581fc3407f55 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:13.812245 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-5de269ad-f35f-4e57-a59d-3f65227a42bb req-c4cfd592-cf59-4a16-9307-581fc3407f55 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:13.824059 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-5de269ad-f35f-4e57-a59d-3f65227a42bb req-c4cfd592-cf59-4a16-9307-581fc3407f55 service nova] Creating event network-changed:1ea132e6-d2b3-4bbf-8e6e-5903b8eaca0e for instance e736db7f-287e-4b48-92e5-23c3d1b5369b on n-h2-master-1 Jul 31 01:52:13.830204 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-5de269ad-f35f-4e57-a59d-3f65227a42bb req-c4cfd592-cf59-4a16-9307-581fc3407f55 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036687 Jul 31 01:52:13.831043 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3059/6145] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:52:13.985039 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2bc0a85c-6d17-4bd1-b039-256b4343c5a7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:13.985841 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2bc0a85c-6d17-4bd1-b039-256b4343c5a7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:13.992031 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:13.992942 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:13.995945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bc0a85c-6d17-4bd1-b039-256b4343c5a7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:13.996515 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bc0a85c-6d17-4bd1-b039-256b4343c5a7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:13.997405 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bc0a85c-6d17-4bd1-b039-256b4343c5a7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:13.997945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bc0a85c-6d17-4bd1-b039-256b4343c5a7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:14.327681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2bc0a85c-6d17-4bd1-b039-256b4343c5a7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:14.339226 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2bc0a85c-6d17-4bd1-b039-256b4343c5a7 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1564 microversion: 2.1 time: 0.358523 Jul 31 01:52:14.340055 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3087/6146] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:13 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1564 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:14.362562 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-205abab0-47ae-473c-8952-58a7d58e1f63 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:14.363780 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-205abab0-47ae-473c-8952-58a7d58e1f63 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:14.377376 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-205abab0-47ae-473c-8952-58a7d58e1f63 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:14.377929 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-205abab0-47ae-473c-8952-58a7d58e1f63 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:14.378982 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-205abab0-47ae-473c-8952-58a7d58e1f63 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:14.379477 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-205abab0-47ae-473c-8952-58a7d58e1f63 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:14.691028 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-205abab0-47ae-473c-8952-58a7d58e1f63 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:14.698653 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-205abab0-47ae-473c-8952-58a7d58e1f63 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1564 microversion: 2.1 time: 0.342267 Jul 31 01:52:14.699232 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3060/6147] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:14 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1564 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:15.343806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-698f6dec-2f7e-44e8-87a1-243299dc7bd9 req-91900644-c06c-4afd-81ce-959abb8b2ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e736db7f-287e-4b48-92e5-23c3d1b5369b", "tag": "1ea132e6-d2b3-4bbf-8e6e-5903b8eaca0e"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:15.354136 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-698f6dec-2f7e-44e8-87a1-243299dc7bd9 req-91900644-c06c-4afd-81ce-959abb8b2ae4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:15.354602 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-698f6dec-2f7e-44e8-87a1-243299dc7bd9 req-91900644-c06c-4afd-81ce-959abb8b2ae4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:15.368113 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-698f6dec-2f7e-44e8-87a1-243299dc7bd9 req-91900644-c06c-4afd-81ce-959abb8b2ae4 service nova] Creating event network-changed:1ea132e6-d2b3-4bbf-8e6e-5903b8eaca0e for instance e736db7f-287e-4b48-92e5-23c3d1b5369b on n-h2-master-1 Jul 31 01:52:15.373187 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-698f6dec-2f7e-44e8-87a1-243299dc7bd9 req-91900644-c06c-4afd-81ce-959abb8b2ae4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033171 Jul 31 01:52:15.374427 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3088/6148] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:52:16.668425 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6bca9b14-dc7c-4803-941e-02a4372ccd2b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:16.669226 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6bca9b14-dc7c-4803-941e-02a4372ccd2b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:16.672996 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-c19a0dd4-aa77-4674-b595-59a486659b5d req-ef029c60-420b-4063-b7e8-7a084ca48d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836693e0-6da6-453c-ae50-8595401eeaa6", "tag": "be6f1d93-71fd-4590-a692-85e9f6f6c86b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:16.676982 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6bca9b14-dc7c-4803-941e-02a4372ccd2b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:16.677637 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6bca9b14-dc7c-4803-941e-02a4372ccd2b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:16.678711 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6bca9b14-dc7c-4803-941e-02a4372ccd2b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:16.679271 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6bca9b14-dc7c-4803-941e-02a4372ccd2b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:16.683904 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c19a0dd4-aa77-4674-b595-59a486659b5d req-ef029c60-420b-4063-b7e8-7a084ca48d58 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:16.684354 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c19a0dd4-aa77-4674-b595-59a486659b5d req-ef029c60-420b-4063-b7e8-7a084ca48d58 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:16.696336 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-c19a0dd4-aa77-4674-b595-59a486659b5d req-ef029c60-420b-4063-b7e8-7a084ca48d58 service nova] Creating event network-changed:be6f1d93-71fd-4590-a692-85e9f6f6c86b for instance 836693e0-6da6-453c-ae50-8595401eeaa6 on n-h1-master-1 Jul 31 01:52:16.701421 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-c19a0dd4-aa77-4674-b595-59a486659b5d req-ef029c60-420b-4063-b7e8-7a084ca48d58 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034051 Jul 31 01:52:16.702649 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3089/6149] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:52:16.829581 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6bca9b14-dc7c-4803-941e-02a4372ccd2b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:16.840101 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6bca9b14-dc7c-4803-941e-02a4372ccd2b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1564 microversion: 2.1 time: 0.176071 Jul 31 01:52:16.840961 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3061/6150] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:16 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:17.388998 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-bb1a1708-f06f-483b-9832-1e3b1d9898cb req-b8c7df59-40b9-4ec6-bc8f-617b3dd9db83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e736db7f-287e-4b48-92e5-23c3d1b5369b", "tag": "1ea132e6-d2b3-4bbf-8e6e-5903b8eaca0e"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:17.398760 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-bb1a1708-f06f-483b-9832-1e3b1d9898cb req-b8c7df59-40b9-4ec6-bc8f-617b3dd9db83 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:17.399220 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-bb1a1708-f06f-483b-9832-1e3b1d9898cb req-b8c7df59-40b9-4ec6-bc8f-617b3dd9db83 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:17.414228 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-bb1a1708-f06f-483b-9832-1e3b1d9898cb req-b8c7df59-40b9-4ec6-bc8f-617b3dd9db83 service nova] Creating event network-changed:1ea132e6-d2b3-4bbf-8e6e-5903b8eaca0e for instance e736db7f-287e-4b48-92e5-23c3d1b5369b on n-h2-master-1 Jul 31 01:52:17.419081 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-bb1a1708-f06f-483b-9832-1e3b1d9898cb req-b8c7df59-40b9-4ec6-bc8f-617b3dd9db83 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034351 Jul 31 01:52:17.419764 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3090/6151] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:52:28.950886 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3688174d-2f62-449c-a054-88dbbcaf7149 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:28.951667 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3688174d-2f62-449c-a054-88dbbcaf7149 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:28.955662 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=19 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:28.956324 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=61 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:28.961343 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3688174d-2f62-449c-a054-88dbbcaf7149 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:28.961814 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3688174d-2f62-449c-a054-88dbbcaf7149 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:28.962607 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3688174d-2f62-449c-a054-88dbbcaf7149 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:28.963097 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3688174d-2f62-449c-a054-88dbbcaf7149 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:28.987719 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3688174d-2f62-449c-a054-88dbbcaf7149 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/ips" status: 200 len: 150 microversion: 2.1 time: 0.041358 Jul 31 01:52:28.988306 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3062/6152] 10.222.0.45 () {58 vars in 1248 bytes} [Sun Jul 31 01:52:28 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:52:30.337085 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=13 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:30.337773 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=38 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:30.342062 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8fc0e5ed-258e-4a3c-a6ff-05623ad91068 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1af0c0da-aec8-4b20-a584-aa23125bee1e"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:30.344534 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8fc0e5ed-258e-4a3c-a6ff-05623ad91068 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:30.352089 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fc0e5ed-258e-4a3c-a6ff-05623ad91068 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:30.352547 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fc0e5ed-258e-4a3c-a6ff-05623ad91068 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:30.353318 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fc0e5ed-258e-4a3c-a6ff-05623ad91068 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:30.353762 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8fc0e5ed-258e-4a3c-a6ff-05623ad91068 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:30.615610 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8fc0e5ed-258e-4a3c-a6ff-05623ad91068 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "POST /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280175 Jul 31 01:52:30.616264 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3091/6153] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:52:30 2022] POST /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:52:38.100178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-87b7f715-9b7c-47f5-910b-10b775631f11 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:38.102709 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-87b7f715-9b7c-47f5-910b-10b775631f11 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:38.109464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87b7f715-9b7c-47f5-910b-10b775631f11 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:38.109936 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87b7f715-9b7c-47f5-910b-10b775631f11 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:38.110754 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87b7f715-9b7c-47f5-910b-10b775631f11 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:38.111773 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87b7f715-9b7c-47f5-910b-10b775631f11 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:38.174644 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-87b7f715-9b7c-47f5-910b-10b775631f11 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6/action" status: 200 len: 24566 microversion: 2.1 time: 0.078277 Jul 31 01:52:38.175291 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3063/6154] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:52:38 2022] POST /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6/action => generated 24566 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:52:41.349318 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:41.350200 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:41.354531 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c1b78cf5-33cb-4e71-979d-f6aac91edac4 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Action: 'create', calling method: .version_select at 0x7fede5e7ed30>, body: {"keypair": {"name": "tempest-keypair-1940822891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI326p9trhTOsahZejulxoY1oNV5j4uuYYRpYnzRw6Sl/Ya9CIuqOrewz38AtalxogoWeJNtPN94mEeUxpsU543U3NLF3mEL6CitMTlPlG2c77doLmGI3SCzpl8T6SXRQA=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:41.372569 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-c1b78cf5-33cb-4e71-979d-f6aac91edac4 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Getting quotas for project 29818dc3fb6e4de198be5662dc764989. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:52:41.378267 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-c1b78cf5-33cb-4e71-979d-f6aac91edac4 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Getting quotas for user 145ff42ae8134ad697f09fd339933bb9 and project 29818dc3fb6e4de198be5662dc764989. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:52:41.402568 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c1b78cf5-33cb-4e71-979d-f6aac91edac4 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055056 Jul 31 01:52:41.403169 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3092/6155] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:52:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:52:42.649568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e2d0b852-0ef7-40c5-9da8-44572db447f0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1195544720", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c763115-7f67-4122-8316-1251598f7da5"}], "security_groups": [{"name": "tempest-securitygroup--666349596"}], "key_name": "tempest-keypair-1940822891", "user_data": "}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:42.755569 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-e2d0b852-0ef7-40c5-9da8-44572db447f0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] validate_networks() for [('3c763115-7f67-4122-8316-1251598f7da5', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:52:43.132034 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e2d0b852-0ef7-40c5-9da8-44572db447f0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:52:43.132475 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e2d0b852-0ef7-40c5-9da8-44572db447f0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:52:43.132969 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e2d0b852-0ef7-40c5-9da8-44572db447f0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:52:43.133402 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e2d0b852-0ef7-40c5-9da8-44572db447f0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:52:43.133831 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e2d0b852-0ef7-40c5-9da8-44572db447f0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:52:43.142785 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2d0b852-0ef7-40c5-9da8-44572db447f0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:43.143819 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2d0b852-0ef7-40c5-9da8-44572db447f0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:43.144634 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2d0b852-0ef7-40c5-9da8-44572db447f0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:43.145088 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2d0b852-0ef7-40c5-9da8-44572db447f0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:43.161600 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-e2d0b852-0ef7-40c5-9da8-44572db447f0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Getting quotas for project 29818dc3fb6e4de198be5662dc764989. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:52:43.166794 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-e2d0b852-0ef7-40c5-9da8-44572db447f0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Getting quotas for user 145ff42ae8134ad697f09fd339933bb9 and project 29818dc3fb6e4de198be5662dc764989. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:52:43.179039 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e2d0b852-0ef7-40c5-9da8-44572db447f0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:52:43.181478 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e2d0b852-0ef7-40c5-9da8-44572db447f0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:52:43.227193 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e2d0b852-0ef7-40c5-9da8-44572db447f0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.582317 Jul 31 01:52:43.227886 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3064/6156] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:52:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:52:43.240563 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a16efcbd-2a65-498c-99ae-077071803b2e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:43.241673 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a16efcbd-2a65-498c-99ae-077071803b2e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:43.296559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a16efcbd-2a65-498c-99ae-077071803b2e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:43.304910 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a16efcbd-2a65-498c-99ae-077071803b2e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 200 len: 1242 microversion: 2.1 time: 0.069916 Jul 31 01:52:43.306592 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3093/6157] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:43 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:44.327371 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-73664c86-5174-4a08-a4b4-cc062bde3418 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:44.328006 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-73664c86-5174-4a08-a4b4-cc062bde3418 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:44.340359 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73664c86-5174-4a08-a4b4-cc062bde3418 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:44.340842 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73664c86-5174-4a08-a4b4-cc062bde3418 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:44.341666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73664c86-5174-4a08-a4b4-cc062bde3418 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:44.342134 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-73664c86-5174-4a08-a4b4-cc062bde3418 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:44.423798 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-73664c86-5174-4a08-a4b4-cc062bde3418 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:44.436637 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-73664c86-5174-4a08-a4b4-cc062bde3418 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 200 len: 1312 microversion: 2.1 time: 0.114267 Jul 31 01:52:44.438133 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3065/6158] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:44 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:44.770732 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-772de565-e1a7-4baa-b7cc-cb2b0a706528 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:44.772146 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-772de565-e1a7-4baa-b7cc-cb2b0a706528 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:44.772422 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1c270e07-97e8-4c9f-a444-52fd82461287 req-506689a5-1b2c-4d2b-be48-eb135e748f90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e736db7f-287e-4b48-92e5-23c3d1b5369b", "tag": "1ea132e6-d2b3-4bbf-8e6e-5903b8eaca0e"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:44.784074 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1c270e07-97e8-4c9f-a444-52fd82461287 req-506689a5-1b2c-4d2b-be48-eb135e748f90 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:44.784658 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1c270e07-97e8-4c9f-a444-52fd82461287 req-506689a5-1b2c-4d2b-be48-eb135e748f90 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:44.785022 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-772de565-e1a7-4baa-b7cc-cb2b0a706528 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:44.785729 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-772de565-e1a7-4baa-b7cc-cb2b0a706528 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:44.787490 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-772de565-e1a7-4baa-b7cc-cb2b0a706528 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:44.788215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-772de565-e1a7-4baa-b7cc-cb2b0a706528 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:44.798005 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1c270e07-97e8-4c9f-a444-52fd82461287 req-506689a5-1b2c-4d2b-be48-eb135e748f90 service nova] Creating event network-changed:1ea132e6-d2b3-4bbf-8e6e-5903b8eaca0e for instance e736db7f-287e-4b48-92e5-23c3d1b5369b on n-h2-master-1 Jul 31 01:52:44.805814 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1c270e07-97e8-4c9f-a444-52fd82461287 req-506689a5-1b2c-4d2b-be48-eb135e748f90 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041376 Jul 31 01:52:44.809855 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3066/6159] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:52:44.826299 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-772de565-e1a7-4baa-b7cc-cb2b0a706528 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:52:44.951594 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-772de565-e1a7-4baa-b7cc-cb2b0a706528 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 204 len: 0 microversion: 2.1 time: 0.190222 Jul 31 01:52:44.954910 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3094/6160] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:52:44 2022] DELETE /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:52:44.964637 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-61a7c5de-c1d8-4a40-a96b-4ba4868d11b8 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:44.965629 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-61a7c5de-c1d8-4a40-a96b-4ba4868d11b8 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:44.972510 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61a7c5de-c1d8-4a40-a96b-4ba4868d11b8 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:44.973211 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61a7c5de-c1d8-4a40-a96b-4ba4868d11b8 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:44.974509 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61a7c5de-c1d8-4a40-a96b-4ba4868d11b8 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:44.975153 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-61a7c5de-c1d8-4a40-a96b-4ba4868d11b8 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:45.226527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-61a7c5de-c1d8-4a40-a96b-4ba4868d11b8 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:45.245296 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-61a7c5de-c1d8-4a40-a96b-4ba4868d11b8 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1585 microversion: 2.1 time: 0.285186 Jul 31 01:52:45.246635 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3067/6161] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:44 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1585 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:45.459789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a0bb13e4-5cc6-4544-a440-3c03f2115f52 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:45.460525 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a0bb13e4-5cc6-4544-a440-3c03f2115f52 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:45.467613 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0bb13e4-5cc6-4544-a440-3c03f2115f52 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:45.468074 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0bb13e4-5cc6-4544-a440-3c03f2115f52 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:45.468862 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0bb13e4-5cc6-4544-a440-3c03f2115f52 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:45.469306 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0bb13e4-5cc6-4544-a440-3c03f2115f52 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:45.651766 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a0bb13e4-5cc6-4544-a440-3c03f2115f52 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:45.666510 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a0bb13e4-5cc6-4544-a440-3c03f2115f52 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 200 len: 1367 microversion: 2.1 time: 0.211285 Jul 31 01:52:45.667375 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3095/6162] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:45 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:46.269059 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-62e81730-2d01-439a-95de-67fdba7d0be3 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:46.270377 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-62e81730-2d01-439a-95de-67fdba7d0be3 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:46.278409 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62e81730-2d01-439a-95de-67fdba7d0be3 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:46.278965 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62e81730-2d01-439a-95de-67fdba7d0be3 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:46.280223 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62e81730-2d01-439a-95de-67fdba7d0be3 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:46.280792 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62e81730-2d01-439a-95de-67fdba7d0be3 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:46.504414 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-62e81730-2d01-439a-95de-67fdba7d0be3 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:46.513157 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-62e81730-2d01-439a-95de-67fdba7d0be3 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1585 microversion: 2.1 time: 0.248780 Jul 31 01:52:46.514461 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3068/6163] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:46 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1585 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:52:46.690813 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-298801fd-a14d-41c8-b69a-38bd2f54fe66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:46.691619 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-298801fd-a14d-41c8-b69a-38bd2f54fe66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:46.699263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-298801fd-a14d-41c8-b69a-38bd2f54fe66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:46.700112 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-298801fd-a14d-41c8-b69a-38bd2f54fe66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:46.702501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-298801fd-a14d-41c8-b69a-38bd2f54fe66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:46.703449 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-298801fd-a14d-41c8-b69a-38bd2f54fe66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:46.865817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-b5c46f57-9b39-475e-bbc1-b59e935adfdf req-aaa4429d-4afd-4587-a3f0-892806ca937b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b653a5-553a-4e7e-afa3-aa1e5b57f90f", "tag": "440c0f37-ddca-4d9f-8cda-a77133dbd106"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:46.878339 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b5c46f57-9b39-475e-bbc1-b59e935adfdf req-aaa4429d-4afd-4587-a3f0-892806ca937b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:46.879321 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b5c46f57-9b39-475e-bbc1-b59e935adfdf req-aaa4429d-4afd-4587-a3f0-892806ca937b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:46.892554 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-b5c46f57-9b39-475e-bbc1-b59e935adfdf req-aaa4429d-4afd-4587-a3f0-892806ca937b service nova] Creating event network-changed:440c0f37-ddca-4d9f-8cda-a77133dbd106 for instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f on n-h2-master-1 Jul 31 01:52:46.898939 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-b5c46f57-9b39-475e-bbc1-b59e935adfdf req-aaa4429d-4afd-4587-a3f0-892806ca937b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038987 Jul 31 01:52:46.900497 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3069/6164] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:52:46.929573 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-298801fd-a14d-41c8-b69a-38bd2f54fe66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:46.939474 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-298801fd-a14d-41c8-b69a-38bd2f54fe66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 200 len: 1367 microversion: 2.1 time: 0.251658 Jul 31 01:52:46.940105 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3096/6165] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:46 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:47.166388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-2e16c922-3fb5-4dc9-860c-257e66c96d23 req-a959da8c-ad14-498a-82d7-7770c0c10e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e736db7f-287e-4b48-92e5-23c3d1b5369b", "name": "network-vif-deleted", "tag": "1ea132e6-d2b3-4bbf-8e6e-5903b8eaca0e"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:47.176138 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2e16c922-3fb5-4dc9-860c-257e66c96d23 req-a959da8c-ad14-498a-82d7-7770c0c10e74 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:47.176518 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2e16c922-3fb5-4dc9-860c-257e66c96d23 req-a959da8c-ad14-498a-82d7-7770c0c10e74 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:47.188587 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-2e16c922-3fb5-4dc9-860c-257e66c96d23 req-a959da8c-ad14-498a-82d7-7770c0c10e74 service nova] Creating event network-vif-deleted:1ea132e6-d2b3-4bbf-8e6e-5903b8eaca0e for instance e736db7f-287e-4b48-92e5-23c3d1b5369b on n-h2-master-1 Jul 31 01:52:47.194234 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-2e16c922-3fb5-4dc9-860c-257e66c96d23 req-a959da8c-ad14-498a-82d7-7770c0c10e74 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031852 Jul 31 01:52:47.194843 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3070/6166] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:52:47.538185 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cd586fbf-8707-41de-9c54-5d46acbac8e7 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:47.539170 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cd586fbf-8707-41de-9c54-5d46acbac8e7 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:47.545837 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd586fbf-8707-41de-9c54-5d46acbac8e7 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:47.546542 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd586fbf-8707-41de-9c54-5d46acbac8e7 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:47.547558 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd586fbf-8707-41de-9c54-5d46acbac8e7 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:47.548184 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cd586fbf-8707-41de-9c54-5d46acbac8e7 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:47.615205 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cd586fbf-8707-41de-9c54-5d46acbac8e7 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:47.622998 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cd586fbf-8707-41de-9c54-5d46acbac8e7 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1230 microversion: 2.1 time: 0.088766 Jul 31 01:52:47.623609 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3097/6167] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:47 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1230 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:47.961649 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8c89862f-47b6-4ec6-804b-8062ed07c4d7 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:47.962487 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8c89862f-47b6-4ec6-804b-8062ed07c4d7 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:47.973412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8c89862f-47b6-4ec6-804b-8062ed07c4d7 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:47.973992 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8c89862f-47b6-4ec6-804b-8062ed07c4d7 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:47.974789 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8c89862f-47b6-4ec6-804b-8062ed07c4d7 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:47.975239 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8c89862f-47b6-4ec6-804b-8062ed07c4d7 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:48.121529 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8c89862f-47b6-4ec6-804b-8062ed07c4d7 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:48.129609 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8c89862f-47b6-4ec6-804b-8062ed07c4d7 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 200 len: 1367 microversion: 2.1 time: 0.173026 Jul 31 01:52:48.130172 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3071/6168] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:47 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:48.645053 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bf10d003-64bc-462c-9c99-a5a103418ca1 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:48.645982 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bf10d003-64bc-462c-9c99-a5a103418ca1 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:48.652756 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf10d003-64bc-462c-9c99-a5a103418ca1 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:48.653351 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf10d003-64bc-462c-9c99-a5a103418ca1 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:48.654939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf10d003-64bc-462c-9c99-a5a103418ca1 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:48.655657 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf10d003-64bc-462c-9c99-a5a103418ca1 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:48.729030 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bf10d003-64bc-462c-9c99-a5a103418ca1 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:48.738213 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bf10d003-64bc-462c-9c99-a5a103418ca1 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1230 microversion: 2.1 time: 0.097770 Jul 31 01:52:48.738839 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3098/6169] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:48 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:52:49.150463 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-756283a2-3175-458c-ac15-db0bb471e158 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:49.150991 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-756283a2-3175-458c-ac15-db0bb471e158 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:49.158180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-756283a2-3175-458c-ac15-db0bb471e158 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:49.158638 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-756283a2-3175-458c-ac15-db0bb471e158 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:49.159943 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-756283a2-3175-458c-ac15-db0bb471e158 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:49.160392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-756283a2-3175-458c-ac15-db0bb471e158 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:49.231681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fd79c7c6-f133-4b5b-974c-1d5c7bb7ff20 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:49.232432 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fd79c7c6-f133-4b5b-974c-1d5c7bb7ff20 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:49.239885 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd79c7c6-f133-4b5b-974c-1d5c7bb7ff20 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:49.240802 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd79c7c6-f133-4b5b-974c-1d5c7bb7ff20 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:49.241748 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd79c7c6-f133-4b5b-974c-1d5c7bb7ff20 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:49.242396 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fd79c7c6-f133-4b5b-974c-1d5c7bb7ff20 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:49.320821 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-756283a2-3175-458c-ac15-db0bb471e158 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:49.329437 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-756283a2-3175-458c-ac15-db0bb471e158 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 200 len: 1367 microversion: 2.1 time: 0.182911 Jul 31 01:52:49.330012 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3072/6170] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:49 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:49.386070 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fd79c7c6-f133-4b5b-974c-1d5c7bb7ff20 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:49.394349 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fd79c7c6-f133-4b5b-974c-1d5c7bb7ff20 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1683 microversion: 2.1 time: 0.166683 Jul 31 01:52:49.394927 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3099/6171] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:49 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:52:49.497931 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-087bcfba-8dbb-4960-92ed-348716f3155f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:49.500207 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-087bcfba-8dbb-4960-92ed-348716f3155f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:49.506382 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-087bcfba-8dbb-4960-92ed-348716f3155f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:49.506846 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-087bcfba-8dbb-4960-92ed-348716f3155f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:49.507650 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-087bcfba-8dbb-4960-92ed-348716f3155f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:49.508102 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-087bcfba-8dbb-4960-92ed-348716f3155f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:49.574631 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-087bcfba-8dbb-4960-92ed-348716f3155f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6/action" status: 200 len: 32642 microversion: 2.1 time: 0.080395 Jul 31 01:52:49.582352 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3073/6172] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:52:49 2022] POST /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6/action => generated 32642 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:52:49.716449 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1573b61a-3701-4fa6-b30a-bc7df58aed11 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:49.717048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1573b61a-3701-4fa6-b30a-bc7df58aed11 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:49.724060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1573b61a-3701-4fa6-b30a-bc7df58aed11 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:49.724514 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1573b61a-3701-4fa6-b30a-bc7df58aed11 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:49.725285 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1573b61a-3701-4fa6-b30a-bc7df58aed11 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:49.725725 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1573b61a-3701-4fa6-b30a-bc7df58aed11 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:49.762596 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-555293dd-4b0d-4e3c-adb8-a5bdd45c0055 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:49.763327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-555293dd-4b0d-4e3c-adb8-a5bdd45c0055 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:49.771597 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-555293dd-4b0d-4e3c-adb8-a5bdd45c0055 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:49.772073 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-555293dd-4b0d-4e3c-adb8-a5bdd45c0055 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:49.772869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-555293dd-4b0d-4e3c-adb8-a5bdd45c0055 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:49.773420 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-555293dd-4b0d-4e3c-adb8-a5bdd45c0055 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:49.842175 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-555293dd-4b0d-4e3c-adb8-a5bdd45c0055 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:49.850147 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-555293dd-4b0d-4e3c-adb8-a5bdd45c0055 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1230 microversion: 2.1 time: 0.091802 Jul 31 01:52:49.851684 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3074/6173] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:49 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:52:49.885512 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1573b61a-3701-4fa6-b30a-bc7df58aed11 tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1834 microversion: 2.1 time: 0.172765 Jul 31 01:52:49.886100 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3100/6174] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:49 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1834 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:49.914032 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-203849c3-ed3a-4cd7-adaa-64c448603dee tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:49.916576 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-203849c3-ed3a-4cd7-adaa-64c448603dee tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:49.924931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-203849c3-ed3a-4cd7-adaa-64c448603dee tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:49.925407 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-203849c3-ed3a-4cd7-adaa-64c448603dee tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:49.926821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-203849c3-ed3a-4cd7-adaa-64c448603dee tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:49.927292 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-203849c3-ed3a-4cd7-adaa-64c448603dee tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:49.953428 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-203849c3-ed3a-4cd7-adaa-64c448603dee tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lazy-loading 'flavor' on Instance uuid 836693e0-6da6-453c-ae50-8595401eeaa6 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:52:49.966369 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-203849c3-ed3a-4cd7-adaa-64c448603dee tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Going to try to live migrate instance to another host {{(pid=119474) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Jul 31 01:52:50.350031 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-821d2928-2925-4759-b989-89ebcc7f5dd3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:50.350657 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-821d2928-2925-4759-b989-89ebcc7f5dd3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:50.357192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-821d2928-2925-4759-b989-89ebcc7f5dd3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:50.357692 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-821d2928-2925-4759-b989-89ebcc7f5dd3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:50.358479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-821d2928-2925-4759-b989-89ebcc7f5dd3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:50.358932 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-821d2928-2925-4759-b989-89ebcc7f5dd3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:50.525250 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-821d2928-2925-4759-b989-89ebcc7f5dd3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:50.543728 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-821d2928-2925-4759-b989-89ebcc7f5dd3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 200 len: 1367 microversion: 2.1 time: 0.196414 Jul 31 01:52:50.544098 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3101/6175] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:50 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:52:50.872424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-56a1d85d-27ce-44e1-8f9e-39154ebd2a0f tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:50.873218 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-56a1d85d-27ce-44e1-8f9e-39154ebd2a0f tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:50.888415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56a1d85d-27ce-44e1-8f9e-39154ebd2a0f tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:50.888969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56a1d85d-27ce-44e1-8f9e-39154ebd2a0f tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:50.889861 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56a1d85d-27ce-44e1-8f9e-39154ebd2a0f tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:50.890432 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56a1d85d-27ce-44e1-8f9e-39154ebd2a0f tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:50.957197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-56a1d85d-27ce-44e1-8f9e-39154ebd2a0f tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c112f6022494bdeb9ee7cd5d9ec31c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483fc54931f40ea8eba3508b60e158d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:50.965356 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-56a1d85d-27ce-44e1-8f9e-39154ebd2a0f tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 200 len: 1230 microversion: 2.1 time: 0.098326 Jul 31 01:52:50.966239 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3102/6176] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:50 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:51.416184 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-203849c3-ed3a-4cd7-adaa-64c448603dee tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6/action" status: 202 len: 0 microversion: 2.1 time: 1.506066 Jul 31 01:52:51.416896 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3075/6177] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:52:49 2022] POST /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6/action => generated 0 bytes in 1508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:52:51.426158 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ad23b430-65a2-448c-83a4-9e00e9fed4aa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:51.426942 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ad23b430-65a2-448c-83a4-9e00e9fed4aa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:51.434188 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad23b430-65a2-448c-83a4-9e00e9fed4aa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:51.434882 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad23b430-65a2-448c-83a4-9e00e9fed4aa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:51.435693 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad23b430-65a2-448c-83a4-9e00e9fed4aa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:51.436300 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad23b430-65a2-448c-83a4-9e00e9fed4aa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:51.570088 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fa9ab260-6b72-47cc-a495-27e6b17db15b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:51.570338 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fa9ab260-6b72-47cc-a495-27e6b17db15b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:51.578490 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa9ab260-6b72-47cc-a495-27e6b17db15b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:51.578950 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa9ab260-6b72-47cc-a495-27e6b17db15b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:51.579772 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa9ab260-6b72-47cc-a495-27e6b17db15b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:51.580222 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa9ab260-6b72-47cc-a495-27e6b17db15b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:51.589210 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ad23b430-65a2-448c-83a4-9e00e9fed4aa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:51.597325 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ad23b430-65a2-448c-83a4-9e00e9fed4aa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1693 microversion: 2.1 time: 0.175070 Jul 31 01:52:51.598332 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3103/6178] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:51 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:51.712599 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fa9ab260-6b72-47cc-a495-27e6b17db15b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:51.720569 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fa9ab260-6b72-47cc-a495-27e6b17db15b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 200 len: 1367 microversion: 2.1 time: 0.156967 Jul 31 01:52:51.721142 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3076/6179] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:51 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:52:51.986081 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-142342c6-a21b-4763-97c3-c97185296803 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:51.986877 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-142342c6-a21b-4763-97c3-c97185296803 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] [instance: e736db7f-287e-4b48-92e5-23c3d1b5369b] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:51.995474 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-142342c6-a21b-4763-97c3-c97185296803 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:51.996023 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-142342c6-a21b-4763-97c3-c97185296803 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:51.997060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-142342c6-a21b-4763-97c3-c97185296803 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:51.998874 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-142342c6-a21b-4763-97c3-c97185296803 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:52.013272 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-142342c6-a21b-4763-97c3-c97185296803 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] HTTP exception thrown: Instance e736db7f-287e-4b48-92e5-23c3d1b5369b could not be found. Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-142342c6-a21b-4763-97c3-c97185296803 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Request method failure captured: Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b HTTP/1.1 Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5d-xN5HwgrqdWSWTp7aPw00PhfzCKnEdj3eHST2CKFQHsnF79_oKnUu8VjYBxMxotX_kstVLwwKdL4P_4sVKh148bXWcXZMotxzPoLxLWu86jDbhtXUU7jSsBx2CSetBgja2rftQ4GT92RYksfEdUXCseF93zF4iSE-UhZ-Gyg4wIbI Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 7483fc54931f40ea8eba3508b60e158d Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestVolumeBackupRestore-1547569766 Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7483fc54931f40ea8eba3508b60e158d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/7483fc54931f40ea8eba3508b60e158d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/7483fc54931f40ea8eba3508b60e158d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_7483fc54931f40ea8eba3508b60e158d", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestVolumeBackupRestore-1547569766 Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 7483fc54931f40ea8eba3508b60e158d Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1547569766 Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestVolumeBackupRestore-1547569766-project Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 6c112f6022494bdeb9ee7cd5d9ec31c6 Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestVolumeBackupRestore-1547569766-project Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: exception: Instance e736db7f-287e-4b48-92e5-23c3d1b5369b could not be found. Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'e736db7f-287e-4b48-92e5-23c3d1b5369b'} Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e736db7f-287e-4b48-92e5-23c3d1b5369b could not be found. Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e736db7f-287e-4b48-92e5-23c3d1b5369b could not be found. Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:52:52.015517 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:52:52.020355 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:52:52.020355 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:52:52.020355 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:52:52.020355 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:52:52.020355 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:52:52.020355 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e736db7f-287e-4b48-92e5-23c3d1b5369b could not be found. Jul 31 01:52:52.020355 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:52:52.020355 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-142342c6-a21b-4763-97c3-c97185296803 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Returning 404 to user: Instance e736db7f-287e-4b48-92e5-23c3d1b5369b could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:52:52.020355 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-142342c6-a21b-4763-97c3-c97185296803 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b" status: 404 len: 111 microversion: 2.1 time: 0.035297 Jul 31 01:52:52.020355 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3104/6180] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:51 2022] GET /compute/v2.1/servers/e736db7f-287e-4b48-92e5-23c3d1b5369b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:52:52.072341 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-d521a94c-b4c7-4e4b-b4a3-782e294c7fe6 req-48775513-8dcb-4dfa-b633-84e1c9006bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b653a5-553a-4e7e-afa3-aa1e5b57f90f", "name": "network-vif-plugged", "status": "completed", "tag": "440c0f37-ddca-4d9f-8cda-a77133dbd106"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:52.091643 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d521a94c-b4c7-4e4b-b4a3-782e294c7fe6 req-48775513-8dcb-4dfa-b633-84e1c9006bc4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:52.092694 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d521a94c-b4c7-4e4b-b4a3-782e294c7fe6 req-48775513-8dcb-4dfa-b633-84e1c9006bc4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:52.109910 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-d521a94c-b4c7-4e4b-b4a3-782e294c7fe6 req-48775513-8dcb-4dfa-b633-84e1c9006bc4 service nova] Creating event network-vif-plugged:440c0f37-ddca-4d9f-8cda-a77133dbd106 for instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f on n-h2-master-1 Jul 31 01:52:52.118279 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-d521a94c-b4c7-4e4b-b4a3-782e294c7fe6 req-48775513-8dcb-4dfa-b633-84e1c9006bc4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052333 Jul 31 01:52:52.119306 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3077/6181] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:52:52.219851 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d725b71b-c76b-4ae2-b7e3-ec83616295a6 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] Calling method '.version_select at 0x7fede5e7ee50>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:52.241601 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d725b71b-c76b-4ae2-b7e3-ec83616295a6 tempest-TestVolumeBackupRestore-1547569766 tempest-TestVolumeBackupRestore-1547569766-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1549827024" status: 202 len: 0 microversion: 2.1 time: 0.025596 Jul 31 01:52:52.242205 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3105/6182] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 01:52:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1549827024 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:52:52.620625 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9465a4eb-a029-486a-bb6c-ba04e9a6e3b4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:52.621336 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9465a4eb-a029-486a-bb6c-ba04e9a6e3b4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:52.633364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9465a4eb-a029-486a-bb6c-ba04e9a6e3b4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:52.633843 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9465a4eb-a029-486a-bb6c-ba04e9a6e3b4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:52.634642 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9465a4eb-a029-486a-bb6c-ba04e9a6e3b4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:52.635907 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9465a4eb-a029-486a-bb6c-ba04e9a6e3b4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:52.742334 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6abf2337-9cf8-4aee-b0e4-e33f8f545a50 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:52.742962 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6abf2337-9cf8-4aee-b0e4-e33f8f545a50 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:52.751161 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6abf2337-9cf8-4aee-b0e4-e33f8f545a50 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:52.754751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6abf2337-9cf8-4aee-b0e4-e33f8f545a50 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:52.755745 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6abf2337-9cf8-4aee-b0e4-e33f8f545a50 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:52.756210 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6abf2337-9cf8-4aee-b0e4-e33f8f545a50 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:53.152858 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:53.174881 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:53.260048 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9465a4eb-a029-486a-bb6c-ba04e9a6e3b4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:53.271524 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9465a4eb-a029-486a-bb6c-ba04e9a6e3b4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1693 microversion: 2.1 time: 0.654736 Jul 31 01:52:53.283077 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3078/6183] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:52 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1693 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:53.302172 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:53.767667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6abf2337-9cf8-4aee-b0e4-e33f8f545a50 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:53.778995 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6abf2337-9cf8-4aee-b0e4-e33f8f545a50 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 200 len: 1367 microversion: 2.1 time: 1.041709 Jul 31 01:52:53.782058 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3106/6184] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:52 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 1367 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:52:53.845438 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-9bdc77d2-9833-47de-b9ce-40621a411176 req-9af946b9-13f0-4ca3-b412-f7473b9e87a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836693e0-6da6-453c-ae50-8595401eeaa6", "name": "network-vif-unplugged", "status": "completed", "tag": "be6f1d93-71fd-4590-a692-85e9f6f6c86b"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:53.881320 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9bdc77d2-9833-47de-b9ce-40621a411176 req-9af946b9-13f0-4ca3-b412-f7473b9e87a6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:53.881783 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9bdc77d2-9833-47de-b9ce-40621a411176 req-9af946b9-13f0-4ca3-b412-f7473b9e87a6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:53.904771 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-9bdc77d2-9833-47de-b9ce-40621a411176 req-9af946b9-13f0-4ca3-b412-f7473b9e87a6 service nova] Creating event network-vif-unplugged:be6f1d93-71fd-4590-a692-85e9f6f6c86b for instance 836693e0-6da6-453c-ae50-8595401eeaa6 on n-h1-master-1 Jul 31 01:52:53.913395 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-9bdc77d2-9833-47de-b9ce-40621a411176 req-9af946b9-13f0-4ca3-b412-f7473b9e87a6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.232051 Jul 31 01:52:53.914663 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3079/6185] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:52:54.302498 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1577ad81-b4c1-46ff-bfe0-51ed50eb67be tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:54.304702 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1577ad81-b4c1-46ff-bfe0-51ed50eb67be tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:54.317296 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1577ad81-b4c1-46ff-bfe0-51ed50eb67be tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:54.317879 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1577ad81-b4c1-46ff-bfe0-51ed50eb67be tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:54.318751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1577ad81-b4c1-46ff-bfe0-51ed50eb67be tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:54.319775 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1577ad81-b4c1-46ff-bfe0-51ed50eb67be tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:54.495758 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1577ad81-b4c1-46ff-bfe0-51ed50eb67be tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:54.506135 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1577ad81-b4c1-46ff-bfe0-51ed50eb67be tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1693 microversion: 2.1 time: 0.213116 Jul 31 01:52:54.507647 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3107/6186] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:54 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1693 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:54.809317 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7e7ed041-080d-4be6-8b8b-193762dd5ded tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:54.810182 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7e7ed041-080d-4be6-8b8b-193762dd5ded tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:54.819525 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e7ed041-080d-4be6-8b8b-193762dd5ded tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:54.820265 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e7ed041-080d-4be6-8b8b-193762dd5ded tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:54.821356 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e7ed041-080d-4be6-8b8b-193762dd5ded tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:54.822174 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e7ed041-080d-4be6-8b8b-193762dd5ded tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:55.008781 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7e7ed041-080d-4be6-8b8b-193762dd5ded tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:55.021494 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7e7ed041-080d-4be6-8b8b-193762dd5ded tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 200 len: 1558 microversion: 2.1 time: 0.218382 Jul 31 01:52:55.022122 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3080/6187] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:54 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:55.043210 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-47fa657b-99a3-4f62-86ae-6a4c9851c3b6 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:55.043660 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-47fa657b-99a3-4f62-86ae-6a4c9851c3b6 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:55.052719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47fa657b-99a3-4f62-86ae-6a4c9851c3b6 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:55.053182 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47fa657b-99a3-4f62-86ae-6a4c9851c3b6 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:55.053979 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47fa657b-99a3-4f62-86ae-6a4c9851c3b6 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:55.054425 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-47fa657b-99a3-4f62-86ae-6a4c9851c3b6 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:55.164544 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-47fa657b-99a3-4f62-86ae-6a4c9851c3b6 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125534 Jul 31 01:52:55.165861 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3108/6188] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:52:55 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:52:55.529424 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-66183967-7a6e-4581-a91d-4b7a09993628 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:55.530292 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-66183967-7a6e-4581-a91d-4b7a09993628 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:55.540142 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66183967-7a6e-4581-a91d-4b7a09993628 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:55.544620 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66183967-7a6e-4581-a91d-4b7a09993628 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:55.545649 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66183967-7a6e-4581-a91d-4b7a09993628 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:55.547952 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66183967-7a6e-4581-a91d-4b7a09993628 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:55.863832 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-66183967-7a6e-4581-a91d-4b7a09993628 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:55.871943 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:55.878802 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-66183967-7a6e-4581-a91d-4b7a09993628 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1693 microversion: 2.1 time: 0.353335 Jul 31 01:52:55.896431 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3081/6189] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:55 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1693 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:55.964050 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-61ae9085-c58b-4ef6-bae9-b71ffcb227e1 req-89b7f34c-6e1a-43b6-87e2-7d4bf80a47d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836693e0-6da6-453c-ae50-8595401eeaa6", "tag": "be6f1d93-71fd-4590-a692-85e9f6f6c86b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:56.017845 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-61ae9085-c58b-4ef6-bae9-b71ffcb227e1 req-89b7f34c-6e1a-43b6-87e2-7d4bf80a47d9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:56.019062 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-61ae9085-c58b-4ef6-bae9-b71ffcb227e1 req-89b7f34c-6e1a-43b6-87e2-7d4bf80a47d9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:56.045715 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-61ae9085-c58b-4ef6-bae9-b71ffcb227e1 req-89b7f34c-6e1a-43b6-87e2-7d4bf80a47d9 service nova] Creating event network-changed:be6f1d93-71fd-4590-a692-85e9f6f6c86b for instance 836693e0-6da6-453c-ae50-8595401eeaa6 on n-h1-master-1 Jul 31 01:52:56.056720 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-61ae9085-c58b-4ef6-bae9-b71ffcb227e1 req-89b7f34c-6e1a-43b6-87e2-7d4bf80a47d9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129351 Jul 31 01:52:56.060078 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3109/6190] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:52:57.014513 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7fea21af-0166-46b9-baab-c2cd5b360a9e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:57.015165 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7fea21af-0166-46b9-baab-c2cd5b360a9e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:57.026220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fea21af-0166-46b9-baab-c2cd5b360a9e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:57.030869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fea21af-0166-46b9-baab-c2cd5b360a9e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:57.038379 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fea21af-0166-46b9-baab-c2cd5b360a9e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:57.039093 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fea21af-0166-46b9-baab-c2cd5b360a9e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:57.100994 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-e3a49d75-1e60-4e1f-a2ce-eee9aab0ac06 req-f3e171c6-f46b-4c61-8571-f2fbd2debdf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b653a5-553a-4e7e-afa3-aa1e5b57f90f", "tag": "440c0f37-ddca-4d9f-8cda-a77133dbd106"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:52:57.121174 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e3a49d75-1e60-4e1f-a2ce-eee9aab0ac06 req-f3e171c6-f46b-4c61-8571-f2fbd2debdf2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:57.122118 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e3a49d75-1e60-4e1f-a2ce-eee9aab0ac06 req-f3e171c6-f46b-4c61-8571-f2fbd2debdf2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:57.139470 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-e3a49d75-1e60-4e1f-a2ce-eee9aab0ac06 req-f3e171c6-f46b-4c61-8571-f2fbd2debdf2 service nova] Creating event network-changed:440c0f37-ddca-4d9f-8cda-a77133dbd106 for instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f on n-h2-master-1 Jul 31 01:52:57.145408 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-e3a49d75-1e60-4e1f-a2ce-eee9aab0ac06 req-f3e171c6-f46b-4c61-8571-f2fbd2debdf2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049039 Jul 31 01:52:57.146669 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3110/6191] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:52:57.415479 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7fea21af-0166-46b9-baab-c2cd5b360a9e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:57.428144 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7fea21af-0166-46b9-baab-c2cd5b360a9e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1693 microversion: 2.1 time: 0.529830 Jul 31 01:52:57.429397 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3082/6192] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:56 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1693 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:52:58.452126 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-403a9f65-dcca-41e8-b2e8-f6d5960d0556 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:58.452847 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-403a9f65-dcca-41e8-b2e8-f6d5960d0556 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:58.460335 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-403a9f65-dcca-41e8-b2e8-f6d5960d0556 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:58.460886 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-403a9f65-dcca-41e8-b2e8-f6d5960d0556 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:58.461748 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-403a9f65-dcca-41e8-b2e8-f6d5960d0556 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:58.462502 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-403a9f65-dcca-41e8-b2e8-f6d5960d0556 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:58.694049 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-403a9f65-dcca-41e8-b2e8-f6d5960d0556 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:52:58.701703 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-403a9f65-dcca-41e8-b2e8-f6d5960d0556 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1693 microversion: 2.1 time: 0.254791 Jul 31 01:52:58.702293 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3111/6193] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:58 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1693 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:52:59.722686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ad2a3be0-f9e0-4e23-8304-7026763f2da5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:52:59.723323 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ad2a3be0-f9e0-4e23-8304-7026763f2da5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:52:59.726366 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:52:59.732952 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad2a3be0-f9e0-4e23-8304-7026763f2da5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:59.733663 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad2a3be0-f9e0-4e23-8304-7026763f2da5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:52:59.734693 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad2a3be0-f9e0-4e23-8304-7026763f2da5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:52:59.735182 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad2a3be0-f9e0-4e23-8304-7026763f2da5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:00.286406 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ad2a3be0-f9e0-4e23-8304-7026763f2da5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:00.294369 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ad2a3be0-f9e0-4e23-8304-7026763f2da5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1693 microversion: 2.1 time: 0.576078 Jul 31 01:53:00.306688 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3083/6194] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:52:59 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1693 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:01.316258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7d6fa285-2eb2-4e28-8cbd-43f2aed94410 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:01.317489 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7d6fa285-2eb2-4e28-8cbd-43f2aed94410 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:01.324890 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7d6fa285-2eb2-4e28-8cbd-43f2aed94410 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:01.325436 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7d6fa285-2eb2-4e28-8cbd-43f2aed94410 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:01.326244 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7d6fa285-2eb2-4e28-8cbd-43f2aed94410 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:01.326703 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7d6fa285-2eb2-4e28-8cbd-43f2aed94410 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:01.331601 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:53:01.635032 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7d6fa285-2eb2-4e28-8cbd-43f2aed94410 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:01.643450 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7d6fa285-2eb2-4e28-8cbd-43f2aed94410 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1693 microversion: 2.1 time: 0.330500 Jul 31 01:53:01.657685 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3112/6195] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:01 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1693 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:02.664776 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1fce5411-4f28-49ed-86b9-bdae89b441ab tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:02.665429 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1fce5411-4f28-49ed-86b9-bdae89b441ab tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:02.672369 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fce5411-4f28-49ed-86b9-bdae89b441ab tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:02.672828 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fce5411-4f28-49ed-86b9-bdae89b441ab tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:02.673625 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fce5411-4f28-49ed-86b9-bdae89b441ab tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:02.674257 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fce5411-4f28-49ed-86b9-bdae89b441ab tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:02.841414 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1fce5411-4f28-49ed-86b9-bdae89b441ab tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:02.849758 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1fce5411-4f28-49ed-86b9-bdae89b441ab tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1683 microversion: 2.1 time: 0.188848 Jul 31 01:53:02.850891 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3084/6196] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:02 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:02.871397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-26e0fc14-2c5a-40d0-a880-bf6180692a9d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:02.872663 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-26e0fc14-2c5a-40d0-a880-bf6180692a9d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:02.880308 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-26e0fc14-2c5a-40d0-a880-bf6180692a9d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:02.880775 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-26e0fc14-2c5a-40d0-a880-bf6180692a9d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:02.881774 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-26e0fc14-2c5a-40d0-a880-bf6180692a9d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:02.882222 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-26e0fc14-2c5a-40d0-a880-bf6180692a9d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:03.034429 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-26e0fc14-2c5a-40d0-a880-bf6180692a9d tempest-TestNetworkAdvancedServerOps-1394200605 tempest-TestNetworkAdvancedServerOps-1394200605-project-admin] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1834 microversion: 2.1 time: 0.166683 Jul 31 01:53:03.044661 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3113/6197] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:02 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1834 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:03.057968 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63d08f20-e2e3-4353-b3e0-e36cff2f7b5e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:03.058595 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-63d08f20-e2e3-4353-b3e0-e36cff2f7b5e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:03.065567 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63d08f20-e2e3-4353-b3e0-e36cff2f7b5e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:03.066388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63d08f20-e2e3-4353-b3e0-e36cff2f7b5e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:03.067314 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63d08f20-e2e3-4353-b3e0-e36cff2f7b5e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:03.067993 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63d08f20-e2e3-4353-b3e0-e36cff2f7b5e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:03.217560 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-63d08f20-e2e3-4353-b3e0-e36cff2f7b5e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:03.226210 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-63d08f20-e2e3-4353-b3e0-e36cff2f7b5e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1683 microversion: 2.1 time: 0.172144 Jul 31 01:53:03.226800 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3085/6198] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:03 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:05.335139 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4dbfde3f-91d7-404a-bd3c-4485279500a3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:05.337588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4dbfde3f-91d7-404a-bd3c-4485279500a3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:05.344711 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4dbfde3f-91d7-404a-bd3c-4485279500a3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:05.345090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4dbfde3f-91d7-404a-bd3c-4485279500a3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:05.345924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4dbfde3f-91d7-404a-bd3c-4485279500a3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:05.346876 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4dbfde3f-91d7-404a-bd3c-4485279500a3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:05.418927 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4dbfde3f-91d7-404a-bd3c-4485279500a3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6/action" status: 200 len: 38627 microversion: 2.1 time: 0.087488 Jul 31 01:53:05.419838 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3114/6199] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:53:05 2022] POST /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6/action => generated 38627 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:53:06.752567 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fd5055b9-3da3-43f3-b6fc-c3b013de295c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:06.753117 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fd5055b9-3da3-43f3-b6fc-c3b013de295c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:06.755908 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f088286e-d12f-4485-8d5f-f1c090fd8868 req-0b2fecf8-8814-400f-a3d6-5d5381396998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836693e0-6da6-453c-ae50-8595401eeaa6", "tag": "be6f1d93-71fd-4590-a692-85e9f6f6c86b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:06.760290 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd5055b9-3da3-43f3-b6fc-c3b013de295c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:06.760964 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd5055b9-3da3-43f3-b6fc-c3b013de295c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:06.761760 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd5055b9-3da3-43f3-b6fc-c3b013de295c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:06.762374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd5055b9-3da3-43f3-b6fc-c3b013de295c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:06.766813 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f088286e-d12f-4485-8d5f-f1c090fd8868 req-0b2fecf8-8814-400f-a3d6-5d5381396998 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:06.767269 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f088286e-d12f-4485-8d5f-f1c090fd8868 req-0b2fecf8-8814-400f-a3d6-5d5381396998 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:06.780900 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f088286e-d12f-4485-8d5f-f1c090fd8868 req-0b2fecf8-8814-400f-a3d6-5d5381396998 service nova] Creating event network-changed:be6f1d93-71fd-4590-a692-85e9f6f6c86b for instance 836693e0-6da6-453c-ae50-8595401eeaa6 on n-h2-master-1 Jul 31 01:53:06.786685 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f088286e-d12f-4485-8d5f-f1c090fd8868 req-0b2fecf8-8814-400f-a3d6-5d5381396998 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034914 Jul 31 01:53:06.787307 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3115/6200] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:53:06.793491 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fd5055b9-3da3-43f3-b6fc-c3b013de295c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:53:06.882042 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fd5055b9-3da3-43f3-b6fc-c3b013de295c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "DELETE /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 204 len: 0 microversion: 2.1 time: 0.133047 Jul 31 01:53:06.883078 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3086/6201] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:53:06 2022] DELETE /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:53:06.892627 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6d5fb8b6-cbcc-46c2-a3e0-794bfcee5bfa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:06.894129 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6d5fb8b6-cbcc-46c2-a3e0-794bfcee5bfa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:06.900620 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d5fb8b6-cbcc-46c2-a3e0-794bfcee5bfa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:06.901086 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d5fb8b6-cbcc-46c2-a3e0-794bfcee5bfa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:06.901872 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d5fb8b6-cbcc-46c2-a3e0-794bfcee5bfa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:06.902325 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6d5fb8b6-cbcc-46c2-a3e0-794bfcee5bfa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:07.041419 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6d5fb8b6-cbcc-46c2-a3e0-794bfcee5bfa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:07.049222 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6d5fb8b6-cbcc-46c2-a3e0-794bfcee5bfa tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1689 microversion: 2.1 time: 0.161624 Jul 31 01:53:07.049821 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3116/6202] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:06 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:08.072948 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e9f2383a-f4c9-4ac7-9323-38414f988c71 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:08.073897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e9f2383a-f4c9-4ac7-9323-38414f988c71 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:08.080793 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e9f2383a-f4c9-4ac7-9323-38414f988c71 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:08.081771 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e9f2383a-f4c9-4ac7-9323-38414f988c71 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:08.082559 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e9f2383a-f4c9-4ac7-9323-38414f988c71 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:08.083014 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e9f2383a-f4c9-4ac7-9323-38414f988c71 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:08.241661 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e9f2383a-f4c9-4ac7-9323-38414f988c71 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:08.249861 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e9f2383a-f4c9-4ac7-9323-38414f988c71 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 200 len: 1570 microversion: 2.1 time: 0.183240 Jul 31 01:53:08.250854 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3087/6203] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:08 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:08.251324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-55a5bee7-57fc-49c7-9d2f-3b4695d12377 req-135f74ff-3484-4d30-b5ce-748b5cf533b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836693e0-6da6-453c-ae50-8595401eeaa6", "name": "network-vif-deleted", "tag": "be6f1d93-71fd-4590-a692-85e9f6f6c86b"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:08.261688 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-55a5bee7-57fc-49c7-9d2f-3b4695d12377 req-135f74ff-3484-4d30-b5ce-748b5cf533b6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:08.262084 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-55a5bee7-57fc-49c7-9d2f-3b4695d12377 req-135f74ff-3484-4d30-b5ce-748b5cf533b6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:08.275942 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-55a5bee7-57fc-49c7-9d2f-3b4695d12377 req-135f74ff-3484-4d30-b5ce-748b5cf533b6 service nova] Creating event network-vif-deleted:be6f1d93-71fd-4590-a692-85e9f6f6c86b for instance 836693e0-6da6-453c-ae50-8595401eeaa6 on n-h2-master-1 Jul 31 01:53:08.280747 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-55a5bee7-57fc-49c7-9d2f-3b4695d12377 req-135f74ff-3484-4d30-b5ce-748b5cf533b6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033174 Jul 31 01:53:08.281351 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3117/6204] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:53:09.270913 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a89250d1-3962-4ad9-b560-b2c5f09828b6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:09.271602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a89250d1-3962-4ad9-b560-b2c5f09828b6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 836693e0-6da6-453c-ae50-8595401eeaa6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:09.278404 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a89250d1-3962-4ad9-b560-b2c5f09828b6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:09.278867 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a89250d1-3962-4ad9-b560-b2c5f09828b6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:09.279775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a89250d1-3962-4ad9-b560-b2c5f09828b6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:09.280220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a89250d1-3962-4ad9-b560-b2c5f09828b6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:09.293718 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-a89250d1-3962-4ad9-b560-b2c5f09828b6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] HTTP exception thrown: Instance 836693e0-6da6-453c-ae50-8595401eeaa6 could not be found. Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a89250d1-3962-4ad9-b560-b2c5f09828b6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Request method failure captured: Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 HTTP/1.1 Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5d9Kf4E3IZDZUsj11OUUTq3aW5TKVoTTbNXJKKFyTqRkWTfvcurnGmoWdsnkQBC06JOC-RzmfXv9UpgiSjIwgxiuii_gLTCRUhYfcSIeg4jSALKpm0sQONrNpVV2nG8N0HrFSmgFYp_LLq1OtetyO0y_1Ae7AWsoynrjLTPfogUx0M8 Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 736abaeccdf44e3899d98fdf2cac4c0f Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-882728420 Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/736abaeccdf44e3899d98fdf2cac4c0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/736abaeccdf44e3899d98fdf2cac4c0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/736abaeccdf44e3899d98fdf2cac4c0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_736abaeccdf44e3899d98fdf2cac4c0f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestNetworkAdvancedServerOps-882728420 Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 736abaeccdf44e3899d98fdf2cac4c0f Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-882728420 Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestNetworkAdvancedServerOps-882728420-project Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: b799c19fd26348d3a84198bb76581c87 Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestNetworkAdvancedServerOps-882728420-project Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 836693e0-6da6-453c-ae50-8595401eeaa6 could not be found. Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '836693e0-6da6-453c-ae50-8595401eeaa6'} Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 836693e0-6da6-453c-ae50-8595401eeaa6 could not be found. Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 836693e0-6da6-453c-ae50-8595401eeaa6 could not be found. Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:53:09.295327 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:09.300858 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:53:09.300858 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:53:09.300858 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:53:09.300858 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:53:09.300858 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:53:09.300858 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 836693e0-6da6-453c-ae50-8595401eeaa6 could not be found. Jul 31 01:53:09.300858 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:09.300858 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a89250d1-3962-4ad9-b560-b2c5f09828b6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Returning 404 to user: Instance 836693e0-6da6-453c-ae50-8595401eeaa6 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:53:09.300858 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a89250d1-3962-4ad9-b560-b2c5f09828b6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6" status: 404 len: 111 microversion: 2.1 time: 0.029757 Jul 31 01:53:09.300858 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3088/6205] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:09 2022] GET /compute/v2.1/servers/836693e0-6da6-453c-ae50-8595401eeaa6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:53:12.254042 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-08099565-7218-4671-8118-e2ec578eacec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '.version_select at 0x7fede5cb5940>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:12.263215 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:53:12.278304 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-08099565-7218-4671-8118-e2ec578eacec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1901530457" status: 202 len: 0 microversion: 2.1 time: 0.028807 Jul 31 01:53:12.279365 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3118/6206] 10.222.0.45 () {58 vars in 1284 bytes} [Sun Jul 31 01:53:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1901530457 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:53:12.308198 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9255b00d-9025-40e1-8c3c-a8327d71b7e3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'create', calling method: .version_select at 0x7fede4e1a0d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1811616414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwBIr324muAv2TY1t4lmZbcu8crITuDt+xE+V75ch99b/BBiamGlHdGLzm7QeVVBOpPloxpfOgMKijSelMoYXdieDEVx+Hx/0MJ/97Hqp4AB9X2Yy4+OKU7NZ5Y8/o54w=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:12.326445 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9255b00d-9025-40e1-8c3c-a8327d71b7e3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Getting quotas for project 736abaeccdf44e3899d98fdf2cac4c0f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:53:12.334022 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9255b00d-9025-40e1-8c3c-a8327d71b7e3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Getting quotas for user b799c19fd26348d3a84198bb76581c87 and project 736abaeccdf44e3899d98fdf2cac4c0f. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:53:12.358975 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9255b00d-9025-40e1-8c3c-a8327d71b7e3 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054904 Jul 31 01:53:12.363027 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3089/6207] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:53:12 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:53:18.022030 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-211e8f98-94c6-479e-be59-ea87737d1d0c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-402476895", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "5bee0c81-201c-4529-97a7-f735fe886414"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1811616414", "security_groups": [{"name": "tempest-secgroup-smoke-1350727149"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:18.147370 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-211e8f98-94c6-479e-be59-ea87737d1d0c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] validate_networks() for [('5bee0c81-201c-4529-97a7-f735fe886414', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:53:18.266911 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=24 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:53:18.574405 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-211e8f98-94c6-479e-be59-ea87737d1d0c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:53:18.574850 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-211e8f98-94c6-479e-be59-ea87737d1d0c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:53:18.575355 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-211e8f98-94c6-479e-be59-ea87737d1d0c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:53:18.575784 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-211e8f98-94c6-479e-be59-ea87737d1d0c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:53:18.576210 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-211e8f98-94c6-479e-be59-ea87737d1d0c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:53:18.585678 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-211e8f98-94c6-479e-be59-ea87737d1d0c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:18.586140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-211e8f98-94c6-479e-be59-ea87737d1d0c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:18.586963 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-211e8f98-94c6-479e-be59-ea87737d1d0c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:18.587445 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-211e8f98-94c6-479e-be59-ea87737d1d0c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:18.605436 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-211e8f98-94c6-479e-be59-ea87737d1d0c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Getting quotas for project 736abaeccdf44e3899d98fdf2cac4c0f. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:53:18.610780 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-211e8f98-94c6-479e-be59-ea87737d1d0c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Getting quotas for user b799c19fd26348d3a84198bb76581c87 and project 736abaeccdf44e3899d98fdf2cac4c0f. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:53:18.624243 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-211e8f98-94c6-479e-be59-ea87737d1d0c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:53:18.626652 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-211e8f98-94c6-479e-be59-ea87737d1d0c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:53:18.674079 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-211e8f98-94c6-479e-be59-ea87737d1d0c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.658814 Jul 31 01:53:18.681510 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3119/6208] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:53:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:53:18.688689 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-60eabe87-8d02-48c4-9ada-927e8f0a2c7e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:18.689369 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-60eabe87-8d02-48c4-9ada-927e8f0a2c7e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:18.753914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-60eabe87-8d02-48c4-9ada-927e8f0a2c7e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:18.760672 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-60eabe87-8d02-48c4-9ada-927e8f0a2c7e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1266 microversion: 2.1 time: 0.077077 Jul 31 01:53:18.761601 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3090/6209] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:18 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:19.781278 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eaaf9d48-e683-4441-8a76-eec8e33d228a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:19.782500 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eaaf9d48-e683-4441-8a76-eec8e33d228a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:19.790579 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eaaf9d48-e683-4441-8a76-eec8e33d228a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:19.792076 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eaaf9d48-e683-4441-8a76-eec8e33d228a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:19.793575 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eaaf9d48-e683-4441-8a76-eec8e33d228a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:19.794104 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eaaf9d48-e683-4441-8a76-eec8e33d228a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:19.877869 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eaaf9d48-e683-4441-8a76-eec8e33d228a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:19.886000 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eaaf9d48-e683-4441-8a76-eec8e33d228a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1336 microversion: 2.1 time: 0.108608 Jul 31 01:53:19.886597 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3120/6210] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:19 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1336 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:20.907706 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-947b7276-18b6-49cd-969f-cbab28683500 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:20.908362 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-947b7276-18b6-49cd-969f-cbab28683500 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:20.910429 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:53:20.917802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-947b7276-18b6-49cd-969f-cbab28683500 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:20.918278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-947b7276-18b6-49cd-969f-cbab28683500 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:20.919115 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-947b7276-18b6-49cd-969f-cbab28683500 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:20.919602 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-947b7276-18b6-49cd-969f-cbab28683500 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:21.084516 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-947b7276-18b6-49cd-969f-cbab28683500 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:21.092433 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-947b7276-18b6-49cd-969f-cbab28683500 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1392 microversion: 2.1 time: 0.189301 Jul 31 01:53:21.095388 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3091/6211] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:20 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:21.152289 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-8aa1c122-8f4f-4841-a33f-769130966e57 req-b613cedf-2bc3-4e95-9a47-75f12168f26e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1beeae60-b912-44b1-9832-58ac3b4ff2e5", "tag": "b414663b-1ae8-40e3-992e-1e1fe62210ba"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:21.170069 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8aa1c122-8f4f-4841-a33f-769130966e57 req-b613cedf-2bc3-4e95-9a47-75f12168f26e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:21.170923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8aa1c122-8f4f-4841-a33f-769130966e57 req-b613cedf-2bc3-4e95-9a47-75f12168f26e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:21.186357 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-8aa1c122-8f4f-4841-a33f-769130966e57 req-b613cedf-2bc3-4e95-9a47-75f12168f26e service nova] Creating event network-changed:b414663b-1ae8-40e3-992e-1e1fe62210ba for instance 1beeae60-b912-44b1-9832-58ac3b4ff2e5 on n-h1-master-1 Jul 31 01:53:21.193619 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-8aa1c122-8f4f-4841-a33f-769130966e57 req-b613cedf-2bc3-4e95-9a47-75f12168f26e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044713 Jul 31 01:53:21.195459 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3121/6212] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:53:22.113818 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d708ea65-3168-4b4e-9b52-a82fc46cf14e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:22.114482 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d708ea65-3168-4b4e-9b52-a82fc46cf14e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:22.121703 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d708ea65-3168-4b4e-9b52-a82fc46cf14e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:22.122183 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d708ea65-3168-4b4e-9b52-a82fc46cf14e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:22.122965 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d708ea65-3168-4b4e-9b52-a82fc46cf14e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:22.123464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d708ea65-3168-4b4e-9b52-a82fc46cf14e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:22.257677 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d708ea65-3168-4b4e-9b52-a82fc46cf14e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:22.266173 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d708ea65-3168-4b4e-9b52-a82fc46cf14e tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1392 microversion: 2.1 time: 0.156307 Jul 31 01:53:22.266742 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3092/6213] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:22 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:23.289000 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-98a606de-cb4d-41a6-8985-824427e1280d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:23.289637 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-98a606de-cb4d-41a6-8985-824427e1280d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:23.297681 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-98a606de-cb4d-41a6-8985-824427e1280d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:23.298142 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-98a606de-cb4d-41a6-8985-824427e1280d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:23.298923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-98a606de-cb4d-41a6-8985-824427e1280d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:23.299919 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-98a606de-cb4d-41a6-8985-824427e1280d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:23.443991 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-98a606de-cb4d-41a6-8985-824427e1280d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:23.451834 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-98a606de-cb4d-41a6-8985-824427e1280d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1392 microversion: 2.1 time: 0.167123 Jul 31 01:53:23.452431 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3122/6214] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:23 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:24.474126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-325efad8-4eb1-4de9-b27f-10ee09a1afaf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:24.474748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-325efad8-4eb1-4de9-b27f-10ee09a1afaf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:24.481671 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-325efad8-4eb1-4de9-b27f-10ee09a1afaf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:24.482133 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-325efad8-4eb1-4de9-b27f-10ee09a1afaf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:24.482902 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-325efad8-4eb1-4de9-b27f-10ee09a1afaf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:24.483362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-325efad8-4eb1-4de9-b27f-10ee09a1afaf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:24.610993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-325efad8-4eb1-4de9-b27f-10ee09a1afaf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:24.619218 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-325efad8-4eb1-4de9-b27f-10ee09a1afaf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1392 microversion: 2.1 time: 0.148974 Jul 31 01:53:24.619815 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3093/6215] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:24 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1392 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:25.640854 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-54846be2-c8dc-41cf-a4f1-ff39f796d217 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:25.641539 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-54846be2-c8dc-41cf-a4f1-ff39f796d217 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:25.648493 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54846be2-c8dc-41cf-a4f1-ff39f796d217 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:25.648962 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54846be2-c8dc-41cf-a4f1-ff39f796d217 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:25.649738 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54846be2-c8dc-41cf-a4f1-ff39f796d217 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:25.650199 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54846be2-c8dc-41cf-a4f1-ff39f796d217 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:25.787093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-54846be2-c8dc-41cf-a4f1-ff39f796d217 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:25.797356 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-54846be2-c8dc-41cf-a4f1-ff39f796d217 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1392 microversion: 2.1 time: 0.160338 Jul 31 01:53:25.797948 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3123/6216] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:25 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:26.819464 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-45e468f3-8fec-4985-9bc2-89a06df62723 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:26.820096 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-45e468f3-8fec-4985-9bc2-89a06df62723 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:26.827008 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-45e468f3-8fec-4985-9bc2-89a06df62723 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:26.827514 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-45e468f3-8fec-4985-9bc2-89a06df62723 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:26.828293 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-45e468f3-8fec-4985-9bc2-89a06df62723 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:26.828748 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-45e468f3-8fec-4985-9bc2-89a06df62723 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:26.960589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-45e468f3-8fec-4985-9bc2-89a06df62723 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:26.968428 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-45e468f3-8fec-4985-9bc2-89a06df62723 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1392 microversion: 2.1 time: 0.153449 Jul 31 01:53:26.969024 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3094/6217] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:26 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:27.500779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-81fbcbcf-762a-46e1-beba-0083168ba22a req-f3e21384-bcf5-4a9c-b3e2-ede22b202861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1beeae60-b912-44b1-9832-58ac3b4ff2e5", "name": "network-vif-plugged", "status": "completed", "tag": "b414663b-1ae8-40e3-992e-1e1fe62210ba"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:27.510310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-81fbcbcf-762a-46e1-beba-0083168ba22a req-f3e21384-bcf5-4a9c-b3e2-ede22b202861 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:27.510763 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-81fbcbcf-762a-46e1-beba-0083168ba22a req-f3e21384-bcf5-4a9c-b3e2-ede22b202861 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:27.522081 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-81fbcbcf-762a-46e1-beba-0083168ba22a req-f3e21384-bcf5-4a9c-b3e2-ede22b202861 service nova] Creating event network-vif-plugged:b414663b-1ae8-40e3-992e-1e1fe62210ba for instance 1beeae60-b912-44b1-9832-58ac3b4ff2e5 on n-h1-master-1 Jul 31 01:53:27.527011 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-81fbcbcf-762a-46e1-beba-0083168ba22a req-f3e21384-bcf5-4a9c-b3e2-ede22b202861 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156436 Jul 31 01:53:27.527637 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3124/6218] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:53:27.992258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-03cea3e8-8a94-46a9-9cf1-df4f99519d59 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:27.992917 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-03cea3e8-8a94-46a9-9cf1-df4f99519d59 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:27.999936 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03cea3e8-8a94-46a9-9cf1-df4f99519d59 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:28.000381 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03cea3e8-8a94-46a9-9cf1-df4f99519d59 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:28.001523 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03cea3e8-8a94-46a9-9cf1-df4f99519d59 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:28.001622 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-03cea3e8-8a94-46a9-9cf1-df4f99519d59 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:28.134813 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-03cea3e8-8a94-46a9-9cf1-df4f99519d59 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:28.142249 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-03cea3e8-8a94-46a9-9cf1-df4f99519d59 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1392 microversion: 2.1 time: 0.154158 Jul 31 01:53:28.142812 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3095/6219] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:27 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:29.161630 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:53:29.162435 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:53:29.167283 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-131ab547-1806-4b79-872a-8d28675b383b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:29.168028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-131ab547-1806-4b79-872a-8d28675b383b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:29.176459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-131ab547-1806-4b79-872a-8d28675b383b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:29.176867 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-131ab547-1806-4b79-872a-8d28675b383b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:29.177646 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-131ab547-1806-4b79-872a-8d28675b383b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:29.178099 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-131ab547-1806-4b79-872a-8d28675b383b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:29.307978 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-131ab547-1806-4b79-872a-8d28675b383b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:29.316390 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-131ab547-1806-4b79-872a-8d28675b383b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1564 microversion: 2.1 time: 0.156561 Jul 31 01:53:29.319216 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3125/6220] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:29 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:29.339316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3f13f5e5-5f42-4225-8334-7b596e403af0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:29.339968 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3f13f5e5-5f42-4225-8334-7b596e403af0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:29.341896 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:53:29.347982 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f13f5e5-5f42-4225-8334-7b596e403af0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:29.348448 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f13f5e5-5f42-4225-8334-7b596e403af0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:29.349226 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f13f5e5-5f42-4225-8334-7b596e403af0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:29.349712 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f13f5e5-5f42-4225-8334-7b596e403af0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:29.485093 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3f13f5e5-5f42-4225-8334-7b596e403af0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:29.493466 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3f13f5e5-5f42-4225-8334-7b596e403af0 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1564 microversion: 2.1 time: 0.158033 Jul 31 01:53:29.494037 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3096/6221] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:29 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:30.021165 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c3cc7a4c-60e5-4132-98a6-8eaa9b77d99c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:30.021600 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c3cc7a4c-60e5-4132-98a6-8eaa9b77d99c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:30.027778 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3cc7a4c-60e5-4132-98a6-8eaa9b77d99c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:30.028239 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3cc7a4c-60e5-4132-98a6-8eaa9b77d99c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:30.029026 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3cc7a4c-60e5-4132-98a6-8eaa9b77d99c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:30.029485 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3cc7a4c-60e5-4132-98a6-8eaa9b77d99c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:30.052988 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c3cc7a4c-60e5-4132-98a6-8eaa9b77d99c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f/ips" status: 200 len: 151 microversion: 2.1 time: 0.036628 Jul 31 01:53:30.053573 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3126/6222] 10.222.0.45 () {58 vars in 1248 bytes} [Sun Jul 31 01:53:30 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:53:30.064867 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-292603c7-9f4d-4822-ab77-7ce8bb7c8093 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1af0c0da-aec8-4b20-a584-aa23125bee1e"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:30.067424 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-292603c7-9f4d-4822-ab77-7ce8bb7c8093 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:30.070365 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:53:30.074152 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-292603c7-9f4d-4822-ab77-7ce8bb7c8093 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:30.074614 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-292603c7-9f4d-4822-ab77-7ce8bb7c8093 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:30.075448 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-292603c7-9f4d-4822-ab77-7ce8bb7c8093 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:30.075897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-292603c7-9f4d-4822-ab77-7ce8bb7c8093 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:30.157086 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-292603c7-9f4d-4822-ab77-7ce8bb7c8093 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] HTTP exception thrown: Invalid volume: volume 1af0c0da-aec8-4b20-a584-aa23125bee1e is already attached to instances: 1353bba5-65a1-4282-8c94-49e748b2b16d Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-292603c7-9f4d-4822-ab77-7ce8bb7c8093 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Request method failure captured: Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f/os-volume_attachments HTTP/1.1 Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 74 Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eArI_gg0PT5-mV1qvuSL56nJadb0JF4TL7uux8WXl3vok79f3uc98C7KYpH06iqd1o5cKdHNoOHQWtXYdIXh_OVDcfYH6kPL5MbcaUpikVPOXbVysh9krPcYr4kZ9fFwweKvXn3eXhTJHKVTngQ3MZesHwqBtr4Ap4TCwGoP0qN184 Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29818dc3fb6e4de198be5662dc764989", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 145ff42ae8134ad697f09fd339933bb9 Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: {"volumeAttachment": {"volumeId": "1af0c0da-aec8-4b20-a584-aa23125bee1e"}} Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid volume: volume 1af0c0da-aec8-4b20-a584-aa23125bee1e is already attached to instances: 1353bba5-65a1-4282-8c94-49e748b2b16d Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: action_args: {'server_id': 'd4b653a5-553a-4e7e-afa3-aa1e5b57f90f', 'body': {'volumeAttachment': {'volumeId': '1af0c0da-aec8-4b20-a584-aa23125bee1e'}}} Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1af0c0da-aec8-4b20-a584-aa23125bee1e is already attached to instances: 1353bba5-65a1-4282-8c94-49e748b2b16d Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:53:30.158837 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1af0c0da-aec8-4b20-a584-aa23125bee1e is already attached to instances: 1353bba5-65a1-4282-8c94-49e748b2b16d Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1af0c0da-aec8-4b20-a584-aa23125bee1e is already attached to instances: 1353bba5-65a1-4282-8c94-49e748b2b16d Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-292603c7-9f4d-4822-ab77-7ce8bb7c8093 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Returning 400 to user: Invalid volume: volume 1af0c0da-aec8-4b20-a584-aa23125bee1e is already attached to instances: 1353bba5-65a1-4282-8c94-49e748b2b16d {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-292603c7-9f4d-4822-ab77-7ce8bb7c8093 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "POST /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099892 Jul 31 01:53:30.163221 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3097/6223] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:53:30 2022] POST /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 31 01:53:30.169356 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d8d5774d-6187-4814-8c8b-971b81ec032c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:30.169869 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d8d5774d-6187-4814-8c8b-971b81ec032c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:30.177310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8d5774d-6187-4814-8c8b-971b81ec032c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:30.177772 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8d5774d-6187-4814-8c8b-971b81ec032c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:30.178548 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8d5774d-6187-4814-8c8b-971b81ec032c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:30.178995 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d8d5774d-6187-4814-8c8b-971b81ec032c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:30.205703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d8d5774d-6187-4814-8c8b-971b81ec032c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:53:30.286857 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d8d5774d-6187-4814-8c8b-971b81ec032c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 204 len: 0 microversion: 2.1 time: 0.120655 Jul 31 01:53:30.287548 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3127/6224] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:53:30 2022] DELETE /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:53:30.299845 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-be95090b-eb9c-4558-a291-720e2f8ff526 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:30.300745 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-be95090b-eb9c-4558-a291-720e2f8ff526 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:30.306965 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be95090b-eb9c-4558-a291-720e2f8ff526 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:30.307482 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be95090b-eb9c-4558-a291-720e2f8ff526 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:30.308264 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be95090b-eb9c-4558-a291-720e2f8ff526 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:30.308890 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be95090b-eb9c-4558-a291-720e2f8ff526 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:30.514313 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-be95090b-eb9c-4558-a291-720e2f8ff526 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:30.522585 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-be95090b-eb9c-4558-a291-720e2f8ff526 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 200 len: 1683 microversion: 2.1 time: 0.230226 Jul 31 01:53:30.523228 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3098/6225] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:30 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 1683 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:31.479932 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7c3d4f6b-1ae5-437b-a630-2a555ff67ab4 req-a3fa89d8-ca85-4af2-876b-172e360d0f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1beeae60-b912-44b1-9832-58ac3b4ff2e5", "tag": "b414663b-1ae8-40e3-992e-1e1fe62210ba"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:31.480159 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-88d3983c-4ea8-46c3-9f6a-142456a457b4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:31.480984 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-88d3983c-4ea8-46c3-9f6a-142456a457b4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:31.492679 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88d3983c-4ea8-46c3-9f6a-142456a457b4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:31.493204 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88d3983c-4ea8-46c3-9f6a-142456a457b4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:31.495028 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7c3d4f6b-1ae5-437b-a630-2a555ff67ab4 req-a3fa89d8-ca85-4af2-876b-172e360d0f85 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:31.495611 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7c3d4f6b-1ae5-437b-a630-2a555ff67ab4 req-a3fa89d8-ca85-4af2-876b-172e360d0f85 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:31.496213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88d3983c-4ea8-46c3-9f6a-142456a457b4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:31.496881 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-88d3983c-4ea8-46c3-9f6a-142456a457b4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:31.509841 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7c3d4f6b-1ae5-437b-a630-2a555ff67ab4 req-a3fa89d8-ca85-4af2-876b-172e360d0f85 service nova] Creating event network-changed:b414663b-1ae8-40e3-992e-1e1fe62210ba for instance 1beeae60-b912-44b1-9832-58ac3b4ff2e5 on n-h1-master-1 Jul 31 01:53:31.514959 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7c3d4f6b-1ae5-437b-a630-2a555ff67ab4 req-a3fa89d8-ca85-4af2-876b-172e360d0f85 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039589 Jul 31 01:53:31.515969 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3099/6226] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:53:31.544665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-292cfaf0-67b4-4705-b5cf-9e3bff154f88 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:31.545666 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-292cfaf0-67b4-4705-b5cf-9e3bff154f88 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:31.553348 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-292cfaf0-67b4-4705-b5cf-9e3bff154f88 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:31.554122 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-292cfaf0-67b4-4705-b5cf-9e3bff154f88 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:31.555277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-292cfaf0-67b4-4705-b5cf-9e3bff154f88 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:31.555984 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-292cfaf0-67b4-4705-b5cf-9e3bff154f88 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:31.706002 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-88d3983c-4ea8-46c3-9f6a-142456a457b4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:31.721454 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-88d3983c-4ea8-46c3-9f6a-142456a457b4 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1564 microversion: 2.1 time: 0.247827 Jul 31 01:53:31.722173 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3128/6227] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:31 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1564 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:31.805886 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-292cfaf0-67b4-4705-b5cf-9e3bff154f88 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:31.814051 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-292cfaf0-67b4-4705-b5cf-9e3bff154f88 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 200 len: 1683 microversion: 2.1 time: 0.273652 Jul 31 01:53:31.815025 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3100/6228] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:31 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 1683 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:53:32.836835 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-43b06425-38c3-4df8-97d6-fc7180857e53 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:32.838033 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-43b06425-38c3-4df8-97d6-fc7180857e53 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:32.844935 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43b06425-38c3-4df8-97d6-fc7180857e53 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:32.845395 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43b06425-38c3-4df8-97d6-fc7180857e53 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:32.846177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43b06425-38c3-4df8-97d6-fc7180857e53 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:32.846800 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43b06425-38c3-4df8-97d6-fc7180857e53 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:32.923566 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-43b06425-38c3-4df8-97d6-fc7180857e53 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:32.932053 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-43b06425-38c3-4df8-97d6-fc7180857e53 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 200 len: 1616 microversion: 2.1 time: 0.099137 Jul 31 01:53:32.932899 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3129/6229] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:32 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 1616 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:33.136514 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-973ebbe9-c98c-490a-b3fa-98f2d6437235 req-6fbdf889-361b-4cb5-bdd2-7e5454918621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b653a5-553a-4e7e-afa3-aa1e5b57f90f", "name": "network-vif-deleted", "tag": "440c0f37-ddca-4d9f-8cda-a77133dbd106"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:33.146824 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-973ebbe9-c98c-490a-b3fa-98f2d6437235 req-6fbdf889-361b-4cb5-bdd2-7e5454918621 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:33.147227 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-973ebbe9-c98c-490a-b3fa-98f2d6437235 req-6fbdf889-361b-4cb5-bdd2-7e5454918621 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:33.161194 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-973ebbe9-c98c-490a-b3fa-98f2d6437235 req-6fbdf889-361b-4cb5-bdd2-7e5454918621 service nova] Creating event network-vif-deleted:440c0f37-ddca-4d9f-8cda-a77133dbd106 for instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f on n-h2-master-1 Jul 31 01:53:33.166184 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-973ebbe9-c98c-490a-b3fa-98f2d6437235 req-6fbdf889-361b-4cb5-bdd2-7e5454918621 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033421 Jul 31 01:53:33.166784 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3101/6230] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:53:33.954198 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0ec152a6-c38a-410a-85ec-79bb91bf1f0c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:33.954951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0ec152a6-c38a-410a-85ec-79bb91bf1f0c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:33.962575 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ec152a6-c38a-410a-85ec-79bb91bf1f0c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:33.963046 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ec152a6-c38a-410a-85ec-79bb91bf1f0c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:33.963860 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ec152a6-c38a-410a-85ec-79bb91bf1f0c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:33.964493 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ec152a6-c38a-410a-85ec-79bb91bf1f0c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:33.996089 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ec152a6-c38a-410a-85ec-79bb91bf1f0c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:33.996549 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ec152a6-c38a-410a-85ec-79bb91bf1f0c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:33.997017 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-0ec152a6-c38a-410a-85ec-79bb91bf1f0c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lazy-loading 'fault' on Instance uuid d4b653a5-553a-4e7e-afa3-aa1e5b57f90f {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:53:34.042627 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0ec152a6-c38a-410a-85ec-79bb91bf1f0c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:34.050464 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0ec152a6-c38a-410a-85ec-79bb91bf1f0c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 200 len: 1332 microversion: 2.1 time: 0.100130 Jul 31 01:53:34.050980 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3130/6231] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:33 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:35.073080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-42328dd4-3bb9-449a-a8c0-461e35dc3914 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:35.073823 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-42328dd4-3bb9-449a-a8c0-461e35dc3914 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:35.080027 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42328dd4-3bb9-449a-a8c0-461e35dc3914 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:35.080998 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42328dd4-3bb9-449a-a8c0-461e35dc3914 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:35.081764 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42328dd4-3bb9-449a-a8c0-461e35dc3914 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:35.082349 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42328dd4-3bb9-449a-a8c0-461e35dc3914 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:35.095392 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-42328dd4-3bb9-449a-a8c0-461e35dc3914 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] HTTP exception thrown: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-42328dd4-3bb9-449a-a8c0-461e35dc3914 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Request method failure captured: Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f HTTP/1.1 Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eArI_gg0PT5-mV1qvuSL56nJadb0JF4TL7uux8WXl3vok79f3uc98C7KYpH06iqd1o5cKdHNoOHQWtXYdIXh_OVDcfYH6kPL5MbcaUpikVPOXbVysh9krPcYr4kZ9fFwweKvXn3eXhTJHKVTngQ3MZesHwqBtr4Ap4TCwGoP0qN184 Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29818dc3fb6e4de198be5662dc764989", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 145ff42ae8134ad697f09fd339933bb9 Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: exception: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'd4b653a5-553a-4e7e-afa3-aa1e5b57f90f'} Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:53:35.097543 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:35.102650 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:53:35.102650 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:53:35.102650 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:53:35.102650 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:53:35.102650 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:53:35.102650 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. Jul 31 01:53:35.102650 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:35.102650 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-42328dd4-3bb9-449a-a8c0-461e35dc3914 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Returning 404 to user: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:53:35.102650 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-42328dd4-3bb9-449a-a8c0-461e35dc3914 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 404 len: 111 microversion: 2.1 time: 0.031084 Jul 31 01:53:35.102650 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3102/6232] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:35 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:53:35.107521 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-807b5d8b-1557-4aca-96c1-fe16fa613256 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '.version_select at 0x7fedeaa12d30>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:35.126728 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-807b5d8b-1557-4aca-96c1-fe16fa613256 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940822891" status: 202 len: 0 microversion: 2.1 time: 0.023001 Jul 31 01:53:35.127289 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3131/6233] 10.222.0.45 () {58 vars in 1221 bytes} [Sun Jul 31 01:53:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940822891 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:53:35.773753 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-34882689-f997-4e03-a54e-4d99f13808c5 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:35.774269 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-34882689-f997-4e03-a54e-4d99f13808c5 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:35.780367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-34882689-f997-4e03-a54e-4d99f13808c5 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:35.780838 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-34882689-f997-4e03-a54e-4d99f13808c5 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:35.781624 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-34882689-f997-4e03-a54e-4d99f13808c5 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:35.782085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-34882689-f997-4e03-a54e-4d99f13808c5 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:35.861240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-34882689-f997-4e03-a54e-4d99f13808c5 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lazy-loading 'services' on Instance uuid 1353bba5-65a1-4282-8c94-49e748b2b16d {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:53:35.931084 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-34882689-f997-4e03-a54e-4d99f13808c5 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-volume_attachments/1af0c0da-aec8-4b20-a584-aa23125bee1e" status: 202 len: 0 microversion: 2.1 time: 0.161084 Jul 31 01:53:35.931718 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3103/6234] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 01:53:35 2022] DELETE /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-volume_attachments/1af0c0da-aec8-4b20-a584-aa23125bee1e => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:53:35.940833 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1b61f3e1-066c-42ed-ba20-8bf2dd7352fa tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:35.943083 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1b61f3e1-066c-42ed-ba20-8bf2dd7352fa tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:35.950773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b61f3e1-066c-42ed-ba20-8bf2dd7352fa tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:35.951527 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b61f3e1-066c-42ed-ba20-8bf2dd7352fa tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:35.952325 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b61f3e1-066c-42ed-ba20-8bf2dd7352fa tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:35.952781 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b61f3e1-066c-42ed-ba20-8bf2dd7352fa tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:35.982506 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1b61f3e1-066c-42ed-ba20-8bf2dd7352fa tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046295 Jul 31 01:53:35.983082 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3132/6235] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:53:35 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:53:36.997990 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-68cefa6d-652a-4843-80c2-0b86488fe9f3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:37.002076 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-68cefa6d-652a-4843-80c2-0b86488fe9f3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:37.010201 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68cefa6d-652a-4843-80c2-0b86488fe9f3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:37.010666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68cefa6d-652a-4843-80c2-0b86488fe9f3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:37.011613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68cefa6d-652a-4843-80c2-0b86488fe9f3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:37.012065 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68cefa6d-652a-4843-80c2-0b86488fe9f3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:37.042321 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-68cefa6d-652a-4843-80c2-0b86488fe9f3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050499 Jul 31 01:53:37.042887 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3104/6236] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:53:36 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:53:38.054300 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-15697491-83ec-4f31-965e-9e30e2d1cd20 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:38.056571 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-15697491-83ec-4f31-965e-9e30e2d1cd20 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:38.066411 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-15697491-83ec-4f31-965e-9e30e2d1cd20 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:38.066866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-15697491-83ec-4f31-965e-9e30e2d1cd20 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:38.067685 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-15697491-83ec-4f31-965e-9e30e2d1cd20 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:38.068126 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-15697491-83ec-4f31-965e-9e30e2d1cd20 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:38.098791 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-15697491-83ec-4f31-965e-9e30e2d1cd20 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048462 Jul 31 01:53:38.099550 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3133/6237] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:53:38 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:53:39.111135 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a3267d97-7d4d-4cde-b0d1-6d46ae79bef8 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:39.113817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a3267d97-7d4d-4cde-b0d1-6d46ae79bef8 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:39.121131 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3267d97-7d4d-4cde-b0d1-6d46ae79bef8 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:39.121601 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3267d97-7d4d-4cde-b0d1-6d46ae79bef8 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:39.122386 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3267d97-7d4d-4cde-b0d1-6d46ae79bef8 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:39.122842 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3267d97-7d4d-4cde-b0d1-6d46ae79bef8 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:39.152611 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a3267d97-7d4d-4cde-b0d1-6d46ae79bef8 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045626 Jul 31 01:53:39.153163 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3105/6238] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:53:39 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:53:40.164965 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9f6a3118-cb71-42c0-acde-a9c274c1f5ed tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:40.167167 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9f6a3118-cb71-42c0-acde-a9c274c1f5ed tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:40.174276 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9f6a3118-cb71-42c0-acde-a9c274c1f5ed tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:40.174739 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9f6a3118-cb71-42c0-acde-a9c274c1f5ed tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:40.175547 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9f6a3118-cb71-42c0-acde-a9c274c1f5ed tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:40.175995 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9f6a3118-cb71-42c0-acde-a9c274c1f5ed tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:40.206801 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9f6a3118-cb71-42c0-acde-a9c274c1f5ed tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045919 Jul 31 01:53:40.207422 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3134/6239] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:53:40 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:53:41.219110 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7b39e820-808e-4b62-b867-1da3ecf4de68 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:41.221410 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7b39e820-808e-4b62-b867-1da3ecf4de68 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:41.228512 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b39e820-808e-4b62-b867-1da3ecf4de68 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:41.228986 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b39e820-808e-4b62-b867-1da3ecf4de68 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:41.229765 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b39e820-808e-4b62-b867-1da3ecf4de68 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:41.230224 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7b39e820-808e-4b62-b867-1da3ecf4de68 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:41.259896 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7b39e820-808e-4b62-b867-1da3ecf4de68 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044586 Jul 31 01:53:41.260451 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3106/6240] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:53:41 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:53:41.320388 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-efada269-bc9e-414d-b112-10f189ff6b31 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:41.320903 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-efada269-bc9e-414d-b112-10f189ff6b31 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:41.327844 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efada269-bc9e-414d-b112-10f189ff6b31 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:41.328308 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efada269-bc9e-414d-b112-10f189ff6b31 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:41.329084 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efada269-bc9e-414d-b112-10f189ff6b31 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:41.329538 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efada269-bc9e-414d-b112-10f189ff6b31 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:41.354043 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-efada269-bc9e-414d-b112-10f189ff6b31 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:53:41.390765 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:53:41.435034 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-efada269-bc9e-414d-b112-10f189ff6b31 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d" status: 204 len: 0 microversion: 2.1 time: 0.118211 Jul 31 01:53:41.435755 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3135/6241] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:53:41 2022] DELETE /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:53:41.444326 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1526044e-9cb3-4d9a-9d4f-62b5cb850363 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:41.444959 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1526044e-9cb3-4d9a-9d4f-62b5cb850363 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:41.450984 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1526044e-9cb3-4d9a-9d4f-62b5cb850363 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:41.451511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1526044e-9cb3-4d9a-9d4f-62b5cb850363 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:41.452279 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1526044e-9cb3-4d9a-9d4f-62b5cb850363 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:41.452739 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1526044e-9cb3-4d9a-9d4f-62b5cb850363 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:41.584453 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1526044e-9cb3-4d9a-9d4f-62b5cb850363 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:41.592790 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1526044e-9cb3-4d9a-9d4f-62b5cb850363 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d" status: 200 len: 1680 microversion: 2.1 time: 0.151841 Jul 31 01:53:41.592790 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3107/6242] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:41 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:42.615301 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a32b4fb9-5cd7-498c-aece-43b054e160a3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:42.616053 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a32b4fb9-5cd7-498c-aece-43b054e160a3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:42.623463 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a32b4fb9-5cd7-498c-aece-43b054e160a3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:42.623933 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a32b4fb9-5cd7-498c-aece-43b054e160a3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:42.625113 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a32b4fb9-5cd7-498c-aece-43b054e160a3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:42.625214 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a32b4fb9-5cd7-498c-aece-43b054e160a3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:42.759821 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a32b4fb9-5cd7-498c-aece-43b054e160a3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:42.767511 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a32b4fb9-5cd7-498c-aece-43b054e160a3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d" status: 200 len: 1680 microversion: 2.1 time: 0.157252 Jul 31 01:53:42.768095 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3136/6243] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:42 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:43.789290 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0268e133-7c8c-480c-9d92-038665fa6038 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:43.790056 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0268e133-7c8c-480c-9d92-038665fa6038 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:43.797229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0268e133-7c8c-480c-9d92-038665fa6038 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:43.797807 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0268e133-7c8c-480c-9d92-038665fa6038 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:43.798785 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0268e133-7c8c-480c-9d92-038665fa6038 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:43.799228 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0268e133-7c8c-480c-9d92-038665fa6038 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:43.865639 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0268e133-7c8c-480c-9d92-038665fa6038 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:43.869308 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:53:43.874471 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0268e133-7c8c-480c-9d92-038665fa6038 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d" status: 200 len: 1613 microversion: 2.1 time: 0.089187 Jul 31 01:53:43.875053 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3108/6244] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:43 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d => generated 1613 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:44.015505 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-aa23eb28-42b4-4922-b332-8177aeb9ad77 req-b801ce2d-7e28-4703-a4c4-a0a2f66a7328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1353bba5-65a1-4282-8c94-49e748b2b16d", "name": "network-vif-deleted", "tag": "5857dbc8-0d83-4d68-9212-08fef174f2d0"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:44.026633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-aa23eb28-42b4-4922-b332-8177aeb9ad77 req-b801ce2d-7e28-4703-a4c4-a0a2f66a7328 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:44.027083 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-aa23eb28-42b4-4922-b332-8177aeb9ad77 req-b801ce2d-7e28-4703-a4c4-a0a2f66a7328 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:44.038936 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-aa23eb28-42b4-4922-b332-8177aeb9ad77 req-b801ce2d-7e28-4703-a4c4-a0a2f66a7328 service nova] Creating event network-vif-deleted:5857dbc8-0d83-4d68-9212-08fef174f2d0 for instance 1353bba5-65a1-4282-8c94-49e748b2b16d on n-h1-master-1 Jul 31 01:53:44.043907 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-aa23eb28-42b4-4922-b332-8177aeb9ad77 req-b801ce2d-7e28-4703-a4c4-a0a2f66a7328 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032366 Jul 31 01:53:44.044692 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3137/6245] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:53:44.897171 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b8ce7a2e-013d-45d7-975b-c0c567407859 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:44.897805 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b8ce7a2e-013d-45d7-975b-c0c567407859 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:44.906731 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b8ce7a2e-013d-45d7-975b-c0c567407859 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:44.907208 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b8ce7a2e-013d-45d7-975b-c0c567407859 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:44.908578 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b8ce7a2e-013d-45d7-975b-c0c567407859 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:44.909039 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b8ce7a2e-013d-45d7-975b-c0c567407859 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:44.922724 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-b8ce7a2e-013d-45d7-975b-c0c567407859 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] HTTP exception thrown: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b8ce7a2e-013d-45d7-975b-c0c567407859 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Request method failure captured: Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d HTTP/1.1 Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eArI_gg0PT5-mV1qvuSL56nJadb0JF4TL7uux8WXl3vok79f3uc98C7KYpH06iqd1o5cKdHNoOHQWtXYdIXh_OVDcfYH6kPL5MbcaUpikVPOXbVysh9krPcYr4kZ9fFwweKvXn3eXhTJHKVTngQ3MZesHwqBtr4Ap4TCwGoP0qN184 Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29818dc3fb6e4de198be5662dc764989", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 145ff42ae8134ad697f09fd339933bb9 Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '1353bba5-65a1-4282-8c94-49e748b2b16d'} Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:53:44.924434 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:44.929351 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:53:44.929351 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:53:44.929351 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:53:44.929351 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:53:44.929351 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:53:44.929351 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. Jul 31 01:53:44.929351 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:53:44.929351 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b8ce7a2e-013d-45d7-975b-c0c567407859 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Returning 404 to user: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:53:44.929351 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b8ce7a2e-013d-45d7-975b-c0c567407859 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d" status: 404 len: 111 microversion: 2.1 time: 0.033310 Jul 31 01:53:44.929351 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3109/6246] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:44 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:53:44.935872 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-af950c40-267c-4cb7-bde9-da4f9b943f11 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '.version_select at 0x7fede47829d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:44.956556 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-af950c40-267c-4cb7-bde9-da4f9b943f11 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-196827809" status: 202 len: 0 microversion: 2.1 time: 0.025065 Jul 31 01:53:44.957249 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3138/6247] 10.222.0.45 () {58 vars in 1218 bytes} [Sun Jul 31 01:53:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-196827809 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:53:45.596991 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-82cfc4e7-7e58-4e77-8ae9-caa1121d0ca0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Action: 'create', calling method: .version_select at 0x7fede58b4160>, body: {"keypair": {"name": "tempest-keypair-767898071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF++BCArP7qAq6+6jk+yKmS/bgReysZ+ps4zQ+cG2WpWPJ1ZfW9VzL95Pw5/80Xf0FJctSwkUcBLch1nzRXbL6+9KSTuY8bodzWD2zwwHlInZLO3CMnqw3FbRAbroRXBsg=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:45.612530 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-82cfc4e7-7e58-4e77-8ae9-caa1121d0ca0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Getting quotas for project 29818dc3fb6e4de198be5662dc764989. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:53:45.617885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-82cfc4e7-7e58-4e77-8ae9-caa1121d0ca0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Getting quotas for user 145ff42ae8134ad697f09fd339933bb9 and project 29818dc3fb6e4de198be5662dc764989. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:53:45.640469 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-82cfc4e7-7e58-4e77-8ae9-caa1121d0ca0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048094 Jul 31 01:53:45.641064 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3110/6248] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:53:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:53:46.959795 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5828eb3f-833e-4189-b6ab-83d8fb639472 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1916584585", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c763115-7f67-4122-8316-1251598f7da5"}], "security_groups": [{"name": "tempest-securitygroup--501105250"}], "key_name": "tempest-keypair-767898071", "user_data": "}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:47.063108 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-5828eb3f-833e-4189-b6ab-83d8fb639472 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] validate_networks() for [('3c763115-7f67-4122-8316-1251598f7da5', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:53:47.432503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-5828eb3f-833e-4189-b6ab-83d8fb639472 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:53:47.432940 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-5828eb3f-833e-4189-b6ab-83d8fb639472 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:53:47.433427 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-5828eb3f-833e-4189-b6ab-83d8fb639472 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:53:47.433846 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-5828eb3f-833e-4189-b6ab-83d8fb639472 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:53:47.434269 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-5828eb3f-833e-4189-b6ab-83d8fb639472 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:53:47.443247 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5828eb3f-833e-4189-b6ab-83d8fb639472 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:47.443756 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5828eb3f-833e-4189-b6ab-83d8fb639472 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:47.444561 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5828eb3f-833e-4189-b6ab-83d8fb639472 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:47.445013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5828eb3f-833e-4189-b6ab-83d8fb639472 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:47.461476 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-5828eb3f-833e-4189-b6ab-83d8fb639472 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Getting quotas for project 29818dc3fb6e4de198be5662dc764989. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:53:47.466716 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-5828eb3f-833e-4189-b6ab-83d8fb639472 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Getting quotas for user 145ff42ae8134ad697f09fd339933bb9 and project 29818dc3fb6e4de198be5662dc764989. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:53:47.479477 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5828eb3f-833e-4189-b6ab-83d8fb639472 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:53:47.481807 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5828eb3f-833e-4189-b6ab-83d8fb639472 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:53:47.527569 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5828eb3f-833e-4189-b6ab-83d8fb639472 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.573621 Jul 31 01:53:47.528231 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3139/6249] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:53:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:53:47.539889 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-12a13ca6-faa0-41e0-a238-be94e6b4c4e2 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:47.540617 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-12a13ca6-faa0-41e0-a238-be94e6b4c4e2 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:47.597039 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-12a13ca6-faa0-41e0-a238-be94e6b4c4e2 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:47.603804 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-12a13ca6-faa0-41e0-a238-be94e6b4c4e2 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72" status: 200 len: 1241 microversion: 2.1 time: 0.067923 Jul 31 01:53:47.604366 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3111/6250] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:47 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:48.626723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b1a28c34-3717-47cb-95e9-b01629992aab tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:48.627741 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b1a28c34-3717-47cb-95e9-b01629992aab tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:48.629857 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=3,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:53:48.640741 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b1a28c34-3717-47cb-95e9-b01629992aab tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:48.641304 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b1a28c34-3717-47cb-95e9-b01629992aab tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:48.642723 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b1a28c34-3717-47cb-95e9-b01629992aab tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:48.643178 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b1a28c34-3717-47cb-95e9-b01629992aab tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:48.709489 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b1a28c34-3717-47cb-95e9-b01629992aab tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:48.717087 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b1a28c34-3717-47cb-95e9-b01629992aab tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72" status: 200 len: 1299 microversion: 2.1 time: 0.095464 Jul 31 01:53:48.717670 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3140/6251] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:48 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:49.739788 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-54367f41-11a3-49bf-a36a-5b5278055517 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:49.740458 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-54367f41-11a3-49bf-a36a-5b5278055517 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:49.747719 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-54367f41-11a3-49bf-a36a-5b5278055517 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:49.748201 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-54367f41-11a3-49bf-a36a-5b5278055517 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:49.748986 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-54367f41-11a3-49bf-a36a-5b5278055517 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:49.749559 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-54367f41-11a3-49bf-a36a-5b5278055517 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:49.839157 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-759e4927-d120-45db-9fca-3bd87b7df869 req-9912568b-8a6f-4ade-9af9-89e719eeb60c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "310c394a-649d-49cd-98d4-707c32674d72", "tag": "36d57061-1058-4fc2-a922-198bce4e2e71"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:49.855544 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-759e4927-d120-45db-9fca-3bd87b7df869 req-9912568b-8a6f-4ade-9af9-89e719eeb60c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:49.856923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-759e4927-d120-45db-9fca-3bd87b7df869 req-9912568b-8a6f-4ade-9af9-89e719eeb60c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:49.875763 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-759e4927-d120-45db-9fca-3bd87b7df869 req-9912568b-8a6f-4ade-9af9-89e719eeb60c service nova] Creating event network-changed:36d57061-1058-4fc2-a922-198bce4e2e71 for instance 310c394a-649d-49cd-98d4-707c32674d72 on n-h2-master-1 Jul 31 01:53:49.884456 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-759e4927-d120-45db-9fca-3bd87b7df869 req-9912568b-8a6f-4ade-9af9-89e719eeb60c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050329 Jul 31 01:53:49.886566 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3141/6252] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:53:49.896120 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-54367f41-11a3-49bf-a36a-5b5278055517 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:49.903850 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-54367f41-11a3-49bf-a36a-5b5278055517 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72" status: 200 len: 1366 microversion: 2.1 time: 0.169502 Jul 31 01:53:49.904422 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3112/6253] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:49 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:50.925735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-951aa210-f292-4fee-beb7-ff6239e12400 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:50.926399 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-951aa210-f292-4fee-beb7-ff6239e12400 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:50.933841 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-951aa210-f292-4fee-beb7-ff6239e12400 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:50.934304 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-951aa210-f292-4fee-beb7-ff6239e12400 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:50.935075 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-951aa210-f292-4fee-beb7-ff6239e12400 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:50.935556 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-951aa210-f292-4fee-beb7-ff6239e12400 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:51.064053 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-951aa210-f292-4fee-beb7-ff6239e12400 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:51.071492 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-951aa210-f292-4fee-beb7-ff6239e12400 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72" status: 200 len: 1366 microversion: 2.1 time: 0.150133 Jul 31 01:53:51.072068 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3142/6254] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:50 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:52.092580 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c4a2b15b-1ba0-4fb5-9240-c27ba1d60a15 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:52.093210 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c4a2b15b-1ba0-4fb5-9240-c27ba1d60a15 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:52.100928 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4a2b15b-1ba0-4fb5-9240-c27ba1d60a15 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:52.101396 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4a2b15b-1ba0-4fb5-9240-c27ba1d60a15 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:52.102178 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4a2b15b-1ba0-4fb5-9240-c27ba1d60a15 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:52.102630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4a2b15b-1ba0-4fb5-9240-c27ba1d60a15 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:52.235390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c4a2b15b-1ba0-4fb5-9240-c27ba1d60a15 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:52.244240 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c4a2b15b-1ba0-4fb5-9240-c27ba1d60a15 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72" status: 200 len: 1366 microversion: 2.1 time: 0.155494 Jul 31 01:53:52.244828 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3113/6255] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:52 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:53.020066 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b065ed24-9c25-4f79-a952-846040f35526 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:53.022237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b065ed24-9c25-4f79-a952-846040f35526 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:53.028341 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b065ed24-9c25-4f79-a952-846040f35526 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:53.028798 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b065ed24-9c25-4f79-a952-846040f35526 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:53.029560 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b065ed24-9c25-4f79-a952-846040f35526 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:53.030002 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b065ed24-9c25-4f79-a952-846040f35526 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:53.090804 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b065ed24-9c25-4f79-a952-846040f35526 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5/action" status: 200 len: 24575 microversion: 2.1 time: 0.075463 Jul 31 01:53:53.091492 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3143/6256] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:53:53 2022] POST /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5/action => generated 24575 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:53:53.265551 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-49bb0059-e5b6-4821-bd0d-4b983d74024f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:53.266111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-49bb0059-e5b6-4821-bd0d-4b983d74024f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:53.273048 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49bb0059-e5b6-4821-bd0d-4b983d74024f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:53.273516 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49bb0059-e5b6-4821-bd0d-4b983d74024f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:53.274293 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49bb0059-e5b6-4821-bd0d-4b983d74024f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:53.274748 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49bb0059-e5b6-4821-bd0d-4b983d74024f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:53.403162 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-49bb0059-e5b6-4821-bd0d-4b983d74024f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:53.412099 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-49bb0059-e5b6-4821-bd0d-4b983d74024f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72" status: 200 len: 1366 microversion: 2.1 time: 0.150456 Jul 31 01:53:53.412679 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3114/6257] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:53 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:54.249990 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-3ee7e674-acb8-4632-81a6-62acffbb2878 req-0bdf382e-d482-429c-b4bd-9c234a41efb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310c394a-649d-49cd-98d4-707c32674d72", "name": "network-vif-plugged", "status": "completed", "tag": "36d57061-1058-4fc2-a922-198bce4e2e71"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:54.261385 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3ee7e674-acb8-4632-81a6-62acffbb2878 req-0bdf382e-d482-429c-b4bd-9c234a41efb7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:54.261848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3ee7e674-acb8-4632-81a6-62acffbb2878 req-0bdf382e-d482-429c-b4bd-9c234a41efb7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:54.276835 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-3ee7e674-acb8-4632-81a6-62acffbb2878 req-0bdf382e-d482-429c-b4bd-9c234a41efb7 service nova] Creating event network-vif-plugged:36d57061-1058-4fc2-a922-198bce4e2e71 for instance 310c394a-649d-49cd-98d4-707c32674d72 on n-h2-master-1 Jul 31 01:53:54.281666 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-3ee7e674-acb8-4632-81a6-62acffbb2878 req-0bdf382e-d482-429c-b4bd-9c234a41efb7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035954 Jul 31 01:53:54.282270 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3144/6258] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:53:54.433173 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0e138140-951e-4b6c-b2f2-b19df1493865 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:54.434453 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0e138140-951e-4b6c-b2f2-b19df1493865 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:54.441927 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e138140-951e-4b6c-b2f2-b19df1493865 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:54.442398 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e138140-951e-4b6c-b2f2-b19df1493865 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:54.443198 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e138140-951e-4b6c-b2f2-b19df1493865 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:54.443682 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e138140-951e-4b6c-b2f2-b19df1493865 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:54.574816 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e138140-951e-4b6c-b2f2-b19df1493865 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:54.583055 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0e138140-951e-4b6c-b2f2-b19df1493865 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72" status: 200 len: 1366 microversion: 2.1 time: 0.153819 Jul 31 01:53:54.583657 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3115/6259] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:54 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:55.604748 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-20a1b2be-41d3-469b-9655-3a075e5e9d81 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:55.605466 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-20a1b2be-41d3-469b-9655-3a075e5e9d81 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:55.611784 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20a1b2be-41d3-469b-9655-3a075e5e9d81 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:55.612874 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20a1b2be-41d3-469b-9655-3a075e5e9d81 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:55.613648 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20a1b2be-41d3-469b-9655-3a075e5e9d81 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:55.614097 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20a1b2be-41d3-469b-9655-3a075e5e9d81 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:55.748556 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-20a1b2be-41d3-469b-9655-3a075e5e9d81 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:53:55.756148 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-20a1b2be-41d3-469b-9655-3a075e5e9d81 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72" status: 200 len: 1557 microversion: 2.1 time: 0.156530 Jul 31 01:53:55.756719 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3145/6260] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:53:55 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:53:55.776175 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e8d5828d-a01d-4889-a102-9211399a8618 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:53:55.776687 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e8d5828d-a01d-4889-a102-9211399a8618 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:53:55.783582 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8d5828d-a01d-4889-a102-9211399a8618 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:55.784577 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8d5828d-a01d-4889-a102-9211399a8618 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:55.785358 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8d5828d-a01d-4889-a102-9211399a8618 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:55.785812 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8d5828d-a01d-4889-a102-9211399a8618 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:55.866585 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e8d5828d-a01d-4889-a102-9211399a8618 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094194 Jul 31 01:53:55.867202 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3116/6261] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:53:55 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:53:56.795170 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-0f8796d7-844f-4993-9500-b2525d847112 req-9fcc762f-340d-4569-8855-e37990ecaf59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "310c394a-649d-49cd-98d4-707c32674d72", "tag": "36d57061-1058-4fc2-a922-198bce4e2e71"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:53:56.805492 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0f8796d7-844f-4993-9500-b2525d847112 req-9fcc762f-340d-4569-8855-e37990ecaf59 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:53:56.806024 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0f8796d7-844f-4993-9500-b2525d847112 req-9fcc762f-340d-4569-8855-e37990ecaf59 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:53:56.817250 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-0f8796d7-844f-4993-9500-b2525d847112 req-9fcc762f-340d-4569-8855-e37990ecaf59 service nova] Creating event network-changed:36d57061-1058-4fc2-a922-198bce4e2e71 for instance 310c394a-649d-49cd-98d4-707c32674d72 on n-h2-master-1 Jul 31 01:53:56.822256 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-0f8796d7-844f-4993-9500-b2525d847112 req-9fcc762f-340d-4569-8855-e37990ecaf59 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030876 Jul 31 01:53:56.822876 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3146/6262] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:54:04.141759 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:54:04.146026 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0f306572-729b-4b95-a357-79461887e541"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:54:04.148905 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:04.150662 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:54:04.156657 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:04.157158 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:04.157936 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:04.158385 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:04.235938 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:54:04.236368 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:54:04.236859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:54:04.237311 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:54:04.237742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:54:04.297255 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:04.303581 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:04.304059 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:04.304853 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:04.305309 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:04.332210 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ddc668e0-bdf8-4b60-8420-4ce0a383c0cd tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5/action" status: 202 len: 1136 microversion: 2.1 time: 0.191707 Jul 31 01:54:04.333576 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3117/6263] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:54:04 2022] POST /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5/action => generated 1136 bytes in 194 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 31 01:54:04.349747 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:54:04.350607 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:54:04.355406 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8ac12f19-b918-4643-a709-7e75f4a22229 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:04.356150 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8ac12f19-b918-4643-a709-7e75f4a22229 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:04.363275 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ac12f19-b918-4643-a709-7e75f4a22229 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:04.363763 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ac12f19-b918-4643-a709-7e75f4a22229 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:04.364793 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ac12f19-b918-4643-a709-7e75f4a22229 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:04.365239 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ac12f19-b918-4643-a709-7e75f4a22229 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:04.502340 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8ac12f19-b918-4643-a709-7e75f4a22229 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:04.509880 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8ac12f19-b918-4643-a709-7e75f4a22229 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1691 microversion: 2.1 time: 0.162154 Jul 31 01:54:04.510456 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3147/6264] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:04 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:54:05.532600 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f932ec83-29d2-4958-8541-93407a1d7b7c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:05.533302 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f932ec83-29d2-4958-8541-93407a1d7b7c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:05.540931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f932ec83-29d2-4958-8541-93407a1d7b7c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:05.541400 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f932ec83-29d2-4958-8541-93407a1d7b7c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:05.542221 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f932ec83-29d2-4958-8541-93407a1d7b7c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:05.542779 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f932ec83-29d2-4958-8541-93407a1d7b7c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:05.682626 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f932ec83-29d2-4958-8541-93407a1d7b7c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:05.690323 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f932ec83-29d2-4958-8541-93407a1d7b7c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1691 microversion: 2.1 time: 0.161663 Jul 31 01:54:05.690891 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3118/6265] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:05 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:06.711866 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1a88f37c-1a23-44de-aee7-0fb80e069b5c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:06.712512 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1a88f37c-1a23-44de-aee7-0fb80e069b5c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:06.719464 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a88f37c-1a23-44de-aee7-0fb80e069b5c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:06.719922 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a88f37c-1a23-44de-aee7-0fb80e069b5c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:06.720684 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a88f37c-1a23-44de-aee7-0fb80e069b5c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:06.721126 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1a88f37c-1a23-44de-aee7-0fb80e069b5c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:06.857150 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1a88f37c-1a23-44de-aee7-0fb80e069b5c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:06.864943 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1a88f37c-1a23-44de-aee7-0fb80e069b5c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1691 microversion: 2.1 time: 0.156959 Jul 31 01:54:06.866157 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3148/6266] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:06 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:07.886569 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c3aaf3f1-9d37-499a-a116-f7dbb4d75af9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:07.887197 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c3aaf3f1-9d37-499a-a116-f7dbb4d75af9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:07.894166 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3aaf3f1-9d37-499a-a116-f7dbb4d75af9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:07.894629 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3aaf3f1-9d37-499a-a116-f7dbb4d75af9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:07.895440 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3aaf3f1-9d37-499a-a116-f7dbb4d75af9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:07.895897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c3aaf3f1-9d37-499a-a116-f7dbb4d75af9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:08.030131 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c3aaf3f1-9d37-499a-a116-f7dbb4d75af9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:08.037580 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c3aaf3f1-9d37-499a-a116-f7dbb4d75af9 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1691 microversion: 2.1 time: 0.155006 Jul 31 01:54:08.038143 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3119/6267] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:07 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:09.058379 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b0e67f75-dce1-41f5-8c6f-f907fc912b40 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:09.059013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b0e67f75-dce1-41f5-8c6f-f907fc912b40 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:09.065986 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0e67f75-dce1-41f5-8c6f-f907fc912b40 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:09.066453 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0e67f75-dce1-41f5-8c6f-f907fc912b40 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:09.067235 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0e67f75-dce1-41f5-8c6f-f907fc912b40 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:09.067719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0e67f75-dce1-41f5-8c6f-f907fc912b40 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:09.200836 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b0e67f75-dce1-41f5-8c6f-f907fc912b40 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:09.208465 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b0e67f75-dce1-41f5-8c6f-f907fc912b40 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1691 microversion: 2.1 time: 0.154009 Jul 31 01:54:09.209045 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3149/6268] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:09 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:10.230238 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d93cf620-7a7a-4f08-b6df-792a01beb18c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:10.230860 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d93cf620-7a7a-4f08-b6df-792a01beb18c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:10.237810 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d93cf620-7a7a-4f08-b6df-792a01beb18c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:10.238299 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d93cf620-7a7a-4f08-b6df-792a01beb18c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:10.239064 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d93cf620-7a7a-4f08-b6df-792a01beb18c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:10.239790 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d93cf620-7a7a-4f08-b6df-792a01beb18c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:10.367213 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d93cf620-7a7a-4f08-b6df-792a01beb18c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:10.374820 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d93cf620-7a7a-4f08-b6df-792a01beb18c tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1691 microversion: 2.1 time: 0.148472 Jul 31 01:54:10.375409 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3120/6269] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:10 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:11.396195 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e56d6492-c041-4713-8d69-6c9852b72c5b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:11.396861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e56d6492-c041-4713-8d69-6c9852b72c5b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:11.405652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e56d6492-c041-4713-8d69-6c9852b72c5b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:11.406501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e56d6492-c041-4713-8d69-6c9852b72c5b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:11.407307 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e56d6492-c041-4713-8d69-6c9852b72c5b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:11.407798 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e56d6492-c041-4713-8d69-6c9852b72c5b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:11.412337 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:54:11.540713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e56d6492-c041-4713-8d69-6c9852b72c5b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:11.548205 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e56d6492-c041-4713-8d69-6c9852b72c5b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1691 microversion: 2.1 time: 0.155981 Jul 31 01:54:11.548800 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3150/6270] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:11 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:12.569945 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7ccb1d83-ec68-411e-aafc-2e16d21eab6a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:12.570579 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7ccb1d83-ec68-411e-aafc-2e16d21eab6a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:12.577371 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ccb1d83-ec68-411e-aafc-2e16d21eab6a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:12.577845 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ccb1d83-ec68-411e-aafc-2e16d21eab6a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:12.578623 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ccb1d83-ec68-411e-aafc-2e16d21eab6a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:12.579078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ccb1d83-ec68-411e-aafc-2e16d21eab6a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:12.710951 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7ccb1d83-ec68-411e-aafc-2e16d21eab6a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:12.720013 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7ccb1d83-ec68-411e-aafc-2e16d21eab6a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1691 microversion: 2.1 time: 0.154486 Jul 31 01:54:12.720650 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3121/6271] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:12 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:13.743031 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-056052a8-1aeb-4ada-b6d6-904aaffc7029 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:13.743683 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-056052a8-1aeb-4ada-b6d6-904aaffc7029 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:13.750495 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-056052a8-1aeb-4ada-b6d6-904aaffc7029 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:13.750951 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-056052a8-1aeb-4ada-b6d6-904aaffc7029 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:13.751739 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-056052a8-1aeb-4ada-b6d6-904aaffc7029 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:13.752182 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-056052a8-1aeb-4ada-b6d6-904aaffc7029 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:13.887735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-056052a8-1aeb-4ada-b6d6-904aaffc7029 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:13.895257 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-056052a8-1aeb-4ada-b6d6-904aaffc7029 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1691 microversion: 2.1 time: 0.157021 Jul 31 01:54:13.895889 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3151/6272] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:13 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:54:14.916931 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4aa584eb-3b8f-4c72-8bbc-cdd0bc0c344f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:14.917454 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4aa584eb-3b8f-4c72-8bbc-cdd0bc0c344f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:14.924580 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4aa584eb-3b8f-4c72-8bbc-cdd0bc0c344f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:14.925048 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4aa584eb-3b8f-4c72-8bbc-cdd0bc0c344f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:14.925831 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4aa584eb-3b8f-4c72-8bbc-cdd0bc0c344f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:14.926289 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4aa584eb-3b8f-4c72-8bbc-cdd0bc0c344f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:14.928896 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:54:15.057580 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4aa584eb-3b8f-4c72-8bbc-cdd0bc0c344f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:15.064959 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4aa584eb-3b8f-4c72-8bbc-cdd0bc0c344f tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1691 microversion: 2.1 time: 0.152671 Jul 31 01:54:15.065522 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3122/6273] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:14 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:16.086055 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dc6161e2-fa94-4c37-8430-ddaf83e44964 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:16.086709 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dc6161e2-fa94-4c37-8430-ddaf83e44964 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:16.093760 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc6161e2-fa94-4c37-8430-ddaf83e44964 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:16.094222 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc6161e2-fa94-4c37-8430-ddaf83e44964 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:16.095022 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc6161e2-fa94-4c37-8430-ddaf83e44964 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:16.095498 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc6161e2-fa94-4c37-8430-ddaf83e44964 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:16.230230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dc6161e2-fa94-4c37-8430-ddaf83e44964 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:16.237928 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dc6161e2-fa94-4c37-8430-ddaf83e44964 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1691 microversion: 2.1 time: 0.155827 Jul 31 01:54:16.238611 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3152/6274] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:16 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:17.260365 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-49f3fb1d-7b40-44ac-9ec0-fa8410a39bec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:17.260895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-49f3fb1d-7b40-44ac-9ec0-fa8410a39bec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:17.267812 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49f3fb1d-7b40-44ac-9ec0-fa8410a39bec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:17.268275 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49f3fb1d-7b40-44ac-9ec0-fa8410a39bec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:17.269043 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49f3fb1d-7b40-44ac-9ec0-fa8410a39bec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:17.269491 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49f3fb1d-7b40-44ac-9ec0-fa8410a39bec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:17.397421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-49f3fb1d-7b40-44ac-9ec0-fa8410a39bec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:17.405224 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-49f3fb1d-7b40-44ac-9ec0-fa8410a39bec tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1691 microversion: 2.1 time: 0.149448 Jul 31 01:54:17.405859 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3123/6275] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:17 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:18.427212 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0ae23de8-0d8d-424f-8389-50fb362ea1f8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:18.427887 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0ae23de8-0d8d-424f-8389-50fb362ea1f8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:18.435769 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ae23de8-0d8d-424f-8389-50fb362ea1f8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:18.436228 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ae23de8-0d8d-424f-8389-50fb362ea1f8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:18.436994 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ae23de8-0d8d-424f-8389-50fb362ea1f8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:18.437436 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ae23de8-0d8d-424f-8389-50fb362ea1f8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:18.570419 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0ae23de8-0d8d-424f-8389-50fb362ea1f8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:18.578619 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0ae23de8-0d8d-424f-8389-50fb362ea1f8 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1691 microversion: 2.1 time: 0.155298 Jul 31 01:54:18.579205 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3153/6276] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:18 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:19.599962 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6ba8c377-e350-47d6-8d41-9c143eadcf24 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:19.600582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6ba8c377-e350-47d6-8d41-9c143eadcf24 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:19.607571 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6ba8c377-e350-47d6-8d41-9c143eadcf24 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:19.608040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6ba8c377-e350-47d6-8d41-9c143eadcf24 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:19.608829 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6ba8c377-e350-47d6-8d41-9c143eadcf24 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:19.609277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6ba8c377-e350-47d6-8d41-9c143eadcf24 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:19.746826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6ba8c377-e350-47d6-8d41-9c143eadcf24 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:19.754359 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6ba8c377-e350-47d6-8d41-9c143eadcf24 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1691 microversion: 2.1 time: 0.158411 Jul 31 01:54:19.754926 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3124/6277] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:19 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:20.776015 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f01becf3-7d8a-4ea3-9360-7adff55b566d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:20.776642 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f01becf3-7d8a-4ea3-9360-7adff55b566d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:20.779390 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=28 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:54:20.785048 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f01becf3-7d8a-4ea3-9360-7adff55b566d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:20.785516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f01becf3-7d8a-4ea3-9360-7adff55b566d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:20.786300 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f01becf3-7d8a-4ea3-9360-7adff55b566d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:20.786750 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f01becf3-7d8a-4ea3-9360-7adff55b566d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:20.916830 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f01becf3-7d8a-4ea3-9360-7adff55b566d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:20.924303 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f01becf3-7d8a-4ea3-9360-7adff55b566d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1691 microversion: 2.1 time: 0.152773 Jul 31 01:54:20.924877 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3154/6278] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:20 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:21.945682 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d5666d5d-a3b9-4386-a366-e8efdb3c92bf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:21.946232 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d5666d5d-a3b9-4386-a366-e8efdb3c92bf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:21.953316 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5666d5d-a3b9-4386-a366-e8efdb3c92bf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:21.953785 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5666d5d-a3b9-4386-a366-e8efdb3c92bf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:21.954562 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5666d5d-a3b9-4386-a366-e8efdb3c92bf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:21.955016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5666d5d-a3b9-4386-a366-e8efdb3c92bf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:22.089925 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d5666d5d-a3b9-4386-a366-e8efdb3c92bf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:22.098077 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d5666d5d-a3b9-4386-a366-e8efdb3c92bf tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1691 microversion: 2.1 time: 0.156431 Jul 31 01:54:22.098649 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3125/6279] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:21 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:23.120622 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fe7c16b4-1197-4d25-86e2-014619843508 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:23.121249 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fe7c16b4-1197-4d25-86e2-014619843508 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:23.127815 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe7c16b4-1197-4d25-86e2-014619843508 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:23.128277 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe7c16b4-1197-4d25-86e2-014619843508 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:23.129082 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe7c16b4-1197-4d25-86e2-014619843508 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:23.129532 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe7c16b4-1197-4d25-86e2-014619843508 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:23.262722 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fe7c16b4-1197-4d25-86e2-014619843508 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:23.270434 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fe7c16b4-1197-4d25-86e2-014619843508 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1697 microversion: 2.1 time: 0.153862 Jul 31 01:54:23.271005 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3155/6280] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:23 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:24.293309 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8f2410b6-3040-40d8-aaa8-5ff7b0626eb6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:24.293947 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8f2410b6-3040-40d8-aaa8-5ff7b0626eb6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:24.300945 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f2410b6-3040-40d8-aaa8-5ff7b0626eb6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:24.301414 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f2410b6-3040-40d8-aaa8-5ff7b0626eb6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:24.302322 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f2410b6-3040-40d8-aaa8-5ff7b0626eb6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:24.302784 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f2410b6-3040-40d8-aaa8-5ff7b0626eb6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:24.435330 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8f2410b6-3040-40d8-aaa8-5ff7b0626eb6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:24.442755 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8f2410b6-3040-40d8-aaa8-5ff7b0626eb6 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1682 microversion: 2.1 time: 0.153539 Jul 31 01:54:24.443317 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3126/6281] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:24 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:25.779425 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-9f99a32b-5dc0-4f25-b86d-3821529cfd61 req-599fc029-c730-4634-b2b8-b82485c6add9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1beeae60-b912-44b1-9832-58ac3b4ff2e5", "name": "network-vif-unplugged", "status": "completed", "tag": "b414663b-1ae8-40e3-992e-1e1fe62210ba"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:54:25.790232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9f99a32b-5dc0-4f25-b86d-3821529cfd61 req-599fc029-c730-4634-b2b8-b82485c6add9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:25.790683 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9f99a32b-5dc0-4f25-b86d-3821529cfd61 req-599fc029-c730-4634-b2b8-b82485c6add9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:25.802437 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-9f99a32b-5dc0-4f25-b86d-3821529cfd61 req-599fc029-c730-4634-b2b8-b82485c6add9 service nova] Creating event network-vif-unplugged:b414663b-1ae8-40e3-992e-1e1fe62210ba for instance 1beeae60-b912-44b1-9832-58ac3b4ff2e5 on n-h1-master-1 Jul 31 01:54:25.808063 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-9f99a32b-5dc0-4f25-b86d-3821529cfd61 req-599fc029-c730-4634-b2b8-b82485c6add9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032280 Jul 31 01:54:25.809133 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3156/6282] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:54:27.826596 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-defd3b0d-b13c-48af-8a06-8431e0f54c27 req-57f6ae44-f8c6-4a1d-8647-7994aa76b8fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1beeae60-b912-44b1-9832-58ac3b4ff2e5", "name": "network-vif-plugged", "status": "completed", "tag": "b414663b-1ae8-40e3-992e-1e1fe62210ba"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:54:27.837670 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-defd3b0d-b13c-48af-8a06-8431e0f54c27 req-57f6ae44-f8c6-4a1d-8647-7994aa76b8fa service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:27.838134 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-defd3b0d-b13c-48af-8a06-8431e0f54c27 req-57f6ae44-f8c6-4a1d-8647-7994aa76b8fa service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:27.848889 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-defd3b0d-b13c-48af-8a06-8431e0f54c27 req-57f6ae44-f8c6-4a1d-8647-7994aa76b8fa service nova] Creating event network-vif-plugged:b414663b-1ae8-40e3-992e-1e1fe62210ba for instance 1beeae60-b912-44b1-9832-58ac3b4ff2e5 on n-h1-master-1 Jul 31 01:54:27.853968 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-defd3b0d-b13c-48af-8a06-8431e0f54c27 req-57f6ae44-f8c6-4a1d-8647-7994aa76b8fa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031126 Jul 31 01:54:27.854794 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3127/6283] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:54:28.859832 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e22779b1-2728-4a10-b1c7-0ed2cbd4e4ff tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:28.860352 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e22779b1-2728-4a10-b1c7-0ed2cbd4e4ff tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:28.867463 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e22779b1-2728-4a10-b1c7-0ed2cbd4e4ff tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:28.867921 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e22779b1-2728-4a10-b1c7-0ed2cbd4e4ff tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:28.868689 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e22779b1-2728-4a10-b1c7-0ed2cbd4e4ff tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:28.869137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e22779b1-2728-4a10-b1c7-0ed2cbd4e4ff tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:28.894847 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e22779b1-2728-4a10-b1c7-0ed2cbd4e4ff tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/ips" status: 200 len: 151 microversion: 2.1 time: 0.040449 Jul 31 01:54:28.895434 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3157/6284] 10.222.0.45 () {58 vars in 1248 bytes} [Sun Jul 31 01:54:28 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:54:30.218674 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ff1c0bdf-be38-434e-b2eb-bed04a3ec182 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d9612fe-2d67-465d-bb0d-a7c47ec04bdd"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:54:30.221188 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ff1c0bdf-be38-434e-b2eb-bed04a3ec182 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:30.228397 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff1c0bdf-be38-434e-b2eb-bed04a3ec182 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:30.228869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff1c0bdf-be38-434e-b2eb-bed04a3ec182 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:30.229650 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff1c0bdf-be38-434e-b2eb-bed04a3ec182 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:30.230110 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff1c0bdf-be38-434e-b2eb-bed04a3ec182 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:30.478864 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ff1c0bdf-be38-434e-b2eb-bed04a3ec182 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "POST /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264253 Jul 31 01:54:30.479541 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3128/6285] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:54:30 2022] POST /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:54:41.177989 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5af546ff-ff1a-4ed5-8a9a-99f4c1978f95 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d9612fe-2d67-465d-bb0d-a7c47ec04bdd"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:54:41.180363 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5af546ff-ff1a-4ed5-8a9a-99f4c1978f95 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:41.183260 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=7 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:54:41.183931 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=41 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:54:41.190066 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5af546ff-ff1a-4ed5-8a9a-99f4c1978f95 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:41.190530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5af546ff-ff1a-4ed5-8a9a-99f4c1978f95 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:41.191355 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5af546ff-ff1a-4ed5-8a9a-99f4c1978f95 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:41.191818 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5af546ff-ff1a-4ed5-8a9a-99f4c1978f95 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:41.273349 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-5af546ff-ff1a-4ed5-8a9a-99f4c1978f95 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] HTTP exception thrown: Invalid volume: volume 6d9612fe-2d67-465d-bb0d-a7c47ec04bdd is already attached to instances: 310c394a-649d-49cd-98d4-707c32674d72 Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5af546ff-ff1a-4ed5-8a9a-99f4c1978f95 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Request method failure captured: Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments HTTP/1.1 Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 74 Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eArI_gg0PT5-mV1qvuSL56nJadb0JF4TL7uux8WXl3vok79f3uc98C7KYpH06iqd1o5cKdHNoOHQWtXYdIXh_OVDcfYH6kPL5MbcaUpikVPOXbVysh9krPcYr4kZ9fFwweKvXn3eXhTJHKVTngQ3MZesHwqBtr4Ap4TCwGoP0qN184 Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29818dc3fb6e4de198be5662dc764989", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 145ff42ae8134ad697f09fd339933bb9 Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: {"volumeAttachment": {"volumeId": "6d9612fe-2d67-465d-bb0d-a7c47ec04bdd"}} Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: exception: Invalid volume: volume 6d9612fe-2d67-465d-bb0d-a7c47ec04bdd is already attached to instances: 310c394a-649d-49cd-98d4-707c32674d72 Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: action_args: {'server_id': '310c394a-649d-49cd-98d4-707c32674d72', 'body': {'volumeAttachment': {'volumeId': '6d9612fe-2d67-465d-bb0d-a7c47ec04bdd'}}} Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6d9612fe-2d67-465d-bb0d-a7c47ec04bdd is already attached to instances: 310c394a-649d-49cd-98d4-707c32674d72 Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:54:41.275120 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6d9612fe-2d67-465d-bb0d-a7c47ec04bdd is already attached to instances: 310c394a-649d-49cd-98d4-707c32674d72 Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6d9612fe-2d67-465d-bb0d-a7c47ec04bdd is already attached to instances: 310c394a-649d-49cd-98d4-707c32674d72 Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5af546ff-ff1a-4ed5-8a9a-99f4c1978f95 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Returning 400 to user: Invalid volume: volume 6d9612fe-2d67-465d-bb0d-a7c47ec04bdd is already attached to instances: 310c394a-649d-49cd-98d4-707c32674d72 {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5af546ff-ff1a-4ed5-8a9a-99f4c1978f95 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "POST /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102660 Jul 31 01:54:41.279642 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3158/6286] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:54:41 2022] POST /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 01:54:41.340364 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-80d70dc1-9699-4958-bd9c-5fcd0c9525f8 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:41.340973 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-80d70dc1-9699-4958-bd9c-5fcd0c9525f8 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:41.343573 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=27 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:54:41.344400 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:54:41.350636 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80d70dc1-9699-4958-bd9c-5fcd0c9525f8 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:41.351108 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80d70dc1-9699-4958-bd9c-5fcd0c9525f8 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:41.351928 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80d70dc1-9699-4958-bd9c-5fcd0c9525f8 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:41.352391 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-80d70dc1-9699-4958-bd9c-5fcd0c9525f8 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:41.433466 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-80d70dc1-9699-4958-bd9c-5fcd0c9525f8 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lazy-loading 'services' on Instance uuid 310c394a-649d-49cd-98d4-707c32674d72 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:54:41.501359 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-80d70dc1-9699-4958-bd9c-5fcd0c9525f8 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "DELETE /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments/6d9612fe-2d67-465d-bb0d-a7c47ec04bdd" status: 202 len: 0 microversion: 2.1 time: 0.165401 Jul 31 01:54:41.501965 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3129/6287] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 01:54:41 2022] DELETE /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments/6d9612fe-2d67-465d-bb0d-a7c47ec04bdd => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:54:41.510978 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0d46aa86-3d24-4b5a-adcc-339470065803 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:41.513248 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0d46aa86-3d24-4b5a-adcc-339470065803 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:41.519309 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d46aa86-3d24-4b5a-adcc-339470065803 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:41.519831 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d46aa86-3d24-4b5a-adcc-339470065803 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:41.520675 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d46aa86-3d24-4b5a-adcc-339470065803 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:41.521149 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d46aa86-3d24-4b5a-adcc-339470065803 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:41.552329 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0d46aa86-3d24-4b5a-adcc-339470065803 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045947 Jul 31 01:54:41.552895 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3159/6288] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:54:41 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:54:42.566459 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bffbf274-0eab-46ed-b5f4-ea38fbc7c360 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:42.570765 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bffbf274-0eab-46ed-b5f4-ea38fbc7c360 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:42.577147 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bffbf274-0eab-46ed-b5f4-ea38fbc7c360 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:42.577692 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bffbf274-0eab-46ed-b5f4-ea38fbc7c360 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:42.578715 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bffbf274-0eab-46ed-b5f4-ea38fbc7c360 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:42.579236 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bffbf274-0eab-46ed-b5f4-ea38fbc7c360 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:42.622410 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bffbf274-0eab-46ed-b5f4-ea38fbc7c360 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061062 Jul 31 01:54:42.623287 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3130/6289] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:54:42 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:54:43.634303 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a37be188-d459-487c-b5bf-903efff7e91e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:43.636569 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a37be188-d459-487c-b5bf-903efff7e91e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:43.643530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a37be188-d459-487c-b5bf-903efff7e91e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:43.643999 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a37be188-d459-487c-b5bf-903efff7e91e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:43.644780 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a37be188-d459-487c-b5bf-903efff7e91e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:43.645230 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a37be188-d459-487c-b5bf-903efff7e91e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:43.675678 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a37be188-d459-487c-b5bf-903efff7e91e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045387 Jul 31 01:54:43.676448 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3160/6290] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:54:43 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:54:44.688257 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f97ce497-ce86-45f8-a07d-b2c343ff6054 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:44.690381 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f97ce497-ce86-45f8-a07d-b2c343ff6054 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:44.697500 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f97ce497-ce86-45f8-a07d-b2c343ff6054 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:44.697967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f97ce497-ce86-45f8-a07d-b2c343ff6054 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:44.698749 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f97ce497-ce86-45f8-a07d-b2c343ff6054 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:44.699200 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f97ce497-ce86-45f8-a07d-b2c343ff6054 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:44.728680 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f97ce497-ce86-45f8-a07d-b2c343ff6054 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044513 Jul 31 01:54:44.729239 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3131/6291] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:54:44 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:54:45.742792 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e033e648-37f7-4c23-bc13-c158ffd88520 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:45.745205 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e033e648-37f7-4c23-bc13-c158ffd88520 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:45.752026 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e033e648-37f7-4c23-bc13-c158ffd88520 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:45.752523 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e033e648-37f7-4c23-bc13-c158ffd88520 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:45.753315 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e033e648-37f7-4c23-bc13-c158ffd88520 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:45.753768 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e033e648-37f7-4c23-bc13-c158ffd88520 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:45.784493 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e033e648-37f7-4c23-bc13-c158ffd88520 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047205 Jul 31 01:54:45.785176 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3161/6292] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:54:45 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:54:46.799099 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1f6ed4c1-b553-4442-a211-bb872de5decc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:46.801570 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1f6ed4c1-b553-4442-a211-bb872de5decc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:46.808525 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f6ed4c1-b553-4442-a211-bb872de5decc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:46.808998 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f6ed4c1-b553-4442-a211-bb872de5decc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:46.809789 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f6ed4c1-b553-4442-a211-bb872de5decc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:46.810250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1f6ed4c1-b553-4442-a211-bb872de5decc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:46.839180 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1f6ed4c1-b553-4442-a211-bb872de5decc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045746 Jul 31 01:54:46.839760 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3132/6293] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:54:46 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:54:46.902486 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4927a205-0ef4-42e8-b4f2-40d8a0d20e5f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:46.903024 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4927a205-0ef4-42e8-b4f2-40d8a0d20e5f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:46.909900 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4927a205-0ef4-42e8-b4f2-40d8a0d20e5f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:46.910360 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4927a205-0ef4-42e8-b4f2-40d8a0d20e5f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:46.911131 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4927a205-0ef4-42e8-b4f2-40d8a0d20e5f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:46.911608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4927a205-0ef4-42e8-b4f2-40d8a0d20e5f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:46.935788 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4927a205-0ef4-42e8-b4f2-40d8a0d20e5f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:54:47.010548 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4927a205-0ef4-42e8-b4f2-40d8a0d20e5f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "DELETE /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72" status: 204 len: 0 microversion: 2.1 time: 0.112268 Jul 31 01:54:47.011162 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3162/6294] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:54:46 2022] DELETE /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:54:47.019263 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f4368f6-6e6a-4f32-810c-d53110303bcc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:47.019927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6f4368f6-6e6a-4f32-810c-d53110303bcc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:47.026739 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f4368f6-6e6a-4f32-810c-d53110303bcc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:47.027200 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f4368f6-6e6a-4f32-810c-d53110303bcc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:47.028216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f4368f6-6e6a-4f32-810c-d53110303bcc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:47.028668 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f4368f6-6e6a-4f32-810c-d53110303bcc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:47.158120 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6f4368f6-6e6a-4f32-810c-d53110303bcc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:47.165750 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6f4368f6-6e6a-4f32-810c-d53110303bcc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72" status: 200 len: 1682 microversion: 2.1 time: 0.150391 Jul 31 01:54:47.166318 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3133/6295] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:47 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:48.188085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c7a723a2-1015-42a6-9d59-b2fac5cc7c5b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:48.188885 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c7a723a2-1015-42a6-9d59-b2fac5cc7c5b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:48.196986 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7a723a2-1015-42a6-9d59-b2fac5cc7c5b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:48.197449 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7a723a2-1015-42a6-9d59-b2fac5cc7c5b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:48.198231 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7a723a2-1015-42a6-9d59-b2fac5cc7c5b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:48.198674 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c7a723a2-1015-42a6-9d59-b2fac5cc7c5b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:48.331868 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c7a723a2-1015-42a6-9d59-b2fac5cc7c5b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:48.340971 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c7a723a2-1015-42a6-9d59-b2fac5cc7c5b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72" status: 200 len: 1682 microversion: 2.1 time: 0.157793 Jul 31 01:54:48.341556 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3163/6296] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:48 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:48.642301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2498ef5b-9173-4188-9313-2c75f5680e55 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:54:48.644647 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2498ef5b-9173-4188-9313-2c75f5680e55 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:48.652360 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2498ef5b-9173-4188-9313-2c75f5680e55 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:48.652853 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2498ef5b-9173-4188-9313-2c75f5680e55 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:48.653640 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2498ef5b-9173-4188-9313-2c75f5680e55 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:48.654087 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2498ef5b-9173-4188-9313-2c75f5680e55 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:48.716070 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2498ef5b-9173-4188-9313-2c75f5680e55 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "POST /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5/action" status: 200 len: 24575 microversion: 2.1 time: 0.077461 Jul 31 01:54:48.722830 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3134/6297] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:54:48 2022] POST /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5/action => generated 24575 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 01:54:49.362228 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bdb74ad1-08ac-4094-aa22-bdaeb6756d6a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:49.362859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bdb74ad1-08ac-4094-aa22-bdaeb6756d6a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:49.370856 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdb74ad1-08ac-4094-aa22-bdaeb6756d6a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:49.371355 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdb74ad1-08ac-4094-aa22-bdaeb6756d6a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:49.372169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdb74ad1-08ac-4094-aa22-bdaeb6756d6a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:49.372642 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdb74ad1-08ac-4094-aa22-bdaeb6756d6a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:49.447200 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bdb74ad1-08ac-4094-aa22-bdaeb6756d6a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:49.456234 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bdb74ad1-08ac-4094-aa22-bdaeb6756d6a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72" status: 200 len: 1615 microversion: 2.1 time: 0.097232 Jul 31 01:54:49.458629 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3164/6298] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:49 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 => generated 1615 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:49.613628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-2d7865aa-23a8-4d9e-8893-1007308f924a req-5568f65a-c928-4036-a7f4-d9feb57cd1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310c394a-649d-49cd-98d4-707c32674d72", "name": "network-vif-deleted", "tag": "36d57061-1058-4fc2-a922-198bce4e2e71"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:54:49.626296 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2d7865aa-23a8-4d9e-8893-1007308f924a req-5568f65a-c928-4036-a7f4-d9feb57cd1e0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:49.626894 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2d7865aa-23a8-4d9e-8893-1007308f924a req-5568f65a-c928-4036-a7f4-d9feb57cd1e0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:49.638762 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-2d7865aa-23a8-4d9e-8893-1007308f924a req-5568f65a-c928-4036-a7f4-d9feb57cd1e0 service nova] Creating event network-vif-deleted:36d57061-1058-4fc2-a922-198bce4e2e71 for instance 310c394a-649d-49cd-98d4-707c32674d72 on n-h2-master-1 Jul 31 01:54:49.644161 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-2d7865aa-23a8-4d9e-8893-1007308f924a req-5568f65a-c928-4036-a7f4-d9feb57cd1e0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206631 Jul 31 01:54:49.644863 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3135/6299] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:54:50.478399 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dc64c8f1-2938-4f8f-881f-bad7069cc6b3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:50.479119 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dc64c8f1-2938-4f8f-881f-bad7069cc6b3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:50.485962 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc64c8f1-2938-4f8f-881f-bad7069cc6b3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:50.486415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc64c8f1-2938-4f8f-881f-bad7069cc6b3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:50.487186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc64c8f1-2938-4f8f-881f-bad7069cc6b3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:50.487659 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc64c8f1-2938-4f8f-881f-bad7069cc6b3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:50.501588 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-dc64c8f1-2938-4f8f-881f-bad7069cc6b3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] HTTP exception thrown: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dc64c8f1-2938-4f8f-881f-bad7069cc6b3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Request method failure captured: Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 HTTP/1.1 Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eArI_gg0PT5-mV1qvuSL56nJadb0JF4TL7uux8WXl3vok79f3uc98C7KYpH06iqd1o5cKdHNoOHQWtXYdIXh_OVDcfYH6kPL5MbcaUpikVPOXbVysh9krPcYr4kZ9fFwweKvXn3eXhTJHKVTngQ3MZesHwqBtr4Ap4TCwGoP0qN184 Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29818dc3fb6e4de198be5662dc764989", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 145ff42ae8134ad697f09fd339933bb9 Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '310c394a-649d-49cd-98d4-707c32674d72'} Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:54:50.503449 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:54:50.507742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:54:50.507742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:54:50.507742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:54:50.507742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:54:50.507742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:54:50.507742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. Jul 31 01:54:50.507742 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:54:50.507742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dc64c8f1-2938-4f8f-881f-bad7069cc6b3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Returning 404 to user: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:54:50.507742 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dc64c8f1-2938-4f8f-881f-bad7069cc6b3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72" status: 404 len: 111 microversion: 2.1 time: 0.030980 Jul 31 01:54:50.507742 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3165/6300] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:50 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:54:50.517140 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-092bc65f-6a76-4711-a3b2-4664cd88f036 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '.version_select at 0x7fede55d8160>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:50.536886 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-092bc65f-6a76-4711-a3b2-4664cd88f036 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-767898071" status: 202 len: 0 microversion: 2.1 time: 0.026422 Jul 31 01:54:50.537463 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3136/6301] 10.222.0.45 () {58 vars in 1218 bytes} [Sun Jul 31 01:54:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-767898071 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:54:51.149046 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d1b95522-2961-4572-906e-d4c70b438c45 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Action: 'create', calling method: .version_select at 0x7fede5b408b0>, body: {"keypair": {"name": "tempest-keypair-89360702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnlsk+meTgy+pBMHVF/RaH9kgJ1bO95cwTS+DiQQ8+mcJr44vUTBy1epENb3OwFYFd07Gm6JKAWEEOGEvlWNkVYbvrrWQotRLLXefh4za34CUT01eBvQXXUY+LS4JGD4A=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:54:51.164365 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-d1b95522-2961-4572-906e-d4c70b438c45 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Getting quotas for project 29818dc3fb6e4de198be5662dc764989. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:54:51.169424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-d1b95522-2961-4572-906e-d4c70b438c45 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Getting quotas for user 145ff42ae8134ad697f09fd339933bb9 and project 29818dc3fb6e4de198be5662dc764989. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:54:51.192248 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d1b95522-2961-4572-906e-d4c70b438c45 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.047238 Jul 31 01:54:51.192839 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3166/6302] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 01:54:51 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:54:52.735279 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d5b5645d-1402-4106-bb4e-fc8400250a9c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-125010993", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c763115-7f67-4122-8316-1251598f7da5"}], "security_groups": [{"name": "tempest-securitygroup--229409298"}], "key_name": "tempest-keypair-89360702", "user_data": "}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:54:52.837510 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-d5b5645d-1402-4106-bb4e-fc8400250a9c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] validate_networks() for [('3c763115-7f67-4122-8316-1251598f7da5', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:54:53.356082 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d5b5645d-1402-4106-bb4e-fc8400250a9c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:54:53.356526 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d5b5645d-1402-4106-bb4e-fc8400250a9c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:54:53.357043 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d5b5645d-1402-4106-bb4e-fc8400250a9c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:54:53.357497 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d5b5645d-1402-4106-bb4e-fc8400250a9c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:54:53.357943 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d5b5645d-1402-4106-bb4e-fc8400250a9c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:54:53.367996 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5b5645d-1402-4106-bb4e-fc8400250a9c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:53.368468 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5b5645d-1402-4106-bb4e-fc8400250a9c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:53.369285 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5b5645d-1402-4106-bb4e-fc8400250a9c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:53.369743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5b5645d-1402-4106-bb4e-fc8400250a9c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:53.387764 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-d5b5645d-1402-4106-bb4e-fc8400250a9c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Getting quotas for project 29818dc3fb6e4de198be5662dc764989. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:54:53.392992 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-d5b5645d-1402-4106-bb4e-fc8400250a9c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Getting quotas for user 145ff42ae8134ad697f09fd339933bb9 and project 29818dc3fb6e4de198be5662dc764989. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:54:53.405390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d5b5645d-1402-4106-bb4e-fc8400250a9c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:54:53.407787 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d5b5645d-1402-4106-bb4e-fc8400250a9c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:54:53.455683 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d5b5645d-1402-4106-bb4e-fc8400250a9c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.725949 Jul 31 01:54:53.456538 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3137/6303] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:54:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 01:54:53.468134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7e6a26e0-7ea9-4751-989f-dcfd23ead972 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:53.468758 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7e6a26e0-7ea9-4751-989f-dcfd23ead972 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:53.527475 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7e6a26e0-7ea9-4751-989f-dcfd23ead972 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:53.534241 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7e6a26e0-7ea9-4751-989f-dcfd23ead972 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73" status: 200 len: 1239 microversion: 2.1 time: 0.071044 Jul 31 01:54:53.534808 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3167/6304] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:53 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:54.556118 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-acb742d5-cd91-411d-be48-c4a23bbb411a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:54.557515 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-acb742d5-cd91-411d-be48-c4a23bbb411a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:54.564791 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-acb742d5-cd91-411d-be48-c4a23bbb411a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:54.565328 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-acb742d5-cd91-411d-be48-c4a23bbb411a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:54.566190 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-acb742d5-cd91-411d-be48-c4a23bbb411a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:54.566707 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-acb742d5-cd91-411d-be48-c4a23bbb411a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:54.635821 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-acb742d5-cd91-411d-be48-c4a23bbb411a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:54.646281 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-acb742d5-cd91-411d-be48-c4a23bbb411a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73" status: 200 len: 1299 microversion: 2.1 time: 0.095317 Jul 31 01:54:54.646865 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3138/6305] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:54 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:55.668756 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3e16a56-b0eb-4e30-b6da-119117a78ba3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:55.670782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3e16a56-b0eb-4e30-b6da-119117a78ba3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:55.678167 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3e16a56-b0eb-4e30-b6da-119117a78ba3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:55.678571 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3e16a56-b0eb-4e30-b6da-119117a78ba3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:55.679440 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3e16a56-b0eb-4e30-b6da-119117a78ba3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:55.679825 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3e16a56-b0eb-4e30-b6da-119117a78ba3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:55.816253 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3e16a56-b0eb-4e30-b6da-119117a78ba3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:55.823730 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3e16a56-b0eb-4e30-b6da-119117a78ba3 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73" status: 200 len: 1364 microversion: 2.1 time: 0.159376 Jul 31 01:54:55.824307 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3168/6306] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:55 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:55.908253 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7b3bc579-6b67-44df-ac6f-0e35d6d81946 req-d3b23ad9-d76b-41d6-bef1-bcca0662089a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec2eb056-cfe4-4573-bbfd-9ec5e167ac73", "tag": "d8dfba9c-4453-4bee-98fb-e36489ed2ab9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:54:55.918836 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7b3bc579-6b67-44df-ac6f-0e35d6d81946 req-d3b23ad9-d76b-41d6-bef1-bcca0662089a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:55.919376 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7b3bc579-6b67-44df-ac6f-0e35d6d81946 req-d3b23ad9-d76b-41d6-bef1-bcca0662089a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:55.930550 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7b3bc579-6b67-44df-ac6f-0e35d6d81946 req-d3b23ad9-d76b-41d6-bef1-bcca0662089a service nova] Creating event network-changed:d8dfba9c-4453-4bee-98fb-e36489ed2ab9 for instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 on n-h2-master-1 Jul 31 01:54:55.935459 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7b3bc579-6b67-44df-ac6f-0e35d6d81946 req-d3b23ad9-d76b-41d6-bef1-bcca0662089a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030922 Jul 31 01:54:55.936056 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3139/6307] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:54:56.845471 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-40f242a2-cbe4-498f-ba57-52f7e39682d7 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:56.846041 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-40f242a2-cbe4-498f-ba57-52f7e39682d7 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:56.853479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40f242a2-cbe4-498f-ba57-52f7e39682d7 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:56.853946 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40f242a2-cbe4-498f-ba57-52f7e39682d7 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:56.854720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40f242a2-cbe4-498f-ba57-52f7e39682d7 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:56.855173 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-40f242a2-cbe4-498f-ba57-52f7e39682d7 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:56.987442 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-40f242a2-cbe4-498f-ba57-52f7e39682d7 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:56.995644 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-40f242a2-cbe4-498f-ba57-52f7e39682d7 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73" status: 200 len: 1364 microversion: 2.1 time: 0.154300 Jul 31 01:54:56.996222 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3169/6308] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:56 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:58.018068 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f53a4736-8fe7-434f-a7a9-2f44b71cb295 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:58.018819 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f53a4736-8fe7-434f-a7a9-2f44b71cb295 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:58.025584 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f53a4736-8fe7-434f-a7a9-2f44b71cb295 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:58.026059 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f53a4736-8fe7-434f-a7a9-2f44b71cb295 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:58.026854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f53a4736-8fe7-434f-a7a9-2f44b71cb295 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:58.027294 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f53a4736-8fe7-434f-a7a9-2f44b71cb295 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:58.156137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f53a4736-8fe7-434f-a7a9-2f44b71cb295 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:58.163945 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f53a4736-8fe7-434f-a7a9-2f44b71cb295 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73" status: 200 len: 1364 microversion: 2.1 time: 0.150976 Jul 31 01:54:58.164516 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3140/6309] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:58 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:54:59.185176 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-72ffdf7d-364f-4696-9411-b7fcb71aae6b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:54:59.185859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-72ffdf7d-364f-4696-9411-b7fcb71aae6b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:54:59.192954 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72ffdf7d-364f-4696-9411-b7fcb71aae6b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:59.193415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72ffdf7d-364f-4696-9411-b7fcb71aae6b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:59.194199 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72ffdf7d-364f-4696-9411-b7fcb71aae6b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:54:59.194701 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72ffdf7d-364f-4696-9411-b7fcb71aae6b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:54:59.324929 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-72ffdf7d-364f-4696-9411-b7fcb71aae6b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:54:59.332360 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-72ffdf7d-364f-4696-9411-b7fcb71aae6b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73" status: 200 len: 1364 microversion: 2.1 time: 0.151106 Jul 31 01:54:59.332948 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3170/6310] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:54:59 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:55:00.354055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0aeeae6f-7a4f-4cd8-aa78-d3b46e68b33c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:00.354798 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0aeeae6f-7a4f-4cd8-aa78-d3b46e68b33c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:00.361637 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0aeeae6f-7a4f-4cd8-aa78-d3b46e68b33c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:00.362106 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0aeeae6f-7a4f-4cd8-aa78-d3b46e68b33c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:00.362895 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0aeeae6f-7a4f-4cd8-aa78-d3b46e68b33c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:00.363365 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0aeeae6f-7a4f-4cd8-aa78-d3b46e68b33c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:00.588200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0aeeae6f-7a4f-4cd8-aa78-d3b46e68b33c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:55:00.601463 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-1babe0fd-87e1-4f94-af0b-17042ccd8a84 req-b405895e-54de-45c2-b175-faf17d4969e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec2eb056-cfe4-4573-bbfd-9ec5e167ac73", "name": "network-vif-plugged", "status": "completed", "tag": "d8dfba9c-4453-4bee-98fb-e36489ed2ab9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:55:00.607751 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0aeeae6f-7a4f-4cd8-aa78-d3b46e68b33c tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73" status: 200 len: 1364 microversion: 2.1 time: 0.256943 Jul 31 01:55:00.610103 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3141/6311] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:55:00 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:55:00.615356 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1babe0fd-87e1-4f94-af0b-17042ccd8a84 req-b405895e-54de-45c2-b175-faf17d4969e2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:00.616788 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1babe0fd-87e1-4f94-af0b-17042ccd8a84 req-b405895e-54de-45c2-b175-faf17d4969e2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:00.629646 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1babe0fd-87e1-4f94-af0b-17042ccd8a84 req-b405895e-54de-45c2-b175-faf17d4969e2 service nova] Creating event network-vif-plugged:d8dfba9c-4453-4bee-98fb-e36489ed2ab9 for instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 on n-h2-master-1 Jul 31 01:55:00.640664 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-1babe0fd-87e1-4f94-af0b-17042ccd8a84 req-b405895e-54de-45c2-b175-faf17d4969e2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043474 Jul 31 01:55:00.641437 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3171/6312] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:55:00.644920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dc301b84-8165-4910-8d31-5f08bdd5d07b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:00.645715 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dc301b84-8165-4910-8d31-5f08bdd5d07b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:00.647779 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-ac857d7a-3ff4-48aa-b173-458845411a20 req-f66c6c3f-c7f1-41ea-927b-d8508a080630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1beeae60-b912-44b1-9832-58ac3b4ff2e5", "tag": "b414663b-1ae8-40e3-992e-1e1fe62210ba"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:55:00.655558 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dc301b84-8165-4910-8d31-5f08bdd5d07b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:00.656412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dc301b84-8165-4910-8d31-5f08bdd5d07b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:00.657510 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dc301b84-8165-4910-8d31-5f08bdd5d07b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:00.658094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ac857d7a-3ff4-48aa-b173-458845411a20 req-f66c6c3f-c7f1-41ea-927b-d8508a080630 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:00.658456 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dc301b84-8165-4910-8d31-5f08bdd5d07b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:00.659840 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ac857d7a-3ff4-48aa-b173-458845411a20 req-f66c6c3f-c7f1-41ea-927b-d8508a080630 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:00.676014 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-ac857d7a-3ff4-48aa-b173-458845411a20 req-f66c6c3f-c7f1-41ea-927b-d8508a080630 service nova] Creating event network-changed:b414663b-1ae8-40e3-992e-1e1fe62210ba for instance 1beeae60-b912-44b1-9832-58ac3b4ff2e5 on n-h1-master-1 Jul 31 01:55:00.681667 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-ac857d7a-3ff4-48aa-b173-458845411a20 req-f66c6c3f-c7f1-41ea-927b-d8508a080630 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038513 Jul 31 01:55:00.685307 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3172/6313] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:55:00.699541 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dc301b84-8165-4910-8d31-5f08bdd5d07b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:55:00.806713 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dc301b84-8165-4910-8d31-5f08bdd5d07b tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 204 len: 0 microversion: 2.1 time: 0.167179 Jul 31 01:55:00.807881 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3142/6314] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:55:00 2022] DELETE /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 01:55:00.817219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c73472bf-abe7-47bc-8b38-3dd8853b818d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:00.818168 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c73472bf-abe7-47bc-8b38-3dd8853b818d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:00.824942 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c73472bf-abe7-47bc-8b38-3dd8853b818d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:00.825406 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c73472bf-abe7-47bc-8b38-3dd8853b818d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:00.826409 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c73472bf-abe7-47bc-8b38-3dd8853b818d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:00.826912 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c73472bf-abe7-47bc-8b38-3dd8853b818d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:00.964858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c73472bf-abe7-47bc-8b38-3dd8853b818d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:55:00.972771 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c73472bf-abe7-47bc-8b38-3dd8853b818d tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1688 microversion: 2.1 time: 0.160470 Jul 31 01:55:00.973375 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3173/6315] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:55:00 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:55:01.635856 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a92b5095-08a0-4d84-b4e9-bcd3f0664a65 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:01.636594 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a92b5095-08a0-4d84-b4e9-bcd3f0664a65 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:01.643745 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a92b5095-08a0-4d84-b4e9-bcd3f0664a65 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:01.644224 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a92b5095-08a0-4d84-b4e9-bcd3f0664a65 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:01.645028 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a92b5095-08a0-4d84-b4e9-bcd3f0664a65 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:01.645486 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a92b5095-08a0-4d84-b4e9-bcd3f0664a65 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:01.786696 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a92b5095-08a0-4d84-b4e9-bcd3f0664a65 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:55:01.794246 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a92b5095-08a0-4d84-b4e9-bcd3f0664a65 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73" status: 200 len: 1364 microversion: 2.1 time: 0.164212 Jul 31 01:55:01.794804 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3143/6316] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:55:01 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:55:01.996902 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a37d0ccb-c0ae-4965-bd82-9a47701153f5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:01.997528 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a37d0ccb-c0ae-4965-bd82-9a47701153f5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:02.004539 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a37d0ccb-c0ae-4965-bd82-9a47701153f5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:02.005003 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a37d0ccb-c0ae-4965-bd82-9a47701153f5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:02.005782 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a37d0ccb-c0ae-4965-bd82-9a47701153f5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:02.006229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a37d0ccb-c0ae-4965-bd82-9a47701153f5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:02.138008 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a37d0ccb-c0ae-4965-bd82-9a47701153f5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b799c19fd26348d3a84198bb76581c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736abaeccdf44e3899d98fdf2cac4c0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:55:02.145549 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a37d0ccb-c0ae-4965-bd82-9a47701153f5 tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 200 len: 1688 microversion: 2.1 time: 0.152564 Jul 31 01:55:02.146128 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3174/6317] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:55:01 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:55:02.696697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-60ecff95-86f6-47bc-8d6e-886f0c5760f3 req-68bc97a7-303b-4050-8df6-78c6a2567dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1beeae60-b912-44b1-9832-58ac3b4ff2e5", "name": "network-vif-deleted", "tag": "b414663b-1ae8-40e3-992e-1e1fe62210ba"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:55:02.708394 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-60ecff95-86f6-47bc-8d6e-886f0c5760f3 req-68bc97a7-303b-4050-8df6-78c6a2567dc5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:02.708858 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-60ecff95-86f6-47bc-8d6e-886f0c5760f3 req-68bc97a7-303b-4050-8df6-78c6a2567dc5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:02.722236 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-60ecff95-86f6-47bc-8d6e-886f0c5760f3 req-68bc97a7-303b-4050-8df6-78c6a2567dc5 service nova] Creating event network-vif-deleted:b414663b-1ae8-40e3-992e-1e1fe62210ba for instance 1beeae60-b912-44b1-9832-58ac3b4ff2e5 on n-h1-master-1 Jul 31 01:55:02.727690 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-60ecff95-86f6-47bc-8d6e-886f0c5760f3 req-68bc97a7-303b-4050-8df6-78c6a2567dc5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035152 Jul 31 01:55:02.728301 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3144/6318] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:55:02.814481 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-43d8f9fd-5eb6-4d9a-ac33-cc557898c271 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:02.815108 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-43d8f9fd-5eb6-4d9a-ac33-cc557898c271 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:02.821872 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43d8f9fd-5eb6-4d9a-ac33-cc557898c271 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:02.822332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43d8f9fd-5eb6-4d9a-ac33-cc557898c271 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:02.823109 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43d8f9fd-5eb6-4d9a-ac33-cc557898c271 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:02.823579 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43d8f9fd-5eb6-4d9a-ac33-cc557898c271 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:02.958817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-43d8f9fd-5eb6-4d9a-ac33-cc557898c271 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:55:02.967638 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-43d8f9fd-5eb6-4d9a-ac33-cc557898c271 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73" status: 200 len: 1554 microversion: 2.1 time: 0.156895 Jul 31 01:55:02.968127 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3175/6319] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:55:02 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:55:02.989143 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5d956fe7-e257-4daa-a65b-eac3914d1a16 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:02.989781 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5d956fe7-e257-4daa-a65b-eac3914d1a16 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:02.996956 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d956fe7-e257-4daa-a65b-eac3914d1a16 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:02.997426 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d956fe7-e257-4daa-a65b-eac3914d1a16 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:02.998221 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d956fe7-e257-4daa-a65b-eac3914d1a16 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:02.998673 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d956fe7-e257-4daa-a65b-eac3914d1a16 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:03.088579 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5d956fe7-e257-4daa-a65b-eac3914d1a16 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104073 Jul 31 01:55:03.089576 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3145/6320] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 01:55:02 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:55:03.166126 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6f8df3f3-7ef4-44eb-b9ae-def48ec1793a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:03.166655 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6f8df3f3-7ef4-44eb-b9ae-def48ec1793a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] [instance: 1beeae60-b912-44b1-9832-58ac3b4ff2e5] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:03.173543 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6f8df3f3-7ef4-44eb-b9ae-def48ec1793a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:03.174003 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6f8df3f3-7ef4-44eb-b9ae-def48ec1793a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:03.174822 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6f8df3f3-7ef4-44eb-b9ae-def48ec1793a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:03.175241 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6f8df3f3-7ef4-44eb-b9ae-def48ec1793a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:03.189541 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-6f8df3f3-7ef4-44eb-b9ae-def48ec1793a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] HTTP exception thrown: Instance 1beeae60-b912-44b1-9832-58ac3b4ff2e5 could not be found. Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6f8df3f3-7ef4-44eb-b9ae-def48ec1793a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Request method failure captured: Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 HTTP/1.1 Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5d9Kf4E3IZDZUsj11OUUTq3aW5TKVoTTbNXJKKFyTqRkWTfvcurnGmoWdsnkQBC06JOC-RzmfXv9UpgiSjIwgxiuii_gLTCRUhYfcSIeg4jSALKpm0sQONrNpVV2nG8N0HrFSmgFYp_LLq1OtetyO0y_1Ae7AWsoynrjLTPfogUx0M8 Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 736abaeccdf44e3899d98fdf2cac4c0f Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-882728420 Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/736abaeccdf44e3899d98fdf2cac4c0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/736abaeccdf44e3899d98fdf2cac4c0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/736abaeccdf44e3899d98fdf2cac4c0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_736abaeccdf44e3899d98fdf2cac4c0f", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestNetworkAdvancedServerOps-882728420 Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 736abaeccdf44e3899d98fdf2cac4c0f Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-882728420 Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestNetworkAdvancedServerOps-882728420-project Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: b799c19fd26348d3a84198bb76581c87 Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestNetworkAdvancedServerOps-882728420-project Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 1beeae60-b912-44b1-9832-58ac3b4ff2e5 could not be found. Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '1beeae60-b912-44b1-9832-58ac3b4ff2e5'} Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1beeae60-b912-44b1-9832-58ac3b4ff2e5 could not be found. Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1beeae60-b912-44b1-9832-58ac3b4ff2e5 could not be found. Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:55:03.191223 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:55:03.196264 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:55:03.196264 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:55:03.196264 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:55:03.196264 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:55:03.196264 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:55:03.196264 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1beeae60-b912-44b1-9832-58ac3b4ff2e5 could not be found. Jul 31 01:55:03.196264 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:55:03.196264 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6f8df3f3-7ef4-44eb-b9ae-def48ec1793a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Returning 404 to user: Instance 1beeae60-b912-44b1-9832-58ac3b4ff2e5 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:55:03.196264 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6f8df3f3-7ef4-44eb-b9ae-def48ec1793a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5" status: 404 len: 111 microversion: 2.1 time: 0.030563 Jul 31 01:55:03.196264 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3176/6321] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:55:03 2022] GET /compute/v2.1/servers/1beeae60-b912-44b1-9832-58ac3b4ff2e5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:55:04.048011 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:55:04.048802 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:55:04.053437 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-9877f628-dadf-4d4b-ba0a-f360452e9df8 req-8352b12f-3e5d-496d-80f8-a9f118322707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec2eb056-cfe4-4573-bbfd-9ec5e167ac73", "tag": "d8dfba9c-4453-4bee-98fb-e36489ed2ab9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:55:04.064038 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9877f628-dadf-4d4b-ba0a-f360452e9df8 req-8352b12f-3e5d-496d-80f8-a9f118322707 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:04.064489 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9877f628-dadf-4d4b-ba0a-f360452e9df8 req-8352b12f-3e5d-496d-80f8-a9f118322707 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:04.076443 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-9877f628-dadf-4d4b-ba0a-f360452e9df8 req-8352b12f-3e5d-496d-80f8-a9f118322707 service nova] Creating event network-changed:d8dfba9c-4453-4bee-98fb-e36489ed2ab9 for instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 on n-h2-master-1 Jul 31 01:55:04.081496 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-9877f628-dadf-4d4b-ba0a-f360452e9df8 req-8352b12f-3e5d-496d-80f8-a9f118322707 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034177 Jul 31 01:55:04.082102 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3146/6322] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:55:06.742923 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-63ee2733-6624-4bd0-a853-257e57a17f0a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] Calling method '.version_select at 0x7fede57afb80>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:06.753882 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:55:06.774994 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-63ee2733-6624-4bd0-a853-257e57a17f0a tempest-TestNetworkAdvancedServerOps-882728420 tempest-TestNetworkAdvancedServerOps-882728420-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1811616414" status: 202 len: 0 microversion: 2.1 time: 0.036544 Jul 31 01:55:06.776202 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3177/6323] 10.222.0.45 () {58 vars in 1284 bytes} [Sun Jul 31 01:55:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1811616414 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:55:33.220590 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:55:33.221545 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:55:33.226189 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e5d92b45-720c-47cc-b2fe-f0616d4dec7b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:33.227400 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e5d92b45-720c-47cc-b2fe-f0616d4dec7b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:33.235216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5d92b45-720c-47cc-b2fe-f0616d4dec7b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:33.235723 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5d92b45-720c-47cc-b2fe-f0616d4dec7b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:33.236508 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5d92b45-720c-47cc-b2fe-f0616d4dec7b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:33.236965 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e5d92b45-720c-47cc-b2fe-f0616d4dec7b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:33.262812 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e5d92b45-720c-47cc-b2fe-f0616d4dec7b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/ips" status: 200 len: 149 microversion: 2.1 time: 0.044220 Jul 31 01:55:33.263416 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3147/6324] 10.222.0.45 () {58 vars in 1248 bytes} [Sun Jul 31 01:55:33 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:55:34.584314 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:55:34.585083 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:55:34.590773 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2108d41d-54c4-4435-aab9-c2e6b2a396cc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d281255-a9f4-408b-9be7-090b9b0b1f92"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:55:34.594255 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2108d41d-54c4-4435-aab9-c2e6b2a396cc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:34.602885 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2108d41d-54c4-4435-aab9-c2e6b2a396cc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:34.603373 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2108d41d-54c4-4435-aab9-c2e6b2a396cc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:34.604156 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2108d41d-54c4-4435-aab9-c2e6b2a396cc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:34.604611 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2108d41d-54c4-4435-aab9-c2e6b2a396cc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:34.858673 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2108d41d-54c4-4435-aab9-c2e6b2a396cc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "POST /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275979 Jul 31 01:55:34.859283 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3178/6325] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 01:55:34 2022] POST /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:55:45.660364 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-14b00450-41b8-4cb2-bc5f-c9a3504f702b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:45.660904 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-14b00450-41b8-4cb2-bc5f-c9a3504f702b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:45.663214 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:55:45.663892 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:55:45.670004 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-14b00450-41b8-4cb2-bc5f-c9a3504f702b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:45.670473 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-14b00450-41b8-4cb2-bc5f-c9a3504f702b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:45.671288 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-14b00450-41b8-4cb2-bc5f-c9a3504f702b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:45.671770 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-14b00450-41b8-4cb2-bc5f-c9a3504f702b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:45.754614 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-14b00450-41b8-4cb2-bc5f-c9a3504f702b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lazy-loading 'services' on Instance uuid ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:55:45.826583 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-14b00450-41b8-4cb2-bc5f-c9a3504f702b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-volume_attachments/8d281255-a9f4-408b-9be7-090b9b0b1f92" status: 202 len: 0 microversion: 2.1 time: 0.170079 Jul 31 01:55:45.827183 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3148/6326] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 01:55:45 2022] DELETE /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-volume_attachments/8d281255-a9f4-408b-9be7-090b9b0b1f92 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:55:45.834584 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:55:45.835396 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:55:45.840985 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-312eb651-ba5a-404a-ac78-a734f23531be tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:45.843503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-312eb651-ba5a-404a-ac78-a734f23531be tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:45.852775 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-312eb651-ba5a-404a-ac78-a734f23531be tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:45.853239 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-312eb651-ba5a-404a-ac78-a734f23531be tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:45.854031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-312eb651-ba5a-404a-ac78-a734f23531be tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:45.854479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-312eb651-ba5a-404a-ac78-a734f23531be tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:45.892217 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-312eb651-ba5a-404a-ac78-a734f23531be tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059556 Jul 31 01:55:45.892954 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3179/6327] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:55:45 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:55:46.905121 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-78db58a4-74e1-4e1a-bcaa-50aba4e4013d tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:46.907493 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-78db58a4-74e1-4e1a-bcaa-50aba4e4013d tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:46.914690 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78db58a4-74e1-4e1a-bcaa-50aba4e4013d tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:46.915142 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78db58a4-74e1-4e1a-bcaa-50aba4e4013d tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:46.915944 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78db58a4-74e1-4e1a-bcaa-50aba4e4013d tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:46.916392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78db58a4-74e1-4e1a-bcaa-50aba4e4013d tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:46.955295 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-78db58a4-74e1-4e1a-bcaa-50aba4e4013d tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054579 Jul 31 01:55:46.955882 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3149/6328] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:55:46 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:55:47.968273 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-652d0cef-e054-4ffe-8bc4-4e88b9418c5f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:47.970518 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-652d0cef-e054-4ffe-8bc4-4e88b9418c5f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:47.977957 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-652d0cef-e054-4ffe-8bc4-4e88b9418c5f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:47.978409 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-652d0cef-e054-4ffe-8bc4-4e88b9418c5f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:47.979173 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-652d0cef-e054-4ffe-8bc4-4e88b9418c5f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:47.979635 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-652d0cef-e054-4ffe-8bc4-4e88b9418c5f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:48.012870 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-652d0cef-e054-4ffe-8bc4-4e88b9418c5f tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048652 Jul 31 01:55:48.013589 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3180/6329] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:55:47 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:55:49.024931 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6a2a2020-001b-4c87-a604-40c5df932465 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:49.027150 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6a2a2020-001b-4c87-a604-40c5df932465 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:49.035143 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a2a2020-001b-4c87-a604-40c5df932465 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:49.035665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a2a2020-001b-4c87-a604-40c5df932465 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:49.036426 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a2a2020-001b-4c87-a604-40c5df932465 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:49.036910 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a2a2020-001b-4c87-a604-40c5df932465 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:49.067377 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6a2a2020-001b-4c87-a604-40c5df932465 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046446 Jul 31 01:55:49.067947 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3150/6330] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:55:49 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:55:50.079731 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cb77aee9-6dc1-441a-bc22-1101d5dc6d0a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:50.081947 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cb77aee9-6dc1-441a-bc22-1101d5dc6d0a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:50.089672 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb77aee9-6dc1-441a-bc22-1101d5dc6d0a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:50.090137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb77aee9-6dc1-441a-bc22-1101d5dc6d0a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:50.090924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb77aee9-6dc1-441a-bc22-1101d5dc6d0a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:50.091399 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cb77aee9-6dc1-441a-bc22-1101d5dc6d0a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:50.121440 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cb77aee9-6dc1-441a-bc22-1101d5dc6d0a tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045749 Jul 31 01:55:50.122018 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3181/6331] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:55:50 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:55:51.133859 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f6d1ce9d-f724-43e1-aa9b-60c03538b0aa tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:51.136157 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f6d1ce9d-f724-43e1-aa9b-60c03538b0aa tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:51.143064 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6d1ce9d-f724-43e1-aa9b-60c03538b0aa tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:51.143558 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6d1ce9d-f724-43e1-aa9b-60c03538b0aa tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:51.144332 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6d1ce9d-f724-43e1-aa9b-60c03538b0aa tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:51.144783 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6d1ce9d-f724-43e1-aa9b-60c03538b0aa tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:51.173690 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f6d1ce9d-f724-43e1-aa9b-60c03538b0aa tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043866 Jul 31 01:55:51.174230 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3151/6332] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 01:55:51 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 01:55:51.234153 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2c44cd99-a905-42c5-a124-b47f4efc14fc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:51.234684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2c44cd99-a905-42c5-a124-b47f4efc14fc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:51.241701 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c44cd99-a905-42c5-a124-b47f4efc14fc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:51.242157 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c44cd99-a905-42c5-a124-b47f4efc14fc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:51.243035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c44cd99-a905-42c5-a124-b47f4efc14fc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:51.243513 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2c44cd99-a905-42c5-a124-b47f4efc14fc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:51.268270 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2c44cd99-a905-42c5-a124-b47f4efc14fc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:55:51.342101 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2c44cd99-a905-42c5-a124-b47f4efc14fc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73" status: 204 len: 0 microversion: 2.1 time: 0.111553 Jul 31 01:55:51.342687 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3182/6333] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:55:51 2022] DELETE /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:55:51.351403 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-26ace3cf-b640-46b0-8a64-eff4600b0588 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:51.352040 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-26ace3cf-b640-46b0-8a64-eff4600b0588 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:51.358157 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26ace3cf-b640-46b0-8a64-eff4600b0588 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:51.358626 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26ace3cf-b640-46b0-8a64-eff4600b0588 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:51.359433 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26ace3cf-b640-46b0-8a64-eff4600b0588 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:51.359894 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26ace3cf-b640-46b0-8a64-eff4600b0588 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:51.493868 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-26ace3cf-b640-46b0-8a64-eff4600b0588 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:55:51.501486 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-26ace3cf-b640-46b0-8a64-eff4600b0588 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73" status: 200 len: 1678 microversion: 2.1 time: 0.154222 Jul 31 01:55:51.502053 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3152/6334] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:55:51 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:55:52.523482 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4b499f4b-b4c4-4b7f-abcc-b2410772b302 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:52.524693 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4b499f4b-b4c4-4b7f-abcc-b2410772b302 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:52.531118 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b499f4b-b4c4-4b7f-abcc-b2410772b302 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:52.531603 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b499f4b-b4c4-4b7f-abcc-b2410772b302 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:52.532368 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b499f4b-b4c4-4b7f-abcc-b2410772b302 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:52.532808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4b499f4b-b4c4-4b7f-abcc-b2410772b302 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:52.661980 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4b499f4b-b4c4-4b7f-abcc-b2410772b302 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:55:52.670188 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4b499f4b-b4c4-4b7f-abcc-b2410772b302 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73" status: 200 len: 1678 microversion: 2.1 time: 0.151159 Jul 31 01:55:52.670766 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3183/6335] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:55:52 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:55:53.692264 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4475f8e1-f359-44fa-b7af-e5dc395267ce tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:53.692914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4475f8e1-f359-44fa-b7af-e5dc395267ce tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:53.701107 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4475f8e1-f359-44fa-b7af-e5dc395267ce tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:53.701335 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4475f8e1-f359-44fa-b7af-e5dc395267ce tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:53.702139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4475f8e1-f359-44fa-b7af-e5dc395267ce tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:53.702531 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4475f8e1-f359-44fa-b7af-e5dc395267ce tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:53.757500 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-e2056d0a-0e46-4d69-b51e-953d65a7d0ee req-81705fb9-b43f-416d-ac53-644f4826c60f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec2eb056-cfe4-4573-bbfd-9ec5e167ac73", "name": "network-vif-deleted", "tag": "d8dfba9c-4453-4bee-98fb-e36489ed2ab9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:55:53.769420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e2056d0a-0e46-4d69-b51e-953d65a7d0ee req-81705fb9-b43f-416d-ac53-644f4826c60f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:53.769872 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e2056d0a-0e46-4d69-b51e-953d65a7d0ee req-81705fb9-b43f-416d-ac53-644f4826c60f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:53.783217 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-e2056d0a-0e46-4d69-b51e-953d65a7d0ee req-81705fb9-b43f-416d-ac53-644f4826c60f service nova] Creating event network-vif-deleted:d8dfba9c-4453-4bee-98fb-e36489ed2ab9 for instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 on n-h2-master-1 Jul 31 01:55:53.788897 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-e2056d0a-0e46-4d69-b51e-953d65a7d0ee req-81705fb9-b43f-416d-ac53-644f4826c60f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034980 Jul 31 01:55:53.790010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4475f8e1-f359-44fa-b7af-e5dc395267ce tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ff42ae8134ad697f09fd339933bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29818dc3fb6e4de198be5662dc764989', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:55:53.794583 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3184/6336] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:55:53.798951 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4475f8e1-f359-44fa-b7af-e5dc395267ce tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73" status: 200 len: 1611 microversion: 2.1 time: 0.111471 Jul 31 01:55:53.799778 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3153/6337] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:55:53 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 => generated 1611 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:55:54.822240 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a6c7a7a6-2d55-42ec-84d7-9789f2581abc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:54.822953 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a6c7a7a6-2d55-42ec-84d7-9789f2581abc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:54.829292 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a6c7a7a6-2d55-42ec-84d7-9789f2581abc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:54.829749 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a6c7a7a6-2d55-42ec-84d7-9789f2581abc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:54.830519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a6c7a7a6-2d55-42ec-84d7-9789f2581abc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:54.830965 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a6c7a7a6-2d55-42ec-84d7-9789f2581abc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:54.844549 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-a6c7a7a6-2d55-42ec-84d7-9789f2581abc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] HTTP exception thrown: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a6c7a7a6-2d55-42ec-84d7-9789f2581abc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Request method failure captured: Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 HTTP/1.1 Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eArI_gg0PT5-mV1qvuSL56nJadb0JF4TL7uux8WXl3vok79f3uc98C7KYpH06iqd1o5cKdHNoOHQWtXYdIXh_OVDcfYH6kPL5MbcaUpikVPOXbVysh9krPcYr4kZ9fFwweKvXn3eXhTJHKVTngQ3MZesHwqBtr4Ap4TCwGoP0qN184 Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29818dc3fb6e4de198be5662dc764989", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 145ff42ae8134ad697f09fd339933bb9 Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: exception: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'ec2eb056-cfe4-4573-bbfd-9ec5e167ac73'} Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:55:54.846152 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:55:54.850813 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:55:54.850813 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:55:54.850813 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:55:54.850813 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:55:54.850813 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:55:54.850813 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. Jul 31 01:55:54.850813 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:55:54.850813 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a6c7a7a6-2d55-42ec-84d7-9789f2581abc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Returning 404 to user: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:55:54.850813 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a6c7a7a6-2d55-42ec-84d7-9789f2581abc tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73" status: 404 len: 111 microversion: 2.1 time: 0.030634 Jul 31 01:55:54.850813 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3185/6338] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:55:54 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:55:54.857064 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a9587595-ca1d-48c4-98bc-d523d1c2a513 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '.version_select at 0x7fede5647430>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:54.876492 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a9587595-ca1d-48c4-98bc-d523d1c2a513 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-89360702" status: 202 len: 0 microversion: 2.1 time: 0.023310 Jul 31 01:55:54.877063 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3154/6339] 10.222.0.45 () {58 vars in 1215 bytes} [Sun Jul 31 01:55:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-89360702 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:55:58.728739 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a814bb09-9658-4b3c-9566-250d7638f67b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:58.729323 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a814bb09-9658-4b3c-9566-250d7638f67b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:58.736915 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a814bb09-9658-4b3c-9566-250d7638f67b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:58.737384 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a814bb09-9658-4b3c-9566-250d7638f67b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:58.738179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a814bb09-9658-4b3c-9566-250d7638f67b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:58.738953 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a814bb09-9658-4b3c-9566-250d7638f67b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:58.755271 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-a814bb09-9658-4b3c-9566-250d7638f67b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] HTTP exception thrown: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a814bb09-9658-4b3c-9566-250d7638f67b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Request method failure captured: Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 HTTP/1.1 Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eArI_gg0PT5-mV1qvuSL56nJadb0JF4TL7uux8WXl3vok79f3uc98C7KYpH06iqd1o5cKdHNoOHQWtXYdIXh_OVDcfYH6kPL5MbcaUpikVPOXbVysh9krPcYr4kZ9fFwweKvXn3eXhTJHKVTngQ3MZesHwqBtr4Ap4TCwGoP0qN184 Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29818dc3fb6e4de198be5662dc764989", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 145ff42ae8134ad697f09fd339933bb9 Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: exception: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'ec2eb056-cfe4-4573-bbfd-9ec5e167ac73'} Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:55:58.756886 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:55:58.765132 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. Jul 31 01:55:58.765132 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:55:58.765132 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:55:58.765132 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:55:58.765132 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:55:58.765132 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:55:58.765132 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:55:58.765132 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:55:58.765132 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:55:58.765132 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. Jul 31 01:55:58.765132 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:55:58.765132 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a814bb09-9658-4b3c-9566-250d7638f67b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Returning 404 to user: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:55:58.765132 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a814bb09-9658-4b3c-9566-250d7638f67b tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73" status: 404 len: 111 microversion: 2.1 time: 0.033561 Jul 31 01:55:58.765132 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3186/6340] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:55:58 2022] DELETE /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:55:58.769701 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2a9a444d-e304-4fdd-b086-20236df02397 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:55:58.770409 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2a9a444d-e304-4fdd-b086-20236df02397 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: ec2eb056-cfe4-4573-bbfd-9ec5e167ac73] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:55:58.779302 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2a9a444d-e304-4fdd-b086-20236df02397 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:58.779811 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2a9a444d-e304-4fdd-b086-20236df02397 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:58.780603 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2a9a444d-e304-4fdd-b086-20236df02397 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:55:58.781057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2a9a444d-e304-4fdd-b086-20236df02397 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:55:58.794837 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-2a9a444d-e304-4fdd-b086-20236df02397 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] HTTP exception thrown: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2a9a444d-e304-4fdd-b086-20236df02397 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Request method failure captured: Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 HTTP/1.1 Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eArI_gg0PT5-mV1qvuSL56nJadb0JF4TL7uux8WXl3vok79f3uc98C7KYpH06iqd1o5cKdHNoOHQWtXYdIXh_OVDcfYH6kPL5MbcaUpikVPOXbVysh9krPcYr4kZ9fFwweKvXn3eXhTJHKVTngQ3MZesHwqBtr4Ap4TCwGoP0qN184 Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29818dc3fb6e4de198be5662dc764989", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 145ff42ae8134ad697f09fd339933bb9 Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: exception: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'ec2eb056-cfe4-4573-bbfd-9ec5e167ac73'} Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:55:58.796558 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:55:58.800536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:55:58.800536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:55:58.800536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:55:58.800536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:55:58.800536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:55:58.800536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. Jul 31 01:55:58.800536 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:55:58.800536 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2a9a444d-e304-4fdd-b086-20236df02397 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Returning 404 to user: Instance ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:55:58.800536 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2a9a444d-e304-4fdd-b086-20236df02397 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73" status: 404 len: 111 microversion: 2.1 time: 0.033258 Jul 31 01:55:58.800536 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3155/6341] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:55:58 2022] GET /compute/v2.1/servers/ec2eb056-cfe4-4573-bbfd-9ec5e167ac73 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:55:59.347548 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 01:55:59.347720 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 01:55:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 01:56:02.059586 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b6cb14d1-9a2f-42b5-b0d6-81737b698fd0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:56:02.060238 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b6cb14d1-9a2f-42b5-b0d6-81737b698fd0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:56:02.068516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6cb14d1-9a2f-42b5-b0d6-81737b698fd0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:56:02.068983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6cb14d1-9a2f-42b5-b0d6-81737b698fd0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:56:02.069779 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6cb14d1-9a2f-42b5-b0d6-81737b698fd0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:56:02.070229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6cb14d1-9a2f-42b5-b0d6-81737b698fd0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:56:02.088295 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-b6cb14d1-9a2f-42b5-b0d6-81737b698fd0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] HTTP exception thrown: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b6cb14d1-9a2f-42b5-b0d6-81737b698fd0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Request method failure captured: Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 HTTP/1.1 Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eArI_gg0PT5-mV1qvuSL56nJadb0JF4TL7uux8WXl3vok79f3uc98C7KYpH06iqd1o5cKdHNoOHQWtXYdIXh_OVDcfYH6kPL5MbcaUpikVPOXbVysh9krPcYr4kZ9fFwweKvXn3eXhTJHKVTngQ3MZesHwqBtr4Ap4TCwGoP0qN184 Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29818dc3fb6e4de198be5662dc764989", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 145ff42ae8134ad697f09fd339933bb9 Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '310c394a-649d-49cd-98d4-707c32674d72'} Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:56:02.089878 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:56:02.098748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. Jul 31 01:56:02.098748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.098748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:56:02.098748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.098748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:02.098748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:56:02.098748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:56:02.098748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:56:02.098748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:56:02.098748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. Jul 31 01:56:02.098748 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.098748 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b6cb14d1-9a2f-42b5-b0d6-81737b698fd0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Returning 404 to user: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:56:02.098748 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b6cb14d1-9a2f-42b5-b0d6-81737b698fd0 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "DELETE /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72" status: 404 len: 111 microversion: 2.1 time: 0.035769 Jul 31 01:56:02.098748 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3187/6342] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:56:02 2022] DELETE /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:56:02.101962 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7d9af909-45bd-49c2-9ec7-824bc18df231 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:56:02.101962 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7d9af909-45bd-49c2-9ec7-824bc18df231 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 310c394a-649d-49cd-98d4-707c32674d72] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:56:02.109015 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d9af909-45bd-49c2-9ec7-824bc18df231 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:56:02.109519 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d9af909-45bd-49c2-9ec7-824bc18df231 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:56:02.110308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d9af909-45bd-49c2-9ec7-824bc18df231 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:56:02.110764 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d9af909-45bd-49c2-9ec7-824bc18df231 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:56:02.127283 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-7d9af909-45bd-49c2-9ec7-824bc18df231 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] HTTP exception thrown: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7d9af909-45bd-49c2-9ec7-824bc18df231 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Request method failure captured: Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 HTTP/1.1 Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eArI_gg0PT5-mV1qvuSL56nJadb0JF4TL7uux8WXl3vok79f3uc98C7KYpH06iqd1o5cKdHNoOHQWtXYdIXh_OVDcfYH6kPL5MbcaUpikVPOXbVysh9krPcYr4kZ9fFwweKvXn3eXhTJHKVTngQ3MZesHwqBtr4Ap4TCwGoP0qN184 Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29818dc3fb6e4de198be5662dc764989", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 145ff42ae8134ad697f09fd339933bb9 Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '310c394a-649d-49cd-98d4-707c32674d72'} Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:56:02.128864 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.134344 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:02.134344 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:56:02.134344 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:56:02.134344 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:56:02.134344 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:56:02.134344 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. Jul 31 01:56:02.134344 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.134344 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7d9af909-45bd-49c2-9ec7-824bc18df231 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Returning 404 to user: Instance 310c394a-649d-49cd-98d4-707c32674d72 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:56:02.134344 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7d9af909-45bd-49c2-9ec7-824bc18df231 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72" status: 404 len: 111 microversion: 2.1 time: 0.034006 Jul 31 01:56:02.134344 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3156/6343] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:56:02 2022] GET /compute/v2.1/servers/310c394a-649d-49cd-98d4-707c32674d72 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:56:02.139614 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a762c6e-63ee-4c70-a3cf-8ec7b80246c1 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:56:02.140124 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9a762c6e-63ee-4c70-a3cf-8ec7b80246c1 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:56:02.146174 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a762c6e-63ee-4c70-a3cf-8ec7b80246c1 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:56:02.146632 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a762c6e-63ee-4c70-a3cf-8ec7b80246c1 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:56:02.147443 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a762c6e-63ee-4c70-a3cf-8ec7b80246c1 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:56:02.147891 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a762c6e-63ee-4c70-a3cf-8ec7b80246c1 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:56:02.161314 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-9a762c6e-63ee-4c70-a3cf-8ec7b80246c1 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] HTTP exception thrown: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a762c6e-63ee-4c70-a3cf-8ec7b80246c1 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Request method failure captured: Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f HTTP/1.1 Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eArI_gg0PT5-mV1qvuSL56nJadb0JF4TL7uux8WXl3vok79f3uc98C7KYpH06iqd1o5cKdHNoOHQWtXYdIXh_OVDcfYH6kPL5MbcaUpikVPOXbVysh9krPcYr4kZ9fFwweKvXn3eXhTJHKVTngQ3MZesHwqBtr4Ap4TCwGoP0qN184 Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29818dc3fb6e4de198be5662dc764989", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 145ff42ae8134ad697f09fd339933bb9 Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: exception: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'd4b653a5-553a-4e7e-afa3-aa1e5b57f90f'} Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:56:02.162863 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:56:02.167825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. Jul 31 01:56:02.167825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.167825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:56:02.167825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.167825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:02.167825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:56:02.167825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:56:02.167825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:56:02.167825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:56:02.167825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. Jul 31 01:56:02.167825 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.167825 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a762c6e-63ee-4c70-a3cf-8ec7b80246c1 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Returning 404 to user: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:56:02.167825 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9a762c6e-63ee-4c70-a3cf-8ec7b80246c1 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 404 len: 111 microversion: 2.1 time: 0.028619 Jul 31 01:56:02.167825 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3188/6344] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:56:02 2022] DELETE /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:56:02.173958 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f3c6103a-d9a8-4fff-8b17-04b998217ef4 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:56:02.174587 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f3c6103a-d9a8-4fff-8b17-04b998217ef4 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: d4b653a5-553a-4e7e-afa3-aa1e5b57f90f] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:56:02.181342 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3c6103a-d9a8-4fff-8b17-04b998217ef4 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:56:02.181809 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3c6103a-d9a8-4fff-8b17-04b998217ef4 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:56:02.182588 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3c6103a-d9a8-4fff-8b17-04b998217ef4 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:56:02.183039 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f3c6103a-d9a8-4fff-8b17-04b998217ef4 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:56:02.197192 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-f3c6103a-d9a8-4fff-8b17-04b998217ef4 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] HTTP exception thrown: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f3c6103a-d9a8-4fff-8b17-04b998217ef4 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Request method failure captured: Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f HTTP/1.1 Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eArI_gg0PT5-mV1qvuSL56nJadb0JF4TL7uux8WXl3vok79f3uc98C7KYpH06iqd1o5cKdHNoOHQWtXYdIXh_OVDcfYH6kPL5MbcaUpikVPOXbVysh9krPcYr4kZ9fFwweKvXn3eXhTJHKVTngQ3MZesHwqBtr4Ap4TCwGoP0qN184 Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29818dc3fb6e4de198be5662dc764989", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 145ff42ae8134ad697f09fd339933bb9 Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: exception: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'd4b653a5-553a-4e7e-afa3-aa1e5b57f90f'} Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:56:02.198725 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.203761 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:02.203761 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:56:02.203761 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:56:02.203761 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:56:02.203761 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:56:02.203761 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. Jul 31 01:56:02.203761 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:56:02.203761 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f3c6103a-d9a8-4fff-8b17-04b998217ef4 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Returning 404 to user: Instance d4b653a5-553a-4e7e-afa3-aa1e5b57f90f could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:56:02.203761 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f3c6103a-d9a8-4fff-8b17-04b998217ef4 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f" status: 404 len: 111 microversion: 2.1 time: 0.030038 Jul 31 01:56:02.203761 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3157/6345] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:56:02 2022] GET /compute/v2.1/servers/d4b653a5-553a-4e7e-afa3-aa1e5b57f90f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:56:05.462386 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b0bee278-78b6-40d9-a671-78798abeae6e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:56:05.462899 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b0bee278-78b6-40d9-a671-78798abeae6e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:56:05.469829 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0bee278-78b6-40d9-a671-78798abeae6e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:56:05.470694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0bee278-78b6-40d9-a671-78798abeae6e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:56:05.471050 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0bee278-78b6-40d9-a671-78798abeae6e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:56:05.471725 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0bee278-78b6-40d9-a671-78798abeae6e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:56:05.487579 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-b0bee278-78b6-40d9-a671-78798abeae6e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] HTTP exception thrown: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b0bee278-78b6-40d9-a671-78798abeae6e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Request method failure captured: Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d HTTP/1.1 Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eArI_gg0PT5-mV1qvuSL56nJadb0JF4TL7uux8WXl3vok79f3uc98C7KYpH06iqd1o5cKdHNoOHQWtXYdIXh_OVDcfYH6kPL5MbcaUpikVPOXbVysh9krPcYr4kZ9fFwweKvXn3eXhTJHKVTngQ3MZesHwqBtr4Ap4TCwGoP0qN184 Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29818dc3fb6e4de198be5662dc764989", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 145ff42ae8134ad697f09fd339933bb9 Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '1353bba5-65a1-4282-8c94-49e748b2b16d'} Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:56:05.489444 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:56:05.493504 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. Jul 31 01:56:05.493504 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:56:05.493504 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:56:05.493504 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:56:05.493504 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:05.493504 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:56:05.493504 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:56:05.493504 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:56:05.493504 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:56:05.493504 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. Jul 31 01:56:05.493504 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:56:05.493504 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b0bee278-78b6-40d9-a671-78798abeae6e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Returning 404 to user: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:56:05.493504 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b0bee278-78b6-40d9-a671-78798abeae6e tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d" status: 404 len: 111 microversion: 2.1 time: 0.032939 Jul 31 01:56:05.493504 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3189/6346] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:56:05 2022] DELETE /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:56:05.499370 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63d75c6a-1bd9-4680-be5e-fc591e9d8d66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:56:05.500012 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-63d75c6a-1bd9-4680-be5e-fc591e9d8d66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] [instance: 1353bba5-65a1-4282-8c94-49e748b2b16d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:56:05.506691 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63d75c6a-1bd9-4680-be5e-fc591e9d8d66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:56:05.507153 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63d75c6a-1bd9-4680-be5e-fc591e9d8d66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:56:05.508463 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63d75c6a-1bd9-4680-be5e-fc591e9d8d66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:56:05.508909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63d75c6a-1bd9-4680-be5e-fc591e9d8d66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:56:05.522092 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-63d75c6a-1bd9-4680-be5e-fc591e9d8d66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] HTTP exception thrown: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63d75c6a-1bd9-4680-be5e-fc591e9d8d66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Request method failure captured: Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d HTTP/1.1 Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eArI_gg0PT5-mV1qvuSL56nJadb0JF4TL7uux8WXl3vok79f3uc98C7KYpH06iqd1o5cKdHNoOHQWtXYdIXh_OVDcfYH6kPL5MbcaUpikVPOXbVysh9krPcYr4kZ9fFwweKvXn3eXhTJHKVTngQ3MZesHwqBtr4Ap4TCwGoP0qN184 Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/29818dc3fb6e4de198be5662dc764989"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_29818dc3fb6e4de198be5662dc764989", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 29818dc3fb6e4de198be5662dc764989 Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1550631171 Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 145ff42ae8134ad697f09fd339933bb9 Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-AttachVolumeNegativeTest-1550631171-project Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '1353bba5-65a1-4282-8c94-49e748b2b16d'} Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:56:05.524256 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:56:05.528983 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:56:05.528983 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:56:05.528983 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:56:05.528983 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:56:05.528983 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:56:05.528983 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. Jul 31 01:56:05.528983 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:56:05.528983 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63d75c6a-1bd9-4680-be5e-fc591e9d8d66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] Returning 404 to user: Instance 1353bba5-65a1-4282-8c94-49e748b2b16d could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:56:05.528983 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-63d75c6a-1bd9-4680-be5e-fc591e9d8d66 tempest-AttachVolumeNegativeTest-1550631171 tempest-AttachVolumeNegativeTest-1550631171-project] 10.222.0.45 "GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d" status: 404 len: 111 microversion: 2.1 time: 0.030190 Jul 31 01:56:05.528983 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3158/6347] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:56:05 2022] GET /compute/v2.1/servers/1353bba5-65a1-4282-8c94-49e748b2b16d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:57:39.089010 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 01:57:39.089562 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 01:57:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 01:58:15.023027 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:15.023797 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:15.151954 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f91036c8-b79d-4a93-84ad-7d07f99f6fc3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1497099912", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:58:15.341397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-f91036c8-b79d-4a93-84ad-7d07f99f6fc3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] validate_networks() for None {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:58:15.638473 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f91036c8-b79d-4a93-84ad-7d07f99f6fc3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:58:15.638908 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f91036c8-b79d-4a93-84ad-7d07f99f6fc3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:58:15.639465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f91036c8-b79d-4a93-84ad-7d07f99f6fc3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:58:15.639886 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f91036c8-b79d-4a93-84ad-7d07f99f6fc3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:58:15.640315 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f91036c8-b79d-4a93-84ad-7d07f99f6fc3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:58:15.649267 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f91036c8-b79d-4a93-84ad-7d07f99f6fc3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:15.649725 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f91036c8-b79d-4a93-84ad-7d07f99f6fc3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:15.650559 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f91036c8-b79d-4a93-84ad-7d07f99f6fc3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:15.651006 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f91036c8-b79d-4a93-84ad-7d07f99f6fc3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:15.667571 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-f91036c8-b79d-4a93-84ad-7d07f99f6fc3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Getting quotas for project 07473176eafb41fb9ee1dd90e91e7ee2. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:58:15.672775 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-f91036c8-b79d-4a93-84ad-7d07f99f6fc3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Getting quotas for user e1661638fffd421490aa51d8026fa6e0 and project 07473176eafb41fb9ee1dd90e91e7ee2. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:58:15.686290 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f91036c8-b79d-4a93-84ad-7d07f99f6fc3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:58:15.688105 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f91036c8-b79d-4a93-84ad-7d07f99f6fc3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:58:15.732498 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f91036c8-b79d-4a93-84ad-7d07f99f6fc3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715195 Jul 31 01:58:15.733149 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3190/6348] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:58:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:58:15.744451 n-d-master-1 devstack@n-api.service[119474]: ERROR oslo.messaging._drivers.impl_rabbit [-] [161f59ee-e913-4622-b753-eac5ec38d240] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 31 01:58:15.745019 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:15.745789 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:15.749786 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8ca0e4e9-3f10-4a08-bfed-b099d2cba525 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:15.750644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8ca0e4e9-3f10-4a08-bfed-b099d2cba525 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:15.919404 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8ca0e4e9-3f10-4a08-bfed-b099d2cba525 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1661638fffd421490aa51d8026fa6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07473176eafb41fb9ee1dd90e91e7ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:15.926365 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8ca0e4e9-3f10-4a08-bfed-b099d2cba525 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] 10.222.0.45 "GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88" status: 200 len: 1222 microversion: 2.1 time: 0.184762 Jul 31 01:58:15.927044 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3159/6349] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:15 2022] GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 => generated 1222 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:16.950542 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a5f97b68-49ae-41ac-84b6-37b8c99e2414 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:16.951084 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a5f97b68-49ae-41ac-84b6-37b8c99e2414 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:16.957815 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5f97b68-49ae-41ac-84b6-37b8c99e2414 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:16.958530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5f97b68-49ae-41ac-84b6-37b8c99e2414 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:16.959327 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5f97b68-49ae-41ac-84b6-37b8c99e2414 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:16.959925 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a5f97b68-49ae-41ac-84b6-37b8c99e2414 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:17.037723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a5f97b68-49ae-41ac-84b6-37b8c99e2414 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1661638fffd421490aa51d8026fa6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07473176eafb41fb9ee1dd90e91e7ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:17.045367 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a5f97b68-49ae-41ac-84b6-37b8c99e2414 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] 10.222.0.45 "GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88" status: 200 len: 1292 microversion: 2.1 time: 0.101187 Jul 31 01:58:17.045936 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3191/6350] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:16 2022] GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:18.070579 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-812a7cb9-a325-4c76-84d0-064a2b0b587c tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:18.071895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-812a7cb9-a325-4c76-84d0-064a2b0b587c tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:18.084358 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-812a7cb9-a325-4c76-84d0-064a2b0b587c tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:18.086469 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-812a7cb9-a325-4c76-84d0-064a2b0b587c tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:18.086469 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-812a7cb9-a325-4c76-84d0-064a2b0b587c tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:18.086469 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-812a7cb9-a325-4c76-84d0-064a2b0b587c tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:18.093891 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] [161f59ee-e913-4622-b753-eac5ec38d240] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 35826. Jul 31 01:58:18.288195 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-812a7cb9-a325-4c76-84d0-064a2b0b587c tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1661638fffd421490aa51d8026fa6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07473176eafb41fb9ee1dd90e91e7ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:18.297003 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-812a7cb9-a325-4c76-84d0-064a2b0b587c tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] 10.222.0.45 "GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88" status: 200 len: 1322 microversion: 2.1 time: 0.230336 Jul 31 01:58:18.297620 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3160/6351] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:18 2022] GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:18.610619 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-02ccb2c3-ade0-49c1-bca8-b093ff6f3939 req-50aa9f46-b17c-4c15-a05a-a1146159bcd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba3bb0b-c4ff-45c3-bc55-557ccc158f88", "tag": "a42d81a0-4f05-41b7-b6cc-300d242493d5"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:58:18.620914 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-02ccb2c3-ade0-49c1-bca8-b093ff6f3939 req-50aa9f46-b17c-4c15-a05a-a1146159bcd4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:18.621451 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-02ccb2c3-ade0-49c1-bca8-b093ff6f3939 req-50aa9f46-b17c-4c15-a05a-a1146159bcd4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:18.632637 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-02ccb2c3-ade0-49c1-bca8-b093ff6f3939 req-50aa9f46-b17c-4c15-a05a-a1146159bcd4 service nova] Creating event network-changed:a42d81a0-4f05-41b7-b6cc-300d242493d5 for instance 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 on n-h1-master-1 Jul 31 01:58:18.637583 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-02ccb2c3-ade0-49c1-bca8-b093ff6f3939 req-50aa9f46-b17c-4c15-a05a-a1146159bcd4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119535 Jul 31 01:58:18.638325 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3192/6352] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:58:19.319881 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-23650e85-09d2-48d3-863c-3b96ed3c5baa tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:19.320574 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-23650e85-09d2-48d3-863c-3b96ed3c5baa tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:19.328196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23650e85-09d2-48d3-863c-3b96ed3c5baa tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:19.328669 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23650e85-09d2-48d3-863c-3b96ed3c5baa tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:19.329451 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23650e85-09d2-48d3-863c-3b96ed3c5baa tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:19.329908 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23650e85-09d2-48d3-863c-3b96ed3c5baa tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:19.464337 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-23650e85-09d2-48d3-863c-3b96ed3c5baa tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1661638fffd421490aa51d8026fa6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07473176eafb41fb9ee1dd90e91e7ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:19.471841 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-23650e85-09d2-48d3-863c-3b96ed3c5baa tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] 10.222.0.45 "GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88" status: 200 len: 1322 microversion: 2.1 time: 0.155937 Jul 31 01:58:19.472413 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3161/6353] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:19 2022] GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:20.494274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-412c53b3-dcfc-4047-a92a-f92eea81b3af tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:20.494989 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-412c53b3-dcfc-4047-a92a-f92eea81b3af tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:20.501304 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-412c53b3-dcfc-4047-a92a-f92eea81b3af tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:20.501762 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-412c53b3-dcfc-4047-a92a-f92eea81b3af tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:20.502539 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-412c53b3-dcfc-4047-a92a-f92eea81b3af tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:20.502986 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-412c53b3-dcfc-4047-a92a-f92eea81b3af tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:20.714740 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-412c53b3-dcfc-4047-a92a-f92eea81b3af tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1661638fffd421490aa51d8026fa6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07473176eafb41fb9ee1dd90e91e7ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:20.722305 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-412c53b3-dcfc-4047-a92a-f92eea81b3af tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] 10.222.0.45 "GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88" status: 200 len: 1322 microversion: 2.1 time: 0.233432 Jul 31 01:58:20.722886 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3193/6354] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:20 2022] GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:21.744382 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-080244b4-84ab-40b8-ae7d-23dba8e298ae tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:21.745023 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-080244b4-84ab-40b8-ae7d-23dba8e298ae tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:21.752000 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-080244b4-84ab-40b8-ae7d-23dba8e298ae tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:21.752474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-080244b4-84ab-40b8-ae7d-23dba8e298ae tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:21.753308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-080244b4-84ab-40b8-ae7d-23dba8e298ae tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:21.753776 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-080244b4-84ab-40b8-ae7d-23dba8e298ae tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:21.882183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-080244b4-84ab-40b8-ae7d-23dba8e298ae tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1661638fffd421490aa51d8026fa6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07473176eafb41fb9ee1dd90e91e7ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:21.890299 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-080244b4-84ab-40b8-ae7d-23dba8e298ae tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] 10.222.0.45 "GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88" status: 200 len: 1322 microversion: 2.1 time: 0.150597 Jul 31 01:58:21.890878 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3162/6355] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:21 2022] GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:22.910745 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ecfceadd-4ada-46ec-a23e-0291ec64e24c tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:22.911605 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ecfceadd-4ada-46ec-a23e-0291ec64e24c tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:22.917981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecfceadd-4ada-46ec-a23e-0291ec64e24c tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:22.918449 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecfceadd-4ada-46ec-a23e-0291ec64e24c tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:22.919232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecfceadd-4ada-46ec-a23e-0291ec64e24c tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:22.919711 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecfceadd-4ada-46ec-a23e-0291ec64e24c tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:22.948280 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-996efcb3-45b2-4aa6-a871-81b71809ccbb req-1c2686e8-3a1f-447a-a0f5-c1d06abcb3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba3bb0b-c4ff-45c3-bc55-557ccc158f88", "name": "network-vif-plugged", "status": "completed", "tag": "a42d81a0-4f05-41b7-b6cc-300d242493d5"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:58:22.959082 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-996efcb3-45b2-4aa6-a871-81b71809ccbb req-1c2686e8-3a1f-447a-a0f5-c1d06abcb3b5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:22.959572 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-996efcb3-45b2-4aa6-a871-81b71809ccbb req-1c2686e8-3a1f-447a-a0f5-c1d06abcb3b5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:22.971844 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-996efcb3-45b2-4aa6-a871-81b71809ccbb req-1c2686e8-3a1f-447a-a0f5-c1d06abcb3b5 service nova] Creating event network-vif-plugged:a42d81a0-4f05-41b7-b6cc-300d242493d5 for instance 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 on n-h1-master-1 Jul 31 01:58:22.976815 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-996efcb3-45b2-4aa6-a871-81b71809ccbb req-1c2686e8-3a1f-447a-a0f5-c1d06abcb3b5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033094 Jul 31 01:58:22.977601 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3163/6356] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:58:23.058825 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ecfceadd-4ada-46ec-a23e-0291ec64e24c tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1661638fffd421490aa51d8026fa6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07473176eafb41fb9ee1dd90e91e7ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:23.066564 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ecfceadd-4ada-46ec-a23e-0291ec64e24c tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] 10.222.0.45 "GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88" status: 200 len: 1322 microversion: 2.1 time: 0.159814 Jul 31 01:58:23.067138 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3194/6357] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:22 2022] GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:24.089616 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4d0abe11-e232-4731-8375-7af9730f9ec8 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:24.090332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4d0abe11-e232-4731-8375-7af9730f9ec8 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:24.096617 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d0abe11-e232-4731-8375-7af9730f9ec8 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:24.097087 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d0abe11-e232-4731-8375-7af9730f9ec8 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:24.097863 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d0abe11-e232-4731-8375-7af9730f9ec8 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:24.098317 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d0abe11-e232-4731-8375-7af9730f9ec8 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:24.234447 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4d0abe11-e232-4731-8375-7af9730f9ec8 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1661638fffd421490aa51d8026fa6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07473176eafb41fb9ee1dd90e91e7ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:24.242327 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4d0abe11-e232-4731-8375-7af9730f9ec8 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] 10.222.0.45 "GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88" status: 200 len: 1322 microversion: 2.1 time: 0.158268 Jul 31 01:58:24.242893 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3164/6358] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:24 2022] GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:25.263826 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c40dde66-0b50-4879-b476-d672d43c042e tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:25.264445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c40dde66-0b50-4879-b476-d672d43c042e tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:25.271313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c40dde66-0b50-4879-b476-d672d43c042e tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:25.271794 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c40dde66-0b50-4879-b476-d672d43c042e tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:25.272555 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c40dde66-0b50-4879-b476-d672d43c042e tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:25.273050 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c40dde66-0b50-4879-b476-d672d43c042e tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:25.405411 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c40dde66-0b50-4879-b476-d672d43c042e tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1661638fffd421490aa51d8026fa6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07473176eafb41fb9ee1dd90e91e7ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:25.412879 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c40dde66-0b50-4879-b476-d672d43c042e tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] 10.222.0.45 "GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88" status: 200 len: 1472 microversion: 2.1 time: 0.152979 Jul 31 01:58:25.413444 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3195/6359] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:25 2022] GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 => generated 1472 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:25.489568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2fc20f8f-2f47-4170-9511-b56bf0ee89b7 tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Calling method '.version_select at 0x7fedea8fc430>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:25.557431 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2fc20f8f-2f47-4170-9511-b56bf0ee89b7 tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/48c2aebf16d6490d8ff3303324690ada" status: 200 len: 371 microversion: 2.1 time: 0.125562 Jul 31 01:58:25.558015 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3165/6360] 10.222.0.45 () {58 vars in 1242 bytes} [Sun Jul 31 01:58:25 2022] GET /compute/v2.1/os-quota-sets/48c2aebf16d6490d8ff3303324690ada => generated 371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:58:25.569616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fa5b48ff-aa4c-48e0-ae34-cae3ac45911a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-550857914", "id": 1518282812, "os-flavor-access:is_public": "True"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:58:25.573306 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:58:25.573306 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:58:25.587911 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fa5b48ff-aa4c-48e0-ae34-cae3ac45911a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.022193 Jul 31 01:58:25.588479 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3196/6361] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:58:25 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:58:25.600257 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1518282812"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:58:25.602645 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:25.608787 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:25.609255 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:25.610037 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:25.610493 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:25.694694 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e866135b233743be9d048f596b4ebfca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c2aebf16d6490d8ff3303324690ada', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:25.701587 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-550857914 {{(pid=119474) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 31 01:58:25.708005 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:25.708469 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:25.709278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:25.709734 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:25.731570 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Getting quotas for project 07473176eafb41fb9ee1dd90e91e7ee2. Resources: {'cores', 'ram'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:58:25.744466 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Getting quotas for user e1661638fffd421490aa51d8026fa6e0 and project 07473176eafb41fb9ee1dd90e91e7ee2. Resources: {'cores', 'ram'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:58:25.756979 n-d-master-1 devstack@n-api.service[119474]: INFO nova.compute.api [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] ram quota exceeded for 48c2aebf16d6490d8ff3303324690ada, tried to resize instance. Jul 31 01:58:25.757537 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Request method failure captured: Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88/action HTTP/1.1 Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 39 Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eG2GdO10p1xqDeKlXchpaHPjAAPz4IVJKBSHNnZTCg9qU8dEAWsCp1ltgpAaeODcB3SFRbtC60A9BtFN4FOb_8qCNs9GB4f3eVP9lLnMGHZzMYgCqAhocPVZlW53sHDMBkv7NI1hUS0izsIJUtJgA_aVssRUsYPIuRh9xZsKRZ_PxI Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 48c2aebf16d6490d8ff3303324690ada Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-960323825 Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,admin,reader Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,admin,reader Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/48c2aebf16d6490d8ff3303324690ada"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/48c2aebf16d6490d8ff3303324690ada"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/48c2aebf16d6490d8ff3303324690ada"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_48c2aebf16d6490d8ff3303324690ada", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersAdminNegativeTestJSON-960323825 Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 48c2aebf16d6490d8ff3303324690ada Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-960323825 Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersAdminNegativeTestJSON-960323825-project-admin Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: e866135b233743be9d048f596b4ebfca Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersAdminNegativeTestJSON-960323825-project-admin Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: {"resize": {"flavorRef": "1518282812"}} Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '2ba3bb0b-c4ff-45c3-bc55-557ccc158f88', 'body': {'resize': {'flavorRef': '1518282812'}}} Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:58:25.759667 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-85c1f66e-26d3-4824-acc7-f6b8cd43d14e tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88/action" status: 403 len: 118 microversion: 2.1 time: 0.164917 Jul 31 01:58:25.764722 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3166/6362] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:58:25 2022] POST /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88/action => generated 118 bytes in 166 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 31 01:58:25.770574 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-02380480-21b2-480e-bfaf-bb2f26134e0a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:25.771411 n-d-master-1 devstack@n-api.service[119475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:58:25.771411 n-d-master-1 devstack@n-api.service[119475]: warnings.warn(msg) Jul 31 01:58:25.773560 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:25.774239 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:25.790268 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-02380480-21b2-480e-bfaf-bb2f26134e0a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/1518282812" status: 202 len: 0 microversion: 2.1 time: 0.023646 Jul 31 01:58:25.790832 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3197/6363] 10.222.0.45 () {58 vars in 1161 bytes} [Sun Jul 31 01:58:25 2022] DELETE /compute/v2.1/flavors/1518282812 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:58:25.798607 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d42fc072-f873-48d5-8c2a-53d9f34db2e5 tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:25.819098 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d42fc072-f873-48d5-8c2a-53d9f34db2e5 tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024117 Jul 31 01:58:25.819671 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3167/6364] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:58:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:58:25.838471 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-889325cc-dde0-4746-828e-e30d4a9d76ab tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Calling method '.version_select at 0x7fedeaa17ca0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:25.908733 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-889325cc-dde0-4746-828e-e30d4a9d76ab tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] 10.222.0.45 "GET /compute/v2.1/os-quota-sets/48c2aebf16d6490d8ff3303324690ada" status: 200 len: 371 microversion: 2.1 time: 0.073893 Jul 31 01:58:25.909308 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3198/6365] 10.222.0.45 () {58 vars in 1242 bytes} [Sun Jul 31 01:58:25 2022] GET /compute/v2.1/os-quota-sets/48c2aebf16d6490d8ff3303324690ada => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:58:25.921055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-218600a8-bcda-407e-99fa-cb1df68b6700 tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1514228138", "id": 94220519, "os-flavor-access:is_public": "True"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:58:25.924070 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:58:25.924070 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:58:25.939294 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-218600a8-bcda-407e-99fa-cb1df68b6700 tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.021951 Jul 31 01:58:25.939867 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3168/6366] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:58:25 2022] POST /compute/v2.1/flavors => generated 431 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:58:25.951670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "94220519"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:58:25.954001 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:25.960184 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:25.960586 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:25.961583 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:25.962035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:26.096133 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e866135b233743be9d048f596b4ebfca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c2aebf16d6490d8ff3303324690ada', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:26.103216 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1514228138 {{(pid=119475) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 31 01:58:26.109679 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:26.110133 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:26.110937 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:26.111416 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:26.132241 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Getting quotas for project 07473176eafb41fb9ee1dd90e91e7ee2. Resources: {'cores', 'ram'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:58:26.137370 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Getting quotas for user e1661638fffd421490aa51d8026fa6e0 and project 07473176eafb41fb9ee1dd90e91e7ee2. Resources: {'cores', 'ram'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:58:26.149609 n-d-master-1 devstack@n-api.service[119475]: INFO nova.compute.api [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] cores quota exceeded for 48c2aebf16d6490d8ff3303324690ada, tried to resize instance. Jul 31 01:58:26.150152 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Request method failure captured: Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88/action HTTP/1.1 Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 37 Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eG2GdO10p1xqDeKlXchpaHPjAAPz4IVJKBSHNnZTCg9qU8dEAWsCp1ltgpAaeODcB3SFRbtC60A9BtFN4FOb_8qCNs9GB4f3eVP9lLnMGHZzMYgCqAhocPVZlW53sHDMBkv7NI1hUS0izsIJUtJgA_aVssRUsYPIuRh9xZsKRZ_PxI Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 48c2aebf16d6490d8ff3303324690ada Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-960323825 Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,admin,reader Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,admin,reader Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/48c2aebf16d6490d8ff3303324690ada"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/48c2aebf16d6490d8ff3303324690ada"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/48c2aebf16d6490d8ff3303324690ada"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_48c2aebf16d6490d8ff3303324690ada", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersAdminNegativeTestJSON-960323825 Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 48c2aebf16d6490d8ff3303324690ada Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-960323825 Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersAdminNegativeTestJSON-960323825-project-admin Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: e866135b233743be9d048f596b4ebfca Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersAdminNegativeTestJSON-960323825-project-admin Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: {"resize": {"flavorRef": "94220519"}} Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '2ba3bb0b-c4ff-45c3-bc55-557ccc158f88', 'body': {'resize': {'flavorRef': '94220519'}}} Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:58:26.152268 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-61f76e05-159c-43c1-9022-163e8830334a tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] 10.222.0.45 "POST /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88/action" status: 403 len: 113 microversion: 2.1 time: 0.206018 Jul 31 01:58:26.157220 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3199/6367] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:58:25 2022] POST /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88/action => generated 113 bytes in 207 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:58:26.162341 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8fad0955-a6ae-43cc-9e76-ffe67fb7e745 tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:26.163118 n-d-master-1 devstack@n-api.service[119474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:58:26.163118 n-d-master-1 devstack@n-api.service[119474]: warnings.warn(msg) Jul 31 01:58:26.180553 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8fad0955-a6ae-43cc-9e76-ffe67fb7e745 tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] 10.222.0.45 "DELETE /compute/v2.1/flavors/94220519" status: 202 len: 0 microversion: 2.1 time: 0.021824 Jul 31 01:58:26.181118 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3169/6368] 10.222.0.45 () {58 vars in 1155 bytes} [Sun Jul 31 01:58:26 2022] DELETE /compute/v2.1/flavors/94220519 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:58:26.189218 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c70497fe-f0e4-4436-b426-b4d58f096133 tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:26.209633 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c70497fe-f0e4-4436-b426-b4d58f096133 tempest-ServersAdminNegativeTestJSON-960323825 tempest-ServersAdminNegativeTestJSON-960323825-project-admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024073 Jul 31 01:58:26.210120 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3200/6369] 10.222.0.45 () {58 vars in 1146 bytes} [Sun Jul 31 01:58:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:26.230657 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aa90a5fd-5da7-43ec-8cfb-edc3d0f67e85 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:26.231170 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aa90a5fd-5da7-43ec-8cfb-edc3d0f67e85 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:26.237495 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa90a5fd-5da7-43ec-8cfb-edc3d0f67e85 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:26.237962 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa90a5fd-5da7-43ec-8cfb-edc3d0f67e85 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:26.238995 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa90a5fd-5da7-43ec-8cfb-edc3d0f67e85 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:26.239479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa90a5fd-5da7-43ec-8cfb-edc3d0f67e85 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:26.263826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aa90a5fd-5da7-43ec-8cfb-edc3d0f67e85 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:58:26.344238 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aa90a5fd-5da7-43ec-8cfb-edc3d0f67e85 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88" status: 204 len: 0 microversion: 2.1 time: 0.117653 Jul 31 01:58:26.344941 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3170/6370] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:58:26 2022] DELETE /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:58:26.354523 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b7b20243-c897-44e2-b2e3-9ebf9eb47b9d tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:26.355152 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b7b20243-c897-44e2-b2e3-9ebf9eb47b9d tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:26.362252 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7b20243-c897-44e2-b2e3-9ebf9eb47b9d tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:26.362782 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7b20243-c897-44e2-b2e3-9ebf9eb47b9d tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:26.363856 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7b20243-c897-44e2-b2e3-9ebf9eb47b9d tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:26.364303 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7b20243-c897-44e2-b2e3-9ebf9eb47b9d tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:26.492578 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b7b20243-c897-44e2-b2e3-9ebf9eb47b9d tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1661638fffd421490aa51d8026fa6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07473176eafb41fb9ee1dd90e91e7ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:26.500465 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b7b20243-c897-44e2-b2e3-9ebf9eb47b9d tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] 10.222.0.45 "GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88" status: 200 len: 1478 microversion: 2.1 time: 0.150499 Jul 31 01:58:26.501039 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3201/6371] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:26 2022] GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 => generated 1478 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:58:27.522750 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f7bf539c-cdc7-404c-88e4-4f39366c96c3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:27.523432 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f7bf539c-cdc7-404c-88e4-4f39366c96c3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:27.530817 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7bf539c-cdc7-404c-88e4-4f39366c96c3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:27.531285 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7bf539c-cdc7-404c-88e4-4f39366c96c3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:27.532090 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7bf539c-cdc7-404c-88e4-4f39366c96c3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:27.532542 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f7bf539c-cdc7-404c-88e4-4f39366c96c3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:27.663988 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f7bf539c-cdc7-404c-88e4-4f39366c96c3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1661638fffd421490aa51d8026fa6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07473176eafb41fb9ee1dd90e91e7ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:27.671366 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f7bf539c-cdc7-404c-88e4-4f39366c96c3 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] 10.222.0.45 "GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88" status: 200 len: 1478 microversion: 2.1 time: 0.153016 Jul 31 01:58:27.671933 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3171/6372] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:27 2022] GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 => generated 1478 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:28.197128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2c91e977-7f64-458f-89ea-5e0e023f3390 req-095e869b-0e29-4db5-b231-38f62976c9ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba3bb0b-c4ff-45c3-bc55-557ccc158f88", "name": "network-vif-deleted", "tag": "a42d81a0-4f05-41b7-b6cc-300d242493d5"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:58:28.211569 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2c91e977-7f64-458f-89ea-5e0e023f3390 req-095e869b-0e29-4db5-b231-38f62976c9ae service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:28.212360 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2c91e977-7f64-458f-89ea-5e0e023f3390 req-095e869b-0e29-4db5-b231-38f62976c9ae service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:28.228563 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2c91e977-7f64-458f-89ea-5e0e023f3390 req-095e869b-0e29-4db5-b231-38f62976c9ae service nova] Creating event network-vif-deleted:a42d81a0-4f05-41b7-b6cc-300d242493d5 for instance 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 on n-h1-master-1 Jul 31 01:58:28.235305 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2c91e977-7f64-458f-89ea-5e0e023f3390 req-095e869b-0e29-4db5-b231-38f62976c9ae service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041746 Jul 31 01:58:28.236669 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3202/6373] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:58:28.693436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-adfd2a29-3a51-4dc1-b653-2cd4cff84a00 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:28.694065 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-adfd2a29-3a51-4dc1-b653-2cd4cff84a00 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:28.703500 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adfd2a29-3a51-4dc1-b653-2cd4cff84a00 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:28.704599 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adfd2a29-3a51-4dc1-b653-2cd4cff84a00 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:28.705890 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adfd2a29-3a51-4dc1-b653-2cd4cff84a00 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:28.706567 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adfd2a29-3a51-4dc1-b653-2cd4cff84a00 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:28.750006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adfd2a29-3a51-4dc1-b653-2cd4cff84a00 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:28.750474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adfd2a29-3a51-4dc1-b653-2cd4cff84a00 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:28.751041 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-adfd2a29-3a51-4dc1-b653-2cd4cff84a00 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lazy-loading 'fault' on Instance uuid 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 01:58:28.799254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-adfd2a29-3a51-4dc1-b653-2cd4cff84a00 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1661638fffd421490aa51d8026fa6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07473176eafb41fb9ee1dd90e91e7ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:28.808408 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-adfd2a29-3a51-4dc1-b653-2cd4cff84a00 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] 10.222.0.45 "GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88" status: 200 len: 1312 microversion: 2.1 time: 0.119156 Jul 31 01:58:28.808985 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3172/6374] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:28 2022] GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 => generated 1312 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:29.831647 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f8001556-e6ba-41a7-ba06-29e8b04a8b27 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:29.832280 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f8001556-e6ba-41a7-ba06-29e8b04a8b27 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] [instance: 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:29.839175 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8001556-e6ba-41a7-ba06-29e8b04a8b27 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:29.839664 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8001556-e6ba-41a7-ba06-29e8b04a8b27 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:29.840441 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8001556-e6ba-41a7-ba06-29e8b04a8b27 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:29.840894 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f8001556-e6ba-41a7-ba06-29e8b04a8b27 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:29.854548 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-f8001556-e6ba-41a7-ba06-29e8b04a8b27 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] HTTP exception thrown: Instance 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 could not be found. Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f8001556-e6ba-41a7-ba06-29e8b04a8b27 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Request method failure captured: Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 HTTP/1.1 Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eG2nJ3ui2c9blDu7tSqGp8Gf-hg4559YhfErR9DGK2nZVbi2nqJWiaTtSqEtX9tlpLJ_Jx_42pk2ORczfQwlcg5MAuDBXdic1At4h_gWuRYs4lSezQFRpLnCIKddKVJaP7psxvuQvgGZVExQWFKJzx2_y9_XoEepCCgeh1ej-NdE0U Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 07473176eafb41fb9ee1dd90e91e7ee2 Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1236663994 Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07473176eafb41fb9ee1dd90e91e7ee2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/07473176eafb41fb9ee1dd90e91e7ee2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/07473176eafb41fb9ee1dd90e91e7ee2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_07473176eafb41fb9ee1dd90e91e7ee2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1236663994 Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 07473176eafb41fb9ee1dd90e91e7ee2 Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1236663994 Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersAdminNegativeTestJSON-1236663994-project Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: e1661638fffd421490aa51d8026fa6e0 Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1236663994-project Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 could not be found. Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '2ba3bb0b-c4ff-45c3-bc55-557ccc158f88'} Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 could not be found. Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 could not be found. Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:58:29.856194 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:58:29.860904 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:58:29.860904 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:58:29.860904 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:58:29.860904 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:58:29.860904 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:58:29.860904 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:58:29.860904 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 could not be found. Jul 31 01:58:29.860904 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:58:29.860904 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f8001556-e6ba-41a7-ba06-29e8b04a8b27 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] Returning 404 to user: Instance 2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:58:29.860904 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f8001556-e6ba-41a7-ba06-29e8b04a8b27 tempest-ServersAdminNegativeTestJSON-1236663994 tempest-ServersAdminNegativeTestJSON-1236663994-project] 10.222.0.45 "GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88" status: 404 len: 111 microversion: 2.1 time: 0.031256 Jul 31 01:58:29.860904 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3203/6375] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:29 2022] GET /compute/v2.1/servers/2ba3bb0b-c4ff-45c3-bc55-557ccc158f88 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:58:35.976182 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:35.976902 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:36.083995 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0792d286-891b-4f76-b87d-676391e16b97 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1311934237", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "f6039ef9-3fe8-4c6f-b09d-1789bb36a8a6"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:58:36.136297 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-0792d286-891b-4f76-b87d-676391e16b97 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] validate_networks() for [('f6039ef9-3fe8-4c6f-b09d-1789bb36a8a6', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:58:36.515532 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0792d286-891b-4f76-b87d-676391e16b97 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:58:36.515982 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0792d286-891b-4f76-b87d-676391e16b97 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:58:36.516476 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0792d286-891b-4f76-b87d-676391e16b97 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:58:36.516906 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0792d286-891b-4f76-b87d-676391e16b97 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:58:36.517360 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0792d286-891b-4f76-b87d-676391e16b97 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:58:36.527504 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0792d286-891b-4f76-b87d-676391e16b97 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:36.527984 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0792d286-891b-4f76-b87d-676391e16b97 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:36.528809 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0792d286-891b-4f76-b87d-676391e16b97 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:36.529267 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0792d286-891b-4f76-b87d-676391e16b97 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:36.547603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-0792d286-891b-4f76-b87d-676391e16b97 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Getting quotas for project 06af800dcc0d4529a12baa6da174b8e9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:58:36.552995 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-0792d286-891b-4f76-b87d-676391e16b97 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Getting quotas for user 5e4aa8ebe1044e939bde053eab64f85c and project 06af800dcc0d4529a12baa6da174b8e9. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:58:36.566601 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0792d286-891b-4f76-b87d-676391e16b97 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:58:36.568925 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0792d286-891b-4f76-b87d-676391e16b97 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:58:36.621369 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0792d286-891b-4f76-b87d-676391e16b97 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651127 Jul 31 01:58:36.622327 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3173/6376] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:58:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:58:36.633007 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8d2e25e7-bacd-4b72-b055-83032ab9d852 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:36.634216 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8d2e25e7-bacd-4b72-b055-83032ab9d852 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:36.638282 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:36.639139 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:36.699414 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8d2e25e7-bacd-4b72-b055-83032ab9d852 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:36.707132 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8d2e25e7-bacd-4b72-b055-83032ab9d852 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1215 microversion: 2.1 time: 0.077775 Jul 31 01:58:36.707876 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3204/6377] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:36 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:37.731200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f645111-d478-4130-81c1-10409a8edc41 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:37.732927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6f645111-d478-4130-81c1-10409a8edc41 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:37.740793 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f645111-d478-4130-81c1-10409a8edc41 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:37.742150 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f645111-d478-4130-81c1-10409a8edc41 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:37.744244 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f645111-d478-4130-81c1-10409a8edc41 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:37.745007 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f645111-d478-4130-81c1-10409a8edc41 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:37.867846 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6f645111-d478-4130-81c1-10409a8edc41 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:37.879725 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6f645111-d478-4130-81c1-10409a8edc41 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1285 microversion: 2.1 time: 0.153314 Jul 31 01:58:37.880534 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3174/6378] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:37 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:38.901890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dda0f863-4051-441b-84c6-c40be25ad368 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:38.902527 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dda0f863-4051-441b-84c6-c40be25ad368 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:38.911450 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dda0f863-4051-441b-84c6-c40be25ad368 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:38.911914 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dda0f863-4051-441b-84c6-c40be25ad368 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:38.912715 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dda0f863-4051-441b-84c6-c40be25ad368 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:38.913244 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dda0f863-4051-441b-84c6-c40be25ad368 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:39.125293 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-0fe0e2e0-739f-4eae-9cb7-873f931ab8ae req-0b29e07d-d630-4f12-a848-42070cc44d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4d48150-292c-46a0-b6e6-cf5ba567f6f3", "tag": "d605bc1e-ad07-4e01-aad6-0da625b0b113"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:58:39.146910 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dda0f863-4051-441b-84c6-c40be25ad368 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:39.162457 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dda0f863-4051-441b-84c6-c40be25ad368 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1315 microversion: 2.1 time: 0.263855 Jul 31 01:58:39.166566 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3205/6379] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:38 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:39.169535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0fe0e2e0-739f-4eae-9cb7-873f931ab8ae req-0b29e07d-d630-4f12-a848-42070cc44d63 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:39.170198 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0fe0e2e0-739f-4eae-9cb7-873f931ab8ae req-0b29e07d-d630-4f12-a848-42070cc44d63 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:39.185858 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-0fe0e2e0-739f-4eae-9cb7-873f931ab8ae req-0b29e07d-d630-4f12-a848-42070cc44d63 service nova] Creating event network-changed:d605bc1e-ad07-4e01-aad6-0da625b0b113 for instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 on n-h1-master-1 Jul 31 01:58:39.191572 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-0fe0e2e0-739f-4eae-9cb7-873f931ab8ae req-0b29e07d-d630-4f12-a848-42070cc44d63 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071033 Jul 31 01:58:39.192344 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3175/6380] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:58:40.186594 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b93dfff0-3607-4eb9-aefa-d482520264d7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:40.187230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b93dfff0-3607-4eb9-aefa-d482520264d7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:40.194298 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b93dfff0-3607-4eb9-aefa-d482520264d7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:40.194756 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b93dfff0-3607-4eb9-aefa-d482520264d7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:40.195565 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b93dfff0-3607-4eb9-aefa-d482520264d7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:40.196761 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b93dfff0-3607-4eb9-aefa-d482520264d7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:40.355259 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b93dfff0-3607-4eb9-aefa-d482520264d7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:40.362773 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b93dfff0-3607-4eb9-aefa-d482520264d7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1315 microversion: 2.1 time: 0.180357 Jul 31 01:58:40.363356 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3206/6381] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:40 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:41.384497 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e099f4be-52e1-4bc6-b0f2-c1320e514bf7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:41.385205 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e099f4be-52e1-4bc6-b0f2-c1320e514bf7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:41.392199 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e099f4be-52e1-4bc6-b0f2-c1320e514bf7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:41.392661 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e099f4be-52e1-4bc6-b0f2-c1320e514bf7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:41.393430 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e099f4be-52e1-4bc6-b0f2-c1320e514bf7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:41.393896 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e099f4be-52e1-4bc6-b0f2-c1320e514bf7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:41.520736 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e099f4be-52e1-4bc6-b0f2-c1320e514bf7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:41.528244 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e099f4be-52e1-4bc6-b0f2-c1320e514bf7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1315 microversion: 2.1 time: 0.148670 Jul 31 01:58:41.528809 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3176/6382] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:41 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:42.548874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3760360c-7e92-4d70-98db-f55e54f3f47c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:42.549521 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3760360c-7e92-4d70-98db-f55e54f3f47c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:42.556951 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3760360c-7e92-4d70-98db-f55e54f3f47c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:42.557404 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3760360c-7e92-4d70-98db-f55e54f3f47c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:42.558171 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3760360c-7e92-4d70-98db-f55e54f3f47c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:42.558611 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3760360c-7e92-4d70-98db-f55e54f3f47c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:42.689357 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3760360c-7e92-4d70-98db-f55e54f3f47c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:42.696888 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3760360c-7e92-4d70-98db-f55e54f3f47c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1315 microversion: 2.1 time: 0.151921 Jul 31 01:58:42.697484 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3207/6383] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:42 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:43.717606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1322a465-c79e-4ac3-b7ae-bb253c7abe84 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:43.718227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1322a465-c79e-4ac3-b7ae-bb253c7abe84 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:43.725060 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1322a465-c79e-4ac3-b7ae-bb253c7abe84 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:43.725515 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1322a465-c79e-4ac3-b7ae-bb253c7abe84 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:43.726283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1322a465-c79e-4ac3-b7ae-bb253c7abe84 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:43.726728 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1322a465-c79e-4ac3-b7ae-bb253c7abe84 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:43.856114 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1322a465-c79e-4ac3-b7ae-bb253c7abe84 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:43.863864 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1322a465-c79e-4ac3-b7ae-bb253c7abe84 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1315 microversion: 2.1 time: 0.149809 Jul 31 01:58:43.864427 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3177/6384] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:43 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:44.886095 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-64dfad63-a155-49ae-bf6a-ae14198cb620 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:44.886653 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-64dfad63-a155-49ae-bf6a-ae14198cb620 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:44.893619 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64dfad63-a155-49ae-bf6a-ae14198cb620 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:44.894088 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64dfad63-a155-49ae-bf6a-ae14198cb620 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:44.894865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64dfad63-a155-49ae-bf6a-ae14198cb620 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:44.895313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-64dfad63-a155-49ae-bf6a-ae14198cb620 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:45.026258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-64dfad63-a155-49ae-bf6a-ae14198cb620 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:45.033936 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-64dfad63-a155-49ae-bf6a-ae14198cb620 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1315 microversion: 2.1 time: 0.152456 Jul 31 01:58:45.034512 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3208/6385] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:44 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:45.134114 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-f1a904e2-76fe-4b5f-bcf9-9837b889aeb0 req-44b957b2-c40b-4ca5-851f-ca0f89c919e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d48150-292c-46a0-b6e6-cf5ba567f6f3", "name": "network-vif-plugged", "status": "completed", "tag": "d605bc1e-ad07-4e01-aad6-0da625b0b113"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:58:45.144139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f1a904e2-76fe-4b5f-bcf9-9837b889aeb0 req-44b957b2-c40b-4ca5-851f-ca0f89c919e0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:45.144547 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f1a904e2-76fe-4b5f-bcf9-9837b889aeb0 req-44b957b2-c40b-4ca5-851f-ca0f89c919e0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:45.155222 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-f1a904e2-76fe-4b5f-bcf9-9837b889aeb0 req-44b957b2-c40b-4ca5-851f-ca0f89c919e0 service nova] Creating event network-vif-plugged:d605bc1e-ad07-4e01-aad6-0da625b0b113 for instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 on n-h1-master-1 Jul 31 01:58:45.160128 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-f1a904e2-76fe-4b5f-bcf9-9837b889aeb0 req-44b957b2-c40b-4ca5-851f-ca0f89c919e0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103331 Jul 31 01:58:45.160717 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3178/6386] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:58:46.054937 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1873edde-9ceb-49bc-b5ce-4902fe0332e4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:46.055600 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1873edde-9ceb-49bc-b5ce-4902fe0332e4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:46.058250 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:46.063640 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1873edde-9ceb-49bc-b5ce-4902fe0332e4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:46.064104 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1873edde-9ceb-49bc-b5ce-4902fe0332e4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:46.064877 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1873edde-9ceb-49bc-b5ce-4902fe0332e4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:46.065328 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1873edde-9ceb-49bc-b5ce-4902fe0332e4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:46.070116 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=76 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:46.204413 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1873edde-9ceb-49bc-b5ce-4902fe0332e4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:46.212504 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1873edde-9ceb-49bc-b5ce-4902fe0332e4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1315 microversion: 2.1 time: 0.161490 Jul 31 01:58:46.213075 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3209/6387] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:46 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:47.232055 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:47.232839 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:47.236974 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-60557e77-c894-4b0f-b643-054174859b61 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:47.237631 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-60557e77-c894-4b0f-b643-054174859b61 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:47.239692 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:47.246960 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60557e77-c894-4b0f-b643-054174859b61 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:47.247451 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60557e77-c894-4b0f-b643-054174859b61 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:47.248230 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60557e77-c894-4b0f-b643-054174859b61 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:47.248687 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60557e77-c894-4b0f-b643-054174859b61 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:47.251929 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:47.389385 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-60557e77-c894-4b0f-b643-054174859b61 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:47.397152 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-60557e77-c894-4b0f-b643-054174859b61 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1501 microversion: 2.1 time: 0.166864 Jul 31 01:58:47.398041 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3179/6388] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:47 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:47.419140 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b0f37bb2-5ce4-4f3d-a8c7-f94fa57da056 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:58:47.421525 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b0f37bb2-5ce4-4f3d-a8c7-f94fa57da056 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:47.423667 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:58:47.430386 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0f37bb2-5ce4-4f3d-a8c7-f94fa57da056 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:47.430988 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0f37bb2-5ce4-4f3d-a8c7-f94fa57da056 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:47.431891 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0f37bb2-5ce4-4f3d-a8c7-f94fa57da056 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:47.432547 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b0f37bb2-5ce4-4f3d-a8c7-f94fa57da056 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:47.461882 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b0f37bb2-5ce4-4f3d-a8c7-f94fa57da056 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:47.468105 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b0f37bb2-5ce4-4f3d-a8c7-f94fa57da056 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Old instance type m1.heat2, new instance type m1.heat {{(pid=119475) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 31 01:58:47.474455 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b0f37bb2-5ce4-4f3d-a8c7-f94fa57da056 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:58:47.474889 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b0f37bb2-5ce4-4f3d-a8c7-f94fa57da056 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:58:47.475397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b0f37bb2-5ce4-4f3d-a8c7-f94fa57da056 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:58:47.475827 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b0f37bb2-5ce4-4f3d-a8c7-f94fa57da056 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:58:47.476270 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b0f37bb2-5ce4-4f3d-a8c7-f94fa57da056 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:58:47.540433 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b0f37bb2-5ce4-4f3d-a8c7-f94fa57da056 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "POST /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3/action" status: 202 len: 0 microversion: 2.1 time: 0.125930 Jul 31 01:58:47.541149 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3210/6389] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:58:47 2022] POST /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:58:47.549126 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-256dbe33-ca88-4517-80c1-1244cde87c40 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:47.550102 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-256dbe33-ca88-4517-80c1-1244cde87c40 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:47.556366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-256dbe33-ca88-4517-80c1-1244cde87c40 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:47.556838 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-256dbe33-ca88-4517-80c1-1244cde87c40 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:47.559753 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-256dbe33-ca88-4517-80c1-1244cde87c40 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:47.560224 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-256dbe33-ca88-4517-80c1-1244cde87c40 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:47.727822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-256dbe33-ca88-4517-80c1-1244cde87c40 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:47.735901 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-256dbe33-ca88-4517-80c1-1244cde87c40 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1510 microversion: 2.1 time: 0.190683 Jul 31 01:58:47.736674 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3180/6390] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:47 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:48.758984 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1c56a9c2-376c-4d43-884c-d2cafffa8a39 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:48.759673 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1c56a9c2-376c-4d43-884c-d2cafffa8a39 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:48.766409 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c56a9c2-376c-4d43-884c-d2cafffa8a39 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:48.766869 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c56a9c2-376c-4d43-884c-d2cafffa8a39 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:48.767678 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c56a9c2-376c-4d43-884c-d2cafffa8a39 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:48.768126 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c56a9c2-376c-4d43-884c-d2cafffa8a39 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:48.907010 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1c56a9c2-376c-4d43-884c-d2cafffa8a39 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:48.915385 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1c56a9c2-376c-4d43-884c-d2cafffa8a39 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1510 microversion: 2.1 time: 0.161268 Jul 31 01:58:48.915980 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3211/6391] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:48 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:49.936914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fd4fdc63-55e0-4549-beba-70655433d37f tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:49.937641 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fd4fdc63-55e0-4549-beba-70655433d37f tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:49.944354 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd4fdc63-55e0-4549-beba-70655433d37f tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:49.944825 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd4fdc63-55e0-4549-beba-70655433d37f tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:49.945612 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd4fdc63-55e0-4549-beba-70655433d37f tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:49.946582 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd4fdc63-55e0-4549-beba-70655433d37f tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:50.076409 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fd4fdc63-55e0-4549-beba-70655433d37f tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:50.083907 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fd4fdc63-55e0-4549-beba-70655433d37f tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.151065 Jul 31 01:58:50.084473 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3181/6392] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:49 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:58:51.105403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-384a090d-2778-41f9-8a54-bf66ede4e37c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:51.106036 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-384a090d-2778-41f9-8a54-bf66ede4e37c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:51.113012 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-384a090d-2778-41f9-8a54-bf66ede4e37c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:51.113738 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-384a090d-2778-41f9-8a54-bf66ede4e37c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:51.114517 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-384a090d-2778-41f9-8a54-bf66ede4e37c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:51.114991 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-384a090d-2778-41f9-8a54-bf66ede4e37c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:51.242210 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-384a090d-2778-41f9-8a54-bf66ede4e37c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:51.250302 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-384a090d-2778-41f9-8a54-bf66ede4e37c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.148844 Jul 31 01:58:51.250883 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3212/6393] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:51 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:52.271652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-056627ea-3195-4253-a941-45b0d5452d7a tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:52.272312 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-056627ea-3195-4253-a941-45b0d5452d7a tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:52.280068 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-056627ea-3195-4253-a941-45b0d5452d7a tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:52.280536 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-056627ea-3195-4253-a941-45b0d5452d7a tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:52.281316 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-056627ea-3195-4253-a941-45b0d5452d7a tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:52.281768 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-056627ea-3195-4253-a941-45b0d5452d7a tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:52.414027 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-056627ea-3195-4253-a941-45b0d5452d7a tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:52.421628 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-056627ea-3195-4253-a941-45b0d5452d7a tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.153869 Jul 31 01:58:52.422190 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3182/6394] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:52 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:58:53.443174 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0dcfe095-ec90-4e6b-8173-95427d2d4fd3 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:53.443752 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0dcfe095-ec90-4e6b-8173-95427d2d4fd3 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:53.450482 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0dcfe095-ec90-4e6b-8173-95427d2d4fd3 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:53.450942 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0dcfe095-ec90-4e6b-8173-95427d2d4fd3 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:53.451761 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0dcfe095-ec90-4e6b-8173-95427d2d4fd3 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:53.452221 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0dcfe095-ec90-4e6b-8173-95427d2d4fd3 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:53.582865 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0dcfe095-ec90-4e6b-8173-95427d2d4fd3 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:53.591370 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0dcfe095-ec90-4e6b-8173-95427d2d4fd3 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.152454 Jul 31 01:58:53.591942 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3213/6395] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:53 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:54.612473 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-43d3f8d0-7561-4d64-8540-37c9bc7e21f1 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:54.613106 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-43d3f8d0-7561-4d64-8540-37c9bc7e21f1 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:54.620328 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43d3f8d0-7561-4d64-8540-37c9bc7e21f1 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:54.620798 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43d3f8d0-7561-4d64-8540-37c9bc7e21f1 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:54.621611 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43d3f8d0-7561-4d64-8540-37c9bc7e21f1 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:54.622064 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43d3f8d0-7561-4d64-8540-37c9bc7e21f1 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:54.753436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-43d3f8d0-7561-4d64-8540-37c9bc7e21f1 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:54.761351 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-43d3f8d0-7561-4d64-8540-37c9bc7e21f1 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.152790 Jul 31 01:58:54.761920 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3183/6396] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:54 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:55.782184 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8f236e7d-eb3b-4ea7-b914-7246fbd21520 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:55.782802 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8f236e7d-eb3b-4ea7-b914-7246fbd21520 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:55.790169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f236e7d-eb3b-4ea7-b914-7246fbd21520 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:55.790627 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f236e7d-eb3b-4ea7-b914-7246fbd21520 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:55.791410 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f236e7d-eb3b-4ea7-b914-7246fbd21520 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:55.791854 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8f236e7d-eb3b-4ea7-b914-7246fbd21520 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:55.920325 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8f236e7d-eb3b-4ea7-b914-7246fbd21520 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:55.927784 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8f236e7d-eb3b-4ea7-b914-7246fbd21520 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.149475 Jul 31 01:58:55.928359 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3214/6397] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:55 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:56.950791 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-533315e1-b28c-4cb4-92c2-dcccb04886fc tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:56.951388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-533315e1-b28c-4cb4-92c2-dcccb04886fc tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:56.958386 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-533315e1-b28c-4cb4-92c2-dcccb04886fc tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:56.958860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-533315e1-b28c-4cb4-92c2-dcccb04886fc tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:56.959789 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-533315e1-b28c-4cb4-92c2-dcccb04886fc tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:56.960247 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-533315e1-b28c-4cb4-92c2-dcccb04886fc tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:57.091938 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-533315e1-b28c-4cb4-92c2-dcccb04886fc tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:57.099293 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-533315e1-b28c-4cb4-92c2-dcccb04886fc tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.152534 Jul 31 01:58:57.099873 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3184/6398] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:56 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:58.120530 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5c2b2575-8437-41a1-b54d-f245fdc15db8 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:58.121148 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5c2b2575-8437-41a1-b54d-f245fdc15db8 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:58.128155 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c2b2575-8437-41a1-b54d-f245fdc15db8 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:58.128622 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c2b2575-8437-41a1-b54d-f245fdc15db8 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:58.129404 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c2b2575-8437-41a1-b54d-f245fdc15db8 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:58.129853 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c2b2575-8437-41a1-b54d-f245fdc15db8 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:58.257474 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5c2b2575-8437-41a1-b54d-f245fdc15db8 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:58.265540 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5c2b2575-8437-41a1-b54d-f245fdc15db8 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.148941 Jul 31 01:58:58.266119 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3215/6399] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:58 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:58:59.289005 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-62651966-f9de-4074-a354-f3cc1ee7cf6d tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:58:59.291827 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-62651966-f9de-4074-a354-f3cc1ee7cf6d tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:58:59.299466 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62651966-f9de-4074-a354-f3cc1ee7cf6d tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:59.299939 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62651966-f9de-4074-a354-f3cc1ee7cf6d tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:59.300731 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62651966-f9de-4074-a354-f3cc1ee7cf6d tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:58:59.302826 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62651966-f9de-4074-a354-f3cc1ee7cf6d tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:58:59.433191 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-62651966-f9de-4074-a354-f3cc1ee7cf6d tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:58:59.440630 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-62651966-f9de-4074-a354-f3cc1ee7cf6d tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.156944 Jul 31 01:58:59.441199 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3185/6400] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:58:59 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:00.462049 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e5e0528a-9de7-4a25-89a3-79f4209b846e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:00.462682 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e5e0528a-9de7-4a25-89a3-79f4209b846e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:00.469633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e5e0528a-9de7-4a25-89a3-79f4209b846e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:00.470093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e5e0528a-9de7-4a25-89a3-79f4209b846e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:00.470863 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e5e0528a-9de7-4a25-89a3-79f4209b846e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:00.471310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e5e0528a-9de7-4a25-89a3-79f4209b846e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:00.608242 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e5e0528a-9de7-4a25-89a3-79f4209b846e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:00.615934 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e5e0528a-9de7-4a25-89a3-79f4209b846e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.157768 Jul 31 01:59:00.616509 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3216/6401] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:00 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:01.638914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6c5c5709-fd6f-4600-994d-4f5fa6324ca1 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:01.639532 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6c5c5709-fd6f-4600-994d-4f5fa6324ca1 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:01.647004 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c5c5709-fd6f-4600-994d-4f5fa6324ca1 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:01.647819 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c5c5709-fd6f-4600-994d-4f5fa6324ca1 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:01.648310 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c5c5709-fd6f-4600-994d-4f5fa6324ca1 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:01.648766 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c5c5709-fd6f-4600-994d-4f5fa6324ca1 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:01.792668 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6c5c5709-fd6f-4600-994d-4f5fa6324ca1 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:01.800275 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6c5c5709-fd6f-4600-994d-4f5fa6324ca1 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.166220 Jul 31 01:59:01.800862 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3186/6402] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:01 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:02.822895 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2517b709-4947-4556-8829-ce4dc103eeb8 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:02.823474 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2517b709-4947-4556-8829-ce4dc103eeb8 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:02.830369 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2517b709-4947-4556-8829-ce4dc103eeb8 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:02.830850 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2517b709-4947-4556-8829-ce4dc103eeb8 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:02.831653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2517b709-4947-4556-8829-ce4dc103eeb8 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:02.832102 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2517b709-4947-4556-8829-ce4dc103eeb8 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:02.963621 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2517b709-4947-4556-8829-ce4dc103eeb8 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:02.971749 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2517b709-4947-4556-8829-ce4dc103eeb8 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.153387 Jul 31 01:59:02.972805 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3217/6403] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:02 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:03.994792 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9bf79f61-f0a3-49d8-bbd7-55bd8b45c3da tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:03.995403 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9bf79f61-f0a3-49d8-bbd7-55bd8b45c3da tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:04.002336 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9bf79f61-f0a3-49d8-bbd7-55bd8b45c3da tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:04.002797 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9bf79f61-f0a3-49d8-bbd7-55bd8b45c3da tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:04.003592 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9bf79f61-f0a3-49d8-bbd7-55bd8b45c3da tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:04.004045 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9bf79f61-f0a3-49d8-bbd7-55bd8b45c3da tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:04.129996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9bf79f61-f0a3-49d8-bbd7-55bd8b45c3da tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:04.137435 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9bf79f61-f0a3-49d8-bbd7-55bd8b45c3da tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.147259 Jul 31 01:59:04.137991 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3187/6404] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:03 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:05.157966 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6685f080-a389-40f5-aa5f-859e54d9f9d4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:05.158587 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6685f080-a389-40f5-aa5f-859e54d9f9d4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:05.165459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6685f080-a389-40f5-aa5f-859e54d9f9d4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:05.165912 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6685f080-a389-40f5-aa5f-859e54d9f9d4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:05.166674 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6685f080-a389-40f5-aa5f-859e54d9f9d4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:05.167113 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6685f080-a389-40f5-aa5f-859e54d9f9d4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:05.302714 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6685f080-a389-40f5-aa5f-859e54d9f9d4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:05.311608 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6685f080-a389-40f5-aa5f-859e54d9f9d4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.157381 Jul 31 01:59:05.312211 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3218/6405] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:05 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:06.333808 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8df82eb8-20b4-45b7-9e73-9fbe9c611166 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:06.334435 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8df82eb8-20b4-45b7-9e73-9fbe9c611166 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:06.341169 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8df82eb8-20b4-45b7-9e73-9fbe9c611166 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:06.341631 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8df82eb8-20b4-45b7-9e73-9fbe9c611166 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:06.342401 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8df82eb8-20b4-45b7-9e73-9fbe9c611166 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:06.342847 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8df82eb8-20b4-45b7-9e73-9fbe9c611166 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:06.474128 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8df82eb8-20b4-45b7-9e73-9fbe9c611166 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:06.482080 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8df82eb8-20b4-45b7-9e73-9fbe9c611166 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.152114 Jul 31 01:59:06.482647 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3188/6406] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:06 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:07.503430 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6106284d-9a6a-4eff-b213-f05973daa02e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:07.503994 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6106284d-9a6a-4eff-b213-f05973daa02e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:07.510885 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6106284d-9a6a-4eff-b213-f05973daa02e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:07.511366 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6106284d-9a6a-4eff-b213-f05973daa02e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:07.512477 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6106284d-9a6a-4eff-b213-f05973daa02e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:07.512925 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6106284d-9a6a-4eff-b213-f05973daa02e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:07.640705 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6106284d-9a6a-4eff-b213-f05973daa02e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:07.649585 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6106284d-9a6a-4eff-b213-f05973daa02e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.150150 Jul 31 01:59:07.650377 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3219/6407] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:07 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:08.671244 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4e164e38-c98f-4001-a138-b2d1f728fc0a tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:08.671976 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4e164e38-c98f-4001-a138-b2d1f728fc0a tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:08.678845 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4e164e38-c98f-4001-a138-b2d1f728fc0a tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:08.679315 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4e164e38-c98f-4001-a138-b2d1f728fc0a tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:08.680771 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4e164e38-c98f-4001-a138-b2d1f728fc0a tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:08.681226 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4e164e38-c98f-4001-a138-b2d1f728fc0a tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:08.813749 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4e164e38-c98f-4001-a138-b2d1f728fc0a tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:08.821396 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4e164e38-c98f-4001-a138-b2d1f728fc0a tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.153970 Jul 31 01:59:08.821897 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3189/6408] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:08 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:09.842407 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c1856dd9-87fb-4f7b-8a81-2c8549476ba0 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:09.842967 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c1856dd9-87fb-4f7b-8a81-2c8549476ba0 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:09.849974 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1856dd9-87fb-4f7b-8a81-2c8549476ba0 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:09.850437 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1856dd9-87fb-4f7b-8a81-2c8549476ba0 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:09.851210 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1856dd9-87fb-4f7b-8a81-2c8549476ba0 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:09.851697 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1856dd9-87fb-4f7b-8a81-2c8549476ba0 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:09.987826 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c1856dd9-87fb-4f7b-8a81-2c8549476ba0 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:09.996217 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c1856dd9-87fb-4f7b-8a81-2c8549476ba0 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.157827 Jul 31 01:59:09.996793 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3220/6409] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:09 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:11.016609 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9e9bf15f-1e34-4a55-9d8f-3f27f6b7c936 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:11.017163 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9e9bf15f-1e34-4a55-9d8f-3f27f6b7c936 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:11.029136 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e9bf15f-1e34-4a55-9d8f-3f27f6b7c936 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:11.029606 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e9bf15f-1e34-4a55-9d8f-3f27f6b7c936 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:11.030400 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e9bf15f-1e34-4a55-9d8f-3f27f6b7c936 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:11.030857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9e9bf15f-1e34-4a55-9d8f-3f27f6b7c936 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:11.164884 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9e9bf15f-1e34-4a55-9d8f-3f27f6b7c936 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:11.172369 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9e9bf15f-1e34-4a55-9d8f-3f27f6b7c936 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.159875 Jul 31 01:59:11.172949 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3190/6410] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:11 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:12.194160 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-997a7d65-06a7-40a6-9387-5ea7d972d8ef tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:12.194765 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-997a7d65-06a7-40a6-9387-5ea7d972d8ef tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:12.202101 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-997a7d65-06a7-40a6-9387-5ea7d972d8ef tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:12.202561 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-997a7d65-06a7-40a6-9387-5ea7d972d8ef tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:12.203348 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-997a7d65-06a7-40a6-9387-5ea7d972d8ef tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:12.203786 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-997a7d65-06a7-40a6-9387-5ea7d972d8ef tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:12.339174 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-997a7d65-06a7-40a6-9387-5ea7d972d8ef tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:12.346654 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-997a7d65-06a7-40a6-9387-5ea7d972d8ef tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.156411 Jul 31 01:59:12.347253 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3221/6411] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:12 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:13.368519 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-81737f0f-093f-4e6a-9936-66b15ff3c9cb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:13.369141 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-81737f0f-093f-4e6a-9936-66b15ff3c9cb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:13.376131 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81737f0f-093f-4e6a-9936-66b15ff3c9cb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:13.376588 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81737f0f-093f-4e6a-9936-66b15ff3c9cb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:13.377351 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81737f0f-093f-4e6a-9936-66b15ff3c9cb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:13.377795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81737f0f-093f-4e6a-9936-66b15ff3c9cb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:13.507052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-81737f0f-093f-4e6a-9936-66b15ff3c9cb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:13.515324 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-81737f0f-093f-4e6a-9936-66b15ff3c9cb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.151371 Jul 31 01:59:13.515914 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3191/6412] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:13 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:14.536659 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-896a29e6-eee7-436a-84cd-2982c1e2cdde tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:14.537282 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-896a29e6-eee7-436a-84cd-2982c1e2cdde tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:14.544701 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-896a29e6-eee7-436a-84cd-2982c1e2cdde tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:14.545157 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-896a29e6-eee7-436a-84cd-2982c1e2cdde tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:14.545921 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-896a29e6-eee7-436a-84cd-2982c1e2cdde tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:14.546359 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-896a29e6-eee7-436a-84cd-2982c1e2cdde tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:14.678948 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-896a29e6-eee7-436a-84cd-2982c1e2cdde tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:14.687007 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-896a29e6-eee7-436a-84cd-2982c1e2cdde tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.154207 Jul 31 01:59:14.687616 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3222/6413] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:14 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:15.710837 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e99f5b60-a827-4dc7-9a6c-cf444c9e8021 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:15.711614 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e99f5b60-a827-4dc7-9a6c-cf444c9e8021 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:15.718727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e99f5b60-a827-4dc7-9a6c-cf444c9e8021 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:15.719197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e99f5b60-a827-4dc7-9a6c-cf444c9e8021 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:15.720013 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e99f5b60-a827-4dc7-9a6c-cf444c9e8021 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:15.720472 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e99f5b60-a827-4dc7-9a6c-cf444c9e8021 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:15.850795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e99f5b60-a827-4dc7-9a6c-cf444c9e8021 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:15.859673 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e99f5b60-a827-4dc7-9a6c-cf444c9e8021 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.152649 Jul 31 01:59:15.860259 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3192/6414] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:15 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:16.881878 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6751a6be-012f-41a7-8db4-c84283f6d89c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:16.882432 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6751a6be-012f-41a7-8db4-c84283f6d89c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:16.885661 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=32 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:59:16.891056 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6751a6be-012f-41a7-8db4-c84283f6d89c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:16.891559 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6751a6be-012f-41a7-8db4-c84283f6d89c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:16.892347 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6751a6be-012f-41a7-8db4-c84283f6d89c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:16.892859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6751a6be-012f-41a7-8db4-c84283f6d89c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:16.896963 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:59:17.025741 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6751a6be-012f-41a7-8db4-c84283f6d89c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:17.033137 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6751a6be-012f-41a7-8db4-c84283f6d89c tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.155270 Jul 31 01:59:17.033731 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3223/6415] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:16 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:18.054082 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-be66d0aa-6b11-4d9c-9118-a547a803a3b5 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:18.054728 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-be66d0aa-6b11-4d9c-9118-a547a803a3b5 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:18.057475 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=28 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:59:18.063425 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be66d0aa-6b11-4d9c-9118-a547a803a3b5 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:18.063900 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be66d0aa-6b11-4d9c-9118-a547a803a3b5 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:18.064689 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be66d0aa-6b11-4d9c-9118-a547a803a3b5 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:18.065145 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be66d0aa-6b11-4d9c-9118-a547a803a3b5 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:18.067727 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=84 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:59:18.194993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-be66d0aa-6b11-4d9c-9118-a547a803a3b5 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:18.203008 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-be66d0aa-6b11-4d9c-9118-a547a803a3b5 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.152842 Jul 31 01:59:18.203606 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3193/6416] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:18 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:19.224166 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-56b6a1ce-f34a-4c19-82a8-a1306fbd4510 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:19.224789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-56b6a1ce-f34a-4c19-82a8-a1306fbd4510 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:19.232379 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56b6a1ce-f34a-4c19-82a8-a1306fbd4510 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:19.232838 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56b6a1ce-f34a-4c19-82a8-a1306fbd4510 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:19.233606 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56b6a1ce-f34a-4c19-82a8-a1306fbd4510 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:19.234052 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-56b6a1ce-f34a-4c19-82a8-a1306fbd4510 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:19.364379 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-56b6a1ce-f34a-4c19-82a8-a1306fbd4510 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:19.371836 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-56b6a1ce-f34a-4c19-82a8-a1306fbd4510 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.151566 Jul 31 01:59:19.372413 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3224/6417] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:19 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:20.393240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4052a442-4981-4821-b4ee-210368a70f33 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:20.393917 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4052a442-4981-4821-b4ee-210368a70f33 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:20.402248 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4052a442-4981-4821-b4ee-210368a70f33 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:20.402704 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4052a442-4981-4821-b4ee-210368a70f33 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:20.403498 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4052a442-4981-4821-b4ee-210368a70f33 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:20.403940 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4052a442-4981-4821-b4ee-210368a70f33 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:20.533802 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4052a442-4981-4821-b4ee-210368a70f33 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:20.541217 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4052a442-4981-4821-b4ee-210368a70f33 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.151858 Jul 31 01:59:20.541782 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3194/6418] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:20 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:21.562051 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c8b80317-2347-4790-9c41-d9b2f9a47e72 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:21.562678 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c8b80317-2347-4790-9c41-d9b2f9a47e72 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:21.570231 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8b80317-2347-4790-9c41-d9b2f9a47e72 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:21.570739 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8b80317-2347-4790-9c41-d9b2f9a47e72 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:21.571563 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8b80317-2347-4790-9c41-d9b2f9a47e72 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:21.572034 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c8b80317-2347-4790-9c41-d9b2f9a47e72 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:21.737022 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c8b80317-2347-4790-9c41-d9b2f9a47e72 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:21.744840 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c8b80317-2347-4790-9c41-d9b2f9a47e72 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1515 microversion: 2.1 time: 0.186718 Jul 31 01:59:21.745416 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3225/6419] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:21 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:22.301353 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-fcd64b00-a01e-4c3e-b3c6-87b07c0a7665 req-19eb9a73-8eb1-4188-b27b-ef6238561db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d48150-292c-46a0-b6e6-cf5ba567f6f3", "name": "network-vif-unplugged", "status": "completed", "tag": "d605bc1e-ad07-4e01-aad6-0da625b0b113"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:59:22.312596 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fcd64b00-a01e-4c3e-b3c6-87b07c0a7665 req-19eb9a73-8eb1-4188-b27b-ef6238561db6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:22.313114 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fcd64b00-a01e-4c3e-b3c6-87b07c0a7665 req-19eb9a73-8eb1-4188-b27b-ef6238561db6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:22.325848 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-fcd64b00-a01e-4c3e-b3c6-87b07c0a7665 req-19eb9a73-8eb1-4188-b27b-ef6238561db6 service nova] Creating event network-vif-unplugged:d605bc1e-ad07-4e01-aad6-0da625b0b113 for instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 on n-h2-master-1 Jul 31 01:59:22.331214 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-fcd64b00-a01e-4c3e-b3c6-87b07c0a7665 req-19eb9a73-8eb1-4188-b27b-ef6238561db6 service nova] Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:59:22.341845 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-fcd64b00-a01e-4c3e-b3c6-87b07c0a7665 req-19eb9a73-8eb1-4188-b27b-ef6238561db6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044185 Jul 31 01:59:22.342455 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3195/6420] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:59:22.766749 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5d69ba5b-0150-4b1b-8d44-3ba340bce113 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:22.768004 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5d69ba5b-0150-4b1b-8d44-3ba340bce113 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:22.774628 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d69ba5b-0150-4b1b-8d44-3ba340bce113 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:22.775092 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d69ba5b-0150-4b1b-8d44-3ba340bce113 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:22.775894 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d69ba5b-0150-4b1b-8d44-3ba340bce113 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:22.776349 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d69ba5b-0150-4b1b-8d44-3ba340bce113 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:22.908633 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5d69ba5b-0150-4b1b-8d44-3ba340bce113 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:22.917121 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5d69ba5b-0150-4b1b-8d44-3ba340bce113 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1514 microversion: 2.1 time: 0.154639 Jul 31 01:59:22.917714 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3226/6421] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:22 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:23.941617 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c56ea01e-a658-4c1a-ac5c-f8e54110fb4d tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:23.942258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c56ea01e-a658-4c1a-ac5c-f8e54110fb4d tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:23.949184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c56ea01e-a658-4c1a-ac5c-f8e54110fb4d tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:23.949653 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c56ea01e-a658-4c1a-ac5c-f8e54110fb4d tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:23.950464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c56ea01e-a658-4c1a-ac5c-f8e54110fb4d tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:23.950921 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c56ea01e-a658-4c1a-ac5c-f8e54110fb4d tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:24.084836 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c56ea01e-a658-4c1a-ac5c-f8e54110fb4d tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:24.092465 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c56ea01e-a658-4c1a-ac5c-f8e54110fb4d tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1512 microversion: 2.1 time: 0.156051 Jul 31 01:59:24.093037 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3196/6422] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:23 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:24.359624 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-e8cbea8f-6d24-4bae-ae5e-fe540be36ad3 req-caa0793f-00cd-4706-8077-d1b45310116f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4d48150-292c-46a0-b6e6-cf5ba567f6f3", "tag": "d605bc1e-ad07-4e01-aad6-0da625b0b113"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:59:24.370479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e8cbea8f-6d24-4bae-ae5e-fe540be36ad3 req-caa0793f-00cd-4706-8077-d1b45310116f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:24.370925 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e8cbea8f-6d24-4bae-ae5e-fe540be36ad3 req-caa0793f-00cd-4706-8077-d1b45310116f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:24.382230 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-e8cbea8f-6d24-4bae-ae5e-fe540be36ad3 req-caa0793f-00cd-4706-8077-d1b45310116f service nova] Creating event network-changed:d605bc1e-ad07-4e01-aad6-0da625b0b113 for instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 on n-h2-master-1 Jul 31 01:59:24.387466 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-e8cbea8f-6d24-4bae-ae5e-fe540be36ad3 req-caa0793f-00cd-4706-8077-d1b45310116f service nova] Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 01:59:24.397938 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-e8cbea8f-6d24-4bae-ae5e-fe540be36ad3 req-caa0793f-00cd-4706-8077-d1b45310116f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041970 Jul 31 01:59:24.398522 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3227/6423] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:59:25.113950 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b6bc7861-e46d-4d9b-a5f8-d9c780ca8ae7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:25.114578 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b6bc7861-e46d-4d9b-a5f8-d9c780ca8ae7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:25.121464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6bc7861-e46d-4d9b-a5f8-d9c780ca8ae7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:25.121931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6bc7861-e46d-4d9b-a5f8-d9c780ca8ae7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:25.122739 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6bc7861-e46d-4d9b-a5f8-d9c780ca8ae7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:25.123196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6bc7861-e46d-4d9b-a5f8-d9c780ca8ae7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:25.251375 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b6bc7861-e46d-4d9b-a5f8-d9c780ca8ae7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:25.259379 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b6bc7861-e46d-4d9b-a5f8-d9c780ca8ae7 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1509 microversion: 2.1 time: 0.149584 Jul 31 01:59:25.259953 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3197/6424] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:25 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:25.280816 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e08f15b4-10aa-4481-8d1a-eb6ab1a09c75 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:25.281433 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e08f15b4-10aa-4481-8d1a-eb6ab1a09c75 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:25.287653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e08f15b4-10aa-4481-8d1a-eb6ab1a09c75 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:25.288104 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e08f15b4-10aa-4481-8d1a-eb6ab1a09c75 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:25.288863 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e08f15b4-10aa-4481-8d1a-eb6ab1a09c75 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:25.289323 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e08f15b4-10aa-4481-8d1a-eb6ab1a09c75 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:25.314619 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e08f15b4-10aa-4481-8d1a-eb6ab1a09c75 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 01:59:25.361996 n-d-master-1 devstack@n-api.service[119475]: INFO nova.compute.api [None req-e08f15b4-10aa-4481-8d1a-eb6ab1a09c75 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Found an unconfirmed migration during delete, id: 16, status: finished Jul 31 01:59:26.807087 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e08f15b4-10aa-4481-8d1a-eb6ab1a09c75 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 204 len: 0 microversion: 2.1 time: 1.530170 Jul 31 01:59:26.808016 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3228/6425] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:59:25 2022] DELETE /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 0 bytes in 1532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 01:59:26.818109 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-50965815-a06e-491e-8d2b-88543e6748c2 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:26.818996 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-50965815-a06e-491e-8d2b-88543e6748c2 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:26.827223 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50965815-a06e-491e-8d2b-88543e6748c2 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:26.827719 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50965815-a06e-491e-8d2b-88543e6748c2 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:26.828493 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50965815-a06e-491e-8d2b-88543e6748c2 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:26.828939 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-50965815-a06e-491e-8d2b-88543e6748c2 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:26.958116 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-50965815-a06e-491e-8d2b-88543e6748c2 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:26.965630 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-50965815-a06e-491e-8d2b-88543e6748c2 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1501 microversion: 2.1 time: 0.153133 Jul 31 01:59:26.966199 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3198/6426] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:26 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:27.891116 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2838c906-cb05-431e-ab7c-1749bdfdda03 req-cd7df93a-e817-4faa-86ce-826ae067d9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d48150-292c-46a0-b6e6-cf5ba567f6f3", "name": "network-vif-plugged", "status": "completed", "tag": "d605bc1e-ad07-4e01-aad6-0da625b0b113"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:59:27.903572 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2838c906-cb05-431e-ab7c-1749bdfdda03 req-cd7df93a-e817-4faa-86ce-826ae067d9d9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:27.904033 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2838c906-cb05-431e-ab7c-1749bdfdda03 req-cd7df93a-e817-4faa-86ce-826ae067d9d9 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:27.914606 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2838c906-cb05-431e-ab7c-1749bdfdda03 req-cd7df93a-e817-4faa-86ce-826ae067d9d9 service nova] Creating event network-vif-plugged:d605bc1e-ad07-4e01-aad6-0da625b0b113 for instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 on n-h2-master-1 Jul 31 01:59:27.919354 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2838c906-cb05-431e-ab7c-1749bdfdda03 req-cd7df93a-e817-4faa-86ce-826ae067d9d9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032482 Jul 31 01:59:27.919962 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3229/6427] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:59:27.986652 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f329ca48-d622-43a5-a6eb-8315c764e42f tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:27.987285 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f329ca48-d622-43a5-a6eb-8315c764e42f tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:27.994580 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f329ca48-d622-43a5-a6eb-8315c764e42f tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:27.995051 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f329ca48-d622-43a5-a6eb-8315c764e42f tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:27.995890 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f329ca48-d622-43a5-a6eb-8315c764e42f tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:27.996345 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f329ca48-d622-43a5-a6eb-8315c764e42f tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:28.138963 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f329ca48-d622-43a5-a6eb-8315c764e42f tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4aa8ebe1044e939bde053eab64f85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06af800dcc0d4529a12baa6da174b8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:28.146489 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f329ca48-d622-43a5-a6eb-8315c764e42f tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 200 len: 1501 microversion: 2.1 time: 0.163732 Jul 31 01:59:28.147066 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3199/6428] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:27 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:59:28.625603 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-52b18ff6-5513-43b4-bc21-46462cacf0d0 req-3ecde251-fc11-4667-928b-02eb3f014cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d48150-292c-46a0-b6e6-cf5ba567f6f3", "name": "network-vif-deleted", "tag": "d605bc1e-ad07-4e01-aad6-0da625b0b113"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:59:28.636726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-52b18ff6-5513-43b4-bc21-46462cacf0d0 req-3ecde251-fc11-4667-928b-02eb3f014cf1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:28.637179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-52b18ff6-5513-43b4-bc21-46462cacf0d0 req-3ecde251-fc11-4667-928b-02eb3f014cf1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:28.654602 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-52b18ff6-5513-43b4-bc21-46462cacf0d0 req-3ecde251-fc11-4667-928b-02eb3f014cf1 service nova] Creating event network-vif-deleted:d605bc1e-ad07-4e01-aad6-0da625b0b113 for instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 on n-h2-master-1 Jul 31 01:59:28.660081 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-52b18ff6-5513-43b4-bc21-46462cacf0d0 req-3ecde251-fc11-4667-928b-02eb3f014cf1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039038 Jul 31 01:59:28.661089 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3230/6429] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:59:29.168404 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-15dbbace-7fa3-48a1-9e25-08ea98fb2ed4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:29.169563 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-15dbbace-7fa3-48a1-9e25-08ea98fb2ed4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:29.178830 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15dbbace-7fa3-48a1-9e25-08ea98fb2ed4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:29.179693 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15dbbace-7fa3-48a1-9e25-08ea98fb2ed4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:29.181000 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15dbbace-7fa3-48a1-9e25-08ea98fb2ed4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:29.181459 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15dbbace-7fa3-48a1-9e25-08ea98fb2ed4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:29.194937 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-15dbbace-7fa3-48a1-9e25-08ea98fb2ed4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] HTTP exception thrown: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-15dbbace-7fa3-48a1-9e25-08ea98fb2ed4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Request method failure captured: Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 HTTP/1.1 Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eHLMj8c09CnRHxtHyTpHXKmpIaXQDshAgcxYCiP2ixRLYwOm0E85yfGYPiK4_m93dMNzG6T4klbWuKr2Oeuc0oFk6PuCREPmK7vyTD1lBadgKuAelDMTZpFM9PwZ5olEkftjE7TFmFRmSr0fzyuQIIBh-OQ7lBxKveYuB30EsHFQvI Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 06af800dcc0d4529a12baa6da174b8e9 Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersTestJSON-1372074066 Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/06af800dcc0d4529a12baa6da174b8e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/06af800dcc0d4529a12baa6da174b8e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/06af800dcc0d4529a12baa6da174b8e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_06af800dcc0d4529a12baa6da174b8e9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersTestJSON-1372074066 Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 06af800dcc0d4529a12baa6da174b8e9 Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersTestJSON-1372074066 Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersTestJSON-1372074066-project Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 5e4aa8ebe1044e939bde053eab64f85c Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersTestJSON-1372074066-project Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: exception: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'f4d48150-292c-46a0-b6e6-cf5ba567f6f3'} Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:59:29.197203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:59:29.202350 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:59:29.202350 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:59:29.202350 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:59:29.202350 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:59:29.202350 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:59:29.202350 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. Jul 31 01:59:29.202350 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:59:29.202350 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-15dbbace-7fa3-48a1-9e25-08ea98fb2ed4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Returning 404 to user: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:59:29.202350 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-15dbbace-7fa3-48a1-9e25-08ea98fb2ed4 tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 404 len: 111 microversion: 2.1 time: 0.034411 Jul 31 01:59:29.202350 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3200/6430] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:29 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:59:29.218924 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4e33ca25-f018-49fd-a5a0-1b3555370adb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:29.220879 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4e33ca25-f018-49fd-a5a0-1b3555370adb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:29.226705 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e33ca25-f018-49fd-a5a0-1b3555370adb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:29.227169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e33ca25-f018-49fd-a5a0-1b3555370adb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:29.227995 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e33ca25-f018-49fd-a5a0-1b3555370adb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:29.228436 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4e33ca25-f018-49fd-a5a0-1b3555370adb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:29.244875 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-4e33ca25-f018-49fd-a5a0-1b3555370adb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] HTTP exception thrown: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4e33ca25-f018-49fd-a5a0-1b3555370adb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Request method failure captured: Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 HTTP/1.1 Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eHLMj8c09CnRHxtHyTpHXKmpIaXQDshAgcxYCiP2ixRLYwOm0E85yfGYPiK4_m93dMNzG6T4klbWuKr2Oeuc0oFk6PuCREPmK7vyTD1lBadgKuAelDMTZpFM9PwZ5olEkftjE7TFmFRmSr0fzyuQIIBh-OQ7lBxKveYuB30EsHFQvI Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 06af800dcc0d4529a12baa6da174b8e9 Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-DeleteServersTestJSON-1372074066 Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/06af800dcc0d4529a12baa6da174b8e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/06af800dcc0d4529a12baa6da174b8e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/06af800dcc0d4529a12baa6da174b8e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_06af800dcc0d4529a12baa6da174b8e9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-DeleteServersTestJSON-1372074066 Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 06af800dcc0d4529a12baa6da174b8e9 Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-DeleteServersTestJSON-1372074066 Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-DeleteServersTestJSON-1372074066-project Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 5e4aa8ebe1044e939bde053eab64f85c Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-DeleteServersTestJSON-1372074066-project Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: exception: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'f4d48150-292c-46a0-b6e6-cf5ba567f6f3'} Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:59:29.246424 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:59:29.251711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. Jul 31 01:59:29.251711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:59:29.251711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:59:29.251711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:59:29.251711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:59:29.251711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:59:29.251711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:59:29.251711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:59:29.251711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:59:29.251711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. Jul 31 01:59:29.251711 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 01:59:29.251711 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4e33ca25-f018-49fd-a5a0-1b3555370adb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Returning 404 to user: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:59:29.251711 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4e33ca25-f018-49fd-a5a0-1b3555370adb tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 404 len: 111 microversion: 2.1 time: 0.035660 Jul 31 01:59:29.251711 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3231/6431] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 01:59:29 2022] DELETE /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:59:29.256953 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-68e968b2-39df-4261-9d89-a37a14fb742e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:29.257588 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-68e968b2-39df-4261-9d89-a37a14fb742e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] [instance: f4d48150-292c-46a0-b6e6-cf5ba567f6f3] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:29.264377 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68e968b2-39df-4261-9d89-a37a14fb742e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:29.264846 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68e968b2-39df-4261-9d89-a37a14fb742e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:29.265629 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68e968b2-39df-4261-9d89-a37a14fb742e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:29.266079 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-68e968b2-39df-4261-9d89-a37a14fb742e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:29.280276 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-68e968b2-39df-4261-9d89-a37a14fb742e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] HTTP exception thrown: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-68e968b2-39df-4261-9d89-a37a14fb742e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Request method failure captured: Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 HTTP/1.1 Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eHLMj8c09CnRHxtHyTpHXKmpIaXQDshAgcxYCiP2ixRLYwOm0E85yfGYPiK4_m93dMNzG6T4klbWuKr2Oeuc0oFk6PuCREPmK7vyTD1lBadgKuAelDMTZpFM9PwZ5olEkftjE7TFmFRmSr0fzyuQIIBh-OQ7lBxKveYuB30EsHFQvI Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 06af800dcc0d4529a12baa6da174b8e9 Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-DeleteServersTestJSON-1372074066 Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/06af800dcc0d4529a12baa6da174b8e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/06af800dcc0d4529a12baa6da174b8e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/06af800dcc0d4529a12baa6da174b8e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_06af800dcc0d4529a12baa6da174b8e9", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-DeleteServersTestJSON-1372074066 Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 06af800dcc0d4529a12baa6da174b8e9 Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-DeleteServersTestJSON-1372074066 Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-DeleteServersTestJSON-1372074066-project Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 5e4aa8ebe1044e939bde053eab64f85c Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-DeleteServersTestJSON-1372074066-project Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: exception: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'f4d48150-292c-46a0-b6e6-cf5ba567f6f3'} Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 01:59:29.281831 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:59:29.286916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 01:59:29.286916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 01:59:29.286916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 01:59:29.286916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 01:59:29.286916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 01:59:29.286916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. Jul 31 01:59:29.286916 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 01:59:29.286916 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-68e968b2-39df-4261-9d89-a37a14fb742e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] Returning 404 to user: Instance f4d48150-292c-46a0-b6e6-cf5ba567f6f3 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 01:59:29.286916 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-68e968b2-39df-4261-9d89-a37a14fb742e tempest-DeleteServersTestJSON-1372074066 tempest-DeleteServersTestJSON-1372074066-project] 10.222.0.45 "GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3" status: 404 len: 111 microversion: 2.1 time: 0.030497 Jul 31 01:59:29.286916 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3201/6432] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:29 2022] GET /compute/v2.1/servers/f4d48150-292c-46a0-b6e6-cf5ba567f6f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 01:59:37.840793 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-21096b43-b501-4bef-9f74-0c2c61a26f42 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-676308902", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "7cb2b369-6ec1-4a8a-9d2f-088650f790e4"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:59:37.897368 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-21096b43-b501-4bef-9f74-0c2c61a26f42 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] validate_networks() for [('7cb2b369-6ec1-4a8a-9d2f-088650f790e4', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 01:59:38.294130 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-21096b43-b501-4bef-9f74-0c2c61a26f42 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:59:38.294562 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-21096b43-b501-4bef-9f74-0c2c61a26f42 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:59:38.295044 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-21096b43-b501-4bef-9f74-0c2c61a26f42 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:59:38.295493 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-21096b43-b501-4bef-9f74-0c2c61a26f42 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:59:38.295915 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-21096b43-b501-4bef-9f74-0c2c61a26f42 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:59:38.306011 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21096b43-b501-4bef-9f74-0c2c61a26f42 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:38.306466 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21096b43-b501-4bef-9f74-0c2c61a26f42 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:38.307445 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21096b43-b501-4bef-9f74-0c2c61a26f42 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:38.307877 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21096b43-b501-4bef-9f74-0c2c61a26f42 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:38.326083 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-21096b43-b501-4bef-9f74-0c2c61a26f42 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Getting quotas for project 5cda29a34d894ed082400a2960f75cb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 01:59:38.331605 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-21096b43-b501-4bef-9f74-0c2c61a26f42 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Getting quotas for user 3185f2944a7e483aa4cdc214aca21da6 and project 5cda29a34d894ed082400a2960f75cb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 01:59:38.345457 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-21096b43-b501-4bef-9f74-0c2c61a26f42 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 01:59:38.348116 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-21096b43-b501-4bef-9f74-0c2c61a26f42 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 01:59:38.395265 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-21096b43-b501-4bef-9f74-0c2c61a26f42 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682830 Jul 31 01:59:38.395970 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3232/6433] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 01:59:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 01:59:38.408454 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1214f4af-f0e0-4e3e-9ff6-cc5abbfc6445 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:38.409364 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1214f4af-f0e0-4e3e-9ff6-cc5abbfc6445 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:38.470359 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1214f4af-f0e0-4e3e-9ff6-cc5abbfc6445 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:38.478153 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1214f4af-f0e0-4e3e-9ff6-cc5abbfc6445 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1217 microversion: 2.1 time: 0.074098 Jul 31 01:59:38.478925 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3202/6434] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:38 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:39.501454 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a0cc521e-8285-4c13-bebf-0439daf30649 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:39.502797 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a0cc521e-8285-4c13-bebf-0439daf30649 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:39.511390 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0cc521e-8285-4c13-bebf-0439daf30649 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:39.512179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0cc521e-8285-4c13-bebf-0439daf30649 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:39.513264 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0cc521e-8285-4c13-bebf-0439daf30649 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:39.513938 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a0cc521e-8285-4c13-bebf-0439daf30649 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:39.639412 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a0cc521e-8285-4c13-bebf-0439daf30649 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:39.648154 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a0cc521e-8285-4c13-bebf-0439daf30649 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1287 microversion: 2.1 time: 0.152022 Jul 31 01:59:39.662701 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3233/6435] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:39 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1287 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:40.670217 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0fab4e05-1f52-458c-a280-0f585002c681 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:40.670855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0fab4e05-1f52-458c-a280-0f585002c681 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:40.673818 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=43 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:59:40.682237 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0fab4e05-1f52-458c-a280-0f585002c681 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:40.682978 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0fab4e05-1f52-458c-a280-0f585002c681 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:40.683812 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0fab4e05-1f52-458c-a280-0f585002c681 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:40.684277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0fab4e05-1f52-458c-a280-0f585002c681 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:40.875368 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0fab4e05-1f52-458c-a280-0f585002c681 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:40.885455 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0fab4e05-1f52-458c-a280-0f585002c681 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1317 microversion: 2.1 time: 0.219151 Jul 31 01:59:40.892049 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3203/6436] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:40 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:40.892607 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-0c8777fc-3ea9-4b05-a105-4e9c2acff3e4 req-29cc8856-b4d3-4926-b8f1-b631eb3ea3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdbfa422-e433-42fe-b5a7-b7629221d105", "tag": "fe55fcf3-53ad-4497-a578-b5c13573cf01"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:59:40.905391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0c8777fc-3ea9-4b05-a105-4e9c2acff3e4 req-29cc8856-b4d3-4926-b8f1-b631eb3ea3a5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:40.905953 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-0c8777fc-3ea9-4b05-a105-4e9c2acff3e4 req-29cc8856-b4d3-4926-b8f1-b631eb3ea3a5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:40.919846 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-0c8777fc-3ea9-4b05-a105-4e9c2acff3e4 req-29cc8856-b4d3-4926-b8f1-b631eb3ea3a5 service nova] Creating event network-changed:fe55fcf3-53ad-4497-a578-b5c13573cf01 for instance fdbfa422-e433-42fe-b5a7-b7629221d105 on n-h1-master-1 Jul 31 01:59:40.925668 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-0c8777fc-3ea9-4b05-a105-4e9c2acff3e4 req-29cc8856-b4d3-4926-b8f1-b631eb3ea3a5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036585 Jul 31 01:59:40.926622 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3234/6437] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 01:59:41.907880 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-66ffd5d9-2b21-49e0-86bc-5c294b76b8ba tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:41.908561 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-66ffd5d9-2b21-49e0-86bc-5c294b76b8ba tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:41.915954 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66ffd5d9-2b21-49e0-86bc-5c294b76b8ba tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:41.916415 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66ffd5d9-2b21-49e0-86bc-5c294b76b8ba tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:41.917178 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66ffd5d9-2b21-49e0-86bc-5c294b76b8ba tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:41.917624 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66ffd5d9-2b21-49e0-86bc-5c294b76b8ba tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:42.048464 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-66ffd5d9-2b21-49e0-86bc-5c294b76b8ba tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:42.055899 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-66ffd5d9-2b21-49e0-86bc-5c294b76b8ba tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1317 microversion: 2.1 time: 0.151984 Jul 31 01:59:42.056488 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3204/6438] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:41 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:43.077749 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-81d22e49-5128-4d18-96da-cc67c3c323c8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:43.078495 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-81d22e49-5128-4d18-96da-cc67c3c323c8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:43.084724 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81d22e49-5128-4d18-96da-cc67c3c323c8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:43.085181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81d22e49-5128-4d18-96da-cc67c3c323c8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:43.085949 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81d22e49-5128-4d18-96da-cc67c3c323c8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:43.086398 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81d22e49-5128-4d18-96da-cc67c3c323c8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:43.218796 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-81d22e49-5128-4d18-96da-cc67c3c323c8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:43.227142 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-81d22e49-5128-4d18-96da-cc67c3c323c8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1317 microversion: 2.1 time: 0.153980 Jul 31 01:59:43.227755 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3235/6439] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:43 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:44.248420 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ccb69f8-2a02-4ac1-a125-db7b1874834b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:44.249043 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0ccb69f8-2a02-4ac1-a125-db7b1874834b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:44.255974 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ccb69f8-2a02-4ac1-a125-db7b1874834b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:44.256440 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ccb69f8-2a02-4ac1-a125-db7b1874834b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:44.257215 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ccb69f8-2a02-4ac1-a125-db7b1874834b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:44.257666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ccb69f8-2a02-4ac1-a125-db7b1874834b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:44.385531 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0ccb69f8-2a02-4ac1-a125-db7b1874834b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:44.392957 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0ccb69f8-2a02-4ac1-a125-db7b1874834b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1317 microversion: 2.1 time: 0.148533 Jul 31 01:59:44.393532 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3205/6440] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:44 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:45.414615 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-517e4b70-455a-40ec-8b1b-f1b83bf81963 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:45.415223 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-517e4b70-455a-40ec-8b1b-f1b83bf81963 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:45.422813 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-517e4b70-455a-40ec-8b1b-f1b83bf81963 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:45.423274 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-517e4b70-455a-40ec-8b1b-f1b83bf81963 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:45.424065 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-517e4b70-455a-40ec-8b1b-f1b83bf81963 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:45.424499 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-517e4b70-455a-40ec-8b1b-f1b83bf81963 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:45.431966 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-388f3f5d-0f41-4b24-b138-8ecbd8f4be27 req-96cf5ca6-124a-43e3-b9c5-28e1d78549ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbfa422-e433-42fe-b5a7-b7629221d105", "name": "network-vif-plugged", "status": "completed", "tag": "fe55fcf3-53ad-4497-a578-b5c13573cf01"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:59:45.442756 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-388f3f5d-0f41-4b24-b138-8ecbd8f4be27 req-96cf5ca6-124a-43e3-b9c5-28e1d78549ee service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:45.443403 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-388f3f5d-0f41-4b24-b138-8ecbd8f4be27 req-96cf5ca6-124a-43e3-b9c5-28e1d78549ee service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:45.458502 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-388f3f5d-0f41-4b24-b138-8ecbd8f4be27 req-96cf5ca6-124a-43e3-b9c5-28e1d78549ee service nova] Creating event network-vif-plugged:fe55fcf3-53ad-4497-a578-b5c13573cf01 for instance fdbfa422-e433-42fe-b5a7-b7629221d105 on n-h1-master-1 Jul 31 01:59:45.463857 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-388f3f5d-0f41-4b24-b138-8ecbd8f4be27 req-96cf5ca6-124a-43e3-b9c5-28e1d78549ee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036204 Jul 31 01:59:45.464464 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3206/6441] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 01:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 01:59:45.620662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-517e4b70-455a-40ec-8b1b-f1b83bf81963 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:45.628375 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-517e4b70-455a-40ec-8b1b-f1b83bf81963 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1317 microversion: 2.1 time: 0.218096 Jul 31 01:59:45.632372 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3236/6442] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:45 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:46.650505 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-450e3cf3-acb4-456d-8a29-b8b1d96da9c4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:46.651210 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-450e3cf3-acb4-456d-8a29-b8b1d96da9c4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:46.657469 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-450e3cf3-acb4-456d-8a29-b8b1d96da9c4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:46.657931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-450e3cf3-acb4-456d-8a29-b8b1d96da9c4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:46.658705 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-450e3cf3-acb4-456d-8a29-b8b1d96da9c4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:46.659150 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-450e3cf3-acb4-456d-8a29-b8b1d96da9c4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:46.808391 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-450e3cf3-acb4-456d-8a29-b8b1d96da9c4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:46.815890 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-450e3cf3-acb4-456d-8a29-b8b1d96da9c4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1317 microversion: 2.1 time: 0.170416 Jul 31 01:59:46.816458 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3207/6443] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:46 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:47.836911 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9b2c1b93-19d4-4471-a45a-4494b1d410a5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:47.837538 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9b2c1b93-19d4-4471-a45a-4494b1d410a5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:47.840338 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:59:47.845809 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9b2c1b93-19d4-4471-a45a-4494b1d410a5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:47.846274 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9b2c1b93-19d4-4471-a45a-4494b1d410a5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:47.847058 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9b2c1b93-19d4-4471-a45a-4494b1d410a5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:47.847532 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9b2c1b93-19d4-4471-a45a-4494b1d410a5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:47.852544 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:59:47.979870 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9b2c1b93-19d4-4471-a45a-4494b1d410a5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:47.987462 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9b2c1b93-19d4-4471-a45a-4494b1d410a5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1507 microversion: 2.1 time: 0.154414 Jul 31 01:59:47.988040 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3237/6444] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:47 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:48.009394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0a11a733-664f-48aa-9ca0-9e3403fd77d2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:48.010021 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0a11a733-664f-48aa-9ca0-9e3403fd77d2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:48.016862 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a11a733-664f-48aa-9ca0-9e3403fd77d2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:48.017330 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a11a733-664f-48aa-9ca0-9e3403fd77d2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:48.018382 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a11a733-664f-48aa-9ca0-9e3403fd77d2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:48.018585 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a11a733-664f-48aa-9ca0-9e3403fd77d2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:48.151710 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0a11a733-664f-48aa-9ca0-9e3403fd77d2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:48.159196 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0a11a733-664f-48aa-9ca0-9e3403fd77d2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1507 microversion: 2.1 time: 0.154201 Jul 31 01:59:48.159790 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3208/6445] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:48 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:48.180223 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-82955cda-3718-4449-b914-3e434fd8436c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:59:48.182640 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-82955cda-3718-4449-b914-3e434fd8436c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:48.188746 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-82955cda-3718-4449-b914-3e434fd8436c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:48.189214 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-82955cda-3718-4449-b914-3e434fd8436c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:48.189995 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-82955cda-3718-4449-b914-3e434fd8436c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:48.190443 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-82955cda-3718-4449-b914-3e434fd8436c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:48.256212 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-82955cda-3718-4449-b914-3e434fd8436c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "PUT /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1079 microversion: 2.1 time: 0.080419 Jul 31 01:59:48.256874 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3238/6446] 10.222.0.45 () {60 vars in 1256 bytes} [Sun Jul 31 01:59:48 2022] PUT /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1079 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:48.273640 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-37fc1190-c3d4-4f64-8978-99412c4a18a6 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:48.274264 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-37fc1190-c3d4-4f64-8978-99412c4a18a6 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:48.276241 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=34 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:59:48.281455 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37fc1190-c3d4-4f64-8978-99412c4a18a6 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:48.281911 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37fc1190-c3d4-4f64-8978-99412c4a18a6 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:48.282676 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37fc1190-c3d4-4f64-8978-99412c4a18a6 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:48.283127 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-37fc1190-c3d4-4f64-8978-99412c4a18a6 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:48.410113 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-37fc1190-c3d4-4f64-8978-99412c4a18a6 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:48.418146 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-37fc1190-c3d4-4f64-8978-99412c4a18a6 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1505 microversion: 2.1 time: 0.148282 Jul 31 01:59:48.418741 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3209/6447] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:48 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:48.438468 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b2813f3d-aacf-4c46-9d73-05d0c5016f45 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:48.439131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b2813f3d-aacf-4c46-9d73-05d0c5016f45 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:48.441026 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:59:48.441841 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:59:48.447980 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b2813f3d-aacf-4c46-9d73-05d0c5016f45 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:48.448441 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b2813f3d-aacf-4c46-9d73-05d0c5016f45 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:48.449236 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b2813f3d-aacf-4c46-9d73-05d0c5016f45 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:48.449672 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b2813f3d-aacf-4c46-9d73-05d0c5016f45 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:48.578172 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b2813f3d-aacf-4c46-9d73-05d0c5016f45 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:48.586206 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b2813f3d-aacf-4c46-9d73-05d0c5016f45 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1505 microversion: 2.1 time: 0.151153 Jul 31 01:59:48.586783 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3239/6448] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:48 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:48.606773 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-75529d2b-9362-4221-a0bd-9e68cd0b3f5d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 01:59:48.609134 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-75529d2b-9362-4221-a0bd-9e68cd0b3f5d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:48.611005 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:59:48.616861 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75529d2b-9362-4221-a0bd-9e68cd0b3f5d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:48.617326 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75529d2b-9362-4221-a0bd-9e68cd0b3f5d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:48.618107 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75529d2b-9362-4221-a0bd-9e68cd0b3f5d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:48.618560 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75529d2b-9362-4221-a0bd-9e68cd0b3f5d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:48.645697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-75529d2b-9362-4221-a0bd-9e68cd0b3f5d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:48.652115 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-75529d2b-9362-4221-a0bd-9e68cd0b3f5d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Old instance type m1.heat2, new instance type m1.heat {{(pid=119474) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 31 01:59:48.658216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-75529d2b-9362-4221-a0bd-9e68cd0b3f5d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 01:59:48.658650 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-75529d2b-9362-4221-a0bd-9e68cd0b3f5d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 01:59:48.659137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-75529d2b-9362-4221-a0bd-9e68cd0b3f5d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 01:59:48.659586 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-75529d2b-9362-4221-a0bd-9e68cd0b3f5d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 01:59:48.660011 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-75529d2b-9362-4221-a0bd-9e68cd0b3f5d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 01:59:48.720847 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-75529d2b-9362-4221-a0bd-9e68cd0b3f5d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "POST /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105/action" status: 202 len: 0 microversion: 2.1 time: 0.117862 Jul 31 01:59:48.721448 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3210/6449] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 01:59:48 2022] POST /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 01:59:48.730243 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fe5286af-6de9-443d-8106-bc56ef0ed53c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:48.730867 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fe5286af-6de9-443d-8106-bc56ef0ed53c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:48.736939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe5286af-6de9-443d-8106-bc56ef0ed53c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:48.737390 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe5286af-6de9-443d-8106-bc56ef0ed53c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:48.738188 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe5286af-6de9-443d-8106-bc56ef0ed53c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:48.738895 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe5286af-6de9-443d-8106-bc56ef0ed53c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:48.905531 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fe5286af-6de9-443d-8106-bc56ef0ed53c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:48.915743 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fe5286af-6de9-443d-8106-bc56ef0ed53c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1516 microversion: 2.1 time: 0.189696 Jul 31 01:59:48.917477 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3240/6450] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:48 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:49.939131 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-15d05819-67bc-44d0-aec4-769b868b0272 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:49.939717 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-15d05819-67bc-44d0-aec4-769b868b0272 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:49.945666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15d05819-67bc-44d0-aec4-769b868b0272 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:49.946146 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15d05819-67bc-44d0-aec4-769b868b0272 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:49.946882 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15d05819-67bc-44d0-aec4-769b868b0272 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:49.947330 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15d05819-67bc-44d0-aec4-769b868b0272 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:50.079175 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-15d05819-67bc-44d0-aec4-769b868b0272 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:50.087294 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-15d05819-67bc-44d0-aec4-769b868b0272 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1516 microversion: 2.1 time: 0.153230 Jul 31 01:59:50.087965 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3211/6451] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:49 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:51.108537 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cbc8512a-b111-42d5-83ff-8167182f9a6a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:51.109094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cbc8512a-b111-42d5-83ff-8167182f9a6a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:51.116321 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cbc8512a-b111-42d5-83ff-8167182f9a6a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:51.117295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cbc8512a-b111-42d5-83ff-8167182f9a6a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:51.118070 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cbc8512a-b111-42d5-83ff-8167182f9a6a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:51.118516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cbc8512a-b111-42d5-83ff-8167182f9a6a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:51.249616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cbc8512a-b111-42d5-83ff-8167182f9a6a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:51.257082 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cbc8512a-b111-42d5-83ff-8167182f9a6a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.152551 Jul 31 01:59:51.257670 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3241/6452] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:51 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:59:52.279278 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6f742110-ed9c-4685-b3b6-fe50a8f8b2c7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:52.279953 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6f742110-ed9c-4685-b3b6-fe50a8f8b2c7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:52.286868 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f742110-ed9c-4685-b3b6-fe50a8f8b2c7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:52.287331 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f742110-ed9c-4685-b3b6-fe50a8f8b2c7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:52.288139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f742110-ed9c-4685-b3b6-fe50a8f8b2c7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:52.288585 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6f742110-ed9c-4685-b3b6-fe50a8f8b2c7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:52.415176 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6f742110-ed9c-4685-b3b6-fe50a8f8b2c7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:52.422695 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6f742110-ed9c-4685-b3b6-fe50a8f8b2c7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.147342 Jul 31 01:59:52.423265 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3212/6453] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:52 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:53.444638 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-01c1c30b-bdfe-4243-9944-8b19584d18a8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:53.445176 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-01c1c30b-bdfe-4243-9944-8b19584d18a8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:53.452303 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01c1c30b-bdfe-4243-9944-8b19584d18a8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:53.452767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01c1c30b-bdfe-4243-9944-8b19584d18a8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:53.453544 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01c1c30b-bdfe-4243-9944-8b19584d18a8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:53.453989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01c1c30b-bdfe-4243-9944-8b19584d18a8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:53.587676 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-01c1c30b-bdfe-4243-9944-8b19584d18a8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:53.595046 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-01c1c30b-bdfe-4243-9944-8b19584d18a8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.154703 Jul 31 01:59:53.595654 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3242/6454] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:53 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:54.616731 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f4859647-1967-40ff-a692-94635ade12f4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:54.617875 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f4859647-1967-40ff-a692-94635ade12f4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:54.624863 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4859647-1967-40ff-a692-94635ade12f4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:54.625333 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4859647-1967-40ff-a692-94635ade12f4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:54.626118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4859647-1967-40ff-a692-94635ade12f4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:54.626573 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4859647-1967-40ff-a692-94635ade12f4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:54.756884 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f4859647-1967-40ff-a692-94635ade12f4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:54.764974 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f4859647-1967-40ff-a692-94635ade12f4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.152339 Jul 31 01:59:54.765493 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3213/6455] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:54 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 01:59:55.786131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d65fae4f-995a-4e22-8935-45c8c125e2cd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:55.786764 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d65fae4f-995a-4e22-8935-45c8c125e2cd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:55.793751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d65fae4f-995a-4e22-8935-45c8c125e2cd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:55.794215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d65fae4f-995a-4e22-8935-45c8c125e2cd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:55.794989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d65fae4f-995a-4e22-8935-45c8c125e2cd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:55.795463 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d65fae4f-995a-4e22-8935-45c8c125e2cd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:55.926136 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d65fae4f-995a-4e22-8935-45c8c125e2cd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:55.933642 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d65fae4f-995a-4e22-8935-45c8c125e2cd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.151485 Jul 31 01:59:55.934216 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3243/6456] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:55 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:56.955277 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21944dc3-31dc-424d-9721-0aa5a02c895b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:56.955886 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-21944dc3-31dc-424d-9721-0aa5a02c895b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:56.962789 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21944dc3-31dc-424d-9721-0aa5a02c895b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:56.963276 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21944dc3-31dc-424d-9721-0aa5a02c895b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:56.964081 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21944dc3-31dc-424d-9721-0aa5a02c895b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:56.964538 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21944dc3-31dc-424d-9721-0aa5a02c895b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:57.098554 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-21944dc3-31dc-424d-9721-0aa5a02c895b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:57.106117 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-21944dc3-31dc-424d-9721-0aa5a02c895b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.154832 Jul 31 01:59:57.106688 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3214/6457] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:56 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:58.129142 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-67a74de2-a045-45b6-b0a2-e2510f2b1a0e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:58.129776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-67a74de2-a045-45b6-b0a2-e2510f2b1a0e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:58.137157 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-67a74de2-a045-45b6-b0a2-e2510f2b1a0e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:58.137618 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-67a74de2-a045-45b6-b0a2-e2510f2b1a0e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:58.138387 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-67a74de2-a045-45b6-b0a2-e2510f2b1a0e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:58.138835 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-67a74de2-a045-45b6-b0a2-e2510f2b1a0e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:58.285466 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-67a74de2-a045-45b6-b0a2-e2510f2b1a0e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:58.293581 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-67a74de2-a045-45b6-b0a2-e2510f2b1a0e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.168204 Jul 31 01:59:58.294200 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3244/6458] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:58 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 01:59:59.315000 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d38046cc-bdf5-4edf-bd0f-b0938e9356ae tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 01:59:59.315646 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d38046cc-bdf5-4edf-bd0f-b0938e9356ae tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 01:59:59.322646 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d38046cc-bdf5-4edf-bd0f-b0938e9356ae tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:59.323102 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d38046cc-bdf5-4edf-bd0f-b0938e9356ae tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:59.323897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d38046cc-bdf5-4edf-bd0f-b0938e9356ae tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 01:59:59.324343 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d38046cc-bdf5-4edf-bd0f-b0938e9356ae tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 01:59:59.454569 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d38046cc-bdf5-4edf-bd0f-b0938e9356ae tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 01:59:59.462682 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d38046cc-bdf5-4edf-bd0f-b0938e9356ae tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.151048 Jul 31 01:59:59.463244 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3215/6459] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 01:59:59 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:00.483595 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-adbb4282-95dd-4b9e-95de-e1fc1dd21437 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:00.484224 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-adbb4282-95dd-4b9e-95de-e1fc1dd21437 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:00.491597 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-adbb4282-95dd-4b9e-95de-e1fc1dd21437 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:00.492062 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-adbb4282-95dd-4b9e-95de-e1fc1dd21437 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:00.492843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-adbb4282-95dd-4b9e-95de-e1fc1dd21437 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:00.493793 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-adbb4282-95dd-4b9e-95de-e1fc1dd21437 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:00.622910 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-adbb4282-95dd-4b9e-95de-e1fc1dd21437 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:00.630507 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-adbb4282-95dd-4b9e-95de-e1fc1dd21437 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.150885 Jul 31 02:00:00.631083 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3245/6460] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:00 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:01.652353 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3108a63d-8775-4ae0-8f70-30b287d9d14a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:01.653021 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3108a63d-8775-4ae0-8f70-30b287d9d14a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:01.660008 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3108a63d-8775-4ae0-8f70-30b287d9d14a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:01.660473 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3108a63d-8775-4ae0-8f70-30b287d9d14a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:01.661253 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3108a63d-8775-4ae0-8f70-30b287d9d14a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:01.661819 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3108a63d-8775-4ae0-8f70-30b287d9d14a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:01.795741 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3108a63d-8775-4ae0-8f70-30b287d9d14a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:01.803380 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3108a63d-8775-4ae0-8f70-30b287d9d14a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.154946 Jul 31 02:00:01.803953 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3216/6461] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:01 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:02.825750 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-450b356e-242d-4299-8004-351e204f5384 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:02.826299 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-450b356e-242d-4299-8004-351e204f5384 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:02.833193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-450b356e-242d-4299-8004-351e204f5384 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:02.833655 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-450b356e-242d-4299-8004-351e204f5384 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:02.834433 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-450b356e-242d-4299-8004-351e204f5384 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:02.834879 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-450b356e-242d-4299-8004-351e204f5384 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:02.962343 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-450b356e-242d-4299-8004-351e204f5384 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:02.969871 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-450b356e-242d-4299-8004-351e204f5384 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.148761 Jul 31 02:00:02.970460 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3246/6462] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:02 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:03.991463 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bec7b72e-6ce1-43f8-ab7c-3a90c03bdca2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:03.992087 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bec7b72e-6ce1-43f8-ab7c-3a90c03bdca2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:03.998982 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bec7b72e-6ce1-43f8-ab7c-3a90c03bdca2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:03.999471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bec7b72e-6ce1-43f8-ab7c-3a90c03bdca2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:04.000238 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bec7b72e-6ce1-43f8-ab7c-3a90c03bdca2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:04.000685 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bec7b72e-6ce1-43f8-ab7c-3a90c03bdca2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:04.130952 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bec7b72e-6ce1-43f8-ab7c-3a90c03bdca2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:04.138885 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bec7b72e-6ce1-43f8-ab7c-3a90c03bdca2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.151563 Jul 31 02:00:04.139481 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3217/6463] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:03 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:05.161198 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d70cb337-ffdb-48ad-9cf7-05ccee944ad9 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:05.161826 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d70cb337-ffdb-48ad-9cf7-05ccee944ad9 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:05.169357 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d70cb337-ffdb-48ad-9cf7-05ccee944ad9 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:05.169813 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d70cb337-ffdb-48ad-9cf7-05ccee944ad9 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:05.170583 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d70cb337-ffdb-48ad-9cf7-05ccee944ad9 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:05.171025 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d70cb337-ffdb-48ad-9cf7-05ccee944ad9 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:05.297295 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d70cb337-ffdb-48ad-9cf7-05ccee944ad9 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:05.304769 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d70cb337-ffdb-48ad-9cf7-05ccee944ad9 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.147602 Jul 31 02:00:05.305362 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3247/6464] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:05 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:06.326179 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fc7aab2f-cf7b-458d-b474-721d614071b1 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:06.326813 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fc7aab2f-cf7b-458d-b474-721d614071b1 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:06.333408 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc7aab2f-cf7b-458d-b474-721d614071b1 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:06.333876 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc7aab2f-cf7b-458d-b474-721d614071b1 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:06.334656 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc7aab2f-cf7b-458d-b474-721d614071b1 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:06.335113 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc7aab2f-cf7b-458d-b474-721d614071b1 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:06.463527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fc7aab2f-cf7b-458d-b474-721d614071b1 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:06.466946 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:00:06.471739 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fc7aab2f-cf7b-458d-b474-721d614071b1 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.149593 Jul 31 02:00:06.472315 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3218/6465] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:06 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:07.494951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0e0892cd-6800-4baf-8e68-64d42fa698ed tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:07.495531 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0e0892cd-6800-4baf-8e68-64d42fa698ed tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:07.502461 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e0892cd-6800-4baf-8e68-64d42fa698ed tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:07.502929 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e0892cd-6800-4baf-8e68-64d42fa698ed tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:07.503742 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e0892cd-6800-4baf-8e68-64d42fa698ed tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:07.504192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e0892cd-6800-4baf-8e68-64d42fa698ed tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:07.637113 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0e0892cd-6800-4baf-8e68-64d42fa698ed tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:07.644851 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0e0892cd-6800-4baf-8e68-64d42fa698ed tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.154490 Jul 31 02:00:07.645438 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3248/6466] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:07 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:08.667603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bdc67fec-2122-4f52-afb8-db26b4a710de tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:08.668223 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bdc67fec-2122-4f52-afb8-db26b4a710de tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:08.676705 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bdc67fec-2122-4f52-afb8-db26b4a710de tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:08.677168 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bdc67fec-2122-4f52-afb8-db26b4a710de tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:08.677937 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bdc67fec-2122-4f52-afb8-db26b4a710de tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:08.678383 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bdc67fec-2122-4f52-afb8-db26b4a710de tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:08.810807 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bdc67fec-2122-4f52-afb8-db26b4a710de tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:08.818455 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bdc67fec-2122-4f52-afb8-db26b4a710de tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.155531 Jul 31 02:00:08.818950 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3219/6467] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:08 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:09.840287 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-194e1d2a-da07-4a70-9dd9-9686617d3b12 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:09.840887 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-194e1d2a-da07-4a70-9dd9-9686617d3b12 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:09.847826 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-194e1d2a-da07-4a70-9dd9-9686617d3b12 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:09.848285 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-194e1d2a-da07-4a70-9dd9-9686617d3b12 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:09.849058 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-194e1d2a-da07-4a70-9dd9-9686617d3b12 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:09.849502 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-194e1d2a-da07-4a70-9dd9-9686617d3b12 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:09.980937 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-194e1d2a-da07-4a70-9dd9-9686617d3b12 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:09.988439 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-194e1d2a-da07-4a70-9dd9-9686617d3b12 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.152122 Jul 31 02:00:09.989279 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3249/6468] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:09 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:11.010255 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4f2b53b9-39b6-4f72-bcd2-4c623ad9cdb3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:11.010786 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4f2b53b9-39b6-4f72-bcd2-4c623ad9cdb3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:11.017741 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4f2b53b9-39b6-4f72-bcd2-4c623ad9cdb3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:11.018200 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4f2b53b9-39b6-4f72-bcd2-4c623ad9cdb3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:11.018967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4f2b53b9-39b6-4f72-bcd2-4c623ad9cdb3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:11.019434 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4f2b53b9-39b6-4f72-bcd2-4c623ad9cdb3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:11.145774 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4f2b53b9-39b6-4f72-bcd2-4c623ad9cdb3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:11.153598 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4f2b53b9-39b6-4f72-bcd2-4c623ad9cdb3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.147305 Jul 31 02:00:11.154167 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3220/6469] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:11 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:12.175047 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c1dfead0-a8d0-4c61-affa-a038e31cc827 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:12.175703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c1dfead0-a8d0-4c61-affa-a038e31cc827 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:12.183351 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1dfead0-a8d0-4c61-affa-a038e31cc827 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:12.183821 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1dfead0-a8d0-4c61-affa-a038e31cc827 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:12.184596 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1dfead0-a8d0-4c61-affa-a038e31cc827 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:12.185044 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1dfead0-a8d0-4c61-affa-a038e31cc827 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:12.322491 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c1dfead0-a8d0-4c61-affa-a038e31cc827 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:12.330066 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c1dfead0-a8d0-4c61-affa-a038e31cc827 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.158902 Jul 31 02:00:12.330662 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3250/6470] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:12 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:13.350213 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-10699249-c445-4384-b123-43cb10a0c302 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:13.350851 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-10699249-c445-4384-b123-43cb10a0c302 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:13.357785 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10699249-c445-4384-b123-43cb10a0c302 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:13.358273 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10699249-c445-4384-b123-43cb10a0c302 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:13.359046 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10699249-c445-4384-b123-43cb10a0c302 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:13.359533 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10699249-c445-4384-b123-43cb10a0c302 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:13.486377 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-10699249-c445-4384-b123-43cb10a0c302 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:13.494698 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-10699249-c445-4384-b123-43cb10a0c302 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.147878 Jul 31 02:00:13.495273 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3221/6471] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:13 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:14.516281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-daeba6ed-82c8-42fa-acd4-3b32d69480f9 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:14.516905 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-daeba6ed-82c8-42fa-acd4-3b32d69480f9 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:14.523820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daeba6ed-82c8-42fa-acd4-3b32d69480f9 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:14.524275 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daeba6ed-82c8-42fa-acd4-3b32d69480f9 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:14.525046 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daeba6ed-82c8-42fa-acd4-3b32d69480f9 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:14.526059 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daeba6ed-82c8-42fa-acd4-3b32d69480f9 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:14.656284 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-daeba6ed-82c8-42fa-acd4-3b32d69480f9 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:14.663803 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-daeba6ed-82c8-42fa-acd4-3b32d69480f9 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.151377 Jul 31 02:00:14.664378 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3251/6472] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:14 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:15.685001 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-60df02ca-ca21-4c30-bdeb-cc9211890d88 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:15.685635 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-60df02ca-ca21-4c30-bdeb-cc9211890d88 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:15.692619 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60df02ca-ca21-4c30-bdeb-cc9211890d88 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:15.693087 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60df02ca-ca21-4c30-bdeb-cc9211890d88 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:15.693865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60df02ca-ca21-4c30-bdeb-cc9211890d88 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:15.694315 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-60df02ca-ca21-4c30-bdeb-cc9211890d88 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:15.830546 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-60df02ca-ca21-4c30-bdeb-cc9211890d88 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:15.838076 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-60df02ca-ca21-4c30-bdeb-cc9211890d88 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.157001 Jul 31 02:00:15.838641 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3222/6473] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:15 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:16.858639 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5da035db-f6e7-496f-8bf6-91195ddfecfb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:16.859242 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5da035db-f6e7-496f-8bf6-91195ddfecfb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:16.866427 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5da035db-f6e7-496f-8bf6-91195ddfecfb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:16.866884 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5da035db-f6e7-496f-8bf6-91195ddfecfb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:16.867683 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5da035db-f6e7-496f-8bf6-91195ddfecfb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:16.868126 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5da035db-f6e7-496f-8bf6-91195ddfecfb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:16.999268 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5da035db-f6e7-496f-8bf6-91195ddfecfb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:17.006823 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5da035db-f6e7-496f-8bf6-91195ddfecfb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.152158 Jul 31 02:00:17.007422 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3252/6474] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:16 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:18.029133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b954c465-20e2-4f72-9cdc-27cc82b75938 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:18.029769 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b954c465-20e2-4f72-9cdc-27cc82b75938 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:18.036744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b954c465-20e2-4f72-9cdc-27cc82b75938 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:18.037216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b954c465-20e2-4f72-9cdc-27cc82b75938 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:18.038008 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b954c465-20e2-4f72-9cdc-27cc82b75938 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:18.038466 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b954c465-20e2-4f72-9cdc-27cc82b75938 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:18.170626 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b954c465-20e2-4f72-9cdc-27cc82b75938 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:18.178060 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b954c465-20e2-4f72-9cdc-27cc82b75938 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.153682 Jul 31 02:00:18.178621 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3223/6475] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:18 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:00:19.200129 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7c040ab-5f95-4155-9e51-2919234c7e37 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:19.200759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a7c040ab-5f95-4155-9e51-2919234c7e37 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:19.203472 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=32 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:00:19.208963 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7c040ab-5f95-4155-9e51-2919234c7e37 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:19.209420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7c040ab-5f95-4155-9e51-2919234c7e37 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:19.210191 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7c040ab-5f95-4155-9e51-2919234c7e37 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:19.210636 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7c040ab-5f95-4155-9e51-2919234c7e37 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:19.213350 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:00:19.340425 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a7c040ab-5f95-4155-9e51-2919234c7e37 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:19.347935 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a7c040ab-5f95-4155-9e51-2919234c7e37 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.151700 Jul 31 02:00:19.348513 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3253/6476] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:19 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:20.369903 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6a7b6675-bc65-4b12-ac87-08f9b81ab81c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:20.370563 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6a7b6675-bc65-4b12-ac87-08f9b81ab81c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:20.373945 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=34 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:00:20.379286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a7b6675-bc65-4b12-ac87-08f9b81ab81c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:20.379775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a7b6675-bc65-4b12-ac87-08f9b81ab81c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:20.380561 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a7b6675-bc65-4b12-ac87-08f9b81ab81c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:20.381014 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6a7b6675-bc65-4b12-ac87-08f9b81ab81c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:20.507505 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6a7b6675-bc65-4b12-ac87-08f9b81ab81c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:20.514929 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6a7b6675-bc65-4b12-ac87-08f9b81ab81c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.148898 Jul 31 02:00:20.515516 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3224/6477] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:20 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:21.536189 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-055d56cd-e4e3-452c-afcf-4240ae37406f tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:21.536735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-055d56cd-e4e3-452c-afcf-4240ae37406f tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:21.544241 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-055d56cd-e4e3-452c-afcf-4240ae37406f tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:21.544703 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-055d56cd-e4e3-452c-afcf-4240ae37406f tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:21.545514 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-055d56cd-e4e3-452c-afcf-4240ae37406f tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:21.545962 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-055d56cd-e4e3-452c-afcf-4240ae37406f tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:21.680425 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-055d56cd-e4e3-452c-afcf-4240ae37406f tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:21.688030 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-055d56cd-e4e3-452c-afcf-4240ae37406f tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.155838 Jul 31 02:00:21.688614 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3254/6478] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:21 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:22.709012 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-74d64df0-9a62-4d6d-b727-ed1d4a20c9bf tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:22.709731 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-74d64df0-9a62-4d6d-b727-ed1d4a20c9bf tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:22.716872 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74d64df0-9a62-4d6d-b727-ed1d4a20c9bf tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:22.717335 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74d64df0-9a62-4d6d-b727-ed1d4a20c9bf tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:22.718110 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74d64df0-9a62-4d6d-b727-ed1d4a20c9bf tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:22.718552 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74d64df0-9a62-4d6d-b727-ed1d4a20c9bf tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:22.861438 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-74d64df0-9a62-4d6d-b727-ed1d4a20c9bf tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:22.869505 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-74d64df0-9a62-4d6d-b727-ed1d4a20c9bf tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1521 microversion: 2.1 time: 0.164331 Jul 31 02:00:22.870090 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3225/6479] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:22 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:23.283233 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-d6df2b79-f036-437e-a8c9-c5dc24d667de req-4a4673e9-4d87-431d-bded-8ee6ca101867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbfa422-e433-42fe-b5a7-b7629221d105", "name": "network-vif-unplugged", "status": "completed", "tag": "fe55fcf3-53ad-4497-a578-b5c13573cf01"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:00:23.293224 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d6df2b79-f036-437e-a8c9-c5dc24d667de req-4a4673e9-4d87-431d-bded-8ee6ca101867 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:23.293680 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d6df2b79-f036-437e-a8c9-c5dc24d667de req-4a4673e9-4d87-431d-bded-8ee6ca101867 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:23.306185 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-d6df2b79-f036-437e-a8c9-c5dc24d667de req-4a4673e9-4d87-431d-bded-8ee6ca101867 service nova] Creating event network-vif-unplugged:fe55fcf3-53ad-4497-a578-b5c13573cf01 for instance fdbfa422-e433-42fe-b5a7-b7629221d105 on n-h2-master-1 Jul 31 02:00:23.311874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-d6df2b79-f036-437e-a8c9-c5dc24d667de req-4a4673e9-4d87-431d-bded-8ee6ca101867 service nova] Instance fdbfa422-e433-42fe-b5a7-b7629221d105 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:00:23.325419 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-d6df2b79-f036-437e-a8c9-c5dc24d667de req-4a4673e9-4d87-431d-bded-8ee6ca101867 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119268 Jul 31 02:00:23.326213 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3255/6480] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:00:23.891911 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6d38719f-7250-47f1-be69-1a7b0296f0ef tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:23.892578 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6d38719f-7250-47f1-be69-1a7b0296f0ef tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:23.899885 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d38719f-7250-47f1-be69-1a7b0296f0ef tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:23.900356 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d38719f-7250-47f1-be69-1a7b0296f0ef tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:23.901159 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d38719f-7250-47f1-be69-1a7b0296f0ef tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:23.901616 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6d38719f-7250-47f1-be69-1a7b0296f0ef tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:24.035785 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6d38719f-7250-47f1-be69-1a7b0296f0ef tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:24.043909 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6d38719f-7250-47f1-be69-1a7b0296f0ef tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1520 microversion: 2.1 time: 0.155344 Jul 31 02:00:24.044481 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3226/6481] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:23 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:25.065510 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-83a6e386-7923-4323-803e-3884745504e7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:25.066217 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-83a6e386-7923-4323-803e-3884745504e7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:25.073418 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83a6e386-7923-4323-803e-3884745504e7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:25.073880 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83a6e386-7923-4323-803e-3884745504e7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:25.075159 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83a6e386-7923-4323-803e-3884745504e7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:25.075638 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83a6e386-7923-4323-803e-3884745504e7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:25.206697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-83a6e386-7923-4323-803e-3884745504e7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:25.215398 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-83a6e386-7923-4323-803e-3884745504e7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1518 microversion: 2.1 time: 0.154143 Jul 31 02:00:25.215978 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3256/6482] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:25 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:25.342297 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7546af25-f076-4e32-92cb-39d4ed4b7132 req-1fe0cfd2-dc0d-4d07-b63f-6c509a213635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdbfa422-e433-42fe-b5a7-b7629221d105", "tag": "fe55fcf3-53ad-4497-a578-b5c13573cf01"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:00:25.352557 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7546af25-f076-4e32-92cb-39d4ed4b7132 req-1fe0cfd2-dc0d-4d07-b63f-6c509a213635 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:25.353021 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7546af25-f076-4e32-92cb-39d4ed4b7132 req-1fe0cfd2-dc0d-4d07-b63f-6c509a213635 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:25.364516 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7546af25-f076-4e32-92cb-39d4ed4b7132 req-1fe0cfd2-dc0d-4d07-b63f-6c509a213635 service nova] Creating event network-changed:fe55fcf3-53ad-4497-a578-b5c13573cf01 for instance fdbfa422-e433-42fe-b5a7-b7629221d105 on n-h2-master-1 Jul 31 02:00:25.369726 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-7546af25-f076-4e32-92cb-39d4ed4b7132 req-1fe0cfd2-dc0d-4d07-b63f-6c509a213635 service nova] Instance fdbfa422-e433-42fe-b5a7-b7629221d105 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:00:25.380853 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7546af25-f076-4e32-92cb-39d4ed4b7132 req-1fe0cfd2-dc0d-4d07-b63f-6c509a213635 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042601 Jul 31 02:00:25.381429 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3227/6483] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:00:26.236923 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7bef4333-ce14-4958-a4d1-e552fe2e1098 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:26.237546 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7bef4333-ce14-4958-a4d1-e552fe2e1098 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:26.244717 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7bef4333-ce14-4958-a4d1-e552fe2e1098 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:26.245177 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7bef4333-ce14-4958-a4d1-e552fe2e1098 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:26.245950 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7bef4333-ce14-4958-a4d1-e552fe2e1098 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:26.246399 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7bef4333-ce14-4958-a4d1-e552fe2e1098 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:26.670948 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7bef4333-ce14-4958-a4d1-e552fe2e1098 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:26.678607 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7bef4333-ce14-4958-a4d1-e552fe2e1098 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1515 microversion: 2.1 time: 0.445531 Jul 31 02:00:26.679283 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3257/6484] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:26 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1515 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:26.701416 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-373e2f6e-91c4-4f1d-905a-f930f37162ff tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:00:26.702053 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-373e2f6e-91c4-4f1d-905a-f930f37162ff tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:26.708616 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-373e2f6e-91c4-4f1d-905a-f930f37162ff tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:26.709084 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-373e2f6e-91c4-4f1d-905a-f930f37162ff tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:26.709864 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-373e2f6e-91c4-4f1d-905a-f930f37162ff tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:26.710317 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-373e2f6e-91c4-4f1d-905a-f930f37162ff tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:26.768907 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-373e2f6e-91c4-4f1d-905a-f930f37162ff tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "POST /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105/action" status: 204 len: 0 microversion: 2.1 time: 0.072979 Jul 31 02:00:26.769555 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3228/6485] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:00:26 2022] POST /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:00:26.777553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-09258b9f-93a9-4f7d-96b8-5503223d96ff tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:26.778269 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-09258b9f-93a9-4f7d-96b8-5503223d96ff tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:26.784519 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09258b9f-93a9-4f7d-96b8-5503223d96ff tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:26.785021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09258b9f-93a9-4f7d-96b8-5503223d96ff tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:26.785995 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09258b9f-93a9-4f7d-96b8-5503223d96ff tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:26.786494 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-09258b9f-93a9-4f7d-96b8-5503223d96ff tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:27.002037 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-09258b9f-93a9-4f7d-96b8-5503223d96ff tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:27.009724 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-09258b9f-93a9-4f7d-96b8-5503223d96ff tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1515 microversion: 2.1 time: 0.235933 Jul 31 02:00:27.010308 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3258/6486] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:26 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:00:28.033998 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-48d88bfc-ca53-4999-a273-9b62f22ccd81 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:28.034730 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-48d88bfc-ca53-4999-a273-9b62f22ccd81 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:28.041544 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48d88bfc-ca53-4999-a273-9b62f22ccd81 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:28.041998 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48d88bfc-ca53-4999-a273-9b62f22ccd81 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:28.042957 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48d88bfc-ca53-4999-a273-9b62f22ccd81 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:28.043589 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48d88bfc-ca53-4999-a273-9b62f22ccd81 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:28.148280 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-00d2e290-eb2e-41ce-b201-3aaaf4d6cec8 req-2b993b30-313c-4853-80a1-d9b27171838b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbfa422-e433-42fe-b5a7-b7629221d105", "name": "network-vif-plugged", "status": "completed", "tag": "fe55fcf3-53ad-4497-a578-b5c13573cf01"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:00:28.160318 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-00d2e290-eb2e-41ce-b201-3aaaf4d6cec8 req-2b993b30-313c-4853-80a1-d9b27171838b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:28.160796 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-00d2e290-eb2e-41ce-b201-3aaaf4d6cec8 req-2b993b30-313c-4853-80a1-d9b27171838b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:28.173542 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-00d2e290-eb2e-41ce-b201-3aaaf4d6cec8 req-2b993b30-313c-4853-80a1-d9b27171838b service nova] Creating event network-vif-plugged:fe55fcf3-53ad-4497-a578-b5c13573cf01 for instance fdbfa422-e433-42fe-b5a7-b7629221d105 on n-h2-master-1 Jul 31 02:00:28.179138 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-00d2e290-eb2e-41ce-b201-3aaaf4d6cec8 req-2b993b30-313c-4853-80a1-d9b27171838b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034496 Jul 31 02:00:28.179919 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3259/6487] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:00:28.186495 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-48d88bfc-ca53-4999-a273-9b62f22ccd81 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:28.194134 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-48d88bfc-ca53-4999-a273-9b62f22ccd81 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1507 microversion: 2.1 time: 0.166147 Jul 31 02:00:28.194913 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3229/6488] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:28 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:28.217744 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f7f0671f-1f35-4285-8e76-3679a03609dd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:28.218409 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f7f0671f-1f35-4285-8e76-3679a03609dd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:28.225701 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7f0671f-1f35-4285-8e76-3679a03609dd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:28.226198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7f0671f-1f35-4285-8e76-3679a03609dd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:28.226990 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7f0671f-1f35-4285-8e76-3679a03609dd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:28.227463 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7f0671f-1f35-4285-8e76-3679a03609dd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:28.370595 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f7f0671f-1f35-4285-8e76-3679a03609dd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:28.378223 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f7f0671f-1f35-4285-8e76-3679a03609dd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1507 microversion: 2.1 time: 0.166012 Jul 31 02:00:28.378808 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3260/6489] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:28 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:28.401868 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9ada363c-f710-46f6-bedb-8e69aae411a7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Action: 'create', calling method: .version_select at 0x7fede55abc10>, body: {"keypair": {"name": "tempest-keypair-1313290541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFn3JrOmz1X/0J/8LFZwde0+rg1hJbUTNG5pE5uaxuP+a1IuBBjhPvxv10UrO1coyCNqpaOX8tE62AUA92Iup8OK621KvXrwvMdtEdSHfTFb4Mz9H9uAE+F0/YpjAO+SSQ=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:00:28.417585 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9ada363c-f710-46f6-bedb-8e69aae411a7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Getting quotas for project 5cda29a34d894ed082400a2960f75cb7. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:00:28.423329 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-9ada363c-f710-46f6-bedb-8e69aae411a7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Getting quotas for user 3185f2944a7e483aa4cdc214aca21da6 and project 5cda29a34d894ed082400a2960f75cb7. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:00:28.436418 n-d-master-1 devstack@n-api.service[119474]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9ada363c-f710-46f6-bedb-8e69aae411a7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [d79002dc-f733-4f12-b7b6-e29705290878] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 31 02:00:29.443369 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [None req-9ada363c-f710-46f6-bedb-8e69aae411a7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [d79002dc-f733-4f12-b7b6-e29705290878] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 36324. Jul 31 02:00:29.460693 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9ada363c-f710-46f6-bedb-8e69aae411a7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.062596 Jul 31 02:00:29.461292 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3230/6490] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 02:00:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:00:30.634472 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c0d5b2d3-d6b0-4ddf-8c1b-8a985f5f2bf0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:30.635101 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c0d5b2d3-d6b0-4ddf-8c1b-8a985f5f2bf0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:30.642041 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0d5b2d3-d6b0-4ddf-8c1b-8a985f5f2bf0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:30.642501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0d5b2d3-d6b0-4ddf-8c1b-8a985f5f2bf0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:30.643299 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0d5b2d3-d6b0-4ddf-8c1b-8a985f5f2bf0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:30.643766 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c0d5b2d3-d6b0-4ddf-8c1b-8a985f5f2bf0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:30.772630 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c0d5b2d3-d6b0-4ddf-8c1b-8a985f5f2bf0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:30.780575 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c0d5b2d3-d6b0-4ddf-8c1b-8a985f5f2bf0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 200 len: 1507 microversion: 2.1 time: 0.150007 Jul 31 02:00:30.781149 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3261/6491] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:30 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:30.801506 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-75cd27e0-96dd-4227-872c-9994ff509826 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:30.802081 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-75cd27e0-96dd-4227-872c-9994ff509826 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:30.808222 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75cd27e0-96dd-4227-872c-9994ff509826 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:30.808770 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75cd27e0-96dd-4227-872c-9994ff509826 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:30.809551 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75cd27e0-96dd-4227-872c-9994ff509826 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:30.810009 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75cd27e0-96dd-4227-872c-9994ff509826 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:30.834680 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-75cd27e0-96dd-4227-872c-9994ff509826 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:00:30.910024 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-75cd27e0-96dd-4227-872c-9994ff509826 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 204 len: 0 microversion: 2.1 time: 0.112770 Jul 31 02:00:30.910024 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3231/6492] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:00:30 2022] DELETE /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:00:30.971902 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b784e63e-6548-41cc-a1a4-1deccb815017 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1833443331", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "7cb2b369-6ec1-4a8a-9d2f-088650f790e4"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:00:31.026648 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-b784e63e-6548-41cc-a1a4-1deccb815017 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] validate_networks() for [('7cb2b369-6ec1-4a8a-9d2f-088650f790e4', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:00:31.405652 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b784e63e-6548-41cc-a1a4-1deccb815017 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:00:31.406090 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b784e63e-6548-41cc-a1a4-1deccb815017 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:00:31.406579 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b784e63e-6548-41cc-a1a4-1deccb815017 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:00:31.407001 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b784e63e-6548-41cc-a1a4-1deccb815017 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:00:31.407450 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-b784e63e-6548-41cc-a1a4-1deccb815017 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:00:31.416391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b784e63e-6548-41cc-a1a4-1deccb815017 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:31.416856 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b784e63e-6548-41cc-a1a4-1deccb815017 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:31.417666 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b784e63e-6548-41cc-a1a4-1deccb815017 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:31.418114 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b784e63e-6548-41cc-a1a4-1deccb815017 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:31.435171 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-b784e63e-6548-41cc-a1a4-1deccb815017 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Getting quotas for project 5cda29a34d894ed082400a2960f75cb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:00:31.440454 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-b784e63e-6548-41cc-a1a4-1deccb815017 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Getting quotas for user 3185f2944a7e483aa4cdc214aca21da6 and project 5cda29a34d894ed082400a2960f75cb7. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:00:31.457500 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b784e63e-6548-41cc-a1a4-1deccb815017 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:00:31.459789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b784e63e-6548-41cc-a1a4-1deccb815017 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:00:31.503894 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b784e63e-6548-41cc-a1a4-1deccb815017 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536545 Jul 31 02:00:31.504556 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3262/6493] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:00:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:00:31.516508 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d187e873-2c6c-48ca-b1d0-ab8799fdec03 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:31.517677 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d187e873-2c6c-48ca-b1d0-ab8799fdec03 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:31.580071 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d187e873-2c6c-48ca-b1d0-ab8799fdec03 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:31.586949 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d187e873-2c6c-48ca-b1d0-ab8799fdec03 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1218 microversion: 2.1 time: 0.075152 Jul 31 02:00:31.587839 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3232/6494] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:31 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:00:32.610015 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3ea51fa3-74e9-425f-af84-7614d2456a19 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:32.610662 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3ea51fa3-74e9-425f-af84-7614d2456a19 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:32.620109 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ea51fa3-74e9-425f-af84-7614d2456a19 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:32.620566 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ea51fa3-74e9-425f-af84-7614d2456a19 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:32.621935 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ea51fa3-74e9-425f-af84-7614d2456a19 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:32.622380 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3ea51fa3-74e9-425f-af84-7614d2456a19 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:32.693882 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3ea51fa3-74e9-425f-af84-7614d2456a19 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:32.702967 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3ea51fa3-74e9-425f-af84-7614d2456a19 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1270 microversion: 2.1 time: 0.098150 Jul 31 02:00:32.703579 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3263/6495] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:32 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:33.082413 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-29942897-624c-412d-994e-a691fafd9fb3 req-c2eb1f3f-91e2-43ce-bfa9-6435fcb4bd42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbfa422-e433-42fe-b5a7-b7629221d105", "name": "network-vif-deleted", "tag": "fe55fcf3-53ad-4497-a578-b5c13573cf01"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:00:33.104573 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-29942897-624c-412d-994e-a691fafd9fb3 req-c2eb1f3f-91e2-43ce-bfa9-6435fcb4bd42 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:33.105123 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-29942897-624c-412d-994e-a691fafd9fb3 req-c2eb1f3f-91e2-43ce-bfa9-6435fcb4bd42 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:33.117020 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-29942897-624c-412d-994e-a691fafd9fb3 req-c2eb1f3f-91e2-43ce-bfa9-6435fcb4bd42 service nova] Creating event network-vif-deleted:fe55fcf3-53ad-4497-a578-b5c13573cf01 for instance fdbfa422-e433-42fe-b5a7-b7629221d105 on n-h2-master-1 Jul 31 02:00:33.122345 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-29942897-624c-412d-994e-a691fafd9fb3 req-c2eb1f3f-91e2-43ce-bfa9-6435fcb4bd42 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048300 Jul 31 02:00:33.123330 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3233/6496] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:00:33.724349 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e970b225-3680-4548-9ce0-94c19d92eea8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:33.725185 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e970b225-3680-4548-9ce0-94c19d92eea8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:33.732394 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e970b225-3680-4548-9ce0-94c19d92eea8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:33.733551 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e970b225-3680-4548-9ce0-94c19d92eea8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:33.734443 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e970b225-3680-4548-9ce0-94c19d92eea8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:33.734978 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e970b225-3680-4548-9ce0-94c19d92eea8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:33.982829 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e970b225-3680-4548-9ce0-94c19d92eea8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:33.990487 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e970b225-3680-4548-9ce0-94c19d92eea8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1318 microversion: 2.1 time: 0.270065 Jul 31 02:00:33.991060 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3264/6497] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:33 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:34.283596 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-9a76eb46-6d69-46ab-b004-67cd61ef4b62 req-b6bfbc6b-8142-47ec-aa3e-3fd2a86ebdb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fdc36b-83b4-477b-934f-dfae927a9a85", "tag": "daa733e4-fc57-4de8-8f22-a0c161521208"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:00:34.294539 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9a76eb46-6d69-46ab-b004-67cd61ef4b62 req-b6bfbc6b-8142-47ec-aa3e-3fd2a86ebdb0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:34.295103 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-9a76eb46-6d69-46ab-b004-67cd61ef4b62 req-b6bfbc6b-8142-47ec-aa3e-3fd2a86ebdb0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:34.306454 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-9a76eb46-6d69-46ab-b004-67cd61ef4b62 req-b6bfbc6b-8142-47ec-aa3e-3fd2a86ebdb0 service nova] Creating event network-changed:daa733e4-fc57-4de8-8f22-a0c161521208 for instance b8fdc36b-83b4-477b-934f-dfae927a9a85 on n-h2-master-1 Jul 31 02:00:34.311555 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-9a76eb46-6d69-46ab-b004-67cd61ef4b62 req-b6bfbc6b-8142-47ec-aa3e-3fd2a86ebdb0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032816 Jul 31 02:00:34.312152 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3234/6498] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:00:35.012940 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8b631859-0d15-4232-aff3-d1b96b1663bb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:35.013561 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8b631859-0d15-4232-aff3-d1b96b1663bb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:35.020535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b631859-0d15-4232-aff3-d1b96b1663bb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:35.020997 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b631859-0d15-4232-aff3-d1b96b1663bb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:35.021772 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b631859-0d15-4232-aff3-d1b96b1663bb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:35.022218 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8b631859-0d15-4232-aff3-d1b96b1663bb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:35.151723 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8b631859-0d15-4232-aff3-d1b96b1663bb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:35.159078 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8b631859-0d15-4232-aff3-d1b96b1663bb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1318 microversion: 2.1 time: 0.150417 Jul 31 02:00:35.159702 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3265/6499] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:35 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:36.181904 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-064fb8eb-08ce-4dbd-bfb6-34044063cf4f tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:36.182653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-064fb8eb-08ce-4dbd-bfb6-34044063cf4f tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:36.188981 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-064fb8eb-08ce-4dbd-bfb6-34044063cf4f tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:36.189450 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-064fb8eb-08ce-4dbd-bfb6-34044063cf4f tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:36.190233 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-064fb8eb-08ce-4dbd-bfb6-34044063cf4f tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:36.190690 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-064fb8eb-08ce-4dbd-bfb6-34044063cf4f tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:36.330537 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-064fb8eb-08ce-4dbd-bfb6-34044063cf4f tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:36.338231 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-064fb8eb-08ce-4dbd-bfb6-34044063cf4f tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1318 microversion: 2.1 time: 0.161506 Jul 31 02:00:36.338824 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3235/6500] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:36 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:37.359886 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f39a3e8a-0f20-42d5-804f-16ccc7f490f8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:37.360515 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f39a3e8a-0f20-42d5-804f-16ccc7f490f8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:37.368178 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f39a3e8a-0f20-42d5-804f-16ccc7f490f8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:37.368642 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f39a3e8a-0f20-42d5-804f-16ccc7f490f8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:37.369413 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f39a3e8a-0f20-42d5-804f-16ccc7f490f8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:37.369862 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f39a3e8a-0f20-42d5-804f-16ccc7f490f8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:37.497742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f39a3e8a-0f20-42d5-804f-16ccc7f490f8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:37.507039 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f39a3e8a-0f20-42d5-804f-16ccc7f490f8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1318 microversion: 2.1 time: 0.150732 Jul 31 02:00:37.508197 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3266/6501] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:37 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:38.231864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-0e0b2137-47de-4cbb-8891-c0580db21d9a req-97abe01b-48db-41cc-bc09-8a67b6c694de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fdc36b-83b4-477b-934f-dfae927a9a85", "name": "network-vif-plugged", "status": "completed", "tag": "daa733e4-fc57-4de8-8f22-a0c161521208"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:00:38.244037 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0e0b2137-47de-4cbb-8891-c0580db21d9a req-97abe01b-48db-41cc-bc09-8a67b6c694de service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:38.244711 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0e0b2137-47de-4cbb-8891-c0580db21d9a req-97abe01b-48db-41cc-bc09-8a67b6c694de service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:38.256564 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-0e0b2137-47de-4cbb-8891-c0580db21d9a req-97abe01b-48db-41cc-bc09-8a67b6c694de service nova] Creating event network-vif-plugged:daa733e4-fc57-4de8-8f22-a0c161521208 for instance b8fdc36b-83b4-477b-934f-dfae927a9a85 on n-h2-master-1 Jul 31 02:00:38.261289 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-0e0b2137-47de-4cbb-8891-c0580db21d9a req-97abe01b-48db-41cc-bc09-8a67b6c694de service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033689 Jul 31 02:00:38.262426 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3236/6502] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:00:38.529688 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2d0d73f5-d765-4ce9-801b-b36e2b6b401b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:38.530374 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2d0d73f5-d765-4ce9-801b-b36e2b6b401b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:38.537227 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d0d73f5-d765-4ce9-801b-b36e2b6b401b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:38.537686 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d0d73f5-d765-4ce9-801b-b36e2b6b401b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:38.538459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d0d73f5-d765-4ce9-801b-b36e2b6b401b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:38.538906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2d0d73f5-d765-4ce9-801b-b36e2b6b401b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:38.666703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2d0d73f5-d765-4ce9-801b-b36e2b6b401b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:38.674332 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2d0d73f5-d765-4ce9-801b-b36e2b6b401b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1318 microversion: 2.1 time: 0.149045 Jul 31 02:00:38.675096 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3267/6503] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:38 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:39.697922 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-772fbe5e-d939-4b70-ba36-a22206d1798d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:39.698658 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-772fbe5e-d939-4b70-ba36-a22206d1798d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:39.706144 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-772fbe5e-d939-4b70-ba36-a22206d1798d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:39.706620 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-772fbe5e-d939-4b70-ba36-a22206d1798d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:39.707438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-772fbe5e-d939-4b70-ba36-a22206d1798d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:39.707897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-772fbe5e-d939-4b70-ba36-a22206d1798d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:39.711938 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:00:39.840039 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-772fbe5e-d939-4b70-ba36-a22206d1798d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:39.847591 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-772fbe5e-d939-4b70-ba36-a22206d1798d tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1509 microversion: 2.1 time: 0.155111 Jul 31 02:00:39.848151 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3237/6504] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:39 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:39.868929 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-abfc18aa-8f22-4dbf-83da-05a15f04c198 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:39.869700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-abfc18aa-8f22-4dbf-83da-05a15f04c198 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:39.877075 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abfc18aa-8f22-4dbf-83da-05a15f04c198 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:39.877535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abfc18aa-8f22-4dbf-83da-05a15f04c198 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:39.878296 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abfc18aa-8f22-4dbf-83da-05a15f04c198 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:39.878736 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-abfc18aa-8f22-4dbf-83da-05a15f04c198 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:40.008002 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-abfc18aa-8f22-4dbf-83da-05a15f04c198 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:40.015438 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-abfc18aa-8f22-4dbf-83da-05a15f04c198 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1509 microversion: 2.1 time: 0.150616 Jul 31 02:00:40.016013 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3268/6505] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:39 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:00:40.035587 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1fdb8c74-6e17-442b-a915-86904415efd8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:00:40.037894 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1fdb8c74-6e17-442b-a915-86904415efd8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:40.043963 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fdb8c74-6e17-442b-a915-86904415efd8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:40.044942 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fdb8c74-6e17-442b-a915-86904415efd8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:40.045723 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fdb8c74-6e17-442b-a915-86904415efd8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:40.046173 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1fdb8c74-6e17-442b-a915-86904415efd8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:40.073736 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1fdb8c74-6e17-442b-a915-86904415efd8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:40.079601 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1fdb8c74-6e17-442b-a915-86904415efd8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Old instance type m1.heat2, new instance type m1.heat {{(pid=119474) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 31 02:00:40.085897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-1fdb8c74-6e17-442b-a915-86904415efd8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:00:40.086330 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-1fdb8c74-6e17-442b-a915-86904415efd8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:00:40.086812 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-1fdb8c74-6e17-442b-a915-86904415efd8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:00:40.087230 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-1fdb8c74-6e17-442b-a915-86904415efd8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:00:40.087724 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-1fdb8c74-6e17-442b-a915-86904415efd8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:00:40.148677 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1fdb8c74-6e17-442b-a915-86904415efd8 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "POST /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85/action" status: 202 len: 0 microversion: 2.1 time: 0.117112 Jul 31 02:00:40.149477 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3238/6506] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:00:40 2022] POST /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:00:40.158169 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6765aaa1-f55a-481e-a3a3-e08d6a746beb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:40.158802 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6765aaa1-f55a-481e-a3a3-e08d6a746beb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:40.165554 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6765aaa1-f55a-481e-a3a3-e08d6a746beb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:40.166008 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6765aaa1-f55a-481e-a3a3-e08d6a746beb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:40.166870 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6765aaa1-f55a-481e-a3a3-e08d6a746beb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:40.167318 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6765aaa1-f55a-481e-a3a3-e08d6a746beb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:40.325980 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6765aaa1-f55a-481e-a3a3-e08d6a746beb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:40.336718 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6765aaa1-f55a-481e-a3a3-e08d6a746beb tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1516 microversion: 2.1 time: 0.182922 Jul 31 02:00:40.337321 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3269/6507] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:40 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:41.358493 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-187ed41f-dfdf-4574-b54e-54a7fa9aaeb7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:41.359123 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-187ed41f-dfdf-4574-b54e-54a7fa9aaeb7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:41.366375 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-187ed41f-dfdf-4574-b54e-54a7fa9aaeb7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:41.366845 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-187ed41f-dfdf-4574-b54e-54a7fa9aaeb7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:41.367666 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-187ed41f-dfdf-4574-b54e-54a7fa9aaeb7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:41.368115 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-187ed41f-dfdf-4574-b54e-54a7fa9aaeb7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:41.499494 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-187ed41f-dfdf-4574-b54e-54a7fa9aaeb7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:41.507078 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-187ed41f-dfdf-4574-b54e-54a7fa9aaeb7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1516 microversion: 2.1 time: 0.152940 Jul 31 02:00:41.507686 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3239/6508] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:41 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:42.528294 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d7e7f2b2-b783-4fe5-846e-0535fb57b2e7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:42.529475 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d7e7f2b2-b783-4fe5-846e-0535fb57b2e7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:42.532320 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:00:42.533023 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:00:42.538889 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7e7f2b2-b783-4fe5-846e-0535fb57b2e7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:42.539398 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7e7f2b2-b783-4fe5-846e-0535fb57b2e7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:42.540205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7e7f2b2-b783-4fe5-846e-0535fb57b2e7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:42.540655 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d7e7f2b2-b783-4fe5-846e-0535fb57b2e7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:42.674251 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d7e7f2b2-b783-4fe5-846e-0535fb57b2e7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:42.681767 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d7e7f2b2-b783-4fe5-846e-0535fb57b2e7 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.157424 Jul 31 02:00:42.682340 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3270/6509] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:42 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:43.703431 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e60f4774-a83c-4fad-8abe-7b0c9aa61fee tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:43.704083 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e60f4774-a83c-4fad-8abe-7b0c9aa61fee tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:43.705924 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:00:43.712040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e60f4774-a83c-4fad-8abe-7b0c9aa61fee tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:43.712500 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e60f4774-a83c-4fad-8abe-7b0c9aa61fee tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:43.713266 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e60f4774-a83c-4fad-8abe-7b0c9aa61fee tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:43.713714 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e60f4774-a83c-4fad-8abe-7b0c9aa61fee tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:43.850107 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e60f4774-a83c-4fad-8abe-7b0c9aa61fee tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:43.858198 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e60f4774-a83c-4fad-8abe-7b0c9aa61fee tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.158715 Jul 31 02:00:43.858780 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3240/6510] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:43 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:44.879731 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-864e45b6-1ddb-4c1f-9b61-0d7e206ec0e0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:44.880306 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-864e45b6-1ddb-4c1f-9b61-0d7e206ec0e0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:44.887073 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-864e45b6-1ddb-4c1f-9b61-0d7e206ec0e0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:44.887572 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-864e45b6-1ddb-4c1f-9b61-0d7e206ec0e0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:44.888962 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-864e45b6-1ddb-4c1f-9b61-0d7e206ec0e0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:44.889399 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-864e45b6-1ddb-4c1f-9b61-0d7e206ec0e0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:44.903809 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:00:45.023676 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-864e45b6-1ddb-4c1f-9b61-0d7e206ec0e0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:45.031266 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-864e45b6-1ddb-4c1f-9b61-0d7e206ec0e0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.155501 Jul 31 02:00:45.031881 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3271/6511] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:44 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:46.052968 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1cb16de7-d8c2-491d-9bf1-9d38b46582f4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:46.053854 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1cb16de7-d8c2-491d-9bf1-9d38b46582f4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:46.061690 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cb16de7-d8c2-491d-9bf1-9d38b46582f4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:46.062161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cb16de7-d8c2-491d-9bf1-9d38b46582f4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:46.062950 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cb16de7-d8c2-491d-9bf1-9d38b46582f4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:46.063430 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cb16de7-d8c2-491d-9bf1-9d38b46582f4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:46.207894 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1cb16de7-d8c2-491d-9bf1-9d38b46582f4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:46.215897 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1cb16de7-d8c2-491d-9bf1-9d38b46582f4 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.166760 Jul 31 02:00:46.219384 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3241/6512] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:46 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:47.237729 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3a34af23-aeab-4311-942d-42e37090b817 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:47.238345 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3a34af23-aeab-4311-942d-42e37090b817 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:47.245742 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3a34af23-aeab-4311-942d-42e37090b817 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:47.246194 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3a34af23-aeab-4311-942d-42e37090b817 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:47.246952 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3a34af23-aeab-4311-942d-42e37090b817 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:47.247416 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3a34af23-aeab-4311-942d-42e37090b817 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:47.375372 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3a34af23-aeab-4311-942d-42e37090b817 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:47.382800 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3a34af23-aeab-4311-942d-42e37090b817 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.148985 Jul 31 02:00:47.383394 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3272/6513] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:47 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:48.405293 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-39cc7311-118d-4643-bde4-0e12345e2748 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:48.405930 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-39cc7311-118d-4643-bde4-0e12345e2748 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:48.412506 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39cc7311-118d-4643-bde4-0e12345e2748 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:48.412978 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39cc7311-118d-4643-bde4-0e12345e2748 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:48.413763 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39cc7311-118d-4643-bde4-0e12345e2748 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:48.414222 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39cc7311-118d-4643-bde4-0e12345e2748 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:48.544942 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-39cc7311-118d-4643-bde4-0e12345e2748 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:48.552345 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-39cc7311-118d-4643-bde4-0e12345e2748 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.151620 Jul 31 02:00:48.552908 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3242/6514] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:48 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:49.573350 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b84f0a9f-b06a-436e-855d-18a2026961ab tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:49.574073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b84f0a9f-b06a-436e-855d-18a2026961ab tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:49.576825 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:00:49.582502 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b84f0a9f-b06a-436e-855d-18a2026961ab tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:49.582977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b84f0a9f-b06a-436e-855d-18a2026961ab tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:49.583820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b84f0a9f-b06a-436e-855d-18a2026961ab tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:49.584276 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b84f0a9f-b06a-436e-855d-18a2026961ab tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:49.807134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b84f0a9f-b06a-436e-855d-18a2026961ab tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:49.815260 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b84f0a9f-b06a-436e-855d-18a2026961ab tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.245811 Jul 31 02:00:49.815881 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3273/6515] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:49 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:50.836516 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6ccf2130-0400-4cad-acf1-7192679a5388 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:50.837143 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6ccf2130-0400-4cad-acf1-7192679a5388 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:50.839878 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:00:50.845589 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6ccf2130-0400-4cad-acf1-7192679a5388 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:50.846051 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6ccf2130-0400-4cad-acf1-7192679a5388 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:50.846834 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6ccf2130-0400-4cad-acf1-7192679a5388 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:50.847283 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6ccf2130-0400-4cad-acf1-7192679a5388 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:50.976758 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6ccf2130-0400-4cad-acf1-7192679a5388 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:50.984702 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6ccf2130-0400-4cad-acf1-7192679a5388 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.152132 Jul 31 02:00:50.985263 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3243/6516] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:50 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:00:52.007098 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6a8fe0ec-4a22-430e-9330-9192dea80def tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:52.007684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6a8fe0ec-4a22-430e-9330-9192dea80def tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:52.013922 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a8fe0ec-4a22-430e-9330-9192dea80def tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:52.014385 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a8fe0ec-4a22-430e-9330-9192dea80def tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:52.015156 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a8fe0ec-4a22-430e-9330-9192dea80def tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:52.015636 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a8fe0ec-4a22-430e-9330-9192dea80def tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:52.144759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6a8fe0ec-4a22-430e-9330-9192dea80def tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:52.152192 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6a8fe0ec-4a22-430e-9330-9192dea80def tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.149282 Jul 31 02:00:52.152767 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3274/6517] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:52 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:00:53.174259 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-795f4a0a-2823-4621-a61a-21ed89997b82 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:53.174893 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-795f4a0a-2823-4621-a61a-21ed89997b82 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:53.182392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-795f4a0a-2823-4621-a61a-21ed89997b82 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:53.182522 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-795f4a0a-2823-4621-a61a-21ed89997b82 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:53.183323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-795f4a0a-2823-4621-a61a-21ed89997b82 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:53.183795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-795f4a0a-2823-4621-a61a-21ed89997b82 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:53.311086 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-795f4a0a-2823-4621-a61a-21ed89997b82 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:53.318557 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-795f4a0a-2823-4621-a61a-21ed89997b82 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.148365 Jul 31 02:00:53.319123 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3244/6518] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:53 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:54.339849 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4d6ec7ef-9000-4b04-9c21-0207114f0b68 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:54.340492 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4d6ec7ef-9000-4b04-9c21-0207114f0b68 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:54.348032 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d6ec7ef-9000-4b04-9c21-0207114f0b68 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:54.348492 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d6ec7ef-9000-4b04-9c21-0207114f0b68 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:54.349264 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d6ec7ef-9000-4b04-9c21-0207114f0b68 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:54.349712 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d6ec7ef-9000-4b04-9c21-0207114f0b68 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:54.484259 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4d6ec7ef-9000-4b04-9c21-0207114f0b68 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:54.492018 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4d6ec7ef-9000-4b04-9c21-0207114f0b68 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.156146 Jul 31 02:00:54.492624 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3275/6519] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:54 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:00:55.513500 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-794e23a6-185b-47ef-9be6-18035b556523 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:55.514075 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-794e23a6-185b-47ef-9be6-18035b556523 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:55.521164 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-794e23a6-185b-47ef-9be6-18035b556523 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:55.521634 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-794e23a6-185b-47ef-9be6-18035b556523 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:55.522416 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-794e23a6-185b-47ef-9be6-18035b556523 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:55.522869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-794e23a6-185b-47ef-9be6-18035b556523 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:55.649667 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-794e23a6-185b-47ef-9be6-18035b556523 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:55.657219 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-794e23a6-185b-47ef-9be6-18035b556523 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.147739 Jul 31 02:00:55.657785 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3245/6520] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:55 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:56.678018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ef537bb1-6917-4a62-9fcc-5124cdaf67e3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:56.678640 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ef537bb1-6917-4a62-9fcc-5124cdaf67e3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:56.685617 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef537bb1-6917-4a62-9fcc-5124cdaf67e3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:56.686076 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef537bb1-6917-4a62-9fcc-5124cdaf67e3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:56.686846 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef537bb1-6917-4a62-9fcc-5124cdaf67e3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:56.687288 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ef537bb1-6917-4a62-9fcc-5124cdaf67e3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:56.820579 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ef537bb1-6917-4a62-9fcc-5124cdaf67e3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:56.828076 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ef537bb1-6917-4a62-9fcc-5124cdaf67e3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.153914 Jul 31 02:00:56.828656 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3276/6521] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:56 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:57.849980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-86560445-a441-4eac-b1ae-44103039fa1b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:57.851003 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-86560445-a441-4eac-b1ae-44103039fa1b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:57.858097 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86560445-a441-4eac-b1ae-44103039fa1b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:57.858569 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86560445-a441-4eac-b1ae-44103039fa1b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:57.859360 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86560445-a441-4eac-b1ae-44103039fa1b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:57.859815 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86560445-a441-4eac-b1ae-44103039fa1b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:57.989624 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-86560445-a441-4eac-b1ae-44103039fa1b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:57.997142 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-86560445-a441-4eac-b1ae-44103039fa1b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.151153 Jul 31 02:00:57.997714 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3246/6522] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:57 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:59.018891 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dafc7811-381b-4b4a-b742-12d36db99953 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:00:59.019473 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dafc7811-381b-4b4a-b742-12d36db99953 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:00:59.026434 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dafc7811-381b-4b4a-b742-12d36db99953 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:59.026884 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dafc7811-381b-4b4a-b742-12d36db99953 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:59.027676 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dafc7811-381b-4b4a-b742-12d36db99953 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:00:59.028118 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dafc7811-381b-4b4a-b742-12d36db99953 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:00:59.159693 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dafc7811-381b-4b4a-b742-12d36db99953 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:00:59.167151 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dafc7811-381b-4b4a-b742-12d36db99953 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.152445 Jul 31 02:00:59.167827 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3277/6523] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:00:59 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:00:59.375469 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:00:59.375703 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 02:00:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:01:00.188572 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-94321398-883c-425f-bbb6-9172c7192f7c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:00.189192 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-94321398-883c-425f-bbb6-9172c7192f7c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:00.196180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-94321398-883c-425f-bbb6-9172c7192f7c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:00.196650 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-94321398-883c-425f-bbb6-9172c7192f7c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:00.197432 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-94321398-883c-425f-bbb6-9172c7192f7c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:00.197888 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-94321398-883c-425f-bbb6-9172c7192f7c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:00.328910 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-94321398-883c-425f-bbb6-9172c7192f7c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:00.336385 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-94321398-883c-425f-bbb6-9172c7192f7c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.151768 Jul 31 02:01:00.336957 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3247/6524] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:00 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:01.358684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-96b58f4e-a56f-445f-bc83-1d1e9de64311 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:01.359302 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-96b58f4e-a56f-445f-bc83-1d1e9de64311 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:01.366480 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96b58f4e-a56f-445f-bc83-1d1e9de64311 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:01.366930 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96b58f4e-a56f-445f-bc83-1d1e9de64311 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:01.367728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96b58f4e-a56f-445f-bc83-1d1e9de64311 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:01.368166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96b58f4e-a56f-445f-bc83-1d1e9de64311 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:01.496029 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-96b58f4e-a56f-445f-bc83-1d1e9de64311 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:01.503542 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-96b58f4e-a56f-445f-bc83-1d1e9de64311 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.149373 Jul 31 02:01:01.504114 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3278/6525] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:01 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:02.524493 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f4a4e234-2013-4646-8be3-b2228f5682c6 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:02.525049 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f4a4e234-2013-4646-8be3-b2228f5682c6 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:02.531952 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4a4e234-2013-4646-8be3-b2228f5682c6 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:02.532413 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4a4e234-2013-4646-8be3-b2228f5682c6 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:02.533177 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4a4e234-2013-4646-8be3-b2228f5682c6 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:02.533622 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4a4e234-2013-4646-8be3-b2228f5682c6 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:02.665218 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f4a4e234-2013-4646-8be3-b2228f5682c6 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:02.673338 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f4a4e234-2013-4646-8be3-b2228f5682c6 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.152834 Jul 31 02:01:02.673894 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3248/6526] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:02 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:01:03.694204 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-681faa16-c267-458f-9670-0a031f77d912 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:03.694833 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-681faa16-c267-458f-9670-0a031f77d912 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:03.702389 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-681faa16-c267-458f-9670-0a031f77d912 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:03.702854 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-681faa16-c267-458f-9670-0a031f77d912 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:03.703673 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-681faa16-c267-458f-9670-0a031f77d912 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:03.704120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-681faa16-c267-458f-9670-0a031f77d912 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:03.832379 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-681faa16-c267-458f-9670-0a031f77d912 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:03.839968 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-681faa16-c267-458f-9670-0a031f77d912 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.149793 Jul 31 02:01:03.841681 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3279/6527] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:03 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:04.862662 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f8f8e7bd-f183-4678-bf36-016360edc27b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:04.863241 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f8f8e7bd-f183-4678-bf36-016360edc27b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:04.870276 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8f8e7bd-f183-4678-bf36-016360edc27b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:04.870743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8f8e7bd-f183-4678-bf36-016360edc27b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:04.871550 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8f8e7bd-f183-4678-bf36-016360edc27b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:04.872009 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f8f8e7bd-f183-4678-bf36-016360edc27b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:04.998678 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f8f8e7bd-f183-4678-bf36-016360edc27b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:05.006133 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f8f8e7bd-f183-4678-bf36-016360edc27b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.147453 Jul 31 02:01:05.006704 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3249/6528] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:04 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:06.027648 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-86ef468e-4a55-4ba8-a6b0-56bfb5c05c1b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:06.028850 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-86ef468e-4a55-4ba8-a6b0-56bfb5c05c1b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:06.035879 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-86ef468e-4a55-4ba8-a6b0-56bfb5c05c1b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:06.036340 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-86ef468e-4a55-4ba8-a6b0-56bfb5c05c1b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:06.037113 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-86ef468e-4a55-4ba8-a6b0-56bfb5c05c1b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:06.037561 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-86ef468e-4a55-4ba8-a6b0-56bfb5c05c1b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:06.168618 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-86ef468e-4a55-4ba8-a6b0-56bfb5c05c1b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:06.176145 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-86ef468e-4a55-4ba8-a6b0-56bfb5c05c1b tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.152542 Jul 31 02:01:06.176725 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3280/6529] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:06 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:07.197217 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1b109bc0-47ca-41c0-ac0e-4b83fd3198aa tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:07.197853 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1b109bc0-47ca-41c0-ac0e-4b83fd3198aa tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:07.205028 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b109bc0-47ca-41c0-ac0e-4b83fd3198aa tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:07.205499 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b109bc0-47ca-41c0-ac0e-4b83fd3198aa tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:07.206289 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b109bc0-47ca-41c0-ac0e-4b83fd3198aa tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:07.206745 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1b109bc0-47ca-41c0-ac0e-4b83fd3198aa tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:07.334720 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1b109bc0-47ca-41c0-ac0e-4b83fd3198aa tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:07.342706 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1b109bc0-47ca-41c0-ac0e-4b83fd3198aa tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.149369 Jul 31 02:01:07.343320 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3250/6530] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:07 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:08.365929 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-039999d1-5719-4093-a098-f88980c1aab0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:08.367082 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-039999d1-5719-4093-a098-f88980c1aab0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:08.375688 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-039999d1-5719-4093-a098-f88980c1aab0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:08.376157 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-039999d1-5719-4093-a098-f88980c1aab0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:08.376947 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-039999d1-5719-4093-a098-f88980c1aab0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:08.377395 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-039999d1-5719-4093-a098-f88980c1aab0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:08.512017 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-039999d1-5719-4093-a098-f88980c1aab0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:08.519473 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-039999d1-5719-4093-a098-f88980c1aab0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1521 microversion: 2.1 time: 0.158475 Jul 31 02:01:08.520042 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3281/6531] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:08 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:09.446613 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-ddc52014-16df-4450-9084-0e1b2a8630a2 req-064c59d3-a896-4d14-b29b-a6bcd4218683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fdc36b-83b4-477b-934f-dfae927a9a85", "name": "network-vif-unplugged", "status": "completed", "tag": "daa733e4-fc57-4de8-8f22-a0c161521208"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:01:09.464276 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-ddc52014-16df-4450-9084-0e1b2a8630a2 req-064c59d3-a896-4d14-b29b-a6bcd4218683 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:09.464732 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-ddc52014-16df-4450-9084-0e1b2a8630a2 req-064c59d3-a896-4d14-b29b-a6bcd4218683 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:09.477150 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-ddc52014-16df-4450-9084-0e1b2a8630a2 req-064c59d3-a896-4d14-b29b-a6bcd4218683 service nova] Creating event network-vif-unplugged:daa733e4-fc57-4de8-8f22-a0c161521208 for instance b8fdc36b-83b4-477b-934f-dfae927a9a85 on n-h1-master-1 Jul 31 02:01:09.482494 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-ddc52014-16df-4450-9084-0e1b2a8630a2 req-064c59d3-a896-4d14-b29b-a6bcd4218683 service nova] Instance b8fdc36b-83b4-477b-934f-dfae927a9a85 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:01:09.494745 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-ddc52014-16df-4450-9084-0e1b2a8630a2 req-064c59d3-a896-4d14-b29b-a6bcd4218683 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051410 Jul 31 02:01:09.495360 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3251/6532] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:01:09.540987 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8d12ccdf-45c6-478e-8b1d-9e5866017bbd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:09.541624 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8d12ccdf-45c6-478e-8b1d-9e5866017bbd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:09.550939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d12ccdf-45c6-478e-8b1d-9e5866017bbd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:09.551669 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d12ccdf-45c6-478e-8b1d-9e5866017bbd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:09.552639 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d12ccdf-45c6-478e-8b1d-9e5866017bbd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:09.553272 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8d12ccdf-45c6-478e-8b1d-9e5866017bbd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:09.806484 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8d12ccdf-45c6-478e-8b1d-9e5866017bbd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:09.814903 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8d12ccdf-45c6-478e-8b1d-9e5866017bbd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1520 microversion: 2.1 time: 0.277969 Jul 31 02:01:09.815546 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3282/6533] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:09 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:01:10.837429 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-24ce006b-9623-4c31-8a2b-572a77f6bcdd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:10.838099 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-24ce006b-9623-4c31-8a2b-572a77f6bcdd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:10.845861 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-24ce006b-9623-4c31-8a2b-572a77f6bcdd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:10.846337 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-24ce006b-9623-4c31-8a2b-572a77f6bcdd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:10.847118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-24ce006b-9623-4c31-8a2b-572a77f6bcdd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:10.847672 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-24ce006b-9623-4c31-8a2b-572a77f6bcdd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:10.851664 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:01:10.987115 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-24ce006b-9623-4c31-8a2b-572a77f6bcdd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:10.994892 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-24ce006b-9623-4c31-8a2b-572a77f6bcdd tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1518 microversion: 2.1 time: 0.161888 Jul 31 02:01:10.995498 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3252/6534] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:10 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:11.509997 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-3b0019c3-f61b-437e-9757-c47760796ddb req-2988d192-2c5b-41b0-9bf1-ee10836dd1ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fdc36b-83b4-477b-934f-dfae927a9a85", "tag": "daa733e4-fc57-4de8-8f22-a0c161521208"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:01:11.520945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3b0019c3-f61b-437e-9757-c47760796ddb req-2988d192-2c5b-41b0-9bf1-ee10836dd1ce service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:11.521397 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-3b0019c3-f61b-437e-9757-c47760796ddb req-2988d192-2c5b-41b0-9bf1-ee10836dd1ce service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:11.533398 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-3b0019c3-f61b-437e-9757-c47760796ddb req-2988d192-2c5b-41b0-9bf1-ee10836dd1ce service nova] Creating event network-changed:daa733e4-fc57-4de8-8f22-a0c161521208 for instance b8fdc36b-83b4-477b-934f-dfae927a9a85 on n-h1-master-1 Jul 31 02:01:11.538644 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-3b0019c3-f61b-437e-9757-c47760796ddb req-2988d192-2c5b-41b0-9bf1-ee10836dd1ce service nova] Instance b8fdc36b-83b4-477b-934f-dfae927a9a85 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:01:11.549404 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-3b0019c3-f61b-437e-9757-c47760796ddb req-2988d192-2c5b-41b0-9bf1-ee10836dd1ce service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043111 Jul 31 02:01:11.550001 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3283/6535] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:01:12.017202 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4a614bc7-4c39-44fe-9b5b-71dd43e07b2a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:12.017759 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4a614bc7-4c39-44fe-9b5b-71dd43e07b2a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:12.024598 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a614bc7-4c39-44fe-9b5b-71dd43e07b2a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:12.025065 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a614bc7-4c39-44fe-9b5b-71dd43e07b2a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:12.025845 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a614bc7-4c39-44fe-9b5b-71dd43e07b2a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:12.026297 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4a614bc7-4c39-44fe-9b5b-71dd43e07b2a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:12.329408 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4a614bc7-4c39-44fe-9b5b-71dd43e07b2a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:12.336955 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4a614bc7-4c39-44fe-9b5b-71dd43e07b2a tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1515 microversion: 2.1 time: 0.323779 Jul 31 02:01:12.337528 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3253/6536] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:12 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1515 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:12.359109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5d15adfb-54ea-4399-862c-f414c2778f9c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:01:12.359848 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5d15adfb-54ea-4399-862c-f414c2778f9c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:12.366408 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d15adfb-54ea-4399-862c-f414c2778f9c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:12.366874 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d15adfb-54ea-4399-862c-f414c2778f9c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:12.367884 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d15adfb-54ea-4399-862c-f414c2778f9c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:12.368333 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d15adfb-54ea-4399-862c-f414c2778f9c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:12.429184 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5d15adfb-54ea-4399-862c-f414c2778f9c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "POST /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85/action" status: 204 len: 0 microversion: 2.1 time: 0.074756 Jul 31 02:01:12.430038 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3284/6537] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:01:12 2022] POST /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:01:12.438127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dcaeffca-15a1-4701-bd44-a75c505549f0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:12.438855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dcaeffca-15a1-4701-bd44-a75c505549f0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:12.445130 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dcaeffca-15a1-4701-bd44-a75c505549f0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:12.445729 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dcaeffca-15a1-4701-bd44-a75c505549f0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:12.446497 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dcaeffca-15a1-4701-bd44-a75c505549f0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:12.446925 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dcaeffca-15a1-4701-bd44-a75c505549f0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:13.000142 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dcaeffca-15a1-4701-bd44-a75c505549f0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:13.007603 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dcaeffca-15a1-4701-bd44-a75c505549f0 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1515 microversion: 2.1 time: 0.573467 Jul 31 02:01:13.008177 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3254/6538] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:12 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1515 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:13.838023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-690c6137-50b3-4648-85e9-b5eac67025a6 req-7153188e-9998-4df6-8e5d-be8de1952bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fdc36b-83b4-477b-934f-dfae927a9a85", "name": "network-vif-plugged", "status": "completed", "tag": "daa733e4-fc57-4de8-8f22-a0c161521208"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:01:13.852870 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-690c6137-50b3-4648-85e9-b5eac67025a6 req-7153188e-9998-4df6-8e5d-be8de1952bd2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:13.853415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-690c6137-50b3-4648-85e9-b5eac67025a6 req-7153188e-9998-4df6-8e5d-be8de1952bd2 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:13.866982 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-690c6137-50b3-4648-85e9-b5eac67025a6 req-7153188e-9998-4df6-8e5d-be8de1952bd2 service nova] Creating event network-vif-plugged:daa733e4-fc57-4de8-8f22-a0c161521208 for instance b8fdc36b-83b4-477b-934f-dfae927a9a85 on n-h1-master-1 Jul 31 02:01:13.874805 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-690c6137-50b3-4648-85e9-b5eac67025a6 req-7153188e-9998-4df6-8e5d-be8de1952bd2 service nova] Instance b8fdc36b-83b4-477b-934f-dfae927a9a85 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:01:13.888556 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-690c6137-50b3-4648-85e9-b5eac67025a6 req-7153188e-9998-4df6-8e5d-be8de1952bd2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053960 Jul 31 02:01:13.889180 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3285/6539] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:01:14.029950 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-82502a1e-94ac-466c-8d9d-9815d07e020e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:14.030583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-82502a1e-94ac-466c-8d9d-9815d07e020e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:14.037616 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-82502a1e-94ac-466c-8d9d-9815d07e020e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:14.038086 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-82502a1e-94ac-466c-8d9d-9815d07e020e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:14.038868 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-82502a1e-94ac-466c-8d9d-9815d07e020e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:14.039330 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-82502a1e-94ac-466c-8d9d-9815d07e020e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:14.181308 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-82502a1e-94ac-466c-8d9d-9815d07e020e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:14.189579 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-82502a1e-94ac-466c-8d9d-9815d07e020e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1507 microversion: 2.1 time: 0.163474 Jul 31 02:01:14.190157 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3255/6540] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:14 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:14.211298 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4dd96053-9e50-4fd1-be8b-e1146740356e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:14.212180 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4dd96053-9e50-4fd1-be8b-e1146740356e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:14.219178 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4dd96053-9e50-4fd1-be8b-e1146740356e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:14.219677 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4dd96053-9e50-4fd1-be8b-e1146740356e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:14.220459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4dd96053-9e50-4fd1-be8b-e1146740356e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:14.220909 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4dd96053-9e50-4fd1-be8b-e1146740356e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:14.350600 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4dd96053-9e50-4fd1-be8b-e1146740356e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:14.359129 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4dd96053-9e50-4fd1-be8b-e1146740356e tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1507 microversion: 2.1 time: 0.152366 Jul 31 02:01:14.359746 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3286/6541] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:14 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:14.380490 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f09346c7-d1a9-42e8-9eac-8fcec171bfc3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:14.381109 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f09346c7-d1a9-42e8-9eac-8fcec171bfc3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:14.387142 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f09346c7-d1a9-42e8-9eac-8fcec171bfc3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:14.387645 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f09346c7-d1a9-42e8-9eac-8fcec171bfc3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:14.388410 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f09346c7-d1a9-42e8-9eac-8fcec171bfc3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:14.388859 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f09346c7-d1a9-42e8-9eac-8fcec171bfc3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:14.516837 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f09346c7-d1a9-42e8-9eac-8fcec171bfc3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:14.529610 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f09346c7-d1a9-42e8-9eac-8fcec171bfc3 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1507 microversion: 2.1 time: 0.152962 Jul 31 02:01:14.530217 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3256/6542] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:14 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:14.550297 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2b40f5ac-e281-48db-8132-2a8d5409b856 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:14.550806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2b40f5ac-e281-48db-8132-2a8d5409b856 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:14.556896 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b40f5ac-e281-48db-8132-2a8d5409b856 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:14.557356 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b40f5ac-e281-48db-8132-2a8d5409b856 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:14.558129 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b40f5ac-e281-48db-8132-2a8d5409b856 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:14.558578 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b40f5ac-e281-48db-8132-2a8d5409b856 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:14.577161 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:01:14.585260 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2b40f5ac-e281-48db-8132-2a8d5409b856 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:01:14.660023 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2b40f5ac-e281-48db-8132-2a8d5409b856 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 204 len: 0 microversion: 2.1 time: 0.113258 Jul 31 02:01:14.660627 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3287/6543] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:01:14 2022] DELETE /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:01:14.677077 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8031a018-ee98-4641-ba84-31316cff6d85 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:14.677681 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8031a018-ee98-4641-ba84-31316cff6d85 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:14.683806 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8031a018-ee98-4641-ba84-31316cff6d85 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:14.684307 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8031a018-ee98-4641-ba84-31316cff6d85 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:14.685108 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8031a018-ee98-4641-ba84-31316cff6d85 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:14.685561 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8031a018-ee98-4641-ba84-31316cff6d85 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:14.709841 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8031a018-ee98-4641-ba84-31316cff6d85 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:01:14.754812 n-d-master-1 devstack@n-api.service[119474]: INFO nova.compute.api [None req-8031a018-ee98-4641-ba84-31316cff6d85 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Instance is already in deleting state, ignoring this request Jul 31 02:01:14.759081 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8031a018-ee98-4641-ba84-31316cff6d85 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 204 len: 0 microversion: 2.1 time: 0.082278 Jul 31 02:01:14.759081 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3257/6544] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:01:14 2022] DELETE /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:01:14.766536 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dcb5c014-3ce6-4d75-b4aa-2e01f353181c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:14.767244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dcb5c014-3ce6-4d75-b4aa-2e01f353181c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:14.773973 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dcb5c014-3ce6-4d75-b4aa-2e01f353181c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:14.774440 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dcb5c014-3ce6-4d75-b4aa-2e01f353181c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:14.775205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dcb5c014-3ce6-4d75-b4aa-2e01f353181c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:14.775683 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dcb5c014-3ce6-4d75-b4aa-2e01f353181c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:14.907408 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dcb5c014-3ce6-4d75-b4aa-2e01f353181c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:14.914866 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dcb5c014-3ce6-4d75-b4aa-2e01f353181c tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1513 microversion: 2.1 time: 0.152540 Jul 31 02:01:14.915461 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3288/6545] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:14 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:15.937994 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9a6b1200-0867-42bf-805d-c75cc3bd0dd2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:15.938555 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9a6b1200-0867-42bf-805d-c75cc3bd0dd2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:15.945377 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a6b1200-0867-42bf-805d-c75cc3bd0dd2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:15.945835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a6b1200-0867-42bf-805d-c75cc3bd0dd2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:15.946781 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a6b1200-0867-42bf-805d-c75cc3bd0dd2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:15.947226 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a6b1200-0867-42bf-805d-c75cc3bd0dd2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:16.080142 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9a6b1200-0867-42bf-805d-c75cc3bd0dd2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3185f2944a7e483aa4cdc214aca21da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cda29a34d894ed082400a2960f75cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:16.087576 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9a6b1200-0867-42bf-805d-c75cc3bd0dd2 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 200 len: 1513 microversion: 2.1 time: 0.154875 Jul 31 02:01:16.088141 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3258/6546] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:15 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:16.560571 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-9e9e839a-a833-4f6e-9906-de2d00ec8dfc req-aa1c0c9b-2094-49d4-9621-95b4cb884708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fdc36b-83b4-477b-934f-dfae927a9a85", "name": "network-vif-deleted", "tag": "daa733e4-fc57-4de8-8f22-a0c161521208"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:01:16.570981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9e9e839a-a833-4f6e-9906-de2d00ec8dfc req-aa1c0c9b-2094-49d4-9621-95b4cb884708 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:16.571556 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9e9e839a-a833-4f6e-9906-de2d00ec8dfc req-aa1c0c9b-2094-49d4-9621-95b4cb884708 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:16.585472 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-9e9e839a-a833-4f6e-9906-de2d00ec8dfc req-aa1c0c9b-2094-49d4-9621-95b4cb884708 service nova] Creating event network-vif-deleted:daa733e4-fc57-4de8-8f22-a0c161521208 for instance b8fdc36b-83b4-477b-934f-dfae927a9a85 on n-h1-master-1 Jul 31 02:01:16.590149 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-9e9e839a-a833-4f6e-9906-de2d00ec8dfc req-aa1c0c9b-2094-49d4-9621-95b4cb884708 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033780 Jul 31 02:01:16.591105 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3289/6547] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:01:17.109603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e3d435fc-e441-4b49-9219-16622b88b772 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:17.110173 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e3d435fc-e441-4b49-9219-16622b88b772 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: b8fdc36b-83b4-477b-934f-dfae927a9a85] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:17.117244 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3d435fc-e441-4b49-9219-16622b88b772 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:17.117703 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3d435fc-e441-4b49-9219-16622b88b772 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:17.118472 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3d435fc-e441-4b49-9219-16622b88b772 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:17.118914 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e3d435fc-e441-4b49-9219-16622b88b772 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:17.131954 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-e3d435fc-e441-4b49-9219-16622b88b772 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] HTTP exception thrown: Instance b8fdc36b-83b4-477b-934f-dfae927a9a85 could not be found. Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e3d435fc-e441-4b49-9219-16622b88b772 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Request method failure captured: Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 HTTP/1.1 Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eIJrnLVQMxkZi-Na3TpKNExoPcX4C8HhB---Dvo-FLer_bsaRBW_YW0oTYRgqKHnGFJ6gN9z3Tt3B9sWRkP47-DBajCI-N34iU-rGtsHprTdd_XY-IWaDavhv-UwNyv93cJ-LcTVahIlSXKPWP8jq4nyIo2KVl23EwGwIQ_ZQirt5s Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 5cda29a34d894ed082400a2960f75cb7 Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1214775011 Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cda29a34d894ed082400a2960f75cb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cda29a34d894ed082400a2960f75cb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5cda29a34d894ed082400a2960f75cb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5cda29a34d894ed082400a2960f75cb7", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerDiskConfigTestJSON-1214775011 Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 5cda29a34d894ed082400a2960f75cb7 Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1214775011 Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerDiskConfigTestJSON-1214775011-project Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 3185f2944a7e483aa4cdc214aca21da6 Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerDiskConfigTestJSON-1214775011-project Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: exception: Instance b8fdc36b-83b4-477b-934f-dfae927a9a85 could not be found. Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'b8fdc36b-83b4-477b-934f-dfae927a9a85'} Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8fdc36b-83b4-477b-934f-dfae927a9a85 could not be found. Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8fdc36b-83b4-477b-934f-dfae927a9a85 could not be found. Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:01:17.133588 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:01:17.139141 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:01:17.139141 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:01:17.139141 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:01:17.139141 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:01:17.139141 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:01:17.139141 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8fdc36b-83b4-477b-934f-dfae927a9a85 could not be found. Jul 31 02:01:17.139141 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:01:17.139141 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e3d435fc-e441-4b49-9219-16622b88b772 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Returning 404 to user: Instance b8fdc36b-83b4-477b-934f-dfae927a9a85 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:01:17.139141 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e3d435fc-e441-4b49-9219-16622b88b772 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85" status: 404 len: 111 microversion: 2.1 time: 0.029913 Jul 31 02:01:17.139141 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3259/6548] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:17 2022] GET /compute/v2.1/servers/b8fdc36b-83b4-477b-934f-dfae927a9a85 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:01:17.144093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6658e875-5a2b-4f65-a660-8a5e2cf263ea tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '.version_select at 0x7fede57bf280>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:17.169342 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6658e875-5a2b-4f65-a660-8a5e2cf263ea tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1313290541" status: 202 len: 0 microversion: 2.1 time: 0.029386 Jul 31 02:01:17.169948 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3290/6549] 10.222.0.45 () {58 vars in 1221 bytes} [Sun Jul 31 02:01:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1313290541 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 02:01:17.760278 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-02faa1ad-c29c-43c6-9b0b-a96d689f2704 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:17.760799 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-02faa1ad-c29c-43c6-9b0b-a96d689f2704 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:17.767678 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02faa1ad-c29c-43c6-9b0b-a96d689f2704 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:17.768152 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02faa1ad-c29c-43c6-9b0b-a96d689f2704 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:17.769161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02faa1ad-c29c-43c6-9b0b-a96d689f2704 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:17.769652 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02faa1ad-c29c-43c6-9b0b-a96d689f2704 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:17.785348 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-02faa1ad-c29c-43c6-9b0b-a96d689f2704 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] HTTP exception thrown: Instance fdbfa422-e433-42fe-b5a7-b7629221d105 could not be found. Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-02faa1ad-c29c-43c6-9b0b-a96d689f2704 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Request method failure captured: Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 HTTP/1.1 Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eIJrnLVQMxkZi-Na3TpKNExoPcX4C8HhB---Dvo-FLer_bsaRBW_YW0oTYRgqKHnGFJ6gN9z3Tt3B9sWRkP47-DBajCI-N34iU-rGtsHprTdd_XY-IWaDavhv-UwNyv93cJ-LcTVahIlSXKPWP8jq4nyIo2KVl23EwGwIQ_ZQirt5s Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 5cda29a34d894ed082400a2960f75cb7 Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1214775011 Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cda29a34d894ed082400a2960f75cb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cda29a34d894ed082400a2960f75cb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5cda29a34d894ed082400a2960f75cb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5cda29a34d894ed082400a2960f75cb7", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerDiskConfigTestJSON-1214775011 Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 5cda29a34d894ed082400a2960f75cb7 Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1214775011 Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerDiskConfigTestJSON-1214775011-project Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 3185f2944a7e483aa4cdc214aca21da6 Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerDiskConfigTestJSON-1214775011-project Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: exception: Instance fdbfa422-e433-42fe-b5a7-b7629221d105 could not be found. Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'fdbfa422-e433-42fe-b5a7-b7629221d105'} Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdbfa422-e433-42fe-b5a7-b7629221d105 could not be found. Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:01:17.787177 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:01:17.792362 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdbfa422-e433-42fe-b5a7-b7629221d105 could not be found. Jul 31 02:01:17.792362 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:01:17.792362 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:01:17.792362 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:01:17.792362 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:01:17.792362 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:01:17.792362 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:01:17.792362 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:01:17.792362 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:01:17.792362 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdbfa422-e433-42fe-b5a7-b7629221d105 could not be found. Jul 31 02:01:17.792362 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:01:17.792362 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-02faa1ad-c29c-43c6-9b0b-a96d689f2704 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Returning 404 to user: Instance fdbfa422-e433-42fe-b5a7-b7629221d105 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:01:17.792362 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-02faa1ad-c29c-43c6-9b0b-a96d689f2704 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 404 len: 111 microversion: 2.1 time: 0.032336 Jul 31 02:01:17.793459 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3260/6550] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:01:17 2022] DELETE /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:01:17.799018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c1419c12-1de9-4ae8-a4d9-3d194ab383d5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:17.799813 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c1419c12-1de9-4ae8-a4d9-3d194ab383d5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] [instance: fdbfa422-e433-42fe-b5a7-b7629221d105] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:17.806636 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1419c12-1de9-4ae8-a4d9-3d194ab383d5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:17.807095 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1419c12-1de9-4ae8-a4d9-3d194ab383d5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:17.807902 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1419c12-1de9-4ae8-a4d9-3d194ab383d5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:17.808349 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c1419c12-1de9-4ae8-a4d9-3d194ab383d5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:17.821838 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-c1419c12-1de9-4ae8-a4d9-3d194ab383d5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] HTTP exception thrown: Instance fdbfa422-e433-42fe-b5a7-b7629221d105 could not be found. Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c1419c12-1de9-4ae8-a4d9-3d194ab383d5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Request method failure captured: Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 HTTP/1.1 Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eIJrnLVQMxkZi-Na3TpKNExoPcX4C8HhB---Dvo-FLer_bsaRBW_YW0oTYRgqKHnGFJ6gN9z3Tt3B9sWRkP47-DBajCI-N34iU-rGtsHprTdd_XY-IWaDavhv-UwNyv93cJ-LcTVahIlSXKPWP8jq4nyIo2KVl23EwGwIQ_ZQirt5s Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 5cda29a34d894ed082400a2960f75cb7 Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1214775011 Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cda29a34d894ed082400a2960f75cb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5cda29a34d894ed082400a2960f75cb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5cda29a34d894ed082400a2960f75cb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5cda29a34d894ed082400a2960f75cb7", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerDiskConfigTestJSON-1214775011 Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 5cda29a34d894ed082400a2960f75cb7 Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1214775011 Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerDiskConfigTestJSON-1214775011-project Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 3185f2944a7e483aa4cdc214aca21da6 Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerDiskConfigTestJSON-1214775011-project Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: exception: Instance fdbfa422-e433-42fe-b5a7-b7629221d105 could not be found. Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'fdbfa422-e433-42fe-b5a7-b7629221d105'} Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdbfa422-e433-42fe-b5a7-b7629221d105 could not be found. Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdbfa422-e433-42fe-b5a7-b7629221d105 could not be found. Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:01:17.823503 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:01:17.828799 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:01:17.828799 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:01:17.828799 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:01:17.828799 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:01:17.828799 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:01:17.828799 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdbfa422-e433-42fe-b5a7-b7629221d105 could not be found. Jul 31 02:01:17.828799 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:01:17.828799 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c1419c12-1de9-4ae8-a4d9-3d194ab383d5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] Returning 404 to user: Instance fdbfa422-e433-42fe-b5a7-b7629221d105 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:01:17.828799 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c1419c12-1de9-4ae8-a4d9-3d194ab383d5 tempest-ServerDiskConfigTestJSON-1214775011 tempest-ServerDiskConfigTestJSON-1214775011-project] 10.222.0.45 "GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105" status: 404 len: 111 microversion: 2.1 time: 0.030988 Jul 31 02:01:17.828799 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3291/6551] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:17 2022] GET /compute/v2.1/servers/fdbfa422-e433-42fe-b5a7-b7629221d105 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:01:26.173703 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7dee222c-e101-4a32-af40-9243eeb266b7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Action: 'create', calling method: .version_select at 0x7fedea959a60>, body: {"keypair": {"name": "tempest-keypair-596934869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOds/iUN/9e5YfiKii4hOE0smc4vQ9RGzBbmGJEamVYmgmVqpNPVxcKZNAnY8S76YIXwtgdtCSFOoFu2waR+Lpvvaxe/TLtffjcl07NWZASkhr8znwEVPs2LYcoHOQhT3g=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:01:26.179079 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=36 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:01:26.190768 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-7dee222c-e101-4a32-af40-9243eeb266b7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Getting quotas for project 6f8bba8850b446fcb8b4cb1aedb51876. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:01:26.195884 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-7dee222c-e101-4a32-af40-9243eeb266b7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Getting quotas for user 50f66e518b9143f485b4a9938cb8dd7c and project 6f8bba8850b446fcb8b4cb1aedb51876. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:01:26.220616 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7dee222c-e101-4a32-af40-9243eeb266b7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.177025 Jul 31 02:01:26.221203 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3261/6552] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 02:01:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:01:27.461756 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f976123a-8bac-4c56-b8ca-71f00b41410e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-497555175", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b566735-8db1-4f81-80aa-d07655229680"}], "security_groups": [{"name": "tempest-securitygroup--1769531531"}], "key_name": "tempest-keypair-596934869", "user_data": "}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:01:27.470409 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:01:27.572139 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-f976123a-8bac-4c56-b8ca-71f00b41410e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] validate_networks() for [('3b566735-8db1-4f81-80aa-d07655229680', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:01:27.813419 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:01:27.964680 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f976123a-8bac-4c56-b8ca-71f00b41410e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:01:27.965304 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f976123a-8bac-4c56-b8ca-71f00b41410e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:01:27.965789 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f976123a-8bac-4c56-b8ca-71f00b41410e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:01:27.966208 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f976123a-8bac-4c56-b8ca-71f00b41410e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:01:27.966626 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-f976123a-8bac-4c56-b8ca-71f00b41410e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:01:27.975896 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f976123a-8bac-4c56-b8ca-71f00b41410e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:27.976354 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f976123a-8bac-4c56-b8ca-71f00b41410e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:27.977157 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f976123a-8bac-4c56-b8ca-71f00b41410e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:27.977631 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f976123a-8bac-4c56-b8ca-71f00b41410e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:27.995835 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-f976123a-8bac-4c56-b8ca-71f00b41410e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Getting quotas for project 6f8bba8850b446fcb8b4cb1aedb51876. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:01:28.001801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-f976123a-8bac-4c56-b8ca-71f00b41410e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Getting quotas for user 50f66e518b9143f485b4a9938cb8dd7c and project 6f8bba8850b446fcb8b4cb1aedb51876. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:01:28.015529 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f976123a-8bac-4c56-b8ca-71f00b41410e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:01:28.017958 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f976123a-8bac-4c56-b8ca-71f00b41410e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:01:28.067331 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f976123a-8bac-4c56-b8ca-71f00b41410e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.609378 Jul 31 02:01:28.067548 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3292/6553] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:01:27 2022] POST /compute/v2.1/servers => generated 409 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:01:28.076275 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:01:28.080949 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9edec765-74ce-4df9-9463-031d74c3a96c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:28.081687 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9edec765-74ce-4df9-9463-031d74c3a96c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:28.153576 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9edec765-74ce-4df9-9463-031d74c3a96c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:28.162982 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9edec765-74ce-4df9-9463-031d74c3a96c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1237 microversion: 2.1 time: 0.088599 Jul 31 02:01:28.163700 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3262/6554] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:28 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:29.187035 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cc53647c-011c-4161-a9dc-d15e7f0b6977 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:29.187747 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cc53647c-011c-4161-a9dc-d15e7f0b6977 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:29.194953 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc53647c-011c-4161-a9dc-d15e7f0b6977 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:29.195755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc53647c-011c-4161-a9dc-d15e7f0b6977 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:29.196791 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc53647c-011c-4161-a9dc-d15e7f0b6977 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:29.197627 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cc53647c-011c-4161-a9dc-d15e7f0b6977 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:29.330588 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cc53647c-011c-4161-a9dc-d15e7f0b6977 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:29.346059 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cc53647c-011c-4161-a9dc-d15e7f0b6977 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1297 microversion: 2.1 time: 0.164233 Jul 31 02:01:29.353376 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3293/6555] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:29 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1297 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:30.368192 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1c66352f-3d2e-4671-8248-f1e0ba9f2f05 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:30.368743 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1c66352f-3d2e-4671-8248-f1e0ba9f2f05 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:30.376268 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c66352f-3d2e-4671-8248-f1e0ba9f2f05 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:30.377114 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c66352f-3d2e-4671-8248-f1e0ba9f2f05 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:30.377907 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c66352f-3d2e-4671-8248-f1e0ba9f2f05 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:30.378366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1c66352f-3d2e-4671-8248-f1e0ba9f2f05 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:30.616317 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1c66352f-3d2e-4671-8248-f1e0ba9f2f05 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:30.624273 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1c66352f-3d2e-4671-8248-f1e0ba9f2f05 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1363 microversion: 2.1 time: 0.260213 Jul 31 02:01:30.624792 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3263/6556] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:30 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:30.749311 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f7b2baa4-4f84-4846-96f4-d5d39195db98 req-d7b4c53d-835c-4945-8d7b-57b4b6f63d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "798f76a6-9f6c-4bc6-9f98-288b642a5583", "tag": "084bfe1f-99f6-4b03-8c54-c919e77f9525"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:01:30.763085 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f7b2baa4-4f84-4846-96f4-d5d39195db98 req-d7b4c53d-835c-4945-8d7b-57b4b6f63d35 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:30.763552 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f7b2baa4-4f84-4846-96f4-d5d39195db98 req-d7b4c53d-835c-4945-8d7b-57b4b6f63d35 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:30.776182 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f7b2baa4-4f84-4846-96f4-d5d39195db98 req-d7b4c53d-835c-4945-8d7b-57b4b6f63d35 service nova] Creating event network-changed:084bfe1f-99f6-4b03-8c54-c919e77f9525 for instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 on n-h1-master-1 Jul 31 02:01:30.781391 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f7b2baa4-4f84-4846-96f4-d5d39195db98 req-d7b4c53d-835c-4945-8d7b-57b4b6f63d35 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038180 Jul 31 02:01:30.782399 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3294/6557] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:01:31.645785 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-67c59c53-3798-493a-b955-a2c374f17333 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:31.646404 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-67c59c53-3798-493a-b955-a2c374f17333 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:31.653401 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-67c59c53-3798-493a-b955-a2c374f17333 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:31.653861 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-67c59c53-3798-493a-b955-a2c374f17333 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:31.654654 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-67c59c53-3798-493a-b955-a2c374f17333 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:31.655100 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-67c59c53-3798-493a-b955-a2c374f17333 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:31.785391 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-67c59c53-3798-493a-b955-a2c374f17333 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:31.793410 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-67c59c53-3798-493a-b955-a2c374f17333 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1363 microversion: 2.1 time: 0.150943 Jul 31 02:01:31.793980 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3264/6558] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:31 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:32.816393 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-29f701f5-65b8-42f9-a140-fc6b5713dff9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:32.817107 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-29f701f5-65b8-42f9-a140-fc6b5713dff9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:32.823418 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29f701f5-65b8-42f9-a140-fc6b5713dff9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:32.823885 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29f701f5-65b8-42f9-a140-fc6b5713dff9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:32.825352 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29f701f5-65b8-42f9-a140-fc6b5713dff9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:32.825806 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-29f701f5-65b8-42f9-a140-fc6b5713dff9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:32.961203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-29f701f5-65b8-42f9-a140-fc6b5713dff9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:32.968737 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-29f701f5-65b8-42f9-a140-fc6b5713dff9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1363 microversion: 2.1 time: 0.157541 Jul 31 02:01:32.969312 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3295/6559] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:32 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:33.989602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-888a64b2-f73c-4ac6-a5c7-6222bd61df37 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:33.990421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-888a64b2-f73c-4ac6-a5c7-6222bd61df37 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:33.997778 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-888a64b2-f73c-4ac6-a5c7-6222bd61df37 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:33.998332 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-888a64b2-f73c-4ac6-a5c7-6222bd61df37 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:33.999122 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-888a64b2-f73c-4ac6-a5c7-6222bd61df37 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:33.999598 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-888a64b2-f73c-4ac6-a5c7-6222bd61df37 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:34.134813 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-888a64b2-f73c-4ac6-a5c7-6222bd61df37 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:34.142723 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-888a64b2-f73c-4ac6-a5c7-6222bd61df37 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1363 microversion: 2.1 time: 0.157321 Jul 31 02:01:34.143294 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3265/6560] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:33 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:35.163711 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b4bbf0b6-a3db-47ac-968b-46472248994b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:35.164332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b4bbf0b6-a3db-47ac-968b-46472248994b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:35.171824 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4bbf0b6-a3db-47ac-968b-46472248994b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:35.172282 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4bbf0b6-a3db-47ac-968b-46472248994b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:35.173057 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4bbf0b6-a3db-47ac-968b-46472248994b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:35.173504 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b4bbf0b6-a3db-47ac-968b-46472248994b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:35.302102 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b4bbf0b6-a3db-47ac-968b-46472248994b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:35.309656 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b4bbf0b6-a3db-47ac-968b-46472248994b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1363 microversion: 2.1 time: 0.149916 Jul 31 02:01:35.310428 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3296/6561] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:35 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:35.960203 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-916c3f99-4d08-4a37-a7c6-2247f7227a12 req-a2717159-4476-4c6a-8ef4-25b7857437b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798f76a6-9f6c-4bc6-9f98-288b642a5583", "name": "network-vif-plugged", "status": "completed", "tag": "084bfe1f-99f6-4b03-8c54-c919e77f9525"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:01:35.971439 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-916c3f99-4d08-4a37-a7c6-2247f7227a12 req-a2717159-4476-4c6a-8ef4-25b7857437b3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:35.972056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-916c3f99-4d08-4a37-a7c6-2247f7227a12 req-a2717159-4476-4c6a-8ef4-25b7857437b3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:35.984927 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-916c3f99-4d08-4a37-a7c6-2247f7227a12 req-a2717159-4476-4c6a-8ef4-25b7857437b3 service nova] Creating event network-vif-plugged:084bfe1f-99f6-4b03-8c54-c919e77f9525 for instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 on n-h1-master-1 Jul 31 02:01:35.990192 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-916c3f99-4d08-4a37-a7c6-2247f7227a12 req-a2717159-4476-4c6a-8ef4-25b7857437b3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034010 Jul 31 02:01:35.990936 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3266/6562] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:01:36.330496 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-08d49025-7a55-4b42-812f-ed89c4953d4b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:36.331129 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-08d49025-7a55-4b42-812f-ed89c4953d4b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:36.338097 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08d49025-7a55-4b42-812f-ed89c4953d4b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:36.338560 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08d49025-7a55-4b42-812f-ed89c4953d4b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:36.339331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08d49025-7a55-4b42-812f-ed89c4953d4b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:36.339807 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-08d49025-7a55-4b42-812f-ed89c4953d4b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:36.470166 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-08d49025-7a55-4b42-812f-ed89c4953d4b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:36.477545 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-08d49025-7a55-4b42-812f-ed89c4953d4b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1363 microversion: 2.1 time: 0.150990 Jul 31 02:01:36.478126 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3297/6563] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:36 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:37.499048 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0449cb57-55c2-4d6e-8a7d-fab0ed4741be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:37.500226 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0449cb57-55c2-4d6e-8a7d-fab0ed4741be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:37.507184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0449cb57-55c2-4d6e-8a7d-fab0ed4741be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:37.507680 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0449cb57-55c2-4d6e-8a7d-fab0ed4741be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:37.508459 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0449cb57-55c2-4d6e-8a7d-fab0ed4741be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:37.508909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0449cb57-55c2-4d6e-8a7d-fab0ed4741be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:37.645182 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0449cb57-55c2-4d6e-8a7d-fab0ed4741be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:01:37.653404 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0449cb57-55c2-4d6e-8a7d-fab0ed4741be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1548 microversion: 2.1 time: 0.158000 Jul 31 02:01:37.653978 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3267/6564] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:01:37 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:01:37.676163 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f9765b70-fad3-4788-9966-aac8c5abe376 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:01:37.676747 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f9765b70-fad3-4788-9966-aac8c5abe376 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:01:37.683578 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9765b70-fad3-4788-9966-aac8c5abe376 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:37.684076 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9765b70-fad3-4788-9966-aac8c5abe376 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:37.684866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9765b70-fad3-4788-9966-aac8c5abe376 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:37.685337 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9765b70-fad3-4788-9966-aac8c5abe376 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:37.761499 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f9765b70-fad3-4788-9966-aac8c5abe376 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089215 Jul 31 02:01:37.762633 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3298/6565] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 02:01:37 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:01:38.974925 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-210c1880-7353-4107-a8d4-116cfb965101 req-b9b8b55f-22ee-43b2-a9b9-3dc7fa204c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "798f76a6-9f6c-4bc6-9f98-288b642a5583", "tag": "084bfe1f-99f6-4b03-8c54-c919e77f9525"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:01:38.979952 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:01:38.987185 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-210c1880-7353-4107-a8d4-116cfb965101 req-b9b8b55f-22ee-43b2-a9b9-3dc7fa204c55 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:01:38.987673 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-210c1880-7353-4107-a8d4-116cfb965101 req-b9b8b55f-22ee-43b2-a9b9-3dc7fa204c55 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:01:38.999137 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-210c1880-7353-4107-a8d4-116cfb965101 req-b9b8b55f-22ee-43b2-a9b9-3dc7fa204c55 service nova] Creating event network-changed:084bfe1f-99f6-4b03-8c54-c919e77f9525 for instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 on n-h1-master-1 Jul 31 02:01:39.003985 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-210c1880-7353-4107-a8d4-116cfb965101 req-b9b8b55f-22ee-43b2-a9b9-3dc7fa204c55 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032768 Jul 31 02:01:39.004586 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3268/6566] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:02:08.468879 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:02:08.469665 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:02:08.471517 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:02:08.472176 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=32 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:02:08.476432 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-637fd870-d749-4fdc-afb6-bbf27d758d49 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:08.477059 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-637fd870-d749-4fdc-afb6-bbf27d758d49 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:08.484978 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-637fd870-d749-4fdc-afb6-bbf27d758d49 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:08.485441 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-637fd870-d749-4fdc-afb6-bbf27d758d49 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:08.486220 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-637fd870-d749-4fdc-afb6-bbf27d758d49 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:08.486671 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-637fd870-d749-4fdc-afb6-bbf27d758d49 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:08.618520 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-637fd870-d749-4fdc-afb6-bbf27d758d49 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:08.626595 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-637fd870-d749-4fdc-afb6-bbf27d758d49 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1667 microversion: 2.1 time: 0.159173 Jul 31 02:02:08.627174 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3299/6567] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:08 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1667 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:08.646373 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:02:08.647167 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=28 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:02:08.651273 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dd566fbc-4a5b-4760-8e77-0a76916e0d9a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:08.652009 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dd566fbc-4a5b-4760-8e77-0a76916e0d9a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:08.659787 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd566fbc-4a5b-4760-8e77-0a76916e0d9a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:08.660252 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd566fbc-4a5b-4760-8e77-0a76916e0d9a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:08.661018 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd566fbc-4a5b-4760-8e77-0a76916e0d9a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:08.661466 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd566fbc-4a5b-4760-8e77-0a76916e0d9a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:08.797209 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dd566fbc-4a5b-4760-8e77-0a76916e0d9a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:08.804845 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dd566fbc-4a5b-4760-8e77-0a76916e0d9a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1667 microversion: 2.1 time: 0.160421 Jul 31 02:02:08.805425 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3269/6568] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:08 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:08.826306 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b7e8db9c-3c8e-43ea-a3f8-42a4a180aef5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:08.826937 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b7e8db9c-3c8e-43ea-a3f8-42a4a180aef5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:08.833612 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7e8db9c-3c8e-43ea-a3f8-42a4a180aef5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:08.834082 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7e8db9c-3c8e-43ea-a3f8-42a4a180aef5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:08.834855 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7e8db9c-3c8e-43ea-a3f8-42a4a180aef5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:08.835304 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7e8db9c-3c8e-43ea-a3f8-42a4a180aef5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:08.963931 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b7e8db9c-3c8e-43ea-a3f8-42a4a180aef5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:08.971400 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b7e8db9c-3c8e-43ea-a3f8-42a4a180aef5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1667 microversion: 2.1 time: 0.148938 Jul 31 02:02:08.971998 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3300/6569] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:08 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1667 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:08.992921 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-453c3b70-68f3-4a68-bf09-804e5b51c16b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:02:08.995104 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-453c3b70-68f3-4a68-bf09-804e5b51c16b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:09.001731 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-453c3b70-68f3-4a68-bf09-804e5b51c16b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:09.002197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-453c3b70-68f3-4a68-bf09-804e5b51c16b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:09.002970 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-453c3b70-68f3-4a68-bf09-804e5b51c16b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:09.003453 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-453c3b70-68f3-4a68-bf09-804e5b51c16b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:09.030170 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-453c3b70-68f3-4a68-bf09-804e5b51c16b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:09.035771 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-453c3b70-68f3-4a68-bf09-804e5b51c16b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Old instance type m1.heat2, new instance type m1.heat {{(pid=119474) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 31 02:02:09.041841 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-453c3b70-68f3-4a68-bf09-804e5b51c16b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:02:09.042275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-453c3b70-68f3-4a68-bf09-804e5b51c16b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:02:09.042760 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-453c3b70-68f3-4a68-bf09-804e5b51c16b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:02:09.043183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-453c3b70-68f3-4a68-bf09-804e5b51c16b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:02:09.043633 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-453c3b70-68f3-4a68-bf09-804e5b51c16b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:02:09.105771 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-453c3b70-68f3-4a68-bf09-804e5b51c16b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "POST /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583/action" status: 202 len: 0 microversion: 2.1 time: 0.117131 Jul 31 02:02:09.106541 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3270/6570] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:02:08 2022] POST /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:02:09.115304 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fa25997e-e9b0-4a9b-b3e1-d5163ce7a071 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:09.115965 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fa25997e-e9b0-4a9b-b3e1-d5163ce7a071 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:09.122022 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fa25997e-e9b0-4a9b-b3e1-d5163ce7a071 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:09.122484 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fa25997e-e9b0-4a9b-b3e1-d5163ce7a071 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:09.123263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fa25997e-e9b0-4a9b-b3e1-d5163ce7a071 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:09.123726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fa25997e-e9b0-4a9b-b3e1-d5163ce7a071 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:09.285690 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fa25997e-e9b0-4a9b-b3e1-d5163ce7a071 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:09.294048 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fa25997e-e9b0-4a9b-b3e1-d5163ce7a071 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1676 microversion: 2.1 time: 0.182841 Jul 31 02:02:09.294860 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3301/6571] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:09 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:02:10.317409 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4917611f-ab1f-4ce2-af4d-aa4acbadeb04 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:10.318046 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4917611f-ab1f-4ce2-af4d-aa4acbadeb04 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:10.324246 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4917611f-ab1f-4ce2-af4d-aa4acbadeb04 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:10.324718 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4917611f-ab1f-4ce2-af4d-aa4acbadeb04 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:10.325506 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4917611f-ab1f-4ce2-af4d-aa4acbadeb04 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:10.325973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4917611f-ab1f-4ce2-af4d-aa4acbadeb04 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:10.460319 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4917611f-ab1f-4ce2-af4d-aa4acbadeb04 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:10.467874 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4917611f-ab1f-4ce2-af4d-aa4acbadeb04 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1676 microversion: 2.1 time: 0.155809 Jul 31 02:02:10.468516 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3271/6572] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:10 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:11.488721 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-410e48ba-ddfe-46fb-8532-ea40bd62d2f2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:11.489520 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-410e48ba-ddfe-46fb-8532-ea40bd62d2f2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:11.496414 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-410e48ba-ddfe-46fb-8532-ea40bd62d2f2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:11.496876 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-410e48ba-ddfe-46fb-8532-ea40bd62d2f2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:11.497647 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-410e48ba-ddfe-46fb-8532-ea40bd62d2f2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:11.498094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-410e48ba-ddfe-46fb-8532-ea40bd62d2f2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:11.635601 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-410e48ba-ddfe-46fb-8532-ea40bd62d2f2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:11.643053 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-410e48ba-ddfe-46fb-8532-ea40bd62d2f2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1681 microversion: 2.1 time: 0.158285 Jul 31 02:02:11.643722 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3302/6573] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:11 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:12.665548 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c4438ad4-9d52-467f-abda-906a2ca2f720 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:12.666172 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c4438ad4-9d52-467f-abda-906a2ca2f720 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:12.673667 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4438ad4-9d52-467f-abda-906a2ca2f720 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:12.674133 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4438ad4-9d52-467f-abda-906a2ca2f720 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:12.674907 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4438ad4-9d52-467f-abda-906a2ca2f720 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:12.675378 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c4438ad4-9d52-467f-abda-906a2ca2f720 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:12.812669 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c4438ad4-9d52-467f-abda-906a2ca2f720 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:12.820305 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c4438ad4-9d52-467f-abda-906a2ca2f720 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1681 microversion: 2.1 time: 0.158704 Jul 31 02:02:12.820815 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3272/6574] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:12 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:13.842002 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-075622bd-b908-4670-ac89-026a267939a0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:13.842631 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-075622bd-b908-4670-ac89-026a267939a0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:13.849830 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-075622bd-b908-4670-ac89-026a267939a0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:13.850293 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-075622bd-b908-4670-ac89-026a267939a0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:13.851067 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-075622bd-b908-4670-ac89-026a267939a0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:13.851548 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-075622bd-b908-4670-ac89-026a267939a0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:13.987177 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-075622bd-b908-4670-ac89-026a267939a0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:13.994822 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-075622bd-b908-4670-ac89-026a267939a0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1681 microversion: 2.1 time: 0.156768 Jul 31 02:02:13.995414 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3303/6575] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:13 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:15.016705 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c0b4711e-93df-4128-aa8c-da4e1790c77d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:15.017295 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c0b4711e-93df-4128-aa8c-da4e1790c77d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:15.024192 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0b4711e-93df-4128-aa8c-da4e1790c77d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:15.024658 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0b4711e-93df-4128-aa8c-da4e1790c77d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:15.025431 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0b4711e-93df-4128-aa8c-da4e1790c77d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:15.025881 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0b4711e-93df-4128-aa8c-da4e1790c77d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:15.156319 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c0b4711e-93df-4128-aa8c-da4e1790c77d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:15.164451 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c0b4711e-93df-4128-aa8c-da4e1790c77d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1681 microversion: 2.1 time: 0.151783 Jul 31 02:02:15.165025 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3273/6576] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:15 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:16.188524 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-04b7d228-e190-41a6-97b6-d57203ce4746 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:16.189150 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-04b7d228-e190-41a6-97b6-d57203ce4746 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:16.196131 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04b7d228-e190-41a6-97b6-d57203ce4746 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:16.196594 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04b7d228-e190-41a6-97b6-d57203ce4746 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:16.197370 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04b7d228-e190-41a6-97b6-d57203ce4746 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:16.197820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-04b7d228-e190-41a6-97b6-d57203ce4746 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:16.333455 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-04b7d228-e190-41a6-97b6-d57203ce4746 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:16.340992 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-04b7d228-e190-41a6-97b6-d57203ce4746 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1681 microversion: 2.1 time: 0.156948 Jul 31 02:02:16.341574 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3304/6577] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:16 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:17.362401 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-303945bf-00be-4129-8c7d-f87f9ab4c953 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:17.362950 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-303945bf-00be-4129-8c7d-f87f9ab4c953 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:17.370170 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-303945bf-00be-4129-8c7d-f87f9ab4c953 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:17.370638 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-303945bf-00be-4129-8c7d-f87f9ab4c953 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:17.371444 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-303945bf-00be-4129-8c7d-f87f9ab4c953 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:17.371902 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-303945bf-00be-4129-8c7d-f87f9ab4c953 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:17.500444 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-303945bf-00be-4129-8c7d-f87f9ab4c953 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:17.508162 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-303945bf-00be-4129-8c7d-f87f9ab4c953 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1681 microversion: 2.1 time: 0.149736 Jul 31 02:02:17.508724 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3274/6578] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:17 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:18.530010 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-30fd82fd-705d-4a4a-ac20-13e6f7e0fee2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:18.530636 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-30fd82fd-705d-4a4a-ac20-13e6f7e0fee2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:18.537648 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30fd82fd-705d-4a4a-ac20-13e6f7e0fee2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:18.538104 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30fd82fd-705d-4a4a-ac20-13e6f7e0fee2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:18.538872 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30fd82fd-705d-4a4a-ac20-13e6f7e0fee2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:18.539315 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30fd82fd-705d-4a4a-ac20-13e6f7e0fee2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:18.675526 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-30fd82fd-705d-4a4a-ac20-13e6f7e0fee2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:18.682957 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-30fd82fd-705d-4a4a-ac20-13e6f7e0fee2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1681 microversion: 2.1 time: 0.156880 Jul 31 02:02:18.683569 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3305/6579] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:18 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:19.705562 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c97dcda0-cf98-47ab-9eed-f3c34ec3886b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:19.706321 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c97dcda0-cf98-47ab-9eed-f3c34ec3886b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:19.713210 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c97dcda0-cf98-47ab-9eed-f3c34ec3886b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:19.713682 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c97dcda0-cf98-47ab-9eed-f3c34ec3886b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:19.714465 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c97dcda0-cf98-47ab-9eed-f3c34ec3886b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:19.714920 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c97dcda0-cf98-47ab-9eed-f3c34ec3886b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:19.843492 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c97dcda0-cf98-47ab-9eed-f3c34ec3886b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:19.851048 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c97dcda0-cf98-47ab-9eed-f3c34ec3886b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1681 microversion: 2.1 time: 0.150052 Jul 31 02:02:19.851642 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3275/6580] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:19 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:20.872086 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a6e08f03-5e7b-4000-a434-96b70dec82fa tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:20.872659 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a6e08f03-5e7b-4000-a434-96b70dec82fa tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:20.880264 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a6e08f03-5e7b-4000-a434-96b70dec82fa tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:20.880730 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a6e08f03-5e7b-4000-a434-96b70dec82fa tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:20.881507 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a6e08f03-5e7b-4000-a434-96b70dec82fa tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:20.881955 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a6e08f03-5e7b-4000-a434-96b70dec82fa tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:21.009238 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a6e08f03-5e7b-4000-a434-96b70dec82fa tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:21.016969 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a6e08f03-5e7b-4000-a434-96b70dec82fa tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1681 microversion: 2.1 time: 0.148887 Jul 31 02:02:21.017557 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3306/6581] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:20 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:22.038286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d0120e5d-74fc-4a5c-b51e-cb266ade6dbe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:22.038839 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d0120e5d-74fc-4a5c-b51e-cb266ade6dbe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:22.045750 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0120e5d-74fc-4a5c-b51e-cb266ade6dbe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:22.046207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0120e5d-74fc-4a5c-b51e-cb266ade6dbe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:22.047002 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0120e5d-74fc-4a5c-b51e-cb266ade6dbe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:22.047468 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d0120e5d-74fc-4a5c-b51e-cb266ade6dbe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:22.178632 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d0120e5d-74fc-4a5c-b51e-cb266ade6dbe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:22.185958 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d0120e5d-74fc-4a5c-b51e-cb266ade6dbe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1681 microversion: 2.1 time: 0.151685 Jul 31 02:02:22.186522 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3276/6582] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:22 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:23.208667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bd01d836-d17b-4ed1-9996-76e8a729f4e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:23.209266 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bd01d836-d17b-4ed1-9996-76e8a729f4e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:23.215694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd01d836-d17b-4ed1-9996-76e8a729f4e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:23.216151 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd01d836-d17b-4ed1-9996-76e8a729f4e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:23.216921 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd01d836-d17b-4ed1-9996-76e8a729f4e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:23.217374 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bd01d836-d17b-4ed1-9996-76e8a729f4e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:23.408165 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bd01d836-d17b-4ed1-9996-76e8a729f4e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:23.415773 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bd01d836-d17b-4ed1-9996-76e8a729f4e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1680 microversion: 2.1 time: 0.211205 Jul 31 02:02:23.416671 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3307/6583] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:23 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1680 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:23.701122 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-f808cf6f-7eab-4fdd-8858-937cc8404d5b req-5a59c244-4621-476e-a675-af719363f702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798f76a6-9f6c-4bc6-9f98-288b642a5583", "name": "network-vif-unplugged", "status": "completed", "tag": "084bfe1f-99f6-4b03-8c54-c919e77f9525"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:02:23.711436 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f808cf6f-7eab-4fdd-8858-937cc8404d5b req-5a59c244-4621-476e-a675-af719363f702 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:23.711900 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f808cf6f-7eab-4fdd-8858-937cc8404d5b req-5a59c244-4621-476e-a675-af719363f702 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:23.724414 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-f808cf6f-7eab-4fdd-8858-937cc8404d5b req-5a59c244-4621-476e-a675-af719363f702 service nova] Creating event network-vif-unplugged:084bfe1f-99f6-4b03-8c54-c919e77f9525 for instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 on n-h2-master-1 Jul 31 02:02:23.729858 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-f808cf6f-7eab-4fdd-8858-937cc8404d5b req-5a59c244-4621-476e-a675-af719363f702 service nova] Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:02:23.741742 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-f808cf6f-7eab-4fdd-8858-937cc8404d5b req-5a59c244-4621-476e-a675-af719363f702 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044286 Jul 31 02:02:23.742369 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3277/6584] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:02:24.438719 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-16647854-6624-42d3-9e1d-fc4d6f5f033c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:24.439332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-16647854-6624-42d3-9e1d-fc4d6f5f033c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:24.446559 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16647854-6624-42d3-9e1d-fc4d6f5f033c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:24.447017 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16647854-6624-42d3-9e1d-fc4d6f5f033c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:24.447831 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16647854-6624-42d3-9e1d-fc4d6f5f033c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:24.448273 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-16647854-6624-42d3-9e1d-fc4d6f5f033c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:24.857742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-16647854-6624-42d3-9e1d-fc4d6f5f033c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:24.866061 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-16647854-6624-42d3-9e1d-fc4d6f5f033c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1680 microversion: 2.1 time: 0.431884 Jul 31 02:02:24.866628 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3308/6585] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:24 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1680 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:25.772127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-25c13f74-f48d-4993-8a27-dea66ec8a8f7 req-6b9618d8-9758-4100-826d-0e449e169d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "798f76a6-9f6c-4bc6-9f98-288b642a5583", "tag": "084bfe1f-99f6-4b03-8c54-c919e77f9525"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:02:25.782139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-25c13f74-f48d-4993-8a27-dea66ec8a8f7 req-6b9618d8-9758-4100-826d-0e449e169d99 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:25.782590 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-25c13f74-f48d-4993-8a27-dea66ec8a8f7 req-6b9618d8-9758-4100-826d-0e449e169d99 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:25.793742 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-25c13f74-f48d-4993-8a27-dea66ec8a8f7 req-6b9618d8-9758-4100-826d-0e449e169d99 service nova] Creating event network-changed:084bfe1f-99f6-4b03-8c54-c919e77f9525 for instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 on n-h2-master-1 Jul 31 02:02:25.799542 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-25c13f74-f48d-4993-8a27-dea66ec8a8f7 req-6b9618d8-9758-4100-826d-0e449e169d99 service nova] Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:02:25.809735 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-25c13f74-f48d-4993-8a27-dea66ec8a8f7 req-6b9618d8-9758-4100-826d-0e449e169d99 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042510 Jul 31 02:02:25.810299 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3278/6586] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:02:25.888315 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2ec8e4cf-0275-44a8-8814-71ddd973933e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:25.888871 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2ec8e4cf-0275-44a8-8814-71ddd973933e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:25.895809 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ec8e4cf-0275-44a8-8814-71ddd973933e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:25.896271 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ec8e4cf-0275-44a8-8814-71ddd973933e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:25.897055 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ec8e4cf-0275-44a8-8814-71ddd973933e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:25.897500 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ec8e4cf-0275-44a8-8814-71ddd973933e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:26.110329 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2ec8e4cf-0275-44a8-8814-71ddd973933e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:26.118289 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2ec8e4cf-0275-44a8-8814-71ddd973933e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1678 microversion: 2.1 time: 0.234038 Jul 31 02:02:26.118873 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3309/6587] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:25 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1678 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:27.141199 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5ec271cb-e0a9-46f1-8781-d348c1f6eba7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:27.141913 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5ec271cb-e0a9-46f1-8781-d348c1f6eba7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:27.148305 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ec271cb-e0a9-46f1-8781-d348c1f6eba7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:27.148763 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ec271cb-e0a9-46f1-8781-d348c1f6eba7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:27.149532 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ec271cb-e0a9-46f1-8781-d348c1f6eba7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:27.149981 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5ec271cb-e0a9-46f1-8781-d348c1f6eba7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:27.282721 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5ec271cb-e0a9-46f1-8781-d348c1f6eba7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:27.290243 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5ec271cb-e0a9-46f1-8781-d348c1f6eba7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1675 microversion: 2.1 time: 0.154171 Jul 31 02:02:27.290812 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3279/6588] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:27 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:27.311423 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5e61cdf9-102e-4c34-bbfa-a7f62b98dff3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:02:27.312012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5e61cdf9-102e-4c34-bbfa-a7f62b98dff3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:27.318818 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e61cdf9-102e-4c34-bbfa-a7f62b98dff3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:27.319286 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e61cdf9-102e-4c34-bbfa-a7f62b98dff3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:27.320098 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e61cdf9-102e-4c34-bbfa-a7f62b98dff3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:27.320550 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e61cdf9-102e-4c34-bbfa-a7f62b98dff3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:27.377855 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5e61cdf9-102e-4c34-bbfa-a7f62b98dff3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "POST /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583/action" status: 204 len: 0 microversion: 2.1 time: 0.070225 Jul 31 02:02:27.378496 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3310/6589] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:02:27 2022] POST /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:02:27.386628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c52158bd-6caa-4579-bf30-9f6bbb3006d6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:27.387260 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c52158bd-6caa-4579-bf30-9f6bbb3006d6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:27.393563 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c52158bd-6caa-4579-bf30-9f6bbb3006d6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:27.394181 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c52158bd-6caa-4579-bf30-9f6bbb3006d6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:27.394991 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c52158bd-6caa-4579-bf30-9f6bbb3006d6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:27.395505 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c52158bd-6caa-4579-bf30-9f6bbb3006d6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:27.608584 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c52158bd-6caa-4579-bf30-9f6bbb3006d6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:27.617255 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c52158bd-6caa-4579-bf30-9f6bbb3006d6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1675 microversion: 2.1 time: 0.234432 Jul 31 02:02:27.617767 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3280/6590] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:27 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1675 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:28.639697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-82c30eaf-7323-4589-ba2c-01bf7f52eaae tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:28.640472 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-82c30eaf-7323-4589-ba2c-01bf7f52eaae tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:28.647002 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-82c30eaf-7323-4589-ba2c-01bf7f52eaae tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:28.648137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-82c30eaf-7323-4589-ba2c-01bf7f52eaae tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:28.648758 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-82c30eaf-7323-4589-ba2c-01bf7f52eaae tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:28.649382 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-82c30eaf-7323-4589-ba2c-01bf7f52eaae tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:28.803765 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-82c30eaf-7323-4589-ba2c-01bf7f52eaae tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:28.811554 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-82c30eaf-7323-4589-ba2c-01bf7f52eaae tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1667 microversion: 2.1 time: 0.177087 Jul 31 02:02:28.812179 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3311/6591] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:28 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1667 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:28.833016 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5492a241-f8c1-4ecc-8368-49fb7dcd828d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:28.833637 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5492a241-f8c1-4ecc-8368-49fb7dcd828d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:28.841281 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5492a241-f8c1-4ecc-8368-49fb7dcd828d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:28.841743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5492a241-f8c1-4ecc-8368-49fb7dcd828d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:28.842517 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5492a241-f8c1-4ecc-8368-49fb7dcd828d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:28.843507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5492a241-f8c1-4ecc-8368-49fb7dcd828d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:28.976645 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5492a241-f8c1-4ecc-8368-49fb7dcd828d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:28.984864 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5492a241-f8c1-4ecc-8368-49fb7dcd828d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1667 microversion: 2.1 time: 0.156013 Jul 31 02:02:28.985442 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3281/6592] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:28 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:02:29.005463 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-36a9140f-4749-436a-9f05-8f111f3052c8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:29.006086 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-36a9140f-4749-436a-9f05-8f111f3052c8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:29.012326 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36a9140f-4749-436a-9f05-8f111f3052c8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:29.012721 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36a9140f-4749-436a-9f05-8f111f3052c8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:29.013495 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36a9140f-4749-436a-9f05-8f111f3052c8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:29.013941 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-36a9140f-4749-436a-9f05-8f111f3052c8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:29.151281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-36a9140f-4749-436a-9f05-8f111f3052c8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:29.159487 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-36a9140f-4749-436a-9f05-8f111f3052c8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1667 microversion: 2.1 time: 0.157874 Jul 31 02:02:29.160066 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3312/6593] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:29 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:29.179897 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ee0c1099-f57f-45e4-b15b-3302aad4ed8e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:29.180405 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ee0c1099-f57f-45e4-b15b-3302aad4ed8e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:29.186382 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee0c1099-f57f-45e4-b15b-3302aad4ed8e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:29.186868 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee0c1099-f57f-45e4-b15b-3302aad4ed8e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:29.187659 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee0c1099-f57f-45e4-b15b-3302aad4ed8e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:29.188105 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ee0c1099-f57f-45e4-b15b-3302aad4ed8e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:29.212101 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ee0c1099-f57f-45e4-b15b-3302aad4ed8e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:02:29.291394 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ee0c1099-f57f-45e4-b15b-3302aad4ed8e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "DELETE /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 204 len: 0 microversion: 2.1 time: 0.114753 Jul 31 02:02:29.291994 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3282/6594] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:02:29 2022] DELETE /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:02:29.300927 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2ef56a81-b7d7-451e-a432-c44f75fa95b6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:29.301546 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2ef56a81-b7d7-451e-a432-c44f75fa95b6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:29.307650 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ef56a81-b7d7-451e-a432-c44f75fa95b6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:29.308108 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ef56a81-b7d7-451e-a432-c44f75fa95b6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:29.308872 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ef56a81-b7d7-451e-a432-c44f75fa95b6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:29.309315 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2ef56a81-b7d7-451e-a432-c44f75fa95b6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:29.435475 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2ef56a81-b7d7-451e-a432-c44f75fa95b6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:29.443593 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2ef56a81-b7d7-451e-a432-c44f75fa95b6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1673 microversion: 2.1 time: 0.147136 Jul 31 02:02:29.444233 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3313/6595] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:29 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:30.465612 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-726daaa0-8197-47f6-92aa-fe4d346915df tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:30.466330 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-726daaa0-8197-47f6-92aa-fe4d346915df tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:30.473730 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-726daaa0-8197-47f6-92aa-fe4d346915df tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:30.474202 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-726daaa0-8197-47f6-92aa-fe4d346915df tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:30.475012 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-726daaa0-8197-47f6-92aa-fe4d346915df tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:30.475494 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-726daaa0-8197-47f6-92aa-fe4d346915df tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:30.479536 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:02:30.617941 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-726daaa0-8197-47f6-92aa-fe4d346915df tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:30.626078 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-726daaa0-8197-47f6-92aa-fe4d346915df tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1673 microversion: 2.1 time: 0.164664 Jul 31 02:02:30.626655 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3283/6596] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:30 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:30.676776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-9491c18b-d1fe-4780-b3db-e09210aaf741 req-61e16d2c-57d4-428a-8c51-bcb8950ed44a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798f76a6-9f6c-4bc6-9f98-288b642a5583", "name": "network-vif-plugged", "status": "completed", "tag": "084bfe1f-99f6-4b03-8c54-c919e77f9525"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:02:30.688353 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9491c18b-d1fe-4780-b3db-e09210aaf741 req-61e16d2c-57d4-428a-8c51-bcb8950ed44a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:30.689046 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-9491c18b-d1fe-4780-b3db-e09210aaf741 req-61e16d2c-57d4-428a-8c51-bcb8950ed44a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:30.705078 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-9491c18b-d1fe-4780-b3db-e09210aaf741 req-61e16d2c-57d4-428a-8c51-bcb8950ed44a service nova] Creating event network-vif-plugged:084bfe1f-99f6-4b03-8c54-c919e77f9525 for instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 on n-h2-master-1 Jul 31 02:02:30.711541 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-9491c18b-d1fe-4780-b3db-e09210aaf741 req-61e16d2c-57d4-428a-8c51-bcb8950ed44a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038408 Jul 31 02:02:30.713390 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3314/6597] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:02:31.592792 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-51b7addb-d168-43c4-a13d-a7e47e878c70 req-2f6ddde5-fcc9-42fe-ad29-6620539d0b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798f76a6-9f6c-4bc6-9f98-288b642a5583", "name": "network-vif-deleted", "tag": "084bfe1f-99f6-4b03-8c54-c919e77f9525"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:02:31.604865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-51b7addb-d168-43c4-a13d-a7e47e878c70 req-2f6ddde5-fcc9-42fe-ad29-6620539d0b74 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:31.605326 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-51b7addb-d168-43c4-a13d-a7e47e878c70 req-2f6ddde5-fcc9-42fe-ad29-6620539d0b74 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:31.617992 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-51b7addb-d168-43c4-a13d-a7e47e878c70 req-2f6ddde5-fcc9-42fe-ad29-6620539d0b74 service nova] Creating event network-vif-deleted:084bfe1f-99f6-4b03-8c54-c919e77f9525 for instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 on n-h2-master-1 Jul 31 02:02:31.623526 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-51b7addb-d168-43c4-a13d-a7e47e878c70 req-2f6ddde5-fcc9-42fe-ad29-6620539d0b74 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034092 Jul 31 02:02:31.624418 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3284/6598] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:02:31.648318 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-27c564f8-7294-48b9-a05a-bc8fbb4a9afd tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:31.648952 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-27c564f8-7294-48b9-a05a-bc8fbb4a9afd tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:31.665232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27c564f8-7294-48b9-a05a-bc8fbb4a9afd tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:31.665700 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27c564f8-7294-48b9-a05a-bc8fbb4a9afd tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:31.666516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27c564f8-7294-48b9-a05a-bc8fbb4a9afd tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:31.666953 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27c564f8-7294-48b9-a05a-bc8fbb4a9afd tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:31.669999 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:02:31.741191 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-27c564f8-7294-48b9-a05a-bc8fbb4a9afd tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:31.751358 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-27c564f8-7294-48b9-a05a-bc8fbb4a9afd tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 200 len: 1322 microversion: 2.1 time: 0.107414 Jul 31 02:02:31.752002 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3315/6599] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:31 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 1322 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:02:32.775895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e929c833-1d3d-4e1c-99d3-61455696958c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:32.776860 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e929c833-1d3d-4e1c-99d3-61455696958c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:32.784347 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e929c833-1d3d-4e1c-99d3-61455696958c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:32.784820 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e929c833-1d3d-4e1c-99d3-61455696958c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:32.785972 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e929c833-1d3d-4e1c-99d3-61455696958c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:32.786438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e929c833-1d3d-4e1c-99d3-61455696958c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:32.802234 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-e929c833-1d3d-4e1c-99d3-61455696958c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] HTTP exception thrown: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e929c833-1d3d-4e1c-99d3-61455696958c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Request method failure captured: Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 HTTP/1.1 Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eJ1I2l5yEhe8PxarxZ9XRm4z-6QjmhbZOvRUbxzByRHW6l8LEbbUxtG2DytV3QuDPs6Keq8bbte8TVSyRSiRWBkH4zpt8Eg76zlOmP_pIHa1L3zACHKWuHbXQcEqAA0sFnYwcj_YJydQgWa7PJBhmxQGIPQylFIUtatKCWUFm6XMLI Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f8bba8850b446fcb8b4cb1aedb51876", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerActionsTestJSON-945544621 Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 50f66e518b9143f485b4a9938cb8dd7c Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '798f76a6-9f6c-4bc6-9f98-288b642a5583'} Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:02:32.803938 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:02:32.809359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:02:32.809359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:02:32.809359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:02:32.809359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:02:32.809359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:02:32.809359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:02:32.809359 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:02:32.809359 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e929c833-1d3d-4e1c-99d3-61455696958c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Returning 404 to user: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:02:32.809359 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e929c833-1d3d-4e1c-99d3-61455696958c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 404 len: 111 microversion: 2.1 time: 0.035275 Jul 31 02:02:32.809359 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3285/6600] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:32 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:02:32.817122 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d42ec50b-2223-4fbf-884f-cd1d06e6082c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:32.817801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d42ec50b-2223-4fbf-884f-cd1d06e6082c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:32.824864 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d42ec50b-2223-4fbf-884f-cd1d06e6082c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:32.825332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d42ec50b-2223-4fbf-884f-cd1d06e6082c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:32.826106 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d42ec50b-2223-4fbf-884f-cd1d06e6082c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:32.826554 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d42ec50b-2223-4fbf-884f-cd1d06e6082c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:32.839768 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-d42ec50b-2223-4fbf-884f-cd1d06e6082c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] HTTP exception thrown: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d42ec50b-2223-4fbf-884f-cd1d06e6082c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Request method failure captured: Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 HTTP/1.1 Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eJ1I2l5yEhe8PxarxZ9XRm4z-6QjmhbZOvRUbxzByRHW6l8LEbbUxtG2DytV3QuDPs6Keq8bbte8TVSyRSiRWBkH4zpt8Eg76zlOmP_pIHa1L3zACHKWuHbXQcEqAA0sFnYwcj_YJydQgWa7PJBhmxQGIPQylFIUtatKCWUFm6XMLI Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f8bba8850b446fcb8b4cb1aedb51876", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerActionsTestJSON-945544621 Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 50f66e518b9143f485b4a9938cb8dd7c Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '798f76a6-9f6c-4bc6-9f98-288b642a5583'} Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:02:32.841432 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:02:32.847073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:02:32.847073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:02:32.847073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:02:32.847073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:02:32.847073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:02:32.847073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:02:32.847073 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:02:32.847073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d42ec50b-2223-4fbf-884f-cd1d06e6082c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Returning 404 to user: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:02:32.847073 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d42ec50b-2223-4fbf-884f-cd1d06e6082c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 404 len: 111 microversion: 2.1 time: 0.029621 Jul 31 02:02:32.847073 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3316/6601] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:32 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 02:02:32.897320 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d31608f6-6ce2-4978-b028-9928eed944ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-475039511", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "3b566735-8db1-4f81-80aa-d07655229680"}], "security_groups": [{"name": "tempest-securitygroup--1769531531"}], "key_name": "tempest-keypair-596934869", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:02:32.999881 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-d31608f6-6ce2-4978-b028-9928eed944ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] validate_networks() for [('3b566735-8db1-4f81-80aa-d07655229680', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:02:33.720693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d31608f6-6ce2-4978-b028-9928eed944ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:02:33.721137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d31608f6-6ce2-4978-b028-9928eed944ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:02:33.721633 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d31608f6-6ce2-4978-b028-9928eed944ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:02:33.722061 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d31608f6-6ce2-4978-b028-9928eed944ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:02:33.722490 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-d31608f6-6ce2-4978-b028-9928eed944ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:02:33.731569 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d31608f6-6ce2-4978-b028-9928eed944ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:33.732041 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d31608f6-6ce2-4978-b028-9928eed944ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:33.732858 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d31608f6-6ce2-4978-b028-9928eed944ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:33.733314 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d31608f6-6ce2-4978-b028-9928eed944ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:33.751428 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-d31608f6-6ce2-4978-b028-9928eed944ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Getting quotas for project 6f8bba8850b446fcb8b4cb1aedb51876. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:02:33.756820 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-d31608f6-6ce2-4978-b028-9928eed944ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Getting quotas for user 50f66e518b9143f485b4a9938cb8dd7c and project 6f8bba8850b446fcb8b4cb1aedb51876. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:02:33.769331 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d31608f6-6ce2-4978-b028-9928eed944ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:02:33.771632 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d31608f6-6ce2-4978-b028-9928eed944ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:02:33.818061 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d31608f6-6ce2-4978-b028-9928eed944ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.926521 Jul 31 02:02:33.818705 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3286/6602] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:02:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:02:33.830054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-108ab0f2-6b42-4b5e-ae2e-f378a8897aa3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:33.830679 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-108ab0f2-6b42-4b5e-ae2e-f378a8897aa3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:33.888249 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-108ab0f2-6b42-4b5e-ae2e-f378a8897aa3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:33.895999 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-108ab0f2-6b42-4b5e-ae2e-f378a8897aa3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1237 microversion: 2.1 time: 0.069889 Jul 31 02:02:33.896567 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3317/6603] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:33 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:34.919145 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-08668bb4-c281-4f87-a9f4-8fdcaf02fa94 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:34.919784 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-08668bb4-c281-4f87-a9f4-8fdcaf02fa94 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:34.927641 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08668bb4-c281-4f87-a9f4-8fdcaf02fa94 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:34.928199 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08668bb4-c281-4f87-a9f4-8fdcaf02fa94 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:34.929003 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08668bb4-c281-4f87-a9f4-8fdcaf02fa94 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:34.929459 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08668bb4-c281-4f87-a9f4-8fdcaf02fa94 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:34.995397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-08668bb4-c281-4f87-a9f4-8fdcaf02fa94 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:35.003853 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-08668bb4-c281-4f87-a9f4-8fdcaf02fa94 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1295 microversion: 2.1 time: 0.089643 Jul 31 02:02:35.004440 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3287/6604] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:34 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1295 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:36.025264 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-167166ab-892c-48fa-9bb0-6b36e06d1edb tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:36.025945 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-167166ab-892c-48fa-9bb0-6b36e06d1edb tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:36.033565 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-167166ab-892c-48fa-9bb0-6b36e06d1edb tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:36.034063 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-167166ab-892c-48fa-9bb0-6b36e06d1edb tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:36.034855 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-167166ab-892c-48fa-9bb0-6b36e06d1edb tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:36.035306 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-167166ab-892c-48fa-9bb0-6b36e06d1edb tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:36.224706 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-167166ab-892c-48fa-9bb0-6b36e06d1edb tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:36.232334 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-167166ab-892c-48fa-9bb0-6b36e06d1edb tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1363 microversion: 2.1 time: 0.210995 Jul 31 02:02:36.232907 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3318/6605] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:36 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:36.312766 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-937857c5-a433-4412-a092-31bafb2d59e8 req-cd689598-048a-4bfa-980d-ca9f89bda636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b576704d-7984-4476-a244-b91d73f2b0c8", "tag": "56baef82-07a8-4206-8099-45f3ee82750f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:02:36.324115 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-937857c5-a433-4412-a092-31bafb2d59e8 req-cd689598-048a-4bfa-980d-ca9f89bda636 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:36.324849 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-937857c5-a433-4412-a092-31bafb2d59e8 req-cd689598-048a-4bfa-980d-ca9f89bda636 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:36.339847 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-937857c5-a433-4412-a092-31bafb2d59e8 req-cd689598-048a-4bfa-980d-ca9f89bda636 service nova] Creating event network-changed:56baef82-07a8-4206-8099-45f3ee82750f for instance b576704d-7984-4476-a244-b91d73f2b0c8 on n-h1-master-1 Jul 31 02:02:36.344908 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-937857c5-a433-4412-a092-31bafb2d59e8 req-cd689598-048a-4bfa-980d-ca9f89bda636 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036556 Jul 31 02:02:36.345513 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3288/6606] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:02:37.253375 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-276f5f9b-ac0e-4dc3-8f3f-d2c4107ec0f8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:37.253997 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-276f5f9b-ac0e-4dc3-8f3f-d2c4107ec0f8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:37.260821 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-276f5f9b-ac0e-4dc3-8f3f-d2c4107ec0f8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:37.261278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-276f5f9b-ac0e-4dc3-8f3f-d2c4107ec0f8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:37.262039 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-276f5f9b-ac0e-4dc3-8f3f-d2c4107ec0f8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:37.262486 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-276f5f9b-ac0e-4dc3-8f3f-d2c4107ec0f8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:37.392689 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-276f5f9b-ac0e-4dc3-8f3f-d2c4107ec0f8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:37.400015 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-276f5f9b-ac0e-4dc3-8f3f-d2c4107ec0f8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1363 microversion: 2.1 time: 0.150584 Jul 31 02:02:37.400608 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3319/6607] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:37 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:38.424105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5854d7c3-ef14-45c4-8c72-65d013fa86c8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:38.424824 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5854d7c3-ef14-45c4-8c72-65d013fa86c8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:38.431016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5854d7c3-ef14-45c4-8c72-65d013fa86c8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:38.431530 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5854d7c3-ef14-45c4-8c72-65d013fa86c8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:38.432328 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5854d7c3-ef14-45c4-8c72-65d013fa86c8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:38.432789 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5854d7c3-ef14-45c4-8c72-65d013fa86c8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:38.564426 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5854d7c3-ef14-45c4-8c72-65d013fa86c8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:38.571981 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5854d7c3-ef14-45c4-8c72-65d013fa86c8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1363 microversion: 2.1 time: 0.153911 Jul 31 02:02:38.572549 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3289/6608] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:38 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:39.593167 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-55a07059-c5d9-4903-a474-92b60b88d476 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:39.593803 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-55a07059-c5d9-4903-a474-92b60b88d476 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:39.597767 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=45 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:02:39.602757 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55a07059-c5d9-4903-a474-92b60b88d476 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:39.603394 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55a07059-c5d9-4903-a474-92b60b88d476 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:39.604181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55a07059-c5d9-4903-a474-92b60b88d476 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:39.604638 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-55a07059-c5d9-4903-a474-92b60b88d476 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:39.740962 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-55a07059-c5d9-4903-a474-92b60b88d476 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:39.748451 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-55a07059-c5d9-4903-a474-92b60b88d476 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1363 microversion: 2.1 time: 0.159148 Jul 31 02:02:39.749590 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3320/6609] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:39 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:40.391216 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-b3d3424c-9207-44b6-87c9-83bb6b87b007 req-18473744-dcb9-49e0-9074-7b508fc82b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b576704d-7984-4476-a244-b91d73f2b0c8", "name": "network-vif-plugged", "status": "completed", "tag": "56baef82-07a8-4206-8099-45f3ee82750f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:02:40.397240 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:02:40.405203 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b3d3424c-9207-44b6-87c9-83bb6b87b007 req-18473744-dcb9-49e0-9074-7b508fc82b63 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:40.405671 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b3d3424c-9207-44b6-87c9-83bb6b87b007 req-18473744-dcb9-49e0-9074-7b508fc82b63 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:40.420757 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-b3d3424c-9207-44b6-87c9-83bb6b87b007 req-18473744-dcb9-49e0-9074-7b508fc82b63 service nova] Creating event network-vif-plugged:56baef82-07a8-4206-8099-45f3ee82750f for instance b576704d-7984-4476-a244-b91d73f2b0c8 on n-h1-master-1 Jul 31 02:02:40.425901 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-b3d3424c-9207-44b6-87c9-83bb6b87b007 req-18473744-dcb9-49e0-9074-7b508fc82b63 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038944 Jul 31 02:02:40.426497 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3290/6610] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:02:40.771047 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1b336b46-6f02-433a-92cf-86220fbb155b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:40.771631 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1b336b46-6f02-433a-92cf-86220fbb155b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:40.778584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b336b46-6f02-433a-92cf-86220fbb155b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:40.779038 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b336b46-6f02-433a-92cf-86220fbb155b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:40.779831 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b336b46-6f02-433a-92cf-86220fbb155b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:40.780274 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b336b46-6f02-433a-92cf-86220fbb155b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:40.909761 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1b336b46-6f02-433a-92cf-86220fbb155b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:40.917188 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1b336b46-6f02-433a-92cf-86220fbb155b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1363 microversion: 2.1 time: 0.150190 Jul 31 02:02:40.917767 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3321/6611] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:40 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:02:41.941984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-284c2607-7392-4b7e-8d5e-b3f62ab1a86f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:41.942623 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-284c2607-7392-4b7e-8d5e-b3f62ab1a86f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:41.949830 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-284c2607-7392-4b7e-8d5e-b3f62ab1a86f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:41.950302 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-284c2607-7392-4b7e-8d5e-b3f62ab1a86f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:41.951084 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-284c2607-7392-4b7e-8d5e-b3f62ab1a86f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:41.951581 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-284c2607-7392-4b7e-8d5e-b3f62ab1a86f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:42.086941 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-284c2607-7392-4b7e-8d5e-b3f62ab1a86f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:02:42.095027 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-284c2607-7392-4b7e-8d5e-b3f62ab1a86f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1549 microversion: 2.1 time: 0.157414 Jul 31 02:02:42.095632 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3291/6612] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:02:41 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:02:42.116342 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ab20f47-c16f-41e4-b016-cbadc37b4a62 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:02:42.116901 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4ab20f47-c16f-41e4-b016-cbadc37b4a62 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:02:42.123686 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ab20f47-c16f-41e4-b016-cbadc37b4a62 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:42.124140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ab20f47-c16f-41e4-b016-cbadc37b4a62 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:42.124905 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ab20f47-c16f-41e4-b016-cbadc37b4a62 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:42.125344 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ab20f47-c16f-41e4-b016-cbadc37b4a62 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:42.200658 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4ab20f47-c16f-41e4-b016-cbadc37b4a62 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088467 Jul 31 02:02:42.201259 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3322/6613] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 02:02:42 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:02:43.141185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-86ce4e5f-853c-4c4b-bb82-27e842de7b2c req-2516867c-395d-41a0-a122-23094513838b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b576704d-7984-4476-a244-b91d73f2b0c8", "tag": "56baef82-07a8-4206-8099-45f3ee82750f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:02:43.151450 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-86ce4e5f-853c-4c4b-bb82-27e842de7b2c req-2516867c-395d-41a0-a122-23094513838b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:02:43.151910 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-86ce4e5f-853c-4c4b-bb82-27e842de7b2c req-2516867c-395d-41a0-a122-23094513838b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:02:43.163396 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-86ce4e5f-853c-4c4b-bb82-27e842de7b2c req-2516867c-395d-41a0-a122-23094513838b service nova] Creating event network-changed:56baef82-07a8-4206-8099-45f3ee82750f for instance b576704d-7984-4476-a244-b91d73f2b0c8 on n-h1-master-1 Jul 31 02:02:43.168350 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-86ce4e5f-853c-4c4b-bb82-27e842de7b2c req-2516867c-395d-41a0-a122-23094513838b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030798 Jul 31 02:02:43.168943 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3292/6614] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:03:16.103270 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:03:16.104512 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=5 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:03:16.105139 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=35 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:03:16.109371 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b2648789-eaf0-4816-8d8f-10c4fc50a6a3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:03:16.117304 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b2648789-eaf0-4816-8d8f-10c4fc50a6a3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:16.117758 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b2648789-eaf0-4816-8d8f-10c4fc50a6a3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:16.139111 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b2648789-eaf0-4816-8d8f-10c4fc50a6a3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Going to try to stop instance {{(pid=119475) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 02:03:16.180061 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b2648789-eaf0-4816-8d8f-10c4fc50a6a3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "POST /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8/action" status: 202 len: 0 microversion: 2.1 time: 0.078196 Jul 31 02:03:16.180672 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3323/6615] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:03:16 2022] POST /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:03:16.186122 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:03:16.187073 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:03:16.189314 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=5 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:03:16.189545 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=34 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:03:16.194242 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-76529fd4-6486-4281-a2ad-a8921efd903a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:16.194954 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-76529fd4-6486-4281-a2ad-a8921efd903a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:16.203227 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-76529fd4-6486-4281-a2ad-a8921efd903a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:16.203750 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-76529fd4-6486-4281-a2ad-a8921efd903a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:16.204534 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-76529fd4-6486-4281-a2ad-a8921efd903a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:16.204987 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-76529fd4-6486-4281-a2ad-a8921efd903a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:16.396560 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-76529fd4-6486-4281-a2ad-a8921efd903a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:16.404038 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-76529fd4-6486-4281-a2ad-a8921efd903a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1678 microversion: 2.1 time: 0.218913 Jul 31 02:03:16.404604 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3293/6616] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:16 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:17.428054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-89d74ae5-06c2-402f-9b61-49a2ff4ad742 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:17.428757 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-89d74ae5-06c2-402f-9b61-49a2ff4ad742 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:17.434971 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89d74ae5-06c2-402f-9b61-49a2ff4ad742 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:17.435462 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89d74ae5-06c2-402f-9b61-49a2ff4ad742 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:17.436226 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89d74ae5-06c2-402f-9b61-49a2ff4ad742 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:17.436665 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-89d74ae5-06c2-402f-9b61-49a2ff4ad742 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:17.618564 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-89d74ae5-06c2-402f-9b61-49a2ff4ad742 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:17.626142 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-89d74ae5-06c2-402f-9b61-49a2ff4ad742 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1678 microversion: 2.1 time: 0.203796 Jul 31 02:03:17.626737 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3324/6617] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:17 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:18.647558 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c661fd7b-4513-41af-9034-754abed1cf42 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:18.648193 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c661fd7b-4513-41af-9034-754abed1cf42 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:18.654717 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c661fd7b-4513-41af-9034-754abed1cf42 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:18.655183 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c661fd7b-4513-41af-9034-754abed1cf42 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:18.655993 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c661fd7b-4513-41af-9034-754abed1cf42 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:18.656448 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c661fd7b-4513-41af-9034-754abed1cf42 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:18.792746 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c661fd7b-4513-41af-9034-754abed1cf42 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:18.800831 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c661fd7b-4513-41af-9034-754abed1cf42 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1678 microversion: 2.1 time: 0.157384 Jul 31 02:03:18.801388 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3294/6618] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:18 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:19.822690 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e885c0d4-25be-477a-91ed-ef416b7167ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:19.823257 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e885c0d4-25be-477a-91ed-ef416b7167ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:19.830794 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e885c0d4-25be-477a-91ed-ef416b7167ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:19.831256 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e885c0d4-25be-477a-91ed-ef416b7167ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:19.832057 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e885c0d4-25be-477a-91ed-ef416b7167ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:19.832506 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e885c0d4-25be-477a-91ed-ef416b7167ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:19.963940 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e885c0d4-25be-477a-91ed-ef416b7167ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:19.971596 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e885c0d4-25be-477a-91ed-ef416b7167ef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1678 microversion: 2.1 time: 0.152852 Jul 31 02:03:19.972209 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3325/6619] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:19 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:20.993273 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-53920f1f-1459-4e53-8fa5-25d33f1e06b0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:20.993834 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-53920f1f-1459-4e53-8fa5-25d33f1e06b0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:21.000793 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53920f1f-1459-4e53-8fa5-25d33f1e06b0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:21.001262 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53920f1f-1459-4e53-8fa5-25d33f1e06b0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:21.002046 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53920f1f-1459-4e53-8fa5-25d33f1e06b0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:21.002506 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-53920f1f-1459-4e53-8fa5-25d33f1e06b0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:21.134019 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-53920f1f-1459-4e53-8fa5-25d33f1e06b0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:21.142079 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-53920f1f-1459-4e53-8fa5-25d33f1e06b0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1678 microversion: 2.1 time: 0.152575 Jul 31 02:03:21.142659 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3295/6620] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:20 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:22.164082 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5860a556-c239-4f5e-a684-05d047354b9f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:22.164708 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5860a556-c239-4f5e-a684-05d047354b9f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:22.171068 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5860a556-c239-4f5e-a684-05d047354b9f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:22.171568 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5860a556-c239-4f5e-a684-05d047354b9f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:22.172348 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5860a556-c239-4f5e-a684-05d047354b9f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:22.172820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5860a556-c239-4f5e-a684-05d047354b9f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:22.302727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5860a556-c239-4f5e-a684-05d047354b9f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:22.310244 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5860a556-c239-4f5e-a684-05d047354b9f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1678 microversion: 2.1 time: 0.150028 Jul 31 02:03:22.310989 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3326/6621] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:22 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:23.332807 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0f368f1c-cb41-461f-81f9-08b32bb8c243 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:23.334052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0f368f1c-cb41-461f-81f9-08b32bb8c243 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:23.340862 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f368f1c-cb41-461f-81f9-08b32bb8c243 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:23.341365 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f368f1c-cb41-461f-81f9-08b32bb8c243 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:23.342146 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f368f1c-cb41-461f-81f9-08b32bb8c243 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:23.342604 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f368f1c-cb41-461f-81f9-08b32bb8c243 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:23.470978 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0f368f1c-cb41-461f-81f9-08b32bb8c243 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:23.478505 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0f368f1c-cb41-461f-81f9-08b32bb8c243 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1678 microversion: 2.1 time: 0.150245 Jul 31 02:03:23.479083 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3296/6622] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:23 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:24.499273 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6407f962-47e4-4353-b90a-2688775455f0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:24.499925 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6407f962-47e4-4353-b90a-2688775455f0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:24.506787 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6407f962-47e4-4353-b90a-2688775455f0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:24.507249 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6407f962-47e4-4353-b90a-2688775455f0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:24.508054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6407f962-47e4-4353-b90a-2688775455f0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:24.508501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6407f962-47e4-4353-b90a-2688775455f0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:24.638143 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6407f962-47e4-4353-b90a-2688775455f0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:24.646297 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6407f962-47e4-4353-b90a-2688775455f0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1678 microversion: 2.1 time: 0.150928 Jul 31 02:03:24.646897 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3327/6623] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:24 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:03:25.668472 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-81854708-a7cd-4553-8755-9e3cd32b2c7d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:25.669132 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-81854708-a7cd-4553-8755-9e3cd32b2c7d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:25.676639 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81854708-a7cd-4553-8755-9e3cd32b2c7d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:25.677111 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81854708-a7cd-4553-8755-9e3cd32b2c7d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:25.677891 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81854708-a7cd-4553-8755-9e3cd32b2c7d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:25.678345 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81854708-a7cd-4553-8755-9e3cd32b2c7d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:25.811754 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-81854708-a7cd-4553-8755-9e3cd32b2c7d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:25.819361 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-81854708-a7cd-4553-8755-9e3cd32b2c7d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1678 microversion: 2.1 time: 0.154733 Jul 31 02:03:25.819874 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3297/6624] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:25 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:26.840700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9560a798-b623-4971-b088-463b39f33c4b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:26.841282 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9560a798-b623-4971-b088-463b39f33c4b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:26.848343 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9560a798-b623-4971-b088-463b39f33c4b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:26.848810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9560a798-b623-4971-b088-463b39f33c4b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:26.849589 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9560a798-b623-4971-b088-463b39f33c4b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:26.850037 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9560a798-b623-4971-b088-463b39f33c4b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:26.977153 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9560a798-b623-4971-b088-463b39f33c4b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:26.985426 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9560a798-b623-4971-b088-463b39f33c4b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1678 microversion: 2.1 time: 0.148187 Jul 31 02:03:26.986029 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3328/6625] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:26 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:28.007684 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2bee6561-4116-47c5-84fc-bbb3769f28b7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:28.008308 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2bee6561-4116-47c5-84fc-bbb3769f28b7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:28.015286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2bee6561-4116-47c5-84fc-bbb3769f28b7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:28.015780 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2bee6561-4116-47c5-84fc-bbb3769f28b7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:28.016557 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2bee6561-4116-47c5-84fc-bbb3769f28b7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:28.017010 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2bee6561-4116-47c5-84fc-bbb3769f28b7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:28.150742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2bee6561-4116-47c5-84fc-bbb3769f28b7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:28.158745 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2bee6561-4116-47c5-84fc-bbb3769f28b7 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1678 microversion: 2.1 time: 0.154972 Jul 31 02:03:28.159306 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3298/6626] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:28 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:29.180837 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fdfe6b93-c559-4889-9a2c-63b2ffcb4315 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:29.181455 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fdfe6b93-c559-4889-9a2c-63b2ffcb4315 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:29.189008 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fdfe6b93-c559-4889-9a2c-63b2ffcb4315 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:29.189462 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fdfe6b93-c559-4889-9a2c-63b2ffcb4315 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:29.190223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fdfe6b93-c559-4889-9a2c-63b2ffcb4315 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:29.190663 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fdfe6b93-c559-4889-9a2c-63b2ffcb4315 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:29.317746 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fdfe6b93-c559-4889-9a2c-63b2ffcb4315 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:29.325073 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fdfe6b93-c559-4889-9a2c-63b2ffcb4315 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1678 microversion: 2.1 time: 0.148139 Jul 31 02:03:29.325651 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3329/6627] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:29 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:30.348992 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d32c83e4-ee54-4e0b-9200-5060cd06bf65 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:30.349604 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d32c83e4-ee54-4e0b-9200-5060cd06bf65 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:30.356532 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d32c83e4-ee54-4e0b-9200-5060cd06bf65 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:30.356995 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d32c83e4-ee54-4e0b-9200-5060cd06bf65 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:30.357766 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d32c83e4-ee54-4e0b-9200-5060cd06bf65 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:30.358216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d32c83e4-ee54-4e0b-9200-5060cd06bf65 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:30.489654 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d32c83e4-ee54-4e0b-9200-5060cd06bf65 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:30.497506 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d32c83e4-ee54-4e0b-9200-5060cd06bf65 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1678 microversion: 2.1 time: 0.152415 Jul 31 02:03:30.498077 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3299/6628] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:30 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:31.520206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e8c875f6-9af2-49d8-bc1d-80139da19202 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:31.520734 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e8c875f6-9af2-49d8-bc1d-80139da19202 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:31.527644 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8c875f6-9af2-49d8-bc1d-80139da19202 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:31.528110 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8c875f6-9af2-49d8-bc1d-80139da19202 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:31.528895 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8c875f6-9af2-49d8-bc1d-80139da19202 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:31.529343 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8c875f6-9af2-49d8-bc1d-80139da19202 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:31.669174 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e8c875f6-9af2-49d8-bc1d-80139da19202 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:31.676720 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e8c875f6-9af2-49d8-bc1d-80139da19202 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1655 microversion: 2.1 time: 0.161080 Jul 31 02:03:31.677299 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3330/6629] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:31 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1655 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:31.697646 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0a771480-607c-4671-80cf-7f90c9103ba8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:03:31.699939 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0a771480-607c-4671-80cf-7f90c9103ba8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:31.707593 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a771480-607c-4671-80cf-7f90c9103ba8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:31.708062 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a771480-607c-4671-80cf-7f90c9103ba8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:31.708844 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a771480-607c-4671-80cf-7f90c9103ba8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:31.709297 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a771480-607c-4671-80cf-7f90c9103ba8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:31.736442 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0a771480-607c-4671-80cf-7f90c9103ba8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:31.743508 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0a771480-607c-4671-80cf-7f90c9103ba8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Old instance type m1.heat2, new instance type m1.heat {{(pid=119474) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 31 02:03:31.749854 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0a771480-607c-4671-80cf-7f90c9103ba8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:03:31.750291 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0a771480-607c-4671-80cf-7f90c9103ba8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:03:31.751300 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0a771480-607c-4671-80cf-7f90c9103ba8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:03:31.751748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0a771480-607c-4671-80cf-7f90c9103ba8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:03:31.752175 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-0a771480-607c-4671-80cf-7f90c9103ba8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:03:31.814480 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0a771480-607c-4671-80cf-7f90c9103ba8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "POST /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8/action" status: 202 len: 0 microversion: 2.1 time: 0.120684 Jul 31 02:03:31.815083 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3300/6630] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:03:31 2022] POST /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:03:31.823389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-be5b5d1a-d83a-4583-9602-7c7b319da090 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:31.824013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-be5b5d1a-d83a-4583-9602-7c7b319da090 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:31.830620 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be5b5d1a-d83a-4583-9602-7c7b319da090 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:31.831079 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be5b5d1a-d83a-4583-9602-7c7b319da090 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:31.831874 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be5b5d1a-d83a-4583-9602-7c7b319da090 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:31.832319 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be5b5d1a-d83a-4583-9602-7c7b319da090 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:31.994478 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-be5b5d1a-d83a-4583-9602-7c7b319da090 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:32.002495 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-be5b5d1a-d83a-4583-9602-7c7b319da090 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1678 microversion: 2.1 time: 0.183073 Jul 31 02:03:32.003070 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3331/6631] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:31 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:33.026247 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cb07f982-091b-4540-8163-ea59f0b6e339 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:33.026845 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cb07f982-091b-4540-8163-ea59f0b6e339 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:33.037014 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb07f982-091b-4540-8163-ea59f0b6e339 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:33.037482 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb07f982-091b-4540-8163-ea59f0b6e339 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:33.038258 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb07f982-091b-4540-8163-ea59f0b6e339 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:33.038712 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cb07f982-091b-4540-8163-ea59f0b6e339 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:33.170395 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cb07f982-091b-4540-8163-ea59f0b6e339 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:33.178070 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cb07f982-091b-4540-8163-ea59f0b6e339 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1678 microversion: 2.1 time: 0.157610 Jul 31 02:03:33.178646 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3301/6632] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:33 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:34.200267 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-22f02f62-0baf-4d14-a142-2756f639971e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:34.200816 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-22f02f62-0baf-4d14-a142-2756f639971e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:34.207886 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22f02f62-0baf-4d14-a142-2756f639971e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:34.208347 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22f02f62-0baf-4d14-a142-2756f639971e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:34.209114 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22f02f62-0baf-4d14-a142-2756f639971e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:34.209560 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22f02f62-0baf-4d14-a142-2756f639971e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:34.349183 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-22f02f62-0baf-4d14-a142-2756f639971e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:34.356845 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-22f02f62-0baf-4d14-a142-2756f639971e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1683 microversion: 2.1 time: 0.160562 Jul 31 02:03:34.357506 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3332/6633] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:34 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:35.379564 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-758d0c19-a20e-453f-8e2c-54dbb0c4571c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:35.380195 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-758d0c19-a20e-453f-8e2c-54dbb0c4571c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:35.386995 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-758d0c19-a20e-453f-8e2c-54dbb0c4571c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:35.387633 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-758d0c19-a20e-453f-8e2c-54dbb0c4571c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:35.388457 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-758d0c19-a20e-453f-8e2c-54dbb0c4571c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:35.388913 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-758d0c19-a20e-453f-8e2c-54dbb0c4571c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:35.561754 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-758d0c19-a20e-453f-8e2c-54dbb0c4571c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:35.569913 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-758d0c19-a20e-453f-8e2c-54dbb0c4571c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1683 microversion: 2.1 time: 0.194252 Jul 31 02:03:35.570481 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3302/6634] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:35 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1683 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:36.199583 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2d73f066-275d-49a1-a4da-0f9b8e21e7cc req-b928a3e4-59b2-4d8f-8f7b-e2736bc44da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b576704d-7984-4476-a244-b91d73f2b0c8", "name": "network-vif-unplugged", "status": "completed", "tag": "56baef82-07a8-4206-8099-45f3ee82750f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:03:36.209036 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2d73f066-275d-49a1-a4da-0f9b8e21e7cc req-b928a3e4-59b2-4d8f-8f7b-e2736bc44da4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:36.209491 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2d73f066-275d-49a1-a4da-0f9b8e21e7cc req-b928a3e4-59b2-4d8f-8f7b-e2736bc44da4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:36.224222 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2d73f066-275d-49a1-a4da-0f9b8e21e7cc req-b928a3e4-59b2-4d8f-8f7b-e2736bc44da4 service nova] Creating event network-vif-unplugged:56baef82-07a8-4206-8099-45f3ee82750f for instance b576704d-7984-4476-a244-b91d73f2b0c8 on n-h2-master-1 Jul 31 02:03:36.229635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-2d73f066-275d-49a1-a4da-0f9b8e21e7cc req-b928a3e4-59b2-4d8f-8f7b-e2736bc44da4 service nova] Instance b576704d-7984-4476-a244-b91d73f2b0c8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:03:36.241116 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2d73f066-275d-49a1-a4da-0f9b8e21e7cc req-b928a3e4-59b2-4d8f-8f7b-e2736bc44da4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114074 Jul 31 02:03:36.242130 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3333/6635] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:03:36.591960 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ec3b4358-f6e5-435f-b8f0-e74e25e57f02 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:36.592594 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ec3b4358-f6e5-435f-b8f0-e74e25e57f02 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:36.600187 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec3b4358-f6e5-435f-b8f0-e74e25e57f02 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:36.600654 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec3b4358-f6e5-435f-b8f0-e74e25e57f02 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:36.601472 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec3b4358-f6e5-435f-b8f0-e74e25e57f02 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:36.601929 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec3b4358-f6e5-435f-b8f0-e74e25e57f02 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:36.806218 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ec3b4358-f6e5-435f-b8f0-e74e25e57f02 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:36.813833 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ec3b4358-f6e5-435f-b8f0-e74e25e57f02 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1682 microversion: 2.1 time: 0.225788 Jul 31 02:03:36.814409 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3303/6636] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:36 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1682 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:37.836810 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5db79707-8847-446a-b68a-482cf828542e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:37.837484 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5db79707-8847-446a-b68a-482cf828542e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:37.843752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5db79707-8847-446a-b68a-482cf828542e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:37.844714 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5db79707-8847-446a-b68a-482cf828542e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:37.845493 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5db79707-8847-446a-b68a-482cf828542e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:37.845939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5db79707-8847-446a-b68a-482cf828542e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:37.977013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5db79707-8847-446a-b68a-482cf828542e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:37.985338 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5db79707-8847-446a-b68a-482cf828542e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1680 microversion: 2.1 time: 0.153699 Jul 31 02:03:37.986119 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3334/6637] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:37 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:38.259855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-6025b8a0-6968-4e84-acaa-dea125459c05 req-f261e540-d99a-4a80-acd8-e4d3dad59248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b576704d-7984-4476-a244-b91d73f2b0c8", "tag": "56baef82-07a8-4206-8099-45f3ee82750f"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:03:38.270931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-6025b8a0-6968-4e84-acaa-dea125459c05 req-f261e540-d99a-4a80-acd8-e4d3dad59248 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:38.271312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-6025b8a0-6968-4e84-acaa-dea125459c05 req-f261e540-d99a-4a80-acd8-e4d3dad59248 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:38.283634 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-6025b8a0-6968-4e84-acaa-dea125459c05 req-f261e540-d99a-4a80-acd8-e4d3dad59248 service nova] Creating event network-changed:56baef82-07a8-4206-8099-45f3ee82750f for instance b576704d-7984-4476-a244-b91d73f2b0c8 on n-h2-master-1 Jul 31 02:03:38.288886 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-6025b8a0-6968-4e84-acaa-dea125459c05 req-f261e540-d99a-4a80-acd8-e4d3dad59248 service nova] Instance b576704d-7984-4476-a244-b91d73f2b0c8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:03:38.299954 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-6025b8a0-6968-4e84-acaa-dea125459c05 req-f261e540-d99a-4a80-acd8-e4d3dad59248 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044058 Jul 31 02:03:38.300553 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3304/6638] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:03:39.007824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6a0dccce-ddfc-484f-bc20-529c7610bb3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:39.008448 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6a0dccce-ddfc-484f-bc20-529c7610bb3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:39.015778 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a0dccce-ddfc-484f-bc20-529c7610bb3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:39.016235 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a0dccce-ddfc-484f-bc20-529c7610bb3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:39.017025 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a0dccce-ddfc-484f-bc20-529c7610bb3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:39.017474 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6a0dccce-ddfc-484f-bc20-529c7610bb3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:39.514817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6a0dccce-ddfc-484f-bc20-529c7610bb3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:39.522327 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6a0dccce-ddfc-484f-bc20-529c7610bb3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1676 microversion: 2.1 time: 0.518439 Jul 31 02:03:39.522923 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3335/6639] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:39 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1676 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:39.546488 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e34fddb6-fbde-4aab-8712-8953ae1539d9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:03:39.547935 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e34fddb6-fbde-4aab-8712-8953ae1539d9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:39.555226 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e34fddb6-fbde-4aab-8712-8953ae1539d9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:39.555746 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e34fddb6-fbde-4aab-8712-8953ae1539d9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:39.556548 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e34fddb6-fbde-4aab-8712-8953ae1539d9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:39.557873 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e34fddb6-fbde-4aab-8712-8953ae1539d9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:39.620025 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e34fddb6-fbde-4aab-8712-8953ae1539d9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "POST /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8/action" status: 204 len: 0 microversion: 2.1 time: 0.078707 Jul 31 02:03:39.620663 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3305/6640] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:03:39 2022] POST /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:03:39.628824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0bcc31de-88d0-48a0-b8af-367f4b1e2437 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:39.629539 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0bcc31de-88d0-48a0-b8af-367f4b1e2437 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:39.635779 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bcc31de-88d0-48a0-b8af-367f4b1e2437 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:39.636379 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bcc31de-88d0-48a0-b8af-367f4b1e2437 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:39.637196 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bcc31de-88d0-48a0-b8af-367f4b1e2437 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:39.637638 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bcc31de-88d0-48a0-b8af-367f4b1e2437 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:39.849608 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0bcc31de-88d0-48a0-b8af-367f4b1e2437 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:39.857252 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0bcc31de-88d0-48a0-b8af-367f4b1e2437 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1676 microversion: 2.1 time: 0.232274 Jul 31 02:03:39.857839 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3336/6641] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:39 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1676 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:03:40.879577 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6604c072-3e5a-4956-b955-65c4b8b6aced tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:40.880376 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6604c072-3e5a-4956-b955-65c4b8b6aced tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:40.886745 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6604c072-3e5a-4956-b955-65c4b8b6aced tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:40.887232 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6604c072-3e5a-4956-b955-65c4b8b6aced tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:40.888032 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6604c072-3e5a-4956-b955-65c4b8b6aced tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:40.888508 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6604c072-3e5a-4956-b955-65c4b8b6aced tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:41.030614 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6604c072-3e5a-4956-b955-65c4b8b6aced tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:41.038762 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6604c072-3e5a-4956-b955-65c4b8b6aced tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1676 microversion: 2.1 time: 0.164363 Jul 31 02:03:41.039419 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3306/6642] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:40 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:42.062122 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1fe373c2-6d5f-4e8f-bd1b-91085aa03347 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:42.062760 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1fe373c2-6d5f-4e8f-bd1b-91085aa03347 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:42.069715 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1fe373c2-6d5f-4e8f-bd1b-91085aa03347 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:42.070191 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1fe373c2-6d5f-4e8f-bd1b-91085aa03347 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:42.070969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1fe373c2-6d5f-4e8f-bd1b-91085aa03347 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:42.071443 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1fe373c2-6d5f-4e8f-bd1b-91085aa03347 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:42.198271 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1fe373c2-6d5f-4e8f-bd1b-91085aa03347 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:42.206404 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1fe373c2-6d5f-4e8f-bd1b-91085aa03347 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1655 microversion: 2.1 time: 0.148237 Jul 31 02:03:42.206979 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3337/6643] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:42 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:42.226632 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9359294a-21a9-4444-800c-141f0e1666de tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:42.227265 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9359294a-21a9-4444-800c-141f0e1666de tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:42.234232 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9359294a-21a9-4444-800c-141f0e1666de tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:42.234702 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9359294a-21a9-4444-800c-141f0e1666de tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:42.235515 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9359294a-21a9-4444-800c-141f0e1666de tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:42.235972 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9359294a-21a9-4444-800c-141f0e1666de tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:42.251196 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:03:42.374008 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9359294a-21a9-4444-800c-141f0e1666de tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:42.382090 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9359294a-21a9-4444-800c-141f0e1666de tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1655 microversion: 2.1 time: 0.159288 Jul 31 02:03:42.382667 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3307/6644] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:42 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1655 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:42.402976 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bdc60387-cefe-427e-9aec-9eda8bb76403 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:03:42.409091 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdc60387-cefe-427e-9aec-9eda8bb76403 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:42.409555 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bdc60387-cefe-427e-9aec-9eda8bb76403 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:42.430671 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bdc60387-cefe-427e-9aec-9eda8bb76403 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Going to try to start instance {{(pid=119475) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 31 02:03:42.434933 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:03:42.472200 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bdc60387-cefe-427e-9aec-9eda8bb76403 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "POST /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8/action" status: 202 len: 0 microversion: 2.1 time: 0.072960 Jul 31 02:03:42.472865 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3338/6645] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:03:42 2022] POST /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:03:42.481242 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8af69253-7d0b-492b-a0ec-165abe015673 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:42.481879 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8af69253-7d0b-492b-a0ec-165abe015673 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:42.487970 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8af69253-7d0b-492b-a0ec-165abe015673 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:42.488441 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8af69253-7d0b-492b-a0ec-165abe015673 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:42.489220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8af69253-7d0b-492b-a0ec-165abe015673 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:42.489673 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8af69253-7d0b-492b-a0ec-165abe015673 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:42.666998 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8af69253-7d0b-492b-a0ec-165abe015673 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:42.674690 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8af69253-7d0b-492b-a0ec-165abe015673 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1664 microversion: 2.1 time: 0.197393 Jul 31 02:03:42.675267 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3308/6646] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:42 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1664 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:43.017536 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-151ebc0e-3408-4d95-b98d-a5e10757e310 req-253acb6d-b2f0-4c3d-a3ed-a25f45f119c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b576704d-7984-4476-a244-b91d73f2b0c8", "name": "network-vif-plugged", "status": "completed", "tag": "56baef82-07a8-4206-8099-45f3ee82750f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:03:43.027159 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-151ebc0e-3408-4d95-b98d-a5e10757e310 req-253acb6d-b2f0-4c3d-a3ed-a25f45f119c7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:43.027700 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-151ebc0e-3408-4d95-b98d-a5e10757e310 req-253acb6d-b2f0-4c3d-a3ed-a25f45f119c7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:43.047828 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-151ebc0e-3408-4d95-b98d-a5e10757e310 req-253acb6d-b2f0-4c3d-a3ed-a25f45f119c7 service nova] Creating event network-vif-plugged:56baef82-07a8-4206-8099-45f3ee82750f for instance b576704d-7984-4476-a244-b91d73f2b0c8 on n-h2-master-1 Jul 31 02:03:43.053326 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-151ebc0e-3408-4d95-b98d-a5e10757e310 req-253acb6d-b2f0-4c3d-a3ed-a25f45f119c7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040194 Jul 31 02:03:43.054203 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3339/6647] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:03:43.696545 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dfb1a8d8-aafe-4f33-9a51-8be3167aceb5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:43.697102 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dfb1a8d8-aafe-4f33-9a51-8be3167aceb5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:43.704787 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dfb1a8d8-aafe-4f33-9a51-8be3167aceb5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:43.705258 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dfb1a8d8-aafe-4f33-9a51-8be3167aceb5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:43.706048 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dfb1a8d8-aafe-4f33-9a51-8be3167aceb5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:43.706507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dfb1a8d8-aafe-4f33-9a51-8be3167aceb5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:43.847817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dfb1a8d8-aafe-4f33-9a51-8be3167aceb5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:43.855696 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dfb1a8d8-aafe-4f33-9a51-8be3167aceb5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1664 microversion: 2.1 time: 0.163177 Jul 31 02:03:43.856447 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3309/6648] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:43 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:44.878638 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-69a2b663-4f6d-44d7-b147-91f7d13939a8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:44.879266 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-69a2b663-4f6d-44d7-b147-91f7d13939a8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:44.886347 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69a2b663-4f6d-44d7-b147-91f7d13939a8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:44.886805 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69a2b663-4f6d-44d7-b147-91f7d13939a8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:44.887600 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69a2b663-4f6d-44d7-b147-91f7d13939a8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:44.888040 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69a2b663-4f6d-44d7-b147-91f7d13939a8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:45.018770 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-69a2b663-4f6d-44d7-b147-91f7d13939a8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:45.026200 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-69a2b663-4f6d-44d7-b147-91f7d13939a8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1668 microversion: 2.1 time: 0.151874 Jul 31 02:03:45.026774 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3340/6649] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:44 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:45.051840 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-91c067a5-b063-4888-8bd8-328b9b449994 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:45.052407 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-91c067a5-b063-4888-8bd8-328b9b449994 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:45.059934 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91c067a5-b063-4888-8bd8-328b9b449994 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:45.060409 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91c067a5-b063-4888-8bd8-328b9b449994 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:45.061198 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91c067a5-b063-4888-8bd8-328b9b449994 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:45.061655 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91c067a5-b063-4888-8bd8-328b9b449994 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:45.086660 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-91c067a5-b063-4888-8bd8-328b9b449994 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:03:45.160543 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-91c067a5-b063-4888-8bd8-328b9b449994 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 204 len: 0 microversion: 2.1 time: 0.112241 Jul 31 02:03:45.161059 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3310/6650] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:03:45 2022] DELETE /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:03:45.169795 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-07aff401-1627-4da1-b91d-75e71d52af6a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:45.170518 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-07aff401-1627-4da1-b91d-75e71d52af6a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:45.176753 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07aff401-1627-4da1-b91d-75e71d52af6a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:45.177189 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07aff401-1627-4da1-b91d-75e71d52af6a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:45.177958 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07aff401-1627-4da1-b91d-75e71d52af6a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:45.178394 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07aff401-1627-4da1-b91d-75e71d52af6a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:45.304823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-07aff401-1627-4da1-b91d-75e71d52af6a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:45.312321 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-07aff401-1627-4da1-b91d-75e71d52af6a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1674 microversion: 2.1 time: 0.147020 Jul 31 02:03:45.313413 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3341/6651] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:45 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:46.335158 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3a65a00e-a945-4972-92cc-37102abbcd27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:46.335817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3a65a00e-a945-4972-92cc-37102abbcd27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:46.338591 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:03:46.343938 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a65a00e-a945-4972-92cc-37102abbcd27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:46.344405 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a65a00e-a945-4972-92cc-37102abbcd27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:46.345180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a65a00e-a945-4972-92cc-37102abbcd27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:46.345620 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a65a00e-a945-4972-92cc-37102abbcd27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:46.486385 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3a65a00e-a945-4972-92cc-37102abbcd27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:46.494389 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3a65a00e-a945-4972-92cc-37102abbcd27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1674 microversion: 2.1 time: 0.163603 Jul 31 02:03:46.495044 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3311/6652] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:46 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:47.451728 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2e1b8962-1ee2-44d2-b0d8-476ec444ac29 req-aae9d7cf-ec95-447a-bb1a-4168b074ef26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b576704d-7984-4476-a244-b91d73f2b0c8", "name": "network-vif-deleted", "tag": "56baef82-07a8-4206-8099-45f3ee82750f"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:03:47.458897 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=39 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:03:47.464876 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2e1b8962-1ee2-44d2-b0d8-476ec444ac29 req-aae9d7cf-ec95-447a-bb1a-4168b074ef26 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:47.465323 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2e1b8962-1ee2-44d2-b0d8-476ec444ac29 req-aae9d7cf-ec95-447a-bb1a-4168b074ef26 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:47.477880 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2e1b8962-1ee2-44d2-b0d8-476ec444ac29 req-aae9d7cf-ec95-447a-bb1a-4168b074ef26 service nova] Creating event network-vif-deleted:56baef82-07a8-4206-8099-45f3ee82750f for instance b576704d-7984-4476-a244-b91d73f2b0c8 on n-h2-master-1 Jul 31 02:03:47.483283 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2e1b8962-1ee2-44d2-b0d8-476ec444ac29 req-aae9d7cf-ec95-447a-bb1a-4168b074ef26 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035563 Jul 31 02:03:47.483931 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3342/6653] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:03:47.517010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-48a6d9f4-4e0d-49ec-9fed-6d288f8def66 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:47.518346 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-48a6d9f4-4e0d-49ec-9fed-6d288f8def66 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:47.530636 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48a6d9f4-4e0d-49ec-9fed-6d288f8def66 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:47.531103 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48a6d9f4-4e0d-49ec-9fed-6d288f8def66 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:47.531953 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48a6d9f4-4e0d-49ec-9fed-6d288f8def66 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:47.532402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48a6d9f4-4e0d-49ec-9fed-6d288f8def66 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:47.597134 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-48a6d9f4-4e0d-49ec-9fed-6d288f8def66 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:47.605164 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-48a6d9f4-4e0d-49ec-9fed-6d288f8def66 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 200 len: 1322 microversion: 2.1 time: 0.092697 Jul 31 02:03:47.605738 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3312/6654] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:47 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 1322 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:48.628553 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-21dfc365-84e6-4d23-bc0d-194bf594ed35 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:48.629924 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-21dfc365-84e6-4d23-bc0d-194bf594ed35 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:48.637143 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21dfc365-84e6-4d23-bc0d-194bf594ed35 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:48.637598 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21dfc365-84e6-4d23-bc0d-194bf594ed35 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:48.638387 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21dfc365-84e6-4d23-bc0d-194bf594ed35 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:48.638914 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-21dfc365-84e6-4d23-bc0d-194bf594ed35 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:48.653032 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-21dfc365-84e6-4d23-bc0d-194bf594ed35 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] HTTP exception thrown: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-21dfc365-84e6-4d23-bc0d-194bf594ed35 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Request method failure captured: Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 HTTP/1.1 Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eJ1I2l5yEhe8PxarxZ9XRm4z-6QjmhbZOvRUbxzByRHW6l8LEbbUxtG2DytV3QuDPs6Keq8bbte8TVSyRSiRWBkH4zpt8Eg76zlOmP_pIHa1L3zACHKWuHbXQcEqAA0sFnYwcj_YJydQgWa7PJBhmxQGIPQylFIUtatKCWUFm6XMLI Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f8bba8850b446fcb8b4cb1aedb51876", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerActionsTestJSON-945544621 Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 50f66e518b9143f485b4a9938cb8dd7c Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: exception: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'b576704d-7984-4476-a244-b91d73f2b0c8'} Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:03:48.654598 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:03:48.661110 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:03:48.661110 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:03:48.661110 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:03:48.661110 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:03:48.661110 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:03:48.661110 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:03:48.661110 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:03:48.661110 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-21dfc365-84e6-4d23-bc0d-194bf594ed35 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Returning 404 to user: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:03:48.661110 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-21dfc365-84e6-4d23-bc0d-194bf594ed35 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 404 len: 111 microversion: 2.1 time: 0.033044 Jul 31 02:03:48.661110 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3343/6655] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:48 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:03:48.671178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-42cb832c-a7fe-4e22-95dd-d867f5e47629 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:48.672042 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-42cb832c-a7fe-4e22-95dd-d867f5e47629 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:48.678721 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42cb832c-a7fe-4e22-95dd-d867f5e47629 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:48.679264 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42cb832c-a7fe-4e22-95dd-d867f5e47629 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:48.680091 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42cb832c-a7fe-4e22-95dd-d867f5e47629 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:48.680549 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-42cb832c-a7fe-4e22-95dd-d867f5e47629 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:48.694309 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-42cb832c-a7fe-4e22-95dd-d867f5e47629 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] HTTP exception thrown: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-42cb832c-a7fe-4e22-95dd-d867f5e47629 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Request method failure captured: Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 HTTP/1.1 Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eJ1I2l5yEhe8PxarxZ9XRm4z-6QjmhbZOvRUbxzByRHW6l8LEbbUxtG2DytV3QuDPs6Keq8bbte8TVSyRSiRWBkH4zpt8Eg76zlOmP_pIHa1L3zACHKWuHbXQcEqAA0sFnYwcj_YJydQgWa7PJBhmxQGIPQylFIUtatKCWUFm6XMLI Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f8bba8850b446fcb8b4cb1aedb51876", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerActionsTestJSON-945544621 Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 50f66e518b9143f485b4a9938cb8dd7c Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: exception: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'b576704d-7984-4476-a244-b91d73f2b0c8'} Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:03:48.695993 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:03:48.701205 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:03:48.701205 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:03:48.701205 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:03:48.701205 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:03:48.701205 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:03:48.701205 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:03:48.701205 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:03:48.701205 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-42cb832c-a7fe-4e22-95dd-d867f5e47629 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Returning 404 to user: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:03:48.701205 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-42cb832c-a7fe-4e22-95dd-d867f5e47629 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 404 len: 111 microversion: 2.1 time: 0.031215 Jul 31 02:03:48.701205 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3313/6656] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:48 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:03:48.748510 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0a96da65-2f6b-4756-91b5-0060f3b3b112 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-286708582", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "3b566735-8db1-4f81-80aa-d07655229680"}], "security_groups": [{"name": "tempest-securitygroup--1769531531"}], "key_name": "tempest-keypair-596934869", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:03:48.853321 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-0a96da65-2f6b-4756-91b5-0060f3b3b112 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] validate_networks() for [('3b566735-8db1-4f81-80aa-d07655229680', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:03:49.272360 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-0a96da65-2f6b-4756-91b5-0060f3b3b112 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:03:49.272796 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-0a96da65-2f6b-4756-91b5-0060f3b3b112 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:03:49.273282 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-0a96da65-2f6b-4756-91b5-0060f3b3b112 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:03:49.273703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-0a96da65-2f6b-4756-91b5-0060f3b3b112 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:03:49.274127 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-0a96da65-2f6b-4756-91b5-0060f3b3b112 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:03:49.282977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a96da65-2f6b-4756-91b5-0060f3b3b112 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:49.283468 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a96da65-2f6b-4756-91b5-0060f3b3b112 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:49.284280 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a96da65-2f6b-4756-91b5-0060f3b3b112 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:49.284729 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0a96da65-2f6b-4756-91b5-0060f3b3b112 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:49.301760 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-0a96da65-2f6b-4756-91b5-0060f3b3b112 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Getting quotas for project 6f8bba8850b446fcb8b4cb1aedb51876. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:03:49.306975 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-0a96da65-2f6b-4756-91b5-0060f3b3b112 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Getting quotas for user 50f66e518b9143f485b4a9938cb8dd7c and project 6f8bba8850b446fcb8b4cb1aedb51876. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:03:49.320051 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0a96da65-2f6b-4756-91b5-0060f3b3b112 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:03:49.322295 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0a96da65-2f6b-4756-91b5-0060f3b3b112 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:03:49.367419 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0a96da65-2f6b-4756-91b5-0060f3b3b112 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.622737 Jul 31 02:03:49.368069 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3344/6657] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:03:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:03:49.379519 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e54b5c68-07a6-4f00-9554-dff30cc12fb6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:49.380164 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e54b5c68-07a6-4f00-9554-dff30cc12fb6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:49.432487 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e54b5c68-07a6-4f00-9554-dff30cc12fb6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:49.440022 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e54b5c68-07a6-4f00-9554-dff30cc12fb6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1237 microversion: 2.1 time: 0.064897 Jul 31 02:03:49.440591 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3314/6658] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:49 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:50.461748 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-694c3d8e-9849-4960-83bd-b3967c71374f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:50.462388 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-694c3d8e-9849-4960-83bd-b3967c71374f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:50.469512 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-694c3d8e-9849-4960-83bd-b3967c71374f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:50.469979 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-694c3d8e-9849-4960-83bd-b3967c71374f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:50.470796 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-694c3d8e-9849-4960-83bd-b3967c71374f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:50.471479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-694c3d8e-9849-4960-83bd-b3967c71374f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:50.541827 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-694c3d8e-9849-4960-83bd-b3967c71374f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:50.549926 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-694c3d8e-9849-4960-83bd-b3967c71374f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1295 microversion: 2.1 time: 0.093109 Jul 31 02:03:50.550509 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3345/6659] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:50 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1295 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:51.572078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-75dcc8ad-f6c8-4de3-9262-b739e110b4aa tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:51.572712 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-75dcc8ad-f6c8-4de3-9262-b739e110b4aa tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:51.583119 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75dcc8ad-f6c8-4de3-9262-b739e110b4aa tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:51.583623 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75dcc8ad-f6c8-4de3-9262-b739e110b4aa tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:51.584421 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75dcc8ad-f6c8-4de3-9262-b739e110b4aa tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:51.584880 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75dcc8ad-f6c8-4de3-9262-b739e110b4aa tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:51.737231 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f01554af-684d-4c4d-aead-44a19c1fe794 req-56582175-a70e-466e-ab25-e12eff25d1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93dfb8e-de00-45b8-bb74-97c5260603a6", "tag": "30d6c01c-f372-4d4d-a108-9180c2521df8"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:03:51.751227 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f01554af-684d-4c4d-aead-44a19c1fe794 req-56582175-a70e-466e-ab25-e12eff25d1b5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:51.752075 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f01554af-684d-4c4d-aead-44a19c1fe794 req-56582175-a70e-466e-ab25-e12eff25d1b5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:51.766060 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f01554af-684d-4c4d-aead-44a19c1fe794 req-56582175-a70e-466e-ab25-e12eff25d1b5 service nova] Creating event network-changed:30d6c01c-f372-4d4d-a108-9180c2521df8 for instance d93dfb8e-de00-45b8-bb74-97c5260603a6 on n-h1-master-1 Jul 31 02:03:51.771296 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f01554af-684d-4c4d-aead-44a19c1fe794 req-56582175-a70e-466e-ab25-e12eff25d1b5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038489 Jul 31 02:03:51.772231 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3346/6660] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:03:51.810039 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-75dcc8ad-f6c8-4de3-9262-b739e110b4aa tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:51.818475 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-75dcc8ad-f6c8-4de3-9262-b739e110b4aa tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1363 microversion: 2.1 time: 0.250147 Jul 31 02:03:51.819321 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3315/6661] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:51 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:52.840706 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d4d62ac2-34ab-4498-a61b-2e9112dc6fe6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:52.841331 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d4d62ac2-34ab-4498-a61b-2e9112dc6fe6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:52.848304 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4d62ac2-34ab-4498-a61b-2e9112dc6fe6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:52.848767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4d62ac2-34ab-4498-a61b-2e9112dc6fe6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:52.849545 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4d62ac2-34ab-4498-a61b-2e9112dc6fe6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:52.849993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d4d62ac2-34ab-4498-a61b-2e9112dc6fe6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:52.978206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d4d62ac2-34ab-4498-a61b-2e9112dc6fe6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:52.986555 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d4d62ac2-34ab-4498-a61b-2e9112dc6fe6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1363 microversion: 2.1 time: 0.150104 Jul 31 02:03:52.987432 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3347/6662] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:52 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:54.008796 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-81736ce0-b43e-48e8-a787-a13bb7198c4f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:54.009424 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-81736ce0-b43e-48e8-a787-a13bb7198c4f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:54.016488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81736ce0-b43e-48e8-a787-a13bb7198c4f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:54.016954 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81736ce0-b43e-48e8-a787-a13bb7198c4f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:54.017735 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81736ce0-b43e-48e8-a787-a13bb7198c4f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:54.018185 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81736ce0-b43e-48e8-a787-a13bb7198c4f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:54.441616 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-81736ce0-b43e-48e8-a787-a13bb7198c4f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:54.449073 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-81736ce0-b43e-48e8-a787-a13bb7198c4f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1363 microversion: 2.1 time: 0.444263 Jul 31 02:03:54.449629 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3316/6663] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:54 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1363 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:55.470964 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b3a97dad-eee3-442e-af4f-e984766647f9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:55.471608 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b3a97dad-eee3-442e-af4f-e984766647f9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:55.478476 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3a97dad-eee3-442e-af4f-e984766647f9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:55.478935 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3a97dad-eee3-442e-af4f-e984766647f9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:55.479737 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3a97dad-eee3-442e-af4f-e984766647f9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:55.480181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b3a97dad-eee3-442e-af4f-e984766647f9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:55.609302 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b3a97dad-eee3-442e-af4f-e984766647f9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:55.616931 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b3a97dad-eee3-442e-af4f-e984766647f9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1363 microversion: 2.1 time: 0.150459 Jul 31 02:03:55.617506 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3348/6664] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:55 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:56.638281 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-86479841-574c-4bcf-a96e-e8a644857963 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:56.638912 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-86479841-574c-4bcf-a96e-e8a644857963 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:56.646784 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86479841-574c-4bcf-a96e-e8a644857963 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:56.647326 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86479841-574c-4bcf-a96e-e8a644857963 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:56.648168 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86479841-574c-4bcf-a96e-e8a644857963 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:56.648668 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86479841-574c-4bcf-a96e-e8a644857963 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:56.813523 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-cd0315c9-9517-4d67-98b3-24a2d6608ca5 req-6efb762f-6fef-4552-a0e4-d5a63f07a509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93dfb8e-de00-45b8-bb74-97c5260603a6", "name": "network-vif-plugged", "status": "completed", "tag": "30d6c01c-f372-4d4d-a108-9180c2521df8"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:03:56.823483 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-cd0315c9-9517-4d67-98b3-24a2d6608ca5 req-6efb762f-6fef-4552-a0e4-d5a63f07a509 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:56.823846 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-cd0315c9-9517-4d67-98b3-24a2d6608ca5 req-6efb762f-6fef-4552-a0e4-d5a63f07a509 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:56.834742 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-cd0315c9-9517-4d67-98b3-24a2d6608ca5 req-6efb762f-6fef-4552-a0e4-d5a63f07a509 service nova] Creating event network-vif-plugged:30d6c01c-f372-4d4d-a108-9180c2521df8 for instance d93dfb8e-de00-45b8-bb74-97c5260603a6 on n-h1-master-1 Jul 31 02:03:56.839750 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-cd0315c9-9517-4d67-98b3-24a2d6608ca5 req-6efb762f-6fef-4552-a0e4-d5a63f07a509 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111157 Jul 31 02:03:56.840347 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3349/6665] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:03:56.848758 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-86479841-574c-4bcf-a96e-e8a644857963 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:56.856154 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-86479841-574c-4bcf-a96e-e8a644857963 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1363 microversion: 2.1 time: 0.221819 Jul 31 02:03:56.856716 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3317/6666] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:56 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:57.880343 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a9ec781b-e11b-44df-a9f7-cb105da37877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:57.881004 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a9ec781b-e11b-44df-a9f7-cb105da37877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:57.887271 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9ec781b-e11b-44df-a9f7-cb105da37877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:57.887761 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9ec781b-e11b-44df-a9f7-cb105da37877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:57.888535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9ec781b-e11b-44df-a9f7-cb105da37877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:57.888982 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9ec781b-e11b-44df-a9f7-cb105da37877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:58.064733 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a9ec781b-e11b-44df-a9f7-cb105da37877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:58.073345 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a9ec781b-e11b-44df-a9f7-cb105da37877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1363 microversion: 2.1 time: 0.198717 Jul 31 02:03:58.073922 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3350/6667] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:57 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:59.095244 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6ef3a438-ea6e-451f-a30f-b1482bfc237d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:59.095882 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6ef3a438-ea6e-451f-a30f-b1482bfc237d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:59.102778 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6ef3a438-ea6e-451f-a30f-b1482bfc237d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:59.103236 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6ef3a438-ea6e-451f-a30f-b1482bfc237d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:59.104034 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6ef3a438-ea6e-451f-a30f-b1482bfc237d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:59.104479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6ef3a438-ea6e-451f-a30f-b1482bfc237d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:59.237685 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6ef3a438-ea6e-451f-a30f-b1482bfc237d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:03:59.245470 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6ef3a438-ea6e-451f-a30f-b1482bfc237d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1549 microversion: 2.1 time: 0.154124 Jul 31 02:03:59.246028 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3318/6668] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:03:59 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:03:59.267127 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-068afac5-7d41-4e76-84a2-3660ca57372a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:03:59.267663 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-068afac5-7d41-4e76-84a2-3660ca57372a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:03:59.274453 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-068afac5-7d41-4e76-84a2-3660ca57372a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:59.274914 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-068afac5-7d41-4e76-84a2-3660ca57372a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:59.275713 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-068afac5-7d41-4e76-84a2-3660ca57372a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:03:59.276163 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-068afac5-7d41-4e76-84a2-3660ca57372a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:03:59.292429 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:03:59.314977 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:03:59.354609 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-068afac5-7d41-4e76-84a2-3660ca57372a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091327 Jul 31 02:03:59.355213 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3351/6669] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 02:03:59 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:04:00.292690 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-28fc7c89-2478-4cab-b87c-b9371bd78c04 req-372d3562-9a3c-44c0-af17-7ff45707b22e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93dfb8e-de00-45b8-bb74-97c5260603a6", "tag": "30d6c01c-f372-4d4d-a108-9180c2521df8"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:04:00.297610 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:04:00.304321 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-28fc7c89-2478-4cab-b87c-b9371bd78c04 req-372d3562-9a3c-44c0-af17-7ff45707b22e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:00.304853 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-28fc7c89-2478-4cab-b87c-b9371bd78c04 req-372d3562-9a3c-44c0-af17-7ff45707b22e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:00.316444 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-28fc7c89-2478-4cab-b87c-b9371bd78c04 req-372d3562-9a3c-44c0-af17-7ff45707b22e service nova] Creating event network-changed:30d6c01c-f372-4d4d-a108-9180c2521df8 for instance d93dfb8e-de00-45b8-bb74-97c5260603a6 on n-h1-master-1 Jul 31 02:04:00.321528 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-28fc7c89-2478-4cab-b87c-b9371bd78c04 req-372d3562-9a3c-44c0-af17-7ff45707b22e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032481 Jul 31 02:04:00.322211 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3319/6670] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:04:19.093114 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:04:19.093742 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 02:04:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:04:19.383609 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:04:19.384122 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 02:04:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:04:33.220718 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:04:33.222007 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:04:33.226559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ca4bd17c-3b50-46b3-afc1-0713c6c94b27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:04:33.228863 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ca4bd17c-3b50-46b3-afc1-0713c6c94b27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:33.237986 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca4bd17c-3b50-46b3-afc1-0713c6c94b27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:33.238453 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca4bd17c-3b50-46b3-afc1-0713c6c94b27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:33.239232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca4bd17c-3b50-46b3-afc1-0713c6c94b27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:33.239711 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ca4bd17c-3b50-46b3-afc1-0713c6c94b27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:33.267169 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ca4bd17c-3b50-46b3-afc1-0713c6c94b27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:33.273341 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ca4bd17c-3b50-46b3-afc1-0713c6c94b27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Old instance type m1.heat2, new instance type m1.heat {{(pid=119475) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 31 02:04:33.279496 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ca4bd17c-3b50-46b3-afc1-0713c6c94b27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:04:33.279929 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ca4bd17c-3b50-46b3-afc1-0713c6c94b27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:04:33.280414 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ca4bd17c-3b50-46b3-afc1-0713c6c94b27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:04:33.280835 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ca4bd17c-3b50-46b3-afc1-0713c6c94b27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:04:33.281256 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-ca4bd17c-3b50-46b3-afc1-0713c6c94b27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:04:33.342903 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ca4bd17c-3b50-46b3-afc1-0713c6c94b27 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "POST /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6/action" status: 202 len: 0 microversion: 2.1 time: 0.123802 Jul 31 02:04:33.347073 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3352/6671] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:04:33 2022] POST /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:04:33.350716 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=19 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:04:33.351769 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:04:33.355920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e7e860ef-4c01-479c-b656-916b3f0f47f5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:33.356711 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e7e860ef-4c01-479c-b656-916b3f0f47f5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:33.370648 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7e860ef-4c01-479c-b656-916b3f0f47f5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:33.371114 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7e860ef-4c01-479c-b656-916b3f0f47f5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:33.371931 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7e860ef-4c01-479c-b656-916b3f0f47f5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:33.372381 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7e860ef-4c01-479c-b656-916b3f0f47f5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:33.598796 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e7e860ef-4c01-479c-b656-916b3f0f47f5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:33.607102 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e7e860ef-4c01-479c-b656-916b3f0f47f5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1677 microversion: 2.1 time: 0.258490 Jul 31 02:04:33.607701 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3320/6672] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:33 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1677 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:34.630911 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d515b87f-267f-4b19-a7d5-9e176246ff40 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:34.631630 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d515b87f-267f-4b19-a7d5-9e176246ff40 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:34.637718 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d515b87f-267f-4b19-a7d5-9e176246ff40 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:34.638180 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d515b87f-267f-4b19-a7d5-9e176246ff40 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:34.638950 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d515b87f-267f-4b19-a7d5-9e176246ff40 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:34.639423 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d515b87f-267f-4b19-a7d5-9e176246ff40 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:34.883647 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d515b87f-267f-4b19-a7d5-9e176246ff40 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:34.891145 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d515b87f-267f-4b19-a7d5-9e176246ff40 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1677 microversion: 2.1 time: 0.265582 Jul 31 02:04:34.892003 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3353/6673] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:34 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1677 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:35.912646 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8f470e17-4975-4ff6-8f01-c5d94cba4da4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:35.913200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8f470e17-4975-4ff6-8f01-c5d94cba4da4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:35.919937 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f470e17-4975-4ff6-8f01-c5d94cba4da4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:35.920409 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f470e17-4975-4ff6-8f01-c5d94cba4da4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:35.921222 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f470e17-4975-4ff6-8f01-c5d94cba4da4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:35.921678 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f470e17-4975-4ff6-8f01-c5d94cba4da4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:36.051563 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8f470e17-4975-4ff6-8f01-c5d94cba4da4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:36.059003 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8f470e17-4975-4ff6-8f01-c5d94cba4da4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1682 microversion: 2.1 time: 0.150890 Jul 31 02:04:36.059608 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3321/6674] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:35 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:37.082435 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5e76828d-7285-4f2e-8485-d9094bffe3b2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:37.082435 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5e76828d-7285-4f2e-8485-d9094bffe3b2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:37.089454 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e76828d-7285-4f2e-8485-d9094bffe3b2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:37.089893 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e76828d-7285-4f2e-8485-d9094bffe3b2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:37.090670 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e76828d-7285-4f2e-8485-d9094bffe3b2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:37.091117 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e76828d-7285-4f2e-8485-d9094bffe3b2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:37.249339 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5e76828d-7285-4f2e-8485-d9094bffe3b2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:37.257366 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5e76828d-7285-4f2e-8485-d9094bffe3b2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1682 microversion: 2.1 time: 0.180796 Jul 31 02:04:37.257940 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3354/6675] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:37 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:38.281160 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-edfbe8bc-d0e9-4bf1-a9ee-e8bf93ce09a3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:38.281788 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-edfbe8bc-d0e9-4bf1-a9ee-e8bf93ce09a3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:38.289486 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-edfbe8bc-d0e9-4bf1-a9ee-e8bf93ce09a3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:38.289959 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-edfbe8bc-d0e9-4bf1-a9ee-e8bf93ce09a3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:38.290734 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-edfbe8bc-d0e9-4bf1-a9ee-e8bf93ce09a3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:38.291184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-edfbe8bc-d0e9-4bf1-a9ee-e8bf93ce09a3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:38.418723 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-edfbe8bc-d0e9-4bf1-a9ee-e8bf93ce09a3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:38.426561 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-edfbe8bc-d0e9-4bf1-a9ee-e8bf93ce09a3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1682 microversion: 2.1 time: 0.149297 Jul 31 02:04:38.427129 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3322/6676] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:38 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:39.448173 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-96c1a410-72f0-4c91-9752-99cc2727c3f1 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:39.448791 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-96c1a410-72f0-4c91-9752-99cc2727c3f1 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:39.455610 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96c1a410-72f0-4c91-9752-99cc2727c3f1 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:39.456064 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96c1a410-72f0-4c91-9752-99cc2727c3f1 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:39.457475 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96c1a410-72f0-4c91-9752-99cc2727c3f1 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:39.457911 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-96c1a410-72f0-4c91-9752-99cc2727c3f1 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:39.594308 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-96c1a410-72f0-4c91-9752-99cc2727c3f1 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:39.601954 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-96c1a410-72f0-4c91-9752-99cc2727c3f1 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1682 microversion: 2.1 time: 0.157694 Jul 31 02:04:39.602760 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3355/6677] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:39 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:40.623683 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1cc3b52d-af57-473c-a2cb-f5bd986866f9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:40.624328 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1cc3b52d-af57-473c-a2cb-f5bd986866f9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:40.631219 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cc3b52d-af57-473c-a2cb-f5bd986866f9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:40.631716 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cc3b52d-af57-473c-a2cb-f5bd986866f9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:40.632491 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cc3b52d-af57-473c-a2cb-f5bd986866f9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:40.632942 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1cc3b52d-af57-473c-a2cb-f5bd986866f9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:40.760290 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1cc3b52d-af57-473c-a2cb-f5bd986866f9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:40.767803 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1cc3b52d-af57-473c-a2cb-f5bd986866f9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1682 microversion: 2.1 time: 0.148064 Jul 31 02:04:40.768368 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3323/6678] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:40 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:41.790542 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ad9ed83d-8530-4b71-bb9e-a154bdd712f8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:41.791126 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ad9ed83d-8530-4b71-bb9e-a154bdd712f8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:41.797974 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad9ed83d-8530-4b71-bb9e-a154bdd712f8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:41.798435 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad9ed83d-8530-4b71-bb9e-a154bdd712f8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:41.799212 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad9ed83d-8530-4b71-bb9e-a154bdd712f8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:41.799694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ad9ed83d-8530-4b71-bb9e-a154bdd712f8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:41.928858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ad9ed83d-8530-4b71-bb9e-a154bdd712f8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:41.936356 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ad9ed83d-8530-4b71-bb9e-a154bdd712f8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1682 microversion: 2.1 time: 0.150360 Jul 31 02:04:41.936932 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3356/6679] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:41 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:42.958404 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dec17f6a-1235-42d5-8d44-c2efea09aea8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:42.958964 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dec17f6a-1235-42d5-8d44-c2efea09aea8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:42.965854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dec17f6a-1235-42d5-8d44-c2efea09aea8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:42.966335 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dec17f6a-1235-42d5-8d44-c2efea09aea8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:42.967119 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dec17f6a-1235-42d5-8d44-c2efea09aea8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:42.967607 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dec17f6a-1235-42d5-8d44-c2efea09aea8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:43.095019 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dec17f6a-1235-42d5-8d44-c2efea09aea8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:43.102495 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dec17f6a-1235-42d5-8d44-c2efea09aea8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1682 microversion: 2.1 time: 0.148120 Jul 31 02:04:43.103053 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3324/6680] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:42 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:44.124468 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7b3d4dbf-1805-4ce8-aa60-9c677bffd118 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:44.125087 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7b3d4dbf-1805-4ce8-aa60-9c677bffd118 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:44.136136 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b3d4dbf-1805-4ce8-aa60-9c677bffd118 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:44.136603 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b3d4dbf-1805-4ce8-aa60-9c677bffd118 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:44.137383 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b3d4dbf-1805-4ce8-aa60-9c677bffd118 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:44.137832 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7b3d4dbf-1805-4ce8-aa60-9c677bffd118 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:44.269322 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7b3d4dbf-1805-4ce8-aa60-9c677bffd118 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:44.283876 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7b3d4dbf-1805-4ce8-aa60-9c677bffd118 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1682 microversion: 2.1 time: 0.163157 Jul 31 02:04:44.285351 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3357/6681] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:44 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:45.306595 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-48cea5e2-c8a2-46f9-8906-3607f2f74360 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:45.307235 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-48cea5e2-c8a2-46f9-8906-3607f2f74360 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:45.314274 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48cea5e2-c8a2-46f9-8906-3607f2f74360 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:45.314747 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48cea5e2-c8a2-46f9-8906-3607f2f74360 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:45.315567 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48cea5e2-c8a2-46f9-8906-3607f2f74360 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:45.316617 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48cea5e2-c8a2-46f9-8906-3607f2f74360 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:45.447365 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-48cea5e2-c8a2-46f9-8906-3607f2f74360 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:45.454801 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-48cea5e2-c8a2-46f9-8906-3607f2f74360 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1682 microversion: 2.1 time: 0.152092 Jul 31 02:04:45.455395 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3325/6682] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:45 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:46.475421 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-92c7df04-18f5-41ea-b136-a3a8085ac84e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:46.475982 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-92c7df04-18f5-41ea-b136-a3a8085ac84e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:46.482775 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92c7df04-18f5-41ea-b136-a3a8085ac84e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:46.483231 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92c7df04-18f5-41ea-b136-a3a8085ac84e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:46.484035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92c7df04-18f5-41ea-b136-a3a8085ac84e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:46.484478 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-92c7df04-18f5-41ea-b136-a3a8085ac84e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:46.614938 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-92c7df04-18f5-41ea-b136-a3a8085ac84e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:46.622921 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-92c7df04-18f5-41ea-b136-a3a8085ac84e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1682 microversion: 2.1 time: 0.151552 Jul 31 02:04:46.623534 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3358/6683] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:46 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:47.645466 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b248208b-1f83-4772-a33a-dd437cf2541f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:47.646096 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b248208b-1f83-4772-a33a-dd437cf2541f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:47.653189 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b248208b-1f83-4772-a33a-dd437cf2541f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:47.653658 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b248208b-1f83-4772-a33a-dd437cf2541f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:47.654433 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b248208b-1f83-4772-a33a-dd437cf2541f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:47.654889 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b248208b-1f83-4772-a33a-dd437cf2541f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:47.785668 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b248208b-1f83-4772-a33a-dd437cf2541f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:47.793244 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b248208b-1f83-4772-a33a-dd437cf2541f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1682 microversion: 2.1 time: 0.151739 Jul 31 02:04:47.793811 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3326/6684] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:47 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:48.815093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8ae57973-4a63-4307-a72e-d9cdff4b2579 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:48.816441 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8ae57973-4a63-4307-a72e-d9cdff4b2579 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:48.824012 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ae57973-4a63-4307-a72e-d9cdff4b2579 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:48.824485 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ae57973-4a63-4307-a72e-d9cdff4b2579 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:48.825336 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ae57973-4a63-4307-a72e-d9cdff4b2579 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:48.825861 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8ae57973-4a63-4307-a72e-d9cdff4b2579 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:48.958190 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8ae57973-4a63-4307-a72e-d9cdff4b2579 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:48.969873 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8ae57973-4a63-4307-a72e-d9cdff4b2579 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1682 microversion: 2.1 time: 0.154945 Jul 31 02:04:48.969873 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3359/6685] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:48 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:49.990060 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ef9fac73-3803-4e43-8078-65c3b19b1fe5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:49.990902 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ef9fac73-3803-4e43-8078-65c3b19b1fe5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:49.997490 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef9fac73-3803-4e43-8078-65c3b19b1fe5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:49.997965 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef9fac73-3803-4e43-8078-65c3b19b1fe5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:49.998748 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef9fac73-3803-4e43-8078-65c3b19b1fe5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:49.999204 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef9fac73-3803-4e43-8078-65c3b19b1fe5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:50.130822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ef9fac73-3803-4e43-8078-65c3b19b1fe5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:50.138859 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ef9fac73-3803-4e43-8078-65c3b19b1fe5 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1682 microversion: 2.1 time: 0.153502 Jul 31 02:04:50.139466 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3327/6686] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:49 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:51.162037 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3585f940-bbb6-4a24-ab98-8ad41baeb4e4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:51.162668 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3585f940-bbb6-4a24-ab98-8ad41baeb4e4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:51.169641 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3585f940-bbb6-4a24-ab98-8ad41baeb4e4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:51.170104 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3585f940-bbb6-4a24-ab98-8ad41baeb4e4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:51.170878 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3585f940-bbb6-4a24-ab98-8ad41baeb4e4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:51.171331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3585f940-bbb6-4a24-ab98-8ad41baeb4e4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:51.301274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3585f940-bbb6-4a24-ab98-8ad41baeb4e4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:51.308665 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3585f940-bbb6-4a24-ab98-8ad41baeb4e4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1682 microversion: 2.1 time: 0.151123 Jul 31 02:04:51.309238 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3360/6687] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:51 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:52.330761 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-59389da9-3157-4f0d-bc9e-b5e9e348b083 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:52.331579 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-59389da9-3157-4f0d-bc9e-b5e9e348b083 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:52.339957 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59389da9-3157-4f0d-bc9e-b5e9e348b083 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:52.340514 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59389da9-3157-4f0d-bc9e-b5e9e348b083 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:52.341388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59389da9-3157-4f0d-bc9e-b5e9e348b083 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:52.341914 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59389da9-3157-4f0d-bc9e-b5e9e348b083 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:52.867817 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-59389da9-3157-4f0d-bc9e-b5e9e348b083 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:52.875544 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-59389da9-3157-4f0d-bc9e-b5e9e348b083 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1681 microversion: 2.1 time: 0.548956 Jul 31 02:04:52.876112 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3328/6688] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:52 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1681 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:53.108798 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-44915ba6-404a-441c-afef-5e107408ddff req-ea793465-ce4c-4147-9186-f98fad8d424f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93dfb8e-de00-45b8-bb74-97c5260603a6", "name": "network-vif-unplugged", "status": "completed", "tag": "30d6c01c-f372-4d4d-a108-9180c2521df8"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:04:53.119197 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-44915ba6-404a-441c-afef-5e107408ddff req-ea793465-ce4c-4147-9186-f98fad8d424f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:53.119667 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-44915ba6-404a-441c-afef-5e107408ddff req-ea793465-ce4c-4147-9186-f98fad8d424f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:53.133913 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-44915ba6-404a-441c-afef-5e107408ddff req-ea793465-ce4c-4147-9186-f98fad8d424f service nova] Creating event network-vif-unplugged:30d6c01c-f372-4d4d-a108-9180c2521df8 for instance d93dfb8e-de00-45b8-bb74-97c5260603a6 on n-h2-master-1 Jul 31 02:04:53.139283 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-44915ba6-404a-441c-afef-5e107408ddff req-ea793465-ce4c-4147-9186-f98fad8d424f service nova] Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:04:53.149942 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-44915ba6-404a-441c-afef-5e107408ddff req-ea793465-ce4c-4147-9186-f98fad8d424f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094632 Jul 31 02:04:53.150556 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3361/6689] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:04:53.897909 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-39653b60-f1ea-48d1-8f9b-204c570e8489 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:53.898573 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-39653b60-f1ea-48d1-8f9b-204c570e8489 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:53.905388 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39653b60-f1ea-48d1-8f9b-204c570e8489 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:53.905865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39653b60-f1ea-48d1-8f9b-204c570e8489 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:53.906655 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39653b60-f1ea-48d1-8f9b-204c570e8489 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:53.907115 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-39653b60-f1ea-48d1-8f9b-204c570e8489 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:54.120925 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-39653b60-f1ea-48d1-8f9b-204c570e8489 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:54.128398 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-39653b60-f1ea-48d1-8f9b-204c570e8489 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1681 microversion: 2.1 time: 0.234402 Jul 31 02:04:54.129112 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3329/6690] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:53 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:55.158353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f88a28ec-8c76-4d27-aca9-877865d59fbe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:55.158922 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f88a28ec-8c76-4d27-aca9-877865d59fbe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:55.165241 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f88a28ec-8c76-4d27-aca9-877865d59fbe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:55.165497 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1b1635fe-b824-4f62-a549-599af2fdae49 req-3cf9840b-eef3-4f3f-862b-e3ac6935ad66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93dfb8e-de00-45b8-bb74-97c5260603a6", "tag": "30d6c01c-f372-4d4d-a108-9180c2521df8"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:04:55.165976 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f88a28ec-8c76-4d27-aca9-877865d59fbe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:55.166474 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f88a28ec-8c76-4d27-aca9-877865d59fbe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:55.166917 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f88a28ec-8c76-4d27-aca9-877865d59fbe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:55.176234 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1b1635fe-b824-4f62-a549-599af2fdae49 req-3cf9840b-eef3-4f3f-862b-e3ac6935ad66 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:55.176699 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1b1635fe-b824-4f62-a549-599af2fdae49 req-3cf9840b-eef3-4f3f-862b-e3ac6935ad66 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:55.188064 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1b1635fe-b824-4f62-a549-599af2fdae49 req-3cf9840b-eef3-4f3f-862b-e3ac6935ad66 service nova] Creating event network-changed:30d6c01c-f372-4d4d-a108-9180c2521df8 for instance d93dfb8e-de00-45b8-bb74-97c5260603a6 on n-h2-master-1 Jul 31 02:04:55.193965 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-1b1635fe-b824-4f62-a549-599af2fdae49 req-3cf9840b-eef3-4f3f-862b-e3ac6935ad66 service nova] Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:04:55.204784 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1b1635fe-b824-4f62-a549-599af2fdae49 req-3cf9840b-eef3-4f3f-862b-e3ac6935ad66 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042953 Jul 31 02:04:55.205385 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3330/6691] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:04:55.350522 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f88a28ec-8c76-4d27-aca9-877865d59fbe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:55.358128 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f88a28ec-8c76-4d27-aca9-877865d59fbe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1679 microversion: 2.1 time: 0.205167 Jul 31 02:04:55.358702 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3362/6692] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:55 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1679 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:56.382650 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cdf56d87-0e79-4e98-8a66-6ccd6d63ecad tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:56.383390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cdf56d87-0e79-4e98-8a66-6ccd6d63ecad tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:56.389623 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cdf56d87-0e79-4e98-8a66-6ccd6d63ecad tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:56.390088 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cdf56d87-0e79-4e98-8a66-6ccd6d63ecad tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:56.390864 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cdf56d87-0e79-4e98-8a66-6ccd6d63ecad tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:56.391312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cdf56d87-0e79-4e98-8a66-6ccd6d63ecad tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:56.603909 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cdf56d87-0e79-4e98-8a66-6ccd6d63ecad tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:56.611726 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cdf56d87-0e79-4e98-8a66-6ccd6d63ecad tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1676 microversion: 2.1 time: 0.234755 Jul 31 02:04:56.612234 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3331/6693] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:56 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:56.632791 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-13d645b5-7651-4a20-8540-bf6522c03b24 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:04:56.633346 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-13d645b5-7651-4a20-8540-bf6522c03b24 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:56.640199 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13d645b5-7651-4a20-8540-bf6522c03b24 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:56.640667 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13d645b5-7651-4a20-8540-bf6522c03b24 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:56.641438 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13d645b5-7651-4a20-8540-bf6522c03b24 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:56.641888 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13d645b5-7651-4a20-8540-bf6522c03b24 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:56.678983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13d645b5-7651-4a20-8540-bf6522c03b24 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:56.679460 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13d645b5-7651-4a20-8540-bf6522c03b24 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:56.680268 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13d645b5-7651-4a20-8540-bf6522c03b24 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:56.680718 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13d645b5-7651-4a20-8540-bf6522c03b24 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:56.701411 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-13d645b5-7651-4a20-8540-bf6522c03b24 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Getting quotas for project 6f8bba8850b446fcb8b4cb1aedb51876. Resources: {'cores', 'ram'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:04:56.706615 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-13d645b5-7651-4a20-8540-bf6522c03b24 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Getting quotas for user 50f66e518b9143f485b4a9938cb8dd7c and project 6f8bba8850b446fcb8b4cb1aedb51876. Resources: {'cores', 'ram'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:04:56.809795 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-13d645b5-7651-4a20-8540-bf6522c03b24 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "POST /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6/action" status: 202 len: 0 microversion: 2.1 time: 0.180649 Jul 31 02:04:56.810384 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3363/6694] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:04:56 2022] POST /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:04:56.819214 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4b9eb22a-51eb-4465-b782-23a8aec2ccc0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:56.820028 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4b9eb22a-51eb-4465-b782-23a8aec2ccc0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:56.826368 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b9eb22a-51eb-4465-b782-23a8aec2ccc0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:56.826986 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b9eb22a-51eb-4465-b782-23a8aec2ccc0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:56.827833 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b9eb22a-51eb-4465-b782-23a8aec2ccc0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:56.828293 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4b9eb22a-51eb-4465-b782-23a8aec2ccc0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:57.036585 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4b9eb22a-51eb-4465-b782-23a8aec2ccc0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:57.044100 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4b9eb22a-51eb-4465-b782-23a8aec2ccc0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1675 microversion: 2.1 time: 0.229276 Jul 31 02:04:57.044651 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3332/6695] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:56 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:58.067309 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cdf3209f-f11a-4791-8d2b-283a01761227 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:58.068042 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cdf3209f-f11a-4791-8d2b-283a01761227 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:58.075157 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdf3209f-f11a-4791-8d2b-283a01761227 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:58.075650 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdf3209f-f11a-4791-8d2b-283a01761227 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:58.076431 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdf3209f-f11a-4791-8d2b-283a01761227 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:58.076882 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdf3209f-f11a-4791-8d2b-283a01761227 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:58.094243 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:04:58.213069 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cdf3209f-f11a-4791-8d2b-283a01761227 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:58.220523 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cdf3209f-f11a-4791-8d2b-283a01761227 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1675 microversion: 2.1 time: 0.158366 Jul 31 02:04:58.221098 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3364/6696] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:58 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:59.242900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-58aa40d5-925e-4ccb-b041-b3dab53a8f8c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:04:59.243559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-58aa40d5-925e-4ccb-b041-b3dab53a8f8c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:04:59.250614 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58aa40d5-925e-4ccb-b041-b3dab53a8f8c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:59.251078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58aa40d5-925e-4ccb-b041-b3dab53a8f8c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:59.251890 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58aa40d5-925e-4ccb-b041-b3dab53a8f8c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:59.252347 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-58aa40d5-925e-4ccb-b041-b3dab53a8f8c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:59.417224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-58aa40d5-925e-4ccb-b041-b3dab53a8f8c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:04:59.425527 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-58aa40d5-925e-4ccb-b041-b3dab53a8f8c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1675 microversion: 2.1 time: 0.187171 Jul 31 02:04:59.427256 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3333/6697] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:04:59 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:04:59.523020 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-ae480ead-0999-4544-89ff-58ee3c793a1c req-a5fc1ff5-40f3-4d29-a3f0-01da79a1c726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93dfb8e-de00-45b8-bb74-97c5260603a6", "name": "network-vif-plugged", "status": "completed", "tag": "30d6c01c-f372-4d4d-a108-9180c2521df8"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:04:59.532859 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ae480ead-0999-4544-89ff-58ee3c793a1c req-a5fc1ff5-40f3-4d29-a3f0-01da79a1c726 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:04:59.533326 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ae480ead-0999-4544-89ff-58ee3c793a1c req-a5fc1ff5-40f3-4d29-a3f0-01da79a1c726 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:04:59.545506 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-ae480ead-0999-4544-89ff-58ee3c793a1c req-a5fc1ff5-40f3-4d29-a3f0-01da79a1c726 service nova] Creating event network-vif-plugged:30d6c01c-f372-4d4d-a108-9180c2521df8 for instance d93dfb8e-de00-45b8-bb74-97c5260603a6 on n-h1-master-1 Jul 31 02:04:59.550953 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-ae480ead-0999-4544-89ff-58ee3c793a1c req-a5fc1ff5-40f3-4d29-a3f0-01da79a1c726 service nova] Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:04:59.561720 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-ae480ead-0999-4544-89ff-58ee3c793a1c req-a5fc1ff5-40f3-4d29-a3f0-01da79a1c726 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094266 Jul 31 02:04:59.562342 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3365/6698] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:05:00.087999 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-0f063e41-c8b2-4954-8cb4-80367960a18d req-c8865d71-3658-46d7-bc32-8707a6933058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93dfb8e-de00-45b8-bb74-97c5260603a6", "name": "network-vif-unplugged", "status": "completed", "tag": "30d6c01c-f372-4d4d-a108-9180c2521df8"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:05:00.098008 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0f063e41-c8b2-4954-8cb4-80367960a18d req-c8865d71-3658-46d7-bc32-8707a6933058 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:00.098667 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0f063e41-c8b2-4954-8cb4-80367960a18d req-c8865d71-3658-46d7-bc32-8707a6933058 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:00.113393 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-0f063e41-c8b2-4954-8cb4-80367960a18d req-c8865d71-3658-46d7-bc32-8707a6933058 service nova] Creating event network-vif-unplugged:30d6c01c-f372-4d4d-a108-9180c2521df8 for instance d93dfb8e-de00-45b8-bb74-97c5260603a6 on n-h1-master-1 Jul 31 02:05:00.119031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-0f063e41-c8b2-4954-8cb4-80367960a18d req-c8865d71-3658-46d7-bc32-8707a6933058 service nova] Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:05:00.130804 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-0f063e41-c8b2-4954-8cb4-80367960a18d req-c8865d71-3658-46d7-bc32-8707a6933058 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046647 Jul 31 02:05:00.131435 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3334/6699] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:05:00.452054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7f61c3b9-95f2-4941-9830-40e6be30af9d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:00.452776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7f61c3b9-95f2-4941-9830-40e6be30af9d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:00.459843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f61c3b9-95f2-4941-9830-40e6be30af9d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:00.460314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f61c3b9-95f2-4941-9830-40e6be30af9d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:00.461136 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f61c3b9-95f2-4941-9830-40e6be30af9d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:00.461591 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7f61c3b9-95f2-4941-9830-40e6be30af9d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:00.681215 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7f61c3b9-95f2-4941-9830-40e6be30af9d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:00.689378 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7f61c3b9-95f2-4941-9830-40e6be30af9d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1675 microversion: 2.1 time: 0.243253 Jul 31 02:05:00.696640 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3366/6700] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:00 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1675 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:01.711894 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cd01030f-1f3a-47da-91d6-0c05e0c6975e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:01.712603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cd01030f-1f3a-47da-91d6-0c05e0c6975e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:01.719613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd01030f-1f3a-47da-91d6-0c05e0c6975e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:01.720080 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd01030f-1f3a-47da-91d6-0c05e0c6975e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:01.720853 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd01030f-1f3a-47da-91d6-0c05e0c6975e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:01.721299 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cd01030f-1f3a-47da-91d6-0c05e0c6975e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:01.855896 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cd01030f-1f3a-47da-91d6-0c05e0c6975e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:01.863547 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cd01030f-1f3a-47da-91d6-0c05e0c6975e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1675 microversion: 2.1 time: 0.155855 Jul 31 02:05:01.864126 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3335/6701] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:01 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:02.171596 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-8363e770-cc7a-40b4-846f-734525e2706c req-830db21c-071e-4cd2-9b52-c3ec09f7f7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93dfb8e-de00-45b8-bb74-97c5260603a6", "tag": "30d6c01c-f372-4d4d-a108-9180c2521df8"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:05:02.181753 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8363e770-cc7a-40b4-846f-734525e2706c req-830db21c-071e-4cd2-9b52-c3ec09f7f7c4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:02.182206 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8363e770-cc7a-40b4-846f-734525e2706c req-830db21c-071e-4cd2-9b52-c3ec09f7f7c4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:02.194071 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-8363e770-cc7a-40b4-846f-734525e2706c req-830db21c-071e-4cd2-9b52-c3ec09f7f7c4 service nova] Creating event network-changed:30d6c01c-f372-4d4d-a108-9180c2521df8 for instance d93dfb8e-de00-45b8-bb74-97c5260603a6 on n-h1-master-1 Jul 31 02:05:02.199284 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-8363e770-cc7a-40b4-846f-734525e2706c req-830db21c-071e-4cd2-9b52-c3ec09f7f7c4 service nova] Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:05:02.210321 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-8363e770-cc7a-40b4-846f-734525e2706c req-830db21c-071e-4cd2-9b52-c3ec09f7f7c4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042422 Jul 31 02:05:02.210912 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3367/6702] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:05:02.886957 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8295f703-658e-498e-8811-f475b53fa8ee tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:02.887606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8295f703-658e-498e-8811-f475b53fa8ee tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:02.895145 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8295f703-658e-498e-8811-f475b53fa8ee tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:02.895648 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8295f703-658e-498e-8811-f475b53fa8ee tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:02.896432 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8295f703-658e-498e-8811-f475b53fa8ee tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:02.896881 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8295f703-658e-498e-8811-f475b53fa8ee tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:03.129268 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8295f703-658e-498e-8811-f475b53fa8ee tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:03.137529 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8295f703-658e-498e-8811-f475b53fa8ee tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1668 microversion: 2.1 time: 0.254429 Jul 31 02:05:03.138496 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3336/6703] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:02 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1668 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:05:03.159049 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0adcbbea-5ef7-444a-9452-c442847b5e83 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:03.159768 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0adcbbea-5ef7-444a-9452-c442847b5e83 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:03.167727 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0adcbbea-5ef7-444a-9452-c442847b5e83 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:03.168303 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0adcbbea-5ef7-444a-9452-c442847b5e83 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:03.169676 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0adcbbea-5ef7-444a-9452-c442847b5e83 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:03.170229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0adcbbea-5ef7-444a-9452-c442847b5e83 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:03.363034 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0adcbbea-5ef7-444a-9452-c442847b5e83 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:03.371539 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0adcbbea-5ef7-444a-9452-c442847b5e83 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1668 microversion: 2.1 time: 0.216666 Jul 31 02:05:03.372109 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3368/6704] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:03 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1668 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:03.392175 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a45c0cff-66b1-48da-8ed4-1afd94bfa447 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:03.392800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a45c0cff-66b1-48da-8ed4-1afd94bfa447 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:03.394748 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=35 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:03.400620 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a45c0cff-66b1-48da-8ed4-1afd94bfa447 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:03.401081 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a45c0cff-66b1-48da-8ed4-1afd94bfa447 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:03.401856 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a45c0cff-66b1-48da-8ed4-1afd94bfa447 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:03.402303 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a45c0cff-66b1-48da-8ed4-1afd94bfa447 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:03.406325 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=99 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:03.533920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a45c0cff-66b1-48da-8ed4-1afd94bfa447 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:03.541589 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a45c0cff-66b1-48da-8ed4-1afd94bfa447 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1668 microversion: 2.1 time: 0.153236 Jul 31 02:05:03.542180 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3337/6705] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:03 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:03.562804 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d6c70f69-0a6b-4924-ab86-c000c4a4bd4d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:03.563624 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d6c70f69-0a6b-4924-ab86-c000c4a4bd4d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:03.566805 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:03.571551 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d6c70f69-0a6b-4924-ab86-c000c4a4bd4d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:03.572013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d6c70f69-0a6b-4924-ab86-c000c4a4bd4d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:03.572906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d6c70f69-0a6b-4924-ab86-c000c4a4bd4d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:03.573382 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d6c70f69-0a6b-4924-ab86-c000c4a4bd4d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:03.603531 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d6c70f69-0a6b-4924-ab86-c000c4a4bd4d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:05:03.680043 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d6c70f69-0a6b-4924-ab86-c000c4a4bd4d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 204 len: 0 microversion: 2.1 time: 0.120724 Jul 31 02:05:03.680767 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3369/6706] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:05:03 2022] DELETE /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:05:03.689272 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-981d1ce1-2662-42cb-98e5-61192e3ed571 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:03.689912 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-981d1ce1-2662-42cb-98e5-61192e3ed571 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:03.696488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-981d1ce1-2662-42cb-98e5-61192e3ed571 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:03.696961 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-981d1ce1-2662-42cb-98e5-61192e3ed571 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:03.697744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-981d1ce1-2662-42cb-98e5-61192e3ed571 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:03.698199 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-981d1ce1-2662-42cb-98e5-61192e3ed571 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:03.830868 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-981d1ce1-2662-42cb-98e5-61192e3ed571 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:03.838437 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-981d1ce1-2662-42cb-98e5-61192e3ed571 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1674 microversion: 2.1 time: 0.153153 Jul 31 02:05:03.839003 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3338/6707] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:03 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:04.861276 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-acc4a630-05e5-447d-826f-871795153e42 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:04.861902 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-acc4a630-05e5-447d-826f-871795153e42 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:04.869082 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-acc4a630-05e5-447d-826f-871795153e42 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:04.869553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-acc4a630-05e5-447d-826f-871795153e42 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:04.870328 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-acc4a630-05e5-447d-826f-871795153e42 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:04.870778 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-acc4a630-05e5-447d-826f-871795153e42 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:05.000965 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-acc4a630-05e5-447d-826f-871795153e42 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:05.011255 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-acc4a630-05e5-447d-826f-871795153e42 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1674 microversion: 2.1 time: 0.154251 Jul 31 02:05:05.011976 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3370/6708] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:04 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:05.132371 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-cc2cb098-55bd-4cde-8855-51a6a734ac9b req-e4747637-1db7-476a-a89e-40a57ede0b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93dfb8e-de00-45b8-bb74-97c5260603a6", "name": "network-vif-plugged", "status": "completed", "tag": "30d6c01c-f372-4d4d-a108-9180c2521df8"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:05:05.142794 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-cc2cb098-55bd-4cde-8855-51a6a734ac9b req-e4747637-1db7-476a-a89e-40a57ede0b32 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:05.143260 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-cc2cb098-55bd-4cde-8855-51a6a734ac9b req-e4747637-1db7-476a-a89e-40a57ede0b32 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:05.155576 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-cc2cb098-55bd-4cde-8855-51a6a734ac9b req-e4747637-1db7-476a-a89e-40a57ede0b32 service nova] Creating event network-vif-plugged:30d6c01c-f372-4d4d-a108-9180c2521df8 for instance d93dfb8e-de00-45b8-bb74-97c5260603a6 on n-h1-master-1 Jul 31 02:05:05.161139 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-cc2cb098-55bd-4cde-8855-51a6a734ac9b req-e4747637-1db7-476a-a89e-40a57ede0b32 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033177 Jul 31 02:05:05.161968 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3339/6709] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:05:05.890605 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-ead7a538-1dce-4037-91bd-7895e34cadf7 req-e0a466b6-16c2-44e9-8c35-bca2ec37bf9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93dfb8e-de00-45b8-bb74-97c5260603a6", "name": "network-vif-deleted", "tag": "30d6c01c-f372-4d4d-a108-9180c2521df8"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:05:05.903531 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ead7a538-1dce-4037-91bd-7895e34cadf7 req-e0a466b6-16c2-44e9-8c35-bca2ec37bf9a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:05.903986 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-ead7a538-1dce-4037-91bd-7895e34cadf7 req-e0a466b6-16c2-44e9-8c35-bca2ec37bf9a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:05.917275 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-ead7a538-1dce-4037-91bd-7895e34cadf7 req-e0a466b6-16c2-44e9-8c35-bca2ec37bf9a service nova] Creating event network-vif-deleted:30d6c01c-f372-4d4d-a108-9180c2521df8 for instance d93dfb8e-de00-45b8-bb74-97c5260603a6 on n-h1-master-1 Jul 31 02:05:05.923234 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-ead7a538-1dce-4037-91bd-7895e34cadf7 req-e0a466b6-16c2-44e9-8c35-bca2ec37bf9a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037146 Jul 31 02:05:05.924054 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3371/6710] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:05:06.033986 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fc5e4212-ee06-4aef-8b47-36e29b569f89 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:06.034719 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fc5e4212-ee06-4aef-8b47-36e29b569f89 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:06.042164 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc5e4212-ee06-4aef-8b47-36e29b569f89 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:06.042640 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc5e4212-ee06-4aef-8b47-36e29b569f89 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:06.043480 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc5e4212-ee06-4aef-8b47-36e29b569f89 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:06.044117 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc5e4212-ee06-4aef-8b47-36e29b569f89 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:06.079192 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc5e4212-ee06-4aef-8b47-36e29b569f89 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:06.079703 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc5e4212-ee06-4aef-8b47-36e29b569f89 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:06.080179 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-fc5e4212-ee06-4aef-8b47-36e29b569f89 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lazy-loading 'fault' on Instance uuid d93dfb8e-de00-45b8-bb74-97c5260603a6 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:05:06.123086 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fc5e4212-ee06-4aef-8b47-36e29b569f89 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:06.130646 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fc5e4212-ee06-4aef-8b47-36e29b569f89 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 200 len: 1327 microversion: 2.1 time: 0.100944 Jul 31 02:05:06.131247 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3340/6711] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:06 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:07.152752 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-83a5125d-0824-4a26-b22f-1f16d5cf41e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:07.153366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-83a5125d-0824-4a26-b22f-1f16d5cf41e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:07.155606 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:07.162846 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83a5125d-0824-4a26-b22f-1f16d5cf41e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:07.163303 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83a5125d-0824-4a26-b22f-1f16d5cf41e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:07.164094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83a5125d-0824-4a26-b22f-1f16d5cf41e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:07.164536 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83a5125d-0824-4a26-b22f-1f16d5cf41e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:07.178366 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-83a5125d-0824-4a26-b22f-1f16d5cf41e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] HTTP exception thrown: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-83a5125d-0824-4a26-b22f-1f16d5cf41e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Request method failure captured: Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 HTTP/1.1 Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eJ1I2l5yEhe8PxarxZ9XRm4z-6QjmhbZOvRUbxzByRHW6l8LEbbUxtG2DytV3QuDPs6Keq8bbte8TVSyRSiRWBkH4zpt8Eg76zlOmP_pIHa1L3zACHKWuHbXQcEqAA0sFnYwcj_YJydQgWa7PJBhmxQGIPQylFIUtatKCWUFm6XMLI Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f8bba8850b446fcb8b4cb1aedb51876", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerActionsTestJSON-945544621 Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 50f66e518b9143f485b4a9938cb8dd7c Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: exception: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'd93dfb8e-de00-45b8-bb74-97c5260603a6'} Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:05:07.179982 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:05:07.185505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:05:07.185505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:05:07.185505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:05:07.185505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:05:07.185505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:05:07.185505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:05:07.185505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:05:07.185505 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-83a5125d-0824-4a26-b22f-1f16d5cf41e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Returning 404 to user: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:05:07.185505 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-83a5125d-0824-4a26-b22f-1f16d5cf41e6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 404 len: 111 microversion: 2.1 time: 0.032959 Jul 31 02:05:07.185505 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3372/6712] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:07 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 02:05:07.196653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-823f67f3-6da2-49ad-abcc-c58b4d0e1b58 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:07.197279 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-823f67f3-6da2-49ad-abcc-c58b4d0e1b58 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:07.204435 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-823f67f3-6da2-49ad-abcc-c58b4d0e1b58 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:07.204994 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-823f67f3-6da2-49ad-abcc-c58b4d0e1b58 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:07.205972 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-823f67f3-6da2-49ad-abcc-c58b4d0e1b58 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:07.206437 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-823f67f3-6da2-49ad-abcc-c58b4d0e1b58 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:07.219952 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-823f67f3-6da2-49ad-abcc-c58b4d0e1b58 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] HTTP exception thrown: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-823f67f3-6da2-49ad-abcc-c58b4d0e1b58 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Request method failure captured: Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 HTTP/1.1 Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eJ1I2l5yEhe8PxarxZ9XRm4z-6QjmhbZOvRUbxzByRHW6l8LEbbUxtG2DytV3QuDPs6Keq8bbte8TVSyRSiRWBkH4zpt8Eg76zlOmP_pIHa1L3zACHKWuHbXQcEqAA0sFnYwcj_YJydQgWa7PJBhmxQGIPQylFIUtatKCWUFm6XMLI Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f8bba8850b446fcb8b4cb1aedb51876", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerActionsTestJSON-945544621 Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 50f66e518b9143f485b4a9938cb8dd7c Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: exception: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'd93dfb8e-de00-45b8-bb74-97c5260603a6'} Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:05:07.221572 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:05:07.227523 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:05:07.227523 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:05:07.227523 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:05:07.227523 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:05:07.227523 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:05:07.227523 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:05:07.227523 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:05:07.227523 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-823f67f3-6da2-49ad-abcc-c58b4d0e1b58 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Returning 404 to user: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:05:07.227523 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-823f67f3-6da2-49ad-abcc-c58b4d0e1b58 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 404 len: 111 microversion: 2.1 time: 0.030337 Jul 31 02:05:07.227523 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3341/6713] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:07 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:05:07.328704 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eb81334d-4fba-4ea6-9d6a-184122d86bfe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1024607769", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "3b566735-8db1-4f81-80aa-d07655229680"}], "security_groups": [{"name": "tempest-securitygroup--1769531531"}], "key_name": "tempest-keypair-596934869", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:05:07.433055 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-eb81334d-4fba-4ea6-9d6a-184122d86bfe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] validate_networks() for [('3b566735-8db1-4f81-80aa-d07655229680', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:05:07.910805 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-eb81334d-4fba-4ea6-9d6a-184122d86bfe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:05:07.911265 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-eb81334d-4fba-4ea6-9d6a-184122d86bfe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:05:07.911777 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-eb81334d-4fba-4ea6-9d6a-184122d86bfe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:05:07.912193 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-eb81334d-4fba-4ea6-9d6a-184122d86bfe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:05:07.912612 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-eb81334d-4fba-4ea6-9d6a-184122d86bfe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:05:07.921432 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb81334d-4fba-4ea6-9d6a-184122d86bfe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:07.921886 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb81334d-4fba-4ea6-9d6a-184122d86bfe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:07.922687 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb81334d-4fba-4ea6-9d6a-184122d86bfe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:07.923131 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb81334d-4fba-4ea6-9d6a-184122d86bfe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:07.940134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-eb81334d-4fba-4ea6-9d6a-184122d86bfe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Getting quotas for project 6f8bba8850b446fcb8b4cb1aedb51876. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:05:07.945844 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-eb81334d-4fba-4ea6-9d6a-184122d86bfe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Getting quotas for user 50f66e518b9143f485b4a9938cb8dd7c and project 6f8bba8850b446fcb8b4cb1aedb51876. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:05:07.957876 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eb81334d-4fba-4ea6-9d6a-184122d86bfe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:05:07.960149 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eb81334d-4fba-4ea6-9d6a-184122d86bfe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:05:08.004077 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eb81334d-4fba-4ea6-9d6a-184122d86bfe tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.680273 Jul 31 02:05:08.004729 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3373/6714] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:05:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:05:08.017919 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d50e7368-195e-459e-8136-9d49fba2de0a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:08.018876 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d50e7368-195e-459e-8136-9d49fba2de0a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:08.087326 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d50e7368-195e-459e-8136-9d49fba2de0a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:08.094316 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d50e7368-195e-459e-8136-9d49fba2de0a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1238 microversion: 2.1 time: 0.081295 Jul 31 02:05:08.094986 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3342/6715] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:08 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:09.116968 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-25d711ad-35c4-4dd2-aa84-ced1ba1a1822 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:09.117591 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-25d711ad-35c4-4dd2-aa84-ced1ba1a1822 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:09.126833 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25d711ad-35c4-4dd2-aa84-ced1ba1a1822 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:09.127296 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25d711ad-35c4-4dd2-aa84-ced1ba1a1822 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:09.128734 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25d711ad-35c4-4dd2-aa84-ced1ba1a1822 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:09.129188 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-25d711ad-35c4-4dd2-aa84-ced1ba1a1822 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:09.239425 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-25d711ad-35c4-4dd2-aa84-ced1ba1a1822 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:09.247316 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-25d711ad-35c4-4dd2-aa84-ced1ba1a1822 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1296 microversion: 2.1 time: 0.135409 Jul 31 02:05:09.248262 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3374/6716] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:09 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1296 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:10.269894 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d354f957-970a-427c-8811-dd4fee6a9312 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:10.271084 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d354f957-970a-427c-8811-dd4fee6a9312 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:10.280934 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d354f957-970a-427c-8811-dd4fee6a9312 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:10.281411 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d354f957-970a-427c-8811-dd4fee6a9312 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:10.282204 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d354f957-970a-427c-8811-dd4fee6a9312 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:10.282661 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d354f957-970a-427c-8811-dd4fee6a9312 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:10.314908 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-6a83ce82-680e-4a15-853e-49e97df9bf33 req-31f9684f-6bf1-4ae6-a4a3-2162ff28ae3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c51596d-f2c3-4521-aede-0bfe6e475486", "tag": "90540662-84bb-4d10-bc9e-a86cfa5f4a91"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:05:10.326451 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6a83ce82-680e-4a15-853e-49e97df9bf33 req-31f9684f-6bf1-4ae6-a4a3-2162ff28ae3a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:10.327185 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-6a83ce82-680e-4a15-853e-49e97df9bf33 req-31f9684f-6bf1-4ae6-a4a3-2162ff28ae3a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:10.341637 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-6a83ce82-680e-4a15-853e-49e97df9bf33 req-31f9684f-6bf1-4ae6-a4a3-2162ff28ae3a service nova] Creating event network-changed:90540662-84bb-4d10-bc9e-a86cfa5f4a91 for instance 1c51596d-f2c3-4521-aede-0bfe6e475486 on n-h2-master-1 Jul 31 02:05:10.347094 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-6a83ce82-680e-4a15-853e-49e97df9bf33 req-31f9684f-6bf1-4ae6-a4a3-2162ff28ae3a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035864 Jul 31 02:05:10.347661 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3375/6717] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:05:10.842541 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d354f957-970a-427c-8811-dd4fee6a9312 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:10.850532 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d354f957-970a-427c-8811-dd4fee6a9312 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1364 microversion: 2.1 time: 0.584658 Jul 31 02:05:10.851097 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3343/6718] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:10 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1364 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:11.874351 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ede4be49-ba73-4db6-ae51-33c354376ac9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:11.875008 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ede4be49-ba73-4db6-ae51-33c354376ac9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:11.881312 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ede4be49-ba73-4db6-ae51-33c354376ac9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:11.881772 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ede4be49-ba73-4db6-ae51-33c354376ac9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:11.882542 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ede4be49-ba73-4db6-ae51-33c354376ac9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:11.882989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ede4be49-ba73-4db6-ae51-33c354376ac9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:12.109756 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ede4be49-ba73-4db6-ae51-33c354376ac9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:12.117412 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ede4be49-ba73-4db6-ae51-33c354376ac9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1364 microversion: 2.1 time: 0.248262 Jul 31 02:05:12.117987 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3376/6719] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:11 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:13.139621 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-88242bd4-6e64-436e-96cc-135756254aa9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:13.140256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-88242bd4-6e64-436e-96cc-135756254aa9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:13.147222 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88242bd4-6e64-436e-96cc-135756254aa9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:13.147727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88242bd4-6e64-436e-96cc-135756254aa9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:13.148511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88242bd4-6e64-436e-96cc-135756254aa9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:13.148969 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88242bd4-6e64-436e-96cc-135756254aa9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:13.276050 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-88242bd4-6e64-436e-96cc-135756254aa9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:13.283480 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-88242bd4-6e64-436e-96cc-135756254aa9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1364 microversion: 2.1 time: 0.147805 Jul 31 02:05:13.284048 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3344/6720] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:13 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:14.306503 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-66746ac4-d893-4b86-89a7-d610371c4ee9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:14.307209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-66746ac4-d893-4b86-89a7-d610371c4ee9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:14.314759 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-66746ac4-d893-4b86-89a7-d610371c4ee9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:14.315223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-66746ac4-d893-4b86-89a7-d610371c4ee9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:14.316031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-66746ac4-d893-4b86-89a7-d610371c4ee9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:14.316483 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-66746ac4-d893-4b86-89a7-d610371c4ee9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:14.448376 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-66746ac4-d893-4b86-89a7-d610371c4ee9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:14.455888 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-66746ac4-d893-4b86-89a7-d610371c4ee9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1364 microversion: 2.1 time: 0.154170 Jul 31 02:05:14.456469 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3377/6721] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:14 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:15.477412 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-10e165ae-6790-49ef-b3c6-067c3d26a5bc tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:15.478051 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-10e165ae-6790-49ef-b3c6-067c3d26a5bc tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:15.485258 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10e165ae-6790-49ef-b3c6-067c3d26a5bc tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:15.485737 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10e165ae-6790-49ef-b3c6-067c3d26a5bc tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:15.486525 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10e165ae-6790-49ef-b3c6-067c3d26a5bc tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:15.486993 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-10e165ae-6790-49ef-b3c6-067c3d26a5bc tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:15.620033 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-10e165ae-6790-49ef-b3c6-067c3d26a5bc tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:15.627654 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-10e165ae-6790-49ef-b3c6-067c3d26a5bc tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1364 microversion: 2.1 time: 0.154169 Jul 31 02:05:15.628222 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3345/6722] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:15 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:16.649767 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0bddfe7a-22d4-476c-b676-a84ae151ce2b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:16.650387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0bddfe7a-22d4-476c-b676-a84ae151ce2b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:16.657213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bddfe7a-22d4-476c-b676-a84ae151ce2b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:16.657668 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bddfe7a-22d4-476c-b676-a84ae151ce2b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:16.658429 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bddfe7a-22d4-476c-b676-a84ae151ce2b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:16.658867 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0bddfe7a-22d4-476c-b676-a84ae151ce2b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:16.785195 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0bddfe7a-22d4-476c-b676-a84ae151ce2b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:16.793450 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0bddfe7a-22d4-476c-b676-a84ae151ce2b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1364 microversion: 2.1 time: 0.147564 Jul 31 02:05:16.794019 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3378/6723] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:16 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:17.444249 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7a635289-657a-4ba1-8b71-55811977f24c req-b084918e-2719-4483-befb-d1034d23fdbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c51596d-f2c3-4521-aede-0bfe6e475486", "name": "network-vif-plugged", "status": "completed", "tag": "90540662-84bb-4d10-bc9e-a86cfa5f4a91"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:05:17.463867 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7a635289-657a-4ba1-8b71-55811977f24c req-b084918e-2719-4483-befb-d1034d23fdbd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:17.464365 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7a635289-657a-4ba1-8b71-55811977f24c req-b084918e-2719-4483-befb-d1034d23fdbd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:17.475795 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7a635289-657a-4ba1-8b71-55811977f24c req-b084918e-2719-4483-befb-d1034d23fdbd service nova] Creating event network-vif-plugged:90540662-84bb-4d10-bc9e-a86cfa5f4a91 for instance 1c51596d-f2c3-4521-aede-0bfe6e475486 on n-h2-master-1 Jul 31 02:05:17.480934 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7a635289-657a-4ba1-8b71-55811977f24c req-b084918e-2719-4483-befb-d1034d23fdbd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040842 Jul 31 02:05:17.481721 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3346/6724] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:05:17.815396 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2bb46fe3-07f1-4086-9f9c-658a9fded425 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:17.816020 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2bb46fe3-07f1-4086-9f9c-658a9fded425 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:17.823578 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bb46fe3-07f1-4086-9f9c-658a9fded425 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:17.823986 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bb46fe3-07f1-4086-9f9c-658a9fded425 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:17.824760 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bb46fe3-07f1-4086-9f9c-658a9fded425 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:17.825213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2bb46fe3-07f1-4086-9f9c-658a9fded425 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:17.931076 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:17.953349 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2bb46fe3-07f1-4086-9f9c-658a9fded425 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:17.955565 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:17.961876 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2bb46fe3-07f1-4086-9f9c-658a9fded425 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1364 microversion: 2.1 time: 0.150428 Jul 31 02:05:17.962453 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3379/6725] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:17 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:18.980596 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:18.985847 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-715bd6ae-1e6a-4e2f-b403-0a2910c36204 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:18.986565 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-715bd6ae-1e6a-4e2f-b403-0a2910c36204 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:18.993938 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-715bd6ae-1e6a-4e2f-b403-0a2910c36204 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:18.994410 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-715bd6ae-1e6a-4e2f-b403-0a2910c36204 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:18.995189 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-715bd6ae-1e6a-4e2f-b403-0a2910c36204 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:18.995672 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-715bd6ae-1e6a-4e2f-b403-0a2910c36204 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:19.129101 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-715bd6ae-1e6a-4e2f-b403-0a2910c36204 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:19.136644 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-715bd6ae-1e6a-4e2f-b403-0a2910c36204 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1549 microversion: 2.1 time: 0.157068 Jul 31 02:05:19.137209 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3347/6726] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:18 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:19.157554 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7e10631b-8607-4b04-89be-2614802c6c96 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:19.158042 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7e10631b-8607-4b04-89be-2614802c6c96 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:19.165369 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e10631b-8607-4b04-89be-2614802c6c96 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:19.165832 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e10631b-8607-4b04-89be-2614802c6c96 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:19.166611 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e10631b-8607-4b04-89be-2614802c6c96 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:19.167062 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e10631b-8607-4b04-89be-2614802c6c96 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:19.243434 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7e10631b-8607-4b04-89be-2614802c6c96 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089639 Jul 31 02:05:19.244043 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3380/6727] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 02:05:19 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:05:20.172849 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-a09ffe69-eced-40b4-ae9c-2f4663a05cee req-e883aa0e-92f6-4c16-9213-0532236bac3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c51596d-f2c3-4521-aede-0bfe6e475486", "tag": "90540662-84bb-4d10-bc9e-a86cfa5f4a91"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:05:20.182926 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a09ffe69-eced-40b4-ae9c-2f4663a05cee req-e883aa0e-92f6-4c16-9213-0532236bac3a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:20.183411 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a09ffe69-eced-40b4-ae9c-2f4663a05cee req-e883aa0e-92f6-4c16-9213-0532236bac3a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:20.194379 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-a09ffe69-eced-40b4-ae9c-2f4663a05cee req-e883aa0e-92f6-4c16-9213-0532236bac3a service nova] Creating event network-changed:90540662-84bb-4d10-bc9e-a86cfa5f4a91 for instance 1c51596d-f2c3-4521-aede-0bfe6e475486 on n-h2-master-1 Jul 31 02:05:20.199465 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-a09ffe69-eced-40b4-ae9c-2f4663a05cee req-e883aa0e-92f6-4c16-9213-0532236bac3a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030134 Jul 31 02:05:20.200263 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3348/6728] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:05:54.431673 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:54.432439 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:54.436594 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e44a1f5a-bbdd-47f3-918f-edf7aa9d71fc tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:05:54.437253 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e44a1f5a-bbdd-47f3-918f-edf7aa9d71fc tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:54.444671 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e44a1f5a-bbdd-47f3-918f-edf7aa9d71fc tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:54.445392 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e44a1f5a-bbdd-47f3-918f-edf7aa9d71fc tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:54.446813 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e44a1f5a-bbdd-47f3-918f-edf7aa9d71fc tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:54.447277 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e44a1f5a-bbdd-47f3-918f-edf7aa9d71fc tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:54.580976 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e44a1f5a-bbdd-47f3-918f-edf7aa9d71fc tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:05:54.588426 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e44a1f5a-bbdd-47f3-918f-edf7aa9d71fc tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1668 microversion: 2.1 time: 0.160044 Jul 31 02:05:54.588995 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3381/6729] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:05:54 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:05:54.607058 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=27 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:54.607846 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=51 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:05:54.612417 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d5697452-559c-49e6-b8c4-a14c1af0408c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b3c6ced-1afa-4f0f-8a57-e3826a9aa14c"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:05:54.614821 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d5697452-559c-49e6-b8c4-a14c1af0408c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:05:54.622527 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5697452-559c-49e6-b8c4-a14c1af0408c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:54.622999 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5697452-559c-49e6-b8c4-a14c1af0408c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:54.623818 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5697452-559c-49e6-b8c4-a14c1af0408c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:05:54.624275 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d5697452-559c-49e6-b8c4-a14c1af0408c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:05:54.869245 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d5697452-559c-49e6-b8c4-a14c1af0408c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "POST /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264143 Jul 31 02:05:54.869865 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3349/6730] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 02:05:54 2022] POST /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:05:59.103326 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:05:59.103951 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 02:05:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:06:05.575259 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-18def3fb-5649-4d85-8236-f5fe28e7cc00 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:06:05.577576 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-18def3fb-5649-4d85-8236-f5fe28e7cc00 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:05.580372 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:06:05.581030 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:06:05.591070 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18def3fb-5649-4d85-8236-f5fe28e7cc00 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:05.591501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18def3fb-5649-4d85-8236-f5fe28e7cc00 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:05.592286 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18def3fb-5649-4d85-8236-f5fe28e7cc00 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:05.592740 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-18def3fb-5649-4d85-8236-f5fe28e7cc00 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:05.621121 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-18def3fb-5649-4d85-8236-f5fe28e7cc00 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:05.629149 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-18def3fb-5649-4d85-8236-f5fe28e7cc00 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Old instance type m1.heat2, new instance type m1.heat {{(pid=119475) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 31 02:06:05.636420 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-18def3fb-5649-4d85-8236-f5fe28e7cc00 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:06:05.636838 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-18def3fb-5649-4d85-8236-f5fe28e7cc00 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:06:05.637310 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-18def3fb-5649-4d85-8236-f5fe28e7cc00 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:06:05.637718 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-18def3fb-5649-4d85-8236-f5fe28e7cc00 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:06:05.638128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-18def3fb-5649-4d85-8236-f5fe28e7cc00 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:06:05.698726 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-18def3fb-5649-4d85-8236-f5fe28e7cc00 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "POST /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486/action" status: 202 len: 0 microversion: 2.1 time: 0.127328 Jul 31 02:06:05.699428 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3382/6731] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:06:05 2022] POST /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:06:05.705615 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:06:05.706423 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:06:05.711080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ecb9da48-84e0-4f6c-9158-f935cf01d546 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:05.711831 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ecb9da48-84e0-4f6c-9158-f935cf01d546 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:05.723396 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecb9da48-84e0-4f6c-9158-f935cf01d546 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:05.723919 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecb9da48-84e0-4f6c-9158-f935cf01d546 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:05.724782 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecb9da48-84e0-4f6c-9158-f935cf01d546 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:05.725319 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ecb9da48-84e0-4f6c-9158-f935cf01d546 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:05.911202 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ecb9da48-84e0-4f6c-9158-f935cf01d546 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:05.919840 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ecb9da48-84e0-4f6c-9158-f935cf01d546 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1723 microversion: 2.1 time: 0.216058 Jul 31 02:06:05.920470 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3350/6732] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:05 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:06.942643 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3f4c2e5e-eca7-454a-8854-5a649e076bc9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:06.943268 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3f4c2e5e-eca7-454a-8854-5a649e076bc9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:06.949556 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f4c2e5e-eca7-454a-8854-5a649e076bc9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:06.950047 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f4c2e5e-eca7-454a-8854-5a649e076bc9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:06.950830 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f4c2e5e-eca7-454a-8854-5a649e076bc9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:06.951278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3f4c2e5e-eca7-454a-8854-5a649e076bc9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:07.080976 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3f4c2e5e-eca7-454a-8854-5a649e076bc9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:07.089637 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3f4c2e5e-eca7-454a-8854-5a649e076bc9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1723 microversion: 2.1 time: 0.151754 Jul 31 02:06:07.095170 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3383/6733] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:06 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:08.111959 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7e8b3499-6581-499d-88e5-2fc23040e4be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:08.112667 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7e8b3499-6581-499d-88e5-2fc23040e4be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:08.120147 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e8b3499-6581-499d-88e5-2fc23040e4be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:08.120661 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e8b3499-6581-499d-88e5-2fc23040e4be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:08.121448 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e8b3499-6581-499d-88e5-2fc23040e4be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:08.121908 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7e8b3499-6581-499d-88e5-2fc23040e4be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:08.252435 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7e8b3499-6581-499d-88e5-2fc23040e4be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:08.260408 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7e8b3499-6581-499d-88e5-2fc23040e4be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1728 microversion: 2.1 time: 0.152523 Jul 31 02:06:08.260971 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3351/6734] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:08 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:09.282248 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-72f774b2-26c3-4183-bde7-282d9a9b9198 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:09.282800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-72f774b2-26c3-4183-bde7-282d9a9b9198 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:09.289653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72f774b2-26c3-4183-bde7-282d9a9b9198 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:09.290120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72f774b2-26c3-4183-bde7-282d9a9b9198 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:09.290892 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72f774b2-26c3-4183-bde7-282d9a9b9198 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:09.291366 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-72f774b2-26c3-4183-bde7-282d9a9b9198 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:09.418436 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-72f774b2-26c3-4183-bde7-282d9a9b9198 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:09.426468 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-72f774b2-26c3-4183-bde7-282d9a9b9198 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1728 microversion: 2.1 time: 0.148224 Jul 31 02:06:09.427044 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3384/6735] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:09 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:10.449053 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9f3ba8df-8744-46a1-959a-55eef4fe3f3e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:10.449686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9f3ba8df-8744-46a1-959a-55eef4fe3f3e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:10.456583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f3ba8df-8744-46a1-959a-55eef4fe3f3e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:10.457055 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f3ba8df-8744-46a1-959a-55eef4fe3f3e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:10.457835 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f3ba8df-8744-46a1-959a-55eef4fe3f3e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:10.458291 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f3ba8df-8744-46a1-959a-55eef4fe3f3e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:10.590913 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9f3ba8df-8744-46a1-959a-55eef4fe3f3e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:10.598928 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9f3ba8df-8744-46a1-959a-55eef4fe3f3e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1728 microversion: 2.1 time: 0.154337 Jul 31 02:06:10.599515 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3352/6736] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:10 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:06:11.621424 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fb189ae8-db0f-4330-ac52-db2cc52110ee tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:11.621972 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fb189ae8-db0f-4330-ac52-db2cc52110ee tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:11.628759 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb189ae8-db0f-4330-ac52-db2cc52110ee tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:11.629221 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb189ae8-db0f-4330-ac52-db2cc52110ee tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:11.629982 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb189ae8-db0f-4330-ac52-db2cc52110ee tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:11.630420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fb189ae8-db0f-4330-ac52-db2cc52110ee tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:11.757472 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fb189ae8-db0f-4330-ac52-db2cc52110ee tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:11.765292 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fb189ae8-db0f-4330-ac52-db2cc52110ee tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1728 microversion: 2.1 time: 0.148873 Jul 31 02:06:11.765866 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3385/6737] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:11 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:12.787593 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-886c02d9-0910-41c8-af22-92a2b9d8e765 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:12.788230 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-886c02d9-0910-41c8-af22-92a2b9d8e765 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:12.795546 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-886c02d9-0910-41c8-af22-92a2b9d8e765 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:12.796023 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-886c02d9-0910-41c8-af22-92a2b9d8e765 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:12.796810 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-886c02d9-0910-41c8-af22-92a2b9d8e765 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:12.797273 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-886c02d9-0910-41c8-af22-92a2b9d8e765 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:12.923745 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-886c02d9-0910-41c8-af22-92a2b9d8e765 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:12.932316 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-886c02d9-0910-41c8-af22-92a2b9d8e765 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1728 microversion: 2.1 time: 0.148660 Jul 31 02:06:12.932877 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3353/6738] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:12 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:13.953817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-73dd7219-4501-4fd4-9b42-e48e2ed329c0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:13.954383 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-73dd7219-4501-4fd4-9b42-e48e2ed329c0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:13.961285 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73dd7219-4501-4fd4-9b42-e48e2ed329c0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:13.961754 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73dd7219-4501-4fd4-9b42-e48e2ed329c0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:13.962530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73dd7219-4501-4fd4-9b42-e48e2ed329c0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:13.962978 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-73dd7219-4501-4fd4-9b42-e48e2ed329c0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:14.095164 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-73dd7219-4501-4fd4-9b42-e48e2ed329c0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:14.103075 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-73dd7219-4501-4fd4-9b42-e48e2ed329c0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1728 microversion: 2.1 time: 0.153332 Jul 31 02:06:14.103685 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3386/6739] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:13 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:15.124482 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-951094b4-5514-4046-a986-4a2838a42026 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:15.126419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-951094b4-5514-4046-a986-4a2838a42026 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:15.132221 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-951094b4-5514-4046-a986-4a2838a42026 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:15.133197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-951094b4-5514-4046-a986-4a2838a42026 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:15.133987 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-951094b4-5514-4046-a986-4a2838a42026 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:15.134447 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-951094b4-5514-4046-a986-4a2838a42026 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:15.261013 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-951094b4-5514-4046-a986-4a2838a42026 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:15.269103 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-951094b4-5514-4046-a986-4a2838a42026 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1728 microversion: 2.1 time: 0.148547 Jul 31 02:06:15.269673 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3354/6740] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:15 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:16.291403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e08a2261-51d2-4514-bced-f8c5e4b442e4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:16.291962 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e08a2261-51d2-4514-bced-f8c5e4b442e4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:16.298905 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e08a2261-51d2-4514-bced-f8c5e4b442e4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:16.299397 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e08a2261-51d2-4514-bced-f8c5e4b442e4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:16.300176 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e08a2261-51d2-4514-bced-f8c5e4b442e4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:16.300623 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e08a2261-51d2-4514-bced-f8c5e4b442e4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:16.441797 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e08a2261-51d2-4514-bced-f8c5e4b442e4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:16.450280 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e08a2261-51d2-4514-bced-f8c5e4b442e4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1728 microversion: 2.1 time: 0.162850 Jul 31 02:06:16.450852 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3387/6741] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:16 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:17.471646 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3872eab0-c413-4b5c-bfdd-0d080c77f6e9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:17.472207 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3872eab0-c413-4b5c-bfdd-0d080c77f6e9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:17.479762 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3872eab0-c413-4b5c-bfdd-0d080c77f6e9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:17.480226 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3872eab0-c413-4b5c-bfdd-0d080c77f6e9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:17.481004 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3872eab0-c413-4b5c-bfdd-0d080c77f6e9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:17.481453 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3872eab0-c413-4b5c-bfdd-0d080c77f6e9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:17.611693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3872eab0-c413-4b5c-bfdd-0d080c77f6e9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:17.619951 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3872eab0-c413-4b5c-bfdd-0d080c77f6e9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1728 microversion: 2.1 time: 0.152344 Jul 31 02:06:17.620554 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3355/6742] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:17 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:18.641795 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-472a3fa4-2bad-4387-823f-cc9ce7f38130 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:18.642422 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-472a3fa4-2bad-4387-823f-cc9ce7f38130 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:18.649940 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-472a3fa4-2bad-4387-823f-cc9ce7f38130 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:18.650395 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-472a3fa4-2bad-4387-823f-cc9ce7f38130 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:18.651160 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-472a3fa4-2bad-4387-823f-cc9ce7f38130 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:18.651631 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-472a3fa4-2bad-4387-823f-cc9ce7f38130 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:18.782265 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-472a3fa4-2bad-4387-823f-cc9ce7f38130 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:18.791189 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-472a3fa4-2bad-4387-823f-cc9ce7f38130 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1728 microversion: 2.1 time: 0.153061 Jul 31 02:06:18.791799 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3388/6743] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:18 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:19.818268 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f5b4b2d3-3121-435a-baf7-83393355c4be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:19.818902 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f5b4b2d3-3121-435a-baf7-83393355c4be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:19.827788 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5b4b2d3-3121-435a-baf7-83393355c4be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:19.828255 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5b4b2d3-3121-435a-baf7-83393355c4be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:19.829034 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5b4b2d3-3121-435a-baf7-83393355c4be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:19.829484 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5b4b2d3-3121-435a-baf7-83393355c4be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:19.966628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f5b4b2d3-3121-435a-baf7-83393355c4be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:19.974802 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f5b4b2d3-3121-435a-baf7-83393355c4be tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1728 microversion: 2.1 time: 0.163309 Jul 31 02:06:19.975380 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3356/6744] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:19 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:20.996843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e1e31180-dd8f-404a-aad9-e4677ff10183 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:20.997372 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e1e31180-dd8f-404a-aad9-e4677ff10183 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:21.004185 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1e31180-dd8f-404a-aad9-e4677ff10183 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:21.004637 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1e31180-dd8f-404a-aad9-e4677ff10183 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:21.005397 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1e31180-dd8f-404a-aad9-e4677ff10183 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:21.005834 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e1e31180-dd8f-404a-aad9-e4677ff10183 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:21.136470 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e1e31180-dd8f-404a-aad9-e4677ff10183 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:21.144510 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e1e31180-dd8f-404a-aad9-e4677ff10183 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1728 microversion: 2.1 time: 0.151592 Jul 31 02:06:21.145092 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3389/6745] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:20 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:22.167201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-66ff59ca-f015-4d20-9f86-ed4f1d366f7b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:22.167870 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-66ff59ca-f015-4d20-9f86-ed4f1d366f7b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:22.174724 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66ff59ca-f015-4d20-9f86-ed4f1d366f7b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:22.175192 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66ff59ca-f015-4d20-9f86-ed4f1d366f7b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:22.176006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66ff59ca-f015-4d20-9f86-ed4f1d366f7b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:22.176458 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-66ff59ca-f015-4d20-9f86-ed4f1d366f7b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:22.305394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-66ff59ca-f015-4d20-9f86-ed4f1d366f7b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:22.313362 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-66ff59ca-f015-4d20-9f86-ed4f1d366f7b tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1728 microversion: 2.1 time: 0.150732 Jul 31 02:06:22.313926 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3357/6746] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:22 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:23.334085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1b1ed02c-593f-4dbb-b6bc-418425adc962 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:23.334702 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1b1ed02c-593f-4dbb-b6bc-418425adc962 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:23.340703 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b1ed02c-593f-4dbb-b6bc-418425adc962 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:23.341155 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b1ed02c-593f-4dbb-b6bc-418425adc962 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:23.341910 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b1ed02c-593f-4dbb-b6bc-418425adc962 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:23.342349 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b1ed02c-593f-4dbb-b6bc-418425adc962 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:23.469708 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1b1ed02c-593f-4dbb-b6bc-418425adc962 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:23.478104 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1b1ed02c-593f-4dbb-b6bc-418425adc962 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1728 microversion: 2.1 time: 0.148192 Jul 31 02:06:23.478670 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3390/6747] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:23 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:24.501528 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-971db796-7648-4c67-899d-686302c088de tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:24.502138 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-971db796-7648-4c67-899d-686302c088de tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:24.509714 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-971db796-7648-4c67-899d-686302c088de tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:24.510180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-971db796-7648-4c67-899d-686302c088de tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:24.510965 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-971db796-7648-4c67-899d-686302c088de tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:24.511515 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-971db796-7648-4c67-899d-686302c088de tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:24.937951 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-971db796-7648-4c67-899d-686302c088de tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:24.946129 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-971db796-7648-4c67-899d-686302c088de tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1728 microversion: 2.1 time: 0.449627 Jul 31 02:06:24.946691 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3358/6748] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:24 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1728 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:26.014767 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2b0678c6-d1f0-4992-ae64-9d1073e03699 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:26.015425 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2b0678c6-d1f0-4992-ae64-9d1073e03699 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:26.021466 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b0678c6-d1f0-4992-ae64-9d1073e03699 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:26.021933 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b0678c6-d1f0-4992-ae64-9d1073e03699 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:26.022716 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b0678c6-d1f0-4992-ae64-9d1073e03699 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:26.023168 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b0678c6-d1f0-4992-ae64-9d1073e03699 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:26.151104 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2b0678c6-d1f0-4992-ae64-9d1073e03699 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:26.159156 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2b0678c6-d1f0-4992-ae64-9d1073e03699 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1728 microversion: 2.1 time: 0.195294 Jul 31 02:06:26.160042 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3391/6749] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:25 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:06:27.180637 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-87999f18-76de-4f83-9b28-3619c386e381 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:27.181268 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-87999f18-76de-4f83-9b28-3619c386e381 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:27.188129 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87999f18-76de-4f83-9b28-3619c386e381 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:27.188630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87999f18-76de-4f83-9b28-3619c386e381 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:27.189392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87999f18-76de-4f83-9b28-3619c386e381 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:27.189847 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87999f18-76de-4f83-9b28-3619c386e381 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:27.208046 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-e64587d8-ff57-4026-9332-356489a58a3a req-94527678-30ee-499d-b521-52bdbd8bb63e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c51596d-f2c3-4521-aede-0bfe6e475486", "name": "network-vif-unplugged", "status": "completed", "tag": "90540662-84bb-4d10-bc9e-a86cfa5f4a91"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:06:27.219225 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e64587d8-ff57-4026-9332-356489a58a3a req-94527678-30ee-499d-b521-52bdbd8bb63e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:27.219814 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e64587d8-ff57-4026-9332-356489a58a3a req-94527678-30ee-499d-b521-52bdbd8bb63e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:27.233095 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-e64587d8-ff57-4026-9332-356489a58a3a req-94527678-30ee-499d-b521-52bdbd8bb63e service nova] Creating event network-vif-unplugged:90540662-84bb-4d10-bc9e-a86cfa5f4a91 for instance 1c51596d-f2c3-4521-aede-0bfe6e475486 on n-h1-master-1 Jul 31 02:06:27.238512 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-e64587d8-ff57-4026-9332-356489a58a3a req-94527678-30ee-499d-b521-52bdbd8bb63e service nova] Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:06:27.251571 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-e64587d8-ff57-4026-9332-356489a58a3a req-94527678-30ee-499d-b521-52bdbd8bb63e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047126 Jul 31 02:06:27.252183 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3392/6750] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:06:27.469435 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-87999f18-76de-4f83-9b28-3619c386e381 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:27.478280 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-87999f18-76de-4f83-9b28-3619c386e381 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1727 microversion: 2.1 time: 0.302143 Jul 31 02:06:27.478861 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3359/6751] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:27 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1727 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:28.500755 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f000db5f-bbdd-40eb-a755-3a70d7fe30c6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:28.501422 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f000db5f-bbdd-40eb-a755-3a70d7fe30c6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:28.508526 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f000db5f-bbdd-40eb-a755-3a70d7fe30c6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:28.508993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f000db5f-bbdd-40eb-a755-3a70d7fe30c6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:28.509782 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f000db5f-bbdd-40eb-a755-3a70d7fe30c6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:28.510234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f000db5f-bbdd-40eb-a755-3a70d7fe30c6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:28.641649 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f000db5f-bbdd-40eb-a755-3a70d7fe30c6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:28.649842 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f000db5f-bbdd-40eb-a755-3a70d7fe30c6 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1725 microversion: 2.1 time: 0.153486 Jul 31 02:06:28.650410 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3393/6752] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:28 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:29.266400 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-938dd105-0a09-4c84-8ca5-9417bdffd6b6 req-6b11e565-1100-4731-ba32-ce8a9f44c32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c51596d-f2c3-4521-aede-0bfe6e475486", "tag": "90540662-84bb-4d10-bc9e-a86cfa5f4a91"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:06:29.276816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-938dd105-0a09-4c84-8ca5-9417bdffd6b6 req-6b11e565-1100-4731-ba32-ce8a9f44c32c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:29.277294 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-938dd105-0a09-4c84-8ca5-9417bdffd6b6 req-6b11e565-1100-4731-ba32-ce8a9f44c32c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:29.289778 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-938dd105-0a09-4c84-8ca5-9417bdffd6b6 req-6b11e565-1100-4731-ba32-ce8a9f44c32c service nova] Creating event network-changed:90540662-84bb-4d10-bc9e-a86cfa5f4a91 for instance 1c51596d-f2c3-4521-aede-0bfe6e475486 on n-h1-master-1 Jul 31 02:06:29.295185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-938dd105-0a09-4c84-8ca5-9417bdffd6b6 req-6b11e565-1100-4731-ba32-ce8a9f44c32c service nova] Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:06:29.307745 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-938dd105-0a09-4c84-8ca5-9417bdffd6b6 req-6b11e565-1100-4731-ba32-ce8a9f44c32c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045033 Jul 31 02:06:29.308396 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3360/6753] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:06:29.673284 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1eda9c49-0fc7-47da-8f7c-360c44a0427c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:29.674727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1eda9c49-0fc7-47da-8f7c-360c44a0427c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:29.682892 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1eda9c49-0fc7-47da-8f7c-360c44a0427c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:29.683728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1eda9c49-0fc7-47da-8f7c-360c44a0427c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:29.684659 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1eda9c49-0fc7-47da-8f7c-360c44a0427c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:29.685247 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1eda9c49-0fc7-47da-8f7c-360c44a0427c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:30.014178 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1eda9c49-0fc7-47da-8f7c-360c44a0427c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:30.022279 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1eda9c49-0fc7-47da-8f7c-360c44a0427c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1725 microversion: 2.1 time: 0.353879 Jul 31 02:06:30.022881 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3394/6754] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:29 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1725 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:31.045829 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ec4f83fb-71e2-4e21-ad00-a9b8040d541f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:31.046553 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ec4f83fb-71e2-4e21-ad00-a9b8040d541f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:31.053698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec4f83fb-71e2-4e21-ad00-a9b8040d541f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:31.054173 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec4f83fb-71e2-4e21-ad00-a9b8040d541f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:31.054957 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec4f83fb-71e2-4e21-ad00-a9b8040d541f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:31.055441 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ec4f83fb-71e2-4e21-ad00-a9b8040d541f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:31.191500 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ec4f83fb-71e2-4e21-ad00-a9b8040d541f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:31.200380 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ec4f83fb-71e2-4e21-ad00-a9b8040d541f tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1725 microversion: 2.1 time: 0.158787 Jul 31 02:06:31.201182 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3361/6755] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:31 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:32.222038 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-68be6b3a-0eb2-4cad-b0eb-a891d56cbaf8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:32.222697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-68be6b3a-0eb2-4cad-b0eb-a891d56cbaf8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:32.229590 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-68be6b3a-0eb2-4cad-b0eb-a891d56cbaf8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:32.230051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-68be6b3a-0eb2-4cad-b0eb-a891d56cbaf8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:32.230837 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-68be6b3a-0eb2-4cad-b0eb-a891d56cbaf8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:32.231286 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-68be6b3a-0eb2-4cad-b0eb-a891d56cbaf8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:32.622352 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-68be6b3a-0eb2-4cad-b0eb-a891d56cbaf8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:32.630421 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-68be6b3a-0eb2-4cad-b0eb-a891d56cbaf8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1725 microversion: 2.1 time: 0.412266 Jul 31 02:06:32.631002 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3395/6756] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:32 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1725 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:33.653095 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2dfb4be8-c73b-46a7-8a5e-5646fa3b135e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:33.653661 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2dfb4be8-c73b-46a7-8a5e-5646fa3b135e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:33.660533 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2dfb4be8-c73b-46a7-8a5e-5646fa3b135e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:33.661008 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2dfb4be8-c73b-46a7-8a5e-5646fa3b135e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:33.661795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2dfb4be8-c73b-46a7-8a5e-5646fa3b135e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:33.662258 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2dfb4be8-c73b-46a7-8a5e-5646fa3b135e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:33.793276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2dfb4be8-c73b-46a7-8a5e-5646fa3b135e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:33.803823 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2dfb4be8-c73b-46a7-8a5e-5646fa3b135e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1725 microversion: 2.1 time: 0.154383 Jul 31 02:06:33.804929 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3362/6757] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:33 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:06:34.827162 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4f1eebd5-1b34-42bb-aff5-8df485f8db18 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:34.827806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4f1eebd5-1b34-42bb-aff5-8df485f8db18 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:34.834562 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f1eebd5-1b34-42bb-aff5-8df485f8db18 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:34.835021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f1eebd5-1b34-42bb-aff5-8df485f8db18 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:34.835824 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f1eebd5-1b34-42bb-aff5-8df485f8db18 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:34.836271 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f1eebd5-1b34-42bb-aff5-8df485f8db18 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:34.967330 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4f1eebd5-1b34-42bb-aff5-8df485f8db18 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:34.975188 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4f1eebd5-1b34-42bb-aff5-8df485f8db18 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1725 microversion: 2.1 time: 0.151913 Jul 31 02:06:34.975796 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3396/6758] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:34 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:35.996319 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dd66d1ec-f6be-461c-bb4e-f0633309c84c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:35.996954 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dd66d1ec-f6be-461c-bb4e-f0633309c84c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:35.999581 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=27 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:06:36.005320 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd66d1ec-f6be-461c-bb4e-f0633309c84c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:36.005682 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd66d1ec-f6be-461c-bb4e-f0633309c84c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:36.006515 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd66d1ec-f6be-461c-bb4e-f0633309c84c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:36.006976 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dd66d1ec-f6be-461c-bb4e-f0633309c84c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:36.011478 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=77 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:06:36.135409 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dd66d1ec-f6be-461c-bb4e-f0633309c84c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:36.143452 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dd66d1ec-f6be-461c-bb4e-f0633309c84c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1725 microversion: 2.1 time: 0.151009 Jul 31 02:06:36.144050 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3363/6759] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:35 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:37.166299 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-685fecc6-c699-47af-a8d8-a9d0bacbe392 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:37.167227 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-685fecc6-c699-47af-a8d8-a9d0bacbe392 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:37.170090 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=35 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:06:37.175530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-685fecc6-c699-47af-a8d8-a9d0bacbe392 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:37.176215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-685fecc6-c699-47af-a8d8-a9d0bacbe392 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:37.177599 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-685fecc6-c699-47af-a8d8-a9d0bacbe392 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:37.178060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-685fecc6-c699-47af-a8d8-a9d0bacbe392 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:37.184135 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:06:37.312343 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-685fecc6-c699-47af-a8d8-a9d0bacbe392 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:37.320279 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-685fecc6-c699-47af-a8d8-a9d0bacbe392 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1725 microversion: 2.1 time: 0.159230 Jul 31 02:06:37.320857 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3397/6760] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:37 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:38.342938 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e6a02792-6e09-417a-952e-536c59e0a188 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:38.343639 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e6a02792-6e09-417a-952e-536c59e0a188 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:38.350627 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a02792-6e09-417a-952e-536c59e0a188 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:38.351124 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a02792-6e09-417a-952e-536c59e0a188 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:38.351938 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a02792-6e09-417a-952e-536c59e0a188 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:38.352392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6a02792-6e09-417a-952e-536c59e0a188 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:38.484510 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e6a02792-6e09-417a-952e-536c59e0a188 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:38.493422 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e6a02792-6e09-417a-952e-536c59e0a188 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1725 microversion: 2.1 time: 0.154397 Jul 31 02:06:38.494019 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3364/6761] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:38 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:39.517365 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-20689c82-fafb-4f5c-beb1-a51655863267 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:39.517996 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-20689c82-fafb-4f5c-beb1-a51655863267 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:39.525515 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20689c82-fafb-4f5c-beb1-a51655863267 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:39.525971 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20689c82-fafb-4f5c-beb1-a51655863267 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:39.526750 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20689c82-fafb-4f5c-beb1-a51655863267 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:39.527185 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20689c82-fafb-4f5c-beb1-a51655863267 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:39.675542 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-20689c82-fafb-4f5c-beb1-a51655863267 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:39.688248 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-20689c82-fafb-4f5c-beb1-a51655863267 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1725 microversion: 2.1 time: 0.176720 Jul 31 02:06:39.688851 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3398/6762] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:39 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:40.713342 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f1059dbc-7b30-4bfb-a262-245a88821865 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:40.713997 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f1059dbc-7b30-4bfb-a262-245a88821865 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:40.720872 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1059dbc-7b30-4bfb-a262-245a88821865 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:40.721337 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1059dbc-7b30-4bfb-a262-245a88821865 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:40.722105 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1059dbc-7b30-4bfb-a262-245a88821865 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:40.722553 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f1059dbc-7b30-4bfb-a262-245a88821865 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:40.863193 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f1059dbc-7b30-4bfb-a262-245a88821865 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:40.872734 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f1059dbc-7b30-4bfb-a262-245a88821865 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1722 microversion: 2.1 time: 0.163905 Jul 31 02:06:40.873310 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3365/6763] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:40 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:40.894120 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2993d96f-6c5c-4611-bcea-c50a72e34fac tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:06:40.894672 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2993d96f-6c5c-4611-bcea-c50a72e34fac tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:40.901511 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2993d96f-6c5c-4611-bcea-c50a72e34fac tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:40.901978 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2993d96f-6c5c-4611-bcea-c50a72e34fac tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:40.902751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2993d96f-6c5c-4611-bcea-c50a72e34fac tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:40.903201 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2993d96f-6c5c-4611-bcea-c50a72e34fac tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:40.938825 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2993d96f-6c5c-4611-bcea-c50a72e34fac tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:40.939315 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2993d96f-6c5c-4611-bcea-c50a72e34fac tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:40.940150 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2993d96f-6c5c-4611-bcea-c50a72e34fac tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:40.940596 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2993d96f-6c5c-4611-bcea-c50a72e34fac tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:40.964072 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-2993d96f-6c5c-4611-bcea-c50a72e34fac tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Getting quotas for project 6f8bba8850b446fcb8b4cb1aedb51876. Resources: {'cores', 'ram'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:06:40.969153 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-2993d96f-6c5c-4611-bcea-c50a72e34fac tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Getting quotas for user 50f66e518b9143f485b4a9938cb8dd7c and project 6f8bba8850b446fcb8b4cb1aedb51876. Resources: {'cores', 'ram'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:06:41.066409 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2993d96f-6c5c-4611-bcea-c50a72e34fac tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "POST /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486/action" status: 202 len: 0 microversion: 2.1 time: 0.176084 Jul 31 02:06:41.067006 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3399/6764] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:06:40 2022] POST /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:06:41.075806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0f4978c5-6bcf-4e75-ad30-0e014e2da2b4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:41.076440 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0f4978c5-6bcf-4e75-ad30-0e014e2da2b4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:41.082520 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f4978c5-6bcf-4e75-ad30-0e014e2da2b4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:41.082991 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f4978c5-6bcf-4e75-ad30-0e014e2da2b4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:41.083824 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f4978c5-6bcf-4e75-ad30-0e014e2da2b4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:41.084331 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0f4978c5-6bcf-4e75-ad30-0e014e2da2b4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:41.278253 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0f4978c5-6bcf-4e75-ad30-0e014e2da2b4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:41.286332 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0f4978c5-6bcf-4e75-ad30-0e014e2da2b4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1721 microversion: 2.1 time: 0.214979 Jul 31 02:06:41.286895 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3366/6765] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:41 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:41.799593 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-56fe2a6e-9284-4752-9bb3-6d5c49809fc3 req-2902bff9-d9b3-4bfb-b4f7-02133e7e7287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c51596d-f2c3-4521-aede-0bfe6e475486", "name": "network-vif-plugged", "status": "completed", "tag": "90540662-84bb-4d10-bc9e-a86cfa5f4a91"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:06:41.817373 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-56fe2a6e-9284-4752-9bb3-6d5c49809fc3 req-2902bff9-d9b3-4bfb-b4f7-02133e7e7287 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:41.817932 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-56fe2a6e-9284-4752-9bb3-6d5c49809fc3 req-2902bff9-d9b3-4bfb-b4f7-02133e7e7287 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:41.840350 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-56fe2a6e-9284-4752-9bb3-6d5c49809fc3 req-2902bff9-d9b3-4bfb-b4f7-02133e7e7287 service nova] Creating event network-vif-plugged:90540662-84bb-4d10-bc9e-a86cfa5f4a91 for instance 1c51596d-f2c3-4521-aede-0bfe6e475486 on n-h1-master-1 Jul 31 02:06:41.846066 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-56fe2a6e-9284-4752-9bb3-6d5c49809fc3 req-2902bff9-d9b3-4bfb-b4f7-02133e7e7287 service nova] Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:06:41.858786 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-56fe2a6e-9284-4752-9bb3-6d5c49809fc3 req-2902bff9-d9b3-4bfb-b4f7-02133e7e7287 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068263 Jul 31 02:06:41.859499 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3400/6766] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:06:42.308109 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-efc29721-3716-4cb5-bd7d-1df86f140774 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:42.308748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-efc29721-3716-4cb5-bd7d-1df86f140774 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:42.315690 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efc29721-3716-4cb5-bd7d-1df86f140774 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:42.316166 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efc29721-3716-4cb5-bd7d-1df86f140774 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:42.316958 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efc29721-3716-4cb5-bd7d-1df86f140774 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:42.317414 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efc29721-3716-4cb5-bd7d-1df86f140774 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:42.444134 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-efc29721-3716-4cb5-bd7d-1df86f140774 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:42.452127 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-efc29721-3716-4cb5-bd7d-1df86f140774 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1721 microversion: 2.1 time: 0.147961 Jul 31 02:06:42.452694 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3367/6767] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:42 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:43.475440 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9a5c0f22-a8a6-4818-add1-2944c5ae749c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:43.476138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9a5c0f22-a8a6-4818-add1-2944c5ae749c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:43.482810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a5c0f22-a8a6-4818-add1-2944c5ae749c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:43.483267 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a5c0f22-a8a6-4818-add1-2944c5ae749c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:43.484060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a5c0f22-a8a6-4818-add1-2944c5ae749c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:43.484501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9a5c0f22-a8a6-4818-add1-2944c5ae749c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:43.622478 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9a5c0f22-a8a6-4818-add1-2944c5ae749c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:43.630741 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9a5c0f22-a8a6-4818-add1-2944c5ae749c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1721 microversion: 2.1 time: 0.160377 Jul 31 02:06:43.631311 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3401/6768] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:43 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:44.652619 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-470dc572-8f6e-4ee1-99fc-4b5a48815cef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:44.653264 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-470dc572-8f6e-4ee1-99fc-4b5a48815cef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:44.660212 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-470dc572-8f6e-4ee1-99fc-4b5a48815cef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:44.660687 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-470dc572-8f6e-4ee1-99fc-4b5a48815cef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:44.661451 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-470dc572-8f6e-4ee1-99fc-4b5a48815cef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:44.661898 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-470dc572-8f6e-4ee1-99fc-4b5a48815cef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:44.800245 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-470dc572-8f6e-4ee1-99fc-4b5a48815cef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:44.808939 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-470dc572-8f6e-4ee1-99fc-4b5a48815cef tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1721 microversion: 2.1 time: 0.160275 Jul 31 02:06:44.809519 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3368/6769] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:44 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:45.830133 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-321ac8a5-50f8-429a-92c0-04a2610093d9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:45.830755 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-321ac8a5-50f8-429a-92c0-04a2610093d9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:45.837721 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-321ac8a5-50f8-429a-92c0-04a2610093d9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:45.838755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-321ac8a5-50f8-429a-92c0-04a2610093d9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:45.839568 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-321ac8a5-50f8-429a-92c0-04a2610093d9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:45.840014 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-321ac8a5-50f8-429a-92c0-04a2610093d9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:45.985007 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-321ac8a5-50f8-429a-92c0-04a2610093d9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:45.995376 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-321ac8a5-50f8-429a-92c0-04a2610093d9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1721 microversion: 2.1 time: 0.169115 Jul 31 02:06:46.002038 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3402/6770] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:45 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:47.019049 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f0342507-f803-4c2c-a7b4-a594f4e913b2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:47.019699 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f0342507-f803-4c2c-a7b4-a594f4e913b2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:47.027457 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f0342507-f803-4c2c-a7b4-a594f4e913b2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:47.028034 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f0342507-f803-4c2c-a7b4-a594f4e913b2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:47.028817 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f0342507-f803-4c2c-a7b4-a594f4e913b2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:47.029272 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f0342507-f803-4c2c-a7b4-a594f4e913b2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:47.425058 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-7a245d3a-8b83-4e38-9a93-8c63fb4bb20a req-dc8aeb12-8abd-471e-bca1-4d961d4ff13d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c51596d-f2c3-4521-aede-0bfe6e475486", "name": "network-vif-unplugged", "status": "completed", "tag": "90540662-84bb-4d10-bc9e-a86cfa5f4a91"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:06:47.435376 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7a245d3a-8b83-4e38-9a93-8c63fb4bb20a req-dc8aeb12-8abd-471e-bca1-4d961d4ff13d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:47.435830 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7a245d3a-8b83-4e38-9a93-8c63fb4bb20a req-dc8aeb12-8abd-471e-bca1-4d961d4ff13d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:47.448307 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-7a245d3a-8b83-4e38-9a93-8c63fb4bb20a req-dc8aeb12-8abd-471e-bca1-4d961d4ff13d service nova] Creating event network-vif-unplugged:90540662-84bb-4d10-bc9e-a86cfa5f4a91 for instance 1c51596d-f2c3-4521-aede-0bfe6e475486 on n-h2-master-1 Jul 31 02:06:47.449276 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f0342507-f803-4c2c-a7b4-a594f4e913b2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:47.454912 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-7a245d3a-8b83-4e38-9a93-8c63fb4bb20a req-dc8aeb12-8abd-471e-bca1-4d961d4ff13d service nova] Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:06:47.458086 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f0342507-f803-4c2c-a7b4-a594f4e913b2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1721 microversion: 2.1 time: 0.443671 Jul 31 02:06:47.458862 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3369/6771] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:47 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1721 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:47.480444 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-7a245d3a-8b83-4e38-9a93-8c63fb4bb20a req-dc8aeb12-8abd-471e-bca1-4d961d4ff13d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059323 Jul 31 02:06:47.481077 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3403/6772] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:06:48.481288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-aa11e48c-03c5-4041-b3fa-e018b06d0625 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:48.481919 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-aa11e48c-03c5-4041-b3fa-e018b06d0625 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:48.488725 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa11e48c-03c5-4041-b3fa-e018b06d0625 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:48.489198 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa11e48c-03c5-4041-b3fa-e018b06d0625 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:48.489986 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa11e48c-03c5-4041-b3fa-e018b06d0625 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:48.490445 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-aa11e48c-03c5-4041-b3fa-e018b06d0625 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:48.627299 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-aa11e48c-03c5-4041-b3fa-e018b06d0625 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:48.636109 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-aa11e48c-03c5-4041-b3fa-e018b06d0625 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1721 microversion: 2.1 time: 0.159502 Jul 31 02:06:48.636699 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3370/6773] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:48 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:49.523753 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-4605c97f-5463-4937-9e61-c4b2904449a0 req-3377da8a-3e83-4f90-9bd5-a7b4b9b376f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c51596d-f2c3-4521-aede-0bfe6e475486", "tag": "90540662-84bb-4d10-bc9e-a86cfa5f4a91"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:06:49.533783 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4605c97f-5463-4937-9e61-c4b2904449a0 req-3377da8a-3e83-4f90-9bd5-a7b4b9b376f4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:49.534512 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4605c97f-5463-4937-9e61-c4b2904449a0 req-3377da8a-3e83-4f90-9bd5-a7b4b9b376f4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:49.546907 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-4605c97f-5463-4937-9e61-c4b2904449a0 req-3377da8a-3e83-4f90-9bd5-a7b4b9b376f4 service nova] Creating event network-changed:90540662-84bb-4d10-bc9e-a86cfa5f4a91 for instance 1c51596d-f2c3-4521-aede-0bfe6e475486 on n-h2-master-1 Jul 31 02:06:49.557706 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-4605c97f-5463-4937-9e61-c4b2904449a0 req-3377da8a-3e83-4f90-9bd5-a7b4b9b376f4 service nova] Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:06:49.576221 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-4605c97f-5463-4937-9e61-c4b2904449a0 req-3377da8a-3e83-4f90-9bd5-a7b4b9b376f4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056829 Jul 31 02:06:49.576814 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3404/6774] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:06:49.658220 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-960e827c-db28-4c9c-9131-04d3ab1a265e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:49.660923 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-960e827c-db28-4c9c-9131-04d3ab1a265e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:49.668523 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-960e827c-db28-4c9c-9131-04d3ab1a265e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:49.669167 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-960e827c-db28-4c9c-9131-04d3ab1a265e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:49.670063 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-960e827c-db28-4c9c-9131-04d3ab1a265e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:49.670640 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-960e827c-db28-4c9c-9131-04d3ab1a265e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:50.001341 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-960e827c-db28-4c9c-9131-04d3ab1a265e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:50.009801 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-960e827c-db28-4c9c-9131-04d3ab1a265e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1721 microversion: 2.1 time: 0.355821 Jul 31 02:06:50.010374 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3371/6775] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:49 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1721 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:51.030000 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:06:51.034760 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2a4cc51a-b9fa-44a6-af2d-6927fc6ec0c3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:51.035603 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2a4cc51a-b9fa-44a6-af2d-6927fc6ec0c3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:51.042773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2a4cc51a-b9fa-44a6-af2d-6927fc6ec0c3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:51.043311 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2a4cc51a-b9fa-44a6-af2d-6927fc6ec0c3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:51.044463 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2a4cc51a-b9fa-44a6-af2d-6927fc6ec0c3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:51.044924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2a4cc51a-b9fa-44a6-af2d-6927fc6ec0c3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:51.195097 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2a4cc51a-b9fa-44a6-af2d-6927fc6ec0c3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:51.203180 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2a4cc51a-b9fa-44a6-af2d-6927fc6ec0c3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1721 microversion: 2.1 time: 0.175137 Jul 31 02:06:51.203776 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3405/6776] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:51 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:52.225278 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-db53e028-29f2-4593-b197-ec50526200af tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:52.225925 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-db53e028-29f2-4593-b197-ec50526200af tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:52.233339 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db53e028-29f2-4593-b197-ec50526200af tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:52.233813 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db53e028-29f2-4593-b197-ec50526200af tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:52.234611 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db53e028-29f2-4593-b197-ec50526200af tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:52.235095 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db53e028-29f2-4593-b197-ec50526200af tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:52.366878 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-db53e028-29f2-4593-b197-ec50526200af tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:52.375682 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-db53e028-29f2-4593-b197-ec50526200af tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1721 microversion: 2.1 time: 0.154550 Jul 31 02:06:52.376165 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3372/6777] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:52 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:53.398175 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-77de8f75-2cad-4853-9ee2-79911896f94e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:53.398805 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-77de8f75-2cad-4853-9ee2-79911896f94e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:53.405583 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77de8f75-2cad-4853-9ee2-79911896f94e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:53.406048 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77de8f75-2cad-4853-9ee2-79911896f94e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:53.406822 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77de8f75-2cad-4853-9ee2-79911896f94e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:53.407278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-77de8f75-2cad-4853-9ee2-79911896f94e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:53.539455 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-77de8f75-2cad-4853-9ee2-79911896f94e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:53.547443 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-77de8f75-2cad-4853-9ee2-79911896f94e tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1721 microversion: 2.1 time: 0.153437 Jul 31 02:06:53.548019 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3406/6778] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:53 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:54.569567 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-096a0964-47f2-4cc4-8bb7-b7817627e7bd tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:54.570198 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-096a0964-47f2-4cc4-8bb7-b7817627e7bd tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:54.577730 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-096a0964-47f2-4cc4-8bb7-b7817627e7bd tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:54.578197 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-096a0964-47f2-4cc4-8bb7-b7817627e7bd tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:54.578968 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-096a0964-47f2-4cc4-8bb7-b7817627e7bd tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:54.579443 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-096a0964-47f2-4cc4-8bb7-b7817627e7bd tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:54.707786 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-096a0964-47f2-4cc4-8bb7-b7817627e7bd tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:54.715754 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-096a0964-47f2-4cc4-8bb7-b7817627e7bd tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1721 microversion: 2.1 time: 0.150112 Jul 31 02:06:54.716353 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3373/6779] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:54 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:55.737937 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-421ba93a-905f-4517-84fb-b6d8a797c464 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:55.738508 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-421ba93a-905f-4517-84fb-b6d8a797c464 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:55.746106 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-421ba93a-905f-4517-84fb-b6d8a797c464 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:55.746567 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-421ba93a-905f-4517-84fb-b6d8a797c464 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:55.747367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-421ba93a-905f-4517-84fb-b6d8a797c464 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:55.747820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-421ba93a-905f-4517-84fb-b6d8a797c464 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:55.877008 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-421ba93a-905f-4517-84fb-b6d8a797c464 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:55.885055 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-421ba93a-905f-4517-84fb-b6d8a797c464 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1721 microversion: 2.1 time: 0.151133 Jul 31 02:06:55.886270 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3407/6780] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:55 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:56.907347 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-09cf2a9f-434c-46f9-b09d-41d382ec9bd4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:56.907999 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-09cf2a9f-434c-46f9-b09d-41d382ec9bd4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:56.914944 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-09cf2a9f-434c-46f9-b09d-41d382ec9bd4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:56.915442 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-09cf2a9f-434c-46f9-b09d-41d382ec9bd4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:56.916216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-09cf2a9f-434c-46f9-b09d-41d382ec9bd4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:56.917159 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-09cf2a9f-434c-46f9-b09d-41d382ec9bd4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:57.051275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-09cf2a9f-434c-46f9-b09d-41d382ec9bd4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:57.059737 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-09cf2a9f-434c-46f9-b09d-41d382ec9bd4 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1721 microversion: 2.1 time: 0.156304 Jul 31 02:06:57.060306 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3374/6781] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:56 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:58.081229 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4d41a3e5-ca1e-42f6-b171-f0fee39f7243 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:58.081913 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4d41a3e5-ca1e-42f6-b171-f0fee39f7243 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:58.088803 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d41a3e5-ca1e-42f6-b171-f0fee39f7243 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:58.089269 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d41a3e5-ca1e-42f6-b171-f0fee39f7243 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:58.090053 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d41a3e5-ca1e-42f6-b171-f0fee39f7243 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:58.090506 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4d41a3e5-ca1e-42f6-b171-f0fee39f7243 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:58.222461 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4d41a3e5-ca1e-42f6-b171-f0fee39f7243 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:58.230432 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4d41a3e5-ca1e-42f6-b171-f0fee39f7243 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1721 microversion: 2.1 time: 0.153108 Jul 31 02:06:58.231020 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3408/6782] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:58 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:06:59.253017 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a8592164-e508-4a51-9660-54c517406a69 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:06:59.253673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a8592164-e508-4a51-9660-54c517406a69 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:06:59.261206 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8592164-e508-4a51-9660-54c517406a69 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:59.261679 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8592164-e508-4a51-9660-54c517406a69 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:59.262461 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8592164-e508-4a51-9660-54c517406a69 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:06:59.262916 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a8592164-e508-4a51-9660-54c517406a69 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:06:59.394454 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a8592164-e508-4a51-9660-54c517406a69 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:06:59.403150 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a8592164-e508-4a51-9660-54c517406a69 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1721 microversion: 2.1 time: 0.154079 Jul 31 02:06:59.403758 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3375/6783] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:06:59 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:00.424749 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9d944d5d-dfb4-4b46-ab47-7b5dcbf445a2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:00.425346 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9d944d5d-dfb4-4b46-ab47-7b5dcbf445a2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:00.432244 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d944d5d-dfb4-4b46-ab47-7b5dcbf445a2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:00.432695 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d944d5d-dfb4-4b46-ab47-7b5dcbf445a2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:00.433459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d944d5d-dfb4-4b46-ab47-7b5dcbf445a2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:00.433898 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d944d5d-dfb4-4b46-ab47-7b5dcbf445a2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:00.570470 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9d944d5d-dfb4-4b46-ab47-7b5dcbf445a2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:00.578536 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9d944d5d-dfb4-4b46-ab47-7b5dcbf445a2 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1714 microversion: 2.1 time: 0.157749 Jul 31 02:07:00.579121 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3409/6784] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:00 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:00.599455 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-12dc34e1-857a-4eeb-92e9-2a53dd188153 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:00.600096 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-12dc34e1-857a-4eeb-92e9-2a53dd188153 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:00.607601 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12dc34e1-857a-4eeb-92e9-2a53dd188153 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:00.608079 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12dc34e1-857a-4eeb-92e9-2a53dd188153 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:00.608862 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12dc34e1-857a-4eeb-92e9-2a53dd188153 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:00.609320 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-12dc34e1-857a-4eeb-92e9-2a53dd188153 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:00.736573 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-12dc34e1-857a-4eeb-92e9-2a53dd188153 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:00.744833 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-12dc34e1-857a-4eeb-92e9-2a53dd188153 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1714 microversion: 2.1 time: 0.149321 Jul 31 02:07:00.745396 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3376/6785] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:00 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1714 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:00.765732 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5e9e3c5e-2993-4743-bb37-dfdf12e1f78a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:00.766347 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5e9e3c5e-2993-4743-bb37-dfdf12e1f78a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:00.772311 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e9e3c5e-2993-4743-bb37-dfdf12e1f78a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:00.772765 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e9e3c5e-2993-4743-bb37-dfdf12e1f78a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:00.773529 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e9e3c5e-2993-4743-bb37-dfdf12e1f78a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:00.773971 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5e9e3c5e-2993-4743-bb37-dfdf12e1f78a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:00.907731 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5e9e3c5e-2993-4743-bb37-dfdf12e1f78a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:00.915662 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5e9e3c5e-2993-4743-bb37-dfdf12e1f78a tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1714 microversion: 2.1 time: 0.153769 Jul 31 02:07:00.916226 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3410/6786] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:00 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:00.937699 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c920283-20b3-4d15-a4a1-f28dd6c6b9a1 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:00.938139 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2c920283-20b3-4d15-a4a1-f28dd6c6b9a1 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:00.944139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c920283-20b3-4d15-a4a1-f28dd6c6b9a1 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:00.944605 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c920283-20b3-4d15-a4a1-f28dd6c6b9a1 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:00.945375 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c920283-20b3-4d15-a4a1-f28dd6c6b9a1 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:00.945825 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c920283-20b3-4d15-a4a1-f28dd6c6b9a1 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:00.969315 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2c920283-20b3-4d15-a4a1-f28dd6c6b9a1 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:07:01.043634 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2c920283-20b3-4d15-a4a1-f28dd6c6b9a1 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 204 len: 0 microversion: 2.1 time: 0.109654 Jul 31 02:07:01.044509 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3377/6787] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:07:00 2022] DELETE /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:07:01.052836 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e37e7eb9-aefc-4db9-91d8-1f489e413cc0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:01.053484 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e37e7eb9-aefc-4db9-91d8-1f489e413cc0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:01.059401 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e37e7eb9-aefc-4db9-91d8-1f489e413cc0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:01.059853 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e37e7eb9-aefc-4db9-91d8-1f489e413cc0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:01.060613 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e37e7eb9-aefc-4db9-91d8-1f489e413cc0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:01.061050 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e37e7eb9-aefc-4db9-91d8-1f489e413cc0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:01.186673 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e37e7eb9-aefc-4db9-91d8-1f489e413cc0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:01.188924 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:01.195735 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e37e7eb9-aefc-4db9-91d8-1f489e413cc0 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1720 microversion: 2.1 time: 0.146729 Jul 31 02:07:01.196302 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3411/6788] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:01 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:07:02.217633 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cac83b99-1a1e-46c7-b8e2-662cf350abb3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:02.218272 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cac83b99-1a1e-46c7-b8e2-662cf350abb3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:02.225114 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cac83b99-1a1e-46c7-b8e2-662cf350abb3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:02.225583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cac83b99-1a1e-46c7-b8e2-662cf350abb3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:02.226364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cac83b99-1a1e-46c7-b8e2-662cf350abb3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:02.226820 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cac83b99-1a1e-46c7-b8e2-662cf350abb3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:02.231588 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:02.381768 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cac83b99-1a1e-46c7-b8e2-662cf350abb3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:02.390606 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cac83b99-1a1e-46c7-b8e2-662cf350abb3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1720 microversion: 2.1 time: 0.177882 Jul 31 02:07:02.391190 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3378/6789] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:02 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:03.413121 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-86b111d7-c32c-484f-abe5-fb191472d92c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:03.413758 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-86b111d7-c32c-484f-abe5-fb191472d92c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:03.422923 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-86b111d7-c32c-484f-abe5-fb191472d92c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:03.423478 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-86b111d7-c32c-484f-abe5-fb191472d92c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:03.424275 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-86b111d7-c32c-484f-abe5-fb191472d92c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:03.424724 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-86b111d7-c32c-484f-abe5-fb191472d92c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:03.521912 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-86b111d7-c32c-484f-abe5-fb191472d92c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:03.537333 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-fb4bcb4e-c4b8-44ed-bcf8-04c99d860fec req-d4534fe3-9787-49d1-b29f-e00799b5550e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c51596d-f2c3-4521-aede-0bfe6e475486", "name": "network-vif-deleted", "tag": "90540662-84bb-4d10-bc9e-a86cfa5f4a91"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:07:03.538812 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-86b111d7-c32c-484f-abe5-fb191472d92c tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1652 microversion: 2.1 time: 0.129614 Jul 31 02:07:03.539594 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3412/6790] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:03 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1652 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:03.550118 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fb4bcb4e-c4b8-44ed-bcf8-04c99d860fec req-d4534fe3-9787-49d1-b29f-e00799b5550e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:03.550670 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fb4bcb4e-c4b8-44ed-bcf8-04c99d860fec req-d4534fe3-9787-49d1-b29f-e00799b5550e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:03.579374 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-fb4bcb4e-c4b8-44ed-bcf8-04c99d860fec req-d4534fe3-9787-49d1-b29f-e00799b5550e service nova] Creating event network-vif-deleted:90540662-84bb-4d10-bc9e-a86cfa5f4a91 for instance 1c51596d-f2c3-4521-aede-0bfe6e475486 on n-h2-master-1 Jul 31 02:07:03.587387 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-fb4bcb4e-c4b8-44ed-bcf8-04c99d860fec req-d4534fe3-9787-49d1-b29f-e00799b5550e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054505 Jul 31 02:07:03.588018 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3379/6791] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:07:04.561660 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c09b00c8-3eb4-4fd9-8eb1-dba1248fc269 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:04.562295 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c09b00c8-3eb4-4fd9-8eb1-dba1248fc269 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:04.569488 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c09b00c8-3eb4-4fd9-8eb1-dba1248fc269 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:04.570170 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c09b00c8-3eb4-4fd9-8eb1-dba1248fc269 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:04.570992 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c09b00c8-3eb4-4fd9-8eb1-dba1248fc269 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:04.571651 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c09b00c8-3eb4-4fd9-8eb1-dba1248fc269 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:04.652870 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c09b00c8-3eb4-4fd9-8eb1-dba1248fc269 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:04.661391 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c09b00c8-3eb4-4fd9-8eb1-dba1248fc269 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1369 microversion: 2.1 time: 0.104222 Jul 31 02:07:04.661972 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3413/6792] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:04 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:05.686291 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ed19682-7b5f-4812-a89f-a81ec64388a9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:05.687011 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0ed19682-7b5f-4812-a89f-a81ec64388a9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:05.694237 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ed19682-7b5f-4812-a89f-a81ec64388a9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:05.694708 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ed19682-7b5f-4812-a89f-a81ec64388a9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:05.695520 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ed19682-7b5f-4812-a89f-a81ec64388a9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:05.695971 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ed19682-7b5f-4812-a89f-a81ec64388a9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:05.770910 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0ed19682-7b5f-4812-a89f-a81ec64388a9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:05.779539 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0ed19682-7b5f-4812-a89f-a81ec64388a9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1369 microversion: 2.1 time: 0.097527 Jul 31 02:07:05.780119 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3380/6793] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:05 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:06.803461 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-573ad0cf-f59e-4adf-b018-95a4e1c8e095 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:06.804101 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-573ad0cf-f59e-4adf-b018-95a4e1c8e095 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:06.812147 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-573ad0cf-f59e-4adf-b018-95a4e1c8e095 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:06.812619 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-573ad0cf-f59e-4adf-b018-95a4e1c8e095 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:06.813425 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-573ad0cf-f59e-4adf-b018-95a4e1c8e095 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:06.813880 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-573ad0cf-f59e-4adf-b018-95a4e1c8e095 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:06.880000 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-573ad0cf-f59e-4adf-b018-95a4e1c8e095 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:06.888146 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-573ad0cf-f59e-4adf-b018-95a4e1c8e095 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1369 microversion: 2.1 time: 0.090036 Jul 31 02:07:06.888723 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3414/6794] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:06 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:07.909464 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ff6e8309-f75c-4abe-9d64-11522c066424 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:07.910030 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ff6e8309-f75c-4abe-9d64-11522c066424 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:07.912958 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:07.918469 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff6e8309-f75c-4abe-9d64-11522c066424 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:07.918936 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff6e8309-f75c-4abe-9d64-11522c066424 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:07.919743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff6e8309-f75c-4abe-9d64-11522c066424 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:07.920200 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff6e8309-f75c-4abe-9d64-11522c066424 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:07.952270 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff6e8309-f75c-4abe-9d64-11522c066424 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:07.952739 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ff6e8309-f75c-4abe-9d64-11522c066424 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:07.953204 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-ff6e8309-f75c-4abe-9d64-11522c066424 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lazy-loading 'fault' on Instance uuid 1c51596d-f2c3-4521-aede-0bfe6e475486 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:07:07.997394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ff6e8309-f75c-4abe-9d64-11522c066424 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66e518b9143f485b4a9938cb8dd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8bba8850b446fcb8b4cb1aedb51876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:08.005825 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ff6e8309-f75c-4abe-9d64-11522c066424 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 200 len: 1374 microversion: 2.1 time: 0.100302 Jul 31 02:07:08.006758 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3381/6795] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:07 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 1374 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:09.033082 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7c8cef54-90c4-4c1e-b6cb-4fcb1ba185ea tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:09.033703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7c8cef54-90c4-4c1e-b6cb-4fcb1ba185ea tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:09.036550 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:09.042764 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c8cef54-90c4-4c1e-b6cb-4fcb1ba185ea tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:09.043225 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c8cef54-90c4-4c1e-b6cb-4fcb1ba185ea tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:09.044022 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c8cef54-90c4-4c1e-b6cb-4fcb1ba185ea tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:09.044499 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7c8cef54-90c4-4c1e-b6cb-4fcb1ba185ea tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:09.058906 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-7c8cef54-90c4-4c1e-b6cb-4fcb1ba185ea tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] HTTP exception thrown: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7c8cef54-90c4-4c1e-b6cb-4fcb1ba185ea tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Request method failure captured: Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 HTTP/1.1 Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eJ1I2l5yEhe8PxarxZ9XRm4z-6QjmhbZOvRUbxzByRHW6l8LEbbUxtG2DytV3QuDPs6Keq8bbte8TVSyRSiRWBkH4zpt8Eg76zlOmP_pIHa1L3zACHKWuHbXQcEqAA0sFnYwcj_YJydQgWa7PJBhmxQGIPQylFIUtatKCWUFm6XMLI Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f8bba8850b446fcb8b4cb1aedb51876", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 50f66e518b9143f485b4a9938cb8dd7c Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '1c51596d-f2c3-4521-aede-0bfe6e475486'} Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:09.060589 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:09.066305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:09.066305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:09.066305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:09.066305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:07:09.066305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:07:09.066305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:09.066305 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:09.066305 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7c8cef54-90c4-4c1e-b6cb-4fcb1ba185ea tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Returning 404 to user: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:09.066305 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7c8cef54-90c4-4c1e-b6cb-4fcb1ba185ea tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 404 len: 111 microversion: 2.1 time: 0.032871 Jul 31 02:07:09.066305 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3415/6796] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:09 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:07:09.121243 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7fb4aa58-0758-45c6-a793-b3eae5795120 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:09.123475 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7fb4aa58-0758-45c6-a793-b3eae5795120 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:09.130300 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fb4aa58-0758-45c6-a793-b3eae5795120 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:09.130767 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fb4aa58-0758-45c6-a793-b3eae5795120 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:09.131580 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fb4aa58-0758-45c6-a793-b3eae5795120 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:09.132039 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7fb4aa58-0758-45c6-a793-b3eae5795120 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:09.144405 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-7fb4aa58-0758-45c6-a793-b3eae5795120 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] HTTP exception thrown: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7fb4aa58-0758-45c6-a793-b3eae5795120 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Request method failure captured: Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486/os-volume_attachments HTTP/1.1 Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eJ1I2l5yEhe8PxarxZ9XRm4z-6QjmhbZOvRUbxzByRHW6l8LEbbUxtG2DytV3QuDPs6Keq8bbte8TVSyRSiRWBkH4zpt8Eg76zlOmP_pIHa1L3zACHKWuHbXQcEqAA0sFnYwcj_YJydQgWa7PJBhmxQGIPQylFIUtatKCWUFm6XMLI Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f8bba8850b446fcb8b4cb1aedb51876", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 50f66e518b9143f485b4a9938cb8dd7c Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: action_args: {'server_id': '1c51596d-f2c3-4521-aede-0bfe6e475486'} Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:07:09.146068 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:09.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:09.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:09.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:09.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:09.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:09.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:09.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:07:09.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:07:09.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:09.151292 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:09.151292 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7fb4aa58-0758-45c6-a793-b3eae5795120 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Returning 404 to user: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:09.151292 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7fb4aa58-0758-45c6-a793-b3eae5795120 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031252 Jul 31 02:07:09.151292 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3382/6797] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:07:09 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:07:12.463043 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-911bed70-a0cb-4209-9ec0-34351027f173 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:12.464149 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-911bed70-a0cb-4209-9ec0-34351027f173 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:12.471157 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-911bed70-a0cb-4209-9ec0-34351027f173 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:12.471716 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-911bed70-a0cb-4209-9ec0-34351027f173 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:12.472487 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-911bed70-a0cb-4209-9ec0-34351027f173 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:12.473056 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-911bed70-a0cb-4209-9ec0-34351027f173 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:12.487087 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-911bed70-a0cb-4209-9ec0-34351027f173 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] HTTP exception thrown: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-911bed70-a0cb-4209-9ec0-34351027f173 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Request method failure captured: Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 HTTP/1.1 Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eJ1I2l5yEhe8PxarxZ9XRm4z-6QjmhbZOvRUbxzByRHW6l8LEbbUxtG2DytV3QuDPs6Keq8bbte8TVSyRSiRWBkH4zpt8Eg76zlOmP_pIHa1L3zACHKWuHbXQcEqAA0sFnYwcj_YJydQgWa7PJBhmxQGIPQylFIUtatKCWUFm6XMLI Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f8bba8850b446fcb8b4cb1aedb51876", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 50f66e518b9143f485b4a9938cb8dd7c Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '1c51596d-f2c3-4521-aede-0bfe6e475486'} Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:07:12.488667 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:07:12.493921 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:12.493921 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.493921 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:12.493921 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.493921 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.493921 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:12.493921 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:12.493921 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:07:12.493921 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:07:12.493921 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:12.493921 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.493921 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-911bed70-a0cb-4209-9ec0-34351027f173 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Returning 404 to user: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:12.493921 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-911bed70-a0cb-4209-9ec0-34351027f173 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 404 len: 111 microversion: 2.1 time: 0.030889 Jul 31 02:07:12.493921 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3416/6798] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:07:12 2022] DELETE /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:07:12.498744 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ef200b07-9859-417b-88f8-a1425179fcf9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:12.499397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ef200b07-9859-417b-88f8-a1425179fcf9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 1c51596d-f2c3-4521-aede-0bfe6e475486] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:12.506163 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef200b07-9859-417b-88f8-a1425179fcf9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:12.506630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef200b07-9859-417b-88f8-a1425179fcf9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:12.507430 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef200b07-9859-417b-88f8-a1425179fcf9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:12.507889 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef200b07-9859-417b-88f8-a1425179fcf9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:12.521327 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-ef200b07-9859-417b-88f8-a1425179fcf9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] HTTP exception thrown: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ef200b07-9859-417b-88f8-a1425179fcf9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Request method failure captured: Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 HTTP/1.1 Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eJ1I2l5yEhe8PxarxZ9XRm4z-6QjmhbZOvRUbxzByRHW6l8LEbbUxtG2DytV3QuDPs6Keq8bbte8TVSyRSiRWBkH4zpt8Eg76zlOmP_pIHa1L3zACHKWuHbXQcEqAA0sFnYwcj_YJydQgWa7PJBhmxQGIPQylFIUtatKCWUFm6XMLI Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f8bba8850b446fcb8b4cb1aedb51876", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 50f66e518b9143f485b4a9938cb8dd7c Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '1c51596d-f2c3-4521-aede-0bfe6e475486'} Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:12.522874 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.529686 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.529686 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:12.529686 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:12.529686 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:07:12.529686 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:07:12.529686 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. Jul 31 02:07:12.529686 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.529686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ef200b07-9859-417b-88f8-a1425179fcf9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Returning 404 to user: Instance 1c51596d-f2c3-4521-aede-0bfe6e475486 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:12.529686 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ef200b07-9859-417b-88f8-a1425179fcf9 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486" status: 404 len: 111 microversion: 2.1 time: 0.029423 Jul 31 02:07:12.529686 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3383/6799] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:12 2022] GET /compute/v2.1/servers/1c51596d-f2c3-4521-aede-0bfe6e475486 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:07:12.533665 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-759a7033-cf93-4d66-838a-0ea7dc2077f3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:12.534187 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-759a7033-cf93-4d66-838a-0ea7dc2077f3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:12.540618 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-759a7033-cf93-4d66-838a-0ea7dc2077f3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:12.541088 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-759a7033-cf93-4d66-838a-0ea7dc2077f3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:12.542465 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-759a7033-cf93-4d66-838a-0ea7dc2077f3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:12.542921 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-759a7033-cf93-4d66-838a-0ea7dc2077f3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:12.557789 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-759a7033-cf93-4d66-838a-0ea7dc2077f3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] HTTP exception thrown: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-759a7033-cf93-4d66-838a-0ea7dc2077f3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Request method failure captured: Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 HTTP/1.1 Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eJ1I2l5yEhe8PxarxZ9XRm4z-6QjmhbZOvRUbxzByRHW6l8LEbbUxtG2DytV3QuDPs6Keq8bbte8TVSyRSiRWBkH4zpt8Eg76zlOmP_pIHa1L3zACHKWuHbXQcEqAA0sFnYwcj_YJydQgWa7PJBhmxQGIPQylFIUtatKCWUFm6XMLI Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f8bba8850b446fcb8b4cb1aedb51876", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 50f66e518b9143f485b4a9938cb8dd7c Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: exception: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'd93dfb8e-de00-45b8-bb74-97c5260603a6'} Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:07:12.559613 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:07:12.569957 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:07:12.569957 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.569957 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:12.569957 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.569957 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.569957 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:12.569957 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:12.569957 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:07:12.569957 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:07:12.569957 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:07:12.569957 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.569957 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-759a7033-cf93-4d66-838a-0ea7dc2077f3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Returning 404 to user: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:12.569957 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-759a7033-cf93-4d66-838a-0ea7dc2077f3 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 404 len: 111 microversion: 2.1 time: 0.031610 Jul 31 02:07:12.569957 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3417/6800] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:07:12 2022] DELETE /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 02:07:12.571186 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d83c1ff9-5d8c-4753-9901-074ad1048b3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:12.571186 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d83c1ff9-5d8c-4753-9901-074ad1048b3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: d93dfb8e-de00-45b8-bb74-97c5260603a6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:12.577216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d83c1ff9-5d8c-4753-9901-074ad1048b3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:12.577689 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d83c1ff9-5d8c-4753-9901-074ad1048b3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:12.578527 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d83c1ff9-5d8c-4753-9901-074ad1048b3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:12.578987 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d83c1ff9-5d8c-4753-9901-074ad1048b3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:12.593959 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-d83c1ff9-5d8c-4753-9901-074ad1048b3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] HTTP exception thrown: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d83c1ff9-5d8c-4753-9901-074ad1048b3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Request method failure captured: Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 HTTP/1.1 Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eJ1I2l5yEhe8PxarxZ9XRm4z-6QjmhbZOvRUbxzByRHW6l8LEbbUxtG2DytV3QuDPs6Keq8bbte8TVSyRSiRWBkH4zpt8Eg76zlOmP_pIHa1L3zACHKWuHbXQcEqAA0sFnYwcj_YJydQgWa7PJBhmxQGIPQylFIUtatKCWUFm6XMLI Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f8bba8850b446fcb8b4cb1aedb51876", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 50f66e518b9143f485b4a9938cb8dd7c Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: exception: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'd93dfb8e-de00-45b8-bb74-97c5260603a6'} Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:12.595598 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.601975 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.601975 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:12.601975 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:12.601975 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:07:12.601975 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:07:12.601975 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. Jul 31 02:07:12.601975 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.601975 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d83c1ff9-5d8c-4753-9901-074ad1048b3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Returning 404 to user: Instance d93dfb8e-de00-45b8-bb74-97c5260603a6 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:12.601975 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d83c1ff9-5d8c-4753-9901-074ad1048b3d tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6" status: 404 len: 111 microversion: 2.1 time: 0.030874 Jul 31 02:07:12.601975 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3384/6801] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:12 2022] GET /compute/v2.1/servers/d93dfb8e-de00-45b8-bb74-97c5260603a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:07:12.609061 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f1cbccba-dca1-4cbc-9de5-e5f666ed22cf tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:12.610518 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f1cbccba-dca1-4cbc-9de5-e5f666ed22cf tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:12.617178 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1cbccba-dca1-4cbc-9de5-e5f666ed22cf tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:12.617178 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1cbccba-dca1-4cbc-9de5-e5f666ed22cf tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:12.618488 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1cbccba-dca1-4cbc-9de5-e5f666ed22cf tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:12.618941 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1cbccba-dca1-4cbc-9de5-e5f666ed22cf tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:12.632720 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-f1cbccba-dca1-4cbc-9de5-e5f666ed22cf tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] HTTP exception thrown: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f1cbccba-dca1-4cbc-9de5-e5f666ed22cf tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Request method failure captured: Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 HTTP/1.1 Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eJ1I2l5yEhe8PxarxZ9XRm4z-6QjmhbZOvRUbxzByRHW6l8LEbbUxtG2DytV3QuDPs6Keq8bbte8TVSyRSiRWBkH4zpt8Eg76zlOmP_pIHa1L3zACHKWuHbXQcEqAA0sFnYwcj_YJydQgWa7PJBhmxQGIPQylFIUtatKCWUFm6XMLI Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f8bba8850b446fcb8b4cb1aedb51876", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 50f66e518b9143f485b4a9938cb8dd7c Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: exception: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'b576704d-7984-4476-a244-b91d73f2b0c8'} Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:07:12.634274 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:07:12.640325 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:07:12.640325 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.640325 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:12.640325 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.640325 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.640325 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:12.640325 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:12.640325 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:07:12.640325 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:07:12.640325 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:07:12.640325 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.640325 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f1cbccba-dca1-4cbc-9de5-e5f666ed22cf tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Returning 404 to user: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:12.640325 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f1cbccba-dca1-4cbc-9de5-e5f666ed22cf tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 404 len: 111 microversion: 2.1 time: 0.034354 Jul 31 02:07:12.640325 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3418/6802] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:07:12 2022] DELETE /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:07:12.645973 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-97ae810b-eedf-4334-87c3-0fa895e41877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:12.646727 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-97ae810b-eedf-4334-87c3-0fa895e41877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: b576704d-7984-4476-a244-b91d73f2b0c8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:12.653503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97ae810b-eedf-4334-87c3-0fa895e41877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:12.654045 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97ae810b-eedf-4334-87c3-0fa895e41877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:12.654893 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97ae810b-eedf-4334-87c3-0fa895e41877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:12.655443 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-97ae810b-eedf-4334-87c3-0fa895e41877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:12.669399 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-97ae810b-eedf-4334-87c3-0fa895e41877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] HTTP exception thrown: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-97ae810b-eedf-4334-87c3-0fa895e41877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Request method failure captured: Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 HTTP/1.1 Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eJ1I2l5yEhe8PxarxZ9XRm4z-6QjmhbZOvRUbxzByRHW6l8LEbbUxtG2DytV3QuDPs6Keq8bbte8TVSyRSiRWBkH4zpt8Eg76zlOmP_pIHa1L3zACHKWuHbXQcEqAA0sFnYwcj_YJydQgWa7PJBhmxQGIPQylFIUtatKCWUFm6XMLI Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f8bba8850b446fcb8b4cb1aedb51876", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 50f66e518b9143f485b4a9938cb8dd7c Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: exception: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'b576704d-7984-4476-a244-b91d73f2b0c8'} Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:12.671012 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.676361 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.676361 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:12.676361 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:12.676361 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:07:12.676361 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:07:12.676361 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. Jul 31 02:07:12.676361 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.676361 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-97ae810b-eedf-4334-87c3-0fa895e41877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Returning 404 to user: Instance b576704d-7984-4476-a244-b91d73f2b0c8 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:12.676361 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-97ae810b-eedf-4334-87c3-0fa895e41877 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8" status: 404 len: 111 microversion: 2.1 time: 0.031393 Jul 31 02:07:12.676361 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3385/6803] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:12 2022] GET /compute/v2.1/servers/b576704d-7984-4476-a244-b91d73f2b0c8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:07:12.683433 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e9b0a5c-3286-45bd-a2a6-ea939fb15fd8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:12.683941 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1e9b0a5c-3286-45bd-a2a6-ea939fb15fd8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:12.690095 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e9b0a5c-3286-45bd-a2a6-ea939fb15fd8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:12.690495 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e9b0a5c-3286-45bd-a2a6-ea939fb15fd8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:12.691270 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e9b0a5c-3286-45bd-a2a6-ea939fb15fd8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:12.691740 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1e9b0a5c-3286-45bd-a2a6-ea939fb15fd8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:12.705623 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-1e9b0a5c-3286-45bd-a2a6-ea939fb15fd8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] HTTP exception thrown: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e9b0a5c-3286-45bd-a2a6-ea939fb15fd8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Request method failure captured: Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 HTTP/1.1 Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eJ1I2l5yEhe8PxarxZ9XRm4z-6QjmhbZOvRUbxzByRHW6l8LEbbUxtG2DytV3QuDPs6Keq8bbte8TVSyRSiRWBkH4zpt8Eg76zlOmP_pIHa1L3zACHKWuHbXQcEqAA0sFnYwcj_YJydQgWa7PJBhmxQGIPQylFIUtatKCWUFm6XMLI Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f8bba8850b446fcb8b4cb1aedb51876", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 50f66e518b9143f485b4a9938cb8dd7c Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '798f76a6-9f6c-4bc6-9f98-288b642a5583'} Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:07:12.707181 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:07:12.715939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:07:12.715939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.715939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:12.715939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.715939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.715939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:12.715939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:12.715939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:07:12.715939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:07:12.715939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:07:12.715939 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.715939 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1e9b0a5c-3286-45bd-a2a6-ea939fb15fd8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Returning 404 to user: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:12.715939 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1e9b0a5c-3286-45bd-a2a6-ea939fb15fd8 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "DELETE /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 404 len: 111 microversion: 2.1 time: 0.029304 Jul 31 02:07:12.715939 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3419/6804] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:07:12 2022] DELETE /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:07:12.720275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-684b6dd5-2162-4e9f-92d2-e6649212e529 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:12.720914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-684b6dd5-2162-4e9f-92d2-e6649212e529 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] [instance: 798f76a6-9f6c-4bc6-9f98-288b642a5583] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:12.727264 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-684b6dd5-2162-4e9f-92d2-e6649212e529 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:12.727788 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-684b6dd5-2162-4e9f-92d2-e6649212e529 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:12.728578 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-684b6dd5-2162-4e9f-92d2-e6649212e529 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:12.729038 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-684b6dd5-2162-4e9f-92d2-e6649212e529 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:12.742877 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-684b6dd5-2162-4e9f-92d2-e6649212e529 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] HTTP exception thrown: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-684b6dd5-2162-4e9f-92d2-e6649212e529 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Request method failure captured: Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 HTTP/1.1 Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eJ1I2l5yEhe8PxarxZ9XRm4z-6QjmhbZOvRUbxzByRHW6l8LEbbUxtG2DytV3QuDPs6Keq8bbte8TVSyRSiRWBkH4zpt8Eg76zlOmP_pIHa1L3zACHKWuHbXQcEqAA0sFnYwcj_YJydQgWa7PJBhmxQGIPQylFIUtatKCWUFm6XMLI Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6f8bba8850b446fcb8b4cb1aedb51876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6f8bba8850b446fcb8b4cb1aedb51876", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6f8bba8850b446fcb8b4cb1aedb51876 Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServerActionsTestJSON-945544621 Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 50f66e518b9143f485b4a9938cb8dd7c Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServerActionsTestJSON-945544621-project Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '798f76a6-9f6c-4bc6-9f98-288b642a5583'} Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:12.744675 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.749972 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:12.749972 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:12.749972 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:12.749972 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:07:12.749972 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:07:12.749972 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. Jul 31 02:07:12.749972 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:12.749972 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-684b6dd5-2162-4e9f-92d2-e6649212e529 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Returning 404 to user: Instance 798f76a6-9f6c-4bc6-9f98-288b642a5583 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:12.749972 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-684b6dd5-2162-4e9f-92d2-e6649212e529 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583" status: 404 len: 111 microversion: 2.1 time: 0.031627 Jul 31 02:07:12.749972 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3386/6805] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:12 2022] GET /compute/v2.1/servers/798f76a6-9f6c-4bc6-9f98-288b642a5583 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:07:12.755801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8b61cf38-790c-4499-957c-9aa53116b571 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] Calling method '.version_select at 0x7fedea94a280>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:12.782830 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8b61cf38-790c-4499-957c-9aa53116b571 tempest-ServerActionsTestJSON-945544621 tempest-ServerActionsTestJSON-945544621-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-596934869" status: 202 len: 0 microversion: 2.1 time: 0.030720 Jul 31 02:07:12.783512 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3420/6806] 10.222.0.45 () {58 vars in 1218 bytes} [Sun Jul 31 02:07:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-596934869 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:07:22.058236 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1a587571-9335-46d1-a631-d0bfa0d4dec2 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1613360055", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "159a379a-62d9-4746-9aff-3f4db84342c7"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:07:22.112688 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-1a587571-9335-46d1-a631-d0bfa0d4dec2 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] validate_networks() for [('159a379a-62d9-4746-9aff-3f4db84342c7', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:07:22.615310 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-1a587571-9335-46d1-a631-d0bfa0d4dec2 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:07:22.616092 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-1a587571-9335-46d1-a631-d0bfa0d4dec2 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:07:22.617429 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-1a587571-9335-46d1-a631-d0bfa0d4dec2 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:07:22.620597 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-1a587571-9335-46d1-a631-d0bfa0d4dec2 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:07:22.622768 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-1a587571-9335-46d1-a631-d0bfa0d4dec2 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:07:22.650202 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1a587571-9335-46d1-a631-d0bfa0d4dec2 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:22.651244 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1a587571-9335-46d1-a631-d0bfa0d4dec2 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:22.652111 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1a587571-9335-46d1-a631-d0bfa0d4dec2 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:22.652568 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1a587571-9335-46d1-a631-d0bfa0d4dec2 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:22.671986 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-1a587571-9335-46d1-a631-d0bfa0d4dec2 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Getting quotas for project 77ffe987bb884a3085d26a1b257e878a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:07:22.679586 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-1a587571-9335-46d1-a631-d0bfa0d4dec2 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Getting quotas for user 8d6308a5a44d41eaa91731707f10b6f3 and project 77ffe987bb884a3085d26a1b257e878a. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:07:22.694320 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1a587571-9335-46d1-a631-d0bfa0d4dec2 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:07:22.696674 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1a587571-9335-46d1-a631-d0bfa0d4dec2 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:07:22.744012 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1a587571-9335-46d1-a631-d0bfa0d4dec2 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809876 Jul 31 02:07:22.745839 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3387/6807] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:07:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 02:07:22.754760 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=29 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:22.760470 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9ed36b03-c893-49c6-8603-29a15f08bae9 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:22.761316 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9ed36b03-c893-49c6-8603-29a15f08bae9 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:22.831772 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9ed36b03-c893-49c6-8603-29a15f08bae9 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:22.841244 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9ed36b03-c893-49c6-8603-29a15f08bae9 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1217 microversion: 2.1 time: 0.088203 Jul 31 02:07:22.841836 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3421/6808] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:22 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:23.863904 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8e0b36d3-d1dd-429a-8674-8a9d37ab3390 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:23.864645 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8e0b36d3-d1dd-429a-8674-8a9d37ab3390 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:23.872724 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e0b36d3-d1dd-429a-8674-8a9d37ab3390 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:23.873324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e0b36d3-d1dd-429a-8674-8a9d37ab3390 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:23.874052 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e0b36d3-d1dd-429a-8674-8a9d37ab3390 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:23.874509 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e0b36d3-d1dd-429a-8674-8a9d37ab3390 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:23.952428 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8e0b36d3-d1dd-429a-8674-8a9d37ab3390 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:23.969384 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8e0b36d3-d1dd-429a-8674-8a9d37ab3390 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1269 microversion: 2.1 time: 0.110050 Jul 31 02:07:23.970293 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3388/6809] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:23 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1269 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:24.991479 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5dab38f0-44bf-46d8-82f1-1185f3c90cf9 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:24.993038 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5dab38f0-44bf-46d8-82f1-1185f3c90cf9 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:25.000292 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5dab38f0-44bf-46d8-82f1-1185f3c90cf9 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:25.000761 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5dab38f0-44bf-46d8-82f1-1185f3c90cf9 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:25.001774 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5dab38f0-44bf-46d8-82f1-1185f3c90cf9 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:25.002230 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5dab38f0-44bf-46d8-82f1-1185f3c90cf9 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:25.221405 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5dab38f0-44bf-46d8-82f1-1185f3c90cf9 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:25.229142 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5dab38f0-44bf-46d8-82f1-1185f3c90cf9 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1317 microversion: 2.1 time: 0.241511 Jul 31 02:07:25.230425 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3422/6810] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:24 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:25.437714 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1ae0f5ac-151f-4bd3-911c-7fbfa000e817 req-e7d445f1-3dd7-485b-ad44-6cf08c9ca10a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff4e3ac-9fd8-478a-b3de-de4940d56374", "tag": "2eac3aaa-7da4-4a5c-ba3f-d8b86ae555ca"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:07:25.449542 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1ae0f5ac-151f-4bd3-911c-7fbfa000e817 req-e7d445f1-3dd7-485b-ad44-6cf08c9ca10a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:25.450152 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1ae0f5ac-151f-4bd3-911c-7fbfa000e817 req-e7d445f1-3dd7-485b-ad44-6cf08c9ca10a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:25.465088 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1ae0f5ac-151f-4bd3-911c-7fbfa000e817 req-e7d445f1-3dd7-485b-ad44-6cf08c9ca10a service nova] Creating event network-changed:2eac3aaa-7da4-4a5c-ba3f-d8b86ae555ca for instance 9ff4e3ac-9fd8-478a-b3de-de4940d56374 on n-h1-master-1 Jul 31 02:07:25.479227 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1ae0f5ac-151f-4bd3-911c-7fbfa000e817 req-e7d445f1-3dd7-485b-ad44-6cf08c9ca10a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045011 Jul 31 02:07:25.481070 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3389/6811] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:07:26.251197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c2e2ba5a-3568-487a-9741-b0c772273212 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:26.251877 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c2e2ba5a-3568-487a-9741-b0c772273212 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:26.258736 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2e2ba5a-3568-487a-9741-b0c772273212 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:26.259203 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2e2ba5a-3568-487a-9741-b0c772273212 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:26.260010 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2e2ba5a-3568-487a-9741-b0c772273212 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:26.260463 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2e2ba5a-3568-487a-9741-b0c772273212 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:26.392732 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c2e2ba5a-3568-487a-9741-b0c772273212 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:26.400254 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c2e2ba5a-3568-487a-9741-b0c772273212 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1317 microversion: 2.1 time: 0.152977 Jul 31 02:07:26.401732 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3423/6812] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:26 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:27.423845 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e6cd65b8-94ba-47fc-ab47-fe07aff3eeb5 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:27.425337 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e6cd65b8-94ba-47fc-ab47-fe07aff3eeb5 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:27.431892 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6cd65b8-94ba-47fc-ab47-fe07aff3eeb5 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:27.433121 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6cd65b8-94ba-47fc-ab47-fe07aff3eeb5 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:27.433987 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6cd65b8-94ba-47fc-ab47-fe07aff3eeb5 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:27.434658 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e6cd65b8-94ba-47fc-ab47-fe07aff3eeb5 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:27.579497 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e6cd65b8-94ba-47fc-ab47-fe07aff3eeb5 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:27.587086 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e6cd65b8-94ba-47fc-ab47-fe07aff3eeb5 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1317 microversion: 2.1 time: 0.168699 Jul 31 02:07:27.587700 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3390/6813] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:27 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:28.609155 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-12a3b586-2778-4604-ad2f-3290bfccb514 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:28.609778 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-12a3b586-2778-4604-ad2f-3290bfccb514 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:28.616611 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12a3b586-2778-4604-ad2f-3290bfccb514 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:28.617328 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12a3b586-2778-4604-ad2f-3290bfccb514 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:28.618109 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12a3b586-2778-4604-ad2f-3290bfccb514 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:28.618530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-12a3b586-2778-4604-ad2f-3290bfccb514 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:28.753060 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-12a3b586-2778-4604-ad2f-3290bfccb514 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:28.760535 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-12a3b586-2778-4604-ad2f-3290bfccb514 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1317 microversion: 2.1 time: 0.155283 Jul 31 02:07:28.761118 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3424/6814] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:28 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:29.781583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2d39fe92-704d-401c-ae71-4b8dfb81f76f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:29.782247 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2d39fe92-704d-401c-ae71-4b8dfb81f76f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:29.789207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d39fe92-704d-401c-ae71-4b8dfb81f76f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:29.789676 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d39fe92-704d-401c-ae71-4b8dfb81f76f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:29.790465 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d39fe92-704d-401c-ae71-4b8dfb81f76f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:29.790918 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2d39fe92-704d-401c-ae71-4b8dfb81f76f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:29.879173 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-05199981-ee4c-453c-9e94-5a882307d23f req-b428ce6f-c3da-46bb-93d9-15bd1a36154c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff4e3ac-9fd8-478a-b3de-de4940d56374", "name": "network-vif-plugged", "status": "completed", "tag": "2eac3aaa-7da4-4a5c-ba3f-d8b86ae555ca"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:07:29.889344 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-05199981-ee4c-453c-9e94-5a882307d23f req-b428ce6f-c3da-46bb-93d9-15bd1a36154c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:29.889806 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-05199981-ee4c-453c-9e94-5a882307d23f req-b428ce6f-c3da-46bb-93d9-15bd1a36154c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:29.901859 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-05199981-ee4c-453c-9e94-5a882307d23f req-b428ce6f-c3da-46bb-93d9-15bd1a36154c service nova] Creating event network-vif-plugged:2eac3aaa-7da4-4a5c-ba3f-d8b86ae555ca for instance 9ff4e3ac-9fd8-478a-b3de-de4940d56374 on n-h1-master-1 Jul 31 02:07:29.907505 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-05199981-ee4c-453c-9e94-5a882307d23f req-b428ce6f-c3da-46bb-93d9-15bd1a36154c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033211 Jul 31 02:07:29.908427 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3425/6815] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:07:29.929680 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2d39fe92-704d-401c-ae71-4b8dfb81f76f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:29.938037 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2d39fe92-704d-401c-ae71-4b8dfb81f76f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1317 microversion: 2.1 time: 0.160335 Jul 31 02:07:29.938436 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3391/6816] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:29 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:30.960469 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-95edeea0-5324-48d7-b8b3-e5d6eddcf40e tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:30.961103 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-95edeea0-5324-48d7-b8b3-e5d6eddcf40e tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:30.967999 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95edeea0-5324-48d7-b8b3-e5d6eddcf40e tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:30.968459 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95edeea0-5324-48d7-b8b3-e5d6eddcf40e tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:30.969232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95edeea0-5324-48d7-b8b3-e5d6eddcf40e tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:30.969687 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95edeea0-5324-48d7-b8b3-e5d6eddcf40e tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:31.107458 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-95edeea0-5324-48d7-b8b3-e5d6eddcf40e tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:31.118188 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-95edeea0-5324-48d7-b8b3-e5d6eddcf40e tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1317 microversion: 2.1 time: 0.161844 Jul 31 02:07:31.118781 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3426/6817] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:30 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:32.140697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-48d46bc7-3402-4d2f-9de1-48a64b1d3785 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:32.141327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-48d46bc7-3402-4d2f-9de1-48a64b1d3785 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:32.148250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48d46bc7-3402-4d2f-9de1-48a64b1d3785 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:32.148720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48d46bc7-3402-4d2f-9de1-48a64b1d3785 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:32.149498 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48d46bc7-3402-4d2f-9de1-48a64b1d3785 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:32.149952 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48d46bc7-3402-4d2f-9de1-48a64b1d3785 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:32.278201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-48d46bc7-3402-4d2f-9de1-48a64b1d3785 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:32.280576 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=58 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:32.287083 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-48d46bc7-3402-4d2f-9de1-48a64b1d3785 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1506 microversion: 2.1 time: 0.150348 Jul 31 02:07:32.287695 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3392/6818] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:32 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:32.346726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-186d5529-119e-4e4c-bb4b-db9e089174ca tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-563118219", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "159a379a-62d9-4746-9aff-3f4db84342c7"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:07:32.399190 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-186d5529-119e-4e4c-bb4b-db9e089174ca tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] validate_networks() for [('159a379a-62d9-4746-9aff-3f4db84342c7', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:07:32.766295 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-186d5529-119e-4e4c-bb4b-db9e089174ca tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:07:32.766750 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-186d5529-119e-4e4c-bb4b-db9e089174ca tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:07:32.767234 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-186d5529-119e-4e4c-bb4b-db9e089174ca tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:07:32.767787 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-186d5529-119e-4e4c-bb4b-db9e089174ca tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:07:32.768210 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-186d5529-119e-4e4c-bb4b-db9e089174ca tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:07:32.777188 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-186d5529-119e-4e4c-bb4b-db9e089174ca tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:32.777646 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-186d5529-119e-4e4c-bb4b-db9e089174ca tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:32.778461 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-186d5529-119e-4e4c-bb4b-db9e089174ca tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:32.778906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-186d5529-119e-4e4c-bb4b-db9e089174ca tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:32.795404 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-186d5529-119e-4e4c-bb4b-db9e089174ca tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Getting quotas for project 77ffe987bb884a3085d26a1b257e878a. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:07:32.800989 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-186d5529-119e-4e4c-bb4b-db9e089174ca tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Getting quotas for user 8d6308a5a44d41eaa91731707f10b6f3 and project 77ffe987bb884a3085d26a1b257e878a. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:07:32.814109 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-186d5529-119e-4e4c-bb4b-db9e089174ca tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:07:32.816422 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-186d5529-119e-4e4c-bb4b-db9e089174ca tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:07:32.860426 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-186d5529-119e-4e4c-bb4b-db9e089174ca tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517605 Jul 31 02:07:32.861073 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3427/6819] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:07:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:07:32.872763 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7bb4c4fb-2d86-4d34-b93e-f82e1784f490 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:32.873407 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7bb4c4fb-2d86-4d34-b93e-f82e1784f490 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:32.875508 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:32.876328 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:32.935778 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7bb4c4fb-2d86-4d34-b93e-f82e1784f490 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:32.942697 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7bb4c4fb-2d86-4d34-b93e-f82e1784f490 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c" status: 200 len: 1216 microversion: 2.1 time: 0.074462 Jul 31 02:07:32.943268 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3393/6820] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:32 2022] GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:33.964949 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c270c709-6629-46d3-8e39-4efb6d8920b4 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:33.965694 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c270c709-6629-46d3-8e39-4efb6d8920b4 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:33.972818 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c270c709-6629-46d3-8e39-4efb6d8920b4 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:33.973354 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c270c709-6629-46d3-8e39-4efb6d8920b4 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:33.974476 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c270c709-6629-46d3-8e39-4efb6d8920b4 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:33.974984 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c270c709-6629-46d3-8e39-4efb6d8920b4 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:34.060613 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c270c709-6629-46d3-8e39-4efb6d8920b4 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:34.068015 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c270c709-6629-46d3-8e39-4efb6d8920b4 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c" status: 200 len: 1286 microversion: 2.1 time: 0.108541 Jul 31 02:07:34.068609 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3428/6821] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:33 2022] GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c => generated 1286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:35.090662 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b1c9feef-3546-4b13-8389-eb54f0aa296d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:35.091308 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b1c9feef-3546-4b13-8389-eb54f0aa296d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:35.098293 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1c9feef-3546-4b13-8389-eb54f0aa296d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:35.098798 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1c9feef-3546-4b13-8389-eb54f0aa296d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:35.099621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1c9feef-3546-4b13-8389-eb54f0aa296d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:35.100081 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b1c9feef-3546-4b13-8389-eb54f0aa296d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:35.272937 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-fad69510-23c5-40cb-b3fc-b57612639d49 req-61ea6cd5-1f62-4169-a46c-9888790e6ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85576ff2-2edc-40df-86f1-b06dc7ea3e4c", "tag": "f12d4778-046a-4c84-8cba-253fecca8cc9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:07:35.284779 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-fad69510-23c5-40cb-b3fc-b57612639d49 req-61ea6cd5-1f62-4169-a46c-9888790e6ea3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:35.285349 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-fad69510-23c5-40cb-b3fc-b57612639d49 req-61ea6cd5-1f62-4169-a46c-9888790e6ea3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:35.297298 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-fad69510-23c5-40cb-b3fc-b57612639d49 req-61ea6cd5-1f62-4169-a46c-9888790e6ea3 service nova] Creating event network-changed:f12d4778-046a-4c84-8cba-253fecca8cc9 for instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c on n-h2-master-1 Jul 31 02:07:35.302931 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-fad69510-23c5-40cb-b3fc-b57612639d49 req-61ea6cd5-1f62-4169-a46c-9888790e6ea3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033692 Jul 31 02:07:35.303889 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3429/6822] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:07:35.317914 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b1c9feef-3546-4b13-8389-eb54f0aa296d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:35.326533 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b1c9feef-3546-4b13-8389-eb54f0aa296d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c" status: 200 len: 1316 microversion: 2.1 time: 0.240295 Jul 31 02:07:35.327430 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3394/6823] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:35 2022] GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:36.351372 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4de31293-aa65-45e0-a61c-43470b5e9337 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:36.352079 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4de31293-aa65-45e0-a61c-43470b5e9337 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:36.359038 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4de31293-aa65-45e0-a61c-43470b5e9337 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:36.359550 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4de31293-aa65-45e0-a61c-43470b5e9337 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:36.360329 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4de31293-aa65-45e0-a61c-43470b5e9337 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:36.360781 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4de31293-aa65-45e0-a61c-43470b5e9337 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:36.493574 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4de31293-aa65-45e0-a61c-43470b5e9337 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:36.500955 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4de31293-aa65-45e0-a61c-43470b5e9337 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c" status: 200 len: 1316 microversion: 2.1 time: 0.154793 Jul 31 02:07:36.501523 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3430/6824] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:36 2022] GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:37.521783 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c584f8e1-df5c-4d73-91af-0c67f7dc4911 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:37.522409 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c584f8e1-df5c-4d73-91af-0c67f7dc4911 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:37.529313 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c584f8e1-df5c-4d73-91af-0c67f7dc4911 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:37.529780 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c584f8e1-df5c-4d73-91af-0c67f7dc4911 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:37.530572 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c584f8e1-df5c-4d73-91af-0c67f7dc4911 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:37.531071 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c584f8e1-df5c-4d73-91af-0c67f7dc4911 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:37.662781 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c584f8e1-df5c-4d73-91af-0c67f7dc4911 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:37.670830 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c584f8e1-df5c-4d73-91af-0c67f7dc4911 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c" status: 200 len: 1316 microversion: 2.1 time: 0.153027 Jul 31 02:07:37.671401 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3395/6825] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:37 2022] GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:38.691905 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9c5f9c9e-00fb-44cb-8b5f-ae678f931524 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:38.692505 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9c5f9c9e-00fb-44cb-8b5f-ae678f931524 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:38.700190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c5f9c9e-00fb-44cb-8b5f-ae678f931524 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:38.700648 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c5f9c9e-00fb-44cb-8b5f-ae678f931524 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:38.701421 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c5f9c9e-00fb-44cb-8b5f-ae678f931524 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:38.701865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9c5f9c9e-00fb-44cb-8b5f-ae678f931524 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:38.841004 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9c5f9c9e-00fb-44cb-8b5f-ae678f931524 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:38.849217 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9c5f9c9e-00fb-44cb-8b5f-ae678f931524 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c" status: 200 len: 1316 microversion: 2.1 time: 0.161251 Jul 31 02:07:38.849810 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3431/6826] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:38 2022] GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:39.102485 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:07:39.103030 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 02:07:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:07:39.871270 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5d4ca2bf-0bf6-4dbe-88a0-b8acdf37be13 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:39.871937 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5d4ca2bf-0bf6-4dbe-88a0-b8acdf37be13 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:39.874666 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:39.880905 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d4ca2bf-0bf6-4dbe-88a0-b8acdf37be13 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:39.881401 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d4ca2bf-0bf6-4dbe-88a0-b8acdf37be13 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:39.882186 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d4ca2bf-0bf6-4dbe-88a0-b8acdf37be13 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:39.882644 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5d4ca2bf-0bf6-4dbe-88a0-b8acdf37be13 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:40.017787 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5d4ca2bf-0bf6-4dbe-88a0-b8acdf37be13 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:40.025377 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5d4ca2bf-0bf6-4dbe-88a0-b8acdf37be13 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c" status: 200 len: 1316 microversion: 2.1 time: 0.158315 Jul 31 02:07:40.025947 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3396/6827] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:39 2022] GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:40.160698 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-906dca64-e309-4c46-9a0f-c7fe44548ba6 req-64c111ac-0d6a-45df-88a3-45326a61d1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85576ff2-2edc-40df-86f1-b06dc7ea3e4c", "name": "network-vif-plugged", "status": "completed", "tag": "f12d4778-046a-4c84-8cba-253fecca8cc9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:07:40.166578 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:40.175817 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-906dca64-e309-4c46-9a0f-c7fe44548ba6 req-64c111ac-0d6a-45df-88a3-45326a61d1f5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:40.176266 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-906dca64-e309-4c46-9a0f-c7fe44548ba6 req-64c111ac-0d6a-45df-88a3-45326a61d1f5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:40.189416 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-906dca64-e309-4c46-9a0f-c7fe44548ba6 req-64c111ac-0d6a-45df-88a3-45326a61d1f5 service nova] Creating event network-vif-plugged:f12d4778-046a-4c84-8cba-253fecca8cc9 for instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c on n-h2-master-1 Jul 31 02:07:40.194459 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-906dca64-e309-4c46-9a0f-c7fe44548ba6 req-64c111ac-0d6a-45df-88a3-45326a61d1f5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037568 Jul 31 02:07:40.195571 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3432/6828] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:07:41.046716 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8e93c2d0-5a7e-4aee-9eb1-94b4845e2712 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:41.047405 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8e93c2d0-5a7e-4aee-9eb1-94b4845e2712 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:41.054268 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e93c2d0-5a7e-4aee-9eb1-94b4845e2712 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:41.055209 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e93c2d0-5a7e-4aee-9eb1-94b4845e2712 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:41.056027 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e93c2d0-5a7e-4aee-9eb1-94b4845e2712 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:41.056502 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8e93c2d0-5a7e-4aee-9eb1-94b4845e2712 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:41.190336 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8e93c2d0-5a7e-4aee-9eb1-94b4845e2712 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:41.197789 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8e93c2d0-5a7e-4aee-9eb1-94b4845e2712 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c" status: 200 len: 1316 microversion: 2.1 time: 0.155575 Jul 31 02:07:41.198893 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3397/6829] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:41 2022] GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:42.220567 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-999d20dd-afc1-494c-b57f-51ebb3fec3d7 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:42.221223 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-999d20dd-afc1-494c-b57f-51ebb3fec3d7 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:42.227755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-999d20dd-afc1-494c-b57f-51ebb3fec3d7 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:42.228218 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-999d20dd-afc1-494c-b57f-51ebb3fec3d7 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:42.228997 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-999d20dd-afc1-494c-b57f-51ebb3fec3d7 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:42.229450 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-999d20dd-afc1-494c-b57f-51ebb3fec3d7 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:42.358979 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-999d20dd-afc1-494c-b57f-51ebb3fec3d7 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:42.366507 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-999d20dd-afc1-494c-b57f-51ebb3fec3d7 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c" status: 200 len: 1506 microversion: 2.1 time: 0.152117 Jul 31 02:07:42.367361 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3433/6830] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:42 2022] GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:42.391080 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-243935f9-6c9d-43d0-a3b9-df1850163247 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:42.391626 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-243935f9-6c9d-43d0-a3b9-df1850163247 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:42.399228 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-243935f9-6c9d-43d0-a3b9-df1850163247 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:42.399732 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-243935f9-6c9d-43d0-a3b9-df1850163247 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:42.400514 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-243935f9-6c9d-43d0-a3b9-df1850163247 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:42.400962 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-243935f9-6c9d-43d0-a3b9-df1850163247 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:42.425489 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-243935f9-6c9d-43d0-a3b9-df1850163247 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:07:42.501963 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-243935f9-6c9d-43d0-a3b9-df1850163247 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "DELETE /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c" status: 204 len: 0 microversion: 2.1 time: 0.117011 Jul 31 02:07:42.502670 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3398/6831] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:07:42 2022] DELETE /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:07:42.510902 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3b73563-89fc-4986-9643-f8afaf84e665 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:42.511614 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3b73563-89fc-4986-9643-f8afaf84e665 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:42.517795 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3b73563-89fc-4986-9643-f8afaf84e665 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:42.518263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3b73563-89fc-4986-9643-f8afaf84e665 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:42.519050 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3b73563-89fc-4986-9643-f8afaf84e665 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:42.519535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3b73563-89fc-4986-9643-f8afaf84e665 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:42.648544 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3b73563-89fc-4986-9643-f8afaf84e665 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:42.656629 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3b73563-89fc-4986-9643-f8afaf84e665 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c" status: 200 len: 1512 microversion: 2.1 time: 0.149740 Jul 31 02:07:42.657202 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3434/6832] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:42 2022] GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:43.678147 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f21f9a79-57a5-4cc5-b429-f07f490fca92 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:43.678900 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f21f9a79-57a5-4cc5-b429-f07f490fca92 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:43.681046 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:43.687855 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f21f9a79-57a5-4cc5-b429-f07f490fca92 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:43.688323 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f21f9a79-57a5-4cc5-b429-f07f490fca92 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:43.689107 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f21f9a79-57a5-4cc5-b429-f07f490fca92 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:43.689560 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f21f9a79-57a5-4cc5-b429-f07f490fca92 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:43.823094 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f21f9a79-57a5-4cc5-b429-f07f490fca92 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:43.830731 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f21f9a79-57a5-4cc5-b429-f07f490fca92 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c" status: 200 len: 1512 microversion: 2.1 time: 0.156913 Jul 31 02:07:43.831294 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3399/6833] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:43 2022] GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:44.357461 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-c84cb5ec-94e9-4ff2-8987-6fb1a2327e7b req-58c3a977-2b01-490f-8d79-bfedc89c8b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85576ff2-2edc-40df-86f1-b06dc7ea3e4c", "name": "network-vif-deleted", "tag": "f12d4778-046a-4c84-8cba-253fecca8cc9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:07:44.363771 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:44.365346 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:44.376565 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c84cb5ec-94e9-4ff2-8987-6fb1a2327e7b req-58c3a977-2b01-490f-8d79-bfedc89c8b65 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:44.377129 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c84cb5ec-94e9-4ff2-8987-6fb1a2327e7b req-58c3a977-2b01-490f-8d79-bfedc89c8b65 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:44.409608 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-c84cb5ec-94e9-4ff2-8987-6fb1a2327e7b req-58c3a977-2b01-490f-8d79-bfedc89c8b65 service nova] Creating event network-vif-deleted:f12d4778-046a-4c84-8cba-253fecca8cc9 for instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c on n-h2-master-1 Jul 31 02:07:44.416522 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-c84cb5ec-94e9-4ff2-8987-6fb1a2327e7b req-58c3a977-2b01-490f-8d79-bfedc89c8b65 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065455 Jul 31 02:07:44.418322 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3435/6834] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:07:44.853825 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7990c832-f3ed-4d55-9540-e183115a752a tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:44.855101 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7990c832-f3ed-4d55-9540-e183115a752a tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:44.863119 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7990c832-f3ed-4d55-9540-e183115a752a tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:44.863613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7990c832-f3ed-4d55-9540-e183115a752a tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:44.864399 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7990c832-f3ed-4d55-9540-e183115a752a tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:44.864852 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7990c832-f3ed-4d55-9540-e183115a752a tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:44.879149 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-7990c832-f3ed-4d55-9540-e183115a752a tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] HTTP exception thrown: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7990c832-f3ed-4d55-9540-e183115a752a tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Request method failure captured: Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c HTTP/1.1 Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5ePZ9Vo8kTidJqVfyghT0_M33OFkwwzn3MYUeNrzg5-igDFM-VPwIivSUEs9x280aOjEWnoGLdJcIPVmQgibgq8t95RCDSx02_yza8kbgCw6XR7odygR_8UptDpLpj9GgvPqhsNR6FPDSSq8hIKD1FOg8JR1S8d7TDPC9t3ukXWmD98 Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 77ffe987bb884a3085d26a1b257e878a Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_77ffe987bb884a3085d26a1b257e878a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 77ffe987bb884a3085d26a1b257e878a Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1838346843-project Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 8d6308a5a44d41eaa91731707f10b6f3 Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1838346843-project Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '85576ff2-2edc-40df-86f1-b06dc7ea3e4c'} Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:44.880860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:44.887007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:44.887007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:44.887007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:44.887007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:07:44.887007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:07:44.887007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. Jul 31 02:07:44.887007 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:44.887007 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7990c832-f3ed-4d55-9540-e183115a752a tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Returning 404 to user: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:44.887007 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7990c832-f3ed-4d55-9540-e183115a752a tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c" status: 404 len: 111 microversion: 2.1 time: 0.033178 Jul 31 02:07:44.887007 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3400/6835] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:44 2022] GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:07:44.895135 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-83c5df48-ae41-4f8e-b539-73aa6b8ee924 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:44.895919 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-83c5df48-ae41-4f8e-b539-73aa6b8ee924 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:44.902223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83c5df48-ae41-4f8e-b539-73aa6b8ee924 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:44.902694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83c5df48-ae41-4f8e-b539-73aa6b8ee924 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:44.903532 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83c5df48-ae41-4f8e-b539-73aa6b8ee924 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:44.903987 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-83c5df48-ae41-4f8e-b539-73aa6b8ee924 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:45.041197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-83c5df48-ae41-4f8e-b539-73aa6b8ee924 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:45.049227 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-83c5df48-ae41-4f8e-b539-73aa6b8ee924 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1506 microversion: 2.1 time: 0.158703 Jul 31 02:07:45.049797 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3436/6836] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:44 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:45.070179 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fd2a4442-434b-4db6-a847-746b85ff94bf tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:07:45.072520 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fd2a4442-434b-4db6-a847-746b85ff94bf tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: c97c0bef-02e5-4631-8db0-23695e1dad46] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:45.077966 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-fd2a4442-434b-4db6-a847-746b85ff94bf tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] HTTP exception thrown: Instance c97c0bef-02e5-4631-8db0-23695e1dad46 could not be found. Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fd2a4442-434b-4db6-a847-746b85ff94bf tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Request method failure captured: Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/c97c0bef-02e5-4631-8db0-23695e1dad46/action HTTP/1.1 Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 32 Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5ePZ9Vo8kTidJqVfyghT0_M33OFkwwzn3MYUeNrzg5-igDFM-VPwIivSUEs9x280aOjEWnoGLdJcIPVmQgibgq8t95RCDSx02_yza8kbgCw6XR7odygR_8UptDpLpj9GgvPqhsNR6FPDSSq8hIKD1FOg8JR1S8d7TDPC9t3ukXWmD98 Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 77ffe987bb884a3085d26a1b257e878a Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_77ffe987bb884a3085d26a1b257e878a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 77ffe987bb884a3085d26a1b257e878a Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1838346843-project Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 8d6308a5a44d41eaa91731707f10b6f3 Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1838346843-project Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: {"resize": {"flavorRef": "452"}} Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: exception: Instance c97c0bef-02e5-4631-8db0-23695e1dad46 could not be found. Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'c97c0bef-02e5-4631-8db0-23695e1dad46', 'body': {'resize': {'flavorRef': '452'}}} Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c97c0bef-02e5-4631-8db0-23695e1dad46 could not be found. Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:07:45.079583 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:07:45.085052 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c97c0bef-02e5-4631-8db0-23695e1dad46 could not be found. Jul 31 02:07:45.085052 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.085052 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:45.085052 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.085052 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:45.085052 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:45.085052 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:45.085052 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:07:45.085052 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:07:45.085052 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c97c0bef-02e5-4631-8db0-23695e1dad46 could not be found. Jul 31 02:07:45.085052 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.085052 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fd2a4442-434b-4db6-a847-746b85ff94bf tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Returning 404 to user: Instance c97c0bef-02e5-4631-8db0-23695e1dad46 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:45.085052 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fd2a4442-434b-4db6-a847-746b85ff94bf tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "POST /compute/v2.1/servers/c97c0bef-02e5-4631-8db0-23695e1dad46/action" status: 404 len: 111 microversion: 2.1 time: 0.014868 Jul 31 02:07:45.085052 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3401/6837] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:07:45 2022] POST /compute/v2.1/servers/c97c0bef-02e5-4631-8db0-23695e1dad46/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:07:45.089429 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5887a4e5-788d-42a5-90b1-4e0b4231cffc tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:45.090064 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5887a4e5-788d-42a5-90b1-4e0b4231cffc tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:45.095982 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5887a4e5-788d-42a5-90b1-4e0b4231cffc tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:45.096452 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5887a4e5-788d-42a5-90b1-4e0b4231cffc tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:45.097237 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5887a4e5-788d-42a5-90b1-4e0b4231cffc tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:45.097693 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5887a4e5-788d-42a5-90b1-4e0b4231cffc tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:45.226093 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5887a4e5-788d-42a5-90b1-4e0b4231cffc tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:45.234381 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5887a4e5-788d-42a5-90b1-4e0b4231cffc tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1506 microversion: 2.1 time: 0.148804 Jul 31 02:07:45.234981 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3437/6838] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:45 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:45.255204 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-604af18f-7d7b-4e3a-b673-891339661c18 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:45.255869 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-604af18f-7d7b-4e3a-b673-891339661c18 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:45.262721 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-604af18f-7d7b-4e3a-b673-891339661c18 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:45.263187 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-604af18f-7d7b-4e3a-b673-891339661c18 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:45.263999 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-604af18f-7d7b-4e3a-b673-891339661c18 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:45.264455 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-604af18f-7d7b-4e3a-b673-891339661c18 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:45.397671 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-604af18f-7d7b-4e3a-b673-891339661c18 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:45.405823 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-604af18f-7d7b-4e3a-b673-891339661c18 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1506 microversion: 2.1 time: 0.154436 Jul 31 02:07:45.406394 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3402/6839] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:45 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:45.427206 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7c1681f-e9c2-4939-9b2a-a363fa58e66d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "d6ecf03c-15be-4a8a-be56-6cd8d92d93d2"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:07:45.429584 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a7c1681f-e9c2-4939-9b2a-a363fa58e66d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:45.436439 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7c1681f-e9c2-4939-9b2a-a363fa58e66d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:45.436906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7c1681f-e9c2-4939-9b2a-a363fa58e66d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:45.437681 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7c1681f-e9c2-4939-9b2a-a363fa58e66d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:45.438124 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7c1681f-e9c2-4939-9b2a-a363fa58e66d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:45.465947 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a7c1681f-e9c2-4939-9b2a-a363fa58e66d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:45.471072 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-a7c1681f-e9c2-4939-9b2a-a363fa58e66d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] HTTP exception thrown: Flavor d6ecf03c-15be-4a8a-be56-6cd8d92d93d2 could not be found. Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7c1681f-e9c2-4939-9b2a-a363fa58e66d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Request method failure captured: Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: request: POST /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374/action HTTP/1.1 Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 65 Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5ePZ9Vo8kTidJqVfyghT0_M33OFkwwzn3MYUeNrzg5-igDFM-VPwIivSUEs9x280aOjEWnoGLdJcIPVmQgibgq8t95RCDSx02_yza8kbgCw6XR7odygR_8UptDpLpj9GgvPqhsNR6FPDSSq8hIKD1FOg8JR1S8d7TDPC9t3ukXWmD98 Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 77ffe987bb884a3085d26a1b257e878a Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_77ffe987bb884a3085d26a1b257e878a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 77ffe987bb884a3085d26a1b257e878a Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1838346843-project Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 8d6308a5a44d41eaa91731707f10b6f3 Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1838346843-project Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: {"resize": {"flavorRef": "d6ecf03c-15be-4a8a-be56-6cd8d92d93d2"}} Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: exception: Flavor d6ecf03c-15be-4a8a-be56-6cd8d92d93d2 could not be found. Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '9ff4e3ac-9fd8-478a-b3de-de4940d56374', 'body': {'resize': {'flavorRef': 'd6ecf03c-15be-4a8a-be56-6cd8d92d93d2'}}} Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4148, in resize Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 02:07:45.487828 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d6ecf03c-15be-4a8a-be56-6cd8d92d93d2 could not be found. Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor d6ecf03c-15be-4a8a-be56-6cd8d92d93d2 could not be found. Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d6ecf03c-15be-4a8a-be56-6cd8d92d93d2 could not be found. Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7c1681f-e9c2-4939-9b2a-a363fa58e66d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Returning 400 to user: Flavor d6ecf03c-15be-4a8a-be56-6cd8d92d93d2 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a7c1681f-e9c2-4939-9b2a-a363fa58e66d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "POST /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374/action" status: 400 len: 107 microversion: 2.1 time: 0.066092 Jul 31 02:07:45.493212 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3438/6840] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:07:45 2022] POST /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374/action => generated 107 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 02:07:45.498390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-93e5d18e-5959-429d-af10-37e089a32c00 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:45.499023 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-93e5d18e-5959-429d-af10-37e089a32c00 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:45.505091 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93e5d18e-5959-429d-af10-37e089a32c00 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:45.505560 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93e5d18e-5959-429d-af10-37e089a32c00 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:45.506341 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93e5d18e-5959-429d-af10-37e089a32c00 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:45.506796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93e5d18e-5959-429d-af10-37e089a32c00 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:45.640682 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-93e5d18e-5959-429d-af10-37e089a32c00 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:45.648623 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-93e5d18e-5959-429d-af10-37e089a32c00 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1506 microversion: 2.1 time: 0.154115 Jul 31 02:07:45.649202 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3403/6841] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:45 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:45.670823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-49365eea-cff6-4017-bd94-fe9b7b79e496 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:45.671470 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-49365eea-cff6-4017-bd94-fe9b7b79e496 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:45.677644 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49365eea-cff6-4017-bd94-fe9b7b79e496 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:45.678104 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49365eea-cff6-4017-bd94-fe9b7b79e496 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:45.678873 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49365eea-cff6-4017-bd94-fe9b7b79e496 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:45.679315 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-49365eea-cff6-4017-bd94-fe9b7b79e496 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:45.814738 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-49365eea-cff6-4017-bd94-fe9b7b79e496 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:45.822332 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-49365eea-cff6-4017-bd94-fe9b7b79e496 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1506 microversion: 2.1 time: 0.155545 Jul 31 02:07:45.822932 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3439/6842] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:45 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:07:45.844210 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-956e2384-8a20-40d3-99b5-18382cece11a tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-956e2384-8a20-40d3-99b5-18382cece11a tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Request method failure captured: Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: request: POST /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374/action HTTP/1.1 Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 29 Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5ePZ9Vo8kTidJqVfyghT0_M33OFkwwzn3MYUeNrzg5-igDFM-VPwIivSUEs9x280aOjEWnoGLdJcIPVmQgibgq8t95RCDSx02_yza8kbgCw6XR7odygR_8UptDpLpj9GgvPqhsNR6FPDSSq8hIKD1FOg8JR1S8d7TDPC9t3ukXWmD98 Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 77ffe987bb884a3085d26a1b257e878a Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_77ffe987bb884a3085d26a1b257e878a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 77ffe987bb884a3085d26a1b257e878a Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1838346843-project Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 8d6308a5a44d41eaa91731707f10b6f3 Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1838346843-project Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: {"resize": {"flavorRef": ""}} Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '9ff4e3ac-9fd8-478a-b3de-de4940d56374', 'body': {'resize': {'flavorRef': ''}}} Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise error Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi '' Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.847860 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:45.853719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.853719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:45.853719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:45.853719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:45.853719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 02:07:45.853719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 02:07:45.853719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 31 02:07:45.853719 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:45.853719 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-956e2384-8a20-40d3-99b5-18382cece11a tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:45.853719 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-956e2384-8a20-40d3-99b5-18382cece11a tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "POST /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374/action" status: 400 len: 113 microversion: 2.1 time: 0.010432 Jul 31 02:07:45.853719 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3404/6843] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:07:45 2022] POST /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374/action => generated 113 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 02:07:45.860199 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6eb3fc36-e0c7-4998-a6b1-784700423545 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:45.860835 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6eb3fc36-e0c7-4998-a6b1-784700423545 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:45.866977 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6eb3fc36-e0c7-4998-a6b1-784700423545 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:45.867742 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6eb3fc36-e0c7-4998-a6b1-784700423545 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:45.868524 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6eb3fc36-e0c7-4998-a6b1-784700423545 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:45.869261 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6eb3fc36-e0c7-4998-a6b1-784700423545 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:46.003449 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6eb3fc36-e0c7-4998-a6b1-784700423545 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:46.011655 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6eb3fc36-e0c7-4998-a6b1-784700423545 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1506 microversion: 2.1 time: 0.154685 Jul 31 02:07:46.012248 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3440/6844] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:45 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:46.036177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-43bd323f-ac41-4030-bb1a-e427704708e8 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:46.036698 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-43bd323f-ac41-4030-bb1a-e427704708e8 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:46.043929 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43bd323f-ac41-4030-bb1a-e427704708e8 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:46.044401 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43bd323f-ac41-4030-bb1a-e427704708e8 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:46.045191 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43bd323f-ac41-4030-bb1a-e427704708e8 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:46.045650 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-43bd323f-ac41-4030-bb1a-e427704708e8 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:46.062170 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-43bd323f-ac41-4030-bb1a-e427704708e8 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] HTTP exception thrown: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-43bd323f-ac41-4030-bb1a-e427704708e8 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Request method failure captured: Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c HTTP/1.1 Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5ePZ9Vo8kTidJqVfyghT0_M33OFkwwzn3MYUeNrzg5-igDFM-VPwIivSUEs9x280aOjEWnoGLdJcIPVmQgibgq8t95RCDSx02_yza8kbgCw6XR7odygR_8UptDpLpj9GgvPqhsNR6FPDSSq8hIKD1FOg8JR1S8d7TDPC9t3ukXWmD98 Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 77ffe987bb884a3085d26a1b257e878a Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_77ffe987bb884a3085d26a1b257e878a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 77ffe987bb884a3085d26a1b257e878a Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-ServersNegativeTestJSON-1838346843-project Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 8d6308a5a44d41eaa91731707f10b6f3 Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-ServersNegativeTestJSON-1838346843-project Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '85576ff2-2edc-40df-86f1-b06dc7ea3e4c'} Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:07:46.063810 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:07:46.069262 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. Jul 31 02:07:46.069262 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:46.069262 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:46.069262 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:46.069262 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:46.069262 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:46.069262 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:46.069262 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:07:46.069262 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:07:46.069262 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. Jul 31 02:07:46.069262 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:07:46.069262 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-43bd323f-ac41-4030-bb1a-e427704708e8 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Returning 404 to user: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:46.069262 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-43bd323f-ac41-4030-bb1a-e427704708e8 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "DELETE /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c" status: 404 len: 111 microversion: 2.1 time: 0.033865 Jul 31 02:07:46.069262 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3405/6845] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:07:46 2022] DELETE /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:07:46.076327 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b640975c-972d-43d2-a585-b8a4cae41214 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:46.076968 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b640975c-972d-43d2-a585-b8a4cae41214 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 85576ff2-2edc-40df-86f1-b06dc7ea3e4c] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:46.083026 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b640975c-972d-43d2-a585-b8a4cae41214 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:46.083539 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b640975c-972d-43d2-a585-b8a4cae41214 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:46.084315 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b640975c-972d-43d2-a585-b8a4cae41214 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:46.084767 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b640975c-972d-43d2-a585-b8a4cae41214 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:46.098249 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-b640975c-972d-43d2-a585-b8a4cae41214 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] HTTP exception thrown: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b640975c-972d-43d2-a585-b8a4cae41214 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Request method failure captured: Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c HTTP/1.1 Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5ePZ9Vo8kTidJqVfyghT0_M33OFkwwzn3MYUeNrzg5-igDFM-VPwIivSUEs9x280aOjEWnoGLdJcIPVmQgibgq8t95RCDSx02_yza8kbgCw6XR7odygR_8UptDpLpj9GgvPqhsNR6FPDSSq8hIKD1FOg8JR1S8d7TDPC9t3ukXWmD98 Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 77ffe987bb884a3085d26a1b257e878a Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_77ffe987bb884a3085d26a1b257e878a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 77ffe987bb884a3085d26a1b257e878a Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1838346843-project Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 8d6308a5a44d41eaa91731707f10b6f3 Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1838346843-project Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '85576ff2-2edc-40df-86f1-b06dc7ea3e4c'} Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:46.099837 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:46.108249 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:46.108249 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:46.108249 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:46.108249 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:07:46.108249 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:07:46.108249 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. Jul 31 02:07:46.108249 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:46.108249 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b640975c-972d-43d2-a585-b8a4cae41214 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Returning 404 to user: Instance 85576ff2-2edc-40df-86f1-b06dc7ea3e4c could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:46.108249 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b640975c-972d-43d2-a585-b8a4cae41214 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c" status: 404 len: 111 microversion: 2.1 time: 0.029485 Jul 31 02:07:46.108249 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3441/6846] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:46 2022] GET /compute/v2.1/servers/85576ff2-2edc-40df-86f1-b06dc7ea3e4c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:07:46.111780 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-35897df3-19e9-445a-93f3-5abcb8eae35f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:46.112561 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-35897df3-19e9-445a-93f3-5abcb8eae35f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:46.119625 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35897df3-19e9-445a-93f3-5abcb8eae35f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:46.120627 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35897df3-19e9-445a-93f3-5abcb8eae35f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:46.121422 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35897df3-19e9-445a-93f3-5abcb8eae35f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:46.121884 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-35897df3-19e9-445a-93f3-5abcb8eae35f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:46.149070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-35897df3-19e9-445a-93f3-5abcb8eae35f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:07:46.229826 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-35897df3-19e9-445a-93f3-5abcb8eae35f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 204 len: 0 microversion: 2.1 time: 0.122706 Jul 31 02:07:46.233566 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3406/6847] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:07:46 2022] DELETE /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:07:46.238620 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c10af7f2-fa13-4b23-8ce5-7cb56dfb992b tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:46.239255 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c10af7f2-fa13-4b23-8ce5-7cb56dfb992b tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:46.246524 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c10af7f2-fa13-4b23-8ce5-7cb56dfb992b tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:46.246992 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c10af7f2-fa13-4b23-8ce5-7cb56dfb992b tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:46.247808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c10af7f2-fa13-4b23-8ce5-7cb56dfb992b tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:46.248271 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c10af7f2-fa13-4b23-8ce5-7cb56dfb992b tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:46.386987 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c10af7f2-fa13-4b23-8ce5-7cb56dfb992b tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:46.390603 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=100 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:07:46.395540 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c10af7f2-fa13-4b23-8ce5-7cb56dfb992b tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1512 microversion: 2.1 time: 0.160846 Jul 31 02:07:46.396305 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3442/6848] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:46 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:47.417681 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-79280e2d-bac0-4112-aa4b-767914cd4a0d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:47.418411 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-79280e2d-bac0-4112-aa4b-767914cd4a0d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:47.425142 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79280e2d-bac0-4112-aa4b-767914cd4a0d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:47.425605 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79280e2d-bac0-4112-aa4b-767914cd4a0d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:47.426374 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79280e2d-bac0-4112-aa4b-767914cd4a0d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:47.426821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-79280e2d-bac0-4112-aa4b-767914cd4a0d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:47.560311 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-79280e2d-bac0-4112-aa4b-767914cd4a0d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:47.567902 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-79280e2d-bac0-4112-aa4b-767914cd4a0d tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1512 microversion: 2.1 time: 0.154541 Jul 31 02:07:47.568479 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3407/6849] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:47 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:48.126689 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-4dcc36c2-52f3-4d80-8ffe-b6358f5690f3 req-4a21e96e-df8a-4123-9e83-a5fb826cfb69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff4e3ac-9fd8-478a-b3de-de4940d56374", "name": "network-vif-deleted", "tag": "2eac3aaa-7da4-4a5c-ba3f-d8b86ae555ca"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:07:48.137728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4dcc36c2-52f3-4d80-8ffe-b6358f5690f3 req-4a21e96e-df8a-4123-9e83-a5fb826cfb69 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:48.138169 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4dcc36c2-52f3-4d80-8ffe-b6358f5690f3 req-4a21e96e-df8a-4123-9e83-a5fb826cfb69 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:48.150207 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-4dcc36c2-52f3-4d80-8ffe-b6358f5690f3 req-4a21e96e-df8a-4123-9e83-a5fb826cfb69 service nova] Creating event network-vif-deleted:2eac3aaa-7da4-4a5c-ba3f-d8b86ae555ca for instance 9ff4e3ac-9fd8-478a-b3de-de4940d56374 on n-h1-master-1 Jul 31 02:07:48.156008 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-4dcc36c2-52f3-4d80-8ffe-b6358f5690f3 req-4a21e96e-df8a-4123-9e83-a5fb826cfb69 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033339 Jul 31 02:07:48.159636 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3443/6850] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:07:48.590053 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a28e6f27-f3fc-445c-9f68-55d533d2d356 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:48.590686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a28e6f27-f3fc-445c-9f68-55d533d2d356 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:48.597184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a28e6f27-f3fc-445c-9f68-55d533d2d356 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:48.597646 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a28e6f27-f3fc-445c-9f68-55d533d2d356 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:48.598421 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a28e6f27-f3fc-445c-9f68-55d533d2d356 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:48.598921 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a28e6f27-f3fc-445c-9f68-55d533d2d356 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:48.630889 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a28e6f27-f3fc-445c-9f68-55d533d2d356 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:48.631360 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a28e6f27-f3fc-445c-9f68-55d533d2d356 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:48.631831 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-a28e6f27-f3fc-445c-9f68-55d533d2d356 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lazy-loading 'fault' on Instance uuid 9ff4e3ac-9fd8-478a-b3de-de4940d56374 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:07:48.677238 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a28e6f27-f3fc-445c-9f68-55d533d2d356 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d6308a5a44d41eaa91731707f10b6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffe987bb884a3085d26a1b257e878a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:07:48.684359 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a28e6f27-f3fc-445c-9f68-55d533d2d356 tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 200 len: 1307 microversion: 2.1 time: 0.099069 Jul 31 02:07:48.684940 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3408/6851] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:48 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:07:49.707167 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7115a92a-d416-4933-b78c-b583cdab8a7f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:07:49.707834 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7115a92a-d416-4933-b78c-b583cdab8a7f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] [instance: 9ff4e3ac-9fd8-478a-b3de-de4940d56374] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:07:49.714186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7115a92a-d416-4933-b78c-b583cdab8a7f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:49.715198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7115a92a-d416-4933-b78c-b583cdab8a7f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:49.716011 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7115a92a-d416-4933-b78c-b583cdab8a7f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:07:49.716464 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7115a92a-d416-4933-b78c-b583cdab8a7f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:07:49.730709 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-7115a92a-d416-4933-b78c-b583cdab8a7f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] HTTP exception thrown: Instance 9ff4e3ac-9fd8-478a-b3de-de4940d56374 could not be found. Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7115a92a-d416-4933-b78c-b583cdab8a7f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Request method failure captured: Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 HTTP/1.1 Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5ePZ9Vo8kTidJqVfyghT0_M33OFkwwzn3MYUeNrzg5-igDFM-VPwIivSUEs9x280aOjEWnoGLdJcIPVmQgibgq8t95RCDSx02_yza8kbgCw6XR7odygR_8UptDpLpj9GgvPqhsNR6FPDSSq8hIKD1FOg8JR1S8d7TDPC9t3ukXWmD98 Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 77ffe987bb884a3085d26a1b257e878a Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/77ffe987bb884a3085d26a1b257e878a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_77ffe987bb884a3085d26a1b257e878a", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 77ffe987bb884a3085d26a1b257e878a Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1838346843 Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-ServersNegativeTestJSON-1838346843-project Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 8d6308a5a44d41eaa91731707f10b6f3 Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-ServersNegativeTestJSON-1838346843-project Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 9ff4e3ac-9fd8-478a-b3de-de4940d56374 could not be found. Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '9ff4e3ac-9fd8-478a-b3de-de4940d56374'} Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ff4e3ac-9fd8-478a-b3de-de4940d56374 could not be found. Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ff4e3ac-9fd8-478a-b3de-de4940d56374 could not be found. Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:07:49.732530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:49.738100 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:07:49.738100 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:07:49.738100 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:07:49.738100 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:07:49.738100 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:07:49.738100 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ff4e3ac-9fd8-478a-b3de-de4940d56374 could not be found. Jul 31 02:07:49.738100 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:07:49.738100 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7115a92a-d416-4933-b78c-b583cdab8a7f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] Returning 404 to user: Instance 9ff4e3ac-9fd8-478a-b3de-de4940d56374 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:07:49.738100 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7115a92a-d416-4933-b78c-b583cdab8a7f tempest-ServersNegativeTestJSON-1838346843 tempest-ServersNegativeTestJSON-1838346843-project] 10.222.0.45 "GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374" status: 404 len: 111 microversion: 2.1 time: 0.032077 Jul 31 02:07:49.738100 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3444/6852] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:07:49 2022] GET /compute/v2.1/servers/9ff4e3ac-9fd8-478a-b3de-de4940d56374 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:08:20.880503 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:08:20.881794 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:08:21.068982 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-06bfc97b-88a2-4f9b-866b-2d8fb71c8611 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Action: 'create', calling method: .version_select at 0x7fedeaa53280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1676920259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8QD9akxnuh2PC1ok5EfWGRXhI2CBZ+ghsUmeDe6ndd8Edq4mc9slZ4z7lVCa1MUhv4wsHhMGgwtgGfS+WZms77QLXSmAZkafB1oT7ltigOyD4veKAlAs2n3MJEQdpDqg=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:08:21.084852 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-06bfc97b-88a2-4f9b-866b-2d8fb71c8611 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Getting quotas for project a001c7a532534c2a8eec932478004235. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:08:21.090564 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-06bfc97b-88a2-4f9b-866b-2d8fb71c8611 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Getting quotas for user 9cfbede1b77a482ea259d9c2f5a6a353 and project a001c7a532534c2a8eec932478004235. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:08:21.119973 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-06bfc97b-88a2-4f9b-866b-2d8fb71c8611 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.244715 Jul 31 02:08:21.120603 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3409/6853] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 02:08:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:08:21.171308 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-48f5aa33-c410-4695-bc23-0c9b8e05752e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-297435541", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1676920259", "networks": [{"uuid": "3e48b6f0-1729-4be6-be04-b5d236e594c5"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:08:21.179942 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=27 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:08:21.180592 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:08:21.225377 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-48f5aa33-c410-4695-bc23-0c9b8e05752e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] validate_networks() for [('3e48b6f0-1729-4be6-be04-b5d236e594c5', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:08:21.610414 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-48f5aa33-c410-4695-bc23-0c9b8e05752e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:08:21.610845 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-48f5aa33-c410-4695-bc23-0c9b8e05752e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:08:21.611329 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-48f5aa33-c410-4695-bc23-0c9b8e05752e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:08:21.611807 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-48f5aa33-c410-4695-bc23-0c9b8e05752e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:08:21.612223 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-48f5aa33-c410-4695-bc23-0c9b8e05752e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:08:21.623444 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48f5aa33-c410-4695-bc23-0c9b8e05752e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:21.623912 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48f5aa33-c410-4695-bc23-0c9b8e05752e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:21.624722 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48f5aa33-c410-4695-bc23-0c9b8e05752e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:21.625164 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-48f5aa33-c410-4695-bc23-0c9b8e05752e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:21.641732 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-48f5aa33-c410-4695-bc23-0c9b8e05752e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Getting quotas for project a001c7a532534c2a8eec932478004235. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:08:21.647114 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-48f5aa33-c410-4695-bc23-0c9b8e05752e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Getting quotas for user 9cfbede1b77a482ea259d9c2f5a6a353 and project a001c7a532534c2a8eec932478004235. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:08:21.659763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-48f5aa33-c410-4695-bc23-0c9b8e05752e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:08:21.662063 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-48f5aa33-c410-4695-bc23-0c9b8e05752e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:08:21.708498 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-48f5aa33-c410-4695-bc23-0c9b8e05752e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541205 Jul 31 02:08:21.714679 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3445/6854] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:08:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:08:21.720591 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3e1196ac-cde9-4ddd-a4c3-897e93925a41 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:21.721233 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3e1196ac-cde9-4ddd-a4c3-897e93925a41 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:21.802863 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3e1196ac-cde9-4ddd-a4c3-897e93925a41 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:08:21.826870 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3e1196ac-cde9-4ddd-a4c3-897e93925a41 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6" status: 200 len: 1262 microversion: 2.1 time: 0.110720 Jul 31 02:08:21.839698 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3410/6855] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:21 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 => generated 1262 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:08:22.850943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5b626a8a-2ce7-4b6e-99ad-6bae73faa303 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:22.851636 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5b626a8a-2ce7-4b6e-99ad-6bae73faa303 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:22.863375 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b626a8a-2ce7-4b6e-99ad-6bae73faa303 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:22.864890 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b626a8a-2ce7-4b6e-99ad-6bae73faa303 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:22.866583 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b626a8a-2ce7-4b6e-99ad-6bae73faa303 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:22.869057 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b626a8a-2ce7-4b6e-99ad-6bae73faa303 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:23.009899 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5b626a8a-2ce7-4b6e-99ad-6bae73faa303 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:08:23.020615 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5b626a8a-2ce7-4b6e-99ad-6bae73faa303 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6" status: 200 len: 1322 microversion: 2.1 time: 0.174526 Jul 31 02:08:23.034987 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3446/6856] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:22 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:08:24.042109 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c16e07e4-f79c-4e4a-96e1-1d48f2b4a79d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:24.042753 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c16e07e4-f79c-4e4a-96e1-1d48f2b4a79d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:24.051464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c16e07e4-f79c-4e4a-96e1-1d48f2b4a79d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:24.051951 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c16e07e4-f79c-4e4a-96e1-1d48f2b4a79d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:24.052773 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c16e07e4-f79c-4e4a-96e1-1d48f2b4a79d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:24.053234 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c16e07e4-f79c-4e4a-96e1-1d48f2b4a79d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:24.252905 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c16e07e4-f79c-4e4a-96e1-1d48f2b4a79d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:08:24.261475 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c16e07e4-f79c-4e4a-96e1-1d48f2b4a79d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6" status: 200 len: 1362 microversion: 2.1 time: 0.223196 Jul 31 02:08:24.262059 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3411/6857] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:24 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:08:24.292952 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-41bd5d67-f3f1-4001-af5c-026a3bf2808a req-297a5040-4867-4bcf-8dec-8e20a888333d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0784600a-4bdf-4473-a468-00749408baf6", "tag": "4bb3a0eb-fa83-429f-aafd-24da5f8c8496"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:08:24.308945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-41bd5d67-f3f1-4001-af5c-026a3bf2808a req-297a5040-4867-4bcf-8dec-8e20a888333d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:24.309966 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-41bd5d67-f3f1-4001-af5c-026a3bf2808a req-297a5040-4867-4bcf-8dec-8e20a888333d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:24.325027 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-41bd5d67-f3f1-4001-af5c-026a3bf2808a req-297a5040-4867-4bcf-8dec-8e20a888333d service nova] Creating event network-changed:4bb3a0eb-fa83-429f-aafd-24da5f8c8496 for instance 0784600a-4bdf-4473-a468-00749408baf6 on n-h2-master-1 Jul 31 02:08:24.332663 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-41bd5d67-f3f1-4001-af5c-026a3bf2808a req-297a5040-4867-4bcf-8dec-8e20a888333d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043715 Jul 31 02:08:24.334248 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3447/6858] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:08:25.285028 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-18be9fb4-ce25-4af3-869b-e0799520efa8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:25.285586 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-18be9fb4-ce25-4af3-869b-e0799520efa8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:25.293233 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18be9fb4-ce25-4af3-869b-e0799520efa8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:25.293703 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18be9fb4-ce25-4af3-869b-e0799520efa8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:25.294483 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18be9fb4-ce25-4af3-869b-e0799520efa8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:25.294939 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18be9fb4-ce25-4af3-869b-e0799520efa8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:25.429274 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-18be9fb4-ce25-4af3-869b-e0799520efa8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:08:25.437340 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-18be9fb4-ce25-4af3-869b-e0799520efa8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6" status: 200 len: 1362 microversion: 2.1 time: 0.156263 Jul 31 02:08:25.438496 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3412/6859] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:25 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:08:26.459831 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4f227a75-1529-45ae-a2af-33f75e3a92cf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:26.460470 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4f227a75-1529-45ae-a2af-33f75e3a92cf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:26.467555 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f227a75-1529-45ae-a2af-33f75e3a92cf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:26.468024 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f227a75-1529-45ae-a2af-33f75e3a92cf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:26.468807 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f227a75-1529-45ae-a2af-33f75e3a92cf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:26.469259 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f227a75-1529-45ae-a2af-33f75e3a92cf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:26.603296 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4f227a75-1529-45ae-a2af-33f75e3a92cf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:08:26.611177 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4f227a75-1529-45ae-a2af-33f75e3a92cf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6" status: 200 len: 1362 microversion: 2.1 time: 0.155805 Jul 31 02:08:26.611784 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3448/6860] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:26 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:08:27.633133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-85cdd0db-f152-470a-b73c-bf2795463210 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:27.633755 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-85cdd0db-f152-470a-b73c-bf2795463210 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:27.641182 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85cdd0db-f152-470a-b73c-bf2795463210 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:27.641669 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85cdd0db-f152-470a-b73c-bf2795463210 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:27.642437 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85cdd0db-f152-470a-b73c-bf2795463210 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:27.642886 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-85cdd0db-f152-470a-b73c-bf2795463210 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:27.773762 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-85cdd0db-f152-470a-b73c-bf2795463210 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:08:27.781853 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-85cdd0db-f152-470a-b73c-bf2795463210 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6" status: 200 len: 1362 microversion: 2.1 time: 0.152636 Jul 31 02:08:27.782428 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3413/6861] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:27 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:08:28.803036 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-74e3d302-b842-4552-ae9a-90a7f579f5b1 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:28.803794 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-74e3d302-b842-4552-ae9a-90a7f579f5b1 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:28.810850 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74e3d302-b842-4552-ae9a-90a7f579f5b1 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:28.811885 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74e3d302-b842-4552-ae9a-90a7f579f5b1 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:28.812669 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74e3d302-b842-4552-ae9a-90a7f579f5b1 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:28.813121 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-74e3d302-b842-4552-ae9a-90a7f579f5b1 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:28.946882 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-74e3d302-b842-4552-ae9a-90a7f579f5b1 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:08:28.954993 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-74e3d302-b842-4552-ae9a-90a7f579f5b1 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6" status: 200 len: 1362 microversion: 2.1 time: 0.155988 Jul 31 02:08:28.955606 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3449/6862] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:28 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:08:29.976024 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e4d87b43-81b6-4a6e-b5fa-31b8ad9959ad tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:29.976664 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e4d87b43-81b6-4a6e-b5fa-31b8ad9959ad tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:29.984219 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4d87b43-81b6-4a6e-b5fa-31b8ad9959ad tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:29.984690 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4d87b43-81b6-4a6e-b5fa-31b8ad9959ad tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:29.985472 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4d87b43-81b6-4a6e-b5fa-31b8ad9959ad tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:29.985927 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4d87b43-81b6-4a6e-b5fa-31b8ad9959ad tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:30.114026 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e4d87b43-81b6-4a6e-b5fa-31b8ad9959ad tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:08:30.121736 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e4d87b43-81b6-4a6e-b5fa-31b8ad9959ad tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6" status: 200 len: 1362 microversion: 2.1 time: 0.149596 Jul 31 02:08:30.122303 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3414/6863] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:29 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:08:30.315435 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f3ebed07-3051-459f-99df-ca85582de1d8 req-911b5d36-6683-4216-a399-c1ffb5a2aff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0784600a-4bdf-4473-a468-00749408baf6", "name": "network-vif-plugged", "status": "completed", "tag": "4bb3a0eb-fa83-429f-aafd-24da5f8c8496"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:08:30.327059 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f3ebed07-3051-459f-99df-ca85582de1d8 req-911b5d36-6683-4216-a399-c1ffb5a2aff4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:30.327991 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f3ebed07-3051-459f-99df-ca85582de1d8 req-911b5d36-6683-4216-a399-c1ffb5a2aff4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:30.339554 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f3ebed07-3051-459f-99df-ca85582de1d8 req-911b5d36-6683-4216-a399-c1ffb5a2aff4 service nova] Creating event network-vif-plugged:4bb3a0eb-fa83-429f-aafd-24da5f8c8496 for instance 0784600a-4bdf-4473-a468-00749408baf6 on n-h2-master-1 Jul 31 02:08:30.345021 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f3ebed07-3051-459f-99df-ca85582de1d8 req-911b5d36-6683-4216-a399-c1ffb5a2aff4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033591 Jul 31 02:08:30.345625 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3450/6864] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:08:31.143197 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-75f48ffb-0118-419d-8d18-eb52c5649137 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:31.143920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-75f48ffb-0118-419d-8d18-eb52c5649137 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:31.150999 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75f48ffb-0118-419d-8d18-eb52c5649137 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:31.151519 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75f48ffb-0118-419d-8d18-eb52c5649137 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:31.152309 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75f48ffb-0118-419d-8d18-eb52c5649137 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:31.152763 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-75f48ffb-0118-419d-8d18-eb52c5649137 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:31.280249 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-75f48ffb-0118-419d-8d18-eb52c5649137 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:08:31.288054 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-75f48ffb-0118-419d-8d18-eb52c5649137 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6" status: 200 len: 1362 microversion: 2.1 time: 0.149283 Jul 31 02:08:31.288798 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3415/6865] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:31 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:08:32.308202 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:08:32.308981 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:08:32.313561 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-def72853-db54-41d2-9f16-e82180831f51 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:32.314396 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-def72853-db54-41d2-9f16-e82180831f51 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:32.322719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-def72853-db54-41d2-9f16-e82180831f51 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:32.323371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-def72853-db54-41d2-9f16-e82180831f51 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:32.324156 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-def72853-db54-41d2-9f16-e82180831f51 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:32.324608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-def72853-db54-41d2-9f16-e82180831f51 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:32.456386 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-def72853-db54-41d2-9f16-e82180831f51 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:08:32.464521 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-def72853-db54-41d2-9f16-e82180831f51 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6" status: 200 len: 1554 microversion: 2.1 time: 0.158157 Jul 31 02:08:32.465093 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3451/6866] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:32 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:08:32.485011 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b555d5f8-565a-4fee-a957-10e79d1d6cf4 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:32.485647 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b555d5f8-565a-4fee-a957-10e79d1d6cf4 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:32.487561 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:08:32.494018 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b555d5f8-565a-4fee-a957-10e79d1d6cf4 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:32.494489 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b555d5f8-565a-4fee-a957-10e79d1d6cf4 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:32.495277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b555d5f8-565a-4fee-a957-10e79d1d6cf4 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:32.495816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b555d5f8-565a-4fee-a957-10e79d1d6cf4 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:32.627004 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b555d5f8-565a-4fee-a957-10e79d1d6cf4 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:08:32.635583 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b555d5f8-565a-4fee-a957-10e79d1d6cf4 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6" status: 200 len: 1554 microversion: 2.1 time: 0.154453 Jul 31 02:08:32.636154 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3416/6867] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:32 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:08:34.236916 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9081adc0-269d-4014-85eb-0435ab7b6623 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cee43ec6-8d1b-4631-8c70-b9d11142af04"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:08:34.239886 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9081adc0-269d-4014-85eb-0435ab7b6623 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:34.248140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9081adc0-269d-4014-85eb-0435ab7b6623 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:34.248596 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9081adc0-269d-4014-85eb-0435ab7b6623 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:34.249384 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9081adc0-269d-4014-85eb-0435ab7b6623 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:34.249827 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9081adc0-269d-4014-85eb-0435ab7b6623 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:34.508036 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9081adc0-269d-4014-85eb-0435ab7b6623 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "POST /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274531 Jul 31 02:08:34.508659 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3452/6868] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 02:08:34 2022] POST /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:08:45.215703 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8bbf5704-30b0-409d-a790-ee06b7b829f7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:45.216224 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8bbf5704-30b0-409d-a790-ee06b7b829f7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:45.218876 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:08:45.219835 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=36 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:08:45.225499 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8bbf5704-30b0-409d-a790-ee06b7b829f7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:45.225975 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8bbf5704-30b0-409d-a790-ee06b7b829f7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:45.226765 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8bbf5704-30b0-409d-a790-ee06b7b829f7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:45.227229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8bbf5704-30b0-409d-a790-ee06b7b829f7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:45.306151 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-8bbf5704-30b0-409d-a790-ee06b7b829f7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lazy-loading 'services' on Instance uuid 0784600a-4bdf-4473-a468-00749408baf6 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:08:45.385602 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8bbf5704-30b0-409d-a790-ee06b7b829f7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments/cee43ec6-8d1b-4631-8c70-b9d11142af04" status: 202 len: 0 microversion: 2.1 time: 0.173745 Jul 31 02:08:45.386622 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3417/6869] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 02:08:45 2022] DELETE /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments/cee43ec6-8d1b-4631-8c70-b9d11142af04 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:08:45.395679 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e775e9a3-d328-4b91-9473-29d9bc9ea9fc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:45.398274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e775e9a3-d328-4b91-9473-29d9bc9ea9fc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:45.401359 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:08:45.402047 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:08:45.408772 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e775e9a3-d328-4b91-9473-29d9bc9ea9fc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:45.409242 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e775e9a3-d328-4b91-9473-29d9bc9ea9fc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:45.410037 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e775e9a3-d328-4b91-9473-29d9bc9ea9fc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:45.410492 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e775e9a3-d328-4b91-9473-29d9bc9ea9fc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:45.443592 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e775e9a3-d328-4b91-9473-29d9bc9ea9fc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052209 Jul 31 02:08:45.444060 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3453/6870] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:08:45 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:08:46.455969 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f6f3a8b9-c6cc-4c8d-9c64-9da32ad34192 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:46.459286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f6f3a8b9-c6cc-4c8d-9c64-9da32ad34192 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:46.466870 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6f3a8b9-c6cc-4c8d-9c64-9da32ad34192 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:46.467363 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6f3a8b9-c6cc-4c8d-9c64-9da32ad34192 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:46.468152 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6f3a8b9-c6cc-4c8d-9c64-9da32ad34192 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:46.468722 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6f3a8b9-c6cc-4c8d-9c64-9da32ad34192 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:46.500034 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f6f3a8b9-c6cc-4c8d-9c64-9da32ad34192 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048468 Jul 31 02:08:46.503467 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3418/6871] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:08:46 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:08:47.512971 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c2ae03be-2e00-4410-a1e8-1223827b9fc7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:47.515207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c2ae03be-2e00-4410-a1e8-1223827b9fc7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:47.522440 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2ae03be-2e00-4410-a1e8-1223827b9fc7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:47.522895 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2ae03be-2e00-4410-a1e8-1223827b9fc7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:47.523756 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2ae03be-2e00-4410-a1e8-1223827b9fc7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:47.524198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2ae03be-2e00-4410-a1e8-1223827b9fc7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:47.555628 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c2ae03be-2e00-4410-a1e8-1223827b9fc7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046635 Jul 31 02:08:47.556141 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3454/6872] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:08:47 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:08:48.569170 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8c57b9ac-f59c-436d-aa52-cd05edd82c10 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:48.571562 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8c57b9ac-f59c-436d-aa52-cd05edd82c10 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:48.578316 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8c57b9ac-f59c-436d-aa52-cd05edd82c10 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:48.578793 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8c57b9ac-f59c-436d-aa52-cd05edd82c10 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:48.579615 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8c57b9ac-f59c-436d-aa52-cd05edd82c10 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:48.580078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8c57b9ac-f59c-436d-aa52-cd05edd82c10 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:48.611777 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8c57b9ac-f59c-436d-aa52-cd05edd82c10 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047854 Jul 31 02:08:48.612342 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3419/6873] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:08:48 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:08:49.625175 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ac83dafc-959d-474d-b77b-7709d8672ad6 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:49.628055 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ac83dafc-959d-474d-b77b-7709d8672ad6 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:49.635352 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac83dafc-959d-474d-b77b-7709d8672ad6 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:49.635836 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac83dafc-959d-474d-b77b-7709d8672ad6 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:49.636635 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac83dafc-959d-474d-b77b-7709d8672ad6 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:49.637089 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac83dafc-959d-474d-b77b-7709d8672ad6 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:49.671201 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ac83dafc-959d-474d-b77b-7709d8672ad6 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050254 Jul 31 02:08:49.671724 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3455/6874] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:08:49 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:08:50.683435 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-efbdd8a5-e021-4605-9a7a-c13d85824cd7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:50.685641 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-efbdd8a5-e021-4605-9a7a-c13d85824cd7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:50.693148 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efbdd8a5-e021-4605-9a7a-c13d85824cd7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:50.693621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efbdd8a5-e021-4605-9a7a-c13d85824cd7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:50.694538 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efbdd8a5-e021-4605-9a7a-c13d85824cd7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:50.695312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-efbdd8a5-e021-4605-9a7a-c13d85824cd7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:50.725524 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-efbdd8a5-e021-4605-9a7a-c13d85824cd7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046086 Jul 31 02:08:50.726083 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3420/6875] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:08:50 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 02:08:50.736981 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5191228c-e5e9-4359-8c2b-1ed149128895 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:50.737498 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5191228c-e5e9-4359-8c2b-1ed149128895 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:50.745113 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5191228c-e5e9-4359-8c2b-1ed149128895 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:50.745578 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5191228c-e5e9-4359-8c2b-1ed149128895 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:50.746365 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5191228c-e5e9-4359-8c2b-1ed149128895 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:50.746824 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5191228c-e5e9-4359-8c2b-1ed149128895 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:50.822359 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-5191228c-e5e9-4359-8c2b-1ed149128895 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] HTTP exception thrown: Instance 0784600a-4bdf-4473-a468-00749408baf6 is not attached to volume cee43ec6-8d1b-4631-8c70-b9d11142af04 Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5191228c-e5e9-4359-8c2b-1ed149128895 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Request method failure captured: Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments/cee43ec6-8d1b-4631-8c70-b9d11142af04 HTTP/1.1 Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eQPn5O_C5ZaBUrq3cWaXwKlsVFXoH6_7MGmMPX-CxLike-3xVhRiDByBoyS6KXDo47rKKZ4peb82nhEoua_5b2gn_H4tjDZiF8U_8VfUxFl9A_V5ppeCkxfdOYofUCJ0WPmvGhmlTtgk7ErcR_6KySkNqW6B00rdz9ufcNKJ2cTWKU Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a001c7a532534c2a8eec932478004235 Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a001c7a532534c2a8eec932478004235"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a001c7a532534c2a8eec932478004235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a001c7a532534c2a8eec932478004235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a001c7a532534c2a8eec932478004235", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a001c7a532534c2a8eec932478004235 Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestEncryptedCinderVolumes-1289853719-project Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 9cfbede1b77a482ea259d9c2f5a6a353 Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestEncryptedCinderVolumes-1289853719-project Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 0784600a-4bdf-4473-a468-00749408baf6 is not attached to volume cee43ec6-8d1b-4631-8c70-b9d11142af04 Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: action_args: {'server_id': '0784600a-4bdf-4473-a468-00749408baf6', 'id': 'cee43ec6-8d1b-4631-8c70-b9d11142af04'} Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cee43ec6-8d1b-4631-8c70-b9d11142af04. Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0784600a-4bdf-4473-a468-00749408baf6 is not attached to volume cee43ec6-8d1b-4631-8c70-b9d11142af04 Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:08:50.841124 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:08:50.845414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:08:50.845414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:08:50.845414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0784600a-4bdf-4473-a468-00749408baf6 is not attached to volume cee43ec6-8d1b-4631-8c70-b9d11142af04 Jul 31 02:08:50.845414 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:08:50.845414 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5191228c-e5e9-4359-8c2b-1ed149128895 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Returning 404 to user: Instance 0784600a-4bdf-4473-a468-00749408baf6 is not attached to volume cee43ec6-8d1b-4631-8c70-b9d11142af04 {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:08:50.845414 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5191228c-e5e9-4359-8c2b-1ed149128895 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments/cee43ec6-8d1b-4631-8c70-b9d11142af04" status: 404 len: 154 microversion: 2.1 time: 0.109655 Jul 31 02:08:50.845414 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3456/6876] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 02:08:50 2022] DELETE /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6/os-volume_attachments/cee43ec6-8d1b-4631-8c70-b9d11142af04 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:08:54.179239 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-176e05a4-be4d-4a9a-afa8-c4c2753d3489 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:54.179857 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-176e05a4-be4d-4a9a-afa8-c4c2753d3489 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:54.187143 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-176e05a4-be4d-4a9a-afa8-c4c2753d3489 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:54.187657 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-176e05a4-be4d-4a9a-afa8-c4c2753d3489 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:54.188464 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-176e05a4-be4d-4a9a-afa8-c4c2753d3489 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:54.188926 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-176e05a4-be4d-4a9a-afa8-c4c2753d3489 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:54.217137 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-176e05a4-be4d-4a9a-afa8-c4c2753d3489 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:08:54.294606 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-176e05a4-be4d-4a9a-afa8-c4c2753d3489 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6" status: 204 len: 0 microversion: 2.1 time: 0.119151 Jul 31 02:08:54.298517 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3421/6877] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:08:54 2022] DELETE /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:08:54.303806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ed9b2901-a0b5-4663-bfc8-8e1128eda6f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:54.304461 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ed9b2901-a0b5-4663-bfc8-8e1128eda6f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:54.312571 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed9b2901-a0b5-4663-bfc8-8e1128eda6f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:54.312978 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed9b2901-a0b5-4663-bfc8-8e1128eda6f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:54.313760 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed9b2901-a0b5-4663-bfc8-8e1128eda6f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:54.314212 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ed9b2901-a0b5-4663-bfc8-8e1128eda6f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:54.449883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ed9b2901-a0b5-4663-bfc8-8e1128eda6f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:08:54.457678 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ed9b2901-a0b5-4663-bfc8-8e1128eda6f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6" status: 200 len: 1560 microversion: 2.1 time: 0.157757 Jul 31 02:08:54.458255 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3457/6878] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:54 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:08:55.479521 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b2dc51e3-49d5-4e8c-9cfc-c67071cd723d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:55.480238 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b2dc51e3-49d5-4e8c-9cfc-c67071cd723d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:55.487233 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2dc51e3-49d5-4e8c-9cfc-c67071cd723d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:55.487821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2dc51e3-49d5-4e8c-9cfc-c67071cd723d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:55.488607 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2dc51e3-49d5-4e8c-9cfc-c67071cd723d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:55.489058 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2dc51e3-49d5-4e8c-9cfc-c67071cd723d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:55.622754 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b2dc51e3-49d5-4e8c-9cfc-c67071cd723d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:08:55.630840 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b2dc51e3-49d5-4e8c-9cfc-c67071cd723d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6" status: 200 len: 1560 microversion: 2.1 time: 0.155663 Jul 31 02:08:55.631428 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3422/6879] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:55 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:08:56.396415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-77c4b664-fe1f-4379-805e-eee419c0104d req-661d9d0b-6de2-4249-bfc3-5d97bd9348ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0784600a-4bdf-4473-a468-00749408baf6", "name": "network-vif-deleted", "tag": "4bb3a0eb-fa83-429f-aafd-24da5f8c8496"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:08:56.407657 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-77c4b664-fe1f-4379-805e-eee419c0104d req-661d9d0b-6de2-4249-bfc3-5d97bd9348ff service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:56.408044 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-77c4b664-fe1f-4379-805e-eee419c0104d req-661d9d0b-6de2-4249-bfc3-5d97bd9348ff service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:56.420330 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-77c4b664-fe1f-4379-805e-eee419c0104d req-661d9d0b-6de2-4249-bfc3-5d97bd9348ff service nova] Creating event network-vif-deleted:4bb3a0eb-fa83-429f-aafd-24da5f8c8496 for instance 0784600a-4bdf-4473-a468-00749408baf6 on n-h2-master-1 Jul 31 02:08:56.425564 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-77c4b664-fe1f-4379-805e-eee419c0104d req-661d9d0b-6de2-4249-bfc3-5d97bd9348ff service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032913 Jul 31 02:08:56.426764 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3458/6880] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:08:56.651917 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c7c355e-66f7-45b8-a1cf-a2493db32aee tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:56.652532 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2c7c355e-66f7-45b8-a1cf-a2493db32aee tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:56.659951 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c7c355e-66f7-45b8-a1cf-a2493db32aee tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:56.660420 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c7c355e-66f7-45b8-a1cf-a2493db32aee tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:56.661913 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c7c355e-66f7-45b8-a1cf-a2493db32aee tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:56.662377 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c7c355e-66f7-45b8-a1cf-a2493db32aee tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:56.694803 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c7c355e-66f7-45b8-a1cf-a2493db32aee tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:56.695278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c7c355e-66f7-45b8-a1cf-a2493db32aee tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:56.695779 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-2c7c355e-66f7-45b8-a1cf-a2493db32aee tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lazy-loading 'fault' on Instance uuid 0784600a-4bdf-4473-a468-00749408baf6 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:08:56.745693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2c7c355e-66f7-45b8-a1cf-a2493db32aee tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:08:56.753690 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2c7c355e-66f7-45b8-a1cf-a2493db32aee tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6" status: 200 len: 1352 microversion: 2.1 time: 0.105639 Jul 31 02:08:56.754374 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3423/6881] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:56 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:08:57.777592 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-402bf6bd-4978-4847-8f6b-ce229459b580 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:57.778237 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-402bf6bd-4978-4847-8f6b-ce229459b580 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 0784600a-4bdf-4473-a468-00749408baf6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:57.784489 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-402bf6bd-4978-4847-8f6b-ce229459b580 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:57.784956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-402bf6bd-4978-4847-8f6b-ce229459b580 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:57.786282 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-402bf6bd-4978-4847-8f6b-ce229459b580 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:57.786728 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-402bf6bd-4978-4847-8f6b-ce229459b580 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:57.799763 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-402bf6bd-4978-4847-8f6b-ce229459b580 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] HTTP exception thrown: Instance 0784600a-4bdf-4473-a468-00749408baf6 could not be found. Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-402bf6bd-4978-4847-8f6b-ce229459b580 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Request method failure captured: Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 HTTP/1.1 Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eQPn5O_C5ZaBUrq3cWaXwKlsVFXoH6_7MGmMPX-CxLike-3xVhRiDByBoyS6KXDo47rKKZ4peb82nhEoua_5b2gn_H4tjDZiF8U_8VfUxFl9A_V5ppeCkxfdOYofUCJ0WPmvGhmlTtgk7ErcR_6KySkNqW6B00rdz9ufcNKJ2cTWKU Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a001c7a532534c2a8eec932478004235 Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a001c7a532534c2a8eec932478004235"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a001c7a532534c2a8eec932478004235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a001c7a532534c2a8eec932478004235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a001c7a532534c2a8eec932478004235", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a001c7a532534c2a8eec932478004235 Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestEncryptedCinderVolumes-1289853719-project Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 9cfbede1b77a482ea259d9c2f5a6a353 Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestEncryptedCinderVolumes-1289853719-project Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 0784600a-4bdf-4473-a468-00749408baf6 could not be found. Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '0784600a-4bdf-4473-a468-00749408baf6'} Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0784600a-4bdf-4473-a468-00749408baf6 could not be found. Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0784600a-4bdf-4473-a468-00749408baf6 could not be found. Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:08:57.802024 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:08:57.806010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:08:57.806010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:08:57.806010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:08:57.806010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:08:57.806010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:08:57.806010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0784600a-4bdf-4473-a468-00749408baf6 could not be found. Jul 31 02:08:57.806010 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:08:57.806010 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-402bf6bd-4978-4847-8f6b-ce229459b580 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Returning 404 to user: Instance 0784600a-4bdf-4473-a468-00749408baf6 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:08:57.806010 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-402bf6bd-4978-4847-8f6b-ce229459b580 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6" status: 404 len: 111 microversion: 2.1 time: 0.031079 Jul 31 02:08:57.806010 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3459/6882] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:57 2022] GET /compute/v2.1/servers/0784600a-4bdf-4473-a468-00749408baf6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:08:57.813044 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6d12c58f-499d-4529-86ad-ee3964c62baf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '.version_select at 0x7fede567ba60>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:57.832136 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6d12c58f-499d-4529-86ad-ee3964c62baf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1676920259" status: 202 len: 0 microversion: 2.1 time: 0.023459 Jul 31 02:08:57.832702 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3424/6883] 10.222.0.45 () {58 vars in 1278 bytes} [Sun Jul 31 02:08:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1676920259 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:08:57.850411 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-886bbc4c-f799-4ded-a3f3-828d3a1bd2b5 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Action: 'create', calling method: .version_select at 0x7fede5632670>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-609416378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8OilEcS0WHxuVto/1PeDjPeVNJq/HD984SvCf0yZ9pj2LY1Jmlmwceh++N+J2Jv26UGI4zQQLmy6gUfzHWQECUPzmzLiFKfbk4wVQKgS/AL4dxiKwGhTdEP397KYZYhQ=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:08:57.866168 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-886bbc4c-f799-4ded-a3f3-828d3a1bd2b5 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Getting quotas for project a001c7a532534c2a8eec932478004235. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:08:57.871455 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-886bbc4c-f799-4ded-a3f3-828d3a1bd2b5 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Getting quotas for user 9cfbede1b77a482ea259d9c2f5a6a353 and project a001c7a532534c2a8eec932478004235. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:08:57.894808 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-886bbc4c-f799-4ded-a3f3-828d3a1bd2b5 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048791 Jul 31 02:08:57.895444 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3460/6884] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 02:08:57 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:08:57.944917 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-16571ede-2587-4280-87e9-16950afa88f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-807801460", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-609416378", "networks": [{"uuid": "3e48b6f0-1729-4be6-be04-b5d236e594c5"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:08:57.997395 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-16571ede-2587-4280-87e9-16950afa88f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] validate_networks() for [('3e48b6f0-1729-4be6-be04-b5d236e594c5', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:08:58.362636 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-16571ede-2587-4280-87e9-16950afa88f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:08:58.363077 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-16571ede-2587-4280-87e9-16950afa88f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:08:58.363606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-16571ede-2587-4280-87e9-16950afa88f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:08:58.364034 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-16571ede-2587-4280-87e9-16950afa88f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:08:58.364463 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-16571ede-2587-4280-87e9-16950afa88f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:08:58.378028 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16571ede-2587-4280-87e9-16950afa88f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:58.378495 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16571ede-2587-4280-87e9-16950afa88f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:58.379317 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16571ede-2587-4280-87e9-16950afa88f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:58.382076 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16571ede-2587-4280-87e9-16950afa88f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:58.399925 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-16571ede-2587-4280-87e9-16950afa88f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Getting quotas for project a001c7a532534c2a8eec932478004235. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:08:58.405181 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-16571ede-2587-4280-87e9-16950afa88f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Getting quotas for user 9cfbede1b77a482ea259d9c2f5a6a353 and project a001c7a532534c2a8eec932478004235. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:08:58.418060 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-16571ede-2587-4280-87e9-16950afa88f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:08:58.420382 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-16571ede-2587-4280-87e9-16950afa88f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:08:58.466874 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-16571ede-2587-4280-87e9-16950afa88f8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525883 Jul 31 02:08:58.467555 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3425/6885] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:08:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:08:58.478423 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b4041cd2-b949-429f-9d07-7175991c147f tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:58.479161 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b4041cd2-b949-429f-9d07-7175991c147f tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:58.536901 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b4041cd2-b949-429f-9d07-7175991c147f tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:08:58.543797 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b4041cd2-b949-429f-9d07-7175991c147f tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 200 len: 1261 microversion: 2.1 time: 0.069407 Jul 31 02:08:58.544369 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3461/6886] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:58 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 1261 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:08:59.565802 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a29388fd-39cd-4473-ad7a-d0722991f80d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:08:59.566443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a29388fd-39cd-4473-ad7a-d0722991f80d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:08:59.573888 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a29388fd-39cd-4473-ad7a-d0722991f80d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:59.574370 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a29388fd-39cd-4473-ad7a-d0722991f80d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:59.575166 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a29388fd-39cd-4473-ad7a-d0722991f80d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:08:59.575650 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a29388fd-39cd-4473-ad7a-d0722991f80d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:08:59.959320 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a29388fd-39cd-4473-ad7a-d0722991f80d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:08:59.966874 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a29388fd-39cd-4473-ad7a-d0722991f80d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 200 len: 1321 microversion: 2.1 time: 0.406005 Jul 31 02:08:59.967683 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3426/6887] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:08:59 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 1321 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:00.988061 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-619e6cea-b339-4091-8c15-68e77b07eb50 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:00.988833 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-619e6cea-b339-4091-8c15-68e77b07eb50 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:00.996065 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-619e6cea-b339-4091-8c15-68e77b07eb50 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:00.996534 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-619e6cea-b339-4091-8c15-68e77b07eb50 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:00.997317 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-619e6cea-b339-4091-8c15-68e77b07eb50 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:00.997772 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-619e6cea-b339-4091-8c15-68e77b07eb50 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:01.187448 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-619e6cea-b339-4091-8c15-68e77b07eb50 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:01.195794 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-619e6cea-b339-4091-8c15-68e77b07eb50 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 200 len: 1361 microversion: 2.1 time: 0.212162 Jul 31 02:09:01.196383 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3462/6888] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:00 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:01.239162 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-0bb7f7a4-ee09-431b-bb11-772db37aeae7 req-c84a6dd7-b7ad-451c-bcd6-72a170744d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "462707a5-2627-4ad1-be7b-ee910b86ffb6", "tag": "744b168b-5c09-49e4-8321-e9a04e7842e3"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:09:01.250282 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0bb7f7a4-ee09-431b-bb11-772db37aeae7 req-c84a6dd7-b7ad-451c-bcd6-72a170744d92 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:01.250830 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-0bb7f7a4-ee09-431b-bb11-772db37aeae7 req-c84a6dd7-b7ad-451c-bcd6-72a170744d92 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:01.262867 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-0bb7f7a4-ee09-431b-bb11-772db37aeae7 req-c84a6dd7-b7ad-451c-bcd6-72a170744d92 service nova] Creating event network-changed:744b168b-5c09-49e4-8321-e9a04e7842e3 for instance 462707a5-2627-4ad1-be7b-ee910b86ffb6 on n-h1-master-1 Jul 31 02:09:01.267806 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-0bb7f7a4-ee09-431b-bb11-772db37aeae7 req-c84a6dd7-b7ad-451c-bcd6-72a170744d92 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032852 Jul 31 02:09:01.268412 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3427/6889] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:09:02.216822 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3d60c07-ae65-4f69-9ffe-7718497e680b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:02.217445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3d60c07-ae65-4f69-9ffe-7718497e680b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:02.224907 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3d60c07-ae65-4f69-9ffe-7718497e680b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:02.225351 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3d60c07-ae65-4f69-9ffe-7718497e680b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:02.226157 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3d60c07-ae65-4f69-9ffe-7718497e680b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:02.226607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3d60c07-ae65-4f69-9ffe-7718497e680b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:02.356061 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3d60c07-ae65-4f69-9ffe-7718497e680b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:02.364109 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3d60c07-ae65-4f69-9ffe-7718497e680b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 200 len: 1361 microversion: 2.1 time: 0.150591 Jul 31 02:09:02.364700 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3463/6890] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:02 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:03.387041 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-da1f2cbd-2842-40e6-bdba-9cc61a24114c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:03.387830 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-da1f2cbd-2842-40e6-bdba-9cc61a24114c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:03.394178 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da1f2cbd-2842-40e6-bdba-9cc61a24114c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:03.394650 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da1f2cbd-2842-40e6-bdba-9cc61a24114c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:03.395488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da1f2cbd-2842-40e6-bdba-9cc61a24114c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:03.395948 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-da1f2cbd-2842-40e6-bdba-9cc61a24114c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:03.524604 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-da1f2cbd-2842-40e6-bdba-9cc61a24114c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:03.532192 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-da1f2cbd-2842-40e6-bdba-9cc61a24114c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 200 len: 1361 microversion: 2.1 time: 0.150211 Jul 31 02:09:03.532762 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3428/6891] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:03 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:04.553107 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-edec28b3-800e-48fd-8f63-e99c1b91f254 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:04.553736 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-edec28b3-800e-48fd-8f63-e99c1b91f254 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:04.560714 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-edec28b3-800e-48fd-8f63-e99c1b91f254 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:04.561339 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-edec28b3-800e-48fd-8f63-e99c1b91f254 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:04.562548 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-edec28b3-800e-48fd-8f63-e99c1b91f254 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:04.563240 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-edec28b3-800e-48fd-8f63-e99c1b91f254 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:04.695808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-edec28b3-800e-48fd-8f63-e99c1b91f254 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:04.703192 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-edec28b3-800e-48fd-8f63-e99c1b91f254 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 200 len: 1361 microversion: 2.1 time: 0.154077 Jul 31 02:09:04.703829 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3464/6892] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:04 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:05.725772 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-49cf23ad-aaf0-4b70-a209-1b2bf5dc5d2d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:05.726358 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-49cf23ad-aaf0-4b70-a209-1b2bf5dc5d2d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:05.733192 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49cf23ad-aaf0-4b70-a209-1b2bf5dc5d2d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:05.733669 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49cf23ad-aaf0-4b70-a209-1b2bf5dc5d2d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:05.734455 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49cf23ad-aaf0-4b70-a209-1b2bf5dc5d2d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:05.734915 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49cf23ad-aaf0-4b70-a209-1b2bf5dc5d2d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:05.863101 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-49cf23ad-aaf0-4b70-a209-1b2bf5dc5d2d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:05.870868 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-49cf23ad-aaf0-4b70-a209-1b2bf5dc5d2d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 200 len: 1361 microversion: 2.1 time: 0.149941 Jul 31 02:09:05.871460 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3429/6893] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:05 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:06.891002 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fae3df53-21c8-4a77-bcbc-814c1bfde109 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:06.891599 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fae3df53-21c8-4a77-bcbc-814c1bfde109 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:06.899463 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fae3df53-21c8-4a77-bcbc-814c1bfde109 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:06.899924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fae3df53-21c8-4a77-bcbc-814c1bfde109 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:06.900701 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fae3df53-21c8-4a77-bcbc-814c1bfde109 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:06.901192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fae3df53-21c8-4a77-bcbc-814c1bfde109 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:07.032753 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fae3df53-21c8-4a77-bcbc-814c1bfde109 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:07.040202 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fae3df53-21c8-4a77-bcbc-814c1bfde109 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 200 len: 1361 microversion: 2.1 time: 0.153203 Jul 31 02:09:07.040772 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3465/6894] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:06 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:08.061492 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e009ead7-5d26-4a17-899b-3477f46881cf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:08.062178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e009ead7-5d26-4a17-899b-3477f46881cf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:08.069974 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e009ead7-5d26-4a17-899b-3477f46881cf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:08.070443 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e009ead7-5d26-4a17-899b-3477f46881cf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:08.071223 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e009ead7-5d26-4a17-899b-3477f46881cf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:08.071704 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e009ead7-5d26-4a17-899b-3477f46881cf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:08.210159 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e009ead7-5d26-4a17-899b-3477f46881cf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:08.218293 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e009ead7-5d26-4a17-899b-3477f46881cf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 200 len: 1361 microversion: 2.1 time: 0.160679 Jul 31 02:09:08.218869 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3430/6895] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:08 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:08.231393 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-7ff8300f-973f-46f2-b14b-b1ad0aa38570 req-530388a3-7174-45f9-91e7-b4d501866b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "462707a5-2627-4ad1-be7b-ee910b86ffb6", "name": "network-vif-plugged", "status": "completed", "tag": "744b168b-5c09-49e4-8321-e9a04e7842e3"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:09:08.242078 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7ff8300f-973f-46f2-b14b-b1ad0aa38570 req-530388a3-7174-45f9-91e7-b4d501866b97 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:08.242545 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7ff8300f-973f-46f2-b14b-b1ad0aa38570 req-530388a3-7174-45f9-91e7-b4d501866b97 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:08.254055 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-7ff8300f-973f-46f2-b14b-b1ad0aa38570 req-530388a3-7174-45f9-91e7-b4d501866b97 service nova] Creating event network-vif-plugged:744b168b-5c09-49e4-8321-e9a04e7842e3 for instance 462707a5-2627-4ad1-be7b-ee910b86ffb6 on n-h1-master-1 Jul 31 02:09:08.259571 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-7ff8300f-973f-46f2-b14b-b1ad0aa38570 req-530388a3-7174-45f9-91e7-b4d501866b97 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031943 Jul 31 02:09:08.260173 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3466/6896] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:09:09.239752 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3a7ac3e9-1080-438d-873b-391cd2c22f55 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:09.240428 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3a7ac3e9-1080-438d-873b-391cd2c22f55 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:09.242420 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:09.243380 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:09.250198 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a7ac3e9-1080-438d-873b-391cd2c22f55 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:09.250670 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a7ac3e9-1080-438d-873b-391cd2c22f55 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:09.251482 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a7ac3e9-1080-438d-873b-391cd2c22f55 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:09.251939 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a7ac3e9-1080-438d-873b-391cd2c22f55 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:09.382913 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3a7ac3e9-1080-438d-873b-391cd2c22f55 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:09.391147 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3a7ac3e9-1080-438d-873b-391cd2c22f55 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 200 len: 1361 microversion: 2.1 time: 0.155411 Jul 31 02:09:09.399425 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3431/6897] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:09 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:10.409811 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:10.415655 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e8fb237f-f62c-4485-b62c-3a98f6cb0f83 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:10.416379 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e8fb237f-f62c-4485-b62c-3a98f6cb0f83 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:10.422898 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8fb237f-f62c-4485-b62c-3a98f6cb0f83 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:10.423387 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8fb237f-f62c-4485-b62c-3a98f6cb0f83 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:10.424170 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8fb237f-f62c-4485-b62c-3a98f6cb0f83 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:10.424624 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8fb237f-f62c-4485-b62c-3a98f6cb0f83 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:10.552259 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e8fb237f-f62c-4485-b62c-3a98f6cb0f83 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:10.559854 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e8fb237f-f62c-4485-b62c-3a98f6cb0f83 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 200 len: 1552 microversion: 2.1 time: 0.151025 Jul 31 02:09:10.560673 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3467/6898] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:10 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:10.581297 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f43d0e0b-c377-4146-a422-7f2659e7302e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:10.581952 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f43d0e0b-c377-4146-a422-7f2659e7302e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:10.589474 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f43d0e0b-c377-4146-a422-7f2659e7302e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:10.589937 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f43d0e0b-c377-4146-a422-7f2659e7302e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:10.590711 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f43d0e0b-c377-4146-a422-7f2659e7302e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:10.591159 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f43d0e0b-c377-4146-a422-7f2659e7302e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:10.723065 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f43d0e0b-c377-4146-a422-7f2659e7302e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:10.730662 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f43d0e0b-c377-4146-a422-7f2659e7302e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 200 len: 1552 microversion: 2.1 time: 0.153291 Jul 31 02:09:10.731239 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3432/6899] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:10 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:12.218996 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-22d42787-aa3d-4aa6-9998-1116072706e8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f3617c9-7459-45b8-ab82-9a6dbdea5f76"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:09:12.221426 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-22d42787-aa3d-4aa6-9998-1116072706e8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:12.228771 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22d42787-aa3d-4aa6-9998-1116072706e8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:12.229222 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22d42787-aa3d-4aa6-9998-1116072706e8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:12.229993 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22d42787-aa3d-4aa6-9998-1116072706e8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:12.230444 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-22d42787-aa3d-4aa6-9998-1116072706e8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:12.478957 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-22d42787-aa3d-4aa6-9998-1116072706e8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "POST /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263758 Jul 31 02:09:12.479615 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3468/6900] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 02:09:12 2022] POST /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:09:23.175016 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-26bc3a28-3b2d-4721-8351-b26617142e18 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:23.175568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-26bc3a28-3b2d-4721-8351-b26617142e18 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:23.178794 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:23.179485 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:23.185514 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26bc3a28-3b2d-4721-8351-b26617142e18 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:23.185973 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26bc3a28-3b2d-4721-8351-b26617142e18 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:23.186748 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26bc3a28-3b2d-4721-8351-b26617142e18 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:23.187196 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26bc3a28-3b2d-4721-8351-b26617142e18 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:23.275463 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-26bc3a28-3b2d-4721-8351-b26617142e18 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lazy-loading 'services' on Instance uuid 462707a5-2627-4ad1-be7b-ee910b86ffb6 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:09:23.344818 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-26bc3a28-3b2d-4721-8351-b26617142e18 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "DELETE /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments/8f3617c9-7459-45b8-ab82-9a6dbdea5f76" status: 202 len: 0 microversion: 2.1 time: 0.173624 Jul 31 02:09:23.345413 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3433/6901] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 02:09:23 2022] DELETE /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments/8f3617c9-7459-45b8-ab82-9a6dbdea5f76 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:09:23.352626 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:23.353409 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:23.357715 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b990dc26-eb22-4071-93ce-d5310cc29dbf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:23.360225 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b990dc26-eb22-4071-93ce-d5310cc29dbf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:23.369109 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b990dc26-eb22-4071-93ce-d5310cc29dbf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:23.369646 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b990dc26-eb22-4071-93ce-d5310cc29dbf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:23.370522 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b990dc26-eb22-4071-93ce-d5310cc29dbf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:23.370963 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b990dc26-eb22-4071-93ce-d5310cc29dbf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:23.405650 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b990dc26-eb22-4071-93ce-d5310cc29dbf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054913 Jul 31 02:09:23.406207 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3469/6902] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:09:23 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:09:24.418948 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cdf46825-9d75-4852-85ae-738cd59be5a3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:24.421403 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cdf46825-9d75-4852-85ae-738cd59be5a3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:24.428412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cdf46825-9d75-4852-85ae-738cd59be5a3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:24.429168 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cdf46825-9d75-4852-85ae-738cd59be5a3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:24.429937 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cdf46825-9d75-4852-85ae-738cd59be5a3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:24.430399 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cdf46825-9d75-4852-85ae-738cd59be5a3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:24.460632 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cdf46825-9d75-4852-85ae-738cd59be5a3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046928 Jul 31 02:09:24.461203 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3434/6903] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:09:24 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:09:25.473091 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dbb79c52-084e-422e-bb5c-317cc8c05509 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:25.475421 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dbb79c52-084e-422e-bb5c-317cc8c05509 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:25.482654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dbb79c52-084e-422e-bb5c-317cc8c05509 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:25.483122 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dbb79c52-084e-422e-bb5c-317cc8c05509 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:25.483956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dbb79c52-084e-422e-bb5c-317cc8c05509 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:25.484410 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dbb79c52-084e-422e-bb5c-317cc8c05509 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:25.514477 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dbb79c52-084e-422e-bb5c-317cc8c05509 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045402 Jul 31 02:09:25.515045 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3470/6904] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:09:25 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:09:26.527559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fae112e9-3647-448d-b167-672075971ea8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:26.529750 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fae112e9-3647-448d-b167-672075971ea8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:26.537054 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fae112e9-3647-448d-b167-672075971ea8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:26.537526 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fae112e9-3647-448d-b167-672075971ea8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:26.538314 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fae112e9-3647-448d-b167-672075971ea8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:26.538772 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fae112e9-3647-448d-b167-672075971ea8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:26.572102 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fae112e9-3647-448d-b167-672075971ea8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048718 Jul 31 02:09:26.572890 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3435/6905] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:09:26 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:09:27.584468 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ca2097c-4f3f-4e9c-b91f-2a756da0362b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:27.586693 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4ca2097c-4f3f-4e9c-b91f-2a756da0362b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:27.593751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ca2097c-4f3f-4e9c-b91f-2a756da0362b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:27.594215 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ca2097c-4f3f-4e9c-b91f-2a756da0362b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:27.594999 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ca2097c-4f3f-4e9c-b91f-2a756da0362b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:27.595478 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ca2097c-4f3f-4e9c-b91f-2a756da0362b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:27.625618 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4ca2097c-4f3f-4e9c-b91f-2a756da0362b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045256 Jul 31 02:09:27.626193 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3471/6906] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:09:27 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:09:28.638129 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b36062ba-67f3-4cef-bab7-594d3c001708 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:28.640407 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b36062ba-67f3-4cef-bab7-594d3c001708 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:28.647954 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b36062ba-67f3-4cef-bab7-594d3c001708 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:28.648424 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b36062ba-67f3-4cef-bab7-594d3c001708 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:28.649206 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b36062ba-67f3-4cef-bab7-594d3c001708 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:28.649664 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b36062ba-67f3-4cef-bab7-594d3c001708 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:28.677924 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b36062ba-67f3-4cef-bab7-594d3c001708 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043886 Jul 31 02:09:28.678482 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3436/6907] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:09:28 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 02:09:28.689246 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4cdce2ce-217f-4c71-83ee-00ee2b9cbbfc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:28.689746 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4cdce2ce-217f-4c71-83ee-00ee2b9cbbfc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:28.697016 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4cdce2ce-217f-4c71-83ee-00ee2b9cbbfc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:28.697475 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4cdce2ce-217f-4c71-83ee-00ee2b9cbbfc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:28.698239 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4cdce2ce-217f-4c71-83ee-00ee2b9cbbfc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:28.698685 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4cdce2ce-217f-4c71-83ee-00ee2b9cbbfc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:28.775708 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-4cdce2ce-217f-4c71-83ee-00ee2b9cbbfc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] HTTP exception thrown: Instance 462707a5-2627-4ad1-be7b-ee910b86ffb6 is not attached to volume 8f3617c9-7459-45b8-ab82-9a6dbdea5f76 Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4cdce2ce-217f-4c71-83ee-00ee2b9cbbfc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Request method failure captured: Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: request: DELETE /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments/8f3617c9-7459-45b8-ab82-9a6dbdea5f76 HTTP/1.1 Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eQPn5O_C5ZaBUrq3cWaXwKlsVFXoH6_7MGmMPX-CxLike-3xVhRiDByBoyS6KXDo47rKKZ4peb82nhEoua_5b2gn_H4tjDZiF8U_8VfUxFl9A_V5ppeCkxfdOYofUCJ0WPmvGhmlTtgk7ErcR_6KySkNqW6B00rdz9ufcNKJ2cTWKU Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a001c7a532534c2a8eec932478004235 Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a001c7a532534c2a8eec932478004235"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a001c7a532534c2a8eec932478004235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a001c7a532534c2a8eec932478004235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a001c7a532534c2a8eec932478004235", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a001c7a532534c2a8eec932478004235 Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestEncryptedCinderVolumes-1289853719-project Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 9cfbede1b77a482ea259d9c2f5a6a353 Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestEncryptedCinderVolumes-1289853719-project Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 462707a5-2627-4ad1-be7b-ee910b86ffb6 is not attached to volume 8f3617c9-7459-45b8-ab82-9a6dbdea5f76 Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: action_args: {'server_id': '462707a5-2627-4ad1-be7b-ee910b86ffb6', 'id': '8f3617c9-7459-45b8-ab82-9a6dbdea5f76'} Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8f3617c9-7459-45b8-ab82-9a6dbdea5f76. Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 462707a5-2627-4ad1-be7b-ee910b86ffb6 is not attached to volume 8f3617c9-7459-45b8-ab82-9a6dbdea5f76 Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:09:28.777324 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:09:28.780560 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:09:28.780560 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:09:28.780560 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 462707a5-2627-4ad1-be7b-ee910b86ffb6 is not attached to volume 8f3617c9-7459-45b8-ab82-9a6dbdea5f76 Jul 31 02:09:28.780560 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:09:28.780560 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4cdce2ce-217f-4c71-83ee-00ee2b9cbbfc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Returning 404 to user: Instance 462707a5-2627-4ad1-be7b-ee910b86ffb6 is not attached to volume 8f3617c9-7459-45b8-ab82-9a6dbdea5f76 {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:09:28.780560 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4cdce2ce-217f-4c71-83ee-00ee2b9cbbfc tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "DELETE /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments/8f3617c9-7459-45b8-ab82-9a6dbdea5f76" status: 404 len: 154 microversion: 2.1 time: 0.093580 Jul 31 02:09:28.780560 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3472/6908] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 02:09:28 2022] DELETE /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6/os-volume_attachments/8f3617c9-7459-45b8-ab82-9a6dbdea5f76 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:09:32.154172 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bec77ed7-e280-4c24-bd3c-9ba09cb4358a tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:32.154713 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bec77ed7-e280-4c24-bd3c-9ba09cb4358a tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:32.162389 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bec77ed7-e280-4c24-bd3c-9ba09cb4358a tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:32.162854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bec77ed7-e280-4c24-bd3c-9ba09cb4358a tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:32.163656 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bec77ed7-e280-4c24-bd3c-9ba09cb4358a tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:32.164104 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bec77ed7-e280-4c24-bd3c-9ba09cb4358a tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:32.190169 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bec77ed7-e280-4c24-bd3c-9ba09cb4358a tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:09:32.266565 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bec77ed7-e280-4c24-bd3c-9ba09cb4358a tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "DELETE /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 204 len: 0 microversion: 2.1 time: 0.115943 Jul 31 02:09:32.267455 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3437/6909] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:09:32 2022] DELETE /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:09:32.275845 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-28176da6-27b5-46ff-aa22-cf5e01e52334 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:32.276627 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-28176da6-27b5-46ff-aa22-cf5e01e52334 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:32.285357 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28176da6-27b5-46ff-aa22-cf5e01e52334 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:32.285909 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28176da6-27b5-46ff-aa22-cf5e01e52334 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:32.287299 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28176da6-27b5-46ff-aa22-cf5e01e52334 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:32.287789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-28176da6-27b5-46ff-aa22-cf5e01e52334 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:32.421305 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-28176da6-27b5-46ff-aa22-cf5e01e52334 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:32.429674 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-28176da6-27b5-46ff-aa22-cf5e01e52334 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 200 len: 1558 microversion: 2.1 time: 0.157900 Jul 31 02:09:32.430330 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3473/6910] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:32 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:33.452402 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-22db2279-076f-4a36-98bd-21a2419e4ea8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:33.453138 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-22db2279-076f-4a36-98bd-21a2419e4ea8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:33.460248 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22db2279-076f-4a36-98bd-21a2419e4ea8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:33.460724 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22db2279-076f-4a36-98bd-21a2419e4ea8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:33.461510 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22db2279-076f-4a36-98bd-21a2419e4ea8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:33.462188 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22db2279-076f-4a36-98bd-21a2419e4ea8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:33.699648 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-22db2279-076f-4a36-98bd-21a2419e4ea8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:33.707391 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-22db2279-076f-4a36-98bd-21a2419e4ea8 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 200 len: 1558 microversion: 2.1 time: 0.259365 Jul 31 02:09:33.707960 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3438/6911] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:33 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 1558 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:34.330652 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-23c764e0-9b3f-48cc-b2ec-6a1faa82b3be req-f3a50c51-bfd7-4cfe-acff-9905b05104af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "462707a5-2627-4ad1-be7b-ee910b86ffb6", "name": "network-vif-deleted", "tag": "744b168b-5c09-49e4-8321-e9a04e7842e3"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:09:34.343735 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-23c764e0-9b3f-48cc-b2ec-6a1faa82b3be req-f3a50c51-bfd7-4cfe-acff-9905b05104af service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:34.344198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-23c764e0-9b3f-48cc-b2ec-6a1faa82b3be req-f3a50c51-bfd7-4cfe-acff-9905b05104af service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:34.357746 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-23c764e0-9b3f-48cc-b2ec-6a1faa82b3be req-f3a50c51-bfd7-4cfe-acff-9905b05104af service nova] Creating event network-vif-deleted:744b168b-5c09-49e4-8321-e9a04e7842e3 for instance 462707a5-2627-4ad1-be7b-ee910b86ffb6 on n-h1-master-1 Jul 31 02:09:34.364447 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-23c764e0-9b3f-48cc-b2ec-6a1faa82b3be req-f3a50c51-bfd7-4cfe-acff-9905b05104af service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037458 Jul 31 02:09:34.365113 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3474/6912] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:09:34.728699 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-adc4be49-11bd-4f0f-b854-7d4fd7bd85b9 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:34.729954 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-adc4be49-11bd-4f0f-b854-7d4fd7bd85b9 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:34.737127 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adc4be49-11bd-4f0f-b854-7d4fd7bd85b9 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:34.737781 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adc4be49-11bd-4f0f-b854-7d4fd7bd85b9 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:34.738642 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adc4be49-11bd-4f0f-b854-7d4fd7bd85b9 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:34.739246 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adc4be49-11bd-4f0f-b854-7d4fd7bd85b9 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:34.778208 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adc4be49-11bd-4f0f-b854-7d4fd7bd85b9 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:34.778682 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-adc4be49-11bd-4f0f-b854-7d4fd7bd85b9 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:34.779155 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-adc4be49-11bd-4f0f-b854-7d4fd7bd85b9 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lazy-loading 'fault' on Instance uuid 462707a5-2627-4ad1-be7b-ee910b86ffb6 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:09:34.825219 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-adc4be49-11bd-4f0f-b854-7d4fd7bd85b9 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:34.833648 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-adc4be49-11bd-4f0f-b854-7d4fd7bd85b9 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 200 len: 1351 microversion: 2.1 time: 0.108706 Jul 31 02:09:34.834524 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3439/6913] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:34 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 1351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:35.855941 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d2112b40-7a60-4c2d-946c-cc775add2a99 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:35.856663 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d2112b40-7a60-4c2d-946c-cc775add2a99 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: 462707a5-2627-4ad1-be7b-ee910b86ffb6] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:35.863839 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2112b40-7a60-4c2d-946c-cc775add2a99 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:35.864303 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2112b40-7a60-4c2d-946c-cc775add2a99 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:35.865584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2112b40-7a60-4c2d-946c-cc775add2a99 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:35.866030 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2112b40-7a60-4c2d-946c-cc775add2a99 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:35.879602 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-d2112b40-7a60-4c2d-946c-cc775add2a99 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] HTTP exception thrown: Instance 462707a5-2627-4ad1-be7b-ee910b86ffb6 could not be found. Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d2112b40-7a60-4c2d-946c-cc775add2a99 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Request method failure captured: Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 HTTP/1.1 Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eQPn5O_C5ZaBUrq3cWaXwKlsVFXoH6_7MGmMPX-CxLike-3xVhRiDByBoyS6KXDo47rKKZ4peb82nhEoua_5b2gn_H4tjDZiF8U_8VfUxFl9A_V5ppeCkxfdOYofUCJ0WPmvGhmlTtgk7ErcR_6KySkNqW6B00rdz9ufcNKJ2cTWKU Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: a001c7a532534c2a8eec932478004235 Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a001c7a532534c2a8eec932478004235"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a001c7a532534c2a8eec932478004235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a001c7a532534c2a8eec932478004235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a001c7a532534c2a8eec932478004235", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: a001c7a532534c2a8eec932478004235 Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestEncryptedCinderVolumes-1289853719-project Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 9cfbede1b77a482ea259d9c2f5a6a353 Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestEncryptedCinderVolumes-1289853719-project Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 462707a5-2627-4ad1-be7b-ee910b86ffb6 could not be found. Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '462707a5-2627-4ad1-be7b-ee910b86ffb6'} Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 462707a5-2627-4ad1-be7b-ee910b86ffb6 could not be found. Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 462707a5-2627-4ad1-be7b-ee910b86ffb6 could not be found. Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:09:35.881902 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:09:35.885932 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:09:35.885932 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:09:35.885932 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:09:35.885932 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:09:35.885932 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:09:35.885932 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 462707a5-2627-4ad1-be7b-ee910b86ffb6 could not be found. Jul 31 02:09:35.885932 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:09:35.885932 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d2112b40-7a60-4c2d-946c-cc775add2a99 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Returning 404 to user: Instance 462707a5-2627-4ad1-be7b-ee910b86ffb6 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:09:35.885932 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d2112b40-7a60-4c2d-946c-cc775add2a99 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6" status: 404 len: 111 microversion: 2.1 time: 0.031715 Jul 31 02:09:35.885932 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3475/6914] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:35 2022] GET /compute/v2.1/servers/462707a5-2627-4ad1-be7b-ee910b86ffb6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:09:35.892240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f3387f71-6748-4a5e-8dbe-d8a751f9614d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '.version_select at 0x7fede567bf70>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:35.914085 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f3387f71-6748-4a5e-8dbe-d8a751f9614d tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-609416378" status: 202 len: 0 microversion: 2.1 time: 0.025685 Jul 31 02:09:35.914659 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3440/6915] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 02:09:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-609416378 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:09:35.932199 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5b495a54-9d0c-4639-bf27-ab285f195e50 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Action: 'create', calling method: .version_select at 0x7fede478b4c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-868042871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFGIlxXoug55OPcrLBh6L+baVM+UHBUdv1dG3BA28CbGPdNl8tZEbPRrCJUBsORzNzR+8f6iVcipElPyqrLWZ3IUgp2qxY1CaueBPXJ3hlbywEYrnigSjoRSpvvK/PxlA=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:09:35.947387 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-5b495a54-9d0c-4639-bf27-ab285f195e50 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Getting quotas for project a001c7a532534c2a8eec932478004235. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:09:35.953248 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-5b495a54-9d0c-4639-bf27-ab285f195e50 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Getting quotas for user 9cfbede1b77a482ea259d9c2f5a6a353 and project a001c7a532534c2a8eec932478004235. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:09:35.976260 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5b495a54-9d0c-4639-bf27-ab285f195e50 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048623 Jul 31 02:09:35.976851 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3476/6916] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 02:09:35 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:09:36.026079 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-611c8b6b-2e63-4afe-8507-526b46853b87 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-818681919", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-868042871", "networks": [{"uuid": "3e48b6f0-1729-4be6-be04-b5d236e594c5"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:09:36.078421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-611c8b6b-2e63-4afe-8507-526b46853b87 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] validate_networks() for [('3e48b6f0-1729-4be6-be04-b5d236e594c5', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:09:36.454691 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-611c8b6b-2e63-4afe-8507-526b46853b87 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:09:36.455140 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-611c8b6b-2e63-4afe-8507-526b46853b87 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:09:36.455668 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-611c8b6b-2e63-4afe-8507-526b46853b87 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:09:36.456128 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-611c8b6b-2e63-4afe-8507-526b46853b87 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:09:36.456563 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-611c8b6b-2e63-4afe-8507-526b46853b87 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:09:36.466191 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-611c8b6b-2e63-4afe-8507-526b46853b87 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:36.466664 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-611c8b6b-2e63-4afe-8507-526b46853b87 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:36.467533 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-611c8b6b-2e63-4afe-8507-526b46853b87 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:36.467991 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-611c8b6b-2e63-4afe-8507-526b46853b87 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:36.485452 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-611c8b6b-2e63-4afe-8507-526b46853b87 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Getting quotas for project a001c7a532534c2a8eec932478004235. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:09:36.490962 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-611c8b6b-2e63-4afe-8507-526b46853b87 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Getting quotas for user 9cfbede1b77a482ea259d9c2f5a6a353 and project a001c7a532534c2a8eec932478004235. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:09:36.503675 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-611c8b6b-2e63-4afe-8507-526b46853b87 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:09:36.505984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-611c8b6b-2e63-4afe-8507-526b46853b87 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:09:36.551727 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-611c8b6b-2e63-4afe-8507-526b46853b87 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529502 Jul 31 02:09:36.557953 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3441/6917] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:09:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:09:36.563703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f0497201-e92f-4115-9f6d-eaf708d2956b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:36.564341 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f0497201-e92f-4115-9f6d-eaf708d2956b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:36.671026 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f0497201-e92f-4115-9f6d-eaf708d2956b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:36.677906 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f0497201-e92f-4115-9f6d-eaf708d2956b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94" status: 200 len: 1261 microversion: 2.1 time: 0.118194 Jul 31 02:09:36.678496 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3477/6918] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:36 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94 => generated 1261 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:37.698754 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7de31697-ac49-4017-9fb4-52f291187486 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:37.699307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7de31697-ac49-4017-9fb4-52f291187486 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:37.706992 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7de31697-ac49-4017-9fb4-52f291187486 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:37.707720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7de31697-ac49-4017-9fb4-52f291187486 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:37.708507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7de31697-ac49-4017-9fb4-52f291187486 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:37.709167 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7de31697-ac49-4017-9fb4-52f291187486 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:37.781878 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7de31697-ac49-4017-9fb4-52f291187486 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:37.790009 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7de31697-ac49-4017-9fb4-52f291187486 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94" status: 200 len: 1319 microversion: 2.1 time: 0.095351 Jul 31 02:09:37.790583 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3442/6919] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:37 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94 => generated 1319 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:38.811357 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ced1839c-06ec-4d51-be85-0587d6bbe737 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:38.812521 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ced1839c-06ec-4d51-be85-0587d6bbe737 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:38.820159 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ced1839c-06ec-4d51-be85-0587d6bbe737 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:38.820560 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ced1839c-06ec-4d51-be85-0587d6bbe737 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:38.821870 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ced1839c-06ec-4d51-be85-0587d6bbe737 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:38.821870 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ced1839c-06ec-4d51-be85-0587d6bbe737 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:38.840974 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e7f25ff1-caa0-4db4-9a5a-feedca3a3cf2 req-e2668494-292f-4fcb-a852-7416b369ca05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a383561f-bb96-4e9c-a514-7ae9074bcd94", "tag": "5b75abf4-ed60-4939-acbe-2aec547b4c4c"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:09:38.864990 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e7f25ff1-caa0-4db4-9a5a-feedca3a3cf2 req-e2668494-292f-4fcb-a852-7416b369ca05 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:38.865476 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e7f25ff1-caa0-4db4-9a5a-feedca3a3cf2 req-e2668494-292f-4fcb-a852-7416b369ca05 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:38.885744 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e7f25ff1-caa0-4db4-9a5a-feedca3a3cf2 req-e2668494-292f-4fcb-a852-7416b369ca05 service nova] Creating event network-changed:5b75abf4-ed60-4939-acbe-2aec547b4c4c for instance a383561f-bb96-4e9c-a514-7ae9074bcd94 on n-h1-master-1 Jul 31 02:09:38.891456 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e7f25ff1-caa0-4db4-9a5a-feedca3a3cf2 req-e2668494-292f-4fcb-a852-7416b369ca05 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055038 Jul 31 02:09:38.892294 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3443/6920] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:09:39.088701 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ced1839c-06ec-4d51-be85-0587d6bbe737 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:39.096345 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ced1839c-06ec-4d51-be85-0587d6bbe737 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94" status: 200 len: 1361 microversion: 2.1 time: 0.288917 Jul 31 02:09:39.097033 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3478/6921] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:38 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94 => generated 1361 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:40.119332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9f3092f9-8272-4339-bb1e-965be0fd496e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:40.120083 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9f3092f9-8272-4339-bb1e-965be0fd496e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:40.127255 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f3092f9-8272-4339-bb1e-965be0fd496e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:40.127762 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f3092f9-8272-4339-bb1e-965be0fd496e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:40.128554 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f3092f9-8272-4339-bb1e-965be0fd496e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:40.129012 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f3092f9-8272-4339-bb1e-965be0fd496e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:40.348621 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9f3092f9-8272-4339-bb1e-965be0fd496e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:40.356077 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9f3092f9-8272-4339-bb1e-965be0fd496e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94" status: 200 len: 1361 microversion: 2.1 time: 0.241781 Jul 31 02:09:40.356646 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3444/6922] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:40 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94 => generated 1361 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:41.378314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5d9ae3d5-232f-43b0-b1ee-70353bc85939 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:41.378935 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5d9ae3d5-232f-43b0-b1ee-70353bc85939 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:41.386343 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d9ae3d5-232f-43b0-b1ee-70353bc85939 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:41.386799 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d9ae3d5-232f-43b0-b1ee-70353bc85939 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:41.387587 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d9ae3d5-232f-43b0-b1ee-70353bc85939 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:41.388028 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d9ae3d5-232f-43b0-b1ee-70353bc85939 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:41.518311 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5d9ae3d5-232f-43b0-b1ee-70353bc85939 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:41.526399 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5d9ae3d5-232f-43b0-b1ee-70353bc85939 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94" status: 200 len: 1361 microversion: 2.1 time: 0.151964 Jul 31 02:09:41.526974 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3479/6923] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:41 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:42.546401 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1aec41df-9b74-4154-93ec-f10c6fa160ab tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:42.547065 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1aec41df-9b74-4154-93ec-f10c6fa160ab tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:42.554613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1aec41df-9b74-4154-93ec-f10c6fa160ab tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:42.555085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1aec41df-9b74-4154-93ec-f10c6fa160ab tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:42.555923 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1aec41df-9b74-4154-93ec-f10c6fa160ab tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:42.556383 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1aec41df-9b74-4154-93ec-f10c6fa160ab tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:42.702526 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1aec41df-9b74-4154-93ec-f10c6fa160ab tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:42.711483 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1aec41df-9b74-4154-93ec-f10c6fa160ab tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94" status: 200 len: 1361 microversion: 2.1 time: 0.168983 Jul 31 02:09:42.712071 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3445/6924] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:42 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:43.732621 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4274bf9a-a057-4bc6-a990-c5ca98a3d3ff tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:43.733154 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4274bf9a-a057-4bc6-a990-c5ca98a3d3ff tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:43.739990 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4274bf9a-a057-4bc6-a990-c5ca98a3d3ff tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:43.740442 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4274bf9a-a057-4bc6-a990-c5ca98a3d3ff tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:43.741801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4274bf9a-a057-4bc6-a990-c5ca98a3d3ff tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:43.742243 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4274bf9a-a057-4bc6-a990-c5ca98a3d3ff tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:43.869703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4274bf9a-a057-4bc6-a990-c5ca98a3d3ff tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:43.877183 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4274bf9a-a057-4bc6-a990-c5ca98a3d3ff tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94" status: 200 len: 1361 microversion: 2.1 time: 0.148566 Jul 31 02:09:43.877762 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3480/6925] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:43 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:44.428411 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-a74deeb7-be22-41cc-a798-3de3d4b3a235 req-8a4fb895-28e1-4832-89e6-da0478334d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a383561f-bb96-4e9c-a514-7ae9074bcd94", "name": "network-vif-plugged", "status": "completed", "tag": "5b75abf4-ed60-4939-acbe-2aec547b4c4c"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:09:44.439825 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a74deeb7-be22-41cc-a798-3de3d4b3a235 req-8a4fb895-28e1-4832-89e6-da0478334d2d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:44.440295 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a74deeb7-be22-41cc-a798-3de3d4b3a235 req-8a4fb895-28e1-4832-89e6-da0478334d2d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:44.452480 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-a74deeb7-be22-41cc-a798-3de3d4b3a235 req-8a4fb895-28e1-4832-89e6-da0478334d2d service nova] Creating event network-vif-plugged:5b75abf4-ed60-4939-acbe-2aec547b4c4c for instance a383561f-bb96-4e9c-a514-7ae9074bcd94 on n-h1-master-1 Jul 31 02:09:44.457413 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-a74deeb7-be22-41cc-a798-3de3d4b3a235 req-8a4fb895-28e1-4832-89e6-da0478334d2d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032793 Jul 31 02:09:44.458007 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3446/6926] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:09:44.898307 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1b411371-c879-4751-a19c-f2970be8704e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:44.898864 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1b411371-c879-4751-a19c-f2970be8704e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:44.905776 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b411371-c879-4751-a19c-f2970be8704e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:44.906234 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b411371-c879-4751-a19c-f2970be8704e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:44.907001 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b411371-c879-4751-a19c-f2970be8704e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:44.907468 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b411371-c879-4751-a19c-f2970be8704e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:45.043040 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1b411371-c879-4751-a19c-f2970be8704e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:45.050513 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1b411371-c879-4751-a19c-f2970be8704e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94" status: 200 len: 1361 microversion: 2.1 time: 0.156252 Jul 31 02:09:45.051081 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3481/6927] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:44 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:09:46.074143 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d99fa276-849b-47bf-9e7b-28f4b5597aa3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:46.074869 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d99fa276-849b-47bf-9e7b-28f4b5597aa3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:46.081221 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d99fa276-849b-47bf-9e7b-28f4b5597aa3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:46.081721 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d99fa276-849b-47bf-9e7b-28f4b5597aa3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:46.082507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d99fa276-849b-47bf-9e7b-28f4b5597aa3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:46.082967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d99fa276-849b-47bf-9e7b-28f4b5597aa3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:46.234476 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d99fa276-849b-47bf-9e7b-28f4b5597aa3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:46.243794 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d99fa276-849b-47bf-9e7b-28f4b5597aa3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94" status: 200 len: 1552 microversion: 2.1 time: 0.174357 Jul 31 02:09:46.245368 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3447/6928] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:46 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94 => generated 1552 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:46.266560 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3bf9631f-b6cf-40fc-98c9-d22979cd922c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:46.267201 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3bf9631f-b6cf-40fc-98c9-d22979cd922c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:46.274343 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bf9631f-b6cf-40fc-98c9-d22979cd922c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:46.274810 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bf9631f-b6cf-40fc-98c9-d22979cd922c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:46.275627 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bf9631f-b6cf-40fc-98c9-d22979cd922c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:46.276081 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3bf9631f-b6cf-40fc-98c9-d22979cd922c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:46.411085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3bf9631f-b6cf-40fc-98c9-d22979cd922c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:09:46.419325 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3bf9631f-b6cf-40fc-98c9-d22979cd922c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94" status: 200 len: 1552 microversion: 2.1 time: 0.156632 Jul 31 02:09:46.419880 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3482/6929] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:09:46 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:09:47.916033 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e62b8788-5d61-4793-b91f-3f68db07dca3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cd2e5d4-1687-4e0d-885f-81466feefbb8"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:09:47.918419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e62b8788-5d61-4793-b91f-3f68db07dca3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:47.920436 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:47.921132 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:47.928784 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e62b8788-5d61-4793-b91f-3f68db07dca3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:47.929256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e62b8788-5d61-4793-b91f-3f68db07dca3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:47.930045 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e62b8788-5d61-4793-b91f-3f68db07dca3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:47.930579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e62b8788-5d61-4793-b91f-3f68db07dca3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:48.159651 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:48.177544 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e62b8788-5d61-4793-b91f-3f68db07dca3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "POST /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265896 Jul 31 02:09:48.184179 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3448/6930] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 02:09:47 2022] POST /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:09:58.876262 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ee3eaf56-28ea-4fd0-a991-0ca2d6ddc9af tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:58.876780 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ee3eaf56-28ea-4fd0-a991-0ca2d6ddc9af tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:58.878923 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:58.879770 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:58.880557 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=64 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:58.887181 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee3eaf56-28ea-4fd0-a991-0ca2d6ddc9af tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:58.887755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee3eaf56-28ea-4fd0-a991-0ca2d6ddc9af tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:58.888649 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee3eaf56-28ea-4fd0-a991-0ca2d6ddc9af tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:58.889123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee3eaf56-28ea-4fd0-a991-0ca2d6ddc9af tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:58.972110 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-ee3eaf56-28ea-4fd0-a991-0ca2d6ddc9af tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lazy-loading 'services' on Instance uuid a383561f-bb96-4e9c-a514-7ae9074bcd94 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:09:59.042580 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ee3eaf56-28ea-4fd0-a991-0ca2d6ddc9af tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments/6cd2e5d4-1687-4e0d-885f-81466feefbb8" status: 202 len: 0 microversion: 2.1 time: 0.170314 Jul 31 02:09:59.043187 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3483/6931] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 02:09:58 2022] DELETE /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments/6cd2e5d4-1687-4e0d-885f-81466feefbb8 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:09:59.052405 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-49f11281-067a-4658-864e-882572be1547 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:09:59.054884 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-49f11281-067a-4658-864e-882572be1547 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:09:59.057865 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:09:59.064672 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49f11281-067a-4658-864e-882572be1547 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:59.065145 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49f11281-067a-4658-864e-882572be1547 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:59.065949 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49f11281-067a-4658-864e-882572be1547 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:09:59.066435 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49f11281-067a-4658-864e-882572be1547 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:09:59.100401 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-49f11281-067a-4658-864e-882572be1547 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051995 Jul 31 02:09:59.101086 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3449/6932] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:09:59 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:10:00.114427 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-31c11d65-74d1-40d9-bed5-1a12c76aab0b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:00.117532 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-31c11d65-74d1-40d9-bed5-1a12c76aab0b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:00.124213 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31c11d65-74d1-40d9-bed5-1a12c76aab0b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:00.124673 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31c11d65-74d1-40d9-bed5-1a12c76aab0b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:00.125556 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31c11d65-74d1-40d9-bed5-1a12c76aab0b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:00.126003 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-31c11d65-74d1-40d9-bed5-1a12c76aab0b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:00.158547 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-31c11d65-74d1-40d9-bed5-1a12c76aab0b tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049270 Jul 31 02:10:00.159455 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3484/6933] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:10:00 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:10:01.171637 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-84651425-1e9e-4a99-b472-b2f2091d5bd3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:01.174010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-84651425-1e9e-4a99-b472-b2f2091d5bd3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:01.181746 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-84651425-1e9e-4a99-b472-b2f2091d5bd3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:01.182212 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-84651425-1e9e-4a99-b472-b2f2091d5bd3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:01.183006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-84651425-1e9e-4a99-b472-b2f2091d5bd3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:01.183480 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-84651425-1e9e-4a99-b472-b2f2091d5bd3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:01.213775 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-84651425-1e9e-4a99-b472-b2f2091d5bd3 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046177 Jul 31 02:10:01.214336 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3450/6934] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:10:01 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:10:02.226004 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-07aaa633-cb18-43ec-b5e3-237e9a779ae7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:02.228115 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-07aaa633-cb18-43ec-b5e3-237e9a779ae7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:02.235079 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07aaa633-cb18-43ec-b5e3-237e9a779ae7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:02.235585 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07aaa633-cb18-43ec-b5e3-237e9a779ae7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:02.236371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07aaa633-cb18-43ec-b5e3-237e9a779ae7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:02.236823 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-07aaa633-cb18-43ec-b5e3-237e9a779ae7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:02.266603 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-07aaa633-cb18-43ec-b5e3-237e9a779ae7 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044748 Jul 31 02:10:02.267174 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3485/6935] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:10:02 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:10:03.278827 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dea01af9-0ed1-49a1-be43-24e7484e41df tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:03.281094 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dea01af9-0ed1-49a1-be43-24e7484e41df tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:03.288611 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dea01af9-0ed1-49a1-be43-24e7484e41df tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:03.289180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dea01af9-0ed1-49a1-be43-24e7484e41df tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:03.289976 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dea01af9-0ed1-49a1-be43-24e7484e41df tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:03.290421 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dea01af9-0ed1-49a1-be43-24e7484e41df tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:03.319363 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dea01af9-0ed1-49a1-be43-24e7484e41df tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044454 Jul 31 02:10:03.320132 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3451/6936] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:10:03 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:10:04.331655 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5d674da9-a34e-4184-99a3-20adb3189a28 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:04.334369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5d674da9-a34e-4184-99a3-20adb3189a28 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:04.341406 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d674da9-a34e-4184-99a3-20adb3189a28 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:04.341863 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d674da9-a34e-4184-99a3-20adb3189a28 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:04.342662 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d674da9-a34e-4184-99a3-20adb3189a28 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:04.343134 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d674da9-a34e-4184-99a3-20adb3189a28 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:04.372891 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5d674da9-a34e-4184-99a3-20adb3189a28 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045278 Jul 31 02:10:04.373457 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3486/6937] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:10:04 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 02:10:04.384476 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9d4518e7-d946-4917-88d5-3c1015c5f0d5 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:04.385108 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9d4518e7-d946-4917-88d5-3c1015c5f0d5 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:04.392055 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d4518e7-d946-4917-88d5-3c1015c5f0d5 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:04.392547 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d4518e7-d946-4917-88d5-3c1015c5f0d5 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:04.393326 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d4518e7-d946-4917-88d5-3c1015c5f0d5 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:04.393784 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9d4518e7-d946-4917-88d5-3c1015c5f0d5 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:04.468868 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-9d4518e7-d946-4917-88d5-3c1015c5f0d5 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] HTTP exception thrown: Instance a383561f-bb96-4e9c-a514-7ae9074bcd94 is not attached to volume 6cd2e5d4-1687-4e0d-885f-81466feefbb8 Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9d4518e7-d946-4917-88d5-3c1015c5f0d5 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Request method failure captured: Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments/6cd2e5d4-1687-4e0d-885f-81466feefbb8 HTTP/1.1 Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eQPn5O_C5ZaBUrq3cWaXwKlsVFXoH6_7MGmMPX-CxLike-3xVhRiDByBoyS6KXDo47rKKZ4peb82nhEoua_5b2gn_H4tjDZiF8U_8VfUxFl9A_V5ppeCkxfdOYofUCJ0WPmvGhmlTtgk7ErcR_6KySkNqW6B00rdz9ufcNKJ2cTWKU Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: a001c7a532534c2a8eec932478004235 Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a001c7a532534c2a8eec932478004235"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a001c7a532534c2a8eec932478004235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a001c7a532534c2a8eec932478004235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a001c7a532534c2a8eec932478004235", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: a001c7a532534c2a8eec932478004235 Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestEncryptedCinderVolumes-1289853719-project Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 9cfbede1b77a482ea259d9c2f5a6a353 Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestEncryptedCinderVolumes-1289853719-project Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: exception: Instance a383561f-bb96-4e9c-a514-7ae9074bcd94 is not attached to volume 6cd2e5d4-1687-4e0d-885f-81466feefbb8 Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: action_args: {'server_id': 'a383561f-bb96-4e9c-a514-7ae9074bcd94', 'id': '6cd2e5d4-1687-4e0d-885f-81466feefbb8'} Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6cd2e5d4-1687-4e0d-885f-81466feefbb8. Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a383561f-bb96-4e9c-a514-7ae9074bcd94 is not attached to volume 6cd2e5d4-1687-4e0d-885f-81466feefbb8 Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:10:04.470803 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:10:04.474203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:10:04.474203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:10:04.474203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a383561f-bb96-4e9c-a514-7ae9074bcd94 is not attached to volume 6cd2e5d4-1687-4e0d-885f-81466feefbb8 Jul 31 02:10:04.474203 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:10:04.474203 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9d4518e7-d946-4917-88d5-3c1015c5f0d5 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Returning 404 to user: Instance a383561f-bb96-4e9c-a514-7ae9074bcd94 is not attached to volume 6cd2e5d4-1687-4e0d-885f-81466feefbb8 {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:10:04.474203 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9d4518e7-d946-4917-88d5-3c1015c5f0d5 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments/6cd2e5d4-1687-4e0d-885f-81466feefbb8" status: 404 len: 154 microversion: 2.1 time: 0.092356 Jul 31 02:10:04.474203 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3452/6938] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 02:10:04 2022] DELETE /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94/os-volume_attachments/6cd2e5d4-1687-4e0d-885f-81466feefbb8 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:10:07.811849 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fe22afe2-7dbe-4c43-9585-ee7dbbfefb44 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:07.812455 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fe22afe2-7dbe-4c43-9585-ee7dbbfefb44 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:07.820467 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe22afe2-7dbe-4c43-9585-ee7dbbfefb44 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:07.820934 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe22afe2-7dbe-4c43-9585-ee7dbbfefb44 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:07.821733 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe22afe2-7dbe-4c43-9585-ee7dbbfefb44 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:07.822191 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fe22afe2-7dbe-4c43-9585-ee7dbbfefb44 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:07.849372 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fe22afe2-7dbe-4c43-9585-ee7dbbfefb44 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:10:07.930196 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fe22afe2-7dbe-4c43-9585-ee7dbbfefb44 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94" status: 204 len: 0 microversion: 2.1 time: 0.122310 Jul 31 02:10:07.931105 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3487/6939] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:10:07 2022] DELETE /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:10:07.939356 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-567d7699-2c2e-4aee-99a1-2b906d7a197e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:07.940018 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-567d7699-2c2e-4aee-99a1-2b906d7a197e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:07.947319 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-567d7699-2c2e-4aee-99a1-2b906d7a197e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:07.947827 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-567d7699-2c2e-4aee-99a1-2b906d7a197e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:07.948625 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-567d7699-2c2e-4aee-99a1-2b906d7a197e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:07.949089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-567d7699-2c2e-4aee-99a1-2b906d7a197e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:08.083470 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-567d7699-2c2e-4aee-99a1-2b906d7a197e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:08.098680 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-567d7699-2c2e-4aee-99a1-2b906d7a197e tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94" status: 200 len: 1558 microversion: 2.1 time: 0.163201 Jul 31 02:10:08.099380 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3453/6940] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:07 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:09.123974 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bbc08f63-7cca-45fe-87dd-4e810bb73f19 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:09.124608 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bbc08f63-7cca-45fe-87dd-4e810bb73f19 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:09.131501 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bbc08f63-7cca-45fe-87dd-4e810bb73f19 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:09.131959 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bbc08f63-7cca-45fe-87dd-4e810bb73f19 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:09.132858 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bbc08f63-7cca-45fe-87dd-4e810bb73f19 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:09.133477 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bbc08f63-7cca-45fe-87dd-4e810bb73f19 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:09.273269 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bbc08f63-7cca-45fe-87dd-4e810bb73f19 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:09.281131 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bbc08f63-7cca-45fe-87dd-4e810bb73f19 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94" status: 200 len: 1558 microversion: 2.1 time: 0.161590 Jul 31 02:10:09.281710 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3488/6941] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:09 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:10.204882 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-c4b6e789-8ec4-45dc-944b-4a1eac9b51b1 req-ead3ccb7-3135-4910-9f54-f4673e05714d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a383561f-bb96-4e9c-a514-7ae9074bcd94", "name": "network-vif-deleted", "tag": "5b75abf4-ed60-4939-acbe-2aec547b4c4c"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:10:10.216438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c4b6e789-8ec4-45dc-944b-4a1eac9b51b1 req-ead3ccb7-3135-4910-9f54-f4673e05714d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:10.216909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-c4b6e789-8ec4-45dc-944b-4a1eac9b51b1 req-ead3ccb7-3135-4910-9f54-f4673e05714d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:10.230132 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-c4b6e789-8ec4-45dc-944b-4a1eac9b51b1 req-ead3ccb7-3135-4910-9f54-f4673e05714d service nova] Creating event network-vif-deleted:5b75abf4-ed60-4939-acbe-2aec547b4c4c for instance a383561f-bb96-4e9c-a514-7ae9074bcd94 on n-h1-master-1 Jul 31 02:10:10.236231 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-c4b6e789-8ec4-45dc-944b-4a1eac9b51b1 req-ead3ccb7-3135-4910-9f54-f4673e05714d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104888 Jul 31 02:10:10.237117 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3454/6942] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:10:10.303376 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9e5ac554-4fe6-4a8c-9885-30385b31781c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:10.304012 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9e5ac554-4fe6-4a8c-9885-30385b31781c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:10.310944 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e5ac554-4fe6-4a8c-9885-30385b31781c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:10.311388 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e5ac554-4fe6-4a8c-9885-30385b31781c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:10.312168 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e5ac554-4fe6-4a8c-9885-30385b31781c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:10.312615 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e5ac554-4fe6-4a8c-9885-30385b31781c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:10.344126 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e5ac554-4fe6-4a8c-9885-30385b31781c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:10.344522 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e5ac554-4fe6-4a8c-9885-30385b31781c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:10.344986 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-9e5ac554-4fe6-4a8c-9885-30385b31781c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lazy-loading 'fault' on Instance uuid a383561f-bb96-4e9c-a514-7ae9074bcd94 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:10:10.386366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9e5ac554-4fe6-4a8c-9885-30385b31781c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cfbede1b77a482ea259d9c2f5a6a353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a001c7a532534c2a8eec932478004235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:10.393859 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9e5ac554-4fe6-4a8c-9885-30385b31781c tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94" status: 200 len: 1351 microversion: 2.1 time: 0.094938 Jul 31 02:10:10.394437 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3489/6943] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:10 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94 => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:11.415581 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ab7ef879-4965-4aba-96fb-370ce2bea1bf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:11.416305 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ab7ef879-4965-4aba-96fb-370ce2bea1bf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] [instance: a383561f-bb96-4e9c-a514-7ae9074bcd94] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:11.423542 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab7ef879-4965-4aba-96fb-370ce2bea1bf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:11.424018 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab7ef879-4965-4aba-96fb-370ce2bea1bf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:11.424802 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab7ef879-4965-4aba-96fb-370ce2bea1bf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:11.425261 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ab7ef879-4965-4aba-96fb-370ce2bea1bf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:11.438337 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-ab7ef879-4965-4aba-96fb-370ce2bea1bf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] HTTP exception thrown: Instance a383561f-bb96-4e9c-a514-7ae9074bcd94 could not be found. Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ab7ef879-4965-4aba-96fb-370ce2bea1bf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Request method failure captured: Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94 HTTP/1.1 Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eQPn5O_C5ZaBUrq3cWaXwKlsVFXoH6_7MGmMPX-CxLike-3xVhRiDByBoyS6KXDo47rKKZ4peb82nhEoua_5b2gn_H4tjDZiF8U_8VfUxFl9A_V5ppeCkxfdOYofUCJ0WPmvGhmlTtgk7ErcR_6KySkNqW6B00rdz9ufcNKJ2cTWKU Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: a001c7a532534c2a8eec932478004235 Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a001c7a532534c2a8eec932478004235"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a001c7a532534c2a8eec932478004235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a001c7a532534c2a8eec932478004235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a001c7a532534c2a8eec932478004235", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: a001c7a532534c2a8eec932478004235 Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1289853719 Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestEncryptedCinderVolumes-1289853719-project Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 9cfbede1b77a482ea259d9c2f5a6a353 Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestEncryptedCinderVolumes-1289853719-project Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: exception: Instance a383561f-bb96-4e9c-a514-7ae9074bcd94 could not be found. Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'a383561f-bb96-4e9c-a514-7ae9074bcd94'} Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a383561f-bb96-4e9c-a514-7ae9074bcd94 could not be found. Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a383561f-bb96-4e9c-a514-7ae9074bcd94 could not be found. Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:10:11.439988 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:10:11.446204 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:10:11.446204 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:10:11.446204 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:10:11.446204 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:10:11.446204 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:10:11.446204 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a383561f-bb96-4e9c-a514-7ae9074bcd94 could not be found. Jul 31 02:10:11.446204 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:10:11.446204 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ab7ef879-4965-4aba-96fb-370ce2bea1bf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Returning 404 to user: Instance a383561f-bb96-4e9c-a514-7ae9074bcd94 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:10:11.446204 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ab7ef879-4965-4aba-96fb-370ce2bea1bf tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94" status: 404 len: 111 microversion: 2.1 time: 0.030206 Jul 31 02:10:11.446204 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3455/6944] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:11 2022] GET /compute/v2.1/servers/a383561f-bb96-4e9c-a514-7ae9074bcd94 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:10:11.452066 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d5fd459c-32b8-4620-af94-f35b0b4e74e6 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] Calling method '.version_select at 0x7fede5759b80>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:11.473398 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d5fd459c-32b8-4620-af94-f35b0b4e74e6 tempest-TestEncryptedCinderVolumes-1289853719 tempest-TestEncryptedCinderVolumes-1289853719-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-868042871" status: 202 len: 0 microversion: 2.1 time: 0.025275 Jul 31 02:10:11.473982 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3490/6945] 10.222.0.45 () {58 vars in 1275 bytes} [Sun Jul 31 02:10:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-868042871 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:10:37.246591 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fb74c054-f139-4733-bdda-27d194cb982a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Action: 'create', calling method: .version_select at 0x7fede567ba60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1332414191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGp+2mkGPWbw/vvWV60D9OklwmExPAXMvHovLQeIUfbCSyuECsj7R8I9qz89ky6FMFzrTi0KoHUadXcxDCbmUXVazpvw7Jnkpqv531HiE8xu+uoafT02xEzSPaSjKRqO+Q=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:10:37.252395 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=14 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:10:37.253062 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:10:37.266106 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-fb74c054-f139-4733-bdda-27d194cb982a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Getting quotas for project 8d5d5e2f24ed48ffa0d75192e744bfe1. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:10:37.271241 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-fb74c054-f139-4733-bdda-27d194cb982a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Getting quotas for user 964a6df6b450426da030f2519fe9a62f and project 8d5d5e2f24ed48ffa0d75192e744bfe1. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:10:37.300336 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fb74c054-f139-4733-bdda-27d194cb982a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057839 Jul 31 02:10:37.300961 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3456/6946] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 02:10:37 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:10:37.350439 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:10:37.351204 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:10:37.355586 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2b8d09e6-e700-4471-92b7-47576e97c037 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1521104874", "imageRef": "2144633e-b546-40ed-b345-8bd1a7d45ccb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1332414191", "networks": [{"uuid": "8e17e83d-e5d1-49bb-991d-8b8435666b65"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:10:37.409850 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-2b8d09e6-e700-4471-92b7-47576e97c037 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] validate_networks() for [('8e17e83d-e5d1-49bb-991d-8b8435666b65', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:10:38.171694 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-2b8d09e6-e700-4471-92b7-47576e97c037 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:10:38.172144 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-2b8d09e6-e700-4471-92b7-47576e97c037 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:10:38.172648 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-2b8d09e6-e700-4471-92b7-47576e97c037 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:10:38.173095 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-2b8d09e6-e700-4471-92b7-47576e97c037 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:10:38.173520 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-2b8d09e6-e700-4471-92b7-47576e97c037 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:10:38.182349 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b8d09e6-e700-4471-92b7-47576e97c037 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:38.182811 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b8d09e6-e700-4471-92b7-47576e97c037 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:38.183656 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b8d09e6-e700-4471-92b7-47576e97c037 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:38.184107 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2b8d09e6-e700-4471-92b7-47576e97c037 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:38.204979 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-2b8d09e6-e700-4471-92b7-47576e97c037 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Getting quotas for project 8d5d5e2f24ed48ffa0d75192e744bfe1. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:10:38.210907 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-2b8d09e6-e700-4471-92b7-47576e97c037 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Getting quotas for user 964a6df6b450426da030f2519fe9a62f and project 8d5d5e2f24ed48ffa0d75192e744bfe1. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:10:38.223070 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2b8d09e6-e700-4471-92b7-47576e97c037 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:10:38.225242 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2b8d09e6-e700-4471-92b7-47576e97c037 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2144633e-b546-40ed-b345-8bd1a7d45ccb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:10:38.271635 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2b8d09e6-e700-4471-92b7-47576e97c037 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.922832 Jul 31 02:10:38.272482 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3491/6947] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:10:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:10:38.284089 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ea4a9714-32c5-4352-a2ac-b3a3e45ff993 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:38.284812 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ea4a9714-32c5-4352-a2ac-b3a3e45ff993 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:38.340712 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ea4a9714-32c5-4352-a2ac-b3a3e45ff993 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:38.347714 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ea4a9714-32c5-4352-a2ac-b3a3e45ff993 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1259 microversion: 2.1 time: 0.068604 Jul 31 02:10:38.348294 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3457/6948] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:38 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:39.369993 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b55d7bed-9e8d-4b2a-90b7-e8e55fa0afc4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:39.371255 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b55d7bed-9e8d-4b2a-90b7-e8e55fa0afc4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:39.377897 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b55d7bed-9e8d-4b2a-90b7-e8e55fa0afc4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:39.378729 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b55d7bed-9e8d-4b2a-90b7-e8e55fa0afc4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:39.379801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b55d7bed-9e8d-4b2a-90b7-e8e55fa0afc4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:39.380470 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b55d7bed-9e8d-4b2a-90b7-e8e55fa0afc4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:39.464282 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b55d7bed-9e8d-4b2a-90b7-e8e55fa0afc4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:39.471854 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b55d7bed-9e8d-4b2a-90b7-e8e55fa0afc4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1317 microversion: 2.1 time: 0.106880 Jul 31 02:10:39.472660 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3492/6949] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:39 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1317 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:40.495479 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cf80d779-1b96-4d26-97ca-c3a7ad363427 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:40.496178 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cf80d779-1b96-4d26-97ca-c3a7ad363427 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:40.503773 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf80d779-1b96-4d26-97ca-c3a7ad363427 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:40.504249 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf80d779-1b96-4d26-97ca-c3a7ad363427 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:40.505580 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf80d779-1b96-4d26-97ca-c3a7ad363427 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:40.506028 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cf80d779-1b96-4d26-97ca-c3a7ad363427 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:40.645657 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cf80d779-1b96-4d26-97ca-c3a7ad363427 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:40.654196 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cf80d779-1b96-4d26-97ca-c3a7ad363427 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1359 microversion: 2.1 time: 0.163272 Jul 31 02:10:40.654871 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3458/6950] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:40 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:41.675963 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bff96b65-5fd1-48e3-834c-15422367c9ce tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:41.676627 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bff96b65-5fd1-48e3-834c-15422367c9ce tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:41.684008 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bff96b65-5fd1-48e3-834c-15422367c9ce tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:41.684717 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bff96b65-5fd1-48e3-834c-15422367c9ce tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:41.685517 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bff96b65-5fd1-48e3-834c-15422367c9ce tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:41.685969 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bff96b65-5fd1-48e3-834c-15422367c9ce tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:41.832901 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bff96b65-5fd1-48e3-834c-15422367c9ce tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:41.841502 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bff96b65-5fd1-48e3-834c-15422367c9ce tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1359 microversion: 2.1 time: 0.169652 Jul 31 02:10:41.842170 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3493/6951] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:41 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:42.864059 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8a2ff2bd-78af-4135-a402-a3bf8f3bb71c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:42.865265 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8a2ff2bd-78af-4135-a402-a3bf8f3bb71c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:42.872581 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8a2ff2bd-78af-4135-a402-a3bf8f3bb71c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:42.873053 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8a2ff2bd-78af-4135-a402-a3bf8f3bb71c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:42.873829 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8a2ff2bd-78af-4135-a402-a3bf8f3bb71c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:42.874288 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8a2ff2bd-78af-4135-a402-a3bf8f3bb71c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:43.012283 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8a2ff2bd-78af-4135-a402-a3bf8f3bb71c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:43.020328 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8a2ff2bd-78af-4135-a402-a3bf8f3bb71c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1359 microversion: 2.1 time: 0.160216 Jul 31 02:10:43.021682 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3459/6952] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:42 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:44.042893 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6b0cec93-4ec5-4c55-a385-5cc7c72ef133 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:44.043551 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6b0cec93-4ec5-4c55-a385-5cc7c72ef133 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:44.051619 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b0cec93-4ec5-4c55-a385-5cc7c72ef133 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:44.052525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b0cec93-4ec5-4c55-a385-5cc7c72ef133 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:44.053312 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b0cec93-4ec5-4c55-a385-5cc7c72ef133 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:44.053756 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6b0cec93-4ec5-4c55-a385-5cc7c72ef133 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:44.205922 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6b0cec93-4ec5-4c55-a385-5cc7c72ef133 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:44.214271 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6b0cec93-4ec5-4c55-a385-5cc7c72ef133 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1359 microversion: 2.1 time: 0.175747 Jul 31 02:10:44.215914 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3494/6953] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:44 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:45.238526 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f2441f38-e46b-47ea-81fc-7c86ee8ca690 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:45.240188 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f2441f38-e46b-47ea-81fc-7c86ee8ca690 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:45.248979 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f2441f38-e46b-47ea-81fc-7c86ee8ca690 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:45.249539 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f2441f38-e46b-47ea-81fc-7c86ee8ca690 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:45.250420 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f2441f38-e46b-47ea-81fc-7c86ee8ca690 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:45.250881 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f2441f38-e46b-47ea-81fc-7c86ee8ca690 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:45.393176 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f2441f38-e46b-47ea-81fc-7c86ee8ca690 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:45.402503 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f2441f38-e46b-47ea-81fc-7c86ee8ca690 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1359 microversion: 2.1 time: 0.169846 Jul 31 02:10:45.403444 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3460/6954] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:45 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:46.423732 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0775b756-2e8d-453d-99be-35af5133acda tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:46.424360 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0775b756-2e8d-453d-99be-35af5133acda tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:46.448707 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0775b756-2e8d-453d-99be-35af5133acda tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:46.449098 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0775b756-2e8d-453d-99be-35af5133acda tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:46.450424 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0775b756-2e8d-453d-99be-35af5133acda tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:46.451272 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0775b756-2e8d-453d-99be-35af5133acda tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:46.689009 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0775b756-2e8d-453d-99be-35af5133acda tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:46.700201 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0775b756-2e8d-453d-99be-35af5133acda tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1359 microversion: 2.1 time: 0.279991 Jul 31 02:10:46.706956 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3495/6955] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:46 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1359 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:47.722165 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-db78cc87-5628-472d-a6f4-fd0be43ff706 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:47.722821 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-db78cc87-5628-472d-a6f4-fd0be43ff706 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:47.729812 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db78cc87-5628-472d-a6f4-fd0be43ff706 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:47.730256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db78cc87-5628-472d-a6f4-fd0be43ff706 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:47.731032 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db78cc87-5628-472d-a6f4-fd0be43ff706 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:47.732098 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-db78cc87-5628-472d-a6f4-fd0be43ff706 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:47.962539 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-db78cc87-5628-472d-a6f4-fd0be43ff706 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:47.970317 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-db78cc87-5628-472d-a6f4-fd0be43ff706 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1359 microversion: 2.1 time: 0.252036 Jul 31 02:10:47.970830 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3461/6956] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:47 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:48.036701 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-e10eabca-e16f-49b2-968c-497964ca2c78 req-a84c8972-46d9-43c6-81e1-2b4b7eedf106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e4c701-8593-4309-bf65-a4dd21ba029a", "tag": "54ea4cf8-88e7-4c1e-a057-53d2b535bcb5"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:10:48.048327 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e10eabca-e16f-49b2-968c-497964ca2c78 req-a84c8972-46d9-43c6-81e1-2b4b7eedf106 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:48.049059 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-e10eabca-e16f-49b2-968c-497964ca2c78 req-a84c8972-46d9-43c6-81e1-2b4b7eedf106 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:48.060974 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-e10eabca-e16f-49b2-968c-497964ca2c78 req-a84c8972-46d9-43c6-81e1-2b4b7eedf106 service nova] Creating event network-changed:54ea4cf8-88e7-4c1e-a057-53d2b535bcb5 for instance 24e4c701-8593-4309-bf65-a4dd21ba029a on n-h2-master-1 Jul 31 02:10:48.065961 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-e10eabca-e16f-49b2-968c-497964ca2c78 req-a84c8972-46d9-43c6-81e1-2b4b7eedf106 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033770 Jul 31 02:10:48.066602 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3496/6957] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:10:48.992483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-46dc1bb8-9496-46ad-86bc-a245f7adeac6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:48.993031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-46dc1bb8-9496-46ad-86bc-a245f7adeac6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:48.995332 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:10:49.001625 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46dc1bb8-9496-46ad-86bc-a245f7adeac6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:49.002100 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46dc1bb8-9496-46ad-86bc-a245f7adeac6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:49.002887 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46dc1bb8-9496-46ad-86bc-a245f7adeac6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:49.003355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-46dc1bb8-9496-46ad-86bc-a245f7adeac6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:49.136397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-46dc1bb8-9496-46ad-86bc-a245f7adeac6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:49.143912 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-46dc1bb8-9496-46ad-86bc-a245f7adeac6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1359 microversion: 2.1 time: 0.156070 Jul 31 02:10:49.144485 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3462/6958] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:48 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:50.163197 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:10:50.163949 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:10:50.169364 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0d087e0a-2776-4c31-85cb-df0f42affcf6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:50.170095 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0d087e0a-2776-4c31-85cb-df0f42affcf6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:50.177259 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d087e0a-2776-4c31-85cb-df0f42affcf6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:50.178317 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d087e0a-2776-4c31-85cb-df0f42affcf6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:50.179102 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d087e0a-2776-4c31-85cb-df0f42affcf6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:50.179582 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d087e0a-2776-4c31-85cb-df0f42affcf6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:50.309040 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0d087e0a-2776-4c31-85cb-df0f42affcf6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:50.316624 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0d087e0a-2776-4c31-85cb-df0f42affcf6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1359 microversion: 2.1 time: 0.154993 Jul 31 02:10:50.317205 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3497/6959] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:50 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:51.337726 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7870865a-2d84-452a-a13a-88b1425ca69b tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:51.338355 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7870865a-2d84-452a-a13a-88b1425ca69b tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:51.345400 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7870865a-2d84-452a-a13a-88b1425ca69b tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:51.345868 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7870865a-2d84-452a-a13a-88b1425ca69b tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:51.346654 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7870865a-2d84-452a-a13a-88b1425ca69b tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:51.347109 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7870865a-2d84-452a-a13a-88b1425ca69b tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:51.481597 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7870865a-2d84-452a-a13a-88b1425ca69b tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:51.489152 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7870865a-2d84-452a-a13a-88b1425ca69b tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1359 microversion: 2.1 time: 0.155480 Jul 31 02:10:51.489714 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3463/6960] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:51 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:52.510083 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-709575f9-445e-49ca-bdda-a41d8bfcad76 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:52.510713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-709575f9-445e-49ca-bdda-a41d8bfcad76 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:52.517192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-709575f9-445e-49ca-bdda-a41d8bfcad76 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:52.517657 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-709575f9-445e-49ca-bdda-a41d8bfcad76 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:52.518431 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-709575f9-445e-49ca-bdda-a41d8bfcad76 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:52.518885 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-709575f9-445e-49ca-bdda-a41d8bfcad76 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:52.649944 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-709575f9-445e-49ca-bdda-a41d8bfcad76 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:52.657376 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-709575f9-445e-49ca-bdda-a41d8bfcad76 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1359 microversion: 2.1 time: 0.151222 Jul 31 02:10:52.657958 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3498/6961] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:52 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:53.356713 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-302f5750-71f7-4040-8249-3f978801f6be req-986bdc74-6d50-44b3-b2c1-d8446712cfab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e4c701-8593-4309-bf65-a4dd21ba029a", "name": "network-vif-plugged", "status": "completed", "tag": "54ea4cf8-88e7-4c1e-a057-53d2b535bcb5"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:10:53.366116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-302f5750-71f7-4040-8249-3f978801f6be req-986bdc74-6d50-44b3-b2c1-d8446712cfab service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:53.366569 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-302f5750-71f7-4040-8249-3f978801f6be req-986bdc74-6d50-44b3-b2c1-d8446712cfab service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:53.378305 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-302f5750-71f7-4040-8249-3f978801f6be req-986bdc74-6d50-44b3-b2c1-d8446712cfab service nova] Creating event network-vif-plugged:54ea4cf8-88e7-4c1e-a057-53d2b535bcb5 for instance 24e4c701-8593-4309-bf65-a4dd21ba029a on n-h2-master-1 Jul 31 02:10:53.384710 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-302f5750-71f7-4040-8249-3f978801f6be req-986bdc74-6d50-44b3-b2c1-d8446712cfab service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154984 Jul 31 02:10:53.385577 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3464/6962] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:10:53.678650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d0366e50-5a45-46a9-afcf-38dedbcdf19b tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:53.679207 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d0366e50-5a45-46a9-afcf-38dedbcdf19b tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:53.686057 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d0366e50-5a45-46a9-afcf-38dedbcdf19b tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:53.686512 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d0366e50-5a45-46a9-afcf-38dedbcdf19b tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:53.687291 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d0366e50-5a45-46a9-afcf-38dedbcdf19b tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:53.687768 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d0366e50-5a45-46a9-afcf-38dedbcdf19b tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:53.820250 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d0366e50-5a45-46a9-afcf-38dedbcdf19b tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:53.830307 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d0366e50-5a45-46a9-afcf-38dedbcdf19b tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1359 microversion: 2.1 time: 0.155775 Jul 31 02:10:53.831381 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3499/6963] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:53 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:54.854337 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-042566c5-9d89-4c75-8e17-cbf1cd4b9e05 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:54.855063 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-042566c5-9d89-4c75-8e17-cbf1cd4b9e05 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:54.861416 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-042566c5-9d89-4c75-8e17-cbf1cd4b9e05 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:54.861887 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-042566c5-9d89-4c75-8e17-cbf1cd4b9e05 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:54.862668 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-042566c5-9d89-4c75-8e17-cbf1cd4b9e05 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:54.863127 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-042566c5-9d89-4c75-8e17-cbf1cd4b9e05 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:54.995286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-042566c5-9d89-4c75-8e17-cbf1cd4b9e05 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:55.002811 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-042566c5-9d89-4c75-8e17-cbf1cd4b9e05 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1550 microversion: 2.1 time: 0.154142 Jul 31 02:10:55.003390 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3465/6964] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:54 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:55.023570 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1b994fd5-d61b-46df-9327-90a40cef0b70 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:55.024198 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1b994fd5-d61b-46df-9327-90a40cef0b70 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:55.030981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b994fd5-d61b-46df-9327-90a40cef0b70 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:55.031472 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b994fd5-d61b-46df-9327-90a40cef0b70 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:55.032239 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b994fd5-d61b-46df-9327-90a40cef0b70 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:55.032678 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1b994fd5-d61b-46df-9327-90a40cef0b70 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:55.162307 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1b994fd5-d61b-46df-9327-90a40cef0b70 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:55.170437 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1b994fd5-d61b-46df-9327-90a40cef0b70 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1550 microversion: 2.1 time: 0.151304 Jul 31 02:10:55.171030 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3500/6965] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:55 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1550 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:55.190127 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-48263c6b-3148-4c34-a4f8-d54719f848b5 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:55.194812 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-48263c6b-3148-4c34-a4f8-d54719f848b5 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:55.195647 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-48263c6b-3148-4c34-a4f8-d54719f848b5 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Searching by: {'deleted': False, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 02:10:55.201017 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48263c6b-3148-4c34-a4f8-d54719f848b5 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:55.201479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48263c6b-3148-4c34-a4f8-d54719f848b5 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:55.202282 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48263c6b-3148-4c34-a4f8-d54719f848b5 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:55.202737 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-48263c6b-3148-4c34-a4f8-d54719f848b5 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:55.226644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-48263c6b-3148-4c34-a4f8-d54719f848b5 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 02:10:55.252879 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-48263c6b-3148-4c34-a4f8-d54719f848b5 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.066560 Jul 31 02:10:55.253451 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3466/6966] 10.222.0.45 () {58 vars in 1125 bytes} [Sun Jul 31 02:10:55 2022] GET /compute/v2.1/servers => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:10:55.264599 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f334879a-9664-4b8b-b7ae-e9789d1e5829 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:10:55.265223 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f334879a-9664-4b8b-b7ae-e9789d1e5829 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:55.271160 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f334879a-9664-4b8b-b7ae-e9789d1e5829 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:55.271655 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f334879a-9664-4b8b-b7ae-e9789d1e5829 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:55.272929 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f334879a-9664-4b8b-b7ae-e9789d1e5829 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:55.273368 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f334879a-9664-4b8b-b7ae-e9789d1e5829 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:55.402540 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f334879a-9664-4b8b-b7ae-e9789d1e5829 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:10:55.410165 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f334879a-9664-4b8b-b7ae-e9789d1e5829 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1550 microversion: 2.1 time: 0.149454 Jul 31 02:10:55.410752 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3501/6967] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:10:55 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:10:56.945584 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ce04381-3eda-4ff5-9c5c-2ce7f7c1e504 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f93f5195-4755-4747-b102-f0c90bea3b36"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:10:56.948064 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0ce04381-3eda-4ff5-9c5c-2ce7f7c1e504 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:10:56.954958 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ce04381-3eda-4ff5-9c5c-2ce7f7c1e504 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:56.955466 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ce04381-3eda-4ff5-9c5c-2ce7f7c1e504 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:56.956246 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ce04381-3eda-4ff5-9c5c-2ce7f7c1e504 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:10:56.956700 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ce04381-3eda-4ff5-9c5c-2ce7f7c1e504 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:10:57.205687 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0ce04381-3eda-4ff5-9c5c-2ce7f7c1e504 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "POST /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264037 Jul 31 02:10:57.206510 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3467/6968] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 02:10:56 2022] POST /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:11:10.381904 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-576cbf73-937b-4e51-b5e8-af8363620a01 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:11:10.382566 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-576cbf73-937b-4e51-b5e8-af8363620a01 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:11:10.385434 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:11:10.386089 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=58 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:11:10.391988 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-576cbf73-937b-4e51-b5e8-af8363620a01 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:11:10.392450 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-576cbf73-937b-4e51-b5e8-af8363620a01 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:11:10.393220 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-576cbf73-937b-4e51-b5e8-af8363620a01 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:11:10.393662 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-576cbf73-937b-4e51-b5e8-af8363620a01 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:11:10.524824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-576cbf73-937b-4e51-b5e8-af8363620a01 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:11:10.532785 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-576cbf73-937b-4e51-b5e8-af8363620a01 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1596 microversion: 2.1 time: 0.154708 Jul 31 02:11:10.533360 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3502/6969] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:11:10 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1596 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:11:12.458915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-cd94e113-58b1-4885-a8a7-a0481c952fb6 req-2be297b0-901d-4948-877b-accec825caf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e4c701-8593-4309-bf65-a4dd21ba029a", "tag": "54ea4cf8-88e7-4c1e-a057-53d2b535bcb5"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:11:12.469693 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:11:12.471256 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:11:12.472407 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:11:12.475503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-cd94e113-58b1-4885-a8a7-a0481c952fb6 req-2be297b0-901d-4948-877b-accec825caf8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:11:12.476078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-cd94e113-58b1-4885-a8a7-a0481c952fb6 req-2be297b0-901d-4948-877b-accec825caf8 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:11:12.493672 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-cd94e113-58b1-4885-a8a7-a0481c952fb6 req-2be297b0-901d-4948-877b-accec825caf8 service nova] Creating event network-changed:54ea4cf8-88e7-4c1e-a057-53d2b535bcb5 for instance 24e4c701-8593-4309-bf65-a4dd21ba029a on n-h2-master-1 Jul 31 02:11:12.499619 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-cd94e113-58b1-4885-a8a7-a0481c952fb6 req-2be297b0-901d-4948-877b-accec825caf8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044749 Jul 31 02:11:12.500248 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3468/6970] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:11:13.579014 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-544abd42-52a1-424a-bbec-a9395acf9b08 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-743145702"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:11:13.579609 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-544abd42-52a1-424a-bbec-a9395acf9b08 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:11:13.587239 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-544abd42-52a1-424a-bbec-a9395acf9b08 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:11:13.587548 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-544abd42-52a1-424a-bbec-a9395acf9b08 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:11:13.588337 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-544abd42-52a1-424a-bbec-a9395acf9b08 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:11:13.588786 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-544abd42-52a1-424a-bbec-a9395acf9b08 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:11:13.716627 n-d-master-1 devstack@n-api.service[119475]: INFO nova.network.security_group_api [None req-544abd42-52a1-424a-bbec-a9395acf9b08 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Adding security group 7967f635-3201-48c2-bd23-d9dc4ef36b56 to port 54ea4cf8-88e7-4c1e-a057-53d2b535bcb5 Jul 31 02:11:14.030102 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-544abd42-52a1-424a-bbec-a9395acf9b08 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "POST /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/action" status: 202 len: 0 microversion: 2.1 time: 0.455065 Jul 31 02:11:14.030743 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3503/6971] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:11:13 2022] POST /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:11:14.041269 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-81634dd3-a513-4ecc-8bc5-adf1068f5568 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:11:14.041992 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-81634dd3-a513-4ecc-8bc5-adf1068f5568 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:11:14.048883 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81634dd3-a513-4ecc-8bc5-adf1068f5568 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:11:14.049357 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81634dd3-a513-4ecc-8bc5-adf1068f5568 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:11:14.050161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81634dd3-a513-4ecc-8bc5-adf1068f5568 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:11:14.050622 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-81634dd3-a513-4ecc-8bc5-adf1068f5568 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:11:14.205601 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-81634dd3-a513-4ecc-8bc5-adf1068f5568 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:11:14.214798 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-81634dd3-a513-4ecc-8bc5-adf1068f5568 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1761 microversion: 2.1 time: 0.179658 Jul 31 02:11:14.215394 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3469/6972] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:11:14 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1761 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:11:14.515824 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-7379a7cd-45eb-4faf-8bb9-e80bb3981ad0 req-9aaf1fb2-1f25-42b2-bc68-3734cfa52716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e4c701-8593-4309-bf65-a4dd21ba029a", "tag": "54ea4cf8-88e7-4c1e-a057-53d2b535bcb5"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:11:14.526170 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7379a7cd-45eb-4faf-8bb9-e80bb3981ad0 req-9aaf1fb2-1f25-42b2-bc68-3734cfa52716 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:11:14.526719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7379a7cd-45eb-4faf-8bb9-e80bb3981ad0 req-9aaf1fb2-1f25-42b2-bc68-3734cfa52716 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:11:14.538183 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-7379a7cd-45eb-4faf-8bb9-e80bb3981ad0 req-9aaf1fb2-1f25-42b2-bc68-3734cfa52716 service nova] Creating event network-changed:54ea4cf8-88e7-4c1e-a057-53d2b535bcb5 for instance 24e4c701-8593-4309-bf65-a4dd21ba029a on n-h2-master-1 Jul 31 02:11:14.543993 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-7379a7cd-45eb-4faf-8bb9-e80bb3981ad0 req-9aaf1fb2-1f25-42b2-bc68-3734cfa52716 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031771 Jul 31 02:11:14.544608 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3504/6973] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:12:39.113213 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:12:39.113890 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 02:12:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:12:39.114412 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:12:39.114523 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 02:12:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:12:39.396383 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:12:39.396889 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 02:12:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:12:52.097748 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:12:52.098540 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=8 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:12:52.102573 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b62901c6-1c4a-45c3-9458-1de2a8218246 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:12:52.104911 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b62901c6-1c4a-45c3-9458-1de2a8218246 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:12:52.111717 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b62901c6-1c4a-45c3-9458-1de2a8218246 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:12:52.112187 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b62901c6-1c4a-45c3-9458-1de2a8218246 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:12:52.112968 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b62901c6-1c4a-45c3-9458-1de2a8218246 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:12:52.113426 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b62901c6-1c4a-45c3-9458-1de2a8218246 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:12:52.186446 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b62901c6-1c4a-45c3-9458-1de2a8218246 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "POST /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/action" status: 202 len: 0 microversion: 2.1 time: 0.090228 Jul 31 02:12:52.186999 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3470/6974] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:12:52 2022] POST /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:12:52.193923 n-d-master-1 devstack@n-api.service[119475]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ce818dc8-5b17-41f1-bd07-761ee808087c] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 31 02:12:52.194530 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:12:52.195465 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=12 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:12:52.200132 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c13751da-7876-4e96-958a-65fb6977cf0d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:12:52.200852 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c13751da-7876-4e96-958a-65fb6977cf0d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:12:52.208612 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c13751da-7876-4e96-958a-65fb6977cf0d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:12:52.209072 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c13751da-7876-4e96-958a-65fb6977cf0d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:12:52.209853 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c13751da-7876-4e96-958a-65fb6977cf0d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:12:52.210300 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c13751da-7876-4e96-958a-65fb6977cf0d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:12:52.446254 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c13751da-7876-4e96-958a-65fb6977cf0d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:12:52.454395 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c13751da-7876-4e96-958a-65fb6977cf0d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1763 microversion: 2.1 time: 0.262879 Jul 31 02:12:52.454971 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3505/6975] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:12:52 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1763 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:12:53.478106 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2e251ab6-3819-4730-8a5e-e767a2a61b22 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:12:53.478819 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2e251ab6-3819-4730-8a5e-e767a2a61b22 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:12:53.485056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e251ab6-3819-4730-8a5e-e767a2a61b22 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:12:53.485523 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e251ab6-3819-4730-8a5e-e767a2a61b22 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:12:53.486296 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e251ab6-3819-4730-8a5e-e767a2a61b22 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:12:53.486747 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e251ab6-3819-4730-8a5e-e767a2a61b22 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:12:53.634926 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2e251ab6-3819-4730-8a5e-e767a2a61b22 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:12:53.642956 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2e251ab6-3819-4730-8a5e-e767a2a61b22 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1761 microversion: 2.1 time: 0.171160 Jul 31 02:12:53.643540 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3471/6976] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:12:53 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1761 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:07.166695 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:07.167661 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:07.172067 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f484ecab-2e93-478e-91ca-5de2cbabf0bc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-743145702"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:14:07.173115 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f484ecab-2e93-478e-91ca-5de2cbabf0bc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:07.180890 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f484ecab-2e93-478e-91ca-5de2cbabf0bc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:07.181372 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f484ecab-2e93-478e-91ca-5de2cbabf0bc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:07.182135 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f484ecab-2e93-478e-91ca-5de2cbabf0bc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:07.182586 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f484ecab-2e93-478e-91ca-5de2cbabf0bc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:07.187611 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] [ce818dc8-5b17-41f1-bd07-761ee808087c] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 38854. Jul 31 02:14:07.312339 n-d-master-1 devstack@n-api.service[119475]: INFO nova.network.security_group_api [None req-f484ecab-2e93-478e-91ca-5de2cbabf0bc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Removing security group 7967f635-3201-48c2-bd23-d9dc4ef36b56 from port 54ea4cf8-88e7-4c1e-a057-53d2b535bcb5 Jul 31 02:14:07.618631 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f484ecab-2e93-478e-91ca-5de2cbabf0bc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "POST /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/action" status: 202 len: 0 microversion: 2.1 time: 0.454019 Jul 31 02:14:07.619209 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3506/6977] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:14:07 2022] POST /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:14:07.629583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-bf58eca8-b29b-40ac-84d2-6fb0b84690c3 req-05dec33a-ae4d-4640-a0e4-d585240c1397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e4c701-8593-4309-bf65-a4dd21ba029a", "tag": "54ea4cf8-88e7-4c1e-a057-53d2b535bcb5"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:14:07.653088 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:07.653813 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:07.660466 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-bf58eca8-b29b-40ac-84d2-6fb0b84690c3 req-05dec33a-ae4d-4640-a0e4-d585240c1397 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:07.660822 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-bf58eca8-b29b-40ac-84d2-6fb0b84690c3 req-05dec33a-ae4d-4640-a0e4-d585240c1397 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:07.692317 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-bf58eca8-b29b-40ac-84d2-6fb0b84690c3 req-05dec33a-ae4d-4640-a0e4-d585240c1397 service nova] Creating event network-changed:54ea4cf8-88e7-4c1e-a057-53d2b535bcb5 for instance 24e4c701-8593-4309-bf65-a4dd21ba029a on n-h2-master-1 Jul 31 02:14:07.707905 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-bf58eca8-b29b-40ac-84d2-6fb0b84690c3 req-05dec33a-ae4d-4640-a0e4-d585240c1397 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084317 Jul 31 02:14:07.708520 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3472/6978] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:14:09.026948 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6db5658d-6f5b-41ea-a17c-e3023e2c7437 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:09.027559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6db5658d-6f5b-41ea-a17c-e3023e2c7437 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:09.035364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6db5658d-6f5b-41ea-a17c-e3023e2c7437 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:09.035928 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6db5658d-6f5b-41ea-a17c-e3023e2c7437 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:09.036819 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6db5658d-6f5b-41ea-a17c-e3023e2c7437 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:09.037343 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6db5658d-6f5b-41ea-a17c-e3023e2c7437 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:09.114975 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7c14b761-5435-47f1-84dc-5effa740f46c req-94d53a6e-ec12-4c57-89ea-1863a57f4e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e4c701-8593-4309-bf65-a4dd21ba029a", "tag": "54ea4cf8-88e7-4c1e-a057-53d2b535bcb5"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:14:09.125119 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7c14b761-5435-47f1-84dc-5effa740f46c req-94d53a6e-ec12-4c57-89ea-1863a57f4e21 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:09.125616 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7c14b761-5435-47f1-84dc-5effa740f46c req-94d53a6e-ec12-4c57-89ea-1863a57f4e21 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:09.133101 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-6db5658d-6f5b-41ea-a17c-e3023e2c7437 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lazy-loading 'services' on Instance uuid 24e4c701-8593-4309-bf65-a4dd21ba029a {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:14:09.137039 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7c14b761-5435-47f1-84dc-5effa740f46c req-94d53a6e-ec12-4c57-89ea-1863a57f4e21 service nova] Creating event network-changed:54ea4cf8-88e7-4c1e-a057-53d2b535bcb5 for instance 24e4c701-8593-4309-bf65-a4dd21ba029a on n-h2-master-1 Jul 31 02:14:09.142203 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7c14b761-5435-47f1-84dc-5effa740f46c req-94d53a6e-ec12-4c57-89ea-1863a57f4e21 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087389 Jul 31 02:14:09.142792 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3473/6979] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:14:09.211946 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6db5658d-6f5b-41ea-a17c-e3023e2c7437 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "DELETE /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments/f93f5195-4755-4747-b102-f0c90bea3b36" status: 202 len: 0 microversion: 2.1 time: 0.188839 Jul 31 02:14:09.212821 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3507/6980] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 02:14:09 2022] DELETE /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments/f93f5195-4755-4747-b102-f0c90bea3b36 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:14:09.229564 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21330acb-e1bb-4f5e-b22c-bd58c3001ef4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:09.231408 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-21330acb-e1bb-4f5e-b22c-bd58c3001ef4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:09.240136 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21330acb-e1bb-4f5e-b22c-bd58c3001ef4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:09.240910 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21330acb-e1bb-4f5e-b22c-bd58c3001ef4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:09.242006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21330acb-e1bb-4f5e-b22c-bd58c3001ef4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:09.242499 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21330acb-e1bb-4f5e-b22c-bd58c3001ef4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:09.288401 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-21330acb-e1bb-4f5e-b22c-bd58c3001ef4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070776 Jul 31 02:14:09.289666 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3474/6981] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:14:09 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:14:10.302166 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0c070d34-13ef-4a0a-9754-7040462b7bc3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:10.304621 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0c070d34-13ef-4a0a-9754-7040462b7bc3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:10.312025 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c070d34-13ef-4a0a-9754-7040462b7bc3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:10.312490 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c070d34-13ef-4a0a-9754-7040462b7bc3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:10.313867 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c070d34-13ef-4a0a-9754-7040462b7bc3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:10.314315 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0c070d34-13ef-4a0a-9754-7040462b7bc3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:10.343250 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0c070d34-13ef-4a0a-9754-7040462b7bc3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046008 Jul 31 02:14:10.343840 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3508/6982] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:14:10 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:14:11.355712 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-eaef9747-3db6-49d9-9288-c7fceb9df3fd tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:11.357960 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-eaef9747-3db6-49d9-9288-c7fceb9df3fd tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:11.365309 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eaef9747-3db6-49d9-9288-c7fceb9df3fd tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:11.365779 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eaef9747-3db6-49d9-9288-c7fceb9df3fd tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:11.366572 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eaef9747-3db6-49d9-9288-c7fceb9df3fd tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:11.367027 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-eaef9747-3db6-49d9-9288-c7fceb9df3fd tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:11.402807 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-eaef9747-3db6-49d9-9288-c7fceb9df3fd tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051013 Jul 31 02:14:11.403609 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3475/6983] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:14:11 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:14:12.414464 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c973197a-1207-454f-a661-981e8e0e9677 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:12.416685 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c973197a-1207-454f-a661-981e8e0e9677 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:12.423737 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c973197a-1207-454f-a661-981e8e0e9677 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:12.424201 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c973197a-1207-454f-a661-981e8e0e9677 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:12.425009 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c973197a-1207-454f-a661-981e8e0e9677 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:12.425460 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c973197a-1207-454f-a661-981e8e0e9677 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:12.471228 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c973197a-1207-454f-a661-981e8e0e9677 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060845 Jul 31 02:14:12.475727 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3509/6984] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:14:12 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:14:13.482688 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-afb5931c-d9ae-4e4d-a6e7-5e90a04d99f6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:13.485603 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-afb5931c-d9ae-4e4d-a6e7-5e90a04d99f6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:13.492614 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-afb5931c-d9ae-4e4d-a6e7-5e90a04d99f6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:13.493087 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-afb5931c-d9ae-4e4d-a6e7-5e90a04d99f6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:13.493879 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-afb5931c-d9ae-4e4d-a6e7-5e90a04d99f6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:13.494337 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-afb5931c-d9ae-4e4d-a6e7-5e90a04d99f6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:13.524074 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-afb5931c-d9ae-4e4d-a6e7-5e90a04d99f6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045307 Jul 31 02:14:13.524663 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3476/6985] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:14:13 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:14:14.536476 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a66ada6f-68ea-4874-adb5-059ec5e87e57 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:14.539088 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a66ada6f-68ea-4874-adb5-059ec5e87e57 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:14.550927 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a66ada6f-68ea-4874-adb5-059ec5e87e57 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:14.551420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a66ada6f-68ea-4874-adb5-059ec5e87e57 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:14.552220 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a66ada6f-68ea-4874-adb5-059ec5e87e57 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:14.552674 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a66ada6f-68ea-4874-adb5-059ec5e87e57 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:14.582360 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a66ada6f-68ea-4874-adb5-059ec5e87e57 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049872 Jul 31 02:14:14.582927 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3510/6986] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:14:14 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 02:14:14.593534 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ba41fed5-319a-4fda-b8b9-22b59d1a7700 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:14.594042 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ba41fed5-319a-4fda-b8b9-22b59d1a7700 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:14.601263 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba41fed5-319a-4fda-b8b9-22b59d1a7700 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:14.601728 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba41fed5-319a-4fda-b8b9-22b59d1a7700 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:14.602507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba41fed5-319a-4fda-b8b9-22b59d1a7700 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:14.602959 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ba41fed5-319a-4fda-b8b9-22b59d1a7700 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:14.677555 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-ba41fed5-319a-4fda-b8b9-22b59d1a7700 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] HTTP exception thrown: Instance 24e4c701-8593-4309-bf65-a4dd21ba029a is not attached to volume f93f5195-4755-4747-b102-f0c90bea3b36 Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ba41fed5-319a-4fda-b8b9-22b59d1a7700 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Request method failure captured: Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments/f93f5195-4755-4747-b102-f0c90bea3b36 HTTP/1.1 Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eSPOQA4FJc-qXPxhJhp7qRwkzs74IWlVJ5E11hrI3GGPqfZrHMaJtwW1lBflPvJAeRiOkwlUIfYBPmcmfacAvRiH2r5tzVJQCgEddJZYExSuzVzZgYVY17z0DlhgwmMKnnv2732rLDKJ1g6nPUPtTbyFPzdHD-x7qsYvwQXb_JFvg8 Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 8d5d5e2f24ed48ffa0d75192e744bfe1 Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestMinimumBasicScenario-1962853026 Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8d5d5e2f24ed48ffa0d75192e744bfe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8d5d5e2f24ed48ffa0d75192e744bfe1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8d5d5e2f24ed48ffa0d75192e744bfe1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8d5d5e2f24ed48ffa0d75192e744bfe1", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestMinimumBasicScenario-1962853026 Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 8d5d5e2f24ed48ffa0d75192e744bfe1 Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1962853026 Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestMinimumBasicScenario-1962853026-project Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 964a6df6b450426da030f2519fe9a62f Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestMinimumBasicScenario-1962853026-project Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 24e4c701-8593-4309-bf65-a4dd21ba029a is not attached to volume f93f5195-4755-4747-b102-f0c90bea3b36 Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: action_args: {'server_id': '24e4c701-8593-4309-bf65-a4dd21ba029a', 'id': 'f93f5195-4755-4747-b102-f0c90bea3b36'} Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f93f5195-4755-4747-b102-f0c90bea3b36. Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e4c701-8593-4309-bf65-a4dd21ba029a is not attached to volume f93f5195-4755-4747-b102-f0c90bea3b36 Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:14:14.679197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:14:14.682842 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:14:14.682842 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:14:14.682842 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e4c701-8593-4309-bf65-a4dd21ba029a is not attached to volume f93f5195-4755-4747-b102-f0c90bea3b36 Jul 31 02:14:14.682842 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:14:14.682842 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ba41fed5-319a-4fda-b8b9-22b59d1a7700 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Returning 404 to user: Instance 24e4c701-8593-4309-bf65-a4dd21ba029a is not attached to volume f93f5195-4755-4747-b102-f0c90bea3b36 {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:14:14.682842 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ba41fed5-319a-4fda-b8b9-22b59d1a7700 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "DELETE /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments/f93f5195-4755-4747-b102-f0c90bea3b36" status: 404 len: 154 microversion: 2.1 time: 0.091311 Jul 31 02:14:14.682842 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3477/6987] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 02:14:14 2022] DELETE /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a/os-volume_attachments/f93f5195-4755-4747-b102-f0c90bea3b36 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:14:17.933186 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-32d400bc-9bd6-4182-a663-af8447f2db90 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:17.933694 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-32d400bc-9bd6-4182-a663-af8447f2db90 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:17.940787 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-32d400bc-9bd6-4182-a663-af8447f2db90 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:17.941250 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-32d400bc-9bd6-4182-a663-af8447f2db90 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:17.942034 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-32d400bc-9bd6-4182-a663-af8447f2db90 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:17.942733 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-32d400bc-9bd6-4182-a663-af8447f2db90 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:17.968408 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-32d400bc-9bd6-4182-a663-af8447f2db90 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:14:18.043791 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-32d400bc-9bd6-4182-a663-af8447f2db90 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "DELETE /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 204 len: 0 microversion: 2.1 time: 0.113938 Jul 31 02:14:18.044469 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3511/6988] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:14:17 2022] DELETE /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:14:18.055278 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d1b2c7c2-a8f6-425c-be1a-2e1a11e3a19e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:18.055970 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d1b2c7c2-a8f6-425c-be1a-2e1a11e3a19e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:18.064387 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d1b2c7c2-a8f6-425c-be1a-2e1a11e3a19e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:18.065154 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d1b2c7c2-a8f6-425c-be1a-2e1a11e3a19e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:18.066181 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d1b2c7c2-a8f6-425c-be1a-2e1a11e3a19e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:18.066654 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d1b2c7c2-a8f6-425c-be1a-2e1a11e3a19e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:18.219792 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d1b2c7c2-a8f6-425c-be1a-2e1a11e3a19e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:18.227844 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d1b2c7c2-a8f6-425c-be1a-2e1a11e3a19e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1556 microversion: 2.1 time: 0.177788 Jul 31 02:14:18.228667 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3478/6989] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:18 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:19.258011 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eaffb711-2c04-48aa-ab76-4b0217606922 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:19.258657 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eaffb711-2c04-48aa-ab76-4b0217606922 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:19.266584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eaffb711-2c04-48aa-ab76-4b0217606922 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:19.267040 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eaffb711-2c04-48aa-ab76-4b0217606922 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:19.267840 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eaffb711-2c04-48aa-ab76-4b0217606922 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:19.268280 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eaffb711-2c04-48aa-ab76-4b0217606922 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:19.396217 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eaffb711-2c04-48aa-ab76-4b0217606922 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:19.403770 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eaffb711-2c04-48aa-ab76-4b0217606922 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1556 microversion: 2.1 time: 0.150125 Jul 31 02:14:19.405142 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3512/6990] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:19 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:20.426646 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-285a5ef4-df02-4224-8719-3e2efe75d65a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:20.427293 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-285a5ef4-df02-4224-8719-3e2efe75d65a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:20.456902 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-285a5ef4-df02-4224-8719-3e2efe75d65a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:20.457377 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-285a5ef4-df02-4224-8719-3e2efe75d65a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:20.458184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-285a5ef4-df02-4224-8719-3e2efe75d65a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:20.458642 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-285a5ef4-df02-4224-8719-3e2efe75d65a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:20.482371 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-da374f14-d6f1-42ff-815c-ea08f4abf604 req-cc6870a9-2a81-4e10-ad83-7c8054e59653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e4c701-8593-4309-bf65-a4dd21ba029a", "name": "network-vif-deleted", "tag": "54ea4cf8-88e7-4c1e-a057-53d2b535bcb5"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:14:20.492735 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-da374f14-d6f1-42ff-815c-ea08f4abf604 req-cc6870a9-2a81-4e10-ad83-7c8054e59653 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:20.493193 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-da374f14-d6f1-42ff-815c-ea08f4abf604 req-cc6870a9-2a81-4e10-ad83-7c8054e59653 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:20.506035 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-da374f14-d6f1-42ff-815c-ea08f4abf604 req-cc6870a9-2a81-4e10-ad83-7c8054e59653 service nova] Creating event network-vif-deleted:54ea4cf8-88e7-4c1e-a057-53d2b535bcb5 for instance 24e4c701-8593-4309-bf65-a4dd21ba029a on n-h2-master-1 Jul 31 02:14:20.510998 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-da374f14-d6f1-42ff-815c-ea08f4abf604 req-cc6870a9-2a81-4e10-ad83-7c8054e59653 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032280 Jul 31 02:14:20.512067 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3513/6991] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:14:20.534655 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-285a5ef4-df02-4224-8719-3e2efe75d65a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:20.542389 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-285a5ef4-df02-4224-8719-3e2efe75d65a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 200 len: 1514 microversion: 2.1 time: 0.119814 Jul 31 02:14:20.543148 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3479/6992] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:20 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 1514 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:21.566463 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-efa25a4b-b19c-465d-ae4b-00d160feaba4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:21.567186 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-efa25a4b-b19c-465d-ae4b-00d160feaba4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: 24e4c701-8593-4309-bf65-a4dd21ba029a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:21.573525 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efa25a4b-b19c-465d-ae4b-00d160feaba4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:21.573991 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efa25a4b-b19c-465d-ae4b-00d160feaba4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:21.574771 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efa25a4b-b19c-465d-ae4b-00d160feaba4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:21.575231 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efa25a4b-b19c-465d-ae4b-00d160feaba4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:21.591711 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-efa25a4b-b19c-465d-ae4b-00d160feaba4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] HTTP exception thrown: Instance 24e4c701-8593-4309-bf65-a4dd21ba029a could not be found. Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-efa25a4b-b19c-465d-ae4b-00d160feaba4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Request method failure captured: Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a HTTP/1.1 Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eSPOQA4FJc-qXPxhJhp7qRwkzs74IWlVJ5E11hrI3GGPqfZrHMaJtwW1lBflPvJAeRiOkwlUIfYBPmcmfacAvRiH2r5tzVJQCgEddJZYExSuzVzZgYVY17z0DlhgwmMKnnv2732rLDKJ1g6nPUPtTbyFPzdHD-x7qsYvwQXb_JFvg8 Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 8d5d5e2f24ed48ffa0d75192e744bfe1 Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestMinimumBasicScenario-1962853026 Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8d5d5e2f24ed48ffa0d75192e744bfe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8d5d5e2f24ed48ffa0d75192e744bfe1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8d5d5e2f24ed48ffa0d75192e744bfe1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8d5d5e2f24ed48ffa0d75192e744bfe1", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestMinimumBasicScenario-1962853026 Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 8d5d5e2f24ed48ffa0d75192e744bfe1 Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1962853026 Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestMinimumBasicScenario-1962853026-project Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 964a6df6b450426da030f2519fe9a62f Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestMinimumBasicScenario-1962853026-project Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 24e4c701-8593-4309-bf65-a4dd21ba029a could not be found. Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '24e4c701-8593-4309-bf65-a4dd21ba029a'} Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e4c701-8593-4309-bf65-a4dd21ba029a could not be found. Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e4c701-8593-4309-bf65-a4dd21ba029a could not be found. Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:14:21.593351 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:14:21.598273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:14:21.598273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:14:21.598273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:14:21.598273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:14:21.598273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:14:21.598273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e4c701-8593-4309-bf65-a4dd21ba029a could not be found. Jul 31 02:14:21.598273 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:14:21.598273 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-efa25a4b-b19c-465d-ae4b-00d160feaba4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Returning 404 to user: Instance 24e4c701-8593-4309-bf65-a4dd21ba029a could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:14:21.598273 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-efa25a4b-b19c-465d-ae4b-00d160feaba4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a" status: 404 len: 111 microversion: 2.1 time: 0.034189 Jul 31 02:14:21.598273 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3514/6993] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:21 2022] GET /compute/v2.1/servers/24e4c701-8593-4309-bf65-a4dd21ba029a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:14:21.604365 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a8acc14a-7b0d-40c2-a106-b010b4525036 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '.version_select at 0x7fede560a940>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:21.628232 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a8acc14a-7b0d-40c2-a106-b010b4525036 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1332414191" status: 202 len: 0 microversion: 2.1 time: 0.027752 Jul 31 02:14:21.628801 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3480/6994] 10.222.0.45 () {58 vars in 1272 bytes} [Sun Jul 31 02:14:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1332414191 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:14:30.419130 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f7576456-b0ff-4282-8ddc-f518077e3697 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Action: 'create', calling method: .version_select at 0x7fedeaa38040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-172596802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsLDFaIbvFHBTJzp2QalmFF7swRIORBxgBUuOPDyclW/QwHrPvxp7NekkeGDvWyEv2gz0vz84vWNXaxHb5dP0PtuyXZdqCQR8kZzjTjmNBlG3Bdn31DBYA7I9vFLRWFoA=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:14:30.436128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-f7576456-b0ff-4282-8ddc-f518077e3697 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Getting quotas for project 8d5d5e2f24ed48ffa0d75192e744bfe1. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:14:30.441761 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-f7576456-b0ff-4282-8ddc-f518077e3697 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Getting quotas for user 964a6df6b450426da030f2519fe9a62f and project 8d5d5e2f24ed48ffa0d75192e744bfe1. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:14:30.472008 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f7576456-b0ff-4282-8ddc-f518077e3697 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056865 Jul 31 02:14:30.472614 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3515/6995] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 02:14:30 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:14:30.532201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-07773651-7545-4c70-9461-1afe69c810d4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-626925853", "imageRef": "149f1de6-aad7-44b9-a2aa-9f8dfbf63c0d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-172596802", "networks": [{"uuid": "8e17e83d-e5d1-49bb-991d-8b8435666b65"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:14:30.540967 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=40 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:30.586724 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-07773651-7545-4c70-9461-1afe69c810d4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] validate_networks() for [('8e17e83d-e5d1-49bb-991d-8b8435666b65', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:14:31.019741 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-07773651-7545-4c70-9461-1afe69c810d4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:14:31.020189 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-07773651-7545-4c70-9461-1afe69c810d4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:14:31.020681 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-07773651-7545-4c70-9461-1afe69c810d4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:14:31.021109 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-07773651-7545-4c70-9461-1afe69c810d4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:14:31.021538 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-07773651-7545-4c70-9461-1afe69c810d4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:14:31.030364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07773651-7545-4c70-9461-1afe69c810d4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:31.030833 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07773651-7545-4c70-9461-1afe69c810d4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:31.031714 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07773651-7545-4c70-9461-1afe69c810d4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:31.032717 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-07773651-7545-4c70-9461-1afe69c810d4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:31.049913 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-07773651-7545-4c70-9461-1afe69c810d4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Getting quotas for project 8d5d5e2f24ed48ffa0d75192e744bfe1. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:14:31.055201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-07773651-7545-4c70-9461-1afe69c810d4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Getting quotas for user 964a6df6b450426da030f2519fe9a62f and project 8d5d5e2f24ed48ffa0d75192e744bfe1. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:14:31.067551 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-07773651-7545-4c70-9461-1afe69c810d4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:14:31.069720 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-07773651-7545-4c70-9461-1afe69c810d4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='149f1de6-aad7-44b9-a2aa-9f8dfbf63c0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:14:31.115200 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-07773651-7545-4c70-9461-1afe69c810d4 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587892 Jul 31 02:14:31.115814 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3481/6996] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 02:14:31.126936 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-66cdfbc7-16f2-4425-91a6-86abc52b08a6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:31.127686 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-66cdfbc7-16f2-4425-91a6-86abc52b08a6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:31.191155 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-66cdfbc7-16f2-4425-91a6-86abc52b08a6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:31.199265 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-66cdfbc7-16f2-4425-91a6-86abc52b08a6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1257 microversion: 2.1 time: 0.076307 Jul 31 02:14:31.200145 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3516/6997] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:31 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1257 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:32.221888 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fc1e41c3-a118-4647-820e-4a865aecac3a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:32.222693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fc1e41c3-a118-4647-820e-4a865aecac3a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:32.230032 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc1e41c3-a118-4647-820e-4a865aecac3a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:32.230803 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc1e41c3-a118-4647-820e-4a865aecac3a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:32.231699 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc1e41c3-a118-4647-820e-4a865aecac3a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:32.232250 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc1e41c3-a118-4647-820e-4a865aecac3a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:32.389464 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fc1e41c3-a118-4647-820e-4a865aecac3a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:32.402944 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fc1e41c3-a118-4647-820e-4a865aecac3a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1327 microversion: 2.1 time: 0.186478 Jul 31 02:14:32.403570 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3482/6998] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:32 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1327 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:33.425371 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-893d824f-4b7e-45f6-be9a-a5870dc16313 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:33.425998 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-893d824f-4b7e-45f6-be9a-a5870dc16313 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:33.428794 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:33.435604 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-893d824f-4b7e-45f6-be9a-a5870dc16313 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:33.436056 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-893d824f-4b7e-45f6-be9a-a5870dc16313 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:33.436838 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-893d824f-4b7e-45f6-be9a-a5870dc16313 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:33.437278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-893d824f-4b7e-45f6-be9a-a5870dc16313 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:33.577289 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-893d824f-4b7e-45f6-be9a-a5870dc16313 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:33.586097 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-893d824f-4b7e-45f6-be9a-a5870dc16313 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1357 microversion: 2.1 time: 0.164609 Jul 31 02:14:33.586696 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3517/6999] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:33 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:34.609076 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b500db91-415e-439f-a184-c6fe2a309d12 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:34.609642 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b500db91-415e-439f-a184-c6fe2a309d12 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:34.617662 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b500db91-415e-439f-a184-c6fe2a309d12 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:34.618126 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b500db91-415e-439f-a184-c6fe2a309d12 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:34.619093 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b500db91-415e-439f-a184-c6fe2a309d12 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:34.619721 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b500db91-415e-439f-a184-c6fe2a309d12 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:34.776011 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b500db91-415e-439f-a184-c6fe2a309d12 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:34.784134 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b500db91-415e-439f-a184-c6fe2a309d12 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1357 microversion: 2.1 time: 0.179130 Jul 31 02:14:34.784717 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3483/7000] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:34 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:35.806146 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d2d97ade-e642-43bd-9b49-a8fff7dc6168 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:35.808013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d2d97ade-e642-43bd-9b49-a8fff7dc6168 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:35.817331 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2d97ade-e642-43bd-9b49-a8fff7dc6168 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:35.817786 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2d97ade-e642-43bd-9b49-a8fff7dc6168 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:35.818571 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2d97ade-e642-43bd-9b49-a8fff7dc6168 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:35.819013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d2d97ade-e642-43bd-9b49-a8fff7dc6168 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:36.037522 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d2d97ade-e642-43bd-9b49-a8fff7dc6168 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:36.045068 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d2d97ade-e642-43bd-9b49-a8fff7dc6168 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1357 microversion: 2.1 time: 0.243593 Jul 31 02:14:36.045636 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3518/7001] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:35 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:37.067254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63f669d8-c870-460a-89c9-0b74f4c83ad3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:37.067926 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-63f669d8-c870-460a-89c9-0b74f4c83ad3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:37.074867 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63f669d8-c870-460a-89c9-0b74f4c83ad3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:37.075362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63f669d8-c870-460a-89c9-0b74f4c83ad3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:37.076169 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63f669d8-c870-460a-89c9-0b74f4c83ad3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:37.076629 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63f669d8-c870-460a-89c9-0b74f4c83ad3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:37.222829 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-63f669d8-c870-460a-89c9-0b74f4c83ad3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:37.230439 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-63f669d8-c870-460a-89c9-0b74f4c83ad3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1357 microversion: 2.1 time: 0.167665 Jul 31 02:14:37.231007 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3484/7002] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:37 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:38.251957 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8529a1e0-8eee-4dc7-9d68-60f83ea5e58a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:38.253465 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8529a1e0-8eee-4dc7-9d68-60f83ea5e58a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:38.256574 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:38.262406 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8529a1e0-8eee-4dc7-9d68-60f83ea5e58a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:38.262968 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8529a1e0-8eee-4dc7-9d68-60f83ea5e58a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:38.263865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8529a1e0-8eee-4dc7-9d68-60f83ea5e58a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:38.264412 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8529a1e0-8eee-4dc7-9d68-60f83ea5e58a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:38.413646 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8529a1e0-8eee-4dc7-9d68-60f83ea5e58a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:38.432616 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8529a1e0-8eee-4dc7-9d68-60f83ea5e58a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1357 microversion: 2.1 time: 0.174294 Jul 31 02:14:38.432616 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3519/7003] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:38 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:39.447693 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4d5f6c40-7202-45a0-9d3e-7a345045558e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:39.448380 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4d5f6c40-7202-45a0-9d3e-7a345045558e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:39.451134 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:39.457200 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d5f6c40-7202-45a0-9d3e-7a345045558e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:39.462412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d5f6c40-7202-45a0-9d3e-7a345045558e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:39.462412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d5f6c40-7202-45a0-9d3e-7a345045558e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:39.462412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4d5f6c40-7202-45a0-9d3e-7a345045558e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:39.636146 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4d5f6c40-7202-45a0-9d3e-7a345045558e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:39.644896 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4d5f6c40-7202-45a0-9d3e-7a345045558e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1357 microversion: 2.1 time: 0.201240 Jul 31 02:14:39.657107 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3485/7004] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:39 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:40.666113 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d76e4e92-f3ec-4159-b578-0425eec7f028 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:40.666744 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d76e4e92-f3ec-4159-b578-0425eec7f028 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:40.674344 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d76e4e92-f3ec-4159-b578-0425eec7f028 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:40.674798 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d76e4e92-f3ec-4159-b578-0425eec7f028 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:40.675589 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d76e4e92-f3ec-4159-b578-0425eec7f028 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:40.676037 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d76e4e92-f3ec-4159-b578-0425eec7f028 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:40.816318 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d76e4e92-f3ec-4159-b578-0425eec7f028 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:40.827757 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d76e4e92-f3ec-4159-b578-0425eec7f028 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1357 microversion: 2.1 time: 0.165318 Jul 31 02:14:40.828592 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3520/7005] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:40 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:41.849876 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c0087353-2d20-421d-a86d-4a3fe7e513fa tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:41.850506 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c0087353-2d20-421d-a86d-4a3fe7e513fa tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:41.853254 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:41.853930 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:41.859674 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0087353-2d20-421d-a86d-4a3fe7e513fa tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:41.860142 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0087353-2d20-421d-a86d-4a3fe7e513fa tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:41.860919 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0087353-2d20-421d-a86d-4a3fe7e513fa tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:41.861371 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c0087353-2d20-421d-a86d-4a3fe7e513fa tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:41.995273 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c0087353-2d20-421d-a86d-4a3fe7e513fa tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:42.003934 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c0087353-2d20-421d-a86d-4a3fe7e513fa tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1357 microversion: 2.1 time: 0.158163 Jul 31 02:14:42.004648 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3486/7006] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:41 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:43.025763 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c2d6f2e7-2b31-4b20-94bf-675ab9f18408 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:43.026519 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c2d6f2e7-2b31-4b20-94bf-675ab9f18408 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:43.028567 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:14:43.036035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2d6f2e7-2b31-4b20-94bf-675ab9f18408 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:43.036606 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2d6f2e7-2b31-4b20-94bf-675ab9f18408 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:43.037472 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2d6f2e7-2b31-4b20-94bf-675ab9f18408 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:43.037997 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c2d6f2e7-2b31-4b20-94bf-675ab9f18408 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:43.249871 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c2d6f2e7-2b31-4b20-94bf-675ab9f18408 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:43.257501 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c2d6f2e7-2b31-4b20-94bf-675ab9f18408 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1357 microversion: 2.1 time: 0.235991 Jul 31 02:14:43.258015 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3521/7007] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:43 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:43.339613 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-d81c7b92-d982-4839-9d75-8311404e7dee req-73f3e03e-0c32-4bb7-827f-56323a702e8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a43e1d85-eb47-489e-8d9f-042f882337fc", "tag": "e10ab9ab-0130-4ab7-8516-a9bb1e30ac12"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:14:43.352142 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d81c7b92-d982-4839-9d75-8311404e7dee req-73f3e03e-0c32-4bb7-827f-56323a702e8f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:43.352702 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-d81c7b92-d982-4839-9d75-8311404e7dee req-73f3e03e-0c32-4bb7-827f-56323a702e8f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:43.366393 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-d81c7b92-d982-4839-9d75-8311404e7dee req-73f3e03e-0c32-4bb7-827f-56323a702e8f service nova] Creating event network-changed:e10ab9ab-0130-4ab7-8516-a9bb1e30ac12 for instance a43e1d85-eb47-489e-8d9f-042f882337fc on n-h1-master-1 Jul 31 02:14:43.373900 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-d81c7b92-d982-4839-9d75-8311404e7dee req-73f3e03e-0c32-4bb7-827f-56323a702e8f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036188 Jul 31 02:14:43.373900 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3487/7008] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:14:44.278963 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c65bb36c-8baf-4718-80ac-776cf3503675 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:44.279628 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c65bb36c-8baf-4718-80ac-776cf3503675 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:44.286542 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c65bb36c-8baf-4718-80ac-776cf3503675 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:44.287009 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c65bb36c-8baf-4718-80ac-776cf3503675 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:44.287826 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c65bb36c-8baf-4718-80ac-776cf3503675 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:44.288279 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c65bb36c-8baf-4718-80ac-776cf3503675 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:44.419366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c65bb36c-8baf-4718-80ac-776cf3503675 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:44.427592 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c65bb36c-8baf-4718-80ac-776cf3503675 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1357 microversion: 2.1 time: 0.152548 Jul 31 02:14:44.428190 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3522/7009] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:44 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:45.449989 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-de3c87e3-fc02-4f54-b9f6-59995e1e7b29 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:45.450697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-de3c87e3-fc02-4f54-b9f6-59995e1e7b29 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:45.458535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-de3c87e3-fc02-4f54-b9f6-59995e1e7b29 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:45.458996 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-de3c87e3-fc02-4f54-b9f6-59995e1e7b29 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:45.459796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-de3c87e3-fc02-4f54-b9f6-59995e1e7b29 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:45.460243 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-de3c87e3-fc02-4f54-b9f6-59995e1e7b29 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:45.592840 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-de3c87e3-fc02-4f54-b9f6-59995e1e7b29 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:45.600682 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-de3c87e3-fc02-4f54-b9f6-59995e1e7b29 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1357 microversion: 2.1 time: 0.154663 Jul 31 02:14:45.600958 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3488/7010] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:45 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:46.621577 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-596bf1ba-2d3a-4f2e-af47-1cb61359bb74 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:46.622463 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-596bf1ba-2d3a-4f2e-af47-1cb61359bb74 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:46.629528 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-596bf1ba-2d3a-4f2e-af47-1cb61359bb74 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:46.629997 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-596bf1ba-2d3a-4f2e-af47-1cb61359bb74 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:46.630798 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-596bf1ba-2d3a-4f2e-af47-1cb61359bb74 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:46.631250 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-596bf1ba-2d3a-4f2e-af47-1cb61359bb74 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:46.759433 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-596bf1ba-2d3a-4f2e-af47-1cb61359bb74 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:46.767493 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-596bf1ba-2d3a-4f2e-af47-1cb61359bb74 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1357 microversion: 2.1 time: 0.149360 Jul 31 02:14:46.768070 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3523/7011] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:46 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:47.789071 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0e6d6810-e05c-41b2-8e52-230bad754131 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:47.789706 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0e6d6810-e05c-41b2-8e52-230bad754131 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:47.796729 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e6d6810-e05c-41b2-8e52-230bad754131 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:47.797198 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e6d6810-e05c-41b2-8e52-230bad754131 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:47.797983 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e6d6810-e05c-41b2-8e52-230bad754131 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:47.799043 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0e6d6810-e05c-41b2-8e52-230bad754131 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:47.934527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0e6d6810-e05c-41b2-8e52-230bad754131 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:47.942017 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0e6d6810-e05c-41b2-8e52-230bad754131 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1357 microversion: 2.1 time: 0.156882 Jul 31 02:14:47.942600 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3489/7012] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:47 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:48.963803 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-719c8bf4-949d-4cec-ba16-d9be42a16b48 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:48.964374 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-719c8bf4-949d-4cec-ba16-d9be42a16b48 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:48.974789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-719c8bf4-949d-4cec-ba16-d9be42a16b48 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:48.975250 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-719c8bf4-949d-4cec-ba16-d9be42a16b48 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:48.976058 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-719c8bf4-949d-4cec-ba16-d9be42a16b48 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:48.976607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-719c8bf4-949d-4cec-ba16-d9be42a16b48 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:49.109363 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-719c8bf4-949d-4cec-ba16-d9be42a16b48 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:49.117367 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-719c8bf4-949d-4cec-ba16-d9be42a16b48 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1357 microversion: 2.1 time: 0.157642 Jul 31 02:14:49.117939 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3524/7013] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:48 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:14:49.748568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-b24ab98f-7e97-4031-9f97-4ee56609a77e req-ce0f4b06-e10e-453c-9286-e6b0da7978f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43e1d85-eb47-489e-8d9f-042f882337fc", "name": "network-vif-plugged", "status": "completed", "tag": "e10ab9ab-0130-4ab7-8516-a9bb1e30ac12"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:14:49.760038 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b24ab98f-7e97-4031-9f97-4ee56609a77e req-ce0f4b06-e10e-453c-9286-e6b0da7978f5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:49.761504 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b24ab98f-7e97-4031-9f97-4ee56609a77e req-ce0f4b06-e10e-453c-9286-e6b0da7978f5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:49.774474 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-b24ab98f-7e97-4031-9f97-4ee56609a77e req-ce0f4b06-e10e-453c-9286-e6b0da7978f5 service nova] Creating event network-vif-plugged:e10ab9ab-0130-4ab7-8516-a9bb1e30ac12 for instance a43e1d85-eb47-489e-8d9f-042f882337fc on n-h1-master-1 Jul 31 02:14:49.779764 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-b24ab98f-7e97-4031-9f97-4ee56609a77e req-ce0f4b06-e10e-453c-9286-e6b0da7978f5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035659 Jul 31 02:14:49.780363 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3490/7014] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:14:50.138573 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-86bcca9e-d3eb-4a99-84bb-53e3d4dfd19c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:50.139122 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-86bcca9e-d3eb-4a99-84bb-53e3d4dfd19c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:50.146719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-86bcca9e-d3eb-4a99-84bb-53e3d4dfd19c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:50.147183 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-86bcca9e-d3eb-4a99-84bb-53e3d4dfd19c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:50.148016 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-86bcca9e-d3eb-4a99-84bb-53e3d4dfd19c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:50.148465 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-86bcca9e-d3eb-4a99-84bb-53e3d4dfd19c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:50.279579 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-86bcca9e-d3eb-4a99-84bb-53e3d4dfd19c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:50.286950 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-86bcca9e-d3eb-4a99-84bb-53e3d4dfd19c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1357 microversion: 2.1 time: 0.152416 Jul 31 02:14:50.287555 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3525/7015] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:50 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:51.308959 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ad0d8ae0-a526-4065-bed1-104cf28c43dc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:51.309934 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ad0d8ae0-a526-4065-bed1-104cf28c43dc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:51.316843 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad0d8ae0-a526-4065-bed1-104cf28c43dc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:51.317319 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad0d8ae0-a526-4065-bed1-104cf28c43dc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:51.318133 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad0d8ae0-a526-4065-bed1-104cf28c43dc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:51.318596 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ad0d8ae0-a526-4065-bed1-104cf28c43dc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:51.452527 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ad0d8ae0-a526-4065-bed1-104cf28c43dc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:51.460448 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ad0d8ae0-a526-4065-bed1-104cf28c43dc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1547 microversion: 2.1 time: 0.155825 Jul 31 02:14:51.461220 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3491/7016] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:51 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:51.481243 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-240d0d16-bd29-4f12-a999-55da473e86b3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:51.481964 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-240d0d16-bd29-4f12-a999-55da473e86b3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:51.489602 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-240d0d16-bd29-4f12-a999-55da473e86b3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:51.490059 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-240d0d16-bd29-4f12-a999-55da473e86b3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:51.490844 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-240d0d16-bd29-4f12-a999-55da473e86b3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:51.491289 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-240d0d16-bd29-4f12-a999-55da473e86b3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:51.623542 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-240d0d16-bd29-4f12-a999-55da473e86b3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:51.631049 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-240d0d16-bd29-4f12-a999-55da473e86b3 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1547 microversion: 2.1 time: 0.153683 Jul 31 02:14:51.631656 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3526/7017] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:51 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:51.651857 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-13ffd22d-8fef-407c-a7f4-054153719e56 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:51.656415 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-13ffd22d-8fef-407c-a7f4-054153719e56 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:51.657193 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-13ffd22d-8fef-407c-a7f4-054153719e56 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Searching by: {'deleted': False, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1'} {{(pid=119474) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 02:14:51.663204 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-13ffd22d-8fef-407c-a7f4-054153719e56 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:51.663706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-13ffd22d-8fef-407c-a7f4-054153719e56 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:51.664519 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-13ffd22d-8fef-407c-a7f4-054153719e56 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:51.664970 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-13ffd22d-8fef-407c-a7f4-054153719e56 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:51.687928 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.multi_cell_list [None req-13ffd22d-8fef-407c-a7f4-054153719e56 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119474) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 02:14:51.714294 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-13ffd22d-8fef-407c-a7f4-054153719e56 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.066233 Jul 31 02:14:51.714867 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3492/7018] 10.222.0.45 () {58 vars in 1125 bytes} [Sun Jul 31 02:14:51 2022] GET /compute/v2.1/servers => generated 342 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:14:51.726971 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b7cd98e4-f553-43e9-b861-fef7a1f1e0cb tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:14:51.727631 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b7cd98e4-f553-43e9-b861-fef7a1f1e0cb tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:51.733573 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7cd98e4-f553-43e9-b861-fef7a1f1e0cb tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:51.734031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7cd98e4-f553-43e9-b861-fef7a1f1e0cb tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:51.734832 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7cd98e4-f553-43e9-b861-fef7a1f1e0cb tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:51.735281 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b7cd98e4-f553-43e9-b861-fef7a1f1e0cb tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:51.862538 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b7cd98e4-f553-43e9-b861-fef7a1f1e0cb tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:14:51.870100 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b7cd98e4-f553-43e9-b861-fef7a1f1e0cb tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1547 microversion: 2.1 time: 0.147171 Jul 31 02:14:51.870682 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3527/7019] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:14:51 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:14:53.380516 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3becb864-64ea-4f70-a1fa-64f71041160a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e70bd825-0c17-4d5a-8da7-bd9324ddd84c"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:14:53.382908 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3becb864-64ea-4f70-a1fa-64f71041160a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:14:53.389854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3becb864-64ea-4f70-a1fa-64f71041160a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:53.390322 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3becb864-64ea-4f70-a1fa-64f71041160a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:53.391103 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3becb864-64ea-4f70-a1fa-64f71041160a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:14:53.391587 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3becb864-64ea-4f70-a1fa-64f71041160a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:14:53.638392 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3becb864-64ea-4f70-a1fa-64f71041160a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "POST /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261714 Jul 31 02:14:53.638999 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3493/7020] 10.222.0.45 () {60 vars in 1323 bytes} [Sun Jul 31 02:14:53 2022] POST /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:15:04.389461 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d290582b-71c1-4192-85be-e86caa6d6714 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:15:04.390084 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d290582b-71c1-4192-85be-e86caa6d6714 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:15:04.393144 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=17 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:15:04.393951 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=66 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:15:04.402882 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d290582b-71c1-4192-85be-e86caa6d6714 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:04.403761 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d290582b-71c1-4192-85be-e86caa6d6714 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:04.405180 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d290582b-71c1-4192-85be-e86caa6d6714 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:04.405987 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d290582b-71c1-4192-85be-e86caa6d6714 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:04.544742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d290582b-71c1-4192-85be-e86caa6d6714 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:15:04.552812 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d290582b-71c1-4192-85be-e86caa6d6714 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1593 microversion: 2.1 time: 0.167382 Jul 31 02:15:04.553393 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3528/7021] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:15:04 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1593 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:15:06.425126 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:15:06.425973 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=17 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:15:06.426805 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:15:06.431714 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-f4690d54-f575-464d-8349-e4b2ab20eb73 req-0b1bc6ad-c05e-4304-a9b8-e74fb58ea507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a43e1d85-eb47-489e-8d9f-042f882337fc", "tag": "e10ab9ab-0130-4ab7-8516-a9bb1e30ac12"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:15:06.448948 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f4690d54-f575-464d-8349-e4b2ab20eb73 req-0b1bc6ad-c05e-4304-a9b8-e74fb58ea507 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:06.449407 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f4690d54-f575-464d-8349-e4b2ab20eb73 req-0b1bc6ad-c05e-4304-a9b8-e74fb58ea507 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:06.462719 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-f4690d54-f575-464d-8349-e4b2ab20eb73 req-0b1bc6ad-c05e-4304-a9b8-e74fb58ea507 service nova] Creating event network-changed:e10ab9ab-0130-4ab7-8516-a9bb1e30ac12 for instance a43e1d85-eb47-489e-8d9f-042f882337fc on n-h1-master-1 Jul 31 02:15:06.468141 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-f4690d54-f575-464d-8349-e4b2ab20eb73 req-0b1bc6ad-c05e-4304-a9b8-e74fb58ea507 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044659 Jul 31 02:15:06.468908 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3494/7022] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:15:07.573526 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-44744655-9226-43bf-a28f-c77149fd45bc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1100202101"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:15:07.574177 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-44744655-9226-43bf-a28f-c77149fd45bc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:15:07.581324 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44744655-9226-43bf-a28f-c77149fd45bc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:07.582033 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44744655-9226-43bf-a28f-c77149fd45bc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:07.583043 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44744655-9226-43bf-a28f-c77149fd45bc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:07.583726 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44744655-9226-43bf-a28f-c77149fd45bc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:07.719328 n-d-master-1 devstack@n-api.service[119475]: INFO nova.network.security_group_api [None req-44744655-9226-43bf-a28f-c77149fd45bc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Adding security group d1ab44fc-8399-4223-9bf1-f7e71d319194 to port e10ab9ab-0130-4ab7-8516-a9bb1e30ac12 Jul 31 02:15:08.026917 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-44744655-9226-43bf-a28f-c77149fd45bc tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "POST /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/action" status: 202 len: 0 microversion: 2.1 time: 0.457357 Jul 31 02:15:08.027585 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3529/7023] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:15:07 2022] POST /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:15:08.037356 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-420d9de3-7f3d-4da8-ac33-831dac40fb1c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:15:08.038190 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-420d9de3-7f3d-4da8-ac33-831dac40fb1c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:15:08.045663 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-420d9de3-7f3d-4da8-ac33-831dac40fb1c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:08.046278 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-420d9de3-7f3d-4da8-ac33-831dac40fb1c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:08.047144 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-420d9de3-7f3d-4da8-ac33-831dac40fb1c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:08.047701 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-420d9de3-7f3d-4da8-ac33-831dac40fb1c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:08.214675 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-420d9de3-7f3d-4da8-ac33-831dac40fb1c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:15:08.223378 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-420d9de3-7f3d-4da8-ac33-831dac40fb1c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1759 microversion: 2.1 time: 0.191192 Jul 31 02:15:08.224596 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3495/7024] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:15:08 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1759 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:15:08.482908 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-81ea49e1-5b4c-418c-94ee-9f938145d45a req-f38164e6-17cd-4ae7-b38a-9881212c8697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a43e1d85-eb47-489e-8d9f-042f882337fc", "tag": "e10ab9ab-0130-4ab7-8516-a9bb1e30ac12"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:15:08.492679 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-81ea49e1-5b4c-418c-94ee-9f938145d45a req-f38164e6-17cd-4ae7-b38a-9881212c8697 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:08.493144 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-81ea49e1-5b4c-418c-94ee-9f938145d45a req-f38164e6-17cd-4ae7-b38a-9881212c8697 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:08.505364 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-81ea49e1-5b4c-418c-94ee-9f938145d45a req-f38164e6-17cd-4ae7-b38a-9881212c8697 service nova] Creating event network-changed:e10ab9ab-0130-4ab7-8516-a9bb1e30ac12 for instance a43e1d85-eb47-489e-8d9f-042f882337fc on n-h1-master-1 Jul 31 02:15:08.512181 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-81ea49e1-5b4c-418c-94ee-9f938145d45a req-f38164e6-17cd-4ae7-b38a-9881212c8697 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032539 Jul 31 02:15:08.512809 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3530/7025] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:15:25.128238 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ef793216-1b0f-4196-8ef7-aa0faad7a168 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:15:25.130575 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ef793216-1b0f-4196-8ef7-aa0faad7a168 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:15:25.134195 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:15:25.134873 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=8 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:15:25.140904 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef793216-1b0f-4196-8ef7-aa0faad7a168 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:25.141371 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef793216-1b0f-4196-8ef7-aa0faad7a168 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:25.142152 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef793216-1b0f-4196-8ef7-aa0faad7a168 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:25.142608 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef793216-1b0f-4196-8ef7-aa0faad7a168 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:25.217485 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ef793216-1b0f-4196-8ef7-aa0faad7a168 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "POST /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/action" status: 202 len: 0 microversion: 2.1 time: 0.093158 Jul 31 02:15:25.218130 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3496/7026] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:15:25 2022] POST /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:15:25.224582 n-d-master-1 devstack@n-api.service[119475]: ERROR oslo.messaging._drivers.impl_rabbit [-] [189acb91-3d4b-44e7-81c9-7fd59a69a406] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 31 02:15:25.228467 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c399b4b5-cbbe-44f7-ad04-adf7102fd1b6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:15:25.229216 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c399b4b5-cbbe-44f7-ad04-adf7102fd1b6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:15:25.231924 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:15:25.232695 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=12 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:15:25.239722 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c399b4b5-cbbe-44f7-ad04-adf7102fd1b6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:25.240205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c399b4b5-cbbe-44f7-ad04-adf7102fd1b6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:25.240999 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c399b4b5-cbbe-44f7-ad04-adf7102fd1b6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:25.241448 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c399b4b5-cbbe-44f7-ad04-adf7102fd1b6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:25.483519 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c399b4b5-cbbe-44f7-ad04-adf7102fd1b6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:15:25.492126 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c399b4b5-cbbe-44f7-ad04-adf7102fd1b6 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1751 microversion: 2.1 time: 0.269086 Jul 31 02:15:25.497816 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3531/7027] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:15:25 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1751 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:15:26.514399 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dbe13856-ecad-4e62-b9e5-2ef0d4ce78f9 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:15:26.515117 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dbe13856-ecad-4e62-b9e5-2ef0d4ce78f9 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:15:26.522943 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dbe13856-ecad-4e62-b9e5-2ef0d4ce78f9 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:26.523429 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dbe13856-ecad-4e62-b9e5-2ef0d4ce78f9 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:26.524218 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dbe13856-ecad-4e62-b9e5-2ef0d4ce78f9 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:26.524676 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dbe13856-ecad-4e62-b9e5-2ef0d4ce78f9 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:26.665500 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dbe13856-ecad-4e62-b9e5-2ef0d4ce78f9 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:15:26.673533 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dbe13856-ecad-4e62-b9e5-2ef0d4ce78f9 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1756 microversion: 2.1 time: 0.163495 Jul 31 02:15:26.674104 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3497/7028] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:15:26 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:15:27.695761 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc4231b0-fed7-41ea-9287-4bf5bc77da41 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:15:27.696380 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc4231b0-fed7-41ea-9287-4bf5bc77da41 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:15:27.704494 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc4231b0-fed7-41ea-9287-4bf5bc77da41 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:27.704947 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc4231b0-fed7-41ea-9287-4bf5bc77da41 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:27.705713 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc4231b0-fed7-41ea-9287-4bf5bc77da41 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:27.706154 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc4231b0-fed7-41ea-9287-4bf5bc77da41 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:27.711510 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] [189acb91-3d4b-44e7-81c9-7fd59a69a406] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 39200. Jul 31 02:15:27.852943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-fc4231b0-fed7-41ea-9287-4bf5bc77da41 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:15:27.860943 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc4231b0-fed7-41ea-9287-4bf5bc77da41 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1756 microversion: 2.1 time: 0.169169 Jul 31 02:15:27.861508 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3532/7029] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:15:27 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:15:28.959894 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b07057bf-e66f-474b-b6c8-4d86cde055b0 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:15:28.960537 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b07057bf-e66f-474b-b6c8-4d86cde055b0 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:15:28.966699 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b07057bf-e66f-474b-b6c8-4d86cde055b0 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:28.967170 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b07057bf-e66f-474b-b6c8-4d86cde055b0 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:28.967993 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b07057bf-e66f-474b-b6c8-4d86cde055b0 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:28.968453 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b07057bf-e66f-474b-b6c8-4d86cde055b0 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:29.107075 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b07057bf-e66f-474b-b6c8-4d86cde055b0 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:15:29.115684 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b07057bf-e66f-474b-b6c8-4d86cde055b0 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1756 microversion: 2.1 time: 0.235808 Jul 31 02:15:29.116252 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3498/7030] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:15:28 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1756 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:15:30.138158 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-01954dca-dab5-491a-b30e-d2623f104511 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:15:30.138787 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-01954dca-dab5-491a-b30e-d2623f104511 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:15:30.146278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01954dca-dab5-491a-b30e-d2623f104511 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:30.146737 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01954dca-dab5-491a-b30e-d2623f104511 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:30.147547 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01954dca-dab5-491a-b30e-d2623f104511 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:30.147995 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01954dca-dab5-491a-b30e-d2623f104511 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:30.291825 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-01954dca-dab5-491a-b30e-d2623f104511 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:15:30.299853 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-01954dca-dab5-491a-b30e-d2623f104511 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1756 microversion: 2.1 time: 0.165644 Jul 31 02:15:30.300432 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3533/7031] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:15:30 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:15:31.321751 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-45d2641d-2c6a-4bf8-85aa-f6e97c5d4baf tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:15:31.322394 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-45d2641d-2c6a-4bf8-85aa-f6e97c5d4baf tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:15:31.329382 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-45d2641d-2c6a-4bf8-85aa-f6e97c5d4baf tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:31.329861 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-45d2641d-2c6a-4bf8-85aa-f6e97c5d4baf tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:31.330660 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-45d2641d-2c6a-4bf8-85aa-f6e97c5d4baf tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:31.331116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-45d2641d-2c6a-4bf8-85aa-f6e97c5d4baf tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:31.481905 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-45d2641d-2c6a-4bf8-85aa-f6e97c5d4baf tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:15:31.489908 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-45d2641d-2c6a-4bf8-85aa-f6e97c5d4baf tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1756 microversion: 2.1 time: 0.172199 Jul 31 02:15:31.490477 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3499/7032] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:15:31 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:15:32.512164 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cdc984f8-014f-49ba-a509-7afff3bd02da tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:15:32.512806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cdc984f8-014f-49ba-a509-7afff3bd02da tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:15:32.520257 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdc984f8-014f-49ba-a509-7afff3bd02da tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:32.520722 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdc984f8-014f-49ba-a509-7afff3bd02da tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:32.521517 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdc984f8-014f-49ba-a509-7afff3bd02da tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:32.521968 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cdc984f8-014f-49ba-a509-7afff3bd02da tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:32.669550 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cdc984f8-014f-49ba-a509-7afff3bd02da tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:15:32.678167 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cdc984f8-014f-49ba-a509-7afff3bd02da tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1756 microversion: 2.1 time: 0.170228 Jul 31 02:15:32.678766 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3534/7033] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:15:32 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:15:33.699948 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5870a3d0-7869-4221-8998-e1b3dd90569d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:15:33.700576 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5870a3d0-7869-4221-8998-e1b3dd90569d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:15:33.707559 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5870a3d0-7869-4221-8998-e1b3dd90569d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:33.708028 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5870a3d0-7869-4221-8998-e1b3dd90569d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:33.708832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5870a3d0-7869-4221-8998-e1b3dd90569d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:33.709279 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5870a3d0-7869-4221-8998-e1b3dd90569d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:33.852504 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5870a3d0-7869-4221-8998-e1b3dd90569d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:15:33.860678 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5870a3d0-7869-4221-8998-e1b3dd90569d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1756 microversion: 2.1 time: 0.164632 Jul 31 02:15:33.861246 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3500/7034] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:15:33 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:15:34.883726 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-54a0d40f-1047-4faf-897b-0083effa60cf tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:15:34.884355 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-54a0d40f-1047-4faf-897b-0083effa60cf tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:15:34.891809 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54a0d40f-1047-4faf-897b-0083effa60cf tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:34.892275 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54a0d40f-1047-4faf-897b-0083effa60cf tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:34.893846 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54a0d40f-1047-4faf-897b-0083effa60cf tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:34.894294 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-54a0d40f-1047-4faf-897b-0083effa60cf tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:35.046344 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-54a0d40f-1047-4faf-897b-0083effa60cf tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:15:35.054384 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-54a0d40f-1047-4faf-897b-0083effa60cf tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1756 microversion: 2.1 time: 0.174656 Jul 31 02:15:35.054963 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3535/7035] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:15:34 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:15:36.077200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c1cd7a2c-8596-4107-ab0c-17ca0eb8dacd tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:15:36.077839 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c1cd7a2c-8596-4107-ab0c-17ca0eb8dacd tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:15:36.085100 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1cd7a2c-8596-4107-ab0c-17ca0eb8dacd tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:36.085571 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1cd7a2c-8596-4107-ab0c-17ca0eb8dacd tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:36.086362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1cd7a2c-8596-4107-ab0c-17ca0eb8dacd tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:36.086821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1cd7a2c-8596-4107-ab0c-17ca0eb8dacd tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:36.238193 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c1cd7a2c-8596-4107-ab0c-17ca0eb8dacd tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:15:36.246440 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c1cd7a2c-8596-4107-ab0c-17ca0eb8dacd tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1756 microversion: 2.1 time: 0.173390 Jul 31 02:15:36.247025 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3501/7036] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:15:36 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:15:37.269040 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0d5f457b-e67d-4781-92a0-50e4bbabd664 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:15:37.269681 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0d5f457b-e67d-4781-92a0-50e4bbabd664 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:15:37.276599 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d5f457b-e67d-4781-92a0-50e4bbabd664 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:37.277058 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d5f457b-e67d-4781-92a0-50e4bbabd664 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:37.277836 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d5f457b-e67d-4781-92a0-50e4bbabd664 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:15:37.278284 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0d5f457b-e67d-4781-92a0-50e4bbabd664 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:15:37.418817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0d5f457b-e67d-4781-92a0-50e4bbabd664 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:15:37.427369 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0d5f457b-e67d-4781-92a0-50e4bbabd664 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1759 microversion: 2.1 time: 0.162876 Jul 31 02:15:37.427958 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3536/7037] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:15:37 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:15:59.375632 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:15:59.376204 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 02:15:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:16:09.681800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d90f45dd-172a-4e4c-899e-fc68a582be68 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1100202101"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:16:09.682360 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d90f45dd-172a-4e4c-899e-fc68a582be68 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:09.684843 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=12 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:16:09.685239 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:16:09.691744 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d90f45dd-172a-4e4c-899e-fc68a582be68 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:09.692213 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d90f45dd-172a-4e4c-899e-fc68a582be68 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:09.693011 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d90f45dd-172a-4e4c-899e-fc68a582be68 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:09.693471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d90f45dd-172a-4e4c-899e-fc68a582be68 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:09.824692 n-d-master-1 devstack@n-api.service[119474]: INFO nova.network.security_group_api [None req-d90f45dd-172a-4e4c-899e-fc68a582be68 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Removing security group d1ab44fc-8399-4223-9bf1-f7e71d319194 from port e10ab9ab-0130-4ab7-8516-a9bb1e30ac12 Jul 31 02:16:10.121073 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d90f45dd-172a-4e4c-899e-fc68a582be68 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "POST /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/action" status: 202 len: 0 microversion: 2.1 time: 0.443474 Jul 31 02:16:10.121713 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3502/7038] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:16:09 2022] POST /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 02:16:10.131445 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=12 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:16:10.132226 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=36 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:16:10.243210 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-22d1fd3b-28cf-4845-84a2-d0b8f84dae55 req-d307d9db-4bb6-4fb7-a3c0-b8c005e4bd65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a43e1d85-eb47-489e-8d9f-042f882337fc", "tag": "e10ab9ab-0130-4ab7-8516-a9bb1e30ac12"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:16:10.253650 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-22d1fd3b-28cf-4845-84a2-d0b8f84dae55 req-d307d9db-4bb6-4fb7-a3c0-b8c005e4bd65 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:10.254112 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-22d1fd3b-28cf-4845-84a2-d0b8f84dae55 req-d307d9db-4bb6-4fb7-a3c0-b8c005e4bd65 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:10.265986 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-22d1fd3b-28cf-4845-84a2-d0b8f84dae55 req-d307d9db-4bb6-4fb7-a3c0-b8c005e4bd65 service nova] Creating event network-changed:e10ab9ab-0130-4ab7-8516-a9bb1e30ac12 for instance a43e1d85-eb47-489e-8d9f-042f882337fc on n-h1-master-1 Jul 31 02:16:10.271253 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-22d1fd3b-28cf-4845-84a2-d0b8f84dae55 req-d307d9db-4bb6-4fb7-a3c0-b8c005e4bd65 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145643 Jul 31 02:16:10.272005 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3537/7039] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:16:11.835203 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a81f2e53-4ca2-44b4-bdcf-10c3d7c9a01d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:11.835744 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a81f2e53-4ca2-44b4-bdcf-10c3d7c9a01d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:11.842452 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a81f2e53-4ca2-44b4-bdcf-10c3d7c9a01d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:11.843036 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a81f2e53-4ca2-44b4-bdcf-10c3d7c9a01d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:11.844002 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a81f2e53-4ca2-44b4-bdcf-10c3d7c9a01d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:11.844465 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a81f2e53-4ca2-44b4-bdcf-10c3d7c9a01d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:11.927260 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-a81f2e53-4ca2-44b4-bdcf-10c3d7c9a01d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lazy-loading 'services' on Instance uuid a43e1d85-eb47-489e-8d9f-042f882337fc {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:16:11.999829 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a81f2e53-4ca2-44b4-bdcf-10c3d7c9a01d tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments/e70bd825-0c17-4d5a-8da7-bd9324ddd84c" status: 202 len: 0 microversion: 2.1 time: 0.169814 Jul 31 02:16:12.000424 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3503/7040] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 02:16:11 2022] DELETE /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments/e70bd825-0c17-4d5a-8da7-bd9324ddd84c => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:16:12.010341 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d5a07a06-54da-448e-bc30-16e6e28a2e38 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:12.012654 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d5a07a06-54da-448e-bc30-16e6e28a2e38 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:12.020441 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5a07a06-54da-448e-bc30-16e6e28a2e38 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:12.020908 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5a07a06-54da-448e-bc30-16e6e28a2e38 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:12.022030 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5a07a06-54da-448e-bc30-16e6e28a2e38 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:12.022669 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d5a07a06-54da-448e-bc30-16e6e28a2e38 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:12.053971 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d5a07a06-54da-448e-bc30-16e6e28a2e38 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048694 Jul 31 02:16:12.059499 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3538/7041] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:16:12 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:16:12.287399 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-2bd089fe-5fce-4d37-96cc-fed7ce3edbaf req-e14df090-15e6-4e3c-a6cc-f3dff78d1b42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a43e1d85-eb47-489e-8d9f-042f882337fc", "tag": "e10ab9ab-0130-4ab7-8516-a9bb1e30ac12"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:16:12.297261 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2bd089fe-5fce-4d37-96cc-fed7ce3edbaf req-e14df090-15e6-4e3c-a6cc-f3dff78d1b42 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:12.297726 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2bd089fe-5fce-4d37-96cc-fed7ce3edbaf req-e14df090-15e6-4e3c-a6cc-f3dff78d1b42 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:12.309427 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-2bd089fe-5fce-4d37-96cc-fed7ce3edbaf req-e14df090-15e6-4e3c-a6cc-f3dff78d1b42 service nova] Creating event network-changed:e10ab9ab-0130-4ab7-8516-a9bb1e30ac12 for instance a43e1d85-eb47-489e-8d9f-042f882337fc on n-h1-master-1 Jul 31 02:16:12.314619 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-2bd089fe-5fce-4d37-96cc-fed7ce3edbaf req-e14df090-15e6-4e3c-a6cc-f3dff78d1b42 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032137 Jul 31 02:16:12.315214 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3504/7042] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:16:13.066436 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-05cd1d48-c982-4fcb-8ea7-dc743705e50a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:13.068671 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-05cd1d48-c982-4fcb-8ea7-dc743705e50a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:13.075603 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05cd1d48-c982-4fcb-8ea7-dc743705e50a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:13.076072 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05cd1d48-c982-4fcb-8ea7-dc743705e50a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:13.076880 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05cd1d48-c982-4fcb-8ea7-dc743705e50a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:13.077330 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-05cd1d48-c982-4fcb-8ea7-dc743705e50a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:13.106739 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-05cd1d48-c982-4fcb-8ea7-dc743705e50a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044415 Jul 31 02:16:13.107312 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3539/7043] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:16:13 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:16:14.119462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-09d69b2a-f264-4c9b-96bf-fb23393ce33a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:14.121831 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-09d69b2a-f264-4c9b-96bf-fb23393ce33a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:14.130184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-09d69b2a-f264-4c9b-96bf-fb23393ce33a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:14.130662 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-09d69b2a-f264-4c9b-96bf-fb23393ce33a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:14.131488 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-09d69b2a-f264-4c9b-96bf-fb23393ce33a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:14.131951 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-09d69b2a-f264-4c9b-96bf-fb23393ce33a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:14.161211 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-09d69b2a-f264-4c9b-96bf-fb23393ce33a tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046182 Jul 31 02:16:14.161780 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3505/7044] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:16:14 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:16:15.173744 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9ba585cb-fcf4-4f43-8780-f88b5f78c1f8 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:15.176511 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9ba585cb-fcf4-4f43-8780-f88b5f78c1f8 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:15.183596 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9ba585cb-fcf4-4f43-8780-f88b5f78c1f8 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:15.184065 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9ba585cb-fcf4-4f43-8780-f88b5f78c1f8 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:15.184850 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9ba585cb-fcf4-4f43-8780-f88b5f78c1f8 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:15.185304 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9ba585cb-fcf4-4f43-8780-f88b5f78c1f8 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:15.214531 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9ba585cb-fcf4-4f43-8780-f88b5f78c1f8 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044946 Jul 31 02:16:15.215111 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3540/7045] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:16:15 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:16:16.227119 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-78e06ae0-266b-4914-8aeb-43a65afaf898 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:16.229506 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-78e06ae0-266b-4914-8aeb-43a65afaf898 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:16.236542 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78e06ae0-266b-4914-8aeb-43a65afaf898 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:16.237002 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78e06ae0-266b-4914-8aeb-43a65afaf898 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:16.237775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78e06ae0-266b-4914-8aeb-43a65afaf898 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:16.238225 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-78e06ae0-266b-4914-8aeb-43a65afaf898 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:16.270184 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-78e06ae0-266b-4914-8aeb-43a65afaf898 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045424 Jul 31 02:16:16.271301 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3506/7046] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:16:16 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:16:17.282962 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-be85f082-b131-4257-b66c-560f7816611f tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:17.285808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-be85f082-b131-4257-b66c-560f7816611f tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:17.292677 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be85f082-b131-4257-b66c-560f7816611f tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:17.293137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be85f082-b131-4257-b66c-560f7816611f tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:17.293911 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be85f082-b131-4257-b66c-560f7816611f tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:17.294359 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be85f082-b131-4257-b66c-560f7816611f tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:17.322091 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-be85f082-b131-4257-b66c-560f7816611f tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043209 Jul 31 02:16:17.322644 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3541/7047] 10.222.0.45 () {58 vars in 1302 bytes} [Sun Jul 31 02:16:17 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 02:16:17.333614 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-36fb9c56-8bdb-4f01-94ce-f6c6fc0cfb4c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:17.334133 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-36fb9c56-8bdb-4f01-94ce-f6c6fc0cfb4c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:17.341120 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-36fb9c56-8bdb-4f01-94ce-f6c6fc0cfb4c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:17.341595 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-36fb9c56-8bdb-4f01-94ce-f6c6fc0cfb4c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:17.342384 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-36fb9c56-8bdb-4f01-94ce-f6c6fc0cfb4c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:17.342844 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-36fb9c56-8bdb-4f01-94ce-f6c6fc0cfb4c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:17.416937 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-36fb9c56-8bdb-4f01-94ce-f6c6fc0cfb4c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] HTTP exception thrown: Instance a43e1d85-eb47-489e-8d9f-042f882337fc is not attached to volume e70bd825-0c17-4d5a-8da7-bd9324ddd84c Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-36fb9c56-8bdb-4f01-94ce-f6c6fc0cfb4c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Request method failure captured: Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: request: DELETE /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments/e70bd825-0c17-4d5a-8da7-bd9324ddd84c HTTP/1.1 Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eSPOQA4FJc-qXPxhJhp7qRwkzs74IWlVJ5E11hrI3GGPqfZrHMaJtwW1lBflPvJAeRiOkwlUIfYBPmcmfacAvRiH2r5tzVJQCgEddJZYExSuzVzZgYVY17z0DlhgwmMKnnv2732rLDKJ1g6nPUPtTbyFPzdHD-x7qsYvwQXb_JFvg8 Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 8d5d5e2f24ed48ffa0d75192e744bfe1 Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestMinimumBasicScenario-1962853026 Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8d5d5e2f24ed48ffa0d75192e744bfe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8d5d5e2f24ed48ffa0d75192e744bfe1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8d5d5e2f24ed48ffa0d75192e744bfe1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8d5d5e2f24ed48ffa0d75192e744bfe1", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestMinimumBasicScenario-1962853026 Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 8d5d5e2f24ed48ffa0d75192e744bfe1 Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1962853026 Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestMinimumBasicScenario-1962853026-project Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 964a6df6b450426da030f2519fe9a62f Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestMinimumBasicScenario-1962853026-project Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: exception: Instance a43e1d85-eb47-489e-8d9f-042f882337fc is not attached to volume e70bd825-0c17-4d5a-8da7-bd9324ddd84c Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: action_args: {'server_id': 'a43e1d85-eb47-489e-8d9f-042f882337fc', 'id': 'e70bd825-0c17-4d5a-8da7-bd9324ddd84c'} Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e70bd825-0c17-4d5a-8da7-bd9324ddd84c. Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a43e1d85-eb47-489e-8d9f-042f882337fc is not attached to volume e70bd825-0c17-4d5a-8da7-bd9324ddd84c Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:16:17.418568 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:16:17.422786 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:16:17.422786 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:16:17.422786 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a43e1d85-eb47-489e-8d9f-042f882337fc is not attached to volume e70bd825-0c17-4d5a-8da7-bd9324ddd84c Jul 31 02:16:17.422786 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:16:17.422786 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-36fb9c56-8bdb-4f01-94ce-f6c6fc0cfb4c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Returning 404 to user: Instance a43e1d85-eb47-489e-8d9f-042f882337fc is not attached to volume e70bd825-0c17-4d5a-8da7-bd9324ddd84c {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:16:17.422786 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-36fb9c56-8bdb-4f01-94ce-f6c6fc0cfb4c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments/e70bd825-0c17-4d5a-8da7-bd9324ddd84c" status: 404 len: 154 microversion: 2.1 time: 0.090979 Jul 31 02:16:17.422786 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3507/7048] 10.222.0.45 () {58 vars in 1416 bytes} [Sun Jul 31 02:16:17 2022] DELETE /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc/os-volume_attachments/e70bd825-0c17-4d5a-8da7-bd9324ddd84c => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:16:20.669303 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-10006056-7977-49f3-b9ff-067909fa6c24 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:20.669820 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-10006056-7977-49f3-b9ff-067909fa6c24 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:20.677086 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10006056-7977-49f3-b9ff-067909fa6c24 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:20.677554 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10006056-7977-49f3-b9ff-067909fa6c24 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:20.678352 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10006056-7977-49f3-b9ff-067909fa6c24 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:20.678801 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10006056-7977-49f3-b9ff-067909fa6c24 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:20.709224 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-10006056-7977-49f3-b9ff-067909fa6c24 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:16:20.789810 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-10006056-7977-49f3-b9ff-067909fa6c24 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 204 len: 0 microversion: 2.1 time: 0.124087 Jul 31 02:16:20.790779 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3542/7049] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:16:20 2022] DELETE /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:16:20.799310 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6452f4c6-7d9e-499f-b6c5-1fa313fd29b1 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:20.800593 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6452f4c6-7d9e-499f-b6c5-1fa313fd29b1 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:20.807293 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6452f4c6-7d9e-499f-b6c5-1fa313fd29b1 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:20.807804 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6452f4c6-7d9e-499f-b6c5-1fa313fd29b1 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:20.808767 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6452f4c6-7d9e-499f-b6c5-1fa313fd29b1 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:20.809220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6452f4c6-7d9e-499f-b6c5-1fa313fd29b1 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:20.944521 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6452f4c6-7d9e-499f-b6c5-1fa313fd29b1 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:16:20.952177 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6452f4c6-7d9e-499f-b6c5-1fa313fd29b1 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1553 microversion: 2.1 time: 0.156988 Jul 31 02:16:20.952758 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3508/7050] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:16:20 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:16:21.974016 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1bd64a9d-9645-419d-898c-1f770f93e19c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:21.974658 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1bd64a9d-9645-419d-898c-1f770f93e19c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:21.981541 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bd64a9d-9645-419d-898c-1f770f93e19c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:21.982068 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bd64a9d-9645-419d-898c-1f770f93e19c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:21.982861 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bd64a9d-9645-419d-898c-1f770f93e19c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:21.983307 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1bd64a9d-9645-419d-898c-1f770f93e19c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:22.121338 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1bd64a9d-9645-419d-898c-1f770f93e19c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:16:22.129758 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1bd64a9d-9645-419d-898c-1f770f93e19c tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1553 microversion: 2.1 time: 0.160703 Jul 31 02:16:22.130331 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3543/7051] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:16:21 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:16:22.994755 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-4d7fdec1-bc0f-4c6f-b007-7d8a4ba1cbb6 req-d98bbde6-cecc-4f46-b83e-dae59d0c6d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43e1d85-eb47-489e-8d9f-042f882337fc", "name": "network-vif-deleted", "tag": "e10ab9ab-0130-4ab7-8516-a9bb1e30ac12"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:16:23.009661 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-4d7fdec1-bc0f-4c6f-b007-7d8a4ba1cbb6 req-d98bbde6-cecc-4f46-b83e-dae59d0c6d37 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:23.010033 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-4d7fdec1-bc0f-4c6f-b007-7d8a4ba1cbb6 req-d98bbde6-cecc-4f46-b83e-dae59d0c6d37 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:23.024637 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-4d7fdec1-bc0f-4c6f-b007-7d8a4ba1cbb6 req-d98bbde6-cecc-4f46-b83e-dae59d0c6d37 service nova] Creating event network-vif-deleted:e10ab9ab-0130-4ab7-8516-a9bb1e30ac12 for instance a43e1d85-eb47-489e-8d9f-042f882337fc on n-h1-master-1 Jul 31 02:16:23.032316 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-4d7fdec1-bc0f-4c6f-b007-7d8a4ba1cbb6 req-d98bbde6-cecc-4f46-b83e-dae59d0c6d37 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041281 Jul 31 02:16:23.033035 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3509/7052] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:16:23.151698 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5cfb3dc2-536e-4919-8851-7a20ddba169e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:23.152335 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5cfb3dc2-536e-4919-8851-7a20ddba169e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:23.159660 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5cfb3dc2-536e-4919-8851-7a20ddba169e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:23.160322 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5cfb3dc2-536e-4919-8851-7a20ddba169e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:23.161161 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5cfb3dc2-536e-4919-8851-7a20ddba169e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:23.161682 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5cfb3dc2-536e-4919-8851-7a20ddba169e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:23.197197 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5cfb3dc2-536e-4919-8851-7a20ddba169e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:23.197713 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5cfb3dc2-536e-4919-8851-7a20ddba169e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:23.198133 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-5cfb3dc2-536e-4919-8851-7a20ddba169e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lazy-loading 'fault' on Instance uuid a43e1d85-eb47-489e-8d9f-042f882337fc {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:16:23.243117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5cfb3dc2-536e-4919-8851-7a20ddba169e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '964a6df6b450426da030f2519fe9a62f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5d5e2f24ed48ffa0d75192e744bfe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:16:23.250822 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5cfb3dc2-536e-4919-8851-7a20ddba169e tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 200 len: 1347 microversion: 2.1 time: 0.103117 Jul 31 02:16:23.251417 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3544/7053] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:16:23 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 1347 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:16:24.274506 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-15690d5c-469c-42c8-b77c-529ddbfa3dab tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:24.275233 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-15690d5c-469c-42c8-b77c-529ddbfa3dab tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] [instance: a43e1d85-eb47-489e-8d9f-042f882337fc] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:24.283048 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15690d5c-469c-42c8-b77c-529ddbfa3dab tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:24.283571 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15690d5c-469c-42c8-b77c-529ddbfa3dab tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:24.284356 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15690d5c-469c-42c8-b77c-529ddbfa3dab tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:24.284816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-15690d5c-469c-42c8-b77c-529ddbfa3dab tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:24.298272 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-15690d5c-469c-42c8-b77c-529ddbfa3dab tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] HTTP exception thrown: Instance a43e1d85-eb47-489e-8d9f-042f882337fc could not be found. Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-15690d5c-469c-42c8-b77c-529ddbfa3dab tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Request method failure captured: Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc HTTP/1.1 Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eSPOQA4FJc-qXPxhJhp7qRwkzs74IWlVJ5E11hrI3GGPqfZrHMaJtwW1lBflPvJAeRiOkwlUIfYBPmcmfacAvRiH2r5tzVJQCgEddJZYExSuzVzZgYVY17z0DlhgwmMKnnv2732rLDKJ1g6nPUPtTbyFPzdHD-x7qsYvwQXb_JFvg8 Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 8d5d5e2f24ed48ffa0d75192e744bfe1 Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestMinimumBasicScenario-1962853026 Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8d5d5e2f24ed48ffa0d75192e744bfe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8d5d5e2f24ed48ffa0d75192e744bfe1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8d5d5e2f24ed48ffa0d75192e744bfe1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8d5d5e2f24ed48ffa0d75192e744bfe1", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestMinimumBasicScenario-1962853026 Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 8d5d5e2f24ed48ffa0d75192e744bfe1 Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1962853026 Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestMinimumBasicScenario-1962853026-project Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 964a6df6b450426da030f2519fe9a62f Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestMinimumBasicScenario-1962853026-project Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: exception: Instance a43e1d85-eb47-489e-8d9f-042f882337fc could not be found. Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'a43e1d85-eb47-489e-8d9f-042f882337fc'} Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a43e1d85-eb47-489e-8d9f-042f882337fc could not be found. Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a43e1d85-eb47-489e-8d9f-042f882337fc could not be found. Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:16:24.299913 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:16:24.303867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:16:24.303867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:16:24.303867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:16:24.303867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:16:24.303867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:16:24.303867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a43e1d85-eb47-489e-8d9f-042f882337fc could not be found. Jul 31 02:16:24.303867 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:16:24.303867 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-15690d5c-469c-42c8-b77c-529ddbfa3dab tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Returning 404 to user: Instance a43e1d85-eb47-489e-8d9f-042f882337fc could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:16:24.303867 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-15690d5c-469c-42c8-b77c-529ddbfa3dab tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc" status: 404 len: 111 microversion: 2.1 time: 0.031418 Jul 31 02:16:24.303867 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3510/7054] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:16:24 2022] GET /compute/v2.1/servers/a43e1d85-eb47-489e-8d9f-042f882337fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:16:24.309879 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-38aab14e-a603-430d-a578-7d3d9ccfa305 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] Calling method '.version_select at 0x7fedeaa38b80>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:24.330946 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-38aab14e-a603-430d-a578-7d3d9ccfa305 tempest-TestMinimumBasicScenario-1962853026 tempest-TestMinimumBasicScenario-1962853026-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-172596802" status: 202 len: 0 microversion: 2.1 time: 0.024305 Jul 31 02:16:24.331561 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3545/7055] 10.222.0.45 () {58 vars in 1269 bytes} [Sun Jul 31 02:16:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-172596802 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:16:33.505847 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7995edd2-e1c3-4d0b-9230-2e968b49c3e5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'create', calling method: .version_select at 0x7fede552eaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1694630980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFORjQeBPFmSSw+4e+EJlmYg98FMtJ6L5v3vJmnmYLnwUzeXU0twyg7t/qp/THUa4zjfWTP6prtRq8QtvNv4ne9QzYmvzHEobGY5YFhLluRC0NKfFwK0YzvItjyqCZxcNQ=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:16:33.521577 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-7995edd2-e1c3-4d0b-9230-2e968b49c3e5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for project 14c964a9135b44f2b83dba23842472cd. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:16:33.527617 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-7995edd2-e1c3-4d0b-9230-2e968b49c3e5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for user b070525312804b0bb43370f12c449697 and project 14c964a9135b44f2b83dba23842472cd. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:16:33.550798 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7995edd2-e1c3-4d0b-9230-2e968b49c3e5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.208040 Jul 31 02:16:33.551536 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3511/7056] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 02:16:33 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:16:39.231127 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:16:39.231927 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:16:39.236060 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3e20ffd7-55f8-4d65-ae91-61b015bac01a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-709677274", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "f78cdf28-a915-47dc-8dd3-e64e5c7f34ea"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1694630980", "security_groups": [{"name": "tempest-secgroup-smoke-160702818"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:16:39.374793 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-3e20ffd7-55f8-4d65-ae91-61b015bac01a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] validate_networks() for [('f78cdf28-a915-47dc-8dd3-e64e5c7f34ea', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:16:39.834397 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-3e20ffd7-55f8-4d65-ae91-61b015bac01a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:16:39.834839 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-3e20ffd7-55f8-4d65-ae91-61b015bac01a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:16:39.835404 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-3e20ffd7-55f8-4d65-ae91-61b015bac01a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:16:39.835924 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-3e20ffd7-55f8-4d65-ae91-61b015bac01a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:16:39.836386 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-3e20ffd7-55f8-4d65-ae91-61b015bac01a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:16:39.847240 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e20ffd7-55f8-4d65-ae91-61b015bac01a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:39.847741 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e20ffd7-55f8-4d65-ae91-61b015bac01a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:39.848565 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e20ffd7-55f8-4d65-ae91-61b015bac01a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:39.849016 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3e20ffd7-55f8-4d65-ae91-61b015bac01a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:39.867501 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-3e20ffd7-55f8-4d65-ae91-61b015bac01a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for project 14c964a9135b44f2b83dba23842472cd. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:16:39.872966 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-3e20ffd7-55f8-4d65-ae91-61b015bac01a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for user b070525312804b0bb43370f12c449697 and project 14c964a9135b44f2b83dba23842472cd. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:16:39.886197 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3e20ffd7-55f8-4d65-ae91-61b015bac01a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:16:39.888538 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3e20ffd7-55f8-4d65-ae91-61b015bac01a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:16:39.937960 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3e20ffd7-55f8-4d65-ae91-61b015bac01a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.708898 Jul 31 02:16:39.938937 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3546/7057] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:16:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:16:39.947215 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:16:39.953180 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0fa0af2b-eee3-49de-b194-5cc4b88329fa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:39.954094 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0fa0af2b-eee3-49de-b194-5cc4b88329fa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:39.960517 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:16:40.031291 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0fa0af2b-eee3-49de-b194-5cc4b88329fa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:16:40.041615 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0fa0af2b-eee3-49de-b194-5cc4b88329fa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1266 microversion: 2.1 time: 0.095059 Jul 31 02:16:40.042575 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3512/7058] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:16:39 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:16:41.063891 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d360fc40-e529-4562-a538-e5b246e50b17 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:41.064531 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d360fc40-e529-4562-a538-e5b246e50b17 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:41.072566 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d360fc40-e529-4562-a538-e5b246e50b17 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:41.073032 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d360fc40-e529-4562-a538-e5b246e50b17 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:41.073831 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d360fc40-e529-4562-a538-e5b246e50b17 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:41.074280 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d360fc40-e529-4562-a538-e5b246e50b17 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:41.142775 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d360fc40-e529-4562-a538-e5b246e50b17 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:16:41.153917 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d360fc40-e529-4562-a538-e5b246e50b17 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1318 microversion: 2.1 time: 0.093963 Jul 31 02:16:41.154713 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3547/7059] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:16:41 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1318 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:16:42.176885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bacdf198-793e-4a99-89ab-0b07718079b5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:42.177521 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bacdf198-793e-4a99-89ab-0b07718079b5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:42.185126 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bacdf198-793e-4a99-89ab-0b07718079b5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:42.185535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bacdf198-793e-4a99-89ab-0b07718079b5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:42.186355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bacdf198-793e-4a99-89ab-0b07718079b5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:42.186810 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bacdf198-793e-4a99-89ab-0b07718079b5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:42.411697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bacdf198-793e-4a99-89ab-0b07718079b5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:16:42.419036 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bacdf198-793e-4a99-89ab-0b07718079b5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1391 microversion: 2.1 time: 0.246783 Jul 31 02:16:42.419638 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3513/7060] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:16:42 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1391 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:16:42.724977 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-05bda4da-ffa9-4133-820b-d9ce4c70c507 req-f61381d0-b259-4f77-b932-11e24c1457bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c087f883-b146-4db7-b34a-09208e3226af", "tag": "1c33ec10-749f-49e5-b271-c12ad5b8c35d"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:16:42.735110 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-05bda4da-ffa9-4133-820b-d9ce4c70c507 req-f61381d0-b259-4f77-b932-11e24c1457bb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:42.735843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-05bda4da-ffa9-4133-820b-d9ce4c70c507 req-f61381d0-b259-4f77-b932-11e24c1457bb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:42.747663 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-05bda4da-ffa9-4133-820b-d9ce4c70c507 req-f61381d0-b259-4f77-b932-11e24c1457bb service nova] Creating event network-changed:1c33ec10-749f-49e5-b271-c12ad5b8c35d for instance c087f883-b146-4db7-b34a-09208e3226af on n-h2-master-1 Jul 31 02:16:42.753946 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-05bda4da-ffa9-4133-820b-d9ce4c70c507 req-f61381d0-b259-4f77-b932-11e24c1457bb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033417 Jul 31 02:16:42.755157 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3548/7061] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:16:43.441751 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c12e534e-72dd-4640-a60f-6567cc558e56 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:43.442392 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c12e534e-72dd-4640-a60f-6567cc558e56 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:43.449503 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c12e534e-72dd-4640-a60f-6567cc558e56 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:43.449976 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c12e534e-72dd-4640-a60f-6567cc558e56 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:43.450766 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c12e534e-72dd-4640-a60f-6567cc558e56 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:43.451225 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c12e534e-72dd-4640-a60f-6567cc558e56 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:43.582939 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c12e534e-72dd-4640-a60f-6567cc558e56 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:16:43.590553 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c12e534e-72dd-4640-a60f-6567cc558e56 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1391 microversion: 2.1 time: 0.153358 Jul 31 02:16:43.591126 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3514/7062] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:16:43 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:16:44.613204 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-184ca192-cb10-460d-baa6-9efb0bd5da44 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:44.613845 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-184ca192-cb10-460d-baa6-9efb0bd5da44 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:44.620192 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-184ca192-cb10-460d-baa6-9efb0bd5da44 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:44.620652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-184ca192-cb10-460d-baa6-9efb0bd5da44 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:44.621422 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-184ca192-cb10-460d-baa6-9efb0bd5da44 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:44.621869 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-184ca192-cb10-460d-baa6-9efb0bd5da44 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:44.761903 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-184ca192-cb10-460d-baa6-9efb0bd5da44 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:16:44.770048 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-184ca192-cb10-460d-baa6-9efb0bd5da44 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1391 microversion: 2.1 time: 0.161991 Jul 31 02:16:44.770636 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3549/7063] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:16:44 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:16:45.790406 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a701162a-f794-46bc-afcd-8a84ebb8c2fb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:45.791124 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a701162a-f794-46bc-afcd-8a84ebb8c2fb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:45.798166 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a701162a-f794-46bc-afcd-8a84ebb8c2fb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:45.799294 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a701162a-f794-46bc-afcd-8a84ebb8c2fb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:45.800098 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a701162a-f794-46bc-afcd-8a84ebb8c2fb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:45.800545 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a701162a-f794-46bc-afcd-8a84ebb8c2fb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:45.934342 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a701162a-f794-46bc-afcd-8a84ebb8c2fb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:16:45.942722 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a701162a-f794-46bc-afcd-8a84ebb8c2fb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1391 microversion: 2.1 time: 0.156384 Jul 31 02:16:45.943418 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3515/7064] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:16:45 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:16:46.963854 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c514e5c3-a66d-44d3-9a34-63c6eedc5858 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:46.964473 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c514e5c3-a66d-44d3-9a34-63c6eedc5858 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:46.971828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c514e5c3-a66d-44d3-9a34-63c6eedc5858 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:46.971828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c514e5c3-a66d-44d3-9a34-63c6eedc5858 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:46.972666 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c514e5c3-a66d-44d3-9a34-63c6eedc5858 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:46.972884 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c514e5c3-a66d-44d3-9a34-63c6eedc5858 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:47.108474 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c514e5c3-a66d-44d3-9a34-63c6eedc5858 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:16:47.116517 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c514e5c3-a66d-44d3-9a34-63c6eedc5858 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1391 microversion: 2.1 time: 0.156580 Jul 31 02:16:47.117097 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3550/7065] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:16:46 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:16:47.261462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-a01df3c7-9b6b-4dc9-8af4-0bba37737758 req-99e71b05-c104-46c1-9bad-86aa47f417fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c087f883-b146-4db7-b34a-09208e3226af", "name": "network-vif-plugged", "status": "completed", "tag": "1c33ec10-749f-49e5-b271-c12ad5b8c35d"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:16:47.271170 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a01df3c7-9b6b-4dc9-8af4-0bba37737758 req-99e71b05-c104-46c1-9bad-86aa47f417fe service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:47.271665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-a01df3c7-9b6b-4dc9-8af4-0bba37737758 req-99e71b05-c104-46c1-9bad-86aa47f417fe service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:47.282769 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-a01df3c7-9b6b-4dc9-8af4-0bba37737758 req-99e71b05-c104-46c1-9bad-86aa47f417fe service nova] Creating event network-vif-plugged:1c33ec10-749f-49e5-b271-c12ad5b8c35d for instance c087f883-b146-4db7-b34a-09208e3226af on n-h2-master-1 Jul 31 02:16:47.287719 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-a01df3c7-9b6b-4dc9-8af4-0bba37737758 req-99e71b05-c104-46c1-9bad-86aa47f417fe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085590 Jul 31 02:16:47.288300 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3516/7066] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:16:48.138085 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6145e289-72c7-4c0a-a395-8286f1334f50 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:48.138727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6145e289-72c7-4c0a-a395-8286f1334f50 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:48.148098 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6145e289-72c7-4c0a-a395-8286f1334f50 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:48.148759 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6145e289-72c7-4c0a-a395-8286f1334f50 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:48.149842 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6145e289-72c7-4c0a-a395-8286f1334f50 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:48.150422 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6145e289-72c7-4c0a-a395-8286f1334f50 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:48.281307 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6145e289-72c7-4c0a-a395-8286f1334f50 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:16:48.288735 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6145e289-72c7-4c0a-a395-8286f1334f50 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1391 microversion: 2.1 time: 0.154636 Jul 31 02:16:48.289307 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3551/7067] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:16:48 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:16:49.311190 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-621347f5-06ab-48c3-897c-47dbfa5a02ee tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:49.311959 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-621347f5-06ab-48c3-897c-47dbfa5a02ee tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:49.318598 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-621347f5-06ab-48c3-897c-47dbfa5a02ee tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:49.319085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-621347f5-06ab-48c3-897c-47dbfa5a02ee tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:49.319998 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-621347f5-06ab-48c3-897c-47dbfa5a02ee tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:49.320459 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-621347f5-06ab-48c3-897c-47dbfa5a02ee tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:49.468751 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-621347f5-06ab-48c3-897c-47dbfa5a02ee tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:16:49.477677 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-621347f5-06ab-48c3-897c-47dbfa5a02ee tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1561 microversion: 2.1 time: 0.171887 Jul 31 02:16:49.478360 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3517/7068] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:16:49 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:16:49.502345 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1dd02788-d21e-473c-93ca-5c5bf7df0366 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:49.502963 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1dd02788-d21e-473c-93ca-5c5bf7df0366 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:49.509826 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1dd02788-d21e-473c-93ca-5c5bf7df0366 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:49.510283 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1dd02788-d21e-473c-93ca-5c5bf7df0366 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:49.511050 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1dd02788-d21e-473c-93ca-5c5bf7df0366 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:49.511553 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1dd02788-d21e-473c-93ca-5c5bf7df0366 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:49.653058 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1dd02788-d21e-473c-93ca-5c5bf7df0366 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:16:49.664369 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1dd02788-d21e-473c-93ca-5c5bf7df0366 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1561 microversion: 2.1 time: 0.166099 Jul 31 02:16:49.665263 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3552/7069] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:16:49 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:16:51.560322 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-c88800a7-a82e-47d2-84a0-c07df4d9f7ea req-ac4aa685-4bea-4161-937d-e224e67fd188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c087f883-b146-4db7-b34a-09208e3226af", "tag": "1c33ec10-749f-49e5-b271-c12ad5b8c35d"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:16:51.565712 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4218fdd3-fc71-43f6-9ac8-7b7a541ed7fc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:16:51.566360 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4218fdd3-fc71-43f6-9ac8-7b7a541ed7fc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:16:51.568457 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:16:51.574106 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:16:51.574782 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:16:51.580807 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4218fdd3-fc71-43f6-9ac8-7b7a541ed7fc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:51.581280 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4218fdd3-fc71-43f6-9ac8-7b7a541ed7fc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:51.582091 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4218fdd3-fc71-43f6-9ac8-7b7a541ed7fc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:51.582545 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4218fdd3-fc71-43f6-9ac8-7b7a541ed7fc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:51.588722 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c88800a7-a82e-47d2-84a0-c07df4d9f7ea req-ac4aa685-4bea-4161-937d-e224e67fd188 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:16:51.589196 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-c88800a7-a82e-47d2-84a0-c07df4d9f7ea req-ac4aa685-4bea-4161-937d-e224e67fd188 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:16:51.606592 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-c88800a7-a82e-47d2-84a0-c07df4d9f7ea req-ac4aa685-4bea-4161-937d-e224e67fd188 service nova] Creating event network-changed:1c33ec10-749f-49e5-b271-c12ad5b8c35d for instance c087f883-b146-4db7-b34a-09208e3226af on n-h2-master-1 Jul 31 02:16:51.612258 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-c88800a7-a82e-47d2-84a0-c07df4d9f7ea req-ac4aa685-4bea-4161-937d-e224e67fd188 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055511 Jul 31 02:16:51.613439 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3553/7070] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:16:51.819849 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4218fdd3-fc71-43f6-9ac8-7b7a541ed7fc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:16:51.832087 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4218fdd3-fc71-43f6-9ac8-7b7a541ed7fc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1561 microversion: 2.1 time: 0.279049 Jul 31 02:16:51.833250 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3518/7071] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:16:51 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1561 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:13.096508 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:17:13.097357 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=36 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:17:13.101546 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4edfc672-174d-47db-92d6-c8418d37b92f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:17:13.103838 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4edfc672-174d-47db-92d6-c8418d37b92f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:13.111414 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4edfc672-174d-47db-92d6-c8418d37b92f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:13.111877 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4edfc672-174d-47db-92d6-c8418d37b92f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:13.112637 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4edfc672-174d-47db-92d6-c8418d37b92f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:13.113077 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4edfc672-174d-47db-92d6-c8418d37b92f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:13.175079 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4edfc672-174d-47db-92d6-c8418d37b92f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af/action" status: 200 len: 24571 microversion: 2.1 time: 0.080246 Jul 31 02:17:13.175834 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3554/7072] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:17:13 2022] POST /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af/action => generated 24571 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 02:17:19.636501 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-28fd4c60-f17d-44e7-958e-25a399009ac3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:17:19.637082 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-28fd4c60-f17d-44e7-958e-25a399009ac3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:19.639232 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=15 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:17:19.639990 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=32 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:17:19.646740 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28fd4c60-f17d-44e7-958e-25a399009ac3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:19.647228 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28fd4c60-f17d-44e7-958e-25a399009ac3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:19.648037 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28fd4c60-f17d-44e7-958e-25a399009ac3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:19.648485 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28fd4c60-f17d-44e7-958e-25a399009ac3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:19.717750 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-28fd4c60-f17d-44e7-958e-25a399009ac3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af/action" status: 202 len: 0 microversion: 2.1 time: 0.085343 Jul 31 02:17:19.718831 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3519/7073] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:17:19 2022] POST /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:17:19.727279 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f499ee14-b2eb-428d-a636-da20ad4498aa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:19.728023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f499ee14-b2eb-428d-a636-da20ad4498aa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:19.735783 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f499ee14-b2eb-428d-a636-da20ad4498aa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:19.736232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f499ee14-b2eb-428d-a636-da20ad4498aa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:19.737019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f499ee14-b2eb-428d-a636-da20ad4498aa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:19.737465 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f499ee14-b2eb-428d-a636-da20ad4498aa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:19.870699 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f499ee14-b2eb-428d-a636-da20ad4498aa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:19.878976 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f499ee14-b2eb-428d-a636-da20ad4498aa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1684 microversion: 2.1 time: 0.155908 Jul 31 02:17:19.879575 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3555/7074] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:19 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:20.901467 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-854e36a2-6c97-4fdc-8f97-152ab4bbef9f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:20.902100 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-854e36a2-6c97-4fdc-8f97-152ab4bbef9f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:20.910680 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-854e36a2-6c97-4fdc-8f97-152ab4bbef9f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:20.911140 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-854e36a2-6c97-4fdc-8f97-152ab4bbef9f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:20.912651 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-854e36a2-6c97-4fdc-8f97-152ab4bbef9f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:20.913121 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-854e36a2-6c97-4fdc-8f97-152ab4bbef9f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:21.048144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-854e36a2-6c97-4fdc-8f97-152ab4bbef9f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:21.055590 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-854e36a2-6c97-4fdc-8f97-152ab4bbef9f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1664 microversion: 2.1 time: 0.158418 Jul 31 02:17:21.056156 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3520/7075] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:20 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:22.146909 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5d5ba7a3-b3f0-44a8-88c5-f110c014b8bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:17:22.149263 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5d5ba7a3-b3f0-44a8-88c5-f110c014b8bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:22.160468 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d5ba7a3-b3f0-44a8-88c5-f110c014b8bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:22.160925 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d5ba7a3-b3f0-44a8-88c5-f110c014b8bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:22.161700 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d5ba7a3-b3f0-44a8-88c5-f110c014b8bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:22.162145 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5d5ba7a3-b3f0-44a8-88c5-f110c014b8bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:22.223235 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5d5ba7a3-b3f0-44a8-88c5-f110c014b8bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af/action" status: 200 len: 32646 microversion: 2.1 time: 0.080152 Jul 31 02:17:22.224050 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3556/7076] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:17:22 2022] POST /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af/action => generated 32646 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 02:17:22.235411 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0a06b7b6-5090-464a-8e7a-d7e1159f5d42 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:17:22.235969 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0a06b7b6-5090-464a-8e7a-d7e1159f5d42 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:22.243535 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a06b7b6-5090-464a-8e7a-d7e1159f5d42 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:22.244011 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a06b7b6-5090-464a-8e7a-d7e1159f5d42 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:22.244796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a06b7b6-5090-464a-8e7a-d7e1159f5d42 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:22.245254 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0a06b7b6-5090-464a-8e7a-d7e1159f5d42 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:22.310886 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0a06b7b6-5090-464a-8e7a-d7e1159f5d42 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af/action" status: 202 len: 0 microversion: 2.1 time: 0.079186 Jul 31 02:17:22.311597 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3521/7077] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:17:22 2022] POST /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:17:22.320348 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a9559a28-dda3-487a-93a9-e973a190688a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:22.321055 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a9559a28-dda3-487a-93a9-e973a190688a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:22.328094 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9559a28-dda3-487a-93a9-e973a190688a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:22.328566 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9559a28-dda3-487a-93a9-e973a190688a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:22.329397 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9559a28-dda3-487a-93a9-e973a190688a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:22.329760 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a9559a28-dda3-487a-93a9-e973a190688a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:22.464236 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a9559a28-dda3-487a-93a9-e973a190688a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:22.471668 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a9559a28-dda3-487a-93a9-e973a190688a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1671 microversion: 2.1 time: 0.155484 Jul 31 02:17:22.472897 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3557/7078] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:22 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:23.494874 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9f7fef0a-c289-45b6-a86d-3080fc06d571 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:23.495622 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9f7fef0a-c289-45b6-a86d-3080fc06d571 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:23.503556 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f7fef0a-c289-45b6-a86d-3080fc06d571 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:23.503983 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f7fef0a-c289-45b6-a86d-3080fc06d571 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:23.504775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f7fef0a-c289-45b6-a86d-3080fc06d571 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:23.505235 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f7fef0a-c289-45b6-a86d-3080fc06d571 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:23.643943 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9f7fef0a-c289-45b6-a86d-3080fc06d571 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:23.652092 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9f7fef0a-c289-45b6-a86d-3080fc06d571 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1679 microversion: 2.1 time: 0.161526 Jul 31 02:17:23.652665 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3522/7079] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:23 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:23.744460 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9cf9c0a3-6284-409f-94b2-8c799e44d981 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:17:23.746806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9cf9c0a3-6284-409f-94b2-8c799e44d981 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:23.755413 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9cf9c0a3-6284-409f-94b2-8c799e44d981 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:23.755868 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9cf9c0a3-6284-409f-94b2-8c799e44d981 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:23.756663 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9cf9c0a3-6284-409f-94b2-8c799e44d981 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:23.757103 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9cf9c0a3-6284-409f-94b2-8c799e44d981 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:23.819454 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9cf9c0a3-6284-409f-94b2-8c799e44d981 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af/action" status: 200 len: 35260 microversion: 2.1 time: 0.078769 Jul 31 02:17:23.820124 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3558/7080] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:17:23 2022] POST /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af/action => generated 35260 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 02:17:24.863786 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f4013a0f-80a7-4836-b843-b5ad888c76b1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:24.864301 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f4013a0f-80a7-4836-b843-b5ad888c76b1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:24.867018 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-277f1d61-f88d-4f0d-8958-ceac4f336a65 req-ebb807e3-5758-4a58-9b6b-b2ebb6a1d0fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c087f883-b146-4db7-b34a-09208e3226af", "tag": "1c33ec10-749f-49e5-b271-c12ad5b8c35d"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:17:24.871710 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4013a0f-80a7-4836-b843-b5ad888c76b1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:24.872400 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4013a0f-80a7-4836-b843-b5ad888c76b1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:24.873200 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4013a0f-80a7-4836-b843-b5ad888c76b1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:24.873662 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4013a0f-80a7-4836-b843-b5ad888c76b1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:24.878935 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-277f1d61-f88d-4f0d-8958-ceac4f336a65 req-ebb807e3-5758-4a58-9b6b-b2ebb6a1d0fb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:24.879668 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-277f1d61-f88d-4f0d-8958-ceac4f336a65 req-ebb807e3-5758-4a58-9b6b-b2ebb6a1d0fb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:24.891263 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-277f1d61-f88d-4f0d-8958-ceac4f336a65 req-ebb807e3-5758-4a58-9b6b-b2ebb6a1d0fb service nova] Creating event network-changed:1c33ec10-749f-49e5-b271-c12ad5b8c35d for instance c087f883-b146-4db7-b34a-09208e3226af on n-h2-master-1 Jul 31 02:17:24.897042 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-277f1d61-f88d-4f0d-8958-ceac4f336a65 req-ebb807e3-5758-4a58-9b6b-b2ebb6a1d0fb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034306 Jul 31 02:17:24.897676 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3559/7081] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:17:24.906868 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f4013a0f-80a7-4836-b843-b5ad888c76b1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:17:24.994676 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f4013a0f-80a7-4836-b843-b5ad888c76b1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 204 len: 0 microversion: 2.1 time: 0.134314 Jul 31 02:17:24.995658 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3523/7082] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:17:24 2022] DELETE /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:17:25.006313 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b520e887-5bbf-433b-bdc2-ec876737d953 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:25.007083 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b520e887-5bbf-433b-bdc2-ec876737d953 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:25.017155 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b520e887-5bbf-433b-bdc2-ec876737d953 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:25.017675 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b520e887-5bbf-433b-bdc2-ec876737d953 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:25.019240 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b520e887-5bbf-433b-bdc2-ec876737d953 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:25.019725 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b520e887-5bbf-433b-bdc2-ec876737d953 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:25.188320 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b520e887-5bbf-433b-bdc2-ec876737d953 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:25.196863 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b520e887-5bbf-433b-bdc2-ec876737d953 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1685 microversion: 2.1 time: 0.195978 Jul 31 02:17:25.197431 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3560/7083] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:24 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1685 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:26.218768 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5c3a86f8-4ab4-40a7-91d5-99ffdb7117e3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:26.219462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5c3a86f8-4ab4-40a7-91d5-99ffdb7117e3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:26.227111 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c3a86f8-4ab4-40a7-91d5-99ffdb7117e3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:26.227610 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c3a86f8-4ab4-40a7-91d5-99ffdb7117e3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:26.228391 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c3a86f8-4ab4-40a7-91d5-99ffdb7117e3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:26.228846 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c3a86f8-4ab4-40a7-91d5-99ffdb7117e3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:26.358635 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5c3a86f8-4ab4-40a7-91d5-99ffdb7117e3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:26.366138 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5c3a86f8-4ab4-40a7-91d5-99ffdb7117e3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1685 microversion: 2.1 time: 0.151798 Jul 31 02:17:26.366706 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3524/7084] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:26 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:27.215713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2f2e8394-a7cc-4595-ba60-28e2e8f5b279 req-5639270a-4f6c-45c2-b09f-5d9545de1129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c087f883-b146-4db7-b34a-09208e3226af", "name": "network-vif-deleted", "tag": "1c33ec10-749f-49e5-b271-c12ad5b8c35d"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:17:27.226603 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2f2e8394-a7cc-4595-ba60-28e2e8f5b279 req-5639270a-4f6c-45c2-b09f-5d9545de1129 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:27.227056 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2f2e8394-a7cc-4595-ba60-28e2e8f5b279 req-5639270a-4f6c-45c2-b09f-5d9545de1129 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:27.239174 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2f2e8394-a7cc-4595-ba60-28e2e8f5b279 req-5639270a-4f6c-45c2-b09f-5d9545de1129 service nova] Creating event network-vif-deleted:1c33ec10-749f-49e5-b271-c12ad5b8c35d for instance c087f883-b146-4db7-b34a-09208e3226af on n-h2-master-1 Jul 31 02:17:27.244677 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2f2e8394-a7cc-4595-ba60-28e2e8f5b279 req-5639270a-4f6c-45c2-b09f-5d9545de1129 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032720 Jul 31 02:17:27.245324 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3561/7085] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:17:27.388177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3eab5ce0-6b06-4451-b58c-2a84dfdf3696 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:27.388765 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3eab5ce0-6b06-4451-b58c-2a84dfdf3696 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:27.396349 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3eab5ce0-6b06-4451-b58c-2a84dfdf3696 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:27.396819 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3eab5ce0-6b06-4451-b58c-2a84dfdf3696 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:27.397606 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3eab5ce0-6b06-4451-b58c-2a84dfdf3696 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:27.398066 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3eab5ce0-6b06-4451-b58c-2a84dfdf3696 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:27.428630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3eab5ce0-6b06-4451-b58c-2a84dfdf3696 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:27.429033 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3eab5ce0-6b06-4451-b58c-2a84dfdf3696 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:27.429501 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-3eab5ce0-6b06-4451-b58c-2a84dfdf3696 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lazy-loading 'fault' on Instance uuid c087f883-b146-4db7-b34a-09208e3226af {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:17:27.471124 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3eab5ce0-6b06-4451-b58c-2a84dfdf3696 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:27.479692 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3eab5ce0-6b06-4451-b58c-2a84dfdf3696 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 200 len: 1356 microversion: 2.1 time: 0.095303 Jul 31 02:17:27.480918 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3525/7086] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:27 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 1356 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:28.507960 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc80df8b-a9b4-4d7b-b51c-223fb3f0fcc1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:28.508592 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-fc80df8b-a9b4-4d7b-b51c-223fb3f0fcc1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: c087f883-b146-4db7-b34a-09208e3226af] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:28.514846 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc80df8b-a9b4-4d7b-b51c-223fb3f0fcc1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:28.515309 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc80df8b-a9b4-4d7b-b51c-223fb3f0fcc1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:28.516147 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc80df8b-a9b4-4d7b-b51c-223fb3f0fcc1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:28.516594 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-fc80df8b-a9b4-4d7b-b51c-223fb3f0fcc1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:28.530479 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-fc80df8b-a9b4-4d7b-b51c-223fb3f0fcc1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] HTTP exception thrown: Instance c087f883-b146-4db7-b34a-09208e3226af could not be found. Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc80df8b-a9b4-4d7b-b51c-223fb3f0fcc1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Request method failure captured: Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af HTTP/1.1 Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eYAzDqc_OrsAo-J-1bmHbcGAw2mwcba9oBFF1GuJx7h2q7wwDdcuA7T2_M6jA7aPmOdJhu8rpEfLWey7CD1suIH_p6ArzYUQmGU5sKYkwqNwBdWdKcvT-9kRBlA7tTcoDsaVXE46dP44tqxX1wh2NBRglHhcVT1rTlI3mrQzAiqe2E Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 14c964a9135b44f2b83dba23842472cd Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-97164417 Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/14c964a9135b44f2b83dba23842472cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/14c964a9135b44f2b83dba23842472cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/14c964a9135b44f2b83dba23842472cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_14c964a9135b44f2b83dba23842472cd", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestNetworkAdvancedServerOps-97164417 Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 14c964a9135b44f2b83dba23842472cd Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-97164417 Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestNetworkAdvancedServerOps-97164417-project Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: b070525312804b0bb43370f12c449697 Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestNetworkAdvancedServerOps-97164417-project Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: exception: Instance c087f883-b146-4db7-b34a-09208e3226af could not be found. Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'c087f883-b146-4db7-b34a-09208e3226af'} Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c087f883-b146-4db7-b34a-09208e3226af could not be found. Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c087f883-b146-4db7-b34a-09208e3226af could not be found. Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:17:28.532174 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:17:28.537091 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:17:28.537091 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:17:28.537091 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:17:28.537091 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:17:28.537091 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:17:28.537091 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c087f883-b146-4db7-b34a-09208e3226af could not be found. Jul 31 02:17:28.537091 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:17:28.537091 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fc80df8b-a9b4-4d7b-b51c-223fb3f0fcc1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Returning 404 to user: Instance c087f883-b146-4db7-b34a-09208e3226af could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:17:28.537091 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fc80df8b-a9b4-4d7b-b51c-223fb3f0fcc1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af" status: 404 len: 111 microversion: 2.1 time: 0.030900 Jul 31 02:17:28.537091 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3562/7087] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:28 2022] GET /compute/v2.1/servers/c087f883-b146-4db7-b34a-09208e3226af => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:17:31.469176 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-047933b9-bf04-4afb-866e-de4a7c97be17 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '.version_select at 0x7fedea83d8b0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:31.496723 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-047933b9-bf04-4afb-866e-de4a7c97be17 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1694630980" status: 202 len: 0 microversion: 2.1 time: 0.031588 Jul 31 02:17:31.497328 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3526/7088] 10.222.0.45 () {58 vars in 1284 bytes} [Sun Jul 31 02:17:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1694630980 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:17:31.524880 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-220a67b7-6af6-4b28-b5bc-bc47445fc4fb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'create', calling method: .version_select at 0x7fede55f8550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-909413959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd3+s+SZ5H7vtJmjPLxhzCw634l7eKhJOQBxN/OIfiiF0ggD2qiP6nwh9a7S4LCcChL6CXNmRR8xwspH3zfDaNr9mlrgUf/222Rz0cxPi8i5Ctsxyx+yQzQsV8POQvsnA=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:17:31.544829 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-220a67b7-6af6-4b28-b5bc-bc47445fc4fb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for project 14c964a9135b44f2b83dba23842472cd. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:17:31.550076 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-220a67b7-6af6-4b28-b5bc-bc47445fc4fb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for user b070525312804b0bb43370f12c449697 and project 14c964a9135b44f2b83dba23842472cd. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:17:31.573970 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-220a67b7-6af6-4b28-b5bc-bc47445fc4fb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053231 Jul 31 02:17:31.574583 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3563/7089] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 02:17:31 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:17:37.355390 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1753037700", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "367b62e9-a222-4349-babd-38616a2d4dc5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-909413959", "security_groups": [{"name": "tempest-secgroup-smoke-541638094"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:17:37.476383 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:17:37.496165 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] validate_networks() for [('367b62e9-a222-4349-babd-38616a2d4dc5', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:17:37.969824 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:17:37.970258 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:17:37.970742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:17:37.971161 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:17:37.972388 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:17:37.984301 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:37.984775 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:37.985579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:37.986028 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:38.012454 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for project 14c964a9135b44f2b83dba23842472cd. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:17:38.020806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for user b070525312804b0bb43370f12c449697 and project 14c964a9135b44f2b83dba23842472cd. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:17:38.037547 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:17:38.039559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:17:38.088770 n-d-master-1 devstack@n-api.service[119474]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [f4088874-327d-40e1-af9c-9b26e6d67028] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 31 02:17:39.099000 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [f4088874-327d-40e1-af9c-9b26e6d67028] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 39634. Jul 31 02:17:39.105043 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8ac60448-da1f-4855-9796-d722397f9d07 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.755583 Jul 31 02:17:39.105932 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3527/7090] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:17:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:17:39.115651 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=36 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:17:39.119812 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9d8d1670-641f-4bb4-af75-d69ed5bd8fbd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:39.120447 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9d8d1670-641f-4bb4-af75-d69ed5bd8fbd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:39.197241 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9d8d1670-641f-4bb4-af75-d69ed5bd8fbd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:39.204607 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9d8d1670-641f-4bb4-af75-d69ed5bd8fbd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1266 microversion: 2.1 time: 0.090923 Jul 31 02:17:39.205682 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3564/7091] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:39 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:40.227238 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-256ffe53-4400-4045-9a31-535aeb6dd7fc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:40.227899 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-256ffe53-4400-4045-9a31-535aeb6dd7fc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:40.279365 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-256ffe53-4400-4045-9a31-535aeb6dd7fc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:40.289520 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-256ffe53-4400-4045-9a31-535aeb6dd7fc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1266 microversion: 2.1 time: 0.066752 Jul 31 02:17:40.290131 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3528/7092] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:40 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1266 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:41.315776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c74c9e8f-bcd3-4360-b6d1-2a929bc7665c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:41.316403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c74c9e8f-bcd3-4360-b6d1-2a929bc7665c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:41.374890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c74c9e8f-bcd3-4360-b6d1-2a929bc7665c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:41.381797 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c74c9e8f-bcd3-4360-b6d1-2a929bc7665c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1266 microversion: 2.1 time: 0.069981 Jul 31 02:17:41.382380 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3565/7093] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:41 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1266 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:42.403256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a70db4f0-c7b0-4326-96ee-a6b7d4e41c89 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:42.403919 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a70db4f0-c7b0-4326-96ee-a6b7d4e41c89 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:42.461148 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a70db4f0-c7b0-4326-96ee-a6b7d4e41c89 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:42.467998 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a70db4f0-c7b0-4326-96ee-a6b7d4e41c89 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1266 microversion: 2.1 time: 0.068661 Jul 31 02:17:42.468577 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3529/7094] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:42 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1266 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:43.488945 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c33d7a2b-995e-42ed-bc5a-4ec333c186c0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:43.489613 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c33d7a2b-995e-42ed-bc5a-4ec333c186c0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:43.492360 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:17:43.498281 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c33d7a2b-995e-42ed-bc5a-4ec333c186c0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:43.498751 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c33d7a2b-995e-42ed-bc5a-4ec333c186c0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:43.499815 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c33d7a2b-995e-42ed-bc5a-4ec333c186c0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:43.500271 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c33d7a2b-995e-42ed-bc5a-4ec333c186c0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:43.565281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c33d7a2b-995e-42ed-bc5a-4ec333c186c0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:43.574500 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c33d7a2b-995e-42ed-bc5a-4ec333c186c0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1270 microversion: 2.1 time: 0.089105 Jul 31 02:17:43.575095 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3566/7095] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:43 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:44.606411 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-88f5820c-934c-4a44-a566-5dc7cb5a5951 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:44.607047 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-88f5820c-934c-4a44-a566-5dc7cb5a5951 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:44.615148 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88f5820c-934c-4a44-a566-5dc7cb5a5951 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:44.615643 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88f5820c-934c-4a44-a566-5dc7cb5a5951 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:44.616438 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88f5820c-934c-4a44-a566-5dc7cb5a5951 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:44.617068 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-88f5820c-934c-4a44-a566-5dc7cb5a5951 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:44.708111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-88f5820c-934c-4a44-a566-5dc7cb5a5951 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:44.715688 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-88f5820c-934c-4a44-a566-5dc7cb5a5951 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1324 microversion: 2.1 time: 0.113251 Jul 31 02:17:44.716261 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3530/7096] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:44 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1324 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:45.737836 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-45a4556c-9335-4458-92f3-2a978ecc5512 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:45.738684 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-45a4556c-9335-4458-92f3-2a978ecc5512 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:45.746051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45a4556c-9335-4458-92f3-2a978ecc5512 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:45.746522 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45a4556c-9335-4458-92f3-2a978ecc5512 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:45.747564 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45a4556c-9335-4458-92f3-2a978ecc5512 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:45.748202 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45a4556c-9335-4458-92f3-2a978ecc5512 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:45.846443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-726b2222-043f-4c3c-a35c-60417dc98c5a req-ff31bb44-9481-43fb-9af9-85ac4eb46c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fca1849-b2cc-4290-be79-8cf2e67d46b8", "tag": "a3388986-1104-4d5c-ae36-e27b6bfb1d90"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:17:45.860463 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-726b2222-043f-4c3c-a35c-60417dc98c5a req-ff31bb44-9481-43fb-9af9-85ac4eb46c9b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:45.861302 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-726b2222-043f-4c3c-a35c-60417dc98c5a req-ff31bb44-9481-43fb-9af9-85ac4eb46c9b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:45.885142 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-726b2222-043f-4c3c-a35c-60417dc98c5a req-ff31bb44-9481-43fb-9af9-85ac4eb46c9b service nova] Creating event network-changed:a3388986-1104-4d5c-ae36-e27b6bfb1d90 for instance 8fca1849-b2cc-4290-be79-8cf2e67d46b8 on n-h1-master-1 Jul 31 02:17:45.890830 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-726b2222-043f-4c3c-a35c-60417dc98c5a req-ff31bb44-9481-43fb-9af9-85ac4eb46c9b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049791 Jul 31 02:17:45.891711 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3531/7097] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:17:45.985394 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-45a4556c-9335-4458-92f3-2a978ecc5512 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:45.994249 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-45a4556c-9335-4458-92f3-2a978ecc5512 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1391 microversion: 2.1 time: 0.261042 Jul 31 02:17:45.995098 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3567/7098] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:45 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1391 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:47.017280 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3a99548d-fc12-4287-b72e-f80e3135e908 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:47.017904 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3a99548d-fc12-4287-b72e-f80e3135e908 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:47.024755 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a99548d-fc12-4287-b72e-f80e3135e908 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:47.025217 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a99548d-fc12-4287-b72e-f80e3135e908 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:47.025984 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a99548d-fc12-4287-b72e-f80e3135e908 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:47.026429 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a99548d-fc12-4287-b72e-f80e3135e908 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:47.156623 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3a99548d-fc12-4287-b72e-f80e3135e908 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:47.164086 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3a99548d-fc12-4287-b72e-f80e3135e908 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1391 microversion: 2.1 time: 0.151998 Jul 31 02:17:47.164641 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3532/7099] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:47 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:48.185566 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a1886dab-72a0-4a55-ad62-c36d11a653c0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:48.186230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a1886dab-72a0-4a55-ad62-c36d11a653c0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:48.193713 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1886dab-72a0-4a55-ad62-c36d11a653c0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:48.194174 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1886dab-72a0-4a55-ad62-c36d11a653c0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:48.194950 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1886dab-72a0-4a55-ad62-c36d11a653c0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:48.195420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1886dab-72a0-4a55-ad62-c36d11a653c0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:48.329281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a1886dab-72a0-4a55-ad62-c36d11a653c0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:48.337379 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a1886dab-72a0-4a55-ad62-c36d11a653c0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1391 microversion: 2.1 time: 0.155757 Jul 31 02:17:48.337955 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3568/7100] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:48 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:49.359584 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-26a6f231-8b16-492a-bfe6-2b39ad445d18 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:49.360116 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-26a6f231-8b16-492a-bfe6-2b39ad445d18 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:49.362271 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:17:49.368402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26a6f231-8b16-492a-bfe6-2b39ad445d18 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:49.368869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26a6f231-8b16-492a-bfe6-2b39ad445d18 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:49.369648 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26a6f231-8b16-492a-bfe6-2b39ad445d18 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:49.370103 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-26a6f231-8b16-492a-bfe6-2b39ad445d18 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:49.500671 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-26a6f231-8b16-492a-bfe6-2b39ad445d18 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:49.508127 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-26a6f231-8b16-492a-bfe6-2b39ad445d18 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1391 microversion: 2.1 time: 0.152622 Jul 31 02:17:49.508688 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3533/7101] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:49 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:50.488775 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-fc881ecd-3786-470b-baea-e595f607ccee req-33cc7cf9-6cd2-415c-9e52-6a3b79061b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fca1849-b2cc-4290-be79-8cf2e67d46b8", "name": "network-vif-plugged", "status": "completed", "tag": "a3388986-1104-4d5c-ae36-e27b6bfb1d90"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:17:50.502952 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-fc881ecd-3786-470b-baea-e595f607ccee req-33cc7cf9-6cd2-415c-9e52-6a3b79061b8b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:50.503441 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-fc881ecd-3786-470b-baea-e595f607ccee req-33cc7cf9-6cd2-415c-9e52-6a3b79061b8b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:50.514599 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-fc881ecd-3786-470b-baea-e595f607ccee req-33cc7cf9-6cd2-415c-9e52-6a3b79061b8b service nova] Creating event network-vif-plugged:a3388986-1104-4d5c-ae36-e27b6bfb1d90 for instance 8fca1849-b2cc-4290-be79-8cf2e67d46b8 on n-h1-master-1 Jul 31 02:17:50.519898 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-fc881ecd-3786-470b-baea-e595f607ccee req-33cc7cf9-6cd2-415c-9e52-6a3b79061b8b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035943 Jul 31 02:17:50.520639 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3569/7102] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:17:50.529217 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-794fd8cb-5557-4fb7-bd47-112489fbe664 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:50.529934 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-794fd8cb-5557-4fb7-bd47-112489fbe664 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:50.532786 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:17:50.539294 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-794fd8cb-5557-4fb7-bd47-112489fbe664 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:50.539795 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-794fd8cb-5557-4fb7-bd47-112489fbe664 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:50.540592 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-794fd8cb-5557-4fb7-bd47-112489fbe664 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:50.541050 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-794fd8cb-5557-4fb7-bd47-112489fbe664 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:50.732450 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-794fd8cb-5557-4fb7-bd47-112489fbe664 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:50.740631 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-794fd8cb-5557-4fb7-bd47-112489fbe664 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1391 microversion: 2.1 time: 0.215296 Jul 31 02:17:50.741218 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3534/7103] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:50 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1391 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:51.759439 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:17:51.765072 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1c250889-4a29-4f57-b9fe-a2a4f2f11640 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:51.765800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1c250889-4a29-4f57-b9fe-a2a4f2f11640 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:51.772503 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c250889-4a29-4f57-b9fe-a2a4f2f11640 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:51.773115 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c250889-4a29-4f57-b9fe-a2a4f2f11640 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:51.773880 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c250889-4a29-4f57-b9fe-a2a4f2f11640 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:51.774333 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1c250889-4a29-4f57-b9fe-a2a4f2f11640 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:51.915325 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1c250889-4a29-4f57-b9fe-a2a4f2f11640 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:51.922831 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1c250889-4a29-4f57-b9fe-a2a4f2f11640 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1563 microversion: 2.1 time: 0.164390 Jul 31 02:17:51.923427 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3570/7104] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:51 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:51.943857 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-069d4e0a-cc03-4266-8032-627578901b71 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:51.944493 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-069d4e0a-cc03-4266-8032-627578901b71 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:51.951403 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-069d4e0a-cc03-4266-8032-627578901b71 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:51.951880 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-069d4e0a-cc03-4266-8032-627578901b71 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:51.952669 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-069d4e0a-cc03-4266-8032-627578901b71 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:51.953132 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-069d4e0a-cc03-4266-8032-627578901b71 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:52.087271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-069d4e0a-cc03-4266-8032-627578901b71 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:52.094893 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-069d4e0a-cc03-4266-8032-627578901b71 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1563 microversion: 2.1 time: 0.155016 Jul 31 02:17:52.095484 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3535/7105] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:51 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:17:53.678665 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ecd09997-3f10-4d04-9c72-1ce4dcd61857 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:17:53.679316 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ecd09997-3f10-4d04-9c72-1ce4dcd61857 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:17:53.680895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-62b18f0d-acc8-4044-8cf5-779e66e93eb4 req-81d5bd35-af60-4dce-b4ec-cfa83bb044fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fca1849-b2cc-4290-be79-8cf2e67d46b8", "tag": "a3388986-1104-4d5c-ae36-e27b6bfb1d90"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:17:53.687002 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=10 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:17:53.687820 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecd09997-3f10-4d04-9c72-1ce4dcd61857 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:53.688231 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecd09997-3f10-4d04-9c72-1ce4dcd61857 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:53.689187 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecd09997-3f10-4d04-9c72-1ce4dcd61857 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:53.689643 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ecd09997-3f10-4d04-9c72-1ce4dcd61857 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:53.697255 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-62b18f0d-acc8-4044-8cf5-779e66e93eb4 req-81d5bd35-af60-4dce-b4ec-cfa83bb044fc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:17:53.697723 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-62b18f0d-acc8-4044-8cf5-779e66e93eb4 req-81d5bd35-af60-4dce-b4ec-cfa83bb044fc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:17:53.709334 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-62b18f0d-acc8-4044-8cf5-779e66e93eb4 req-81d5bd35-af60-4dce-b4ec-cfa83bb044fc service nova] Creating event network-changed:a3388986-1104-4d5c-ae36-e27b6bfb1d90 for instance 8fca1849-b2cc-4290-be79-8cf2e67d46b8 on n-h1-master-1 Jul 31 02:17:53.715369 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-62b18f0d-acc8-4044-8cf5-779e66e93eb4 req-81d5bd35-af60-4dce-b4ec-cfa83bb044fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038778 Jul 31 02:17:53.716293 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3536/7106] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:17:53.922758 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ecd09997-3f10-4d04-9c72-1ce4dcd61857 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:17:53.931884 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ecd09997-3f10-4d04-9c72-1ce4dcd61857 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1563 microversion: 2.1 time: 0.258925 Jul 31 02:17:53.932561 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3571/7107] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:17:53 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1563 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:18:17.175857 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=5 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:18:17.176683 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=36 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:18:17.180922 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8515af55-a37f-4b9d-b06c-f96a7dcd02be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:18:17.183271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8515af55-a37f-4b9d-b06c-f96a7dcd02be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:18:17.191618 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8515af55-a37f-4b9d-b06c-f96a7dcd02be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:17.192089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8515af55-a37f-4b9d-b06c-f96a7dcd02be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:17.192873 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8515af55-a37f-4b9d-b06c-f96a7dcd02be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:17.193331 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8515af55-a37f-4b9d-b06c-f96a7dcd02be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:17.255146 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8515af55-a37f-4b9d-b06c-f96a7dcd02be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8/action" status: 200 len: 24570 microversion: 2.1 time: 0.081642 Jul 31 02:18:17.255818 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3537/7108] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:18:17 2022] POST /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8/action => generated 24570 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 02:18:23.734230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-80608dee-a1d5-4d30-8c27-4eb1cbdc8d7b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:18:23.736608 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-80608dee-a1d5-4d30-8c27-4eb1cbdc8d7b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:18:23.739464 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=11 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:18:23.740137 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=32 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:18:23.746773 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80608dee-a1d5-4d30-8c27-4eb1cbdc8d7b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:23.747238 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80608dee-a1d5-4d30-8c27-4eb1cbdc8d7b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:23.748068 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80608dee-a1d5-4d30-8c27-4eb1cbdc8d7b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:23.748521 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80608dee-a1d5-4d30-8c27-4eb1cbdc8d7b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:23.824073 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-80608dee-a1d5-4d30-8c27-4eb1cbdc8d7b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8/action" status: 202 len: 0 microversion: 2.1 time: 0.093689 Jul 31 02:18:23.824662 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3572/7109] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:18:23 2022] POST /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:18:23.834187 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b810710c-d06a-407f-ae10-941b667ad101 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:18:23.835000 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b810710c-d06a-407f-ae10-941b667ad101 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:18:23.842994 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b810710c-d06a-407f-ae10-941b667ad101 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:23.843510 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b810710c-d06a-407f-ae10-941b667ad101 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:23.844428 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b810710c-d06a-407f-ae10-941b667ad101 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:23.844909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b810710c-d06a-407f-ae10-941b667ad101 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:24.358634 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b810710c-d06a-407f-ae10-941b667ad101 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:18:24.366192 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b810710c-d06a-407f-ae10-941b667ad101 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1673 microversion: 2.1 time: 0.536825 Jul 31 02:18:24.366775 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3538/7110] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:18:23 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1673 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:18:25.391073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d9c7b7cd-c61d-45c9-a0d3-464b4444ba40 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:18:25.391808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d9c7b7cd-c61d-45c9-a0d3-464b4444ba40 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:18:25.398736 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9c7b7cd-c61d-45c9-a0d3-464b4444ba40 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:25.399189 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9c7b7cd-c61d-45c9-a0d3-464b4444ba40 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:25.399992 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9c7b7cd-c61d-45c9-a0d3-464b4444ba40 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:25.400434 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d9c7b7cd-c61d-45c9-a0d3-464b4444ba40 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:25.530013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d9c7b7cd-c61d-45c9-a0d3-464b4444ba40 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:18:25.537535 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d9c7b7cd-c61d-45c9-a0d3-464b4444ba40 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1678 microversion: 2.1 time: 0.151864 Jul 31 02:18:25.538109 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3573/7111] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:18:25 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:18:26.559565 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e8f6276c-ee35-4f10-a45c-e5646cd1e299 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:18:26.560230 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e8f6276c-ee35-4f10-a45c-e5646cd1e299 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:18:26.568662 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8f6276c-ee35-4f10-a45c-e5646cd1e299 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:26.569144 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8f6276c-ee35-4f10-a45c-e5646cd1e299 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:26.569898 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8f6276c-ee35-4f10-a45c-e5646cd1e299 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:26.570348 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8f6276c-ee35-4f10-a45c-e5646cd1e299 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:26.702784 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e8f6276c-ee35-4f10-a45c-e5646cd1e299 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:18:26.711264 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e8f6276c-ee35-4f10-a45c-e5646cd1e299 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1678 microversion: 2.1 time: 0.155695 Jul 31 02:18:26.711864 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3539/7112] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:18:26 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:18:27.732804 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3fe01aee-e5dc-4254-af74-b602616b74d9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:18:27.733369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3fe01aee-e5dc-4254-af74-b602616b74d9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:18:27.740618 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3fe01aee-e5dc-4254-af74-b602616b74d9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:27.741099 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3fe01aee-e5dc-4254-af74-b602616b74d9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:27.741879 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3fe01aee-e5dc-4254-af74-b602616b74d9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:27.742327 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3fe01aee-e5dc-4254-af74-b602616b74d9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:27.876265 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3fe01aee-e5dc-4254-af74-b602616b74d9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:18:27.884559 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3fe01aee-e5dc-4254-af74-b602616b74d9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1678 microversion: 2.1 time: 0.155791 Jul 31 02:18:27.885134 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3574/7113] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:18:27 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:18:28.905976 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b2bca2bb-4c6f-4b5c-a825-d4f3026dd8a9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:18:28.906533 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b2bca2bb-4c6f-4b5c-a825-d4f3026dd8a9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:18:28.913797 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2bca2bb-4c6f-4b5c-a825-d4f3026dd8a9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:28.914276 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2bca2bb-4c6f-4b5c-a825-d4f3026dd8a9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:28.915071 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2bca2bb-4c6f-4b5c-a825-d4f3026dd8a9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:28.915557 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2bca2bb-4c6f-4b5c-a825-d4f3026dd8a9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:29.046697 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b2bca2bb-4c6f-4b5c-a825-d4f3026dd8a9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:18:29.054839 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b2bca2bb-4c6f-4b5c-a825-d4f3026dd8a9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1678 microversion: 2.1 time: 0.152936 Jul 31 02:18:29.055484 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3540/7114] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:18:28 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:18:30.077205 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d0df3997-44ef-4ed5-81a5-139447aef759 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:18:30.077837 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d0df3997-44ef-4ed5-81a5-139447aef759 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:18:30.085254 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d0df3997-44ef-4ed5-81a5-139447aef759 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:30.085716 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d0df3997-44ef-4ed5-81a5-139447aef759 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:30.086494 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d0df3997-44ef-4ed5-81a5-139447aef759 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:30.086943 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d0df3997-44ef-4ed5-81a5-139447aef759 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:30.222417 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d0df3997-44ef-4ed5-81a5-139447aef759 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:18:30.230003 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d0df3997-44ef-4ed5-81a5-139447aef759 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1678 microversion: 2.1 time: 0.156815 Jul 31 02:18:30.230584 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3575/7115] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:18:30 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:18:31.251844 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-86d67fad-4d62-4c67-8230-ecf17c0c60cb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:18:31.252493 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-86d67fad-4d62-4c67-8230-ecf17c0c60cb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:18:31.259392 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86d67fad-4d62-4c67-8230-ecf17c0c60cb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:31.259855 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86d67fad-4d62-4c67-8230-ecf17c0c60cb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:31.260626 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86d67fad-4d62-4c67-8230-ecf17c0c60cb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:31.261073 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-86d67fad-4d62-4c67-8230-ecf17c0c60cb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:31.394920 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-86d67fad-4d62-4c67-8230-ecf17c0c60cb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:18:31.402652 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-86d67fad-4d62-4c67-8230-ecf17c0c60cb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1678 microversion: 2.1 time: 0.154883 Jul 31 02:18:31.403140 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3541/7116] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:18:31 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:18:32.425003 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2cab4aa6-78a0-4e55-a8d1-a033d22159e8 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:18:32.425655 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2cab4aa6-78a0-4e55-a8d1-a033d22159e8 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:18:32.432653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cab4aa6-78a0-4e55-a8d1-a033d22159e8 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:32.433114 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cab4aa6-78a0-4e55-a8d1-a033d22159e8 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:32.433886 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cab4aa6-78a0-4e55-a8d1-a033d22159e8 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:32.434335 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cab4aa6-78a0-4e55-a8d1-a033d22159e8 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:32.567749 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2cab4aa6-78a0-4e55-a8d1-a033d22159e8 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:18:32.575397 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2cab4aa6-78a0-4e55-a8d1-a033d22159e8 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1678 microversion: 2.1 time: 0.154905 Jul 31 02:18:32.576047 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3576/7117] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:18:32 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:18:33.596927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5a7ddf08-d1dd-46c0-900c-8bf34ab1b28f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:18:33.597597 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5a7ddf08-d1dd-46c0-900c-8bf34ab1b28f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:18:33.604625 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a7ddf08-d1dd-46c0-900c-8bf34ab1b28f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:33.605099 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a7ddf08-d1dd-46c0-900c-8bf34ab1b28f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:33.605887 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a7ddf08-d1dd-46c0-900c-8bf34ab1b28f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:33.606343 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a7ddf08-d1dd-46c0-900c-8bf34ab1b28f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:33.735861 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5a7ddf08-d1dd-46c0-900c-8bf34ab1b28f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:18:33.744718 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5a7ddf08-d1dd-46c0-900c-8bf34ab1b28f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1678 microversion: 2.1 time: 0.151717 Jul 31 02:18:33.745297 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3542/7118] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:18:33 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:18:34.767080 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-42e406b0-49be-41cc-9e49-2865df606c52 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:18:34.767654 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-42e406b0-49be-41cc-9e49-2865df606c52 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:18:34.775190 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42e406b0-49be-41cc-9e49-2865df606c52 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:34.775685 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42e406b0-49be-41cc-9e49-2865df606c52 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:34.776452 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42e406b0-49be-41cc-9e49-2865df606c52 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:34.776893 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-42e406b0-49be-41cc-9e49-2865df606c52 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:34.906429 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-42e406b0-49be-41cc-9e49-2865df606c52 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:18:34.914015 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-42e406b0-49be-41cc-9e49-2865df606c52 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1678 microversion: 2.1 time: 0.150989 Jul 31 02:18:34.914587 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3577/7119] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:18:34 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:18:35.935642 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e8d9746b-d284-4097-979b-72476b6e7eb1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:18:35.936260 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e8d9746b-d284-4097-979b-72476b6e7eb1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:18:35.943009 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8d9746b-d284-4097-979b-72476b6e7eb1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:35.943507 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8d9746b-d284-4097-979b-72476b6e7eb1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:35.944295 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8d9746b-d284-4097-979b-72476b6e7eb1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:18:35.944745 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e8d9746b-d284-4097-979b-72476b6e7eb1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:18:36.077387 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e8d9746b-d284-4097-979b-72476b6e7eb1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:18:36.086539 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e8d9746b-d284-4097-979b-72476b6e7eb1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1681 microversion: 2.1 time: 0.154831 Jul 31 02:18:36.087123 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3543/7120] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:18:35 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:00.273463 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-23e1723b-43dc-4380-9552-6d2df283f2f7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:19:00.275742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-23e1723b-43dc-4380-9552-6d2df283f2f7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:00.277873 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=12 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:19:00.278540 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:19:00.284289 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23e1723b-43dc-4380-9552-6d2df283f2f7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:00.284745 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23e1723b-43dc-4380-9552-6d2df283f2f7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:00.286021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23e1723b-43dc-4380-9552-6d2df283f2f7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:00.286516 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-23e1723b-43dc-4380-9552-6d2df283f2f7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:00.355162 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-23e1723b-43dc-4380-9552-6d2df283f2f7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8/action" status: 200 len: 69111 microversion: 2.1 time: 0.085778 Jul 31 02:19:00.355916 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3578/7121] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:19:00 2022] POST /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8/action => generated 69111 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 02:19:07.745885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-28ae99d8-19f4-476a-812d-678b227416a0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:07.746453 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-28ae99d8-19f4-476a-812d-678b227416a0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:07.749072 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=14 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:19:07.749650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-788694d7-f0a1-45e4-bb1a-99a5f4231fd4 req-4f86f8db-899d-4a8b-b88a-87ec2da30937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fca1849-b2cc-4290-be79-8cf2e67d46b8", "tag": "a3388986-1104-4d5c-ae36-e27b6bfb1d90"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:19:07.750130 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=40 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:19:07.761664 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-788694d7-f0a1-45e4-bb1a-99a5f4231fd4 req-4f86f8db-899d-4a8b-b88a-87ec2da30937 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:07.762289 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-788694d7-f0a1-45e4-bb1a-99a5f4231fd4 req-4f86f8db-899d-4a8b-b88a-87ec2da30937 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:07.765909 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28ae99d8-19f4-476a-812d-678b227416a0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:07.766631 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28ae99d8-19f4-476a-812d-678b227416a0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:07.767627 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28ae99d8-19f4-476a-812d-678b227416a0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:07.768111 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-28ae99d8-19f4-476a-812d-678b227416a0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:07.775184 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-788694d7-f0a1-45e4-bb1a-99a5f4231fd4 req-4f86f8db-899d-4a8b-b88a-87ec2da30937 service nova] Creating event network-changed:a3388986-1104-4d5c-ae36-e27b6bfb1d90 for instance 8fca1849-b2cc-4290-be79-8cf2e67d46b8 on n-h1-master-1 Jul 31 02:19:07.780622 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-788694d7-f0a1-45e4-bb1a-99a5f4231fd4 req-4f86f8db-899d-4a8b-b88a-87ec2da30937 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035705 Jul 31 02:19:07.781346 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3579/7122] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:19:07.802973 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-28ae99d8-19f4-476a-812d-678b227416a0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:19:07.902076 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-28ae99d8-19f4-476a-812d-678b227416a0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 204 len: 0 microversion: 2.1 time: 0.159352 Jul 31 02:19:07.907011 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3544/7123] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:19:07 2022] DELETE /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:19:07.913816 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-01d9647f-4ed3-4d9b-a7bc-ccc6fcc26920 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:07.914550 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-01d9647f-4ed3-4d9b-a7bc-ccc6fcc26920 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:07.922580 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01d9647f-4ed3-4d9b-a7bc-ccc6fcc26920 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:07.923110 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01d9647f-4ed3-4d9b-a7bc-ccc6fcc26920 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:07.923965 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01d9647f-4ed3-4d9b-a7bc-ccc6fcc26920 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:07.924420 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-01d9647f-4ed3-4d9b-a7bc-ccc6fcc26920 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:08.084587 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-01d9647f-4ed3-4d9b-a7bc-ccc6fcc26920 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:08.092261 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-01d9647f-4ed3-4d9b-a7bc-ccc6fcc26920 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1687 microversion: 2.1 time: 0.183831 Jul 31 02:19:08.093179 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3580/7124] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:07 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:19:09.114806 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-df33476c-a88f-4c77-9604-cd4a6dc980d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:09.115559 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-df33476c-a88f-4c77-9604-cd4a6dc980d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:09.122898 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df33476c-a88f-4c77-9604-cd4a6dc980d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:09.123397 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df33476c-a88f-4c77-9604-cd4a6dc980d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:09.124181 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df33476c-a88f-4c77-9604-cd4a6dc980d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:09.124632 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df33476c-a88f-4c77-9604-cd4a6dc980d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:09.285173 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-df33476c-a88f-4c77-9604-cd4a6dc980d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:09.292688 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-df33476c-a88f-4c77-9604-cd4a6dc980d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1687 microversion: 2.1 time: 0.182216 Jul 31 02:19:09.293264 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3545/7125] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:09 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:10.069316 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-8a2aee6c-ad1a-4d1e-9650-4389134df0b6 req-efdb85eb-a999-42b5-abfa-193a8837823a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fca1849-b2cc-4290-be79-8cf2e67d46b8", "name": "network-vif-deleted", "tag": "a3388986-1104-4d5c-ae36-e27b6bfb1d90"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:19:10.080512 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8a2aee6c-ad1a-4d1e-9650-4389134df0b6 req-efdb85eb-a999-42b5-abfa-193a8837823a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:10.080965 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-8a2aee6c-ad1a-4d1e-9650-4389134df0b6 req-efdb85eb-a999-42b5-abfa-193a8837823a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:10.093938 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-8a2aee6c-ad1a-4d1e-9650-4389134df0b6 req-efdb85eb-a999-42b5-abfa-193a8837823a service nova] Creating event network-vif-deleted:a3388986-1104-4d5c-ae36-e27b6bfb1d90 for instance 8fca1849-b2cc-4290-be79-8cf2e67d46b8 on n-h1-master-1 Jul 31 02:19:10.099946 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-8a2aee6c-ad1a-4d1e-9650-4389134df0b6 req-efdb85eb-a999-42b5-abfa-193a8837823a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118670 Jul 31 02:19:10.100552 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3581/7126] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:19:10.314795 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3cc8c6ef-f7d6-42cf-99a5-b3dd19fcf5c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:10.315273 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3cc8c6ef-f7d6-42cf-99a5-b3dd19fcf5c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:10.323263 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3cc8c6ef-f7d6-42cf-99a5-b3dd19fcf5c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:10.323774 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3cc8c6ef-f7d6-42cf-99a5-b3dd19fcf5c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:10.324569 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3cc8c6ef-f7d6-42cf-99a5-b3dd19fcf5c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:10.325983 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3cc8c6ef-f7d6-42cf-99a5-b3dd19fcf5c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:10.360764 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3cc8c6ef-f7d6-42cf-99a5-b3dd19fcf5c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:10.361229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3cc8c6ef-f7d6-42cf-99a5-b3dd19fcf5c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:10.361701 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-3cc8c6ef-f7d6-42cf-99a5-b3dd19fcf5c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lazy-loading 'fault' on Instance uuid 8fca1849-b2cc-4290-be79-8cf2e67d46b8 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:19:10.408788 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3cc8c6ef-f7d6-42cf-99a5-b3dd19fcf5c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:10.419007 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3cc8c6ef-f7d6-42cf-99a5-b3dd19fcf5c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 200 len: 1356 microversion: 2.1 time: 0.108358 Jul 31 02:19:10.419984 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3546/7127] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:10 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 1356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:11.441513 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b152821b-68af-4841-ad21-c9aa4063322a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:11.442221 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b152821b-68af-4841-ad21-c9aa4063322a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 8fca1849-b2cc-4290-be79-8cf2e67d46b8] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:11.449376 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b152821b-68af-4841-ad21-c9aa4063322a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:11.449831 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b152821b-68af-4841-ad21-c9aa4063322a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:11.450599 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b152821b-68af-4841-ad21-c9aa4063322a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:11.451037 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b152821b-68af-4841-ad21-c9aa4063322a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:11.464103 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-b152821b-68af-4841-ad21-c9aa4063322a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] HTTP exception thrown: Instance 8fca1849-b2cc-4290-be79-8cf2e67d46b8 could not be found. Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b152821b-68af-4841-ad21-c9aa4063322a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Request method failure captured: Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 HTTP/1.1 Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eYAzDqc_OrsAo-J-1bmHbcGAw2mwcba9oBFF1GuJx7h2q7wwDdcuA7T2_M6jA7aPmOdJhu8rpEfLWey7CD1suIH_p6ArzYUQmGU5sKYkwqNwBdWdKcvT-9kRBlA7tTcoDsaVXE46dP44tqxX1wh2NBRglHhcVT1rTlI3mrQzAiqe2E Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 14c964a9135b44f2b83dba23842472cd Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-97164417 Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/14c964a9135b44f2b83dba23842472cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/14c964a9135b44f2b83dba23842472cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/14c964a9135b44f2b83dba23842472cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_14c964a9135b44f2b83dba23842472cd", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestNetworkAdvancedServerOps-97164417 Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 14c964a9135b44f2b83dba23842472cd Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-97164417 Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestNetworkAdvancedServerOps-97164417-project Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: b070525312804b0bb43370f12c449697 Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestNetworkAdvancedServerOps-97164417-project Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 8fca1849-b2cc-4290-be79-8cf2e67d46b8 could not be found. Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '8fca1849-b2cc-4290-be79-8cf2e67d46b8'} Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fca1849-b2cc-4290-be79-8cf2e67d46b8 could not be found. Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fca1849-b2cc-4290-be79-8cf2e67d46b8 could not be found. Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:19:11.465700 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:19:11.470246 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:19:11.470246 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:19:11.470246 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:19:11.470246 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:19:11.470246 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:19:11.470246 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fca1849-b2cc-4290-be79-8cf2e67d46b8 could not be found. Jul 31 02:19:11.470246 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:19:11.470246 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b152821b-68af-4841-ad21-c9aa4063322a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Returning 404 to user: Instance 8fca1849-b2cc-4290-be79-8cf2e67d46b8 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:19:11.470246 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b152821b-68af-4841-ad21-c9aa4063322a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8" status: 404 len: 111 microversion: 2.1 time: 0.029826 Jul 31 02:19:11.470246 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3582/7128] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:11 2022] GET /compute/v2.1/servers/8fca1849-b2cc-4290-be79-8cf2e67d46b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:19:15.020345 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-93880600-d511-47ab-a75d-453be80f4ab5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '.version_select at 0x7fedea8291f0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:15.044913 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-93880600-d511-47ab-a75d-453be80f4ab5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-909413959" status: 202 len: 0 microversion: 2.1 time: 0.028259 Jul 31 02:19:15.045460 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3547/7129] 10.222.0.45 () {58 vars in 1281 bytes} [Sun Jul 31 02:19:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-909413959 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:19:15.073489 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-40ebaae6-133f-4683-a328-8cabcf3953b5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'create', calling method: .version_select at 0x7fede5c6c820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1423756437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmhJuhJ0VObQ1V7G9imQsXucFxpBo/BbSwBcTwEHEg3TY5buQYizC0zqiwpJyomRyIp+Q/TGo7bq+KAtPab7XKEMUzK5PKM9dYuvDSCr785dTIlXxxXCnR+LO/GHEtzqQ=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:19:15.091048 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-40ebaae6-133f-4683-a328-8cabcf3953b5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for project 14c964a9135b44f2b83dba23842472cd. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:19:15.096176 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-40ebaae6-133f-4683-a328-8cabcf3953b5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for user b070525312804b0bb43370f12c449697 and project 14c964a9135b44f2b83dba23842472cd. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:19:15.119305 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-40ebaae6-133f-4683-a328-8cabcf3953b5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.049682 Jul 31 02:19:15.119922 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3583/7130] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 02:19:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:19:19.384982 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:19:19.385573 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 02:19:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:19:20.629588 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:19:20.634172 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-842ac3ab-b4fb-40ed-a02d-5cdb2f541bbc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-777753884", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "d493c25a-a3ea-4e78-a779-c9d2feab75e6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1423756437", "security_groups": [{"name": "tempest-secgroup-smoke-577625371"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:19:20.747200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-842ac3ab-b4fb-40ed-a02d-5cdb2f541bbc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] validate_networks() for [('d493c25a-a3ea-4e78-a779-c9d2feab75e6', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:19:21.143256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-842ac3ab-b4fb-40ed-a02d-5cdb2f541bbc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:19:21.144260 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-842ac3ab-b4fb-40ed-a02d-5cdb2f541bbc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:19:21.145021 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-842ac3ab-b4fb-40ed-a02d-5cdb2f541bbc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:19:21.147645 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-842ac3ab-b4fb-40ed-a02d-5cdb2f541bbc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:19:21.148332 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-842ac3ab-b4fb-40ed-a02d-5cdb2f541bbc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:19:21.160086 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-842ac3ab-b4fb-40ed-a02d-5cdb2f541bbc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:21.160903 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-842ac3ab-b4fb-40ed-a02d-5cdb2f541bbc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:21.161944 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-842ac3ab-b4fb-40ed-a02d-5cdb2f541bbc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:21.162471 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-842ac3ab-b4fb-40ed-a02d-5cdb2f541bbc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:21.183605 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-842ac3ab-b4fb-40ed-a02d-5cdb2f541bbc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for project 14c964a9135b44f2b83dba23842472cd. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:19:21.190546 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-842ac3ab-b4fb-40ed-a02d-5cdb2f541bbc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for user b070525312804b0bb43370f12c449697 and project 14c964a9135b44f2b83dba23842472cd. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:19:21.205364 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-842ac3ab-b4fb-40ed-a02d-5cdb2f541bbc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:19:21.207984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-842ac3ab-b4fb-40ed-a02d-5cdb2f541bbc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:19:21.260973 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-842ac3ab-b4fb-40ed-a02d-5cdb2f541bbc tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.633223 Jul 31 02:19:21.267567 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3548/7131] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:19:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:19:21.273565 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-60d97f3c-6e2c-464a-8660-02fd85f605d8 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:21.274758 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-60d97f3c-6e2c-464a-8660-02fd85f605d8 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:21.343996 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-60d97f3c-6e2c-464a-8660-02fd85f605d8 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:21.352012 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-60d97f3c-6e2c-464a-8660-02fd85f605d8 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1266 microversion: 2.1 time: 0.082919 Jul 31 02:19:21.355475 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3584/7132] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:21 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:22.374247 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5dde4ecc-ec46-4455-9fae-08f42be6a04e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:22.374880 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5dde4ecc-ec46-4455-9fae-08f42be6a04e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:22.429905 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5dde4ecc-ec46-4455-9fae-08f42be6a04e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:22.436903 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5dde4ecc-ec46-4455-9fae-08f42be6a04e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1266 microversion: 2.1 time: 0.067317 Jul 31 02:19:22.437483 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3549/7133] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:22 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1266 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:23.458014 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9d38ce00-9b73-44fd-83dd-8d53f9de6448 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:23.458769 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9d38ce00-9b73-44fd-83dd-8d53f9de6448 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:23.461864 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=16 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:19:23.522388 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9d38ce00-9b73-44fd-83dd-8d53f9de6448 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:23.529571 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9d38ce00-9b73-44fd-83dd-8d53f9de6448 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1266 microversion: 2.1 time: 0.075703 Jul 31 02:19:23.530189 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3585/7134] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:23 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:24.551856 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7414090f-d71e-4d14-9a58-c67084759127 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:24.552484 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7414090f-d71e-4d14-9a58-c67084759127 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:24.606270 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7414090f-d71e-4d14-9a58-c67084759127 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:24.613324 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7414090f-d71e-4d14-9a58-c67084759127 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1266 microversion: 2.1 time: 0.065293 Jul 31 02:19:24.614185 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3550/7135] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:24 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1266 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:25.634819 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f2f54f24-2277-4cec-a708-ee2a571b7525 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:25.635485 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f2f54f24-2277-4cec-a708-ee2a571b7525 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:25.642362 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2f54f24-2277-4cec-a708-ee2a571b7525 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:25.642827 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2f54f24-2277-4cec-a708-ee2a571b7525 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:25.643638 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2f54f24-2277-4cec-a708-ee2a571b7525 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:25.644091 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f2f54f24-2277-4cec-a708-ee2a571b7525 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:25.704695 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f2f54f24-2277-4cec-a708-ee2a571b7525 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:25.712148 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f2f54f24-2277-4cec-a708-ee2a571b7525 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1270 microversion: 2.1 time: 0.081262 Jul 31 02:19:25.712732 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3586/7136] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:25 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:26.733934 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c32849da-8763-4ee7-a2b2-6020a6ae6cd0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:26.734597 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c32849da-8763-4ee7-a2b2-6020a6ae6cd0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:26.743269 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c32849da-8763-4ee7-a2b2-6020a6ae6cd0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:26.743784 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c32849da-8763-4ee7-a2b2-6020a6ae6cd0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:26.744573 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c32849da-8763-4ee7-a2b2-6020a6ae6cd0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:26.745036 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c32849da-8763-4ee7-a2b2-6020a6ae6cd0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:26.808374 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c32849da-8763-4ee7-a2b2-6020a6ae6cd0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:26.815933 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c32849da-8763-4ee7-a2b2-6020a6ae6cd0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1324 microversion: 2.1 time: 0.086155 Jul 31 02:19:26.816506 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3551/7137] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:26 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1324 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:27.631202 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2d330b5a-747f-4d48-b31c-279647805533 req-29cfbe28-f8f7-47e1-99de-e33e3403a25a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeea4870-6554-49d9-8e38-88a288ccff2a", "tag": "21eb3eaf-413a-49cd-8a9b-3f346585af66"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:19:27.642253 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2d330b5a-747f-4d48-b31c-279647805533 req-29cfbe28-f8f7-47e1-99de-e33e3403a25a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:27.642720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2d330b5a-747f-4d48-b31c-279647805533 req-29cfbe28-f8f7-47e1-99de-e33e3403a25a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:27.654360 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2d330b5a-747f-4d48-b31c-279647805533 req-29cfbe28-f8f7-47e1-99de-e33e3403a25a service nova] Creating event network-changed:21eb3eaf-413a-49cd-8a9b-3f346585af66 for instance eeea4870-6554-49d9-8e38-88a288ccff2a on n-h2-master-1 Jul 31 02:19:27.659099 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2d330b5a-747f-4d48-b31c-279647805533 req-29cfbe28-f8f7-47e1-99de-e33e3403a25a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031736 Jul 31 02:19:27.659744 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3587/7138] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:19:27.838605 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a605d419-4217-45b6-915a-f41b296c1548 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:27.839264 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a605d419-4217-45b6-915a-f41b296c1548 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:27.846267 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a605d419-4217-45b6-915a-f41b296c1548 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:27.846743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a605d419-4217-45b6-915a-f41b296c1548 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:27.847579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a605d419-4217-45b6-915a-f41b296c1548 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:27.848035 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a605d419-4217-45b6-915a-f41b296c1548 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:27.995540 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a605d419-4217-45b6-915a-f41b296c1548 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:28.003391 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a605d419-4217-45b6-915a-f41b296c1548 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1391 microversion: 2.1 time: 0.169453 Jul 31 02:19:28.003994 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3552/7139] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:27 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:29.026320 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0b556092-60f0-4011-8911-c9b521ebc772 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:29.027065 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0b556092-60f0-4011-8911-c9b521ebc772 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:29.033223 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b556092-60f0-4011-8911-c9b521ebc772 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:29.033702 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b556092-60f0-4011-8911-c9b521ebc772 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:29.034447 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b556092-60f0-4011-8911-c9b521ebc772 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:29.034890 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0b556092-60f0-4011-8911-c9b521ebc772 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:29.172559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0b556092-60f0-4011-8911-c9b521ebc772 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:29.181241 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0b556092-60f0-4011-8911-c9b521ebc772 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1391 microversion: 2.1 time: 0.160015 Jul 31 02:19:29.181840 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3588/7140] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:29 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:30.201998 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bd23c602-2559-47f2-98db-f3fc2b83a34a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:30.202742 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bd23c602-2559-47f2-98db-f3fc2b83a34a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:30.211185 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd23c602-2559-47f2-98db-f3fc2b83a34a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:30.211688 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd23c602-2559-47f2-98db-f3fc2b83a34a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:30.212497 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd23c602-2559-47f2-98db-f3fc2b83a34a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:30.213362 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bd23c602-2559-47f2-98db-f3fc2b83a34a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:30.355629 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bd23c602-2559-47f2-98db-f3fc2b83a34a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:30.363552 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bd23c602-2559-47f2-98db-f3fc2b83a34a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1391 microversion: 2.1 time: 0.165437 Jul 31 02:19:30.364132 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3553/7141] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:30 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:31.385750 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0ea2280b-0c73-402c-9b24-ec5f2853ac8e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:31.386369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0ea2280b-0c73-402c-9b24-ec5f2853ac8e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:31.389203 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:19:31.395031 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ea2280b-0c73-402c-9b24-ec5f2853ac8e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:31.395514 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ea2280b-0c73-402c-9b24-ec5f2853ac8e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:31.396278 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ea2280b-0c73-402c-9b24-ec5f2853ac8e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:31.396720 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ea2280b-0c73-402c-9b24-ec5f2853ac8e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:31.528854 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0ea2280b-0c73-402c-9b24-ec5f2853ac8e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:31.536223 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0ea2280b-0c73-402c-9b24-ec5f2853ac8e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1391 microversion: 2.1 time: 0.154979 Jul 31 02:19:31.536796 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3589/7142] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:31 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:32.048533 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-090246dc-ee3c-4739-af9f-8d090ea11e60 req-8eb9b6c0-f557-4e37-8a85-f1345b6a267f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeea4870-6554-49d9-8e38-88a288ccff2a", "name": "network-vif-plugged", "status": "completed", "tag": "21eb3eaf-413a-49cd-8a9b-3f346585af66"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:19:32.055025 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:19:32.063760 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-090246dc-ee3c-4739-af9f-8d090ea11e60 req-8eb9b6c0-f557-4e37-8a85-f1345b6a267f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:32.064230 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-090246dc-ee3c-4739-af9f-8d090ea11e60 req-8eb9b6c0-f557-4e37-8a85-f1345b6a267f service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:32.076442 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-090246dc-ee3c-4739-af9f-8d090ea11e60 req-8eb9b6c0-f557-4e37-8a85-f1345b6a267f service nova] Creating event network-vif-plugged:21eb3eaf-413a-49cd-8a9b-3f346585af66 for instance eeea4870-6554-49d9-8e38-88a288ccff2a on n-h2-master-1 Jul 31 02:19:32.082557 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-090246dc-ee3c-4739-af9f-8d090ea11e60 req-8eb9b6c0-f557-4e37-8a85-f1345b6a267f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037416 Jul 31 02:19:32.083166 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3554/7143] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:19:32.557630 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6029fa1f-4b60-4800-a516-e0d5ba7f4992 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:32.558258 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6029fa1f-4b60-4800-a516-e0d5ba7f4992 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:32.565216 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6029fa1f-4b60-4800-a516-e0d5ba7f4992 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:32.565682 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6029fa1f-4b60-4800-a516-e0d5ba7f4992 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:32.566706 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6029fa1f-4b60-4800-a516-e0d5ba7f4992 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:32.567164 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6029fa1f-4b60-4800-a516-e0d5ba7f4992 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:32.703793 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6029fa1f-4b60-4800-a516-e0d5ba7f4992 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:32.711932 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6029fa1f-4b60-4800-a516-e0d5ba7f4992 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1391 microversion: 2.1 time: 0.158265 Jul 31 02:19:32.712514 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3590/7144] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:32 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:33.733614 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a81a7057-4026-40b2-8812-2063c96fb262 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:33.734339 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a81a7057-4026-40b2-8812-2063c96fb262 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:33.742088 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a81a7057-4026-40b2-8812-2063c96fb262 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:33.742559 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a81a7057-4026-40b2-8812-2063c96fb262 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:33.743357 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a81a7057-4026-40b2-8812-2063c96fb262 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:33.743828 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a81a7057-4026-40b2-8812-2063c96fb262 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:33.930768 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a81a7057-4026-40b2-8812-2063c96fb262 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:33.938501 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a81a7057-4026-40b2-8812-2063c96fb262 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1562 microversion: 2.1 time: 0.209214 Jul 31 02:19:33.944062 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3555/7145] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:33 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1562 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:33.958855 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ee90688f-fb6c-4036-a6c7-08421620a059 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:33.959514 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ee90688f-fb6c-4036-a6c7-08421620a059 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:33.961471 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=8 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:19:33.968051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee90688f-fb6c-4036-a6c7-08421620a059 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:33.968547 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee90688f-fb6c-4036-a6c7-08421620a059 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:33.969338 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee90688f-fb6c-4036-a6c7-08421620a059 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:33.969787 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee90688f-fb6c-4036-a6c7-08421620a059 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:34.104020 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ee90688f-fb6c-4036-a6c7-08421620a059 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:34.111654 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ee90688f-fb6c-4036-a6c7-08421620a059 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1562 microversion: 2.1 time: 0.156737 Jul 31 02:19:34.112237 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3591/7146] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:33 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:35.672656 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f44fc058-755d-43a6-b4b4-254297eaf79d req-98f7577b-c6da-4934-95d4-0b2559615cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeea4870-6554-49d9-8e38-88a288ccff2a", "tag": "21eb3eaf-413a-49cd-8a9b-3f346585af66"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:19:35.682290 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e72f950a-3d5f-45a6-aaf6-9e52f853e59d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:19:35.682918 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e72f950a-3d5f-45a6-aaf6-9e52f853e59d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:35.684970 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=10 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:19:35.691096 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e72f950a-3d5f-45a6-aaf6-9e52f853e59d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:35.691589 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f44fc058-755d-43a6-b4b4-254297eaf79d req-98f7577b-c6da-4934-95d4-0b2559615cae service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:35.691721 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e72f950a-3d5f-45a6-aaf6-9e52f853e59d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:35.692044 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f44fc058-755d-43a6-b4b4-254297eaf79d req-98f7577b-c6da-4934-95d4-0b2559615cae service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:35.692385 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e72f950a-3d5f-45a6-aaf6-9e52f853e59d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:35.692851 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e72f950a-3d5f-45a6-aaf6-9e52f853e59d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:35.703435 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f44fc058-755d-43a6-b4b4-254297eaf79d req-98f7577b-c6da-4934-95d4-0b2559615cae service nova] Creating event network-changed:21eb3eaf-413a-49cd-8a9b-3f346585af66 for instance eeea4870-6554-49d9-8e38-88a288ccff2a on n-h2-master-1 Jul 31 02:19:35.708492 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f44fc058-755d-43a6-b4b4-254297eaf79d req-98f7577b-c6da-4934-95d4-0b2559615cae service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039510 Jul 31 02:19:35.709957 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3592/7147] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:19:35.840727 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e72f950a-3d5f-45a6-aaf6-9e52f853e59d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:19:35.849523 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e72f950a-3d5f-45a6-aaf6-9e52f853e59d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1562 microversion: 2.1 time: 0.183214 Jul 31 02:19:35.850685 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3556/7148] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:19:35 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1562 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:19:57.095236 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=7 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:19:57.096039 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=34 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:19:57.100520 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-147e036e-e92e-4955-a57c-f30f44a4c823 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:19:57.103352 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-147e036e-e92e-4955-a57c-f30f44a4c823 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:19:57.110339 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-147e036e-e92e-4955-a57c-f30f44a4c823 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:57.110808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-147e036e-e92e-4955-a57c-f30f44a4c823 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:57.111643 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-147e036e-e92e-4955-a57c-f30f44a4c823 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:19:57.112095 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-147e036e-e92e-4955-a57c-f30f44a4c823 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:19:57.181469 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-147e036e-e92e-4955-a57c-f30f44a4c823 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a/action" status: 200 len: 24571 microversion: 2.1 time: 0.087999 Jul 31 02:19:57.182023 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3593/7149] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:19:57 2022] POST /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a/action => generated 24571 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 02:20:07.874489 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9f96b50b-e209-4702-9f9c-845730227ebd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:20:07.877014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9f96b50b-e209-4702-9f9c-845730227ebd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:07.879521 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:20:07.880266 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=34 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:20:07.886834 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f96b50b-e209-4702-9f9c-845730227ebd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:07.887308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f96b50b-e209-4702-9f9c-845730227ebd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:07.888136 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f96b50b-e209-4702-9f9c-845730227ebd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:07.888596 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9f96b50b-e209-4702-9f9c-845730227ebd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:07.972452 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9f96b50b-e209-4702-9f9c-845730227ebd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:07.979670 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9f96b50b-e209-4702-9f9c-845730227ebd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Old instance type m1.heat2, new instance type m1.heat {{(pid=119474) resize /opt/stack/nova/nova/compute/api.py:4168}} Jul 31 02:20:07.986035 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-9f96b50b-e209-4702-9f9c-845730227ebd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:20:07.986468 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-9f96b50b-e209-4702-9f9c-845730227ebd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:20:07.986983 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-9f96b50b-e209-4702-9f9c-845730227ebd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:20:07.987434 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-9f96b50b-e209-4702-9f9c-845730227ebd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:20:07.987864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-9f96b50b-e209-4702-9f9c-845730227ebd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:20:08.049651 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9f96b50b-e209-4702-9f9c-845730227ebd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a/action" status: 202 len: 0 microversion: 2.1 time: 0.179524 Jul 31 02:20:08.050257 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3557/7150] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:20:07 2022] POST /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:20:08.059028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a1c7b293-2a7c-4d2f-878d-7416367ca4c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:08.059803 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a1c7b293-2a7c-4d2f-878d-7416367ca4c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:08.062487 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:20:08.063323 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:20:08.069873 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1c7b293-2a7c-4d2f-878d-7416367ca4c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:08.070342 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1c7b293-2a7c-4d2f-878d-7416367ca4c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:08.071201 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1c7b293-2a7c-4d2f-878d-7416367ca4c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:08.071638 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a1c7b293-2a7c-4d2f-878d-7416367ca4c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:08.272496 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a1c7b293-2a7c-4d2f-878d-7416367ca4c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:08.281091 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a1c7b293-2a7c-4d2f-878d-7416367ca4c2 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1690 microversion: 2.1 time: 0.226301 Jul 31 02:20:08.281791 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3594/7151] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:08 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1690 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:09.304778 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c9c0cb6-8ed1-4af1-a1e7-5ae54855ff50 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:09.305416 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2c9c0cb6-8ed1-4af1-a1e7-5ae54855ff50 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:09.311549 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c9c0cb6-8ed1-4af1-a1e7-5ae54855ff50 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:09.312023 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c9c0cb6-8ed1-4af1-a1e7-5ae54855ff50 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:09.312806 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c9c0cb6-8ed1-4af1-a1e7-5ae54855ff50 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:09.313259 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2c9c0cb6-8ed1-4af1-a1e7-5ae54855ff50 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:09.451767 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2c9c0cb6-8ed1-4af1-a1e7-5ae54855ff50 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:09.459258 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2c9c0cb6-8ed1-4af1-a1e7-5ae54855ff50 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1690 microversion: 2.1 time: 0.159962 Jul 31 02:20:09.459859 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3558/7152] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:09 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:10.481185 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-00e16fcc-8cc2-4335-a6e4-4ff032dd0eaa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:10.481817 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-00e16fcc-8cc2-4335-a6e4-4ff032dd0eaa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:10.492845 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00e16fcc-8cc2-4335-a6e4-4ff032dd0eaa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:10.493336 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00e16fcc-8cc2-4335-a6e4-4ff032dd0eaa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:10.494104 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00e16fcc-8cc2-4335-a6e4-4ff032dd0eaa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:10.494571 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-00e16fcc-8cc2-4335-a6e4-4ff032dd0eaa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:10.623361 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-00e16fcc-8cc2-4335-a6e4-4ff032dd0eaa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:10.631070 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-00e16fcc-8cc2-4335-a6e4-4ff032dd0eaa tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1695 microversion: 2.1 time: 0.153816 Jul 31 02:20:10.631681 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3595/7153] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:10 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:20:11.653329 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fa8083b7-b9da-41ea-8ff4-f9a1dda95534 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:11.653964 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fa8083b7-b9da-41ea-8ff4-f9a1dda95534 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:11.660995 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa8083b7-b9da-41ea-8ff4-f9a1dda95534 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:11.661479 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa8083b7-b9da-41ea-8ff4-f9a1dda95534 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:11.662263 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa8083b7-b9da-41ea-8ff4-f9a1dda95534 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:11.662720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa8083b7-b9da-41ea-8ff4-f9a1dda95534 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:11.800163 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fa8083b7-b9da-41ea-8ff4-f9a1dda95534 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:11.807726 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fa8083b7-b9da-41ea-8ff4-f9a1dda95534 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1695 microversion: 2.1 time: 0.158324 Jul 31 02:20:11.808286 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3559/7154] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:11 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:12.829099 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a134a504-1ca6-4f40-9ab7-252e91283b52 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:12.829631 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a134a504-1ca6-4f40-9ab7-252e91283b52 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:12.837581 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a134a504-1ca6-4f40-9ab7-252e91283b52 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:12.838048 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a134a504-1ca6-4f40-9ab7-252e91283b52 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:12.839297 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a134a504-1ca6-4f40-9ab7-252e91283b52 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:12.839778 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a134a504-1ca6-4f40-9ab7-252e91283b52 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:12.976293 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a134a504-1ca6-4f40-9ab7-252e91283b52 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:12.984280 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a134a504-1ca6-4f40-9ab7-252e91283b52 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1695 microversion: 2.1 time: 0.159219 Jul 31 02:20:12.984860 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3596/7155] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:12 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:14.008041 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6b66a3ac-8631-4023-8d20-e80ea2942370 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:14.010069 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6b66a3ac-8631-4023-8d20-e80ea2942370 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:14.016334 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b66a3ac-8631-4023-8d20-e80ea2942370 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:14.016808 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b66a3ac-8631-4023-8d20-e80ea2942370 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:14.017599 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b66a3ac-8631-4023-8d20-e80ea2942370 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:14.018056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6b66a3ac-8631-4023-8d20-e80ea2942370 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:14.152887 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6b66a3ac-8631-4023-8d20-e80ea2942370 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:14.160467 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6b66a3ac-8631-4023-8d20-e80ea2942370 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1695 microversion: 2.1 time: 0.159494 Jul 31 02:20:14.161041 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3560/7156] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:13 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:15.182480 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e3e8f026-a64f-449c-acd6-569724259c94 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:15.183094 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e3e8f026-a64f-449c-acd6-569724259c94 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:15.190058 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3e8f026-a64f-449c-acd6-569724259c94 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:15.190521 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3e8f026-a64f-449c-acd6-569724259c94 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:15.191289 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3e8f026-a64f-449c-acd6-569724259c94 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:15.191755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e3e8f026-a64f-449c-acd6-569724259c94 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:15.320504 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e3e8f026-a64f-449c-acd6-569724259c94 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:15.328035 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e3e8f026-a64f-449c-acd6-569724259c94 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1695 microversion: 2.1 time: 0.150176 Jul 31 02:20:15.328625 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3597/7157] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:15 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1695 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:16.348808 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b2bcd76e-117a-44f4-a334-63bcb6f22656 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:16.349447 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b2bcd76e-117a-44f4-a334-63bcb6f22656 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:16.356465 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2bcd76e-117a-44f4-a334-63bcb6f22656 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:16.356936 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2bcd76e-117a-44f4-a334-63bcb6f22656 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:16.357749 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2bcd76e-117a-44f4-a334-63bcb6f22656 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:16.358216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b2bcd76e-117a-44f4-a334-63bcb6f22656 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:16.489211 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b2bcd76e-117a-44f4-a334-63bcb6f22656 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:16.497244 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b2bcd76e-117a-44f4-a334-63bcb6f22656 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1695 microversion: 2.1 time: 0.152373 Jul 31 02:20:16.497801 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3561/7158] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:16 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:17.519972 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f1c8ac48-3824-4a44-ada6-c0ee7906ab69 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:17.520571 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f1c8ac48-3824-4a44-ada6-c0ee7906ab69 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:17.527391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1c8ac48-3824-4a44-ada6-c0ee7906ab69 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:17.527861 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1c8ac48-3824-4a44-ada6-c0ee7906ab69 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:17.528639 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1c8ac48-3824-4a44-ada6-c0ee7906ab69 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:17.529092 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f1c8ac48-3824-4a44-ada6-c0ee7906ab69 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:17.662301 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f1c8ac48-3824-4a44-ada6-c0ee7906ab69 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:17.670343 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f1c8ac48-3824-4a44-ada6-c0ee7906ab69 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1695 microversion: 2.1 time: 0.154419 Jul 31 02:20:17.670921 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3598/7159] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:17 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:18.692913 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-925da39d-1e2c-42bc-b228-345b3ed06acd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:18.693547 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-925da39d-1e2c-42bc-b228-345b3ed06acd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:18.700402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-925da39d-1e2c-42bc-b228-345b3ed06acd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:18.700873 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-925da39d-1e2c-42bc-b228-345b3ed06acd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:18.701682 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-925da39d-1e2c-42bc-b228-345b3ed06acd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:18.702140 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-925da39d-1e2c-42bc-b228-345b3ed06acd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:18.833933 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-925da39d-1e2c-42bc-b228-345b3ed06acd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:18.842059 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-925da39d-1e2c-42bc-b228-345b3ed06acd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1695 microversion: 2.1 time: 0.153083 Jul 31 02:20:18.842624 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3562/7160] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:18 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:19.863259 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7a03db5-c4dd-4bfb-a933-025e16c93f7b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:19.863856 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a7a03db5-c4dd-4bfb-a933-025e16c93f7b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:19.870862 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7a03db5-c4dd-4bfb-a933-025e16c93f7b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:19.871323 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7a03db5-c4dd-4bfb-a933-025e16c93f7b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:19.872122 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7a03db5-c4dd-4bfb-a933-025e16c93f7b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:19.872568 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7a03db5-c4dd-4bfb-a933-025e16c93f7b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:20.010507 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a7a03db5-c4dd-4bfb-a933-025e16c93f7b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:20.017936 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a7a03db5-c4dd-4bfb-a933-025e16c93f7b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1695 microversion: 2.1 time: 0.158677 Jul 31 02:20:20.018534 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3599/7161] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:19 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:21.039798 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a7367896-1f53-4844-874d-4cb84fe9b0bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:21.040372 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a7367896-1f53-4844-874d-4cb84fe9b0bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:21.047308 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7367896-1f53-4844-874d-4cb84fe9b0bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:21.047807 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7367896-1f53-4844-874d-4cb84fe9b0bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:21.048595 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7367896-1f53-4844-874d-4cb84fe9b0bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:21.049056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a7367896-1f53-4844-874d-4cb84fe9b0bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:21.178294 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a7367896-1f53-4844-874d-4cb84fe9b0bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:21.186217 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a7367896-1f53-4844-874d-4cb84fe9b0bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1695 microversion: 2.1 time: 0.150534 Jul 31 02:20:21.186822 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3563/7162] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:21 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:22.208204 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7291aa8b-0cf6-46ad-84e6-9aef1f8d090f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:22.208747 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7291aa8b-0cf6-46ad-84e6-9aef1f8d090f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:22.215584 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7291aa8b-0cf6-46ad-84e6-9aef1f8d090f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:22.216037 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7291aa8b-0cf6-46ad-84e6-9aef1f8d090f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:22.216809 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7291aa8b-0cf6-46ad-84e6-9aef1f8d090f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:22.217251 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7291aa8b-0cf6-46ad-84e6-9aef1f8d090f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:22.354931 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7291aa8b-0cf6-46ad-84e6-9aef1f8d090f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:22.362500 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7291aa8b-0cf6-46ad-84e6-9aef1f8d090f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1695 microversion: 2.1 time: 0.158300 Jul 31 02:20:22.363078 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3600/7163] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:22 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:23.385188 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-347fc36e-ec4f-4a49-bb7a-d5da324a3014 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:23.385822 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-347fc36e-ec4f-4a49-bb7a-d5da324a3014 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:23.392957 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-347fc36e-ec4f-4a49-bb7a-d5da324a3014 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:23.393429 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-347fc36e-ec4f-4a49-bb7a-d5da324a3014 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:23.394232 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-347fc36e-ec4f-4a49-bb7a-d5da324a3014 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:23.394691 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-347fc36e-ec4f-4a49-bb7a-d5da324a3014 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:23.533622 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-347fc36e-ec4f-4a49-bb7a-d5da324a3014 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:23.541269 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-347fc36e-ec4f-4a49-bb7a-d5da324a3014 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1695 microversion: 2.1 time: 0.160563 Jul 31 02:20:23.541840 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3564/7164] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:23 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:24.562765 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9d90a3cc-c00c-4e36-a692-442bb12dabad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:24.563540 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9d90a3cc-c00c-4e36-a692-442bb12dabad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:24.570535 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d90a3cc-c00c-4e36-a692-442bb12dabad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:24.571002 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d90a3cc-c00c-4e36-a692-442bb12dabad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:24.571828 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d90a3cc-c00c-4e36-a692-442bb12dabad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:24.572300 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d90a3cc-c00c-4e36-a692-442bb12dabad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:24.705402 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9d90a3cc-c00c-4e36-a692-442bb12dabad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:24.713498 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9d90a3cc-c00c-4e36-a692-442bb12dabad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1695 microversion: 2.1 time: 0.154658 Jul 31 02:20:24.714081 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3601/7165] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:24 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:25.735041 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6c11e4fe-1e30-48d7-a327-fde20994474b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:25.735695 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6c11e4fe-1e30-48d7-a327-fde20994474b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:25.742668 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c11e4fe-1e30-48d7-a327-fde20994474b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:25.743137 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c11e4fe-1e30-48d7-a327-fde20994474b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:25.744527 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c11e4fe-1e30-48d7-a327-fde20994474b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:25.744982 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6c11e4fe-1e30-48d7-a327-fde20994474b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:25.883771 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6c11e4fe-1e30-48d7-a327-fde20994474b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:25.891360 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6c11e4fe-1e30-48d7-a327-fde20994474b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1695 microversion: 2.1 time: 0.160263 Jul 31 02:20:25.891929 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3565/7166] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:25 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:26.913131 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-196d1753-18e2-4261-9bd8-23efe38eadcb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:26.913686 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-196d1753-18e2-4261-9bd8-23efe38eadcb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:26.920540 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-196d1753-18e2-4261-9bd8-23efe38eadcb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:26.920996 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-196d1753-18e2-4261-9bd8-23efe38eadcb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:26.921762 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-196d1753-18e2-4261-9bd8-23efe38eadcb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:26.922206 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-196d1753-18e2-4261-9bd8-23efe38eadcb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:27.057332 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-196d1753-18e2-4261-9bd8-23efe38eadcb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:27.065344 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-196d1753-18e2-4261-9bd8-23efe38eadcb tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1695 microversion: 2.1 time: 0.156251 Jul 31 02:20:27.066115 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3602/7167] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:26 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:27.596419 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-1e882051-6087-45f3-9517-8ac37117d593 req-cdad7aeb-bb1a-44fa-9ece-407c15f32733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeea4870-6554-49d9-8e38-88a288ccff2a", "name": "network-vif-unplugged", "status": "completed", "tag": "21eb3eaf-413a-49cd-8a9b-3f346585af66"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:20:27.607789 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1e882051-6087-45f3-9517-8ac37117d593 req-cdad7aeb-bb1a-44fa-9ece-407c15f32733 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:27.608530 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-1e882051-6087-45f3-9517-8ac37117d593 req-cdad7aeb-bb1a-44fa-9ece-407c15f32733 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:27.622569 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-1e882051-6087-45f3-9517-8ac37117d593 req-cdad7aeb-bb1a-44fa-9ece-407c15f32733 service nova] Creating event network-vif-unplugged:21eb3eaf-413a-49cd-8a9b-3f346585af66 for instance eeea4870-6554-49d9-8e38-88a288ccff2a on n-h1-master-1 Jul 31 02:20:27.629508 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [req-1e882051-6087-45f3-9517-8ac37117d593 req-cdad7aeb-bb1a-44fa-9ece-407c15f32733 service nova] Instance eeea4870-6554-49d9-8e38-88a288ccff2a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119474) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:20:27.640485 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-1e882051-6087-45f3-9517-8ac37117d593 req-cdad7aeb-bb1a-44fa-9ece-407c15f32733 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048123 Jul 31 02:20:27.641103 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3566/7168] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:20:28.087230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-10424423-2834-4f3f-a762-b98c07ccf9d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:28.088429 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-10424423-2834-4f3f-a762-b98c07ccf9d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:28.095689 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10424423-2834-4f3f-a762-b98c07ccf9d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:28.096137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10424423-2834-4f3f-a762-b98c07ccf9d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:28.096919 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10424423-2834-4f3f-a762-b98c07ccf9d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:28.097366 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-10424423-2834-4f3f-a762-b98c07ccf9d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:28.244890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-10424423-2834-4f3f-a762-b98c07ccf9d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:28.252872 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-10424423-2834-4f3f-a762-b98c07ccf9d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1694 microversion: 2.1 time: 0.169521 Jul 31 02:20:28.253448 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3603/7169] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:28 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:29.276839 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ffda4923-697c-4536-afb3-c418874c5279 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:29.277557 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ffda4923-697c-4536-afb3-c418874c5279 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:29.283821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ffda4923-697c-4536-afb3-c418874c5279 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:29.284290 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ffda4923-697c-4536-afb3-c418874c5279 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:29.285072 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ffda4923-697c-4536-afb3-c418874c5279 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:29.285522 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ffda4923-697c-4536-afb3-c418874c5279 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:29.416411 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ffda4923-697c-4536-afb3-c418874c5279 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:29.423880 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ffda4923-697c-4536-afb3-c418874c5279 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1692 microversion: 2.1 time: 0.152392 Jul 31 02:20:29.424447 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3567/7170] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:29 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:29.678229 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-479ccceb-69f0-477e-8a96-e2e0d1402d92 req-6fbcea52-eec6-49d4-ae40-7e715df1d25b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeea4870-6554-49d9-8e38-88a288ccff2a", "tag": "21eb3eaf-413a-49cd-8a9b-3f346585af66"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:20:29.689296 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-479ccceb-69f0-477e-8a96-e2e0d1402d92 req-6fbcea52-eec6-49d4-ae40-7e715df1d25b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:29.689943 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-479ccceb-69f0-477e-8a96-e2e0d1402d92 req-6fbcea52-eec6-49d4-ae40-7e715df1d25b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:29.702528 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-479ccceb-69f0-477e-8a96-e2e0d1402d92 req-6fbcea52-eec6-49d4-ae40-7e715df1d25b service nova] Creating event network-changed:21eb3eaf-413a-49cd-8a9b-3f346585af66 for instance eeea4870-6554-49d9-8e38-88a288ccff2a on n-h1-master-1 Jul 31 02:20:29.708201 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [req-479ccceb-69f0-477e-8a96-e2e0d1402d92 req-6fbcea52-eec6-49d4-ae40-7e715df1d25b service nova] Instance eeea4870-6554-49d9-8e38-88a288ccff2a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=119475) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Jul 31 02:20:29.720344 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-479ccceb-69f0-477e-8a96-e2e0d1402d92 req-6fbcea52-eec6-49d4-ae40-7e715df1d25b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045888 Jul 31 02:20:29.721353 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3604/7171] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:20:30.446229 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-84511d93-db9f-4ce8-a8bd-04fe34b2d96a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:30.448020 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-84511d93-db9f-4ce8-a8bd-04fe34b2d96a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:30.455367 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-84511d93-db9f-4ce8-a8bd-04fe34b2d96a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:30.456090 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-84511d93-db9f-4ce8-a8bd-04fe34b2d96a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:30.456896 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-84511d93-db9f-4ce8-a8bd-04fe34b2d96a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:30.457359 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-84511d93-db9f-4ce8-a8bd-04fe34b2d96a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:30.598232 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-84511d93-db9f-4ce8-a8bd-04fe34b2d96a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:30.605815 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-84511d93-db9f-4ce8-a8bd-04fe34b2d96a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1689 microversion: 2.1 time: 0.163610 Jul 31 02:20:30.606626 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3568/7172] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:30 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:30.628043 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-76d76aa7-3db8-4659-8fea-eea12266e6b4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:20:30.628683 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-76d76aa7-3db8-4659-8fea-eea12266e6b4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:30.635640 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76d76aa7-3db8-4659-8fea-eea12266e6b4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:30.636106 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76d76aa7-3db8-4659-8fea-eea12266e6b4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:30.636891 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76d76aa7-3db8-4659-8fea-eea12266e6b4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:30.637344 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-76d76aa7-3db8-4659-8fea-eea12266e6b4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:30.695085 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-76d76aa7-3db8-4659-8fea-eea12266e6b4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a/action" status: 204 len: 0 microversion: 2.1 time: 0.071483 Jul 31 02:20:30.696044 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3605/7173] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:20:30 2022] POST /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:20:30.704983 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d8e32da8-84d6-4d6a-be87-51815c2285a0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:30.705555 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d8e32da8-84d6-4d6a-be87-51815c2285a0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:30.712781 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8e32da8-84d6-4d6a-be87-51815c2285a0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:30.713258 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8e32da8-84d6-4d6a-be87-51815c2285a0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:30.714130 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8e32da8-84d6-4d6a-be87-51815c2285a0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:30.714627 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d8e32da8-84d6-4d6a-be87-51815c2285a0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:30.854745 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d8e32da8-84d6-4d6a-be87-51815c2285a0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:30.862971 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d8e32da8-84d6-4d6a-be87-51815c2285a0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1689 microversion: 2.1 time: 0.161813 Jul 31 02:20:30.863772 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3569/7174] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:30 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:20:30.884820 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6733bec4-3559-4b6b-85fa-b65110f2a83a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:30.885528 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6733bec4-3559-4b6b-85fa-b65110f2a83a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:30.891652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6733bec4-3559-4b6b-85fa-b65110f2a83a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:30.892125 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6733bec4-3559-4b6b-85fa-b65110f2a83a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:30.892894 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6733bec4-3559-4b6b-85fa-b65110f2a83a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:30.893332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6733bec4-3559-4b6b-85fa-b65110f2a83a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:31.028951 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6733bec4-3559-4b6b-85fa-b65110f2a83a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:31.036782 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6733bec4-3559-4b6b-85fa-b65110f2a83a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1689 microversion: 2.1 time: 0.156155 Jul 31 02:20:31.037366 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3606/7175] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:30 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:32.059663 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f68a6220-244d-47d0-924c-cdc3012aa500 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:32.060326 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f68a6220-244d-47d0-924c-cdc3012aa500 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:32.068855 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f68a6220-244d-47d0-924c-cdc3012aa500 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:32.069339 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f68a6220-244d-47d0-924c-cdc3012aa500 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:32.070167 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f68a6220-244d-47d0-924c-cdc3012aa500 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:32.070625 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f68a6220-244d-47d0-924c-cdc3012aa500 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:32.211935 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f68a6220-244d-47d0-924c-cdc3012aa500 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:32.219652 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f68a6220-244d-47d0-924c-cdc3012aa500 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1689 microversion: 2.1 time: 0.164444 Jul 31 02:20:32.220231 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3570/7176] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:32 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:33.242221 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f9be59c8-3415-4906-a220-29c1150d0693 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:20:33.242935 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f9be59c8-3415-4906-a220-29c1150d0693 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:33.249718 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9be59c8-3415-4906-a220-29c1150d0693 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:33.250279 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9be59c8-3415-4906-a220-29c1150d0693 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:33.251143 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9be59c8-3415-4906-a220-29c1150d0693 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:33.251954 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f9be59c8-3415-4906-a220-29c1150d0693 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:33.272800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-733c535f-9271-436c-943c-0dc819ddbd9c req-c697701a-7973-478e-9212-629d5bc2aca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeea4870-6554-49d9-8e38-88a288ccff2a", "name": "network-vif-plugged", "status": "completed", "tag": "21eb3eaf-413a-49cd-8a9b-3f346585af66"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:20:33.286466 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-733c535f-9271-436c-943c-0dc819ddbd9c req-c697701a-7973-478e-9212-629d5bc2aca7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:33.287142 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-733c535f-9271-436c-943c-0dc819ddbd9c req-c697701a-7973-478e-9212-629d5bc2aca7 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:33.302114 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-733c535f-9271-436c-943c-0dc819ddbd9c req-c697701a-7973-478e-9212-629d5bc2aca7 service nova] Creating event network-vif-plugged:21eb3eaf-413a-49cd-8a9b-3f346585af66 for instance eeea4870-6554-49d9-8e38-88a288ccff2a on n-h1-master-1 Jul 31 02:20:33.307411 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-733c535f-9271-436c-943c-0dc819ddbd9c req-c697701a-7973-478e-9212-629d5bc2aca7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038202 Jul 31 02:20:33.308287 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3571/7177] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:20:33.406649 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f9be59c8-3415-4906-a220-29c1150d0693 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:20:33.414325 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f9be59c8-3415-4906-a220-29c1150d0693 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1681 microversion: 2.1 time: 0.176550 Jul 31 02:20:33.414903 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3607/7178] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:20:33 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:20:55.589112 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=34 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:20:55.589905 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:20:55.594602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5c73ab14-262c-42e5-b04f-052046aacb1c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:20:55.596908 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5c73ab14-262c-42e5-b04f-052046aacb1c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:20:55.604480 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c73ab14-262c-42e5-b04f-052046aacb1c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:55.604947 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c73ab14-262c-42e5-b04f-052046aacb1c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:55.605757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c73ab14-262c-42e5-b04f-052046aacb1c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:20:55.606211 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5c73ab14-262c-42e5-b04f-052046aacb1c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:20:55.667797 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5c73ab14-262c-42e5-b04f-052046aacb1c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a/action" status: 200 len: 24581 microversion: 2.1 time: 0.081068 Jul 31 02:20:55.668476 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3572/7179] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:20:55 2022] POST /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a/action => generated 24581 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 02:21:02.947317 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5b4b18bd-fe61-4fca-b71e-ec50cbd34c9d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:02.947843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5b4b18bd-fe61-4fca-b71e-ec50cbd34c9d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:02.950349 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-04f49f70-5e37-4578-a3a7-19a357153873 req-5c6ca642-8573-42fa-8009-fbf1afb66530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeea4870-6554-49d9-8e38-88a288ccff2a", "tag": "21eb3eaf-413a-49cd-8a9b-3f346585af66"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:21:02.950760 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=28 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:21:02.951037 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:21:02.958095 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b4b18bd-fe61-4fca-b71e-ec50cbd34c9d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:02.958555 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b4b18bd-fe61-4fca-b71e-ec50cbd34c9d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:02.959348 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b4b18bd-fe61-4fca-b71e-ec50cbd34c9d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:02.959811 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5b4b18bd-fe61-4fca-b71e-ec50cbd34c9d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:02.961375 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-04f49f70-5e37-4578-a3a7-19a357153873 req-5c6ca642-8573-42fa-8009-fbf1afb66530 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:02.961866 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-04f49f70-5e37-4578-a3a7-19a357153873 req-5c6ca642-8573-42fa-8009-fbf1afb66530 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:02.974464 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-04f49f70-5e37-4578-a3a7-19a357153873 req-5c6ca642-8573-42fa-8009-fbf1afb66530 service nova] Creating event network-changed:21eb3eaf-413a-49cd-8a9b-3f346585af66 for instance eeea4870-6554-49d9-8e38-88a288ccff2a on n-h1-master-1 Jul 31 02:21:02.980517 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-04f49f70-5e37-4578-a3a7-19a357153873 req-5c6ca642-8573-42fa-8009-fbf1afb66530 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034768 Jul 31 02:21:02.981350 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3573/7180] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:21:02.988936 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5b4b18bd-fe61-4fca-b71e-ec50cbd34c9d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:21:03.076248 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5b4b18bd-fe61-4fca-b71e-ec50cbd34c9d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 204 len: 0 microversion: 2.1 time: 0.133144 Jul 31 02:21:03.080292 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3608/7181] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:21:02 2022] DELETE /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:21:03.089149 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4dd3befe-04a5-4fbb-b773-532982b96650 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:03.089878 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4dd3befe-04a5-4fbb-b773-532982b96650 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:03.096810 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4dd3befe-04a5-4fbb-b773-532982b96650 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:03.097520 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4dd3befe-04a5-4fbb-b773-532982b96650 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:03.098318 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4dd3befe-04a5-4fbb-b773-532982b96650 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:03.098778 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4dd3befe-04a5-4fbb-b773-532982b96650 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:03.244358 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4dd3befe-04a5-4fbb-b773-532982b96650 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:03.252273 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4dd3befe-04a5-4fbb-b773-532982b96650 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1687 microversion: 2.1 time: 0.167221 Jul 31 02:21:03.252852 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3574/7182] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:03 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:21:04.274637 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0ab07e11-59e5-43b8-84a8-d1d149410d7a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:04.275378 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0ab07e11-59e5-43b8-84a8-d1d149410d7a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:04.282508 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ab07e11-59e5-43b8-84a8-d1d149410d7a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:04.282971 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ab07e11-59e5-43b8-84a8-d1d149410d7a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:04.283776 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ab07e11-59e5-43b8-84a8-d1d149410d7a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:04.284226 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0ab07e11-59e5-43b8-84a8-d1d149410d7a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:04.418073 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0ab07e11-59e5-43b8-84a8-d1d149410d7a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:04.425691 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0ab07e11-59e5-43b8-84a8-d1d149410d7a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 200 len: 1687 microversion: 2.1 time: 0.155344 Jul 31 02:21:04.426276 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3609/7183] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:04 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:21:04.937329 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-11a245a9-5481-41ff-8ea5-03e092804933 req-fbce98a9-802f-40b4-ac6e-1948578f1537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeea4870-6554-49d9-8e38-88a288ccff2a", "name": "network-vif-deleted", "tag": "21eb3eaf-413a-49cd-8a9b-3f346585af66"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:21:04.947403 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-11a245a9-5481-41ff-8ea5-03e092804933 req-fbce98a9-802f-40b4-ac6e-1948578f1537 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:04.947867 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-11a245a9-5481-41ff-8ea5-03e092804933 req-fbce98a9-802f-40b4-ac6e-1948578f1537 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:04.959093 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-11a245a9-5481-41ff-8ea5-03e092804933 req-fbce98a9-802f-40b4-ac6e-1948578f1537 service nova] Creating event network-vif-deleted:21eb3eaf-413a-49cd-8a9b-3f346585af66 for instance eeea4870-6554-49d9-8e38-88a288ccff2a on n-h1-master-1 Jul 31 02:21:04.964468 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-11a245a9-5481-41ff-8ea5-03e092804933 req-fbce98a9-802f-40b4-ac6e-1948578f1537 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031183 Jul 31 02:21:04.965065 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3575/7184] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:21:05.447697 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-daf372ea-fef4-4b0f-a99f-5a8bcdb766c4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:05.448204 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-daf372ea-fef4-4b0f-a99f-5a8bcdb766c4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: eeea4870-6554-49d9-8e38-88a288ccff2a] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:05.455714 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daf372ea-fef4-4b0f-a99f-5a8bcdb766c4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:05.456153 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daf372ea-fef4-4b0f-a99f-5a8bcdb766c4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:05.456925 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daf372ea-fef4-4b0f-a99f-5a8bcdb766c4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:05.457370 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-daf372ea-fef4-4b0f-a99f-5a8bcdb766c4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:05.472230 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-daf372ea-fef4-4b0f-a99f-5a8bcdb766c4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] HTTP exception thrown: Instance eeea4870-6554-49d9-8e38-88a288ccff2a could not be found. Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-daf372ea-fef4-4b0f-a99f-5a8bcdb766c4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Request method failure captured: Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a HTTP/1.1 Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eYAzDqc_OrsAo-J-1bmHbcGAw2mwcba9oBFF1GuJx7h2q7wwDdcuA7T2_M6jA7aPmOdJhu8rpEfLWey7CD1suIH_p6ArzYUQmGU5sKYkwqNwBdWdKcvT-9kRBlA7tTcoDsaVXE46dP44tqxX1wh2NBRglHhcVT1rTlI3mrQzAiqe2E Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 14c964a9135b44f2b83dba23842472cd Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-97164417 Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/14c964a9135b44f2b83dba23842472cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/14c964a9135b44f2b83dba23842472cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/14c964a9135b44f2b83dba23842472cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_14c964a9135b44f2b83dba23842472cd", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestNetworkAdvancedServerOps-97164417 Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 14c964a9135b44f2b83dba23842472cd Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-97164417 Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestNetworkAdvancedServerOps-97164417-project Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: b070525312804b0bb43370f12c449697 Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestNetworkAdvancedServerOps-97164417-project Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: exception: Instance eeea4870-6554-49d9-8e38-88a288ccff2a could not be found. Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'eeea4870-6554-49d9-8e38-88a288ccff2a'} Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeea4870-6554-49d9-8e38-88a288ccff2a could not be found. Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeea4870-6554-49d9-8e38-88a288ccff2a could not be found. Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:21:05.473893 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:21:05.478969 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:21:05.478969 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:21:05.478969 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:21:05.478969 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:21:05.478969 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:21:05.478969 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeea4870-6554-49d9-8e38-88a288ccff2a could not be found. Jul 31 02:21:05.478969 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:21:05.478969 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-daf372ea-fef4-4b0f-a99f-5a8bcdb766c4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Returning 404 to user: Instance eeea4870-6554-49d9-8e38-88a288ccff2a could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:21:05.478969 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-daf372ea-fef4-4b0f-a99f-5a8bcdb766c4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a" status: 404 len: 111 microversion: 2.1 time: 0.031866 Jul 31 02:21:05.478969 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3610/7185] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:05 2022] GET /compute/v2.1/servers/eeea4870-6554-49d9-8e38-88a288ccff2a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:21:08.453761 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-204e5485-beda-4c6f-9227-791df63efe37 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '.version_select at 0x7fede44888b0>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:08.477232 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-204e5485-beda-4c6f-9227-791df63efe37 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1423756437" status: 202 len: 0 microversion: 2.1 time: 0.030948 Jul 31 02:21:08.477832 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3576/7186] 10.222.0.45 () {58 vars in 1284 bytes} [Sun Jul 31 02:21:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1423756437 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:21:08.506204 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8a0e50fc-b95c-40a3-b2e6-25b51c80e78e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'create', calling method: .version_select at 0x7fede52c5040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-643329444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcF952jtu1gE7UP5nt1XTyMyOlGNEdgmu7okf+cv2uRJbvk5g2KN3A7WeO70uqQwHwVOF6/1pU2wKoPWmObQUu4f7ZhDJoea1+k0744Ocxh55XsKLpXHjSnLge2l3vJgA=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:21:08.522525 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-8a0e50fc-b95c-40a3-b2e6-25b51c80e78e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for project 14c964a9135b44f2b83dba23842472cd. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:21:08.529068 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-8a0e50fc-b95c-40a3-b2e6-25b51c80e78e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for user b070525312804b0bb43370f12c449697 and project 14c964a9135b44f2b83dba23842472cd. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:21:08.552346 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8a0e50fc-b95c-40a3-b2e6-25b51c80e78e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050276 Jul 31 02:21:08.552936 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3611/7187] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 02:21:08 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:21:14.585537 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b86fdbd3-3781-4957-a3c3-e1ed2fdf25ab tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1130252238", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "7badd21b-38d3-4541-b20d-791e6923b553"}], "key_name": "tempest-TestNetworkAdvancedServerOps-643329444", "security_groups": [{"name": "tempest-secgroup-smoke-1495108105"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:21:14.697538 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-b86fdbd3-3781-4957-a3c3-e1ed2fdf25ab tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] validate_networks() for [('7badd21b-38d3-4541-b20d-791e6923b553', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:21:14.952670 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=14 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:21:15.147567 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b86fdbd3-3781-4957-a3c3-e1ed2fdf25ab tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:21:15.148010 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b86fdbd3-3781-4957-a3c3-e1ed2fdf25ab tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:21:15.148500 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b86fdbd3-3781-4957-a3c3-e1ed2fdf25ab tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:21:15.148926 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b86fdbd3-3781-4957-a3c3-e1ed2fdf25ab tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:21:15.149927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-b86fdbd3-3781-4957-a3c3-e1ed2fdf25ab tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:21:15.159957 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b86fdbd3-3781-4957-a3c3-e1ed2fdf25ab tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:15.160448 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b86fdbd3-3781-4957-a3c3-e1ed2fdf25ab tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:15.161224 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b86fdbd3-3781-4957-a3c3-e1ed2fdf25ab tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:15.162115 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b86fdbd3-3781-4957-a3c3-e1ed2fdf25ab tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:15.180937 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-b86fdbd3-3781-4957-a3c3-e1ed2fdf25ab tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for project 14c964a9135b44f2b83dba23842472cd. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:21:15.186349 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-b86fdbd3-3781-4957-a3c3-e1ed2fdf25ab tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for user b070525312804b0bb43370f12c449697 and project 14c964a9135b44f2b83dba23842472cd. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:21:15.200393 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b86fdbd3-3781-4957-a3c3-e1ed2fdf25ab tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:21:15.203055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b86fdbd3-3781-4957-a3c3-e1ed2fdf25ab tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:21:15.259798 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b86fdbd3-3781-4957-a3c3-e1ed2fdf25ab tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.678366 Jul 31 02:21:15.266829 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3577/7188] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:21:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:21:15.273932 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-afc8e1bd-a58c-4f15-bebb-fb839d22a1e9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:15.275290 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-afc8e1bd-a58c-4f15-bebb-fb839d22a1e9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:15.345025 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-afc8e1bd-a58c-4f15-bebb-fb839d22a1e9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:15.351886 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-afc8e1bd-a58c-4f15-bebb-fb839d22a1e9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1266 microversion: 2.1 time: 0.083650 Jul 31 02:21:15.352525 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3612/7189] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:15 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:21:16.379024 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1e6760d5-acbe-41d6-9b79-ead268cb4dec tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:16.380536 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1e6760d5-acbe-41d6-9b79-ead268cb4dec tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:16.415817 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e6760d5-acbe-41d6-9b79-ead268cb4dec tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:16.416689 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e6760d5-acbe-41d6-9b79-ead268cb4dec tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:16.417748 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e6760d5-acbe-41d6-9b79-ead268cb4dec tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:16.418421 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1e6760d5-acbe-41d6-9b79-ead268cb4dec tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:16.507251 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1e6760d5-acbe-41d6-9b79-ead268cb4dec tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:16.515952 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1e6760d5-acbe-41d6-9b79-ead268cb4dec tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1336 microversion: 2.1 time: 0.145596 Jul 31 02:21:16.516538 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3578/7190] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:16 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1336 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:21:17.538134 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5c32717c-fa27-445f-b0ca-e1cf4b46adda tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:17.538772 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5c32717c-fa27-445f-b0ca-e1cf4b46adda tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:17.542567 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:21:17.548770 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c32717c-fa27-445f-b0ca-e1cf4b46adda tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:17.549294 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c32717c-fa27-445f-b0ca-e1cf4b46adda tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:17.550160 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c32717c-fa27-445f-b0ca-e1cf4b46adda tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:17.550652 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c32717c-fa27-445f-b0ca-e1cf4b46adda tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:17.770961 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5c32717c-fa27-445f-b0ca-e1cf4b46adda tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:17.779100 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5c32717c-fa27-445f-b0ca-e1cf4b46adda tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1392 microversion: 2.1 time: 0.244928 Jul 31 02:21:17.779943 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3613/7191] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:17 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1392 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:21:17.930313 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-f4d5fdba-6b6e-4c9c-8c91-f33e72816450 req-7b483cfe-7a5f-455c-8e7b-f9cec2be66a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a79732-c4e7-4275-a581-6661e9704332", "tag": "67815244-85e7-49ac-a6f7-d6aef6f3dcc9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:21:17.940340 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f4d5fdba-6b6e-4c9c-8c91-f33e72816450 req-7b483cfe-7a5f-455c-8e7b-f9cec2be66a3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:17.940800 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f4d5fdba-6b6e-4c9c-8c91-f33e72816450 req-7b483cfe-7a5f-455c-8e7b-f9cec2be66a3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:17.952717 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-f4d5fdba-6b6e-4c9c-8c91-f33e72816450 req-7b483cfe-7a5f-455c-8e7b-f9cec2be66a3 service nova] Creating event network-changed:67815244-85e7-49ac-a6f7-d6aef6f3dcc9 for instance 62a79732-c4e7-4275-a581-6661e9704332 on n-h1-master-1 Jul 31 02:21:17.957951 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-f4d5fdba-6b6e-4c9c-8c91-f33e72816450 req-7b483cfe-7a5f-455c-8e7b-f9cec2be66a3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106362 Jul 31 02:21:17.958557 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3579/7192] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:21:18.801253 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6e47647f-5ce0-4e0a-acfd-23e84bcf68e0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:18.801883 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6e47647f-5ce0-4e0a-acfd-23e84bcf68e0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:18.809364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e47647f-5ce0-4e0a-acfd-23e84bcf68e0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:18.809830 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e47647f-5ce0-4e0a-acfd-23e84bcf68e0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:18.810616 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e47647f-5ce0-4e0a-acfd-23e84bcf68e0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:18.811064 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e47647f-5ce0-4e0a-acfd-23e84bcf68e0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:18.944575 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6e47647f-5ce0-4e0a-acfd-23e84bcf68e0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:18.952439 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6e47647f-5ce0-4e0a-acfd-23e84bcf68e0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1392 microversion: 2.1 time: 0.155115 Jul 31 02:21:18.953027 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3614/7193] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:18 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:21:19.974271 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-797741a5-12f9-4c28-86e6-f554eab06522 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:19.975107 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-797741a5-12f9-4c28-86e6-f554eab06522 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:19.981499 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-797741a5-12f9-4c28-86e6-f554eab06522 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:19.981971 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-797741a5-12f9-4c28-86e6-f554eab06522 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:19.982758 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-797741a5-12f9-4c28-86e6-f554eab06522 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:19.983215 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-797741a5-12f9-4c28-86e6-f554eab06522 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:20.123767 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-797741a5-12f9-4c28-86e6-f554eab06522 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:20.131822 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-797741a5-12f9-4c28-86e6-f554eab06522 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1392 microversion: 2.1 time: 0.162737 Jul 31 02:21:20.132509 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3580/7194] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:19 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:21:21.154156 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8cbb6bfd-acec-4b87-9b26-0e4ef40d3ac9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:21.154780 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8cbb6bfd-acec-4b87-9b26-0e4ef40d3ac9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:21.161882 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8cbb6bfd-acec-4b87-9b26-0e4ef40d3ac9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:21.162346 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8cbb6bfd-acec-4b87-9b26-0e4ef40d3ac9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:21.163125 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8cbb6bfd-acec-4b87-9b26-0e4ef40d3ac9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:21.163610 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8cbb6bfd-acec-4b87-9b26-0e4ef40d3ac9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:21.300266 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8cbb6bfd-acec-4b87-9b26-0e4ef40d3ac9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:21.307594 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8cbb6bfd-acec-4b87-9b26-0e4ef40d3ac9 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1392 microversion: 2.1 time: 0.157947 Jul 31 02:21:21.308179 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3615/7195] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:21 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:21:21.535980 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-ee5c436b-ad94-453e-8c5a-ae5fc651ee1c req-7533b59c-0581-4184-b1a8-e3492c7e21f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a79732-c4e7-4275-a581-6661e9704332", "name": "network-vif-plugged", "status": "completed", "tag": "67815244-85e7-49ac-a6f7-d6aef6f3dcc9"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:21:21.546191 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-ee5c436b-ad94-453e-8c5a-ae5fc651ee1c req-7533b59c-0581-4184-b1a8-e3492c7e21f5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:21.546623 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-ee5c436b-ad94-453e-8c5a-ae5fc651ee1c req-7533b59c-0581-4184-b1a8-e3492c7e21f5 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:21.558679 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-ee5c436b-ad94-453e-8c5a-ae5fc651ee1c req-7533b59c-0581-4184-b1a8-e3492c7e21f5 service nova] Creating event network-vif-plugged:67815244-85e7-49ac-a6f7-d6aef6f3dcc9 for instance 62a79732-c4e7-4275-a581-6661e9704332 on n-h1-master-1 Jul 31 02:21:21.563665 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-ee5c436b-ad94-453e-8c5a-ae5fc651ee1c req-7533b59c-0581-4184-b1a8-e3492c7e21f5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031341 Jul 31 02:21:21.564417 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3581/7196] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:21:22.328659 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1f3c8b81-2b26-44ed-9f66-4517a56fc7ae tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:22.329293 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1f3c8b81-2b26-44ed-9f66-4517a56fc7ae tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:22.336197 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f3c8b81-2b26-44ed-9f66-4517a56fc7ae tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:22.337174 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f3c8b81-2b26-44ed-9f66-4517a56fc7ae tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:22.337956 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f3c8b81-2b26-44ed-9f66-4517a56fc7ae tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:22.338402 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f3c8b81-2b26-44ed-9f66-4517a56fc7ae tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:22.473100 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1f3c8b81-2b26-44ed-9f66-4517a56fc7ae tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:22.481291 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1f3c8b81-2b26-44ed-9f66-4517a56fc7ae tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1392 microversion: 2.1 time: 0.156661 Jul 31 02:21:22.481902 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3616/7197] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:22 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:21:23.503606 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-41414dec-66d7-4404-94ea-9d3b619d83ef tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:23.504328 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-41414dec-66d7-4404-94ea-9d3b619d83ef tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:23.510686 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41414dec-66d7-4404-94ea-9d3b619d83ef tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:23.511158 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41414dec-66d7-4404-94ea-9d3b619d83ef tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:23.511967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41414dec-66d7-4404-94ea-9d3b619d83ef tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:23.512425 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41414dec-66d7-4404-94ea-9d3b619d83ef tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:23.644204 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-41414dec-66d7-4404-94ea-9d3b619d83ef tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:23.652156 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-41414dec-66d7-4404-94ea-9d3b619d83ef tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1564 microversion: 2.1 time: 0.153986 Jul 31 02:21:23.652726 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3582/7198] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:23 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:21:23.672735 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-becb8fbe-1670-405d-a5bb-cf8ef8c67b57 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:23.673359 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-becb8fbe-1670-405d-a5bb-cf8ef8c67b57 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:23.680347 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-becb8fbe-1670-405d-a5bb-cf8ef8c67b57 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:23.680717 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-becb8fbe-1670-405d-a5bb-cf8ef8c67b57 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:23.681490 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-becb8fbe-1670-405d-a5bb-cf8ef8c67b57 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:23.681935 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-becb8fbe-1670-405d-a5bb-cf8ef8c67b57 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:23.811184 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-becb8fbe-1670-405d-a5bb-cf8ef8c67b57 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:23.818743 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-becb8fbe-1670-405d-a5bb-cf8ef8c67b57 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1564 microversion: 2.1 time: 0.149889 Jul 31 02:21:23.819331 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3617/7199] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:23 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1564 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:21:25.672310 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-5c316073-915a-42b2-8e88-2f43e6dda73a req-34eea37f-5bff-424b-a149-7c66897f1618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a79732-c4e7-4275-a581-6661e9704332", "tag": "67815244-85e7-49ac-a6f7-d6aef6f3dcc9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:21:25.675813 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bf5d8b06-3204-4a51-b005-08555185120c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:25.676484 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bf5d8b06-3204-4a51-b005-08555185120c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:25.679426 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:21:25.680974 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:21:25.681907 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:21:25.683442 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:21:25.688700 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf5d8b06-3204-4a51-b005-08555185120c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:25.689193 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf5d8b06-3204-4a51-b005-08555185120c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:25.690114 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf5d8b06-3204-4a51-b005-08555185120c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:25.690594 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bf5d8b06-3204-4a51-b005-08555185120c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:25.693988 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5c316073-915a-42b2-8e88-2f43e6dda73a req-34eea37f-5bff-424b-a149-7c66897f1618 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:25.694480 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5c316073-915a-42b2-8e88-2f43e6dda73a req-34eea37f-5bff-424b-a149-7c66897f1618 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:25.708583 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-5c316073-915a-42b2-8e88-2f43e6dda73a req-34eea37f-5bff-424b-a149-7c66897f1618 service nova] Creating event network-changed:67815244-85e7-49ac-a6f7-d6aef6f3dcc9 for instance 62a79732-c4e7-4275-a581-6661e9704332 on n-h1-master-1 Jul 31 02:21:25.715943 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-5c316073-915a-42b2-8e88-2f43e6dda73a req-34eea37f-5bff-424b-a149-7c66897f1618 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046473 Jul 31 02:21:25.717494 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3618/7200] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:21:25.920293 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bf5d8b06-3204-4a51-b005-08555185120c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:25.928101 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bf5d8b06-3204-4a51-b005-08555185120c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1564 microversion: 2.1 time: 0.265182 Jul 31 02:21:25.928676 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3583/7201] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:25 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1564 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:21:47.172560 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:21:47.173310 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=32 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:21:47.220245 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e684d1a8-6070-4cb4-9240-0e28fb655844 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:21:47.222934 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e684d1a8-6070-4cb4-9240-0e28fb655844 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:47.229147 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e684d1a8-6070-4cb4-9240-0e28fb655844 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:47.229613 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e684d1a8-6070-4cb4-9240-0e28fb655844 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:47.230979 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e684d1a8-6070-4cb4-9240-0e28fb655844 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:47.231583 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e684d1a8-6070-4cb4-9240-0e28fb655844 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:47.297708 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e684d1a8-6070-4cb4-9240-0e28fb655844 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332/action" status: 200 len: 24570 microversion: 2.1 time: 0.130613 Jul 31 02:21:47.298324 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3619/7202] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:21:47 2022] POST /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332/action => generated 24570 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 02:21:53.765561 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f5d1a205-f8c0-433d-90f0-6897afa72531 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:21:53.767729 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:21:53.768539 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=30 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:21:53.774230 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5d1a205-f8c0-433d-90f0-6897afa72531 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:53.774702 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f5d1a205-f8c0-433d-90f0-6897afa72531 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:53.796926 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f5d1a205-f8c0-433d-90f0-6897afa72531 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Going to try to stop instance {{(pid=119474) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 02:21:53.843404 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f5d1a205-f8c0-433d-90f0-6897afa72531 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332/action" status: 202 len: 0 microversion: 2.1 time: 0.082533 Jul 31 02:21:53.844202 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3584/7203] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:21:53 2022] POST /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:21:53.853234 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a8dca7f8-7886-4244-a3d0-f70a3944110f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:53.853703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a8dca7f8-7886-4244-a3d0-f70a3944110f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:53.861669 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8dca7f8-7886-4244-a3d0-f70a3944110f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:53.862134 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8dca7f8-7886-4244-a3d0-f70a3944110f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:53.863137 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8dca7f8-7886-4244-a3d0-f70a3944110f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:53.863699 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a8dca7f8-7886-4244-a3d0-f70a3944110f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:54.000083 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a8dca7f8-7886-4244-a3d0-f70a3944110f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:54.008215 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a8dca7f8-7886-4244-a3d0-f70a3944110f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1692 microversion: 2.1 time: 0.159457 Jul 31 02:21:54.008798 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3620/7204] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:53 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:21:55.032286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3a156aaf-70f0-4bf0-812b-6b1e75546257 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:55.032983 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3a156aaf-70f0-4bf0-812b-6b1e75546257 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:55.039543 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a156aaf-70f0-4bf0-812b-6b1e75546257 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:55.040017 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a156aaf-70f0-4bf0-812b-6b1e75546257 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:55.040801 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a156aaf-70f0-4bf0-812b-6b1e75546257 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:55.041256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3a156aaf-70f0-4bf0-812b-6b1e75546257 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:55.176183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3a156aaf-70f0-4bf0-812b-6b1e75546257 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:55.183908 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3a156aaf-70f0-4bf0-812b-6b1e75546257 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1692 microversion: 2.1 time: 0.157662 Jul 31 02:21:55.184482 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3585/7205] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:55 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:21:56.205488 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-20d62e44-4909-400d-a3fb-2d4f1c755f7e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:56.206017 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-20d62e44-4909-400d-a3fb-2d4f1c755f7e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:56.214052 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20d62e44-4909-400d-a3fb-2d4f1c755f7e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:56.214518 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20d62e44-4909-400d-a3fb-2d4f1c755f7e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:56.215313 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20d62e44-4909-400d-a3fb-2d4f1c755f7e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:56.215792 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-20d62e44-4909-400d-a3fb-2d4f1c755f7e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:56.361139 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-20d62e44-4909-400d-a3fb-2d4f1c755f7e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:56.371904 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-20d62e44-4909-400d-a3fb-2d4f1c755f7e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1692 microversion: 2.1 time: 0.170391 Jul 31 02:21:56.372490 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3621/7206] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:56 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:21:57.397047 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dec2755d-cf48-41c7-95b1-4ad8f717b2a5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:57.397684 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dec2755d-cf48-41c7-95b1-4ad8f717b2a5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:57.404845 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dec2755d-cf48-41c7-95b1-4ad8f717b2a5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:57.405312 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dec2755d-cf48-41c7-95b1-4ad8f717b2a5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:57.406096 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dec2755d-cf48-41c7-95b1-4ad8f717b2a5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:57.406555 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dec2755d-cf48-41c7-95b1-4ad8f717b2a5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:57.539718 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dec2755d-cf48-41c7-95b1-4ad8f717b2a5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:57.547125 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dec2755d-cf48-41c7-95b1-4ad8f717b2a5 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1692 microversion: 2.1 time: 0.153977 Jul 31 02:21:57.547717 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3586/7207] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:57 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:21:58.569798 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a740a019-89d6-467a-8144-a43d4a12e6be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:58.570425 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a740a019-89d6-467a-8144-a43d4a12e6be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:58.577975 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a740a019-89d6-467a-8144-a43d4a12e6be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:58.578434 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a740a019-89d6-467a-8144-a43d4a12e6be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:58.579201 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a740a019-89d6-467a-8144-a43d4a12e6be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:58.579680 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a740a019-89d6-467a-8144-a43d4a12e6be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:58.716230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a740a019-89d6-467a-8144-a43d4a12e6be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:58.723744 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a740a019-89d6-467a-8144-a43d4a12e6be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1692 microversion: 2.1 time: 0.157919 Jul 31 02:21:58.724333 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3622/7208] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:58 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:21:59.745020 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a3fc6a95-3464-46cf-9d62-a48c912011b4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:21:59.746155 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a3fc6a95-3464-46cf-9d62-a48c912011b4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:21:59.753333 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3fc6a95-3464-46cf-9d62-a48c912011b4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:59.753805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3fc6a95-3464-46cf-9d62-a48c912011b4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:59.754590 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3fc6a95-3464-46cf-9d62-a48c912011b4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:21:59.755048 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a3fc6a95-3464-46cf-9d62-a48c912011b4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:21:59.895397 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a3fc6a95-3464-46cf-9d62-a48c912011b4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:21:59.902994 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a3fc6a95-3464-46cf-9d62-a48c912011b4 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1692 microversion: 2.1 time: 0.161960 Jul 31 02:21:59.903596 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3587/7209] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:21:59 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:22:00.923844 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3b6dfc3d-4b3f-4f1e-9035-f85c56e5fb25 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:00.924469 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3b6dfc3d-4b3f-4f1e-9035-f85c56e5fb25 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:00.931390 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b6dfc3d-4b3f-4f1e-9035-f85c56e5fb25 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:00.931855 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b6dfc3d-4b3f-4f1e-9035-f85c56e5fb25 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:00.932620 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b6dfc3d-4b3f-4f1e-9035-f85c56e5fb25 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:00.933063 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3b6dfc3d-4b3f-4f1e-9035-f85c56e5fb25 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:01.065478 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3b6dfc3d-4b3f-4f1e-9035-f85c56e5fb25 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:22:01.072917 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3b6dfc3d-4b3f-4f1e-9035-f85c56e5fb25 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1692 microversion: 2.1 time: 0.153012 Jul 31 02:22:01.074107 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3623/7210] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:00 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:22:02.095240 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-44a31dd3-dbdd-4dc7-8a38-5c373acb4187 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:02.095818 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-44a31dd3-dbdd-4dc7-8a38-5c373acb4187 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:02.102706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44a31dd3-dbdd-4dc7-8a38-5c373acb4187 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:02.103178 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44a31dd3-dbdd-4dc7-8a38-5c373acb4187 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:02.103995 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44a31dd3-dbdd-4dc7-8a38-5c373acb4187 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:02.105006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-44a31dd3-dbdd-4dc7-8a38-5c373acb4187 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:02.238144 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-44a31dd3-dbdd-4dc7-8a38-5c373acb4187 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:22:02.245748 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-44a31dd3-dbdd-4dc7-8a38-5c373acb4187 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1692 microversion: 2.1 time: 0.154613 Jul 31 02:22:02.246315 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3588/7211] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:02 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:22:03.266986 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-899d7658-3c62-4f17-a8ab-3f3b5af709b6 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:03.267632 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-899d7658-3c62-4f17-a8ab-3f3b5af709b6 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:03.274593 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-899d7658-3c62-4f17-a8ab-3f3b5af709b6 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:03.275060 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-899d7658-3c62-4f17-a8ab-3f3b5af709b6 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:03.275863 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-899d7658-3c62-4f17-a8ab-3f3b5af709b6 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:03.276421 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-899d7658-3c62-4f17-a8ab-3f3b5af709b6 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:03.410155 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-899d7658-3c62-4f17-a8ab-3f3b5af709b6 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:22:03.417734 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-899d7658-3c62-4f17-a8ab-3f3b5af709b6 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1692 microversion: 2.1 time: 0.154642 Jul 31 02:22:03.418319 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3624/7212] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:03 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:22:04.439251 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-22602256-0218-432a-9e5f-dcb1d4a42fb6 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:04.439923 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-22602256-0218-432a-9e5f-dcb1d4a42fb6 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:04.447015 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22602256-0218-432a-9e5f-dcb1d4a42fb6 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:04.447522 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22602256-0218-432a-9e5f-dcb1d4a42fb6 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:04.448812 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22602256-0218-432a-9e5f-dcb1d4a42fb6 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:04.449274 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-22602256-0218-432a-9e5f-dcb1d4a42fb6 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:04.580418 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-22602256-0218-432a-9e5f-dcb1d4a42fb6 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:22:04.588090 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-22602256-0218-432a-9e5f-dcb1d4a42fb6 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1669 microversion: 2.1 time: 0.152814 Jul 31 02:22:04.588776 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3589/7213] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:04 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:22:05.679452 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2958c539-f6e5-42ce-bab7-f619f3755295 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:22:05.681713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2958c539-f6e5-42ce-bab7-f619f3755295 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:05.689142 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2958c539-f6e5-42ce-bab7-f619f3755295 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:05.689605 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2958c539-f6e5-42ce-bab7-f619f3755295 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:05.690374 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2958c539-f6e5-42ce-bab7-f619f3755295 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:05.690822 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2958c539-f6e5-42ce-bab7-f619f3755295 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:05.746521 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2958c539-f6e5-42ce-bab7-f619f3755295 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332/action" status: 200 len: 35441 microversion: 2.1 time: 0.070952 Jul 31 02:22:05.747182 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3625/7214] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:22:05 2022] POST /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332/action => generated 35441 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 02:22:05.758917 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-df8dde97-ab44-4a71-b861-2a1638efe3be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:22:05.766328 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df8dde97-ab44-4a71-b861-2a1638efe3be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:05.766799 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-df8dde97-ab44-4a71-b861-2a1638efe3be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:05.788393 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-df8dde97-ab44-4a71-b861-2a1638efe3be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Going to try to start instance {{(pid=119474) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 31 02:22:05.831741 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-df8dde97-ab44-4a71-b861-2a1638efe3be tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332/action" status: 202 len: 0 microversion: 2.1 time: 0.076492 Jul 31 02:22:05.832345 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3590/7215] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:22:05 2022] POST /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:22:05.841162 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eb2bd3bf-a7c0-4cad-95d7-efaab5391a4c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:05.841879 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eb2bd3bf-a7c0-4cad-95d7-efaab5391a4c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:05.849347 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb2bd3bf-a7c0-4cad-95d7-efaab5391a4c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:05.849890 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb2bd3bf-a7c0-4cad-95d7-efaab5391a4c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:05.850695 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb2bd3bf-a7c0-4cad-95d7-efaab5391a4c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:05.851149 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eb2bd3bf-a7c0-4cad-95d7-efaab5391a4c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:06.032177 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eb2bd3bf-a7c0-4cad-95d7-efaab5391a4c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:22:06.039918 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eb2bd3bf-a7c0-4cad-95d7-efaab5391a4c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1678 microversion: 2.1 time: 0.202976 Jul 31 02:22:06.040502 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3626/7216] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:05 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1678 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:22:07.064242 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6098286f-efe4-45c5-87d4-7c86d871e9d0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:07.065000 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6098286f-efe4-45c5-87d4-7c86d871e9d0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:07.071350 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6098286f-efe4-45c5-87d4-7c86d871e9d0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:07.071832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6098286f-efe4-45c5-87d4-7c86d871e9d0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:07.072622 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6098286f-efe4-45c5-87d4-7c86d871e9d0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:07.073077 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6098286f-efe4-45c5-87d4-7c86d871e9d0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:07.307043 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6098286f-efe4-45c5-87d4-7c86d871e9d0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:22:07.315721 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6098286f-efe4-45c5-87d4-7c86d871e9d0 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1682 microversion: 2.1 time: 0.257266 Jul 31 02:22:07.316329 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3591/7217] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:07 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1682 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:22:31.510262 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-13ef3dad-8a6c-4775-bce5-870c383782bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:22:31.513685 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-13ef3dad-8a6c-4775-bce5-870c383782bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:31.516532 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=16 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:22:31.517202 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=44 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:22:31.523755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13ef3dad-8a6c-4775-bce5-870c383782bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:31.524216 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13ef3dad-8a6c-4775-bce5-870c383782bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:31.524997 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13ef3dad-8a6c-4775-bce5-870c383782bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:31.525444 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-13ef3dad-8a6c-4775-bce5-870c383782bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:31.587851 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-13ef3dad-8a6c-4775-bce5-870c383782bf tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332/action" status: 200 len: 60003 microversion: 2.1 time: 0.082948 Jul 31 02:22:31.588529 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3627/7218] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:22:31 2022] POST /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332/action => generated 60003 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 02:22:38.949165 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b573d532-fc24-42d8-b426-5578f200cd3d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:38.949748 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b573d532-fc24-42d8-b426-5578f200cd3d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:38.952061 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=16 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:22:38.952863 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:22:38.953081 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-d230de4c-8122-464d-beb5-4ff38aa21c0c req-9b36dafa-9d27-4f71-b7e7-521fecd0a0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a79732-c4e7-4275-a581-6661e9704332", "tag": "67815244-85e7-49ac-a6f7-d6aef6f3dcc9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:22:38.963582 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d230de4c-8122-464d-beb5-4ff38aa21c0c req-9b36dafa-9d27-4f71-b7e7-521fecd0a0e1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:38.964042 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d230de4c-8122-464d-beb5-4ff38aa21c0c req-9b36dafa-9d27-4f71-b7e7-521fecd0a0e1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:38.967096 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b573d532-fc24-42d8-b426-5578f200cd3d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:38.967619 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b573d532-fc24-42d8-b426-5578f200cd3d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:38.968504 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b573d532-fc24-42d8-b426-5578f200cd3d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:38.969019 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b573d532-fc24-42d8-b426-5578f200cd3d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:38.975748 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-d230de4c-8122-464d-beb5-4ff38aa21c0c req-9b36dafa-9d27-4f71-b7e7-521fecd0a0e1 service nova] Creating event network-changed:67815244-85e7-49ac-a6f7-d6aef6f3dcc9 for instance 62a79732-c4e7-4275-a581-6661e9704332 on n-h1-master-1 Jul 31 02:22:38.980778 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-d230de4c-8122-464d-beb5-4ff38aa21c0c req-9b36dafa-9d27-4f71-b7e7-521fecd0a0e1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032144 Jul 31 02:22:38.982126 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3628/7219] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:22:38.997443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b573d532-fc24-42d8-b426-5578f200cd3d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:22:39.090784 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b573d532-fc24-42d8-b426-5578f200cd3d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "DELETE /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 204 len: 0 microversion: 2.1 time: 0.145157 Jul 31 02:22:39.091520 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3592/7220] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:22:38 2022] DELETE /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:22:39.101738 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4f0030d3-a0e7-4bb0-8554-168e8ffc07ad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:39.102467 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4f0030d3-a0e7-4bb0-8554-168e8ffc07ad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:39.109865 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f0030d3-a0e7-4bb0-8554-168e8ffc07ad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:39.110329 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f0030d3-a0e7-4bb0-8554-168e8ffc07ad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:39.111161 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f0030d3-a0e7-4bb0-8554-168e8ffc07ad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:39.111651 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f0030d3-a0e7-4bb0-8554-168e8ffc07ad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:39.253731 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4f0030d3-a0e7-4bb0-8554-168e8ffc07ad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:22:39.261344 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4f0030d3-a0e7-4bb0-8554-168e8ffc07ad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1688 microversion: 2.1 time: 0.164691 Jul 31 02:22:39.261925 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3629/7221] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:39 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:22:39.393834 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:22:39.394053 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 02:22:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:22:40.284340 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-20ae6818-713f-48b0-9df4-a73ccbc5ef67 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:40.285055 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-20ae6818-713f-48b0-9df4-a73ccbc5ef67 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:40.296233 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-20ae6818-713f-48b0-9df4-a73ccbc5ef67 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:40.296698 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-20ae6818-713f-48b0-9df4-a73ccbc5ef67 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:40.297478 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-20ae6818-713f-48b0-9df4-a73ccbc5ef67 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:40.297928 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-20ae6818-713f-48b0-9df4-a73ccbc5ef67 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:40.456502 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-20ae6818-713f-48b0-9df4-a73ccbc5ef67 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:22:40.464038 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-20ae6818-713f-48b0-9df4-a73ccbc5ef67 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1688 microversion: 2.1 time: 0.183906 Jul 31 02:22:40.464612 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3593/7222] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:40 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:22:41.115461 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-177b6180-6200-40a5-a60a-15e0ca1aea63 req-a9266500-01c9-4112-afe5-8b14dcd4bcbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a79732-c4e7-4275-a581-6661e9704332", "name": "network-vif-deleted", "tag": "67815244-85e7-49ac-a6f7-d6aef6f3dcc9"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:22:41.131674 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-177b6180-6200-40a5-a60a-15e0ca1aea63 req-a9266500-01c9-4112-afe5-8b14dcd4bcbd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:41.132140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-177b6180-6200-40a5-a60a-15e0ca1aea63 req-a9266500-01c9-4112-afe5-8b14dcd4bcbd service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:41.143252 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-177b6180-6200-40a5-a60a-15e0ca1aea63 req-a9266500-01c9-4112-afe5-8b14dcd4bcbd service nova] Creating event network-vif-deleted:67815244-85e7-49ac-a6f7-d6aef6f3dcc9 for instance 62a79732-c4e7-4275-a581-6661e9704332 on n-h1-master-1 Jul 31 02:22:41.149788 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-177b6180-6200-40a5-a60a-15e0ca1aea63 req-a9266500-01c9-4112-afe5-8b14dcd4bcbd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038106 Jul 31 02:22:41.150390 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3630/7223] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:22:41.486694 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-be843be3-1b99-4f43-b872-b97644d3c424 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:41.487448 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-be843be3-1b99-4f43-b872-b97644d3c424 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:41.494687 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be843be3-1b99-4f43-b872-b97644d3c424 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:41.495161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be843be3-1b99-4f43-b872-b97644d3c424 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:41.496124 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be843be3-1b99-4f43-b872-b97644d3c424 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:41.496649 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be843be3-1b99-4f43-b872-b97644d3c424 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:41.531511 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be843be3-1b99-4f43-b872-b97644d3c424 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:41.532207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-be843be3-1b99-4f43-b872-b97644d3c424 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:41.532688 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-be843be3-1b99-4f43-b872-b97644d3c424 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lazy-loading 'fault' on Instance uuid 62a79732-c4e7-4275-a581-6661e9704332 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:22:41.579161 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-be843be3-1b99-4f43-b872-b97644d3c424 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:22:41.587968 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-be843be3-1b99-4f43-b872-b97644d3c424 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 200 len: 1356 microversion: 2.1 time: 0.105227 Jul 31 02:22:41.588599 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3594/7224] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:41 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:22:42.610845 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2e7598a5-814a-4716-a483-b02351b26c2b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:42.611591 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2e7598a5-814a-4716-a483-b02351b26c2b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 62a79732-c4e7-4275-a581-6661e9704332] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:42.618845 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e7598a5-814a-4716-a483-b02351b26c2b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:42.619311 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e7598a5-814a-4716-a483-b02351b26c2b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:42.620114 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e7598a5-814a-4716-a483-b02351b26c2b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:42.620567 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2e7598a5-814a-4716-a483-b02351b26c2b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:42.634309 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-2e7598a5-814a-4716-a483-b02351b26c2b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] HTTP exception thrown: Instance 62a79732-c4e7-4275-a581-6661e9704332 could not be found. Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2e7598a5-814a-4716-a483-b02351b26c2b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Request method failure captured: Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 HTTP/1.1 Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5eYAzDqc_OrsAo-J-1bmHbcGAw2mwcba9oBFF1GuJx7h2q7wwDdcuA7T2_M6jA7aPmOdJhu8rpEfLWey7CD1suIH_p6ArzYUQmGU5sKYkwqNwBdWdKcvT-9kRBlA7tTcoDsaVXE46dP44tqxX1wh2NBRglHhcVT1rTlI3mrQzAiqe2E Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 14c964a9135b44f2b83dba23842472cd Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-97164417 Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/14c964a9135b44f2b83dba23842472cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/14c964a9135b44f2b83dba23842472cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/14c964a9135b44f2b83dba23842472cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_14c964a9135b44f2b83dba23842472cd", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestNetworkAdvancedServerOps-97164417 Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 14c964a9135b44f2b83dba23842472cd Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-97164417 Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestNetworkAdvancedServerOps-97164417-project Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: b070525312804b0bb43370f12c449697 Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestNetworkAdvancedServerOps-97164417-project Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 62a79732-c4e7-4275-a581-6661e9704332 could not be found. Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '62a79732-c4e7-4275-a581-6661e9704332'} Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62a79732-c4e7-4275-a581-6661e9704332 could not be found. Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62a79732-c4e7-4275-a581-6661e9704332 could not be found. Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:22:42.635947 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:22:42.641209 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:22:42.641209 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:22:42.641209 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:22:42.641209 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:22:42.641209 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:22:42.641209 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62a79732-c4e7-4275-a581-6661e9704332 could not be found. Jul 31 02:22:42.641209 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:22:42.641209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2e7598a5-814a-4716-a483-b02351b26c2b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Returning 404 to user: Instance 62a79732-c4e7-4275-a581-6661e9704332 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:22:42.641209 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2e7598a5-814a-4716-a483-b02351b26c2b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332" status: 404 len: 111 microversion: 2.1 time: 0.030830 Jul 31 02:22:42.641209 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3631/7225] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:42 2022] GET /compute/v2.1/servers/62a79732-c4e7-4275-a581-6661e9704332 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:22:45.617481 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d18ef152-678c-416c-8d28-e3ff61da615b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '.version_select at 0x7fede557bf70>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:45.643269 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d18ef152-678c-416c-8d28-e3ff61da615b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-643329444" status: 202 len: 0 microversion: 2.1 time: 0.029872 Jul 31 02:22:45.643947 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3595/7226] 10.222.0.45 () {58 vars in 1281 bytes} [Sun Jul 31 02:22:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-643329444 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:22:45.675768 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-de555ab1-8cdb-4d23-8692-97564c48c4ef tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'create', calling method: .version_select at 0x7fedeaa69040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-320123376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1aaYxpeUKOrik2c9zwRkfX6P5DwlR86RlTO5JFECorH4wIQSfr+ZmBovPv8gKiSd3sJ4gtWrdjJsOF/15/wYbVwypWZuOYOAsMLUGKckondM4Q0MEaCnhCDKGAnYk9yw=="}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:22:45.692845 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-de555ab1-8cdb-4d23-8692-97564c48c4ef tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for project 14c964a9135b44f2b83dba23842472cd. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:22:45.697985 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-de555ab1-8cdb-4d23-8692-97564c48c4ef tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for user b070525312804b0bb43370f12c449697 and project 14c964a9135b44f2b83dba23842472cd. Resources: {'key_pairs'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:22:45.723776 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-de555ab1-8cdb-4d23-8692-97564c48c4ef tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051922 Jul 31 02:22:45.724298 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3632/7227] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 02:22:45 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:22:51.698564 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4476e2fb-fff8-486b-8341-8dc59f6a3c3e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-763329125", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "networks": [{"uuid": "aead0c50-105e-434d-bab8-b46827727c45"}], "key_name": "tempest-TestNetworkAdvancedServerOps-320123376", "security_groups": [{"name": "tempest-secgroup-smoke-144242100"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:22:51.709737 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:22:51.815043 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-4476e2fb-fff8-486b-8341-8dc59f6a3c3e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] validate_networks() for [('aead0c50-105e-434d-bab8-b46827727c45', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:22:52.221106 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-4476e2fb-fff8-486b-8341-8dc59f6a3c3e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:22:52.221734 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-4476e2fb-fff8-486b-8341-8dc59f6a3c3e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:22:52.222326 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-4476e2fb-fff8-486b-8341-8dc59f6a3c3e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:22:52.222825 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-4476e2fb-fff8-486b-8341-8dc59f6a3c3e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:22:52.223824 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-4476e2fb-fff8-486b-8341-8dc59f6a3c3e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:22:52.233075 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4476e2fb-fff8-486b-8341-8dc59f6a3c3e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:52.233543 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4476e2fb-fff8-486b-8341-8dc59f6a3c3e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:52.234361 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4476e2fb-fff8-486b-8341-8dc59f6a3c3e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:52.234821 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4476e2fb-fff8-486b-8341-8dc59f6a3c3e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:52.253070 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-4476e2fb-fff8-486b-8341-8dc59f6a3c3e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for project 14c964a9135b44f2b83dba23842472cd. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:22:52.258354 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-4476e2fb-fff8-486b-8341-8dc59f6a3c3e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Getting quotas for user b070525312804b0bb43370f12c449697 and project 14c964a9135b44f2b83dba23842472cd. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:22:52.271283 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4476e2fb-fff8-486b-8341-8dc59f6a3c3e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:22:52.273602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4476e2fb-fff8-486b-8341-8dc59f6a3c3e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:22:52.320500 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4476e2fb-fff8-486b-8341-8dc59f6a3c3e tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.625896 Jul 31 02:22:52.327407 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3596/7228] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:22:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 02:22:52.332915 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8e9f6fc7-18ac-46b7-8202-b23d4b3852c7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:52.334528 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8e9f6fc7-18ac-46b7-8202-b23d4b3852c7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:52.422021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8e9f6fc7-18ac-46b7-8202-b23d4b3852c7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:22:52.430842 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8e9f6fc7-18ac-46b7-8202-b23d4b3852c7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1265 microversion: 2.1 time: 0.100947 Jul 31 02:22:52.432910 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3633/7229] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:52 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:22:53.453350 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b6ac01c0-1f96-4b7f-bf62-0ae24c25b6ad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:53.454581 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b6ac01c0-1f96-4b7f-bf62-0ae24c25b6ad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:53.466695 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6ac01c0-1f96-4b7f-bf62-0ae24c25b6ad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:53.467173 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6ac01c0-1f96-4b7f-bf62-0ae24c25b6ad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:53.468056 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6ac01c0-1f96-4b7f-bf62-0ae24c25b6ad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:53.468525 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b6ac01c0-1f96-4b7f-bf62-0ae24c25b6ad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:53.541702 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b6ac01c0-1f96-4b7f-bf62-0ae24c25b6ad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:22:53.552448 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b6ac01c0-1f96-4b7f-bf62-0ae24c25b6ad tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1335 microversion: 2.1 time: 0.104355 Jul 31 02:22:53.563492 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3597/7230] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:53 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1335 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:22:54.574147 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f52708e1-7717-4219-aa58-fae92a9ac455 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:54.575494 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f52708e1-7717-4219-aa58-fae92a9ac455 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:54.577564 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=16 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:22:54.586612 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f52708e1-7717-4219-aa58-fae92a9ac455 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:54.587080 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f52708e1-7717-4219-aa58-fae92a9ac455 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:54.587901 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f52708e1-7717-4219-aa58-fae92a9ac455 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:54.588356 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f52708e1-7717-4219-aa58-fae92a9ac455 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:54.726415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f52708e1-7717-4219-aa58-fae92a9ac455 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:22:54.735071 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f52708e1-7717-4219-aa58-fae92a9ac455 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1390 microversion: 2.1 time: 0.164752 Jul 31 02:22:54.735787 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3634/7231] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:54 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:22:54.886619 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-fc1a39bf-e03f-4319-803b-bb259e0fbf22 req-fda38974-cc54-424a-8103-ee1f9d4771ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d133140-5165-4c71-91f7-9be57d77c3e4", "tag": "9e6c8cf2-ebec-4c90-8e08-b3d7614d868c"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:22:54.898901 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fc1a39bf-e03f-4319-803b-bb259e0fbf22 req-fda38974-cc54-424a-8103-ee1f9d4771ce service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:54.899722 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fc1a39bf-e03f-4319-803b-bb259e0fbf22 req-fda38974-cc54-424a-8103-ee1f9d4771ce service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:54.914737 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-fc1a39bf-e03f-4319-803b-bb259e0fbf22 req-fda38974-cc54-424a-8103-ee1f9d4771ce service nova] Creating event network-changed:9e6c8cf2-ebec-4c90-8e08-b3d7614d868c for instance 0d133140-5165-4c71-91f7-9be57d77c3e4 on n-h2-master-1 Jul 31 02:22:54.920225 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-fc1a39bf-e03f-4319-803b-bb259e0fbf22 req-fda38974-cc54-424a-8103-ee1f9d4771ce service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037552 Jul 31 02:22:54.921428 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3598/7232] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:22:55.758173 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4ae10328-c92f-4e9d-889c-bb4d09351045 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:55.758859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4ae10328-c92f-4e9d-889c-bb4d09351045 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:55.766530 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ae10328-c92f-4e9d-889c-bb4d09351045 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:55.767050 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ae10328-c92f-4e9d-889c-bb4d09351045 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:55.767862 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ae10328-c92f-4e9d-889c-bb4d09351045 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:55.768314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4ae10328-c92f-4e9d-889c-bb4d09351045 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:55.904555 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4ae10328-c92f-4e9d-889c-bb4d09351045 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:22:55.912377 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4ae10328-c92f-4e9d-889c-bb4d09351045 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1390 microversion: 2.1 time: 0.158222 Jul 31 02:22:55.912880 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3635/7233] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:55 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:22:56.935706 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dadd2d28-4b6b-42c8-9655-0476b9f43b3a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:56.936472 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dadd2d28-4b6b-42c8-9655-0476b9f43b3a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:56.942897 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dadd2d28-4b6b-42c8-9655-0476b9f43b3a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:56.943372 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dadd2d28-4b6b-42c8-9655-0476b9f43b3a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:56.944157 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dadd2d28-4b6b-42c8-9655-0476b9f43b3a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:56.944613 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-dadd2d28-4b6b-42c8-9655-0476b9f43b3a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:57.091768 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dadd2d28-4b6b-42c8-9655-0476b9f43b3a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:22:57.101759 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dadd2d28-4b6b-42c8-9655-0476b9f43b3a tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1390 microversion: 2.1 time: 0.171371 Jul 31 02:22:57.102647 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3599/7234] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:56 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:22:58.124667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-391970b2-f627-418c-b850-f13015ff5de3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:58.125209 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-391970b2-f627-418c-b850-f13015ff5de3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:58.132394 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-391970b2-f627-418c-b850-f13015ff5de3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:58.132858 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-391970b2-f627-418c-b850-f13015ff5de3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:58.133636 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-391970b2-f627-418c-b850-f13015ff5de3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:58.134088 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-391970b2-f627-418c-b850-f13015ff5de3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:58.269542 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-391970b2-f627-418c-b850-f13015ff5de3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:22:58.278261 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-391970b2-f627-418c-b850-f13015ff5de3 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1390 microversion: 2.1 time: 0.157577 Jul 31 02:22:58.278983 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3636/7235] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:58 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:22:58.962436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-311f378b-349b-4f09-9b14-ad7672ee81a4 req-41235c0b-cf83-4f81-9e44-1a303e22f13d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d133140-5165-4c71-91f7-9be57d77c3e4", "name": "network-vif-plugged", "status": "completed", "tag": "9e6c8cf2-ebec-4c90-8e08-b3d7614d868c"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:22:58.972758 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-311f378b-349b-4f09-9b14-ad7672ee81a4 req-41235c0b-cf83-4f81-9e44-1a303e22f13d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:58.973218 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-311f378b-349b-4f09-9b14-ad7672ee81a4 req-41235c0b-cf83-4f81-9e44-1a303e22f13d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:58.984990 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-311f378b-349b-4f09-9b14-ad7672ee81a4 req-41235c0b-cf83-4f81-9e44-1a303e22f13d service nova] Creating event network-vif-plugged:9e6c8cf2-ebec-4c90-8e08-b3d7614d868c for instance 0d133140-5165-4c71-91f7-9be57d77c3e4 on n-h2-master-1 Jul 31 02:22:58.989803 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-311f378b-349b-4f09-9b14-ad7672ee81a4 req-41235c0b-cf83-4f81-9e44-1a303e22f13d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085460 Jul 31 02:22:58.990402 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3600/7236] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:22:59.300122 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bc3d2bf5-a5df-4ce9-99c0-b677f2ed1fac tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:22:59.300760 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bc3d2bf5-a5df-4ce9-99c0-b677f2ed1fac tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:22:59.307719 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc3d2bf5-a5df-4ce9-99c0-b677f2ed1fac tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:59.308184 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc3d2bf5-a5df-4ce9-99c0-b677f2ed1fac tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:59.308974 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc3d2bf5-a5df-4ce9-99c0-b677f2ed1fac tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:22:59.309419 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bc3d2bf5-a5df-4ce9-99c0-b677f2ed1fac tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:22:59.443844 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bc3d2bf5-a5df-4ce9-99c0-b677f2ed1fac tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:22:59.451932 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bc3d2bf5-a5df-4ce9-99c0-b677f2ed1fac tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1390 microversion: 2.1 time: 0.155777 Jul 31 02:22:59.452537 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3637/7237] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:22:59 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:23:00.473892 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5cbf90b8-d94c-4b0a-a031-0f8059bc85fd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:23:00.474543 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5cbf90b8-d94c-4b0a-a031-0f8059bc85fd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:00.484064 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5cbf90b8-d94c-4b0a-a031-0f8059bc85fd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:00.484888 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5cbf90b8-d94c-4b0a-a031-0f8059bc85fd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:00.486327 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5cbf90b8-d94c-4b0a-a031-0f8059bc85fd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:00.487124 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5cbf90b8-d94c-4b0a-a031-0f8059bc85fd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:00.621367 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5cbf90b8-d94c-4b0a-a031-0f8059bc85fd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:23:00.629186 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5cbf90b8-d94c-4b0a-a031-0f8059bc85fd tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1560 microversion: 2.1 time: 0.160795 Jul 31 02:23:00.629773 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3601/7238] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:23:00 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:23:00.650310 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0f4d8fc1-6281-43ea-9965-f9391ae44366 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:23:00.650936 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0f4d8fc1-6281-43ea-9965-f9391ae44366 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:00.658413 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f4d8fc1-6281-43ea-9965-f9391ae44366 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:00.658870 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f4d8fc1-6281-43ea-9965-f9391ae44366 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:00.661404 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f4d8fc1-6281-43ea-9965-f9391ae44366 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:00.661404 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f4d8fc1-6281-43ea-9965-f9391ae44366 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:00.795146 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0f4d8fc1-6281-43ea-9965-f9391ae44366 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:23:00.802694 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0f4d8fc1-6281-43ea-9965-f9391ae44366 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1560 microversion: 2.1 time: 0.156394 Jul 31 02:23:00.803271 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3638/7239] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:23:00 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:23:02.412141 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-08a4bfaa-4b79-401d-a643-f62730c6c606 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:23:02.412862 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-08a4bfaa-4b79-401d-a643-f62730c6c606 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:02.415939 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-92e8e662-43e5-4fc2-a482-1bf5cd79a627 req-1366d783-5535-4102-9645-58b5fd5c6e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d133140-5165-4c71-91f7-9be57d77c3e4", "tag": "9e6c8cf2-ebec-4c90-8e08-b3d7614d868c"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:23:02.418929 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:23:02.419987 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:23:02.422412 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08a4bfaa-4b79-401d-a643-f62730c6c606 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:02.423113 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08a4bfaa-4b79-401d-a643-f62730c6c606 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:02.423242 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:23:02.423990 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08a4bfaa-4b79-401d-a643-f62730c6c606 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:02.424591 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-08a4bfaa-4b79-401d-a643-f62730c6c606 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:02.428083 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-92e8e662-43e5-4fc2-a482-1bf5cd79a627 req-1366d783-5535-4102-9645-58b5fd5c6e6c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:02.428741 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-92e8e662-43e5-4fc2-a482-1bf5cd79a627 req-1366d783-5535-4102-9645-58b5fd5c6e6c service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:02.433141 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:23:02.443531 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-92e8e662-43e5-4fc2-a482-1bf5cd79a627 req-1366d783-5535-4102-9645-58b5fd5c6e6c service nova] Creating event network-changed:9e6c8cf2-ebec-4c90-8e08-b3d7614d868c for instance 0d133140-5165-4c71-91f7-9be57d77c3e4 on n-h2-master-1 Jul 31 02:23:02.453559 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-92e8e662-43e5-4fc2-a482-1bf5cd79a627 req-1366d783-5535-4102-9645-58b5fd5c6e6c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042803 Jul 31 02:23:02.454680 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3639/7240] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:23:02.578469 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-08a4bfaa-4b79-401d-a643-f62730c6c606 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:23:02.586600 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-08a4bfaa-4b79-401d-a643-f62730c6c606 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1560 microversion: 2.1 time: 0.178426 Jul 31 02:23:02.587402 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3602/7241] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:23:02 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:23:23.832929 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7e95917c-7077-4c97-aeb4-c85316aa2368 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:23:23.835115 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7e95917c-7077-4c97-aeb4-c85316aa2368 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:23.837614 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=32 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:23:23.843987 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e95917c-7077-4c97-aeb4-c85316aa2368 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:23.844447 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e95917c-7077-4c97-aeb4-c85316aa2368 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:23.845216 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e95917c-7077-4c97-aeb4-c85316aa2368 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:23.845658 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7e95917c-7077-4c97-aeb4-c85316aa2368 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:23.915098 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7e95917c-7077-4c97-aeb4-c85316aa2368 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4/action" status: 200 len: 24572 microversion: 2.1 time: 0.086827 Jul 31 02:23:23.915800 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3640/7242] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:23:23 2022] POST /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4/action => generated 24572 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 02:23:34.906018 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-454375d2-f0e2-4427-b211-f381e8b38a2d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:23:34.906601 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-454375d2-f0e2-4427-b211-f381e8b38a2d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:34.908880 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:23:34.909684 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=30 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:23:34.916127 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-454375d2-f0e2-4427-b211-f381e8b38a2d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:34.916596 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-454375d2-f0e2-4427-b211-f381e8b38a2d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:34.917379 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-454375d2-f0e2-4427-b211-f381e8b38a2d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:34.917832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-454375d2-f0e2-4427-b211-f381e8b38a2d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:34.941993 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-454375d2-f0e2-4427-b211-f381e8b38a2d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lazy-loading 'flavor' on Instance uuid 0d133140-5165-4c71-91f7-9be57d77c3e4 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:23:35.008837 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-454375d2-f0e2-4427-b211-f381e8b38a2d tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4/action" status: 202 len: 0 microversion: 2.1 time: 0.106571 Jul 31 02:23:35.012418 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3603/7243] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:23:34 2022] POST /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:23:35.019301 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1658b602-b793-4d2f-9431-8ea923e7f4f7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:23:35.019713 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1658b602-b793-4d2f-9431-8ea923e7f4f7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:35.022830 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:23:35.023583 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=4 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:23:35.031188 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1658b602-b793-4d2f-9431-8ea923e7f4f7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:35.032022 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1658b602-b793-4d2f-9431-8ea923e7f4f7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:35.032816 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1658b602-b793-4d2f-9431-8ea923e7f4f7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:35.033295 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1658b602-b793-4d2f-9431-8ea923e7f4f7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:35.168692 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1658b602-b793-4d2f-9431-8ea923e7f4f7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:23:35.176426 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1658b602-b793-4d2f-9431-8ea923e7f4f7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1686 microversion: 2.1 time: 0.161855 Jul 31 02:23:35.177007 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3641/7244] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:23:35 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:23:36.200707 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-0ed69d7d-f4bb-43cf-8c15-31cceaf28b0f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:23:36.201335 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-0ed69d7d-f4bb-43cf-8c15-31cceaf28b0f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:36.207597 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ed69d7d-f4bb-43cf-8c15-31cceaf28b0f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:36.208057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ed69d7d-f4bb-43cf-8c15-31cceaf28b0f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:36.208824 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ed69d7d-f4bb-43cf-8c15-31cceaf28b0f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:36.209271 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-0ed69d7d-f4bb-43cf-8c15-31cceaf28b0f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:36.342532 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-0ed69d7d-f4bb-43cf-8c15-31cceaf28b0f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:23:36.349994 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-0ed69d7d-f4bb-43cf-8c15-31cceaf28b0f tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1669 microversion: 2.1 time: 0.155182 Jul 31 02:23:36.350555 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3604/7245] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:23:36 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:23:37.443616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-81c7fef3-c089-4e4d-b114-19b9c98ac71c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:23:37.445744 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-81c7fef3-c089-4e4d-b114-19b9c98ac71c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:37.453232 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81c7fef3-c089-4e4d-b114-19b9c98ac71c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:37.453694 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81c7fef3-c089-4e4d-b114-19b9c98ac71c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:37.454472 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81c7fef3-c089-4e4d-b114-19b9c98ac71c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:37.454926 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-81c7fef3-c089-4e4d-b114-19b9c98ac71c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:37.509954 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-81c7fef3-c089-4e4d-b114-19b9c98ac71c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4/action" status: 200 len: 38378 microversion: 2.1 time: 0.070463 Jul 31 02:23:37.510661 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3642/7246] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:23:37 2022] POST /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4/action => generated 38378 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 02:23:37.522421 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3f2c0acb-874c-42d7-abfd-8e9e43004c92 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:23:37.522976 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3f2c0acb-874c-42d7-abfd-8e9e43004c92 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:37.529943 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f2c0acb-874c-42d7-abfd-8e9e43004c92 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:37.530408 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f2c0acb-874c-42d7-abfd-8e9e43004c92 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:37.531184 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f2c0acb-874c-42d7-abfd-8e9e43004c92 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:37.531674 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3f2c0acb-874c-42d7-abfd-8e9e43004c92 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:37.597115 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3f2c0acb-874c-42d7-abfd-8e9e43004c92 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4/action" status: 202 len: 0 microversion: 2.1 time: 0.078438 Jul 31 02:23:37.597786 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3605/7247] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:23:37 2022] POST /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:23:37.606994 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d09c17b5-22f9-4352-8d51-878f11a9f712 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:23:37.607737 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d09c17b5-22f9-4352-8d51-878f11a9f712 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:37.615622 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d09c17b5-22f9-4352-8d51-878f11a9f712 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:37.616079 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d09c17b5-22f9-4352-8d51-878f11a9f712 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:37.616864 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d09c17b5-22f9-4352-8d51-878f11a9f712 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:37.617312 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d09c17b5-22f9-4352-8d51-878f11a9f712 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:37.757313 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d09c17b5-22f9-4352-8d51-878f11a9f712 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:23:37.765327 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d09c17b5-22f9-4352-8d51-878f11a9f712 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1675 microversion: 2.1 time: 0.163067 Jul 31 02:23:37.766029 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3643/7248] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:23:37 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:23:38.788685 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6e3c624c-8029-4055-9360-777198611dd1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:23:38.789436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6e3c624c-8029-4055-9360-777198611dd1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:38.796475 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e3c624c-8029-4055-9360-777198611dd1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:38.796949 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e3c624c-8029-4055-9360-777198611dd1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:38.797740 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e3c624c-8029-4055-9360-777198611dd1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:38.798198 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e3c624c-8029-4055-9360-777198611dd1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:38.930987 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6e3c624c-8029-4055-9360-777198611dd1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:23:38.939322 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6e3c624c-8029-4055-9360-777198611dd1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1675 microversion: 2.1 time: 0.155783 Jul 31 02:23:38.939934 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3606/7249] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:23:38 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:23:39.960906 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-03118c36-f316-4e91-a3ca-9825351da1d7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:23:39.961566 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-03118c36-f316-4e91-a3ca-9825351da1d7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:39.969205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03118c36-f316-4e91-a3ca-9825351da1d7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:39.969667 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03118c36-f316-4e91-a3ca-9825351da1d7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:39.970580 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03118c36-f316-4e91-a3ca-9825351da1d7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:39.971026 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-03118c36-f316-4e91-a3ca-9825351da1d7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:40.103754 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-03118c36-f316-4e91-a3ca-9825351da1d7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:23:40.111293 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-03118c36-f316-4e91-a3ca-9825351da1d7 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1678 microversion: 2.1 time: 0.154370 Jul 31 02:23:40.111909 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3644/7250] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:23:39 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:23:40.202944 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fc117a7d-ec08-44ec-aff6-632ef4b169db tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:23:40.205236 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fc117a7d-ec08-44ec-aff6-632ef4b169db tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:40.212158 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc117a7d-ec08-44ec-aff6-632ef4b169db tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:40.212620 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc117a7d-ec08-44ec-aff6-632ef4b169db tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:40.213385 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc117a7d-ec08-44ec-aff6-632ef4b169db tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:40.213832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fc117a7d-ec08-44ec-aff6-632ef4b169db tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:40.271049 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fc117a7d-ec08-44ec-aff6-632ef4b169db tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "POST /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4/action" status: 200 len: 38378 microversion: 2.1 time: 0.072513 Jul 31 02:23:40.271981 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3607/7251] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:23:40 2022] POST /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4/action => generated 38378 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 02:23:41.539218 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4596a4cb-ac4b-421f-afdc-42e010d53b68 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:23:41.539814 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4596a4cb-ac4b-421f-afdc-42e010d53b68 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:41.548729 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-fdf58ab0-51b7-402b-aec9-13338b555e00 req-90940cfd-83b0-417f-9036-4ea1efc3cfeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d133140-5165-4c71-91f7-9be57d77c3e4", "tag": "9e6c8cf2-ebec-4c90-8e08-b3d7614d868c"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:23:41.554818 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4596a4cb-ac4b-421f-afdc-42e010d53b68 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:41.555277 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4596a4cb-ac4b-421f-afdc-42e010d53b68 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:41.556090 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4596a4cb-ac4b-421f-afdc-42e010d53b68 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:41.556533 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4596a4cb-ac4b-421f-afdc-42e010d53b68 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:41.564941 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fdf58ab0-51b7-402b-aec9-13338b555e00 req-90940cfd-83b0-417f-9036-4ea1efc3cfeb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:41.565408 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fdf58ab0-51b7-402b-aec9-13338b555e00 req-90940cfd-83b0-417f-9036-4ea1efc3cfeb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:41.577416 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-fdf58ab0-51b7-402b-aec9-13338b555e00 req-90940cfd-83b0-417f-9036-4ea1efc3cfeb service nova] Creating event network-changed:9e6c8cf2-ebec-4c90-8e08-b3d7614d868c for instance 0d133140-5165-4c71-91f7-9be57d77c3e4 on n-h2-master-1 Jul 31 02:23:41.582508 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-fdf58ab0-51b7-402b-aec9-13338b555e00 req-90940cfd-83b0-417f-9036-4ea1efc3cfeb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037672 Jul 31 02:23:41.583434 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3608/7252] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:23:41.586486 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4596a4cb-ac4b-421f-afdc-42e010d53b68 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:23:41.674609 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4596a4cb-ac4b-421f-afdc-42e010d53b68 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 204 len: 0 microversion: 2.1 time: 0.139044 Jul 31 02:23:41.675356 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3645/7253] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:23:41 2022] DELETE /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:23:41.685027 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-225e86c4-d38e-4847-a632-d1fddf31911b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:23:41.686458 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-225e86c4-d38e-4847-a632-d1fddf31911b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:41.693057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-225e86c4-d38e-4847-a632-d1fddf31911b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:41.693622 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-225e86c4-d38e-4847-a632-d1fddf31911b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:41.694482 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-225e86c4-d38e-4847-a632-d1fddf31911b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:41.695009 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-225e86c4-d38e-4847-a632-d1fddf31911b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:41.830228 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-225e86c4-d38e-4847-a632-d1fddf31911b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:23:41.837643 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-225e86c4-d38e-4847-a632-d1fddf31911b tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1684 microversion: 2.1 time: 0.157703 Jul 31 02:23:41.838235 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3609/7254] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:23:41 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:23:42.862549 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9d08c6b3-a35d-4bd0-92e1-0def2ecbb839 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:23:42.863816 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9d08c6b3-a35d-4bd0-92e1-0def2ecbb839 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:42.871739 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d08c6b3-a35d-4bd0-92e1-0def2ecbb839 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:42.872204 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d08c6b3-a35d-4bd0-92e1-0def2ecbb839 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:42.873054 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d08c6b3-a35d-4bd0-92e1-0def2ecbb839 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:42.873574 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9d08c6b3-a35d-4bd0-92e1-0def2ecbb839 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:43.010869 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9d08c6b3-a35d-4bd0-92e1-0def2ecbb839 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:23:43.019028 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9d08c6b3-a35d-4bd0-92e1-0def2ecbb839 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1684 microversion: 2.1 time: 0.160886 Jul 31 02:23:43.019222 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3646/7255] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:23:42 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:23:43.754939 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-dd4e112f-3957-4691-a09c-e1e8d77e6d31 req-cf5a718e-4bde-418c-b59e-be976327934a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d133140-5165-4c71-91f7-9be57d77c3e4", "name": "network-vif-deleted", "tag": "9e6c8cf2-ebec-4c90-8e08-b3d7614d868c"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:23:43.768038 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-dd4e112f-3957-4691-a09c-e1e8d77e6d31 req-cf5a718e-4bde-418c-b59e-be976327934a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:43.768422 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-dd4e112f-3957-4691-a09c-e1e8d77e6d31 req-cf5a718e-4bde-418c-b59e-be976327934a service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:43.781775 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-dd4e112f-3957-4691-a09c-e1e8d77e6d31 req-cf5a718e-4bde-418c-b59e-be976327934a service nova] Creating event network-vif-deleted:9e6c8cf2-ebec-4c90-8e08-b3d7614d868c for instance 0d133140-5165-4c71-91f7-9be57d77c3e4 on n-h2-master-1 Jul 31 02:23:43.788092 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-dd4e112f-3957-4691-a09c-e1e8d77e6d31 req-cf5a718e-4bde-418c-b59e-be976327934a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037122 Jul 31 02:23:43.788695 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3610/7256] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:23:44.041019 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-51d1bed4-3a76-42b8-a68e-638b0678c99c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:23:44.041673 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-51d1bed4-3a76-42b8-a68e-638b0678c99c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:44.049831 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51d1bed4-3a76-42b8-a68e-638b0678c99c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:44.050301 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51d1bed4-3a76-42b8-a68e-638b0678c99c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:44.051100 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51d1bed4-3a76-42b8-a68e-638b0678c99c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:44.051585 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51d1bed4-3a76-42b8-a68e-638b0678c99c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:44.084495 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51d1bed4-3a76-42b8-a68e-638b0678c99c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:44.084955 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-51d1bed4-3a76-42b8-a68e-638b0678c99c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:44.085422 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-51d1bed4-3a76-42b8-a68e-638b0678c99c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lazy-loading 'fault' on Instance uuid 0d133140-5165-4c71-91f7-9be57d77c3e4 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:23:44.132232 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-51d1bed4-3a76-42b8-a68e-638b0678c99c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b070525312804b0bb43370f12c449697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c964a9135b44f2b83dba23842472cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:23:44.140845 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-51d1bed4-3a76-42b8-a68e-638b0678c99c tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 200 len: 1355 microversion: 2.1 time: 0.103759 Jul 31 02:23:44.141440 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3647/7257] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:23:44 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 1355 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:23:45.164264 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-59837f58-a911-481b-a90b-b0660211d0d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:23:45.165019 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-59837f58-a911-481b-a90b-b0660211d0d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] [instance: 0d133140-5165-4c71-91f7-9be57d77c3e4] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:23:45.172967 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59837f58-a911-481b-a90b-b0660211d0d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:45.173437 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59837f58-a911-481b-a90b-b0660211d0d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:45.174220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59837f58-a911-481b-a90b-b0660211d0d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:23:45.174679 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-59837f58-a911-481b-a90b-b0660211d0d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:23:45.187840 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-59837f58-a911-481b-a90b-b0660211d0d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] HTTP exception thrown: Instance 0d133140-5165-4c71-91f7-9be57d77c3e4 could not be found. Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-59837f58-a911-481b-a90b-b0660211d0d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Request method failure captured: Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 HTTP/1.1 Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5eYAzDqc_OrsAo-J-1bmHbcGAw2mwcba9oBFF1GuJx7h2q7wwDdcuA7T2_M6jA7aPmOdJhu8rpEfLWey7CD1suIH_p6ArzYUQmGU5sKYkwqNwBdWdKcvT-9kRBlA7tTcoDsaVXE46dP44tqxX1wh2NBRglHhcVT1rTlI3mrQzAiqe2E Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 14c964a9135b44f2b83dba23842472cd Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-97164417 Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/14c964a9135b44f2b83dba23842472cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/14c964a9135b44f2b83dba23842472cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/14c964a9135b44f2b83dba23842472cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_14c964a9135b44f2b83dba23842472cd", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestNetworkAdvancedServerOps-97164417 Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 14c964a9135b44f2b83dba23842472cd Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-97164417 Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestNetworkAdvancedServerOps-97164417-project Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: b070525312804b0bb43370f12c449697 Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestNetworkAdvancedServerOps-97164417-project Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 0d133140-5165-4c71-91f7-9be57d77c3e4 could not be found. Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '0d133140-5165-4c71-91f7-9be57d77c3e4'} Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d133140-5165-4c71-91f7-9be57d77c3e4 could not be found. Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d133140-5165-4c71-91f7-9be57d77c3e4 could not be found. Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:23:45.189457 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:23:45.194155 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:23:45.194155 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:23:45.194155 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:23:45.194155 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:23:45.194155 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:23:45.194155 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d133140-5165-4c71-91f7-9be57d77c3e4 could not be found. Jul 31 02:23:45.194155 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:23:45.194155 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-59837f58-a911-481b-a90b-b0660211d0d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Returning 404 to user: Instance 0d133140-5165-4c71-91f7-9be57d77c3e4 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:23:45.194155 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-59837f58-a911-481b-a90b-b0660211d0d1 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4" status: 404 len: 111 microversion: 2.1 time: 0.030994 Jul 31 02:23:45.194155 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3611/7258] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:23:45 2022] GET /compute/v2.1/servers/0d133140-5165-4c71-91f7-9be57d77c3e4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:23:48.217385 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4f7761f2-17b5-461a-bd68-82f83a2d7a98 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] Calling method '.version_select at 0x7fede5b52430>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:23:48.238954 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4f7761f2-17b5-461a-bd68-82f83a2d7a98 tempest-TestNetworkAdvancedServerOps-97164417 tempest-TestNetworkAdvancedServerOps-97164417-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-320123376" status: 202 len: 0 microversion: 2.1 time: 0.026208 Jul 31 02:23:48.243051 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3648/7259] 10.222.0.45 () {58 vars in 1281 bytes} [Sun Jul 31 02:23:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-320123376 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:23:59.628050 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=18 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:23:59.628874 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:23:59.810653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3bb2a1e0-6506-4ed4-ad6d-273d56b6a5f4 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Action: 'create', calling method: .version_select at 0x7fede4fa2ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-110092104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCVGJ2L4jOjamlchVO6XCCvFFYVU2TZ2eVn0ZwOcGgJQeBbg7Y4fSUrNjC03QuH1JoaPd+ixDppxBkrK8/vbJKYB/tMDMTlIcKpRd4RhF+1CVQE2/CC9eqoV/fGdcCo/w=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:23:59.826664 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-3bb2a1e0-6506-4ed4-ad6d-273d56b6a5f4 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Getting quotas for project 6b501064302f41c8997c829a6498492c. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:23:59.838887 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-3bb2a1e0-6506-4ed4-ad6d-273d56b6a5f4 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Getting quotas for user 211c5ded77174ea584b85e6617e3a18c and project 6b501064302f41c8997c829a6498492c. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:23:59.867766 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3bb2a1e0-6506-4ed4-ad6d-273d56b6a5f4 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.245576 Jul 31 02:23:59.868486 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3612/7260] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 02:23:59 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:24:00.915078 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dfa8979d-4ef6-4452-8c7f-db6fecbf0f15 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2022134420", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-110092104", "security_groups": [{"name": "tempest-secgroup-smoke-1692193928"}], "networks": [{"uuid": "bf4ff582-a746-4a40-aeb4-9eb71e2f6f11"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:24:00.924862 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:24:00.925660 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:24:01.024660 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-dfa8979d-4ef6-4452-8c7f-db6fecbf0f15 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] validate_networks() for [('bf4ff582-a746-4a40-aeb4-9eb71e2f6f11', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:24:01.535530 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-dfa8979d-4ef6-4452-8c7f-db6fecbf0f15 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:24:01.535966 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-dfa8979d-4ef6-4452-8c7f-db6fecbf0f15 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:24:01.536544 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-dfa8979d-4ef6-4452-8c7f-db6fecbf0f15 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:24:01.536861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-dfa8979d-4ef6-4452-8c7f-db6fecbf0f15 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:24:01.537281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-dfa8979d-4ef6-4452-8c7f-db6fecbf0f15 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:24:01.547185 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dfa8979d-4ef6-4452-8c7f-db6fecbf0f15 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:01.547679 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dfa8979d-4ef6-4452-8c7f-db6fecbf0f15 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:01.548489 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dfa8979d-4ef6-4452-8c7f-db6fecbf0f15 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:01.548988 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dfa8979d-4ef6-4452-8c7f-db6fecbf0f15 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:01.567786 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-dfa8979d-4ef6-4452-8c7f-db6fecbf0f15 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Getting quotas for project 6b501064302f41c8997c829a6498492c. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:24:01.573219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-dfa8979d-4ef6-4452-8c7f-db6fecbf0f15 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Getting quotas for user 211c5ded77174ea584b85e6617e3a18c and project 6b501064302f41c8997c829a6498492c. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:24:01.586325 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dfa8979d-4ef6-4452-8c7f-db6fecbf0f15 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:24:01.588646 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dfa8979d-4ef6-4452-8c7f-db6fecbf0f15 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:24:01.637860 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dfa8979d-4ef6-4452-8c7f-db6fecbf0f15 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726703 Jul 31 02:24:01.638720 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3649/7261] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:24:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:24:01.652307 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d1b9cf01-f3a3-4656-9cba-6f1ccf2ec05f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:24:01.653520 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d1b9cf01-f3a3-4656-9cba-6f1ccf2ec05f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:24:01.712922 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d1b9cf01-f3a3-4656-9cba-6f1ccf2ec05f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:24:01.720867 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d1b9cf01-f3a3-4656-9cba-6f1ccf2ec05f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1246 microversion: 2.1 time: 0.074302 Jul 31 02:24:01.736252 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3613/7262] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:24:01 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:24:02.744287 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7a0f760b-8062-40f9-b1a2-911a3e0e7b85 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:24:02.746385 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7a0f760b-8062-40f9-b1a2-911a3e0e7b85 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:24:02.754021 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a0f760b-8062-40f9-b1a2-911a3e0e7b85 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:02.754985 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a0f760b-8062-40f9-b1a2-911a3e0e7b85 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:02.756581 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a0f760b-8062-40f9-b1a2-911a3e0e7b85 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:02.757586 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7a0f760b-8062-40f9-b1a2-911a3e0e7b85 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:02.840162 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7a0f760b-8062-40f9-b1a2-911a3e0e7b85 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:24:02.861795 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7a0f760b-8062-40f9-b1a2-911a3e0e7b85 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1298 microversion: 2.1 time: 0.123326 Jul 31 02:24:02.862723 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3650/7263] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:24:02 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:24:03.887526 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-21e7db6b-554b-40ab-a9a1-c5f54d889741 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:24:03.888313 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-21e7db6b-554b-40ab-a9a1-c5f54d889741 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:24:03.903437 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21e7db6b-554b-40ab-a9a1-c5f54d889741 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:03.904088 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21e7db6b-554b-40ab-a9a1-c5f54d889741 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:03.905084 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21e7db6b-554b-40ab-a9a1-c5f54d889741 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:03.905907 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-21e7db6b-554b-40ab-a9a1-c5f54d889741 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:04.118035 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-21e7db6b-554b-40ab-a9a1-c5f54d889741 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:24:04.134059 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-21e7db6b-554b-40ab-a9a1-c5f54d889741 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1372 microversion: 2.1 time: 0.250921 Jul 31 02:24:04.134945 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3614/7264] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:24:03 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1372 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:24:04.362541 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-7f4e0338-40e6-4bd6-ad3d-57787bf8e444 req-85f91277-446c-40ff-88d7-50ede833d968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b189b00c-30a5-415e-bc28-c6cb8a9dd4e9", "tag": "69a8e20f-7bb1-4511-be71-005c6026bb87"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:24:04.383913 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7f4e0338-40e6-4bd6-ad3d-57787bf8e444 req-85f91277-446c-40ff-88d7-50ede833d968 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:04.385016 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-7f4e0338-40e6-4bd6-ad3d-57787bf8e444 req-85f91277-446c-40ff-88d7-50ede833d968 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:04.401995 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-7f4e0338-40e6-4bd6-ad3d-57787bf8e444 req-85f91277-446c-40ff-88d7-50ede833d968 service nova] Creating event network-changed:69a8e20f-7bb1-4511-be71-005c6026bb87 for instance b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 on n-h1-master-1 Jul 31 02:24:04.407931 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-7f4e0338-40e6-4bd6-ad3d-57787bf8e444 req-85f91277-446c-40ff-88d7-50ede833d968 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051574 Jul 31 02:24:04.408814 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3651/7265] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:24:05.157896 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e4fc5558-b7f1-467c-8ca7-dc5e7434a52b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:24:05.158533 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e4fc5558-b7f1-467c-8ca7-dc5e7434a52b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:24:05.165595 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4fc5558-b7f1-467c-8ca7-dc5e7434a52b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:05.166073 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4fc5558-b7f1-467c-8ca7-dc5e7434a52b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:05.167439 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4fc5558-b7f1-467c-8ca7-dc5e7434a52b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:05.167885 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e4fc5558-b7f1-467c-8ca7-dc5e7434a52b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:05.302619 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e4fc5558-b7f1-467c-8ca7-dc5e7434a52b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:24:05.312218 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e4fc5558-b7f1-467c-8ca7-dc5e7434a52b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1372 microversion: 2.1 time: 0.158122 Jul 31 02:24:05.313223 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3615/7266] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:24:05 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:24:06.335104 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bbb8c870-4f72-461a-8596-b1b8636c2d82 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:24:06.335858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bbb8c870-4f72-461a-8596-b1b8636c2d82 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:24:06.342087 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bbb8c870-4f72-461a-8596-b1b8636c2d82 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:06.342544 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bbb8c870-4f72-461a-8596-b1b8636c2d82 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:06.343311 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bbb8c870-4f72-461a-8596-b1b8636c2d82 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:06.343781 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bbb8c870-4f72-461a-8596-b1b8636c2d82 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:06.477665 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bbb8c870-4f72-461a-8596-b1b8636c2d82 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:24:06.485089 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bbb8c870-4f72-461a-8596-b1b8636c2d82 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1372 microversion: 2.1 time: 0.155051 Jul 31 02:24:06.485658 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3652/7267] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:24:06 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:24:07.506784 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-63db96f1-2ff1-4eb5-a5ef-3760924b230e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:24:07.507440 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-63db96f1-2ff1-4eb5-a5ef-3760924b230e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:24:07.514820 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63db96f1-2ff1-4eb5-a5ef-3760924b230e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:07.515286 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63db96f1-2ff1-4eb5-a5ef-3760924b230e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:07.516089 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63db96f1-2ff1-4eb5-a5ef-3760924b230e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:07.516542 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-63db96f1-2ff1-4eb5-a5ef-3760924b230e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:07.649253 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-63db96f1-2ff1-4eb5-a5ef-3760924b230e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:24:07.657261 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-63db96f1-2ff1-4eb5-a5ef-3760924b230e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1372 microversion: 2.1 time: 0.154406 Jul 31 02:24:07.657850 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3616/7268] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:24:07 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:24:08.678244 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e8675de6-8449-457c-8a93-fbac08cf6cc0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:24:08.678943 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e8675de6-8449-457c-8a93-fbac08cf6cc0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:24:08.685737 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8675de6-8449-457c-8a93-fbac08cf6cc0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:08.686205 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8675de6-8449-457c-8a93-fbac08cf6cc0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:08.686996 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8675de6-8449-457c-8a93-fbac08cf6cc0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:08.687479 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e8675de6-8449-457c-8a93-fbac08cf6cc0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:08.822276 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e8675de6-8449-457c-8a93-fbac08cf6cc0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:24:08.830638 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e8675de6-8449-457c-8a93-fbac08cf6cc0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1372 microversion: 2.1 time: 0.156485 Jul 31 02:24:08.831220 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3653/7269] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:24:08 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:24:09.852465 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-87468ab0-1998-42ad-b617-2893c9c14049 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:24:09.853111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-87468ab0-1998-42ad-b617-2893c9c14049 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:24:09.860277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87468ab0-1998-42ad-b617-2893c9c14049 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:09.860758 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87468ab0-1998-42ad-b617-2893c9c14049 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:09.861540 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87468ab0-1998-42ad-b617-2893c9c14049 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:09.862002 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-87468ab0-1998-42ad-b617-2893c9c14049 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:09.998266 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-87468ab0-1998-42ad-b617-2893c9c14049 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:24:10.006141 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-87468ab0-1998-42ad-b617-2893c9c14049 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1372 microversion: 2.1 time: 0.157664 Jul 31 02:24:10.006706 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3617/7270] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:24:09 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:24:10.259028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-1d6287ac-eb4e-48d1-8f7b-4f6c2da46ca5 req-7493f798-a4f6-4336-963f-233606610d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b189b00c-30a5-415e-bc28-c6cb8a9dd4e9", "name": "network-vif-plugged", "status": "completed", "tag": "69a8e20f-7bb1-4511-be71-005c6026bb87"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:24:10.270099 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1d6287ac-eb4e-48d1-8f7b-4f6c2da46ca5 req-7493f798-a4f6-4336-963f-233606610d96 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:10.270552 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-1d6287ac-eb4e-48d1-8f7b-4f6c2da46ca5 req-7493f798-a4f6-4336-963f-233606610d96 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:10.281768 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-1d6287ac-eb4e-48d1-8f7b-4f6c2da46ca5 req-7493f798-a4f6-4336-963f-233606610d96 service nova] Creating event network-vif-plugged:69a8e20f-7bb1-4511-be71-005c6026bb87 for instance b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 on n-h1-master-1 Jul 31 02:24:10.286677 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-1d6287ac-eb4e-48d1-8f7b-4f6c2da46ca5 req-7493f798-a4f6-4336-963f-233606610d96 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031487 Jul 31 02:24:10.287275 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3654/7271] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:24:11.028199 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2cb68b55-3a19-4b3f-a9c9-90a7364eaef8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:24:11.028869 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2cb68b55-3a19-4b3f-a9c9-90a7364eaef8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:24:11.035823 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cb68b55-3a19-4b3f-a9c9-90a7364eaef8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:11.036297 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cb68b55-3a19-4b3f-a9c9-90a7364eaef8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:11.037078 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cb68b55-3a19-4b3f-a9c9-90a7364eaef8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:11.037537 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2cb68b55-3a19-4b3f-a9c9-90a7364eaef8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:11.166186 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2cb68b55-3a19-4b3f-a9c9-90a7364eaef8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:24:11.173707 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2cb68b55-3a19-4b3f-a9c9-90a7364eaef8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1372 microversion: 2.1 time: 0.150022 Jul 31 02:24:11.174273 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3618/7272] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:24:11 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:24:12.193058 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:24:12.193846 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:24:12.198675 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cfa17a3c-23a7-4aa7-8154-fe4aeb7e2751 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:24:12.199414 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cfa17a3c-23a7-4aa7-8154-fe4aeb7e2751 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:24:12.206948 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfa17a3c-23a7-4aa7-8154-fe4aeb7e2751 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:12.207442 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfa17a3c-23a7-4aa7-8154-fe4aeb7e2751 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:12.208235 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfa17a3c-23a7-4aa7-8154-fe4aeb7e2751 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:12.208678 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cfa17a3c-23a7-4aa7-8154-fe4aeb7e2751 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:12.343324 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cfa17a3c-23a7-4aa7-8154-fe4aeb7e2751 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:24:12.351350 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cfa17a3c-23a7-4aa7-8154-fe4aeb7e2751 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1556 microversion: 2.1 time: 0.160038 Jul 31 02:24:12.351940 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3655/7273] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:24:12 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:24:12.372061 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3c6e322f-89ce-4522-9cd5-c9de5f49add1 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:24:12.372688 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3c6e322f-89ce-4522-9cd5-c9de5f49add1 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:24:12.374594 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:24:12.380899 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c6e322f-89ce-4522-9cd5-c9de5f49add1 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:12.381363 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c6e322f-89ce-4522-9cd5-c9de5f49add1 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:12.382133 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c6e322f-89ce-4522-9cd5-c9de5f49add1 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:12.382579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c6e322f-89ce-4522-9cd5-c9de5f49add1 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:12.512238 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3c6e322f-89ce-4522-9cd5-c9de5f49add1 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:24:12.519654 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3c6e322f-89ce-4522-9cd5-c9de5f49add1 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1556 microversion: 2.1 time: 0.151919 Jul 31 02:24:12.520221 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3619/7274] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:24:12 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:24:14.162811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-268d708e-285d-4939-875f-59898cd9f62a req-3642f865-a204-4bea-beaf-eca099e94214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b189b00c-30a5-415e-bc28-c6cb8a9dd4e9", "tag": "69a8e20f-7bb1-4511-be71-005c6026bb87"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:24:14.173222 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-268d708e-285d-4939-875f-59898cd9f62a req-3642f865-a204-4bea-beaf-eca099e94214 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:24:14.173768 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-268d708e-285d-4939-875f-59898cd9f62a req-3642f865-a204-4bea-beaf-eca099e94214 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:24:14.184902 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-268d708e-285d-4939-875f-59898cd9f62a req-3642f865-a204-4bea-beaf-eca099e94214 service nova] Creating event network-changed:69a8e20f-7bb1-4511-be71-005c6026bb87 for instance b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 on n-h1-master-1 Jul 31 02:24:14.190193 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-268d708e-285d-4939-875f-59898cd9f62a req-3642f865-a204-4bea-beaf-eca099e94214 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031171 Jul 31 02:24:14.190825 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3656/7275] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:25:59.139023 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:25:59.139661 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 02:25:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:26:08.231491 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:26:08.232998 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=36 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:26:08.237248 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fd6d4c44-34ee-44e3-b0e4-e38ce3e62f52 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:26:08.237796 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fd6d4c44-34ee-44e3-b0e4-e38ce3e62f52 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:08.245000 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd6d4c44-34ee-44e3-b0e4-e38ce3e62f52 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:08.245458 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd6d4c44-34ee-44e3-b0e4-e38ce3e62f52 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:08.246229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd6d4c44-34ee-44e3-b0e4-e38ce3e62f52 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:08.246678 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fd6d4c44-34ee-44e3-b0e4-e38ce3e62f52 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:08.269618 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-fd6d4c44-34ee-44e3-b0e4-e38ce3e62f52 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lazy-loading 'flavor' on Instance uuid b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:26:08.606847 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fd6d4c44-34ee-44e3-b0e4-e38ce3e62f52 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "POST /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9/action" status: 202 len: 0 microversion: 2.1 time: 0.377170 Jul 31 02:26:08.607467 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3620/7276] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:26:08 2022] POST /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:26:08.613755 n-d-master-1 devstack@n-api.service[119475]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ce818dc8-5b17-41f1-bd07-761ee808087c] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 31 02:26:08.615719 n-d-master-1 devstack@n-api.service[119475]: ERROR oslo.messaging._drivers.impl_rabbit [-] [189acb91-3d4b-44e7-81c9-7fd59a69a406] AMQP server on 10.222.0.45:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 31 02:26:08.616335 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:26:08.617078 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=32 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:26:08.622017 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-2cbb0c4a-778b-4a97-8965-5f57dd81f6b6 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:08.622732 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-2cbb0c4a-778b-4a97-8965-5f57dd81f6b6 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:08.631263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cbb0c4a-778b-4a97-8965-5f57dd81f6b6 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:08.631758 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cbb0c4a-778b-4a97-8965-5f57dd81f6b6 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:08.632533 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cbb0c4a-778b-4a97-8965-5f57dd81f6b6 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:08.632975 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-2cbb0c4a-778b-4a97-8965-5f57dd81f6b6 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:08.826701 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-2cbb0c4a-778b-4a97-8965-5f57dd81f6b6 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:08.834284 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-2cbb0c4a-778b-4a97-8965-5f57dd81f6b6 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1681 microversion: 2.1 time: 0.222323 Jul 31 02:26:08.834848 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3657/7277] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:08 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1681 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:09.858227 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d29a4b9a-3478-4b98-85ca-e0e3c7d956fa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:09.858854 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d29a4b9a-3478-4b98-85ca-e0e3c7d956fa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:09.866680 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d29a4b9a-3478-4b98-85ca-e0e3c7d956fa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:09.867146 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d29a4b9a-3478-4b98-85ca-e0e3c7d956fa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:09.867949 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d29a4b9a-3478-4b98-85ca-e0e3c7d956fa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:09.868706 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d29a4b9a-3478-4b98-85ca-e0e3c7d956fa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:10.004588 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d29a4b9a-3478-4b98-85ca-e0e3c7d956fa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:10.012063 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d29a4b9a-3478-4b98-85ca-e0e3c7d956fa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1681 microversion: 2.1 time: 0.159703 Jul 31 02:26:10.012626 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3621/7278] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:09 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:11.033369 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-532d20df-7b35-45af-8837-afd80887637c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:11.034001 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-532d20df-7b35-45af-8837-afd80887637c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:11.047125 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-532d20df-7b35-45af-8837-afd80887637c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:11.047626 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-532d20df-7b35-45af-8837-afd80887637c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:11.048411 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-532d20df-7b35-45af-8837-afd80887637c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:11.048890 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-532d20df-7b35-45af-8837-afd80887637c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:11.054394 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] [ce818dc8-5b17-41f1-bd07-761ee808087c] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 40616. Jul 31 02:26:11.055107 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] [189acb91-3d4b-44e7-81c9-7fd59a69a406] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 40618. Jul 31 02:26:11.181659 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-532d20df-7b35-45af-8837-afd80887637c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:11.189180 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-532d20df-7b35-45af-8837-afd80887637c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1681 microversion: 2.1 time: 0.159816 Jul 31 02:26:11.189762 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3658/7279] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:11 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:12.210090 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ef237f9f-6de8-4996-a889-32bfc6ac9fe5 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:12.210730 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ef237f9f-6de8-4996-a889-32bfc6ac9fe5 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:12.217850 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef237f9f-6de8-4996-a889-32bfc6ac9fe5 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:12.218321 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef237f9f-6de8-4996-a889-32bfc6ac9fe5 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:12.219106 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef237f9f-6de8-4996-a889-32bfc6ac9fe5 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:12.219595 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ef237f9f-6de8-4996-a889-32bfc6ac9fe5 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:12.356400 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ef237f9f-6de8-4996-a889-32bfc6ac9fe5 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:12.367147 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ef237f9f-6de8-4996-a889-32bfc6ac9fe5 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1681 microversion: 2.1 time: 0.160986 Jul 31 02:26:12.367759 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3622/7280] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:12 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:13.389138 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-9e13f535-6fe6-4847-855a-b44ed17b0424 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:13.389787 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-9e13f535-6fe6-4847-855a-b44ed17b0424 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:13.396921 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e13f535-6fe6-4847-855a-b44ed17b0424 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:13.397389 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e13f535-6fe6-4847-855a-b44ed17b0424 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:13.398158 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e13f535-6fe6-4847-855a-b44ed17b0424 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:13.398633 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-9e13f535-6fe6-4847-855a-b44ed17b0424 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:13.527948 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-9e13f535-6fe6-4847-855a-b44ed17b0424 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:13.535786 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-9e13f535-6fe6-4847-855a-b44ed17b0424 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1681 microversion: 2.1 time: 0.150850 Jul 31 02:26:13.536353 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3659/7281] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:13 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:14.557941 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9b2953c3-481b-4e23-b7a1-5a20cddcdd55 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:14.561835 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9b2953c3-481b-4e23-b7a1-5a20cddcdd55 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:14.565908 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9b2953c3-481b-4e23-b7a1-5a20cddcdd55 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:14.566383 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9b2953c3-481b-4e23-b7a1-5a20cddcdd55 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:14.567181 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9b2953c3-481b-4e23-b7a1-5a20cddcdd55 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:14.567665 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9b2953c3-481b-4e23-b7a1-5a20cddcdd55 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:14.703680 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9b2953c3-481b-4e23-b7a1-5a20cddcdd55 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:14.711224 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9b2953c3-481b-4e23-b7a1-5a20cddcdd55 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1681 microversion: 2.1 time: 0.157261 Jul 31 02:26:14.711824 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3623/7282] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:14 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:15.732727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-69354e4f-a111-468f-aa25-71cfb7f7f674 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:15.741467 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-69354e4f-a111-468f-aa25-71cfb7f7f674 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:15.742973 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69354e4f-a111-468f-aa25-71cfb7f7f674 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:15.743467 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69354e4f-a111-468f-aa25-71cfb7f7f674 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:15.744253 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69354e4f-a111-468f-aa25-71cfb7f7f674 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:15.744704 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69354e4f-a111-468f-aa25-71cfb7f7f674 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:15.877620 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-69354e4f-a111-468f-aa25-71cfb7f7f674 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:15.885164 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-69354e4f-a111-468f-aa25-71cfb7f7f674 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1681 microversion: 2.1 time: 0.156497 Jul 31 02:26:15.885737 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3660/7283] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:15 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:16.911653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-214d45ef-9dd9-4d3c-9757-f4f8d4e3a861 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:16.912286 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-214d45ef-9dd9-4d3c-9757-f4f8d4e3a861 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:16.919263 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-214d45ef-9dd9-4d3c-9757-f4f8d4e3a861 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:16.919769 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-214d45ef-9dd9-4d3c-9757-f4f8d4e3a861 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:16.920551 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-214d45ef-9dd9-4d3c-9757-f4f8d4e3a861 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:16.921009 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-214d45ef-9dd9-4d3c-9757-f4f8d4e3a861 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:17.051478 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-214d45ef-9dd9-4d3c-9757-f4f8d4e3a861 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:17.059690 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-214d45ef-9dd9-4d3c-9757-f4f8d4e3a861 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1681 microversion: 2.1 time: 0.152022 Jul 31 02:26:17.060261 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3624/7284] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:16 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:18.081417 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d1105d88-3d97-4b79-9096-1b0e1670aeb7 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:18.082086 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d1105d88-3d97-4b79-9096-1b0e1670aeb7 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:18.089011 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d1105d88-3d97-4b79-9096-1b0e1670aeb7 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:18.089482 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d1105d88-3d97-4b79-9096-1b0e1670aeb7 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:18.090891 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d1105d88-3d97-4b79-9096-1b0e1670aeb7 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:18.091365 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d1105d88-3d97-4b79-9096-1b0e1670aeb7 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:18.230061 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d1105d88-3d97-4b79-9096-1b0e1670aeb7 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:18.237649 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d1105d88-3d97-4b79-9096-1b0e1670aeb7 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1681 microversion: 2.1 time: 0.160301 Jul 31 02:26:18.238228 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3661/7285] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:18 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:19.259679 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6156cd95-e1a6-4590-a370-814093c240f8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:19.260333 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6156cd95-e1a6-4590-a370-814093c240f8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:19.267006 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6156cd95-e1a6-4590-a370-814093c240f8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:19.267517 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6156cd95-e1a6-4590-a370-814093c240f8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:19.268303 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6156cd95-e1a6-4590-a370-814093c240f8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:19.268771 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6156cd95-e1a6-4590-a370-814093c240f8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:19.407372 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6156cd95-e1a6-4590-a370-814093c240f8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:19.415104 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6156cd95-e1a6-4590-a370-814093c240f8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1702 microversion: 2.1 time: 0.159552 Jul 31 02:26:19.415721 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3625/7286] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:19 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1702 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:20.437444 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ec706f2d-a7c9-484d-8ad3-684a2a58797b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:20.438081 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ec706f2d-a7c9-484d-8ad3-684a2a58797b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:20.445186 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec706f2d-a7c9-484d-8ad3-684a2a58797b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:20.445643 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec706f2d-a7c9-484d-8ad3-684a2a58797b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:20.446404 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec706f2d-a7c9-484d-8ad3-684a2a58797b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:20.446844 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ec706f2d-a7c9-484d-8ad3-684a2a58797b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:20.581037 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ec706f2d-a7c9-484d-8ad3-684a2a58797b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:20.588436 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ec706f2d-a7c9-484d-8ad3-684a2a58797b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1702 microversion: 2.1 time: 0.154860 Jul 31 02:26:20.589013 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3662/7287] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:20 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1702 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:21.610469 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4cc91067-b7b8-4675-971a-a39a0aae3931 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:21.611030 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4cc91067-b7b8-4675-971a-a39a0aae3931 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:21.618764 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4cc91067-b7b8-4675-971a-a39a0aae3931 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:21.619229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4cc91067-b7b8-4675-971a-a39a0aae3931 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:21.620038 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4cc91067-b7b8-4675-971a-a39a0aae3931 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:21.620482 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4cc91067-b7b8-4675-971a-a39a0aae3931 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:21.771364 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4cc91067-b7b8-4675-971a-a39a0aae3931 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:21.779536 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4cc91067-b7b8-4675-971a-a39a0aae3931 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1697 microversion: 2.1 time: 0.172932 Jul 31 02:26:21.792328 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3626/7288] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:21 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:22.803576 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-efea9a6b-b76f-45d6-a4a7-6513046b65ce tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:22.804386 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-efea9a6b-b76f-45d6-a4a7-6513046b65ce tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:22.811417 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efea9a6b-b76f-45d6-a4a7-6513046b65ce tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:22.812217 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efea9a6b-b76f-45d6-a4a7-6513046b65ce tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:22.813541 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efea9a6b-b76f-45d6-a4a7-6513046b65ce tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:22.814235 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-efea9a6b-b76f-45d6-a4a7-6513046b65ce tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:22.992958 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-efea9a6b-b76f-45d6-a4a7-6513046b65ce tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:23.002942 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-efea9a6b-b76f-45d6-a4a7-6513046b65ce tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1697 microversion: 2.1 time: 0.203484 Jul 31 02:26:23.016635 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3663/7289] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:22 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1697 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:24.027686 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-02c0f0fc-5732-4bf9-84c4-7a7c11e214aa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:24.028929 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-02c0f0fc-5732-4bf9-84c4-7a7c11e214aa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:24.036319 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02c0f0fc-5732-4bf9-84c4-7a7c11e214aa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:24.037207 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02c0f0fc-5732-4bf9-84c4-7a7c11e214aa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:24.038865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02c0f0fc-5732-4bf9-84c4-7a7c11e214aa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:24.039753 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-02c0f0fc-5732-4bf9-84c4-7a7c11e214aa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:24.191689 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-02c0f0fc-5732-4bf9-84c4-7a7c11e214aa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:24.200686 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-02c0f0fc-5732-4bf9-84c4-7a7c11e214aa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1697 microversion: 2.1 time: 0.177722 Jul 31 02:26:24.202911 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3627/7290] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:24 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:24.813927 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:26:24.814510 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 02:26:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:26:24.965698 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-18747e2e-1359-4235-b27b-c9c35f35cbf5 req-1e5580b9-d041-4608-bb49-e30406f18085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b189b00c-30a5-415e-bc28-c6cb8a9dd4e9", "name": "network-vif-plugged", "status": "completed", "tag": "69a8e20f-7bb1-4511-be71-005c6026bb87"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:26:24.977282 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-18747e2e-1359-4235-b27b-c9c35f35cbf5 req-1e5580b9-d041-4608-bb49-e30406f18085 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:24.980267 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-18747e2e-1359-4235-b27b-c9c35f35cbf5 req-1e5580b9-d041-4608-bb49-e30406f18085 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:24.995678 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-18747e2e-1359-4235-b27b-c9c35f35cbf5 req-1e5580b9-d041-4608-bb49-e30406f18085 service nova] Creating event network-vif-plugged:69a8e20f-7bb1-4511-be71-005c6026bb87 for instance b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 on n-h1-master-1 Jul 31 02:26:25.002684 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-18747e2e-1359-4235-b27b-c9c35f35cbf5 req-1e5580b9-d041-4608-bb49-e30406f18085 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041901 Jul 31 02:26:25.003678 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3664/7291] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:26:25.224289 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2625cf2a-7e4a-43b5-af1f-b03f36846eb8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:25.225905 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2625cf2a-7e4a-43b5-af1f-b03f36846eb8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:25.235288 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2625cf2a-7e4a-43b5-af1f-b03f36846eb8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:25.236059 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2625cf2a-7e4a-43b5-af1f-b03f36846eb8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:25.237033 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2625cf2a-7e4a-43b5-af1f-b03f36846eb8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:25.237493 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2625cf2a-7e4a-43b5-af1f-b03f36846eb8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:25.397477 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2625cf2a-7e4a-43b5-af1f-b03f36846eb8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:25.406486 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2625cf2a-7e4a-43b5-af1f-b03f36846eb8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1697 microversion: 2.1 time: 0.186091 Jul 31 02:26:25.407080 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3628/7292] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:25 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:26.428719 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-39a89510-0ce3-4a16-a58c-d860e16214a7 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:26.429445 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-39a89510-0ce3-4a16-a58c-d860e16214a7 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:26.437758 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-39a89510-0ce3-4a16-a58c-d860e16214a7 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:26.438289 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-39a89510-0ce3-4a16-a58c-d860e16214a7 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:26.439080 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-39a89510-0ce3-4a16-a58c-d860e16214a7 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:26.439722 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-39a89510-0ce3-4a16-a58c-d860e16214a7 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:26.597456 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-39a89510-0ce3-4a16-a58c-d860e16214a7 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:26.605320 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-39a89510-0ce3-4a16-a58c-d860e16214a7 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1697 microversion: 2.1 time: 0.180853 Jul 31 02:26:26.605905 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3665/7293] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:26 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:27.626574 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cafd5111-79b0-4a63-9ad6-5ee8e356c816 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:27.627185 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cafd5111-79b0-4a63-9ad6-5ee8e356c816 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:27.634452 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cafd5111-79b0-4a63-9ad6-5ee8e356c816 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:27.635128 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cafd5111-79b0-4a63-9ad6-5ee8e356c816 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:27.636112 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cafd5111-79b0-4a63-9ad6-5ee8e356c816 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:27.636764 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cafd5111-79b0-4a63-9ad6-5ee8e356c816 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:27.775751 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cafd5111-79b0-4a63-9ad6-5ee8e356c816 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:27.784699 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cafd5111-79b0-4a63-9ad6-5ee8e356c816 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1697 microversion: 2.1 time: 0.162275 Jul 31 02:26:27.785397 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3629/7294] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:27 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:28.807158 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-86be91d8-bf8a-4948-b4bc-7aad383e213c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:28.808669 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-86be91d8-bf8a-4948-b4bc-7aad383e213c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:28.816438 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-86be91d8-bf8a-4948-b4bc-7aad383e213c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:28.816829 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-86be91d8-bf8a-4948-b4bc-7aad383e213c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:28.817629 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-86be91d8-bf8a-4948-b4bc-7aad383e213c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:28.818080 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-86be91d8-bf8a-4948-b4bc-7aad383e213c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:28.978201 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-86be91d8-bf8a-4948-b4bc-7aad383e213c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:28.986225 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-86be91d8-bf8a-4948-b4bc-7aad383e213c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1697 microversion: 2.1 time: 0.182944 Jul 31 02:26:28.986834 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3666/7295] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:28 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:30.011503 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fa343fd9-5cc5-462d-b6e7-3c971d8c107a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:30.012201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fa343fd9-5cc5-462d-b6e7-3c971d8c107a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:30.019730 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa343fd9-5cc5-462d-b6e7-3c971d8c107a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:30.020206 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa343fd9-5cc5-462d-b6e7-3c971d8c107a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:30.021016 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa343fd9-5cc5-462d-b6e7-3c971d8c107a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:30.021470 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa343fd9-5cc5-462d-b6e7-3c971d8c107a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:30.162474 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fa343fd9-5cc5-462d-b6e7-3c971d8c107a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:30.172163 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fa343fd9-5cc5-462d-b6e7-3c971d8c107a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1697 microversion: 2.1 time: 0.165827 Jul 31 02:26:30.172940 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3630/7296] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:30 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:26:31.194009 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bf402d44-a4a9-4bd5-8eb0-ebbdccc61c1b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:31.194637 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bf402d44-a4a9-4bd5-8eb0-ebbdccc61c1b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:31.201766 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf402d44-a4a9-4bd5-8eb0-ebbdccc61c1b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:31.202229 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf402d44-a4a9-4bd5-8eb0-ebbdccc61c1b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:31.203009 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf402d44-a4a9-4bd5-8eb0-ebbdccc61c1b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:31.203490 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bf402d44-a4a9-4bd5-8eb0-ebbdccc61c1b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:31.335796 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bf402d44-a4a9-4bd5-8eb0-ebbdccc61c1b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:31.343900 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bf402d44-a4a9-4bd5-8eb0-ebbdccc61c1b tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1679 microversion: 2.1 time: 0.153868 Jul 31 02:26:31.344746 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3667/7297] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:31 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:32.366177 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b0aae317-ddc9-4d51-bc5b-d7a373b7610d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:32.366847 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b0aae317-ddc9-4d51-bc5b-d7a373b7610d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:32.374508 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0aae317-ddc9-4d51-bc5b-d7a373b7610d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:32.375234 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0aae317-ddc9-4d51-bc5b-d7a373b7610d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:32.376050 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0aae317-ddc9-4d51-bc5b-d7a373b7610d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:32.376505 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b0aae317-ddc9-4d51-bc5b-d7a373b7610d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:32.510442 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b0aae317-ddc9-4d51-bc5b-d7a373b7610d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:32.518057 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b0aae317-ddc9-4d51-bc5b-d7a373b7610d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1679 microversion: 2.1 time: 0.155793 Jul 31 02:26:32.518632 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3631/7298] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:32 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:33.539801 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-bcd4b817-964d-4e81-8f89-ab6eb33fe78d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:33.540344 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-bcd4b817-964d-4e81-8f89-ab6eb33fe78d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:33.547199 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcd4b817-964d-4e81-8f89-ab6eb33fe78d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:33.547700 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcd4b817-964d-4e81-8f89-ab6eb33fe78d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:33.548470 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcd4b817-964d-4e81-8f89-ab6eb33fe78d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:33.548915 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-bcd4b817-964d-4e81-8f89-ab6eb33fe78d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:33.689806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-bcd4b817-964d-4e81-8f89-ab6eb33fe78d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:33.697442 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-bcd4b817-964d-4e81-8f89-ab6eb33fe78d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1682 microversion: 2.1 time: 0.161696 Jul 31 02:26:33.698028 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3668/7299] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:33 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:33.718955 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b4ccc878-8956-44c2-9e4d-4a082d17732e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:26:33.719602 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b4ccc878-8956-44c2-9e4d-4a082d17732e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:33.726647 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4ccc878-8956-44c2-9e4d-4a082d17732e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:33.727111 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4ccc878-8956-44c2-9e4d-4a082d17732e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:33.727913 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4ccc878-8956-44c2-9e4d-4a082d17732e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:33.728368 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b4ccc878-8956-44c2-9e4d-4a082d17732e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:33.812969 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b4ccc878-8956-44c2-9e4d-4a082d17732e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119474) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 31 02:26:33.880847 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b4ccc878-8956-44c2-9e4d-4a082d17732e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "POST /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9/action" status: 202 len: 0 microversion: 2.1 time: 0.165811 Jul 31 02:26:33.881479 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3632/7300] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:26:33 2022] POST /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 02:26:33.890633 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-34a0f74a-2bf8-45ea-ae4f-c51dca5af6c9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:33.891378 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-34a0f74a-2bf8-45ea-ae4f-c51dca5af6c9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:33.898236 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34a0f74a-2bf8-45ea-ae4f-c51dca5af6c9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:33.898555 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34a0f74a-2bf8-45ea-ae4f-c51dca5af6c9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:33.899817 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34a0f74a-2bf8-45ea-ae4f-c51dca5af6c9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:33.899906 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-34a0f74a-2bf8-45ea-ae4f-c51dca5af6c9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:34.049576 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-34a0f74a-2bf8-45ea-ae4f-c51dca5af6c9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:34.060580 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-34a0f74a-2bf8-45ea-ae4f-c51dca5af6c9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1630 microversion: 2.1 time: 0.174723 Jul 31 02:26:34.061171 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3669/7301] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:33 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1630 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:34.984714 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-7918850c-c97f-43a1-b582-8c8c5b6933e8 req-0e0eb6c8-a5e7-46dd-9081-4a243b906d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b189b00c-30a5-415e-bc28-c6cb8a9dd4e9", "name": "network-vif-unplugged", "status": "completed", "tag": "69a8e20f-7bb1-4511-be71-005c6026bb87"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:26:34.995804 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7918850c-c97f-43a1-b582-8c8c5b6933e8 req-0e0eb6c8-a5e7-46dd-9081-4a243b906d99 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:34.996273 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-7918850c-c97f-43a1-b582-8c8c5b6933e8 req-0e0eb6c8-a5e7-46dd-9081-4a243b906d99 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:35.007120 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-7918850c-c97f-43a1-b582-8c8c5b6933e8 req-0e0eb6c8-a5e7-46dd-9081-4a243b906d99 service nova] Creating event network-vif-unplugged:69a8e20f-7bb1-4511-be71-005c6026bb87 for instance b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 on n-h2-master-1 Jul 31 02:26:35.012086 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-7918850c-c97f-43a1-b582-8c8c5b6933e8 req-0e0eb6c8-a5e7-46dd-9081-4a243b906d99 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032654 Jul 31 02:26:35.012680 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3633/7302] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:26:35.082047 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-f7dc62f7-0217-41a4-aa16-43016b535a33 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:35.082676 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-f7dc62f7-0217-41a4-aa16-43016b535a33 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:35.089551 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7dc62f7-0217-41a4-aa16-43016b535a33 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:35.090013 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7dc62f7-0217-41a4-aa16-43016b535a33 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:35.091319 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7dc62f7-0217-41a4-aa16-43016b535a33 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:35.091792 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-f7dc62f7-0217-41a4-aa16-43016b535a33 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:35.257162 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-f7dc62f7-0217-41a4-aa16-43016b535a33 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:35.265430 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-f7dc62f7-0217-41a4-aa16-43016b535a33 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1688 microversion: 2.1 time: 0.187308 Jul 31 02:26:35.266252 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3670/7303] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:35 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:36.287034 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ba46d44d-fa7f-410d-bc84-c746047d2df3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:36.287966 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ba46d44d-fa7f-410d-bc84-c746047d2df3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:36.296614 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ba46d44d-fa7f-410d-bc84-c746047d2df3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:36.297371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ba46d44d-fa7f-410d-bc84-c746047d2df3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:36.298364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ba46d44d-fa7f-410d-bc84-c746047d2df3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:36.299017 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ba46d44d-fa7f-410d-bc84-c746047d2df3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:36.351983 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-b32f9fa7-8d73-4b44-8f84-d381c0c85e7f req-45c50438-727c-4a80-99a6-07d5eaf026fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b189b00c-30a5-415e-bc28-c6cb8a9dd4e9", "tag": "69a8e20f-7bb1-4511-be71-005c6026bb87"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:26:36.362562 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b32f9fa7-8d73-4b44-8f84-d381c0c85e7f req-45c50438-727c-4a80-99a6-07d5eaf026fc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:36.363020 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-b32f9fa7-8d73-4b44-8f84-d381c0c85e7f req-45c50438-727c-4a80-99a6-07d5eaf026fc service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:36.368357 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:26:36.376525 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-b32f9fa7-8d73-4b44-8f84-d381c0c85e7f req-45c50438-727c-4a80-99a6-07d5eaf026fc service nova] Creating event network-changed:69a8e20f-7bb1-4511-be71-005c6026bb87 for instance b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 on n-h2-master-1 Jul 31 02:26:36.381691 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-b32f9fa7-8d73-4b44-8f84-d381c0c85e7f req-45c50438-727c-4a80-99a6-07d5eaf026fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099733 Jul 31 02:26:36.382289 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3634/7304] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:26:36.527859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ba46d44d-fa7f-410d-bc84-c746047d2df3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:36.535463 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ba46d44d-fa7f-410d-bc84-c746047d2df3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1688 microversion: 2.1 time: 0.252143 Jul 31 02:26:36.536049 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3671/7305] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:36 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1688 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:26:37.558912 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2e1ba34b-e9ce-475b-a234-c69971319e84 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:37.565428 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2e1ba34b-e9ce-475b-a234-c69971319e84 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:37.567681 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e1ba34b-e9ce-475b-a234-c69971319e84 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:37.568168 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e1ba34b-e9ce-475b-a234-c69971319e84 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:37.568965 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e1ba34b-e9ce-475b-a234-c69971319e84 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:37.569416 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2e1ba34b-e9ce-475b-a234-c69971319e84 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:37.730884 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-2e1ba34b-e9ce-475b-a234-c69971319e84 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:37.743923 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2e1ba34b-e9ce-475b-a234-c69971319e84 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1688 microversion: 2.1 time: 0.190274 Jul 31 02:26:37.745735 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3635/7306] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:37 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1688 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:26:38.766931 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-95883303-1cc6-4ea3-994b-55d5e5e85291 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:38.767589 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-95883303-1cc6-4ea3-994b-55d5e5e85291 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:38.770761 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=31 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:26:38.778534 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95883303-1cc6-4ea3-994b-55d5e5e85291 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:38.779442 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95883303-1cc6-4ea3-994b-55d5e5e85291 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:38.784512 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95883303-1cc6-4ea3-994b-55d5e5e85291 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:38.785689 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-95883303-1cc6-4ea3-994b-55d5e5e85291 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:38.789592 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=87 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:26:38.932759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-95883303-1cc6-4ea3-994b-55d5e5e85291 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:38.941926 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-95883303-1cc6-4ea3-994b-55d5e5e85291 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1688 microversion: 2.1 time: 0.179001 Jul 31 02:26:38.956454 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3672/7307] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:38 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:39.965550 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-91ddb349-60ac-4a0b-838c-33d6d6a6f90a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:39.966188 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-91ddb349-60ac-4a0b-838c-33d6d6a6f90a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:39.969080 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:26:39.974780 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91ddb349-60ac-4a0b-838c-33d6d6a6f90a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:39.975307 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91ddb349-60ac-4a0b-838c-33d6d6a6f90a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:39.976128 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91ddb349-60ac-4a0b-838c-33d6d6a6f90a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:39.976616 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-91ddb349-60ac-4a0b-838c-33d6d6a6f90a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:40.119294 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-91ddb349-60ac-4a0b-838c-33d6d6a6f90a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:40.128444 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-91ddb349-60ac-4a0b-838c-33d6d6a6f90a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1688 microversion: 2.1 time: 0.167312 Jul 31 02:26:40.129382 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3636/7308] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:39 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:41.151759 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-93dd2a34-264a-4a83-bf60-dd2afe07b6aa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:41.152384 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-93dd2a34-264a-4a83-bf60-dd2afe07b6aa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:41.159263 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-93dd2a34-264a-4a83-bf60-dd2afe07b6aa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:41.159763 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-93dd2a34-264a-4a83-bf60-dd2afe07b6aa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:41.160541 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-93dd2a34-264a-4a83-bf60-dd2afe07b6aa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:41.160996 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-93dd2a34-264a-4a83-bf60-dd2afe07b6aa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:41.320087 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-93dd2a34-264a-4a83-bf60-dd2afe07b6aa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:41.327712 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-93dd2a34-264a-4a83-bf60-dd2afe07b6aa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1688 microversion: 2.1 time: 0.179833 Jul 31 02:26:41.328303 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3673/7309] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:41 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:42.349549 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-18933369-3c56-45fc-ae22-c5eaee972299 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:42.350256 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-18933369-3c56-45fc-ae22-c5eaee972299 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:42.358297 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18933369-3c56-45fc-ae22-c5eaee972299 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:42.358790 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18933369-3c56-45fc-ae22-c5eaee972299 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:42.359610 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18933369-3c56-45fc-ae22-c5eaee972299 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:42.360055 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-18933369-3c56-45fc-ae22-c5eaee972299 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:42.498855 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-18933369-3c56-45fc-ae22-c5eaee972299 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:42.506818 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-18933369-3c56-45fc-ae22-c5eaee972299 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1688 microversion: 2.1 time: 0.161164 Jul 31 02:26:42.507638 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3637/7310] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:42 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:43.528208 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-be389a1c-9a75-4367-b665-3440bc83c350 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:43.529641 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-be389a1c-9a75-4367-b665-3440bc83c350 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:43.536654 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be389a1c-9a75-4367-b665-3440bc83c350 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:43.537114 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be389a1c-9a75-4367-b665-3440bc83c350 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:43.537896 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be389a1c-9a75-4367-b665-3440bc83c350 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:43.538340 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-be389a1c-9a75-4367-b665-3440bc83c350 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:43.696126 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-be389a1c-9a75-4367-b665-3440bc83c350 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:43.704224 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-be389a1c-9a75-4367-b665-3440bc83c350 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1688 microversion: 2.1 time: 0.180000 Jul 31 02:26:43.704803 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3674/7311] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:43 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:26:44.726486 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-56484eaf-1f35-44c2-9ecb-4204923fec29 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:44.727234 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-56484eaf-1f35-44c2-9ecb-4204923fec29 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:44.734734 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-56484eaf-1f35-44c2-9ecb-4204923fec29 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:44.735216 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-56484eaf-1f35-44c2-9ecb-4204923fec29 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:44.736068 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-56484eaf-1f35-44c2-9ecb-4204923fec29 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:44.736530 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-56484eaf-1f35-44c2-9ecb-4204923fec29 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:44.880826 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-56484eaf-1f35-44c2-9ecb-4204923fec29 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:44.889094 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-56484eaf-1f35-44c2-9ecb-4204923fec29 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1688 microversion: 2.1 time: 0.166602 Jul 31 02:26:44.889937 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3638/7312] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:44 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:26:45.911219 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-051b4588-8a1b-4749-902d-04df436b2296 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:45.911836 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-051b4588-8a1b-4749-902d-04df436b2296 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:45.918613 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-051b4588-8a1b-4749-902d-04df436b2296 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:45.919069 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-051b4588-8a1b-4749-902d-04df436b2296 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:45.919937 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-051b4588-8a1b-4749-902d-04df436b2296 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:45.920381 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-051b4588-8a1b-4749-902d-04df436b2296 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:46.131785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-051b4588-8a1b-4749-902d-04df436b2296 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:46.139779 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-051b4588-8a1b-4749-902d-04df436b2296 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1688 microversion: 2.1 time: 0.232446 Jul 31 02:26:46.140395 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3675/7313] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:45 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1688 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:47.162009 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f84d3902-020f-4f42-9f9d-cf48e6d5b0bf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:47.162646 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f84d3902-020f-4f42-9f9d-cf48e6d5b0bf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:47.170228 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f84d3902-020f-4f42-9f9d-cf48e6d5b0bf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:47.170697 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f84d3902-020f-4f42-9f9d-cf48e6d5b0bf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:47.171504 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f84d3902-020f-4f42-9f9d-cf48e6d5b0bf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:47.171991 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f84d3902-020f-4f42-9f9d-cf48e6d5b0bf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:47.305629 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f84d3902-020f-4f42-9f9d-cf48e6d5b0bf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:47.313761 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f84d3902-020f-4f42-9f9d-cf48e6d5b0bf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1688 microversion: 2.1 time: 0.155610 Jul 31 02:26:47.314290 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3639/7314] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:47 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:48.334510 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-897671e8-467b-42c3-bf17-fe5bd5b9261e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:48.335126 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-897671e8-467b-42c3-bf17-fe5bd5b9261e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:48.342189 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-897671e8-467b-42c3-bf17-fe5bd5b9261e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:48.342644 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-897671e8-467b-42c3-bf17-fe5bd5b9261e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:48.343457 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-897671e8-467b-42c3-bf17-fe5bd5b9261e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:48.343907 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-897671e8-467b-42c3-bf17-fe5bd5b9261e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:48.474673 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-897671e8-467b-42c3-bf17-fe5bd5b9261e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:48.482872 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-897671e8-467b-42c3-bf17-fe5bd5b9261e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1688 microversion: 2.1 time: 0.152291 Jul 31 02:26:48.483482 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3676/7315] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:48 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:26:49.505189 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-25c1259c-07ce-4d5f-9507-aa7e2cfa3600 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:49.505813 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-25c1259c-07ce-4d5f-9507-aa7e2cfa3600 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:49.512468 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25c1259c-07ce-4d5f-9507-aa7e2cfa3600 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:49.512927 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25c1259c-07ce-4d5f-9507-aa7e2cfa3600 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:49.514208 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25c1259c-07ce-4d5f-9507-aa7e2cfa3600 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:49.514649 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-25c1259c-07ce-4d5f-9507-aa7e2cfa3600 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:49.651627 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-25c1259c-07ce-4d5f-9507-aa7e2cfa3600 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:49.659205 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-25c1259c-07ce-4d5f-9507-aa7e2cfa3600 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1688 microversion: 2.1 time: 0.157932 Jul 31 02:26:49.659804 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3640/7316] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:49 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:50.680727 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3758adb7-af96-4305-ba67-cd2f509424f2 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:50.681353 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-3758adb7-af96-4305-ba67-cd2f509424f2 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:50.688975 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3758adb7-af96-4305-ba67-cd2f509424f2 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:50.689437 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3758adb7-af96-4305-ba67-cd2f509424f2 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:50.690216 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3758adb7-af96-4305-ba67-cd2f509424f2 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:50.690662 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-3758adb7-af96-4305-ba67-cd2f509424f2 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:50.823232 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-3758adb7-af96-4305-ba67-cd2f509424f2 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:50.830800 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3758adb7-af96-4305-ba67-cd2f509424f2 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1688 microversion: 2.1 time: 0.153965 Jul 31 02:26:50.831398 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3677/7317] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:50 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:26:51.852200 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d2323a81-44a8-4dfc-bc6a-2e3fa578dbdc tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:51.852833 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d2323a81-44a8-4dfc-bc6a-2e3fa578dbdc tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:51.860377 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2323a81-44a8-4dfc-bc6a-2e3fa578dbdc tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:51.860847 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2323a81-44a8-4dfc-bc6a-2e3fa578dbdc tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:51.861632 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2323a81-44a8-4dfc-bc6a-2e3fa578dbdc tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:51.862085 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d2323a81-44a8-4dfc-bc6a-2e3fa578dbdc tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:51.952641 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2d4a2f33-d014-413a-be01-ce12a67a03b5 req-3b59e050-29d5-424f-84ef-f18491f4ceec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b189b00c-30a5-415e-bc28-c6cb8a9dd4e9", "name": "network-vif-plugged", "status": "completed", "tag": "69a8e20f-7bb1-4511-be71-005c6026bb87"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:26:51.963672 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2d4a2f33-d014-413a-be01-ce12a67a03b5 req-3b59e050-29d5-424f-84ef-f18491f4ceec service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:51.964264 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2d4a2f33-d014-413a-be01-ce12a67a03b5 req-3b59e050-29d5-424f-84ef-f18491f4ceec service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:51.978763 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2d4a2f33-d014-413a-be01-ce12a67a03b5 req-3b59e050-29d5-424f-84ef-f18491f4ceec service nova] Creating event network-vif-plugged:69a8e20f-7bb1-4511-be71-005c6026bb87 for instance b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 on n-h2-master-1 Jul 31 02:26:51.984604 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2d4a2f33-d014-413a-be01-ce12a67a03b5 req-3b59e050-29d5-424f-84ef-f18491f4ceec service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035893 Jul 31 02:26:51.985644 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3678/7318] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:26:52.004878 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d2323a81-44a8-4dfc-bc6a-2e3fa578dbdc tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:52.012632 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d2323a81-44a8-4dfc-bc6a-2e3fa578dbdc tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1688 microversion: 2.1 time: 0.164397 Jul 31 02:26:52.013295 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3641/7319] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:51 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:53.039287 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-8786685b-b7e7-4f8b-ace9-90905925e01e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:53.040016 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-8786685b-b7e7-4f8b-ace9-90905925e01e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:53.048667 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8786685b-b7e7-4f8b-ace9-90905925e01e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:53.049132 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8786685b-b7e7-4f8b-ace9-90905925e01e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:53.049945 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8786685b-b7e7-4f8b-ace9-90905925e01e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:53.050394 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-8786685b-b7e7-4f8b-ace9-90905925e01e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:53.182862 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-8786685b-b7e7-4f8b-ace9-90905925e01e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:53.190562 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-8786685b-b7e7-4f8b-ace9-90905925e01e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1688 microversion: 2.1 time: 0.155541 Jul 31 02:26:53.191157 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3679/7320] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:53 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:26:54.212553 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9116376e-5a0d-4a59-8d9b-49acc8dc7e27 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:26:54.213102 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9116376e-5a0d-4a59-8d9b-49acc8dc7e27 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:26:54.220747 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9116376e-5a0d-4a59-8d9b-49acc8dc7e27 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:54.221212 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9116376e-5a0d-4a59-8d9b-49acc8dc7e27 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:54.221986 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9116376e-5a0d-4a59-8d9b-49acc8dc7e27 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:26:54.222436 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9116376e-5a0d-4a59-8d9b-49acc8dc7e27 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:26:54.354782 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9116376e-5a0d-4a59-8d9b-49acc8dc7e27 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:26:54.362271 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9116376e-5a0d-4a59-8d9b-49acc8dc7e27 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1675 microversion: 2.1 time: 0.153719 Jul 31 02:26:54.362835 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3642/7321] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:26:54 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:03.946235 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=15 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:28:03.947404 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=43 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:28:03.949673 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-2738841f-ea97-4825-8662-a781b4a5a823 req-f975b640-d749-4fa2-a8c0-a4775c2bba23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b189b00c-30a5-415e-bc28-c6cb8a9dd4e9", "tag": "69a8e20f-7bb1-4511-be71-005c6026bb87"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:28:03.952019 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ab5a3c7a-28b1-4604-8b8b-b73fa25d66cf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:03.952535 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ab5a3c7a-28b1-4604-8b8b-b73fa25d66cf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:03.960102 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab5a3c7a-28b1-4604-8b8b-b73fa25d66cf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:03.960570 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab5a3c7a-28b1-4604-8b8b-b73fa25d66cf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:03.961358 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab5a3c7a-28b1-4604-8b8b-b73fa25d66cf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:03.961808 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ab5a3c7a-28b1-4604-8b8b-b73fa25d66cf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:03.967875 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=13 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:28:03.969261 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=48 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:28:03.971430 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2738841f-ea97-4825-8662-a781b4a5a823 req-f975b640-d749-4fa2-a8c0-a4775c2bba23 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:03.971907 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-2738841f-ea97-4825-8662-a781b4a5a823 req-f975b640-d749-4fa2-a8c0-a4775c2bba23 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:03.984610 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-2738841f-ea97-4825-8662-a781b4a5a823 req-f975b640-d749-4fa2-a8c0-a4775c2bba23 service nova] Creating event network-changed:69a8e20f-7bb1-4511-be71-005c6026bb87 for instance b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 on n-h2-master-1 Jul 31 02:28:03.989592 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ab5a3c7a-28b1-4604-8b8b-b73fa25d66cf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Going to try to terminate instance {{(pid=119475) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:28:03.990076 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-2738841f-ea97-4825-8662-a781b4a5a823 req-f975b640-d749-4fa2-a8c0-a4775c2bba23 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044450 Jul 31 02:28:03.990902 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3643/7322] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:28:04.107420 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ab5a3c7a-28b1-4604-8b8b-b73fa25d66cf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 204 len: 0 microversion: 2.1 time: 0.163548 Jul 31 02:28:04.108051 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3680/7323] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:28:03 2022] DELETE /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:28:04.116804 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7efeb51f-14c5-41ef-a7c4-bca55eaf2498 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:04.117722 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7efeb51f-14c5-41ef-a7c4-bca55eaf2498 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:04.124245 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7efeb51f-14c5-41ef-a7c4-bca55eaf2498 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:04.125272 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7efeb51f-14c5-41ef-a7c4-bca55eaf2498 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:04.126180 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7efeb51f-14c5-41ef-a7c4-bca55eaf2498 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:04.126510 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7efeb51f-14c5-41ef-a7c4-bca55eaf2498 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:04.271364 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7efeb51f-14c5-41ef-a7c4-bca55eaf2498 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:04.279032 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7efeb51f-14c5-41ef-a7c4-bca55eaf2498 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1681 microversion: 2.1 time: 0.166476 Jul 31 02:28:04.279637 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3644/7324] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:04 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:28:05.301063 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-06c0d831-b95e-414b-89a5-cced0438368f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:05.301782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-06c0d831-b95e-414b-89a5-cced0438368f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:05.308904 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06c0d831-b95e-414b-89a5-cced0438368f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:05.309399 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06c0d831-b95e-414b-89a5-cced0438368f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:05.310226 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06c0d831-b95e-414b-89a5-cced0438368f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:05.310673 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-06c0d831-b95e-414b-89a5-cced0438368f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:05.517720 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-06c0d831-b95e-414b-89a5-cced0438368f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:05.525317 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-06c0d831-b95e-414b-89a5-cced0438368f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1681 microversion: 2.1 time: 0.228719 Jul 31 02:28:05.525896 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3681/7325] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:05 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:06.073566 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-bb70a593-3c01-4ba2-9723-54cfc5e6ac6c req-66361044-9712-4222-9528-a6fc26221d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b189b00c-30a5-415e-bc28-c6cb8a9dd4e9", "name": "network-vif-deleted", "tag": "69a8e20f-7bb1-4511-be71-005c6026bb87"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:28:06.083010 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-bb70a593-3c01-4ba2-9723-54cfc5e6ac6c req-66361044-9712-4222-9528-a6fc26221d8d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:06.083493 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-bb70a593-3c01-4ba2-9723-54cfc5e6ac6c req-66361044-9712-4222-9528-a6fc26221d8d service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:06.094350 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-bb70a593-3c01-4ba2-9723-54cfc5e6ac6c req-66361044-9712-4222-9528-a6fc26221d8d service nova] Creating event network-vif-deleted:69a8e20f-7bb1-4511-be71-005c6026bb87 for instance b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 on n-h2-master-1 Jul 31 02:28:06.099683 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-bb70a593-3c01-4ba2-9723-54cfc5e6ac6c req-66361044-9712-4222-9528-a6fc26221d8d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084528 Jul 31 02:28:06.100644 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3645/7326] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:28:06.548506 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-d74c9d39-2669-4701-bfdd-46692edf2e6d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:06.549146 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-d74c9d39-2669-4701-bfdd-46692edf2e6d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:06.556303 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d74c9d39-2669-4701-bfdd-46692edf2e6d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:06.556774 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d74c9d39-2669-4701-bfdd-46692edf2e6d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:06.557567 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d74c9d39-2669-4701-bfdd-46692edf2e6d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:06.558019 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d74c9d39-2669-4701-bfdd-46692edf2e6d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:06.588848 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d74c9d39-2669-4701-bfdd-46692edf2e6d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:06.589310 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-d74c9d39-2669-4701-bfdd-46692edf2e6d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:06.589767 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.objects.instance [None req-d74c9d39-2669-4701-bfdd-46692edf2e6d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lazy-loading 'fault' on Instance uuid b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 {{(pid=119475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:28:06.632288 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-d74c9d39-2669-4701-bfdd-46692edf2e6d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:06.639854 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-d74c9d39-2669-4701-bfdd-46692edf2e6d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 200 len: 1336 microversion: 2.1 time: 0.096331 Jul 31 02:28:06.640429 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3682/7327] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:06 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 1336 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:07.663525 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9b898596-fb04-48dd-8d06-21a4ad366fe8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:07.664274 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9b898596-fb04-48dd-8d06-21a4ad366fe8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: b189b00c-30a5-415e-bc28-c6cb8a9dd4e9] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:07.670551 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9b898596-fb04-48dd-8d06-21a4ad366fe8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:07.671018 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9b898596-fb04-48dd-8d06-21a4ad366fe8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:07.671827 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9b898596-fb04-48dd-8d06-21a4ad366fe8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:07.672794 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9b898596-fb04-48dd-8d06-21a4ad366fe8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:07.685733 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-9b898596-fb04-48dd-8d06-21a4ad366fe8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] HTTP exception thrown: Instance b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 could not be found. Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9b898596-fb04-48dd-8d06-21a4ad366fe8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Request method failure captured: Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 HTTP/1.1 Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5ee6QTqQbYUFQDNCsOCJ7YrEBxGrRdEbW-WwjH3ypXcwH-RNdSkPZ8kxoWx2o3yRSHssvlrPuO0mftfvJTlpC_KmJVQFCAcTbjAuND_RRSyjAxYcZAYfjUfhCenMkAKzmsKwCYqy42tquHUtS2D52RuyEZZvD2SWPmAh3Tn5R-yej_Y Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6b501064302f41c8997c829a6498492c Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestShelveInstance-1633452140 Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b501064302f41c8997c829a6498492c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b501064302f41c8997c829a6498492c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6b501064302f41c8997c829a6498492c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6b501064302f41c8997c829a6498492c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestShelveInstance-1633452140 Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6b501064302f41c8997c829a6498492c Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestShelveInstance-1633452140 Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestShelveInstance-1633452140-project Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 211c5ded77174ea584b85e6617e3a18c Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestShelveInstance-1633452140-project Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: exception: Instance b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 could not be found. Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': 'b189b00c-30a5-415e-bc28-c6cb8a9dd4e9'} Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 could not be found. Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 could not be found. Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:28:07.687316 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:28:07.692658 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:28:07.692658 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:28:07.692658 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:28:07.692658 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:28:07.692658 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:28:07.692658 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 could not be found. Jul 31 02:28:07.692658 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:28:07.692658 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9b898596-fb04-48dd-8d06-21a4ad366fe8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Returning 404 to user: Instance b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:28:07.692658 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9b898596-fb04-48dd-8d06-21a4ad366fe8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9" status: 404 len: 111 microversion: 2.1 time: 0.031030 Jul 31 02:28:07.692658 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3646/7328] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:07 2022] GET /compute/v2.1/servers/b189b00c-30a5-415e-bc28-c6cb8a9dd4e9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:28:07.856305 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-3ad20d63-3a30-4cf5-9aa6-32437e83ef4a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '.version_select at 0x7fede455b0d0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:07.880962 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-3ad20d63-3a30-4cf5-9aa6-32437e83ef4a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-110092104" status: 202 len: 0 microversion: 2.1 time: 0.028429 Jul 31 02:28:07.881629 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3683/7329] 10.222.0.45 () {58 vars in 1251 bytes} [Sun Jul 31 02:28:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-110092104 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:28:07.903853 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-10549b83-31c4-4716-9e3a-b3fdebe20460 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Action: 'create', calling method: .version_select at 0x7fede4180430>, body: {"keypair": {"name": "tempest-TestShelveInstance-2041283203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn3wc9rbn4+tvSfwiyf2YXiWTwVx/0sQV4Xs/Vr8oejd4GaV602ZM1Oj94i6UT+4AYmKG29nfV16s8y859qTn+QMM5BcvKrZYzDmi9ufGjW5oetpRJWYu4HpJii3qEsEg=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:28:07.919653 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-10549b83-31c4-4716-9e3a-b3fdebe20460 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Getting quotas for project 6b501064302f41c8997c829a6498492c. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:28:07.925417 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-10549b83-31c4-4716-9e3a-b3fdebe20460 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Getting quotas for user 211c5ded77174ea584b85e6617e3a18c and project 6b501064302f41c8997c829a6498492c. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:28:07.948242 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-10549b83-31c4-4716-9e3a-b3fdebe20460 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.048470 Jul 31 02:28:07.948862 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3647/7330] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 02:28:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:28:24.089813 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-80b86ba1-6f96-4646-a227-88f87f30ebfb tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1508810874", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2041283203", "security_groups": [{"name": "tempest-secgroup-smoke-255641297"}], "networks": [{"uuid": "bf4ff582-a746-4a40-aeb4-9eb71e2f6f11"}], "block_device_mapping_v2": [{"uuid": "1e652e59-fd05-42fc-8fdd-a910d4c1cf06", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:28:24.100831 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:28:24.101484 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:28:24.204948 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-80b86ba1-6f96-4646-a227-88f87f30ebfb tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] validate_networks() for [('bf4ff582-a746-4a40-aeb4-9eb71e2f6f11', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:28:24.882406 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-80b86ba1-6f96-4646-a227-88f87f30ebfb tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:28:24.882843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-80b86ba1-6f96-4646-a227-88f87f30ebfb tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:28:24.883329 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-80b86ba1-6f96-4646-a227-88f87f30ebfb tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:28:24.883816 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-80b86ba1-6f96-4646-a227-88f87f30ebfb tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:28:24.884242 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-80b86ba1-6f96-4646-a227-88f87f30ebfb tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:28:24.893381 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80b86ba1-6f96-4646-a227-88f87f30ebfb tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:24.893877 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80b86ba1-6f96-4646-a227-88f87f30ebfb tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:24.894696 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80b86ba1-6f96-4646-a227-88f87f30ebfb tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:24.895146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-80b86ba1-6f96-4646-a227-88f87f30ebfb tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:24.912564 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-80b86ba1-6f96-4646-a227-88f87f30ebfb tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Getting quotas for project 6b501064302f41c8997c829a6498492c. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:28:24.917813 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-80b86ba1-6f96-4646-a227-88f87f30ebfb tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Getting quotas for user 211c5ded77174ea584b85e6617e3a18c and project 6b501064302f41c8997c829a6498492c. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:28:24.976281 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-80b86ba1-6f96-4646-a227-88f87f30ebfb tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:28:24.978420 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-80b86ba1-6f96-4646-a227-88f87f30ebfb tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e652e59-fd05-42fc-8fdd-a910d4c1cf06',volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:28:25.106085 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-80b86ba1-6f96-4646-a227-88f87f30ebfb tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.020310 Jul 31 02:28:25.106771 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3684/7331] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:28:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:28:25.116227 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=12 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:28:25.117340 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:28:25.118125 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:28:25.123483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-141208da-24eb-4388-8233-7604c766eb73 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:25.124116 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-141208da-24eb-4388-8233-7604c766eb73 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:25.183112 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-141208da-24eb-4388-8233-7604c766eb73 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:25.189937 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-141208da-24eb-4388-8233-7604c766eb73 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1089 microversion: 2.1 time: 0.075539 Jul 31 02:28:25.190501 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3648/7332] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:25 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:26.211023 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-39469492-b658-4264-9f08-04e09db5de86 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:26.211701 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-39469492-b658-4264-9f08-04e09db5de86 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:26.263776 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-39469492-b658-4264-9f08-04e09db5de86 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:26.270953 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-39469492-b658-4264-9f08-04e09db5de86 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1089 microversion: 2.1 time: 0.064644 Jul 31 02:28:26.271559 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3685/7333] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:26 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:27.292222 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-dc189e9e-4b52-4a5b-943e-ad6595777c65 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:27.292864 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-dc189e9e-4b52-4a5b-943e-ad6595777c65 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:27.346768 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-dc189e9e-4b52-4a5b-943e-ad6595777c65 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:27.353906 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-dc189e9e-4b52-4a5b-943e-ad6595777c65 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1089 microversion: 2.1 time: 0.065925 Jul 31 02:28:27.354489 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3649/7334] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:27 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:28.376028 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e0e10a57-9792-4568-a694-fcc4d083fea8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:28.379493 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e0e10a57-9792-4568-a694-fcc4d083fea8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:28.433200 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e0e10a57-9792-4568-a694-fcc4d083fea8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:28.440016 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e0e10a57-9792-4568-a694-fcc4d083fea8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1089 microversion: 2.1 time: 0.068349 Jul 31 02:28:28.440812 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3686/7335] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:28 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:29.461483 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e2fddb85-4546-4408-9153-980a0da1b7cd tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:29.462105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e2fddb85-4546-4408-9153-980a0da1b7cd tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:29.469674 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2fddb85-4546-4408-9153-980a0da1b7cd tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:29.470135 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2fddb85-4546-4408-9153-980a0da1b7cd tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:29.470898 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2fddb85-4546-4408-9153-980a0da1b7cd tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:29.471366 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e2fddb85-4546-4408-9153-980a0da1b7cd tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:29.533533 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e2fddb85-4546-4408-9153-980a0da1b7cd tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:29.540866 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e2fddb85-4546-4408-9153-980a0da1b7cd tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1139 microversion: 2.1 time: 0.083289 Jul 31 02:28:29.541428 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3650/7336] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:29 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:30.567005 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-27b46043-a9ad-4579-9c43-9e11ee4b0a68 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:30.573998 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-27b46043-a9ad-4579-9c43-9e11ee4b0a68 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:30.582237 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27b46043-a9ad-4579-9c43-9e11ee4b0a68 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:30.582699 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27b46043-a9ad-4579-9c43-9e11ee4b0a68 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:30.583973 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27b46043-a9ad-4579-9c43-9e11ee4b0a68 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:30.584415 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-27b46043-a9ad-4579-9c43-9e11ee4b0a68 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:30.648782 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-27b46043-a9ad-4579-9c43-9e11ee4b0a68 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:30.656660 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-27b46043-a9ad-4579-9c43-9e11ee4b0a68 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1205 microversion: 2.1 time: 0.098206 Jul 31 02:28:30.657246 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3687/7337] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:30 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1205 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:31.457443 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e5856b88-aa53-43a8-b18a-ac2fe312b1c2 req-3b3b658f-33f0-4c84-b030-a706dbc949cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d15613c-c3b8-45b2-8da9-347ef8762a2d", "tag": "e7450ea0-a06d-447a-8e9f-5fd7af5f2acc"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:28:31.470959 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e5856b88-aa53-43a8-b18a-ac2fe312b1c2 req-3b3b658f-33f0-4c84-b030-a706dbc949cf service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:31.471599 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e5856b88-aa53-43a8-b18a-ac2fe312b1c2 req-3b3b658f-33f0-4c84-b030-a706dbc949cf service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:31.485690 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e5856b88-aa53-43a8-b18a-ac2fe312b1c2 req-3b3b658f-33f0-4c84-b030-a706dbc949cf service nova] Creating event network-changed:e7450ea0-a06d-447a-8e9f-5fd7af5f2acc for instance 3d15613c-c3b8-45b2-8da9-347ef8762a2d on n-h1-master-1 Jul 31 02:28:31.491060 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e5856b88-aa53-43a8-b18a-ac2fe312b1c2 req-3b3b658f-33f0-4c84-b030-a706dbc949cf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038700 Jul 31 02:28:31.492204 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3651/7338] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:28:31.678035 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7ba2d4ad-251e-4482-bbb5-56eec245cf9e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:31.678800 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7ba2d4ad-251e-4482-bbb5-56eec245cf9e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:31.686154 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ba2d4ad-251e-4482-bbb5-56eec245cf9e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:31.686878 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ba2d4ad-251e-4482-bbb5-56eec245cf9e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:31.687750 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ba2d4ad-251e-4482-bbb5-56eec245cf9e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:31.688807 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7ba2d4ad-251e-4482-bbb5-56eec245cf9e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:31.834284 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7ba2d4ad-251e-4482-bbb5-56eec245cf9e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:31.842161 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7ba2d4ad-251e-4482-bbb5-56eec245cf9e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1272 microversion: 2.1 time: 0.168135 Jul 31 02:28:31.842742 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3688/7339] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:31 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:32.865174 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-93ece03c-4f3d-492e-8f2d-4fde69dbf1b0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:32.865862 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-93ece03c-4f3d-492e-8f2d-4fde69dbf1b0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:32.872248 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93ece03c-4f3d-492e-8f2d-4fde69dbf1b0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:32.872720 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93ece03c-4f3d-492e-8f2d-4fde69dbf1b0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:32.873501 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93ece03c-4f3d-492e-8f2d-4fde69dbf1b0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:32.873949 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-93ece03c-4f3d-492e-8f2d-4fde69dbf1b0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:33.013614 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-93ece03c-4f3d-492e-8f2d-4fde69dbf1b0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:33.021926 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-93ece03c-4f3d-492e-8f2d-4fde69dbf1b0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1272 microversion: 2.1 time: 0.162553 Jul 31 02:28:33.022520 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3652/7340] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:32 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:34.044415 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-59ef1b56-c99c-471a-906c-347e3e14b760 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:34.045054 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-59ef1b56-c99c-471a-906c-347e3e14b760 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:34.053149 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-59ef1b56-c99c-471a-906c-347e3e14b760 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:34.053618 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-59ef1b56-c99c-471a-906c-347e3e14b760 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:34.054417 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-59ef1b56-c99c-471a-906c-347e3e14b760 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:34.054867 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-59ef1b56-c99c-471a-906c-347e3e14b760 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:34.196141 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-59ef1b56-c99c-471a-906c-347e3e14b760 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:34.203997 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-59ef1b56-c99c-471a-906c-347e3e14b760 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1272 microversion: 2.1 time: 0.163607 Jul 31 02:28:34.204637 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3689/7341] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:34 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:35.224988 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fdbc31a9-43e3-41e7-b28a-8b068def7bc9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:35.225503 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fdbc31a9-43e3-41e7-b28a-8b068def7bc9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:35.232344 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdbc31a9-43e3-41e7-b28a-8b068def7bc9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:35.232811 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdbc31a9-43e3-41e7-b28a-8b068def7bc9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:35.233588 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdbc31a9-43e3-41e7-b28a-8b068def7bc9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:35.238332 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdbc31a9-43e3-41e7-b28a-8b068def7bc9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:35.372575 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fdbc31a9-43e3-41e7-b28a-8b068def7bc9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:35.380653 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fdbc31a9-43e3-41e7-b28a-8b068def7bc9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1260 microversion: 2.1 time: 0.159726 Jul 31 02:28:35.381236 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3653/7342] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:35 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:36.402119 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-45098b1a-3d66-458e-bb2e-172a84d0b96e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:36.402658 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-45098b1a-3d66-458e-bb2e-172a84d0b96e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:36.404536 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:28:36.411179 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45098b1a-3d66-458e-bb2e-172a84d0b96e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:36.411682 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45098b1a-3d66-458e-bb2e-172a84d0b96e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:36.412480 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45098b1a-3d66-458e-bb2e-172a84d0b96e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:36.412935 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-45098b1a-3d66-458e-bb2e-172a84d0b96e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:36.546314 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-45098b1a-3d66-458e-bb2e-172a84d0b96e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:36.553971 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-45098b1a-3d66-458e-bb2e-172a84d0b96e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1260 microversion: 2.1 time: 0.155842 Jul 31 02:28:36.554555 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3690/7343] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:36 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:37.575636 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-acb1b566-e0da-4af6-a86f-09d6700c17dc tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:37.576275 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-acb1b566-e0da-4af6-a86f-09d6700c17dc tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:37.579631 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=4 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:28:37.585236 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-acb1b566-e0da-4af6-a86f-09d6700c17dc tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:37.585707 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-acb1b566-e0da-4af6-a86f-09d6700c17dc tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:37.586512 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-acb1b566-e0da-4af6-a86f-09d6700c17dc tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:37.586950 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-acb1b566-e0da-4af6-a86f-09d6700c17dc tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:37.716400 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-acb1b566-e0da-4af6-a86f-09d6700c17dc tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:37.724557 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-acb1b566-e0da-4af6-a86f-09d6700c17dc tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1260 microversion: 2.1 time: 0.152849 Jul 31 02:28:37.725162 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3654/7344] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:37 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:38.745634 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-dc478737-8a31-4080-81a7-01e41e7ffd99 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:38.746195 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-dc478737-8a31-4080-81a7-01e41e7ffd99 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:38.748886 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=10 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:28:38.754643 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc478737-8a31-4080-81a7-01e41e7ffd99 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:38.755109 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc478737-8a31-4080-81a7-01e41e7ffd99 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:38.755916 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc478737-8a31-4080-81a7-01e41e7ffd99 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:38.756364 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-dc478737-8a31-4080-81a7-01e41e7ffd99 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:38.893099 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-dc478737-8a31-4080-81a7-01e41e7ffd99 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:38.901421 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-dc478737-8a31-4080-81a7-01e41e7ffd99 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1260 microversion: 2.1 time: 0.159792 Jul 31 02:28:38.902146 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3691/7345] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:38 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:39.922765 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-6e59a03e-24ad-4865-90fb-b8b500973b9f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:39.923325 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-6e59a03e-24ad-4865-90fb-b8b500973b9f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:39.930317 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e59a03e-24ad-4865-90fb-b8b500973b9f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:39.930788 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e59a03e-24ad-4865-90fb-b8b500973b9f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:39.931618 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e59a03e-24ad-4865-90fb-b8b500973b9f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:39.932076 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-6e59a03e-24ad-4865-90fb-b8b500973b9f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:40.062298 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-6e59a03e-24ad-4865-90fb-b8b500973b9f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:40.069776 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-6e59a03e-24ad-4865-90fb-b8b500973b9f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1260 microversion: 2.1 time: 0.151552 Jul 31 02:28:40.070351 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3655/7346] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:39 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:41.094443 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7958f3f3-aa92-4559-b580-6b798e6849d9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:41.095081 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7958f3f3-aa92-4559-b580-6b798e6849d9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:41.101198 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7958f3f3-aa92-4559-b580-6b798e6849d9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:41.101687 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7958f3f3-aa92-4559-b580-6b798e6849d9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:41.102461 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7958f3f3-aa92-4559-b580-6b798e6849d9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:41.102908 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-7958f3f3-aa92-4559-b580-6b798e6849d9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:41.237977 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7958f3f3-aa92-4559-b580-6b798e6849d9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:41.245510 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7958f3f3-aa92-4559-b580-6b798e6849d9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1260 microversion: 2.1 time: 0.155385 Jul 31 02:28:41.246106 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3692/7347] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:41 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:42.267955 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-32ee61d4-057b-4074-9519-bbdefc99a6fa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:42.268614 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-32ee61d4-057b-4074-9519-bbdefc99a6fa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:42.275592 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-32ee61d4-057b-4074-9519-bbdefc99a6fa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:42.276057 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-32ee61d4-057b-4074-9519-bbdefc99a6fa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:42.276838 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-32ee61d4-057b-4074-9519-bbdefc99a6fa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:42.277293 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-32ee61d4-057b-4074-9519-bbdefc99a6fa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:42.409545 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-32ee61d4-057b-4074-9519-bbdefc99a6fa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:42.417086 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-32ee61d4-057b-4074-9519-bbdefc99a6fa tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1260 microversion: 2.1 time: 0.153717 Jul 31 02:28:42.417648 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3656/7348] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:42 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:43.438481 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c3df9d77-c204-4784-91b3-d220a048fe54 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:43.439112 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c3df9d77-c204-4784-91b3-d220a048fe54 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:43.446332 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3df9d77-c204-4784-91b3-d220a048fe54 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:43.446796 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3df9d77-c204-4784-91b3-d220a048fe54 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:43.447607 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3df9d77-c204-4784-91b3-d220a048fe54 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:43.448057 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c3df9d77-c204-4784-91b3-d220a048fe54 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:43.581204 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c3df9d77-c204-4784-91b3-d220a048fe54 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:43.589006 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c3df9d77-c204-4784-91b3-d220a048fe54 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1260 microversion: 2.1 time: 0.154686 Jul 31 02:28:43.589596 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3693/7349] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:43 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:44.611456 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f6e3419f-64ea-4537-af93-291893a70d83 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:44.612085 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f6e3419f-64ea-4537-af93-291893a70d83 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:44.619051 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6e3419f-64ea-4537-af93-291893a70d83 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:44.619557 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6e3419f-64ea-4537-af93-291893a70d83 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:44.620341 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6e3419f-64ea-4537-af93-291893a70d83 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:44.620805 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f6e3419f-64ea-4537-af93-291893a70d83 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:44.758744 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f6e3419f-64ea-4537-af93-291893a70d83 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:44.766222 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f6e3419f-64ea-4537-af93-291893a70d83 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1260 microversion: 2.1 time: 0.159349 Jul 31 02:28:44.766786 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3657/7350] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:44 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:45.695361 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-d4134480-d7f3-4d7a-9321-ab793e2daff9 req-32cf7b04-b633-4c29-be8c-c470223835ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d15613c-c3b8-45b2-8da9-347ef8762a2d", "name": "network-vif-plugged", "status": "completed", "tag": "e7450ea0-a06d-447a-8e9f-5fd7af5f2acc"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:28:45.707983 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d4134480-d7f3-4d7a-9321-ab793e2daff9 req-32cf7b04-b633-4c29-be8c-c470223835ce service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:45.708462 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-d4134480-d7f3-4d7a-9321-ab793e2daff9 req-32cf7b04-b633-4c29-be8c-c470223835ce service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:45.719877 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-d4134480-d7f3-4d7a-9321-ab793e2daff9 req-32cf7b04-b633-4c29-be8c-c470223835ce service nova] Creating event network-vif-plugged:e7450ea0-a06d-447a-8e9f-5fd7af5f2acc for instance 3d15613c-c3b8-45b2-8da9-347ef8762a2d on n-h1-master-1 Jul 31 02:28:45.724904 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-d4134480-d7f3-4d7a-9321-ab793e2daff9 req-32cf7b04-b633-4c29-be8c-c470223835ce service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099149 Jul 31 02:28:45.725540 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3694/7351] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:28:45.788636 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-166772e9-cf14-4614-a4f0-22796dc02194 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:45.789284 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-166772e9-cf14-4614-a4f0-22796dc02194 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:45.796560 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-166772e9-cf14-4614-a4f0-22796dc02194 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:45.797024 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-166772e9-cf14-4614-a4f0-22796dc02194 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:45.798315 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-166772e9-cf14-4614-a4f0-22796dc02194 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:45.798769 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-166772e9-cf14-4614-a4f0-22796dc02194 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:45.934891 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-166772e9-cf14-4614-a4f0-22796dc02194 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:45.943166 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-166772e9-cf14-4614-a4f0-22796dc02194 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1260 microversion: 2.1 time: 0.158526 Jul 31 02:28:45.943892 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3658/7352] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:45 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:46.964898 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5c577e2c-a2d2-4549-847b-3f368692087f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:46.965607 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5c577e2c-a2d2-4549-847b-3f368692087f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:46.973437 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c577e2c-a2d2-4549-847b-3f368692087f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:46.973902 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c577e2c-a2d2-4549-847b-3f368692087f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:46.974681 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c577e2c-a2d2-4549-847b-3f368692087f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:46.975123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5c577e2c-a2d2-4549-847b-3f368692087f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:47.114706 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-5c577e2c-a2d2-4549-847b-3f368692087f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:47.122301 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5c577e2c-a2d2-4549-847b-3f368692087f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1444 microversion: 2.1 time: 0.161673 Jul 31 02:28:47.122872 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3695/7353] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:46 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:47.143035 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-41b6f619-32c0-4052-a97e-c641d30f9166 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:28:47.143701 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-41b6f619-32c0-4052-a97e-c641d30f9166 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:28:47.150443 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41b6f619-32c0-4052-a97e-c641d30f9166 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:47.150908 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41b6f619-32c0-4052-a97e-c641d30f9166 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:47.152052 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41b6f619-32c0-4052-a97e-c641d30f9166 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:47.152516 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-41b6f619-32c0-4052-a97e-c641d30f9166 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:47.280327 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-41b6f619-32c0-4052-a97e-c641d30f9166 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:28:47.288434 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-41b6f619-32c0-4052-a97e-c641d30f9166 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1444 microversion: 2.1 time: 0.149691 Jul 31 02:28:47.289013 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3659/7354] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:28:47 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1444 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:28:48.873187 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-45870efd-4eab-4294-8fbd-9678f87f2c7b req-f231c8d9-2dda-4c6c-bb37-363759007c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d15613c-c3b8-45b2-8da9-347ef8762a2d", "tag": "e7450ea0-a06d-447a-8e9f-5fd7af5f2acc"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:28:48.885025 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-45870efd-4eab-4294-8fbd-9678f87f2c7b req-f231c8d9-2dda-4c6c-bb37-363759007c2e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:28:48.885498 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-45870efd-4eab-4294-8fbd-9678f87f2c7b req-f231c8d9-2dda-4c6c-bb37-363759007c2e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:28:48.897384 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-45870efd-4eab-4294-8fbd-9678f87f2c7b req-f231c8d9-2dda-4c6c-bb37-363759007c2e service nova] Creating event network-changed:e7450ea0-a06d-447a-8e9f-5fd7af5f2acc for instance 3d15613c-c3b8-45b2-8da9-347ef8762a2d on n-h1-master-1 Jul 31 02:28:48.902649 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-45870efd-4eab-4294-8fbd-9678f87f2c7b req-f231c8d9-2dda-4c6c-bb37-363759007c2e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033224 Jul 31 02:28:48.903256 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3696/7355] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:29:19.147091 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:29:19.147785 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 02:29:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:30:46.093911 n-d-master-1 devstack@n-api.service[119474]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8060e32b-511a-408f-bb92-dd5077e59ac2] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 31 02:30:46.094888 n-d-master-1 devstack@n-api.service[119474]: ERROR oslo.messaging._drivers.impl_rabbit [-] [161f59ee-e913-4622-b753-eac5ec38d240] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 31 02:30:46.095527 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=28 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:30:46.096318 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=56 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:30:46.156981 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b9f155a8-c84b-4ac1-90a1-62e62cd79b73 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:30:46.157539 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b9f155a8-c84b-4ac1-90a1-62e62cd79b73 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:30:46.164067 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9f155a8-c84b-4ac1-90a1-62e62cd79b73 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:46.164530 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9f155a8-c84b-4ac1-90a1-62e62cd79b73 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:46.165310 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9f155a8-c84b-4ac1-90a1-62e62cd79b73 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:46.165757 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9f155a8-c84b-4ac1-90a1-62e62cd79b73 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:46.189462 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-b9f155a8-c84b-4ac1-90a1-62e62cd79b73 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lazy-loading 'flavor' on Instance uuid 3d15613c-c3b8-45b2-8da9-347ef8762a2d {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:30:46.260651 n-d-master-1 devstack@n-api.service[119474]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b9f155a8-c84b-4ac1-90a1-62e62cd79b73 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [253d2950-c08b-4c57-b89e-75459e24b9dd] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 31 02:30:47.104195 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] [8060e32b-511a-408f-bb92-dd5077e59ac2] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41154. Jul 31 02:30:47.106927 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] [161f59ee-e913-4622-b753-eac5ec38d240] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41156. Jul 31 02:30:47.268413 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [None req-b9f155a8-c84b-4ac1-90a1-62e62cd79b73 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [253d2950-c08b-4c57-b89e-75459e24b9dd] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41158. Jul 31 02:30:47.271822 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b9f155a8-c84b-4ac1-90a1-62e62cd79b73 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "POST /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d/action" status: 202 len: 0 microversion: 2.1 time: 1.184343 Jul 31 02:30:47.272432 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3660/7356] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:30:46 2022] POST /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d/action => generated 0 bytes in 1186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:30:47.278870 n-d-master-1 devstack@n-api.service[119475]: ERROR oslo.messaging._drivers.impl_rabbit [-] [189acb91-3d4b-44e7-81c9-7fd59a69a406] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 31 02:30:47.279723 n-d-master-1 devstack@n-api.service[119475]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ce818dc8-5b17-41f1-bd07-761ee808087c] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 31 02:30:47.280356 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:30:47.281106 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=54 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:30:47.286181 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-607d79cc-4994-4527-a297-19992ee45f42 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:30:47.286898 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-607d79cc-4994-4527-a297-19992ee45f42 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:30:47.296103 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-607d79cc-4994-4527-a297-19992ee45f42 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:47.296571 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-607d79cc-4994-4527-a297-19992ee45f42 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:47.297356 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-607d79cc-4994-4527-a297-19992ee45f42 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:47.297836 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-607d79cc-4994-4527-a297-19992ee45f42 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:47.431680 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-607d79cc-4994-4527-a297-19992ee45f42 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:30:47.440504 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-607d79cc-4994-4527-a297-19992ee45f42 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1569 microversion: 2.1 time: 0.163589 Jul 31 02:30:47.441083 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3697/7357] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:30:47 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:30:48.463625 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-74f8657a-83a6-4f78-a67f-a9667aa97a4f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:30:48.465713 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-74f8657a-83a6-4f78-a67f-a9667aa97a4f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:30:48.471986 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74f8657a-83a6-4f78-a67f-a9667aa97a4f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:48.472446 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74f8657a-83a6-4f78-a67f-a9667aa97a4f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:48.473211 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74f8657a-83a6-4f78-a67f-a9667aa97a4f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:48.473658 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-74f8657a-83a6-4f78-a67f-a9667aa97a4f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:48.610665 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-74f8657a-83a6-4f78-a67f-a9667aa97a4f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:30:48.618236 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-74f8657a-83a6-4f78-a67f-a9667aa97a4f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1569 microversion: 2.1 time: 0.159784 Jul 31 02:30:48.618802 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3661/7358] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:30:48 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:30:49.640010 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-82043e5d-d66d-4d4d-a858-34623e51c1c4 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:30:49.640635 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-82043e5d-d66d-4d4d-a858-34623e51c1c4 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:30:49.650397 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-82043e5d-d66d-4d4d-a858-34623e51c1c4 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:49.650787 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-82043e5d-d66d-4d4d-a858-34623e51c1c4 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:49.651592 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-82043e5d-d66d-4d4d-a858-34623e51c1c4 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:49.652035 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-82043e5d-d66d-4d4d-a858-34623e51c1c4 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:49.658887 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] [ce818dc8-5b17-41f1-bd07-761ee808087c] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41172. Jul 31 02:30:49.659732 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] [189acb91-3d4b-44e7-81c9-7fd59a69a406] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41170. Jul 31 02:30:49.786639 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-82043e5d-d66d-4d4d-a858-34623e51c1c4 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:30:49.795050 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-82043e5d-d66d-4d4d-a858-34623e51c1c4 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1569 microversion: 2.1 time: 0.158903 Jul 31 02:30:49.795657 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3698/7359] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:30:49 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:30:50.816824 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f96f2f19-77c7-464f-8936-a67274397a1d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:30:50.817415 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f96f2f19-77c7-464f-8936-a67274397a1d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:30:50.825296 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f96f2f19-77c7-464f-8936-a67274397a1d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:50.825766 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f96f2f19-77c7-464f-8936-a67274397a1d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:50.826579 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f96f2f19-77c7-464f-8936-a67274397a1d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:50.827032 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f96f2f19-77c7-464f-8936-a67274397a1d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:50.963064 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f96f2f19-77c7-464f-8936-a67274397a1d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:30:50.971278 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f96f2f19-77c7-464f-8936-a67274397a1d tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1569 microversion: 2.1 time: 0.158460 Jul 31 02:30:50.971871 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3662/7360] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:30:50 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:30:51.993672 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cae12bcf-5e45-475a-ba77-659df8dc4a6f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:30:51.994234 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cae12bcf-5e45-475a-ba77-659df8dc4a6f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:30:52.002298 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cae12bcf-5e45-475a-ba77-659df8dc4a6f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:52.002762 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cae12bcf-5e45-475a-ba77-659df8dc4a6f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:52.003587 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cae12bcf-5e45-475a-ba77-659df8dc4a6f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:52.004079 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cae12bcf-5e45-475a-ba77-659df8dc4a6f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:52.136961 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cae12bcf-5e45-475a-ba77-659df8dc4a6f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:30:52.144496 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cae12bcf-5e45-475a-ba77-659df8dc4a6f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1569 microversion: 2.1 time: 0.154905 Jul 31 02:30:52.145078 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3699/7361] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:30:51 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:30:53.165927 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-5a3911f5-69a5-43d3-9668-559b8816ea08 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:30:53.166468 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-5a3911f5-69a5-43d3-9668-559b8816ea08 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:30:53.173395 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a3911f5-69a5-43d3-9668-559b8816ea08 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:53.173857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a3911f5-69a5-43d3-9668-559b8816ea08 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:53.174621 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a3911f5-69a5-43d3-9668-559b8816ea08 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:53.175066 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-5a3911f5-69a5-43d3-9668-559b8816ea08 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:53.312263 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-5a3911f5-69a5-43d3-9668-559b8816ea08 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:30:53.319643 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-5a3911f5-69a5-43d3-9668-559b8816ea08 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1569 microversion: 2.1 time: 0.157674 Jul 31 02:30:53.320200 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3663/7362] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:30:53 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:30:54.342856 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0f8118f9-27c0-43c1-8222-c1b5273a3093 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:30:54.343537 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0f8118f9-27c0-43c1-8222-c1b5273a3093 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:30:54.350363 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f8118f9-27c0-43c1-8222-c1b5273a3093 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:54.350850 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f8118f9-27c0-43c1-8222-c1b5273a3093 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:54.351655 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f8118f9-27c0-43c1-8222-c1b5273a3093 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:54.352103 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0f8118f9-27c0-43c1-8222-c1b5273a3093 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:54.485124 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0f8118f9-27c0-43c1-8222-c1b5273a3093 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:30:54.492746 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0f8118f9-27c0-43c1-8222-c1b5273a3093 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1569 microversion: 2.1 time: 0.154697 Jul 31 02:30:54.493326 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3700/7363] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:30:54 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:30:55.515093 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-9a204349-f0a3-49ec-ae0c-9fbef2c14e45 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:30:55.515751 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-9a204349-f0a3-49ec-ae0c-9fbef2c14e45 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:30:55.522632 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a204349-f0a3-49ec-ae0c-9fbef2c14e45 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:55.523098 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a204349-f0a3-49ec-ae0c-9fbef2c14e45 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:55.523912 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a204349-f0a3-49ec-ae0c-9fbef2c14e45 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:55.524364 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-9a204349-f0a3-49ec-ae0c-9fbef2c14e45 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:55.662905 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-9a204349-f0a3-49ec-ae0c-9fbef2c14e45 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:30:55.670845 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-9a204349-f0a3-49ec-ae0c-9fbef2c14e45 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1569 microversion: 2.1 time: 0.160287 Jul 31 02:30:55.671452 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3664/7364] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:30:55 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:30:56.692366 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-17858960-bb5d-4e67-8eac-0b89466b1d00 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:30:56.692996 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-17858960-bb5d-4e67-8eac-0b89466b1d00 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:30:56.699908 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17858960-bb5d-4e67-8eac-0b89466b1d00 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:56.700367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17858960-bb5d-4e67-8eac-0b89466b1d00 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:56.701647 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17858960-bb5d-4e67-8eac-0b89466b1d00 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:56.702089 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-17858960-bb5d-4e67-8eac-0b89466b1d00 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:56.836264 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-17858960-bb5d-4e67-8eac-0b89466b1d00 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:30:56.844445 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-17858960-bb5d-4e67-8eac-0b89466b1d00 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1569 microversion: 2.1 time: 0.155967 Jul 31 02:30:56.845020 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3701/7365] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:30:56 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:30:57.865958 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-ce2e4628-9e42-4be1-a595-ac5d0c4299c9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:30:57.866582 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-ce2e4628-9e42-4be1-a595-ac5d0c4299c9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:30:57.873622 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce2e4628-9e42-4be1-a595-ac5d0c4299c9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:57.874084 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce2e4628-9e42-4be1-a595-ac5d0c4299c9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:57.874865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce2e4628-9e42-4be1-a595-ac5d0c4299c9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:57.875604 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-ce2e4628-9e42-4be1-a595-ac5d0c4299c9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:58.008541 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-ce2e4628-9e42-4be1-a595-ac5d0c4299c9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:30:58.016902 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-ce2e4628-9e42-4be1-a595-ac5d0c4299c9 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1569 microversion: 2.1 time: 0.154819 Jul 31 02:30:58.017478 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3665/7366] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:30:57 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:30:59.038203 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-69a70fb7-97d8-48ad-9842-66331c9c7880 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:30:59.038757 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-69a70fb7-97d8-48ad-9842-66331c9c7880 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:30:59.045710 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69a70fb7-97d8-48ad-9842-66331c9c7880 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:59.046170 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69a70fb7-97d8-48ad-9842-66331c9c7880 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:59.046939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69a70fb7-97d8-48ad-9842-66331c9c7880 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:30:59.047408 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-69a70fb7-97d8-48ad-9842-66331c9c7880 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:30:59.140017 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:30:59.140504 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 02:30:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:30:59.180823 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-69a70fb7-97d8-48ad-9842-66331c9c7880 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:30:59.188945 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-69a70fb7-97d8-48ad-9842-66331c9c7880 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1569 microversion: 2.1 time: 0.154758 Jul 31 02:30:59.189524 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3702/7367] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:30:59 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:30:59.407836 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:30:59.408010 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 02:30:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:30:59.420958 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:30:59.421093 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 02:30:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:31:00.210078 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d7a9af81-83c6-4643-a273-dec9a4f6b3b5 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:00.210720 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d7a9af81-83c6-4643-a273-dec9a4f6b3b5 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:00.217832 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7a9af81-83c6-4643-a273-dec9a4f6b3b5 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:00.218304 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7a9af81-83c6-4643-a273-dec9a4f6b3b5 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:00.219095 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7a9af81-83c6-4643-a273-dec9a4f6b3b5 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:00.219575 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d7a9af81-83c6-4643-a273-dec9a4f6b3b5 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:00.353764 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d7a9af81-83c6-4643-a273-dec9a4f6b3b5 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:00.362245 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d7a9af81-83c6-4643-a273-dec9a4f6b3b5 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1569 microversion: 2.1 time: 0.155987 Jul 31 02:31:00.362828 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3666/7368] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:00 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:01.384563 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ac709dc2-8d3d-4ee9-941f-90c5ac15c40a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:01.385187 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ac709dc2-8d3d-4ee9-941f-90c5ac15c40a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:01.393858 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac709dc2-8d3d-4ee9-941f-90c5ac15c40a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:01.394314 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac709dc2-8d3d-4ee9-941f-90c5ac15c40a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:01.395097 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac709dc2-8d3d-4ee9-941f-90c5ac15c40a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:01.395605 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ac709dc2-8d3d-4ee9-941f-90c5ac15c40a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:01.527703 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ac709dc2-8d3d-4ee9-941f-90c5ac15c40a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:01.535552 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ac709dc2-8d3d-4ee9-941f-90c5ac15c40a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1570 microversion: 2.1 time: 0.154777 Jul 31 02:31:01.536142 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3703/7369] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:01 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:01.556371 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1da58521-7c96-4c73-8bb0-a8304d6d01ed tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:31:01.556984 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1da58521-7c96-4c73-8bb0-a8304d6d01ed tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:01.564883 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1da58521-7c96-4c73-8bb0-a8304d6d01ed tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:01.565355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1da58521-7c96-4c73-8bb0-a8304d6d01ed tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:01.566150 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1da58521-7c96-4c73-8bb0-a8304d6d01ed tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:01.567014 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1da58521-7c96-4c73-8bb0-a8304d6d01ed tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:01.596292 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1da58521-7c96-4c73-8bb0-a8304d6d01ed tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119474) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 31 02:31:01.665203 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1da58521-7c96-4c73-8bb0-a8304d6d01ed tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "POST /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d/action" status: 202 len: 0 microversion: 2.1 time: 0.112667 Jul 31 02:31:01.669210 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3667/7370] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:31:01 2022] POST /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:31:01.678496 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0e666174-93d8-4b95-9350-1503bd589c16 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:01.679132 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0e666174-93d8-4b95-9350-1503bd589c16 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:01.687145 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e666174-93d8-4b95-9350-1503bd589c16 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:01.688943 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e666174-93d8-4b95-9350-1503bd589c16 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:01.690105 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e666174-93d8-4b95-9350-1503bd589c16 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:01.690787 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0e666174-93d8-4b95-9350-1503bd589c16 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:01.837013 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0e666174-93d8-4b95-9350-1503bd589c16 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:01.844603 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0e666174-93d8-4b95-9350-1503bd589c16 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1518 microversion: 2.1 time: 0.174366 Jul 31 02:31:01.845179 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3704/7371] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:01 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:02.377482 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-6eca3e82-37c2-43c2-a4f0-7f36143c30bd req-d4cdbb6d-7e8f-4730-b907-cc2cdf2fcdd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d15613c-c3b8-45b2-8da9-347ef8762a2d", "name": "network-vif-unplugged", "status": "completed", "tag": "e7450ea0-a06d-447a-8e9f-5fd7af5f2acc"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:31:02.390637 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-6eca3e82-37c2-43c2-a4f0-7f36143c30bd req-d4cdbb6d-7e8f-4730-b907-cc2cdf2fcdd3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:02.390965 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-6eca3e82-37c2-43c2-a4f0-7f36143c30bd req-d4cdbb6d-7e8f-4730-b907-cc2cdf2fcdd3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:02.408403 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.compute.server_external_events [req-6eca3e82-37c2-43c2-a4f0-7f36143c30bd req-d4cdbb6d-7e8f-4730-b907-cc2cdf2fcdd3 service nova] Unable to find a host for instance 3d15613c-c3b8-45b2-8da9-347ef8762a2d. Dropping event network-vif-unplugged {{(pid=119474) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 31 02:31:02.409037 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-6eca3e82-37c2-43c2-a4f0-7f36143c30bd req-d4cdbb6d-7e8f-4730-b907-cc2cdf2fcdd3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036483 Jul 31 02:31:02.409705 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3668/7372] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 31 02:31:02.866335 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6585e90c-8028-4478-ab80-4a5222e35f6f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:02.866955 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6585e90c-8028-4478-ab80-4a5222e35f6f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:02.874778 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6585e90c-8028-4478-ab80-4a5222e35f6f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:02.875521 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6585e90c-8028-4478-ab80-4a5222e35f6f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:02.876304 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6585e90c-8028-4478-ab80-4a5222e35f6f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:02.876745 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6585e90c-8028-4478-ab80-4a5222e35f6f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:03.025486 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6585e90c-8028-4478-ab80-4a5222e35f6f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:03.033994 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6585e90c-8028-4478-ab80-4a5222e35f6f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1520 microversion: 2.1 time: 0.171745 Jul 31 02:31:03.034599 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3705/7373] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:02 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:04.056100 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1953197c-3a46-4d27-89ec-fd655188d083 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:04.056729 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1953197c-3a46-4d27-89ec-fd655188d083 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:04.063628 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1953197c-3a46-4d27-89ec-fd655188d083 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:04.064087 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1953197c-3a46-4d27-89ec-fd655188d083 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:04.064857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1953197c-3a46-4d27-89ec-fd655188d083 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:04.065304 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1953197c-3a46-4d27-89ec-fd655188d083 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:04.201464 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1953197c-3a46-4d27-89ec-fd655188d083 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:04.209048 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1953197c-3a46-4d27-89ec-fd655188d083 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1520 microversion: 2.1 time: 0.156841 Jul 31 02:31:04.209621 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3669/7374] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:04 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:05.230040 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a800c9f0-2e6a-4b30-a4ec-d17031652b35 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:05.230667 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a800c9f0-2e6a-4b30-a4ec-d17031652b35 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:05.238524 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a800c9f0-2e6a-4b30-a4ec-d17031652b35 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:05.238981 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a800c9f0-2e6a-4b30-a4ec-d17031652b35 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:05.239799 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a800c9f0-2e6a-4b30-a4ec-d17031652b35 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:05.240247 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a800c9f0-2e6a-4b30-a4ec-d17031652b35 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:05.379806 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a800c9f0-2e6a-4b30-a4ec-d17031652b35 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:05.387449 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a800c9f0-2e6a-4b30-a4ec-d17031652b35 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1520 microversion: 2.1 time: 0.161253 Jul 31 02:31:05.388173 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3706/7375] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:05 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:06.409889 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-bab4a4f8-4332-44cd-895e-a0ca925e7c5f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:06.410467 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-bab4a4f8-4332-44cd-895e-a0ca925e7c5f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:06.417485 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bab4a4f8-4332-44cd-895e-a0ca925e7c5f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:06.417955 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bab4a4f8-4332-44cd-895e-a0ca925e7c5f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:06.418737 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bab4a4f8-4332-44cd-895e-a0ca925e7c5f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:06.419723 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-bab4a4f8-4332-44cd-895e-a0ca925e7c5f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:06.552031 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-bab4a4f8-4332-44cd-895e-a0ca925e7c5f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:06.560465 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-bab4a4f8-4332-44cd-895e-a0ca925e7c5f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1520 microversion: 2.1 time: 0.154070 Jul 31 02:31:06.561059 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3670/7376] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:06 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:07.582461 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e17c67f0-b4e7-4680-8440-a531b2a2941f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:07.583143 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e17c67f0-b4e7-4680-8440-a531b2a2941f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:07.590146 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e17c67f0-b4e7-4680-8440-a531b2a2941f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:07.590637 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e17c67f0-b4e7-4680-8440-a531b2a2941f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:07.591477 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e17c67f0-b4e7-4680-8440-a531b2a2941f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:07.591926 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e17c67f0-b4e7-4680-8440-a531b2a2941f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:07.781021 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e17c67f0-b4e7-4680-8440-a531b2a2941f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:07.788733 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e17c67f0-b4e7-4680-8440-a531b2a2941f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1576 microversion: 2.1 time: 0.209994 Jul 31 02:31:07.799531 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3707/7377] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:07 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:08.811662 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e7bfbacc-7dde-48b4-990c-1371feb91647 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:08.812346 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e7bfbacc-7dde-48b4-990c-1371feb91647 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:08.819556 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7bfbacc-7dde-48b4-990c-1371feb91647 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:08.819982 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7bfbacc-7dde-48b4-990c-1371feb91647 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:08.820761 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7bfbacc-7dde-48b4-990c-1371feb91647 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:08.821225 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e7bfbacc-7dde-48b4-990c-1371feb91647 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:09.000236 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e7bfbacc-7dde-48b4-990c-1371feb91647 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:09.008246 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e7bfbacc-7dde-48b4-990c-1371feb91647 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1576 microversion: 2.1 time: 0.201128 Jul 31 02:31:09.008816 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3671/7378] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:08 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:10.030205 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-aba7dab9-c57e-43b2-8d1b-2bc4d61f7075 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:10.030742 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-aba7dab9-c57e-43b2-8d1b-2bc4d61f7075 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:10.037653 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aba7dab9-c57e-43b2-8d1b-2bc4d61f7075 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:10.038109 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aba7dab9-c57e-43b2-8d1b-2bc4d61f7075 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:10.038866 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aba7dab9-c57e-43b2-8d1b-2bc4d61f7075 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:10.039306 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-aba7dab9-c57e-43b2-8d1b-2bc4d61f7075 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:10.171092 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-aba7dab9-c57e-43b2-8d1b-2bc4d61f7075 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:10.178887 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-aba7dab9-c57e-43b2-8d1b-2bc4d61f7075 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1576 microversion: 2.1 time: 0.153346 Jul 31 02:31:10.179498 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3708/7379] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:10 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:11.200330 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-a918a990-405b-4565-9605-243eb48103bf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:11.201581 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-a918a990-405b-4565-9605-243eb48103bf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:11.208606 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a918a990-405b-4565-9605-243eb48103bf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:11.209074 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a918a990-405b-4565-9605-243eb48103bf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:11.209857 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a918a990-405b-4565-9605-243eb48103bf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:11.210311 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-a918a990-405b-4565-9605-243eb48103bf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:11.342086 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-a918a990-405b-4565-9605-243eb48103bf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:11.349657 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-a918a990-405b-4565-9605-243eb48103bf tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1576 microversion: 2.1 time: 0.153258 Jul 31 02:31:11.350232 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3672/7380] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:11 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:12.371450 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6846314b-f10c-4844-9b68-dbbf259b1002 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:12.372084 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6846314b-f10c-4844-9b68-dbbf259b1002 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:12.379290 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6846314b-f10c-4844-9b68-dbbf259b1002 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:12.379789 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6846314b-f10c-4844-9b68-dbbf259b1002 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:12.380555 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6846314b-f10c-4844-9b68-dbbf259b1002 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:12.381008 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6846314b-f10c-4844-9b68-dbbf259b1002 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:12.516514 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6846314b-f10c-4844-9b68-dbbf259b1002 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:12.524384 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6846314b-f10c-4844-9b68-dbbf259b1002 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1576 microversion: 2.1 time: 0.156941 Jul 31 02:31:12.524964 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3709/7381] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:12 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:13.546470 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-95048d61-9d5f-48b7-9ff6-cd4824be200e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:13.547105 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-95048d61-9d5f-48b7-9ff6-cd4824be200e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:13.554101 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95048d61-9d5f-48b7-9ff6-cd4824be200e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:13.554573 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95048d61-9d5f-48b7-9ff6-cd4824be200e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:13.555380 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95048d61-9d5f-48b7-9ff6-cd4824be200e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:13.555839 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-95048d61-9d5f-48b7-9ff6-cd4824be200e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:13.685340 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-95048d61-9d5f-48b7-9ff6-cd4824be200e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:13.693008 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-95048d61-9d5f-48b7-9ff6-cd4824be200e tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1576 microversion: 2.1 time: 0.150565 Jul 31 02:31:13.693580 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3673/7382] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:13 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:14.715230 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-cf1e4ac0-13b9-4ba6-997d-27ae2e949fe6 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:14.715887 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-cf1e4ac0-13b9-4ba6-997d-27ae2e949fe6 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:14.723465 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf1e4ac0-13b9-4ba6-997d-27ae2e949fe6 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:14.723933 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf1e4ac0-13b9-4ba6-997d-27ae2e949fe6 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:14.724709 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf1e4ac0-13b9-4ba6-997d-27ae2e949fe6 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:14.725165 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-cf1e4ac0-13b9-4ba6-997d-27ae2e949fe6 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:14.854869 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-cf1e4ac0-13b9-4ba6-997d-27ae2e949fe6 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:14.862371 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-cf1e4ac0-13b9-4ba6-997d-27ae2e949fe6 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1576 microversion: 2.1 time: 0.151073 Jul 31 02:31:14.862946 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3710/7383] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:14 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:15.884758 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b9c6c256-4eda-4ce7-84cb-1e1f96a700b8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:15.886515 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b9c6c256-4eda-4ce7-84cb-1e1f96a700b8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:15.892610 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9c6c256-4eda-4ce7-84cb-1e1f96a700b8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:15.893084 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9c6c256-4eda-4ce7-84cb-1e1f96a700b8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:15.893870 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9c6c256-4eda-4ce7-84cb-1e1f96a700b8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:15.894329 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b9c6c256-4eda-4ce7-84cb-1e1f96a700b8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:15.898369 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:31:16.032521 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-b9c6c256-4eda-4ce7-84cb-1e1f96a700b8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:16.040043 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b9c6c256-4eda-4ce7-84cb-1e1f96a700b8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1576 microversion: 2.1 time: 0.159262 Jul 31 02:31:16.040612 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3674/7384] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:15 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:17.062151 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-30a9ebe2-268e-4b08-bc56-7278b2ef640f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:17.062773 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-30a9ebe2-268e-4b08-bc56-7278b2ef640f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:17.069634 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30a9ebe2-268e-4b08-bc56-7278b2ef640f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:17.070084 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30a9ebe2-268e-4b08-bc56-7278b2ef640f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:17.070847 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30a9ebe2-268e-4b08-bc56-7278b2ef640f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:17.071284 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-30a9ebe2-268e-4b08-bc56-7278b2ef640f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:17.198955 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-30a9ebe2-268e-4b08-bc56-7278b2ef640f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:17.206458 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-30a9ebe2-268e-4b08-bc56-7278b2ef640f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1576 microversion: 2.1 time: 0.148767 Jul 31 02:31:17.207032 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3711/7385] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:17 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:18.228804 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-99f2853e-24a5-4532-9119-dd4817b9dc8f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:18.229583 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-99f2853e-24a5-4532-9119-dd4817b9dc8f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:18.232817 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:31:18.240055 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99f2853e-24a5-4532-9119-dd4817b9dc8f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:18.240556 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99f2853e-24a5-4532-9119-dd4817b9dc8f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:18.241596 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99f2853e-24a5-4532-9119-dd4817b9dc8f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:18.242051 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-99f2853e-24a5-4532-9119-dd4817b9dc8f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:18.373024 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-185df7a6-c268-48c6-ade3-b11e92f0d710 req-d4f12568-c275-458b-8e04-a612fd091b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d15613c-c3b8-45b2-8da9-347ef8762a2d", "name": "network-vif-plugged", "status": "completed", "tag": "e7450ea0-a06d-447a-8e9f-5fd7af5f2acc"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:31:18.378547 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-99f2853e-24a5-4532-9119-dd4817b9dc8f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:18.383795 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=31 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:31:18.390272 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-99f2853e-24a5-4532-9119-dd4817b9dc8f tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1576 microversion: 2.1 time: 0.165260 Jul 31 02:31:18.394818 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-185df7a6-c268-48c6-ade3-b11e92f0d710 req-d4f12568-c275-458b-8e04-a612fd091b4b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:18.395066 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-185df7a6-c268-48c6-ade3-b11e92f0d710 req-d4f12568-c275-458b-8e04-a612fd091b4b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:18.399636 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=91 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:31:18.404443 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3675/7386] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:18 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:18.412876 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-185df7a6-c268-48c6-ade3-b11e92f0d710 req-d4f12568-c275-458b-8e04-a612fd091b4b service nova] Creating event network-vif-plugged:e7450ea0-a06d-447a-8e9f-5fd7af5f2acc for instance 3d15613c-c3b8-45b2-8da9-347ef8762a2d on n-h1-master-1 Jul 31 02:31:18.418291 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-185df7a6-c268-48c6-ade3-b11e92f0d710 req-d4f12568-c275-458b-8e04-a612fd091b4b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049667 Jul 31 02:31:18.418967 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3712/7387] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:31:19.415585 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-587201eb-9647-4d1b-b63e-aa60e4623235 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:19.416254 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-587201eb-9647-4d1b-b63e-aa60e4623235 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:19.423977 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-587201eb-9647-4d1b-b63e-aa60e4623235 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:19.424446 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-587201eb-9647-4d1b-b63e-aa60e4623235 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:19.425229 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-587201eb-9647-4d1b-b63e-aa60e4623235 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:19.425681 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-587201eb-9647-4d1b-b63e-aa60e4623235 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:19.558053 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-587201eb-9647-4d1b-b63e-aa60e4623235 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:19.565875 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-587201eb-9647-4d1b-b63e-aa60e4623235 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1576 microversion: 2.1 time: 0.154188 Jul 31 02:31:19.566448 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3676/7388] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:19 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:31:20.588833 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c994e310-80b8-4c06-93b9-90100866da97 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:31:20.589546 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c994e310-80b8-4c06-93b9-90100866da97 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:31:20.595884 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c994e310-80b8-4c06-93b9-90100866da97 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:20.596348 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c994e310-80b8-4c06-93b9-90100866da97 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:20.597123 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c994e310-80b8-4c06-93b9-90100866da97 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:31:20.597571 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c994e310-80b8-4c06-93b9-90100866da97 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:31:20.727611 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c994e310-80b8-4c06-93b9-90100866da97 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:31:20.735740 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c994e310-80b8-4c06-93b9-90100866da97 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1563 microversion: 2.1 time: 0.152238 Jul 31 02:31:20.736325 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3713/7389] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:31:20 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:32:33.735547 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:32:33.736311 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=16 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:32:33.741935 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-b21542f6-7601-43a8-95ec-94159b735cb8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:32:33.742457 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b21542f6-7601-43a8-95ec-94159b735cb8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:32:33.742590 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:32:33.743315 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=7 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:32:33.751126 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b21542f6-7601-43a8-95ec-94159b735cb8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:33.751611 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b21542f6-7601-43a8-95ec-94159b735cb8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:33.752426 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b21542f6-7601-43a8-95ec-94159b735cb8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:33.752874 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-b21542f6-7601-43a8-95ec-94159b735cb8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:33.780364 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-b21542f6-7601-43a8-95ec-94159b735cb8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:32:33.798770 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-98e63ed3-8113-4ac3-aa21-a769179802d6 req-d650d509-01cc-4bc2-aadd-40bb3edf42fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d15613c-c3b8-45b2-8da9-347ef8762a2d", "tag": "e7450ea0-a06d-447a-8e9f-5fd7af5f2acc"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:32:33.809316 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-98e63ed3-8113-4ac3-aa21-a769179802d6 req-d650d509-01cc-4bc2-aadd-40bb3edf42fb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:33.809782 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-98e63ed3-8113-4ac3-aa21-a769179802d6 req-d650d509-01cc-4bc2-aadd-40bb3edf42fb service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:33.822418 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-98e63ed3-8113-4ac3-aa21-a769179802d6 req-d650d509-01cc-4bc2-aadd-40bb3edf42fb service nova] Creating event network-changed:e7450ea0-a06d-447a-8e9f-5fd7af5f2acc for instance 3d15613c-c3b8-45b2-8da9-347ef8762a2d on n-h1-master-1 Jul 31 02:32:33.827926 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-98e63ed3-8113-4ac3-aa21-a769179802d6 req-d650d509-01cc-4bc2-aadd-40bb3edf42fb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092021 Jul 31 02:32:33.828719 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3714/7390] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:32:33.861690 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-b21542f6-7601-43a8-95ec-94159b735cb8 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "DELETE /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 204 len: 0 microversion: 2.1 time: 0.127488 Jul 31 02:32:33.862936 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3677/7391] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:32:33 2022] DELETE /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:32:33.874777 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-33ece67a-076d-4540-be9d-7e0546925ef3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:32:33.875858 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-33ece67a-076d-4540-be9d-7e0546925ef3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:32:33.883166 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33ece67a-076d-4540-be9d-7e0546925ef3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:33.883753 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33ece67a-076d-4540-be9d-7e0546925ef3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:33.884638 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33ece67a-076d-4540-be9d-7e0546925ef3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:33.885167 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-33ece67a-076d-4540-be9d-7e0546925ef3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:34.023808 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-33ece67a-076d-4540-be9d-7e0546925ef3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:32:34.031330 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-33ece67a-076d-4540-be9d-7e0546925ef3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1569 microversion: 2.1 time: 0.161438 Jul 31 02:32:34.032044 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3715/7392] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:32:33 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:32:35.053568 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-454953d4-38e4-425c-b0d2-9006882524e3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:32:35.054288 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-454953d4-38e4-425c-b0d2-9006882524e3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:32:35.061576 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-454953d4-38e4-425c-b0d2-9006882524e3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:35.062041 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-454953d4-38e4-425c-b0d2-9006882524e3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:35.062816 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-454953d4-38e4-425c-b0d2-9006882524e3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:35.063266 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-454953d4-38e4-425c-b0d2-9006882524e3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:35.195315 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-454953d4-38e4-425c-b0d2-9006882524e3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:32:35.202884 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-454953d4-38e4-425c-b0d2-9006882524e3 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1569 microversion: 2.1 time: 0.153565 Jul 31 02:32:35.203593 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3678/7393] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:32:35 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:32:35.949597 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-22c77338-2a70-4244-9054-8516ae95bf52 req-810877aa-c875-4a1e-97ad-66946c8ac465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d15613c-c3b8-45b2-8da9-347ef8762a2d", "name": "network-vif-deleted", "tag": "e7450ea0-a06d-447a-8e9f-5fd7af5f2acc"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:32:35.960788 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-22c77338-2a70-4244-9054-8516ae95bf52 req-810877aa-c875-4a1e-97ad-66946c8ac465 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:35.961343 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-22c77338-2a70-4244-9054-8516ae95bf52 req-810877aa-c875-4a1e-97ad-66946c8ac465 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:35.972833 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-22c77338-2a70-4244-9054-8516ae95bf52 req-810877aa-c875-4a1e-97ad-66946c8ac465 service nova] Creating event network-vif-deleted:e7450ea0-a06d-447a-8e9f-5fd7af5f2acc for instance 3d15613c-c3b8-45b2-8da9-347ef8762a2d on n-h1-master-1 Jul 31 02:32:35.979006 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-22c77338-2a70-4244-9054-8516ae95bf52 req-810877aa-c875-4a1e-97ad-66946c8ac465 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033173 Jul 31 02:32:35.979651 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3716/7394] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:32:36.224644 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8f081575-6771-4c71-9757-1af06eca1d9c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:32:36.225853 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8f081575-6771-4c71-9757-1af06eca1d9c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:32:36.233655 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f081575-6771-4c71-9757-1af06eca1d9c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:36.234128 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f081575-6771-4c71-9757-1af06eca1d9c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:36.234961 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f081575-6771-4c71-9757-1af06eca1d9c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:36.235468 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8f081575-6771-4c71-9757-1af06eca1d9c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:36.304157 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8f081575-6771-4c71-9757-1af06eca1d9c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:32:36.313065 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8f081575-6771-4c71-9757-1af06eca1d9c tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1220 microversion: 2.1 time: 0.092314 Jul 31 02:32:36.320345 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3679/7395] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:32:36 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:32:37.335761 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-100a5ecc-0bb1-4a07-81b8-4616b9240d2a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:32:37.336607 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-100a5ecc-0bb1-4a07-81b8-4616b9240d2a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:32:37.346641 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-100a5ecc-0bb1-4a07-81b8-4616b9240d2a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:37.347183 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-100a5ecc-0bb1-4a07-81b8-4616b9240d2a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:37.348218 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-100a5ecc-0bb1-4a07-81b8-4616b9240d2a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:37.349081 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-100a5ecc-0bb1-4a07-81b8-4616b9240d2a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:37.415586 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-100a5ecc-0bb1-4a07-81b8-4616b9240d2a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:32:37.423418 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-100a5ecc-0bb1-4a07-81b8-4616b9240d2a tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1220 microversion: 2.1 time: 0.092826 Jul 31 02:32:37.424014 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3717/7396] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:32:37 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:32:38.446183 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3863cc7b-e77e-4683-a584-b0141ea82f68 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:32:38.446852 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3863cc7b-e77e-4683-a584-b0141ea82f68 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:32:38.453901 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3863cc7b-e77e-4683-a584-b0141ea82f68 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:38.454368 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3863cc7b-e77e-4683-a584-b0141ea82f68 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:38.455149 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3863cc7b-e77e-4683-a584-b0141ea82f68 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:38.455626 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3863cc7b-e77e-4683-a584-b0141ea82f68 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:38.517759 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3863cc7b-e77e-4683-a584-b0141ea82f68 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:32:38.525393 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3863cc7b-e77e-4683-a584-b0141ea82f68 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1220 microversion: 2.1 time: 0.083788 Jul 31 02:32:38.525968 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3680/7397] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:32:38 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:32:39.546889 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1f6e580e-bf15-4898-a1ce-a6e0b75dcf13 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:32:39.547616 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1f6e580e-bf15-4898-a1ce-a6e0b75dcf13 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:32:39.554663 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f6e580e-bf15-4898-a1ce-a6e0b75dcf13 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:39.555122 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f6e580e-bf15-4898-a1ce-a6e0b75dcf13 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:39.555925 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f6e580e-bf15-4898-a1ce-a6e0b75dcf13 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:39.556367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f6e580e-bf15-4898-a1ce-a6e0b75dcf13 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:39.618477 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1f6e580e-bf15-4898-a1ce-a6e0b75dcf13 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211c5ded77174ea584b85e6617e3a18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b501064302f41c8997c829a6498492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:32:39.626357 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1f6e580e-bf15-4898-a1ce-a6e0b75dcf13 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 200 len: 1220 microversion: 2.1 time: 0.083434 Jul 31 02:32:39.626925 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3718/7398] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:32:39 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:32:40.648799 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d9f6e9d0-547b-46f4-b27a-694742dc0728 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:32:40.649416 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d9f6e9d0-547b-46f4-b27a-694742dc0728 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] [instance: 3d15613c-c3b8-45b2-8da9-347ef8762a2d] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:32:40.656583 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d9f6e9d0-547b-46f4-b27a-694742dc0728 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:40.657079 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d9f6e9d0-547b-46f4-b27a-694742dc0728 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:40.657869 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d9f6e9d0-547b-46f4-b27a-694742dc0728 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:32:40.658324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d9f6e9d0-547b-46f4-b27a-694742dc0728 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:32:40.672288 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.wsgi [None req-d9f6e9d0-547b-46f4-b27a-694742dc0728 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] HTTP exception thrown: Instance 3d15613c-c3b8-45b2-8da9-347ef8762a2d could not be found. Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d9f6e9d0-547b-46f4-b27a-694742dc0728 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Request method failure captured: Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: request: GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d HTTP/1.1 Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: Accept: application/json Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: Accept-Encoding: identity Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: Connection: close Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: Content-Length: 0 Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: Content-Type: application/json Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: Host: 10.222.0.45 Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: Openstack-System-Scope: None Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: User-Agent: python-urllib3/1.26.10 Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-Auth-Token: gAAAAABi5ee6QTqQbYUFQDNCsOCJ7YrEBxGrRdEbW-WwjH3ypXcwH-RNdSkPZ8kxoWx2o3yRSHssvlrPuO0mftfvJTlpC_KmJVQFCAcTbjAuND_RRSyjAxYcZAYfjUfhCenMkAKzmsKwCYqy42tquHUtS2D52RuyEZZvD2SWPmAh3Tn5R-yej_Y Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Id: None Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-Domain-Name: None Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-Identity-Status: Confirmed Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-Is-Admin-Project: True Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Id: default Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-Project-Domain-Name: Default Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-Project-Id: 6b501064302f41c8997c829a6498492c Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-Project-Name: tempest-TestShelveInstance-1633452140 Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-Role: member,reader Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-Roles: member,reader Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b501064302f41c8997c829a6498492c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/6b501064302f41c8997c829a6498492c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/6b501064302f41c8997c829a6498492c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_6b501064302f41c8997c829a6498492c", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-Tenant: tempest-TestShelveInstance-1633452140 Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Id: 6b501064302f41c8997c829a6498492c Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-Tenant-Name: tempest-TestShelveInstance-1633452140 Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-User: tempest-TestShelveInstance-1633452140-project Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Id: default Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-User-Domain-Name: Default Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-User-Id: 211c5ded77174ea584b85e6617e3a18c Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: X-User-Name: tempest-TestShelveInstance-1633452140-project Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: method: > Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: exception: Instance 3d15613c-c3b8-45b2-8da9-347ef8762a2d could not be found. Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: action_args: {'id': '3d15613c-c3b8-45b2-8da9-347ef8762a2d'} Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d15613c-c3b8-45b2-8da9-347ef8762a2d could not be found. Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d15613c-c3b8-45b2-8da9-347ef8762a2d could not be found. Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:32:40.673952 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:32:40.678197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:32:40.678197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:32:40.678197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:32:40.678197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:32:40.678197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:32:40.678197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d15613c-c3b8-45b2-8da9-347ef8762a2d could not be found. Jul 31 02:32:40.678197 n-d-master-1 devstack@n-api.service[119474]: ERROR nova.api.openstack.wsgi Jul 31 02:32:40.678197 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d9f6e9d0-547b-46f4-b27a-694742dc0728 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Returning 404 to user: Instance 3d15613c-c3b8-45b2-8da9-347ef8762a2d could not be found. {{(pid=119474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:32:40.678197 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d9f6e9d0-547b-46f4-b27a-694742dc0728 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d" status: 404 len: 111 microversion: 2.1 time: 0.031185 Jul 31 02:32:40.678197 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3681/7399] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:32:40 2022] GET /compute/v2.1/servers/3d15613c-c3b8-45b2-8da9-347ef8762a2d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:32:40.846803 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-fdd719ae-b8ab-4aab-abea-31e66bb109a0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] Calling method '.version_select at 0x7fedea924dc0>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:32:40.874678 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-fdd719ae-b8ab-4aab-abea-31e66bb109a0 tempest-TestShelveInstance-1633452140 tempest-TestShelveInstance-1633452140-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2041283203" status: 202 len: 0 microversion: 2.1 time: 0.032485 Jul 31 02:32:40.876180 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3719/7400] 10.222.0.45 () {58 vars in 1254 bytes} [Sun Jul 31 02:32:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2041283203 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:32:58.051660 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:32:58.052441 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:32:58.279047 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1302c143-31d5-47c5-8592-599378f55568 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Action: 'create', calling method: .version_select at 0x7fede565ad30>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-875961163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl9mkTIgj34GPlaxbbOOZCmsjWN6PtXIV3PyomVfA5nA0ayupp9tMwIE06YQ3/Sq4/C+L6/tHDjOZE/1FNRZhC7lAcJKTf6DA0tSULIbt0B0ky4fECRrq2wyajHu4ro3g=="}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:32:58.296207 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-1302c143-31d5-47c5-8592-599378f55568 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Getting quotas for project 55940c7e67524086ad0bf355779767d2. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:32:58.302367 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-1302c143-31d5-47c5-8592-599378f55568 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Getting quotas for user 0ec2a4e627f14aa7b4bc5c02d78bdf70 and project 55940c7e67524086ad0bf355779767d2. Resources: {'key_pairs'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:32:58.335475 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1302c143-31d5-47c5-8592-599378f55568 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.288835 Jul 31 02:32:58.336087 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3682/7401] 10.222.0.45 () {60 vars in 1159 bytes} [Sun Jul 31 02:32:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:32:59.359606 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=22 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:32:59.360366 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:32:59.365128 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1d394eb4-cf44-43b2-a172-51d1cb212caf tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2014692700", "imageRef": "0f306572-729b-4b95-a357-79461887e541", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-875961163", "security_groups": [{"name": "tempest-secgroup-smoke-661315865"}], "networks": [{"uuid": "37821fd7-3862-4ec5-b28f-f6c369ad8905"}]}} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:32:59.470861 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.network.neutron [None req-1d394eb4-cf44-43b2-a172-51d1cb212caf tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] validate_networks() for [('37821fd7-3862-4ec5-b28f-f6c369ad8905', None, None, None, None, None)] {{(pid=119475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:33:00.276828 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-1d394eb4-cf44-43b2-a172-51d1cb212caf tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Flavor limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:33:00.277274 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-1d394eb4-cf44-43b2-a172-51d1cb212caf tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Image limits 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:33:00.278004 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-1d394eb4-cf44-43b2-a172-51d1cb212caf tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Flavor pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:33:00.278285 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-1d394eb4-cf44-43b2-a172-51d1cb212caf tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Image pref 0:0:0 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:33:00.278611 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.virt.hardware [None req-1d394eb4-cf44-43b2-a172-51d1cb212caf tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:33:00.287854 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d394eb4-cf44-43b2-a172-51d1cb212caf tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:00.288317 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d394eb4-cf44-43b2-a172-51d1cb212caf tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:00.289140 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d394eb4-cf44-43b2-a172-51d1cb212caf tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:00.289593 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1d394eb4-cf44-43b2-a172-51d1cb212caf tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:00.310403 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-1d394eb4-cf44-43b2-a172-51d1cb212caf tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Getting quotas for project 55940c7e67524086ad0bf355779767d2. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:33:00.315887 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.quota [None req-1d394eb4-cf44-43b2-a172-51d1cb212caf tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Getting quotas for user 0ec2a4e627f14aa7b4bc5c02d78bdf70 and project 55940c7e67524086ad0bf355779767d2. Resources: {'cores', 'ram', 'instances'} {{(pid=119475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:33:00.329058 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1d394eb4-cf44-43b2-a172-51d1cb212caf tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Going to run 1 instances... {{(pid=119475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:33:00.331389 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1d394eb4-cf44-43b2-a172-51d1cb212caf tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0f306572-729b-4b95-a357-79461887e541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:33:00.379594 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1d394eb4-cf44-43b2-a172-51d1cb212caf tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.021775 Jul 31 02:33:00.382249 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3720/7402] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:32:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:33:00.394047 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e7eb9f94-f128-408f-96d0-69895f8c5e45 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:33:00.394956 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e7eb9f94-f128-408f-96d0-69895f8c5e45 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:33:00.453895 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e7eb9f94-f128-408f-96d0-69895f8c5e45 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:33:00.463913 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e7eb9f94-f128-408f-96d0-69895f8c5e45 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79" status: 200 len: 1248 microversion: 2.1 time: 0.075076 Jul 31 02:33:00.465107 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3683/7403] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:33:00 2022] GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 => generated 1248 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:33:01.485907 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e52206b8-df8a-4315-aa4c-3d186a534019 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:33:01.486602 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e52206b8-df8a-4315-aa4c-3d186a534019 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:33:01.493367 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e52206b8-df8a-4315-aa4c-3d186a534019 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:01.493826 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e52206b8-df8a-4315-aa4c-3d186a534019 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:01.494608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e52206b8-df8a-4315-aa4c-3d186a534019 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:01.495047 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e52206b8-df8a-4315-aa4c-3d186a534019 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:01.573124 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e52206b8-df8a-4315-aa4c-3d186a534019 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:33:01.581477 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e52206b8-df8a-4315-aa4c-3d186a534019 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79" status: 200 len: 1300 microversion: 2.1 time: 0.100374 Jul 31 02:33:01.582674 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3721/7404] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:33:01 2022] GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 => generated 1300 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:33:02.606622 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-1423f06f-4af6-43d6-a097-ba05f68a1f06 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:33:02.609295 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-1423f06f-4af6-43d6-a097-ba05f68a1f06 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:33:02.618025 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1423f06f-4af6-43d6-a097-ba05f68a1f06 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:02.618743 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1423f06f-4af6-43d6-a097-ba05f68a1f06 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:02.619739 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1423f06f-4af6-43d6-a097-ba05f68a1f06 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:02.620352 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-1423f06f-4af6-43d6-a097-ba05f68a1f06 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:02.832642 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-1423f06f-4af6-43d6-a097-ba05f68a1f06 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:33:02.840065 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-1423f06f-4af6-43d6-a097-ba05f68a1f06 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79" status: 200 len: 1373 microversion: 2.1 time: 0.238480 Jul 31 02:33:02.840650 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3684/7405] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:33:02 2022] GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 => generated 1373 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:33:03.149559 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-23f6c08e-bfdb-4f66-a547-43b15d9bc02a req-b8d2b27b-5fe9-48d3-9240-f6389077f138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc0643e1-e6fb-47ba-85da-e6719dd4ac79", "tag": "73fa1d00-3ba7-43e5-916a-6ee8b154d0a7"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:33:03.162838 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-23f6c08e-bfdb-4f66-a547-43b15d9bc02a req-b8d2b27b-5fe9-48d3-9240-f6389077f138 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:03.163285 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-23f6c08e-bfdb-4f66-a547-43b15d9bc02a req-b8d2b27b-5fe9-48d3-9240-f6389077f138 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:03.174709 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-23f6c08e-bfdb-4f66-a547-43b15d9bc02a req-b8d2b27b-5fe9-48d3-9240-f6389077f138 service nova] Creating event network-changed:73fa1d00-3ba7-43e5-916a-6ee8b154d0a7 for instance bc0643e1-e6fb-47ba-85da-e6719dd4ac79 on n-h1-master-1 Jul 31 02:33:03.179644 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-23f6c08e-bfdb-4f66-a547-43b15d9bc02a req-b8d2b27b-5fe9-48d3-9240-f6389077f138 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035190 Jul 31 02:33:03.180255 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3722/7406] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:33:03.862350 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e679cd2e-136b-450a-9f48-6082db572d7c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:33:03.863065 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e679cd2e-136b-450a-9f48-6082db572d7c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:33:03.870277 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e679cd2e-136b-450a-9f48-6082db572d7c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:03.870746 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e679cd2e-136b-450a-9f48-6082db572d7c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:03.871602 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e679cd2e-136b-450a-9f48-6082db572d7c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:03.872060 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e679cd2e-136b-450a-9f48-6082db572d7c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:04.018296 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-e679cd2e-136b-450a-9f48-6082db572d7c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:33:04.026659 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e679cd2e-136b-450a-9f48-6082db572d7c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79" status: 200 len: 1373 microversion: 2.1 time: 0.168220 Jul 31 02:33:04.027286 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3685/7407] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:33:03 2022] GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:33:05.049969 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-b6c09973-45c7-4dae-91d4-7500dca9fee7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:33:05.050680 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-b6c09973-45c7-4dae-91d4-7500dca9fee7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:33:05.057037 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6c09973-45c7-4dae-91d4-7500dca9fee7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:05.057502 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6c09973-45c7-4dae-91d4-7500dca9fee7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:05.058276 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6c09973-45c7-4dae-91d4-7500dca9fee7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:05.058727 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-b6c09973-45c7-4dae-91d4-7500dca9fee7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:05.192391 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-b6c09973-45c7-4dae-91d4-7500dca9fee7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:33:05.200352 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-b6c09973-45c7-4dae-91d4-7500dca9fee7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79" status: 200 len: 1373 microversion: 2.1 time: 0.155558 Jul 31 02:33:05.200929 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3723/7408] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:33:05 2022] GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:33:06.220964 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-16e357b0-5fb8-4c9a-8286-751ab3435999 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:33:06.221589 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-16e357b0-5fb8-4c9a-8286-751ab3435999 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:33:06.229226 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16e357b0-5fb8-4c9a-8286-751ab3435999 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:06.229696 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16e357b0-5fb8-4c9a-8286-751ab3435999 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:06.230478 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16e357b0-5fb8-4c9a-8286-751ab3435999 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:06.230924 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-16e357b0-5fb8-4c9a-8286-751ab3435999 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:06.364304 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-16e357b0-5fb8-4c9a-8286-751ab3435999 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:33:06.371807 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-16e357b0-5fb8-4c9a-8286-751ab3435999 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79" status: 200 len: 1373 microversion: 2.1 time: 0.154720 Jul 31 02:33:06.372376 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3686/7409] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:33:06 2022] GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:33:07.393486 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a37919a7-51dc-4277-bdbc-aa3f976f7996 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:33:07.394039 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a37919a7-51dc-4277-bdbc-aa3f976f7996 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:33:07.400755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a37919a7-51dc-4277-bdbc-aa3f976f7996 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:07.401212 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a37919a7-51dc-4277-bdbc-aa3f976f7996 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:07.401973 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a37919a7-51dc-4277-bdbc-aa3f976f7996 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:07.402413 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a37919a7-51dc-4277-bdbc-aa3f976f7996 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:07.533859 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-a37919a7-51dc-4277-bdbc-aa3f976f7996 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:33:07.541861 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a37919a7-51dc-4277-bdbc-aa3f976f7996 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79" status: 200 len: 1373 microversion: 2.1 time: 0.152395 Jul 31 02:33:07.542433 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3724/7410] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:33:07 2022] GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:33:08.562487 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-90144ad0-eeee-46f7-9d1f-853b341153d8 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:33:08.563156 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-90144ad0-eeee-46f7-9d1f-853b341153d8 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:33:08.571040 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90144ad0-eeee-46f7-9d1f-853b341153d8 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:08.571541 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90144ad0-eeee-46f7-9d1f-853b341153d8 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:08.572339 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90144ad0-eeee-46f7-9d1f-853b341153d8 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:08.572796 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-90144ad0-eeee-46f7-9d1f-853b341153d8 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:08.708952 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-90144ad0-eeee-46f7-9d1f-853b341153d8 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:33:08.717190 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-90144ad0-eeee-46f7-9d1f-853b341153d8 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79" status: 200 len: 1373 microversion: 2.1 time: 0.158632 Jul 31 02:33:08.717762 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3687/7411] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:33:08 2022] GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:33:08.801386 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-37c1f831-9757-4881-87be-a6d2e8870562 req-4200e7dc-e118-4abe-95cf-c6e315bf51a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0643e1-e6fb-47ba-85da-e6719dd4ac79", "name": "network-vif-plugged", "status": "completed", "tag": "73fa1d00-3ba7-43e5-916a-6ee8b154d0a7"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:33:08.813051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-37c1f831-9757-4881-87be-a6d2e8870562 req-4200e7dc-e118-4abe-95cf-c6e315bf51a4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:08.813374 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-37c1f831-9757-4881-87be-a6d2e8870562 req-4200e7dc-e118-4abe-95cf-c6e315bf51a4 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:08.824640 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-37c1f831-9757-4881-87be-a6d2e8870562 req-4200e7dc-e118-4abe-95cf-c6e315bf51a4 service nova] Creating event network-vif-plugged:73fa1d00-3ba7-43e5-916a-6ee8b154d0a7 for instance bc0643e1-e6fb-47ba-85da-e6719dd4ac79 on n-h1-master-1 Jul 31 02:33:08.829635 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-37c1f831-9757-4881-87be-a6d2e8870562 req-4200e7dc-e118-4abe-95cf-c6e315bf51a4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032041 Jul 31 02:33:08.830251 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3725/7412] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:33:09.739562 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fa40c1c5-b92b-4d4e-a7b2-1f1e111d906b tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:33:09.740201 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fa40c1c5-b92b-4d4e-a7b2-1f1e111d906b tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:33:09.747627 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa40c1c5-b92b-4d4e-a7b2-1f1e111d906b tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:09.748093 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa40c1c5-b92b-4d4e-a7b2-1f1e111d906b tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:09.748870 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa40c1c5-b92b-4d4e-a7b2-1f1e111d906b tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:09.749325 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fa40c1c5-b92b-4d4e-a7b2-1f1e111d906b tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:09.883245 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fa40c1c5-b92b-4d4e-a7b2-1f1e111d906b tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:33:09.890717 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fa40c1c5-b92b-4d4e-a7b2-1f1e111d906b tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79" status: 200 len: 1373 microversion: 2.1 time: 0.155190 Jul 31 02:33:09.891287 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3688/7413] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:33:09 2022] GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:33:10.910318 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:33:10.911317 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=6 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:33:10.916292 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-ee8cb05a-6dd4-40fe-8b6c-be4e14d2bcb5 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:33:10.917296 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-ee8cb05a-6dd4-40fe-8b6c-be4e14d2bcb5 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:33:10.924776 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee8cb05a-6dd4-40fe-8b6c-be4e14d2bcb5 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:10.925282 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee8cb05a-6dd4-40fe-8b6c-be4e14d2bcb5 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:10.926071 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee8cb05a-6dd4-40fe-8b6c-be4e14d2bcb5 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:10.926520 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-ee8cb05a-6dd4-40fe-8b6c-be4e14d2bcb5 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:11.062190 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-ee8cb05a-6dd4-40fe-8b6c-be4e14d2bcb5 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:33:11.070643 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-ee8cb05a-6dd4-40fe-8b6c-be4e14d2bcb5 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79" status: 200 len: 1558 microversion: 2.1 time: 0.162289 Jul 31 02:33:11.071221 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3726/7414] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:33:10 2022] GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:33:11.091510 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-cbac087b-6b80-4450-84a7-6a94d2540d2a tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:33:11.092140 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-cbac087b-6b80-4450-84a7-6a94d2540d2a tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:33:11.094038 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:33:11.100161 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbac087b-6b80-4450-84a7-6a94d2540d2a tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:11.100629 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbac087b-6b80-4450-84a7-6a94d2540d2a tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:11.101402 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbac087b-6b80-4450-84a7-6a94d2540d2a tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:11.101851 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-cbac087b-6b80-4450-84a7-6a94d2540d2a tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:11.235800 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-cbac087b-6b80-4450-84a7-6a94d2540d2a tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:33:11.245605 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-cbac087b-6b80-4450-84a7-6a94d2540d2a tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79" status: 200 len: 1558 microversion: 2.1 time: 0.157935 Jul 31 02:33:11.246193 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3689/7415] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:33:11 2022] GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:33:12.866799 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f79369fc-543d-4427-9c5a-d7d630f18560 req-a835af87-4147-4a3a-828d-53302dce191b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc0643e1-e6fb-47ba-85da-e6719dd4ac79", "tag": "73fa1d00-3ba7-43e5-916a-6ee8b154d0a7"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:33:12.877096 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f79369fc-543d-4427-9c5a-d7d630f18560 req-a835af87-4147-4a3a-828d-53302dce191b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:33:12.877537 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f79369fc-543d-4427-9c5a-d7d630f18560 req-a835af87-4147-4a3a-828d-53302dce191b service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:33:12.888719 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f79369fc-543d-4427-9c5a-d7d630f18560 req-a835af87-4147-4a3a-828d-53302dce191b service nova] Creating event network-changed:73fa1d00-3ba7-43e5-916a-6ee8b154d0a7 for instance bc0643e1-e6fb-47ba-85da-e6719dd4ac79 on n-h1-master-1 Jul 31 02:33:12.893643 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f79369fc-543d-4427-9c5a-d7d630f18560 req-a835af87-4147-4a3a-828d-53302dce191b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030593 Jul 31 02:33:12.894242 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3727/7416] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:34:19.157629 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:34:19.158181 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 02:34:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:34:57.018800 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:34:57.019645 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 02:34:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:35:08.142115 n-d-master-1 devstack@n-api.service[119474]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8060e32b-511a-408f-bb92-dd5077e59ac2] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 31 02:35:08.143306 n-d-master-1 devstack@n-api.service[119474]: ERROR oslo.messaging._drivers.impl_rabbit [-] [161f59ee-e913-4622-b753-eac5ec38d240] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 31 02:35:08.143859 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:35:08.144829 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=36 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:35:08.149619 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2f5f9d49-928e-4792-9651-581581b707e6 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1584852147"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:35:08.152111 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2f5f9d49-928e-4792-9651-581581b707e6 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:08.162919 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2f5f9d49-928e-4792-9651-581581b707e6 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:08.164088 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2f5f9d49-928e-4792-9651-581581b707e6 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:08.164880 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2f5f9d49-928e-4792-9651-581581b707e6 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:08.165334 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2f5f9d49-928e-4792-9651-581581b707e6 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:08.358958 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2f5f9d49-928e-4792-9651-581581b707e6 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "POST /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79/action" status: 202 len: 0 microversion: 2.1 time: 0.218376 Jul 31 02:35:08.359629 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3690/7417] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:35:08 2022] POST /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 31 02:35:13.452288 n-d-master-1 devstack@n-api.service[119475]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ce818dc8-5b17-41f1-bd07-761ee808087c] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 31 02:35:13.454169 n-d-master-1 devstack@n-api.service[119475]: ERROR oslo.messaging._drivers.impl_rabbit [-] [189acb91-3d4b-44e7-81c9-7fd59a69a406] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 31 02:35:13.454963 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:35:13.456384 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=32 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:35:13.551351 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-b5e32ded-713e-47a8-b31b-ac7e78e378c3 req-142a5de1-3767-44cc-a28e-66f61ff471e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0643e1-e6fb-47ba-85da-e6719dd4ac79", "name": "network-vif-plugged", "status": "completed", "tag": "73fa1d00-3ba7-43e5-916a-6ee8b154d0a7"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:35:13.572549 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b5e32ded-713e-47a8-b31b-ac7e78e378c3 req-142a5de1-3767-44cc-a28e-66f61ff471e1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:13.573264 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-b5e32ded-713e-47a8-b31b-ac7e78e378c3 req-142a5de1-3767-44cc-a28e-66f61ff471e1 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:13.587685 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-b5e32ded-713e-47a8-b31b-ac7e78e378c3 req-142a5de1-3767-44cc-a28e-66f61ff471e1 service nova] Creating event network-vif-plugged:73fa1d00-3ba7-43e5-916a-6ee8b154d0a7 for instance bc0643e1-e6fb-47ba-85da-e6719dd4ac79 on n-h1-master-1 Jul 31 02:35:13.594300 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-b5e32ded-713e-47a8-b31b-ac7e78e378c3 req-142a5de1-3767-44cc-a28e-66f61ff471e1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143924 Jul 31 02:35:13.595145 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3728/7418] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:35:21.902184 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:35:21.903124 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:35:21.907313 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-e855f81e-eea8-4c56-964e-3f57f18ae909 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1061142386", "imageRef": "f7627178-3d02-4017-be6f-91634366481e", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-875961163", "security_groups": [{"name": "tempest-secgroup-smoke-661315865"}], "networks": [{"uuid": "37821fd7-3862-4ec5-b28f-f6c369ad8905"}]}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:35:21.933737 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] [8060e32b-511a-408f-bb92-dd5077e59ac2] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41662. Jul 31 02:35:21.935317 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] [161f59ee-e913-4622-b753-eac5ec38d240] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41664. Jul 31 02:35:22.021915 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.network.neutron [None req-e855f81e-eea8-4c56-964e-3f57f18ae909 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] validate_networks() for [('37821fd7-3862-4ec5-b28f-f6c369ad8905', None, None, None, None, None)] {{(pid=119474) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 02:35:22.448643 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e855f81e-eea8-4c56-964e-3f57f18ae909 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Flavor limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 02:35:22.449108 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e855f81e-eea8-4c56-964e-3f57f18ae909 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Image limits 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 02:35:22.449593 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e855f81e-eea8-4c56-964e-3f57f18ae909 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Flavor pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 02:35:22.450014 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e855f81e-eea8-4c56-964e-3f57f18ae909 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Image pref 0:0:0 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 02:35:22.450436 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.virt.hardware [None req-e855f81e-eea8-4c56-964e-3f57f18ae909 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119474) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 02:35:22.459304 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e855f81e-eea8-4c56-964e-3f57f18ae909 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:22.459790 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e855f81e-eea8-4c56-964e-3f57f18ae909 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:22.461100 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e855f81e-eea8-4c56-964e-3f57f18ae909 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:22.461607 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-e855f81e-eea8-4c56-964e-3f57f18ae909 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:22.478929 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-e855f81e-eea8-4c56-964e-3f57f18ae909 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Getting quotas for project 55940c7e67524086ad0bf355779767d2. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 02:35:22.484322 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.quota [None req-e855f81e-eea8-4c56-964e-3f57f18ae909 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Getting quotas for user 0ec2a4e627f14aa7b4bc5c02d78bdf70 and project 55940c7e67524086ad0bf355779767d2. Resources: {'cores', 'ram', 'instances'} {{(pid=119474) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 02:35:22.497480 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e855f81e-eea8-4c56-964e-3f57f18ae909 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Going to run 1 instances... {{(pid=119474) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 02:35:22.499969 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-e855f81e-eea8-4c56-964e-3f57f18ae909 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7627178-3d02-4017-be6f-91634366481e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119474) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 02:35:22.546826 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-e855f81e-eea8-4c56-964e-3f57f18ae909 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.646880 Jul 31 02:35:22.547499 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3691/7419] 10.222.0.45 () {60 vars in 1147 bytes} [Sun Jul 31 02:35:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 02:35:22.568831 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-7e490df5-0e3c-4f1f-b2f2-7bfd881c8e18 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:22.569592 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-7e490df5-0e3c-4f1f-b2f2-7bfd881c8e18 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:22.577615 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] [ce818dc8-5b17-41f1-bd07-761ee808087c] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41678. Jul 31 02:35:22.581311 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] [189acb91-3d4b-44e7-81c9-7fd59a69a406] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41680. Jul 31 02:35:22.635994 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-7e490df5-0e3c-4f1f-b2f2-7bfd881c8e18 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:22.642577 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-7e490df5-0e3c-4f1f-b2f2-7bfd881c8e18 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1248 microversion: 2.1 time: 0.087849 Jul 31 02:35:22.643140 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3729/7420] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:22 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1248 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:23.664439 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-d40831ae-5d07-476d-8a9a-38985213d3b2 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:23.665211 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-d40831ae-5d07-476d-8a9a-38985213d3b2 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:23.672656 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d40831ae-5d07-476d-8a9a-38985213d3b2 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:23.673220 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d40831ae-5d07-476d-8a9a-38985213d3b2 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:23.674454 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d40831ae-5d07-476d-8a9a-38985213d3b2 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:23.674971 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-d40831ae-5d07-476d-8a9a-38985213d3b2 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:23.743128 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-d40831ae-5d07-476d-8a9a-38985213d3b2 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:23.750812 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-d40831ae-5d07-476d-8a9a-38985213d3b2 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1318 microversion: 2.1 time: 0.091090 Jul 31 02:35:23.751758 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3692/7421] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:23 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1318 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:24.775379 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-0711d281-4515-4c00-a106-463de1901724 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:24.776784 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-0711d281-4515-4c00-a106-463de1901724 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:24.784515 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:35:24.788592 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0711d281-4515-4c00-a106-463de1901724 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:24.789416 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0711d281-4515-4c00-a106-463de1901724 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:24.790427 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0711d281-4515-4c00-a106-463de1901724 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:24.791080 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-0711d281-4515-4c00-a106-463de1901724 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:24.954795 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-0711d281-4515-4c00-a106-463de1901724 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:24.966169 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-0711d281-4515-4c00-a106-463de1901724 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1373 microversion: 2.1 time: 0.196028 Jul 31 02:35:24.967278 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3730/7422] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:24 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1373 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:25.487534 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-e63ca4a5-0681-4614-9595-13b70bee2756 req-594e4058-8d0d-46d1-8edb-e808768f48c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0643e1-e6fb-47ba-85da-e6719dd4ac79", "name": "network-vif-unplugged", "status": "completed", "tag": "73fa1d00-3ba7-43e5-916a-6ee8b154d0a7"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:35:25.498727 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e63ca4a5-0681-4614-9595-13b70bee2756 req-594e4058-8d0d-46d1-8edb-e808768f48c0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:25.499256 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-e63ca4a5-0681-4614-9595-13b70bee2756 req-594e4058-8d0d-46d1-8edb-e808768f48c0 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:25.511612 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-e63ca4a5-0681-4614-9595-13b70bee2756 req-594e4058-8d0d-46d1-8edb-e808768f48c0 service nova] Creating event network-vif-unplugged:73fa1d00-3ba7-43e5-916a-6ee8b154d0a7 for instance bc0643e1-e6fb-47ba-85da-e6719dd4ac79 on n-h1-master-1 Jul 31 02:35:25.516728 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-e63ca4a5-0681-4614-9595-13b70bee2756 req-594e4058-8d0d-46d1-8edb-e808768f48c0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032975 Jul 31 02:35:25.517362 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3693/7423] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:35:25.988323 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-eaf2c0eb-f96a-4df7-a50d-15e076159c0b tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:25.989968 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-eaf2c0eb-f96a-4df7-a50d-15e076159c0b tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:25.998381 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eaf2c0eb-f96a-4df7-a50d-15e076159c0b tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:25.998939 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eaf2c0eb-f96a-4df7-a50d-15e076159c0b tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:25.999844 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eaf2c0eb-f96a-4df7-a50d-15e076159c0b tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:26.000388 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-eaf2c0eb-f96a-4df7-a50d-15e076159c0b tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:26.148563 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-eaf2c0eb-f96a-4df7-a50d-15e076159c0b tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:26.156772 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-eaf2c0eb-f96a-4df7-a50d-15e076159c0b tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1373 microversion: 2.1 time: 0.172426 Jul 31 02:35:26.157373 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3731/7424] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:25 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:27.180451 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-f4f88fc0-5b63-48df-b214-0f6792d79027 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:27.181161 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-f4f88fc0-5b63-48df-b214-0f6792d79027 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:27.187597 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4f88fc0-5b63-48df-b214-0f6792d79027 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:27.188073 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4f88fc0-5b63-48df-b214-0f6792d79027 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:27.188960 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4f88fc0-5b63-48df-b214-0f6792d79027 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:27.189368 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-f4f88fc0-5b63-48df-b214-0f6792d79027 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:27.346519 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-f4f88fc0-5b63-48df-b214-0f6792d79027 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:27.354804 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-f4f88fc0-5b63-48df-b214-0f6792d79027 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1373 microversion: 2.1 time: 0.179950 Jul 31 02:35:27.355393 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3694/7425] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:27 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:28.376900 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-e10ae187-fdd6-4043-8de0-4f6c2b1f5788 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:28.377523 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-e10ae187-fdd6-4043-8de0-4f6c2b1f5788 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:28.385120 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e10ae187-fdd6-4043-8de0-4f6c2b1f5788 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:28.385585 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e10ae187-fdd6-4043-8de0-4f6c2b1f5788 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:28.386398 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e10ae187-fdd6-4043-8de0-4f6c2b1f5788 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:28.386856 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-e10ae187-fdd6-4043-8de0-4f6c2b1f5788 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:28.520095 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-e10ae187-fdd6-4043-8de0-4f6c2b1f5788 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:28.527649 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-e10ae187-fdd6-4043-8de0-4f6c2b1f5788 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1373 microversion: 2.1 time: 0.154774 Jul 31 02:35:28.528216 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3732/7426] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:28 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:29.550404 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7ca292fe-bbb2-4cda-813b-e2af231353f7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:29.551076 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7ca292fe-bbb2-4cda-813b-e2af231353f7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:29.558780 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ca292fe-bbb2-4cda-813b-e2af231353f7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:29.559247 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ca292fe-bbb2-4cda-813b-e2af231353f7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:29.560077 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ca292fe-bbb2-4cda-813b-e2af231353f7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:29.560540 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7ca292fe-bbb2-4cda-813b-e2af231353f7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:29.716228 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7ca292fe-bbb2-4cda-813b-e2af231353f7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:29.724570 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7ca292fe-bbb2-4cda-813b-e2af231353f7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1373 microversion: 2.1 time: 0.178071 Jul 31 02:35:29.735994 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3695/7427] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:29 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1373 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:30.749890 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-44dfb1ae-cd1f-482e-b8e8-444210f5500c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:30.750704 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-44dfb1ae-cd1f-482e-b8e8-444210f5500c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:30.761113 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44dfb1ae-cd1f-482e-b8e8-444210f5500c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:30.761752 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44dfb1ae-cd1f-482e-b8e8-444210f5500c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:30.763582 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44dfb1ae-cd1f-482e-b8e8-444210f5500c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:30.764093 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-44dfb1ae-cd1f-482e-b8e8-444210f5500c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:30.909730 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-44dfb1ae-cd1f-482e-b8e8-444210f5500c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:30.919612 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-44dfb1ae-cd1f-482e-b8e8-444210f5500c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1373 microversion: 2.1 time: 0.174615 Jul 31 02:35:30.934192 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3733/7428] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:30 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1373 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:31.940891 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7f5ed240-d5da-49c2-8117-48496a4ebe9e tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:31.941778 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7f5ed240-d5da-49c2-8117-48496a4ebe9e tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:31.949733 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f5ed240-d5da-49c2-8117-48496a4ebe9e tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:31.950311 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f5ed240-d5da-49c2-8117-48496a4ebe9e tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:31.951224 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f5ed240-d5da-49c2-8117-48496a4ebe9e tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:31.951836 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7f5ed240-d5da-49c2-8117-48496a4ebe9e tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:32.092312 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7f5ed240-d5da-49c2-8117-48496a4ebe9e tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:32.099667 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7f5ed240-d5da-49c2-8117-48496a4ebe9e tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1373 microversion: 2.1 time: 0.162641 Jul 31 02:35:32.100231 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3696/7429] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:31 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:33.128297 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-75de2580-c37e-4705-b3a7-1e2c903f528c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:33.128843 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-75de2580-c37e-4705-b3a7-1e2c903f528c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:33.131507 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell0:SELECT=2 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:35:33.137805 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75de2580-c37e-4705-b3a7-1e2c903f528c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:33.138051 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75de2580-c37e-4705-b3a7-1e2c903f528c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:33.138843 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75de2580-c37e-4705-b3a7-1e2c903f528c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:33.139292 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-75de2580-c37e-4705-b3a7-1e2c903f528c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:33.276547 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-75de2580-c37e-4705-b3a7-1e2c903f528c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:33.284227 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-75de2580-c37e-4705-b3a7-1e2c903f528c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1373 microversion: 2.1 time: 0.160170 Jul 31 02:35:33.284819 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3734/7430] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:33 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:34.305722 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-4ae9e330-a5bf-4b5c-af9f-489799b8a276 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:34.306371 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-4ae9e330-a5bf-4b5c-af9f-489799b8a276 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:34.308413 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:35:34.309080 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell0:SELECT=6 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:35:34.315630 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ae9e330-a5bf-4b5c-af9f-489799b8a276 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:34.316090 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ae9e330-a5bf-4b5c-af9f-489799b8a276 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:34.316854 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ae9e330-a5bf-4b5c-af9f-489799b8a276 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:34.317297 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-4ae9e330-a5bf-4b5c-af9f-489799b8a276 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:34.449534 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-4ae9e330-a5bf-4b5c-af9f-489799b8a276 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:34.456926 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-4ae9e330-a5bf-4b5c-af9f-489799b8a276 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1373 microversion: 2.1 time: 0.155125 Jul 31 02:35:34.457484 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3697/7431] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:34 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:35.288785 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-5e5f1ef2-e6a0-4551-9e1e-5f90186ffeaf req-d5bf20d4-b1d5-47dd-b855-dbcc91610117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "969b8f08-f4d6-46e3-baca-baff12f670b7", "tag": "bc905c17-94c4-42ed-8819-7856a9ee2295"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:35:35.298571 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5e5f1ef2-e6a0-4551-9e1e-5f90186ffeaf req-d5bf20d4-b1d5-47dd-b855-dbcc91610117 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:35.299680 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-5e5f1ef2-e6a0-4551-9e1e-5f90186ffeaf req-d5bf20d4-b1d5-47dd-b855-dbcc91610117 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:35.311377 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-5e5f1ef2-e6a0-4551-9e1e-5f90186ffeaf req-d5bf20d4-b1d5-47dd-b855-dbcc91610117 service nova] Creating event network-changed:bc905c17-94c4-42ed-8819-7856a9ee2295 for instance 969b8f08-f4d6-46e3-baca-baff12f670b7 on n-h2-master-1 Jul 31 02:35:35.316328 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-5e5f1ef2-e6a0-4551-9e1e-5f90186ffeaf req-d5bf20d4-b1d5-47dd-b855-dbcc91610117 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096766 Jul 31 02:35:35.316936 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3735/7432] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:35:35.477865 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-c1eff7b6-d538-4d45-8b57-0566ef9cab76 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:35.478591 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-c1eff7b6-d538-4d45-8b57-0566ef9cab76 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:35.485381 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1eff7b6-d538-4d45-8b57-0566ef9cab76 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:35.485928 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1eff7b6-d538-4d45-8b57-0566ef9cab76 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:35.486794 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1eff7b6-d538-4d45-8b57-0566ef9cab76 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:35.487324 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-c1eff7b6-d538-4d45-8b57-0566ef9cab76 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:35.628848 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-c1eff7b6-d538-4d45-8b57-0566ef9cab76 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:35.636475 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-c1eff7b6-d538-4d45-8b57-0566ef9cab76 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1373 microversion: 2.1 time: 0.162584 Jul 31 02:35:35.637371 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3698/7433] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:35 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:36.659117 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-6e8f1abe-f627-41ce-a6ce-3b5216414254 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:36.659872 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-6e8f1abe-f627-41ce-a6ce-3b5216414254 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:36.666197 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e8f1abe-f627-41ce-a6ce-3b5216414254 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:36.666661 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e8f1abe-f627-41ce-a6ce-3b5216414254 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:36.667489 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e8f1abe-f627-41ce-a6ce-3b5216414254 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:36.667924 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-6e8f1abe-f627-41ce-a6ce-3b5216414254 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:36.811916 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-6e8f1abe-f627-41ce-a6ce-3b5216414254 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:36.820001 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-6e8f1abe-f627-41ce-a6ce-3b5216414254 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1373 microversion: 2.1 time: 0.166024 Jul 31 02:35:36.820592 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3736/7434] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:36 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:37.841057 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-49a6a72c-3f49-47f6-af9c-dc0d09e9c3e7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:37.841628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-49a6a72c-3f49-47f6-af9c-dc0d09e9c3e7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:37.848608 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49a6a72c-3f49-47f6-af9c-dc0d09e9c3e7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:37.849084 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49a6a72c-3f49-47f6-af9c-dc0d09e9c3e7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:37.849900 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49a6a72c-3f49-47f6-af9c-dc0d09e9c3e7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:37.850865 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-49a6a72c-3f49-47f6-af9c-dc0d09e9c3e7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:37.982019 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-49a6a72c-3f49-47f6-af9c-dc0d09e9c3e7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:37.989746 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-49a6a72c-3f49-47f6-af9c-dc0d09e9c3e7 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1373 microversion: 2.1 time: 0.152769 Jul 31 02:35:37.990303 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3699/7435] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:37 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:39.011863 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-de73e512-22bc-48ee-99ed-58e4312afdf8 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:39.012488 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-de73e512-22bc-48ee-99ed-58e4312afdf8 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:39.019211 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-de73e512-22bc-48ee-99ed-58e4312afdf8 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:39.019693 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-de73e512-22bc-48ee-99ed-58e4312afdf8 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:39.020458 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-de73e512-22bc-48ee-99ed-58e4312afdf8 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:39.020897 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-de73e512-22bc-48ee-99ed-58e4312afdf8 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:39.156180 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-de73e512-22bc-48ee-99ed-58e4312afdf8 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:39.163594 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-de73e512-22bc-48ee-99ed-58e4312afdf8 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1373 microversion: 2.1 time: 0.156239 Jul 31 02:35:39.164165 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3737/7436] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:39 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:40.185004 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-8b22f03c-6e8e-4626-b581-fee28df83d31 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:40.185670 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-8b22f03c-6e8e-4626-b581-fee28df83d31 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:40.192653 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b22f03c-6e8e-4626-b581-fee28df83d31 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:40.193126 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b22f03c-6e8e-4626-b581-fee28df83d31 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:40.194414 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b22f03c-6e8e-4626-b581-fee28df83d31 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:40.194900 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-8b22f03c-6e8e-4626-b581-fee28df83d31 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:40.331885 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-8b22f03c-6e8e-4626-b581-fee28df83d31 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:40.340283 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-8b22f03c-6e8e-4626-b581-fee28df83d31 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1373 microversion: 2.1 time: 0.159566 Jul 31 02:35:40.340867 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3700/7437] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:40 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 02:35:40.430874 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-4e58c5fe-55be-4992-a8a7-a0ae0d01c96d req-64077017-c26a-4ecb-affb-2166defa8fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969b8f08-f4d6-46e3-baca-baff12f670b7", "name": "network-vif-plugged", "status": "completed", "tag": "bc905c17-94c4-42ed-8819-7856a9ee2295"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:35:40.442267 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4e58c5fe-55be-4992-a8a7-a0ae0d01c96d req-64077017-c26a-4ecb-affb-2166defa8fc3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:40.442708 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4e58c5fe-55be-4992-a8a7-a0ae0d01c96d req-64077017-c26a-4ecb-affb-2166defa8fc3 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:40.455029 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-4e58c5fe-55be-4992-a8a7-a0ae0d01c96d req-64077017-c26a-4ecb-affb-2166defa8fc3 service nova] Creating event network-vif-plugged:bc905c17-94c4-42ed-8819-7856a9ee2295 for instance 969b8f08-f4d6-46e3-baca-baff12f670b7 on n-h2-master-1 Jul 31 02:35:40.460027 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-4e58c5fe-55be-4992-a8a7-a0ae0d01c96d req-64077017-c26a-4ecb-affb-2166defa8fc3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033478 Jul 31 02:35:40.460632 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3738/7438] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:35:41.361107 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-fdffacab-528e-48a4-9186-681c21f9a091 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:41.361735 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-fdffacab-528e-48a4-9186-681c21f9a091 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:41.368708 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdffacab-528e-48a4-9186-681c21f9a091 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:41.369175 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdffacab-528e-48a4-9186-681c21f9a091 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:41.369983 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdffacab-528e-48a4-9186-681c21f9a091 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:41.370434 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-fdffacab-528e-48a4-9186-681c21f9a091 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:41.499575 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-fdffacab-528e-48a4-9186-681c21f9a091 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:41.507821 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-fdffacab-528e-48a4-9186-681c21f9a091 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1373 microversion: 2.1 time: 0.150618 Jul 31 02:35:41.508397 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3701/7439] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:41 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1373 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:42.529958 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-43e32bac-2362-4c0c-97bd-f4e37c7d3012 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:42.530670 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-43e32bac-2362-4c0c-97bd-f4e37c7d3012 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:42.536989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43e32bac-2362-4c0c-97bd-f4e37c7d3012 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:42.537391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43e32bac-2362-4c0c-97bd-f4e37c7d3012 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:42.538690 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43e32bac-2362-4c0c-97bd-f4e37c7d3012 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:42.539136 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-43e32bac-2362-4c0c-97bd-f4e37c7d3012 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:42.675168 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-43e32bac-2362-4c0c-97bd-f4e37c7d3012 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:42.682668 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-43e32bac-2362-4c0c-97bd-f4e37c7d3012 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1558 microversion: 2.1 time: 0.157931 Jul 31 02:35:42.683243 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3739/7440] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:42 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:42.702975 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-62f0e6ea-e149-4079-9658-7b22e7593a3a tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:35:42.703641 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-62f0e6ea-e149-4079-9658-7b22e7593a3a tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:35:42.711067 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62f0e6ea-e149-4079-9658-7b22e7593a3a tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:42.711564 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62f0e6ea-e149-4079-9658-7b22e7593a3a tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:42.712347 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62f0e6ea-e149-4079-9658-7b22e7593a3a tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:42.712804 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-62f0e6ea-e149-4079-9658-7b22e7593a3a tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:42.845628 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-62f0e6ea-e149-4079-9658-7b22e7593a3a tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:35:42.853777 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-62f0e6ea-e149-4079-9658-7b22e7593a3a tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1558 microversion: 2.1 time: 0.154738 Jul 31 02:35:42.854363 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3702/7441] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:35:42 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:35:44.451768 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f886fe2a-3d38-40fd-b616-4394c6a7ad0e req-f0699e64-0c6c-4459-a0b9-e8d39808bf9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "969b8f08-f4d6-46e3-baca-baff12f670b7", "tag": "bc905c17-94c4-42ed-8819-7856a9ee2295"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:35:44.457821 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=27 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:35:44.464873 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f886fe2a-3d38-40fd-b616-4394c6a7ad0e req-f0699e64-0c6c-4459-a0b9-e8d39808bf9e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:35:44.465257 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f886fe2a-3d38-40fd-b616-4394c6a7ad0e req-f0699e64-0c6c-4459-a0b9-e8d39808bf9e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:35:44.477022 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f886fe2a-3d38-40fd-b616-4394c6a7ad0e req-f0699e64-0c6c-4459-a0b9-e8d39808bf9e service nova] Creating event network-changed:bc905c17-94c4-42ed-8819-7856a9ee2295 for instance 969b8f08-f4d6-46e3-baca-baff12f670b7 on n-h2-master-1 Jul 31 02:35:44.482194 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f886fe2a-3d38-40fd-b616-4394c6a7ad0e req-f0699e64-0c6c-4459-a0b9-e8d39808bf9e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034101 Jul 31 02:35:44.482902 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3740/7442] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 02:35:59.149898 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:35:59.150458 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 02:35:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:35:59.418338 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:35:59.418802 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 02:35:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:35:59.429184 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:35:59.429317 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 02:35:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:37:11.534061 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:37:11.534829 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=64 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:37:11.539845 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-783d4a32-755d-4cc9-b861-21246e1e9fa0 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-732565557"}} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:37:11.542156 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-783d4a32-755d-4cc9-b861-21246e1e9fa0 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:37:11.549396 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-783d4a32-755d-4cc9-b861-21246e1e9fa0 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:11.549870 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-783d4a32-755d-4cc9-b861-21246e1e9fa0 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:11.550653 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-783d4a32-755d-4cc9-b861-21246e1e9fa0 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:11.551139 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-783d4a32-755d-4cc9-b861-21246e1e9fa0 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:11.918478 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-783d4a32-755d-4cc9-b861-21246e1e9fa0 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "POST /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7/action" status: 202 len: 0 microversion: 2.1 time: 0.386152 Jul 31 02:37:11.919118 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3703/7443] 10.222.0.45 () {60 vars in 1278 bytes} [Sun Jul 31 02:37:11 2022] POST /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 31 02:37:16.829579 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_api:SELECT=1 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:37:16.830372 n-d-master-1 devstack@n-api.service[119475]: DEBUG dbcounter [-] [119475] Writing DB stats nova_cell1:SELECT=54 {{(pid=119475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:37:16.835856 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-f462222f-5e0a-4b8f-a67d-15b76d310a16 req-8cd8e9c3-f50c-4607-b7cc-e25012e3723e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969b8f08-f4d6-46e3-baca-baff12f670b7", "name": "network-vif-plugged", "status": "completed", "tag": "bc905c17-94c4-42ed-8819-7856a9ee2295"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:37:16.856260 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f462222f-5e0a-4b8f-a67d-15b76d310a16 req-8cd8e9c3-f50c-4607-b7cc-e25012e3723e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:16.856724 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-f462222f-5e0a-4b8f-a67d-15b76d310a16 req-8cd8e9c3-f50c-4607-b7cc-e25012e3723e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:16.870472 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-f462222f-5e0a-4b8f-a67d-15b76d310a16 req-8cd8e9c3-f50c-4607-b7cc-e25012e3723e service nova] Creating event network-vif-plugged:bc905c17-94c4-42ed-8819-7856a9ee2295 for instance 969b8f08-f4d6-46e3-baca-baff12f670b7 on n-h2-master-1 Jul 31 02:37:16.875673 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-f462222f-5e0a-4b8f-a67d-15b76d310a16 req-8cd8e9c3-f50c-4607-b7cc-e25012e3723e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048247 Jul 31 02:37:16.876563 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3741/7444] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:37:25.509816 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_api:SELECT=2 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:37:25.510805 n-d-master-1 devstack@n-api.service[119474]: DEBUG dbcounter [-] [119474] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 02:37:25.514413 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-2dbc12b8-6f04-49ee-bde2-44b9c1d96302 req-ee9a66a3-1ace-4dfa-a01e-5f7bcf738def service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "969b8f08-f4d6-46e3-baca-baff12f670b7", "tag": "bc905c17-94c4-42ed-8819-7856a9ee2295"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:37:25.515845 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-23faf02c-01da-4aeb-979e-162ee3b34d0c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:37:25.516458 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-23faf02c-01da-4aeb-979e-162ee3b34d0c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:37:25.524163 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23faf02c-01da-4aeb-979e-162ee3b34d0c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:25.524908 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23faf02c-01da-4aeb-979e-162ee3b34d0c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:25.525935 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23faf02c-01da-4aeb-979e-162ee3b34d0c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:25.526391 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-23faf02c-01da-4aeb-979e-162ee3b34d0c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:25.526874 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2dbc12b8-6f04-49ee-bde2-44b9c1d96302 req-ee9a66a3-1ace-4dfa-a01e-5f7bcf738def service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:25.527357 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-2dbc12b8-6f04-49ee-bde2-44b9c1d96302 req-ee9a66a3-1ace-4dfa-a01e-5f7bcf738def service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:25.539607 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-2dbc12b8-6f04-49ee-bde2-44b9c1d96302 req-ee9a66a3-1ace-4dfa-a01e-5f7bcf738def service nova] Creating event network-changed:bc905c17-94c4-42ed-8819-7856a9ee2295 for instance 969b8f08-f4d6-46e3-baca-baff12f670b7 on n-h2-master-1 Jul 31 02:37:25.545022 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-2dbc12b8-6f04-49ee-bde2-44b9c1d96302 req-ee9a66a3-1ace-4dfa-a01e-5f7bcf738def service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035002 Jul 31 02:37:25.545812 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3742/7445] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:37:25.558547 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-23faf02c-01da-4aeb-979e-162ee3b34d0c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:37:25.647872 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-23faf02c-01da-4aeb-979e-162ee3b34d0c tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "DELETE /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 204 len: 0 microversion: 2.1 time: 0.140493 Jul 31 02:37:25.651431 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3704/7446] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:37:25 2022] DELETE /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:37:25.659621 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-4f8eddbb-0939-4513-8f9b-1db1c484de5e tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:37:25.660715 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-4f8eddbb-0939-4513-8f9b-1db1c484de5e tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:37:25.667618 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f8eddbb-0939-4513-8f9b-1db1c484de5e tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:25.668083 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f8eddbb-0939-4513-8f9b-1db1c484de5e tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:25.668947 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f8eddbb-0939-4513-8f9b-1db1c484de5e tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:25.669391 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-4f8eddbb-0939-4513-8f9b-1db1c484de5e tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:26.173533 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-4f8eddbb-0939-4513-8f9b-1db1c484de5e tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:37:26.181195 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-4f8eddbb-0939-4513-8f9b-1db1c484de5e tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1682 microversion: 2.1 time: 0.526333 Jul 31 02:37:26.181774 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3743/7447] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:37:25 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1682 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:37:26.780975 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-f102d791-2eaa-4181-8d73-b8acc9cadb30 req-ccac0dcf-dfaf-402d-9b0d-9324a10519ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969b8f08-f4d6-46e3-baca-baff12f670b7", "name": "network-vif-unplugged", "status": "completed", "tag": "bc905c17-94c4-42ed-8819-7856a9ee2295"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:37:26.791977 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f102d791-2eaa-4181-8d73-b8acc9cadb30 req-ccac0dcf-dfaf-402d-9b0d-9324a10519ed service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:26.792442 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-f102d791-2eaa-4181-8d73-b8acc9cadb30 req-ccac0dcf-dfaf-402d-9b0d-9324a10519ed service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:26.804296 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-f102d791-2eaa-4181-8d73-b8acc9cadb30 req-ccac0dcf-dfaf-402d-9b0d-9324a10519ed service nova] Creating event network-vif-unplugged:bc905c17-94c4-42ed-8819-7856a9ee2295 for instance 969b8f08-f4d6-46e3-baca-baff12f670b7 on n-h2-master-1 Jul 31 02:37:26.809156 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-f102d791-2eaa-4181-8d73-b8acc9cadb30 req-ccac0dcf-dfaf-402d-9b0d-9324a10519ed service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032338 Jul 31 02:37:26.809914 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3705/7448] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:37:27.202194 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-c9e11ee5-022b-479f-8df1-0e14d174e1ff tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:37:27.202910 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-c9e11ee5-022b-479f-8df1-0e14d174e1ff tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:37:27.210111 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9e11ee5-022b-479f-8df1-0e14d174e1ff tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:27.210571 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9e11ee5-022b-479f-8df1-0e14d174e1ff tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:27.211371 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9e11ee5-022b-479f-8df1-0e14d174e1ff tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:27.211823 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-c9e11ee5-022b-479f-8df1-0e14d174e1ff tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:27.447741 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-c9e11ee5-022b-479f-8df1-0e14d174e1ff tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:37:27.455651 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-c9e11ee5-022b-479f-8df1-0e14d174e1ff tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 200 len: 1682 microversion: 2.1 time: 0.257318 Jul 31 02:37:27.456971 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3744/7449] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:37:27 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 1682 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:37:27.802955 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [req-fa6e3b5c-e995-4e4c-8ac5-402f98f07bfb req-5990743b-c945-4811-8ba2-63687667c9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969b8f08-f4d6-46e3-baca-baff12f670b7", "name": "network-vif-deleted", "tag": "bc905c17-94c4-42ed-8819-7856a9ee2295"}]} {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:37:27.812833 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fa6e3b5c-e995-4e4c-8ac5-402f98f07bfb req-5990743b-c945-4811-8ba2-63687667c9d6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:27.813298 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [req-fa6e3b5c-e995-4e4c-8ac5-402f98f07bfb req-5990743b-c945-4811-8ba2-63687667c9d6 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:27.824371 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.compute.server_external_events [req-fa6e3b5c-e995-4e4c-8ac5-402f98f07bfb req-5990743b-c945-4811-8ba2-63687667c9d6 service nova] Creating event network-vif-deleted:bc905c17-94c4-42ed-8819-7856a9ee2295 for instance 969b8f08-f4d6-46e3-baca-baff12f670b7 on n-h2-master-1 Jul 31 02:37:27.829584 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [req-fa6e3b5c-e995-4e4c-8ac5-402f98f07bfb req-5990743b-c945-4811-8ba2-63687667c9d6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031520 Jul 31 02:37:27.829939 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3706/7450] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:37:28.477282 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5abbf50d-5d32-4ab6-8b04-0f6406dda178 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:37:28.477811 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-5abbf50d-5d32-4ab6-8b04-0f6406dda178 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: 969b8f08-f4d6-46e3-baca-baff12f670b7] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:37:28.484745 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5abbf50d-5d32-4ab6-8b04-0f6406dda178 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:28.485206 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5abbf50d-5d32-4ab6-8b04-0f6406dda178 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:28.485989 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5abbf50d-5d32-4ab6-8b04-0f6406dda178 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:28.486427 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-5abbf50d-5d32-4ab6-8b04-0f6406dda178 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:28.499980 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-5abbf50d-5d32-4ab6-8b04-0f6406dda178 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] HTTP exception thrown: Instance 969b8f08-f4d6-46e3-baca-baff12f670b7 could not be found. Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5abbf50d-5d32-4ab6-8b04-0f6406dda178 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Request method failure captured: Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 HTTP/1.1 Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5enU0nydfiZ50PWWvwLqs3dK1fnguQ8LWSjHy0wiNG6zUKMfz_-PFE_0g-_nZDvmXGnKq1rt9CXrX9TnVcatSlkkuqlKg6Fx1uKq7USv3nDI-Cn-LA_86E1VLokuZksXzAQcyjc2JK2QmbBuyzu3VYNf8bnE3gDSyaafrS4MmxqpuWU Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 55940c7e67524086ad0bf355779767d2 Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestSnapshotPattern-821696154 Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/55940c7e67524086ad0bf355779767d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/55940c7e67524086ad0bf355779767d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/55940c7e67524086ad0bf355779767d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_55940c7e67524086ad0bf355779767d2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestSnapshotPattern-821696154 Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 55940c7e67524086ad0bf355779767d2 Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestSnapshotPattern-821696154 Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestSnapshotPattern-821696154-project Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 0ec2a4e627f14aa7b4bc5c02d78bdf70 Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestSnapshotPattern-821696154-project Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: exception: Instance 969b8f08-f4d6-46e3-baca-baff12f670b7 could not be found. Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': '969b8f08-f4d6-46e3-baca-baff12f670b7'} Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 969b8f08-f4d6-46e3-baca-baff12f670b7 could not be found. Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 969b8f08-f4d6-46e3-baca-baff12f670b7 could not be found. Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:37:28.501602 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:37:28.506530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:37:28.506530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:37:28.506530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:37:28.506530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:37:28.506530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:37:28.506530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 969b8f08-f4d6-46e3-baca-baff12f670b7 could not be found. Jul 31 02:37:28.506530 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:37:28.506530 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-5abbf50d-5d32-4ab6-8b04-0f6406dda178 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Returning 404 to user: Instance 969b8f08-f4d6-46e3-baca-baff12f670b7 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:37:28.506530 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-5abbf50d-5d32-4ab6-8b04-0f6406dda178 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7" status: 404 len: 111 microversion: 2.1 time: 0.030037 Jul 31 02:37:28.506530 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3745/7451] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:37:28 2022] GET /compute/v2.1/servers/969b8f08-f4d6-46e3-baca-baff12f670b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:37:29.848492 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2b1f3723-f6ee-432a-8ec5-40ff8ab6d812 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:37:29.849099 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2b1f3723-f6ee-432a-8ec5-40ff8ab6d812 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:37:29.851139 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-4bedc99b-66ee-4beb-b42c-d79d11888345 req-e5ebfbda-6ea6-42d2-a8f8-d17c9788865e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc0643e1-e6fb-47ba-85da-e6719dd4ac79", "tag": "73fa1d00-3ba7-43e5-916a-6ee8b154d0a7"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:37:29.856640 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b1f3723-f6ee-432a-8ec5-40ff8ab6d812 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:29.857116 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b1f3723-f6ee-432a-8ec5-40ff8ab6d812 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:29.858096 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b1f3723-f6ee-432a-8ec5-40ff8ab6d812 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:29.858555 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-2b1f3723-f6ee-432a-8ec5-40ff8ab6d812 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:29.863954 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4bedc99b-66ee-4beb-b42c-d79d11888345 req-e5ebfbda-6ea6-42d2-a8f8-d17c9788865e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:29.864534 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-4bedc99b-66ee-4beb-b42c-d79d11888345 req-e5ebfbda-6ea6-42d2-a8f8-d17c9788865e service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:29.878880 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-4bedc99b-66ee-4beb-b42c-d79d11888345 req-e5ebfbda-6ea6-42d2-a8f8-d17c9788865e service nova] Creating event network-changed:73fa1d00-3ba7-43e5-916a-6ee8b154d0a7 for instance bc0643e1-e6fb-47ba-85da-e6719dd4ac79 on n-h1-master-1 Jul 31 02:37:29.885619 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-4bedc99b-66ee-4beb-b42c-d79d11888345 req-e5ebfbda-6ea6-42d2-a8f8-d17c9788865e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038517 Jul 31 02:37:29.886829 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3746/7452] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:37:29.887226 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-2b1f3723-f6ee-432a-8ec5-40ff8ab6d812 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Going to try to terminate instance {{(pid=119474) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 02:37:29.972655 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2b1f3723-f6ee-432a-8ec5-40ff8ab6d812 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79" status: 204 len: 0 microversion: 2.1 time: 0.128086 Jul 31 02:37:29.977102 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3707/7453] 10.222.0.45 () {58 vars in 1239 bytes} [Sun Jul 31 02:37:29 2022] DELETE /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 02:37:29.983390 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-1f685663-2823-4f24-b4c5-c7b20e7f1a69 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:37:29.984229 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-1f685663-2823-4f24-b4c5-c7b20e7f1a69 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:37:29.994110 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f685663-2823-4f24-b4c5-c7b20e7f1a69 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:29.994714 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f685663-2823-4f24-b4c5-c7b20e7f1a69 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:29.995608 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f685663-2823-4f24-b4c5-c7b20e7f1a69 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:29.996134 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-1f685663-2823-4f24-b4c5-c7b20e7f1a69 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:30.173650 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.policy [None req-1f685663-2823-4f24-b4c5-c7b20e7f1a69 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119475) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:37:30.181968 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-1f685663-2823-4f24-b4c5-c7b20e7f1a69 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79" status: 200 len: 1682 microversion: 2.1 time: 0.203499 Jul 31 02:37:30.182608 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3747/7454] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:37:29 2022] GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 => generated 1682 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:37:31.205107 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-3c66ce21-b191-4b8b-865a-b9385f39d188 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:37:31.205819 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-3c66ce21-b191-4b8b-865a-b9385f39d188 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:37:31.212860 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c66ce21-b191-4b8b-865a-b9385f39d188 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:31.213355 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c66ce21-b191-4b8b-865a-b9385f39d188 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:31.214137 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c66ce21-b191-4b8b-865a-b9385f39d188 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:31.214592 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-3c66ce21-b191-4b8b-865a-b9385f39d188 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:31.413891 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-3c66ce21-b191-4b8b-865a-b9385f39d188 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:37:31.421624 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-3c66ce21-b191-4b8b-865a-b9385f39d188 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79" status: 200 len: 1682 microversion: 2.1 time: 0.221823 Jul 31 02:37:31.422187 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3708/7455] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:37:31 2022] GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 => generated 1682 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:37:32.080408 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [req-764e4e80-f9f5-4c84-80bf-a50245d21413 req-636cceb4-75e2-4321-9904-6b1b1bea1887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0643e1-e6fb-47ba-85da-e6719dd4ac79", "name": "network-vif-deleted", "tag": "73fa1d00-3ba7-43e5-916a-6ee8b154d0a7"}]} {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 02:37:32.092408 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-764e4e80-f9f5-4c84-80bf-a50245d21413 req-636cceb4-75e2-4321-9904-6b1b1bea1887 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:32.092855 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [req-764e4e80-f9f5-4c84-80bf-a50245d21413 req-636cceb4-75e2-4321-9904-6b1b1bea1887 service nova] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:32.105569 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.compute.server_external_events [req-764e4e80-f9f5-4c84-80bf-a50245d21413 req-636cceb4-75e2-4321-9904-6b1b1bea1887 service nova] Creating event network-vif-deleted:73fa1d00-3ba7-43e5-916a-6ee8b154d0a7 for instance bc0643e1-e6fb-47ba-85da-e6719dd4ac79 on n-h1-master-1 Jul 31 02:37:32.111139 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [req-764e4e80-f9f5-4c84-80bf-a50245d21413 req-636cceb4-75e2-4321-9904-6b1b1bea1887 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034418 Jul 31 02:37:32.112303 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3748/7456] 10.222.0.45 () {64 vars in 1317 bytes} [Sun Jul 31 02:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 02:37:32.443837 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-7d5bf530-68fc-4d6f-ac8c-f677873453d9 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:37:32.445184 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.compute.api [None req-7d5bf530-68fc-4d6f-ac8c-f677873453d9 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119474) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:37:32.453591 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d5bf530-68fc-4d6f-ac8c-f677873453d9 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:32.454163 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d5bf530-68fc-4d6f-ac8c-f677873453d9 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:32.455113 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d5bf530-68fc-4d6f-ac8c-f677873453d9 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:32.455691 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d5bf530-68fc-4d6f-ac8c-f677873453d9 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:32.491882 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d5bf530-68fc-4d6f-ac8c-f677873453d9 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:32.492416 n-d-master-1 devstack@n-api.service[119474]: DEBUG oslo_concurrency.lockutils [None req-7d5bf530-68fc-4d6f-ac8c-f677873453d9 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:32.492943 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.objects.instance [None req-7d5bf530-68fc-4d6f-ac8c-f677873453d9 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lazy-loading 'fault' on Instance uuid bc0643e1-e6fb-47ba-85da-e6719dd4ac79 {{(pid=119474) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 02:37:32.535657 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.policy [None req-7d5bf530-68fc-4d6f-ac8c-f677873453d9 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ec2a4e627f14aa7b4bc5c02d78bdf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55940c7e67524086ad0bf355779767d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119474) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 02:37:32.543798 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-7d5bf530-68fc-4d6f-ac8c-f677873453d9 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79" status: 200 len: 1338 microversion: 2.1 time: 0.105552 Jul 31 02:37:32.544377 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3709/7457] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:37:32 2022] GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 02:37:33.566692 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7218ef9-fa6f-4430-bd14-b0c028314cfa tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '>' {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:37:33.567771 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.compute.api [None req-a7218ef9-fa6f-4430-bd14-b0c028314cfa tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] [instance: bc0643e1-e6fb-47ba-85da-e6719dd4ac79] Fetching instance by UUID {{(pid=119475) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 02:37:33.574755 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7218ef9-fa6f-4430-bd14-b0c028314cfa tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:33.575225 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7218ef9-fa6f-4430-bd14-b0c028314cfa tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:33.576029 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7218ef9-fa6f-4430-bd14-b0c028314cfa tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 02:37:33.576481 n-d-master-1 devstack@n-api.service[119475]: DEBUG oslo_concurrency.lockutils [None req-a7218ef9-fa6f-4430-bd14-b0c028314cfa tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Lock "b79bbab3-22fe-4aca-b591-999750c84479" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 02:37:33.590185 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.wsgi [None req-a7218ef9-fa6f-4430-bd14-b0c028314cfa tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] HTTP exception thrown: Instance bc0643e1-e6fb-47ba-85da-e6719dd4ac79 could not be found. Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7218ef9-fa6f-4430-bd14-b0c028314cfa tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Request method failure captured: Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: request: GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 HTTP/1.1 Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: Accept: application/json Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: Accept-Encoding: identity Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: Connection: close Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: Content-Length: 0 Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: Content-Type: application/json Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: Host: 10.222.0.45 Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: Openstack-System-Scope: None Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: User-Agent: python-urllib3/1.26.10 Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-Auth-Token: gAAAAABi5enU0nydfiZ50PWWvwLqs3dK1fnguQ8LWSjHy0wiNG6zUKMfz_-PFE_0g-_nZDvmXGnKq1rt9CXrX9TnVcatSlkkuqlKg6Fx1uKq7USv3nDI-Cn-LA_86E1VLokuZksXzAQcyjc2JK2QmbBuyzu3VYNf8bnE3gDSyaafrS4MmxqpuWU Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Id: None Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-Domain-Name: None Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-Identity-Status: Confirmed Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-Is-Admin-Project: True Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Id: default Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-Project-Domain-Name: Default Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-Project-Id: 55940c7e67524086ad0bf355779767d2 Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-Project-Name: tempest-TestSnapshotPattern-821696154 Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-Role: member,reader Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-Roles: member,reader Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/55940c7e67524086ad0bf355779767d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/55940c7e67524086ad0bf355779767d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/55940c7e67524086ad0bf355779767d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_55940c7e67524086ad0bf355779767d2", "adminURL": "http://10.222.0.45:8080"}]}] Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-Tenant: tempest-TestSnapshotPattern-821696154 Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Id: 55940c7e67524086ad0bf355779767d2 Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-Tenant-Name: tempest-TestSnapshotPattern-821696154 Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-User: tempest-TestSnapshotPattern-821696154-project Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Id: default Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-User-Domain-Name: Default Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-User-Id: 0ec2a4e627f14aa7b4bc5c02d78bdf70 Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: X-User-Name: tempest-TestSnapshotPattern-821696154-project Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: method: > Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: exception: Instance bc0643e1-e6fb-47ba-85da-e6719dd4ac79 could not be found. Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: action_args: {'id': 'bc0643e1-e6fb-47ba-85da-e6719dd4ac79'} Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: {{(pid=119475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc0643e1-e6fb-47ba-85da-e6719dd4ac79 could not be found. Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc0643e1-e6fb-47ba-85da-e6719dd4ac79 could not be found. Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 02:37:33.591821 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:37:33.596505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 02:37:33.596505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 02:37:33.596505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 02:37:33.596505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 02:37:33.596505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 02:37:33.596505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc0643e1-e6fb-47ba-85da-e6719dd4ac79 could not be found. Jul 31 02:37:33.596505 n-d-master-1 devstack@n-api.service[119475]: ERROR nova.api.openstack.wsgi Jul 31 02:37:33.596505 n-d-master-1 devstack@n-api.service[119475]: DEBUG nova.api.openstack.wsgi [None req-a7218ef9-fa6f-4430-bd14-b0c028314cfa tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Returning 404 to user: Instance bc0643e1-e6fb-47ba-85da-e6719dd4ac79 could not be found. {{(pid=119475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 02:37:33.596505 n-d-master-1 devstack@n-api.service[119475]: INFO nova.api.openstack.requestlog [None req-a7218ef9-fa6f-4430-bd14-b0c028314cfa tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79" status: 404 len: 111 microversion: 2.1 time: 0.030899 Jul 31 02:37:33.596505 n-d-master-1 devstack@n-api.service[119475]: [pid: 119475|app: 0|req: 3749/7458] 10.222.0.45 () {58 vars in 1236 bytes} [Sun Jul 31 02:37:33 2022] GET /compute/v2.1/servers/bc0643e1-e6fb-47ba-85da-e6719dd4ac79 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 02:37:33.761657 n-d-master-1 devstack@n-api.service[119474]: DEBUG nova.api.openstack.wsgi [None req-2c3b0e17-9ced-493e-b247-d9457d760d47 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] Calling method '.version_select at 0x7fede4047e50>' {{(pid=119474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 02:37:33.790069 n-d-master-1 devstack@n-api.service[119474]: INFO nova.api.openstack.requestlog [None req-2c3b0e17-9ced-493e-b247-d9457d760d47 tempest-TestSnapshotPattern-821696154 tempest-TestSnapshotPattern-821696154-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-875961163" status: 202 len: 0 microversion: 2.1 time: 0.033003 Jul 31 02:37:33.790642 n-d-master-1 devstack@n-api.service[119474]: [pid: 119474|app: 0|req: 3710/7459] 10.222.0.45 () {58 vars in 1254 bytes} [Sun Jul 31 02:37:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-875961163 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 02:39:19.426324 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:39:19.426937 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 02:39:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:39:19.437964 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:39:19.438093 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 02:39:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:39:57.029073 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:39:57.029772 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 02:39:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:40:59.169182 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:40:59.169894 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 02:40:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:42:39.161291 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:42:39.161887 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 02:42:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:42:39.435026 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:42:39.435571 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 02:42:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:42:39.446096 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:42:39.446224 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 02:42:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:43:04.837810 n-d-master-1 devstack@n-api.service[119475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:43:04.838482 n-d-master-1 devstack@n-api.service[119475]: Sun Jul 31 02:43:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:43:17.037174 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:43:17.037778 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 02:43:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 02:44:19.177792 n-d-master-1 devstack@n-api.service[119474]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 02:44:19.178528 n-d-master-1 devstack@n-api.service[119474]: Sun Jul 31 02:44:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!